-- Logs begin at Sun 2022-08-28 18:08:09 UTC, end at Sun 2022-08-28 20:36:20 UTC. -- Aug 28 18:35:12.586252 n-d-854118-7 systemd[1]: Starting Devstack devstack@keystone.service... Aug 28 18:35:12.593771 n-d-854118-7 devstack@keystone.service[88366]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 28 18:35:12 2022] *** Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: nodename: n-d-854118-7 Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: machine: x86_64 Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: clock source: unix Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: pcre jit disabled Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: detected number of CPU cores: 4 Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: current working directory: / Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: detected binary path: /usr/bin/uwsgi-core Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: your processes number limit is 47680 Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: your memory page size is 4096 bytes Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: detected max file descriptor number: 2048 Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: lock engine: pthread robust mutexes Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: thunder lock: enabled Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 28 18:35:12.598806 n-d-854118-7 devstack@keystone.service[88366]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 28 18:35:12.636969 n-d-854118-7 devstack@keystone.service[88366]: Python main interpreter initialized at 0x558b800cc9c0 Aug 28 18:35:12.636969 n-d-854118-7 devstack@keystone.service[88366]: python threads support enabled Aug 28 18:35:12.636969 n-d-854118-7 devstack@keystone.service[88366]: your server socket listen backlog is limited to 100 connections Aug 28 18:35:12.636969 n-d-854118-7 devstack@keystone.service[88366]: your mercy for graceful operations on workers is 90 seconds Aug 28 18:35:12.637340 n-d-854118-7 devstack@keystone.service[88366]: mapped 403077 bytes (393 KB) for 2 cores Aug 28 18:35:12.637415 n-d-854118-7 devstack@keystone.service[88366]: *** Operational MODE: preforking *** Aug 28 18:35:12.637648 n-d-854118-7 devstack@keystone.service[88366]: *** uWSGI is running in multiple interpreter mode *** Aug 28 18:35:12.637648 n-d-854118-7 devstack@keystone.service[88366]: spawned uWSGI master process (pid: 88366) Aug 28 18:35:12.637853 n-d-854118-7 systemd[1]: Started Devstack devstack@keystone.service. Aug 28 18:35:12.638777 n-d-854118-7 devstack@keystone.service[88366]: spawned uWSGI worker 1 (pid: 88374, cores: 1) Aug 28 18:35:12.638777 n-d-854118-7 devstack@keystone.service[88366]: spawned uWSGI worker 2 (pid: 88375, cores: 1) Aug 28 18:35:12.638943 n-d-854118-7 devstack@keystone.service[88366]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 28 18:35:16.957114 n-d-854118-7 devstack@keystone.service[88374]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 18:35:16.957114 n-d-854118-7 devstack@keystone.service[88374]: from cryptography.utils import int_from_bytes Aug 28 18:35:16.958223 n-d-854118-7 devstack@keystone.service[88375]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 18:35:16.958223 n-d-854118-7 devstack@keystone.service[88375]: from cryptography.utils import int_from_bytes Aug 28 18:35:16.958670 n-d-854118-7 devstack@keystone.service[88374]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 18:35:16.958670 n-d-854118-7 devstack@keystone.service[88374]: from cryptography.utils import int_from_bytes Aug 28 18:35:16.958830 n-d-854118-7 devstack@keystone.service[88375]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 18:35:16.958830 n-d-854118-7 devstack@keystone.service[88375]: from cryptography.utils import int_from_bytes Aug 28 18:35:17.007486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 18:35:17.007666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 18:35:17.007859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] command line args: [] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 18:35:17.008129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 18:35:17.008214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 18:35:17.008294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ================================================================================ {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 18:35:17.008374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 18:35:17.008552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] admin_token = **** {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.008640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] command line args: [] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 18:35:17.008796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] config_dir = [] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.008876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 18:35:17.008985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.009072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ================================================================================ {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 18:35:17.009169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] config_source = [] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.009248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] admin_token = **** {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.009350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] debug = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.009475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] config_dir = [] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.009565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.009812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.009888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] config_source = [] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.009951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.010009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] debug = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.010076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.010228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.010336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.010436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.010558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.010650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.010816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] list_limit = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.010925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.010994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] log_config_append = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.011133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.011234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.011303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] log_dir = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.011366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] list_limit = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.011494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] log_file = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.011667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] log_config_append = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.011667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.011977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.012065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] log_dir = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.012139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.012199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] log_file = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.012261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.012318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.012444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.012540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.012613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.012732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.012806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.012928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.013014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.013086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.013207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.013283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.013442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.013570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.013678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.013765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.013911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.013994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.014146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.014233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.014385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.014512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.014604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.014681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.014879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.014962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.015127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.015392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.015478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.015575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] publish_errors = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.015809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.015887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.016040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.016117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] publish_errors = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.016242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.016324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.016455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.016534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.016668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.016761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.016915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] standard_threads = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.016993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.017154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.017274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.017388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] standard_threads = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.017483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.017563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.017633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.017728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] use_journal = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.017868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.018065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] use_json = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.018194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.018323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] use_stderr = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.018462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] use_journal = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.018594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] use_syslog = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.018722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] use_json = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.018838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.018913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] use_stderr = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.018913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] use_syslog = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.019046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.019046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.019177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 18:35:17.019257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.019335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.019412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.019488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.019662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.019744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.019980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.020065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.020260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.020447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.020526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.020703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.020794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.020964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.021049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.021217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.021321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.021467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.021554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.021705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.021793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.021944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.022020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.022181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.022268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.022423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.022506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.022672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.022769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.022939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.023043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.023182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.023261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.023443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.023522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.023689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.023843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.023917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.023993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.024161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.024239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.024418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.024509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.024673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.024750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.024925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.025002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.025162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.025248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.025395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.025473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.025628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.025712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.025861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.025939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.026100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.026178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.026349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.026432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.026583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.026662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.026836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.026914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.027073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.027154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.027325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.027405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.027565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.027643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.027804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.027882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.028034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.028112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.028271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.028350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.028509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.028585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.028740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.028817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.028971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.029047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.029201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.029276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.029422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.029503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.029657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.029734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.029897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.029975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.030129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.030213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.030367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.030447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.030600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.030686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.030860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.030967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.031083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.031158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.031309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.031387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.031540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.031618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.031779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.031858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.032017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.032096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.032256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.032334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.032492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.032609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.032730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.032818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.032961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.033038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.033192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.033275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.033432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.033517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.033669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.033748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.033902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.033988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.034135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.034222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.034390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.034481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.034623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.034708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.034886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.034966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.035108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.035197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.035356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.035988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.036210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.036333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.036421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.036507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.036606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.036684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.036856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.036977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.037093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.037182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.037330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.037423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.037565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.037646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.037813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.037903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.038051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.038130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.038288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.038394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.038531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.038649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.038814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.038921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.039019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.039116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.039256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.039354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.039492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.039572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.039727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.039805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.039963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.040053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.040200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.040281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.040451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.040531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.040691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.040819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.040962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.041058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.041167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.041247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.041403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.041560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.041686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.041763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.041878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.041954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.042080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.042206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.042291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.042365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.042523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.042606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.042784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.042868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.042995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.043077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.043232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.043314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.043463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.043541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.043701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.043787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.043937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.044016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.044175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.044256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.044415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.044495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.044678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.044758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.044922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.045000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.045148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] auth.external = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.045236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.045379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.045461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] auth.external = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.045618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.045716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.045902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.045982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.046136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] auth.password = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.046218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.046370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] auth.token = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.046449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] auth.password = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.046602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] auth.token = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.046683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.046861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.046948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.047106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.047184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.047338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.047433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.047577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.047658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.047823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.047902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.048057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.048137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.048291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.048373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] credential.caching = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.048530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] credential.caching = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.048611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.048779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.048859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.049027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.049114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.049273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.049353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.049515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.049601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.049749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.049829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.049986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.050064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.050233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.050318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.050470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.050551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.050714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.050875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.051012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.051711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.051917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.052000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.052204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.052283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.052453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.052533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.052714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.052796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.052953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] federation.caching = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.053033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.053191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.053277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] federation.caching = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.053441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.053522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.053690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.053769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.053923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.054001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.054161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.054289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.054397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.054476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.054639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.054727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.054902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.054985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.055158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.055248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.055396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.055484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.055644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.055730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.055880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.caching = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.055965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.056122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.caching = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.056276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.056353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.056423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.056592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.056673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.056829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.056918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.057064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.057149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.057301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.057379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.057536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.057633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.057774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.057861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.058023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.058138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.058257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.058394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.058495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.058630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.059023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.059195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.059285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.059371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.059483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.059621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.059733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.059874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.059990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.060125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.060238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.060385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.060512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.060636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.060752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.060912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.060993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.061154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.061240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.061395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.061476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.061629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.061712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.061869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.061949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.062103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.062183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.062340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.062422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.062583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.062663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.062836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.062920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.063086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.063169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.063318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.063397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.063555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.063634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.063802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.063884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.064039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.064119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.064269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.064348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.064508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.064590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.064741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.064822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.064980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.065058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.065215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.065296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.065454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.065533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.065691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.065779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.065928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.066009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.066175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.066254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.066416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.066505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.066670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.066823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.066962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.067101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.067238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.067375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.067465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.067537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.067651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.067733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.067900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.067990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.068146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.068247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.068379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.068460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.068622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.068710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.068883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.068963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.069119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.069199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.069369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.069459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.069603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.069682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.069854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.069934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.070089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.070176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.070322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.070404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.070559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.070640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.070813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.070910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.071053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.071134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.071285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.071363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.071522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.071613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.071755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.071835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.072002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.072081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.072247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.072334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.072496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.072575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.072734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.072814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.072979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.073066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.073212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.073292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.073448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.073537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.073685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.073772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.073920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.073999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.074155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.074233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.074392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.074481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.074630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.074709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.074902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.074981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.075142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.075234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.075387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.075466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.075621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.075700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.075857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.075944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.076098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.076178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.076334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.076449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.076573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.076696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.076822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.076933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.077066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.077174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.077302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.077419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] resource.caching = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.077542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.077678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.077791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] resource.caching = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.077928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.078009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.078168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.078249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.078423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.078502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.078676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.078776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.078943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.079025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.079193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.079271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.079435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.079512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.079677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.079757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.079913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] role.caching = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.079991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.080148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] role.caching = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.080225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] role.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.080387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.080466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] role.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.080620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.080697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.080872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.080959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.081120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.081197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.081367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.081443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.081614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.081700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.081860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.081937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.082106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.082182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.082418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.082525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.082650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.082729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.082996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.083079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.083248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.083340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.083504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.083599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.083749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.083853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.084105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.084193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.084377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.084503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.084630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.084740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.084882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.084991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.085133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.085244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.085386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.085493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.085622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.085743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.085877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.085980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.086132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.086239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.086376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.086494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.086611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.086762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.086868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.086993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.087090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.087229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.087344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.087464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.087601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.087719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.087851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.087961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.088090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.088212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.088327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.088451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.088564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.088690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.088802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] token.caching = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.088923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.089039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.089159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] token.caching = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.089287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.089397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.089526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.089645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.089782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.089882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.090030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.090139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.090269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.090387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.090513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.090625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.090774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.090897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.091027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.091143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.091265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.091392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.091508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.091634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.091744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.091875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.091989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.092110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.092264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.092344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.092497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.092623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.092740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.092856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.093005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.093093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.093266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.connection = **** {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.093353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.093513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.093599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.connection = **** {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.093762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.093844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.094002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.094089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.094245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.094323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.094483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.094562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.094722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.094824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.094983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.095070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.095221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.095308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.095461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.095548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.095697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.095775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.095934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.096011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.096167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.096252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.096407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.096484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.096640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.096717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.096880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.096965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.097110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.097187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.097349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.097446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.097579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.097674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.097738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 18:35:17.097798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 18:35:17.098563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 18:35:17.127845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.128075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.128309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.128539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.128777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.129009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.137252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.138028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.166087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.166314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.166405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.166608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.221200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.221539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.270423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.270680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.271005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.271249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.426736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.426996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.427218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.427444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.427666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.427888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.428300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.428533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.428759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.429005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.429208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.429425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.450937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.451044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.451175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.451274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.451407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.451489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.451633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.451714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.451857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.451939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.452077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.452155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.452293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.452382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.463942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.464259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.477472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.477657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.477740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.477884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.477967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.478111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.478192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.478334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.478423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.478550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.478632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.478784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.478868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.479028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 18:35:17.495893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.496106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 18:35:17.496280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.496454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.496535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 18:35:17.496656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 18:35:17.496829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.496934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.497016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 18:35:17.497199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.497287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.497462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.497585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.497720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.498056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.498322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.507694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.507794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.507976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.508082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.508247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.508343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.508532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.508634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.515495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.515633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.518378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.518538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.518666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.518852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.518977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.519140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.519268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.519426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.519556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.519713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.520435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.520560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.520647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.520814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.520910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.521126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.521297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.521393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.521485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.521661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.521744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.522002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.544842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.545187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.546303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.546590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.546670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.546955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.551175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.551465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.551749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.551832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.552050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.552410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.558217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.558507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.558689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.559271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.562856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.563167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.563440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.563534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.563735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.563841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.564017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.564103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.564354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.564644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.564932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.565216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.565487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.566037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.566337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.566642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.582809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.583180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.583602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.583854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.587040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.587752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.590117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.590416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.590987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.591288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.594778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.595529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.598502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.599291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.602025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.602325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.602474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.602613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.602847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.602933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.603140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.603222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.603430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.603570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.603713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.604008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.619347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.619841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.620118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.620413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.620413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.620574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.620693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.620854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.627578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.628280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.629134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.630205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.630858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.631147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.631810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.632090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.633807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.634104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.634501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.634766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.634851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.635059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.635140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.635353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.635640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.635924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.647003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.647289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.647671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.647894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.647976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.648180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.648262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.648464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.648547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.648749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.648830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.649033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.649310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.649596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.664802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.665674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.667729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.668720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.670602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.671625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.672084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.673068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.673698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.673983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.674268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.674540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.674853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.675143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.680687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.681932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.682156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.683446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.685442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.685736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.686028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.686331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.686575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.686893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.687181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.687476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.694239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.694532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.694843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.695429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.695724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.696009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.701718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.702008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.702294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.702588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.702892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.702976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 18:35:17.703183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.703264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.703463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.703543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.703738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.703821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.704009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.704099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.704281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.704365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.704556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.704636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.704830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.704918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.705099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.705179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.705370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.705450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.705642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.705916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.706198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.706467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 18:35:17.741413 n-d-854118-7 devstack@keystone.service[88374]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558b800cc9c0 pid: 88374 (default app) Aug 28 18:35:17.741522 n-d-854118-7 devstack@keystone.service[88375]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558b800cc9c0 pid: 88375 (default app) Aug 28 18:35:17.744687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7ac98-34fa-4def-9665-782f9083ee90 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:17.744978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7ac98-34fa-4def-9665-782f9083ee90 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:17.745255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7ac98-34fa-4def-9665-782f9083ee90 None None] PATH_INFO: `/v3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:17.749412 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Sun Aug 28 18:35:17 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:24.309070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14ff3b-0ca0-4a46-b2de-0b16366c5957 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:24.309663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14ff3b-0ca0-4a46-b2de-0b16366c5957 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:24.309663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14ff3b-0ca0-4a46-b2de-0b16366c5957 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:24.313905 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:35:24.319820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bb9fd-f9ec-4f4b-8795-a45c77095ff6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:24.320390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bb9fd-f9ec-4f4b-8795-a45c77095ff6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:24.320390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bb9fd-f9ec-4f4b-8795-a45c77095ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:24.390598 n-d-854118-7 devstack@keystone.service[88374]: INFO dbcounter [None req-4d6bb9fd-f9ec-4f4b-8795-a45c77095ff6 None None] Registered counter for database keystone Aug 28 18:35:24.409826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG oslo_db.sqlalchemy.engines [None req-4d6bb9fd-f9ec-4f4b-8795-a45c77095ff6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 18:35:24.416685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writer thread running {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 18:35:24.605062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG passlib.handlers.bcrypt [None req-4d6bb9fd-f9ec-4f4b-8795-a45c77095ff6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88374) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 18:35:24.605481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG passlib.handlers.bcrypt [None req-4d6bb9fd-f9ec-4f4b-8795-a45c77095ff6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88374) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 18:35:24.660028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4d6bb9fd-f9ec-4f4b-8795-a45c77095ff6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:24.661808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4d6bb9fd-f9ec-4f4b-8795-a45c77095ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:24.794800 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 28 18:35:25.283465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14ff3b-0ca0-4a46-b2de-0b16366c5957 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:25.354756 n-d-854118-7 devstack@keystone.service[88375]: INFO dbcounter [None req-3a14ff3b-0ca0-4a46-b2de-0b16366c5957 None None] Registered counter for database keystone Aug 28 18:35:25.376603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG oslo_db.sqlalchemy.engines [None req-3a14ff3b-0ca0-4a46-b2de-0b16366c5957 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 18:35:25.383066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writer thread running {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 18:35:25.504463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14ff3b-0ca0-4a46-b2de-0b16366c5957 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:25.508960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f76137-480d-4ff7-9be3-4c1a27fcff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:25.509584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76137-480d-4ff7-9be3-4c1a27fcff93 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:25.509870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76137-480d-4ff7-9be3-4c1a27fcff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:25.510143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76137-480d-4ff7-9be3-4c1a27fcff93 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:25.518288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f76137-480d-4ff7-9be3-4c1a27fcff93 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:25.572357 n-d-854118-7 devstack@keystone.service[88375]: WARNING keystone.common.rbac_enforcer.enforcer [None req-42f76137-480d-4ff7-9be3-4c1a27fcff93 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 18:35:25.572645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f76137-480d-4ff7-9be3-4c1a27fcff93 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:25.582693 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Sun Aug 28 18:35:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:35:25.588604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bb9fd-f9ec-4f4b-8795-a45c77095ff6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:25.603678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bb9fd-f9ec-4f4b-8795-a45c77095ff6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:25.608094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d01209-46b2-49ef-bda4-d9733d73bf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:25.609212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d01209-46b2-49ef-bda4-d9733d73bf65 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:25.609504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d01209-46b2-49ef-bda4-d9733d73bf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:25.609787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d01209-46b2-49ef-bda4-d9733d73bf65 admin admin] PATH_INFO: `/v3/projects/58e6322e28544af5ae4a5db517170f8c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:25.611391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d01209-46b2-49ef-bda4-d9733d73bf65 admin admin] RBAC: Authorizing `identity:get_project(project_id=58e6322e28544af5ae4a5db517170f8c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:25.664966 n-d-854118-7 devstack@keystone.service[88374]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e9d01209-46b2-49ef-bda4-d9733d73bf65 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 18:35:25.665319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d01209-46b2-49ef-bda4-d9733d73bf65 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:25.669808 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Sun Aug 28 18:35:25 2022] GET /identity/v3/projects/58e6322e28544af5ae4a5db517170f8c => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:27.550605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d3cd7-ad22-4fb5-82c8-17806b8392a4 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:27.551763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d3cd7-ad22-4fb5-82c8-17806b8392a4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:27.551763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d3cd7-ad22-4fb5-82c8-17806b8392a4 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:27.555958 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:27.561677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8e010-8223-4022-bad8-b77baa1c1b6d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:27.562108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8e010-8223-4022-bad8-b77baa1c1b6d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:27.562242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8e010-8223-4022-bad8-b77baa1c1b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:27.582118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c2f8e010-8223-4022-bad8-b77baa1c1b6d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:27.583836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c2f8e010-8223-4022-bad8-b77baa1c1b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:27.591644 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 28 18:35:27.864327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d3cd7-ad22-4fb5-82c8-17806b8392a4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:27.876308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d3cd7-ad22-4fb5-82c8-17806b8392a4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:27.880496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45f1e0-1bf3-4017-9b61-98adcb3143d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:27.881087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45f1e0-1bf3-4017-9b61-98adcb3143d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:27.881368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45f1e0-1bf3-4017-9b61-98adcb3143d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:27.881642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45f1e0-1bf3-4017-9b61-98adcb3143d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:27.889239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45f1e0-1bf3-4017-9b61-98adcb3143d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:27.891058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45f1e0-1bf3-4017-9b61-98adcb3143d6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:27.900238 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Sun Aug 28 18:35:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:35:27.905649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8e010-8223-4022-bad8-b77baa1c1b6d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:27.915666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8e010-8223-4022-bad8-b77baa1c1b6d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:27.920000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ac69e-2276-4326-9dea-a9808f4440b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:27.920628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ac69e-2276-4326-9dea-a9808f4440b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:27.920917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ac69e-2276-4326-9dea-a9808f4440b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:27.921197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ac69e-2276-4326-9dea-a9808f4440b6 admin admin] PATH_INFO: `/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:27.922512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ac69e-2276-4326-9dea-a9808f4440b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=60fe26b30a2d4d8bbf2347a182f6c4a7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:27.924397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ac69e-2276-4326-9dea-a9808f4440b6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:27.925924 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Sun Aug 28 18:35:27 2022] GET /identity/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:29.920482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c9195-d88a-4623-a498-8c6ec34e5e1e None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:29.920978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b25957-163d-45bc-acae-4ce0ca56ecf1 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:29.921343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c9195-d88a-4623-a498-8c6ec34e5e1e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:29.921436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b25957-163d-45bc-acae-4ce0ca56ecf1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:29.921522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c9195-d88a-4623-a498-8c6ec34e5e1e None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:29.921610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b25957-163d-45bc-acae-4ce0ca56ecf1 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:29.922265 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:35:29.922817 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 6/11] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:35:29.927424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf3ce4-3a62-4341-8fae-65a2c474484f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:29.927549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0c2fb-3cb5-49d6-afe4-861a8392bd2c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:29.927719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf3ce4-3a62-4341-8fae-65a2c474484f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:29.927920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0c2fb-3cb5-49d6-afe4-861a8392bd2c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:29.928229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf3ce4-3a62-4341-8fae-65a2c474484f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:29.928343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0c2fb-3cb5-49d6-afe4-861a8392bd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:29.946793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e1d0c2fb-3cb5-49d6-afe4-861a8392bd2c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:29.947970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e1d0c2fb-3cb5-49d6-afe4-861a8392bd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:29.970844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG passlib.handlers.bcrypt [None req-78cf3ce4-3a62-4341-8fae-65a2c474484f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88375) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 18:35:29.971270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG passlib.handlers.bcrypt [None req-78cf3ce4-3a62-4341-8fae-65a2c474484f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88375) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 18:35:30.016691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-78cf3ce4-3a62-4341-8fae-65a2c474484f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:30.018278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-78cf3ce4-3a62-4341-8fae-65a2c474484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:30.029925 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 7/12] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:30.118381 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 6/13] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:35:30.295629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0c2fb-3cb5-49d6-afe4-861a8392bd2c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:30.320653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:30.389356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf3ce4-3a62-4341-8fae-65a2c474484f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:30.402331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0c2fb-3cb5-49d6-afe4-861a8392bd2c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:30.436590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4c135-e389-44a2-b21e-2dbb394ee338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:30.437210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4c135-e389-44a2-b21e-2dbb394ee338 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:30.437499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4c135-e389-44a2-b21e-2dbb394ee338 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:30.437779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4c135-e389-44a2-b21e-2dbb394ee338 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:30.491737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf3ce4-3a62-4341-8fae-65a2c474484f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:30.494005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:30.508235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4c135-e389-44a2-b21e-2dbb394ee338 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:30.509764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4c135-e389-44a2-b21e-2dbb394ee338 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:30.529898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccd693-c067-4823-9c41-e4881ff38e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:30.531055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd693-c067-4823-9c41-e4881ff38e38 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:30.531344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd693-c067-4823-9c41-e4881ff38e38 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:30.531637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd693-c067-4823-9c41-e4881ff38e38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:30.533468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:30.543437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccd693-c067-4823-9c41-e4881ff38e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-b1ccd693-c067-4823-9c41-e4881ff38e38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:30.552361 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:30.553293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:30.554280 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:30.554280 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:30.554280 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:30.554280 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:30.554280 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:30.554280 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:30.554280 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:30.554280 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:30.554280 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:30.554280 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:30.554280 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:30.554280 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:35:30.554280 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:35:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:35:30.559473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccd693-c067-4823-9c41-e4881ff38e38 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:30.617233 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 8/15] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:35:30.622557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4c135-e389-44a2-b21e-2dbb394ee338 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:30.666160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccd693-c067-4823-9c41-e4881ff38e38 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:30.700056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15e63e-b5e2-4385-9c9d-e478a8404b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:30.700659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15e63e-b5e2-4385-9c9d-e478a8404b31 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:30.700939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15e63e-b5e2-4385-9c9d-e478a8404b31 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:30.701212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15e63e-b5e2-4385-9c9d-e478a8404b31 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:30.701875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15e63e-b5e2-4385-9c9d-e478a8404b31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:30.702179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15e63e-b5e2-4385-9c9d-e478a8404b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:30.703659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15e63e-b5e2-4385-9c9d-e478a8404b31 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:30.715755 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 8/16] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:30.721157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15e63e-b5e2-4385-9c9d-e478a8404b31 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:30.728691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4c135-e389-44a2-b21e-2dbb394ee338 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:30.747272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:30.752087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:30.765488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e143d6f-9f68-42d1-9ba5-7ee18218ef4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:30.766128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e143d6f-9f68-42d1-9ba5-7ee18218ef4c None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:30.766411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e143d6f-9f68-42d1-9ba5-7ee18218ef4c None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:30.766685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e143d6f-9f68-42d1-9ba5-7ee18218ef4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:30.777256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e143d6f-9f68-42d1-9ba5-7ee18218ef4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:30.778724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e143d6f-9f68-42d1-9ba5-7ee18218ef4c None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-3e143d6f-9f68-42d1-9ba5-7ee18218ef4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:35:30.796966 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:30.797826 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:35:30.798627 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:35:30.798627 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:35:30.798627 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:35:30.798627 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 9/17] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:35:30.804313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e143d6f-9f68-42d1-9ba5-7ee18218ef4c None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:30.821240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15e63e-b5e2-4385-9c9d-e478a8404b31 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:30.854413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661a11e-4a6a-4b07-88d4-dc785d08d11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:30.855118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661a11e-4a6a-4b07-88d4-dc785d08d11e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:30.855403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661a11e-4a6a-4b07-88d4-dc785d08d11e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:30.855679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661a11e-4a6a-4b07-88d4-dc785d08d11e None admin] PATH_INFO: `/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:30.857191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661a11e-4a6a-4b07-88d4-dc785d08d11e None admin] RBAC: Authorizing `identity:get_user(user_id=60fe26b30a2d4d8bbf2347a182f6c4a7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:30.858664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661a11e-4a6a-4b07-88d4-dc785d08d11e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:30.860273 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 9/18] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:30 2022] GET /identity/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:30.866430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661a11e-4a6a-4b07-88d4-dc785d08d11e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:30.910563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e143d6f-9f68-42d1-9ba5-7ee18218ef4c None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:30.947614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37b7ae-f2e2-40d7-91aa-d109e2583560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:30.948227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37b7ae-f2e2-40d7-91aa-d109e2583560 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:30.948503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37b7ae-f2e2-40d7-91aa-d109e2583560 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:30.948785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37b7ae-f2e2-40d7-91aa-d109e2583560 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:30.949429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37b7ae-f2e2-40d7-91aa-d109e2583560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:30.949737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37b7ae-f2e2-40d7-91aa-d109e2583560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:30.951157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37b7ae-f2e2-40d7-91aa-d109e2583560 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:30.960190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:30.967509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661a11e-4a6a-4b07-88d4-dc785d08d11e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:30.973673 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 10/19] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:31.003817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa249af-a67f-474b-85e0-703aa25c08e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:31.004520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa249af-a67f-474b-85e0-703aa25c08e6 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:31.004803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa249af-a67f-474b-85e0-703aa25c08e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:31.005051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa249af-a67f-474b-85e0-703aa25c08e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:31.006300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa249af-a67f-474b-85e0-703aa25c08e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:31.007846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa249af-a67f-474b-85e0-703aa25c08e6 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:31.009474 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 10/20] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:35:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:31.015508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37b7ae-f2e2-40d7-91aa-d109e2583560 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:31.054806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:31.128378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37b7ae-f2e2-40d7-91aa-d109e2583560 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:31.164707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a4129-142e-487a-a4a5-486d3ca4e60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:31.165330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a4129-142e-487a-a4a5-486d3ca4e60a None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:31.165623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a4129-142e-487a-a4a5-486d3ca4e60a None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:31.165900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a4129-142e-487a-a4a5-486d3ca4e60a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:31.166633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a4129-142e-487a-a4a5-486d3ca4e60a None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.domain.id=default, user.id=60fe26b30a2d4d8bbf2347a182f6c4a7) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:31.167020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a4129-142e-487a-a4a5-486d3ca4e60a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:31.168499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a4129-142e-487a-a4a5-486d3ca4e60a None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:31.175383 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 11/21] 10.222.0.70 () {56 vars in 1322 bytes} [Sun Aug 28 18:35:31 2022] GET /identity/v3/role_assignments?user.id=60fe26b30a2d4d8bbf2347a182f6c4a7&scope.domain.id=default&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:33.281692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fba5b-8dd7-4a3d-938f-56c613f703f6 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:33.282224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fba5b-8dd7-4a3d-938f-56c613f703f6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:33.282224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fba5b-8dd7-4a3d-938f-56c613f703f6 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:33.283688 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 11/22] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:33.289974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d9083-3fa9-4850-9481-11e557b07d04 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:33.290421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d9083-3fa9-4850-9481-11e557b07d04 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:33.290609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d9083-3fa9-4850-9481-11e557b07d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:33.314196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d74d9083-3fa9-4850-9481-11e557b07d04 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:33.315442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d74d9083-3fa9-4850-9481-11e557b07d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:33.390698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911ec3d-c870-4caa-ac3b-73fac91a1da4 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:33.391029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911ec3d-c870-4caa-ac3b-73fac91a1da4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:33.391289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911ec3d-c870-4caa-ac3b-73fac91a1da4 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:33.392943 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 12/23] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:35:33.402950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0b5e7-3c94-49ef-ae1d-e277f9a72001 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:33.403235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0b5e7-3c94-49ef-ae1d-e277f9a72001 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:33.403509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0b5e7-3c94-49ef-ae1d-e277f9a72001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:33.411381 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 12/24] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:33.439778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f9c0b5e7-3c94-49ef-ae1d-e277f9a72001 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:33.440992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f9c0b5e7-3c94-49ef-ae1d-e277f9a72001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:33.553078 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 13/25] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:33.765213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d9083-3fa9-4850-9481-11e557b07d04 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:33.794625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a97e6e-1793-4bee-9c8d-c0b74ef6c912 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:33.794932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a97e6e-1793-4bee-9c8d-c0b74ef6c912 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:33.795215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a97e6e-1793-4bee-9c8d-c0b74ef6c912 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:33.796716 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 14/26] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:35:33.798574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:33.804051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4b89d-0337-438f-bfd1-e1655c9f4f69 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:33.804263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4b89d-0337-438f-bfd1-e1655c9f4f69 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:33.804548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4b89d-0337-438f-bfd1-e1655c9f4f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:33.840047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-28d4b89d-0337-438f-bfd1-e1655c9f4f69 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:33.841260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-28d4b89d-0337-438f-bfd1-e1655c9f4f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:33.966578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d9083-3fa9-4850-9481-11e557b07d04 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:33.971212 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 15/27] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:33.972512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcc6f0-c10b-44ee-8f32-e9b52343586a None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:33.972962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcc6f0-c10b-44ee-8f32-e9b52343586a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:33.973482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcc6f0-c10b-44ee-8f32-e9b52343586a None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:33.975262 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 16/28] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:33.975987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcc6f0-c10b-44ee-8f32-e9b52343586a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:34.009012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:34.046008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2ca7d-6882-4d1a-9c1a-22e9efd019cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:34.047055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2ca7d-6882-4d1a-9c1a-22e9efd019cb None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:34.047677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2ca7d-6882-4d1a-9c1a-22e9efd019cb None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:34.048189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2ca7d-6882-4d1a-9c1a-22e9efd019cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:34.081278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2ca7d-6882-4d1a-9c1a-22e9efd019cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-bca2ca7d-6882-4d1a-9c1a-22e9efd019cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:34.089429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:34.090275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:34.091047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:34.091047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:34.091047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:34.091047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:34.091047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:34.091047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:34.091047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:34.091047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:34.091047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:34.091047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:34.091047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:34.091047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:35:34.091047 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 13/29] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:35:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:34.093742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706bee7-f1d1-46b2-bf52-f70e7f2e24ed None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:34.094937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706bee7-f1d1-46b2-bf52-f70e7f2e24ed None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:34.098404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706bee7-f1d1-46b2-bf52-f70e7f2e24ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:34.107543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcc6f0-c10b-44ee-8f32-e9b52343586a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:34.128561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7706bee7-f1d1-46b2-bf52-f70e7f2e24ed None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:34.134779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7706bee7-f1d1-46b2-bf52-f70e7f2e24ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:34.177053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb57ec-d4d6-4749-88df-e971df919587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:34.178085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb57ec-d4d6-4749-88df-e971df919587 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:34.178587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb57ec-d4d6-4749-88df-e971df919587 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:34.179092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb57ec-d4d6-4749-88df-e971df919587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:34.208328 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 14/30] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:34.209255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706bee7-f1d1-46b2-bf52-f70e7f2e24ed None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:34.219814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb57ec-d4d6-4749-88df-e971df919587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:34.221606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb57ec-d4d6-4749-88df-e971df919587 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:34.230115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-b4fb57ec-d4d6-4749-88df-e971df919587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:35:34.253184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:34.254782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:35:34.256070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:35:34.256070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:35:34.256070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:35:34.257889 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 17/31] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:34.263533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb57ec-d4d6-4749-88df-e971df919587 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:34.321596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706bee7-f1d1-46b2-bf52-f70e7f2e24ed None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:34.362180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191f044-7cf4-4497-a9a3-c93204d66da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:34.362781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191f044-7cf4-4497-a9a3-c93204d66da6 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:34.363077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191f044-7cf4-4497-a9a3-c93204d66da6 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:34.364340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191f044-7cf4-4497-a9a3-c93204d66da6 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:34.365167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191f044-7cf4-4497-a9a3-c93204d66da6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:34.365490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191f044-7cf4-4497-a9a3-c93204d66da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:34.366925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191f044-7cf4-4497-a9a3-c93204d66da6 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:34.388883 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 15/32] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:34.389806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191f044-7cf4-4497-a9a3-c93204d66da6 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:34.447086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:34.479393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:34.481014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb57ec-d4d6-4749-88df-e971df919587 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:34.507958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191f044-7cf4-4497-a9a3-c93204d66da6 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:34.546779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f2e3c-9aea-484d-992c-f33a7a44a01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:34.547412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f2e3c-9aea-484d-992c-f33a7a44a01d None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:34.547699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f2e3c-9aea-484d-992c-f33a7a44a01d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:34.547975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f2e3c-9aea-484d-992c-f33a7a44a01d None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:34.548648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f2e3c-9aea-484d-992c-f33a7a44a01d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:34.550117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f2e3c-9aea-484d-992c-f33a7a44a01d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:34.573484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e53ef2-dbab-483e-85a6-976fbe02ea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:34.574106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e53ef2-dbab-483e-85a6-976fbe02ea40 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:34.577328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e53ef2-dbab-483e-85a6-976fbe02ea40 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:34.577328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e53ef2-dbab-483e-85a6-976fbe02ea40 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:34.577328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e53ef2-dbab-483e-85a6-976fbe02ea40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:34.577328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e53ef2-dbab-483e-85a6-976fbe02ea40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:34.583589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e53ef2-dbab-483e-85a6-976fbe02ea40 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:34.607304 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 18/33] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:34.608782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e53ef2-dbab-483e-85a6-976fbe02ea40 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:34.691388 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 16/34] 10.222.0.70 () {60 vars in 1131 bytes} [Sun Aug 28 18:35:34 2022] POST /identity/v3/roles => generated 219 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:34.693000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f2e3c-9aea-484d-992c-f33a7a44a01d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:34.734444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e53ef2-dbab-483e-85a6-976fbe02ea40 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:34.781776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995cc3d-22cd-47a7-9044-3b925c469cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:34.782440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995cc3d-22cd-47a7-9044-3b925c469cbe None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:34.782731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995cc3d-22cd-47a7-9044-3b925c469cbe None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:34.783151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995cc3d-22cd-47a7-9044-3b925c469cbe None admin] PATH_INFO: `/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:34.784474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995cc3d-22cd-47a7-9044-3b925c469cbe None admin] RBAC: Authorizing `identity:get_user(user_id=60fe26b30a2d4d8bbf2347a182f6c4a7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:34.787497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995cc3d-22cd-47a7-9044-3b925c469cbe None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:34.789370 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 19/35] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:34 2022] GET /identity/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:34.791425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995cc3d-22cd-47a7-9044-3b925c469cbe None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:34.794389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:34.835319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f2e3c-9aea-484d-992c-f33a7a44a01d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:34.878072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ecf37-a5cc-45ff-a9b8-19ce4f6c063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:34.878697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ecf37-a5cc-45ff-a9b8-19ce4f6c063e None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:34.879675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ecf37-a5cc-45ff-a9b8-19ce4f6c063e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:34.879951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ecf37-a5cc-45ff-a9b8-19ce4f6c063e None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:34.880606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ecf37-a5cc-45ff-a9b8-19ce4f6c063e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:34.882130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ecf37-a5cc-45ff-a9b8-19ce4f6c063e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:34.897363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:34.901920 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 17/36] 10.222.0.70 () {60 vars in 1131 bytes} [Sun Aug 28 18:35:34 2022] POST /identity/v3/roles => generated 225 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:34.903381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab89708-c4d3-44b5-995b-63165253e867 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:34.904351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab89708-c4d3-44b5-995b-63165253e867 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:34.904911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab89708-c4d3-44b5-995b-63165253e867 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:34.906612 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 18/37] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:34.908692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab89708-c4d3-44b5-995b-63165253e867 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:34.943090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995cc3d-22cd-47a7-9044-3b925c469cbe None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:34.986517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87349fc4-33d4-4406-be92-dd7d79678db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:34.987332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87349fc4-33d4-4406-be92-dd7d79678db2 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:34.987621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87349fc4-33d4-4406-be92-dd7d79678db2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:34.987953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87349fc4-33d4-4406-be92-dd7d79678db2 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:34.989333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87349fc4-33d4-4406-be92-dd7d79678db2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:34.991388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87349fc4-33d4-4406-be92-dd7d79678db2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:35.039261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab89708-c4d3-44b5-995b-63165253e867 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:35.087515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d8ab4-40f2-497e-9844-6f45b12432fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:35.088178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d8ab4-40f2-497e-9844-6f45b12432fd None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:35.088527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d8ab4-40f2-497e-9844-6f45b12432fd None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:35.088808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d8ab4-40f2-497e-9844-6f45b12432fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:35.090113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d8ab4-40f2-497e-9844-6f45b12432fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:35.091784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d8ab4-40f2-497e-9844-6f45b12432fd None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:35.093389 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 19/38] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:35:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:35.096744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a8efd-034a-4030-8a9c-8cf2060dba9f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:35.097590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a8efd-034a-4030-8a9c-8cf2060dba9f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:35.099029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a8efd-034a-4030-8a9c-8cf2060dba9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:35.120844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-689a8efd-034a-4030-8a9c-8cf2060dba9f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:35.122692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-689a8efd-034a-4030-8a9c-8cf2060dba9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:35.156015 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 20/39] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:35:34 2022] POST /identity/v3/projects => generated 301 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:35.158768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87349fc4-33d4-4406-be92-dd7d79678db2 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:35.200604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:35.207322 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 20/40] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:35.208812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650eecf7-9433-4aeb-ba6a-12fbb36218f4 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:35.211818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650eecf7-9433-4aeb-ba6a-12fbb36218f4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:35.212134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650eecf7-9433-4aeb-ba6a-12fbb36218f4 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:35.213812 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 21/41] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:35.219523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c882f-54c3-4e56-a4e7-230666df10e0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:35.219805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c882f-54c3-4e56-a4e7-230666df10e0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:35.220088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c882f-54c3-4e56-a4e7-230666df10e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:35.231960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:35.289950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87349fc4-33d4-4406-be92-dd7d79678db2 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:35.334789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91ebcf-f0d9-4a94-b3ca-4dd670a717eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:35.336744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91ebcf-f0d9-4a94-b3ca-4dd670a717eb None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:35.336744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91ebcf-f0d9-4a94-b3ca-4dd670a717eb None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:35.336744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91ebcf-f0d9-4a94-b3ca-4dd670a717eb None admin] PATH_INFO: `/v3/domains/default/users/60fe26b30a2d4d8bbf2347a182f6c4a7/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:35.339917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91ebcf-f0d9-4a94-b3ca-4dd670a717eb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=60fe26b30a2d4d8bbf2347a182f6c4a7, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:35.341281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91ebcf-f0d9-4a94-b3ca-4dd670a717eb None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:35.356296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-de9c882f-54c3-4e56-a4e7-230666df10e0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:35.357518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-de9c882f-54c3-4e56-a4e7-230666df10e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:35.362730 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 21/42] 10.222.0.70 () {58 vars in 1361 bytes} [Sun Aug 28 18:35:35 2022] PUT /identity/v3/domains/default/users/60fe26b30a2d4d8bbf2347a182f6c4a7/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:35.455609 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 22/43] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:35.492685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91ebcf-f0d9-4a94-b3ca-4dd670a717eb None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:35.604121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91ebcf-f0d9-4a94-b3ca-4dd670a717eb None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:35.619456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:35.641946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37276140-4cd2-40a0-9cb6-ab79455359a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:35.642567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37276140-4cd2-40a0-9cb6-ab79455359a8 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:35.642908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37276140-4cd2-40a0-9cb6-ab79455359a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:35.643189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37276140-4cd2-40a0-9cb6-ab79455359a8 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:35.643881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37276140-4cd2-40a0-9cb6-ab79455359a8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:35.645507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37276140-4cd2-40a0-9cb6-ab79455359a8 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:35.663067 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 22/44] 10.222.0.70 () {60 vars in 1131 bytes} [Sun Aug 28 18:35:35 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:35.736273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c882f-54c3-4e56-a4e7-230666df10e0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:35.858444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c882f-54c3-4e56-a4e7-230666df10e0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:35.887528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:35.896817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f7f8d-7fc8-4a6b-8c43-c1756afc788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:35.897454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f7f8d-7fc8-4a6b-8c43-c1756afc788d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:35.897742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f7f8d-7fc8-4a6b-8c43-c1756afc788d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:35.898020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f7f8d-7fc8-4a6b-8c43-c1756afc788d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:35.899221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f7f8d-7fc8-4a6b-8c43-c1756afc788d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:35.900664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f7f8d-7fc8-4a6b-8c43-c1756afc788d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:35.902237 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 23/45] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:35:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:35.907889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37276140-4cd2-40a0-9cb6-ab79455359a8 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:36.007919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37276140-4cd2-40a0-9cb6-ab79455359a8 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:36.041778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d8c79-4372-4bf4-97d1-9adc716be470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:36.042424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d8c79-4372-4bf4-97d1-9adc716be470 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:36.042709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d8c79-4372-4bf4-97d1-9adc716be470 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:36.043016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d8c79-4372-4bf4-97d1-9adc716be470 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:36.043671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d8c79-4372-4bf4-97d1-9adc716be470 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:36.045127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d8c79-4372-4bf4-97d1-9adc716be470 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:36.073656 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 23/46] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:35:35 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:37.300096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e803b-60ab-4d23-ba8d-05d3475846f5 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:37.300613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e803b-60ab-4d23-ba8d-05d3475846f5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:37.300746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e803b-60ab-4d23-ba8d-05d3475846f5 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:37.302646 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 24/47] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:37.308054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c266f2-6cf0-4a7d-93af-433404dffc0e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:37.308442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c266f2-6cf0-4a7d-93af-433404dffc0e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:37.308884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c266f2-6cf0-4a7d-93af-433404dffc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:37.328250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-84c266f2-6cf0-4a7d-93af-433404dffc0e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:37.329765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-84c266f2-6cf0-4a7d-93af-433404dffc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:37.350476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:37.502466 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 24/48] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:37.767932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e803b-60ab-4d23-ba8d-05d3475846f5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:37.872573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e803b-60ab-4d23-ba8d-05d3475846f5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:37.905554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae9b1b-704a-40e6-83a7-68e1170cf611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:37.906184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae9b1b-704a-40e6-83a7-68e1170cf611 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:37.906471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae9b1b-704a-40e6-83a7-68e1170cf611 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:37.906769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae9b1b-704a-40e6-83a7-68e1170cf611 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:37.917246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae9b1b-704a-40e6-83a7-68e1170cf611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-1cae9b1b-704a-40e6-83a7-68e1170cf611 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:37.922069 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:37.923151 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:37.923961 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:37.923961 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:37.923961 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:37.923961 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:37.923961 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:37.923961 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:37.923961 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:37.923961 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:37.923961 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:37.923961 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:37.923961 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:37.923961 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:35:37.923961 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 25/49] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:35:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:37.928959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c266f2-6cf0-4a7d-93af-433404dffc0e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:37.986730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d990e6-f908-4fca-b7b0-94ebec2c7c6e None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:37.987041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d990e6-f908-4fca-b7b0-94ebec2c7c6e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:37.987324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d990e6-f908-4fca-b7b0-94ebec2c7c6e None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:37.988725 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 26/50] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:35:37.993601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e83bda-99b3-4462-b9de-af652f181ee9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:37.993889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e83bda-99b3-4462-b9de-af652f181ee9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:37.994163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e83bda-99b3-4462-b9de-af652f181ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:38.012143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-49e83bda-99b3-4462-b9de-af652f181ee9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:38.013335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-49e83bda-99b3-4462-b9de-af652f181ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:38.030363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c266f2-6cf0-4a7d-93af-433404dffc0e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:38.063835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:38.066879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa59295-c737-47bd-82aa-de884109d6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:38.067916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa59295-c737-47bd-82aa-de884109d6d2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:38.068461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa59295-c737-47bd-82aa-de884109d6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:38.068904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa59295-c737-47bd-82aa-de884109d6d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:38.070110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa59295-c737-47bd-82aa-de884109d6d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:38.071159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa59295-c737-47bd-82aa-de884109d6d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:38.072603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa59295-c737-47bd-82aa-de884109d6d2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:38.081104 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 25/51] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:38.085100 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 27/52] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:35:38.087233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa59295-c737-47bd-82aa-de884109d6d2 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:38.105434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:38.184540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa59295-c737-47bd-82aa-de884109d6d2 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:38.218187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4d791-7fd9-468e-b3cb-400ab2ca514c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:38.218860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4d791-7fd9-468e-b3cb-400ab2ca514c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:38.219153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4d791-7fd9-468e-b3cb-400ab2ca514c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:38.219436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4d791-7fd9-468e-b3cb-400ab2ca514c None admin] PATH_INFO: `/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:38.220583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4d791-7fd9-468e-b3cb-400ab2ca514c None admin] RBAC: Authorizing `identity:get_user(user_id=60fe26b30a2d4d8bbf2347a182f6c4a7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:38.222029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4d791-7fd9-468e-b3cb-400ab2ca514c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:38.223788 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 26/53] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:38 2022] GET /identity/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:38.229335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e83bda-99b3-4462-b9de-af652f181ee9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:38.328391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e83bda-99b3-4462-b9de-af652f181ee9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:38.354376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4d791-7fd9-468e-b3cb-400ab2ca514c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:38.362023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534670f-c7c4-42a3-a51e-f0cabb985024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:38.362657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534670f-c7c4-42a3-a51e-f0cabb985024 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:38.362973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534670f-c7c4-42a3-a51e-f0cabb985024 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:38.363249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534670f-c7c4-42a3-a51e-f0cabb985024 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:38.364951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534670f-c7c4-42a3-a51e-f0cabb985024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:38.366400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534670f-c7c4-42a3-a51e-f0cabb985024 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:38.368101 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 28/54] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:35:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:38.373854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534670f-c7c4-42a3-a51e-f0cabb985024 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:38.442607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:38.450027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:38.465505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4d791-7fd9-468e-b3cb-400ab2ca514c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:38.488108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534670f-c7c4-42a3-a51e-f0cabb985024 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:38.499570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed41743-62c1-4814-bd82-4faf316ddd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:38.500213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed41743-62c1-4814-bd82-4faf316ddd9d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:38.500497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed41743-62c1-4814-bd82-4faf316ddd9d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:38.500777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed41743-62c1-4814-bd82-4faf316ddd9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:38.501894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed41743-62c1-4814-bd82-4faf316ddd9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:38.503390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed41743-62c1-4814-bd82-4faf316ddd9d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:38.505103 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 27/55] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:35:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:38.510532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed41743-62c1-4814-bd82-4faf316ddd9d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:38.522664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae43e3-a70e-472b-8265-4549c3043a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:38.523366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae43e3-a70e-472b-8265-4549c3043a1b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:38.523648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae43e3-a70e-472b-8265-4549c3043a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:38.523927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae43e3-a70e-472b-8265-4549c3043a1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:38.524647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae43e3-a70e-472b-8265-4549c3043a1b None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.domain.id=default, user.id=60fe26b30a2d4d8bbf2347a182f6c4a7) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:38.524957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae43e3-a70e-472b-8265-4549c3043a1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:38.526405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae43e3-a70e-472b-8265-4549c3043a1b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:38.532143 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 29/56] 10.222.0.70 () {56 vars in 1322 bytes} [Sun Aug 28 18:35:38 2022] GET /identity/v3/role_assignments?user.id=60fe26b30a2d4d8bbf2347a182f6c4a7&scope.domain.id=default&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:38.627885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed41743-62c1-4814-bd82-4faf316ddd9d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:38.665665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585b8c2-1f5f-43b4-abb3-93ff5593cd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:38.666297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585b8c2-1f5f-43b4-abb3-93ff5593cd53 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:38.666584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585b8c2-1f5f-43b4-abb3-93ff5593cd53 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:38.666904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585b8c2-1f5f-43b4-abb3-93ff5593cd53 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:38.667570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585b8c2-1f5f-43b4-abb3-93ff5593cd53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:38.669040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585b8c2-1f5f-43b4-abb3-93ff5593cd53 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:38.696972 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 28/57] 10.222.0.70 () {60 vars in 1140 bytes} [Sun Aug 28 18:35:38 2022] POST /identity/v3/projects => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:35:40.591074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28e4fb-8be9-472f-96a4-cf4153624135 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:40.591473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28e4fb-8be9-472f-96a4-cf4153624135 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:40.591640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28e4fb-8be9-472f-96a4-cf4153624135 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:40.592999 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 30/58] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:40.598046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eec64-e580-43e7-987c-b0f0fc0f19dc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:40.598439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eec64-e580-43e7-987c-b0f0fc0f19dc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:40.598610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43eec64-e580-43e7-987c-b0f0fc0f19dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:40.611417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:40.617998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d43eec64-e580-43e7-987c-b0f0fc0f19dc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:40.619559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d43eec64-e580-43e7-987c-b0f0fc0f19dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:40.693392 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 29/59] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:40.970101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28e4fb-8be9-472f-96a4-cf4153624135 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:41.071025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28e4fb-8be9-472f-96a4-cf4153624135 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:41.087606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:41.104749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ea06c-7a92-4781-81ec-a074930ed1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:41.105372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ea06c-7a92-4781-81ec-a074930ed1e9 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:41.105656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ea06c-7a92-4781-81ec-a074930ed1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:41.105932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ea06c-7a92-4781-81ec-a074930ed1e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:41.107055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ea06c-7a92-4781-81ec-a074930ed1e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:41.108500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ea06c-7a92-4781-81ec-a074930ed1e9 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:41.110054 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 31/60] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:35:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:41.116430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43eec64-e580-43e7-987c-b0f0fc0f19dc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:41.214012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43eec64-e580-43e7-987c-b0f0fc0f19dc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:41.248111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65220a2-6b72-4a4a-8765-9d59b8bc16fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:41.248714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65220a2-6b72-4a4a-8765-9d59b8bc16fa None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:41.249003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65220a2-6b72-4a4a-8765-9d59b8bc16fa None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:41.249286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65220a2-6b72-4a4a-8765-9d59b8bc16fa None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:41.249933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65220a2-6b72-4a4a-8765-9d59b8bc16fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:41.251405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65220a2-6b72-4a4a-8765-9d59b8bc16fa None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:41.263148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:41.279079 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 30/61] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:35:41 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:44.375604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301469d-e22a-42f8-b44e-cb2a778d0473 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:44.376629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301469d-e22a-42f8-b44e-cb2a778d0473 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:44.377118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301469d-e22a-42f8-b44e-cb2a778d0473 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:44.378773 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 32/62] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:44.384239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b47760-a2f2-4485-9292-605c02086274 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:44.385088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b47760-a2f2-4485-9292-605c02086274 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:44.385562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b47760-a2f2-4485-9292-605c02086274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:44.411596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a8b47760-a2f2-4485-9292-605c02086274 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:44.412826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a8b47760-a2f2-4485-9292-605c02086274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:44.505844 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 31/63] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:44.512795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f7549-bd18-428e-a9d5-8d5e791ebcaa None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:44.513314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f7549-bd18-428e-a9d5-8d5e791ebcaa None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:44.513789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f7549-bd18-428e-a9d5-8d5e791ebcaa None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:44.515356 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 33/64] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:44.520730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303b2b6-8686-4720-9b61-15d61263511f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:44.521029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303b2b6-8686-4720-9b61-15d61263511f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:44.521316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303b2b6-8686-4720-9b61-15d61263511f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:44.555784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c303b2b6-8686-4720-9b61-15d61263511f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:44.556991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c303b2b6-8686-4720-9b61-15d61263511f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:44.584358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a15f-b899-41a8-a6d1-7e9b50a22dc8 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:44.584952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a15f-b899-41a8-a6d1-7e9b50a22dc8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:44.585426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a15f-b899-41a8-a6d1-7e9b50a22dc8 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:44.587084 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 34/65] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:44.608614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e17924-24ae-4448-a8a1-65876af6ea5f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:44.609216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e17924-24ae-4448-a8a1-65876af6ea5f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:44.609725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e17924-24ae-4448-a8a1-65876af6ea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:44.647994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-01e17924-24ae-4448-a8a1-65876af6ea5f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:44.649603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-01e17924-24ae-4448-a8a1-65876af6ea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:44.663787 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 32/66] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:44.755839 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 35/67] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:35:44.854465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992c2b-c9c9-4d8f-91bd-f7aeed4121b2 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:44.855115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992c2b-c9c9-4d8f-91bd-f7aeed4121b2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:44.855613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992c2b-c9c9-4d8f-91bd-f7aeed4121b2 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:44.857436 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 33/68] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:44.862315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39730df-a945-4ff1-93d1-91ae17848e0d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:44.862852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39730df-a945-4ff1-93d1-91ae17848e0d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:44.863899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39730df-a945-4ff1-93d1-91ae17848e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:44.872265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09992c2b-c9c9-4d8f-91bd-f7aeed4121b2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:44.888526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f39730df-a945-4ff1-93d1-91ae17848e0d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:44.889841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f39730df-a945-4ff1-93d1-91ae17848e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:44.951251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:44.983453 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 36/69] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:44.984692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39730df-a945-4ff1-93d1-91ae17848e0d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:45.012861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09992c2b-c9c9-4d8f-91bd-f7aeed4121b2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:45.037855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:45.055532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6aa303-603e-49c7-95c6-0e732c84464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:45.056565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6aa303-603e-49c7-95c6-0e732c84464b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:45.057087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6aa303-603e-49c7-95c6-0e732c84464b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:45.057557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6aa303-603e-49c7-95c6-0e732c84464b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:45.069373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6aa303-603e-49c7-95c6-0e732c84464b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-8f6aa303-603e-49c7-95c6-0e732c84464b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:45.074774 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:45.075591 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:45.076316 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:45.076316 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:45.076316 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:45.076316 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:45.076316 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:45.076316 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:45.076316 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:45.076316 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:45.076316 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:45.076316 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:45.076316 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:45.076316 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:35:45.078764 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 34/70] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:35:45.080808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2131620-8aa7-4962-a90b-cd142323ccc4 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:45.081472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2131620-8aa7-4962-a90b-cd142323ccc4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:45.082205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2131620-8aa7-4962-a90b-cd142323ccc4 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:45.084896 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 35/71] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:45.085824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2131620-8aa7-4962-a90b-cd142323ccc4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:45.102989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39730df-a945-4ff1-93d1-91ae17848e0d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:45.138167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228345f-d6f6-4ec2-aef6-b72918d6dc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:45.138833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228345f-d6f6-4ec2-aef6-b72918d6dc8f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:45.139126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228345f-d6f6-4ec2-aef6-b72918d6dc8f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:45.139406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228345f-d6f6-4ec2-aef6-b72918d6dc8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:45.150575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228345f-d6f6-4ec2-aef6-b72918d6dc8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-8228345f-d6f6-4ec2-aef6-b72918d6dc8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:45.155514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:45.156349 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:45.157090 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:45.157090 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:45.157090 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:45.157090 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:45.157090 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:45.157090 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:45.157090 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:45.157090 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:45.157090 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:45.157090 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:45.157090 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:35:45.157090 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:35:45.157090 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 37/72] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:45.163448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836d3b9-af6f-4b69-8577-14e20a1c6a74 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:45.163448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836d3b9-af6f-4b69-8577-14e20a1c6a74 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:45.163448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836d3b9-af6f-4b69-8577-14e20a1c6a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:45.177393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0836d3b9-af6f-4b69-8577-14e20a1c6a74 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:45.178586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0836d3b9-af6f-4b69-8577-14e20a1c6a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:45.209276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2131620-8aa7-4962-a90b-cd142323ccc4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:45.223268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:45.244552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6987002-9763-4152-b8f0-a177e8dd210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:45.245273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6987002-9763-4152-b8f0-a177e8dd210c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:45.245625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6987002-9763-4152-b8f0-a177e8dd210c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:45.245983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6987002-9763-4152-b8f0-a177e8dd210c None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:45.246657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6987002-9763-4152-b8f0-a177e8dd210c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:45.246994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6987002-9763-4152-b8f0-a177e8dd210c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:45.248387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6987002-9763-4152-b8f0-a177e8dd210c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:45.254428 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 38/73] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:45.255321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836d3b9-af6f-4b69-8577-14e20a1c6a74 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:45.265648 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 36/74] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:45.267209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6987002-9763-4152-b8f0-a177e8dd210c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:45.294620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:45.368248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836d3b9-af6f-4b69-8577-14e20a1c6a74 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:45.374258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6987002-9763-4152-b8f0-a177e8dd210c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:45.406415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561f4b-5b8e-4f36-ba5b-2a2572945a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:45.407257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561f4b-5b8e-4f36-ba5b-2a2572945a4b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:45.407493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561f4b-5b8e-4f36-ba5b-2a2572945a4b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:45.407769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f561f4b-5b8e-4f36-ba5b-2a2572945a4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:45.411222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98787df-b835-40ff-a75d-c02d8af9fc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:45.411834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98787df-b835-40ff-a75d-c02d8af9fc6d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:45.412117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98787df-b835-40ff-a75d-c02d8af9fc6d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:45.412397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98787df-b835-40ff-a75d-c02d8af9fc6d None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:45.413058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98787df-b835-40ff-a75d-c02d8af9fc6d None admin] RBAC: Adding query filter params (name=member) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:45.413366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98787df-b835-40ff-a75d-c02d8af9fc6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:45.414763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98787df-b835-40ff-a75d-c02d8af9fc6d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:45.418952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f561f4b-5b8e-4f36-ba5b-2a2572945a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:45.428439 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 37/75] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:35:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:45.428439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98787df-b835-40ff-a75d-c02d8af9fc6d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-0f561f4b-5b8e-4f36-ba5b-2a2572945a4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:45.428665 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:45.429412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 39/76] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:35:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:45.430131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561f4b-5b8e-4f36-ba5b-2a2572945a4b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:45.468125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:45.526356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:45.532709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f561f4b-5b8e-4f36-ba5b-2a2572945a4b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:45.543693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98787df-b835-40ff-a75d-c02d8af9fc6d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:45.567935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c00e5-8509-4c95-bd77-9072ffac4dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:45.568568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c00e5-8509-4c95-bd77-9072ffac4dc6 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:45.568850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c00e5-8509-4c95-bd77-9072ffac4dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:45.569121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c00e5-8509-4c95-bd77-9072ffac4dc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:45.582424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a878c2-f20e-433b-980f-899560e4e475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:45.583102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a878c2-f20e-433b-980f-899560e4e475 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:45.583314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5c00e5-8509-4c95-bd77-9072ffac4dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:45.583409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a878c2-f20e-433b-980f-899560e4e475 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:45.583652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a878c2-f20e-433b-980f-899560e4e475 None admin] PATH_INFO: `/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:45.584801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a878c2-f20e-433b-980f-899560e4e475 None admin] RBAC: Authorizing `identity:get_user(user_id=60fe26b30a2d4d8bbf2347a182f6c4a7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:45.586263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a878c2-f20e-433b-980f-899560e4e475 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:45.587881 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 38/77] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:45 2022] GET /identity/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-fb5c00e5-8509-4c95-bd77-9072ffac4dc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:45.588114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:45.588927 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:45.589722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:45.589722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:45.589722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:45.589722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:45.589722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:45.589722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:45.589722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:45.589722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:45.589722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:45.589722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:45.589722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:35:45.589722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:35:45.590334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a878c2-f20e-433b-980f-899560e4e475 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:45.590399 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 40/78] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:45.590399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c00e5-8509-4c95-bd77-9072ffac4dc6 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:45.690205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a878c2-f20e-433b-980f-899560e4e475 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:45.691489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c00e5-8509-4c95-bd77-9072ffac4dc6 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:45.693488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:45.725483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74910cf-7c28-4446-aa14-103e550ad42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:45.725654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495e2a-4517-47af-8a79-933f36f10c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:45.726045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74910cf-7c28-4446-aa14-103e550ad42a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:45.726138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495e2a-4517-47af-8a79-933f36f10c1d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:45.726331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74910cf-7c28-4446-aa14-103e550ad42a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:45.726421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495e2a-4517-47af-8a79-933f36f10c1d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:45.726608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74910cf-7c28-4446-aa14-103e550ad42a None admin] PATH_INFO: `/v3/users/0489bf2a330a4690b46f44735ab56fb3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:45.726693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495e2a-4517-47af-8a79-933f36f10c1d None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:45.727317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6495e2a-4517-47af-8a79-933f36f10c1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:45.727628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6495e2a-4517-47af-8a79-933f36f10c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:45.729013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6495e2a-4517-47af-8a79-933f36f10c1d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:45.736907 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 41/79] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:35:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:45.736907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495e2a-4517-47af-8a79-933f36f10c1d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:45.742941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74910cf-7c28-4446-aa14-103e550ad42a None admin] RBAC: Authorizing `identity:get_user(user_id=0489bf2a330a4690b46f44735ab56fb3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:45.744406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74910cf-7c28-4446-aa14-103e550ad42a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:45.746060 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 39/80] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:45 2022] GET /identity/v3/users/0489bf2a330a4690b46f44735ab56fb3 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:45.746845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74910cf-7c28-4446-aa14-103e550ad42a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:45.760902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:45.840572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495e2a-4517-47af-8a79-933f36f10c1d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:45.843808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74910cf-7c28-4446-aa14-103e550ad42a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:45.874269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22299a-ded2-405e-b4c2-01dd283f7f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:45.874942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22299a-ded2-405e-b4c2-01dd283f7f54 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:45.875226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22299a-ded2-405e-b4c2-01dd283f7f54 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:45.875503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22299a-ded2-405e-b4c2-01dd283f7f54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:45.876614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22299a-ded2-405e-b4c2-01dd283f7f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:45.877878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826c535-95b7-425d-8919-9766eeab94dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:45.878073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22299a-ded2-405e-b4c2-01dd283f7f54 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:45.878488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826c535-95b7-425d-8919-9766eeab94dd None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:45.878842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826c535-95b7-425d-8919-9766eeab94dd None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:45.879088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826c535-95b7-425d-8919-9766eeab94dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:45.880070 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 42/81] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:35:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:45.880853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22299a-ded2-405e-b4c2-01dd283f7f54 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:45.911236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:45.950312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826c535-95b7-425d-8919-9766eeab94dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:45.951908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826c535-95b7-425d-8919-9766eeab94dd None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:45.967761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:45.983651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22299a-ded2-405e-b4c2-01dd283f7f54 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:46.016537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00c91d-05f3-4c58-bbaa-1cd799133132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:46.017147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00c91d-05f3-4c58-bbaa-1cd799133132 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:46.017443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00c91d-05f3-4c58-bbaa-1cd799133132 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:46.017719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00c91d-05f3-4c58-bbaa-1cd799133132 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:46.018391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00c91d-05f3-4c58-bbaa-1cd799133132 None admin] RBAC: Adding query filter params (name=member) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:46.018707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00c91d-05f3-4c58-bbaa-1cd799133132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:46.020817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00c91d-05f3-4c58-bbaa-1cd799133132 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:46.029109 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 43/82] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:35:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:46.029701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00c91d-05f3-4c58-bbaa-1cd799133132 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:46.053716 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 40/83] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:35:46.053716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826c535-95b7-425d-8919-9766eeab94dd None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:46.111969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:46.133034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00c91d-05f3-4c58-bbaa-1cd799133132 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:46.149672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826c535-95b7-425d-8919-9766eeab94dd None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:46.167252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6130281-ba71-4332-9199-cd2542a2b1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:46.167881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6130281-ba71-4332-9199-cd2542a2b1e6 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:46.168163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6130281-ba71-4332-9199-cd2542a2b1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:46.168439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6130281-ba71-4332-9199-cd2542a2b1e6 None admin] PATH_INFO: `/v3/users/0489bf2a330a4690b46f44735ab56fb3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:46.169554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6130281-ba71-4332-9199-cd2542a2b1e6 None admin] RBAC: Authorizing `identity:get_user(user_id=0489bf2a330a4690b46f44735ab56fb3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:46.171108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6130281-ba71-4332-9199-cd2542a2b1e6 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:46.172671 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 44/84] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:46 2022] GET /identity/v3/users/0489bf2a330a4690b46f44735ab56fb3 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:46.173410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6130281-ba71-4332-9199-cd2542a2b1e6 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:46.185526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ff6b3-0a9b-4866-932a-5d2f51ea7df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:46.186147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ff6b3-0a9b-4866-932a-5d2f51ea7df4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:46.186437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ff6b3-0a9b-4866-932a-5d2f51ea7df4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:46.186716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ff6b3-0a9b-4866-932a-5d2f51ea7df4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:46.191180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:46.255724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ff6b3-0a9b-4866-932a-5d2f51ea7df4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:46.257207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ff6b3-0a9b-4866-932a-5d2f51ea7df4 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:46.274982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6130281-ba71-4332-9199-cd2542a2b1e6 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:46.307679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983489c5-29d9-4070-ae08-330740fab074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:46.308293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983489c5-29d9-4070-ae08-330740fab074 None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:46.308833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983489c5-29d9-4070-ae08-330740fab074 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:46.309116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983489c5-29d9-4070-ae08-330740fab074 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:46.309768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983489c5-29d9-4070-ae08-330740fab074 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:46.311261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983489c5-29d9-4070-ae08-330740fab074 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:46.316875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:46.339165 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 45/85] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:35:46 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:46.339993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983489c5-29d9-4070-ae08-330740fab074 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:46.361815 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 41/86] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:35:46.362692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ff6b3-0a9b-4866-932a-5d2f51ea7df4 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:46.440526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:46.478021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983489c5-29d9-4070-ae08-330740fab074 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:46.484894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ff6b3-0a9b-4866-932a-5d2f51ea7df4 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:46.520599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db563-6e49-4758-bd65-131ed81ac3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:46.521176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db563-6e49-4758-bd65-131ed81ac3cd None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:46.521462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db563-6e49-4758-bd65-131ed81ac3cd None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:46.521742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db563-6e49-4758-bd65-131ed81ac3cd None admin] PATH_INFO: `/v3/users/0489bf2a330a4690b46f44735ab56fb3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:46.523061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576db563-6e49-4758-bd65-131ed81ac3cd None admin] RBAC: Authorizing `identity:get_user(user_id=0489bf2a330a4690b46f44735ab56fb3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:46.524552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576db563-6e49-4758-bd65-131ed81ac3cd None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:46.526149 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 46/87] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:46 2022] GET /identity/v3/users/0489bf2a330a4690b46f44735ab56fb3 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:46.530968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db563-6e49-4758-bd65-131ed81ac3cd None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:46.534307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f49276-d6e4-4bd1-8a67-4fde4a9648fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:46.535518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49276-d6e4-4bd1-8a67-4fde4a9648fc None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:46.535857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49276-d6e4-4bd1-8a67-4fde4a9648fc None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:46.536378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f49276-d6e4-4bd1-8a67-4fde4a9648fc None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:46.537545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f49276-d6e4-4bd1-8a67-4fde4a9648fc None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:46.539019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f49276-d6e4-4bd1-8a67-4fde4a9648fc None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:46.540669 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 42/88] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:46 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:46.541801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f49276-d6e4-4bd1-8a67-4fde4a9648fc None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:46.585935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:46.666917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db563-6e49-4758-bd65-131ed81ac3cd None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:46.681214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f49276-d6e4-4bd1-8a67-4fde4a9648fc None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:46.709605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120eb8-97cf-4350-a550-e209408dfb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:46.710229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120eb8-97cf-4350-a550-e209408dfb16 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:46.710515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120eb8-97cf-4350-a550-e209408dfb16 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:46.710818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6120eb8-97cf-4350-a550-e209408dfb16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:46.727328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:46.732621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f8693-cc96-4ad8-a4cf-2f26a7aee7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:46.733279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f8693-cc96-4ad8-a4cf-2f26a7aee7ac None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:46.733568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f8693-cc96-4ad8-a4cf-2f26a7aee7ac None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:46.733844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f8693-cc96-4ad8-a4cf-2f26a7aee7ac None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:46.735301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f8693-cc96-4ad8-a4cf-2f26a7aee7ac None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:46.736751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f8693-cc96-4ad8-a4cf-2f26a7aee7ac None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:46.738756 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 43/89] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:46 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:46.739842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f8693-cc96-4ad8-a4cf-2f26a7aee7ac None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:46.805022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6120eb8-97cf-4350-a550-e209408dfb16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:46.806922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6120eb8-97cf-4350-a550-e209408dfb16 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:46.850649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:46.855153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f8693-cc96-4ad8-a4cf-2f26a7aee7ac None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:46.895486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc5811-19f1-481e-98e0-40a574f5246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:46.896152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc5811-19f1-481e-98e0-40a574f5246b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:46.896636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc5811-19f1-481e-98e0-40a574f5246b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:46.896760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc5811-19f1-481e-98e0-40a574f5246b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:46.919867 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 47/90] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:35:46.921030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120eb8-97cf-4350-a550-e209408dfb16 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:46.969505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:46.971447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc5811-19f1-481e-98e0-40a574f5246b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:46.974267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc5811-19f1-481e-98e0-40a574f5246b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:47.041406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6120eb8-97cf-4350-a550-e209408dfb16 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:47.076892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a3494-36f7-4259-a47b-3eb3d064c5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:47.077718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a3494-36f7-4259-a47b-3eb3d064c5c6 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:47.078142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a3494-36f7-4259-a47b-3eb3d064c5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:47.078566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a3494-36f7-4259-a47b-3eb3d064c5c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:47.079472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a3494-36f7-4259-a47b-3eb3d064c5c6 None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=fea2e1e9b16a4405b41888375f40c504, user.id=60fe26b30a2d4d8bbf2347a182f6c4a7) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:47.079941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a3494-36f7-4259-a47b-3eb3d064c5c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:47.081539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a3494-36f7-4259-a47b-3eb3d064c5c6 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:47.087548 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 48/91] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:35:46 2022] GET /identity/v3/role_assignments?user.id=60fe26b30a2d4d8bbf2347a182f6c4a7&scope.project.id=fea2e1e9b16a4405b41888375f40c504&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:47.088671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a3494-36f7-4259-a47b-3eb3d064c5c6 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:47.091525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:47.096948 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 44/92] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:35:47.099219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc5811-19f1-481e-98e0-40a574f5246b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:47.199043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a3494-36f7-4259-a47b-3eb3d064c5c6 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:47.202247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:47.219252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc5811-19f1-481e-98e0-40a574f5246b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:47.237175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267113c0-9702-42b3-b1e5-9d42637eae9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:47.239107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267113c0-9702-42b3-b1e5-9d42637eae9a None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:47.239747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267113c0-9702-42b3-b1e5-9d42637eae9a None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:47.240312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267113c0-9702-42b3-b1e5-9d42637eae9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:47.241536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267113c0-9702-42b3-b1e5-9d42637eae9a None admin] RBAC: Adding query filter params (role.id=24fee0983ae345c288f4974d93a3805d, scope.project.id=fea2e1e9b16a4405b41888375f40c504, user.id=0489bf2a330a4690b46f44735ab56fb3) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:47.242032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267113c0-9702-42b3-b1e5-9d42637eae9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:47.243766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267113c0-9702-42b3-b1e5-9d42637eae9a None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:47.252596 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 49/93] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:35:47 2022] GET /identity/v3/role_assignments?user.id=0489bf2a330a4690b46f44735ab56fb3&scope.project.id=fea2e1e9b16a4405b41888375f40c504&role.id=24fee0983ae345c288f4974d93a3805d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:47.253982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267113c0-9702-42b3-b1e5-9d42637eae9a None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:47.260529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3479da-0bc8-4c9d-9888-7c2009bfb027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:47.261262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3479da-0bc8-4c9d-9888-7c2009bfb027 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:47.261556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3479da-0bc8-4c9d-9888-7c2009bfb027 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:47.261836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3479da-0bc8-4c9d-9888-7c2009bfb027 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:47.263109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3479da-0bc8-4c9d-9888-7c2009bfb027 None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:47.264588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3479da-0bc8-4c9d-9888-7c2009bfb027 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:47.266379 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 45/94] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:47 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:47.273255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3479da-0bc8-4c9d-9888-7c2009bfb027 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:47.381752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:47.392813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267113c0-9702-42b3-b1e5-9d42637eae9a None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:47.435922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730b3b4-b196-4e86-80e4-6c78fef49a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:47.436853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730b3b4-b196-4e86-80e4-6c78fef49a91 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:47.437280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730b3b4-b196-4e86-80e4-6c78fef49a91 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:47.437698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730b3b4-b196-4e86-80e4-6c78fef49a91 None admin] PATH_INFO: `/v3/projects/012183641bb945f19dcace487a5df1a0` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:47.439565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730b3b4-b196-4e86-80e4-6c78fef49a91 None admin] RBAC: Authorizing `identity:get_project(project_id=012183641bb945f19dcace487a5df1a0)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:47.441602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730b3b4-b196-4e86-80e4-6c78fef49a91 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:47.444438 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 50/95] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:47 2022] GET /identity/v3/projects/012183641bb945f19dcace487a5df1a0 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:47.450208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730b3b4-b196-4e86-80e4-6c78fef49a91 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:47.460209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3479da-0bc8-4c9d-9888-7c2009bfb027 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:47.499696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8a106-32c2-4909-8166-2eac926f0c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:47.501122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8a106-32c2-4909-8166-2eac926f0c7f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:47.501566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8a106-32c2-4909-8166-2eac926f0c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:47.501979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8a106-32c2-4909-8166-2eac926f0c7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:47.503203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8a106-32c2-4909-8166-2eac926f0c7f None admin] RBAC: Adding query filter params (role.id=9e9271d4f0cd4c5688279b54d26e079f, scope.project.id=fea2e1e9b16a4405b41888375f40c504, user.id=0489bf2a330a4690b46f44735ab56fb3) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:47.503772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8a106-32c2-4909-8166-2eac926f0c7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:47.506045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8a106-32c2-4909-8166-2eac926f0c7f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:47.514969 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 46/96] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:35:47 2022] GET /identity/v3/role_assignments?user.id=0489bf2a330a4690b46f44735ab56fb3&scope.project.id=fea2e1e9b16a4405b41888375f40c504&role.id=9e9271d4f0cd4c5688279b54d26e079f => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:47.531151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:47.610072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730b3b4-b196-4e86-80e4-6c78fef49a91 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:47.648833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eca380-fd93-463b-bb5f-4a41c9f568a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:47.649717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eca380-fd93-463b-bb5f-4a41c9f568a5 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:47.650145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eca380-fd93-463b-bb5f-4a41c9f568a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:47.650563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eca380-fd93-463b-bb5f-4a41c9f568a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:47.651489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eca380-fd93-463b-bb5f-4a41c9f568a5 None admin] RBAC: Adding query filter params (role.id=24fee0983ae345c288f4974d93a3805d, scope.project.id=012183641bb945f19dcace487a5df1a0, user.id=0489bf2a330a4690b46f44735ab56fb3) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:47.651940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eca380-fd93-463b-bb5f-4a41c9f568a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:47.653611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eca380-fd93-463b-bb5f-4a41c9f568a5 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:47.661178 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 51/97] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:35:47 2022] GET /identity/v3/role_assignments?user.id=0489bf2a330a4690b46f44735ab56fb3&scope.project.id=012183641bb945f19dcace487a5df1a0&role.id=24fee0983ae345c288f4974d93a3805d => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:48.740625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c450f7f-ebb1-4a3e-865f-af3103478a91 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:48.741622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c450f7f-ebb1-4a3e-865f-af3103478a91 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:48.742104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c450f7f-ebb1-4a3e-865f-af3103478a91 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:48.743725 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 47/98] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:48.757003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03396052-2551-41a4-92fe-13c080957576 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:48.757907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03396052-2551-41a4-92fe-13c080957576 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:48.758400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03396052-2551-41a4-92fe-13c080957576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:48.783737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-03396052-2551-41a4-92fe-13c080957576 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:48.785806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-03396052-2551-41a4-92fe-13c080957576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:48.867675 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 52/99] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:49.181533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190d32c-0a67-4b22-b37c-306a36e89aa7 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:49.182175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190d32c-0a67-4b22-b37c-306a36e89aa7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:49.182656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190d32c-0a67-4b22-b37c-306a36e89aa7 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:49.184491 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 48/100] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:49.192606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66285653-0306-4895-8928-28278fe07738 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:49.193177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66285653-0306-4895-8928-28278fe07738 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:49.193651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66285653-0306-4895-8928-28278fe07738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:49.220023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-66285653-0306-4895-8928-28278fe07738 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:49.221622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-66285653-0306-4895-8928-28278fe07738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:49.257122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:49.318105 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 53/101] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:35:49.410704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190d32c-0a67-4b22-b37c-306a36e89aa7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:49.543878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190d32c-0a67-4b22-b37c-306a36e89aa7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:49.599758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:49.606568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2266bc-c938-4ab7-a59f-e0f42d125f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:49.607510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2266bc-c938-4ab7-a59f-e0f42d125f5b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:49.607801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2266bc-c938-4ab7-a59f-e0f42d125f5b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:49.608083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2266bc-c938-4ab7-a59f-e0f42d125f5b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:49.624615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2266bc-c938-4ab7-a59f-e0f42d125f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-2a2266bc-c938-4ab7-a59f-e0f42d125f5b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:49.629762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:49.630583 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:49.631457 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:49.631457 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:49.631457 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:49.631457 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:49.631457 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:49.631457 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:49.631457 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:49.631457 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:49.631457 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:49.631457 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:49.631457 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:35:49.631457 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:35:49.631457 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 49/102] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:49.637059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66285653-0306-4895-8928-28278fe07738 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:49.781439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66285653-0306-4895-8928-28278fe07738 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:49.829849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff30640-2ecb-4f8b-9bab-8119d1c012d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:49.830468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff30640-2ecb-4f8b-9bab-8119d1c012d3 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:49.830775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff30640-2ecb-4f8b-9bab-8119d1c012d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:49.831069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff30640-2ecb-4f8b-9bab-8119d1c012d3 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:49.832269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff30640-2ecb-4f8b-9bab-8119d1c012d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:49.832580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff30640-2ecb-4f8b-9bab-8119d1c012d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:49.834087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff30640-2ecb-4f8b-9bab-8119d1c012d3 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:49.848326 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 54/103] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:35:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:49.855833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2266bc-c938-4ab7-a59f-e0f42d125f5b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:49.974055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff30640-2ecb-4f8b-9bab-8119d1c012d3 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:50.021345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:50.035940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2266bc-c938-4ab7-a59f-e0f42d125f5b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:50.105096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371d923-c0fc-45fa-838e-4790839a987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:50.106418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d923-c0fc-45fa-838e-4790839a987b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:50.107017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d923-c0fc-45fa-838e-4790839a987b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:50.107501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d923-c0fc-45fa-838e-4790839a987b None admin] PATH_INFO: `/v3/users/49e7bcf41b994ca6aae62fb78071aa46` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:50.125926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371d923-c0fc-45fa-838e-4790839a987b None admin] RBAC: Authorizing `identity:get_user(user_id=49e7bcf41b994ca6aae62fb78071aa46)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:50.127104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff30640-2ecb-4f8b-9bab-8119d1c012d3 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:50.128003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371d923-c0fc-45fa-838e-4790839a987b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:50.134976 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 50/104] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:49 2022] GET /identity/v3/users/49e7bcf41b994ca6aae62fb78071aa46 => generated 289 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:50.136568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b762653-ba4b-4b46-bb70-37ef37f3eb1b None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:50.137053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b762653-ba4b-4b46-bb70-37ef37f3eb1b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:50.137564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b762653-ba4b-4b46-bb70-37ef37f3eb1b None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:50.139609 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 51/105] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:50.140946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cede0c-b1bd-4807-badf-6fd2ee3e4c84 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:50.141423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cede0c-b1bd-4807-badf-6fd2ee3e4c84 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:50.141886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cede0c-b1bd-4807-badf-6fd2ee3e4c84 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:50.143452 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 52/106] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:50.144477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cede0c-b1bd-4807-badf-6fd2ee3e4c84 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:50.167607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ec65a-0b07-4103-abb3-fbecf47b17f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:50.168548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ec65a-0b07-4103-abb3-fbecf47b17f0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:50.168654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ec65a-0b07-4103-abb3-fbecf47b17f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:50.168893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ec65a-0b07-4103-abb3-fbecf47b17f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:50.170072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ec65a-0b07-4103-abb3-fbecf47b17f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:50.171494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ec65a-0b07-4103-abb3-fbecf47b17f0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:50.173464 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 55/107] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:35:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:50.174465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a751-64d0-48bb-81df-504537a50812 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:50.174776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a751-64d0-48bb-81df-504537a50812 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:50.175064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a751-64d0-48bb-81df-504537a50812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:50.194799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7c84a751-64d0-48bb-81df-504537a50812 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:50.196090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7c84a751-64d0-48bb-81df-504537a50812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:50.202164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:50.258447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cede0c-b1bd-4807-badf-6fd2ee3e4c84 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:50.272399 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 56/108] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:50.273851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a7bd3-1b02-4865-8acf-5eb3f836b6b9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:50.274148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a7bd3-1b02-4865-8acf-5eb3f836b6b9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:50.274423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a7bd3-1b02-4865-8acf-5eb3f836b6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:50.294075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-795a7bd3-1b02-4865-8acf-5eb3f836b6b9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:50.295300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-795a7bd3-1b02-4865-8acf-5eb3f836b6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:50.297683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace9887-fb0b-4e2f-a183-90e6bd9ae129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:50.298631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace9887-fb0b-4e2f-a183-90e6bd9ae129 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:50.299161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace9887-fb0b-4e2f-a183-90e6bd9ae129 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:50.299623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace9887-fb0b-4e2f-a183-90e6bd9ae129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:50.312023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:50.371944 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 57/109] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:50.372711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a7bd3-1b02-4865-8acf-5eb3f836b6b9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:50.376932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace9887-fb0b-4e2f-a183-90e6bd9ae129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:50.378695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace9887-fb0b-4e2f-a183-90e6bd9ae129 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:50.431179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:50.487409 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 53/110] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:35:50.493947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace9887-fb0b-4e2f-a183-90e6bd9ae129 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:50.556560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a7bd3-1b02-4865-8acf-5eb3f836b6b9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:50.595267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9ee86-089a-4304-9688-bb2d7bff93c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:50.595920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9ee86-089a-4304-9688-bb2d7bff93c6 None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:50.596207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9ee86-089a-4304-9688-bb2d7bff93c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:50.596488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9ee86-089a-4304-9688-bb2d7bff93c6 None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:50.597271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9ee86-089a-4304-9688-bb2d7bff93c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:50.599536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9ee86-089a-4304-9688-bb2d7bff93c6 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:50.639541 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 58/111] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:35:50 2022] POST /identity/v3/projects => generated 302 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:35:50.640913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f84544-c92e-4550-a78f-808f384e90ca None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:50.641213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f84544-c92e-4550-a78f-808f384e90ca None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:50.641497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f84544-c92e-4550-a78f-808f384e90ca None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:50.644079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace9887-fb0b-4e2f-a183-90e6bd9ae129 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:50.648200 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 59/112] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:50.653938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b195017-4d95-466d-b232-b26a9b366a74 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:50.654234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b195017-4d95-466d-b232-b26a9b366a74 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:50.654514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b195017-4d95-466d-b232-b26a9b366a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:50.666340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:50.684417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3f17-8147-418c-83b6-3b35f77234cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:50.685553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3f17-8147-418c-83b6-3b35f77234cb None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:50.686059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3f17-8147-418c-83b6-3b35f77234cb None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:50.686525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3f17-8147-418c-83b6-3b35f77234cb None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:50.688038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c3f17-8147-418c-83b6-3b35f77234cb None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:50.689953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c3f17-8147-418c-83b6-3b35f77234cb None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:50.690067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7b195017-4d95-466d-b232-b26a9b366a74 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:50.692627 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 54/113] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:50 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:50.694950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7b195017-4d95-466d-b232-b26a9b366a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:50.698449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3f17-8147-418c-83b6-3b35f77234cb None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:50.732052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:50.798487 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 60/114] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 18:35:50.799423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b195017-4d95-466d-b232-b26a9b366a74 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:50.845508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3f17-8147-418c-83b6-3b35f77234cb None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:50.890519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594afe1c-c42b-4270-ae51-c489b431699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:50.891134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594afe1c-c42b-4270-ae51-c489b431699f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:50.891351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594afe1c-c42b-4270-ae51-c489b431699f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:50.891980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594afe1c-c42b-4270-ae51-c489b431699f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:50.892721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594afe1c-c42b-4270-ae51-c489b431699f None admin] RBAC: Adding query filter params (role.id=b23c0fe3d2bc47ada7cee9cb5db1638a, scope.project.id=fea2e1e9b16a4405b41888375f40c504, user.id=49e7bcf41b994ca6aae62fb78071aa46) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:50.893317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594afe1c-c42b-4270-ae51-c489b431699f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:50.895620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594afe1c-c42b-4270-ae51-c489b431699f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:50.901467 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 55/115] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:35:50 2022] GET /identity/v3/role_assignments?user.id=49e7bcf41b994ca6aae62fb78071aa46&scope.project.id=fea2e1e9b16a4405b41888375f40c504&role.id=b23c0fe3d2bc47ada7cee9cb5db1638a => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:50.902146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594afe1c-c42b-4270-ae51-c489b431699f None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:50.922303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b195017-4d95-466d-b232-b26a9b366a74 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:50.978659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb2fdb-271e-4a06-a82c-c44855702b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:50.979461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb2fdb-271e-4a06-a82c-c44855702b5c None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:50.979824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb2fdb-271e-4a06-a82c-c44855702b5c None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:50.980197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb2fdb-271e-4a06-a82c-c44855702b5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:50.980996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:50.999794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb2fdb-271e-4a06-a82c-c44855702b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-d5bb2fdb-271e-4a06-a82c-c44855702b5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:51.005184 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:51.006311 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:51.007283 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:51.007283 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:51.007283 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:51.007283 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:51.007283 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:51.007283 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:51.007283 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:51.007283 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:51.007283 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:51.007283 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:51.007283 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:35:51.007283 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:35:51.013527 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 61/116] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:51.013527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e6edb-0796-459b-b620-e63ab6604ca4 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:51.013527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e6edb-0796-459b-b620-e63ab6604ca4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:51.013527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e6edb-0796-459b-b620-e63ab6604ca4 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:51.013527 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 62/117] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:51.018783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7ee0a-54f8-4633-bebc-14bb1cde5052 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:51.019085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7ee0a-54f8-4633-bebc-14bb1cde5052 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:51.019397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7ee0a-54f8-4633-bebc-14bb1cde5052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:51.023144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:51.044241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-aff7ee0a-54f8-4633-bebc-14bb1cde5052 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:51.045665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aff7ee0a-54f8-4633-bebc-14bb1cde5052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:51.051793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594afe1c-c42b-4270-ae51-c489b431699f None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:51.100712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35b970-f268-44f5-a935-e07c9611fd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:51.101391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35b970-f268-44f5-a935-e07c9611fd85 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:51.101679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35b970-f268-44f5-a935-e07c9611fd85 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:51.101959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35b970-f268-44f5-a935-e07c9611fd85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:51.116025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35b970-f268-44f5-a935-e07c9611fd85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-4f35b970-f268-44f5-a935-e07c9611fd85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:51.123657 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:51.124497 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:51.125245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:51.125245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:51.125245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:51.125245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:51.125245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:51.125245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:51.125245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:51.125245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:51.125245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:51.125245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:51.125245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:51.125245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:35:51.125245 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 56/118] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:51.126319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35b970-f268-44f5-a935-e07c9611fd85 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:51.139358 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 63/119] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:51.140281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7ee0a-54f8-4633-bebc-14bb1cde5052 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:51.239477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35b970-f268-44f5-a935-e07c9611fd85 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:51.276392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79387306-d148-4e52-95e4-07e009fe9e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:51.277055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79387306-d148-4e52-95e4-07e009fe9e1b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:51.277994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79387306-d148-4e52-95e4-07e009fe9e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:51.277994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79387306-d148-4e52-95e4-07e009fe9e1b None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:51.278292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79387306-d148-4e52-95e4-07e009fe9e1b None admin] RBAC: Adding query filter params (name=member) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:51.278709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79387306-d148-4e52-95e4-07e009fe9e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:51.280213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79387306-d148-4e52-95e4-07e009fe9e1b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:51.292544 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 57/120] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:35:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:51.293338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79387306-d148-4e52-95e4-07e009fe9e1b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:51.298019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:51.376790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7ee0a-54f8-4633-bebc-14bb1cde5052 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:51.410561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79387306-d148-4e52-95e4-07e009fe9e1b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:51.445110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:51.449735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cec869-c487-4605-a752-0d6be4687c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:51.450445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cec869-c487-4605-a752-0d6be4687c3d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:51.450735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cec869-c487-4605-a752-0d6be4687c3d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:51.451051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cec869-c487-4605-a752-0d6be4687c3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:51.454125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdb684-65ec-41b5-9343-2d58c699671d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:51.455085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdb684-65ec-41b5-9343-2d58c699671d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:51.455571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdb684-65ec-41b5-9343-2d58c699671d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:51.456074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdb684-65ec-41b5-9343-2d58c699671d None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:51.457154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdb684-65ec-41b5-9343-2d58c699671d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:51.457768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdb684-65ec-41b5-9343-2d58c699671d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:51.459427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdb684-65ec-41b5-9343-2d58c699671d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:51.462765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cec869-c487-4605-a752-0d6be4687c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-17cec869-c487-4605-a752-0d6be4687c3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:51.467793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:51.468643 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:51.469372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:51.469372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:51.469372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:51.469372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:51.469372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:51.469372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:51.469372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:51.469372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:51.469372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:51.469372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:51.469372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:35:51.469372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:35:51.469372 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 58/121] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:35:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:51.469982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cec869-c487-4605-a752-0d6be4687c3d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:51.471649 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 64/122] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:51.481564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdb684-65ec-41b5-9343-2d58c699671d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:51.543123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:51.599617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cec869-c487-4605-a752-0d6be4687c3d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:51.638657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f2b6e-a1f1-421b-b03c-5e176097740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:51.639573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f2b6e-a1f1-421b-b03c-5e176097740c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:51.640007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f2b6e-a1f1-421b-b03c-5e176097740c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:51.640433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f2b6e-a1f1-421b-b03c-5e176097740c None admin] PATH_INFO: `/v3/users/0489bf2a330a4690b46f44735ab56fb3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:51.641814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f2b6e-a1f1-421b-b03c-5e176097740c None admin] RBAC: Authorizing `identity:get_user(user_id=0489bf2a330a4690b46f44735ab56fb3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:51.643536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f2b6e-a1f1-421b-b03c-5e176097740c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:51.646195 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 59/123] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:51 2022] GET /identity/v3/users/0489bf2a330a4690b46f44735ab56fb3 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:51.647203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f2b6e-a1f1-421b-b03c-5e176097740c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:51.664539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdb684-65ec-41b5-9343-2d58c699671d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:51.701614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b467d-7693-488f-8e7f-a4db6239f1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:51.702237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b467d-7693-488f-8e7f-a4db6239f1ce None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:51.702525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b467d-7693-488f-8e7f-a4db6239f1ce None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:51.702830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b467d-7693-488f-8e7f-a4db6239f1ce None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:51.703508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b467d-7693-488f-8e7f-a4db6239f1ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:51.703824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b467d-7693-488f-8e7f-a4db6239f1ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:51.705337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b467d-7693-488f-8e7f-a4db6239f1ce None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:51.714568 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 65/124] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:35:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:51.715300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b467d-7693-488f-8e7f-a4db6239f1ce None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:51.758194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f2b6e-a1f1-421b-b03c-5e176097740c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:51.764503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:51.792054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:51.798668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ecee-39b1-4f79-b344-71c0cdcb2784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:51.799637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ecee-39b1-4f79-b344-71c0cdcb2784 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:51.800102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ecee-39b1-4f79-b344-71c0cdcb2784 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:51.800738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ecee-39b1-4f79-b344-71c0cdcb2784 None admin] PATH_INFO: `/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:51.802589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ecee-39b1-4f79-b344-71c0cdcb2784 None admin] RBAC: Authorizing `identity:get_user(user_id=60fe26b30a2d4d8bbf2347a182f6c4a7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:51.804450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ecee-39b1-4f79-b344-71c0cdcb2784 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:51.806338 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 60/125] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:51 2022] GET /identity/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:51.807464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ecee-39b1-4f79-b344-71c0cdcb2784 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:51.825390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b467d-7693-488f-8e7f-a4db6239f1ce None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:51.862549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178bb21-6173-4459-9ede-a37e9013222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:51.863967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178bb21-6173-4459-9ede-a37e9013222d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:51.864250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178bb21-6173-4459-9ede-a37e9013222d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:51.864531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178bb21-6173-4459-9ede-a37e9013222d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:51.875755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178bb21-6173-4459-9ede-a37e9013222d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-9178bb21-6173-4459-9ede-a37e9013222d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:51.882378 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:51.883254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:51.883991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:51.883991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:51.883991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:51.883991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:51.883991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:51.883991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:51.883991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:51.883991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:51.883991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:51.883991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:51.883991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:35:51.883991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:35:51.883991 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 66/126] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:51.884612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178bb21-6173-4459-9ede-a37e9013222d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:51.929138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ecee-39b1-4f79-b344-71c0cdcb2784 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:51.968803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa62e0-3366-4cd8-9f9a-18ef85a0c550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:51.969774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa62e0-3366-4cd8-9f9a-18ef85a0c550 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:51.970272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa62e0-3366-4cd8-9f9a-18ef85a0c550 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:51.970760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa62e0-3366-4cd8-9f9a-18ef85a0c550 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:51.972136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa62e0-3366-4cd8-9f9a-18ef85a0c550 None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:51.974621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa62e0-3366-4cd8-9f9a-18ef85a0c550 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:51.976707 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 61/127] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:51 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:51.977796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa62e0-3366-4cd8-9f9a-18ef85a0c550 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:52.007280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178bb21-6173-4459-9ede-a37e9013222d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:52.037719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:52.045813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39922349-40da-4015-9af0-9764597f0b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:52.046459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39922349-40da-4015-9af0-9764597f0b8f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:52.046773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39922349-40da-4015-9af0-9764597f0b8f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:52.047089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39922349-40da-4015-9af0-9764597f0b8f None admin] PATH_INFO: `/v3/users/0489bf2a330a4690b46f44735ab56fb3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:52.048542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39922349-40da-4015-9af0-9764597f0b8f None admin] RBAC: Authorizing `identity:get_user(user_id=0489bf2a330a4690b46f44735ab56fb3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:52.049476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:52.051846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39922349-40da-4015-9af0-9764597f0b8f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:52.054457 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 67/128] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:51 2022] GET /identity/v3/users/0489bf2a330a4690b46f44735ab56fb3 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:52.055208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39922349-40da-4015-9af0-9764597f0b8f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:52.088045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa62e0-3366-4cd8-9f9a-18ef85a0c550 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:52.126455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54030a97-e84b-487f-8646-994d24ea94e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:52.127879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54030a97-e84b-487f-8646-994d24ea94e7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:52.128452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54030a97-e84b-487f-8646-994d24ea94e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:52.129080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54030a97-e84b-487f-8646-994d24ea94e7 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:52.131525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54030a97-e84b-487f-8646-994d24ea94e7 None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:52.133503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54030a97-e84b-487f-8646-994d24ea94e7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:52.136823 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 62/129] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:51 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:52.137866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54030a97-e84b-487f-8646-994d24ea94e7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:52.176991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39922349-40da-4015-9af0-9764597f0b8f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:52.219088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d827d-7f3e-42e3-a679-cad2241dcf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:52.219734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d827d-7f3e-42e3-a679-cad2241dcf37 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:52.220044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d827d-7f3e-42e3-a679-cad2241dcf37 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:52.220328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d827d-7f3e-42e3-a679-cad2241dcf37 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:52.221001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d827d-7f3e-42e3-a679-cad2241dcf37 None admin] RBAC: Adding query filter params (name=member) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:52.221312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d827d-7f3e-42e3-a679-cad2241dcf37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:52.223571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d827d-7f3e-42e3-a679-cad2241dcf37 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:52.232282 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 68/130] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:35:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:52.232904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d827d-7f3e-42e3-a679-cad2241dcf37 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:52.256341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54030a97-e84b-487f-8646-994d24ea94e7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:52.283092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:52.299066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd86cf-e70c-4150-87df-aefdacbdcb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:52.299980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd86cf-e70c-4150-87df-aefdacbdcb77 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:52.300674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd86cf-e70c-4150-87df-aefdacbdcb77 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:52.301114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd86cf-e70c-4150-87df-aefdacbdcb77 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504/users/0489bf2a330a4690b46f44735ab56fb3/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:52.304007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd86cf-e70c-4150-87df-aefdacbdcb77 None admin] RBAC: Authorizing `identity:create_grant(project_id=fea2e1e9b16a4405b41888375f40c504, user_id=0489bf2a330a4690b46f44735ab56fb3, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:52.306172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd86cf-e70c-4150-87df-aefdacbdcb77 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:52.308980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:52.324347 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 63/131] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:35:52 2022] PUT /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504/users/0489bf2a330a4690b46f44735ab56fb3/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:52.325457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd86cf-e70c-4150-87df-aefdacbdcb77 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:52.384066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d827d-7f3e-42e3-a679-cad2241dcf37 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:52.455520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd86cf-e70c-4150-87df-aefdacbdcb77 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:52.479640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03849dc6-f42d-4a75-9889-ef68d5a85c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:52.480638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03849dc6-f42d-4a75-9889-ef68d5a85c48 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:52.480957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03849dc6-f42d-4a75-9889-ef68d5a85c48 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:52.481592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03849dc6-f42d-4a75-9889-ef68d5a85c48 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:52.484905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03849dc6-f42d-4a75-9889-ef68d5a85c48 None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:52.486466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03849dc6-f42d-4a75-9889-ef68d5a85c48 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:52.488773 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 69/132] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:52 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:52.489640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03849dc6-f42d-4a75-9889-ef68d5a85c48 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:52.498120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2906e0b-d7de-4174-b3bc-7177f95d46c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:52.499193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2906e0b-d7de-4174-b3bc-7177f95d46c5 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:52.499672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2906e0b-d7de-4174-b3bc-7177f95d46c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:52.500402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2906e0b-d7de-4174-b3bc-7177f95d46c5 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504/users/60fe26b30a2d4d8bbf2347a182f6c4a7/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:52.502597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2906e0b-d7de-4174-b3bc-7177f95d46c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fea2e1e9b16a4405b41888375f40c504, user_id=60fe26b30a2d4d8bbf2347a182f6c4a7, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:52.505884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2906e0b-d7de-4174-b3bc-7177f95d46c5 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:52.556437 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 64/133] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:35:52 2022] PUT /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504/users/60fe26b30a2d4d8bbf2347a182f6c4a7/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:52.557636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2906e0b-d7de-4174-b3bc-7177f95d46c5 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:52.646095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:52.648663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03849dc6-f42d-4a75-9889-ef68d5a85c48 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:52.679150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:52.697680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4e464-c918-4916-92c6-5c0e619fad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:52.698602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4e464-c918-4916-92c6-5c0e619fad17 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:52.698941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4e464-c918-4916-92c6-5c0e619fad17 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:52.699820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4e464-c918-4916-92c6-5c0e619fad17 None admin] PATH_INFO: `/v3/users/0489bf2a330a4690b46f44735ab56fb3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:52.707215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4e464-c918-4916-92c6-5c0e619fad17 None admin] RBAC: Authorizing `identity:get_user(user_id=0489bf2a330a4690b46f44735ab56fb3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:52.707215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4e464-c918-4916-92c6-5c0e619fad17 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:52.707215 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 70/134] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:52 2022] GET /identity/v3/users/0489bf2a330a4690b46f44735ab56fb3 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:52.713618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4e464-c918-4916-92c6-5c0e619fad17 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:52.732346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2906e0b-d7de-4174-b3bc-7177f95d46c5 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:52.794697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd815c-7bde-4899-95b3-4c25b0e36ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:52.795656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd815c-7bde-4899-95b3-4c25b0e36ea8 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:52.796085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd815c-7bde-4899-95b3-4c25b0e36ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:52.796724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd815c-7bde-4899-95b3-4c25b0e36ea8 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504/users/0489bf2a330a4690b46f44735ab56fb3/roles/9e9271d4f0cd4c5688279b54d26e079f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:52.801902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd815c-7bde-4899-95b3-4c25b0e36ea8 None admin] RBAC: Authorizing `identity:create_grant(project_id=fea2e1e9b16a4405b41888375f40c504, user_id=0489bf2a330a4690b46f44735ab56fb3, role_id=9e9271d4f0cd4c5688279b54d26e079f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:52.803886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd815c-7bde-4899-95b3-4c25b0e36ea8 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:52.829204 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 65/135] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:35:52 2022] PUT /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504/users/0489bf2a330a4690b46f44735ab56fb3/roles/9e9271d4f0cd4c5688279b54d26e079f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:52.948423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4e464-c918-4916-92c6-5c0e619fad17 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:53.001736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b65917-ec50-44fa-8a31-d0d2d7923cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:53.002400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65917-ec50-44fa-8a31-d0d2d7923cbb None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:53.002687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65917-ec50-44fa-8a31-d0d2d7923cbb None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:53.003010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65917-ec50-44fa-8a31-d0d2d7923cbb None admin] PATH_INFO: `/v3/projects/012183641bb945f19dcace487a5df1a0` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:53.004754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b65917-ec50-44fa-8a31-d0d2d7923cbb None admin] RBAC: Authorizing `identity:get_project(project_id=012183641bb945f19dcace487a5df1a0)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:53.006247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b65917-ec50-44fa-8a31-d0d2d7923cbb None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:53.012089 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 71/136] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:52 2022] GET /identity/v3/projects/012183641bb945f19dcace487a5df1a0 => generated 312 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:53.018135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd815c-7bde-4899-95b3-4c25b0e36ea8 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:53.098857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff143d61-3a0b-4027-b8ea-621a5593069b None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:53.098857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff143d61-3a0b-4027-b8ea-621a5593069b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:53.098857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff143d61-3a0b-4027-b8ea-621a5593069b None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:53.099589 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 72/137] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:53.105186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fcc6e-86e0-4067-9517-b8b2f9353039 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:53.105516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fcc6e-86e0-4067-9517-b8b2f9353039 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:53.105907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fcc6e-86e0-4067-9517-b8b2f9353039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:53.125156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-540fcc6e-86e0-4067-9517-b8b2f9353039 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:53.126505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-540fcc6e-86e0-4067-9517-b8b2f9353039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:53.192729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:53.196379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd815c-7bde-4899-95b3-4c25b0e36ea8 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:53.215217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:53.239640 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 73/138] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:35:53.240771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a4b59-7eaa-4299-9f30-d9f7d9260ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:53.241021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662ca9f-d561-4870-94ab-c2cdde2b4317 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:53.241318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662ca9f-d561-4870-94ab-c2cdde2b4317 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:53.241598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662ca9f-d561-4870-94ab-c2cdde2b4317 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:53.241694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4b59-7eaa-4299-9f30-d9f7d9260ffd None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:53.241903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4b59-7eaa-4299-9f30-d9f7d9260ffd None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:53.242183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4b59-7eaa-4299-9f30-d9f7d9260ffd None admin] PATH_INFO: `/v3/projects/012183641bb945f19dcace487a5df1a0/users/0489bf2a330a4690b46f44735ab56fb3/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:53.247046 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 74/139] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:53.252080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a4b59-7eaa-4299-9f30-d9f7d9260ffd None admin] RBAC: Authorizing `identity:create_grant(project_id=012183641bb945f19dcace487a5df1a0, user_id=0489bf2a330a4690b46f44735ab56fb3, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:53.253605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a4b59-7eaa-4299-9f30-d9f7d9260ffd None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:53.257421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9afb4-8d93-4dac-a7a8-e1c039119520 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:53.257704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9afb4-8d93-4dac-a7a8-e1c039119520 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:53.257976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9afb4-8d93-4dac-a7a8-e1c039119520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:53.280119 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 66/140] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:35:53 2022] PUT /identity/v3/projects/012183641bb945f19dcace487a5df1a0/users/0489bf2a330a4690b46f44735ab56fb3/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:53.289043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1be9afb4-8d93-4dac-a7a8-e1c039119520 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:53.290363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1be9afb4-8d93-4dac-a7a8-e1c039119520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:53.379335 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 75/141] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:35:53.689164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a4b59-7eaa-4299-9f30-d9f7d9260ffd None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:53.789389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9afb4-8d93-4dac-a7a8-e1c039119520 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:53.833052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a4b59-7eaa-4299-9f30-d9f7d9260ffd None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:53.949720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d237c56-a896-496b-b175-53d10885d3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:53.950290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d237c56-a896-496b-b175-53d10885d3e6 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:53.950573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d237c56-a896-496b-b175-53d10885d3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:53.950895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d237c56-a896-496b-b175-53d10885d3e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:53.956848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d237c56-a896-496b-b175-53d10885d3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:53.956848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d237c56-a896-496b-b175-53d10885d3e6 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:53.957414 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 67/142] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:35:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:53.967170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d237c56-a896-496b-b175-53d10885d3e6 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:53.973141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:53.979475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9afb4-8d93-4dac-a7a8-e1c039119520 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:54.040229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7dd05-bca4-4454-a3c0-d4fbb3630375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:54.041231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7dd05-bca4-4454-a3c0-d4fbb3630375 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:54.041706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7dd05-bca4-4454-a3c0-d4fbb3630375 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:54.042170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7dd05-bca4-4454-a3c0-d4fbb3630375 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:54.054255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7dd05-bca4-4454-a3c0-d4fbb3630375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-7ae7dd05-bca4-4454-a3c0-d4fbb3630375 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:54.059824 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:54.060661 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:54.061389 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:54.061389 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:54.061389 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:54.061389 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:54.061389 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:54.061389 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:54.061389 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:54.061389 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:54.061389 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:54.061389 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:54.061389 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:35:54.061389 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:35:54.064032 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 76/143] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:54.070388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7dd05-bca4-4454-a3c0-d4fbb3630375 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:54.083459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:54.188633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d237c56-a896-496b-b175-53d10885d3e6 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:54.254632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c3030-3829-4f4b-9e68-3fb32f7b5ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:54.256502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c3030-3829-4f4b-9e68-3fb32f7b5ab7 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:54.257537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c3030-3829-4f4b-9e68-3fb32f7b5ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:54.258168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c3030-3829-4f4b-9e68-3fb32f7b5ab7 None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:54.260353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c3030-3829-4f4b-9e68-3fb32f7b5ab7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:54.261291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7dd05-bca4-4454-a3c0-d4fbb3630375 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:54.264467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c3030-3829-4f4b-9e68-3fb32f7b5ab7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:54.311760 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 68/144] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:35:53 2022] POST /identity/v3/users => generated 283 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:35:54.341884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195f49b-eca5-41c9-bb8d-cd02e897eb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:54.342529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195f49b-eca5-41c9-bb8d-cd02e897eb9c None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:54.342839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195f49b-eca5-41c9-bb8d-cd02e897eb9c None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:54.343120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195f49b-eca5-41c9-bb8d-cd02e897eb9c None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:54.343809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195f49b-eca5-41c9-bb8d-cd02e897eb9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:54.344118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195f49b-eca5-41c9-bb8d-cd02e897eb9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:54.345532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195f49b-eca5-41c9-bb8d-cd02e897eb9c None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:54.362321 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 77/145] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:35:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:54.369169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c3030-3829-4f4b-9e68-3fb32f7b5ab7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:54.504355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:54.509343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c3030-3829-4f4b-9e68-3fb32f7b5ab7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:54.552669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b3766-b11f-4fb4-8ab2-9f4a3e0b47f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:54.553327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b3766-b11f-4fb4-8ab2-9f4a3e0b47f5 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:54.553610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b3766-b11f-4fb4-8ab2-9f4a3e0b47f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:54.553885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b3766-b11f-4fb4-8ab2-9f4a3e0b47f5 None admin] PATH_INFO: `/v3/users/49e7bcf41b994ca6aae62fb78071aa46` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:54.559656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b3766-b11f-4fb4-8ab2-9f4a3e0b47f5 None admin] RBAC: Authorizing `identity:get_user(user_id=49e7bcf41b994ca6aae62fb78071aa46)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:54.561173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b3766-b11f-4fb4-8ab2-9f4a3e0b47f5 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:54.562899 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 69/146] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:54 2022] GET /identity/v3/users/49e7bcf41b994ca6aae62fb78071aa46 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:54.571901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195f49b-eca5-41c9-bb8d-cd02e897eb9c None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:54.637575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:54.746776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195f49b-eca5-41c9-bb8d-cd02e897eb9c None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:54.794129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca531c-c796-4f66-8769-d24b6dc639ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:54.794692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca531c-c796-4f66-8769-d24b6dc639ad None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:54.795006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca531c-c796-4f66-8769-d24b6dc639ad None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:54.795292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca531c-c796-4f66-8769-d24b6dc639ad None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:54.796475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca531c-c796-4f66-8769-d24b6dc639ad None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:54.797928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca531c-c796-4f66-8769-d24b6dc639ad None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:54.799604 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 78/147] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:54 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:54.806153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b3766-b11f-4fb4-8ab2-9f4a3e0b47f5 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:54.962921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b3766-b11f-4fb4-8ab2-9f4a3e0b47f5 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:55.014729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2db4fc-d4e7-4920-8768-c97f2e079625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:55.015930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2db4fc-d4e7-4920-8768-c97f2e079625 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:55.016414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2db4fc-d4e7-4920-8768-c97f2e079625 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:55.016909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2db4fc-d4e7-4920-8768-c97f2e079625 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504/users/49e7bcf41b994ca6aae62fb78071aa46/roles/b23c0fe3d2bc47ada7cee9cb5db1638a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:55.019692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2db4fc-d4e7-4920-8768-c97f2e079625 None admin] RBAC: Authorizing `identity:create_grant(project_id=fea2e1e9b16a4405b41888375f40c504, user_id=49e7bcf41b994ca6aae62fb78071aa46, role_id=b23c0fe3d2bc47ada7cee9cb5db1638a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:55.021378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2db4fc-d4e7-4920-8768-c97f2e079625 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:55.051719 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 70/148] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:35:54 2022] PUT /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504/users/49e7bcf41b994ca6aae62fb78071aa46/roles/b23c0fe3d2bc47ada7cee9cb5db1638a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:35:55.197285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725995f7-3701-49c9-959a-0ddd58ab5d81 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:55.197811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725995f7-3701-49c9-959a-0ddd58ab5d81 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:55.197892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725995f7-3701-49c9-959a-0ddd58ab5d81 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:55.199317 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 79/149] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:55.213665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15a1ef-df12-482c-b0e4-5dda09c6eab1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:55.214642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15a1ef-df12-482c-b0e4-5dda09c6eab1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:55.215181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15a1ef-df12-482c-b0e4-5dda09c6eab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:55.243912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-dc15a1ef-df12-482c-b0e4-5dda09c6eab1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:55.245498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dc15a1ef-df12-482c-b0e4-5dda09c6eab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:55.270523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:55.328663 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 71/150] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:55.514677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f03776-d6ad-4b11-8765-ce2b3ab8fede None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:55.515054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f03776-d6ad-4b11-8765-ce2b3ab8fede None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:55.515278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f03776-d6ad-4b11-8765-ce2b3ab8fede None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:55.516885 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 80/151] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:55.523339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd17c0-0b56-4dd5-a8ba-8df1a73629ed None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:55.523650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd17c0-0b56-4dd5-a8ba-8df1a73629ed None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:55.523908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd17c0-0b56-4dd5-a8ba-8df1a73629ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:55.543271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7fdd17c0-0b56-4dd5-a8ba-8df1a73629ed None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:55.544468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7fdd17c0-0b56-4dd5-a8ba-8df1a73629ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:55.641195 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 72/152] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:55.684507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f03776-d6ad-4b11-8765-ce2b3ab8fede None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:55.725898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0ca1b-f04c-4af1-a21f-79ad365adf2b None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:55.726236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0ca1b-f04c-4af1-a21f-79ad365adf2b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:55.726458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0ca1b-f04c-4af1-a21f-79ad365adf2b None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:55.728053 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 73/153] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:55.739816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa982d0-79e4-4d5b-b864-6f1bcee79989 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:55.740096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa982d0-79e4-4d5b-b864-6f1bcee79989 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:55.740366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa982d0-79e4-4d5b-b864-6f1bcee79989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:55.787631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2fa982d0-79e4-4d5b-b864-6f1bcee79989 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:55.788811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2fa982d0-79e4-4d5b-b864-6f1bcee79989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:55.807252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:55.827222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f03776-d6ad-4b11-8765-ce2b3ab8fede None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:55.880869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a417ed-255f-4615-96c3-684ed90a7085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:55.881754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a417ed-255f-4615-96c3-684ed90a7085 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:55.882040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a417ed-255f-4615-96c3-684ed90a7085 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:55.882319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a417ed-255f-4615-96c3-684ed90a7085 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:55.899403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a417ed-255f-4615-96c3-684ed90a7085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-78a417ed-255f-4615-96c3-684ed90a7085 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:55.904351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:55.905205 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:55.905967 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:55.905967 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:55.905967 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:55.905967 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:55.905967 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:55.905967 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:55.905967 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:55.905967 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:55.905967 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:55.905967 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:55.905967 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:35:55.905967 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:35:55.905967 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 81/154] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:55.912666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a417ed-255f-4615-96c3-684ed90a7085 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:55.953083 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 74/155] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 18:35:56.023830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa982d0-79e4-4d5b-b864-6f1bcee79989 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:56.068856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:56.069329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a417ed-255f-4615-96c3-684ed90a7085 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:56.118729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29be4-df7f-4311-89ea-32b27bf4c77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:56.120189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29be4-df7f-4311-89ea-32b27bf4c77d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:56.120649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29be4-df7f-4311-89ea-32b27bf4c77d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:56.121080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29be4-df7f-4311-89ea-32b27bf4c77d None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:56.121934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f29be4-df7f-4311-89ea-32b27bf4c77d None admin] RBAC: Adding query filter params (name=member) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:56.122391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f29be4-df7f-4311-89ea-32b27bf4c77d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:56.124297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f29be4-df7f-4311-89ea-32b27bf4c77d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:56.134839 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 82/156] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:35:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:56.143776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29be4-df7f-4311-89ea-32b27bf4c77d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:56.175149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:56.260097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa982d0-79e4-4d5b-b864-6f1bcee79989 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:56.342115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb053d-8e64-4ee9-91f2-dfaca9d9097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:56.342784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb053d-8e64-4ee9-91f2-dfaca9d9097d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:56.343070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb053d-8e64-4ee9-91f2-dfaca9d9097d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:56.343346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb053d-8e64-4ee9-91f2-dfaca9d9097d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:56.358617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29be4-df7f-4311-89ea-32b27bf4c77d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:56.376261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb053d-8e64-4ee9-91f2-dfaca9d9097d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-22cb053d-8e64-4ee9-91f2-dfaca9d9097d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:56.381531 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:56.382600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:56.383470 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:56.383470 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:56.383470 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:56.383470 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:56.383470 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:56.383470 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:56.383470 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:56.383470 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:56.383470 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:56.383470 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:56.383470 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:56.383470 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:35:56.383470 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 75/157] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:35:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:56.389377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb053d-8e64-4ee9-91f2-dfaca9d9097d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:56.430601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6f19d-0341-4551-b0f0-12970d193e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:56.431328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6f19d-0341-4551-b0f0-12970d193e31 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:56.431623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6f19d-0341-4551-b0f0-12970d193e31 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:56.431923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6f19d-0341-4551-b0f0-12970d193e31 None admin] PATH_INFO: `/v3/users/0489bf2a330a4690b46f44735ab56fb3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:56.433118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6f19d-0341-4551-b0f0-12970d193e31 None admin] RBAC: Authorizing `identity:get_user(user_id=0489bf2a330a4690b46f44735ab56fb3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:56.434883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6f19d-0341-4551-b0f0-12970d193e31 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:56.436820 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 83/158] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:56 2022] GET /identity/v3/users/0489bf2a330a4690b46f44735ab56fb3 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:56.448886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6f19d-0341-4551-b0f0-12970d193e31 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:56.534496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:56.569363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:56.604593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb053d-8e64-4ee9-91f2-dfaca9d9097d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:56.618366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6f19d-0341-4551-b0f0-12970d193e31 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:56.671535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09099ea-595c-40d1-9e2a-98ed69d1a9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:56.672374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09099ea-595c-40d1-9e2a-98ed69d1a9ce None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:56.672807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09099ea-595c-40d1-9e2a-98ed69d1a9ce None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:56.673225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09099ea-595c-40d1-9e2a-98ed69d1a9ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:56.673606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ea6d1-907c-474f-bca1-c746ca92d698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:56.674468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ea6d1-907c-474f-bca1-c746ca92d698 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:56.674991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ea6d1-907c-474f-bca1-c746ca92d698 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:56.675516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ea6d1-907c-474f-bca1-c746ca92d698 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:56.676518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ea6d1-907c-474f-bca1-c746ca92d698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:56.677081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ea6d1-907c-474f-bca1-c746ca92d698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:56.678694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ea6d1-907c-474f-bca1-c746ca92d698 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:56.694897 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 76/159] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:56.696116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ea6d1-907c-474f-bca1-c746ca92d698 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:56.819544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09099ea-595c-40d1-9e2a-98ed69d1a9ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:56.821029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09099ea-595c-40d1-9e2a-98ed69d1a9ce None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:56.833893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ea6d1-907c-474f-bca1-c746ca92d698 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:56.869699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2fdac-fa22-464f-bf19-cddc06e3dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:56.870685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2fdac-fa22-464f-bf19-cddc06e3dc15 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:56.871216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2fdac-fa22-464f-bf19-cddc06e3dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:56.871704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2fdac-fa22-464f-bf19-cddc06e3dc15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:56.879810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:56.884799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2fdac-fa22-464f-bf19-cddc06e3dc15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-27b2fdac-fa22-464f-bf19-cddc06e3dc15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:56.890027 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:56.890975 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:56.891747 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:56.891747 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:56.891747 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:56.891747 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:56.891747 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:56.891747 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:56.891747 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:56.891747 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:56.891747 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:56.891747 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:56.891747 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:35:56.891747 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:35:56.894123 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 77/160] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:35:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:56.895704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2fdac-fa22-464f-bf19-cddc06e3dc15 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:56.979184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:57.012105 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 84/161] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 18:35:57.012982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09099ea-595c-40d1-9e2a-98ed69d1a9ce None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:57.111737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2fdac-fa22-464f-bf19-cddc06e3dc15 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:57.158279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09099ea-595c-40d1-9e2a-98ed69d1a9ce None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:57.233944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13384c7b-e16a-4674-af3f-473bbcd8073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:57.234513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384c7b-e16a-4674-af3f-473bbcd8073f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:57.234825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384c7b-e16a-4674-af3f-473bbcd8073f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:57.235109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384c7b-e16a-4674-af3f-473bbcd8073f None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:57.235520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00afe68-dd21-4e3a-afd0-759b754992ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:57.235808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13384c7b-e16a-4674-af3f-473bbcd8073f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:57.236121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13384c7b-e16a-4674-af3f-473bbcd8073f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:57.236219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00afe68-dd21-4e3a-afd0-759b754992ac None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:57.236454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00afe68-dd21-4e3a-afd0-759b754992ac None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:57.236731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00afe68-dd21-4e3a-afd0-759b754992ac None admin] PATH_INFO: `/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:57.237570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13384c7b-e16a-4674-af3f-473bbcd8073f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:57.243568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00afe68-dd21-4e3a-afd0-759b754992ac None admin] RBAC: Authorizing `identity:get_user(user_id=60fe26b30a2d4d8bbf2347a182f6c4a7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:57.245062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00afe68-dd21-4e3a-afd0-759b754992ac None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:57.246907 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 78/162] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:56 2022] GET /identity/v3/users/60fe26b30a2d4d8bbf2347a182f6c4a7 => generated 247 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:57.247513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00afe68-dd21-4e3a-afd0-759b754992ac None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:57.249812 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 85/163] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:35:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:57.251114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7589ac-1854-4811-88bf-09c79996f3f6 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:57.251408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7589ac-1854-4811-88bf-09c79996f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:57.251690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7589ac-1854-4811-88bf-09c79996f3f6 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:57.252922 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 86/164] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:57.253761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7589ac-1854-4811-88bf-09c79996f3f6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:57.347229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:57.458392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:57.464837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7589ac-1854-4811-88bf-09c79996f3f6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:57.533574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00afe68-dd21-4e3a-afd0-759b754992ac None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:57.537511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a887b7-2899-4455-a89e-46f2c582cce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:57.538134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a887b7-2899-4455-a89e-46f2c582cce9 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:57.538413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a887b7-2899-4455-a89e-46f2c582cce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:57.538682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a887b7-2899-4455-a89e-46f2c582cce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:57.603646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5465b62-3081-4507-979e-25690b817bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:57.604421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465b62-3081-4507-979e-25690b817bf0 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:57.604708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465b62-3081-4507-979e-25690b817bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:57.605158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5465b62-3081-4507-979e-25690b817bf0 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:57.606338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5465b62-3081-4507-979e-25690b817bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:57.607836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5465b62-3081-4507-979e-25690b817bf0 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:57.609582 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 79/165] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:57 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:57.611447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907c53-09e9-4c46-957f-4480c4bb3cf3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:57.611904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907c53-09e9-4c46-957f-4480c4bb3cf3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:57.612191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907c53-09e9-4c46-957f-4480c4bb3cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:57.645746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8d907c53-09e9-4c46-957f-4480c4bb3cf3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:57.647368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8d907c53-09e9-4c46-957f-4480c4bb3cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:57.717528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a887b7-2899-4455-a89e-46f2c582cce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:57.719174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a887b7-2899-4455-a89e-46f2c582cce9 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:57.776760 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 80/166] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:57.777631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d907c53-09e9-4c46-957f-4480c4bb3cf3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:57.819280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:57.879318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:57.936078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d907c53-09e9-4c46-957f-4480c4bb3cf3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:57.982959 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 87/167] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:35:57.984188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a887b7-2899-4455-a89e-46f2c582cce9 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:57.993525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde45f7-5998-4899-824d-b8e29604af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:57.994433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde45f7-5998-4899-824d-b8e29604af44 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:57.994919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde45f7-5998-4899-824d-b8e29604af44 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:57.995390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde45f7-5998-4899-824d-b8e29604af44 None admin] PATH_INFO: `/v3/users/0489bf2a330a4690b46f44735ab56fb3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:57.999465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde45f7-5998-4899-824d-b8e29604af44 None admin] RBAC: Authorizing `identity:get_user(user_id=0489bf2a330a4690b46f44735ab56fb3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:58.001133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde45f7-5998-4899-824d-b8e29604af44 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:58.002988 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 81/168] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:57 2022] GET /identity/v3/users/0489bf2a330a4690b46f44735ab56fb3 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:58.004676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde45f7-5998-4899-824d-b8e29604af44 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:58.092365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a887b7-2899-4455-a89e-46f2c582cce9 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:58.127832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226cef-1c58-44cc-b8aa-f974a649dbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:58.128756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226cef-1c58-44cc-b8aa-f974a649dbae None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:58.129204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226cef-1c58-44cc-b8aa-f974a649dbae None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:58.129656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226cef-1c58-44cc-b8aa-f974a649dbae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:58.130507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226cef-1c58-44cc-b8aa-f974a649dbae None admin] RBAC: Adding query filter params (role.id=24fee0983ae345c288f4974d93a3805d, scope.project.id=fea2e1e9b16a4405b41888375f40c504, user.id=0489bf2a330a4690b46f44735ab56fb3) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:58.130988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226cef-1c58-44cc-b8aa-f974a649dbae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:58.132644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226cef-1c58-44cc-b8aa-f974a649dbae None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:58.138780 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 88/169] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:35:57 2022] GET /identity/v3/role_assignments?user.id=0489bf2a330a4690b46f44735ab56fb3&scope.project.id=fea2e1e9b16a4405b41888375f40c504&role.id=24fee0983ae345c288f4974d93a3805d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:58.143826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226cef-1c58-44cc-b8aa-f974a649dbae None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:58.154944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:58.172913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde45f7-5998-4899-824d-b8e29604af44 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:58.239265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:58.253869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40226f0a-ae60-4dd5-8afc-c26b5dc2bb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:58.254577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40226f0a-ae60-4dd5-8afc-c26b5dc2bb6a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:58.254882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40226f0a-ae60-4dd5-8afc-c26b5dc2bb6a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:58.255153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40226f0a-ae60-4dd5-8afc-c26b5dc2bb6a None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:58.256291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40226f0a-ae60-4dd5-8afc-c26b5dc2bb6a None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:58.257732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40226f0a-ae60-4dd5-8afc-c26b5dc2bb6a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:58.267960 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 82/170] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:58 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:58.297024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226cef-1c58-44cc-b8aa-f974a649dbae None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:58.304700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40226f0a-ae60-4dd5-8afc-c26b5dc2bb6a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:58.334804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486c1a2-84ff-4263-8129-886fd3a40903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:58.335833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486c1a2-84ff-4263-8129-886fd3a40903 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:58.336256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486c1a2-84ff-4263-8129-886fd3a40903 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:58.336670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486c1a2-84ff-4263-8129-886fd3a40903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:58.413104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486c1a2-84ff-4263-8129-886fd3a40903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:58.414817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486c1a2-84ff-4263-8129-886fd3a40903 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:58.423453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:58.512777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40226f0a-ae60-4dd5-8afc-c26b5dc2bb6a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:58.521676 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 89/171] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:35:58.522618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486c1a2-84ff-4263-8129-886fd3a40903 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:58.573715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb41d6-12a7-4648-8de1-20a50843e21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:58.574586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb41d6-12a7-4648-8de1-20a50843e21b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:58.575093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb41d6-12a7-4648-8de1-20a50843e21b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:58.575583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb41d6-12a7-4648-8de1-20a50843e21b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:58.576531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb41d6-12a7-4648-8de1-20a50843e21b None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=fea2e1e9b16a4405b41888375f40c504, user.id=60fe26b30a2d4d8bbf2347a182f6c4a7) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:58.577035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb41d6-12a7-4648-8de1-20a50843e21b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:58.578672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb41d6-12a7-4648-8de1-20a50843e21b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:58.594011 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 83/172] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:35:58 2022] GET /identity/v3/role_assignments?user.id=60fe26b30a2d4d8bbf2347a182f6c4a7&scope.project.id=fea2e1e9b16a4405b41888375f40c504&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:58.597125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb41d6-12a7-4648-8de1-20a50843e21b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:58.654217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486c1a2-84ff-4263-8129-886fd3a40903 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:58.668110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:58.715572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751a504-037b-4275-89a4-1ec883da7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:58.716467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a504-037b-4275-89a4-1ec883da7d1f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:58.716909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a504-037b-4275-89a4-1ec883da7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:58.717351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a504-037b-4275-89a4-1ec883da7d1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:58.720336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:58.735320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751a504-037b-4275-89a4-1ec883da7d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-7751a504-037b-4275-89a4-1ec883da7d1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:58.740939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:58.741797 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:58.742542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:58.742542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:58.742542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:58.742542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:58.742542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:58.742542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:58.742542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:58.742542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:58.742542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:58.742542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:58.742542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:35:58.742542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:35:58.742542 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 90/173] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:58.748501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751a504-037b-4275-89a4-1ec883da7d1f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:58.786687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb41d6-12a7-4648-8de1-20a50843e21b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:58.858334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237f8b6-7e62-4806-a14e-a888197e66d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:58.859542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237f8b6-7e62-4806-a14e-a888197e66d7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:58.862583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237f8b6-7e62-4806-a14e-a888197e66d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:58.863354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237f8b6-7e62-4806-a14e-a888197e66d7 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:58.865332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237f8b6-7e62-4806-a14e-a888197e66d7 None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:58.868375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237f8b6-7e62-4806-a14e-a888197e66d7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:58.875740 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 84/174] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:58 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:58.878836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153acbce-5b55-43f1-aad8-7f5b7c557bb7 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:58.879537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153acbce-5b55-43f1-aad8-7f5b7c557bb7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:58.883296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153acbce-5b55-43f1-aad8-7f5b7c557bb7 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:58.889044 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 85/175] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:58.890697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153acbce-5b55-43f1-aad8-7f5b7c557bb7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:58.946331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751a504-037b-4275-89a4-1ec883da7d1f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:58.983341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae16fc-7f83-4d22-9954-2829a5687787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:58.983957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae16fc-7f83-4d22-9954-2829a5687787 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:58.984237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae16fc-7f83-4d22-9954-2829a5687787 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:58.984510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae16fc-7f83-4d22-9954-2829a5687787 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:58.985386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae16fc-7f83-4d22-9954-2829a5687787 None admin] RBAC: Adding query filter params (name=member) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:58.985577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae16fc-7f83-4d22-9954-2829a5687787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:58.987010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae16fc-7f83-4d22-9954-2829a5687787 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:58.998772 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 91/176] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:35:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:35:58.998772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b15e1-ae9a-44fd-be93-822e9ca74ea7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:58.999027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b15e1-ae9a-44fd-be93-822e9ca74ea7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:58.999302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b15e1-ae9a-44fd-be93-822e9ca74ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.020831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-971b15e1-ae9a-44fd-be93-822e9ca74ea7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:59.021810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-971b15e1-ae9a-44fd-be93-822e9ca74ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:59.049003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:59.060322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153acbce-5b55-43f1-aad8-7f5b7c557bb7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:59.097890 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 92/177] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:59.098953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b15e1-ae9a-44fd-be93-822e9ca74ea7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:59.123799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:59.132876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acac64-91d2-486c-910b-44c0aca05d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:59.133742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acac64-91d2-486c-910b-44c0aca05d66 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.134030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acac64-91d2-486c-910b-44c0aca05d66 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.134307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acac64-91d2-486c-910b-44c0aca05d66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.135252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acac64-91d2-486c-910b-44c0aca05d66 None admin] RBAC: Adding query filter params (role.id=9e9271d4f0cd4c5688279b54d26e079f, scope.project.id=fea2e1e9b16a4405b41888375f40c504, user.id=0489bf2a330a4690b46f44735ab56fb3) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:59.135615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acac64-91d2-486c-910b-44c0aca05d66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:59.137615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acac64-91d2-486c-910b-44c0aca05d66 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:59.145246 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 86/178] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:35:58 2022] GET /identity/v3/role_assignments?user.id=0489bf2a330a4690b46f44735ab56fb3&scope.project.id=fea2e1e9b16a4405b41888375f40c504&role.id=9e9271d4f0cd4c5688279b54d26e079f => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:59.146546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e60038-137b-4735-a085-5f5842af777a None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.146880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e60038-137b-4735-a085-5f5842af777a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.147160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e60038-137b-4735-a085-5f5842af777a None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.149064 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 87/179] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:59.151060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4cc98-ab58-48ca-be0d-3e51180da5de None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.151358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4cc98-ab58-48ca-be0d-3e51180da5de None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.151637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4cc98-ab58-48ca-be0d-3e51180da5de None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.153586 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 88/180] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:59.154648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3243b50-7fef-44fc-ba3c-751677245f4a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.154957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3243b50-7fef-44fc-ba3c-751677245f4a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.155430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3243b50-7fef-44fc-ba3c-751677245f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.181492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f3243b50-7fef-44fc-ba3c-751677245f4a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:59.182717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f3243b50-7fef-44fc-ba3c-751677245f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:59.225026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b15e1-ae9a-44fd-be93-822e9ca74ea7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:59.262267 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 89/181] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:35:59.263370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c32e-5d3c-486a-ab4c-6e87703f7e0e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.263667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c32e-5d3c-486a-ab4c-6e87703f7e0e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.263948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6c32e-5d3c-486a-ab4c-6e87703f7e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.265658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c5f2a-a2f6-4284-890c-2539f06d4986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:59.266519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c5f2a-a2f6-4284-890c-2539f06d4986 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.266987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c5f2a-a2f6-4284-890c-2539f06d4986 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.267450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c5f2a-a2f6-4284-890c-2539f06d4986 None admin] PATH_INFO: `/v3/users/0489bf2a330a4690b46f44735ab56fb3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.268761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c5f2a-a2f6-4284-890c-2539f06d4986 None admin] RBAC: Authorizing `identity:get_user(user_id=0489bf2a330a4690b46f44735ab56fb3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:59.270528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c5f2a-a2f6-4284-890c-2539f06d4986 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:59.272501 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 93/182] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:59 2022] GET /identity/v3/users/0489bf2a330a4690b46f44735ab56fb3 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:59.280636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c5f2a-a2f6-4284-890c-2539f06d4986 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:59.295267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7ea6c32e-5d3c-486a-ab4c-6e87703f7e0e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:59.296761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7ea6c32e-5d3c-486a-ab4c-6e87703f7e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:59.336219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:59.437629 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 90/183] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:59.438483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c32e-5d3c-486a-ab4c-6e87703f7e0e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:59.461785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c5f2a-a2f6-4284-890c-2539f06d4986 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:59.502928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:59.509560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca51c18-5273-4018-81bf-baeabdb67ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:59.510185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca51c18-5273-4018-81bf-baeabdb67ede None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.510620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca51c18-5273-4018-81bf-baeabdb67ede None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.510930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca51c18-5273-4018-81bf-baeabdb67ede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.555880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6c32e-5d3c-486a-ab4c-6e87703f7e0e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:59.603920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e849649-a543-405c-9a0b-342ffc13abef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:59.604702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e849649-a543-405c-9a0b-342ffc13abef None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.605082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e849649-a543-405c-9a0b-342ffc13abef None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.605471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e849649-a543-405c-9a0b-342ffc13abef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.617566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e849649-a543-405c-9a0b-342ffc13abef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:59.617720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca51c18-5273-4018-81bf-baeabdb67ede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:59.619246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca51c18-5273-4018-81bf-baeabdb67ede None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-6e849649-a543-405c-9a0b-342ffc13abef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:59.623283 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:59.625468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 91/184] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:35:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:59.627500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca232935-fbb8-4dbe-b3db-a398bd40d433 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.629400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca232935-fbb8-4dbe-b3db-a398bd40d433 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.629400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca232935-fbb8-4dbe-b3db-a398bd40d433 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.629400 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 92/185] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:35:59.638764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca232935-fbb8-4dbe-b3db-a398bd40d433 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:59.650983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:59.737136 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 94/186] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:35:59.738822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823f971-e83d-491d-85ba-4f8fe0945c4a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.739114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823f971-e83d-491d-85ba-4f8fe0945c4a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.739386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823f971-e83d-491d-85ba-4f8fe0945c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.755887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca232935-fbb8-4dbe-b3db-a398bd40d433 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:59.758779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0823f971-e83d-491d-85ba-4f8fe0945c4a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:35:59.759950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0823f971-e83d-491d-85ba-4f8fe0945c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:35:59.773671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:59.791985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c43cd-0191-4912-b8bd-73fec65992da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:59.792590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c43cd-0191-4912-b8bd-73fec65992da None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.792867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c43cd-0191-4912-b8bd-73fec65992da None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.793141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c43cd-0191-4912-b8bd-73fec65992da None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.793804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c43cd-0191-4912-b8bd-73fec65992da None admin] RBAC: Adding query filter params (name=admin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:35:59.794100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c43cd-0191-4912-b8bd-73fec65992da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:59.795516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c43cd-0191-4912-b8bd-73fec65992da None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:59.803573 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 93/187] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:59.804382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c43cd-0191-4912-b8bd-73fec65992da None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:59.828004 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 95/188] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:35:59.832578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823f971-e83d-491d-85ba-4f8fe0945c4a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:59.892623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:35:59.920280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c43cd-0191-4912-b8bd-73fec65992da None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:59.941298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823f971-e83d-491d-85ba-4f8fe0945c4a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:35:59.955476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdd55d-e35c-4490-bd3f-f83598fc4b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:59.956109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdd55d-e35c-4490-bd3f-f83598fc4b67 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.956417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdd55d-e35c-4490-bd3f-f83598fc4b67 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.956908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdd55d-e35c-4490-bd3f-f83598fc4b67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.967364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdd55d-e35c-4490-bd3f-f83598fc4b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-c9fdd55d-e35c-4490-bd3f-f83598fc4b67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:35:59.973272 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:35:59.974389 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 94/189] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:35:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:35:59.975216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdd55d-e35c-4490-bd3f-f83598fc4b67 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:35:59.984167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0d5b9-f95b-434d-9e85-7d8489ac2d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:35:59.984874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0d5b9-f95b-434d-9e85-7d8489ac2d6f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:35:59.985090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0d5b9-f95b-434d-9e85-7d8489ac2d6f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:35:59.985356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0d5b9-f95b-434d-9e85-7d8489ac2d6f None admin] PATH_INFO: `/v3/projects/012183641bb945f19dcace487a5df1a0` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:35:59.986460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0d5b9-f95b-434d-9e85-7d8489ac2d6f None admin] RBAC: Authorizing `identity:get_project(project_id=012183641bb945f19dcace487a5df1a0)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:35:59.988745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0d5b9-f95b-434d-9e85-7d8489ac2d6f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:35:59.990657 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 96/190] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:35:59 2022] GET /identity/v3/projects/012183641bb945f19dcace487a5df1a0 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:35:59.991305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0d5b9-f95b-434d-9e85-7d8489ac2d6f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:00.016567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:00.079900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdd55d-e35c-4490-bd3f-f83598fc4b67 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:00.111621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0d5b9-f95b-434d-9e85-7d8489ac2d6f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:00.115219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ceb7c-fd32-4858-8c70-ab5a56b5a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:00.115846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ceb7c-fd32-4858-8c70-ab5a56b5a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:00.116122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ceb7c-fd32-4858-8c70-ab5a56b5a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:00.116392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ceb7c-fd32-4858-8c70-ab5a56b5a8d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:00.117488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ceb7c-fd32-4858-8c70-ab5a56b5a8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:00.118966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ceb7c-fd32-4858-8c70-ab5a56b5a8d8 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:00.120546 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 95/191] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:35:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:00.122814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ceb7c-fd32-4858-8c70-ab5a56b5a8d8 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:00.136359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:00.148292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70ab2b-1c4f-4d91-a141-d13e7366b88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:00.148929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70ab2b-1c4f-4d91-a141-d13e7366b88b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:00.149213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70ab2b-1c4f-4d91-a141-d13e7366b88b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:00.149493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70ab2b-1c4f-4d91-a141-d13e7366b88b None admin] PATH_INFO: `/v3/users/8fb588ae6ddb46fabc6115f9eb588459` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:00.163758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70ab2b-1c4f-4d91-a141-d13e7366b88b None admin] RBAC: Authorizing `identity:get_user(user_id=8fb588ae6ddb46fabc6115f9eb588459)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:00.165214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70ab2b-1c4f-4d91-a141-d13e7366b88b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:00.166869 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 97/192] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:35:59 2022] GET /identity/v3/users/8fb588ae6ddb46fabc6115f9eb588459 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:00.167646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70ab2b-1c4f-4d91-a141-d13e7366b88b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:00.222108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ceb7c-fd32-4858-8c70-ab5a56b5a8d8 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:00.230009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:00.256734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439afd17-bcb6-40ab-82c0-34890d182a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:00.257331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439afd17-bcb6-40ab-82c0-34890d182a96 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:00.257603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439afd17-bcb6-40ab-82c0-34890d182a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:00.257873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439afd17-bcb6-40ab-82c0-34890d182a96 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:00.258525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439afd17-bcb6-40ab-82c0-34890d182a96 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:00.258925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439afd17-bcb6-40ab-82c0-34890d182a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:00.260210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439afd17-bcb6-40ab-82c0-34890d182a96 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:00.267889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70ab2b-1c4f-4d91-a141-d13e7366b88b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:00.268068 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 96/193] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:00.269391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439afd17-bcb6-40ab-82c0-34890d182a96 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:00.306446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f8cfc-4efc-4a59-9271-d7bf6b5b7774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:00.307082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f8cfc-4efc-4a59-9271-d7bf6b5b7774 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:00.307368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f8cfc-4efc-4a59-9271-d7bf6b5b7774 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:00.307645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f8cfc-4efc-4a59-9271-d7bf6b5b7774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:00.308630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f8cfc-4efc-4a59-9271-d7bf6b5b7774 None admin] RBAC: Adding query filter params (role.id=24fee0983ae345c288f4974d93a3805d, scope.project.id=012183641bb945f19dcace487a5df1a0, user.id=0489bf2a330a4690b46f44735ab56fb3) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:00.308944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f8cfc-4efc-4a59-9271-d7bf6b5b7774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:00.310394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f8cfc-4efc-4a59-9271-d7bf6b5b7774 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:00.316433 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 98/194] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:00 2022] GET /identity/v3/role_assignments?user.id=0489bf2a330a4690b46f44735ab56fb3&scope.project.id=012183641bb945f19dcace487a5df1a0&role.id=24fee0983ae345c288f4974d93a3805d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:00.317358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f8cfc-4efc-4a59-9271-d7bf6b5b7774 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:00.387039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439afd17-bcb6-40ab-82c0-34890d182a96 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:00.399439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:00.423114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7023e-935c-497d-9f08-2ef41b8a7b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:00.423860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7023e-935c-497d-9f08-2ef41b8a7b35 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:00.424143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7023e-935c-497d-9f08-2ef41b8a7b35 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:00.424416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7023e-935c-497d-9f08-2ef41b8a7b35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:00.436888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7023e-935c-497d-9f08-2ef41b8a7b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-3fa7023e-935c-497d-9f08-2ef41b8a7b35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:00.443152 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:00.444074 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:00.444867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:00.444867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:00.444867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:00.444867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:00.444867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:00.444867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:00.444867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:00.444867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:00.444867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:00.444867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:00.444867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:00.444867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:00.444867 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 97/195] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:36:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:00.445498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7023e-935c-497d-9f08-2ef41b8a7b35 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:00.468498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f8cfc-4efc-4a59-9271-d7bf6b5b7774 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:00.476310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:00.514551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b211f8-d5ae-4dd1-8157-75b244ec5dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:00.515292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b211f8-d5ae-4dd1-8157-75b244ec5dbb None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:00.515580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b211f8-d5ae-4dd1-8157-75b244ec5dbb None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:00.515925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b211f8-d5ae-4dd1-8157-75b244ec5dbb None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:00.516510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b211f8-d5ae-4dd1-8157-75b244ec5dbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:00.518074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b211f8-d5ae-4dd1-8157-75b244ec5dbb None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:00.542260 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 99/196] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:36:00 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:00.543139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b211f8-d5ae-4dd1-8157-75b244ec5dbb None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:00.568719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7023e-935c-497d-9f08-2ef41b8a7b35 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:00.611370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fba4c-d811-454e-9c25-2d2272a9d98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:00.612001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fba4c-d811-454e-9c25-2d2272a9d98c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:00.612283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fba4c-d811-454e-9c25-2d2272a9d98c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:00.612619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fba4c-d811-454e-9c25-2d2272a9d98c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:00.669713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b211f8-d5ae-4dd1-8157-75b244ec5dbb None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:00.672157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:00.694152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fba4c-d811-454e-9c25-2d2272a9d98c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:00.695711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fba4c-d811-454e-9c25-2d2272a9d98c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:00.715772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592cce7-f9ea-49e8-ad69-bbbab7d74dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:00.716426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592cce7-f9ea-49e8-ad69-bbbab7d74dec None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:00.716840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592cce7-f9ea-49e8-ad69-bbbab7d74dec None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:00.717109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592cce7-f9ea-49e8-ad69-bbbab7d74dec None admin] PATH_INFO: `/v3/users/49e7bcf41b994ca6aae62fb78071aa46` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:00.718377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592cce7-f9ea-49e8-ad69-bbbab7d74dec None admin] RBAC: Authorizing `identity:get_user(user_id=49e7bcf41b994ca6aae62fb78071aa46)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:00.719924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592cce7-f9ea-49e8-ad69-bbbab7d74dec None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:00.721974 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 100/197] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:00 2022] GET /identity/v3/users/49e7bcf41b994ca6aae62fb78071aa46 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:00.722528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592cce7-f9ea-49e8-ad69-bbbab7d74dec None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:00.730221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:00.823695 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 98/198] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:00.824489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fba4c-d811-454e-9c25-2d2272a9d98c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:00.849006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592cce7-f9ea-49e8-ad69-bbbab7d74dec None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:00.904123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec82018-6ca8-4903-b21a-3ed6a8556649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:00.904862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec82018-6ca8-4903-b21a-3ed6a8556649 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:00.905155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec82018-6ca8-4903-b21a-3ed6a8556649 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:00.905546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec82018-6ca8-4903-b21a-3ed6a8556649 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:00.906221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec82018-6ca8-4903-b21a-3ed6a8556649 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:00.906529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec82018-6ca8-4903-b21a-3ed6a8556649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:00.907957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec82018-6ca8-4903-b21a-3ed6a8556649 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:00.917556 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 101/199] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:00.918395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec82018-6ca8-4903-b21a-3ed6a8556649 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:00.955387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fba4c-d811-454e-9c25-2d2272a9d98c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:00.962248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:00.989550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:00.998901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316964ac-a90e-4599-870c-9a79a2b31d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:00.999766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316964ac-a90e-4599-870c-9a79a2b31d10 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:01.000170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316964ac-a90e-4599-870c-9a79a2b31d10 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:01.000547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316964ac-a90e-4599-870c-9a79a2b31d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:01.053979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec82018-6ca8-4903-b21a-3ed6a8556649 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:01.092506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9559d96-cf7f-4afb-bb37-0747073c1ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:01.093215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9559d96-cf7f-4afb-bb37-0747073c1ff6 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:01.093603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9559d96-cf7f-4afb-bb37-0747073c1ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:01.094128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9559d96-cf7f-4afb-bb37-0747073c1ff6 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:01.095505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9559d96-cf7f-4afb-bb37-0747073c1ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:01.097157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9559d96-cf7f-4afb-bb37-0747073c1ff6 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:01.097962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316964ac-a90e-4599-870c-9a79a2b31d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:01.099313 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 102/200] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:00 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:01.099650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316964ac-a90e-4599-870c-9a79a2b31d10 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:01.105033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9559d96-cf7f-4afb-bb37-0747073c1ff6 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:01.222084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:01.226414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9559d96-cf7f-4afb-bb37-0747073c1ff6 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:01.240258 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 99/201] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:01.240954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316964ac-a90e-4599-870c-9a79a2b31d10 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:01.266044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed73c9-af57-445b-85b5-7dfaec30a4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:01.266868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed73c9-af57-445b-85b5-7dfaec30a4ec None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:01.267244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed73c9-af57-445b-85b5-7dfaec30a4ec None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:01.267612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed73c9-af57-445b-85b5-7dfaec30a4ec None admin] PATH_INFO: `/v3/users/8fb588ae6ddb46fabc6115f9eb588459` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:01.268891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed73c9-af57-445b-85b5-7dfaec30a4ec None admin] RBAC: Authorizing `identity:get_user(user_id=8fb588ae6ddb46fabc6115f9eb588459)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:01.271032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed73c9-af57-445b-85b5-7dfaec30a4ec None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:01.272731 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 103/202] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:01 2022] GET /identity/v3/users/8fb588ae6ddb46fabc6115f9eb588459 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:01.273639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed73c9-af57-445b-85b5-7dfaec30a4ec None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:01.276999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:01.353752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316964ac-a90e-4599-870c-9a79a2b31d10 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:01.382929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed73c9-af57-445b-85b5-7dfaec30a4ec None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:01.389404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b04a9-47a6-4b89-9d14-81e52ac292f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:01.390013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b04a9-47a6-4b89-9d14-81e52ac292f7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:01.390294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b04a9-47a6-4b89-9d14-81e52ac292f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:01.390563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b04a9-47a6-4b89-9d14-81e52ac292f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:01.391334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b04a9-47a6-4b89-9d14-81e52ac292f7 None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=00edf8173f2c446bbfd98af8172124c6, user.id=8fb588ae6ddb46fabc6115f9eb588459) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:01.391645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b04a9-47a6-4b89-9d14-81e52ac292f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:01.393081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b04a9-47a6-4b89-9d14-81e52ac292f7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:01.398976 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 100/203] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:01 2022] GET /identity/v3/role_assignments?user.id=8fb588ae6ddb46fabc6115f9eb588459&scope.project.id=00edf8173f2c446bbfd98af8172124c6&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:01.399607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b04a9-47a6-4b89-9d14-81e52ac292f7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:01.442050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2c369-c830-4451-be0e-38e86da5b369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:01.442703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2c369-c830-4451-be0e-38e86da5b369 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:01.443038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2c369-c830-4451-be0e-38e86da5b369 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:01.443315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2c369-c830-4451-be0e-38e86da5b369 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:01.447548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2c369-c830-4451-be0e-38e86da5b369 None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:01.449027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2c369-c830-4451-be0e-38e86da5b369 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:01.450766 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 104/204] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:01 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:01.457175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2c369-c830-4451-be0e-38e86da5b369 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:01.505341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:01.514849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b04a9-47a6-4b89-9d14-81e52ac292f7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:01.521639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:01.554438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d004844-6368-4931-90b2-31db202e7e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:01.555154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d004844-6368-4931-90b2-31db202e7e44 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:01.555433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d004844-6368-4931-90b2-31db202e7e44 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:01.555759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d004844-6368-4931-90b2-31db202e7e44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:01.657173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d004844-6368-4931-90b2-31db202e7e44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:01.659293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d004844-6368-4931-90b2-31db202e7e44 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:01.673960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2c369-c830-4451-be0e-38e86da5b369 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:01.742107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c131c-dbf1-4e90-8af1-e3c1a7a98260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:01.742735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c131c-dbf1-4e90-8af1-e3c1a7a98260 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:01.743040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c131c-dbf1-4e90-8af1-e3c1a7a98260 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:01.743318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c131c-dbf1-4e90-8af1-e3c1a7a98260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:01.744063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c131c-dbf1-4e90-8af1-e3c1a7a98260 None admin] RBAC: Adding query filter params (role.id=b23c0fe3d2bc47ada7cee9cb5db1638a, scope.project.id=fea2e1e9b16a4405b41888375f40c504, user.id=49e7bcf41b994ca6aae62fb78071aa46) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:01.744375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c131c-dbf1-4e90-8af1-e3c1a7a98260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:01.745848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c131c-dbf1-4e90-8af1-e3c1a7a98260 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:01.762245 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 105/205] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:01 2022] GET /identity/v3/role_assignments?user.id=49e7bcf41b994ca6aae62fb78071aa46&scope.project.id=fea2e1e9b16a4405b41888375f40c504&role.id=b23c0fe3d2bc47ada7cee9cb5db1638a => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:01.818519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:01.840801 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 101/206] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:01.846833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c131c-dbf1-4e90-8af1-e3c1a7a98260 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:01.991807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:01.995605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c131c-dbf1-4e90-8af1-e3c1a7a98260 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:02.033934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443ab30-2f61-4b35-84ad-483dc27768b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:02.035316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443ab30-2f61-4b35-84ad-483dc27768b7 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:02.035857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443ab30-2f61-4b35-84ad-483dc27768b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:02.036342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443ab30-2f61-4b35-84ad-483dc27768b7 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:02.037885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443ab30-2f61-4b35-84ad-483dc27768b7 None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:02.039396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443ab30-2f61-4b35-84ad-483dc27768b7 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:02.041405 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 106/207] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:01 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:02.047613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d004844-6368-4931-90b2-31db202e7e44 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:02.167601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d004844-6368-4931-90b2-31db202e7e44 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:02.221288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30b596-6ad0-4d18-a44b-ad7cbcec03ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:02.221913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30b596-6ad0-4d18-a44b-ad7cbcec03ca None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:02.222255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30b596-6ad0-4d18-a44b-ad7cbcec03ca None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:02.222550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30b596-6ad0-4d18-a44b-ad7cbcec03ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:02.223367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30b596-6ad0-4d18-a44b-ad7cbcec03ca None admin] RBAC: Adding query filter params (role.id=9e9271d4f0cd4c5688279b54d26e079f, scope.project.id=00edf8173f2c446bbfd98af8172124c6, user.id=8fb588ae6ddb46fabc6115f9eb588459) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:02.223724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30b596-6ad0-4d18-a44b-ad7cbcec03ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:02.225307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30b596-6ad0-4d18-a44b-ad7cbcec03ca None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:02.234039 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 102/208] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:02 2022] GET /identity/v3/role_assignments?user.id=8fb588ae6ddb46fabc6115f9eb588459&scope.project.id=00edf8173f2c446bbfd98af8172124c6&role.id=9e9271d4f0cd4c5688279b54d26e079f => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:02.755098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cff7c-29d7-4c4b-9deb-21d620593ddc None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:02.755606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cff7c-29d7-4c4b-9deb-21d620593ddc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:02.755712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cff7c-29d7-4c4b-9deb-21d620593ddc None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:02.757260 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 107/209] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:02.763961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20213584-4b1f-4a5e-bdef-d2f7b70be78c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:02.764565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20213584-4b1f-4a5e-bdef-d2f7b70be78c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:02.764565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20213584-4b1f-4a5e-bdef-d2f7b70be78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:02.784617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-20213584-4b1f-4a5e-bdef-d2f7b70be78c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:02.786264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-20213584-4b1f-4a5e-bdef-d2f7b70be78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:02.846094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:02.868157 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 103/210] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:03.001350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9975348-d687-4105-a28d-4fa6af28e71d None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:03.001673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9975348-d687-4105-a28d-4fa6af28e71d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:03.001903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9975348-d687-4105-a28d-4fa6af28e71d None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:03.003911 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 108/211] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:03.013495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383fcd-edd9-41d5-ae9a-3eca618380b8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:03.013495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383fcd-edd9-41d5-ae9a-3eca618380b8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:03.013495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2383fcd-edd9-41d5-ae9a-3eca618380b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:03.029733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b2383fcd-edd9-41d5-ae9a-3eca618380b8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:03.031279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b2383fcd-edd9-41d5-ae9a-3eca618380b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:03.109763 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 104/212] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:03.188002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9975348-d687-4105-a28d-4fa6af28e71d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:03.296505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9975348-d687-4105-a28d-4fa6af28e71d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:03.332472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369b8e3-050b-4883-9609-3b81fea8c0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:03.333479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369b8e3-050b-4883-9609-3b81fea8c0ac None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:03.333961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369b8e3-050b-4883-9609-3b81fea8c0ac None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:03.334480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369b8e3-050b-4883-9609-3b81fea8c0ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:03.335843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369b8e3-050b-4883-9609-3b81fea8c0ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:03.337562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369b8e3-050b-4883-9609-3b81fea8c0ac None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:03.339786 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 109/213] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:03.345380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2383fcd-edd9-41d5-ae9a-3eca618380b8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:03.399079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369b8e3-050b-4883-9609-3b81fea8c0ac None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:03.447122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:03.455782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2383fcd-edd9-41d5-ae9a-3eca618380b8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:03.474398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:03.494865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0e4d0-9081-44f7-983e-8e307513a87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:03.495508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0e4d0-9081-44f7-983e-8e307513a87e None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:03.495954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0e4d0-9081-44f7-983e-8e307513a87e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:03.496378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0e4d0-9081-44f7-983e-8e307513a87e None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:03.497250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0e4d0-9081-44f7-983e-8e307513a87e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:03.498905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0e4d0-9081-44f7-983e-8e307513a87e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:03.528787 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 105/214] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:36:03 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:03.549006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369b8e3-050b-4883-9609-3b81fea8c0ac None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:03.591546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55288921-ddf2-4de3-a5f5-6f8aafd71b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:03.592262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55288921-ddf2-4de3-a5f5-6f8aafd71b5d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:03.592551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55288921-ddf2-4de3-a5f5-6f8aafd71b5d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:03.592885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55288921-ddf2-4de3-a5f5-6f8aafd71b5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:03.607022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55288921-ddf2-4de3-a5f5-6f8aafd71b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-55288921-ddf2-4de3-a5f5-6f8aafd71b5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:03.614336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:03.615433 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:03.616213 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:03.616213 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:03.616213 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:03.616213 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:03.616213 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:03.616213 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:03.616213 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:03.616213 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:03.616213 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:03.616213 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:03.616213 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:03.616213 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:03.616805 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 110/215] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:03.622784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0e4d0-9081-44f7-983e-8e307513a87e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:03.722897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3232b7-70e4-4ecb-8347-691825b8c405 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:03.723964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3232b7-70e4-4ecb-8347-691825b8c405 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:03.724315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3232b7-70e4-4ecb-8347-691825b8c405 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:03.725753 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 111/216] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:03.731018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f718b6-9878-41f2-99f7-ab0493a73e30 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:03.731309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f718b6-9878-41f2-99f7-ab0493a73e30 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:03.731589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f718b6-9878-41f2-99f7-ab0493a73e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:03.740603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0e4d0-9081-44f7-983e-8e307513a87e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:03.754776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-83f718b6-9878-41f2-99f7-ab0493a73e30 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:03.756023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-83f718b6-9878-41f2-99f7-ab0493a73e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:03.783633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d94580-37f5-4f66-9eef-ae9225945ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:03.784293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d94580-37f5-4f66-9eef-ae9225945ade None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:03.784716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d94580-37f5-4f66-9eef-ae9225945ade None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:03.784995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d94580-37f5-4f66-9eef-ae9225945ade None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:03.785675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d94580-37f5-4f66-9eef-ae9225945ade None admin] RBAC: Adding query filter params (name=member) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:03.785991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d94580-37f5-4f66-9eef-ae9225945ade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:03.787412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d94580-37f5-4f66-9eef-ae9225945ade None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:03.801152 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 106/217] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:03.802064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d94580-37f5-4f66-9eef-ae9225945ade None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:03.844431 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 112/218] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:03.849394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:03.922487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d94580-37f5-4f66-9eef-ae9225945ade None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:03.965779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331edbd3-c478-487e-91ff-64f247f632c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:03.966428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331edbd3-c478-487e-91ff-64f247f632c4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:03.966710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331edbd3-c478-487e-91ff-64f247f632c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:03.967011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331edbd3-c478-487e-91ff-64f247f632c4 None admin] PATH_INFO: `/v3/users/c9b1f486e84044a59213907ae973fef8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:03.983803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331edbd3-c478-487e-91ff-64f247f632c4 None admin] RBAC: Authorizing `identity:get_user(user_id=c9b1f486e84044a59213907ae973fef8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:03.985195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331edbd3-c478-487e-91ff-64f247f632c4 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:03.987028 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 107/219] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:03 2022] GET /identity/v3/users/c9b1f486e84044a59213907ae973fef8 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:03.993054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f718b6-9878-41f2-99f7-ab0493a73e30 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:04.022792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:04.105102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f718b6-9878-41f2-99f7-ab0493a73e30 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:04.145418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e17e-684a-4462-ac93-4578f53dc226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:04.146031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e17e-684a-4462-ac93-4578f53dc226 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:04.146311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e17e-684a-4462-ac93-4578f53dc226 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:04.146583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e17e-684a-4462-ac93-4578f53dc226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:04.191617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331edbd3-c478-487e-91ff-64f247f632c4 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:04.223908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24e17e-684a-4462-ac93-4578f53dc226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:04.225795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24e17e-684a-4462-ac93-4578f53dc226 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:04.294288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:04.335038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:04.343866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331edbd3-c478-487e-91ff-64f247f632c4 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:04.383567 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 113/220] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:04.391741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e17e-684a-4462-ac93-4578f53dc226 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:04.409323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db594d01-9747-4040-89e8-413a82cb3eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:04.410250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db594d01-9747-4040-89e8-413a82cb3eb6 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:04.410618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db594d01-9747-4040-89e8-413a82cb3eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:04.411036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db594d01-9747-4040-89e8-413a82cb3eb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:04.435938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db594d01-9747-4040-89e8-413a82cb3eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-db594d01-9747-4040-89e8-413a82cb3eb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:04.441405 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:04.442294 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:04.443092 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:04.443092 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:04.443092 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:04.443092 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:04.443092 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:04.443092 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:04.443092 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:04.443092 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:04.443092 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:04.443092 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:04.443092 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:36:04.443092 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:04.447832 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 108/221] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:36:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:04.451694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db594d01-9747-4040-89e8-413a82cb3eb6 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:04.531383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e17e-684a-4462-ac93-4578f53dc226 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:04.567591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:04.581673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de1cb2-d241-407e-8d76-174ac7ff54fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:04.581673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1cb2-d241-407e-8d76-174ac7ff54fa None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:04.581902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1cb2-d241-407e-8d76-174ac7ff54fa None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:04.582317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1cb2-d241-407e-8d76-174ac7ff54fa None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:04.583862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de1cb2-d241-407e-8d76-174ac7ff54fa None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:04.586346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de1cb2-d241-407e-8d76-174ac7ff54fa None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:04.589329 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 114/222] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:04 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:04.591022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53476537-b1f6-4ced-89d8-58c2ced842dc None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:04.591665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53476537-b1f6-4ced-89d8-58c2ced842dc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:04.592058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53476537-b1f6-4ced-89d8-58c2ced842dc None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:04.594303 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 115/223] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:04.595259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53476537-b1f6-4ced-89d8-58c2ced842dc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:04.616829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db594d01-9747-4040-89e8-413a82cb3eb6 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:04.654169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97115d00-6d8e-4526-8b80-e25f27e2340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:04.655152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97115d00-6d8e-4526-8b80-e25f27e2340f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:04.655746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97115d00-6d8e-4526-8b80-e25f27e2340f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:04.656339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97115d00-6d8e-4526-8b80-e25f27e2340f None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:04.657606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97115d00-6d8e-4526-8b80-e25f27e2340f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:04.658264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97115d00-6d8e-4526-8b80-e25f27e2340f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:04.660875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97115d00-6d8e-4526-8b80-e25f27e2340f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:04.669593 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 109/224] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:04.670954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18404b7d-b26a-42a0-bf0f-e03ab216d2f6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:04.671294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18404b7d-b26a-42a0-bf0f-e03ab216d2f6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:04.671576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18404b7d-b26a-42a0-bf0f-e03ab216d2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:04.690588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-18404b7d-b26a-42a0-bf0f-e03ab216d2f6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:04.692556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-18404b7d-b26a-42a0-bf0f-e03ab216d2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:04.702770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:04.717288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53476537-b1f6-4ced-89d8-58c2ced842dc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:04.753917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5baf2-4708-4b5c-a043-e42007b5a4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:04.754573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5baf2-4708-4b5c-a043-e42007b5a4cf None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:04.754884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5baf2-4708-4b5c-a043-e42007b5a4cf None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:04.755162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5baf2-4708-4b5c-a043-e42007b5a4cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:04.755898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5baf2-4708-4b5c-a043-e42007b5a4cf None admin] RBAC: Adding query filter params (role.id=24fee0983ae345c288f4974d93a3805d, scope.project.id=00edf8173f2c446bbfd98af8172124c6, user.id=c9b1f486e84044a59213907ae973fef8) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:04.756208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5baf2-4708-4b5c-a043-e42007b5a4cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:04.757666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5baf2-4708-4b5c-a043-e42007b5a4cf None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:04.763916 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 116/225] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:04 2022] GET /identity/v3/role_assignments?user.id=c9b1f486e84044a59213907ae973fef8&scope.project.id=00edf8173f2c446bbfd98af8172124c6&role.id=24fee0983ae345c288f4974d93a3805d => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:04.764833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5baf2-4708-4b5c-a043-e42007b5a4cf None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:04.765778 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 110/226] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:04.852122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:04.901050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5baf2-4708-4b5c-a043-e42007b5a4cf None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:04.942601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc337c6-8d60-40c9-ab6f-0316db2c7933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:04.943294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc337c6-8d60-40c9-ab6f-0316db2c7933 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:04.943585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc337c6-8d60-40c9-ab6f-0316db2c7933 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:04.943861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc337c6-8d60-40c9-ab6f-0316db2c7933 None admin] PATH_INFO: `/v3/users/8fb588ae6ddb46fabc6115f9eb588459` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:04.945052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc337c6-8d60-40c9-ab6f-0316db2c7933 None admin] RBAC: Authorizing `identity:get_user(user_id=8fb588ae6ddb46fabc6115f9eb588459)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:04.946520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc337c6-8d60-40c9-ab6f-0316db2c7933 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:04.948163 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 117/227] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:04 2022] GET /identity/v3/users/8fb588ae6ddb46fabc6115f9eb588459 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:04.953761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18404b7d-b26a-42a0-bf0f-e03ab216d2f6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:05.091751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18404b7d-b26a-42a0-bf0f-e03ab216d2f6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:05.136051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d694abb-f521-4acc-83dd-20440fa536f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:05.136621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d694abb-f521-4acc-83dd-20440fa536f1 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:05.136903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d694abb-f521-4acc-83dd-20440fa536f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:05.137180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d694abb-f521-4acc-83dd-20440fa536f1 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:05.138359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d694abb-f521-4acc-83dd-20440fa536f1 None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:05.139971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d694abb-f521-4acc-83dd-20440fa536f1 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:05.141790 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 111/228] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:04 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:05.148326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc337c6-8d60-40c9-ab6f-0316db2c7933 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:05.155866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d694abb-f521-4acc-83dd-20440fa536f1 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:05.182636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:05.274386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc337c6-8d60-40c9-ab6f-0316db2c7933 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:05.327620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d694abb-f521-4acc-83dd-20440fa536f1 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:05.337329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:05.353062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51df9c-a319-4cec-a1de-802bff2722c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:05.353993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51df9c-a319-4cec-a1de-802bff2722c8 None admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:05.354431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51df9c-a319-4cec-a1de-802bff2722c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:05.354879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51df9c-a319-4cec-a1de-802bff2722c8 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6/users/8fb588ae6ddb46fabc6115f9eb588459/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:05.359143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51df9c-a319-4cec-a1de-802bff2722c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=00edf8173f2c446bbfd98af8172124c6, user_id=8fb588ae6ddb46fabc6115f9eb588459, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:05.362023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51df9c-a319-4cec-a1de-802bff2722c8 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:05.403531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f7247-db25-45d7-9638-1ba54b11e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:05.404432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f7247-db25-45d7-9638-1ba54b11e684 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:05.404857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f7247-db25-45d7-9638-1ba54b11e684 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:05.405271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f7247-db25-45d7-9638-1ba54b11e684 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:05.422891 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 118/229] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:36:05 2022] PUT /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6/users/8fb588ae6ddb46fabc6115f9eb588459/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:05.436284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f7247-db25-45d7-9638-1ba54b11e684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-3e1f7247-db25-45d7-9638-1ba54b11e684 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:05.451057 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:05.451993 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:05.452763 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:05.452763 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:05.452763 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:05.452763 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:05.452763 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:05.452763 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:05.452763 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:05.452763 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:05.452763 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:05.452763 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:05.452763 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:05.452763 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:05.454730 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 112/230] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:36:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:05.461753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51df9c-a319-4cec-a1de-802bff2722c8 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:05.715352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51df9c-a319-4cec-a1de-802bff2722c8 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:05.786043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e897b87-c110-4b3a-8940-20051cb1e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:05.786670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e897b87-c110-4b3a-8940-20051cb1e645 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:05.787364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e897b87-c110-4b3a-8940-20051cb1e645 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:05.787644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e897b87-c110-4b3a-8940-20051cb1e645 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:05.790987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e897b87-c110-4b3a-8940-20051cb1e645 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:05.791333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e897b87-c110-4b3a-8940-20051cb1e645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:05.792763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e897b87-c110-4b3a-8940-20051cb1e645 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:05.805979 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 119/231] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:05.813634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f7247-db25-45d7-9638-1ba54b11e684 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:05.955188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:05.984225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069b1da-35c3-4d40-b12e-0aebbc38fd1a None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:05.984533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069b1da-35c3-4d40-b12e-0aebbc38fd1a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:05.984699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069b1da-35c3-4d40-b12e-0aebbc38fd1a None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:05.986055 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 120/232] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:05.987250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f7247-db25-45d7-9638-1ba54b11e684 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:05.996099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9972cbf-1014-4ef8-86b2-dcc2dc82ca61 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:05.996385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9972cbf-1014-4ef8-86b2-dcc2dc82ca61 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:05.996666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9972cbf-1014-4ef8-86b2-dcc2dc82ca61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:06.023391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286aa5a7-2c7a-4e28-87cf-84dc6ff21b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:06.024265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286aa5a7-2c7a-4e28-87cf-84dc6ff21b0d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:06.024713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286aa5a7-2c7a-4e28-87cf-84dc6ff21b0d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:06.025122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286aa5a7-2c7a-4e28-87cf-84dc6ff21b0d None admin] PATH_INFO: `/v3/users/8fb588ae6ddb46fabc6115f9eb588459` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:06.026457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286aa5a7-2c7a-4e28-87cf-84dc6ff21b0d None admin] RBAC: Authorizing `identity:get_user(user_id=8fb588ae6ddb46fabc6115f9eb588459)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:06.028080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286aa5a7-2c7a-4e28-87cf-84dc6ff21b0d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:06.034282 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 113/233] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:05 2022] GET /identity/v3/users/8fb588ae6ddb46fabc6115f9eb588459 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:06.036493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286aa5a7-2c7a-4e28-87cf-84dc6ff21b0d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:06.046609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a9972cbf-1014-4ef8-86b2-dcc2dc82ca61 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:06.047950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a9972cbf-1014-4ef8-86b2-dcc2dc82ca61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:06.148716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286aa5a7-2c7a-4e28-87cf-84dc6ff21b0d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:06.199971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:06.226264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c73897-7f79-4e15-a2e6-9374d28d21f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:06.227276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c73897-7f79-4e15-a2e6-9374d28d21f7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:06.227752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c73897-7f79-4e15-a2e6-9374d28d21f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:06.228164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c73897-7f79-4e15-a2e6-9374d28d21f7 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:06.229666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c73897-7f79-4e15-a2e6-9374d28d21f7 None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:06.232809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c73897-7f79-4e15-a2e6-9374d28d21f7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:06.238059 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 114/234] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:06 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:06.245188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c73897-7f79-4e15-a2e6-9374d28d21f7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:06.257632 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 121/235] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:06.263221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:06.358657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c73897-7f79-4e15-a2e6-9374d28d21f7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:06.393116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4a977-4961-4ce6-8dcd-9735b0196465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:06.394528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4a977-4961-4ce6-8dcd-9735b0196465 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:06.395075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4a977-4961-4ce6-8dcd-9735b0196465 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:06.395487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4a977-4961-4ce6-8dcd-9735b0196465 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6/users/8fb588ae6ddb46fabc6115f9eb588459/roles/9e9271d4f0cd4c5688279b54d26e079f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:06.397846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4a977-4961-4ce6-8dcd-9735b0196465 None admin] RBAC: Authorizing `identity:create_grant(project_id=00edf8173f2c446bbfd98af8172124c6, user_id=8fb588ae6ddb46fabc6115f9eb588459, role_id=9e9271d4f0cd4c5688279b54d26e079f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:06.399460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4a977-4961-4ce6-8dcd-9735b0196465 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:06.407029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e29421-f45e-4f96-8d59-af13dbe84697 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:06.407535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e29421-f45e-4f96-8d59-af13dbe84697 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:06.407961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e29421-f45e-4f96-8d59-af13dbe84697 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:06.410486 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 122/236] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:36:06.415422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e9cf0-adf5-4459-bd3e-ec890f731a00 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:06.415709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e9cf0-adf5-4459-bd3e-ec890f731a00 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:06.415987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e9cf0-adf5-4459-bd3e-ec890f731a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:06.423476 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 115/237] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:36:06 2022] PUT /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6/users/8fb588ae6ddb46fabc6115f9eb588459/roles/9e9271d4f0cd4c5688279b54d26e079f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:06.446190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-139e9cf0-adf5-4459-bd3e-ec890f731a00 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:06.447428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-139e9cf0-adf5-4459-bd3e-ec890f731a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:06.561509 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 123/238] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:06.619731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4a977-4961-4ce6-8dcd-9735b0196465 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:06.692465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:06.731057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4a977-4961-4ce6-8dcd-9735b0196465 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:06.767657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1833de9-fdd6-4949-a695-d1861659e225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:06.768293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1833de9-fdd6-4949-a695-d1861659e225 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:06.768569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1833de9-fdd6-4949-a695-d1861659e225 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:06.769383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1833de9-fdd6-4949-a695-d1861659e225 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:06.785857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1833de9-fdd6-4949-a695-d1861659e225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-f1833de9-fdd6-4949-a695-d1861659e225 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:06.791331 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:06.792174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:06.792951 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:06.792951 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:06.792951 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:06.792951 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:06.792951 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:06.792951 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:06.792951 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:06.792951 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:06.792951 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:06.792951 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:06.792951 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:36:06.792951 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:06.792951 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 116/239] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:06.798782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e9cf0-adf5-4459-bd3e-ec890f731a00 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:06.870834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1833de9-fdd6-4949-a695-d1861659e225 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:06.937903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e9cf0-adf5-4459-bd3e-ec890f731a00 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:06.963150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:06.987397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa829e7-caa5-4a7f-8abe-fe22b0e815cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:06.988738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa829e7-caa5-4a7f-8abe-fe22b0e815cf None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:06.989034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa829e7-caa5-4a7f-8abe-fe22b0e815cf None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:06.989308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa829e7-caa5-4a7f-8abe-fe22b0e815cf None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:06.989987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa829e7-caa5-4a7f-8abe-fe22b0e815cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:06.990293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa829e7-caa5-4a7f-8abe-fe22b0e815cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:06.991712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa829e7-caa5-4a7f-8abe-fe22b0e815cf None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:07.002294 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 124/240] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:07.008826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa829e7-caa5-4a7f-8abe-fe22b0e815cf None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:07.112663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1833de9-fdd6-4949-a695-d1861659e225 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:07.163946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:07.180262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f7756-0e92-4ef5-8d6f-02c832827b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:07.180905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f7756-0e92-4ef5-8d6f-02c832827b97 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:07.181186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f7756-0e92-4ef5-8d6f-02c832827b97 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:07.181457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f7756-0e92-4ef5-8d6f-02c832827b97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:07.183577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f7756-0e92-4ef5-8d6f-02c832827b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:07.185035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f7756-0e92-4ef5-8d6f-02c832827b97 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:07.189657 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 117/241] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:07.196448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f7756-0e92-4ef5-8d6f-02c832827b97 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:07.204686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa829e7-caa5-4a7f-8abe-fe22b0e815cf None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:07.271120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ff267-6559-424c-b071-1d41780667ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:07.271765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ff267-6559-424c-b071-1d41780667ec None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:07.272047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ff267-6559-424c-b071-1d41780667ec None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:07.272320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ff267-6559-424c-b071-1d41780667ec None admin] PATH_INFO: `/v3/users/003db1054d304928af578d1bc90df1c5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:07.295492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ff267-6559-424c-b071-1d41780667ec None admin] RBAC: Authorizing `identity:get_user(user_id=003db1054d304928af578d1bc90df1c5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:07.296965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ff267-6559-424c-b071-1d41780667ec None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:07.300961 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 125/242] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:07 2022] GET /identity/v3/users/003db1054d304928af578d1bc90df1c5 => generated 297 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:07.306652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ff267-6559-424c-b071-1d41780667ec None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:07.353382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:07.388664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f7756-0e92-4ef5-8d6f-02c832827b97 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:07.436611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9389f-b864-431c-a0b3-578479d280fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:07.437613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9389f-b864-431c-a0b3-578479d280fe None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:07.437949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9389f-b864-431c-a0b3-578479d280fe None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:07.438515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9389f-b864-431c-a0b3-578479d280fe None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:07.439221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9389f-b864-431c-a0b3-578479d280fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:07.441627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9389f-b864-431c-a0b3-578479d280fe None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:07.462474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ff267-6559-424c-b071-1d41780667ec None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:07.470527 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 118/243] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:36:07 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:07.473215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc2b9-7183-4773-99a9-67b860a84e84 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:07.473922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc2b9-7183-4773-99a9-67b860a84e84 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:07.474206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adc2b9-7183-4773-99a9-67b860a84e84 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:07.475674 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 119/244] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:07.482585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78374f78-5093-4d94-bdfa-0f129c3a9316 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:07.482954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78374f78-5093-4d94-bdfa-0f129c3a9316 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:07.483236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78374f78-5093-4d94-bdfa-0f129c3a9316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:07.506669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-78374f78-5093-4d94-bdfa-0f129c3a9316 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:07.508472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-78374f78-5093-4d94-bdfa-0f129c3a9316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:07.530420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed887eb-9add-4030-9fba-8253d3930432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:07.531172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed887eb-9add-4030-9fba-8253d3930432 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:07.531460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed887eb-9add-4030-9fba-8253d3930432 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:07.531781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed887eb-9add-4030-9fba-8253d3930432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:07.568934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:07.597522 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 120/245] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:07.684222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed887eb-9add-4030-9fba-8253d3930432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:07.685743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed887eb-9add-4030-9fba-8253d3930432 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:07.724591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:07.805786 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 126/246] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 18:36:07.812078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78374f78-5093-4d94-bdfa-0f129c3a9316 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:07.866636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be5749-5c31-4f63-9bb9-6220b8a0110a None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:07.867002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be5749-5c31-4f63-9bb9-6220b8a0110a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:07.867278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be5749-5c31-4f63-9bb9-6220b8a0110a None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:07.868898 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 127/247] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:36:07.875296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e076-7f5a-482a-8e57-cba919327ae5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:07.875584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e076-7f5a-482a-8e57-cba919327ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:07.875859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e076-7f5a-482a-8e57-cba919327ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:07.910533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-66c3e076-7f5a-482a-8e57-cba919327ae5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:07.910533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-66c3e076-7f5a-482a-8e57-cba919327ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:07.957651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78374f78-5093-4d94-bdfa-0f129c3a9316 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:08.002212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5eac2-2464-4954-9626-8c3ee66289b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:08.002984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5eac2-2464-4954-9626-8c3ee66289b8 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:08.003966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5eac2-2464-4954-9626-8c3ee66289b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:08.004253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5eac2-2464-4954-9626-8c3ee66289b8 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:08.005452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5eac2-2464-4954-9626-8c3ee66289b8 None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:08.006089 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 128/248] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:08.007123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3e076-7f5a-482a-8e57-cba919327ae5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:08.007238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5eac2-2464-4954-9626-8c3ee66289b8 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:08.008809 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 121/249] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:07 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:08.021379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5eac2-2464-4954-9626-8c3ee66289b8 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:08.087671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:08.088359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:08.142050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3e076-7f5a-482a-8e57-cba919327ae5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:08.156804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5eac2-2464-4954-9626-8c3ee66289b8 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:08.180825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b1e33-e5db-4f02-a4fa-8f40c614d025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:08.181475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b1e33-e5db-4f02-a4fa-8f40c614d025 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:08.181759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b1e33-e5db-4f02-a4fa-8f40c614d025 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:08.182035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b1e33-e5db-4f02-a4fa-8f40c614d025 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:08.193516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b1e33-e5db-4f02-a4fa-8f40c614d025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-a30b1e33-e5db-4f02-a4fa-8f40c614d025 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:08.198501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:08.199428 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:08.200206 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:08.200206 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:08.200206 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:08.200206 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:08.200206 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:08.200206 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:08.200206 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:08.200206 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:08.200206 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:08.200206 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:08.200206 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:08.200206 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:08.200206 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 129/250] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:08.200846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee4808-1633-48cb-99d9-158d727e4782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:08.200846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee4808-1633-48cb-99d9-158d727e4782 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:08.200985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee4808-1633-48cb-99d9-158d727e4782 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:08.201552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee4808-1633-48cb-99d9-158d727e4782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:08.202195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee4808-1633-48cb-99d9-158d727e4782 None admin] RBAC: Adding query filter params (role.id=b23c0fe3d2bc47ada7cee9cb5db1638a, scope.project.id=00edf8173f2c446bbfd98af8172124c6, user.id=003db1054d304928af578d1bc90df1c5) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:08.202195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee4808-1633-48cb-99d9-158d727e4782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:08.203765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee4808-1633-48cb-99d9-158d727e4782 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:08.205545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b1e33-e5db-4f02-a4fa-8f40c614d025 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:08.217669 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 122/251] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:08 2022] GET /identity/v3/role_assignments?user.id=003db1054d304928af578d1bc90df1c5&scope.project.id=00edf8173f2c446bbfd98af8172124c6&role.id=b23c0fe3d2bc47ada7cee9cb5db1638a => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:08.320750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b1e33-e5db-4f02-a4fa-8f40c614d025 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:08.340633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:08.361236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dc144-fa5e-4a3c-82c3-418c7a4def4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:08.361857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dc144-fa5e-4a3c-82c3-418c7a4def4a None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:08.362141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dc144-fa5e-4a3c-82c3-418c7a4def4a None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:08.362416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dc144-fa5e-4a3c-82c3-418c7a4def4a None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:08.363967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dc144-fa5e-4a3c-82c3-418c7a4def4a None admin] RBAC: Adding query filter params (name=member) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:08.364271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dc144-fa5e-4a3c-82c3-418c7a4def4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:08.365693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dc144-fa5e-4a3c-82c3-418c7a4def4a None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:08.375271 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 130/252] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:08.382011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee4808-1633-48cb-99d9-158d727e4782 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:08.445605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dc144-fa5e-4a3c-82c3-418c7a4def4a None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:08.545801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee4808-1633-48cb-99d9-158d727e4782 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:08.581966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:08.598159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dc144-fa5e-4a3c-82c3-418c7a4def4a None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:08.615006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13231b11-e0fc-4f1b-987d-1ea85beab66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:08.616015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231b11-e0fc-4f1b-987d-1ea85beab66a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:08.616553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231b11-e0fc-4f1b-987d-1ea85beab66a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:08.616995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231b11-e0fc-4f1b-987d-1ea85beab66a None admin] PATH_INFO: `/v3/users/c9b1f486e84044a59213907ae973fef8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:08.618292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13231b11-e0fc-4f1b-987d-1ea85beab66a None admin] RBAC: Authorizing `identity:get_user(user_id=c9b1f486e84044a59213907ae973fef8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:08.620069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13231b11-e0fc-4f1b-987d-1ea85beab66a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:08.629440 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 123/253] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:08 2022] GET /identity/v3/users/c9b1f486e84044a59213907ae973fef8 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:08.629440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13231b11-e0fc-4f1b-987d-1ea85beab66a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:08.644534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd684f1-c8e3-4ba8-91b6-78a98848fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:08.645238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd684f1-c8e3-4ba8-91b6-78a98848fad3 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:08.645524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd684f1-c8e3-4ba8-91b6-78a98848fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:08.645796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd684f1-c8e3-4ba8-91b6-78a98848fad3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:08.672234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd684f1-c8e3-4ba8-91b6-78a98848fad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-8fd684f1-c8e3-4ba8-91b6-78a98848fad3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:08.677772 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:08.678630 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:08.679449 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:08.679449 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:08.679449 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:08.679449 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:08.679449 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:08.679449 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:08.679449 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:08.679449 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:08.679449 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:08.679449 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:08.679449 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:36:08.679449 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:08.679449 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 131/254] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:36:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:08.685028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd684f1-c8e3-4ba8-91b6-78a98848fad3 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:08.751099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:08.856973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd684f1-c8e3-4ba8-91b6-78a98848fad3 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:08.857561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13231b11-e0fc-4f1b-987d-1ea85beab66a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:08.896119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42c8a0-ca97-41d4-89bf-6bd414ddc12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:08.896767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c8a0-ca97-41d4-89bf-6bd414ddc12a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:08.897051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c8a0-ca97-41d4-89bf-6bd414ddc12a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:08.897327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42c8a0-ca97-41d4-89bf-6bd414ddc12a None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:08.898529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42c8a0-ca97-41d4-89bf-6bd414ddc12a None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:08.900180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42c8a0-ca97-41d4-89bf-6bd414ddc12a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:08.902324 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 124/255] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:08 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:08.911747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42c8a0-ca97-41d4-89bf-6bd414ddc12a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:08.951474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94bf83-455f-4c4b-8f2c-14d456395b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:08.952115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94bf83-455f-4c4b-8f2c-14d456395b14 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:08.952399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94bf83-455f-4c4b-8f2c-14d456395b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:08.952674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94bf83-455f-4c4b-8f2c-14d456395b14 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:08.953348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94bf83-455f-4c4b-8f2c-14d456395b14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:08.953653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94bf83-455f-4c4b-8f2c-14d456395b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:08.955090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94bf83-455f-4c4b-8f2c-14d456395b14 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:08.973459 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 132/256] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:08.979116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94bf83-455f-4c4b-8f2c-14d456395b14 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:08.999484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:09.060705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42c8a0-ca97-41d4-89bf-6bd414ddc12a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:09.102070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2e446-886c-432d-b70a-cfc351ceb7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:09.102771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2e446-886c-432d-b70a-cfc351ceb7b9 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:09.103054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2e446-886c-432d-b70a-cfc351ceb7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:09.103336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2e446-886c-432d-b70a-cfc351ceb7b9 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6/users/c9b1f486e84044a59213907ae973fef8/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:09.106106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2e446-886c-432d-b70a-cfc351ceb7b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=00edf8173f2c446bbfd98af8172124c6, user_id=c9b1f486e84044a59213907ae973fef8, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:09.107918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2e446-886c-432d-b70a-cfc351ceb7b9 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:09.125145 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 125/257] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:36:08 2022] PUT /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6/users/c9b1f486e84044a59213907ae973fef8/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:09.126976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1970eaa-2a34-4213-968b-35dd8d6afe18 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:09.127254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1970eaa-2a34-4213-968b-35dd8d6afe18 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:09.127529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1970eaa-2a34-4213-968b-35dd8d6afe18 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:09.131911 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 126/258] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:09.137595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759a6e-c8f8-4582-b519-14c6072043e9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:09.137894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759a6e-c8f8-4582-b519-14c6072043e9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:09.138148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73759a6e-c8f8-4582-b519-14c6072043e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:09.180588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-73759a6e-c8f8-4582-b519-14c6072043e9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:09.181826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-73759a6e-c8f8-4582-b519-14c6072043e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:09.228783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94bf83-455f-4c4b-8f2c-14d456395b14 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:09.234768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:09.327056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a071a3e-8a71-44fe-b46d-d24de36ec897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:09.328251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a071a3e-8a71-44fe-b46d-d24de36ec897 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:09.328705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a071a3e-8a71-44fe-b46d-d24de36ec897 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:09.329145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a071a3e-8a71-44fe-b46d-d24de36ec897 None admin] PATH_INFO: `/v3/users/8fb588ae6ddb46fabc6115f9eb588459` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:09.330607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a071a3e-8a71-44fe-b46d-d24de36ec897 None admin] RBAC: Authorizing `identity:get_user(user_id=8fb588ae6ddb46fabc6115f9eb588459)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:09.333061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a071a3e-8a71-44fe-b46d-d24de36ec897 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:09.339470 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 133/259] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:08 2022] GET /identity/v3/users/8fb588ae6ddb46fabc6115f9eb588459 => generated 283 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:09.345576 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 127/260] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:09.352284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a071a3e-8a71-44fe-b46d-d24de36ec897 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:09.500204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a071a3e-8a71-44fe-b46d-d24de36ec897 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:09.545404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604d9e8-b7e9-40ec-9c53-4421410b5812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:09.546316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d9e8-b7e9-40ec-9c53-4421410b5812 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:09.546813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d9e8-b7e9-40ec-9c53-4421410b5812 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:09.547271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d9e8-b7e9-40ec-9c53-4421410b5812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:09.623086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:09.662356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604d9e8-b7e9-40ec-9c53-4421410b5812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:09.663980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604d9e8-b7e9-40ec-9c53-4421410b5812 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:09.802920 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 134/261] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:09.809146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759a6e-c8f8-4582-b519-14c6072043e9 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:09.895003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:09.973540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73759a6e-c8f8-4582-b519-14c6072043e9 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:09.976217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604d9e8-b7e9-40ec-9c53-4421410b5812 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:10.035452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeb083-8ed1-4bef-a135-097d15adada2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:10.036617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeb083-8ed1-4bef-a135-097d15adada2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:10.037151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeb083-8ed1-4bef-a135-097d15adada2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:10.037625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeb083-8ed1-4bef-a135-097d15adada2 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:10.039018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aeb083-8ed1-4bef-a135-097d15adada2 None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:10.040720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aeb083-8ed1-4bef-a135-097d15adada2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:10.042569 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 128/262] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:09 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:10.048731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeb083-8ed1-4bef-a135-097d15adada2 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:10.129086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:10.194451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604d9e8-b7e9-40ec-9c53-4421410b5812 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:10.232922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeb083-8ed1-4bef-a135-097d15adada2 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:10.254467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:10.287755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cf585-5d85-4b08-a8b1-dbd8fe788aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:10.288380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cf585-5d85-4b08-a8b1-dbd8fe788aa3 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:10.288661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cf585-5d85-4b08-a8b1-dbd8fe788aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:10.288938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cf585-5d85-4b08-a8b1-dbd8fe788aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:10.289677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cf585-5d85-4b08-a8b1-dbd8fe788aa3 None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=00edf8173f2c446bbfd98af8172124c6, user.id=8fb588ae6ddb46fabc6115f9eb588459) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:10.289990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cf585-5d85-4b08-a8b1-dbd8fe788aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:10.291475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cf585-5d85-4b08-a8b1-dbd8fe788aa3 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:10.303478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dc788-f7e4-4d8a-9919-6e2286a9b9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:10.304133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dc788-f7e4-4d8a-9919-6e2286a9b9fe None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:10.304410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dc788-f7e4-4d8a-9919-6e2286a9b9fe None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:10.304687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dc788-f7e4-4d8a-9919-6e2286a9b9fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:10.309116 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 129/263] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:10 2022] GET /identity/v3/role_assignments?user.id=8fb588ae6ddb46fabc6115f9eb588459&scope.project.id=00edf8173f2c446bbfd98af8172124c6&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:10.323354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749dc788-f7e4-4d8a-9919-6e2286a9b9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-749dc788-f7e4-4d8a-9919-6e2286a9b9fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:10.328414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:10.329346 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:10.330126 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:10.330126 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:10.330126 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:10.330126 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:10.330126 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:10.330126 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:10.330126 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:10.330126 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:10.330126 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:10.330126 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:10.330126 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:10.330126 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:10.330126 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 135/264] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:36:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:10.337085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cf585-5d85-4b08-a8b1-dbd8fe788aa3 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:10.498715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cf585-5d85-4b08-a8b1-dbd8fe788aa3 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:10.538803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6585bc7-b286-4250-8a3b-2eae1671ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:10.539428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6585bc7-b286-4250-8a3b-2eae1671ab2a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:10.539711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6585bc7-b286-4250-8a3b-2eae1671ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:10.539984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6585bc7-b286-4250-8a3b-2eae1671ab2a None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:10.540664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6585bc7-b286-4250-8a3b-2eae1671ab2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:10.540970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6585bc7-b286-4250-8a3b-2eae1671ab2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:10.542374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6585bc7-b286-4250-8a3b-2eae1671ab2a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:10.551845 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 130/265] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:10.557180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dc788-f7e4-4d8a-9919-6e2286a9b9fe None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:10.714137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dc788-f7e4-4d8a-9919-6e2286a9b9fe None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:10.749471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:10.755927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d4bd-2c66-4f65-91cf-d17225435aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:10.756731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d4bd-2c66-4f65-91cf-d17225435aa3 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:10.757009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d4bd-2c66-4f65-91cf-d17225435aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:10.757280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d4bd-2c66-4f65-91cf-d17225435aa3 None admin] PATH_INFO: `/v3/users/8fb588ae6ddb46fabc6115f9eb588459` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:10.758427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66d4bd-2c66-4f65-91cf-d17225435aa3 None admin] RBAC: Authorizing `identity:get_user(user_id=8fb588ae6ddb46fabc6115f9eb588459)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:10.759925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66d4bd-2c66-4f65-91cf-d17225435aa3 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:10.761503 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 136/266] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:10 2022] GET /identity/v3/users/8fb588ae6ddb46fabc6115f9eb588459 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:10.767280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6585bc7-b286-4250-8a3b-2eae1671ab2a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:10.812004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:10.853773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce596ea-dfc1-4c00-8e84-d2e28bc2f0e2 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:10.854099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce596ea-dfc1-4c00-8e84-d2e28bc2f0e2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:10.854320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce596ea-dfc1-4c00-8e84-d2e28bc2f0e2 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:10.855966 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 137/267] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:36:10.870805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979021e-0cac-4fbb-8252-ee5c230551ea None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:10.870805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979021e-0cac-4fbb-8252-ee5c230551ea None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:10.870805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979021e-0cac-4fbb-8252-ee5c230551ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:10.898671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d979021e-0cac-4fbb-8252-ee5c230551ea None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:10.905377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d979021e-0cac-4fbb-8252-ee5c230551ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:10.965684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6585bc7-b286-4250-8a3b-2eae1671ab2a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:11.035987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71237e46-8642-4d65-a6ca-e067df845054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:11.036618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71237e46-8642-4d65-a6ca-e067df845054 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:11.036904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71237e46-8642-4d65-a6ca-e067df845054 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:11.037179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71237e46-8642-4d65-a6ca-e067df845054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:11.063685 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 138/268] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 18:36:11.092219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bd46e-f699-4321-90c9-8db0fa79f0d3 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:11.092533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bd46e-f699-4321-90c9-8db0fa79f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:11.092780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bd46e-f699-4321-90c9-8db0fa79f0d3 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:11.098858 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 139/269] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:36:11.101082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276972a7-5f61-4cc0-989a-f33ee860491a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:11.101378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276972a7-5f61-4cc0-989a-f33ee860491a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:11.101660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276972a7-5f61-4cc0-989a-f33ee860491a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:11.134373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-276972a7-5f61-4cc0-989a-f33ee860491a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:11.136598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-276972a7-5f61-4cc0-989a-f33ee860491a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:11.155451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71237e46-8642-4d65-a6ca-e067df845054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:11.156947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71237e46-8642-4d65-a6ca-e067df845054 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:11.212428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:11.279530 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 131/270] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:11.286993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71237e46-8642-4d65-a6ca-e067df845054 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:11.304829 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 140/271] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:11.344820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28227a66-849f-4f60-9410-33e5b6bc08ce None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:11.345325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28227a66-849f-4f60-9410-33e5b6bc08ce None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:11.345740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28227a66-849f-4f60-9410-33e5b6bc08ce None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:11.347823 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 141/272] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:36:11.352845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26333af1-a05e-40ca-951f-2b44c21fd4f3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:11.353350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26333af1-a05e-40ca-951f-2b44c21fd4f3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:11.353816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26333af1-a05e-40ca-951f-2b44c21fd4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:11.377937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-26333af1-a05e-40ca-951f-2b44c21fd4f3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:11.379767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-26333af1-a05e-40ca-951f-2b44c21fd4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:11.419272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71237e46-8642-4d65-a6ca-e067df845054 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:11.448324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:11.461655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f094aa-35c6-4086-8f94-fa06547c89cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:11.462361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f094aa-35c6-4086-8f94-fa06547c89cb None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:11.462652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f094aa-35c6-4086-8f94-fa06547c89cb None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:11.462963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f094aa-35c6-4086-8f94-fa06547c89cb None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:11.464098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f094aa-35c6-4086-8f94-fa06547c89cb None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:11.464254 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 142/273] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:11.465354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26333af1-a05e-40ca-951f-2b44c21fd4f3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:11.465723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f094aa-35c6-4086-8f94-fa06547c89cb None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:11.467666 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 132/274] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:11 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:11.475677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f094aa-35c6-4086-8f94-fa06547c89cb None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:11.484639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:11.648243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26333af1-a05e-40ca-951f-2b44c21fd4f3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:11.655410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f094aa-35c6-4086-8f94-fa06547c89cb None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:11.695502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19948b54-d386-4130-af6f-97bf9ea16f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:11.695813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540ca11-9a27-4570-aca8-d59ff0fdddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:11.696413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19948b54-d386-4130-af6f-97bf9ea16f90 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:11.696698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19948b54-d386-4130-af6f-97bf9ea16f90 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:11.696909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540ca11-9a27-4570-aca8-d59ff0fdddcf None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:11.697024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19948b54-d386-4130-af6f-97bf9ea16f90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:11.697808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540ca11-9a27-4570-aca8-d59ff0fdddcf None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:11.698457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540ca11-9a27-4570-aca8-d59ff0fdddcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:11.699604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540ca11-9a27-4570-aca8-d59ff0fdddcf None admin] RBAC: Adding query filter params (role.id=9e9271d4f0cd4c5688279b54d26e079f, scope.project.id=00edf8173f2c446bbfd98af8172124c6, user.id=8fb588ae6ddb46fabc6115f9eb588459) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:11.700077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540ca11-9a27-4570-aca8-d59ff0fdddcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:11.701670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540ca11-9a27-4570-aca8-d59ff0fdddcf None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:11.709589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19948b54-d386-4130-af6f-97bf9ea16f90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-19948b54-d386-4130-af6f-97bf9ea16f90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:11.714644 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:11.715739 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:11.716514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:11.716514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:11.716514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:11.716514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:11.716514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:11.716514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:11.716514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:11.716514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:11.716514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:11.716514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:11.716514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:11.716514 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:11.716514 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 143/276] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:11.717250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19948b54-d386-4130-af6f-97bf9ea16f90 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:11.717641 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 133/276] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:11 2022] GET /identity/v3/role_assignments?user.id=8fb588ae6ddb46fabc6115f9eb588459&scope.project.id=00edf8173f2c446bbfd98af8172124c6&role.id=9e9271d4f0cd4c5688279b54d26e079f => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:11.722914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540ca11-9a27-4570-aca8-d59ff0fdddcf None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:11.811136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:11.811472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:11.857525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19948b54-d386-4130-af6f-97bf9ea16f90 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:11.857886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540ca11-9a27-4570-aca8-d59ff0fdddcf None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:11.897686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556cd14-8f39-418e-9c2f-dc62fa00fee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:11.898673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556cd14-8f39-418e-9c2f-dc62fa00fee1 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:11.898991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556cd14-8f39-418e-9c2f-dc62fa00fee1 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:11.899269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556cd14-8f39-418e-9c2f-dc62fa00fee1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:11.901135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9abf5-7115-41ba-9ca9-1f3585d87b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:11.901351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9abf5-7115-41ba-9ca9-1f3585d87b29 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:11.901587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9abf5-7115-41ba-9ca9-1f3585d87b29 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:11.902795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9abf5-7115-41ba-9ca9-1f3585d87b29 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:11.902795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9abf5-7115-41ba-9ca9-1f3585d87b29 None admin] RBAC: Adding query filter params (name=member) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:11.902998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9abf5-7115-41ba-9ca9-1f3585d87b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:11.904262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9abf5-7115-41ba-9ca9-1f3585d87b29 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:11.913066 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 134/277] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:11.913888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9abf5-7115-41ba-9ca9-1f3585d87b29 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:11.915280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556cd14-8f39-418e-9c2f-dc62fa00fee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-f556cd14-8f39-418e-9c2f-dc62fa00fee1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:11.920614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:11.921477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:11.922251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:11.922251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:11.922251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:11.922251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:11.922251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:11.922251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:11.922251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:11.922251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:11.922251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:11.922251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:11.922251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:36:11.922251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:11.922251 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 144/278] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:11.925063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994ff1f-9f29-458e-ac2f-21687132b4d6 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:11.925063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994ff1f-9f29-458e-ac2f-21687132b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:11.925063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994ff1f-9f29-458e-ac2f-21687132b4d6 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:11.927326 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 145/279] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:11.928042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994ff1f-9f29-458e-ac2f-21687132b4d6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:12.016875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9abf5-7115-41ba-9ca9-1f3585d87b29 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:12.039908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994ff1f-9f29-458e-ac2f-21687132b4d6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:12.043087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:12.049418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:12.051619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da2000-aef5-43a9-ab72-1bbe9ea74dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:12.052195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da2000-aef5-43a9-ab72-1bbe9ea74dbb None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:12.052476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da2000-aef5-43a9-ab72-1bbe9ea74dbb None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:12.052753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da2000-aef5-43a9-ab72-1bbe9ea74dbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:12.053857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da2000-aef5-43a9-ab72-1bbe9ea74dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:12.055367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da2000-aef5-43a9-ab72-1bbe9ea74dbb None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:12.056924 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 135/280] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:12.057678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da2000-aef5-43a9-ab72-1bbe9ea74dbb None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:12.077828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179605-22c9-4c48-b729-5e64408174d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:12.078464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179605-22c9-4c48-b729-5e64408174d8 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:12.078766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179605-22c9-4c48-b729-5e64408174d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:12.079062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179605-22c9-4c48-b729-5e64408174d8 None admin] PATH_INFO: `/v3/users/e7772324721b448dbaea3369f9e3efa3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:12.093299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72179605-22c9-4c48-b729-5e64408174d8 None admin] RBAC: Authorizing `identity:get_user(user_id=e7772324721b448dbaea3369f9e3efa3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:12.094781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72179605-22c9-4c48-b729-5e64408174d8 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:12.096405 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 146/281] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:11 2022] GET /identity/v3/users/e7772324721b448dbaea3369f9e3efa3 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:12.096405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd1b6-c9d1-4997-8257-8d901546143e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:12.096405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd1b6-c9d1-4997-8257-8d901546143e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:12.096405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd1b6-c9d1-4997-8257-8d901546143e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:12.115964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6c8fd1b6-c9d1-4997-8257-8d901546143e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:12.117082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6c8fd1b6-c9d1-4997-8257-8d901546143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:12.161076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da2000-aef5-43a9-ab72-1bbe9ea74dbb None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:12.183604 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 147/282] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:12.184413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fd1b6-c9d1-4997-8257-8d901546143e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:12.196166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d4116-442c-49dc-bc43-61663678a7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:12.196774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d4116-442c-49dc-bc43-61663678a7da None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:12.197409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d4116-442c-49dc-bc43-61663678a7da None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:12.197681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d4116-442c-49dc-bc43-61663678a7da None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:12.198334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d4116-442c-49dc-bc43-61663678a7da None admin] RBAC: Adding query filter params (name=reader) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:12.198977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d4116-442c-49dc-bc43-61663678a7da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:12.200452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d4116-442c-49dc-bc43-61663678a7da None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:12.209738 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 136/283] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:12.210919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d4116-442c-49dc-bc43-61663678a7da None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:12.275863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:12.288593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:12.294508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fd1b6-c9d1-4997-8257-8d901546143e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:12.325831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d4116-442c-49dc-bc43-61663678a7da None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:12.332024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56c441-1343-4b4d-873d-7b8c8421118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:12.332731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56c441-1343-4b4d-873d-7b8c8421118d None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:12.333010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56c441-1343-4b4d-873d-7b8c8421118d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:12.333648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56c441-1343-4b4d-873d-7b8c8421118d None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:12.333946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56c441-1343-4b4d-873d-7b8c8421118d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:12.335433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56c441-1343-4b4d-873d-7b8c8421118d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:12.360939 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 148/284] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:36:12 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:12.365345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab27364-1740-40e7-89e3-d7082e9649e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:12.366074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab27364-1740-40e7-89e3-d7082e9649e7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:12.366314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab27364-1740-40e7-89e3-d7082e9649e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:12.366585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab27364-1740-40e7-89e3-d7082e9649e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:12.367352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab27364-1740-40e7-89e3-d7082e9649e7 None admin] RBAC: Adding query filter params (role.id=24fee0983ae345c288f4974d93a3805d, user.id=e7772324721b448dbaea3369f9e3efa3, scope.system=all) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:12.367662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab27364-1740-40e7-89e3-d7082e9649e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:12.369138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab27364-1740-40e7-89e3-d7082e9649e7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:12.371951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56c441-1343-4b4d-873d-7b8c8421118d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:12.375134 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 137/285] 10.222.0.70 () {56 vars in 1308 bytes} [Sun Aug 28 18:36:12 2022] GET /identity/v3/role_assignments?user.id=e7772324721b448dbaea3369f9e3efa3&scope.system=all&role.id=24fee0983ae345c288f4974d93a3805d => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:12.459823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab27364-1740-40e7-89e3-d7082e9649e7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:12.513982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56c441-1343-4b4d-873d-7b8c8421118d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:12.563075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bee6d-4224-4587-8cd4-8757ccbaace4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:12.563744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bee6d-4224-4587-8cd4-8757ccbaace4 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:12.564024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bee6d-4224-4587-8cd4-8757ccbaace4 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:12.564295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bee6d-4224-4587-8cd4-8757ccbaace4 None admin] PATH_INFO: `/v3/users/003db1054d304928af578d1bc90df1c5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:12.566349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bee6d-4224-4587-8cd4-8757ccbaace4 None admin] RBAC: Authorizing `identity:get_user(user_id=003db1054d304928af578d1bc90df1c5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:12.569443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bee6d-4224-4587-8cd4-8757ccbaace4 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:12.576393 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 149/286] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:12 2022] GET /identity/v3/users/003db1054d304928af578d1bc90df1c5 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:12.580477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bee6d-4224-4587-8cd4-8757ccbaace4 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:12.606626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:12.609696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab27364-1740-40e7-89e3-d7082e9649e7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:12.639244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:12.655476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702473c-e62a-428f-8cb4-f514f56634e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:12.656109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702473c-e62a-428f-8cb4-f514f56634e8 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:12.656388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702473c-e62a-428f-8cb4-f514f56634e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:12.656657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702473c-e62a-428f-8cb4-f514f56634e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:12.671009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702473c-e62a-428f-8cb4-f514f56634e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-8702473c-e62a-428f-8cb4-f514f56634e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:12.678170 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:12.679139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:12.679919 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:12.679919 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:12.679919 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:12.679919 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:12.679919 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:12.679919 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:12.679919 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:12.679919 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:12.679919 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:12.679919 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:12.679919 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:12.679919 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:12.679919 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 138/287] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:12.686758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702473c-e62a-428f-8cb4-f514f56634e8 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:12.706926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bee6d-4224-4587-8cd4-8757ccbaace4 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:12.752711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92512b06-838f-4fa1-8964-cc060042cdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:12.754063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92512b06-838f-4fa1-8964-cc060042cdec None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:12.754436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92512b06-838f-4fa1-8964-cc060042cdec None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:12.755113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92512b06-838f-4fa1-8964-cc060042cdec None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:12.756609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92512b06-838f-4fa1-8964-cc060042cdec None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:12.758655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92512b06-838f-4fa1-8964-cc060042cdec None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:12.760481 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 150/288] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:12 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:12.765898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92512b06-838f-4fa1-8964-cc060042cdec None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:12.813124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702473c-e62a-428f-8cb4-f514f56634e8 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:12.861034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88dbdf0-97fb-4008-9118-ec8baa992836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:12.861653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dbdf0-97fb-4008-9118-ec8baa992836 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:12.861990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dbdf0-97fb-4008-9118-ec8baa992836 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:12.862271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dbdf0-97fb-4008-9118-ec8baa992836 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:12.863554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88dbdf0-97fb-4008-9118-ec8baa992836 None admin] RBAC: Adding query filter params (name=member) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:12.863940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88dbdf0-97fb-4008-9118-ec8baa992836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:12.865319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88dbdf0-97fb-4008-9118-ec8baa992836 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:12.874637 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 139/289] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:12.885002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88dbdf0-97fb-4008-9118-ec8baa992836 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:12.888943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:12.903919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92512b06-838f-4fa1-8964-cc060042cdec None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:12.937726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:12.942871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72810bd-b79a-46d5-a03d-932be6abef3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:12.943844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72810bd-b79a-46d5-a03d-932be6abef3f None admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:12.944323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72810bd-b79a-46d5-a03d-932be6abef3f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:12.944790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72810bd-b79a-46d5-a03d-932be6abef3f None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6/users/003db1054d304928af578d1bc90df1c5/roles/b23c0fe3d2bc47ada7cee9cb5db1638a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:12.947051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72810bd-b79a-46d5-a03d-932be6abef3f None admin] RBAC: Authorizing `identity:create_grant(project_id=00edf8173f2c446bbfd98af8172124c6, user_id=003db1054d304928af578d1bc90df1c5, role_id=b23c0fe3d2bc47ada7cee9cb5db1638a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:12.948713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72810bd-b79a-46d5-a03d-932be6abef3f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:12.963924 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 151/290] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:36:12 2022] PUT /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6/users/003db1054d304928af578d1bc90df1c5/roles/b23c0fe3d2bc47ada7cee9cb5db1638a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:36:13.027077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88dbdf0-97fb-4008-9118-ec8baa992836 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:13.083547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d49392-b7ad-4a35-9e55-ff44b8b10320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:13.084200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d49392-b7ad-4a35-9e55-ff44b8b10320 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:13.084478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d49392-b7ad-4a35-9e55-ff44b8b10320 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:13.084747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d49392-b7ad-4a35-9e55-ff44b8b10320 None admin] PATH_INFO: `/v3/users/c9b1f486e84044a59213907ae973fef8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:13.089407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d49392-b7ad-4a35-9e55-ff44b8b10320 None admin] RBAC: Authorizing `identity:get_user(user_id=c9b1f486e84044a59213907ae973fef8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:13.091014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d49392-b7ad-4a35-9e55-ff44b8b10320 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:13.093079 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 140/291] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:12 2022] GET /identity/v3/users/c9b1f486e84044a59213907ae973fef8 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:13.098680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72810bd-b79a-46d5-a03d-932be6abef3f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:13.227093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72810bd-b79a-46d5-a03d-932be6abef3f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:13.263264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a32481-25e7-49e8-baad-a86bb7e1b348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:13.264292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a32481-25e7-49e8-baad-a86bb7e1b348 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:13.264767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a32481-25e7-49e8-baad-a86bb7e1b348 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:13.265247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a32481-25e7-49e8-baad-a86bb7e1b348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:13.288856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:13.339397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a32481-25e7-49e8-baad-a86bb7e1b348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:13.340866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a32481-25e7-49e8-baad-a86bb7e1b348 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:13.444164 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 152/292] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:13.449698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d49392-b7ad-4a35-9e55-ff44b8b10320 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:13.589480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d49392-b7ad-4a35-9e55-ff44b8b10320 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:13.603569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:13.640368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb519a-4155-4a6a-8af2-d7b4fff33ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:13.641006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb519a-4155-4a6a-8af2-d7b4fff33ec0 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:13.641286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb519a-4155-4a6a-8af2-d7b4fff33ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:13.641559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb519a-4155-4a6a-8af2-d7b4fff33ec0 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:13.647408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb519a-4155-4a6a-8af2-d7b4fff33ec0 None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:13.648853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb519a-4155-4a6a-8af2-d7b4fff33ec0 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:13.650823 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 141/293] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:13 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:13.656543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a32481-25e7-49e8-baad-a86bb7e1b348 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:13.774767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:13.854828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a32481-25e7-49e8-baad-a86bb7e1b348 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:13.902588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ba0e3-e002-497a-ac29-720dbfc5edaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:13.903226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ba0e3-e002-497a-ac29-720dbfc5edaf None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:13.903505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ba0e3-e002-497a-ac29-720dbfc5edaf None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:13.903774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ba0e3-e002-497a-ac29-720dbfc5edaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:13.904503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ba0e3-e002-497a-ac29-720dbfc5edaf None admin] RBAC: Adding query filter params (role.id=24fee0983ae345c288f4974d93a3805d, scope.project.id=00edf8173f2c446bbfd98af8172124c6, user.id=c9b1f486e84044a59213907ae973fef8) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:13.904806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ba0e3-e002-497a-ac29-720dbfc5edaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:13.906237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ba0e3-e002-497a-ac29-720dbfc5edaf None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:13.913177 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 153/294] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:13 2022] GET /identity/v3/role_assignments?user.id=c9b1f486e84044a59213907ae973fef8&scope.project.id=00edf8173f2c446bbfd98af8172124c6&role.id=24fee0983ae345c288f4974d93a3805d => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:14.657654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6b011-b1f1-4988-8584-5e696dd51454 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:14.658156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6b011-b1f1-4988-8584-5e696dd51454 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:14.658259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6b011-b1f1-4988-8584-5e696dd51454 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:14.660419 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 142/295] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:14.665631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deaa78-7119-453a-92e4-f25297aa0404 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:14.666044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deaa78-7119-453a-92e4-f25297aa0404 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:14.666367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deaa78-7119-453a-92e4-f25297aa0404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:14.685415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-79deaa78-7119-453a-92e4-f25297aa0404 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:14.686591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-79deaa78-7119-453a-92e4-f25297aa0404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:14.758474 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 154/296] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:14.857278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594971fb-b7a4-4ffc-99eb-faeac4847b00 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:14.857591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594971fb-b7a4-4ffc-99eb-faeac4847b00 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:14.857784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594971fb-b7a4-4ffc-99eb-faeac4847b00 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:14.859424 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 143/297] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:14.864846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb5b8a-7624-4e80-898b-d1d3901ec583 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:14.865143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb5b8a-7624-4e80-898b-d1d3901ec583 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:14.865425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb5b8a-7624-4e80-898b-d1d3901ec583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:14.884064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-16bb5b8a-7624-4e80-898b-d1d3901ec583 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:14.885266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-16bb5b8a-7624-4e80-898b-d1d3901ec583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:14.921952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:14.928366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a091c-0c4a-4b97-96dc-77708abb6006 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:14.928658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a091c-0c4a-4b97-96dc-77708abb6006 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:14.928937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a091c-0c4a-4b97-96dc-77708abb6006 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:14.930276 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 144/298] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:36:14.935524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687276b-cb1f-438f-960e-3a1a055dd469 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:14.936037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687276b-cb1f-438f-960e-3a1a055dd469 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:14.936510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687276b-cb1f-438f-960e-3a1a055dd469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:14.958557 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 155/299] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:14.959400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4687276b-cb1f-438f-960e-3a1a055dd469 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:14.960854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4687276b-cb1f-438f-960e-3a1a055dd469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:15.033003 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 145/300] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:15.054966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb5b8a-7624-4e80-898b-d1d3901ec583 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:15.159070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb5b8a-7624-4e80-898b-d1d3901ec583 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:15.194198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db4533-ae17-45f8-b827-af98875935b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:15.194860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db4533-ae17-45f8-b827-af98875935b6 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:15.195148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db4533-ae17-45f8-b827-af98875935b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:15.195424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db4533-ae17-45f8-b827-af98875935b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:15.205646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db4533-ae17-45f8-b827-af98875935b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-b8db4533-ae17-45f8-b827-af98875935b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:15.211351 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:15.212194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:15.213391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:15.213391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:15.213391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:15.213391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:15.213391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:15.213391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:15.213391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:15.213391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:15.213391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:15.213391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:15.213391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:15.213391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:15.213391 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 156/301] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:15.218216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687276b-cb1f-438f-960e-3a1a055dd469 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:15.236664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db4533-ae17-45f8-b827-af98875935b6 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:15.277428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:15.325187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687276b-cb1f-438f-960e-3a1a055dd469 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:15.337753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:15.364325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db4533-ae17-45f8-b827-af98875935b6 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:15.364873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e6aa2-2a53-42a1-9ec6-138cb03119f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:15.365480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e6aa2-2a53-42a1-9ec6-138cb03119f1 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:15.365795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e6aa2-2a53-42a1-9ec6-138cb03119f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:15.366020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e6aa2-2a53-42a1-9ec6-138cb03119f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:15.366780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e6aa2-2a53-42a1-9ec6-138cb03119f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:15.367010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e6aa2-2a53-42a1-9ec6-138cb03119f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:15.368370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e6aa2-2a53-42a1-9ec6-138cb03119f1 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:15.378999 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 146/302] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:15.378999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e6aa2-2a53-42a1-9ec6-138cb03119f1 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:15.401530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2a32e-6657-4886-b552-247593cd785a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:15.402162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a32e-6657-4886-b552-247593cd785a None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:15.402445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a32e-6657-4886-b552-247593cd785a None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:15.402723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a32e-6657-4886-b552-247593cd785a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:15.403930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2a32e-6657-4886-b552-247593cd785a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:15.405372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2a32e-6657-4886-b552-247593cd785a None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:15.407118 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 157/303] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:15.407807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2a32e-6657-4886-b552-247593cd785a None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:15.487891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e6aa2-2a53-42a1-9ec6-138cb03119f1 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:15.508278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:15.511423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2a32e-6657-4886-b552-247593cd785a None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:15.520729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3fb4-28de-47f6-921f-95a7d20f0cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:15.521359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3fb4-28de-47f6-921f-95a7d20f0cfb None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:15.521638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3fb4-28de-47f6-921f-95a7d20f0cfb None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:15.521910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3fb4-28de-47f6-921f-95a7d20f0cfb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:15.531755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de3fb4-28de-47f6-921f-95a7d20f0cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-c0de3fb4-28de-47f6-921f-95a7d20f0cfb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:15.537676 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:15.538539 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 147/304] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:15.539662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3fb4-28de-47f6-921f-95a7d20f0cfb None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:15.549257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672ec61-ca4a-45da-814e-7593e4ba6f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:15.550467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672ec61-ca4a-45da-814e-7593e4ba6f25 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:15.550933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672ec61-ca4a-45da-814e-7593e4ba6f25 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:15.551204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672ec61-ca4a-45da-814e-7593e4ba6f25 None admin] PATH_INFO: `/v3/users/e7772324721b448dbaea3369f9e3efa3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:15.552333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672ec61-ca4a-45da-814e-7593e4ba6f25 None admin] RBAC: Authorizing `identity:get_user(user_id=e7772324721b448dbaea3369f9e3efa3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:15.553765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672ec61-ca4a-45da-814e-7593e4ba6f25 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:15.555385 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 158/305] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:15 2022] GET /identity/v3/users/e7772324721b448dbaea3369f9e3efa3 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:15.556491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c70bb-c644-4c3f-8661-c1bafefb407a None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:15.556775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c70bb-c644-4c3f-8661-c1bafefb407a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:15.557048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c70bb-c644-4c3f-8661-c1bafefb407a None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:15.558483 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 159/306] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:15.559222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c70bb-c644-4c3f-8661-c1bafefb407a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:15.582081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:15.652112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3fb4-28de-47f6-921f-95a7d20f0cfb None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:15.669464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c70bb-c644-4c3f-8661-c1bafefb407a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:15.685954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0fa5-bef2-44c3-ab74-a34165bf0025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:15.686562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0fa5-bef2-44c3-ab74-a34165bf0025 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:15.686875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0fa5-bef2-44c3-ab74-a34165bf0025 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:15.687389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0fa5-bef2-44c3-ab74-a34165bf0025 None admin] PATH_INFO: `/v3/groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:15.687770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b0fa5-bef2-44c3-ab74-a34165bf0025 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:15.689194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b0fa5-bef2-44c3-ab74-a34165bf0025 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:15.704691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a7934-f4e5-4c29-87e6-dc5c9d2c5f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:15.704879 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 148/307] 10.222.0.70 () {60 vars in 1134 bytes} [Sun Aug 28 18:36:15 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:15.705593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0fa5-bef2-44c3-ab74-a34165bf0025 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:15.707285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a7934-f4e5-4c29-87e6-dc5c9d2c5f78 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:15.707571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a7934-f4e5-4c29-87e6-dc5c9d2c5f78 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:15.707851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a7934-f4e5-4c29-87e6-dc5c9d2c5f78 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:15.708567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a7934-f4e5-4c29-87e6-dc5c9d2c5f78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:15.708875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a7934-f4e5-4c29-87e6-dc5c9d2c5f78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:15.710285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a7934-f4e5-4c29-87e6-dc5c9d2c5f78 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:15.725999 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 160/308] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:15.725999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0fb4-ea2a-4856-b7d3-0f4ff89a460c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:15.725999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0fb4-ea2a-4856-b7d3-0f4ff89a460c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:15.725999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e0fb4-ea2a-4856-b7d3-0f4ff89a460c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:15.745459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-891e0fb4-ea2a-4856-b7d3-0f4ff89a460c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:15.746680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-891e0fb4-ea2a-4856-b7d3-0f4ff89a460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:15.777363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:15.818393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:15.829906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0fa5-bef2-44c3-ab74-a34165bf0025 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:15.830926 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 161/309] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:15.831884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0fb4-ea2a-4856-b7d3-0f4ff89a460c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:15.880009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac6b70-e159-47f7-983d-9f7a0f93b3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:15.880682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac6b70-e159-47f7-983d-9f7a0f93b3a8 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:15.880965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac6b70-e159-47f7-983d-9f7a0f93b3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:15.881243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac6b70-e159-47f7-983d-9f7a0f93b3a8 None admin] PATH_INFO: `/v3/system/users/e7772324721b448dbaea3369f9e3efa3/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:15.882680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac6b70-e159-47f7-983d-9f7a0f93b3a8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e7772324721b448dbaea3369f9e3efa3, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:15.884121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac6b70-e159-47f7-983d-9f7a0f93b3a8 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:15.896774 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 149/310] 10.222.0.70 () {58 vars in 1334 bytes} [Sun Aug 28 18:36:15 2022] PUT /identity/v3/system/users/e7772324721b448dbaea3369f9e3efa3/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:15.980240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e0fb4-ea2a-4856-b7d3-0f4ff89a460c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:16.022210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcd46f-0322-4198-90f2-54cf836c11ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:16.023248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcd46f-0322-4198-90f2-54cf836c11ec None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:16.023736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcd46f-0322-4198-90f2-54cf836c11ec None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:16.024211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcd46f-0322-4198-90f2-54cf836c11ec None admin] PATH_INFO: `/v3/users/1ee89d5e23cf4c5ab1080fa0653972ed` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:16.041581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcd46f-0322-4198-90f2-54cf836c11ec None admin] RBAC: Authorizing `identity:get_user(user_id=1ee89d5e23cf4c5ab1080fa0653972ed)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:16.043488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcd46f-0322-4198-90f2-54cf836c11ec None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:16.045387 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 162/311] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:15 2022] GET /identity/v3/users/1ee89d5e23cf4c5ab1080fa0653972ed => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:16.051620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac6b70-e159-47f7-983d-9f7a0f93b3a8 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:16.108815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcd46f-0322-4198-90f2-54cf836c11ec None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:16.134587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:16.176720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac6b70-e159-47f7-983d-9f7a0f93b3a8 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:16.217153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0553cf-fb14-4f63-8cb1-aabe1a54f3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:16.218221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0553cf-fb14-4f63-8cb1-aabe1a54f3d8 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:16.218705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0553cf-fb14-4f63-8cb1-aabe1a54f3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:16.219360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0553cf-fb14-4f63-8cb1-aabe1a54f3d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:16.220318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0553cf-fb14-4f63-8cb1-aabe1a54f3d8 None admin] RBAC: Adding query filter params (role.id=b23c0fe3d2bc47ada7cee9cb5db1638a, user.id=1ee89d5e23cf4c5ab1080fa0653972ed, scope.system=all) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:16.220833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0553cf-fb14-4f63-8cb1-aabe1a54f3d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:16.223727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0553cf-fb14-4f63-8cb1-aabe1a54f3d8 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:16.230048 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 150/312] 10.222.0.70 () {56 vars in 1308 bytes} [Sun Aug 28 18:36:16 2022] GET /identity/v3/role_assignments?user.id=1ee89d5e23cf4c5ab1080fa0653972ed&scope.system=all&role.id=b23c0fe3d2bc47ada7cee9cb5db1638a => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:16.241155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcd46f-0322-4198-90f2-54cf836c11ec None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:16.281039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c4ae-0460-4461-9694-4d75bb522832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:16.281620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c4ae-0460-4461-9694-4d75bb522832 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:16.281971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c4ae-0460-4461-9694-4d75bb522832 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:16.282246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57c4ae-0460-4461-9694-4d75bb522832 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:16.295076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57c4ae-0460-4461-9694-4d75bb522832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-4a57c4ae-0460-4461-9694-4d75bb522832 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:16.300716 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:16.302059 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:16.303338 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:16.303338 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:16.303338 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:16.303338 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:16.303338 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:16.303338 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:16.303338 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:16.303338 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:16.303338 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:16.303338 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:16.303338 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:36:16.303338 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:16.303338 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 163/313] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:16.309026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0553cf-fb14-4f63-8cb1-aabe1a54f3d8 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:16.334196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:16.421519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0553cf-fb14-4f63-8cb1-aabe1a54f3d8 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:16.458381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5543b4c-9e4f-48a2-94ec-bf0e2356905c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:16.459028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5543b4c-9e4f-48a2-94ec-bf0e2356905c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:16.459309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5543b4c-9e4f-48a2-94ec-bf0e2356905c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:16.459586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5543b4c-9e4f-48a2-94ec-bf0e2356905c None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:16.460257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5543b4c-9e4f-48a2-94ec-bf0e2356905c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:16.460559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5543b4c-9e4f-48a2-94ec-bf0e2356905c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:16.461936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5543b4c-9e4f-48a2-94ec-bf0e2356905c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:16.471073 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 151/314] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:16.476776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c4ae-0460-4461-9694-4d75bb522832 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:16.558857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:16.588251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57c4ae-0460-4461-9694-4d75bb522832 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:16.624416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55d6fb-891b-4caf-a074-a1168280f907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:16.625045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55d6fb-891b-4caf-a074-a1168280f907 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:16.625323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55d6fb-891b-4caf-a074-a1168280f907 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:16.625597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55d6fb-891b-4caf-a074-a1168280f907 None admin] PATH_INFO: `/v3/users/003db1054d304928af578d1bc90df1c5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:16.626795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55d6fb-891b-4caf-a074-a1168280f907 None admin] RBAC: Authorizing `identity:get_user(user_id=003db1054d304928af578d1bc90df1c5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:16.628443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55d6fb-891b-4caf-a074-a1168280f907 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:16.630447 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 164/315] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:16 2022] GET /identity/v3/users/003db1054d304928af578d1bc90df1c5 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:16.636473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5543b4c-9e4f-48a2-94ec-bf0e2356905c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:16.734379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:16.755957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5543b4c-9e4f-48a2-94ec-bf0e2356905c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:16.792318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f39e7-52f8-4df7-a61e-7acf670e247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:16.793349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f39e7-52f8-4df7-a61e-7acf670e247a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:16.793858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f39e7-52f8-4df7-a61e-7acf670e247a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:16.794350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f39e7-52f8-4df7-a61e-7acf670e247a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:16.869791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f39e7-52f8-4df7-a61e-7acf670e247a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:16.871623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f39e7-52f8-4df7-a61e-7acf670e247a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:16.961661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:16.984043 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 152/316] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:16.994774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55d6fb-891b-4caf-a074-a1168280f907 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:17.094220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55d6fb-891b-4caf-a074-a1168280f907 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:17.132520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea7e6c-400f-4109-a8be-dcd64ba161f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:17.133070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7e6c-400f-4109-a8be-dcd64ba161f8 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:17.133347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7e6c-400f-4109-a8be-dcd64ba161f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:17.133618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7e6c-400f-4109-a8be-dcd64ba161f8 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:17.134734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea7e6c-400f-4109-a8be-dcd64ba161f8 None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:17.136202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea7e6c-400f-4109-a8be-dcd64ba161f8 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:17.138109 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 165/317] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:16 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:17.144184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f39e7-52f8-4df7-a61e-7acf670e247a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:17.252452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f39e7-52f8-4df7-a61e-7acf670e247a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:17.289074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66246540-d372-4b50-af5a-482fa420b514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:17.289978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66246540-d372-4b50-af5a-482fa420b514 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:17.290453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66246540-d372-4b50-af5a-482fa420b514 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:17.290921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66246540-d372-4b50-af5a-482fa420b514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:17.291834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66246540-d372-4b50-af5a-482fa420b514 None admin] RBAC: Adding query filter params (role.id=b23c0fe3d2bc47ada7cee9cb5db1638a, scope.project.id=00edf8173f2c446bbfd98af8172124c6, user.id=003db1054d304928af578d1bc90df1c5) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:17.292315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66246540-d372-4b50-af5a-482fa420b514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:17.293980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66246540-d372-4b50-af5a-482fa420b514 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:17.301370 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 153/318] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:17 2022] GET /identity/v3/role_assignments?user.id=003db1054d304928af578d1bc90df1c5&scope.project.id=00edf8173f2c446bbfd98af8172124c6&role.id=b23c0fe3d2bc47ada7cee9cb5db1638a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:17.749205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eb277-ff11-4a80-838b-107b142d84a9 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:17.749567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eb277-ff11-4a80-838b-107b142d84a9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:17.749762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eb277-ff11-4a80-838b-107b142d84a9 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:17.751288 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 166/319] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:17.756975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd6624-22e3-4932-aa11-5ae2bb8e3e0a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:17.757435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd6624-22e3-4932-aa11-5ae2bb8e3e0a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:17.757599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd6624-22e3-4932-aa11-5ae2bb8e3e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:17.776367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d8bd6624-22e3-4932-aa11-5ae2bb8e3e0a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:17.777548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d8bd6624-22e3-4932-aa11-5ae2bb8e3e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:17.822216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:17.848813 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 154/320] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:17.990257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632e0fc-544a-4597-892d-586c5428b0c0 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:17.990615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632e0fc-544a-4597-892d-586c5428b0c0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:17.990843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632e0fc-544a-4597-892d-586c5428b0c0 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:17.992324 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 167/321] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:17.997431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28def4ca-de97-482d-85b1-59f78e311497 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:17.997729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28def4ca-de97-482d-85b1-59f78e311497 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:17.998009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28def4ca-de97-482d-85b1-59f78e311497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.016110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-28def4ca-de97-482d-85b1-59f78e311497 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:18.017294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-28def4ca-de97-482d-85b1-59f78e311497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:18.086477 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 155/322] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:18.127541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632e0fc-544a-4597-892d-586c5428b0c0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.144204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:18.201232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160197-0393-4e56-9f76-840407009ec3 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.201526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160197-0393-4e56-9f76-840407009ec3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.201802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160197-0393-4e56-9f76-840407009ec3 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.203181 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 156/323] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:36:18.208740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838f73f-bd1f-409c-a95c-3a32fe23e237 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.209024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838f73f-bd1f-409c-a95c-3a32fe23e237 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.209297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838f73f-bd1f-409c-a95c-3a32fe23e237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.228050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1838f73f-bd1f-409c-a95c-3a32fe23e237 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:18.229289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1838f73f-bd1f-409c-a95c-3a32fe23e237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:18.240737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632e0fc-544a-4597-892d-586c5428b0c0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:18.278714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402c7cb-c5ca-471a-8400-13a58392ac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:18.279457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402c7cb-c5ca-471a-8400-13a58392ac49 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.279635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402c7cb-c5ca-471a-8400-13a58392ac49 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.279905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402c7cb-c5ca-471a-8400-13a58392ac49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.280995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402c7cb-c5ca-471a-8400-13a58392ac49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:18.282429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402c7cb-c5ca-471a-8400-13a58392ac49 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:18.284764 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 168/324] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:18.290097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402c7cb-c5ca-471a-8400-13a58392ac49 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.310521 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 157/325] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:18.369234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838f73f-bd1f-409c-a95c-3a32fe23e237 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.378142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:18.400050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402c7cb-c5ca-471a-8400-13a58392ac49 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:18.405189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:18.439292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad5fb9-4330-4342-b384-802a350a5efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:18.440169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad5fb9-4330-4342-b384-802a350a5efd None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.440858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad5fb9-4330-4342-b384-802a350a5efd None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.441313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad5fb9-4330-4342-b384-802a350a5efd None admin] PATH_INFO: `/v3/groups` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.442081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad5fb9-4330-4342-b384-802a350a5efd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:18.443705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad5fb9-4330-4342-b384-802a350a5efd None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:18.474773 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 169/326] 10.222.0.70 () {60 vars in 1134 bytes} [Sun Aug 28 18:36:18 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:36:18.477926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838f73f-bd1f-409c-a95c-3a32fe23e237 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:18.517664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0196e31-1b20-4c6b-9ee0-755a14628865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:18.518320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0196e31-1b20-4c6b-9ee0-755a14628865 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.518635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0196e31-1b20-4c6b-9ee0-755a14628865 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.519050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0196e31-1b20-4c6b-9ee0-755a14628865 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.531017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0196e31-1b20-4c6b-9ee0-755a14628865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-b0196e31-1b20-4c6b-9ee0-755a14628865 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:18.536766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:18.537671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:18.538485 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:18.538485 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:18.538485 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:18.538485 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:18.538485 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:18.538485 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:18.538485 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:18.538485 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:18.538485 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:18.538485 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:18.538485 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:18.538485 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:18.542829 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 158/327] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:18.544229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad5fb9-4330-4342-b384-802a350a5efd None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.587605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0196e31-1b20-4c6b-9ee0-755a14628865 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.661715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad5fb9-4330-4342-b384-802a350a5efd None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:18.704904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb790f43-c209-49e0-b6e8-1acd23418749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:18.705772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790f43-c209-49e0-b6e8-1acd23418749 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.706726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790f43-c209-49e0-b6e8-1acd23418749 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.707038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790f43-c209-49e0-b6e8-1acd23418749 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.707896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb790f43-c209-49e0-b6e8-1acd23418749 None admin] RBAC: Adding query filter params (name=member) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:18.708159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb790f43-c209-49e0-b6e8-1acd23418749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:18.709555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb790f43-c209-49e0-b6e8-1acd23418749 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:18.710439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:18.718832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0196e31-1b20-4c6b-9ee0-755a14628865 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:18.721889 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 170/328] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:18.729510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb790f43-c209-49e0-b6e8-1acd23418749 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.735419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:18.763680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b45dc-76f8-4b1d-86a5-c5f633ee0390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:18.764331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b45dc-76f8-4b1d-86a5-c5f633ee0390 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.764614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b45dc-76f8-4b1d-86a5-c5f633ee0390 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.764889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b45dc-76f8-4b1d-86a5-c5f633ee0390 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.778228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b45dc-76f8-4b1d-86a5-c5f633ee0390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-6b1b45dc-76f8-4b1d-86a5-c5f633ee0390 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:18.783262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:18.784681 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:18.785565 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:18.785565 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:18.785565 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:18.785565 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:18.785565 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:18.785565 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:18.785565 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:18.785565 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:18.785565 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:18.785565 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:18.785565 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:36:18.785565 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:18.785565 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 159/329] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:18.792378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b45dc-76f8-4b1d-86a5-c5f633ee0390 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.881029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb790f43-c209-49e0-b6e8-1acd23418749 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:18.922101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597de27a-26aa-46f1-af3d-f7385d462fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:18.923061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597de27a-26aa-46f1-af3d-f7385d462fc6 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.923531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597de27a-26aa-46f1-af3d-f7385d462fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.923810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597de27a-26aa-46f1-af3d-f7385d462fc6 None admin] PATH_INFO: `/v3/users/e7772324721b448dbaea3369f9e3efa3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.925517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597de27a-26aa-46f1-af3d-f7385d462fc6 None admin] RBAC: Authorizing `identity:get_user(user_id=e7772324721b448dbaea3369f9e3efa3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:18.927115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597de27a-26aa-46f1-af3d-f7385d462fc6 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:18.929023 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 171/330] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:18 2022] GET /identity/v3/users/e7772324721b448dbaea3369f9e3efa3 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:18.935359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597de27a-26aa-46f1-af3d-f7385d462fc6 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:18.937946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b45dc-76f8-4b1d-86a5-c5f633ee0390 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:18.992541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e9134-1ad2-4a05-b464-770c9acec195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:18.994076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e9134-1ad2-4a05-b464-770c9acec195 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:18.994556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e9134-1ad2-4a05-b464-770c9acec195 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:18.995047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e9134-1ad2-4a05-b464-770c9acec195 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:18.996410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e9134-1ad2-4a05-b464-770c9acec195 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:18.996935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e9134-1ad2-4a05-b464-770c9acec195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:19.000333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e9134-1ad2-4a05-b464-770c9acec195 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:19.013977 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 160/331] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:19.021218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e9134-1ad2-4a05-b464-770c9acec195 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:19.037468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:19.046013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:19.086129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597de27a-26aa-46f1-af3d-f7385d462fc6 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:19.134475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51d4ce-db88-44ab-8efa-b654b596f026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:19.135130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51d4ce-db88-44ab-8efa-b654b596f026 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:19.135394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51d4ce-db88-44ab-8efa-b654b596f026 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:19.135676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51d4ce-db88-44ab-8efa-b654b596f026 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:19.136485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51d4ce-db88-44ab-8efa-b654b596f026 None admin] RBAC: Adding query filter params (role.id=24fee0983ae345c288f4974d93a3805d, user.id=e7772324721b448dbaea3369f9e3efa3, scope.system=all) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:19.136799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51d4ce-db88-44ab-8efa-b654b596f026 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:19.138564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51d4ce-db88-44ab-8efa-b654b596f026 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:19.155030 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 172/332] 10.222.0.70 () {56 vars in 1308 bytes} [Sun Aug 28 18:36:18 2022] GET /identity/v3/role_assignments?user.id=e7772324721b448dbaea3369f9e3efa3&scope.system=all&role.id=24fee0983ae345c288f4974d93a3805d => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:19.165447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e9134-1ad2-4a05-b464-770c9acec195 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:19.209364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb34b0-2ee7-45ab-8f4c-8019dbe26b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:19.209995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb34b0-2ee7-45ab-8f4c-8019dbe26b9b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:19.210284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb34b0-2ee7-45ab-8f4c-8019dbe26b9b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:19.210561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb34b0-2ee7-45ab-8f4c-8019dbe26b9b None admin] PATH_INFO: `/v3/users/1ee89d5e23cf4c5ab1080fa0653972ed` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:19.211817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb34b0-2ee7-45ab-8f4c-8019dbe26b9b None admin] RBAC: Authorizing `identity:get_user(user_id=1ee89d5e23cf4c5ab1080fa0653972ed)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:19.213456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb34b0-2ee7-45ab-8f4c-8019dbe26b9b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:19.215459 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 161/333] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:19 2022] GET /identity/v3/users/1ee89d5e23cf4c5ab1080fa0653972ed => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:19.220962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51d4ce-db88-44ab-8efa-b654b596f026 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:19.341060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51d4ce-db88-44ab-8efa-b654b596f026 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:19.372618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:19.378993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1c1a4-4853-4b8a-8553-177dcbbe95f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:19.380108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1c1a4-4853-4b8a-8553-177dcbbe95f9 None admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:19.380459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1c1a4-4853-4b8a-8553-177dcbbe95f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:19.380802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1c1a4-4853-4b8a-8553-177dcbbe95f9 None admin] PATH_INFO: `/v3/system/users/1ee89d5e23cf4c5ab1080fa0653972ed/roles/b23c0fe3d2bc47ada7cee9cb5db1638a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:19.382316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1c1a4-4853-4b8a-8553-177dcbbe95f9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1ee89d5e23cf4c5ab1080fa0653972ed, role_id=b23c0fe3d2bc47ada7cee9cb5db1638a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:19.383895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1c1a4-4853-4b8a-8553-177dcbbe95f9 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:19.396709 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 173/334] 10.222.0.70 () {58 vars in 1334 bytes} [Sun Aug 28 18:36:19 2022] PUT /identity/v3/system/users/1ee89d5e23cf4c5ab1080fa0653972ed/roles/b23c0fe3d2bc47ada7cee9cb5db1638a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:20.671872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a07b9-a012-45d7-a49e-506d4c8d9029 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:20.671872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a07b9-a012-45d7-a49e-506d4c8d9029 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:20.671872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a07b9-a012-45d7-a49e-506d4c8d9029 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:20.672866 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 162/335] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:20.679339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0274a-7fa3-4198-96d5-08c290231a65 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:20.679800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0274a-7fa3-4198-96d5-08c290231a65 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:20.680042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0274a-7fa3-4198-96d5-08c290231a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:20.702239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bad0274a-7fa3-4198-96d5-08c290231a65 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:20.706546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bad0274a-7fa3-4198-96d5-08c290231a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:20.801892 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 174/336] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:21.115744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185a55c-00ce-4674-bdb1-df353d2a5b99 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:21.116117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185a55c-00ce-4674-bdb1-df353d2a5b99 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:21.116304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185a55c-00ce-4674-bdb1-df353d2a5b99 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:21.117793 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 163/337] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:21.136258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a69ae-9dc5-43f1-ac5a-d9ae1f2f32a0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:21.136564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a69ae-9dc5-43f1-ac5a-d9ae1f2f32a0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:21.136820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a69ae-9dc5-43f1-ac5a-d9ae1f2f32a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:21.161399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7e7a69ae-9dc5-43f1-ac5a-d9ae1f2f32a0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:21.162602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7e7a69ae-9dc5-43f1-ac5a-d9ae1f2f32a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:21.253409 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 175/338] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:21.313615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185a55c-00ce-4674-bdb1-df353d2a5b99 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:21.426167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:21.445387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185a55c-00ce-4674-bdb1-df353d2a5b99 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:21.484053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b4ad9-a2fa-4f1b-8e31-b19b0997a2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:21.484687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b4ad9-a2fa-4f1b-8e31-b19b0997a2c5 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:21.484965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b4ad9-a2fa-4f1b-8e31-b19b0997a2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:21.485289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b4ad9-a2fa-4f1b-8e31-b19b0997a2c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:21.502554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b4ad9-a2fa-4f1b-8e31-b19b0997a2c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-f32b4ad9-a2fa-4f1b-8e31-b19b0997a2c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:21.508273 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:21.509148 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:21.509912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:21.509912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:21.509912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:21.509912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:21.509912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:21.509912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:21.509912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:21.509912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:21.509912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:21.509912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:21.509912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:21.509912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:21.509912 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 164/339] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:21.515867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a69ae-9dc5-43f1-ac5a-d9ae1f2f32a0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:21.594693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:21.648088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a69ae-9dc5-43f1-ac5a-d9ae1f2f32a0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:21.699751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eb527-31f1-43c1-8c3b-e77b1c047cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:21.700338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eb527-31f1-43c1-8c3b-e77b1c047cab None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:21.700561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eb527-31f1-43c1-8c3b-e77b1c047cab None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:21.700820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eb527-31f1-43c1-8c3b-e77b1c047cab None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:21.701492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7eb527-31f1-43c1-8c3b-e77b1c047cab None admin] RBAC: Adding query filter params (name=member) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:21.701793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7eb527-31f1-43c1-8c3b-e77b1c047cab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:21.703275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7eb527-31f1-43c1-8c3b-e77b1c047cab None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:21.718640 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 176/340] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:21.724201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b4ad9-a2fa-4f1b-8e31-b19b0997a2c5 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:21.726345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ceee01-492c-4dd3-a678-19501e6e6837 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:21.726632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ceee01-492c-4dd3-a678-19501e6e6837 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:21.726940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ceee01-492c-4dd3-a678-19501e6e6837 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:21.728514 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 177/341] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:21.746718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a6588-129c-4675-8995-e9915bd7fa43 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:21.747015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a6588-129c-4675-8995-e9915bd7fa43 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:21.747334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a6588-129c-4675-8995-e9915bd7fa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:21.771817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d99a6588-129c-4675-8995-e9915bd7fa43 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:21.773028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d99a6588-129c-4675-8995-e9915bd7fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:21.882083 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 178/342] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:21.884223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a6588-129c-4675-8995-e9915bd7fa43 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:21.933652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b4ad9-a2fa-4f1b-8e31-b19b0997a2c5 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:21.939304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:21.983140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396fc3d-f9d2-492b-8e38-32f42b675130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:21.983673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396fc3d-f9d2-492b-8e38-32f42b675130 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:21.983951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396fc3d-f9d2-492b-8e38-32f42b675130 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:21.984222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396fc3d-f9d2-492b-8e38-32f42b675130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:22.001022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:22.005001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a6588-129c-4675-8995-e9915bd7fa43 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:22.052299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16621cce-7065-4638-944e-69671154b5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:22.053306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16621cce-7065-4638-944e-69671154b5e5 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:22.053807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16621cce-7065-4638-944e-69671154b5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:22.054274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16621cce-7065-4638-944e-69671154b5e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:22.064291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396fc3d-f9d2-492b-8e38-32f42b675130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:22.065850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16621cce-7065-4638-944e-69671154b5e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:22.066357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396fc3d-f9d2-492b-8e38-32f42b675130 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-16621cce-7065-4638-944e-69671154b5e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:22.071262 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:22.072125 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:22.072883 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:22.072883 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:22.072883 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:22.072883 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:22.072883 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:22.072883 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:22.072883 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:22.072883 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:22.072883 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:22.072883 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:22.072883 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:22.072883 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:22.075577 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 179/343] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:36:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:22.077482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09332110-e6ec-4bd9-a425-d0c8dbe476d1 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:22.077964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09332110-e6ec-4bd9-a425-d0c8dbe476d1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:22.078430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09332110-e6ec-4bd9-a425-d0c8dbe476d1 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:22.084399 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 180/344] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:22.086837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09332110-e6ec-4bd9-a425-d0c8dbe476d1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:22.207190 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 165/345] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:22.208829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150765-505d-4eae-bfc8-696ac9cbdc05 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:22.209363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150765-505d-4eae-bfc8-696ac9cbdc05 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:22.209849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95150765-505d-4eae-bfc8-696ac9cbdc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:22.227175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09332110-e6ec-4bd9-a425-d0c8dbe476d1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:22.230184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-95150765-505d-4eae-bfc8-696ac9cbdc05 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:22.231632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-95150765-505d-4eae-bfc8-696ac9cbdc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:22.235732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:22.268084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049600fe-c8c7-4cef-a971-7312bbee58ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:22.268845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049600fe-c8c7-4cef-a971-7312bbee58ec None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:22.269132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049600fe-c8c7-4cef-a971-7312bbee58ec None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:22.269411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049600fe-c8c7-4cef-a971-7312bbee58ec None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:22.270078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049600fe-c8c7-4cef-a971-7312bbee58ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:22.270398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049600fe-c8c7-4cef-a971-7312bbee58ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:22.271916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049600fe-c8c7-4cef-a971-7312bbee58ec None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:22.281364 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 181/346] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:22.282195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049600fe-c8c7-4cef-a971-7312bbee58ec None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:22.285887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:22.314630 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 166/347] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:22.315755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95150765-505d-4eae-bfc8-696ac9cbdc05 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:22.392592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049600fe-c8c7-4cef-a971-7312bbee58ec None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:22.425648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95150765-505d-4eae-bfc8-696ac9cbdc05 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:22.430353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf88c8-d1a2-4860-9950-83ed218d3e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:22.431287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf88c8-d1a2-4860-9950-83ed218d3e8f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:22.431781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf88c8-d1a2-4860-9950-83ed218d3e8f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:22.432244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf88c8-d1a2-4860-9950-83ed218d3e8f None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:22.433905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf88c8-d1a2-4860-9950-83ed218d3e8f None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:22.435574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf88c8-d1a2-4860-9950-83ed218d3e8f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:22.437758 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 182/348] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:22 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:22.438734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf88c8-d1a2-4860-9950-83ed218d3e8f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:22.468272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb8f94-a44a-4030-9504-6d66e74863d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:22.469336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb8f94-a44a-4030-9504-6d66e74863d9 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:22.469336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb8f94-a44a-4030-9504-6d66e74863d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:22.469584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb8f94-a44a-4030-9504-6d66e74863d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:22.481363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb8f94-a44a-4030-9504-6d66e74863d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:22.483911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-5abb8f94-a44a-4030-9504-6d66e74863d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:22.488797 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:22.489884 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:22.490732 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:22.490732 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:22.490732 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:22.490732 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:22.490732 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:22.490732 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:22.490732 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:22.490732 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:22.490732 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:22.490732 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:22.490732 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:22.490732 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:22.493498 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 167/349] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:22.499231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb8f94-a44a-4030-9504-6d66e74863d9 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:22.557041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf88c8-d1a2-4860-9950-83ed218d3e8f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:22.560113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:22.602640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf83e4-9f99-4bfd-874c-9046ac50e22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:22.603429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf83e4-9f99-4bfd-874c-9046ac50e22f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:22.603857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf83e4-9f99-4bfd-874c-9046ac50e22f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:22.604250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf83e4-9f99-4bfd-874c-9046ac50e22f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:22.621535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb8f94-a44a-4030-9504-6d66e74863d9 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:22.661914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95171723-dbb3-48a7-8089-7817db9671d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:22.663141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95171723-dbb3-48a7-8089-7817db9671d3 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:22.663567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95171723-dbb3-48a7-8089-7817db9671d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:22.663974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95171723-dbb3-48a7-8089-7817db9671d3 None admin] PATH_INFO: `/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:22.675543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95171723-dbb3-48a7-8089-7817db9671d3 None admin] RBAC: Authorizing `identity:get_group(group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:22.677207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95171723-dbb3-48a7-8089-7817db9671d3 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:22.679065 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 168/350] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:22 2022] GET /identity/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:22.681983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf83e4-9f99-4bfd-874c-9046ac50e22f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:22.683413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95171723-dbb3-48a7-8089-7817db9671d3 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:22.688624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf83e4-9f99-4bfd-874c-9046ac50e22f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:22.727765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:22.804995 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 183/351] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:22.806542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf83e4-9f99-4bfd-874c-9046ac50e22f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:22.868591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:22.872881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95171723-dbb3-48a7-8089-7817db9671d3 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:22.913517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f2558-067b-43d6-99e7-7dfece59026b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:22.914397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f2558-067b-43d6-99e7-7dfece59026b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:22.914853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f2558-067b-43d6-99e7-7dfece59026b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:22.915279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f2558-067b-43d6-99e7-7dfece59026b None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:22.915952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f2558-067b-43d6-99e7-7dfece59026b None admin] RBAC: Adding query filter params (name=member) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:22.916254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f2558-067b-43d6-99e7-7dfece59026b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:22.917624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f2558-067b-43d6-99e7-7dfece59026b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:22.926342 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 169/352] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:22.927273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f2558-067b-43d6-99e7-7dfece59026b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:22.947542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf83e4-9f99-4bfd-874c-9046ac50e22f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:22.994535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3138d-a818-4ab7-9b18-97363285cf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:22.995802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3138d-a818-4ab7-9b18-97363285cf74 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:22.996262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3138d-a818-4ab7-9b18-97363285cf74 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:22.996711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3138d-a818-4ab7-9b18-97363285cf74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:22.997608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3138d-a818-4ab7-9b18-97363285cf74 None admin] RBAC: Adding query filter params (group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b, role.id=24fee0983ae345c288f4974d93a3805d, scope.project.id=fea2e1e9b16a4405b41888375f40c504) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:22.998540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3138d-a818-4ab7-9b18-97363285cf74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:23.000449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3138d-a818-4ab7-9b18-97363285cf74 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:23.008700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:23.009006 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 184/353] 10.222.0.70 () {56 vars in 1376 bytes} [Sun Aug 28 18:36:22 2022] GET /identity/v3/role_assignments?group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b&scope.project.id=fea2e1e9b16a4405b41888375f40c504&role.id=24fee0983ae345c288f4974d93a3805d => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:23.010946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3138d-a818-4ab7-9b18-97363285cf74 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:23.063142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f2558-067b-43d6-99e7-7dfece59026b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:23.106475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e9261-4d60-4540-8bc8-28c053f65bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:23.107185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e9261-4d60-4540-8bc8-28c053f65bac None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:23.107464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e9261-4d60-4540-8bc8-28c053f65bac None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:23.107733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e9261-4d60-4540-8bc8-28c053f65bac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:23.120177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e9261-4d60-4540-8bc8-28c053f65bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-3d9e9261-4d60-4540-8bc8-28c053f65bac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:23.126623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:23.127608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:23.128915 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:23.128915 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:23.128915 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:23.128915 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:23.128915 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:23.128915 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:23.128915 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:23.128915 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:23.128915 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:23.128915 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:23.128915 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 18:36:23.128915 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:23.128915 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 170/354] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:23.135855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5f8c9-26ed-4af2-b5bc-f5d4856e00f7 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:23.136270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5f8c9-26ed-4af2-b5bc-f5d4856e00f7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:23.136592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5f8c9-26ed-4af2-b5bc-f5d4856e00f7 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:23.138122 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 171/355] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:23.138968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5f8c9-26ed-4af2-b5bc-f5d4856e00f7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:23.143434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3138d-a818-4ab7-9b18-97363285cf74 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:23.171238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:23.186683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c50f9-426d-43f5-a939-268946bbb896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:23.187356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c50f9-426d-43f5-a939-268946bbb896 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:23.187640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c50f9-426d-43f5-a939-268946bbb896 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:23.187917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c50f9-426d-43f5-a939-268946bbb896 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:23.189481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c50f9-426d-43f5-a939-268946bbb896 None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:23.191011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c50f9-426d-43f5-a939-268946bbb896 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:23.192687 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 185/356] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:23 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:23.193537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c50f9-426d-43f5-a939-268946bbb896 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:23.269147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5f8c9-26ed-4af2-b5bc-f5d4856e00f7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:23.272471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:23.314820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be60f1-ea63-41b8-a298-6f2b8aef5fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:23.315519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be60f1-ea63-41b8-a298-6f2b8aef5fdf None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:23.315858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be60f1-ea63-41b8-a298-6f2b8aef5fdf None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:23.316199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be60f1-ea63-41b8-a298-6f2b8aef5fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:23.324633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c50f9-426d-43f5-a939-268946bbb896 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:23.381079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c47037-ba0f-4f44-ac60-fd31c02bc245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:23.381718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c47037-ba0f-4f44-ac60-fd31c02bc245 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:23.382114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c47037-ba0f-4f44-ac60-fd31c02bc245 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:23.382391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c47037-ba0f-4f44-ac60-fd31c02bc245 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:23.383214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c47037-ba0f-4f44-ac60-fd31c02bc245 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:23.383522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c47037-ba0f-4f44-ac60-fd31c02bc245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:23.384918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c47037-ba0f-4f44-ac60-fd31c02bc245 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:23.395294 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 186/357] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:23.397330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86c2c5-5274-4882-916a-4530bf565853 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:23.397741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86c2c5-5274-4882-916a-4530bf565853 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:23.398020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86c2c5-5274-4882-916a-4530bf565853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:23.411537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be60f1-ea63-41b8-a298-6f2b8aef5fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:23.412999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be60f1-ea63-41b8-a298-6f2b8aef5fdf None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:23.419976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8a86c2c5-5274-4882-916a-4530bf565853 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:23.421343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8a86c2c5-5274-4882-916a-4530bf565853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:23.441814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:23.511983 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 187/358] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:23.513599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86c2c5-5274-4882-916a-4530bf565853 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:23.582091 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 172/359] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:23.582911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be60f1-ea63-41b8-a298-6f2b8aef5fdf None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:23.590961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:23.638194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86c2c5-5274-4882-916a-4530bf565853 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:23.683640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d456d5f-4a0e-4ba1-ab00-cc4afa271e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:23.684585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d456d5f-4a0e-4ba1-ab00-cc4afa271e29 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:23.685045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d456d5f-4a0e-4ba1-ab00-cc4afa271e29 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:23.685762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d456d5f-4a0e-4ba1-ab00-cc4afa271e29 None admin] PATH_INFO: `/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:23.689346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d456d5f-4a0e-4ba1-ab00-cc4afa271e29 None admin] RBAC: Authorizing `identity:get_group(group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:23.691788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d456d5f-4a0e-4ba1-ab00-cc4afa271e29 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:23.693640 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 188/360] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:23 2022] GET /identity/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:23.695409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d456d5f-4a0e-4ba1-ab00-cc4afa271e29 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:23.716524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be60f1-ea63-41b8-a298-6f2b8aef5fdf None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:23.745575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:23.761481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d311de5-9734-412b-b062-9bfce6e62cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:23.762126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d311de5-9734-412b-b062-9bfce6e62cd9 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:23.762453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d311de5-9734-412b-b062-9bfce6e62cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:23.762925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d311de5-9734-412b-b062-9bfce6e62cd9 None admin] PATH_INFO: `/v3/users/1ee89d5e23cf4c5ab1080fa0653972ed` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:23.764424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d311de5-9734-412b-b062-9bfce6e62cd9 None admin] RBAC: Authorizing `identity:get_user(user_id=1ee89d5e23cf4c5ab1080fa0653972ed)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:23.765877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d311de5-9734-412b-b062-9bfce6e62cd9 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:23.767686 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 173/361] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:36:23 2022] GET /identity/v3/users/1ee89d5e23cf4c5ab1080fa0653972ed => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:23.768572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d311de5-9734-412b-b062-9bfce6e62cd9 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:23.844485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d456d5f-4a0e-4ba1-ab00-cc4afa271e29 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:23.885468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:23.896538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dde979-ab21-4503-b752-7fbeb23a384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:23.897495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dde979-ab21-4503-b752-7fbeb23a384f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:23.897990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dde979-ab21-4503-b752-7fbeb23a384f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:23.899019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dde979-ab21-4503-b752-7fbeb23a384f None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:23.900370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dde979-ab21-4503-b752-7fbeb23a384f None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:23.904767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dde979-ab21-4503-b752-7fbeb23a384f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:23.907590 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 189/362] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:23 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:23.908874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dde979-ab21-4503-b752-7fbeb23a384f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:23.918776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d311de5-9734-412b-b062-9bfce6e62cd9 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:23.958855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826cfa8-f7e4-4d4d-965b-43b31ef2e9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:23.959765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826cfa8-f7e4-4d4d-965b-43b31ef2e9b0 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:23.960221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826cfa8-f7e4-4d4d-965b-43b31ef2e9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:23.960669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826cfa8-f7e4-4d4d-965b-43b31ef2e9b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:23.961568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826cfa8-f7e4-4d4d-965b-43b31ef2e9b0 None admin] RBAC: Adding query filter params (group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b, role.id=9e9271d4f0cd4c5688279b54d26e079f, scope.project.id=fea2e1e9b16a4405b41888375f40c504) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:23.962078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826cfa8-f7e4-4d4d-965b-43b31ef2e9b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:23.963715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826cfa8-f7e4-4d4d-965b-43b31ef2e9b0 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:23.969981 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 174/363] 10.222.0.70 () {56 vars in 1376 bytes} [Sun Aug 28 18:36:23 2022] GET /identity/v3/role_assignments?group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b&scope.project.id=fea2e1e9b16a4405b41888375f40c504&role.id=9e9271d4f0cd4c5688279b54d26e079f => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:23.971047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826cfa8-f7e4-4d4d-965b-43b31ef2e9b0 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:24.035632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:24.068050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dde979-ab21-4503-b752-7fbeb23a384f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:24.114717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826cfa8-f7e4-4d4d-965b-43b31ef2e9b0 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:24.116884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8fdf2-7f2b-450a-a4b8-4d947f6e9bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:24.117521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8fdf2-7f2b-450a-a4b8-4d947f6e9bb2 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.117808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8fdf2-7f2b-450a-a4b8-4d947f6e9bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.118087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8fdf2-7f2b-450a-a4b8-4d947f6e9bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.118912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8fdf2-7f2b-450a-a4b8-4d947f6e9bb2 None admin] RBAC: Adding query filter params (role.id=b23c0fe3d2bc47ada7cee9cb5db1638a, user.id=1ee89d5e23cf4c5ab1080fa0653972ed, scope.system=all) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:24.119232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8fdf2-7f2b-450a-a4b8-4d947f6e9bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:24.120731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8fdf2-7f2b-450a-a4b8-4d947f6e9bb2 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:24.134893 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 190/364] 10.222.0.70 () {56 vars in 1308 bytes} [Sun Aug 28 18:36:23 2022] GET /identity/v3/role_assignments?user.id=1ee89d5e23cf4c5ab1080fa0653972ed&scope.system=all&role.id=b23c0fe3d2bc47ada7cee9cb5db1638a => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:24.135867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8fdf2-7f2b-450a-a4b8-4d947f6e9bb2 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:24.167569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822e213-a4ea-4fe4-80b2-0d5d7a3f1989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:24.168331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822e213-a4ea-4fe4-80b2-0d5d7a3f1989 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.168718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822e213-a4ea-4fe4-80b2-0d5d7a3f1989 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.168996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822e213-a4ea-4fe4-80b2-0d5d7a3f1989 None admin] PATH_INFO: `/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.172477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822e213-a4ea-4fe4-80b2-0d5d7a3f1989 None admin] RBAC: Authorizing `identity:get_group(group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:24.174049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822e213-a4ea-4fe4-80b2-0d5d7a3f1989 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:24.176321 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 175/365] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:23 2022] GET /identity/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:24.177734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a86072-f891-47a6-952f-f0ff1f65d0bc None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.178014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a86072-f891-47a6-952f-f0ff1f65d0bc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.178280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a86072-f891-47a6-952f-f0ff1f65d0bc None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.183446 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 176/366] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:24.187526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a86072-f891-47a6-952f-f0ff1f65d0bc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:24.207164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:24.265907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8fdf2-7f2b-450a-a4b8-4d947f6e9bb2 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:24.323108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8109cef-5cf1-4b11-84a3-8c077cf52bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:24.323763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8109cef-5cf1-4b11-84a3-8c077cf52bc9 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.324052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8109cef-5cf1-4b11-84a3-8c077cf52bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.324331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8109cef-5cf1-4b11-84a3-8c077cf52bc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.339782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8109cef-5cf1-4b11-84a3-8c077cf52bc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:24.341736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a86072-f891-47a6-952f-f0ff1f65d0bc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-d8109cef-5cf1-4b11-84a3-8c077cf52bc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:24.347303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:24.348223 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:24.349446 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:24.349446 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:24.349446 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:24.349446 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:24.349446 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:24.349446 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:24.349446 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:24.349446 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:24.349446 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:24.349446 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:24.349446 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:24.349446 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:24.349446 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 191/367] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:36:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:24.350104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff7245-9380-4e73-9e8b-8a33b5ea30c4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.350104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff7245-9380-4e73-9e8b-8a33b5ea30c4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.350447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff7245-9380-4e73-9e8b-8a33b5ea30c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.375091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5aff7245-9380-4e73-9e8b-8a33b5ea30c4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:24.376565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5aff7245-9380-4e73-9e8b-8a33b5ea30c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:24.378345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:24.394313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce988f-7318-4080-aa39-f8d0dd3b595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:24.396317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce988f-7318-4080-aa39-f8d0dd3b595c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.396317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce988f-7318-4080-aa39-f8d0dd3b595c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.396317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce988f-7318-4080-aa39-f8d0dd3b595c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.398441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce988f-7318-4080-aa39-f8d0dd3b595c None admin] RBAC: Adding query filter params (group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b, role.id=24fee0983ae345c288f4974d93a3805d, scope.project.id=00edf8173f2c446bbfd98af8172124c6) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:24.398441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce988f-7318-4080-aa39-f8d0dd3b595c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:24.399808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce988f-7318-4080-aa39-f8d0dd3b595c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:24.408605 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 177/368] 10.222.0.70 () {56 vars in 1376 bytes} [Sun Aug 28 18:36:24 2022] GET /identity/v3/role_assignments?group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b&scope.project.id=00edf8173f2c446bbfd98af8172124c6&role.id=24fee0983ae345c288f4974d93a3805d => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:24.409560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce988f-7318-4080-aa39-f8d0dd3b595c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:24.497524 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 192/369] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:24.616587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce988f-7318-4080-aa39-f8d0dd3b595c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:24.670363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11d531-d1c3-44cc-a9ce-5820cfc7bc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:24.670945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11d531-d1c3-44cc-a9ce-5820cfc7bc24 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.671232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11d531-d1c3-44cc-a9ce-5820cfc7bc24 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.671507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11d531-d1c3-44cc-a9ce-5820cfc7bc24 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.672185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11d531-d1c3-44cc-a9ce-5820cfc7bc24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:24.672491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11d531-d1c3-44cc-a9ce-5820cfc7bc24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:24.673865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11d531-d1c3-44cc-a9ce-5820cfc7bc24 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:24.684107 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 178/370] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:24.689419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff7245-9380-4e73-9e8b-8a33b5ea30c4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:24.769237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:24.824882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11d531-d1c3-44cc-a9ce-5820cfc7bc24 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:24.854694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff7245-9380-4e73-9e8b-8a33b5ea30c4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:24.895655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7981d-f8d8-49eb-b3f8-320ad0a64a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:24.896290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7981d-f8d8-49eb-b3f8-320ad0a64a8c None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:24.896557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7981d-f8d8-49eb-b3f8-320ad0a64a8c None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:24.896826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7981d-f8d8-49eb-b3f8-320ad0a64a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:24.923125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:25.028530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11d531-d1c3-44cc-a9ce-5820cfc7bc24 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:25.049145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7981d-f8d8-49eb-b3f8-320ad0a64a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:25.051027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7981d-f8d8-49eb-b3f8-320ad0a64a8c None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:25.098590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e072767-9eed-440d-98a1-72716fafac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:25.100016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e072767-9eed-440d-98a1-72716fafac38 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:25.100295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e072767-9eed-440d-98a1-72716fafac38 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:25.100562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e072767-9eed-440d-98a1-72716fafac38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:25.122153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e072767-9eed-440d-98a1-72716fafac38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:25.132310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-8e072767-9eed-440d-98a1-72716fafac38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:25.133773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:25.134628 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:25.135589 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:25.135589 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:25.135589 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:25.135589 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:25.135589 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:25.135589 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:25.135589 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:25.135589 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:25.135589 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:25.135589 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:25.135589 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:36:25.135589 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:25.142835 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 179/371] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:25.151802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e072767-9eed-440d-98a1-72716fafac38 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:25.215107 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 193/372] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:25.216669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7981d-f8d8-49eb-b3f8-320ad0a64a8c None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:25.327733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7981d-f8d8-49eb-b3f8-320ad0a64a8c None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:25.363485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e072767-9eed-440d-98a1-72716fafac38 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:25.371364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b657dad-05dd-496c-817f-89ff79c59541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:25.372060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b657dad-05dd-496c-817f-89ff79c59541 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:25.372342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b657dad-05dd-496c-817f-89ff79c59541 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:25.372614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b657dad-05dd-496c-817f-89ff79c59541 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:25.373229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:25.375874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b657dad-05dd-496c-817f-89ff79c59541 None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:25.377675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b657dad-05dd-496c-817f-89ff79c59541 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:25.381188 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 194/373] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:25 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:25.386763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b657dad-05dd-496c-817f-89ff79c59541 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:25.402873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fefdc-c08e-409b-8229-cc3fa8e04fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:25.403088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:25.403502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fefdc-c08e-409b-8229-cc3fa8e04fde None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:25.403781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fefdc-c08e-409b-8229-cc3fa8e04fde None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:25.404061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fefdc-c08e-409b-8229-cc3fa8e04fde None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:25.404728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fefdc-c08e-409b-8229-cc3fa8e04fde None admin] RBAC: Adding query filter params (name=admin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:25.405035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fefdc-c08e-409b-8229-cc3fa8e04fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:25.406411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fefdc-c08e-409b-8229-cc3fa8e04fde None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:25.418208 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 180/374] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:25.428305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fefdc-c08e-409b-8229-cc3fa8e04fde None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:25.545231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b657dad-05dd-496c-817f-89ff79c59541 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:25.592903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135acb6-2cf2-49dd-9677-f282ec589400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:25.593551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135acb6-2cf2-49dd-9677-f282ec589400 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:25.593837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135acb6-2cf2-49dd-9677-f282ec589400 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:25.594113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135acb6-2cf2-49dd-9677-f282ec589400 None admin] PATH_INFO: `/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:25.598256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135acb6-2cf2-49dd-9677-f282ec589400 None admin] RBAC: Authorizing `identity:get_group(group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:25.599806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135acb6-2cf2-49dd-9677-f282ec589400 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:25.601737 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 195/375] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:25 2022] GET /identity/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:25.603147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eb533-987b-45f3-8ff0-ab121066a8f1 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:25.603435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eb533-987b-45f3-8ff0-ab121066a8f1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:25.603714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87eb533-987b-45f3-8ff0-ab121066a8f1 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:25.605330 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 196/376] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:25.609985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eb533-987b-45f3-8ff0-ab121066a8f1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:25.614822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fefdc-c08e-409b-8229-cc3fa8e04fde None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:25.663292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57668c1-dfde-4441-854d-685b90e208f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:25.664015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57668c1-dfde-4441-854d-685b90e208f9 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:25.664302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57668c1-dfde-4441-854d-685b90e208f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:25.664577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57668c1-dfde-4441-854d-685b90e208f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:25.710339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:25.712755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:25.737293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87eb533-987b-45f3-8ff0-ab121066a8f1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:25.747425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57668c1-dfde-4441-854d-685b90e208f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:25.749022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57668c1-dfde-4441-854d-685b90e208f9 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:25.774457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21acd48-8d30-47f1-9603-b87eedc6e21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:25.775110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21acd48-8d30-47f1-9603-b87eedc6e21e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:25.775398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21acd48-8d30-47f1-9603-b87eedc6e21e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:25.775671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21acd48-8d30-47f1-9603-b87eedc6e21e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:25.776408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21acd48-8d30-47f1-9603-b87eedc6e21e None admin] RBAC: Adding query filter params (group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b, role.id=9e9271d4f0cd4c5688279b54d26e079f, scope.project.id=00edf8173f2c446bbfd98af8172124c6) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:25.776724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21acd48-8d30-47f1-9603-b87eedc6e21e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:25.778182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21acd48-8d30-47f1-9603-b87eedc6e21e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:25.784973 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 197/377] 10.222.0.70 () {56 vars in 1376 bytes} [Sun Aug 28 18:36:25 2022] GET /identity/v3/role_assignments?group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b&scope.project.id=00edf8173f2c446bbfd98af8172124c6&role.id=9e9271d4f0cd4c5688279b54d26e079f => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:25.786206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a6a0-7463-4d7d-941f-12ac1864b1da None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:25.786487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a6a0-7463-4d7d-941f-12ac1864b1da None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:25.787740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a6a0-7463-4d7d-941f-12ac1864b1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:25.812777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-49a7a6a0-7463-4d7d-941f-12ac1864b1da None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:25.813952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-49a7a6a0-7463-4d7d-941f-12ac1864b1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:25.869385 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 181/378] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:25.875287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57668c1-dfde-4441-854d-685b90e208f9 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:25.896124 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 198/379] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:25.979213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:25.989713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57668c1-dfde-4441-854d-685b90e208f9 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:26.026505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3c22a-53fb-45f1-bcd7-7a1b23889db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:26.027173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3c22a-53fb-45f1-bcd7-7a1b23889db7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:26.027450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3c22a-53fb-45f1-bcd7-7a1b23889db7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:26.027722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3c22a-53fb-45f1-bcd7-7a1b23889db7 None admin] PATH_INFO: `/v3/projects/58e6322e28544af5ae4a5db517170f8c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:26.028851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3c22a-53fb-45f1-bcd7-7a1b23889db7 None admin] RBAC: Authorizing `identity:get_project(project_id=58e6322e28544af5ae4a5db517170f8c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:26.030287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3c22a-53fb-45f1-bcd7-7a1b23889db7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:26.032072 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 182/380] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:25 2022] GET /identity/v3/projects/58e6322e28544af5ae4a5db517170f8c => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:26.039531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7a6a0-7463-4d7d-941f-12ac1864b1da None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:26.149279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:26.181307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7a6a0-7463-4d7d-941f-12ac1864b1da None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:26.227449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0f543-73b7-4ca8-858b-fab881dc90c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:26.228106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0f543-73b7-4ca8-858b-fab881dc90c0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:26.228392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0f543-73b7-4ca8-858b-fab881dc90c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:26.228676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0f543-73b7-4ca8-858b-fab881dc90c0 None admin] PATH_INFO: `/v3/groups/bb6ad444997042718855f4db6f2bb119` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:26.235224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0f543-73b7-4ca8-858b-fab881dc90c0 None admin] RBAC: Authorizing `identity:get_group(group_id=bb6ad444997042718855f4db6f2bb119)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:26.236671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0f543-73b7-4ca8-858b-fab881dc90c0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:26.239304 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 199/381] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:26 2022] GET /identity/v3/groups/bb6ad444997042718855f4db6f2bb119 => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:26.245062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3c22a-53fb-45f1-bcd7-7a1b23889db7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:26.367058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0f543-73b7-4ca8-858b-fab881dc90c0 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:26.386776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3c22a-53fb-45f1-bcd7-7a1b23889db7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:26.424835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7c368-b62a-4fb4-9e15-854fe71b0c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:26.425363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7c368-b62a-4fb4-9e15-854fe71b0c61 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:26.425802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7c368-b62a-4fb4-9e15-854fe71b0c61 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:26.426296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7c368-b62a-4fb4-9e15-854fe71b0c61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:26.427570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7c368-b62a-4fb4-9e15-854fe71b0c61 None admin] RBAC: Adding query filter params (group.id=bb6ad444997042718855f4db6f2bb119, role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=58e6322e28544af5ae4a5db517170f8c) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:26.427890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7c368-b62a-4fb4-9e15-854fe71b0c61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:26.429525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7c368-b62a-4fb4-9e15-854fe71b0c61 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:26.437145 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 183/382] 10.222.0.70 () {56 vars in 1376 bytes} [Sun Aug 28 18:36:26 2022] GET /identity/v3/role_assignments?group.id=bb6ad444997042718855f4db6f2bb119&scope.project.id=58e6322e28544af5ae4a5db517170f8c&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:26.563094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0f543-73b7-4ca8-858b-fab881dc90c0 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:26.605241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ceb77d-c6f5-44db-b394-4957a6b73d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:26.605882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceb77d-c6f5-44db-b394-4957a6b73d6d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:26.606160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceb77d-c6f5-44db-b394-4957a6b73d6d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:26.606440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceb77d-c6f5-44db-b394-4957a6b73d6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:26.614713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:26.619395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ceb77d-c6f5-44db-b394-4957a6b73d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-f8ceb77d-c6f5-44db-b394-4957a6b73d6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:26.624301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:26.625203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:26.626326 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:26.626326 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:26.626326 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:26.626326 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:26.626326 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:26.626326 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:26.626326 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:26.626326 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:26.626326 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:26.626326 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:26.626326 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:26.626326 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:26.626326 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 200/383] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:26.633139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7c368-b62a-4fb4-9e15-854fe71b0c61 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:26.636104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:26.747250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7c368-b62a-4fb4-9e15-854fe71b0c61 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:26.783835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30209809-a325-42a4-ac6f-95e4ce334256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:26.784504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209809-a325-42a4-ac6f-95e4ce334256 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:26.784949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209809-a325-42a4-ac6f-95e4ce334256 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:26.785221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209809-a325-42a4-ac6f-95e4ce334256 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:26.785883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30209809-a325-42a4-ac6f-95e4ce334256 None admin] RBAC: Adding query filter params (name=member) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:26.786186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30209809-a325-42a4-ac6f-95e4ce334256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:26.787635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30209809-a325-42a4-ac6f-95e4ce334256 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:26.796470 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 184/384] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:26.801945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ceb77d-c6f5-44db-b394-4957a6b73d6d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:26.830049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df290f6-78b7-46c8-b40d-828fcdad57ac None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:26.831557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df290f6-78b7-46c8-b40d-828fcdad57ac None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:26.832326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df290f6-78b7-46c8-b40d-828fcdad57ac None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:26.834123 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 185/385] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:36:26.847093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0201e-d912-45ba-b0dc-e40566345b9a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:26.847823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0201e-d912-45ba-b0dc-e40566345b9a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:26.848536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0201e-d912-45ba-b0dc-e40566345b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:26.879423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-baa0201e-d912-45ba-b0dc-e40566345b9a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:26.883899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-baa0201e-d912-45ba-b0dc-e40566345b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:26.999763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ceb77d-c6f5-44db-b394-4957a6b73d6d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:27.010296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:27.022919 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 186/386] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:27.024580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd6c99-eded-43a4-9591-bdd97fcf9888 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:27.025002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd6c99-eded-43a4-9591-bdd97fcf9888 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:27.025421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd6c99-eded-43a4-9591-bdd97fcf9888 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:27.026819 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 187/387] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:27.032242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b82dc-1895-401b-8682-65103daa9880 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:27.032786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b82dc-1895-401b-8682-65103daa9880 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:27.033208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b82dc-1895-401b-8682-65103daa9880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:27.047588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e860f-ac23-42bd-a41f-5506ec709145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:27.048575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e860f-ac23-42bd-a41f-5506ec709145 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:27.049065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e860f-ac23-42bd-a41f-5506ec709145 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:27.050223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e860f-ac23-42bd-a41f-5506ec709145 None admin] PATH_INFO: `/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:27.051739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e860f-ac23-42bd-a41f-5506ec709145 None admin] RBAC: Authorizing `identity:get_group(group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:27.053562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e860f-ac23-42bd-a41f-5506ec709145 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:27.054162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c40b82dc-1895-401b-8682-65103daa9880 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:27.055394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c40b82dc-1895-401b-8682-65103daa9880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:27.056044 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 201/388] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:26 2022] GET /identity/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:27.063965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e860f-ac23-42bd-a41f-5506ec709145 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:27.190546 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 188/389] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:27.210589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:27.263003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e860f-ac23-42bd-a41f-5506ec709145 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:27.319484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc06d5-6590-45b1-981a-d3b1a0a6c012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:27.320138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc06d5-6590-45b1-981a-d3b1a0a6c012 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:27.320419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc06d5-6590-45b1-981a-d3b1a0a6c012 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:27.320691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc06d5-6590-45b1-981a-d3b1a0a6c012 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:27.322026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc06d5-6590-45b1-981a-d3b1a0a6c012 None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:27.323499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc06d5-6590-45b1-981a-d3b1a0a6c012 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:27.325474 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 202/390] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:27 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:27.331283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b82dc-1895-401b-8682-65103daa9880 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:27.369031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc06d5-6590-45b1-981a-d3b1a0a6c012 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:27.452083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b82dc-1895-401b-8682-65103daa9880 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:27.479101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:27.495980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd6fdc-6235-4388-a056-dc6a35490573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:27.496984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd6fdc-6235-4388-a056-dc6a35490573 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:27.497638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd6fdc-6235-4388-a056-dc6a35490573 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:27.498117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd6fdc-6235-4388-a056-dc6a35490573 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:27.500247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd6fdc-6235-4388-a056-dc6a35490573 None admin] RBAC: Authorizing `identity:create_grant(project_id=fea2e1e9b16a4405b41888375f40c504, group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:27.501904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd6fdc-6235-4388-a056-dc6a35490573 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:27.517753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc06d5-6590-45b1-981a-d3b1a0a6c012 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:27.526828 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 189/391] 10.222.0.70 () {58 vars in 1442 bytes} [Sun Aug 28 18:36:27 2022] PUT /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:27.572221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1908bd-39cf-4876-9870-0e930d5828b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:27.572933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1908bd-39cf-4876-9870-0e930d5828b4 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:27.573215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1908bd-39cf-4876-9870-0e930d5828b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:27.573489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1908bd-39cf-4876-9870-0e930d5828b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:27.575887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:27.595488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1908bd-39cf-4876-9870-0e930d5828b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-fc1908bd-39cf-4876-9870-0e930d5828b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:27.601885 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:27.602822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:27.603643 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:27.603643 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:27.603643 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:27.603643 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:27.603643 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:27.603643 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:27.603643 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:27.603643 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:27.603643 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:27.603643 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:27.603643 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:27.603643 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:27.603643 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 203/392] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:36:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:27.610651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd6fdc-6235-4388-a056-dc6a35490573 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:27.720192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1908bd-39cf-4876-9870-0e930d5828b4 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:27.766094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd6fdc-6235-4388-a056-dc6a35490573 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:27.813138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fda23-c2a0-4a7f-8d80-e8bfee544603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:27.813679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fda23-c2a0-4a7f-8d80-e8bfee544603 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:27.813958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fda23-c2a0-4a7f-8d80-e8bfee544603 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:27.814219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fda23-c2a0-4a7f-8d80-e8bfee544603 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:27.814911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fda23-c2a0-4a7f-8d80-e8bfee544603 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:27.816498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fda23-c2a0-4a7f-8d80-e8bfee544603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:27.817308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fda23-c2a0-4a7f-8d80-e8bfee544603 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:27.835192 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 190/393] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:27.842399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fda23-c2a0-4a7f-8d80-e8bfee544603 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:27.885922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1908bd-39cf-4876-9870-0e930d5828b4 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:27.911279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:27.928374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535b044-177c-4469-b5a6-1e69bd3dabff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:27.929368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535b044-177c-4469-b5a6-1e69bd3dabff None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:27.929862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535b044-177c-4469-b5a6-1e69bd3dabff None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:27.930355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535b044-177c-4469-b5a6-1e69bd3dabff None admin] PATH_INFO: `/v3/roles/member` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:27.942256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535b044-177c-4469-b5a6-1e69bd3dabff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-6535b044-177c-4469-b5a6-1e69bd3dabff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:27.949068 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:27.949922 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:27.950722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:27.950722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:27.950722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:27.950722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:27.950722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:27.950722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:27.950722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:27.950722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:27.950722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:27.950722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:27.950722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:27.950722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:27.953304 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 204/394] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:27.959263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535b044-177c-4469-b5a6-1e69bd3dabff None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:27.987670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fda23-c2a0-4a7f-8d80-e8bfee544603 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:28.046545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac790a9b-0179-4fe1-b77c-f12c65e3aeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:28.048048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac790a9b-0179-4fe1-b77c-f12c65e3aeb5 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:28.048545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac790a9b-0179-4fe1-b77c-f12c65e3aeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:28.049029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac790a9b-0179-4fe1-b77c-f12c65e3aeb5 None admin] PATH_INFO: `/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:28.050689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac790a9b-0179-4fe1-b77c-f12c65e3aeb5 None admin] RBAC: Authorizing `identity:get_group(group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:28.052679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac790a9b-0179-4fe1-b77c-f12c65e3aeb5 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:28.054797 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 191/395] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:27 2022] GET /identity/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:28.060922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac790a9b-0179-4fe1-b77c-f12c65e3aeb5 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:28.080538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:28.149652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535b044-177c-4469-b5a6-1e69bd3dabff None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:28.184206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac790a9b-0179-4fe1-b77c-f12c65e3aeb5 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:28.192016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaaddc-8ab3-4a11-b0b1-7a06e10cb4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:28.192646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaaddc-8ab3-4a11-b0b1-7a06e10cb4db None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:28.192930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaaddc-8ab3-4a11-b0b1-7a06e10cb4db None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:28.193210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaaddc-8ab3-4a11-b0b1-7a06e10cb4db None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:28.193881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaaddc-8ab3-4a11-b0b1-7a06e10cb4db None admin] RBAC: Adding query filter params (name=member) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:28.194186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaaddc-8ab3-4a11-b0b1-7a06e10cb4db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:28.196170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaaddc-8ab3-4a11-b0b1-7a06e10cb4db None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:28.205305 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 205/396] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:28.207980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:28.212392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaaddc-8ab3-4a11-b0b1-7a06e10cb4db None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:28.230046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e8435-edc8-4b42-9954-b6c0bef03f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:28.231031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e8435-edc8-4b42-9954-b6c0bef03f26 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:28.231327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e8435-edc8-4b42-9954-b6c0bef03f26 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:28.231610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e8435-edc8-4b42-9954-b6c0bef03f26 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:28.233037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e8435-edc8-4b42-9954-b6c0bef03f26 None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:28.234472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e8435-edc8-4b42-9954-b6c0bef03f26 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:28.237252 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 192/397] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:28 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:28.242650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e8435-edc8-4b42-9954-b6c0bef03f26 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:28.365269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaaddc-8ab3-4a11-b0b1-7a06e10cb4db None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:28.375544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e8435-edc8-4b42-9954-b6c0bef03f26 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:28.393051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:28.421382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03044810-d8a5-478a-b7b2-7cd39520fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:28.421584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044810-d8a5-478a-b7b2-7cd39520fd88 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:28.421857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044810-d8a5-478a-b7b2-7cd39520fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:28.422137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03044810-d8a5-478a-b7b2-7cd39520fd88 None admin] PATH_INFO: `/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:28.423889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03044810-d8a5-478a-b7b2-7cd39520fd88 None admin] RBAC: Authorizing `identity:get_group(group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:28.425927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03044810-d8a5-478a-b7b2-7cd39520fd88 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:28.427944 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 206/398] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:28 2022] GET /identity/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:28.429296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e680b-0216-4cfc-ae25-ffedbf6a16fe None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:28.429587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e680b-0216-4cfc-ae25-ffedbf6a16fe None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:28.429866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e680b-0216-4cfc-ae25-ffedbf6a16fe None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:28.430931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c802e-b927-4115-b070-938e7bd60df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:28.431068 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 207/399] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:28.432020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c802e-b927-4115-b070-938e7bd60df7 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:28.432557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c802e-b927-4115-b070-938e7bd60df7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:28.433039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c802e-b927-4115-b070-938e7bd60df7 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b/roles/9e9271d4f0cd4c5688279b54d26e079f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:28.435712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e680b-0216-4cfc-ae25-ffedbf6a16fe None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:28.436500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c802e-b927-4115-b070-938e7bd60df7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fea2e1e9b16a4405b41888375f40c504, group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b, role_id=9e9271d4f0cd4c5688279b54d26e079f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:28.438166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c802e-b927-4115-b070-938e7bd60df7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:28.459841 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 193/400] 10.222.0.70 () {58 vars in 1442 bytes} [Sun Aug 28 18:36:28 2022] PUT /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b/roles/9e9271d4f0cd4c5688279b54d26e079f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:36:28.463033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67823bc3-a8c6-4577-a0ac-81b735d91e54 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:28.463591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67823bc3-a8c6-4577-a0ac-81b735d91e54 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:28.464175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67823bc3-a8c6-4577-a0ac-81b735d91e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:28.507930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-67823bc3-a8c6-4577-a0ac-81b735d91e54 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:28.509171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-67823bc3-a8c6-4577-a0ac-81b735d91e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:28.597154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e680b-0216-4cfc-ae25-ffedbf6a16fe None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:28.632767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:28.645826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471ae0f-9a64-46b8-bb53-f50d417dc28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:28.647345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471ae0f-9a64-46b8-bb53-f50d417dc28e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:28.648279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471ae0f-9a64-46b8-bb53-f50d417dc28e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:28.648984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471ae0f-9a64-46b8-bb53-f50d417dc28e None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:28.651336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471ae0f-9a64-46b8-bb53-f50d417dc28e None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:28.653392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471ae0f-9a64-46b8-bb53-f50d417dc28e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:28.656239 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 208/401] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:28 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:28.665210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471ae0f-9a64-46b8-bb53-f50d417dc28e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:28.680589 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 194/402] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:28.723840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:28.774899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471ae0f-9a64-46b8-bb53-f50d417dc28e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:28.821398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f172e7-5a4e-4d74-b0ec-c653bb0132b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:28.822068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f172e7-5a4e-4d74-b0ec-c653bb0132b4 None admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:28.822351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f172e7-5a4e-4d74-b0ec-c653bb0132b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:28.822630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f172e7-5a4e-4d74-b0ec-c653bb0132b4 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:28.827100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f172e7-5a4e-4d74-b0ec-c653bb0132b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=00edf8173f2c446bbfd98af8172124c6, group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:28.828552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f172e7-5a4e-4d74-b0ec-c653bb0132b4 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:28.864614 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 209/403] 10.222.0.70 () {58 vars in 1442 bytes} [Sun Aug 28 18:36:28 2022] PUT /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:28.929864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fb0ce-9840-4aa4-a9ab-e9fddf6c1abb None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:28.930488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fb0ce-9840-4aa4-a9ab-e9fddf6c1abb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:28.931016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fb0ce-9840-4aa4-a9ab-e9fddf6c1abb None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:28.932612 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 195/404] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:28.940192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e0a62-9aca-40d7-8e0c-0dad94b20d2a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:28.940808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e0a62-9aca-40d7-8e0c-0dad94b20d2a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:28.941277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e0a62-9aca-40d7-8e0c-0dad94b20d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:28.963892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-072e0a62-9aca-40d7-8e0c-0dad94b20d2a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:28.965532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-072e0a62-9aca-40d7-8e0c-0dad94b20d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:29.006690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fb0ce-9840-4aa4-a9ab-e9fddf6c1abb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:29.061457 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 210/405] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:29.183047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fb0ce-9840-4aa4-a9ab-e9fddf6c1abb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:29.230804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dba2d-6242-4da7-b75d-5c90dbba91e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:29.231450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dba2d-6242-4da7-b75d-5c90dbba91e5 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:29.231725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dba2d-6242-4da7-b75d-5c90dbba91e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:29.231992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dba2d-6242-4da7-b75d-5c90dbba91e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:29.248905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240dba2d-6242-4da7-b75d-5c90dbba91e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-240dba2d-6242-4da7-b75d-5c90dbba91e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:29.254062 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:29.254991 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:29.256534 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:29.256534 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:29.256534 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:29.256534 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:29.256534 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:29.256534 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:29.256534 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:29.256534 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:29.256534 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:29.256534 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:29.256534 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:29.256534 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:29.256534 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 196/406] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:36:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:29.261378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e0a62-9aca-40d7-8e0c-0dad94b20d2a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:29.335175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:29.416271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e0a62-9aca-40d7-8e0c-0dad94b20d2a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:29.456700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01291a0-39b7-450f-8265-6cda66684cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:29.457644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01291a0-39b7-450f-8265-6cda66684cce None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:29.458123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01291a0-39b7-450f-8265-6cda66684cce None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:29.458613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01291a0-39b7-450f-8265-6cda66684cce None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:29.459514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01291a0-39b7-450f-8265-6cda66684cce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:29.460045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01291a0-39b7-450f-8265-6cda66684cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:29.461603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01291a0-39b7-450f-8265-6cda66684cce None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:29.470617 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 211/407] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:29.477297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dba2d-6242-4da7-b75d-5c90dbba91e5 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:29.528076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01291a0-39b7-450f-8265-6cda66684cce None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:29.529530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:29.638056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dba2d-6242-4da7-b75d-5c90dbba91e5 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:29.674945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26642f25-3514-4ce8-ac1c-65768e36c9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:29.674945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26642f25-3514-4ce8-ac1c-65768e36c9f7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:29.674945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26642f25-3514-4ce8-ac1c-65768e36c9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:29.674945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26642f25-3514-4ce8-ac1c-65768e36c9f7 None admin] PATH_INFO: `/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:29.675606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26642f25-3514-4ce8-ac1c-65768e36c9f7 None admin] RBAC: Authorizing `identity:get_group(group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:29.677168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26642f25-3514-4ce8-ac1c-65768e36c9f7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:29.679121 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 197/408] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:29 2022] GET /identity/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:29.684280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26642f25-3514-4ce8-ac1c-65768e36c9f7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:29.700391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01291a0-39b7-450f-8265-6cda66684cce None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:29.704420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:29.763527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aadc23-6cd5-4bb3-a25b-1f81ac2bfce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:29.764439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aadc23-6cd5-4bb3-a25b-1f81ac2bfce6 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:29.764861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aadc23-6cd5-4bb3-a25b-1f81ac2bfce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:29.765271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aadc23-6cd5-4bb3-a25b-1f81ac2bfce6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:29.789476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aadc23-6cd5-4bb3-a25b-1f81ac2bfce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-18aadc23-6cd5-4bb3-a25b-1f81ac2bfce6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:29.795354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:29.796497 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:29.797464 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:29.797464 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:29.797464 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:29.797464 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:29.797464 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:29.797464 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:29.797464 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:29.797464 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:29.797464 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:29.797464 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:29.797464 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:36:29.797464 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:29.808835 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 212/409] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:36:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:29.814605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aadc23-6cd5-4bb3-a25b-1f81ac2bfce6 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:29.815197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26642f25-3514-4ce8-ac1c-65768e36c9f7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:29.821352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:29.891304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907ac45-8178-42f0-8e35-5d3c970c9f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:29.891946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907ac45-8178-42f0-8e35-5d3c970c9f1c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:29.892226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907ac45-8178-42f0-8e35-5d3c970c9f1c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:29.892499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907ac45-8178-42f0-8e35-5d3c970c9f1c None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:29.896480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907ac45-8178-42f0-8e35-5d3c970c9f1c None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:29.899406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907ac45-8178-42f0-8e35-5d3c970c9f1c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:29.901278 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 198/410] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:29 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:29.906576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907ac45-8178-42f0-8e35-5d3c970c9f1c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:30.023328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907ac45-8178-42f0-8e35-5d3c970c9f1c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:30.063394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bd855-3b94-43ac-920a-0b3d8191d0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:30.064061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bd855-3b94-43ac-920a-0b3d8191d0d3 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:30.064342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bd855-3b94-43ac-920a-0b3d8191d0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:30.064614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bd855-3b94-43ac-920a-0b3d8191d0d3 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b/roles/9e9271d4f0cd4c5688279b54d26e079f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:30.067409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3bd855-3b94-43ac-920a-0b3d8191d0d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=00edf8173f2c446bbfd98af8172124c6, group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b, role_id=9e9271d4f0cd4c5688279b54d26e079f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:30.068868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3bd855-3b94-43ac-920a-0b3d8191d0d3 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:30.085569 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 199/411] 10.222.0.70 () {58 vars in 1442 bytes} [Sun Aug 28 18:36:29 2022] PUT /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b/roles/9e9271d4f0cd4c5688279b54d26e079f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:30.109135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aadc23-6cd5-4bb3-a25b-1f81ac2bfce6 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:30.136885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a24610-6292-4c02-bbaf-c606fdee4577 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:30.137328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a24610-6292-4c02-bbaf-c606fdee4577 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:30.137677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a24610-6292-4c02-bbaf-c606fdee4577 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:30.139586 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 200/412] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:36:30.149026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e7acf-79a6-415e-a351-899891a611c4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:30.149341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e7acf-79a6-415e-a351-899891a611c4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:30.149588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e7acf-79a6-415e-a351-899891a611c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:30.170337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-659e7acf-79a6-415e-a351-899891a611c4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:30.171606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-659e7acf-79a6-415e-a351-899891a611c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:30.194515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f763a7-1df1-4cf0-be74-6f1a9a494b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:30.196704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f763a7-1df1-4cf0-be74-6f1a9a494b7d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:30.197003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f763a7-1df1-4cf0-be74-6f1a9a494b7d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:30.197283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f763a7-1df1-4cf0-be74-6f1a9a494b7d None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:30.197978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f763a7-1df1-4cf0-be74-6f1a9a494b7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:30.198288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f763a7-1df1-4cf0-be74-6f1a9a494b7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:30.203827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f763a7-1df1-4cf0-be74-6f1a9a494b7d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:30.215139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:30.221152 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 213/413] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:30.229996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f763a7-1df1-4cf0-be74-6f1a9a494b7d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:30.281176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:30.302848 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 201/414] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:30.374237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f763a7-1df1-4cf0-be74-6f1a9a494b7d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:30.423388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab46c5-e886-46d6-a3dc-241f79309bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:30.424052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab46c5-e886-46d6-a3dc-241f79309bca None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:30.424904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab46c5-e886-46d6-a3dc-241f79309bca None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:30.425598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab46c5-e886-46d6-a3dc-241f79309bca None admin] PATH_INFO: `/v3/groups/bb6ad444997042718855f4db6f2bb119` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:30.431441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab46c5-e886-46d6-a3dc-241f79309bca None admin] RBAC: Authorizing `identity:get_group(group_id=bb6ad444997042718855f4db6f2bb119)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:30.432928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab46c5-e886-46d6-a3dc-241f79309bca None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:30.434890 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 214/415] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:30 2022] GET /identity/v3/groups/bb6ad444997042718855f4db6f2bb119 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:30.441035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e7acf-79a6-415e-a351-899891a611c4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:30.574632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e7acf-79a6-415e-a351-899891a611c4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:30.610382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce56c74-7b45-43ea-a6a9-b0cc8f7e6d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:30.611049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce56c74-7b45-43ea-a6a9-b0cc8f7e6d1e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:30.611328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce56c74-7b45-43ea-a6a9-b0cc8f7e6d1e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:30.611600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce56c74-7b45-43ea-a6a9-b0cc8f7e6d1e None admin] PATH_INFO: `/v3/projects/58e6322e28544af5ae4a5db517170f8c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:30.613307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce56c74-7b45-43ea-a6a9-b0cc8f7e6d1e None admin] RBAC: Authorizing `identity:get_project(project_id=58e6322e28544af5ae4a5db517170f8c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:30.615016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce56c74-7b45-43ea-a6a9-b0cc8f7e6d1e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:30.616918 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 202/416] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:30 2022] GET /identity/v3/projects/58e6322e28544af5ae4a5db517170f8c => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:30.623855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab46c5-e886-46d6-a3dc-241f79309bca None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:30.624201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce56c74-7b45-43ea-a6a9-b0cc8f7e6d1e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:30.664152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:30.801013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce56c74-7b45-43ea-a6a9-b0cc8f7e6d1e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:30.812138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:30.823035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab46c5-e886-46d6-a3dc-241f79309bca None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:30.868337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc82ce-eeac-4da6-b0b1-dbd2ba4c5395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:30.869003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc82ce-eeac-4da6-b0b1-dbd2ba4c5395 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:30.869288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc82ce-eeac-4da6-b0b1-dbd2ba4c5395 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:30.869564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc82ce-eeac-4da6-b0b1-dbd2ba4c5395 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:30.888214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc82ce-eeac-4da6-b0b1-dbd2ba4c5395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-d4cc82ce-eeac-4da6-b0b1-dbd2ba4c5395 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:30.896196 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:30.897046 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:30.897820 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:30.897820 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:30.897820 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:30.897820 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:30.897820 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:30.897820 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:30.897820 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:30.897820 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:30.897820 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:30.897820 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:30.897820 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:30.897820 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:30.903405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9eeb9-a26f-45cf-ba1b-a3bb545e1098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:30.904146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9eeb9-a26f-45cf-ba1b-a3bb545e1098 None admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:30.904435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9eeb9-a26f-45cf-ba1b-a3bb545e1098 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:30.904720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9eeb9-a26f-45cf-ba1b-a3bb545e1098 None admin] PATH_INFO: `/v3/projects/58e6322e28544af5ae4a5db517170f8c/groups/bb6ad444997042718855f4db6f2bb119/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:30.906736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9eeb9-a26f-45cf-ba1b-a3bb545e1098 None admin] RBAC: Authorizing `identity:create_grant(project_id=58e6322e28544af5ae4a5db517170f8c, group_id=bb6ad444997042718855f4db6f2bb119, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:30.908275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de9eeb9-a26f-45cf-ba1b-a3bb545e1098 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:30.911463 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 203/417] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:30.914062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc82ce-eeac-4da6-b0b1-dbd2ba4c5395 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:30.939256 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 215/418] 10.222.0.70 () {58 vars in 1442 bytes} [Sun Aug 28 18:36:30 2022] PUT /identity/v3/projects/58e6322e28544af5ae4a5db517170f8c/groups/bb6ad444997042718855f4db6f2bb119/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:31.013800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37d2b4-af1e-462b-be06-a8a2375f570e None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:31.014128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37d2b4-af1e-462b-be06-a8a2375f570e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:31.014365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37d2b4-af1e-462b-be06-a8a2375f570e None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:31.016838 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 216/419] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:36:31.022013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e61ff2-8181-4793-a500-baad3198ee00 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:31.022312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e61ff2-8181-4793-a500-baad3198ee00 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:31.022593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e61ff2-8181-4793-a500-baad3198ee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:31.029114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:31.059465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc82ce-eeac-4da6-b0b1-dbd2ba4c5395 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:31.061961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-41e61ff2-8181-4793-a500-baad3198ee00 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:31.063565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-41e61ff2-8181-4793-a500-baad3198ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:31.130872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720733f-31eb-4e76-b4fa-160502584e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:31.131420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720733f-31eb-4e76-b4fa-160502584e42 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:31.131704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720733f-31eb-4e76-b4fa-160502584e42 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:31.132004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720733f-31eb-4e76-b4fa-160502584e42 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:31.132673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720733f-31eb-4e76-b4fa-160502584e42 None admin] RBAC: Adding query filter params (name=member) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:31.132980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720733f-31eb-4e76-b4fa-160502584e42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:31.134354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720733f-31eb-4e76-b4fa-160502584e42 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:31.144727 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 204/420] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:31.150311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720733f-31eb-4e76-b4fa-160502584e42 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:31.169960 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 217/421] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:31.264030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720733f-31eb-4e76-b4fa-160502584e42 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:31.302073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c3bfa-805b-4388-89df-db07c09bea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:31.302692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c3bfa-805b-4388-89df-db07c09bea7d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:31.303002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c3bfa-805b-4388-89df-db07c09bea7d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:31.303278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c3bfa-805b-4388-89df-db07c09bea7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:31.323544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:31.378326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c3bfa-805b-4388-89df-db07c09bea7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:31.379853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c3bfa-805b-4388-89df-db07c09bea7d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:31.485793 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 205/422] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 18:36:31.491846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e61ff2-8181-4793-a500-baad3198ee00 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:31.549436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94d2b6-f574-496c-a7ac-a761f8d3ed68 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:31.549797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94d2b6-f574-496c-a7ac-a761f8d3ed68 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:31.550276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94d2b6-f574-496c-a7ac-a761f8d3ed68 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:31.552026 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 206/423] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:31.571710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adade68-7524-4562-a041-63d1a629bd66 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:31.571990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adade68-7524-4562-a041-63d1a629bd66 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:31.572274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adade68-7524-4562-a041-63d1a629bd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:31.599041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1adade68-7524-4562-a041-63d1a629bd66 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:31.600278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1adade68-7524-4562-a041-63d1a629bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:31.609547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:31.631175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e61ff2-8181-4793-a500-baad3198ee00 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:31.645686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:31.670841 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 207/424] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:31.671910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adade68-7524-4562-a041-63d1a629bd66 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:31.677786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343feb95-da4b-4b29-bd5d-24f50ff4ffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:31.678437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343feb95-da4b-4b29-bd5d-24f50ff4ffde None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:31.678724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343feb95-da4b-4b29-bd5d-24f50ff4ffde None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:31.679031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343feb95-da4b-4b29-bd5d-24f50ff4ffde None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:31.680189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343feb95-da4b-4b29-bd5d-24f50ff4ffde None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:31.681743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343feb95-da4b-4b29-bd5d-24f50ff4ffde None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:31.684036 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 218/425] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:31 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:31.690878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343feb95-da4b-4b29-bd5d-24f50ff4ffde None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:31.839955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adade68-7524-4562-a041-63d1a629bd66 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:31.875478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc94903-3e51-404c-8170-22a34fdadf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:31.876097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc94903-3e51-404c-8170-22a34fdadf70 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:31.876364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc94903-3e51-404c-8170-22a34fdadf70 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:31.877622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc94903-3e51-404c-8170-22a34fdadf70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:31.881993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343feb95-da4b-4b29-bd5d-24f50ff4ffde None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:31.899960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc94903-3e51-404c-8170-22a34fdadf70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-dcc94903-3e51-404c-8170-22a34fdadf70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:31.905125 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:31.905973 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:31.906782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:31.906782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:31.906782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:31.906782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:31.906782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:31.906782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:31.906782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:31.906782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:31.906782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:31.906782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:31.906782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:31.906782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:31.915256 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 208/426] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:36:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:31.920781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc94903-3e51-404c-8170-22a34fdadf70 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:31.931488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a57ea7-061a-47d9-9c5c-fe96e6219ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:31.932473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a57ea7-061a-47d9-9c5c-fe96e6219ef9 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:31.932955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a57ea7-061a-47d9-9c5c-fe96e6219ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:31.933686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a57ea7-061a-47d9-9c5c-fe96e6219ef9 None admin] PATH_INFO: `/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:31.935088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a57ea7-061a-47d9-9c5c-fe96e6219ef9 None admin] RBAC: Authorizing `identity:get_group(group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:31.936728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a57ea7-061a-47d9-9c5c-fe96e6219ef9 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:31.938559 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 219/427] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:31 2022] GET /identity/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:31.944461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a57ea7-061a-47d9-9c5c-fe96e6219ef9 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:31.967613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:31.975683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:32.056928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc94903-3e51-404c-8170-22a34fdadf70 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:32.065961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a57ea7-061a-47d9-9c5c-fe96e6219ef9 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:32.102148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151e874-b662-45cc-93cf-fba9416be4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:32.102675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151e874-b662-45cc-93cf-fba9416be4ff None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:32.102982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151e874-b662-45cc-93cf-fba9416be4ff None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:32.103254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151e874-b662-45cc-93cf-fba9416be4ff None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:32.103912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151e874-b662-45cc-93cf-fba9416be4ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:32.104214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151e874-b662-45cc-93cf-fba9416be4ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:32.104790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804968b-c721-40cc-9706-0973ea44e896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:32.105572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151e874-b662-45cc-93cf-fba9416be4ff None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:32.105828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804968b-c721-40cc-9706-0973ea44e896 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:32.106311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804968b-c721-40cc-9706-0973ea44e896 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:32.106821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804968b-c721-40cc-9706-0973ea44e896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:32.107757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804968b-c721-40cc-9706-0973ea44e896 None admin] RBAC: Adding query filter params (group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b, role.id=24fee0983ae345c288f4974d93a3805d, scope.project.id=fea2e1e9b16a4405b41888375f40c504) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:32.108266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804968b-c721-40cc-9706-0973ea44e896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:32.109893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804968b-c721-40cc-9706-0973ea44e896 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:32.115939 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 209/428] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:32.116814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151e874-b662-45cc-93cf-fba9416be4ff None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:32.123035 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 220/429] 10.222.0.70 () {56 vars in 1376 bytes} [Sun Aug 28 18:36:31 2022] GET /identity/v3/role_assignments?group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b&scope.project.id=fea2e1e9b16a4405b41888375f40c504&role.id=24fee0983ae345c288f4974d93a3805d => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:32.124403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804968b-c721-40cc-9706-0973ea44e896 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:32.239301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:32.243547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151e874-b662-45cc-93cf-fba9416be4ff None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:32.291843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de24c8-a917-4470-ad71-d51b497c5ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:32.292466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de24c8-a917-4470-ad71-d51b497c5ec3 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:32.292762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de24c8-a917-4470-ad71-d51b497c5ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:32.293001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de24c8-a917-4470-ad71-d51b497c5ec3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:32.306988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de24c8-a917-4470-ad71-d51b497c5ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-09de24c8-a917-4470-ad71-d51b497c5ec3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:32.313310 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:32.314205 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:32.315672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:32.315672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:32.315672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:32.315672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:32.315672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:32.315672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:32.315672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:32.315672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:32.315672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:32.315672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:32.315672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 18:36:32.315672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:32.315672 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 210/430] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:32.321602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de24c8-a917-4470-ad71-d51b497c5ec3 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:32.333387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:32.360287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804968b-c721-40cc-9706-0973ea44e896 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:32.411834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69c7c1-c616-4d35-b515-f04601d90a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:32.412714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69c7c1-c616-4d35-b515-f04601d90a84 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:32.412997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69c7c1-c616-4d35-b515-f04601d90a84 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:32.415005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69c7c1-c616-4d35-b515-f04601d90a84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:32.459778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de24c8-a917-4470-ad71-d51b497c5ec3 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:32.509258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278633b4-bb04-4cd5-bb2d-6d76ba42253e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:32.509887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278633b4-bb04-4cd5-bb2d-6d76ba42253e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:32.510172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278633b4-bb04-4cd5-bb2d-6d76ba42253e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:32.510449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278633b4-bb04-4cd5-bb2d-6d76ba42253e None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:32.511386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278633b4-bb04-4cd5-bb2d-6d76ba42253e None admin] RBAC: Adding query filter params (name=member) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:32.511713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278633b4-bb04-4cd5-bb2d-6d76ba42253e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:32.513822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278633b4-bb04-4cd5-bb2d-6d76ba42253e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:32.515529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69c7c1-c616-4d35-b515-f04601d90a84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:32.516988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69c7c1-c616-4d35-b515-f04601d90a84 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:32.523501 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 211/431] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:36:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:32.524791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5604d70-c483-4826-9cd8-34c739e234ae None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:32.525474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5604d70-c483-4826-9cd8-34c739e234ae None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:32.525474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5604d70-c483-4826-9cd8-34c739e234ae None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:32.526711 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 212/432] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:32.531391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5604d70-c483-4826-9cd8-34c739e234ae None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:32.564678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:32.627551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:32.653272 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 221/433] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:32.653272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3026525-90a9-429c-80fc-ffbecf71140a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:32.653272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3026525-90a9-429c-80fc-ffbecf71140a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:32.653272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3026525-90a9-429c-80fc-ffbecf71140a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:32.670818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c3026525-90a9-429c-80fc-ffbecf71140a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:32.672003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c3026525-90a9-429c-80fc-ffbecf71140a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:32.676541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5604d70-c483-4826-9cd8-34c739e234ae None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:32.723693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7d73a-1356-475e-bbbb-a7b31b6e0b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:32.723693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7d73a-1356-475e-bbbb-a7b31b6e0b8e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:32.723991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7d73a-1356-475e-bbbb-a7b31b6e0b8e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:32.724163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7d73a-1356-475e-bbbb-a7b31b6e0b8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:32.748730 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 222/434] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:32.749855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3026525-90a9-429c-80fc-ffbecf71140a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:32.819408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7d73a-1356-475e-bbbb-a7b31b6e0b8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:32.822083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7d73a-1356-475e-bbbb-a7b31b6e0b8e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:32.854301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:32.860564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3026525-90a9-429c-80fc-ffbecf71140a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:32.880107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:32.910026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5239b-581f-4f9e-ac10-4e0db7123473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:32.910843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5239b-581f-4f9e-ac10-4e0db7123473 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:32.911221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5239b-581f-4f9e-ac10-4e0db7123473 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:32.911592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5239b-581f-4f9e-ac10-4e0db7123473 None admin] PATH_INFO: `/v3/projects/fea2e1e9b16a4405b41888375f40c504` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:32.912819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5239b-581f-4f9e-ac10-4e0db7123473 None admin] RBAC: Authorizing `identity:get_project(project_id=fea2e1e9b16a4405b41888375f40c504)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:32.914915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5239b-581f-4f9e-ac10-4e0db7123473 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:32.917126 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 223/435] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:32 2022] GET /identity/v3/projects/fea2e1e9b16a4405b41888375f40c504 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:32.922804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5239b-581f-4f9e-ac10-4e0db7123473 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:32.944836 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 213/436] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:32.953925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7d73a-1356-475e-bbbb-a7b31b6e0b8e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:33.039642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5239b-581f-4f9e-ac10-4e0db7123473 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:33.067249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7d73a-1356-475e-bbbb-a7b31b6e0b8e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:33.076274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3a38d-34c0-45cc-b12e-43a02674bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:33.076901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3a38d-34c0-45cc-b12e-43a02674bdac None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:33.077182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3a38d-34c0-45cc-b12e-43a02674bdac None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:33.077457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3a38d-34c0-45cc-b12e-43a02674bdac None admin] PATH_INFO: `/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:33.078555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3a38d-34c0-45cc-b12e-43a02674bdac None admin] RBAC: Authorizing `identity:get_group(group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:33.080015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3a38d-34c0-45cc-b12e-43a02674bdac None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:33.082158 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 224/437] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:32 2022] GET /identity/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:33.083048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3a38d-34c0-45cc-b12e-43a02674bdac None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:33.098123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:33.113733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adfebc-528e-4919-ac4a-917c9cbb9245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:33.114369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adfebc-528e-4919-ac4a-917c9cbb9245 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:33.114645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adfebc-528e-4919-ac4a-917c9cbb9245 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:33.114964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adfebc-528e-4919-ac4a-917c9cbb9245 None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:33.116064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adfebc-528e-4919-ac4a-917c9cbb9245 None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:33.117499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adfebc-528e-4919-ac4a-917c9cbb9245 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:33.123889 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 214/438] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:32 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:33.124703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adfebc-528e-4919-ac4a-917c9cbb9245 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:33.141587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:33.203011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3a38d-34c0-45cc-b12e-43a02674bdac None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:33.244987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cd553-0e27-4e63-b360-fa63d8787b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:33.245439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adfebc-528e-4919-ac4a-917c9cbb9245 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:33.245634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd553-0e27-4e63-b360-fa63d8787b94 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:33.245976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd553-0e27-4e63-b360-fa63d8787b94 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:33.246256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cd553-0e27-4e63-b360-fa63d8787b94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:33.258870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cd553-0e27-4e63-b360-fa63d8787b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-2c1cd553-0e27-4e63-b360-fa63d8787b94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:33.264940 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:33.267237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 225/439] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:36:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:33.268569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cd553-0e27-4e63-b360-fa63d8787b94 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:33.285860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591d794-694d-475d-818d-60394b9f4c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:33.286472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591d794-694d-475d-818d-60394b9f4c2d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:33.286774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591d794-694d-475d-818d-60394b9f4c2d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:33.287066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591d794-694d-475d-818d-60394b9f4c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:33.287787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591d794-694d-475d-818d-60394b9f4c2d None admin] RBAC: Adding query filter params (group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b, role.id=9e9271d4f0cd4c5688279b54d26e079f, scope.project.id=fea2e1e9b16a4405b41888375f40c504) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:33.288095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591d794-694d-475d-818d-60394b9f4c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:33.289532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591d794-694d-475d-818d-60394b9f4c2d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:33.295530 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 215/440] 10.222.0.70 () {56 vars in 1376 bytes} [Sun Aug 28 18:36:33 2022] GET /identity/v3/role_assignments?group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b&scope.project.id=fea2e1e9b16a4405b41888375f40c504&role.id=9e9271d4f0cd4c5688279b54d26e079f => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:33.303978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591d794-694d-475d-818d-60394b9f4c2d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:33.372226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:33.396343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cd553-0e27-4e63-b360-fa63d8787b94 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:33.408291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:33.425674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591d794-694d-475d-818d-60394b9f4c2d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:33.436546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb8d15-c8b9-4967-ad99-8c43eaf9a5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:33.437500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb8d15-c8b9-4967-ad99-8c43eaf9a5d2 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:33.438013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb8d15-c8b9-4967-ad99-8c43eaf9a5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:33.438201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb8d15-c8b9-4967-ad99-8c43eaf9a5d2 None admin] PATH_INFO: `/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:33.439334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb8d15-c8b9-4967-ad99-8c43eaf9a5d2 None admin] RBAC: Authorizing `identity:get_group(group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:33.441774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb8d15-c8b9-4967-ad99-8c43eaf9a5d2 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:33.443284 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 226/441] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:33 2022] GET /identity/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:33.443783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614eb89-83d5-4f4c-a2f8-279dd69c0536 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:33.444060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614eb89-83d5-4f4c-a2f8-279dd69c0536 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:33.444332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614eb89-83d5-4f4c-a2f8-279dd69c0536 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:33.445677 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 227/442] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:33.448669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614eb89-83d5-4f4c-a2f8-279dd69c0536 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:33.469647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8910f-166c-4fcc-9692-943dcb459c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:33.470266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8910f-166c-4fcc-9692-943dcb459c04 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:33.470547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8910f-166c-4fcc-9692-943dcb459c04 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:33.470849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8910f-166c-4fcc-9692-943dcb459c04 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:33.472161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8910f-166c-4fcc-9692-943dcb459c04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:33.472453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8910f-166c-4fcc-9692-943dcb459c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:33.473816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8910f-166c-4fcc-9692-943dcb459c04 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:33.481996 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 216/443] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:33.486620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff016b52-9026-493a-b5b9-018729154522 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:33.486620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff016b52-9026-493a-b5b9-018729154522 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:33.486620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff016b52-9026-493a-b5b9-018729154522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:33.503391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ff016b52-9026-493a-b5b9-018729154522 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:33.504785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ff016b52-9026-493a-b5b9-018729154522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:33.589378 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 217/444] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:33.590975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff016b52-9026-493a-b5b9-018729154522 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:33.599178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614eb89-83d5-4f4c-a2f8-279dd69c0536 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:33.645633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd195fef-bdd3-4054-9e68-cf5302814281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:33.646658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd195fef-bdd3-4054-9e68-cf5302814281 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:33.647129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd195fef-bdd3-4054-9e68-cf5302814281 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:33.647544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd195fef-bdd3-4054-9e68-cf5302814281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:33.648501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd195fef-bdd3-4054-9e68-cf5302814281 None admin] RBAC: Adding query filter params (group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b, role.id=24fee0983ae345c288f4974d93a3805d, scope.project.id=00edf8173f2c446bbfd98af8172124c6) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:33.648952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd195fef-bdd3-4054-9e68-cf5302814281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:33.649446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:33.650622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd195fef-bdd3-4054-9e68-cf5302814281 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:33.662845 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 228/445] 10.222.0.70 () {56 vars in 1376 bytes} [Sun Aug 28 18:36:33 2022] GET /identity/v3/role_assignments?group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b&scope.project.id=00edf8173f2c446bbfd98af8172124c6&role.id=24fee0983ae345c288f4974d93a3805d => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:33.723835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff016b52-9026-493a-b5b9-018729154522 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:33.763223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7bb6a-2ba6-4268-b11e-6cfa34e294af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:33.764164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7bb6a-2ba6-4268-b11e-6cfa34e294af None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:33.764597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7bb6a-2ba6-4268-b11e-6cfa34e294af None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:33.765010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7bb6a-2ba6-4268-b11e-6cfa34e294af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:33.845400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7bb6a-2ba6-4268-b11e-6cfa34e294af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:33.847479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7bb6a-2ba6-4268-b11e-6cfa34e294af None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:33.865828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd195fef-bdd3-4054-9e68-cf5302814281 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:33.896537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:33.926373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:33.960882 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 218/446] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:33.966301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7bb6a-2ba6-4268-b11e-6cfa34e294af None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:33.996818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd195fef-bdd3-4054-9e68-cf5302814281 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:34.046257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493b976-9dd4-4e5b-9bfd-3ed7e1cf7c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:34.046943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493b976-9dd4-4e5b-9bfd-3ed7e1cf7c93 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:34.047231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493b976-9dd4-4e5b-9bfd-3ed7e1cf7c93 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:34.047756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493b976-9dd4-4e5b-9bfd-3ed7e1cf7c93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:34.060086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493b976-9dd4-4e5b-9bfd-3ed7e1cf7c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-a493b976-9dd4-4e5b-9bfd-3ed7e1cf7c93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:34.065398 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:34.066455 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:34.067572 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:34.067572 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:34.067572 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:34.067572 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:34.067572 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:34.067572 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:34.067572 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:34.067572 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:34.067572 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:34.067572 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:34.067572 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:36:34.067572 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:34.067572 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 229/447] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:36:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:34.072287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493b976-9dd4-4e5b-9bfd-3ed7e1cf7c93 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:34.084949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7bb6a-2ba6-4268-b11e-6cfa34e294af None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:34.121061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a3b06-f9ef-40ee-beb0-aaf9f9199f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:34.121678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a3b06-f9ef-40ee-beb0-aaf9f9199f7a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:34.121960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a3b06-f9ef-40ee-beb0-aaf9f9199f7a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:34.122225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a3b06-f9ef-40ee-beb0-aaf9f9199f7a None admin] PATH_INFO: `/v3/projects/00edf8173f2c446bbfd98af8172124c6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:34.123358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a3b06-f9ef-40ee-beb0-aaf9f9199f7a None admin] RBAC: Authorizing `identity:get_project(project_id=00edf8173f2c446bbfd98af8172124c6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:34.124787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a3b06-f9ef-40ee-beb0-aaf9f9199f7a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:34.126397 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 219/448] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:33 2022] GET /identity/v3/projects/00edf8173f2c446bbfd98af8172124c6 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:34.131888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a3b06-f9ef-40ee-beb0-aaf9f9199f7a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:34.147329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:34.174514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493b976-9dd4-4e5b-9bfd-3ed7e1cf7c93 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:34.176190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:34.208854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e822f5-322b-4e12-b0f5-4816917867d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:34.209426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e822f5-322b-4e12-b0f5-4816917867d8 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:34.209711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e822f5-322b-4e12-b0f5-4816917867d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:34.209988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e822f5-322b-4e12-b0f5-4816917867d8 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:34.210645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e822f5-322b-4e12-b0f5-4816917867d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:34.210989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e822f5-322b-4e12-b0f5-4816917867d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:34.212355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e822f5-322b-4e12-b0f5-4816917867d8 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:34.220335 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 230/449] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:34.226719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e822f5-322b-4e12-b0f5-4816917867d8 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:34.234024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a3b06-f9ef-40ee-beb0-aaf9f9199f7a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:34.269544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32153c1-2876-4772-bbab-2df93fe2be2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:34.270167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32153c1-2876-4772-bbab-2df93fe2be2b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:34.270447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32153c1-2876-4772-bbab-2df93fe2be2b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:34.270731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32153c1-2876-4772-bbab-2df93fe2be2b None admin] PATH_INFO: `/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:34.271867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32153c1-2876-4772-bbab-2df93fe2be2b None admin] RBAC: Authorizing `identity:get_group(group_id=0eb3f2d027cb4036852a8a6d5a8d5c5b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:34.273314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32153c1-2876-4772-bbab-2df93fe2be2b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:34.274888 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 220/450] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:34 2022] GET /identity/v3/groups/0eb3f2d027cb4036852a8a6d5a8d5c5b => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:34.280471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32153c1-2876-4772-bbab-2df93fe2be2b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:34.328001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e822f5-322b-4e12-b0f5-4816917867d8 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:34.361509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:34.362563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1ed6c-be63-40fc-a34f-2d5a67142b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:34.362857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1ed6c-be63-40fc-a34f-2d5a67142b1a None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:34.363153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1ed6c-be63-40fc-a34f-2d5a67142b1a None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:34.363427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1ed6c-be63-40fc-a34f-2d5a67142b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:34.380006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32153c1-2876-4772-bbab-2df93fe2be2b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:34.393507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:34.413451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6d5df-bb0e-4ce7-9ae3-fe8920407380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:34.414057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d5df-bb0e-4ce7-9ae3-fe8920407380 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:34.414402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d5df-bb0e-4ce7-9ae3-fe8920407380 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:34.414654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d5df-bb0e-4ce7-9ae3-fe8920407380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:34.415336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6d5df-bb0e-4ce7-9ae3-fe8920407380 None admin] RBAC: Adding query filter params (group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b, role.id=9e9271d4f0cd4c5688279b54d26e079f, scope.project.id=00edf8173f2c446bbfd98af8172124c6) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:34.415639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6d5df-bb0e-4ce7-9ae3-fe8920407380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:34.417062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6d5df-bb0e-4ce7-9ae3-fe8920407380 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:34.422683 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 221/451] 10.222.0.70 () {56 vars in 1376 bytes} [Sun Aug 28 18:36:34 2022] GET /identity/v3/role_assignments?group.id=0eb3f2d027cb4036852a8a6d5a8d5c5b&scope.project.id=00edf8173f2c446bbfd98af8172124c6&role.id=9e9271d4f0cd4c5688279b54d26e079f => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:34.438662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1ed6c-be63-40fc-a34f-2d5a67142b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:34.440351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1ed6c-be63-40fc-a34f-2d5a67142b1a None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:34.547417 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 231/452] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:34.554007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6d5df-bb0e-4ce7-9ae3-fe8920407380 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:34.660538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6d5df-bb0e-4ce7-9ae3-fe8920407380 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:34.694031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1b428-433f-4e7d-a27a-ff01946951f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:34.694655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1b428-433f-4e7d-a27a-ff01946951f7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:34.694960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1b428-433f-4e7d-a27a-ff01946951f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:34.695236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1b428-433f-4e7d-a27a-ff01946951f7 None admin] PATH_INFO: `/v3/projects/58e6322e28544af5ae4a5db517170f8c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:34.696370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1b428-433f-4e7d-a27a-ff01946951f7 None admin] RBAC: Authorizing `identity:get_project(project_id=58e6322e28544af5ae4a5db517170f8c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:34.697796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1b428-433f-4e7d-a27a-ff01946951f7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:34.699446 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 222/453] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:36:34 2022] GET /identity/v3/projects/58e6322e28544af5ae4a5db517170f8c => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:34.705164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1ed6c-be63-40fc-a34f-2d5a67142b1a None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:34.770313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:34.807724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1ed6c-be63-40fc-a34f-2d5a67142b1a None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:34.840878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c9f5a-7867-4fa1-93f6-364530081777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:34.841500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c9f5a-7867-4fa1-93f6-364530081777 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:34.841778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c9f5a-7867-4fa1-93f6-364530081777 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:34.842050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c9f5a-7867-4fa1-93f6-364530081777 None admin] PATH_INFO: `/v3/groups/bb6ad444997042718855f4db6f2bb119` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:34.843156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c9f5a-7867-4fa1-93f6-364530081777 None admin] RBAC: Authorizing `identity:get_group(group_id=bb6ad444997042718855f4db6f2bb119)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:34.844642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c9f5a-7867-4fa1-93f6-364530081777 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:34.846954 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 232/454] 10.222.0.70 () {56 vars in 1180 bytes} [Sun Aug 28 18:36:34 2022] GET /identity/v3/groups/bb6ad444997042718855f4db6f2bb119 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:34.852727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1b428-433f-4e7d-a27a-ff01946951f7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:34.868585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:34.951233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1b428-433f-4e7d-a27a-ff01946951f7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:34.983906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ec689-d783-4a01-b954-6326d2a4b5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:34.984501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ec689-d783-4a01-b954-6326d2a4b5ff None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:34.984779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ec689-d783-4a01-b954-6326d2a4b5ff None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:34.985051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ec689-d783-4a01-b954-6326d2a4b5ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:34.985762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ec689-d783-4a01-b954-6326d2a4b5ff None admin] RBAC: Adding query filter params (group.id=bb6ad444997042718855f4db6f2bb119, role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=58e6322e28544af5ae4a5db517170f8c) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:34.986069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ec689-d783-4a01-b954-6326d2a4b5ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:34.987673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ec689-d783-4a01-b954-6326d2a4b5ff None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:34.993190 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 223/455] 10.222.0.70 () {56 vars in 1376 bytes} [Sun Aug 28 18:36:34 2022] GET /identity/v3/role_assignments?group.id=bb6ad444997042718855f4db6f2bb119&scope.project.id=58e6322e28544af5ae4a5db517170f8c&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:37.364296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a507d04-df73-4e4b-84cd-5f9d178166b9 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:37.365290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a507d04-df73-4e4b-84cd-5f9d178166b9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:37.365808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a507d04-df73-4e4b-84cd-5f9d178166b9 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:37.367609 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 233/456] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:37.373216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8129ac-5310-4c9e-9d53-3e4c6068cab7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:37.374009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8129ac-5310-4c9e-9d53-3e4c6068cab7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:37.374497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8129ac-5310-4c9e-9d53-3e4c6068cab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:37.403709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ad8129ac-5310-4c9e-9d53-3e4c6068cab7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:37.405223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ad8129ac-5310-4c9e-9d53-3e4c6068cab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:37.504852 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 224/457] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:37.541237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf897d3-2b1e-4751-a8c8-45bd5070bac2 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:37.541840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf897d3-2b1e-4751-a8c8-45bd5070bac2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:37.542394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf897d3-2b1e-4751-a8c8-45bd5070bac2 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:37.544204 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 234/458] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:37.549271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0daf1-84d7-49d7-ac25-ba96b5fa2821 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:37.549665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0daf1-84d7-49d7-ac25-ba96b5fa2821 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:37.549939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0daf1-84d7-49d7-ac25-ba96b5fa2821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:37.579953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5ce0daf1-84d7-49d7-ac25-ba96b5fa2821 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:37.581852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5ce0daf1-84d7-49d7-ac25-ba96b5fa2821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:37.583967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:37.677513 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 225/459] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:37.760840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41963d7-a15d-4b35-8408-07b937cf18f1 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:37.761490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41963d7-a15d-4b35-8408-07b937cf18f1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:37.761971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41963d7-a15d-4b35-8408-07b937cf18f1 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:37.763761 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 235/460] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:37.770126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaa565-0afa-4a9a-a09d-008dc8a04272 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:37.770406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaa565-0afa-4a9a-a09d-008dc8a04272 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:37.770675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaa565-0afa-4a9a-a09d-008dc8a04272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:37.796116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-baeaa565-0afa-4a9a-a09d-008dc8a04272 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:37.797349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-baeaa565-0afa-4a9a-a09d-008dc8a04272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:37.876090 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 226/461] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:38.003285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41963d7-a15d-4b35-8408-07b937cf18f1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:38.014239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaa565-0afa-4a9a-a09d-008dc8a04272 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:38.130678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:38.166689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaa565-0afa-4a9a-a09d-008dc8a04272 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:38.183404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41963d7-a15d-4b35-8408-07b937cf18f1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:38.218431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7b003-7571-441a-89f8-35907848844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:38.219124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7b003-7571-441a-89f8-35907848844a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:38.219403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7b003-7571-441a-89f8-35907848844a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:38.219672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7b003-7571-441a-89f8-35907848844a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:38.225143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:38.231397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88a6d8-1f2f-4812-b64b-d41b532db59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:38.232778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88a6d8-1f2f-4812-b64b-d41b532db59a None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:38.233576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88a6d8-1f2f-4812-b64b-d41b532db59a None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:38.233995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7b003-7571-441a-89f8-35907848844a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:38.234247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88a6d8-1f2f-4812-b64b-d41b532db59a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:38.235479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7b003-7571-441a-89f8-35907848844a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:38.247322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88a6d8-1f2f-4812-b64b-d41b532db59a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:38.249077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88a6d8-1f2f-4812-b64b-d41b532db59a None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-33d7b003-7571-441a-89f8-35907848844a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:38.250576 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:38.251639 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:38.252675 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:38.252675 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:38.252675 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:38.258955 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 227/462] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:38.259862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7b003-7571-441a-89f8-35907848844a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-ca88a6d8-1f2f-4812-b64b-d41b532db59a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:38.268701 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:38.269728 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:38.270537 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:38.270537 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:38.270537 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:38.272596 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 236/463] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:38.273908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88a6d8-1f2f-4812-b64b-d41b532db59a None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:38.368733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7b003-7571-441a-89f8-35907848844a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:38.387346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88a6d8-1f2f-4812-b64b-d41b532db59a None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:38.390637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:38.406325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc82f-0022-4ee4-88c8-5adcc949eeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:38.406981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc82f-0022-4ee4-88c8-5adcc949eeda None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:38.407263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc82f-0022-4ee4-88c8-5adcc949eeda None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:38.407532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc82f-0022-4ee4-88c8-5adcc949eeda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:38.418963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6dc82f-0022-4ee4-88c8-5adcc949eeda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:38.420501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6dc82f-0022-4ee4-88c8-5adcc949eeda None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:38.423204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fcac2-3ef8-4491-94e5-c42f988150c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:38.423741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fcac2-3ef8-4491-94e5-c42f988150c9 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:38.424018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fcac2-3ef8-4491-94e5-c42f988150c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:38.424329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5fcac2-3ef8-4491-94e5-c42f988150c9 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:38.425011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fcac2-3ef8-4491-94e5-c42f988150c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:38.425308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fcac2-3ef8-4491-94e5-c42f988150c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:38.426667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5fcac2-3ef8-4491-94e5-c42f988150c9 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-5d6dc82f-0022-4ee4-88c8-5adcc949eeda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:38.436059 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:38.436923 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:38.437742 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:38.437742 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:38.437742 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:38.437742 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 228/464] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:38.438882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d2c34-27f6-4dad-83ef-e7f72ebf01dd None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:38.438882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d2c34-27f6-4dad-83ef-e7f72ebf01dd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:38.438882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d2c34-27f6-4dad-83ef-e7f72ebf01dd None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:38.440694 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 229/465] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:38.441328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d2c34-27f6-4dad-83ef-e7f72ebf01dd None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:38.451215 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 237/466] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:38.452065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fcac2-3ef8-4491-94e5-c42f988150c9 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:38.501043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:38.549620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d2c34-27f6-4dad-83ef-e7f72ebf01dd None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:38.567714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5fcac2-3ef8-4491-94e5-c42f988150c9 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:38.590197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7c6ca-aa94-4c93-93da-4c3e4c293da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:38.591078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c6ca-aa94-4c93-93da-4c3e4c293da2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:38.591193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c6ca-aa94-4c93-93da-4c3e4c293da2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:38.591393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c6ca-aa94-4c93-93da-4c3e4c293da2 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:38.592095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7c6ca-aa94-4c93-93da-4c3e4c293da2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:38.592406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7c6ca-aa94-4c93-93da-4c3e4c293da2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:38.593771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7c6ca-aa94-4c93-93da-4c3e4c293da2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:38.607545 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 230/467] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:38.608615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a3d6-d6ca-4a44-bfb6-28243ea9fdee None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:38.608895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a3d6-d6ca-4a44-bfb6-28243ea9fdee None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:38.609171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1a3d6-d6ca-4a44-bfb6-28243ea9fdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:38.609751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62925653-2dd7-4a9d-b31b-ee8d458d0327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:38.610359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62925653-2dd7-4a9d-b31b-ee8d458d0327 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:38.610664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62925653-2dd7-4a9d-b31b-ee8d458d0327 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:38.610966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62925653-2dd7-4a9d-b31b-ee8d458d0327 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:38.611744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62925653-2dd7-4a9d-b31b-ee8d458d0327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:38.612887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62925653-2dd7-4a9d-b31b-ee8d458d0327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:38.614053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62925653-2dd7-4a9d-b31b-ee8d458d0327 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:38.626794 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 238/468] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:38.628823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-dfe1a3d6-d6ca-4a44-bfb6-28243ea9fdee None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:38.630018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dfe1a3d6-d6ca-4a44-bfb6-28243ea9fdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:38.632160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62925653-2dd7-4a9d-b31b-ee8d458d0327 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:38.659795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:38.706734 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 231/469] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:38.707433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1a3d6-d6ca-4a44-bfb6-28243ea9fdee None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:38.755911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62925653-2dd7-4a9d-b31b-ee8d458d0327 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:38.759531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:38.794385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c0a7f-098b-4d87-b26a-1422ee9cae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:38.795028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c0a7f-098b-4d87-b26a-1422ee9cae07 None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:38.795309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c0a7f-098b-4d87-b26a-1422ee9cae07 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:38.795642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c0a7f-098b-4d87-b26a-1422ee9cae07 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:38.796284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c0a7f-098b-4d87-b26a-1422ee9cae07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:38.797785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c0a7f-098b-4d87-b26a-1422ee9cae07 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:38.821830 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 239/470] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:36:38 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:38.822886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c0a7f-098b-4d87-b26a-1422ee9cae07 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:38.840779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1a3d6-d6ca-4a44-bfb6-28243ea9fdee None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:38.883893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205d405-86cc-4092-8038-d21bfde83d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:38.884527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205d405-86cc-4092-8038-d21bfde83d99 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:38.884809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205d405-86cc-4092-8038-d21bfde83d99 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:38.885081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205d405-86cc-4092-8038-d21bfde83d99 None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:38.885750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205d405-86cc-4092-8038-d21bfde83d99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:38.887265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205d405-86cc-4092-8038-d21bfde83d99 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:38.917821 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 232/471] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:36:38 2022] POST /identity/v3/users => generated 246 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:38.917821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1906aa-767b-4756-8881-cc0feeedbc43 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:38.917821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1906aa-767b-4756-8881-cc0feeedbc43 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:38.917821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1906aa-767b-4756-8881-cc0feeedbc43 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:38.917821 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 233/472] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:38.944269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152d1c1-b91f-43d5-8ae2-55b47ad101b0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:38.944587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152d1c1-b91f-43d5-8ae2-55b47ad101b0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:38.944806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152d1c1-b91f-43d5-8ae2-55b47ad101b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:38.983015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1152d1c1-b91f-43d5-8ae2-55b47ad101b0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:38.984389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1152d1c1-b91f-43d5-8ae2-55b47ad101b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:38.993138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c0a7f-098b-4d87-b26a-1422ee9cae07 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:39.001456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:39.045262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdf81c-cc45-429a-a42f-3f3207cbf40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:39.046032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdf81c-cc45-429a-a42f-3f3207cbf40e None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:39.046781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdf81c-cc45-429a-a42f-3f3207cbf40e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:39.046781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdf81c-cc45-429a-a42f-3f3207cbf40e None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:39.047272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdf81c-cc45-429a-a42f-3f3207cbf40e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:39.048908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdf81c-cc45-429a-a42f-3f3207cbf40e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:39.079409 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 240/473] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:36:38 2022] POST /identity/v3/users => generated 248 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:39.080138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdf81c-cc45-429a-a42f-3f3207cbf40e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:39.080657 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 234/474] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:39.112444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:39.217157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdf81c-cc45-429a-a42f-3f3207cbf40e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:39.255654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1668c-c598-467d-89ef-52fd5086180a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:39.256301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1668c-c598-467d-89ef-52fd5086180a None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:39.256589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1668c-c598-467d-89ef-52fd5086180a None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:39.256869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1668c-c598-467d-89ef-52fd5086180a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:39.269410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1668c-c598-467d-89ef-52fd5086180a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:39.270994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1668c-c598-467d-89ef-52fd5086180a None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-30d1668c-c598-467d-89ef-52fd5086180a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:39.287261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:39.288186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:39.288999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:39.288999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:39.288999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:39.288999 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 241/475] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:39.294643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152d1c1-b91f-43d5-8ae2-55b47ad101b0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:39.376870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1668c-c598-467d-89ef-52fd5086180a None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:39.420797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152d1c1-b91f-43d5-8ae2-55b47ad101b0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:39.468171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844096b-332d-44cf-a277-a8956d219f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:39.469344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844096b-332d-44cf-a277-a8956d219f3a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:39.469771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844096b-332d-44cf-a277-a8956d219f3a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:39.470214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844096b-332d-44cf-a277-a8956d219f3a None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:39.471651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844096b-332d-44cf-a277-a8956d219f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:39.472495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844096b-332d-44cf-a277-a8956d219f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:39.474114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:39.476111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844096b-332d-44cf-a277-a8956d219f3a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:39.501182 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 235/476] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:39.507522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844096b-332d-44cf-a277-a8956d219f3a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:39.528776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:39.552688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1668c-c598-467d-89ef-52fd5086180a None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:39.651553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0de8d1-826e-4bd5-b67e-c9dfbbdd5951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:39.652096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0de8d1-826e-4bd5-b67e-c9dfbbdd5951 None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:39.652379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0de8d1-826e-4bd5-b67e-c9dfbbdd5951 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:39.652656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0de8d1-826e-4bd5-b67e-c9dfbbdd5951 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:39.653346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0de8d1-826e-4bd5-b67e-c9dfbbdd5951 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:39.654726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0de8d1-826e-4bd5-b67e-c9dfbbdd5951 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:39.660725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844096b-332d-44cf-a277-a8956d219f3a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:39.672897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.sql.core [None req-7e0de8d1-826e-4bd5-b67e-c9dfbbdd5951 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 18:36:39.672897 n-d-854118-7 devstack@keystone.service[88374]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 18:36:39.672897 n-d-854118-7 devstack@keystone.service[88374]: [parameters: {'id': '36fba99afe28449f94e8890bd5a16ddd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 18:36:39.672897 n-d-854118-7 devstack@keystone.service[88374]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88374) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-7e0de8d1-826e-4bd5-b67e-c9dfbbdd5951 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application result.read() Aug 28 18:36:39.689243 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return ref.to_dict() Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:36:39.690354 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application yield resource Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise self.value Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application session.commit() Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 18:36:39.691440 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.session.flush() Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application compat.raise_( Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 18:36:39.692282 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:36:39.693287 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application result.read() Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:36:39.694775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [parameters: {'id': '36fba99afe28449f94e8890bd5a16ddd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:39.696080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 18:36:39.697075 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:39.698110 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 242/477] 10.222.0.70 () {60 vars in 1131 bytes} [Sun Aug 28 18:36:39 2022] POST /identity/v3/roles => generated 144 bytes in 315 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:39.701449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0de8d1-826e-4bd5-b67e-c9dfbbdd5951 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:39.732293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984ac87-b2ca-46a9-9800-6fa260e28fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:39.733098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984ac87-b2ca-46a9-9800-6fa260e28fae None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:39.733475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984ac87-b2ca-46a9-9800-6fa260e28fae None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:39.733865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984ac87-b2ca-46a9-9800-6fa260e28fae None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:39.734684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984ac87-b2ca-46a9-9800-6fa260e28fae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:39.737007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984ac87-b2ca-46a9-9800-6fa260e28fae None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:39.776938 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 236/478] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:36:39 2022] POST /identity/v3/users => generated 249 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:36:39.850034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0de8d1-826e-4bd5-b67e-c9dfbbdd5951 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:39.884939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:39.891252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a65f84-4f32-4057-96f8-549332d540bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:39.891911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a65f84-4f32-4057-96f8-549332d540bc None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:39.892181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a65f84-4f32-4057-96f8-549332d540bc None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:39.892452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a65f84-4f32-4057-96f8-549332d540bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:39.906553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a65f84-4f32-4057-96f8-549332d540bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-e5a65f84-4f32-4057-96f8-549332d540bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:39.914342 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:39.915325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:39.916127 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:39.916127 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:39.916127 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:39.916127 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:39.916127 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:39.916127 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:39.916127 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:39.916127 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:39.916127 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:39.916127 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:39.916127 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 18:36:39.916127 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:39.916127 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 243/479] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:36:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:39.921587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984ac87-b2ca-46a9-9800-6fa260e28fae None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:40.006821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:40.056768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984ac87-b2ca-46a9-9800-6fa260e28fae None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:40.091254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8babe88-7f67-4f26-a791-0f11f51b8129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:40.091857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8babe88-7f67-4f26-a791-0f11f51b8129 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:40.092136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8babe88-7f67-4f26-a791-0f11f51b8129 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:40.092412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8babe88-7f67-4f26-a791-0f11f51b8129 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:40.093071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8babe88-7f67-4f26-a791-0f11f51b8129 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:40.093375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8babe88-7f67-4f26-a791-0f11f51b8129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:40.094751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8babe88-7f67-4f26-a791-0f11f51b8129 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:40.110904 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 237/480] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:41.263588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc43518-4f5b-47c6-b183-5bf4d4426a02 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:41.264098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc43518-4f5b-47c6-b183-5bf4d4426a02 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:41.264098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc43518-4f5b-47c6-b183-5bf4d4426a02 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:41.265661 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 244/481] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:41.271777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6b419-21ba-4955-9145-acd364f533b3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:41.272177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6b419-21ba-4955-9145-acd364f533b3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:41.272365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6b419-21ba-4955-9145-acd364f533b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:41.295959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9ae6b419-21ba-4955-9145-acd364f533b3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:41.297151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9ae6b419-21ba-4955-9145-acd364f533b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:41.392332 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 238/482] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:41.423583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bf82f-54e0-4def-989c-e19e47b648b6 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:41.423583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bf82f-54e0-4def-989c-e19e47b648b6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:41.423583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bf82f-54e0-4def-989c-e19e47b648b6 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:41.428790 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 245/483] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:41.430228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9944e2e-1898-48f9-8d2f-9f404f73bbf2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:41.430517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9944e2e-1898-48f9-8d2f-9f404f73bbf2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:41.430814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9944e2e-1898-48f9-8d2f-9f404f73bbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:41.456129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f9944e2e-1898-48f9-8d2f-9f404f73bbf2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:41.457679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f9944e2e-1898-48f9-8d2f-9f404f73bbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:41.498502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d38d5-ba73-4b8f-8cf3-26ceda9f93d1 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:41.498981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d38d5-ba73-4b8f-8cf3-26ceda9f93d1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:41.499281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d38d5-ba73-4b8f-8cf3-26ceda9f93d1 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:41.502778 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 246/484] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:41.505917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d9e7d-85f7-4cdd-bdaf-a7e7f70ce895 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:41.506198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d9e7d-85f7-4cdd-bdaf-a7e7f70ce895 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:41.506471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d9e7d-85f7-4cdd-bdaf-a7e7f70ce895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:41.526845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7b4d9e7d-85f7-4cdd-bdaf-a7e7f70ce895 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:41.526845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7b4d9e7d-85f7-4cdd-bdaf-a7e7f70ce895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:41.531092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:41.566049 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 239/485] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:41.603826 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 247/486] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:41.858541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9944e2e-1898-48f9-8d2f-9f404f73bbf2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:41.954681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d9e7d-85f7-4cdd-bdaf-a7e7f70ce895 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:41.998839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9944e2e-1898-48f9-8d2f-9f404f73bbf2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.035654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442064f1-8590-48ca-babd-0d29ddf2c115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.036291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442064f1-8590-48ca-babd-0d29ddf2c115 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.036573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442064f1-8590-48ca-babd-0d29ddf2c115 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.036847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442064f1-8590-48ca-babd-0d29ddf2c115 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.047646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442064f1-8590-48ca-babd-0d29ddf2c115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-442064f1-8590-48ca-babd-0d29ddf2c115 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:42.052960 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:42.053830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:42.054627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:42.054627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:42.054627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:42.054627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:42.054627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:42.054627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:42.054627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:42.054627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:42.054627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:42.054627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:42.054627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:42.054627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:42.054627 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 240/487] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:42.055317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442064f1-8590-48ca-babd-0d29ddf2c115 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.074612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d9e7d-85f7-4cdd-bdaf-a7e7f70ce895 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.101397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:42.106673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:42.116943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ad11e-c85d-4b30-8a40-cb2872cd3a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.117986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ad11e-c85d-4b30-8a40-cb2872cd3a8c None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.118400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ad11e-c85d-4b30-8a40-cb2872cd3a8c None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.118839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ad11e-c85d-4b30-8a40-cb2872cd3a8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.130581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ad11e-c85d-4b30-8a40-cb2872cd3a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-1d6ad11e-c85d-4b30-8a40-cb2872cd3a8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:42.135565 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:42.136670 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:42.137648 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:42.137648 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:42.137648 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:42.137648 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:42.137648 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:42.137648 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:42.137648 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:42.137648 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:42.137648 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:42.137648 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:42.137648 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:42.137648 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:42.139903 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 248/488] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:42.140860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ad11e-c85d-4b30-8a40-cb2872cd3a8c None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.172353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442064f1-8590-48ca-babd-0d29ddf2c115 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.209700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369296c-7e21-430c-8ed0-eacd810a4fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.210439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369296c-7e21-430c-8ed0-eacd810a4fe1 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.210856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369296c-7e21-430c-8ed0-eacd810a4fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.211177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369296c-7e21-430c-8ed0-eacd810a4fe1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.223042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369296c-7e21-430c-8ed0-eacd810a4fe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-c369296c-7e21-430c-8ed0-eacd810a4fe1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:42.228086 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:42.229166 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:42.230140 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:42.230140 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:42.230140 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:42.230140 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:42.230140 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:42.230140 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:42.230140 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:42.230140 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:42.230140 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:42.230140 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:42.230140 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:42.230140 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:42.236140 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 241/489] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:42.238042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369296c-7e21-430c-8ed0-eacd810a4fe1 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.260123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ad11e-c85d-4b30-8a40-cb2872cd3a8c None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.297768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab9a25-75ad-43d0-9175-e61bbe69ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.299213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab9a25-75ad-43d0-9175-e61bbe69ccee None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.300278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab9a25-75ad-43d0-9175-e61bbe69ccee None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.300695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab9a25-75ad-43d0-9175-e61bbe69ccee None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.301524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab9a25-75ad-43d0-9175-e61bbe69ccee None admin] RBAC: Adding query filter params (name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:42.301966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab9a25-75ad-43d0-9175-e61bbe69ccee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:42.303484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab9a25-75ad-43d0-9175-e61bbe69ccee None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:42.312400 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 249/490] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:42.318183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab9a25-75ad-43d0-9175-e61bbe69ccee None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.342728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369296c-7e21-430c-8ed0-eacd810a4fe1 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.359294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:42.369249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:42.383862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd317ab-72e5-41d7-871f-ebbd3a5883b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.384860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd317ab-72e5-41d7-871f-ebbd3a5883b7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.385228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd317ab-72e5-41d7-871f-ebbd3a5883b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.385576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd317ab-72e5-41d7-871f-ebbd3a5883b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.386588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd317ab-72e5-41d7-871f-ebbd3a5883b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:42.386999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd317ab-72e5-41d7-871f-ebbd3a5883b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:42.388896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd317ab-72e5-41d7-871f-ebbd3a5883b7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:42.399883 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 242/491] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:42.401008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd317ab-72e5-41d7-871f-ebbd3a5883b7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.432552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab9a25-75ad-43d0-9175-e61bbe69ccee None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.471518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb675080-b5d8-4d88-8578-81fd86d38d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.473033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb675080-b5d8-4d88-8578-81fd86d38d4a None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.473569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb675080-b5d8-4d88-8578-81fd86d38d4a None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.473992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb675080-b5d8-4d88-8578-81fd86d38d4a None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.474837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb675080-b5d8-4d88-8578-81fd86d38d4a None admin] RBAC: Adding query filter params (name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:42.475145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb675080-b5d8-4d88-8578-81fd86d38d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:42.476521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb675080-b5d8-4d88-8578-81fd86d38d4a None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:42.485155 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 250/492] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:42.486183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb675080-b5d8-4d88-8578-81fd86d38d4a None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.530847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd317ab-72e5-41d7-871f-ebbd3a5883b7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.573013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1c3b3-687f-449e-a7cb-8dc96c07d007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.573681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1c3b3-687f-449e-a7cb-8dc96c07d007 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.573962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1c3b3-687f-449e-a7cb-8dc96c07d007 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.574237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1c3b3-687f-449e-a7cb-8dc96c07d007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.588202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1c3b3-687f-449e-a7cb-8dc96c07d007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:42.589685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1c3b3-687f-449e-a7cb-8dc96c07d007 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:42.598109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb675080-b5d8-4d88-8578-81fd86d38d4a None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.605287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-cfa1c3b3-687f-449e-a7cb-8dc96c07d007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:42.606216 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:42.607327 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:42.613707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:42.613707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:42.613707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:42.613707 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 243/493] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:42.613707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c3344-30d8-470e-8936-83b056643899 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.613707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c3344-30d8-470e-8936-83b056643899 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.613707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c3344-30d8-470e-8936-83b056643899 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.613707 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 244/494] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:42.613707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c3344-30d8-470e-8936-83b056643899 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.636737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:42.642678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888a59a-405c-4547-b1d3-e88a0a065b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.643992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888a59a-405c-4547-b1d3-e88a0a065b1b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.644349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888a59a-405c-4547-b1d3-e88a0a065b1b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.644875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888a59a-405c-4547-b1d3-e88a0a065b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.657160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888a59a-405c-4547-b1d3-e88a0a065b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:42.659389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888a59a-405c-4547-b1d3-e88a0a065b1b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-2888a59a-405c-4547-b1d3-e88a0a065b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:42.675248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:42.676138 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:42.676985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:42.676985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:42.676985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:42.676985 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 251/495] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:42.677753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888a59a-405c-4547-b1d3-e88a0a065b1b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.722024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c3344-30d8-470e-8936-83b056643899 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.757780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197364f9-8f82-46f2-a2f4-efda85705f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.758397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197364f9-8f82-46f2-a2f4-efda85705f2c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.758673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197364f9-8f82-46f2-a2f4-efda85705f2c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.758971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197364f9-8f82-46f2-a2f4-efda85705f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.768856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197364f9-8f82-46f2-a2f4-efda85705f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:42.770287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197364f9-8f82-46f2-a2f4-efda85705f2c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:42.778399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888a59a-405c-4547-b1d3-e88a0a065b1b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-197364f9-8f82-46f2-a2f4-efda85705f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:42.784998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:42.785875 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:42.787288 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:42.787288 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:42.787288 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:42.787288 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 245/496] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:42.787634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e4211-a2eb-474f-9e4d-3a33a9d7a804 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.787918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e4211-a2eb-474f-9e4d-3a33a9d7a804 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.788187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e4211-a2eb-474f-9e4d-3a33a9d7a804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.806368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b65e4211-a2eb-474f-9e4d-3a33a9d7a804 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:42.807598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b65e4211-a2eb-474f-9e4d-3a33a9d7a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:42.817054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6176a-96d5-4fde-b08c-35287d0e69e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.817652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6176a-96d5-4fde-b08c-35287d0e69e9 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.817937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6176a-96d5-4fde-b08c-35287d0e69e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.818214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6176a-96d5-4fde-b08c-35287d0e69e9 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.818883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6176a-96d5-4fde-b08c-35287d0e69e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:42.819189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6176a-96d5-4fde-b08c-35287d0e69e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:42.820549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6176a-96d5-4fde-b08c-35287d0e69e9 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:42.832145 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 252/497] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:42.833610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747dbf-57cf-4311-95d9-c3970074b4f7 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.833901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747dbf-57cf-4311-95d9-c3970074b4f7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.834177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747dbf-57cf-4311-95d9-c3970074b4f7 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.835494 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 253/498] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:42.836254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74747dbf-57cf-4311-95d9-c3970074b4f7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.855126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:42.882662 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 246/499] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:42.883535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e4211-a2eb-474f-9e4d-3a33a9d7a804 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:42.885693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:42.953082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74747dbf-57cf-4311-95d9-c3970074b4f7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.989262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e4211-a2eb-474f-9e4d-3a33a9d7a804 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:42.991090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec26b32-7f96-4a9c-9d2f-137f23949817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:42.991709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec26b32-7f96-4a9c-9d2f-137f23949817 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:42.991988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec26b32-7f96-4a9c-9d2f-137f23949817 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:42.992259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec26b32-7f96-4a9c-9d2f-137f23949817 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:42.992899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec26b32-7f96-4a9c-9d2f-137f23949817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:42.993201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec26b32-7f96-4a9c-9d2f-137f23949817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:42.994561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec26b32-7f96-4a9c-9d2f-137f23949817 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.011445 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 254/500] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:43.011445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec26b32-7f96-4a9c-9d2f-137f23949817 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.029890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1a77d-7f84-4d52-b304-298465c1e181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.030516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1a77d-7f84-4d52-b304-298465c1e181 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.030829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1a77d-7f84-4d52-b304-298465c1e181 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.031110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1a77d-7f84-4d52-b304-298465c1e181 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.032176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1a77d-7f84-4d52-b304-298465c1e181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:43.032494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1a77d-7f84-4d52-b304-298465c1e181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.034572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1a77d-7f84-4d52-b304-298465c1e181 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.050963 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 247/501] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:43.050963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfecc2-ff87-4589-b851-bd0c37055684 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.050963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfecc2-ff87-4589-b851-bd0c37055684 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.050963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfecc2-ff87-4589-b851-bd0c37055684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.067438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b1dfecc2-ff87-4589-b851-bd0c37055684 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:43.068627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b1dfecc2-ff87-4589-b851-bd0c37055684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:43.105206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:43.129333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec26b32-7f96-4a9c-9d2f-137f23949817 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.130198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:43.148590 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 248/502] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:43.148590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfecc2-ff87-4589-b851-bd0c37055684 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.179514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0c0ae-8f97-4204-8b1e-01ef3e0902e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.180147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c0ae-8f97-4204-8b1e-01ef3e0902e7 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.180429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c0ae-8f97-4204-8b1e-01ef3e0902e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.180707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c0ae-8f97-4204-8b1e-01ef3e0902e7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.189430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0c0ae-8f97-4204-8b1e-01ef3e0902e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.191029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0c0ae-8f97-4204-8b1e-01ef3e0902e7 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-6ed0c0ae-8f97-4204-8b1e-01ef3e0902e7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:43.204227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:43.205078 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:43.206109 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:43.206109 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:43.206109 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:43.206109 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:43.206109 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:43.206109 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:43.206109 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:43.206109 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:43.206109 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 18:36:43.206109 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:43.206109 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 255/503] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:43.206109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0c0ae-8f97-4204-8b1e-01ef3e0902e7 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.253416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfecc2-ff87-4589-b851-bd0c37055684 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.293003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a092be-37fc-40f8-80bd-b5a146203406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.294373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a092be-37fc-40f8-80bd-b5a146203406 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.295165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a092be-37fc-40f8-80bd-b5a146203406 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.295749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a092be-37fc-40f8-80bd-b5a146203406 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.306087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a092be-37fc-40f8-80bd-b5a146203406 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.308517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a092be-37fc-40f8-80bd-b5a146203406 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-d6a092be-37fc-40f8-80bd-b5a146203406 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:43.324568 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:43.325490 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:43.326380 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:43.326380 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:43.326380 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:43.326380 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:43.326380 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:43.326380 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:43.326380 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:43.326380 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:43.326380 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:36:43.326380 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:43.326380 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 249/504] 10.222.0.70 () {56 vars in 1093 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:43.326934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a092be-37fc-40f8-80bd-b5a146203406 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.333334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0c0ae-8f97-4204-8b1e-01ef3e0902e7 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.379215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b846d0e-6a26-4730-9828-65dda817f836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.379869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b846d0e-6a26-4730-9828-65dda817f836 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.380149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b846d0e-6a26-4730-9828-65dda817f836 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.380425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b846d0e-6a26-4730-9828-65dda817f836 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.388806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b846d0e-6a26-4730-9828-65dda817f836 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.390285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b846d0e-6a26-4730-9828-65dda817f836 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.395244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:43.401599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-7b846d0e-6a26-4730-9828-65dda817f836 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:43.415641 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:43.416857 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:43.417891 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:43.417891 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:43.417891 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:43.417891 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:43.417891 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:43.417891 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:43.417891 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:43.417891 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:43.417891 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:36:43.417891 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:43.418477 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 256/505] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:43.419466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b846d0e-6a26-4730-9828-65dda817f836 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.469384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a092be-37fc-40f8-80bd-b5a146203406 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.504134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed396f5-a18a-42ed-87eb-bee9f285285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.504763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed396f5-a18a-42ed-87eb-bee9f285285c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.505050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed396f5-a18a-42ed-87eb-bee9f285285c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.505327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed396f5-a18a-42ed-87eb-bee9f285285c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.515216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed396f5-a18a-42ed-87eb-bee9f285285c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-4ed396f5-a18a-42ed-87eb-bee9f285285c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:43.521244 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:43.522317 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:43.523416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:43.523416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:43.523416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:43.523416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:43.523416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:43.523416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:43.523416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:43.523416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:43.523416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:43.523416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:43.523416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:43.523416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:43.523416 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 250/506] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:43.524196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed396f5-a18a-42ed-87eb-bee9f285285c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.530272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b846d0e-6a26-4730-9828-65dda817f836 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.567314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a568e-ee8d-4f2e-bbc9-f84a03712f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.567925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a568e-ee8d-4f2e-bbc9-f84a03712f07 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.568209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a568e-ee8d-4f2e-bbc9-f84a03712f07 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.568487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a568e-ee8d-4f2e-bbc9-f84a03712f07 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.569224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a568e-ee8d-4f2e-bbc9-f84a03712f07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:43.569536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a568e-ee8d-4f2e-bbc9-f84a03712f07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.570993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a568e-ee8d-4f2e-bbc9-f84a03712f07 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.607946 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 257/507] 10.222.0.70 () {56 vars in 1137 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:43.608787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a568e-ee8d-4f2e-bbc9-f84a03712f07 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.623321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed396f5-a18a-42ed-87eb-bee9f285285c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.637030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:43.659314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e28197-d3e3-46cf-8070-059637809b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.659911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e28197-d3e3-46cf-8070-059637809b26 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.660183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e28197-d3e3-46cf-8070-059637809b26 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.660454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e28197-d3e3-46cf-8070-059637809b26 None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.661169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e28197-d3e3-46cf-8070-059637809b26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:43.661472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e28197-d3e3-46cf-8070-059637809b26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.662926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e28197-d3e3-46cf-8070-059637809b26 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.667109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:43.699811 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 251/508] 10.222.0.70 () {56 vars in 1133 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:43.700633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e28197-d3e3-46cf-8070-059637809b26 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.717288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a568e-ee8d-4f2e-bbc9-f84a03712f07 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.750700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fa466-4f1b-4f96-a93f-dd06578ac6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.751330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fa466-4f1b-4f96-a93f-dd06578ac6f8 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.751616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fa466-4f1b-4f96-a93f-dd06578ac6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.751888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fa466-4f1b-4f96-a93f-dd06578ac6f8 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.753365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fa466-4f1b-4f96-a93f-dd06578ac6f8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:43.753747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fa466-4f1b-4f96-a93f-dd06578ac6f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.755846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fa466-4f1b-4f96-a93f-dd06578ac6f8 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.772992 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 258/509] 10.222.0.70 () {56 vars in 1137 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:43.773789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fa466-4f1b-4f96-a93f-dd06578ac6f8 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.809339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e28197-d3e3-46cf-8070-059637809b26 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.845024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7602-bc71-4666-b4c5-ecd3e86fc43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.845675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7602-bc71-4666-b4c5-ecd3e86fc43e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.846096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7602-bc71-4666-b4c5-ecd3e86fc43e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.846463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7602-bc71-4666-b4c5-ecd3e86fc43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.857173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d7602-bc71-4666-b4c5-ecd3e86fc43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.858634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d7602-bc71-4666-b4c5-ecd3e86fc43e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-e47d7602-bc71-4666-b4c5-ecd3e86fc43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:43.872662 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:43.873672 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:43.875685 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:43.875685 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:43.875685 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:43.875844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fa466-4f1b-4f96-a93f-dd06578ac6f8 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:43.875922 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 252/510] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:43.875922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7602-bc71-4666-b4c5-ecd3e86fc43e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.890234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:43.900111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:43.912219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf78ecb-3817-4525-a577-e42b2aa57206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:43.912826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf78ecb-3817-4525-a577-e42b2aa57206 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:43.913112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf78ecb-3817-4525-a577-e42b2aa57206 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:43.913388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf78ecb-3817-4525-a577-e42b2aa57206 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:43.914052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf78ecb-3817-4525-a577-e42b2aa57206 None admin] RBAC: Adding query filter params (name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:43.914361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf78ecb-3817-4525-a577-e42b2aa57206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:43.915778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf78ecb-3817-4525-a577-e42b2aa57206 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:43.923593 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 259/511] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:43.924450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf78ecb-3817-4525-a577-e42b2aa57206 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:43.982482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7602-bc71-4666-b4c5-ecd3e86fc43e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.015655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8716c-fe62-4dbb-bfb9-e044635472fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.016184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8716c-fe62-4dbb-bfb9-e044635472fb None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.016464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8716c-fe62-4dbb-bfb9-e044635472fb None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.016733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8716c-fe62-4dbb-bfb9-e044635472fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.024051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf78ecb-3817-4525-a577-e42b2aa57206 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.057725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d7de4-bd53-46c9-81dc-6fe7908e0cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.058588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d7de4-bd53-46c9-81dc-6fe7908e0cb6 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.058902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d7de4-bd53-46c9-81dc-6fe7908e0cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.059187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d7de4-bd53-46c9-81dc-6fe7908e0cb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.083240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8716c-fe62-4dbb-bfb9-e044635472fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.084687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8716c-fe62-4dbb-bfb9-e044635472fb None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:44.105563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:44.107347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:44.128739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d7de4-bd53-46c9-81dc-6fe7908e0cb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.130206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d7de4-bd53-46c9-81dc-6fe7908e0cb6 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:44.182162 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 253/512] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:44.183412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8716c-fe62-4dbb-bfb9-e044635472fb None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:44.235918 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 260/513] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:44.236795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d7de4-bd53-46c9-81dc-6fe7908e0cb6 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:44.281626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8716c-fe62-4dbb-bfb9-e044635472fb None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.304875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:44.315243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:44.317133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd11a-dc9e-4355-9d33-1ef5cfbde590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.317771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd11a-dc9e-4355-9d33-1ef5cfbde590 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.318054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd11a-dc9e-4355-9d33-1ef5cfbde590 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.318326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd11a-dc9e-4355-9d33-1ef5cfbde590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.339163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d7de4-bd53-46c9-81dc-6fe7908e0cb6 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.373265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642d0de-d25b-4dc3-8bdd-290f3fb5f18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.373869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642d0de-d25b-4dc3-8bdd-290f3fb5f18b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.374149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642d0de-d25b-4dc3-8bdd-290f3fb5f18b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.374421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642d0de-d25b-4dc3-8bdd-290f3fb5f18b None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.375092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642d0de-d25b-4dc3-8bdd-290f3fb5f18b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:44.375393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642d0de-d25b-4dc3-8bdd-290f3fb5f18b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.376760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642d0de-d25b-4dc3-8bdd-290f3fb5f18b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:44.385558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbd11a-dc9e-4355-9d33-1ef5cfbde590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.387109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbd11a-dc9e-4355-9d33-1ef5cfbde590 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:44.388457 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 261/514] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:44.389272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642d0de-d25b-4dc3-8bdd-290f3fb5f18b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:44.486293 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 254/515] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:44.487221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd11a-dc9e-4355-9d33-1ef5cfbde590 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:44.490017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642d0de-d25b-4dc3-8bdd-290f3fb5f18b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.511953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:44.526408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb585e75-55a5-4f42-a0fe-de03f2016e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.527068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb585e75-55a5-4f42-a0fe-de03f2016e4f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.527349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb585e75-55a5-4f42-a0fe-de03f2016e4f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.527623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb585e75-55a5-4f42-a0fe-de03f2016e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.530547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:44.539213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb585e75-55a5-4f42-a0fe-de03f2016e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.540600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb585e75-55a5-4f42-a0fe-de03f2016e4f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-fb585e75-55a5-4f42-a0fe-de03f2016e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:44.554462 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:44.555417 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:44.556247 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:44.556247 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:44.556247 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:44.556247 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 262/516] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:44.556466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb585e75-55a5-4f42-a0fe-de03f2016e4f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:44.596261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd11a-dc9e-4355-9d33-1ef5cfbde590 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.629640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecfc8d-a650-471c-a891-ed1ffb4f995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.630267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecfc8d-a650-471c-a891-ed1ffb4f995a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.630547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecfc8d-a650-471c-a891-ed1ffb4f995a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.630853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecfc8d-a650-471c-a891-ed1ffb4f995a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.640657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecfc8d-a650-471c-a891-ed1ffb4f995a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.642187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecfc8d-a650-471c-a891-ed1ffb4f995a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-99ecfc8d-a650-471c-a891-ed1ffb4f995a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:44.657256 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:44.658151 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:44.659154 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:44.659154 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:44.659154 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:44.659807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb585e75-55a5-4f42-a0fe-de03f2016e4f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.659906 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 255/517] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:44.659906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecfc8d-a650-471c-a891-ed1ffb4f995a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:44.693223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050a40c-820d-4283-8689-4e1763c4bc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.693840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050a40c-820d-4283-8689-4e1763c4bc01 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.694120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050a40c-820d-4283-8689-4e1763c4bc01 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.694392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050a40c-820d-4283-8689-4e1763c4bc01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.704574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050a40c-820d-4283-8689-4e1763c4bc01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.706659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050a40c-820d-4283-8689-4e1763c4bc01 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-5050a40c-820d-4283-8689-4e1763c4bc01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:44.720526 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:44.721604 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:44.722432 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:44.722432 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:44.722432 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:44.722432 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 263/518] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:44.727155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050a40c-820d-4283-8689-4e1763c4bc01 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:44.735000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:44.760891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecfc8d-a650-471c-a891-ed1ffb4f995a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.768904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:44.794481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a80db-cf75-40e8-ae0e-b4aa16734eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.795114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a80db-cf75-40e8-ae0e-b4aa16734eae None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.795398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a80db-cf75-40e8-ae0e-b4aa16734eae None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.795671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a80db-cf75-40e8-ae0e-b4aa16734eae None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.796311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a80db-cf75-40e8-ae0e-b4aa16734eae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.797802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a80db-cf75-40e8-ae0e-b4aa16734eae None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:44.819361 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 256/519] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:36:44 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:36:44.820167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a80db-cf75-40e8-ae0e-b4aa16734eae None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:44.839203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050a40c-820d-4283-8689-4e1763c4bc01 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.882081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c9df0-4f8a-40f2-84bf-963639295561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.882795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c9df0-4f8a-40f2-84bf-963639295561 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.883055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c9df0-4f8a-40f2-84bf-963639295561 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.883333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c9df0-4f8a-40f2-84bf-963639295561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.896196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c9df0-4f8a-40f2-84bf-963639295561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.897721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c9df0-4f8a-40f2-84bf-963639295561 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-2d4c9df0-4f8a-40f2-84bf-963639295561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:44.915281 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:44.916248 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:44.917667 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:44.917667 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:44.917667 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:44.917667 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 264/520] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:44.918062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c9df0-4f8a-40f2-84bf-963639295561 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:44.940416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a80db-cf75-40e8-ae0e-b4aa16734eae None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:44.976614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:44.984662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a4008-eb07-4ed9-a373-4e45d3dfeacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:44.985272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a4008-eb07-4ed9-a373-4e45d3dfeacf None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:44.985554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a4008-eb07-4ed9-a373-4e45d3dfeacf None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:44.985824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a4008-eb07-4ed9-a373-4e45d3dfeacf None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:44.986493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a4008-eb07-4ed9-a373-4e45d3dfeacf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:44.987029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a4008-eb07-4ed9-a373-4e45d3dfeacf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:44.988405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a4008-eb07-4ed9-a373-4e45d3dfeacf None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.004357 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 257/521] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:45.005346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a4008-eb07-4ed9-a373-4e45d3dfeacf None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.037808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:45.049300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c9df0-4f8a-40f2-84bf-963639295561 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.086820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e00a6-b4b1-4bda-a2b9-9c5c77fefd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.087595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e00a6-b4b1-4bda-a2b9-9c5c77fefd78 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.087980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e00a6-b4b1-4bda-a2b9-9c5c77fefd78 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.088358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e00a6-b4b1-4bda-a2b9-9c5c77fefd78 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.089115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e00a6-b4b1-4bda-a2b9-9c5c77fefd78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:45.089525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e00a6-b4b1-4bda-a2b9-9c5c77fefd78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.091024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e00a6-b4b1-4bda-a2b9-9c5c77fefd78 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.103824 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 265/522] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:45.104728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e00a6-b4b1-4bda-a2b9-9c5c77fefd78 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.121680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a4008-eb07-4ed9-a373-4e45d3dfeacf None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.159709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031597e3-a024-427a-b005-36d6c2114889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.160386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031597e3-a024-427a-b005-36d6c2114889 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.160666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031597e3-a024-427a-b005-36d6c2114889 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.160939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031597e3-a024-427a-b005-36d6c2114889 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.161614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031597e3-a024-427a-b005-36d6c2114889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:45.161920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031597e3-a024-427a-b005-36d6c2114889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.163323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031597e3-a024-427a-b005-36d6c2114889 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.175408 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 258/523] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:45.176296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031597e3-a024-427a-b005-36d6c2114889 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.216077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e00a6-b4b1-4bda-a2b9-9c5c77fefd78 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.231937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:45.252899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213dbe4-a9d2-45f4-8893-885f5e8348ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.253500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213dbe4-a9d2-45f4-8893-885f5e8348ee None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.253778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213dbe4-a9d2-45f4-8893-885f5e8348ee None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.254050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213dbe4-a9d2-45f4-8893-885f5e8348ee None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.254694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213dbe4-a9d2-45f4-8893-885f5e8348ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:45.255066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213dbe4-a9d2-45f4-8893-885f5e8348ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.256430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213dbe4-a9d2-45f4-8893-885f5e8348ee None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.272377 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 266/524] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:45.272377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213dbe4-a9d2-45f4-8893-885f5e8348ee None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.287293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:45.294140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031597e3-a024-427a-b005-36d6c2114889 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.332743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eb0fc-9da0-4049-9fd5-e44312ccd906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.333300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eb0fc-9da0-4049-9fd5-e44312ccd906 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.333584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eb0fc-9da0-4049-9fd5-e44312ccd906 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.333892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795eb0fc-9da0-4049-9fd5-e44312ccd906 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.342295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795eb0fc-9da0-4049-9fd5-e44312ccd906 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.343831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795eb0fc-9da0-4049-9fd5-e44312ccd906 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-795eb0fc-9da0-4049-9fd5-e44312ccd906 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:45.355967 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:45.356890 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:45.357746 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:45.357746 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:45.357746 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:45.357746 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:45.357746 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:45.357746 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:45.357746 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:45.357746 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:45.357746 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 18:36:45.357746 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:45.357746 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 259/525] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:45.358294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eb0fc-9da0-4049-9fd5-e44312ccd906 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.384127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213dbe4-a9d2-45f4-8893-885f5e8348ee None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.429708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c3a41-f34c-4989-8280-15c111867efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.430347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c3a41-f34c-4989-8280-15c111867efe None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.430634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c3a41-f34c-4989-8280-15c111867efe None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.430945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c3a41-f34c-4989-8280-15c111867efe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.438154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c3a41-f34c-4989-8280-15c111867efe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.439755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c3a41-f34c-4989-8280-15c111867efe None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-e30c3a41-f34c-4989-8280-15c111867efe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:36:45.452642 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:45.453595 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:45.454445 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:36:45.454445 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:36:45.454445 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:36:45.454445 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:36:45.454445 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:36:45.454445 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:36:45.454445 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:45.454445 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:45.458714 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 267/526] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:45.459567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c3a41-f34c-4989-8280-15c111867efe None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.478002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795eb0fc-9da0-4049-9fd5-e44312ccd906 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.490019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:45.518592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c073c-44dc-47df-976d-79379fa46d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.519401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c073c-44dc-47df-976d-79379fa46d5d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.519679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c073c-44dc-47df-976d-79379fa46d5d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.519968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c073c-44dc-47df-976d-79379fa46d5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.526778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c073c-44dc-47df-976d-79379fa46d5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.528720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c073c-44dc-47df-976d-79379fa46d5d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.537341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-c38c073c-44dc-47df-976d-79379fa46d5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:36:45.541649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:45.542465 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:45.543402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:36:45.543402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:36:45.543402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:36:45.543402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:36:45.543402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:36:45.543402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:36:45.543402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:45.543402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:45.543402 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 260/527] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:45.543849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c073c-44dc-47df-976d-79379fa46d5d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.577343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c3a41-f34c-4989-8280-15c111867efe None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.613598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f2c45-0e75-4a5b-b97d-f258756f3f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.614149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f2c45-0e75-4a5b-b97d-f258756f3f76 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.614427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f2c45-0e75-4a5b-b97d-f258756f3f76 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.614699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f2c45-0e75-4a5b-b97d-f258756f3f76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.621326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f2c45-0e75-4a5b-b97d-f258756f3f76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.622806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f2c45-0e75-4a5b-b97d-f258756f3f76 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-d04f2c45-0e75-4a5b-b97d-f258756f3f76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:36:45.633974 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:45.634848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:45.635698 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:36:45.635698 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:36:45.635698 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:36:45.635698 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:36:45.635698 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:36:45.635698 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:36:45.635698 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:45.635698 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:45.635698 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 268/528] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:45.636190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f2c45-0e75-4a5b-b97d-f258756f3f76 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.660241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c073c-44dc-47df-976d-79379fa46d5d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.695461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923decd-2b94-495f-aa00-0e8a3336eccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.696067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923decd-2b94-495f-aa00-0e8a3336eccf None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.696349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923decd-2b94-495f-aa00-0e8a3336eccf None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.696624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923decd-2b94-495f-aa00-0e8a3336eccf None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.697346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923decd-2b94-495f-aa00-0e8a3336eccf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:45.697648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923decd-2b94-495f-aa00-0e8a3336eccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.699105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923decd-2b94-495f-aa00-0e8a3336eccf None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.724108 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 261/529] 10.222.0.70 () {56 vars in 1139 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:45.724108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923decd-2b94-495f-aa00-0e8a3336eccf None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.741666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f2c45-0e75-4a5b-b97d-f258756f3f76 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.754662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:45.772248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:45.779776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac9c13-5252-4078-b484-f3a8c66691c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.780537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac9c13-5252-4078-b484-f3a8c66691c0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.780822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac9c13-5252-4078-b484-f3a8c66691c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.781098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac9c13-5252-4078-b484-f3a8c66691c0 None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.781795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac9c13-5252-4078-b484-f3a8c66691c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:45.782102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac9c13-5252-4078-b484-f3a8c66691c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.784250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac9c13-5252-4078-b484-f3a8c66691c0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.802680 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 269/530] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:45.804068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac9c13-5252-4078-b484-f3a8c66691c0 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.837266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923decd-2b94-495f-aa00-0e8a3336eccf None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.875832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa12929-8d69-40b5-a35d-1c972f769c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.876348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa12929-8d69-40b5-a35d-1c972f769c87 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.876629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa12929-8d69-40b5-a35d-1c972f769c87 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.876901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa12929-8d69-40b5-a35d-1c972f769c87 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.878218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa12929-8d69-40b5-a35d-1c972f769c87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:45.878521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa12929-8d69-40b5-a35d-1c972f769c87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.879979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa12929-8d69-40b5-a35d-1c972f769c87 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.903050 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 262/531] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:45.903050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa12929-8d69-40b5-a35d-1c972f769c87 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:45.928195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac9c13-5252-4078-b484-f3a8c66691c0 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:45.970649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2114464-6087-4fdb-b027-48a89f34e8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:45.972542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114464-6087-4fdb-b027-48a89f34e8bc None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:45.972876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114464-6087-4fdb-b027-48a89f34e8bc None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:45.973305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114464-6087-4fdb-b027-48a89f34e8bc None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:45.974017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2114464-6087-4fdb-b027-48a89f34e8bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:45.974328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2114464-6087-4fdb-b027-48a89f34e8bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:45.975803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2114464-6087-4fdb-b027-48a89f34e8bc None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:45.988224 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 270/532] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:45.989018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2114464-6087-4fdb-b027-48a89f34e8bc None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:46.001468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:46.015490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa12929-8d69-40b5-a35d-1c972f769c87 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:46.046042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:46.054938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93096fd9-8ee6-4b11-aa17-6347f5a4a145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:46.055524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93096fd9-8ee6-4b11-aa17-6347f5a4a145 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.055805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93096fd9-8ee6-4b11-aa17-6347f5a4a145 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.056075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93096fd9-8ee6-4b11-aa17-6347f5a4a145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.096875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2114464-6087-4fdb-b027-48a89f34e8bc None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:46.131130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93096fd9-8ee6-4b11-aa17-6347f5a4a145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:46.133080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93096fd9-8ee6-4b11-aa17-6347f5a4a145 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:46.133218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5172ba6-99e6-4d8a-ba28-34591b9d1db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:46.133717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5172ba6-99e6-4d8a-ba28-34591b9d1db0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.134000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5172ba6-99e6-4d8a-ba28-34591b9d1db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.134274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5172ba6-99e6-4d8a-ba28-34591b9d1db0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.135020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5172ba6-99e6-4d8a-ba28-34591b9d1db0 None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=332144d9eb5742498c0c37a70277ce5e) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:46.135332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5172ba6-99e6-4d8a-ba28-34591b9d1db0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:46.136814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5172ba6-99e6-4d8a-ba28-34591b9d1db0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:46.142156 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 271/533] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/role_assignments?user.id=332144d9eb5742498c0c37a70277ce5e&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:46.143024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5172ba6-99e6-4d8a-ba28-34591b9d1db0 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:46.274329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5172ba6-99e6-4d8a-ba28-34591b9d1db0 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:46.275878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:46.300467 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 263/534] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:46.301697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93096fd9-8ee6-4b11-aa17-6347f5a4a145 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:46.302305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:46.323719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56cbec-4846-46db-9a0d-b7842c224263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:46.324341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56cbec-4846-46db-9a0d-b7842c224263 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.324628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56cbec-4846-46db-9a0d-b7842c224263 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.324911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56cbec-4846-46db-9a0d-b7842c224263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.325682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56cbec-4846-46db-9a0d-b7842c224263 None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=ea8cbbc34aab42a4ada9cbee1772847b) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:46.326511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56cbec-4846-46db-9a0d-b7842c224263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:46.328306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56cbec-4846-46db-9a0d-b7842c224263 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:46.337193 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 272/535] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:46 2022] GET /identity/v3/role_assignments?user.id=ea8cbbc34aab42a4ada9cbee1772847b&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:46.338144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56cbec-4846-46db-9a0d-b7842c224263 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:46.490188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93096fd9-8ee6-4b11-aa17-6347f5a4a145 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:46.512322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56cbec-4846-46db-9a0d-b7842c224263 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:46.536679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365d1d7-a419-46d7-853d-5101005a3c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:46.537758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365d1d7-a419-46d7-853d-5101005a3c1f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.538330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365d1d7-a419-46d7-853d-5101005a3c1f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.539833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365d1d7-a419-46d7-853d-5101005a3c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.540864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365d1d7-a419-46d7-853d-5101005a3c1f None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=afece3fa01d040a1ae8e035ea3ff3219) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:46.541490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365d1d7-a419-46d7-853d-5101005a3c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:46.543295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365d1d7-a419-46d7-853d-5101005a3c1f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:46.550553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9532f-e9e0-4c71-8ce2-a34a7bd52a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:46.551090 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 264/536] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:46 2022] GET /identity/v3/role_assignments?user.id=afece3fa01d040a1ae8e035ea3ff3219&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:46.552077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9532f-e9e0-4c71-8ce2-a34a7bd52a18 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.552077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9532f-e9e0-4c71-8ce2-a34a7bd52a18 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.552077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9532f-e9e0-4c71-8ce2-a34a7bd52a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.573092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9532f-e9e0-4c71-8ce2-a34a7bd52a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:46.574596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9532f-e9e0-4c71-8ce2-a34a7bd52a18 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-6ce9532f-e9e0-4c71-8ce2-a34a7bd52a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:46.594194 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:46.595105 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:46.596499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:46.596499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:46.596499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:46.596499 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 273/537] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:46.601881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365d1d7-a419-46d7-853d-5101005a3c1f None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:46.699772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:46.750813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365d1d7-a419-46d7-853d-5101005a3c1f None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:46.788917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b7819-f0c2-478f-8342-7a820de9c3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:46.789536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b7819-f0c2-478f-8342-7a820de9c3aa None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.789817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b7819-f0c2-478f-8342-7a820de9c3aa None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.790090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b7819-f0c2-478f-8342-7a820de9c3aa None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.790735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b7819-f0c2-478f-8342-7a820de9c3aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:46.791062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b7819-f0c2-478f-8342-7a820de9c3aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:46.792450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b7819-f0c2-478f-8342-7a820de9c3aa None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:46.812193 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 265/538] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:46.818469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9532f-e9e0-4c71-8ce2-a34a7bd52a18 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:46.858629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:46.891990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d140b5-bf66-4f50-8726-0e03edbfe039 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.892276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d140b5-bf66-4f50-8726-0e03edbfe039 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.892556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d140b5-bf66-4f50-8726-0e03edbfe039 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.894896 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 266/539] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:46.901920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32049cf-ff27-4683-9298-5cca179e12cb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:46.902210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32049cf-ff27-4683-9298-5cca179e12cb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:46.902489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32049cf-ff27-4683-9298-5cca179e12cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:46.930412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b32049cf-ff27-4683-9298-5cca179e12cb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:46.932639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b32049cf-ff27-4683-9298-5cca179e12cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:46.986075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9532f-e9e0-4c71-8ce2-a34a7bd52a18 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:47.039576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2980f27-4bb6-4f43-8b64-07f0951f5256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:47.040138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2980f27-4bb6-4f43-8b64-07f0951f5256 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:47.040422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2980f27-4bb6-4f43-8b64-07f0951f5256 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:47.040699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2980f27-4bb6-4f43-8b64-07f0951f5256 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:47.058922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2980f27-4bb6-4f43-8b64-07f0951f5256 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:47.060384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2980f27-4bb6-4f43-8b64-07f0951f5256 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:47.072576 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 267/540] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-d2980f27-4bb6-4f43-8b64-07f0951f5256 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:36:47.080039 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:47.080996 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:47.082322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:36:47.082322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:36:47.082322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:36:47.082322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:36:47.082322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:36:47.082322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:36:47.082322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:47.082322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:47.082322 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 274/541] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:47.087412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32049cf-ff27-4683-9298-5cca179e12cb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:47.139832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:47.194965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32049cf-ff27-4683-9298-5cca179e12cb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:47.230913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddd229-15db-4f14-a907-44e3e98da07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:47.231522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddd229-15db-4f14-a907-44e3e98da07f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:47.231806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddd229-15db-4f14-a907-44e3e98da07f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:47.232079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddd229-15db-4f14-a907-44e3e98da07f None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:47.232768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddd229-15db-4f14-a907-44e3e98da07f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:47.233076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddd229-15db-4f14-a907-44e3e98da07f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:47.234510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddd229-15db-4f14-a907-44e3e98da07f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:47.247312 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 268/542] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:36:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:47.253928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2980f27-4bb6-4f43-8b64-07f0951f5256 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:47.352181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:47.368151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2980f27-4bb6-4f43-8b64-07f0951f5256 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:47.414192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244eda2-5aa8-41d6-939e-c56169c7e5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:47.414822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244eda2-5aa8-41d6-939e-c56169c7e5ab None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:47.415171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244eda2-5aa8-41d6-939e-c56169c7e5ab None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:47.415452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244eda2-5aa8-41d6-939e-c56169c7e5ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:47.416527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244eda2-5aa8-41d6-939e-c56169c7e5ab None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=02ed42702778456ab336afdd250a1d41) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:47.417071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244eda2-5aa8-41d6-939e-c56169c7e5ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:47.419784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244eda2-5aa8-41d6-939e-c56169c7e5ab None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:47.423914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddd229-15db-4f14-a907-44e3e98da07f None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:47.431695 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 275/543] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:47 2022] GET /identity/v3/role_assignments?user.id=02ed42702778456ab336afdd250a1d41&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:47.632644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddd229-15db-4f14-a907-44e3e98da07f None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:47.635084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:47.685481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd9da8-b06a-4591-9342-4dcc7db07f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:47.686183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd9da8-b06a-4591-9342-4dcc7db07f09 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:47.686470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd9da8-b06a-4591-9342-4dcc7db07f09 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:47.686761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd9da8-b06a-4591-9342-4dcc7db07f09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:47.698733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd9da8-b06a-4591-9342-4dcc7db07f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-f0dd9da8-b06a-4591-9342-4dcc7db07f09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:47.704581 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:47.706302 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:47.707320 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:47.707320 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:47.707320 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:47.707320 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:47.707320 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:47.707320 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:47.707320 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:47.707320 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:47.707320 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:47.707320 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:47.707320 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:47.707320 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:47.707320 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 269/544] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:47.712658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244eda2-5aa8-41d6-939e-c56169c7e5ab None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:47.838449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244eda2-5aa8-41d6-939e-c56169c7e5ab None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:47.884837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9209124-f2b7-422b-9798-2a8213d5c6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:47.885366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9209124-f2b7-422b-9798-2a8213d5c6d9 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:47.885647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9209124-f2b7-422b-9798-2a8213d5c6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:47.885922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9209124-f2b7-422b-9798-2a8213d5c6d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:47.886591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9209124-f2b7-422b-9798-2a8213d5c6d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:47.886929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9209124-f2b7-422b-9798-2a8213d5c6d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:47.888296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9209124-f2b7-422b-9798-2a8213d5c6d9 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:47.902032 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 276/545] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:47.911857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd9da8-b06a-4591-9342-4dcc7db07f09 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:48.046384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd9da8-b06a-4591-9342-4dcc7db07f09 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:48.096983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10e6c0-fa78-455b-91dc-d7dd681471e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:48.097761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10e6c0-fa78-455b-91dc-d7dd681471e7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:48.098043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10e6c0-fa78-455b-91dc-d7dd681471e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:48.098308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10e6c0-fa78-455b-91dc-d7dd681471e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:48.112767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10e6c0-fa78-455b-91dc-d7dd681471e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:48.114212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10e6c0-fa78-455b-91dc-d7dd681471e7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-4a10e6c0-fa78-455b-91dc-d7dd681471e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:48.133688 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:48.134604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:48.135570 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:48.135570 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:48.135570 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:48.135570 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 270/546] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:48.140845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9209124-f2b7-422b-9798-2a8213d5c6d9 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:48.166226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:48.280471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9209124-f2b7-422b-9798-2a8213d5c6d9 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:48.333427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b73670-2019-46e4-a302-c6175ca9a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:48.334051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b73670-2019-46e4-a302-c6175ca9a934 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:48.334333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b73670-2019-46e4-a302-c6175ca9a934 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:48.334641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b73670-2019-46e4-a302-c6175ca9a934 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:48.335296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b73670-2019-46e4-a302-c6175ca9a934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:48.335595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b73670-2019-46e4-a302-c6175ca9a934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:48.336974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b73670-2019-46e4-a302-c6175ca9a934 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:48.355948 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 277/547] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:48.361412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10e6c0-fa78-455b-91dc-d7dd681471e7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:48.381600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:48.501150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10e6c0-fa78-455b-91dc-d7dd681471e7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:48.549792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52284cd3-b316-479e-9b9b-d90330379299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:48.550424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52284cd3-b316-479e-9b9b-d90330379299 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:48.550703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52284cd3-b316-479e-9b9b-d90330379299 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:48.551018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52284cd3-b316-479e-9b9b-d90330379299 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:48.564729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52284cd3-b316-479e-9b9b-d90330379299 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:48.566190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52284cd3-b316-479e-9b9b-d90330379299 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:48.582489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0695d0-3608-4041-96a0-0d297ad725bf None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:48.582789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0695d0-3608-4041-96a0-0d297ad725bf None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:48.583064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0695d0-3608-4041-96a0-0d297ad725bf None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:48.584540 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 278/548] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-52284cd3-b316-479e-9b9b-d90330379299 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:48.589298 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:48.590648 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:48.591723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:48.591723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:48.591723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:48.591723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:48.591723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:48.591723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:48.591723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:48.591723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:48.591723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:36:48.591723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:48.592223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c5bcb-9670-450e-9a5d-04634495935b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:48.592223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c5bcb-9670-450e-9a5d-04634495935b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:48.592223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c5bcb-9670-450e-9a5d-04634495935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:48.592407 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 271/549] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:36:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:48.596538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52284cd3-b316-479e-9b9b-d90330379299 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:48.625705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2c4c5bcb-9670-450e-9a5d-04634495935b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:48.628638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2c4c5bcb-9670-450e-9a5d-04634495935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:48.753392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:48.770099 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 279/550] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:48.772654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa08ba-cb10-4c74-88d2-3748093c41ec None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:48.773142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa08ba-cb10-4c74-88d2-3748093c41ec None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:48.773613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa08ba-cb10-4c74-88d2-3748093c41ec None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:48.775292 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 280/551] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:48.788192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a62c1-2966-4319-8779-18e7197fa18a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:48.788771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a62c1-2966-4319-8779-18e7197fa18a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:48.789238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a62c1-2966-4319-8779-18e7197fa18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:48.815920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52284cd3-b316-479e-9b9b-d90330379299 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:48.827789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-125a62c1-2966-4319-8779-18e7197fa18a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:48.828996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-125a62c1-2966-4319-8779-18e7197fa18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:48.833037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:48.857219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aafa11-6b74-4f07-98df-12eae3c433b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:48.857834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aafa11-6b74-4f07-98df-12eae3c433b9 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:48.858180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aafa11-6b74-4f07-98df-12eae3c433b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:48.858518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aafa11-6b74-4f07-98df-12eae3c433b9 None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:48.859363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aafa11-6b74-4f07-98df-12eae3c433b9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:48.859678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aafa11-6b74-4f07-98df-12eae3c433b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:48.861154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aafa11-6b74-4f07-98df-12eae3c433b9 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:48.881262 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 272/552] 10.222.0.70 () {56 vars in 1135 bytes} [Sun Aug 28 18:36:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:48.887246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aafa11-6b74-4f07-98df-12eae3c433b9 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:48.944259 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 281/553] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:48.945980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4b101-8827-45d4-87b0-667bd8a7167f None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:48.946360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4b101-8827-45d4-87b0-667bd8a7167f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:48.947041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4b101-8827-45d4-87b0-667bd8a7167f None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:48.948875 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 282/554] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:48.960416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9741d90-7652-4d1c-91fe-f777c346737f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:48.960689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9741d90-7652-4d1c-91fe-f777c346737f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:48.960962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9741d90-7652-4d1c-91fe-f777c346737f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:48.992133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b9741d90-7652-4d1c-91fe-f777c346737f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:48.995090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b9741d90-7652-4d1c-91fe-f777c346737f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:49.067339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aafa11-6b74-4f07-98df-12eae3c433b9 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.101017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:49.106667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168b1df-f232-41d0-9c4a-dea3abaf4de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.107549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168b1df-f232-41d0-9c4a-dea3abaf4de8 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.108000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168b1df-f232-41d0-9c4a-dea3abaf4de8 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.108436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168b1df-f232-41d0-9c4a-dea3abaf4de8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.126883 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 283/555] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:49.127781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9741d90-7652-4d1c-91fe-f777c346737f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.212994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:49.227333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168b1df-f232-41d0-9c4a-dea3abaf4de8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:49.229210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168b1df-f232-41d0-9c4a-dea3abaf4de8 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:49.255922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9741d90-7652-4d1c-91fe-f777c346737f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.293707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab8ac7-f835-4d7e-a8e1-db8be44f0d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.294335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab8ac7-f835-4d7e-a8e1-db8be44f0d81 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.294613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab8ac7-f835-4d7e-a8e1-db8be44f0d81 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.294915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab8ac7-f835-4d7e-a8e1-db8be44f0d81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.306157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab8ac7-f835-4d7e-a8e1-db8be44f0d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-d5ab8ac7-f835-4d7e-a8e1-db8be44f0d81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:49.311264 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:49.312171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:49.312965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:49.312965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:49.312965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:49.312965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:49.312965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:49.312965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:49.312965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:49.312965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:49.312965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:49.312965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:49.312965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:49.312965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:49.312965 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 284/556] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:49.313676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab8ac7-f835-4d7e-a8e1-db8be44f0d81 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.355000 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 273/557] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:49.355613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168b1df-f232-41d0-9c4a-dea3abaf4de8 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.400033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:49.435979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab8ac7-f835-4d7e-a8e1-db8be44f0d81 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.468180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:49.485114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63738e4-7086-4757-a9ce-a6c9530a1c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.485114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63738e4-7086-4757-a9ce-a6c9530a1c4c None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.485431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63738e4-7086-4757-a9ce-a6c9530a1c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.485431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63738e4-7086-4757-a9ce-a6c9530a1c4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.489355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168b1df-f232-41d0-9c4a-dea3abaf4de8 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.511151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63738e4-7086-4757-a9ce-a6c9530a1c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-a63738e4-7086-4757-a9ce-a6c9530a1c4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:49.516501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:49.517362 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:49.518154 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:49.518154 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:49.518154 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:49.518154 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:49.518154 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:49.518154 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:49.518154 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:49.518154 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:49.518154 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:49.518154 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:49.518154 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:49.518154 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:49.518154 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 285/558] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:49.519370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63738e4-7086-4757-a9ce-a6c9530a1c4c None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.546311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274deafa-0638-439e-9f47-392a5b3bd1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.546990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274deafa-0638-439e-9f47-392a5b3bd1a7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.547276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274deafa-0638-439e-9f47-392a5b3bd1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.547822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274deafa-0638-439e-9f47-392a5b3bd1a7 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.548283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274deafa-0638-439e-9f47-392a5b3bd1a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:49.548595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274deafa-0638-439e-9f47-392a5b3bd1a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:49.550972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274deafa-0638-439e-9f47-392a5b3bd1a7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:49.562221 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 274/559] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:49.562221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274deafa-0638-439e-9f47-392a5b3bd1a7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.661716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63738e4-7086-4757-a9ce-a6c9530a1c4c None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.685986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:49.693548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274deafa-0638-439e-9f47-392a5b3bd1a7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.698711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78691193-980f-493d-987f-1ffe8d68955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.699586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78691193-980f-493d-987f-1ffe8d68955c None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.700074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78691193-980f-493d-987f-1ffe8d68955c None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.700544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78691193-980f-493d-987f-1ffe8d68955c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.711904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78691193-980f-493d-987f-1ffe8d68955c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:49.713567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78691193-980f-493d-987f-1ffe8d68955c None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:49.728505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d11e1-904f-4159-bfdf-2d624d79d2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.729115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d11e1-904f-4159-bfdf-2d624d79d2cd None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.729394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d11e1-904f-4159-bfdf-2d624d79d2cd None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.729664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d11e1-904f-4159-bfdf-2d624d79d2cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-78691193-980f-493d-987f-1ffe8d68955c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:49.731945 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:49.733047 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:49.734101 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:49.734101 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:49.734101 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:49.735904 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 286/560] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:49.737967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78691193-980f-493d-987f-1ffe8d68955c None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.746312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d11e1-904f-4159-bfdf-2d624d79d2cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-4a9d11e1-904f-4159-bfdf-2d624d79d2cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:49.751707 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:49.752626 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:49.754129 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:49.754129 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:49.754129 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:49.754129 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:49.754129 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:49.754129 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:49.754129 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:49.754129 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:49.754129 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:49.754129 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:49.754129 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:49.754129 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:49.754129 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 275/561] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:49.754828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d11e1-904f-4159-bfdf-2d624d79d2cd None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.792147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:49.861081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78691193-980f-493d-987f-1ffe8d68955c None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.873777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d11e1-904f-4159-bfdf-2d624d79d2cd None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:49.897293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed1e3f-3b5a-4194-bcc1-6ec1383845aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.897900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed1e3f-3b5a-4194-bcc1-6ec1383845aa None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.898180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed1e3f-3b5a-4194-bcc1-6ec1383845aa None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.898442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed1e3f-3b5a-4194-bcc1-6ec1383845aa None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.899128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed1e3f-3b5a-4194-bcc1-6ec1383845aa None admin] RBAC: Adding query filter params (name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:49.899429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed1e3f-3b5a-4194-bcc1-6ec1383845aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:49.900785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed1e3f-3b5a-4194-bcc1-6ec1383845aa None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:49.913751 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 287/562] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:49.913751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed1e3f-3b5a-4194-bcc1-6ec1383845aa None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.915939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820eaf8-afb7-4f95-803b-369e93556279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:49.916586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820eaf8-afb7-4f95-803b-369e93556279 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:49.916871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820eaf8-afb7-4f95-803b-369e93556279 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:49.917146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820eaf8-afb7-4f95-803b-369e93556279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:49.929017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820eaf8-afb7-4f95-803b-369e93556279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:49.930450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820eaf8-afb7-4f95-803b-369e93556279 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-c820eaf8-afb7-4f95-803b-369e93556279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:49.945174 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:49.946070 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:49.946968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:49.946968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:49.946968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:49.951011 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 276/563] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:49.951716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820eaf8-afb7-4f95-803b-369e93556279 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:49.960580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:50.012276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed1e3f-3b5a-4194-bcc1-6ec1383845aa None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:50.013773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:50.048619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac99e20-60b8-4102-97c0-ca1ca2a2bcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:50.049278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac99e20-60b8-4102-97c0-ca1ca2a2bcef None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.049719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac99e20-60b8-4102-97c0-ca1ca2a2bcef None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.050003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac99e20-60b8-4102-97c0-ca1ca2a2bcef None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.050648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac99e20-60b8-4102-97c0-ca1ca2a2bcef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:50.050977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac99e20-60b8-4102-97c0-ca1ca2a2bcef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:50.052127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820eaf8-afb7-4f95-803b-369e93556279 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:50.052351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac99e20-60b8-4102-97c0-ca1ca2a2bcef None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:50.064340 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 288/564] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:50.065190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac99e20-60b8-4102-97c0-ca1ca2a2bcef None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:50.085875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab55f2-8461-4ff1-88f2-e98b78fb77e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:50.086484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab55f2-8461-4ff1-88f2-e98b78fb77e8 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.086791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab55f2-8461-4ff1-88f2-e98b78fb77e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.087070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab55f2-8461-4ff1-88f2-e98b78fb77e8 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.087725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab55f2-8461-4ff1-88f2-e98b78fb77e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:50.088035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab55f2-8461-4ff1-88f2-e98b78fb77e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:50.089383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab55f2-8461-4ff1-88f2-e98b78fb77e8 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:50.097684 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 277/565] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:50.098850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40013f57-6156-4691-bde5-e6312833584b None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.099138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40013f57-6156-4691-bde5-e6312833584b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.099413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40013f57-6156-4691-bde5-e6312833584b None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.100604 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 278/566] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:50.101291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40013f57-6156-4691-bde5-e6312833584b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:50.168170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:50.169318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac99e20-60b8-4102-97c0-ca1ca2a2bcef None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:50.202658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40013f57-6156-4691-bde5-e6312833584b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:50.204031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2c9b6-99e6-47e4-9035-6bd733fd809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:50.204658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2c9b6-99e6-47e4-9035-6bd733fd809a None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.204943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2c9b6-99e6-47e4-9035-6bd733fd809a None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.205791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2c9b6-99e6-47e4-9035-6bd733fd809a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.215852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2c9b6-99e6-47e4-9035-6bd733fd809a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:50.217301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2c9b6-99e6-47e4-9035-6bd733fd809a None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-01b2c9b6-99e6-47e4-9035-6bd733fd809a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:50.232588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:50.233592 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:50.234627 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:50.234627 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:50.234627 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:50.234627 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 289/567] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:50.234627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2c9b6-99e6-47e4-9035-6bd733fd809a None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:50.238730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49f278-25f1-4f40-aa38-6634486a219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:50.239375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49f278-25f1-4f40-aa38-6634486a219b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.239661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49f278-25f1-4f40-aa38-6634486a219b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.239938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49f278-25f1-4f40-aa38-6634486a219b None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.240580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49f278-25f1-4f40-aa38-6634486a219b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:50.240887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49f278-25f1-4f40-aa38-6634486a219b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:50.242246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49f278-25f1-4f40-aa38-6634486a219b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:50.250891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:50.254492 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 279/568] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:50.255503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49f278-25f1-4f40-aa38-6634486a219b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:50.341257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2c9b6-99e6-47e4-9035-6bd733fd809a None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:50.358473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49f278-25f1-4f40-aa38-6634486a219b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:50.375414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc23054-7c9d-4d42-b5b3-ee555b564f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:50.376035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc23054-7c9d-4d42-b5b3-ee555b564f08 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.376316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc23054-7c9d-4d42-b5b3-ee555b564f08 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.376592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc23054-7c9d-4d42-b5b3-ee555b564f08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.383586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc23054-7c9d-4d42-b5b3-ee555b564f08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:50.385018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc23054-7c9d-4d42-b5b3-ee555b564f08 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:50.385380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:50.393849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c63065-1913-48fd-bf19-541ea3e03eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:50.394466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c63065-1913-48fd-bf19-541ea3e03eb5 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.394777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c63065-1913-48fd-bf19-541ea3e03eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.395049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c63065-1913-48fd-bf19-541ea3e03eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-9fc23054-7c9d-4d42-b5b3-ee555b564f08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:36:50.396401 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:50.397257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:50.398150 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:36:50.398150 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:36:50.398150 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:36:50.398150 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:36:50.398150 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:36:50.398150 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:36:50.398150 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:50.398150 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:50.398150 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 290/569] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:50.399080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f235a-9473-4aed-96d4-80a148aa7261 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.399352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f235a-9473-4aed-96d4-80a148aa7261 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.399627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f235a-9473-4aed-96d4-80a148aa7261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.407475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c63065-1913-48fd-bf19-541ea3e03eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:50.409571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c63065-1913-48fd-bf19-541ea3e03eb5 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:50.418722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ae4f235a-9473-4aed-96d4-80a148aa7261 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:50.419890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ae4f235a-9473-4aed-96d4-80a148aa7261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-01c63065-1913-48fd-bf19-541ea3e03eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:50.423571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:50.425147 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:50.426006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:50.426006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:50.426006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:50.426006 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 280/570] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:50.426225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c63065-1913-48fd-bf19-541ea3e03eb5 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:50.490044 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 291/571] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:50.490981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f235a-9473-4aed-96d4-80a148aa7261 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:50.494846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:50.536133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c63065-1913-48fd-bf19-541ea3e03eb5 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:50.579441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c0d6c-d000-4a78-8aa9-203178939ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:50.580171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c0d6c-d000-4a78-8aa9-203178939ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.581242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c0d6c-d000-4a78-8aa9-203178939ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.581470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c0d6c-d000-4a78-8aa9-203178939ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.582194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c0d6c-d000-4a78-8aa9-203178939ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:50.582506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c0d6c-d000-4a78-8aa9-203178939ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:50.583930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c0d6c-d000-4a78-8aa9-203178939ac9 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:50.598028 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 281/572] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:50.599236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c0d6c-d000-4a78-8aa9-203178939ac9 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:50.610687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f235a-9473-4aed-96d4-80a148aa7261 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:50.644584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:50.652656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b370044-0312-47d3-b90a-44b1a4617593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:50.653388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b370044-0312-47d3-b90a-44b1a4617593 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.653674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b370044-0312-47d3-b90a-44b1a4617593 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.653948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b370044-0312-47d3-b90a-44b1a4617593 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.662087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b370044-0312-47d3-b90a-44b1a4617593 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:50.663678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b370044-0312-47d3-b90a-44b1a4617593 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-9b370044-0312-47d3-b90a-44b1a4617593 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:50.676152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:50.677074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:50.677988 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:50.677988 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:50.677988 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:50.677988 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:50.677988 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:50.677988 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:50.677988 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:50.677988 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:50.677988 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:36:50.677988 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:50.681880 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 292/573] 10.222.0.70 () {56 vars in 1093 bytes} [Sun Aug 28 18:36:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:50.682563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b370044-0312-47d3-b90a-44b1a4617593 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:50.710247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c0d6c-d000-4a78-8aa9-203178939ac9 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:50.747182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:50.748204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741efc7c-4721-4258-a7fc-fcdcf7df34a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:50.748777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741efc7c-4721-4258-a7fc-fcdcf7df34a2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.749081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741efc7c-4721-4258-a7fc-fcdcf7df34a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.749320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741efc7c-4721-4258-a7fc-fcdcf7df34a2 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.750124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741efc7c-4721-4258-a7fc-fcdcf7df34a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:50.750434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741efc7c-4721-4258-a7fc-fcdcf7df34a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:50.753316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741efc7c-4721-4258-a7fc-fcdcf7df34a2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:50.765310 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 282/574] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:50.766120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741efc7c-4721-4258-a7fc-fcdcf7df34a2 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:50.788120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b370044-0312-47d3-b90a-44b1a4617593 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:50.822901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59092c88-52b2-456d-8d62-eb151766bb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:50.823575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59092c88-52b2-456d-8d62-eb151766bb76 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.823843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59092c88-52b2-456d-8d62-eb151766bb76 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.824122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59092c88-52b2-456d-8d62-eb151766bb76 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.824758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59092c88-52b2-456d-8d62-eb151766bb76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:50.825061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59092c88-52b2-456d-8d62-eb151766bb76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:50.826436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59092c88-52b2-456d-8d62-eb151766bb76 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:50.839152 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 293/575] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:50.840123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59092c88-52b2-456d-8d62-eb151766bb76 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:50.862128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:50.865471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741efc7c-4721-4258-a7fc-fcdcf7df34a2 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:50.899730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec1605-ac94-4426-99d0-9923d276a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:50.900669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec1605-ac94-4426-99d0-9923d276a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.900950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec1605-ac94-4426-99d0-9923d276a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.901220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec1605-ac94-4426-99d0-9923d276a4c1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.909276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec1605-ac94-4426-99d0-9923d276a4c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:50.910706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec1605-ac94-4426-99d0-9923d276a4c1 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-7eec1605-ac94-4426-99d0-9923d276a4c1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:50.921623 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:50.922767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:50.923695 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:50.923695 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:50.923695 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:50.923695 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:50.923695 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:50.923695 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:50.923695 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:50.923695 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:50.923695 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 18:36:50.923695 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:50.923695 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 283/576] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:50.923695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec1605-ac94-4426-99d0-9923d276a4c1 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:50.944216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59092c88-52b2-456d-8d62-eb151766bb76 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:50.968172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:50.979867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb27d7-0328-474b-9ee8-1f830a5a4f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:50.980480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb27d7-0328-474b-9ee8-1f830a5a4f10 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:50.980764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb27d7-0328-474b-9ee8-1f830a5a4f10 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:50.981040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb27d7-0328-474b-9ee8-1f830a5a4f10 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:50.981766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb27d7-0328-474b-9ee8-1f830a5a4f10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:50.982073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb27d7-0328-474b-9ee8-1f830a5a4f10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:50.983536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb27d7-0328-474b-9ee8-1f830a5a4f10 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:51.000824 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 294/577] 10.222.0.70 () {56 vars in 1133 bytes} [Sun Aug 28 18:36:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:51.001514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb27d7-0328-474b-9ee8-1f830a5a4f10 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:51.028631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec1605-ac94-4426-99d0-9923d276a4c1 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:51.062169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f6f90-9d1e-4672-8fbe-e9b1f64be09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:51.062821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f6f90-9d1e-4672-8fbe-e9b1f64be09e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:51.063104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f6f90-9d1e-4672-8fbe-e9b1f64be09e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:51.063376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f6f90-9d1e-4672-8fbe-e9b1f64be09e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:51.073499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f6f90-9d1e-4672-8fbe-e9b1f64be09e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-188f6f90-9d1e-4672-8fbe-e9b1f64be09e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:51.078838 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:51.079895 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:51.081484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:51.081484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:51.081484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:51.081484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:51.081484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:51.081484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:51.081484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:51.081484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:51.081484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:51.081484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:51.081484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:51.081484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:51.081484 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 284/578] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:51.083155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f6f90-9d1e-4672-8fbe-e9b1f64be09e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:51.104793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb27d7-0328-474b-9ee8-1f830a5a4f10 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:51.105362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:51.140906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf15ef1-fd12-4b5f-9a7f-0ae5c485d11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:51.141549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15ef1-fd12-4b5f-9a7f-0ae5c485d11a None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:51.141831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15ef1-fd12-4b5f-9a7f-0ae5c485d11a None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:51.142106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15ef1-fd12-4b5f-9a7f-0ae5c485d11a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:51.143586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf15ef1-fd12-4b5f-9a7f-0ae5c485d11a None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=8787e53dd76c430e9ebe69b79b69827e) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:51.143856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf15ef1-fd12-4b5f-9a7f-0ae5c485d11a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:51.145285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf15ef1-fd12-4b5f-9a7f-0ae5c485d11a None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:51.150606 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 295/579] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:51 2022] GET /identity/v3/role_assignments?user.id=8787e53dd76c430e9ebe69b79b69827e&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:51.151416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf15ef1-fd12-4b5f-9a7f-0ae5c485d11a None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:51.188338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f6f90-9d1e-4672-8fbe-e9b1f64be09e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:51.214158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:51.230816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee59f51-cf5f-4cde-9c60-a27d13f09bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:51.231720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee59f51-cf5f-4cde-9c60-a27d13f09bf1 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:51.232193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee59f51-cf5f-4cde-9c60-a27d13f09bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:51.232607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee59f51-cf5f-4cde-9c60-a27d13f09bf1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:51.242462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee59f51-cf5f-4cde-9c60-a27d13f09bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:51.244252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee59f51-cf5f-4cde-9c60-a27d13f09bf1 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-dee59f51-cf5f-4cde-9c60-a27d13f09bf1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:51.257749 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:51.258922 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:51.260112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:51.260112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:51.260112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:51.260112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:51.260112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:51.260112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:51.260112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:51.260112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:51.260112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:36:51.260112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:51.262082 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 285/580] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:51.263230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee59f51-cf5f-4cde-9c60-a27d13f09bf1 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:51.278735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf15ef1-fd12-4b5f-9a7f-0ae5c485d11a None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:51.317072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ed2af-de7e-4dd4-bcc8-57c0e85a9b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:51.318127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ed2af-de7e-4dd4-bcc8-57c0e85a9b2f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:51.318604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ed2af-de7e-4dd4-bcc8-57c0e85a9b2f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:51.318973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ed2af-de7e-4dd4-bcc8-57c0e85a9b2f None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:51.319758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ed2af-de7e-4dd4-bcc8-57c0e85a9b2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:51.320140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ed2af-de7e-4dd4-bcc8-57c0e85a9b2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:51.321620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ed2af-de7e-4dd4-bcc8-57c0e85a9b2f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:51.343842 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 296/581] 10.222.0.70 () {56 vars in 1137 bytes} [Sun Aug 28 18:36:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:51.343842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ed2af-de7e-4dd4-bcc8-57c0e85a9b2f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:51.366576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:51.390529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee59f51-cf5f-4cde-9c60-a27d13f09bf1 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:51.425967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a6780-2286-4296-b178-792885db0e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:51.426851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a6780-2286-4296-b178-792885db0e6b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:51.427123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a6780-2286-4296-b178-792885db0e6b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:51.427396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a6780-2286-4296-b178-792885db0e6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:51.438855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a6780-2286-4296-b178-792885db0e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:51.440901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a6780-2286-4296-b178-792885db0e6b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:51.442399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ed2af-de7e-4dd4-bcc8-57c0e85a9b2f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:51.444760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-a57a6780-2286-4296-b178-792885db0e6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:51.459864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:51.460873 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:51.461776 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:51.461776 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:51.461776 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:51.461776 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 286/582] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:51.461776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a6780-2286-4296-b178-792885db0e6b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:51.486613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edd13d-8993-46b4-9fbb-f620b32d82f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:51.487181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edd13d-8993-46b4-9fbb-f620b32d82f6 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:51.487465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edd13d-8993-46b4-9fbb-f620b32d82f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:51.487803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edd13d-8993-46b4-9fbb-f620b32d82f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:51.488403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edd13d-8993-46b4-9fbb-f620b32d82f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:51.488708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edd13d-8993-46b4-9fbb-f620b32d82f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:51.490138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edd13d-8993-46b4-9fbb-f620b32d82f6 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:51.503527 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 297/583] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:51.503527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edd13d-8993-46b4-9fbb-f620b32d82f6 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:51.580931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a6780-2286-4296-b178-792885db0e6b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:51.614577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:51.615345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edd13d-8993-46b4-9fbb-f620b32d82f6 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:51.620644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229689e-7fe0-40ab-bb9a-fe03a0277e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:51.621254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229689e-7fe0-40ab-bb9a-fe03a0277e7e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:51.621536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229689e-7fe0-40ab-bb9a-fe03a0277e7e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:51.621807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229689e-7fe0-40ab-bb9a-fe03a0277e7e None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:51.622531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229689e-7fe0-40ab-bb9a-fe03a0277e7e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:51.622864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229689e-7fe0-40ab-bb9a-fe03a0277e7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:51.624291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229689e-7fe0-40ab-bb9a-fe03a0277e7e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:51.646682 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 287/584] 10.222.0.70 () {56 vars in 1137 bytes} [Sun Aug 28 18:36:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:51.646682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229689e-7fe0-40ab-bb9a-fe03a0277e7e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:51.656044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cf516-a32d-41ef-9195-1184376d731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:51.656678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cf516-a32d-41ef-9195-1184376d731e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:51.656960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cf516-a32d-41ef-9195-1184376d731e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:51.657236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cf516-a32d-41ef-9195-1184376d731e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:51.667918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cf516-a32d-41ef-9195-1184376d731e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:51.669374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cf516-a32d-41ef-9195-1184376d731e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-919cf516-a32d-41ef-9195-1184376d731e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:51.684343 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:51.685272 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:51.686148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:51.686148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:51.686148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:51.686148 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 298/585] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:51.686658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cf516-a32d-41ef-9195-1184376d731e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:51.710650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:51.756426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229689e-7fe0-40ab-bb9a-fe03a0277e7e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:51.791439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca067876-9329-4225-8d88-81b252ff44de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:51.792077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca067876-9329-4225-8d88-81b252ff44de None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:51.792328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca067876-9329-4225-8d88-81b252ff44de None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:51.792588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca067876-9329-4225-8d88-81b252ff44de None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:51.793267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca067876-9329-4225-8d88-81b252ff44de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:51.793572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca067876-9329-4225-8d88-81b252ff44de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:51.794948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca067876-9329-4225-8d88-81b252ff44de None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:51.800012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cf516-a32d-41ef-9195-1184376d731e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:51.806989 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 288/586] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:51.807784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca067876-9329-4225-8d88-81b252ff44de None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:51.844996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9517cf-208b-4981-90c5-fe6b08fe8f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:51.846365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9517cf-208b-4981-90c5-fe6b08fe8f11 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:51.846365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9517cf-208b-4981-90c5-fe6b08fe8f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:51.846365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9517cf-208b-4981-90c5-fe6b08fe8f11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:51.857473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9517cf-208b-4981-90c5-fe6b08fe8f11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:51.859036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9517cf-208b-4981-90c5-fe6b08fe8f11 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:51.862851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-af9517cf-208b-4981-90c5-fe6b08fe8f11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:51.874186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:51.875405 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:51.876268 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:51.876268 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:51.876268 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:51.876268 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 299/587] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:51.876268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9517cf-208b-4981-90c5-fe6b08fe8f11 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:51.923105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca067876-9329-4225-8d88-81b252ff44de None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:51.949981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:51.962275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e62f5-ef98-4ee0-b8b5-03382300a580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:51.962927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e62f5-ef98-4ee0-b8b5-03382300a580 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:51.963214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e62f5-ef98-4ee0-b8b5-03382300a580 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:51.963499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e62f5-ef98-4ee0-b8b5-03382300a580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:51.975215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e62f5-ef98-4ee0-b8b5-03382300a580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:51.976666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e62f5-ef98-4ee0-b8b5-03382300a580 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:51.983468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9517cf-208b-4981-90c5-fe6b08fe8f11 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-7c9e62f5-ef98-4ee0-b8b5-03382300a580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:51.992200 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:51.993165 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:51.998649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:51.998649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:51.998649 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:51.998649 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 289/588] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:51.998649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e62f5-ef98-4ee0-b8b5-03382300a580 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:52.034697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69224915-0dbb-4fb1-ac98-d742e628e3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:52.035251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69224915-0dbb-4fb1-ac98-d742e628e3bd None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:52.035536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69224915-0dbb-4fb1-ac98-d742e628e3bd None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:52.035813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69224915-0dbb-4fb1-ac98-d742e628e3bd None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:52.036451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69224915-0dbb-4fb1-ac98-d742e628e3bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:52.036757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69224915-0dbb-4fb1-ac98-d742e628e3bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:52.038125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69224915-0dbb-4fb1-ac98-d742e628e3bd None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:52.057586 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 300/589] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:52.057586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69224915-0dbb-4fb1-ac98-d742e628e3bd None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:52.136654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e62f5-ef98-4ee0-b8b5-03382300a580 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:52.138560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:52.181470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c61581-d518-4004-a7f9-05a849ad726c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:52.182118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c61581-d518-4004-a7f9-05a849ad726c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:52.182366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c61581-d518-4004-a7f9-05a849ad726c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:52.182634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c61581-d518-4004-a7f9-05a849ad726c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:52.184230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69224915-0dbb-4fb1-ac98-d742e628e3bd None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:52.190023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c61581-d518-4004-a7f9-05a849ad726c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:52.191499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c61581-d518-4004-a7f9-05a849ad726c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-23c61581-d518-4004-a7f9-05a849ad726c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:36:52.203723 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:52.206677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:52.207569 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:36:52.207569 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:36:52.207569 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:36:52.207569 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:36:52.207569 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:36:52.207569 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:36:52.207569 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:52.207569 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:52.209991 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 290/590] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:52.210873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c61581-d518-4004-a7f9-05a849ad726c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:52.218033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:52.226016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7638cb6-4954-4a8b-9c06-ccdef4548959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:52.226730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7638cb6-4954-4a8b-9c06-ccdef4548959 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:52.227112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7638cb6-4954-4a8b-9c06-ccdef4548959 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:52.227527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7638cb6-4954-4a8b-9c06-ccdef4548959 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:52.228239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7638cb6-4954-4a8b-9c06-ccdef4548959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:52.228544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7638cb6-4954-4a8b-9c06-ccdef4548959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:52.229901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7638cb6-4954-4a8b-9c06-ccdef4548959 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:52.248577 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 301/591] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:52.249565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7638cb6-4954-4a8b-9c06-ccdef4548959 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:52.318899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c61581-d518-4004-a7f9-05a849ad726c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:52.354233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78953fa9-2ede-4d9d-afd5-6d8c21745e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:52.355003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78953fa9-2ede-4d9d-afd5-6d8c21745e68 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:52.355346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78953fa9-2ede-4d9d-afd5-6d8c21745e68 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:52.355687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78953fa9-2ede-4d9d-afd5-6d8c21745e68 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:52.356406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78953fa9-2ede-4d9d-afd5-6d8c21745e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:52.356775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78953fa9-2ede-4d9d-afd5-6d8c21745e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:52.357580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7638cb6-4954-4a8b-9c06-ccdef4548959 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:52.358272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78953fa9-2ede-4d9d-afd5-6d8c21745e68 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:52.371073 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 291/592] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:52.371928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78953fa9-2ede-4d9d-afd5-6d8c21745e68 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:52.398018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:52.402904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b17090-0d78-4e4a-8f62-f1fd3ac1e434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:52.403709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b17090-0d78-4e4a-8f62-f1fd3ac1e434 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:52.403988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b17090-0d78-4e4a-8f62-f1fd3ac1e434 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:52.404260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b17090-0d78-4e4a-8f62-f1fd3ac1e434 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:52.411746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b17090-0d78-4e4a-8f62-f1fd3ac1e434 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:52.413244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b17090-0d78-4e4a-8f62-f1fd3ac1e434 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-23b17090-0d78-4e4a-8f62-f1fd3ac1e434 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:36:52.424459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:52.425507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:52.426506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:36:52.426506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:36:52.426506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:36:52.426506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:36:52.426506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:36:52.426506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:36:52.426506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:52.426506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:52.426506 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 302/593] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:52.427731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b17090-0d78-4e4a-8f62-f1fd3ac1e434 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:52.482492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:52.483358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78953fa9-2ede-4d9d-afd5-6d8c21745e68 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:52.524621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee4c33-5056-4c87-a305-1e6ce3c1b915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:52.525612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee4c33-5056-4c87-a305-1e6ce3c1b915 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:52.525981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee4c33-5056-4c87-a305-1e6ce3c1b915 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:52.526324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee4c33-5056-4c87-a305-1e6ce3c1b915 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:52.527053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee4c33-5056-4c87-a305-1e6ce3c1b915 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:52.527361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee4c33-5056-4c87-a305-1e6ce3c1b915 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:52.528785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee4c33-5056-4c87-a305-1e6ce3c1b915 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:52.535146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b17090-0d78-4e4a-8f62-f1fd3ac1e434 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:52.545851 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 292/594] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:52.545851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee4c33-5056-4c87-a305-1e6ce3c1b915 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:52.581608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12ae74-b4df-461c-bc83-6683810f865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:52.582250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12ae74-b4df-461c-bc83-6683810f865b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:52.582528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12ae74-b4df-461c-bc83-6683810f865b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:52.582842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12ae74-b4df-461c-bc83-6683810f865b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:52.591286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12ae74-b4df-461c-bc83-6683810f865b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:52.592728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12ae74-b4df-461c-bc83-6683810f865b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-df12ae74-b4df-461c-bc83-6683810f865b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:52.605118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:52.606053 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:52.607610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:52.607610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:52.607610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:52.607610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:52.607610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:52.607610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:52.607610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:52.607610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:52.607610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 18:36:52.607610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:52.607610 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 303/595] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:52.607610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12ae74-b4df-461c-bc83-6683810f865b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:52.643043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:52.666292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee4c33-5056-4c87-a305-1e6ce3c1b915 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:52.703215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15994b-2dd9-4a22-aadd-ac9904b1c41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:52.703847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15994b-2dd9-4a22-aadd-ac9904b1c41b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:52.704122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15994b-2dd9-4a22-aadd-ac9904b1c41b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:52.704461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15994b-2dd9-4a22-aadd-ac9904b1c41b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:52.711766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15994b-2dd9-4a22-aadd-ac9904b1c41b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:52.713184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15994b-2dd9-4a22-aadd-ac9904b1c41b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:52.721635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12ae74-b4df-461c-bc83-6683810f865b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-ad15994b-2dd9-4a22-aadd-ac9904b1c41b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:36:52.724612 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:52.725466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:52.726424 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:36:52.726424 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:36:52.726424 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:36:52.726424 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:36:52.726424 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:36:52.726424 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:36:52.726424 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:52.726424 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:52.726424 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 293/596] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:52.727567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15994b-2dd9-4a22-aadd-ac9904b1c41b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:52.739224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:52.767123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225795ea-d1cb-481d-87e6-f4bf23dcfd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:52.768583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225795ea-d1cb-481d-87e6-f4bf23dcfd1f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:52.768868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225795ea-d1cb-481d-87e6-f4bf23dcfd1f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:52.769145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225795ea-d1cb-481d-87e6-f4bf23dcfd1f None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:52.769906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225795ea-d1cb-481d-87e6-f4bf23dcfd1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:52.770689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225795ea-d1cb-481d-87e6-f4bf23dcfd1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:52.772561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225795ea-d1cb-481d-87e6-f4bf23dcfd1f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:52.793665 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 304/597] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:52.794615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225795ea-d1cb-481d-87e6-f4bf23dcfd1f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:52.837212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15994b-2dd9-4a22-aadd-ac9904b1c41b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:52.877315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f59bae-57d5-46ab-a9d7-75dc1da0e5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:52.878271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f59bae-57d5-46ab-a9d7-75dc1da0e5ba None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:52.878643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f59bae-57d5-46ab-a9d7-75dc1da0e5ba None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:52.879387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f59bae-57d5-46ab-a9d7-75dc1da0e5ba None admin] PATH_INFO: `/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/ea8cbbc34aab42a4ada9cbee1772847b/roles/57a3c5c9b870422597e89540164ee502` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:52.891861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:52.896374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f59bae-57d5-46ab-a9d7-75dc1da0e5ba None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7555fde9e5404eb3b0dbfa04ee871f, user_id=ea8cbbc34aab42a4ada9cbee1772847b, role_id=57a3c5c9b870422597e89540164ee502)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:52.898938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f59bae-57d5-46ab-a9d7-75dc1da0e5ba None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:52.902183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225795ea-d1cb-481d-87e6-f4bf23dcfd1f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:52.922795 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 294/598] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:36:52 2022] PUT /identity/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/ea8cbbc34aab42a4ada9cbee1772847b/roles/57a3c5c9b870422597e89540164ee502 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:52.922795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f59bae-57d5-46ab-a9d7-75dc1da0e5ba None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:52.950919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a44cb-ace7-4c63-987e-576b2365a695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:52.951640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a44cb-ace7-4c63-987e-576b2365a695 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:52.952024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a44cb-ace7-4c63-987e-576b2365a695 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:52.952377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a44cb-ace7-4c63-987e-576b2365a695 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:52.953220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a44cb-ace7-4c63-987e-576b2365a695 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:52.953583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a44cb-ace7-4c63-987e-576b2365a695 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:52.955384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a44cb-ace7-4c63-987e-576b2365a695 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:52.975572 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 305/599] 10.222.0.70 () {56 vars in 1139 bytes} [Sun Aug 28 18:36:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:52.976365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a44cb-ace7-4c63-987e-576b2365a695 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:53.016067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:53.065814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f59bae-57d5-46ab-a9d7-75dc1da0e5ba None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:53.107601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85ac12-ec67-4090-9b2a-016dbed34427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:53.108140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ac12-ec67-4090-9b2a-016dbed34427 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:53.108417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ac12-ec67-4090-9b2a-016dbed34427 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:53.108686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ac12-ec67-4090-9b2a-016dbed34427 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:53.109375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85ac12-ec67-4090-9b2a-016dbed34427 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:53.109687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85ac12-ec67-4090-9b2a-016dbed34427 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:53.111179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85ac12-ec67-4090-9b2a-016dbed34427 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:53.119547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a44cb-ace7-4c63-987e-576b2365a695 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:53.123718 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 295/600] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:53.124542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85ac12-ec67-4090-9b2a-016dbed34427 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:53.161840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275edd-8ec2-4c1c-8dfb-bd82cedf6646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:53.162799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275edd-8ec2-4c1c-8dfb-bd82cedf6646 None admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:53.163263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275edd-8ec2-4c1c-8dfb-bd82cedf6646 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:53.163685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275edd-8ec2-4c1c-8dfb-bd82cedf6646 None admin] PATH_INFO: `/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/332144d9eb5742498c0c37a70277ce5e/roles/57a3c5c9b870422597e89540164ee502` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:53.178861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:53.183889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275edd-8ec2-4c1c-8dfb-bd82cedf6646 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7555fde9e5404eb3b0dbfa04ee871f, user_id=332144d9eb5742498c0c37a70277ce5e, role_id=57a3c5c9b870422597e89540164ee502)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:53.185451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275edd-8ec2-4c1c-8dfb-bd82cedf6646 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:53.206776 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 306/601] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:36:52 2022] PUT /identity/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/332144d9eb5742498c0c37a70277ce5e/roles/57a3c5c9b870422597e89540164ee502 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:53.206776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabba8eb-4548-4c87-b2e7-1309e9ec4772 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:53.206776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabba8eb-4548-4c87-b2e7-1309e9ec4772 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:53.206776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabba8eb-4548-4c87-b2e7-1309e9ec4772 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:53.206776 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 307/602] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:53.206776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabba8eb-4548-4c87-b2e7-1309e9ec4772 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:53.250034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85ac12-ec67-4090-9b2a-016dbed34427 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:53.301153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bb5c9-e0f1-4623-b248-6334636a3c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:53.301806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb5c9-e0f1-4623-b248-6334636a3c57 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:53.302094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb5c9-e0f1-4623-b248-6334636a3c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:53.302369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb5c9-e0f1-4623-b248-6334636a3c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:53.318208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bb5c9-e0f1-4623-b248-6334636a3c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:53.320462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bb5c9-e0f1-4623-b248-6334636a3c57 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:53.323402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-9e8bb5c9-e0f1-4623-b248-6334636a3c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:53.338950 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:53.340328 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:53.341336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:53.341336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:53.341336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:53.348341 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 296/603] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:53.349872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac689e-c0b3-4860-af31-a013b70d8dca None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:53.350254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac689e-c0b3-4860-af31-a013b70d8dca None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:53.350631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac689e-c0b3-4860-af31-a013b70d8dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:53.359452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabba8eb-4548-4c87-b2e7-1309e9ec4772 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:53.373357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c2ac689e-c0b3-4860-af31-a013b70d8dca None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:53.375050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c2ac689e-c0b3-4860-af31-a013b70d8dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:53.403522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57968f0-9334-455b-a63a-2d77e69872b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:53.405934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57968f0-9334-455b-a63a-2d77e69872b1 None admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:53.406221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57968f0-9334-455b-a63a-2d77e69872b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:53.406495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57968f0-9334-455b-a63a-2d77e69872b1 None admin] PATH_INFO: `/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/afece3fa01d040a1ae8e035ea3ff3219/roles/57a3c5c9b870422597e89540164ee502` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:53.422811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57968f0-9334-455b-a63a-2d77e69872b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7555fde9e5404eb3b0dbfa04ee871f, user_id=afece3fa01d040a1ae8e035ea3ff3219, role_id=57a3c5c9b870422597e89540164ee502)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:53.425001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57968f0-9334-455b-a63a-2d77e69872b1 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:53.443196 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 308/604] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:36:53 2022] PUT /identity/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/afece3fa01d040a1ae8e035ea3ff3219/roles/57a3c5c9b870422597e89540164ee502 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:53.444357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57968f0-9334-455b-a63a-2d77e69872b1 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:53.462843 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 297/605] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:53.590506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57968f0-9334-455b-a63a-2d77e69872b1 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:53.637391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:53.648103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132404e-8e76-4053-9508-6ff3a3cd462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:53.648895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132404e-8e76-4053-9508-6ff3a3cd462d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:53.649182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132404e-8e76-4053-9508-6ff3a3cd462d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:53.649450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132404e-8e76-4053-9508-6ff3a3cd462d None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:53.650093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132404e-8e76-4053-9508-6ff3a3cd462d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:53.650396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132404e-8e76-4053-9508-6ff3a3cd462d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:53.651811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132404e-8e76-4053-9508-6ff3a3cd462d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:53.664856 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 309/606] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:53.670385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac689e-c0b3-4860-af31-a013b70d8dca None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:53.712220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:53.780008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132404e-8e76-4053-9508-6ff3a3cd462d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:53.801539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac689e-c0b3-4860-af31-a013b70d8dca None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:53.840479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716181d2-d5ce-4290-8af9-756dc3ae42b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:53.841107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716181d2-d5ce-4290-8af9-756dc3ae42b2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:53.841365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716181d2-d5ce-4290-8af9-756dc3ae42b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:53.841639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716181d2-d5ce-4290-8af9-756dc3ae42b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:53.850239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716181d2-d5ce-4290-8af9-756dc3ae42b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:53.851841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716181d2-d5ce-4290-8af9-756dc3ae42b2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-716181d2-d5ce-4290-8af9-756dc3ae42b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:36:53.872998 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:53.873952 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:53.875277 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:36:53.875277 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:36:53.875277 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:36:53.875277 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:36:53.875277 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:36:53.875277 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:36:53.875277 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:53.875277 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:53.875277 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 298/607] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:53.881080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716181d2-d5ce-4290-8af9-756dc3ae42b2 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:53.966850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132404e-8e76-4053-9508-6ff3a3cd462d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:54.000954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29dba0-75b6-4bcc-973f-e5998d5059d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:54.001590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29dba0-75b6-4bcc-973f-e5998d5059d7 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:54.002098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29dba0-75b6-4bcc-973f-e5998d5059d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:54.002297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29dba0-75b6-4bcc-973f-e5998d5059d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:54.015011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29dba0-75b6-4bcc-973f-e5998d5059d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-5d29dba0-75b6-4bcc-973f-e5998d5059d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:54.021569 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:54.022501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:54.023816 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:54.023816 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:54.023816 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:54.023816 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:54.023816 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:54.023816 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:54.023816 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:54.023816 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:54.023816 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:54.023816 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:54.023816 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:54.023816 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:54.023816 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 310/608] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:54.029733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29dba0-75b6-4bcc-973f-e5998d5059d7 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:54.082269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:54.091608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:54.095525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716181d2-d5ce-4290-8af9-756dc3ae42b2 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:54.150480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29dba0-75b6-4bcc-973f-e5998d5059d7 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:54.184591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09899b-a479-43dd-af67-e3d4913efc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:54.185719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09899b-a479-43dd-af67-e3d4913efc4c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:54.187236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09899b-a479-43dd-af67-e3d4913efc4c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:54.188397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09899b-a479-43dd-af67-e3d4913efc4c None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:54.190404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09899b-a479-43dd-af67-e3d4913efc4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:54.191386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09899b-a479-43dd-af67-e3d4913efc4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:54.193967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09899b-a479-43dd-af67-e3d4913efc4c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:54.198821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f7342-3494-4c8c-8d85-864e4bd16649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:54.199710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f7342-3494-4c8c-8d85-864e4bd16649 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:54.200186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f7342-3494-4c8c-8d85-864e4bd16649 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:54.200909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f7342-3494-4c8c-8d85-864e4bd16649 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:54.202867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f7342-3494-4c8c-8d85-864e4bd16649 None admin] RBAC: Adding query filter params (name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:54.203836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f7342-3494-4c8c-8d85-864e4bd16649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:54.206071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f7342-3494-4c8c-8d85-864e4bd16649 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:54.217488 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 311/609] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:54.223969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f7342-3494-4c8c-8d85-864e4bd16649 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:54.224846 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 299/610] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:54.230771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09899b-a479-43dd-af67-e3d4913efc4c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:54.380244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f7342-3494-4c8c-8d85-864e4bd16649 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:54.418080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d74c7-6314-43ab-aa2d-c16d95032718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:54.419095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d74c7-6314-43ab-aa2d-c16d95032718 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:54.419963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d74c7-6314-43ab-aa2d-c16d95032718 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:54.420462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d74c7-6314-43ab-aa2d-c16d95032718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:54.432438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d74c7-6314-43ab-aa2d-c16d95032718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:54.434374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d74c7-6314-43ab-aa2d-c16d95032718 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-735d74c7-6314-43ab-aa2d-c16d95032718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:54.450613 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:54.451556 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:54.452403 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:54.452403 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:54.452403 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:54.454726 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 312/611] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:54.454726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:54.462575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d74c7-6314-43ab-aa2d-c16d95032718 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:54.499983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09899b-a479-43dd-af67-e3d4913efc4c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:54.575089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05baeee1-54fc-4457-b723-a30ffaa057c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:54.575777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baeee1-54fc-4457-b723-a30ffaa057c9 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:54.576059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baeee1-54fc-4457-b723-a30ffaa057c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:54.576336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baeee1-54fc-4457-b723-a30ffaa057c9 None admin] PATH_INFO: `/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/02ed42702778456ab336afdd250a1d41/roles/57a3c5c9b870422597e89540164ee502` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:54.601451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05baeee1-54fc-4457-b723-a30ffaa057c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7555fde9e5404eb3b0dbfa04ee871f, user_id=02ed42702778456ab336afdd250a1d41, role_id=57a3c5c9b870422597e89540164ee502)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:54.602930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05baeee1-54fc-4457-b723-a30ffaa057c9 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:54.613030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d74c7-6314-43ab-aa2d-c16d95032718 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:54.643767 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 300/612] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:36:54 2022] PUT /identity/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/02ed42702778456ab336afdd250a1d41/roles/57a3c5c9b870422597e89540164ee502 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:36:54.662317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb5785-0b8e-4093-9677-201cafe707c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:54.662993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb5785-0b8e-4093-9677-201cafe707c5 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:54.663280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb5785-0b8e-4093-9677-201cafe707c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:54.663555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb5785-0b8e-4093-9677-201cafe707c5 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:54.664215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb5785-0b8e-4093-9677-201cafe707c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:54.664524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb5785-0b8e-4093-9677-201cafe707c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:54.665938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb5785-0b8e-4093-9677-201cafe707c5 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:54.687879 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 313/613] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:54.694100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05baeee1-54fc-4457-b723-a30ffaa057c9 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:54.699874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:54.838855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05baeee1-54fc-4457-b723-a30ffaa057c9 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:54.876024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821e088-d246-46cf-86b3-df717e271c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:54.876665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821e088-d246-46cf-86b3-df717e271c61 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:54.877533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821e088-d246-46cf-86b3-df717e271c61 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:54.877814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821e088-d246-46cf-86b3-df717e271c61 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:54.890304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821e088-d246-46cf-86b3-df717e271c61 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:54.891782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821e088-d246-46cf-86b3-df717e271c61 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-c821e088-d246-46cf-86b3-df717e271c61 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:54.905812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:54.906767 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:54.907748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:54.907748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:54.907748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:54.907748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:54.907748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:54.907748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:54.907748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:54.907748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:54.907748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:36:54.907748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:54.907748 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 301/614] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:36:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:54.913574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb5785-0b8e-4093-9677-201cafe707c5 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:54.941464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:55.054540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb5785-0b8e-4093-9677-201cafe707c5 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:55.101027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36231a87-6931-4816-ac95-d6d074a93c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:55.101967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231a87-6931-4816-ac95-d6d074a93c09 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:55.102447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231a87-6931-4816-ac95-d6d074a93c09 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:55.102949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36231a87-6931-4816-ac95-d6d074a93c09 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:55.103907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36231a87-6931-4816-ac95-d6d074a93c09 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:55.104428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36231a87-6931-4816-ac95-d6d074a93c09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:55.106103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36231a87-6931-4816-ac95-d6d074a93c09 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:55.130788 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 314/615] 10.222.0.70 () {56 vars in 1135 bytes} [Sun Aug 28 18:36:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:55.136322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821e088-d246-46cf-86b3-df717e271c61 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:55.244249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:55.289419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821e088-d246-46cf-86b3-df717e271c61 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:55.325980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c6d1c-b020-446d-be3d-fdd9ada6fc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:55.326609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6d1c-b020-446d-be3d-fdd9ada6fc6e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:55.326916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6d1c-b020-446d-be3d-fdd9ada6fc6e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:55.327236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c6d1c-b020-446d-be3d-fdd9ada6fc6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:55.339052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c6d1c-b020-446d-be3d-fdd9ada6fc6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:55.340508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c6d1c-b020-446d-be3d-fdd9ada6fc6e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-aa0c6d1c-b020-446d-be3d-fdd9ada6fc6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:55.355703 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:55.356645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:55.357491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:55.357491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:55.357491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:55.357491 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 302/616] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:55.363485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36231a87-6931-4816-ac95-d6d074a93c09 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:55.394405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d301c-d5be-4f9d-ad88-27600395da76 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:55.394714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d301c-d5be-4f9d-ad88-27600395da76 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:55.394976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d301c-d5be-4f9d-ad88-27600395da76 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:55.396309 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 303/617] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:36:55.401608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098d6c1-ee79-485c-9ef3-9c5ba75445e6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:55.402127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098d6c1-ee79-485c-9ef3-9c5ba75445e6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:55.402599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098d6c1-ee79-485c-9ef3-9c5ba75445e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:55.422028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d098d6c1-ee79-485c-9ef3-9c5ba75445e6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:55.424206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d098d6c1-ee79-485c-9ef3-9c5ba75445e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:55.504420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:55.510839 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 304/618] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:55.526645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6751d-7adc-4794-9ef3-380309e97edd None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:55.527150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6751d-7adc-4794-9ef3-380309e97edd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:55.527592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6751d-7adc-4794-9ef3-380309e97edd None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:55.529329 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 305/619] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:36:55.534561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36231a87-6931-4816-ac95-d6d074a93c09 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:55.535036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffe12a-5390-4b12-84d5-fdc6d30b845e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:55.535463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffe12a-5390-4b12-84d5-fdc6d30b845e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:55.535878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffe12a-5390-4b12-84d5-fdc6d30b845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:55.571780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e6ffe12a-5390-4b12-84d5-fdc6d30b845e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:55.572993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e6ffe12a-5390-4b12-84d5-fdc6d30b845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:55.573458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274ffd9-fb00-4d2a-b57a-7bc468336ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:55.574287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ffd9-fb00-4d2a-b57a-7bc468336ca0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:55.574785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ffd9-fb00-4d2a-b57a-7bc468336ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:55.575278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274ffd9-fb00-4d2a-b57a-7bc468336ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:55.576309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274ffd9-fb00-4d2a-b57a-7bc468336ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:55.576812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274ffd9-fb00-4d2a-b57a-7bc468336ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:55.578486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274ffd9-fb00-4d2a-b57a-7bc468336ca0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:55.593677 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 315/620] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:55.601434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274ffd9-fb00-4d2a-b57a-7bc468336ca0 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:55.686060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:55.730543 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 306/621] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 18:36:55.750157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274ffd9-fb00-4d2a-b57a-7bc468336ca0 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:55.784766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2e111-4046-42d2-a2b0-c875befce2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:55.785452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2e111-4046-42d2-a2b0-c875befce2de None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:55.785872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2e111-4046-42d2-a2b0-c875befce2de None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:55.786153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2e111-4046-42d2-a2b0-c875befce2de None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:55.793006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2e111-4046-42d2-a2b0-c875befce2de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:55.794515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2e111-4046-42d2-a2b0-c875befce2de None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:55.797152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-4bb2e111-4046-42d2-a2b0-c875befce2de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:36:55.807165 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:55.808341 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:55.809212 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:36:55.809212 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:36:55.809212 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:36:55.809212 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:36:55.809212 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:36:55.809212 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:36:55.809212 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:55.809212 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:55.809212 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 316/622] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:55.816095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffe12a-5390-4b12-84d5-fdc6d30b845e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:55.862534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2e111-4046-42d2-a2b0-c875befce2de None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:55.942589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffe12a-5390-4b12-84d5-fdc6d30b845e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:55.972139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2e111-4046-42d2-a2b0-c875befce2de None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:55.979323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c9dee-b9ae-43f6-9945-e126902b09f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:55.979935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c9dee-b9ae-43f6-9945-e126902b09f4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:55.980221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c9dee-b9ae-43f6-9945-e126902b09f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:55.980498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c9dee-b9ae-43f6-9945-e126902b09f4 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:55.981189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c9dee-b9ae-43f6-9945-e126902b09f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:55.981497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c9dee-b9ae-43f6-9945-e126902b09f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:55.983113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c9dee-b9ae-43f6-9945-e126902b09f4 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:56.002764 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 307/623] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:56.002764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7899330-69e6-4405-ba1b-5c9d21242cf0 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.002764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7899330-69e6-4405-ba1b-5c9d21242cf0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.002764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7899330-69e6-4405-ba1b-5c9d21242cf0 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.002764 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 308/624] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:56.002764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7899330-69e6-4405-ba1b-5c9d21242cf0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:56.020575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d17cd7-81b7-4ac5-b792-3529956b1962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:56.021214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d17cd7-81b7-4ac5-b792-3529956b1962 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.021495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d17cd7-81b7-4ac5-b792-3529956b1962 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.021799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d17cd7-81b7-4ac5-b792-3529956b1962 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.032335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d17cd7-81b7-4ac5-b792-3529956b1962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-42d17cd7-81b7-4ac5-b792-3529956b1962 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:56.037936 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:56.038872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:56.039696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:56.039696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:56.039696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:56.039696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:56.039696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:56.039696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:56.039696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:56.039696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:56.039696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:56.039696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:56.039696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:56.039696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:56.039696 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 317/625] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:56.040924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b109a69-07d3-4aaf-89e2-6c0c6e06df8f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.041037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b109a69-07d3-4aaf-89e2-6c0c6e06df8f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.041224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b109a69-07d3-4aaf-89e2-6c0c6e06df8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.047092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:56.062337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0b109a69-07d3-4aaf-89e2-6c0c6e06df8f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:56.063665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0b109a69-07d3-4aaf-89e2-6c0c6e06df8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:56.123008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7899330-69e6-4405-ba1b-5c9d21242cf0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:56.139706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:56.152510 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 318/626] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:56.153690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b109a69-07d3-4aaf-89e2-6c0c6e06df8f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:56.170122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb951d-ea33-4cac-b864-d20af558a3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:56.170817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb951d-ea33-4cac-b864-d20af558a3a1 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.171103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb951d-ea33-4cac-b864-d20af558a3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.171377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb951d-ea33-4cac-b864-d20af558a3a1 None admin] PATH_INFO: `/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/8787e53dd76c430e9ebe69b79b69827e/roles/57a3c5c9b870422597e89540164ee502` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.194208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb951d-ea33-4cac-b864-d20af558a3a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7555fde9e5404eb3b0dbfa04ee871f, user_id=8787e53dd76c430e9ebe69b79b69827e, role_id=57a3c5c9b870422597e89540164ee502)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:56.195911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb951d-ea33-4cac-b864-d20af558a3a1 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:56.212950 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 309/627] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:36:56 2022] PUT /identity/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/8787e53dd76c430e9ebe69b79b69827e/roles/57a3c5c9b870422597e89540164ee502 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:36:56.214059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb951d-ea33-4cac-b864-d20af558a3a1 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:56.281322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b109a69-07d3-4aaf-89e2-6c0c6e06df8f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:56.311352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:56.327533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb951d-ea33-4cac-b864-d20af558a3a1 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:56.333007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5709ae-2371-4a4a-b6dd-def8bb6dd123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:56.333999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5709ae-2371-4a4a-b6dd-def8bb6dd123 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.334485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5709ae-2371-4a4a-b6dd-def8bb6dd123 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.335064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5709ae-2371-4a4a-b6dd-def8bb6dd123 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.336016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5709ae-2371-4a4a-b6dd-def8bb6dd123 None admin] RBAC: Adding query filter params (name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:56.336582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5709ae-2371-4a4a-b6dd-def8bb6dd123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:56.338355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5709ae-2371-4a4a-b6dd-def8bb6dd123 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:56.354670 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 319/628] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:56.356462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5709ae-2371-4a4a-b6dd-def8bb6dd123 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:56.367483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ab679-d7b4-459e-9404-0720199b286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:56.368134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ab679-d7b4-459e-9404-0720199b286e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.368941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ab679-d7b4-459e-9404-0720199b286e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.368941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ab679-d7b4-459e-9404-0720199b286e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.380737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ab679-d7b4-459e-9404-0720199b286e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-148ab679-d7b4-459e-9404-0720199b286e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:56.385817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:56.386864 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:56.388169 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:56.388169 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:56.388169 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:56.388169 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:56.388169 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:56.388169 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:56.388169 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:56.388169 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:56.388169 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:56.388169 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:56.388169 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:56.388169 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:56.388169 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 310/629] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:56.393318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ab679-d7b4-459e-9404-0720199b286e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:56.426859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:56.485928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5709ae-2371-4a4a-b6dd-def8bb6dd123 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:56.507547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ab679-d7b4-459e-9404-0720199b286e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:56.526435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44175867-958e-48ad-8ba5-5fdf612147e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:56.527487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44175867-958e-48ad-8ba5-5fdf612147e7 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.527982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44175867-958e-48ad-8ba5-5fdf612147e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.528653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44175867-958e-48ad-8ba5-5fdf612147e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.541705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44175867-958e-48ad-8ba5-5fdf612147e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:56.543611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44175867-958e-48ad-8ba5-5fdf612147e7 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:56.544218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98539e6f-cdb7-4aa4-9fd3-5d553454b85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:56.544834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98539e6f-cdb7-4aa4-9fd3-5d553454b85f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.545114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98539e6f-cdb7-4aa4-9fd3-5d553454b85f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.545385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98539e6f-cdb7-4aa4-9fd3-5d553454b85f None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.546050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98539e6f-cdb7-4aa4-9fd3-5d553454b85f None admin] RBAC: Adding query filter params (name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:56.546352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98539e6f-cdb7-4aa4-9fd3-5d553454b85f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:56.547759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98539e6f-cdb7-4aa4-9fd3-5d553454b85f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:56.557148 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 311/630] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-44175867-958e-48ad-8ba5-5fdf612147e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:56.562699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:56.563715 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:56.565211 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:56.565211 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:56.565211 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:56.569823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98539e6f-cdb7-4aa4-9fd3-5d553454b85f None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:56.570111 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 320/631] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:56.573874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44175867-958e-48ad-8ba5-5fdf612147e7 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:56.587654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:56.691439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44175867-958e-48ad-8ba5-5fdf612147e7 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:56.694336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:56.698039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98539e6f-cdb7-4aa4-9fd3-5d553454b85f None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:56.730951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f39104-5026-4def-9960-e6182afa547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:56.731733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f39104-5026-4def-9960-e6182afa547d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.732017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f39104-5026-4def-9960-e6182afa547d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.732287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f39104-5026-4def-9960-e6182afa547d None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.733146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f39104-5026-4def-9960-e6182afa547d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:56.733454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f39104-5026-4def-9960-e6182afa547d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:56.734886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f39104-5026-4def-9960-e6182afa547d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:56.737845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a27822-b3c1-48b4-ba8e-223ae419db8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:56.738706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a27822-b3c1-48b4-ba8e-223ae419db8a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.739242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a27822-b3c1-48b4-ba8e-223ae419db8a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.739729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a27822-b3c1-48b4-ba8e-223ae419db8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.750917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a27822-b3c1-48b4-ba8e-223ae419db8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:56.753085 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 321/632] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:36:56.753430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a27822-b3c1-48b4-ba8e-223ae419db8a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:56.754133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f39104-5026-4def-9960-e6182afa547d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-98a27822-b3c1-48b4-ba8e-223ae419db8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:56.769984 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:56.771007 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:56.771900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:56.771900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:56.771900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:56.774101 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 312/633] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:36:56.779661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a27822-b3c1-48b4-ba8e-223ae419db8a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:56.862155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:56.874445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f39104-5026-4def-9960-e6182afa547d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:56.913471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783c184-e70a-4624-a89a-a29230ea689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:56.914214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c184-e70a-4624-a89a-a29230ea689b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.914494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c184-e70a-4624-a89a-a29230ea689b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.914785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c184-e70a-4624-a89a-a29230ea689b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.917886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a27822-b3c1-48b4-ba8e-223ae419db8a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:56.926799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783c184-e70a-4624-a89a-a29230ea689b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-a783c184-e70a-4624-a89a-a29230ea689b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:56.931919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:56.933278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:56.934186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:56.934186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:56.934186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:56.934186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:56.934186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:56.934186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:56.934186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:56.934186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:56.934186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:56.934186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:56.934186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:56.934186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:56.934186 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 322/634] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:56.934936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783c184-e70a-4624-a89a-a29230ea689b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:56.961726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9954be-60fc-407a-84db-29475aaba50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:56.962355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9954be-60fc-407a-84db-29475aaba50e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:56.962634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9954be-60fc-407a-84db-29475aaba50e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:56.962944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9954be-60fc-407a-84db-29475aaba50e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:56.965176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:56.974627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9954be-60fc-407a-84db-29475aaba50e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:56.977424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9954be-60fc-407a-84db-29475aaba50e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-9d9954be-60fc-407a-84db-29475aaba50e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:56.992815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:56.994010 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:56.995188 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:56.995188 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:56.995188 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:56.995188 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:56.995188 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:56.995188 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:56.995188 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:56.995188 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:56.995188 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:36:56.995188 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:56.995845 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 313/635] 10.222.0.70 () {56 vars in 1093 bytes} [Sun Aug 28 18:36:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:56.998364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9954be-60fc-407a-84db-29475aaba50e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:57.062634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783c184-e70a-4624-a89a-a29230ea689b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:57.098059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae441ec4-c01d-47e9-8525-82b3239e560d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:57.098673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441ec4-c01d-47e9-8525-82b3239e560d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.098982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441ec4-c01d-47e9-8525-82b3239e560d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.099265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441ec4-c01d-47e9-8525-82b3239e560d None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.099906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae441ec4-c01d-47e9-8525-82b3239e560d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:57.100204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae441ec4-c01d-47e9-8525-82b3239e560d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:57.101586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae441ec4-c01d-47e9-8525-82b3239e560d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:57.113290 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 323/636] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:57.114115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae441ec4-c01d-47e9-8525-82b3239e560d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:57.125256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9954be-60fc-407a-84db-29475aaba50e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:57.148055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:57.165752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6b26d-7b91-4f42-8604-0b4dbc5506cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:57.166465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6b26d-7b91-4f42-8604-0b4dbc5506cb None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.166762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6b26d-7b91-4f42-8604-0b4dbc5506cb None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.167087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6b26d-7b91-4f42-8604-0b4dbc5506cb None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.167804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6b26d-7b91-4f42-8604-0b4dbc5506cb None admin] RBAC: Adding query filter params (name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:57.168154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6b26d-7b91-4f42-8604-0b4dbc5506cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:57.169742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6b26d-7b91-4f42-8604-0b4dbc5506cb None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:57.184188 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 314/637] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:57.185355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ab72a-5aa2-48da-a912-da16c57637a7 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.185642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ab72a-5aa2-48da-a912-da16c57637a7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.185916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ab72a-5aa2-48da-a912-da16c57637a7 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.191241 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 315/638] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:57.191241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ab72a-5aa2-48da-a912-da16c57637a7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:57.208626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:57.226637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae441ec4-c01d-47e9-8525-82b3239e560d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:57.262277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7e7af-a8e0-422a-988d-e2068329f453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:57.262866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7e7af-a8e0-422a-988d-e2068329f453 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.263123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7e7af-a8e0-422a-988d-e2068329f453 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.263395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7e7af-a8e0-422a-988d-e2068329f453 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.264771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7e7af-a8e0-422a-988d-e2068329f453 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:57.264771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7e7af-a8e0-422a-988d-e2068329f453 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:57.265830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7e7af-a8e0-422a-988d-e2068329f453 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:57.284199 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 324/639] 10.222.0.70 () {56 vars in 1133 bytes} [Sun Aug 28 18:36:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:57.289366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7e7af-a8e0-422a-988d-e2068329f453 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:57.297292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ab72a-5aa2-48da-a912-da16c57637a7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:57.333416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe85270-334b-4d6d-a9d1-3d5e11b3d186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:57.334127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe85270-334b-4d6d-a9d1-3d5e11b3d186 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.334478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe85270-334b-4d6d-a9d1-3d5e11b3d186 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.334782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe85270-334b-4d6d-a9d1-3d5e11b3d186 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.342436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe85270-334b-4d6d-a9d1-3d5e11b3d186 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:57.343887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe85270-334b-4d6d-a9d1-3d5e11b3d186 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-ffe85270-334b-4d6d-a9d1-3d5e11b3d186 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:57.355784 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:57.356933 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:57.358044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:57.358044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:57.358044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:57.358044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:57.358044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:57.358044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:57.358044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:57.358044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:57.358044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 18:36:57.358044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:57.361961 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 316/640] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:57.363218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcaf2a-e047-44d0-8d18-f94e8d5d9514 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.363500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcaf2a-e047-44d0-8d18-f94e8d5d9514 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.363770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcaf2a-e047-44d0-8d18-f94e8d5d9514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.381042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9edcaf2a-e047-44d0-8d18-f94e8d5d9514 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:57.382224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9edcaf2a-e047-44d0-8d18-f94e8d5d9514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:57.397017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7e7af-a8e0-422a-988d-e2068329f453 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:57.420118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:57.433159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c7ba0-d8e3-46ca-8c96-6236fe06a02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:57.433910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c7ba0-d8e3-46ca-8c96-6236fe06a02b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.434287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c7ba0-d8e3-46ca-8c96-6236fe06a02b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.434682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c7ba0-d8e3-46ca-8c96-6236fe06a02b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.445140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c7ba0-d8e3-46ca-8c96-6236fe06a02b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:57.446700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c7ba0-d8e3-46ca-8c96-6236fe06a02b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:57.448496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:57.454391 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 317/641] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:57.455531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcaf2a-e047-44d0-8d18-f94e8d5d9514 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-ec6c7ba0-d8e3-46ca-8c96-6236fe06a02b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:57.467555 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:57.468741 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:57.469825 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:57.469825 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:57.469825 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:57.472384 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 325/642] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:57.473445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c7ba0-d8e3-46ca-8c96-6236fe06a02b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:57.586181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c7ba0-d8e3-46ca-8c96-6236fe06a02b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:57.591282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcaf2a-e047-44d0-8d18-f94e8d5d9514 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:57.627304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d6c44-ae4b-4e76-a434-f61e7aa593c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:57.628257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d6c44-ae4b-4e76-a434-f61e7aa593c9 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.628540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d6c44-ae4b-4e76-a434-f61e7aa593c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.628814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d6c44-ae4b-4e76-a434-f61e7aa593c9 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.629987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d6c44-ae4b-4e76-a434-f61e7aa593c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:57.630321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d6c44-ae4b-4e76-a434-f61e7aa593c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:57.632056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d6c44-ae4b-4e76-a434-f61e7aa593c9 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:57.635675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6851d8-1467-4014-9e7d-a24689331415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:57.636411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6851d8-1467-4014-9e7d-a24689331415 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.636757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6851d8-1467-4014-9e7d-a24689331415 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.637093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6851d8-1467-4014-9e7d-a24689331415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.653786 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 326/643] 10.222.0.70 () {56 vars in 1137 bytes} [Sun Aug 28 18:36:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:57.654788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d6c44-ae4b-4e76-a434-f61e7aa593c9 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:57.687099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:57.722196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:57.724041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6851d8-1467-4014-9e7d-a24689331415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:57.726272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6851d8-1467-4014-9e7d-a24689331415 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:57.775722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d6c44-ae4b-4e76-a434-f61e7aa593c9 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:57.815143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d34906-b9f0-4e4a-a1ea-7007316ae3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:57.815960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d34906-b9f0-4e4a-a1ea-7007316ae3bb None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.816242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d34906-b9f0-4e4a-a1ea-7007316ae3bb None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.816511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d34906-b9f0-4e4a-a1ea-7007316ae3bb None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.817146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d34906-b9f0-4e4a-a1ea-7007316ae3bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:57.817446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d34906-b9f0-4e4a-a1ea-7007316ae3bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:57.818969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d34906-b9f0-4e4a-a1ea-7007316ae3bb None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:57.835761 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 318/644] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:57.835761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6851d8-1467-4014-9e7d-a24689331415 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:57.836396 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 327/645] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:57.837287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d34906-b9f0-4e4a-a1ea-7007316ae3bb None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:57.910971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:57.943575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d34906-b9f0-4e4a-a1ea-7007316ae3bb None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:57.944068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6851d8-1467-4014-9e7d-a24689331415 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:57.958307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:57.982249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c4b21-d32d-4b66-8fb8-9b93df47f506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:57.982917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c4b21-d32d-4b66-8fb8-9b93df47f506 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.983200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c4b21-d32d-4b66-8fb8-9b93df47f506 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.983475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c4b21-d32d-4b66-8fb8-9b93df47f506 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.987189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a966f-0078-4d9b-a7e0-6c57e0dcb5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:57.988021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a966f-0078-4d9b-a7e0-6c57e0dcb5ac None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:57.988297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a966f-0078-4d9b-a7e0-6c57e0dcb5ac None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:57.988565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a966f-0078-4d9b-a7e0-6c57e0dcb5ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:57.994881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c4b21-d32d-4b66-8fb8-9b93df47f506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-120c4b21-d32d-4b66-8fb8-9b93df47f506 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:58.000434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:58.001336 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 328/646] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:58.002347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c4b21-d32d-4b66-8fb8-9b93df47f506 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.065068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a966f-0078-4d9b-a7e0-6c57e0dcb5ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.066527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a966f-0078-4d9b-a7e0-6c57e0dcb5ac None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.115123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c4b21-d32d-4b66-8fb8-9b93df47f506 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.147927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:58.158344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf187c-6d6a-4a69-ba85-87129f1e5562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.159083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf187c-6d6a-4a69-ba85-87129f1e5562 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.159364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf187c-6d6a-4a69-ba85-87129f1e5562 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.159639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf187c-6d6a-4a69-ba85-87129f1e5562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.170548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf187c-6d6a-4a69-ba85-87129f1e5562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.172039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf187c-6d6a-4a69-ba85-87129f1e5562 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.181329 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 319/647] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:58.182412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a966f-0078-4d9b-a7e0-6c57e0dcb5ac None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-eccf187c-6d6a-4a69-ba85-87129f1e5562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:58.192005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:58.192957 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:58.194528 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:58.194528 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:58.194528 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:58.194528 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 329/648] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:58.194528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf187c-6d6a-4a69-ba85-87129f1e5562 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.223442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:58.291841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a966f-0078-4d9b-a7e0-6c57e0dcb5ac None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.315466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf187c-6d6a-4a69-ba85-87129f1e5562 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.329312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0648ef-02fd-405f-a543-b1497568895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.330004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0648ef-02fd-405f-a543-b1497568895d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.330489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0648ef-02fd-405f-a543-b1497568895d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.330597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0648ef-02fd-405f-a543-b1497568895d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.338010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0648ef-02fd-405f-a543-b1497568895d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.339518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0648ef-02fd-405f-a543-b1497568895d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.351026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4560bcd-e93e-40ba-8ec2-a24804ad503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.351641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560bcd-e93e-40ba-8ec2-a24804ad503e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-ab0648ef-02fd-405f-a543-b1497568895d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:58.351766 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:58.352652 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:58.358708 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:58.358708 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:58.358708 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:58.358708 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:58.358708 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:58.358708 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:58.358708 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:58.358708 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:58.358708 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:36:58.358708 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:58.359791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560bcd-e93e-40ba-8ec2-a24804ad503e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.359791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4560bcd-e93e-40ba-8ec2-a24804ad503e None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.359791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4560bcd-e93e-40ba-8ec2-a24804ad503e None admin] RBAC: Adding query filter params (name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:58.359975 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 320/649] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:36:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:58.360042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4560bcd-e93e-40ba-8ec2-a24804ad503e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.360108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0648ef-02fd-405f-a543-b1497568895d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.360182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4560bcd-e93e-40ba-8ec2-a24804ad503e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.366523 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 330/650] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:58.371482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4560bcd-e93e-40ba-8ec2-a24804ad503e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.390338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:58.465441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:58.466646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0648ef-02fd-405f-a543-b1497568895d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.480707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4560bcd-e93e-40ba-8ec2-a24804ad503e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.499615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd7684-ca56-4939-8df4-dc46dc60d2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.500240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd7684-ca56-4939-8df4-dc46dc60d2f2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.500520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd7684-ca56-4939-8df4-dc46dc60d2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.500790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd7684-ca56-4939-8df4-dc46dc60d2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.511852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd7684-ca56-4939-8df4-dc46dc60d2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.513302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd7684-ca56-4939-8df4-dc46dc60d2f2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.514879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f749001-ca29-44ae-b2a4-b9e7c7b984e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.515490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f749001-ca29-44ae-b2a4-b9e7c7b984e1 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.515772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f749001-ca29-44ae-b2a4-b9e7c7b984e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.516047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f749001-ca29-44ae-b2a4-b9e7c7b984e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.516686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f749001-ca29-44ae-b2a4-b9e7c7b984e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:58.516991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f749001-ca29-44ae-b2a4-b9e7c7b984e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.518545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f749001-ca29-44ae-b2a4-b9e7c7b984e1 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-d4dd7684-ca56-4939-8df4-dc46dc60d2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:58.527212 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:58.528160 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:58.529055 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:58.529055 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:58.529055 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:58.529055 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 321/651] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:58.529288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd7684-ca56-4939-8df4-dc46dc60d2f2 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.533603 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 331/652] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:58.533603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f749001-ca29-44ae-b2a4-b9e7c7b984e1 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.618139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:58.635864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd7684-ca56-4939-8df4-dc46dc60d2f2 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.639376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f749001-ca29-44ae-b2a4-b9e7c7b984e1 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.668839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade34054-bd00-494b-8dc8-1c366da31fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.669442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade34054-bd00-494b-8dc8-1c366da31fcc None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.669722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade34054-bd00-494b-8dc8-1c366da31fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.669993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade34054-bd00-494b-8dc8-1c366da31fcc None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.670715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade34054-bd00-494b-8dc8-1c366da31fcc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:58.671051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade34054-bd00-494b-8dc8-1c366da31fcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.672478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade34054-bd00-494b-8dc8-1c366da31fcc None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.673241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88f72a-7c45-41c4-af15-5e371b834b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.674452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88f72a-7c45-41c4-af15-5e371b834b52 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.674773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88f72a-7c45-41c4-af15-5e371b834b52 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.675098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88f72a-7c45-41c4-af15-5e371b834b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.685099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88f72a-7c45-41c4-af15-5e371b834b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.686522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88f72a-7c45-41c4-af15-5e371b834b52 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.690412 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 322/653] 10.222.0.70 () {56 vars in 1137 bytes} [Sun Aug 28 18:36:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:58.691443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121d05-fccf-40c0-b75e-53280df36eab None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.691725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121d05-fccf-40c0-b75e-53280df36eab None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.691996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121d05-fccf-40c0-b75e-53280df36eab None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.697540 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 323/654] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:36:58.697540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31121d05-fccf-40c0-b75e-53280df36eab None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.697811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-aa88f72a-7c45-41c4-af15-5e371b834b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:58.703913 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:58.704932 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:58.706102 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:58.706102 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:58.706102 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:58.706102 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 332/655] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:58.706102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88f72a-7c45-41c4-af15-5e371b834b52 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.802127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31121d05-fccf-40c0-b75e-53280df36eab None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.805253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88f72a-7c45-41c4-af15-5e371b834b52 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.835715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1cc40-34a2-4234-afa4-4981b00257f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.836381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1cc40-34a2-4234-afa4-4981b00257f6 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.836611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1cc40-34a2-4234-afa4-4981b00257f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.836881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1cc40-34a2-4234-afa4-4981b00257f6 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.837511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1cc40-34a2-4234-afa4-4981b00257f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:58.837855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1cc40-34a2-4234-afa4-4981b00257f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.838960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f535d41-dd86-4e6d-8d30-54e4ad666c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.839368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1cc40-34a2-4234-afa4-4981b00257f6 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.839655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535d41-dd86-4e6d-8d30-54e4ad666c99 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.839956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535d41-dd86-4e6d-8d30-54e4ad666c99 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.840232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535d41-dd86-4e6d-8d30-54e4ad666c99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.847369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f535d41-dd86-4e6d-8d30-54e4ad666c99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:58.848795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f535d41-dd86-4e6d-8d30-54e4ad666c99 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:58.855361 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 324/656] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:58.855361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1cc40-34a2-4234-afa4-4981b00257f6 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.857884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-0f535d41-dd86-4e6d-8d30-54e4ad666c99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:36:58.860142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:58.861046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:58.862653 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:36:58.862653 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:36:58.862653 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:36:58.862653 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:36:58.862653 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:36:58.862653 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:36:58.862653 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:58.862653 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:58.862653 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 333/657] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:58.863593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86937a-5a9b-4e9f-a685-1d4b5ada3a35 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.863803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86937a-5a9b-4e9f-a685-1d4b5ada3a35 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.864031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86937a-5a9b-4e9f-a685-1d4b5ada3a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:58.882028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6b86937a-5a9b-4e9f-a685-1d4b5ada3a35 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:36:58.883157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6b86937a-5a9b-4e9f-a685-1d4b5ada3a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:36:58.936470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:58.951973 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 334/658] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:36:58.952962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86937a-5a9b-4e9f-a685-1d4b5ada3a35 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:58.959580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1cc40-34a2-4234-afa4-4981b00257f6 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:58.996035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdc65c-6a97-4bf5-adcd-57cf2086b214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:58.996651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdc65c-6a97-4bf5-adcd-57cf2086b214 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:58.996911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdc65c-6a97-4bf5-adcd-57cf2086b214 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:58.997188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdc65c-6a97-4bf5-adcd-57cf2086b214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.061313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86937a-5a9b-4e9f-a685-1d4b5ada3a35 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.069891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdc65c-6a97-4bf5-adcd-57cf2086b214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.071384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdc65c-6a97-4bf5-adcd-57cf2086b214 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.073568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:59.100477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca6d8c-fa87-4964-9708-aefb5b735697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.101098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca6d8c-fa87-4964-9708-aefb5b735697 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.101381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca6d8c-fa87-4964-9708-aefb5b735697 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.101659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca6d8c-fa87-4964-9708-aefb5b735697 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.102297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca6d8c-fa87-4964-9708-aefb5b735697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:59.102605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca6d8c-fa87-4964-9708-aefb5b735697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.104022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca6d8c-fa87-4964-9708-aefb5b735697 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.120431 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 335/659] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:59.120431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca6d8c-fa87-4964-9708-aefb5b735697 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.172432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:59.187764 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 325/660] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:36:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:36:59.187764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdc65c-6a97-4bf5-adcd-57cf2086b214 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.235400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca6d8c-fa87-4964-9708-aefb5b735697 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.269690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade3216-4fa1-4f5e-bfda-32a8dbc87c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.270317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade3216-4fa1-4f5e-bfda-32a8dbc87c06 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.270600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade3216-4fa1-4f5e-bfda-32a8dbc87c06 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.270914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade3216-4fa1-4f5e-bfda-32a8dbc87c06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.277465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade3216-4fa1-4f5e-bfda-32a8dbc87c06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.278953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade3216-4fa1-4f5e-bfda-32a8dbc87c06 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.285050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdc65c-6a97-4bf5-adcd-57cf2086b214 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.286563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-1ade3216-4fa1-4f5e-bfda-32a8dbc87c06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:36:59.292196 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:59.293192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:59.294073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:36:59.294073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:36:59.294073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:36:59.294073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:36:59.294073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:36:59.294073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:36:59.294073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:36:59.294073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:59.294073 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 336/661] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:59.294073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade3216-4fa1-4f5e-bfda-32a8dbc87c06 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.322669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424335d-9e9a-4fd7-ab26-2e202851e6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.323310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424335d-9e9a-4fd7-ab26-2e202851e6f3 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.323594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424335d-9e9a-4fd7-ab26-2e202851e6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.323870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424335d-9e9a-4fd7-ab26-2e202851e6f3 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.324558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424335d-9e9a-4fd7-ab26-2e202851e6f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:59.324860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424335d-9e9a-4fd7-ab26-2e202851e6f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.326290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424335d-9e9a-4fd7-ab26-2e202851e6f3 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.337981 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 326/662] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:59.338609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424335d-9e9a-4fd7-ab26-2e202851e6f3 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.399596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade3216-4fa1-4f5e-bfda-32a8dbc87c06 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.408892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:59.435648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6a12e-021f-4261-9775-0af823d8ebad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.436203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6a12e-021f-4261-9775-0af823d8ebad None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.436485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6a12e-021f-4261-9775-0af823d8ebad None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.436761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6a12e-021f-4261-9775-0af823d8ebad None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.438464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424335d-9e9a-4fd7-ab26-2e202851e6f3 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.444323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6a12e-021f-4261-9775-0af823d8ebad None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.445766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6a12e-021f-4261-9775-0af823d8ebad None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-1cc6a12e-021f-4261-9775-0af823d8ebad None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:36:59.456970 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:59.458171 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:59.459140 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:59.459140 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:59.459140 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:36:59.459140 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:36:59.459140 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:36:59.459140 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:36:59.459140 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:36:59.459140 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:36:59.459140 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 18:36:59.459140 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:59.459140 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 337/663] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:59.459140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6a12e-021f-4261-9775-0af823d8ebad None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.475374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b19f4-3014-4557-a55b-09078efdeb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.476004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b19f4-3014-4557-a55b-09078efdeb45 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.476302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b19f4-3014-4557-a55b-09078efdeb45 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.476559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b19f4-3014-4557-a55b-09078efdeb45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.487644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b19f4-3014-4557-a55b-09078efdeb45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.489086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b19f4-3014-4557-a55b-09078efdeb45 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-192b19f4-3014-4557-a55b-09078efdeb45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:36:59.503396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:59.504309 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:36:59.509810 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:36:59.509810 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:36:59.509810 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:36:59.509810 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 327/664] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:59.509810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b19f4-3014-4557-a55b-09078efdeb45 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.524342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:59.563964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6a12e-021f-4261-9775-0af823d8ebad None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.600988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338875b-d084-4199-91ba-af48a5b2a2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.601729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338875b-d084-4199-91ba-af48a5b2a2b1 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.602016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338875b-d084-4199-91ba-af48a5b2a2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.602290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338875b-d084-4199-91ba-af48a5b2a2b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.612798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338875b-d084-4199-91ba-af48a5b2a2b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-6338875b-d084-4199-91ba-af48a5b2a2b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:36:59.617971 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:36:59.619178 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:36:59.620052 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:36:59.620052 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:36:59.620052 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:36:59.620052 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:36:59.620052 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:36:59.620052 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:36:59.620052 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:36:59.620052 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:36:59.620052 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:36:59.620052 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:36:59.620052 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:36:59.620052 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:36:59.620052 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 338/665] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:36:59.620742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b19f4-3014-4557-a55b-09078efdeb45 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.620815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338875b-d084-4199-91ba-af48a5b2a2b1 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.648412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:59.656011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0aa1b-6ee9-4965-8798-cfbc742fdc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.656619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0aa1b-6ee9-4965-8798-cfbc742fdc0d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.656903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0aa1b-6ee9-4965-8798-cfbc742fdc0d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.657176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0aa1b-6ee9-4965-8798-cfbc742fdc0d None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.657860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0aa1b-6ee9-4965-8798-cfbc742fdc0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:59.658691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0aa1b-6ee9-4965-8798-cfbc742fdc0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.660153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0aa1b-6ee9-4965-8798-cfbc742fdc0d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.671904 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 328/666] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:59.672691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0aa1b-6ee9-4965-8798-cfbc742fdc0d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.723282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338875b-d084-4199-91ba-af48a5b2a2b1 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.748780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:59.758224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c577a-1b42-4daa-8ade-cf740eb0ba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.758981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c577a-1b42-4daa-8ade-cf740eb0ba27 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.759266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c577a-1b42-4daa-8ade-cf740eb0ba27 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.759543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c577a-1b42-4daa-8ade-cf740eb0ba27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.760274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c577a-1b42-4daa-8ade-cf740eb0ba27 None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=ea8cbbc34aab42a4ada9cbee1772847b) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:59.760586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c577a-1b42-4daa-8ade-cf740eb0ba27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.762028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c577a-1b42-4daa-8ade-cf740eb0ba27 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.768542 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 339/667] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/role_assignments?user.id=ea8cbbc34aab42a4ada9cbee1772847b&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:59.769360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c577a-1b42-4daa-8ade-cf740eb0ba27 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.775312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0aa1b-6ee9-4965-8798-cfbc742fdc0d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.817313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7438ae2-2ce3-4987-9b22-d6d4d9cc60c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.818082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7438ae2-2ce3-4987-9b22-d6d4d9cc60c9 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.818437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7438ae2-2ce3-4987-9b22-d6d4d9cc60c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.818833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7438ae2-2ce3-4987-9b22-d6d4d9cc60c9 None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.819701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7438ae2-2ce3-4987-9b22-d6d4d9cc60c9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:59.820156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7438ae2-2ce3-4987-9b22-d6d4d9cc60c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.821947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7438ae2-2ce3-4987-9b22-d6d4d9cc60c9 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.848470 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 329/668] 10.222.0.70 () {56 vars in 1139 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:59.848470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7438ae2-2ce3-4987-9b22-d6d4d9cc60c9 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:36:59.895014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:36:59.907503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c577a-1b42-4daa-8ade-cf740eb0ba27 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.950424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d7b44-49c6-4ed9-831f-a815524f4312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:36:59.951075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7b44-49c6-4ed9-831f-a815524f4312 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:36:59.951356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7b44-49c6-4ed9-831f-a815524f4312 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:36:59.951636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7b44-49c6-4ed9-831f-a815524f4312 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:36:59.952279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d7b44-49c6-4ed9-831f-a815524f4312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:36:59.952588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d7b44-49c6-4ed9-831f-a815524f4312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:36:59.953962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d7b44-49c6-4ed9-831f-a815524f4312 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:36:59.964253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7438ae2-2ce3-4987-9b22-d6d4d9cc60c9 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:36:59.968117 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 340/669] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:36:59.969304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d7b44-49c6-4ed9-831f-a815524f4312 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.003435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:00.009086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9744e-0515-45cf-807e-e2b6dd2801db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.010031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9744e-0515-45cf-807e-e2b6dd2801db None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.010384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9744e-0515-45cf-807e-e2b6dd2801db None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.010774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9744e-0515-45cf-807e-e2b6dd2801db None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.011441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9744e-0515-45cf-807e-e2b6dd2801db None admin] RBAC: Adding query filter params (name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:00.011745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9744e-0515-45cf-807e-e2b6dd2801db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.013114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9744e-0515-45cf-807e-e2b6dd2801db None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.026028 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 330/670] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:00.026028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9744e-0515-45cf-807e-e2b6dd2801db None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.082890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d7b44-49c6-4ed9-831f-a815524f4312 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.119288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301d77b-6463-4802-a97e-ed9bb2d82150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.119893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301d77b-6463-4802-a97e-ed9bb2d82150 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.120168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301d77b-6463-4802-a97e-ed9bb2d82150 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.120437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301d77b-6463-4802-a97e-ed9bb2d82150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.121588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301d77b-6463-4802-a97e-ed9bb2d82150 None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=332144d9eb5742498c0c37a70277ce5e) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:00.122118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301d77b-6463-4802-a97e-ed9bb2d82150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.123354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301d77b-6463-4802-a97e-ed9bb2d82150 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.138776 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 341/671] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:36:59 2022] GET /identity/v3/role_assignments?user.id=332144d9eb5742498c0c37a70277ce5e&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:00.138776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301d77b-6463-4802-a97e-ed9bb2d82150 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.145143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9744e-0515-45cf-807e-e2b6dd2801db None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.157387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:00.192829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e969d15-f93c-4579-9b2e-4bfa92a412cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.193466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e969d15-f93c-4579-9b2e-4bfa92a412cd None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.193748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e969d15-f93c-4579-9b2e-4bfa92a412cd None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.194287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e969d15-f93c-4579-9b2e-4bfa92a412cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.265960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301d77b-6463-4802-a97e-ed9bb2d82150 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.270175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:00.280106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e969d15-f93c-4579-9b2e-4bfa92a412cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.281965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e969d15-f93c-4579-9b2e-4bfa92a412cd None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.312727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56697b8-3575-48f7-8136-bbe57e20c40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.313476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56697b8-3575-48f7-8136-bbe57e20c40b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.313765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56697b8-3575-48f7-8136-bbe57e20c40b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.314043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56697b8-3575-48f7-8136-bbe57e20c40b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.324257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56697b8-3575-48f7-8136-bbe57e20c40b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.326016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56697b8-3575-48f7-8136-bbe57e20c40b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-d56697b8-3575-48f7-8136-bbe57e20c40b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:00.338809 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:00.339958 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:00.341023 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:00.341023 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:00.341023 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:00.341023 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:00.341023 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:00.341023 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:00.341023 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:00.341023 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:00.341023 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 342/672] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:00.341023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56697b8-3575-48f7-8136-bbe57e20c40b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.418120 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 331/673] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:37:00.419049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e969d15-f93c-4579-9b2e-4bfa92a412cd None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.442925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:00.479594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56697b8-3575-48f7-8136-bbe57e20c40b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.515670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d8e36-d4d1-40da-bbc0-002d8dc251c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.516265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d8e36-d4d1-40da-bbc0-002d8dc251c2 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.516486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d8e36-d4d1-40da-bbc0-002d8dc251c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.516760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d8e36-d4d1-40da-bbc0-002d8dc251c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.528274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d8e36-d4d1-40da-bbc0-002d8dc251c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.529720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d8e36-d4d1-40da-bbc0-002d8dc251c2 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.533160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:00.540436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e969d15-f93c-4579-9b2e-4bfa92a412cd None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-e74d8e36-d4d1-40da-bbc0-002d8dc251c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:00.544920 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:00.546152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:00.547162 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:00.547162 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:00.547162 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:00.555278 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 343/674] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:00.555278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d8e36-d4d1-40da-bbc0-002d8dc251c2 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.602421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5313-19a2-4688-b8f1-ebdf82347540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.604124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5313-19a2-4688-b8f1-ebdf82347540 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.604651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5313-19a2-4688-b8f1-ebdf82347540 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.605131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b5313-19a2-4688-b8f1-ebdf82347540 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.606304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b5313-19a2-4688-b8f1-ebdf82347540 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:00.607712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b5313-19a2-4688-b8f1-ebdf82347540 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.609380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b5313-19a2-4688-b8f1-ebdf82347540 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.626318 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 332/675] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:00.627823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5313-19a2-4688-b8f1-ebdf82347540 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.684281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d8e36-d4d1-40da-bbc0-002d8dc251c2 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.713925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:00.724675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d92118-86a5-4143-8a96-e66e1caf8157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.725312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d92118-86a5-4143-8a96-e66e1caf8157 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.725596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d92118-86a5-4143-8a96-e66e1caf8157 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.725872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d92118-86a5-4143-8a96-e66e1caf8157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.741324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d92118-86a5-4143-8a96-e66e1caf8157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.742810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d92118-86a5-4143-8a96-e66e1caf8157 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-a2d92118-86a5-4143-8a96-e66e1caf8157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:00.760377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:00.761347 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:00.762955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:00.762955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:00.762955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:00.762955 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 344/676] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:00.762955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d92118-86a5-4143-8a96-e66e1caf8157 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.778112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b5313-19a2-4688-b8f1-ebdf82347540 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.820068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091476f-64de-4e47-8941-e0610b50948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.820683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091476f-64de-4e47-8941-e0610b50948b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.821026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091476f-64de-4e47-8941-e0610b50948b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.821298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091476f-64de-4e47-8941-e0610b50948b None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.821935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091476f-64de-4e47-8941-e0610b50948b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:00.822286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091476f-64de-4e47-8941-e0610b50948b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.823690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091476f-64de-4e47-8941-e0610b50948b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.838783 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 333/677] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:00.838783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091476f-64de-4e47-8941-e0610b50948b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.865496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:00.895043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d92118-86a5-4143-8a96-e66e1caf8157 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:00.945836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db7a8a-537a-41c1-b8c6-35a9fde747e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:00.946473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db7a8a-537a-41c1-b8c6-35a9fde747e0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:00.946777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db7a8a-537a-41c1-b8c6-35a9fde747e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:00.947066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db7a8a-537a-41c1-b8c6-35a9fde747e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:00.948547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db7a8a-537a-41c1-b8c6-35a9fde747e0 None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=afece3fa01d040a1ae8e035ea3ff3219) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:00.948950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db7a8a-537a-41c1-b8c6-35a9fde747e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:00.950832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db7a8a-537a-41c1-b8c6-35a9fde747e0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:00.966782 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 345/678] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:00 2022] GET /identity/v3/role_assignments?user.id=afece3fa01d040a1ae8e035ea3ff3219&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:00.966782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db7a8a-537a-41c1-b8c6-35a9fde747e0 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:00.967069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091476f-64de-4e47-8941-e0610b50948b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:01.026200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:01.065778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d280e-bb78-452d-b7fc-3ac507070c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:01.066330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d280e-bb78-452d-b7fc-3ac507070c19 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:01.066556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d280e-bb78-452d-b7fc-3ac507070c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:01.066870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d280e-bb78-452d-b7fc-3ac507070c19 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:01.067513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d280e-bb78-452d-b7fc-3ac507070c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:01.067820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d280e-bb78-452d-b7fc-3ac507070c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:01.069187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d280e-bb78-452d-b7fc-3ac507070c19 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:01.089780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db7a8a-537a-41c1-b8c6-35a9fde747e0 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:01.093535 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 334/679] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:01.101235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d280e-bb78-452d-b7fc-3ac507070c19 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:01.131150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d623b-4d88-40c4-ba1f-fac126c0b1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:01.131796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d623b-4d88-40c4-ba1f-fac126c0b1de None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:01.133473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d623b-4d88-40c4-ba1f-fac126c0b1de None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:01.133473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d623b-4d88-40c4-ba1f-fac126c0b1de None admin] PATH_INFO: `/v3/users/swift` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:01.141716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d623b-4d88-40c4-ba1f-fac126c0b1de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:01.143995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d623b-4d88-40c4-ba1f-fac126c0b1de None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-6b9d623b-4d88-40c4-ba1f-fac126c0b1de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:01.159773 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:01.160755 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:01.161675 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:01.161675 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:01.161675 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:01.161675 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:01.161675 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:01.161675 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:01.161675 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:01.161675 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:01.161675 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:37:01.161675 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:01.161675 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 346/680] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:37:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:01.169880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d623b-4d88-40c4-ba1f-fac126c0b1de None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:01.214617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:01.252836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d280e-bb78-452d-b7fc-3ac507070c19 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:01.303741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20ffa5-dbe1-4b5b-9a06-54e2a19b7da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:01.304938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20ffa5-dbe1-4b5b-9a06-54e2a19b7da6 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:01.305369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20ffa5-dbe1-4b5b-9a06-54e2a19b7da6 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:01.305804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20ffa5-dbe1-4b5b-9a06-54e2a19b7da6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:01.317358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20ffa5-dbe1-4b5b-9a06-54e2a19b7da6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:01.318769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20ffa5-dbe1-4b5b-9a06-54e2a19b7da6 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:01.324759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d623b-4d88-40c4-ba1f-fac126c0b1de None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:01.328224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-6b20ffa5-dbe1-4b5b-9a06-54e2a19b7da6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:01.333789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:01.334792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:01.335677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:01.335677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:01.335677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:01.335677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:01.335677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:01.335677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:01.335677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:01.335677 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:01.336647 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 335/681] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:01.343537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20ffa5-dbe1-4b5b-9a06-54e2a19b7da6 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:01.403343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad2d9c-46b4-415c-b8a8-ea381354da60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:01.404307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad2d9c-46b4-415c-b8a8-ea381354da60 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:01.404769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad2d9c-46b4-415c-b8a8-ea381354da60 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:01.405220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad2d9c-46b4-415c-b8a8-ea381354da60 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:01.406577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad2d9c-46b4-415c-b8a8-ea381354da60 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:01.407097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad2d9c-46b4-415c-b8a8-ea381354da60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:01.409181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad2d9c-46b4-415c-b8a8-ea381354da60 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:01.455706 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 347/682] 10.222.0.70 () {56 vars in 1135 bytes} [Sun Aug 28 18:37:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:01.461559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad2d9c-46b4-415c-b8a8-ea381354da60 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:01.515647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20ffa5-dbe1-4b5b-9a06-54e2a19b7da6 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:01.589903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0595e-997c-42fa-89c3-1628c37b7a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:01.590524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0595e-997c-42fa-89c3-1628c37b7a0c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:01.590830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0595e-997c-42fa-89c3-1628c37b7a0c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:01.591111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0595e-997c-42fa-89c3-1628c37b7a0c None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:01.591816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0595e-997c-42fa-89c3-1628c37b7a0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:01.592127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0595e-997c-42fa-89c3-1628c37b7a0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:01.593565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0595e-997c-42fa-89c3-1628c37b7a0c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:01.603497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:01.634676 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 336/683] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:01.636474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0595e-997c-42fa-89c3-1628c37b7a0c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:01.642731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad2d9c-46b4-415c-b8a8-ea381354da60 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:01.683679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8911b-6f66-4604-9e28-e71e1001e680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:01.685138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8911b-6f66-4604-9e28-e71e1001e680 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:01.685424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8911b-6f66-4604-9e28-e71e1001e680 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:01.685700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8911b-6f66-4604-9e28-e71e1001e680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:01.723499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:01.766567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8911b-6f66-4604-9e28-e71e1001e680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:01.768968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8911b-6f66-4604-9e28-e71e1001e680 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:01.881466 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 348/684] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:37:01.886627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8911b-6f66-4604-9e28-e71e1001e680 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:01.890522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0595e-997c-42fa-89c3-1628c37b7a0c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:01.954699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316b897-ca00-4754-88fd-02cd5e6f1b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:01.955936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316b897-ca00-4754-88fd-02cd5e6f1b2d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:01.956220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316b897-ca00-4754-88fd-02cd5e6f1b2d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:01.956493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316b897-ca00-4754-88fd-02cd5e6f1b2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:01.957225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316b897-ca00-4754-88fd-02cd5e6f1b2d None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=02ed42702778456ab336afdd250a1d41) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:01.957534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316b897-ca00-4754-88fd-02cd5e6f1b2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:01.959187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316b897-ca00-4754-88fd-02cd5e6f1b2d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:01.968148 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 337/685] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:01 2022] GET /identity/v3/role_assignments?user.id=02ed42702778456ab336afdd250a1d41&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:01.969458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7a78a-06e6-482b-a5e6-c838a527ac39 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:01.969745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7a78a-06e6-482b-a5e6-c838a527ac39 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:01.970022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7a78a-06e6-482b-a5e6-c838a527ac39 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:01.972232 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 338/686] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:01.982145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ef907-da8e-49d9-96aa-672a85d6f4a5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:01.982145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ef907-da8e-49d9-96aa-672a85d6f4a5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:01.982145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ef907-da8e-49d9-96aa-672a85d6f4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.003849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-780ef907-da8e-49d9-96aa-672a85d6f4a5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:02.005086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-780ef907-da8e-49d9-96aa-672a85d6f4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:02.021783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:02.075735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:02.094153 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 339/687] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:37:02.130702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8911b-6f66-4604-9e28-e71e1001e680 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:02.188116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64055d3b-e39f-42e0-a8e5-666b65e08487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:02.188847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64055d3b-e39f-42e0-a8e5-666b65e08487 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.189010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64055d3b-e39f-42e0-a8e5-666b65e08487 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.189603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64055d3b-e39f-42e0-a8e5-666b65e08487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.200648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64055d3b-e39f-42e0-a8e5-666b65e08487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:02.202272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64055d3b-e39f-42e0-a8e5-666b65e08487 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-64055d3b-e39f-42e0-a8e5-666b65e08487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:02.219100 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:02.222065 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:02.224251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:02.224251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:02.224251 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:02.224251 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 349/688] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:02.227577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ef907-da8e-49d9-96aa-672a85d6f4a5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:02.340288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ef907-da8e-49d9-96aa-672a85d6f4a5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:02.377845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e94fe1-4ea7-4607-9a08-1771b470a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:02.378862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e94fe1-4ea7-4607-9a08-1771b470a58d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.379345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e94fe1-4ea7-4607-9a08-1771b470a58d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.379842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e94fe1-4ea7-4607-9a08-1771b470a58d None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.380693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e94fe1-4ea7-4607-9a08-1771b470a58d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:02.381195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e94fe1-4ea7-4607-9a08-1771b470a58d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:02.382780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e94fe1-4ea7-4607-9a08-1771b470a58d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:02.385227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7600e-7582-45cc-9ec0-855f4d472776 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.385801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7600e-7582-45cc-9ec0-855f4d472776 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.386317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7600e-7582-45cc-9ec0-855f4d472776 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.388278 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 350/689] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:02.394151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976072-6cd9-409b-aad7-577f3567fc85 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.394773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976072-6cd9-409b-aad7-577f3567fc85 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.395304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976072-6cd9-409b-aad7-577f3567fc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.398136 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 340/690] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:02.403576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e94fe1-4ea7-4607-9a08-1771b470a58d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:02.417974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d2976072-6cd9-409b-aad7-577f3567fc85 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:02.419539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d2976072-6cd9-409b-aad7-577f3567fc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:02.473459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:02.497225 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 351/691] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:37:02.503732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976072-6cd9-409b-aad7-577f3567fc85 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:02.544008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e94fe1-4ea7-4607-9a08-1771b470a58d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:02.598283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff9c36-1b5e-4689-894f-feaedc82f962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:02.598950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff9c36-1b5e-4689-894f-feaedc82f962 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.599233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff9c36-1b5e-4689-894f-feaedc82f962 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.599510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff9c36-1b5e-4689-894f-feaedc82f962 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.606589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff9c36-1b5e-4689-894f-feaedc82f962 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:02.607433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:02.608955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff9c36-1b5e-4689-894f-feaedc82f962 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-11ff9c36-1b5e-4689-894f-feaedc82f962 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:02.623009 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:02.623926 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:02.624817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:02.624817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:02.624817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:02.624817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:02.624817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:02.624817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:02.624817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:02.624817 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:02.629769 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 341/692] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:02.630967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff9c36-1b5e-4689-894f-feaedc82f962 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:02.715032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976072-6cd9-409b-aad7-577f3567fc85 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:02.769933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f94983-b894-496e-814b-8445c19abe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:02.770603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f94983-b894-496e-814b-8445c19abe24 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.770953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f94983-b894-496e-814b-8445c19abe24 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.771273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f94983-b894-496e-814b-8445c19abe24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.794135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f94983-b894-496e-814b-8445c19abe24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-51f94983-b894-496e-814b-8445c19abe24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:02.805833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:02.806911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:02.807997 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:02.807997 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:02.807997 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:02.807997 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:02.807997 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:02.807997 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:02.807997 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:02.807997 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:02.807997 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:02.807997 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:02.807997 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:02.807997 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:02.807997 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 352/693] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:37:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:02.813056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f94983-b894-496e-814b-8445c19abe24 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:02.835545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff9c36-1b5e-4689-894f-feaedc82f962 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:02.851192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:02.874514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04341687-86a8-444c-8529-57bf99119c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:02.875194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04341687-86a8-444c-8529-57bf99119c72 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.875476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04341687-86a8-444c-8529-57bf99119c72 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.875751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04341687-86a8-444c-8529-57bf99119c72 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.876512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04341687-86a8-444c-8529-57bf99119c72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:02.877372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04341687-86a8-444c-8529-57bf99119c72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:02.878965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04341687-86a8-444c-8529-57bf99119c72 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:02.892335 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 342/694] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:02.893263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04341687-86a8-444c-8529-57bf99119c72 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:02.941223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f94983-b894-496e-814b-8445c19abe24 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:02.944649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:02.984026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee75a-dade-4fc7-a703-b016a43f2eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:02.984819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee75a-dade-4fc7-a703-b016a43f2eb5 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:02.985143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee75a-dade-4fc7-a703-b016a43f2eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:02.985549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee75a-dade-4fc7-a703-b016a43f2eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:02.986889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ee75a-dade-4fc7-a703-b016a43f2eb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:02.987230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ee75a-dade-4fc7-a703-b016a43f2eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:02.988641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ee75a-dade-4fc7-a703-b016a43f2eb5 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:02.998505 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 353/695] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:37:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:02.999537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee75a-dade-4fc7-a703-b016a43f2eb5 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:03.023813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04341687-86a8-444c-8529-57bf99119c72 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:03.072761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f64bcb-cc4c-4351-bc5a-ee7eee51865c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:03.073697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f64bcb-cc4c-4351-bc5a-ee7eee51865c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:03.073977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f64bcb-cc4c-4351-bc5a-ee7eee51865c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:03.074728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f64bcb-cc4c-4351-bc5a-ee7eee51865c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:03.087282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f64bcb-cc4c-4351-bc5a-ee7eee51865c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:03.088777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f64bcb-cc4c-4351-bc5a-ee7eee51865c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-86f64bcb-cc4c-4351-bc5a-ee7eee51865c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:03.104839 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:03.105799 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:03.108572 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:03.108572 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:03.108572 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:03.108572 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 343/696] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:03.112098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f64bcb-cc4c-4351-bc5a-ee7eee51865c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:03.118810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee75a-dade-4fc7-a703-b016a43f2eb5 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:03.134987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:03.161916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae0303-8ed2-4825-a871-5ef6808fd5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:03.162530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae0303-8ed2-4825-a871-5ef6808fd5a3 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:03.162898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae0303-8ed2-4825-a871-5ef6808fd5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:03.163186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae0303-8ed2-4825-a871-5ef6808fd5a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:03.164017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae0303-8ed2-4825-a871-5ef6808fd5a3 None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=8787e53dd76c430e9ebe69b79b69827e) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:03.164430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae0303-8ed2-4825-a871-5ef6808fd5a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:03.166062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae0303-8ed2-4825-a871-5ef6808fd5a3 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:03.172950 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 354/697] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:02 2022] GET /identity/v3/role_assignments?user.id=8787e53dd76c430e9ebe69b79b69827e&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:03.174673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae0303-8ed2-4825-a871-5ef6808fd5a3 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:03.213261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:03.256650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f64bcb-cc4c-4351-bc5a-ee7eee51865c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:03.300988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae0303-8ed2-4825-a871-5ef6808fd5a3 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:03.334026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccc8af-b4a9-4249-86fc-bd1337bc456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:03.334669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc8af-b4a9-4249-86fc-bd1337bc456f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:03.335000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc8af-b4a9-4249-86fc-bd1337bc456f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:03.335278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccc8af-b4a9-4249-86fc-bd1337bc456f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:03.339139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ac11c-0125-40da-8533-3de1af487cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:03.339756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ac11c-0125-40da-8533-3de1af487cbf None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:03.340037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ac11c-0125-40da-8533-3de1af487cbf None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:03.340316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ac11c-0125-40da-8533-3de1af487cbf None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:03.340962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ac11c-0125-40da-8533-3de1af487cbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:03.341266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ac11c-0125-40da-8533-3de1af487cbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:03.342651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ac11c-0125-40da-8533-3de1af487cbf None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:03.348980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccc8af-b4a9-4249-86fc-bd1337bc456f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:03.350455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccc8af-b4a9-4249-86fc-bd1337bc456f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:03.356926 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 355/698] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:03.363325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ac11c-0125-40da-8533-3de1af487cbf None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-20ccc8af-b4a9-4249-86fc-bd1337bc456f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:03.368135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:03.369045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:03.369909 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:03.369909 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:03.369909 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:03.374167 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 344/699] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:03.375491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccc8af-b4a9-4249-86fc-bd1337bc456f None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:03.471028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:03.497791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:03.510214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccc8af-b4a9-4249-86fc-bd1337bc456f None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:03.511035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ac11c-0125-40da-8533-3de1af487cbf None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:03.554559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb0862-0b1c-40a9-a2b9-a7974c5a9c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:03.555199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb0862-0b1c-40a9-a2b9-a7974c5a9c57 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:03.555480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb0862-0b1c-40a9-a2b9-a7974c5a9c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:03.555808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb0862-0b1c-40a9-a2b9-a7974c5a9c57 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:03.556598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb0862-0b1c-40a9-a2b9-a7974c5a9c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:03.556866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb0862-0b1c-40a9-a2b9-a7974c5a9c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:03.558860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb0862-0b1c-40a9-a2b9-a7974c5a9c57 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:03.570629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c7ec0-2f2b-423c-ae28-858823bf4d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:03.571317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c7ec0-2f2b-423c-ae28-858823bf4d95 None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:03.571604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c7ec0-2f2b-423c-ae28-858823bf4d95 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:03.571879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c7ec0-2f2b-423c-ae28-858823bf4d95 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:03.572544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c7ec0-2f2b-423c-ae28-858823bf4d95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:03.573982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c7ec0-2f2b-423c-ae28-858823bf4d95 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:03.577492 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 345/700] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:03.577492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4521510-0605-48c0-82d2-b111235e2160 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:03.577680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4521510-0605-48c0-82d2-b111235e2160 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:03.578039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4521510-0605-48c0-82d2-b111235e2160 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:03.581283 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 346/701] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:03.586780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4521510-0605-48c0-82d2-b111235e2160 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:03.604543 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 356/702] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:37:03 2022] POST /identity/v3/users => generated 254 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:03.605984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec815a-b60c-43ee-bee7-5921341af0e9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:03.606278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec815a-b60c-43ee-bee7-5921341af0e9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:03.606602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec815a-b60c-43ee-bee7-5921341af0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:03.627858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5cec815a-b60c-43ee-bee7-5921341af0e9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:03.629182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5cec815a-b60c-43ee-bee7-5921341af0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:03.727084 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 357/703] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:37:03.801123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4521510-0605-48c0-82d2-b111235e2160 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:03.834268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:03.840109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd410feb-6ec6-4753-8a2c-d015419252fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:03.840804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd410feb-6ec6-4753-8a2c-d015419252fc None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:03.841088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd410feb-6ec6-4753-8a2c-d015419252fc None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:03.841366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd410feb-6ec6-4753-8a2c-d015419252fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:03.849967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd410feb-6ec6-4753-8a2c-d015419252fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:03.851670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd410feb-6ec6-4753-8a2c-d015419252fc None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-dd410feb-6ec6-4753-8a2c-d015419252fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:03.865451 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:03.866495 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:03.867449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:03.867449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:03.867449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:03.867449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:03.867449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:03.867449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:03.867449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:03.867449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:03.867449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:37:03.867449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:03.867449 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 347/704] 10.222.0.70 () {56 vars in 1093 bytes} [Sun Aug 28 18:37:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:03.872462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec815a-b60c-43ee-bee7-5921341af0e9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:03.962394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:03.994364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec815a-b60c-43ee-bee7-5921341af0e9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:04.018846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd410feb-6ec6-4753-8a2c-d015419252fc None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:04.045700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c7956-e9ad-47ed-af2e-a2d61ea75820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:04.046704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c7956-e9ad-47ed-af2e-a2d61ea75820 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:04.047268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c7956-e9ad-47ed-af2e-a2d61ea75820 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:04.047749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c7956-e9ad-47ed-af2e-a2d61ea75820 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:04.050714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c7956-e9ad-47ed-af2e-a2d61ea75820 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:04.051471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c7956-e9ad-47ed-af2e-a2d61ea75820 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:04.053856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c7956-e9ad-47ed-af2e-a2d61ea75820 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:04.083720 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 358/705] 10.222.0.70 () {56 vars in 1133 bytes} [Sun Aug 28 18:37:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:04.089367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c7956-e9ad-47ed-af2e-a2d61ea75820 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:04.160140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd410feb-6ec6-4753-8a2c-d015419252fc None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:04.199611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81959fc8-2b66-4174-9120-349f4069e268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:04.200295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81959fc8-2b66-4174-9120-349f4069e268 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:04.200576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81959fc8-2b66-4174-9120-349f4069e268 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:04.200818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81959fc8-2b66-4174-9120-349f4069e268 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:04.201371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81959fc8-2b66-4174-9120-349f4069e268 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:04.202734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81959fc8-2b66-4174-9120-349f4069e268 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-81959fc8-2b66-4174-9120-349f4069e268 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:04.215905 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:04.217043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:04.218524 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 348/706] 10.222.0.70 () {56 vars in 1129 bytes} [Sun Aug 28 18:37:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:04.223897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81959fc8-2b66-4174-9120-349f4069e268 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:04.233002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c7956-e9ad-47ed-af2e-a2d61ea75820 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:04.279786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32a910-ceff-4015-838f-b042210f881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:04.280909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a910-ceff-4015-838f-b042210f881b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:04.281773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a910-ceff-4015-838f-b042210f881b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:04.282241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a910-ceff-4015-838f-b042210f881b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:04.287968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:04.364275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:04.385725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32a910-ceff-4015-838f-b042210f881b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:04.387708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32a910-ceff-4015-838f-b042210f881b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:04.458725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81959fc8-2b66-4174-9120-349f4069e268 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:04.503651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16ccf8-0ee6-4269-97de-556af4fd1a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:04.504518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ccf8-0ee6-4269-97de-556af4fd1a75 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:04.504980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ccf8-0ee6-4269-97de-556af4fd1a75 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:04.505428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ccf8-0ee6-4269-97de-556af4fd1a75 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:04.506452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16ccf8-0ee6-4269-97de-556af4fd1a75 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:04.507023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16ccf8-0ee6-4269-97de-556af4fd1a75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:04.509254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16ccf8-0ee6-4269-97de-556af4fd1a75 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:04.514359 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 349/707] 10.222.0.70 () {56 vars in 1124 bytes} [Sun Aug 28 18:37:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:04.515657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec86a-49ae-41c0-adfa-7a8603c128e4 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:04.515945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec86a-49ae-41c0-adfa-7a8603c128e4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:04.516221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec86a-49ae-41c0-adfa-7a8603c128e4 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:04.522521 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 350/708] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:04.523428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ec86a-49ae-41c0-adfa-7a8603c128e4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:04.554365 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 359/709] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 18:37:04.556891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f250444-d0d6-4462-bc9e-7a5f124ce2a5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:04.557392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f250444-d0d6-4462-bc9e-7a5f124ce2a5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:04.558294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f250444-d0d6-4462-bc9e-7a5f124ce2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:04.583701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6f250444-d0d6-4462-bc9e-7a5f124ce2a5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:04.585451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6f250444-d0d6-4462-bc9e-7a5f124ce2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:04.637213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:04.682034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ec86a-49ae-41c0-adfa-7a8603c128e4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:04.695975 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 360/710] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:37:04.697549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f250444-d0d6-4462-bc9e-7a5f124ce2a5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:04.713281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:04.752037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8e11e-08cc-4b5b-b68a-a407dcfa72cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:04.753223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8e11e-08cc-4b5b-b68a-a407dcfa72cc None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:04.753223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8e11e-08cc-4b5b-b68a-a407dcfa72cc None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:04.753401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8e11e-08cc-4b5b-b68a-a407dcfa72cc None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:04.753950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8e11e-08cc-4b5b-b68a-a407dcfa72cc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:04.754255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8e11e-08cc-4b5b-b68a-a407dcfa72cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:04.755666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8e11e-08cc-4b5b-b68a-a407dcfa72cc None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:04.762246 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 351/711] 10.222.0.70 () {56 vars in 1124 bytes} [Sun Aug 28 18:37:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:04.852475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f250444-d0d6-4462-bc9e-7a5f124ce2a5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:04.908052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f68e1-0726-4e4d-bd28-564de320a0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:04.908658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f68e1-0726-4e4d-bd28-564de320a0cc None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:04.908941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f68e1-0726-4e4d-bd28-564de320a0cc None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:04.909275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f68e1-0726-4e4d-bd28-564de320a0cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:04.930379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f68e1-0726-4e4d-bd28-564de320a0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:04.931876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f68e1-0726-4e4d-bd28-564de320a0cc None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-0a2f68e1-0726-4e4d-bd28-564de320a0cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:04.958046 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:04.959073 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:04.960965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:04.960965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:04.960965 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:04.960965 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 361/712] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:04.965261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8e11e-08cc-4b5b-b68a-a407dcfa72cc None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:05.072601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f68e1-0726-4e4d-bd28-564de320a0cc None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:05.101575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:05.108914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8e11e-08cc-4b5b-b68a-a407dcfa72cc None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:05.151439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863ceac-b44a-4533-9375-660e13e93107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:05.152057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863ceac-b44a-4533-9375-660e13e93107 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:05.152343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863ceac-b44a-4533-9375-660e13e93107 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:05.152616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863ceac-b44a-4533-9375-660e13e93107 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:05.153269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863ceac-b44a-4533-9375-660e13e93107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:05.153577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863ceac-b44a-4533-9375-660e13e93107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:05.155007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863ceac-b44a-4533-9375-660e13e93107 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:05.184209 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 352/713] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:05.191355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863ceac-b44a-4533-9375-660e13e93107 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:05.220461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f68e1-0726-4e4d-bd28-564de320a0cc None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:05.277819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:05.291755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b0583-4f31-4783-9299-15df3c9ec199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:05.292463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b0583-4f31-4783-9299-15df3c9ec199 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:05.292751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b0583-4f31-4783-9299-15df3c9ec199 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:05.293024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b0583-4f31-4783-9299-15df3c9ec199 None admin] PATH_INFO: `/v3/services/network` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:05.293673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b0583-4f31-4783-9299-15df3c9ec199 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:05.295208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b0583-4f31-4783-9299-15df3c9ec199 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-189b0583-4f31-4783-9299-15df3c9ec199 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:05.309887 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:05.310956 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:05.312499 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 362/714] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:05 2022] GET /identity/v3/services/network => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:05.318444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b0583-4f31-4783-9299-15df3c9ec199 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:05.393852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863ceac-b44a-4533-9375-660e13e93107 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:05.447890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297edac-34d3-4522-9dd8-3bec5c8b061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:05.448451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297edac-34d3-4522-9dd8-3bec5c8b061f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:05.448734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297edac-34d3-4522-9dd8-3bec5c8b061f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:05.449010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297edac-34d3-4522-9dd8-3bec5c8b061f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:05.456325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297edac-34d3-4522-9dd8-3bec5c8b061f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:05.457768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297edac-34d3-4522-9dd8-3bec5c8b061f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-7297edac-34d3-4522-9dd8-3bec5c8b061f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:05.469135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:05.470076 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:05.471900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:05.471900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:05.471900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:05.471900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:05.471900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:05.471900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:05.471900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:05.471900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:05.471900 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 353/715] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:05.478430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297edac-34d3-4522-9dd8-3bec5c8b061f None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:05.501593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:05.540188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b0583-4f31-4783-9299-15df3c9ec199 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:05.615988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964c4bf-d35c-4a25-87b2-d7860041fec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:05.616610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964c4bf-d35c-4a25-87b2-d7860041fec0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:05.616890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964c4bf-d35c-4a25-87b2-d7860041fec0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:05.617164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964c4bf-d35c-4a25-87b2-d7860041fec0 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:05.617798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964c4bf-d35c-4a25-87b2-d7860041fec0 None admin] RBAC: Adding query filter params (name=network) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:05.618097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964c4bf-d35c-4a25-87b2-d7860041fec0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:05.622700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964c4bf-d35c-4a25-87b2-d7860041fec0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:05.630809 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 363/716] 10.222.0.70 () {56 vars in 1112 bytes} [Sun Aug 28 18:37:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:05.636908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964c4bf-d35c-4a25-87b2-d7860041fec0 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:05.672607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297edac-34d3-4522-9dd8-3bec5c8b061f None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:05.677096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:05.733552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de49800-5ea4-4fda-a87d-a80ec4d572c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:05.734076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de49800-5ea4-4fda-a87d-a80ec4d572c7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:05.734359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de49800-5ea4-4fda-a87d-a80ec4d572c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:05.734635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de49800-5ea4-4fda-a87d-a80ec4d572c7 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:05.735354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de49800-5ea4-4fda-a87d-a80ec4d572c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:05.735661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de49800-5ea4-4fda-a87d-a80ec4d572c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:05.737661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de49800-5ea4-4fda-a87d-a80ec4d572c7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:05.761846 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 354/717] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:05.766066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de49800-5ea4-4fda-a87d-a80ec4d572c7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:05.821697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964c4bf-d35c-4a25-87b2-d7860041fec0 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:05.886560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517562a-d9b7-42dd-95e5-9cb11de2530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:05.887591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517562a-d9b7-42dd-95e5-9cb11de2530e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:05.888070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517562a-d9b7-42dd-95e5-9cb11de2530e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:05.888539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517562a-d9b7-42dd-95e5-9cb11de2530e None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:05.889359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517562a-d9b7-42dd-95e5-9cb11de2530e None admin] RBAC: Adding query filter params (type=network) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:05.889856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517562a-d9b7-42dd-95e5-9cb11de2530e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:05.892805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517562a-d9b7-42dd-95e5-9cb11de2530e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:05.901203 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 364/718] 10.222.0.70 () {56 vars in 1112 bytes} [Sun Aug 28 18:37:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:05.902807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3d2fb-485b-447c-bad6-d4e1c5d9e2eb None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:05.903277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3d2fb-485b-447c-bad6-d4e1c5d9e2eb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:05.904194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3d2fb-485b-447c-bad6-d4e1c5d9e2eb None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:05.911131 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 365/719] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:05.913626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b582d3-f2d9-488c-a390-2ce32bb6acd3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:05.913924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b582d3-f2d9-488c-a390-2ce32bb6acd3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:05.914207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b582d3-f2d9-488c-a390-2ce32bb6acd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:05.925949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de49800-5ea4-4fda-a87d-a80ec4d572c7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:05.933545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-58b582d3-f2d9-488c-a390-2ce32bb6acd3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:05.934923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-58b582d3-f2d9-488c-a390-2ce32bb6acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:05.936987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:05.976669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafd9b2-ed5f-4f92-88e1-69ef04729022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:05.977301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafd9b2-ed5f-4f92-88e1-69ef04729022 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:05.977589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafd9b2-ed5f-4f92-88e1-69ef04729022 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:05.977865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafd9b2-ed5f-4f92-88e1-69ef04729022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:05.978661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafd9b2-ed5f-4f92-88e1-69ef04729022 None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=ea8cbbc34aab42a4ada9cbee1772847b) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:05.979005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafd9b2-ed5f-4f92-88e1-69ef04729022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:05.980492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafd9b2-ed5f-4f92-88e1-69ef04729022 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:05.989491 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 355/720] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:05 2022] GET /identity/v3/role_assignments?user.id=ea8cbbc34aab42a4ada9cbee1772847b&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:06.019403 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 366/721] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:37:06.232384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6a984-29ab-4795-8001-a08863743e25 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:06.232906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6a984-29ab-4795-8001-a08863743e25 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:06.232985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6a984-29ab-4795-8001-a08863743e25 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:06.234267 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 356/722] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:06.240531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c7e73-4312-49f3-be46-ccebcd177c9f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:06.240813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c7e73-4312-49f3-be46-ccebcd177c9f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:06.241092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c7e73-4312-49f3-be46-ccebcd177c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:06.277116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-832c7e73-4312-49f3-be46-ccebcd177c9f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:06.278319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-832c7e73-4312-49f3-be46-ccebcd177c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:06.321220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6a984-29ab-4795-8001-a08863743e25 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:06.398222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:06.402345 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 367/723] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:37:06.538240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6a984-29ab-4795-8001-a08863743e25 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:06.574220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6962a-24da-496f-b6bf-4990d6c955e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:06.582789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6962a-24da-496f-b6bf-4990d6c955e4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:06.582789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6962a-24da-496f-b6bf-4990d6c955e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:06.582789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6962a-24da-496f-b6bf-4990d6c955e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:06.602217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6962a-24da-496f-b6bf-4990d6c955e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-abe6962a-24da-496f-b6bf-4990d6c955e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:06.610680 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:06.612420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:06.613439 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:06.613439 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:06.613439 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:06.613439 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:06.613439 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:06.613439 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:06.613439 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:06.613439 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:06.613439 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:06.613439 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:06.613439 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:06.613439 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:06.615652 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 357/724] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:06.621067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c7e73-4312-49f3-be46-ccebcd177c9f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:06.718091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:06.770179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c7e73-4312-49f3-be46-ccebcd177c9f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:06.828419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a21ad0-59a5-476f-938b-6245b2a72751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:06.828967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a21ad0-59a5-476f-938b-6245b2a72751 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:06.829255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a21ad0-59a5-476f-938b-6245b2a72751 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:06.829536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a21ad0-59a5-476f-938b-6245b2a72751 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:06.830586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a21ad0-59a5-476f-938b-6245b2a72751 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:06.830930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a21ad0-59a5-476f-938b-6245b2a72751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:06.832310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a21ad0-59a5-476f-938b-6245b2a72751 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:06.849863 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 368/725] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:37:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:06.860737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6962a-24da-496f-b6bf-4990d6c955e4 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:06.880073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a21ad0-59a5-476f-938b-6245b2a72751 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:07.088693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a21ad0-59a5-476f-938b-6245b2a72751 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:07.130163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d3b78-054a-4adf-9eed-503b8bf57ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:07.130864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d3b78-054a-4adf-9eed-503b8bf57ff0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:07.131157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d3b78-054a-4adf-9eed-503b8bf57ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:07.131663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d3b78-054a-4adf-9eed-503b8bf57ff0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:07.138226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:07.146356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d3b78-054a-4adf-9eed-503b8bf57ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-974d3b78-054a-4adf-9eed-503b8bf57ff0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:07.153085 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:07.154001 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:07.154876 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:07.154876 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:07.154876 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:07.154876 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:07.154876 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:07.154876 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:07.154876 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:07.154876 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:07.154876 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:07.154876 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:07.154876 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:37:07.154876 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:07.157576 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 369/726] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:37:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:07.158942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:07.165018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d3b78-054a-4adf-9eed-503b8bf57ff0 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:07.188644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6962a-24da-496f-b6bf-4990d6c955e4 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:07.260943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18b281-0f02-4c79-b279-ce8154cdcec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:07.261773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b281-0f02-4c79-b279-ce8154cdcec3 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:07.262163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b281-0f02-4c79-b279-ce8154cdcec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:07.262825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b281-0f02-4c79-b279-ce8154cdcec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:07.275940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18b281-0f02-4c79-b279-ce8154cdcec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:07.277742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18b281-0f02-4c79-b279-ce8154cdcec3 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:07.288689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d3b78-054a-4adf-9eed-503b8bf57ff0 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-7f18b281-0f02-4c79-b279-ce8154cdcec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:07.296801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:07.297768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:07.299261 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:07.299261 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:07.299261 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:07.299261 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 358/727] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:07.304272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bda73-f043-4b4e-9b78-0203e73395c4 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:07.304752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bda73-f043-4b4e-9b78-0203e73395c4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:07.306971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bda73-f043-4b4e-9b78-0203e73395c4 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:07.308724 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 359/728] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:07.310947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bda73-f043-4b4e-9b78-0203e73395c4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:07.339824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5338b-7d5e-4ed6-82a3-8c1442c51766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:07.340302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5338b-7d5e-4ed6-82a3-8c1442c51766 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:07.340659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5338b-7d5e-4ed6-82a3-8c1442c51766 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:07.341009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5338b-7d5e-4ed6-82a3-8c1442c51766 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:07.341750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5338b-7d5e-4ed6-82a3-8c1442c51766 None admin] RBAC: Adding query filter params (name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:07.342131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5338b-7d5e-4ed6-82a3-8c1442c51766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:07.343626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5338b-7d5e-4ed6-82a3-8c1442c51766 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:07.353826 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 370/729] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:37:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:07.355357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e5329-41cf-44e6-8fe7-4f5c585f52c5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:07.355871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e5329-41cf-44e6-8fe7-4f5c585f52c5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:07.356347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e5329-41cf-44e6-8fe7-4f5c585f52c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:07.381295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c11e5329-41cf-44e6-8fe7-4f5c585f52c5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:07.382482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c11e5329-41cf-44e6-8fe7-4f5c585f52c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:07.438611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:07.440673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bda73-f043-4b4e-9b78-0203e73395c4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:07.471015 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 371/730] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:37:07.472668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e5329-41cf-44e6-8fe7-4f5c585f52c5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:07.482664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c38cf-cc86-4ebc-a654-84f8565fad54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:07.483373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c38cf-cc86-4ebc-a654-84f8565fad54 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:07.483655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c38cf-cc86-4ebc-a654-84f8565fad54 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:07.483929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c38cf-cc86-4ebc-a654-84f8565fad54 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:07.484947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c38cf-cc86-4ebc-a654-84f8565fad54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:07.485057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c38cf-cc86-4ebc-a654-84f8565fad54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:07.487247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c38cf-cc86-4ebc-a654-84f8565fad54 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:07.497514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:07.509708 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 360/731] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:07.515241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c38cf-cc86-4ebc-a654-84f8565fad54 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:07.600065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e5329-41cf-44e6-8fe7-4f5c585f52c5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:07.649605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4211439-a234-43d6-a8d6-f6461c9f2468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:07.650623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211439-a234-43d6-a8d6-f6461c9f2468 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:07.651157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211439-a234-43d6-a8d6-f6461c9f2468 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:07.651635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211439-a234-43d6-a8d6-f6461c9f2468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:07.665168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4211439-a234-43d6-a8d6-f6461c9f2468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:07.666902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4211439-a234-43d6-a8d6-f6461c9f2468 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-f4211439-a234-43d6-a8d6-f6461c9f2468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:07.684889 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:07.685851 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:07.686717 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:07.686717 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:07.686717 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:07.689490 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 372/732] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:07.696945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4211439-a234-43d6-a8d6-f6461c9f2468 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:07.734391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c38cf-cc86-4ebc-a654-84f8565fad54 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:07.741098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:07.803839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2e856-83a2-4d36-bb49-580b88107371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:07.804785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2e856-83a2-4d36-bb49-580b88107371 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:07.805242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2e856-83a2-4d36-bb49-580b88107371 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:07.805684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2e856-83a2-4d36-bb49-580b88107371 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:07.821718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4211439-a234-43d6-a8d6-f6461c9f2468 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:07.822981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2e856-83a2-4d36-bb49-580b88107371 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:07.824872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2e856-83a2-4d36-bb49-580b88107371 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-28f2e856-83a2-4d36-bb49-580b88107371 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:07.848689 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:07.849842 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:07.851072 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:07.851072 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:07.851072 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:07.851072 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:07.851072 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:07.851072 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:07.851072 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:07.851072 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:07.851072 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:37:07.851072 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:07.858364 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 361/733] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:37:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:07.863161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5df18a-ddf2-4e28-91f9-8519adbb54e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:07.863924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5df18a-ddf2-4e28-91f9-8519adbb54e7 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:07.864270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2e856-83a2-4d36-bb49-580b88107371 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:07.864386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5df18a-ddf2-4e28-91f9-8519adbb54e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:07.864747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5df18a-ddf2-4e28-91f9-8519adbb54e7 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:07.865669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5df18a-ddf2-4e28-91f9-8519adbb54e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:07.866073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5df18a-ddf2-4e28-91f9-8519adbb54e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:07.867574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5df18a-ddf2-4e28-91f9-8519adbb54e7 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:07.885630 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 373/734] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:07.887026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5df18a-ddf2-4e28-91f9-8519adbb54e7 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:07.945451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:07.995180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:08.003350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5df18a-ddf2-4e28-91f9-8519adbb54e7 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:08.007616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2e856-83a2-4d36-bb49-580b88107371 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:08.048455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfda8c0-64c1-40f5-9a5f-4d530948339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:08.049072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfda8c0-64c1-40f5-9a5f-4d530948339e None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:08.049342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfda8c0-64c1-40f5-9a5f-4d530948339e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:08.049610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfda8c0-64c1-40f5-9a5f-4d530948339e None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:08.050258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfda8c0-64c1-40f5-9a5f-4d530948339e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:08.051825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfda8c0-64c1-40f5-9a5f-4d530948339e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:08.057451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfaa74-f4e9-40bf-9472-8e08ae10ed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:08.058605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfaa74-f4e9-40bf-9472-8e08ae10ed09 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:08.059225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfaa74-f4e9-40bf-9472-8e08ae10ed09 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:08.059758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfaa74-f4e9-40bf-9472-8e08ae10ed09 None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:08.060810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfaa74-f4e9-40bf-9472-8e08ae10ed09 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:08.061341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfaa74-f4e9-40bf-9472-8e08ae10ed09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:08.063564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfaa74-f4e9-40bf-9472-8e08ae10ed09 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:08.078849 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 374/735] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:37:07 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:08.080504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfda8c0-64c1-40f5-9a5f-4d530948339e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:08.087539 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 362/736] 10.222.0.70 () {56 vars in 1135 bytes} [Sun Aug 28 18:37:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:08.094829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfaa74-f4e9-40bf-9472-8e08ae10ed09 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:08.218140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfaa74-f4e9-40bf-9472-8e08ae10ed09 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:08.239334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:08.275999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3b3cf-840a-440c-8ac7-8d8422078243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:08.276624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b3cf-840a-440c-8ac7-8d8422078243 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:08.276892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b3cf-840a-440c-8ac7-8d8422078243 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:08.277168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b3cf-840a-440c-8ac7-8d8422078243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:08.338703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfda8c0-64c1-40f5-9a5f-4d530948339e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:08.361727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3b3cf-840a-440c-8ac7-8d8422078243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:08.363305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3b3cf-840a-440c-8ac7-8d8422078243 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:08.387137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079836e-2e5c-42ea-91d1-3caadee17fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:08.387784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079836e-2e5c-42ea-91d1-3caadee17fa0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:08.388072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079836e-2e5c-42ea-91d1-3caadee17fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:08.388643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079836e-2e5c-42ea-91d1-3caadee17fa0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:08.400065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079836e-2e5c-42ea-91d1-3caadee17fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:08.401574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079836e-2e5c-42ea-91d1-3caadee17fa0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-f079836e-2e5c-42ea-91d1-3caadee17fa0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:08.419081 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:08.420058 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:08.420977 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:08.420977 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:08.420977 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:08.420977 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:08.420977 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:08.420977 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:08.420977 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:08.420977 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:08.420977 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:37:08.420977 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:08.420977 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 375/737] 10.222.0.70 () {56 vars in 1117 bytes} [Sun Aug 28 18:37:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:08.422060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b16e27-5de5-4af8-8202-9ab0818cb9b5 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:08.422060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b16e27-5de5-4af8-8202-9ab0818cb9b5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:08.422223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b16e27-5de5-4af8-8202-9ab0818cb9b5 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:08.427898 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 376/738] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:08.433680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8b737-3623-4b52-a6b8-ed8fb375db2d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:08.433968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8b737-3623-4b52-a6b8-ed8fb375db2d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:08.434243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8b737-3623-4b52-a6b8-ed8fb375db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:08.454988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-89d8b737-3623-4b52-a6b8-ed8fb375db2d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:08.456255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-89d8b737-3623-4b52-a6b8-ed8fb375db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:08.465927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:08.478634 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 363/739] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:08 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:37:08.479449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3b3cf-840a-440c-8ac7-8d8422078243 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:08.495319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:08.535486 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 377/740] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 18:37:08.536588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ce3a9-3984-45c2-95b7-b178b3fbadbc None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:08.536946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ce3a9-3984-45c2-95b7-b178b3fbadbc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:08.537231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ce3a9-3984-45c2-95b7-b178b3fbadbc None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:08.538647 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 378/741] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:08.543137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ce3a9-3984-45c2-95b7-b178b3fbadbc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:08.607241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3b3cf-840a-440c-8ac7-8d8422078243 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:08.647443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4bdc1-1478-423f-bb13-2f9b6f06e5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:08.648510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4bdc1-1478-423f-bb13-2f9b6f06e5f5 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:08.649142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4bdc1-1478-423f-bb13-2f9b6f06e5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:08.649616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4bdc1-1478-423f-bb13-2f9b6f06e5f5 None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:08.650563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4bdc1-1478-423f-bb13-2f9b6f06e5f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:08.651100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4bdc1-1478-423f-bb13-2f9b6f06e5f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:08.653010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4bdc1-1478-423f-bb13-2f9b6f06e5f5 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:08.674123 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 364/742] 10.222.0.70 () {56 vars in 1149 bytes} [Sun Aug 28 18:37:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:08.674530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ce3a9-3984-45c2-95b7-b178b3fbadbc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:08.675432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe7fa3-bbd9-48c2-86e7-926f7ba4f9f6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:08.675720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe7fa3-bbd9-48c2-86e7-926f7ba4f9f6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:08.676477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe7fa3-bbd9-48c2-86e7-926f7ba4f9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:08.699618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-91fe7fa3-bbd9-48c2-86e7-926f7ba4f9f6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:08.700958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-91fe7fa3-bbd9-48c2-86e7-926f7ba4f9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:08.715001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2908-4ab6-4b50-9006-ae03156e488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:08.716001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2908-4ab6-4b50-9006-ae03156e488f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:08.716489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2908-4ab6-4b50-9006-ae03156e488f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:08.717036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2908-4ab6-4b50-9006-ae03156e488f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:08.728630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c2908-4ab6-4b50-9006-ae03156e488f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:08.730581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c2908-4ab6-4b50-9006-ae03156e488f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:08.733488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-459c2908-4ab6-4b50-9006-ae03156e488f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:08.748187 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:08.749186 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:08.750084 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:08.750084 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:08.750084 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:08.754898 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 379/743] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:08.755792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2908-4ab6-4b50-9006-ae03156e488f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:08.780277 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 365/744] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 18:37:08.781108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe7fa3-bbd9-48c2-86e7-926f7ba4f9f6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:08.813294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:08.866503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2908-4ab6-4b50-9006-ae03156e488f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:08.903785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86484d5c-a39e-4701-ac4c-84dc881f4910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:08.904806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86484d5c-a39e-4701-ac4c-84dc881f4910 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:08.905227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86484d5c-a39e-4701-ac4c-84dc881f4910 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:08.905634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86484d5c-a39e-4701-ac4c-84dc881f4910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:08.910352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe7fa3-bbd9-48c2-86e7-926f7ba4f9f6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:08.947291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b469d73-c4b3-4473-9dc3-22d6805aef79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:08.947901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b469d73-c4b3-4473-9dc3-22d6805aef79 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:08.948184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b469d73-c4b3-4473-9dc3-22d6805aef79 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:08.948460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b469d73-c4b3-4473-9dc3-22d6805aef79 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:08.949105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b469d73-c4b3-4473-9dc3-22d6805aef79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:08.949410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b469d73-c4b3-4473-9dc3-22d6805aef79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:08.950819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b469d73-c4b3-4473-9dc3-22d6805aef79 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:08.962980 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 366/745] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:08.963785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b469d73-c4b3-4473-9dc3-22d6805aef79 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:08.993071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:09.001027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86484d5c-a39e-4701-ac4c-84dc881f4910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:09.003449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86484d5c-a39e-4701-ac4c-84dc881f4910 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:09.044555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:09.127896 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 380/746] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:08 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 18:37:09.129010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86484d5c-a39e-4701-ac4c-84dc881f4910 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:09.204648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b469d73-c4b3-4473-9dc3-22d6805aef79 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:09.230487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:09.238076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86484d5c-a39e-4701-ac4c-84dc881f4910 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:09.242106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adee55-b98f-4d29-965a-ea69d5ebf9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:09.242966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adee55-b98f-4d29-965a-ea69d5ebf9fd None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:09.243299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adee55-b98f-4d29-965a-ea69d5ebf9fd None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:09.243518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adee55-b98f-4d29-965a-ea69d5ebf9fd None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:09.244223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adee55-b98f-4d29-965a-ea69d5ebf9fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:09.246011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adee55-b98f-4d29-965a-ea69d5ebf9fd None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:09.263791 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 367/747] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:37:08 2022] POST /identity/v3/services => generated 240 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:09.268512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adee55-b98f-4d29-965a-ea69d5ebf9fd None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:09.280761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8bc58-7bb7-4358-89da-9de91c6f4cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:09.281840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8bc58-7bb7-4358-89da-9de91c6f4cde None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:09.282333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8bc58-7bb7-4358-89da-9de91c6f4cde None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:09.283404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8bc58-7bb7-4358-89da-9de91c6f4cde None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:09.292983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8bc58-7bb7-4358-89da-9de91c6f4cde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:09.294893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8bc58-7bb7-4358-89da-9de91c6f4cde None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-a0b8bc58-7bb7-4358-89da-9de91c6f4cde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:09.308471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:09.309541 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:09.310416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:09.310416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:09.310416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:09.310416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:09.310416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:09.310416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:09.310416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:09.310416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:09.313168 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 381/748] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:09.314410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8bc58-7bb7-4358-89da-9de91c6f4cde None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:09.404128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adee55-b98f-4d29-965a-ea69d5ebf9fd None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:09.436135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:09.451965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdbad8-1b17-440a-8b42-2c1838ba5dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:09.452587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdbad8-1b17-440a-8b42-2c1838ba5dbb None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:09.452869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdbad8-1b17-440a-8b42-2c1838ba5dbb None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:09.453139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdbad8-1b17-440a-8b42-2c1838ba5dbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:09.463247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8bc58-7bb7-4358-89da-9de91c6f4cde None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:09.466346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdbad8-1b17-440a-8b42-2c1838ba5dbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-cefdbad8-1b17-440a-8b42-2c1838ba5dbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:09.472008 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:09.472921 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:09.473735 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:09.473735 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:09.473735 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:09.473735 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:09.473735 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:09.473735 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:09.473735 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:09.473735 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:09.473735 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:09.473735 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:09.473735 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:09.473735 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:09.473735 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 368/749] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:37:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:09.474396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdbad8-1b17-440a-8b42-2c1838ba5dbb None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:09.512761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8c87-430d-46d8-b1e3-22e56a014872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:09.513313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8c87-430d-46d8-b1e3-22e56a014872 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:09.513589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8c87-430d-46d8-b1e3-22e56a014872 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:09.513867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8c87-430d-46d8-b1e3-22e56a014872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:09.526730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f8c87-430d-46d8-b1e3-22e56a014872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:09.528231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f8c87-430d-46d8-b1e3-22e56a014872 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-633f8c87-430d-46d8-b1e3-22e56a014872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:09.547049 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:09.548011 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:09.549784 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:09.549784 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:09.549784 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:09.549784 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 382/750] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:09.550402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8c87-430d-46d8-b1e3-22e56a014872 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:09.554927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:09.593320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdbad8-1b17-440a-8b42-2c1838ba5dbb None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:09.630989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e827d54-30ee-4bde-b744-84b82e3dafa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:09.631606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e827d54-30ee-4bde-b744-84b82e3dafa6 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:09.631890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e827d54-30ee-4bde-b744-84b82e3dafa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:09.632166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e827d54-30ee-4bde-b744-84b82e3dafa6 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:09.632863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e827d54-30ee-4bde-b744-84b82e3dafa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:09.633171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e827d54-30ee-4bde-b744-84b82e3dafa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:09.634612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e827d54-30ee-4bde-b744-84b82e3dafa6 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:09.647348 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 369/751] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:09.648186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e827d54-30ee-4bde-b744-84b82e3dafa6 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:09.670326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8c87-430d-46d8-b1e3-22e56a014872 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:09.698993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:09.712080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0285af9-4a80-4c02-a74b-1b7656396a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:09.713061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0285af9-4a80-4c02-a74b-1b7656396a1b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:09.713551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0285af9-4a80-4c02-a74b-1b7656396a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:09.713972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0285af9-4a80-4c02-a74b-1b7656396a1b None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:09.714911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0285af9-4a80-4c02-a74b-1b7656396a1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:09.715361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0285af9-4a80-4c02-a74b-1b7656396a1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:09.716918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0285af9-4a80-4c02-a74b-1b7656396a1b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:09.727929 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 383/752] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:37:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:09.729120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0285af9-4a80-4c02-a74b-1b7656396a1b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:09.776564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e827d54-30ee-4bde-b744-84b82e3dafa6 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:09.803801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:09.829278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ada3a-ac5a-4c74-89ea-22c53563d530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:09.829976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ada3a-ac5a-4c74-89ea-22c53563d530 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:09.830307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ada3a-ac5a-4c74-89ea-22c53563d530 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:09.830587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ada3a-ac5a-4c74-89ea-22c53563d530 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:09.831361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ada3a-ac5a-4c74-89ea-22c53563d530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:09.831661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ada3a-ac5a-4c74-89ea-22c53563d530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:09.833019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ada3a-ac5a-4c74-89ea-22c53563d530 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:09.848022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0285af9-4a80-4c02-a74b-1b7656396a1b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:09.850157 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 370/753] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:09.851971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ada3a-ac5a-4c74-89ea-22c53563d530 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:09.886394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aecc7a-9356-49ae-8cda-64cb6f287cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:09.887412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aecc7a-9356-49ae-8cda-64cb6f287cb2 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:09.887896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aecc7a-9356-49ae-8cda-64cb6f287cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:09.888368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aecc7a-9356-49ae-8cda-64cb6f287cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:09.889346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aecc7a-9356-49ae-8cda-64cb6f287cb2 None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=8787e53dd76c430e9ebe69b79b69827e) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:09.889890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aecc7a-9356-49ae-8cda-64cb6f287cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:09.891668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aecc7a-9356-49ae-8cda-64cb6f287cb2 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:09.898989 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 384/754] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:09 2022] GET /identity/v3/role_assignments?user.id=8787e53dd76c430e9ebe69b79b69827e&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:09.900066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aecc7a-9356-49ae-8cda-64cb6f287cb2 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:09.980571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ada3a-ac5a-4c74-89ea-22c53563d530 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:09.982650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:10.029166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80396412-b2b5-439b-a91c-7b796840daf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:10.029166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80396412-b2b5-439b-a91c-7b796840daf3 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:10.029166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80396412-b2b5-439b-a91c-7b796840daf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:10.029166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80396412-b2b5-439b-a91c-7b796840daf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:10.043943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80396412-b2b5-439b-a91c-7b796840daf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:10.045560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80396412-b2b5-439b-a91c-7b796840daf3 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-80396412-b2b5-439b-a91c-7b796840daf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:10.064929 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:10.066104 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:10.067127 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:10.067127 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:10.067127 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:10.076505 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 371/755] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:10.082206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80396412-b2b5-439b-a91c-7b796840daf3 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:10.107729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aecc7a-9356-49ae-8cda-64cb6f287cb2 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:10.168681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:10.178315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae270458-beee-40a9-a591-7d80ba7d830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:10.179062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae270458-beee-40a9-a591-7d80ba7d830d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:10.181203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae270458-beee-40a9-a591-7d80ba7d830d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:10.181482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae270458-beee-40a9-a591-7d80ba7d830d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:10.194450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae270458-beee-40a9-a591-7d80ba7d830d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:10.196678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae270458-beee-40a9-a591-7d80ba7d830d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-ae270458-beee-40a9-a591-7d80ba7d830d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:10.218335 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:10.219391 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:10.220828 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:10.220828 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:10.220828 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:10.220828 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:10.220828 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:10.220828 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:10.220828 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:10.220828 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:10.220828 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 385/756] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:10.228654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae270458-beee-40a9-a591-7d80ba7d830d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:10.274654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80396412-b2b5-439b-a91c-7b796840daf3 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:10.336011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03e05c-b43d-429c-9e9a-8ab3f797ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:10.336551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03e05c-b43d-429c-9e9a-8ab3f797ea9e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:10.336830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03e05c-b43d-429c-9e9a-8ab3f797ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:10.337102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03e05c-b43d-429c-9e9a-8ab3f797ea9e None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:10.337744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03e05c-b43d-429c-9e9a-8ab3f797ea9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:10.338047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03e05c-b43d-429c-9e9a-8ab3f797ea9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:10.339451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03e05c-b43d-429c-9e9a-8ab3f797ea9e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:10.353567 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 372/757] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:10.354875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75753e-d2ce-4caa-935d-a31cc893cfa5 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:10.355209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75753e-d2ce-4caa-935d-a31cc893cfa5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:10.355485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75753e-d2ce-4caa-935d-a31cc893cfa5 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:10.356673 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 373/758] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:10.362581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75753e-d2ce-4caa-935d-a31cc893cfa5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:10.384295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:10.398929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae270458-beee-40a9-a591-7d80ba7d830d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:10.448583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30af160-75de-4216-b7d3-287cd3fe3a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:10.449456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30af160-75de-4216-b7d3-287cd3fe3a9f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:10.449887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30af160-75de-4216-b7d3-287cd3fe3a9f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:10.450306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30af160-75de-4216-b7d3-287cd3fe3a9f None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:10.451178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30af160-75de-4216-b7d3-287cd3fe3a9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:10.452178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30af160-75de-4216-b7d3-287cd3fe3a9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:10.454220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30af160-75de-4216-b7d3-287cd3fe3a9f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:10.476627 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 386/759] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:10.476627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db832d-9bf6-4874-b4ac-37f57413ad43 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:10.476627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db832d-9bf6-4874-b4ac-37f57413ad43 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:10.476627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db832d-9bf6-4874-b4ac-37f57413ad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:10.489107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75753e-d2ce-4caa-935d-a31cc893cfa5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:10.499449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d2db832d-9bf6-4874-b4ac-37f57413ad43 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:10.500520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d2db832d-9bf6-4874-b4ac-37f57413ad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:10.537944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6be993-269c-448c-9df4-04be471f8da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:10.538897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be993-269c-448c-9df4-04be471f8da7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:10.539588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be993-269c-448c-9df4-04be471f8da7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:10.540015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be993-269c-448c-9df4-04be471f8da7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:10.550648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6be993-269c-448c-9df4-04be471f8da7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:10.553006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:10.553546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6be993-269c-448c-9df4-04be471f8da7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-2b6be993-269c-448c-9df4-04be471f8da7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:10.574959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:10.576143 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:10.577271 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:10.577271 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:10.577271 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:10.577271 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:10.577271 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:10.577271 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:10.577271 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:10.577271 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:10.577271 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:37:10.577271 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:10.579738 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 374/760] 10.222.0.70 () {56 vars in 1093 bytes} [Sun Aug 28 18:37:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:10.586930 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 387/761] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:10.587600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6be993-269c-448c-9df4-04be471f8da7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:10.587681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db832d-9bf6-4874-b4ac-37f57413ad43 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:10.718914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:10.767954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6be993-269c-448c-9df4-04be471f8da7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:10.784715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db832d-9bf6-4874-b4ac-37f57413ad43 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:10.838355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab0801-44c0-4882-9a52-549e899623b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:10.839629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab0801-44c0-4882-9a52-549e899623b9 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:10.839910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab0801-44c0-4882-9a52-549e899623b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:10.840180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab0801-44c0-4882-9a52-549e899623b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:10.841184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab0801-44c0-4882-9a52-549e899623b9 None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=299bba14d2dd48c997974093cb4f443f) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:10.841498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab0801-44c0-4882-9a52-549e899623b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:10.844396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab0801-44c0-4882-9a52-549e899623b9 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:10.848707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb824ba-0d41-45f7-8bf4-6ed034456264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:10.849621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb824ba-0d41-45f7-8bf4-6ed034456264 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:10.850125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb824ba-0d41-45f7-8bf4-6ed034456264 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:10.850600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb824ba-0d41-45f7-8bf4-6ed034456264 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:10.852030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb824ba-0d41-45f7-8bf4-6ed034456264 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:10.853120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb824ba-0d41-45f7-8bf4-6ed034456264 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:10.855096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb824ba-0d41-45f7-8bf4-6ed034456264 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:10.856058 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 375/762] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:10 2022] GET /identity/v3/role_assignments?user.id=299bba14d2dd48c997974093cb4f443f&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:10.889362 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 388/763] 10.222.0.70 () {56 vars in 1133 bytes} [Sun Aug 28 18:37:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:10.895179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab0801-44c0-4882-9a52-549e899623b9 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:10.955965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb824ba-0d41-45f7-8bf4-6ed034456264 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:11.029967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:11.084392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab0801-44c0-4882-9a52-549e899623b9 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:11.106668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb824ba-0d41-45f7-8bf4-6ed034456264 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:11.124567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf896e3-812f-4b26-a776-3d780880c800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:11.125342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf896e3-812f-4b26-a776-3d780880c800 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:11.125730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf896e3-812f-4b26-a776-3d780880c800 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:11.126179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf896e3-812f-4b26-a776-3d780880c800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:11.133918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:11.152014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf896e3-812f-4b26-a776-3d780880c800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:11.153520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf896e3-812f-4b26-a776-3d780880c800 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:11.166320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b74693-9acc-4545-81bf-04466a2e1bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:11.166320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74693-9acc-4545-81bf-04466a2e1bbd None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:11.166320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74693-9acc-4545-81bf-04466a2e1bbd None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:11.166320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74693-9acc-4545-81bf-04466a2e1bbd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:11.166772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b74693-9acc-4545-81bf-04466a2e1bbd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:11.166772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b74693-9acc-4545-81bf-04466a2e1bbd None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-5cf896e3-812f-4b26-a776-3d780880c800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:11.182036 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:11.183335 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:11.184238 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:11.184238 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:11.184238 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:11.184238 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 376/764] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-d8b74693-9acc-4545-81bf-04466a2e1bbd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:11.186771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:11.188012 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:37:11.188879 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:11.192665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf896e3-812f-4b26-a776-3d780880c800 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:11.195581 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 389/765] 10.222.0.70 () {56 vars in 1129 bytes} [Sun Aug 28 18:37:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:11.197631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b74693-9acc-4545-81bf-04466a2e1bbd None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:11.376990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b74693-9acc-4545-81bf-04466a2e1bbd None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:11.378984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:11.382497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf896e3-812f-4b26-a776-3d780880c800 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:11.436893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68576189-7b8e-41d5-aaa7-922b758b516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:11.437525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68576189-7b8e-41d5-aaa7-922b758b516c None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:11.437812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68576189-7b8e-41d5-aaa7-922b758b516c None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:11.439772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68576189-7b8e-41d5-aaa7-922b758b516c None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:11.439772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68576189-7b8e-41d5-aaa7-922b758b516c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:11.439772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68576189-7b8e-41d5-aaa7-922b758b516c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:11.440847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68576189-7b8e-41d5-aaa7-922b758b516c None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:11.442861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dd8f7-b252-48be-9f6b-6ea5a27a4dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:11.443719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dd8f7-b252-48be-9f6b-6ea5a27a4dc8 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:11.444197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dd8f7-b252-48be-9f6b-6ea5a27a4dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:11.444662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dd8f7-b252-48be-9f6b-6ea5a27a4dc8 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:11.445500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41dd8f7-b252-48be-9f6b-6ea5a27a4dc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:11.446002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41dd8f7-b252-48be-9f6b-6ea5a27a4dc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:11.447638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41dd8f7-b252-48be-9f6b-6ea5a27a4dc8 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:11.451096 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 390/766] 10.222.0.70 () {56 vars in 1124 bytes} [Sun Aug 28 18:37:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:11.452083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68576189-7b8e-41d5-aaa7-922b758b516c None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:11.461609 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 377/767] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:11.467758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dd8f7-b252-48be-9f6b-6ea5a27a4dc8 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:11.525199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:11.588015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68576189-7b8e-41d5-aaa7-922b758b516c None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:11.592437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dd8f7-b252-48be-9f6b-6ea5a27a4dc8 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:11.635062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28d793-4e2e-4771-867b-32fad78f2a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:11.636185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed8e7f-8fcb-45d5-8058-99abad384b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:11.636374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28d793-4e2e-4771-867b-32fad78f2a92 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:11.636982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28d793-4e2e-4771-867b-32fad78f2a92 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:11.637155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed8e7f-8fcb-45d5-8058-99abad384b14 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:11.637464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed8e7f-8fcb-45d5-8058-99abad384b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:11.637831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed8e7f-8fcb-45d5-8058-99abad384b14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:11.638335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28d793-4e2e-4771-867b-32fad78f2a92 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:11.639728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28d793-4e2e-4771-867b-32fad78f2a92 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:11.640699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28d793-4e2e-4771-867b-32fad78f2a92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:11.644602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28d793-4e2e-4771-867b-32fad78f2a92 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:11.646537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed8e7f-8fcb-45d5-8058-99abad384b14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:11.648296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed8e7f-8fcb-45d5-8058-99abad384b14 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:11.653136 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 391/768] 10.222.0.70 () {56 vars in 1124 bytes} [Sun Aug 28 18:37:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:11.654566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f527cc-fad5-4b78-842a-f2782b8d5eab None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:11.655016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f527cc-fad5-4b78-842a-f2782b8d5eab None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:11.655426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f527cc-fad5-4b78-842a-f2782b8d5eab None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:11.661939 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 392/769] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:11.663102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f527cc-fad5-4b78-842a-f2782b8d5eab None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-e2ed8e7f-8fcb-45d5-8058-99abad384b14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:11.669235 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:11.670287 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:11.671398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:11.671398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:11.671398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:11.671398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:11.671398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:11.671398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:11.671398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:11.671398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:11.678370 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 378/770] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:11.678370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eebc96-3e04-4a95-99c1-6e22c9892ae7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:11.678370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eebc96-3e04-4a95-99c1-6e22c9892ae7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:11.678370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eebc96-3e04-4a95-99c1-6e22c9892ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:11.698628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-55eebc96-3e04-4a95-99c1-6e22c9892ae7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:11.700262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-55eebc96-3e04-4a95-99c1-6e22c9892ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:11.709535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:11.786953 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 379/771] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:11.787846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eebc96-3e04-4a95-99c1-6e22c9892ae7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:11.798093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f527cc-fad5-4b78-842a-f2782b8d5eab None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:11.836817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692f71e-e75f-49a0-8d3a-0a0aaa038fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:11.837430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f71e-e75f-49a0-8d3a-0a0aaa038fad None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:11.837706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f71e-e75f-49a0-8d3a-0a0aaa038fad None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:11.837978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f71e-e75f-49a0-8d3a-0a0aaa038fad None admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:11.838723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692f71e-e75f-49a0-8d3a-0a0aaa038fad None admin] RBAC: Adding query filter params (interface=public, service_id=f2f14046606b48c28fd09b7688634678, region_id=RegionOne) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:11.839175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692f71e-e75f-49a0-8d3a-0a0aaa038fad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:11.840710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692f71e-e75f-49a0-8d3a-0a0aaa038fad None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:11.849881 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 393/772] 10.222.0.70 () {56 vars in 1251 bytes} [Sun Aug 28 18:37:11 2022] GET /identity/v3/endpoints?service_id=f2f14046606b48c28fd09b7688634678&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:11.855333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692f71e-e75f-49a0-8d3a-0a0aaa038fad None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:11.893563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:11.959054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:11.966030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692f71e-e75f-49a0-8d3a-0a0aaa038fad None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:12.003067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a06717-94e0-48bc-9e8b-ecfd62ce7bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:12.003681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a06717-94e0-48bc-9e8b-ecfd62ce7bd1 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:12.003961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a06717-94e0-48bc-9e8b-ecfd62ce7bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:12.004230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a06717-94e0-48bc-9e8b-ecfd62ce7bd1 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:12.004834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a06717-94e0-48bc-9e8b-ecfd62ce7bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:12.006262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a06717-94e0-48bc-9e8b-ecfd62ce7bd1 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:12.012463 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 394/773] 10.222.0.70 () {56 vars in 1087 bytes} [Sun Aug 28 18:37:11 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:12.047202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eebc96-3e04-4a95-99c1-6e22c9892ae7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:12.109127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44fb93-7047-40b8-b5aa-58544017f965 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:12.109419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44fb93-7047-40b8-b5aa-58544017f965 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:12.109736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44fb93-7047-40b8-b5aa-58544017f965 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:12.111373 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 395/774] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:37:12.117198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bd6cf-289b-418e-9529-b1fd98381b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:12.117962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bd6cf-289b-418e-9529-b1fd98381b48 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:12.118197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bd6cf-289b-418e-9529-b1fd98381b48 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:12.118469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bd6cf-289b-418e-9529-b1fd98381b48 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:12.119239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bd6cf-289b-418e-9529-b1fd98381b48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:12.119553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bd6cf-289b-418e-9529-b1fd98381b48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:12.121070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bd6cf-289b-418e-9529-b1fd98381b48 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:12.124130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bb166-1b57-4386-838b-6ddbb973d334 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:12.124416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bb166-1b57-4386-838b-6ddbb973d334 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:12.124693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bb166-1b57-4386-838b-6ddbb973d334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:12.136288 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 380/775] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:12.143429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bd6cf-289b-418e-9529-b1fd98381b48 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:12.154386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c06bb166-1b57-4386-838b-6ddbb973d334 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:12.155641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c06bb166-1b57-4386-838b-6ddbb973d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:12.239487 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 396/776] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:12.240209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bb166-1b57-4386-838b-6ddbb973d334 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:12.263966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:12.269586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bd6cf-289b-418e-9529-b1fd98381b48 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:12.327521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9bddf-0360-4407-b7ec-4f0d3ff63f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:12.328180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9bddf-0360-4407-b7ec-4f0d3ff63f28 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:12.328458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9bddf-0360-4407-b7ec-4f0d3ff63f28 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:12.328724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9bddf-0360-4407-b7ec-4f0d3ff63f28 None admin] PATH_INFO: `/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/ea8cbbc34aab42a4ada9cbee1772847b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:12.331400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9bddf-0360-4407-b7ec-4f0d3ff63f28 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7555fde9e5404eb3b0dbfa04ee871f, user_id=ea8cbbc34aab42a4ada9cbee1772847b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:12.335340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9bddf-0360-4407-b7ec-4f0d3ff63f28 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:12.358486 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 381/777] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:37:12 2022] PUT /identity/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/ea8cbbc34aab42a4ada9cbee1772847b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:12.379687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:12.395565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bb166-1b57-4386-838b-6ddbb973d334 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:12.436769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f14f0-34b3-404d-9ea8-c96157ac585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:12.437334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f14f0-34b3-404d-9ea8-c96157ac585f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:12.437614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f14f0-34b3-404d-9ea8-c96157ac585f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:12.437882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f14f0-34b3-404d-9ea8-c96157ac585f None admin] PATH_INFO: `/v3/services/network` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:12.438525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f14f0-34b3-404d-9ea8-c96157ac585f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:12.440051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f14f0-34b3-404d-9ea8-c96157ac585f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-f99f14f0-34b3-404d-9ea8-c96157ac585f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:12.450309 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:12.451396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:12.452215 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 397/778] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:12 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:12.459790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9bddf-0360-4407-b7ec-4f0d3ff63f28 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:12.531581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f14f0-34b3-404d-9ea8-c96157ac585f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:12.606912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9bddf-0360-4407-b7ec-4f0d3ff63f28 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:12.678450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fdbe3-d621-4bc4-8d5c-771a35b51915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:12.679093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fdbe3-d621-4bc4-8d5c-771a35b51915 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:12.679371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fdbe3-d621-4bc4-8d5c-771a35b51915 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:12.680294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fdbe3-d621-4bc4-8d5c-771a35b51915 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:12.680294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fdbe3-d621-4bc4-8d5c-771a35b51915 None admin] RBAC: Adding query filter params (name=network) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:12.680544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fdbe3-d621-4bc4-8d5c-771a35b51915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:12.681904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fdbe3-d621-4bc4-8d5c-771a35b51915 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:12.690079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f14f0-34b3-404d-9ea8-c96157ac585f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:12.691941 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 382/779] 10.222.0.70 () {56 vars in 1112 bytes} [Sun Aug 28 18:37:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:12.697948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fdbe3-d621-4bc4-8d5c-771a35b51915 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:12.728626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98451e47-e497-45fe-9053-29c226e7120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:12.729265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98451e47-e497-45fe-9053-29c226e7120e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:12.729544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98451e47-e497-45fe-9053-29c226e7120e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:12.729816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98451e47-e497-45fe-9053-29c226e7120e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:12.733347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:12.744378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98451e47-e497-45fe-9053-29c226e7120e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-98451e47-e497-45fe-9053-29c226e7120e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:12.750152 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:12.751322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:12.752289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:12.752289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:12.752289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:12.752289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:12.752289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:12.752289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:12.752289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:12.752289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:12.752289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:12.752289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:12.752289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:12.752289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:12.754769 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 398/780] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:37:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:12.761345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98451e47-e497-45fe-9053-29c226e7120e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:12.783314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:12.861923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fdbe3-d621-4bc4-8d5c-771a35b51915 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:12.888393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98451e47-e497-45fe-9053-29c226e7120e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:12.929697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cf8fd-1c7d-4166-bee9-ccd9a411fb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:12.930366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cf8fd-1c7d-4166-bee9-ccd9a411fb92 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:12.930651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cf8fd-1c7d-4166-bee9-ccd9a411fb92 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:12.930949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cf8fd-1c7d-4166-bee9-ccd9a411fb92 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:12.931656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cf8fd-1c7d-4166-bee9-ccd9a411fb92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:12.932017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cf8fd-1c7d-4166-bee9-ccd9a411fb92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:12.933632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cf8fd-1c7d-4166-bee9-ccd9a411fb92 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:12.934301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6225f-f656-4eac-af28-c24529696632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:12.935276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6225f-f656-4eac-af28-c24529696632 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:12.941123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6225f-f656-4eac-af28-c24529696632 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:12.941750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6225f-f656-4eac-af28-c24529696632 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:12.942623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6225f-f656-4eac-af28-c24529696632 None admin] RBAC: Adding query filter params (type=network) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:12.943267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6225f-f656-4eac-af28-c24529696632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:12.943444 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 399/781] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:37:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:12.944982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6225f-f656-4eac-af28-c24529696632 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:12.951907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cf8fd-1c7d-4166-bee9-ccd9a411fb92 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:12.955975 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 383/782] 10.222.0.70 () {56 vars in 1112 bytes} [Sun Aug 28 18:37:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:12.958789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6225f-f656-4eac-af28-c24529696632 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:13.075104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:13.097780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cf8fd-1c7d-4166-bee9-ccd9a411fb92 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:13.142736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2821d0e-7329-4452-a0cc-dd537f5d46ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:13.143922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2821d0e-7329-4452-a0cc-dd537f5d46ea None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:13.144847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2821d0e-7329-4452-a0cc-dd537f5d46ea None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:13.145469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2821d0e-7329-4452-a0cc-dd537f5d46ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:13.151944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:13.162962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2821d0e-7329-4452-a0cc-dd537f5d46ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:13.165728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2821d0e-7329-4452-a0cc-dd537f5d46ea None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:13.167814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6225f-f656-4eac-af28-c24529696632 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-a2821d0e-7329-4452-a0cc-dd537f5d46ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:13.183227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:13.184203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:13.185116 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:13.185116 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:13.185116 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:13.185116 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 400/783] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:13.186346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187874d-69ff-413b-9a53-4cedb55c6b3c None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:13.186771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187874d-69ff-413b-9a53-4cedb55c6b3c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:13.187132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187874d-69ff-413b-9a53-4cedb55c6b3c None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:13.193311 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 401/784] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:13.194157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187874d-69ff-413b-9a53-4cedb55c6b3c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:13.213262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5578ab1-59fa-4d2f-b5bb-aebb41bb076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:13.214252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5578ab1-59fa-4d2f-b5bb-aebb41bb076e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:13.214682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5578ab1-59fa-4d2f-b5bb-aebb41bb076e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:13.215227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5578ab1-59fa-4d2f-b5bb-aebb41bb076e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:13.216257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5578ab1-59fa-4d2f-b5bb-aebb41bb076e None admin] RBAC: Adding query filter params (interface=public, service_id=5e4078fd722a46189350ecd2a78e85e2, region_id=RegionOne) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:13.216720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5578ab1-59fa-4d2f-b5bb-aebb41bb076e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:13.218344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5578ab1-59fa-4d2f-b5bb-aebb41bb076e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:13.228085 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 384/785] 10.222.0.70 () {56 vars in 1251 bytes} [Sun Aug 28 18:37:12 2022] GET /identity/v3/endpoints?service_id=5e4078fd722a46189350ecd2a78e85e2&interface=public®ion_id=RegionOne => generated 194 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:13.229509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cafd4-e072-4c73-b14e-e8d6d672cf9d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:13.229931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cafd4-e072-4c73-b14e-e8d6d672cf9d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:13.230340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cafd4-e072-4c73-b14e-e8d6d672cf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:13.249796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-555cafd4-e072-4c73-b14e-e8d6d672cf9d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:13.251917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-555cafd4-e072-4c73-b14e-e8d6d672cf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:13.309068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187874d-69ff-413b-9a53-4cedb55c6b3c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:13.327279 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 385/786] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:13.328382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cafd4-e072-4c73-b14e-e8d6d672cf9d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:13.346887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:13.372058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bd195-2586-4d84-9e4f-13b95ba9a9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:13.372837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bd195-2586-4d84-9e4f-13b95ba9a9a8 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:13.373222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bd195-2586-4d84-9e4f-13b95ba9a9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:13.373607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bd195-2586-4d84-9e4f-13b95ba9a9a8 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:13.374356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bd195-2586-4d84-9e4f-13b95ba9a9a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:13.374775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bd195-2586-4d84-9e4f-13b95ba9a9a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:13.376389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bd195-2586-4d84-9e4f-13b95ba9a9a8 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:13.399525 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 402/787] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:13.404852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bd195-2586-4d84-9e4f-13b95ba9a9a8 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:13.440805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:13.444773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cafd4-e072-4c73-b14e-e8d6d672cf9d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:13.497772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71957f3-5ec2-498b-9252-3d1fc0fd203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:13.498492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71957f3-5ec2-498b-9252-3d1fc0fd203c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:13.498866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71957f3-5ec2-498b-9252-3d1fc0fd203c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:13.499145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71957f3-5ec2-498b-9252-3d1fc0fd203c None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:13.499754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71957f3-5ec2-498b-9252-3d1fc0fd203c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:13.501124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71957f3-5ec2-498b-9252-3d1fc0fd203c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:13.507361 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 386/788] 10.222.0.70 () {56 vars in 1087 bytes} [Sun Aug 28 18:37:13 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:13.565700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bd195-2586-4d84-9e4f-13b95ba9a9a8 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:13.614426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226696e-f0ac-44f0-a18c-47a75a1e300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:13.615419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226696e-f0ac-44f0-a18c-47a75a1e300c None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:13.615848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226696e-f0ac-44f0-a18c-47a75a1e300c None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:13.616268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226696e-f0ac-44f0-a18c-47a75a1e300c None admin] PATH_INFO: `/v3/users/swift` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:13.629309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226696e-f0ac-44f0-a18c-47a75a1e300c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:13.631224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226696e-f0ac-44f0-a18c-47a75a1e300c None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-1226696e-f0ac-44f0-a18c-47a75a1e300c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:13.650650 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:13.652723 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:13.654943 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:13.654943 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:13.654943 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:13.654943 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:13.654943 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:13.654943 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:13.654943 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:13.654943 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:13.654943 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:37:13.654943 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:13.665387 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 403/789] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:37:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:13.671133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71957f3-5ec2-498b-9252-3d1fc0fd203c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:13.692940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226696e-f0ac-44f0-a18c-47a75a1e300c None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:13.771131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:13.837165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71957f3-5ec2-498b-9252-3d1fc0fd203c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:13.839131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226696e-f0ac-44f0-a18c-47a75a1e300c None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:13.873526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5bc30-8862-463a-9f0c-d4f24e371ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:13.878774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5bc30-8862-463a-9f0c-d4f24e371ebe None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:13.878774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5bc30-8862-463a-9f0c-d4f24e371ebe None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:13.878774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5bc30-8862-463a-9f0c-d4f24e371ebe None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:13.878774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5bc30-8862-463a-9f0c-d4f24e371ebe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:13.878774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5bc30-8862-463a-9f0c-d4f24e371ebe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:13.878774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5bc30-8862-463a-9f0c-d4f24e371ebe None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:13.886091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8017e-8549-494d-b11d-c8cc9fcf8694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:13.886979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8017e-8549-494d-b11d-c8cc9fcf8694 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:13.887405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8017e-8549-494d-b11d-c8cc9fcf8694 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:13.888034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8017e-8549-494d-b11d-c8cc9fcf8694 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:13.898991 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 387/790] 10.222.0.70 () {56 vars in 1135 bytes} [Sun Aug 28 18:37:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:13.904244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5bc30-8862-463a-9f0c-d4f24e371ebe None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:13.908749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:13.915817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8017e-8549-494d-b11d-c8cc9fcf8694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-d5e8017e-8549-494d-b11d-c8cc9fcf8694 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:13.921584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:13.922501 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:13.927490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:13.927490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:13.927490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:13.927490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:13.927490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:13.927490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:13.927490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:13.927490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:13.927490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:13.927490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:13.927490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:37:13.927490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:13.930786 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 404/791] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:37:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:13.938263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8017e-8549-494d-b11d-c8cc9fcf8694 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:14.028111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5bc30-8862-463a-9f0c-d4f24e371ebe None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:14.067109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c9f99-aca2-477e-9e0e-14ab9c5fc639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:14.067749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c9f99-aca2-477e-9e0e-14ab9c5fc639 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:14.068034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c9f99-aca2-477e-9e0e-14ab9c5fc639 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:14.068310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c9f99-aca2-477e-9e0e-14ab9c5fc639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:14.081596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c9f99-aca2-477e-9e0e-14ab9c5fc639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:14.084082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c9f99-aca2-477e-9e0e-14ab9c5fc639 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-906c9f99-aca2-477e-9e0e-14ab9c5fc639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:14.100959 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:14.101938 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:14.102856 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:14.102856 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:14.102856 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:14.102856 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 388/792] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:14.112061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c9f99-aca2-477e-9e0e-14ab9c5fc639 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:14.126515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8017e-8549-494d-b11d-c8cc9fcf8694 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:14.134390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:14.173345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badffb2-360e-4f69-a6c6-f7c5491bc4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:14.174313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badffb2-360e-4f69-a6c6-f7c5491bc4f3 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:14.174818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badffb2-360e-4f69-a6c6-f7c5491bc4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:14.175294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badffb2-360e-4f69-a6c6-f7c5491bc4f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:14.176264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badffb2-360e-4f69-a6c6-f7c5491bc4f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:14.176775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badffb2-360e-4f69-a6c6-f7c5491bc4f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:14.178339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badffb2-360e-4f69-a6c6-f7c5491bc4f3 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:14.197491 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 405/793] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:37:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:14.201530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badffb2-360e-4f69-a6c6-f7c5491bc4f3 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:14.223987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:14.292550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c9f99-aca2-477e-9e0e-14ab9c5fc639 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:14.330172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f2541-9a17-4731-a68a-fb329c7ec39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:14.330897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f2541-9a17-4731-a68a-fb329c7ec39b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:14.331187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f2541-9a17-4731-a68a-fb329c7ec39b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:14.331461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f2541-9a17-4731-a68a-fb329c7ec39b None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:14.332112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f2541-9a17-4731-a68a-fb329c7ec39b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:14.332417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f2541-9a17-4731-a68a-fb329c7ec39b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:14.333798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f2541-9a17-4731-a68a-fb329c7ec39b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:14.346777 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 389/794] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:14.358124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f2541-9a17-4731-a68a-fb329c7ec39b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:14.379783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badffb2-360e-4f69-a6c6-f7c5491bc4f3 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:14.422480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d548f-c388-4d10-8b05-84cd0713cc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:14.423917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d548f-c388-4d10-8b05-84cd0713cc7e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:14.424328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d548f-c388-4d10-8b05-84cd0713cc7e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:14.424700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d548f-c388-4d10-8b05-84cd0713cc7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:14.440351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d548f-c388-4d10-8b05-84cd0713cc7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:14.442709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d548f-c388-4d10-8b05-84cd0713cc7e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-191d548f-c388-4d10-8b05-84cd0713cc7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:14.462327 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:14.463320 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:14.464192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:14.464192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:14.464192 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:14.464371 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 406/795] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:14.465778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a2e6-f84d-4d1c-b340-742ad55c4fb0 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:14.467623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a2e6-f84d-4d1c-b340-742ad55c4fb0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:14.467623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65a2e6-f84d-4d1c-b340-742ad55c4fb0 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:14.467880 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 407/796] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:14.470655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65a2e6-f84d-4d1c-b340-742ad55c4fb0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:14.481801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f2541-9a17-4731-a68a-fb329c7ec39b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:14.501540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:14.505307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:14.522262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd005529-de7e-4d86-8c16-01bc5e5e8f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:14.523069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd005529-de7e-4d86-8c16-01bc5e5e8f9b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:14.523455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd005529-de7e-4d86-8c16-01bc5e5e8f9b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:14.523832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd005529-de7e-4d86-8c16-01bc5e5e8f9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:14.530980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd005529-de7e-4d86-8c16-01bc5e5e8f9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:14.533105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd005529-de7e-4d86-8c16-01bc5e5e8f9b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-fd005529-de7e-4d86-8c16-01bc5e5e8f9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:14.545100 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:14.546045 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:14.546956 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:14.546956 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:14.546956 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:14.546956 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:14.546956 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:14.546956 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:14.546956 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:14.546956 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:14.546956 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 390/797] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:14.548015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a820bb-fcde-4a9b-9388-aa00a88d3e31 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:14.548905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a820bb-fcde-4a9b-9388-aa00a88d3e31 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:14.550896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a820bb-fcde-4a9b-9388-aa00a88d3e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:14.570622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-40a820bb-fcde-4a9b-9388-aa00a88d3e31 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:14.571862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-40a820bb-fcde-4a9b-9388-aa00a88d3e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:14.617635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65a2e6-f84d-4d1c-b340-742ad55c4fb0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:14.651643 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 391/798] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:14.652883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a820bb-fcde-4a9b-9388-aa00a88d3e31 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:14.664809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cac617-2873-41e9-bd9a-e5d6953e3931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:14.665437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cac617-2873-41e9-bd9a-e5d6953e3931 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:14.665725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cac617-2873-41e9-bd9a-e5d6953e3931 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:14.666011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cac617-2873-41e9-bd9a-e5d6953e3931 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:14.666664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cac617-2873-41e9-bd9a-e5d6953e3931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:14.666998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cac617-2873-41e9-bd9a-e5d6953e3931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:14.668530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cac617-2873-41e9-bd9a-e5d6953e3931 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:14.684510 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 408/799] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:14.692026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cac617-2873-41e9-bd9a-e5d6953e3931 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:14.760586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a820bb-fcde-4a9b-9388-aa00a88d3e31 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:14.768544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:14.797313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73d41c-1bd2-4eb0-9b5d-c3cf3e2def04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:14.798696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73d41c-1bd2-4eb0-9b5d-c3cf3e2def04 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:14.799211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73d41c-1bd2-4eb0-9b5d-c3cf3e2def04 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:14.799631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73d41c-1bd2-4eb0-9b5d-c3cf3e2def04 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:14.800475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73d41c-1bd2-4eb0-9b5d-c3cf3e2def04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:14.800946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73d41c-1bd2-4eb0-9b5d-c3cf3e2def04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:14.802532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73d41c-1bd2-4eb0-9b5d-c3cf3e2def04 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:14.820650 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 392/800] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:14.822074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73d41c-1bd2-4eb0-9b5d-c3cf3e2def04 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:14.822644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:14.830450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cac617-2873-41e9-bd9a-e5d6953e3931 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:14.874070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1c1ba-b520-4a6c-93ea-a36457ceddd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:14.874705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1c1ba-b520-4a6c-93ea-a36457ceddd3 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:14.875029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1c1ba-b520-4a6c-93ea-a36457ceddd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:14.875303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1c1ba-b520-4a6c-93ea-a36457ceddd3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:14.885817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1c1ba-b520-4a6c-93ea-a36457ceddd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:14.887818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1c1ba-b520-4a6c-93ea-a36457ceddd3 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-9ac1c1ba-b520-4a6c-93ea-a36457ceddd3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:14.902237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:14.903227 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:14.904142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:14.904142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:14.904142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:14.904142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:14.904142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:14.904142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:14.904142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:14.904142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:14.904142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:37:14.904142 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:14.908744 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 409/801] 10.222.0.70 () {56 vars in 1117 bytes} [Sun Aug 28 18:37:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:14.909842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1c1ba-b520-4a6c-93ea-a36457ceddd3 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:14.972404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73d41c-1bd2-4eb0-9b5d-c3cf3e2def04 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:15.014624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe0d01-7103-4a18-a0fd-fa685e55b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:15.015654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe0d01-7103-4a18-a0fd-fa685e55b718 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:15.015931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe0d01-7103-4a18-a0fd-fa685e55b718 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:15.016214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe0d01-7103-4a18-a0fd-fa685e55b718 None admin] PATH_INFO: `/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/8787e53dd76c430e9ebe69b79b69827e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:15.018580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe0d01-7103-4a18-a0fd-fa685e55b718 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7555fde9e5404eb3b0dbfa04ee871f, user_id=8787e53dd76c430e9ebe69b79b69827e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:15.020058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe0d01-7103-4a18-a0fd-fa685e55b718 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:15.028195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1c1ba-b520-4a6c-93ea-a36457ceddd3 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:15.035520 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 393/802] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:37:14 2022] PUT /identity/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/8787e53dd76c430e9ebe69b79b69827e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:37:15.037576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aec7c-9bc0-4677-a976-bc590edcc39c None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:15.038080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aec7c-9bc0-4677-a976-bc590edcc39c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:15.039063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aec7c-9bc0-4677-a976-bc590edcc39c None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:15.041595 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 394/803] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:15.042637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281aec7c-9bc0-4677-a976-bc590edcc39c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:15.074509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18f926-216b-40e4-b402-20adef8da397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:15.075194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f926-216b-40e4-b402-20adef8da397 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:15.075553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f926-216b-40e4-b402-20adef8da397 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:15.075903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f926-216b-40e4-b402-20adef8da397 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:15.077008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18f926-216b-40e4-b402-20adef8da397 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:15.077175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18f926-216b-40e4-b402-20adef8da397 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:15.078723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18f926-216b-40e4-b402-20adef8da397 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:15.088740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:15.092120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:15.106883 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 410/804] 10.222.0.70 () {56 vars in 1149 bytes} [Sun Aug 28 18:37:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:15.108493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800299c6-b593-4ade-b96b-3bc4f33e96fb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:15.108856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800299c6-b593-4ade-b96b-3bc4f33e96fb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:15.109208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800299c6-b593-4ade-b96b-3bc4f33e96fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:15.130734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-800299c6-b593-4ade-b96b-3bc4f33e96fb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:15.132319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-800299c6-b593-4ade-b96b-3bc4f33e96fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:15.202177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281aec7c-9bc0-4677-a976-bc590edcc39c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:15.226114 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 411/805] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:15.227494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800299c6-b593-4ade-b96b-3bc4f33e96fb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:15.266073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a35fb-1a86-464e-8890-e8dbc3744abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:15.266772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a35fb-1a86-464e-8890-e8dbc3744abf None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:15.267167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a35fb-1a86-464e-8890-e8dbc3744abf None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:15.267667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a35fb-1a86-464e-8890-e8dbc3744abf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:15.268294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a35fb-1a86-464e-8890-e8dbc3744abf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:15.271753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a35fb-1a86-464e-8890-e8dbc3744abf None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-726a35fb-1a86-464e-8890-e8dbc3744abf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:15.288778 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:15.289785 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:15.290604 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 395/806] 10.222.0.70 () {56 vars in 1129 bytes} [Sun Aug 28 18:37:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:15.303205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a35fb-1a86-464e-8890-e8dbc3744abf None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:15.434373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800299c6-b593-4ade-b96b-3bc4f33e96fb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:15.448472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:15.460694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a35fb-1a86-464e-8890-e8dbc3744abf None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:15.487160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:15.503294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314de95c-eeb0-4c5f-9cd2-88e62f3453eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:15.504448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314de95c-eeb0-4c5f-9cd2-88e62f3453eb None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:15.504736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314de95c-eeb0-4c5f-9cd2-88e62f3453eb None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:15.505522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314de95c-eeb0-4c5f-9cd2-88e62f3453eb None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:15.506166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314de95c-eeb0-4c5f-9cd2-88e62f3453eb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:15.506479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314de95c-eeb0-4c5f-9cd2-88e62f3453eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:15.508368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314de95c-eeb0-4c5f-9cd2-88e62f3453eb None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:15.511573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5ffb6-7ffa-44ae-b72a-5a80047fc653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:15.512240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5ffb6-7ffa-44ae-b72a-5a80047fc653 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:15.512531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5ffb6-7ffa-44ae-b72a-5a80047fc653 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:15.512816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5ffb6-7ffa-44ae-b72a-5a80047fc653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:15.514483 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 396/807] 10.222.0.70 () {56 vars in 1124 bytes} [Sun Aug 28 18:37:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:15.515525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314de95c-eeb0-4c5f-9cd2-88e62f3453eb None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:15.525352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5ffb6-7ffa-44ae-b72a-5a80047fc653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:15.527000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5ffb6-7ffa-44ae-b72a-5a80047fc653 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-abf5ffb6-7ffa-44ae-b72a-5a80047fc653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:15.543168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:15.544135 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:15.544999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:15.544999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:15.544999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:15.544999 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 412/808] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:15.545701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5ffb6-7ffa-44ae-b72a-5a80047fc653 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:15.636375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314de95c-eeb0-4c5f-9cd2-88e62f3453eb None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:15.662074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5ffb6-7ffa-44ae-b72a-5a80047fc653 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:15.681952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe736c1-8f3e-49ef-b31e-770ce7aa80e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:15.682860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe736c1-8f3e-49ef-b31e-770ce7aa80e0 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:15.683166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe736c1-8f3e-49ef-b31e-770ce7aa80e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:15.683447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe736c1-8f3e-49ef-b31e-770ce7aa80e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:15.695730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe736c1-8f3e-49ef-b31e-770ce7aa80e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:15.700120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708a053-b2f1-4d25-a416-71d9ab44a7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:15.700987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708a053-b2f1-4d25-a416-71d9ab44a7f4 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:15.701468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708a053-b2f1-4d25-a416-71d9ab44a7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:15.701941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708a053-b2f1-4d25-a416-71d9ab44a7f4 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-cfe736c1-8f3e-49ef-b31e-770ce7aa80e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:15.702131 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:15.703323 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:15.704167 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:15.704167 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:15.704167 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:15.704167 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:15.704167 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:15.704167 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:15.704167 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:15.704167 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:15.704167 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:15.704167 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:15.704167 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:15.704167 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:15.706431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708a053-b2f1-4d25-a416-71d9ab44a7f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:15.706986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708a053-b2f1-4d25-a416-71d9ab44a7f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:15.708565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708a053-b2f1-4d25-a416-71d9ab44a7f4 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:15.709148 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 397/809] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:37:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:15.709998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe736c1-8f3e-49ef-b31e-770ce7aa80e0 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:15.719883 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 413/810] 10.222.0.70 () {56 vars in 1124 bytes} [Sun Aug 28 18:37:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:15.721926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708a053-b2f1-4d25-a416-71d9ab44a7f4 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:15.728060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:15.771027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:15.827868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe736c1-8f3e-49ef-b31e-770ce7aa80e0 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:15.831895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708a053-b2f1-4d25-a416-71d9ab44a7f4 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:15.866562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba17ee4-98ff-4708-8b33-8f04b64433ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:15.867310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba17ee4-98ff-4708-8b33-8f04b64433ac None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:15.867661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba17ee4-98ff-4708-8b33-8f04b64433ac None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:15.868061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba17ee4-98ff-4708-8b33-8f04b64433ac None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:15.868813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba17ee4-98ff-4708-8b33-8f04b64433ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:15.869124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba17ee4-98ff-4708-8b33-8f04b64433ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:15.869666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67276f-ff3e-44f7-b829-872ed2856eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:15.870487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67276f-ff3e-44f7-b829-872ed2856eca None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:15.870602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba17ee4-98ff-4708-8b33-8f04b64433ac None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:15.871117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67276f-ff3e-44f7-b829-872ed2856eca None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:15.871631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67276f-ff3e-44f7-b829-872ed2856eca None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:15.872494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67276f-ff3e-44f7-b829-872ed2856eca None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:15.872997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67276f-ff3e-44f7-b829-872ed2856eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:15.874542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67276f-ff3e-44f7-b829-872ed2856eca None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:15.888432 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 398/812] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:15.888432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba17ee4-98ff-4708-8b33-8f04b64433ac None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:15.888932 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 414/812] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:37:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:15.890012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67276f-ff3e-44f7-b829-872ed2856eca None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:15.969723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:15.999334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba17ee4-98ff-4708-8b33-8f04b64433ac None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:15.999708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67276f-ff3e-44f7-b829-872ed2856eca None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:16.006890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:16.038448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61a45b-4d47-4256-9743-fa615d6504ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:16.039340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61a45b-4d47-4256-9743-fa615d6504ee None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:16.039628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61a45b-4d47-4256-9743-fa615d6504ee None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:16.039898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61a45b-4d47-4256-9743-fa615d6504ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:16.040557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61a45b-4d47-4256-9743-fa615d6504ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:16.041914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61a45b-4d47-4256-9743-fa615d6504ee None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:16.042177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788258-a2f7-4b5f-b936-7202e4c11473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:16.042994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788258-a2f7-4b5f-b936-7202e4c11473 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:16.043438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788258-a2f7-4b5f-b936-7202e4c11473 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:16.043854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788258-a2f7-4b5f-b936-7202e4c11473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:16.056311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08788258-a2f7-4b5f-b936-7202e4c11473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:16.058205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08788258-a2f7-4b5f-b936-7202e4c11473 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:16.065602 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 399/813] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:37:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:16.066369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61a45b-4d47-4256-9743-fa615d6504ee None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-08788258-a2f7-4b5f-b936-7202e4c11473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:16.076450 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:16.077473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:16.078424 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:16.078424 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:16.078424 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:16.081420 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 415/814] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:16.084071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940559b-91d6-439a-9e88-f7a61f30c5c0 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:16.084571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940559b-91d6-439a-9e88-f7a61f30c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:16.085256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940559b-91d6-439a-9e88-f7a61f30c5c0 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:16.091670 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 416/815] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:16.092988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940559b-91d6-439a-9e88-f7a61f30c5c0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:16.214460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61a45b-4d47-4256-9743-fa615d6504ee None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:16.247763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940559b-91d6-439a-9e88-f7a61f30c5c0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:16.251295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:16.263310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767117a-34e7-426c-b725-9f12824875e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:16.264239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767117a-34e7-426c-b725-9f12824875e2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:16.264649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767117a-34e7-426c-b725-9f12824875e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:16.265011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767117a-34e7-426c-b725-9f12824875e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:16.274623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767117a-34e7-426c-b725-9f12824875e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:16.276254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767117a-34e7-426c-b725-9f12824875e2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-8767117a-34e7-426c-b725-9f12824875e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:16.291313 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:16.292449 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:16.293686 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:16.293686 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:16.293686 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:16.293686 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:16.293686 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:16.293686 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:16.293686 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:16.293686 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:16.293686 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 400/816] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:16.294260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11bc75-82e9-413a-a146-06f0dd5d4c0b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:16.294260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11bc75-82e9-413a-a146-06f0dd5d4c0b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:16.294260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11bc75-82e9-413a-a146-06f0dd5d4c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:16.297359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5baa530-7d06-482e-a730-723b9a1281d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:16.298072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baa530-7d06-482e-a730-723b9a1281d9 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:16.299017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baa530-7d06-482e-a730-723b9a1281d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:16.299390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baa530-7d06-482e-a730-723b9a1281d9 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:16.300463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5baa530-7d06-482e-a730-723b9a1281d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:16.300877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5baa530-7d06-482e-a730-723b9a1281d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:16.302355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5baa530-7d06-482e-a730-723b9a1281d9 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:16.317368 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 417/817] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:16.318406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5baa530-7d06-482e-a730-723b9a1281d9 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:16.322166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1a11bc75-82e9-413a-a146-06f0dd5d4c0b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:16.323800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1a11bc75-82e9-413a-a146-06f0dd5d4c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:16.344098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:16.418778 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 401/818] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:16.418778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11bc75-82e9-413a-a146-06f0dd5d4c0b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:16.465682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5baa530-7d06-482e-a730-723b9a1281d9 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:16.532056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92036acd-adc3-4bde-89f4-795ef6c80809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:16.533194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92036acd-adc3-4bde-89f4-795ef6c80809 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:16.533526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92036acd-adc3-4bde-89f4-795ef6c80809 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:16.533804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92036acd-adc3-4bde-89f4-795ef6c80809 None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:16.534500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92036acd-adc3-4bde-89f4-795ef6c80809 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:16.534826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92036acd-adc3-4bde-89f4-795ef6c80809 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:16.536271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92036acd-adc3-4bde-89f4-795ef6c80809 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:16.562223 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 418/819] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:16.567402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92036acd-adc3-4bde-89f4-795ef6c80809 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:16.605873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11bc75-82e9-413a-a146-06f0dd5d4c0b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:16.632909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:16.669812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628fe47-832d-49ae-8fed-182f893f9b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:16.670591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628fe47-832d-49ae-8fed-182f893f9b2d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:16.670969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628fe47-832d-49ae-8fed-182f893f9b2d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:16.671350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628fe47-832d-49ae-8fed-182f893f9b2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:16.684684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628fe47-832d-49ae-8fed-182f893f9b2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:16.686914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628fe47-832d-49ae-8fed-182f893f9b2d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-b628fe47-832d-49ae-8fed-182f893f9b2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:16.706772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:16.707999 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:16.709126 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:16.709126 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:16.709126 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:16.709126 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:16.709126 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:16.709126 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:16.709126 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:16.709126 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:16.709126 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:37:16.709126 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:16.710901 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 402/820] 10.222.0.70 () {56 vars in 1093 bytes} [Sun Aug 28 18:37:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:16.716541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628fe47-832d-49ae-8fed-182f893f9b2d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:16.726694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:16.753494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92036acd-adc3-4bde-89f4-795ef6c80809 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:16.797688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60278ab1-aec7-499b-80dc-d88c4cb705c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:16.799228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60278ab1-aec7-499b-80dc-d88c4cb705c0 None admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:16.799513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60278ab1-aec7-499b-80dc-d88c4cb705c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:16.799954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60278ab1-aec7-499b-80dc-d88c4cb705c0 None admin] PATH_INFO: `/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/299bba14d2dd48c997974093cb4f443f/roles/57a3c5c9b870422597e89540164ee502` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:16.819333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60278ab1-aec7-499b-80dc-d88c4cb705c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7555fde9e5404eb3b0dbfa04ee871f, user_id=299bba14d2dd48c997974093cb4f443f, role_id=57a3c5c9b870422597e89540164ee502)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:16.820953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60278ab1-aec7-499b-80dc-d88c4cb705c0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:16.838882 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 419/821] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:37:16 2022] PUT /identity/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/299bba14d2dd48c997974093cb4f443f/roles/57a3c5c9b870422597e89540164ee502 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:37:16.839733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60278ab1-aec7-499b-80dc-d88c4cb705c0 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:16.840070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628fe47-832d-49ae-8fed-182f893f9b2d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:16.882711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9463b1-fcef-44b5-8fd4-e59e4214fac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:16.883618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9463b1-fcef-44b5-8fd4-e59e4214fac4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:16.883997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9463b1-fcef-44b5-8fd4-e59e4214fac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:16.884417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9463b1-fcef-44b5-8fd4-e59e4214fac4 None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:16.885331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9463b1-fcef-44b5-8fd4-e59e4214fac4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:16.885706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9463b1-fcef-44b5-8fd4-e59e4214fac4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:16.887501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9463b1-fcef-44b5-8fd4-e59e4214fac4 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:16.909686 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 403/822] 10.222.0.70 () {56 vars in 1133 bytes} [Sun Aug 28 18:37:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:16.915291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9463b1-fcef-44b5-8fd4-e59e4214fac4 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:16.954126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:17.007025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60278ab1-aec7-499b-80dc-d88c4cb705c0 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:17.039445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:17.044318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e36bfa-1f9e-4da6-be8f-2672398a13e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:17.045083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e36bfa-1f9e-4da6-be8f-2672398a13e0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:17.045465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e36bfa-1f9e-4da6-be8f-2672398a13e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:17.045833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e36bfa-1f9e-4da6-be8f-2672398a13e0 None admin] PATH_INFO: `/v3/services/network` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:17.046523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e36bfa-1f9e-4da6-be8f-2672398a13e0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:17.048617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e36bfa-1f9e-4da6-be8f-2672398a13e0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-c4e36bfa-1f9e-4da6-be8f-2672398a13e0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:17.059944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:17.061615 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 18:37:17.063425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:17.065214 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 420/823] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:16 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:17.075849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e36bfa-1f9e-4da6-be8f-2672398a13e0 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:17.076512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9463b1-fcef-44b5-8fd4-e59e4214fac4 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:17.117970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4412ce8-c4a8-44e3-b0ad-2a5d9c9a635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:17.118605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4412ce8-c4a8-44e3-b0ad-2a5d9c9a635f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:17.118926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4412ce8-c4a8-44e3-b0ad-2a5d9c9a635f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:17.119246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4412ce8-c4a8-44e3-b0ad-2a5d9c9a635f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:17.202498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4412ce8-c4a8-44e3-b0ad-2a5d9c9a635f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:17.204005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4412ce8-c4a8-44e3-b0ad-2a5d9c9a635f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:17.255149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:17.255476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e36bfa-1f9e-4da6-be8f-2672398a13e0 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:17.291766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac5d62-b61c-4b32-8578-f612d8bd940a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:17.292383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5d62-b61c-4b32-8578-f612d8bd940a None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:17.292668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5d62-b61c-4b32-8578-f612d8bd940a None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:17.292945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5d62-b61c-4b32-8578-f612d8bd940a None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:17.293581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac5d62-b61c-4b32-8578-f612d8bd940a None admin] RBAC: Adding query filter params (name=network) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:17.293889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac5d62-b61c-4b32-8578-f612d8bd940a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:17.295294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac5d62-b61c-4b32-8578-f612d8bd940a None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:17.301494 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 421/824] 10.222.0.70 () {56 vars in 1112 bytes} [Sun Aug 28 18:37:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:17.302703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37476d3-b28c-4452-8a1c-4164a20a0730 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:17.303016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37476d3-b28c-4452-8a1c-4164a20a0730 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:17.303296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37476d3-b28c-4452-8a1c-4164a20a0730 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:17.304744 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 422/825] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:17.309072 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 404/826] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 18:37:17.309844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37476d3-b28c-4452-8a1c-4164a20a0730 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:17.315610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa1285-cecf-4aad-a568-140ac81e53da None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:17.315892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa1285-cecf-4aad-a568-140ac81e53da None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:17.316053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa1285-cecf-4aad-a568-140ac81e53da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:17.335395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9aaa1285-cecf-4aad-a568-140ac81e53da None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:17.336626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9aaa1285-cecf-4aad-a568-140ac81e53da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:17.377268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:17.414341 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 405/827] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:17.415280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa1285-cecf-4aad-a568-140ac81e53da None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:17.427566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37476d3-b28c-4452-8a1c-4164a20a0730 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:17.480202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ca378-83ea-4bba-82f0-f4c790b01ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:17.480833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ca378-83ea-4bba-82f0-f4c790b01ec1 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:17.481125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ca378-83ea-4bba-82f0-f4c790b01ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:17.481401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ca378-83ea-4bba-82f0-f4c790b01ec1 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:17.482048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ca378-83ea-4bba-82f0-f4c790b01ec1 None admin] RBAC: Adding query filter params (type=network) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:17.482358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ca378-83ea-4bba-82f0-f4c790b01ec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:17.483769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ca378-83ea-4bba-82f0-f4c790b01ec1 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:17.490153 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 423/828] 10.222.0.70 () {56 vars in 1112 bytes} [Sun Aug 28 18:37:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:17.495407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ca378-83ea-4bba-82f0-f4c790b01ec1 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:17.516245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:17.564175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa1285-cecf-4aad-a568-140ac81e53da None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:17.637821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e97bb5-044e-4358-9e53-caeb96bf7973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:17.638629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e97bb5-044e-4358-9e53-caeb96bf7973 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:17.639032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e97bb5-044e-4358-9e53-caeb96bf7973 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:17.639430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e97bb5-044e-4358-9e53-caeb96bf7973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:17.654438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e97bb5-044e-4358-9e53-caeb96bf7973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:17.656535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e97bb5-044e-4358-9e53-caeb96bf7973 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-e7e97bb5-044e-4358-9e53-caeb96bf7973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:17.690002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:17.691179 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:17.692253 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:17.692253 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:17.692253 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:17.699192 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 406/829] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:17.703323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e97bb5-044e-4358-9e53-caeb96bf7973 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:17.716988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ca378-83ea-4bba-82f0-f4c790b01ec1 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:17.758192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:17.777637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f8f1c-0d72-46a7-9a94-16b63ea7b6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:17.778673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8f1c-0d72-46a7-9a94-16b63ea7b6c5 None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:17.778992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8f1c-0d72-46a7-9a94-16b63ea7b6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:17.779276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f8f1c-0d72-46a7-9a94-16b63ea7b6c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:17.780239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f8f1c-0d72-46a7-9a94-16b63ea7b6c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:17.781882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f8f1c-0d72-46a7-9a94-16b63ea7b6c5 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:17.812531 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 424/830] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:37:17 2022] POST /identity/v3/endpoints => generated 337 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:37:17.813383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f8f1c-0d72-46a7-9a94-16b63ea7b6c5 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:17.883890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e97bb5-044e-4358-9e53-caeb96bf7973 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:17.914135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:17.943973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401050d-81d5-4966-88b2-be88ea58764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:17.944598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401050d-81d5-4966-88b2-be88ea58764a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:17.944999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401050d-81d5-4966-88b2-be88ea58764a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:17.945276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401050d-81d5-4966-88b2-be88ea58764a None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:17.945931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401050d-81d5-4966-88b2-be88ea58764a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:17.946234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401050d-81d5-4966-88b2-be88ea58764a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:17.947650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401050d-81d5-4966-88b2-be88ea58764a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:17.962548 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 407/831] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:17.968162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401050d-81d5-4966-88b2-be88ea58764a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:18.029962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f8f1c-0d72-46a7-9a94-16b63ea7b6c5 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:18.077320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394d169-adc7-4b96-adba-a65f46683297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:18.078394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394d169-adc7-4b96-adba-a65f46683297 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:18.078682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394d169-adc7-4b96-adba-a65f46683297 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:18.078988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394d169-adc7-4b96-adba-a65f46683297 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:18.094939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394d169-adc7-4b96-adba-a65f46683297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:18.095779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401050d-81d5-4966-88b2-be88ea58764a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:18.138831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112791b-b8fa-4ada-aa61-fd0e9dfa9a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:18.139416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112791b-b8fa-4ada-aa61-fd0e9dfa9a7e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:18.139698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112791b-b8fa-4ada-aa61-fd0e9dfa9a7e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:18.139968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112791b-b8fa-4ada-aa61-fd0e9dfa9a7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:18.148784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112791b-b8fa-4ada-aa61-fd0e9dfa9a7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:18.150262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112791b-b8fa-4ada-aa61-fd0e9dfa9a7e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-0112791b-b8fa-4ada-aa61-fd0e9dfa9a7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:18.166303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:18.168468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:18.170562 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:18.170562 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:18.170562 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:18.170562 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:18.170562 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:18.170562 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:18.170562 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:18.170562 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:18.170562 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 408/832] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:18.174990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112791b-b8fa-4ada-aa61-fd0e9dfa9a7e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:18.215608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-8394d169-adc7-4b96-adba-a65f46683297 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:18.245416 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:18.247512 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:18.248689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:18.248689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:18.248689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:18.248689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:18.248689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:18.248689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:18.248689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:18.248689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:18.248689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:18.248689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:18.248689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:18.248689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:18.248689 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 425/833] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:37:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:18.253291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394d169-adc7-4b96-adba-a65f46683297 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:18.306191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112791b-b8fa-4ada-aa61-fd0e9dfa9a7e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:18.307341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:18.344740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c8a42-f573-4f9f-a557-7801c32a4c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:18.346074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c8a42-f573-4f9f-a557-7801c32a4c83 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:18.346352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c8a42-f573-4f9f-a557-7801c32a4c83 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:18.346626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c8a42-f573-4f9f-a557-7801c32a4c83 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:18.347412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c8a42-f573-4f9f-a557-7801c32a4c83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:18.347721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c8a42-f573-4f9f-a557-7801c32a4c83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:18.349154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c8a42-f573-4f9f-a557-7801c32a4c83 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:18.366775 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 409/834] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:18.366775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56d2cb-38d0-4bbd-86b7-6dfbdce2ded6 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:18.366775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56d2cb-38d0-4bbd-86b7-6dfbdce2ded6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:18.366775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56d2cb-38d0-4bbd-86b7-6dfbdce2ded6 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:18.367310 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 410/835] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:18.369191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56d2cb-38d0-4bbd-86b7-6dfbdce2ded6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:18.394318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394d169-adc7-4b96-adba-a65f46683297 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:18.433045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745dab7-b1ec-41a0-8ec7-1ed4d8df3236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:18.433650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745dab7-b1ec-41a0-8ec7-1ed4d8df3236 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:18.433924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745dab7-b1ec-41a0-8ec7-1ed4d8df3236 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:18.434190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745dab7-b1ec-41a0-8ec7-1ed4d8df3236 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:18.434876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745dab7-b1ec-41a0-8ec7-1ed4d8df3236 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:18.435182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745dab7-b1ec-41a0-8ec7-1ed4d8df3236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:18.436562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745dab7-b1ec-41a0-8ec7-1ed4d8df3236 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:18.446213 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 426/836] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:37:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:18.446213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c3070-7c04-4cbc-8294-3790b845ec49 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:18.446213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c3070-7c04-4cbc-8294-3790b845ec49 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:18.446213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c3070-7c04-4cbc-8294-3790b845ec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:18.467179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-191c3070-7c04-4cbc-8294-3790b845ec49 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:18.468367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-191c3070-7c04-4cbc-8294-3790b845ec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:18.472446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:18.484575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56d2cb-38d0-4bbd-86b7-6dfbdce2ded6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:18.522309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0450ebf-0aaa-49dc-a56c-ecdb6bf4c75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:18.522955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0450ebf-0aaa-49dc-a56c-ecdb6bf4c75e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:18.523243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0450ebf-0aaa-49dc-a56c-ecdb6bf4c75e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:18.523516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0450ebf-0aaa-49dc-a56c-ecdb6bf4c75e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:18.524272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0450ebf-0aaa-49dc-a56c-ecdb6bf4c75e None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=ea8cbbc34aab42a4ada9cbee1772847b) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:18.524666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0450ebf-0aaa-49dc-a56c-ecdb6bf4c75e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:18.526106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0450ebf-0aaa-49dc-a56c-ecdb6bf4c75e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:18.542765 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 411/837] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:18 2022] GET /identity/v3/role_assignments?user.id=ea8cbbc34aab42a4ada9cbee1772847b&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:18.542765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0450ebf-0aaa-49dc-a56c-ecdb6bf4c75e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:18.549881 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 427/838] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:18.670377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0450ebf-0aaa-49dc-a56c-ecdb6bf4c75e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:18.710853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e274332-b7cf-42db-a906-926e44b912df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:18.711828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e274332-b7cf-42db-a906-926e44b912df None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:18.712307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e274332-b7cf-42db-a906-926e44b912df None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:18.712760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e274332-b7cf-42db-a906-926e44b912df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:18.725375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e274332-b7cf-42db-a906-926e44b912df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:18.727157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e274332-b7cf-42db-a906-926e44b912df None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-5e274332-b7cf-42db-a906-926e44b912df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:18.741608 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:18.742592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:18.743574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:18.743574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:18.743574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:18.743574 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 412/839] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:18.750913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c3070-7c04-4cbc-8294-3790b845ec49 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:18.782794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:18.836009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e274332-b7cf-42db-a906-926e44b912df None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:18.849194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:18.864146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c3070-7c04-4cbc-8294-3790b845ec49 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:18.902552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947a37f-a380-4be3-bbb4-4e483d82b843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:18.903443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947a37f-a380-4be3-bbb4-4e483d82b843 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:18.903948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947a37f-a380-4be3-bbb4-4e483d82b843 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:18.904401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947a37f-a380-4be3-bbb4-4e483d82b843 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:18.905261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947a37f-a380-4be3-bbb4-4e483d82b843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:18.905713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947a37f-a380-4be3-bbb4-4e483d82b843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:18.907936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947a37f-a380-4be3-bbb4-4e483d82b843 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:18.921048 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 428/840] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:18.928245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947a37f-a380-4be3-bbb4-4e483d82b843 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:18.955219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e274332-b7cf-42db-a906-926e44b912df None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:18.992926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4277e-d6f1-4426-950c-d3a93ea70c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:18.993615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4277e-d6f1-4426-950c-d3a93ea70c0e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:18.993966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4277e-d6f1-4426-950c-d3a93ea70c0e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:18.994376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4277e-d6f1-4426-950c-d3a93ea70c0e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:18.994983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4277e-d6f1-4426-950c-d3a93ea70c0e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:18.996533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4277e-d6f1-4426-950c-d3a93ea70c0e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-9fa4277e-d6f1-4426-950c-d3a93ea70c0e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:19.006492 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:19.007718 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:37:19.008819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:19.009705 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 413/841] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:37:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:19.014993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4277e-d6f1-4426-950c-d3a93ea70c0e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:19.036665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:19.051171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947a37f-a380-4be3-bbb4-4e483d82b843 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:19.087415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db18df2-401d-42b1-8e13-d47b23fdb94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:19.088048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db18df2-401d-42b1-8e13-d47b23fdb94b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:19.088333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db18df2-401d-42b1-8e13-d47b23fdb94b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:19.088604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db18df2-401d-42b1-8e13-d47b23fdb94b None admin] PATH_INFO: `/v3/users/swift` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:19.097036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db18df2-401d-42b1-8e13-d47b23fdb94b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:19.098463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db18df2-401d-42b1-8e13-d47b23fdb94b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:19.099122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-3db18df2-401d-42b1-8e13-d47b23fdb94b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:19.111731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:19.112732 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:19.113656 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:19.113656 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:19.113656 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:19.113656 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:19.113656 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:19.113656 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:19.113656 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:19.113656 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:19.113656 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 18:37:19.113656 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:19.113656 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 429/842] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:37:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:19.114919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bf873-ddab-4d9e-b493-c04ef6e7b8ef None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:19.114919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bf873-ddab-4d9e-b493-c04ef6e7b8ef None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:19.115080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bf873-ddab-4d9e-b493-c04ef6e7b8ef None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:19.116382 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 430/843] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:19.121082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bf873-ddab-4d9e-b493-c04ef6e7b8ef None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:19.138425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4277e-d6f1-4426-950c-d3a93ea70c0e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:19.177096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55cb31-a436-48fc-a034-24a9917393d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:19.177505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55cb31-a436-48fc-a034-24a9917393d2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:19.177784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55cb31-a436-48fc-a034-24a9917393d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:19.178056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55cb31-a436-48fc-a034-24a9917393d2 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:19.178681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55cb31-a436-48fc-a034-24a9917393d2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:19.179014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55cb31-a436-48fc-a034-24a9917393d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:19.180680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55cb31-a436-48fc-a034-24a9917393d2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:19.190624 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 414/844] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:37:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:19.191662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe417d-9243-4011-b21b-496a87fbad71 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:19.191950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe417d-9243-4011-b21b-496a87fbad71 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:19.192218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe417d-9243-4011-b21b-496a87fbad71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:19.210545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1dbe417d-9243-4011-b21b-496a87fbad71 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:19.211773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1dbe417d-9243-4011-b21b-496a87fbad71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:19.233510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bf873-ddab-4d9e-b493-c04ef6e7b8ef None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:19.269334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0293d-b37a-4dce-9d74-184e0d0389ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:19.269949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0293d-b37a-4dce-9d74-184e0d0389ba None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:19.270232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0293d-b37a-4dce-9d74-184e0d0389ba None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:19.270502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0293d-b37a-4dce-9d74-184e0d0389ba None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:19.271263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0293d-b37a-4dce-9d74-184e0d0389ba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:19.271570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0293d-b37a-4dce-9d74-184e0d0389ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:19.273001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0293d-b37a-4dce-9d74-184e0d0389ba None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:19.286407 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 415/845] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:19.287508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe417d-9243-4011-b21b-496a87fbad71 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:19.302727 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 431/846] 10.222.0.70 () {56 vars in 1135 bytes} [Sun Aug 28 18:37:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:19.306070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0293d-b37a-4dce-9d74-184e0d0389ba None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:19.319414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:19.364394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:19.402616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe417d-9243-4011-b21b-496a87fbad71 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:19.438195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0293d-b37a-4dce-9d74-184e0d0389ba None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:19.440940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1444a-830f-473d-823b-dcb54d032e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:19.441951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1444a-830f-473d-823b-dcb54d032e2e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:19.442294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1444a-830f-473d-823b-dcb54d032e2e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:19.442636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1444a-830f-473d-823b-dcb54d032e2e None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:19.443373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1444a-830f-473d-823b-dcb54d032e2e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:19.443741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1444a-830f-473d-823b-dcb54d032e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:19.445169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1444a-830f-473d-823b-dcb54d032e2e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:19.458774 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 416/847] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:37:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:19.486207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284e45c-f5da-4cd0-ad8f-3dddf41b556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:19.486892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284e45c-f5da-4cd0-ad8f-3dddf41b556b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:19.487264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284e45c-f5da-4cd0-ad8f-3dddf41b556b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:19.487542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284e45c-f5da-4cd0-ad8f-3dddf41b556b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:19.566869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284e45c-f5da-4cd0-ad8f-3dddf41b556b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:19.568360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284e45c-f5da-4cd0-ad8f-3dddf41b556b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:19.583182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:19.602257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1444a-830f-473d-823b-dcb54d032e2e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:19.699287 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 432/848] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:37:19.707914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284e45c-f5da-4cd0-ad8f-3dddf41b556b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:19.723942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1444a-830f-473d-823b-dcb54d032e2e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:19.753883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:19.761176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b82273-14d6-4a70-a0f7-f2095cdc5393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:19.761808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b82273-14d6-4a70-a0f7-f2095cdc5393 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:19.762086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b82273-14d6-4a70-a0f7-f2095cdc5393 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:19.762358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b82273-14d6-4a70-a0f7-f2095cdc5393 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:19.774548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b82273-14d6-4a70-a0f7-f2095cdc5393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-d6b82273-14d6-4a70-a0f7-f2095cdc5393 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:19.780246 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:19.781445 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:19.782450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:19.782450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:19.782450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:19.782450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:19.782450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:19.782450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:19.782450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:19.782450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:19.782450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:19.782450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:19.782450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:37:19.782450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:19.786578 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 417/849] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:37:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:19.787696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b82273-14d6-4a70-a0f7-f2095cdc5393 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:19.832055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284e45c-f5da-4cd0-ad8f-3dddf41b556b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:19.840249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:19.871663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd093c-a19e-4b92-ae46-510b77be623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:19.872578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd093c-a19e-4b92-ae46-510b77be623e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:19.873008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd093c-a19e-4b92-ae46-510b77be623e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:19.873429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd093c-a19e-4b92-ae46-510b77be623e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:19.885199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd093c-a19e-4b92-ae46-510b77be623e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:19.886895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd093c-a19e-4b92-ae46-510b77be623e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-72cd093c-a19e-4b92-ae46-510b77be623e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:19.903871 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:19.905005 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:19.905963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:19.905963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:19.905963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:19.906127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b82273-14d6-4a70-a0f7-f2095cdc5393 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:19.913004 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 433/850] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:19.914112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd093c-a19e-4b92-ae46-510b77be623e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:19.942932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7c5a9-6c65-4e23-882c-7033b939b085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:19.943919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7c5a9-6c65-4e23-882c-7033b939b085 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:19.944382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7c5a9-6c65-4e23-882c-7033b939b085 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:19.944911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7c5a9-6c65-4e23-882c-7033b939b085 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:19.945757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7c5a9-6c65-4e23-882c-7033b939b085 None admin] RBAC: Adding query filter params (name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:19.946214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7c5a9-6c65-4e23-882c-7033b939b085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:19.947965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7c5a9-6c65-4e23-882c-7033b939b085 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:19.958258 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 418/851] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:37:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:19.963883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7c5a9-6c65-4e23-882c-7033b939b085 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:20.030316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:20.042550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd093c-a19e-4b92-ae46-510b77be623e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:20.080633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98d6ee-7726-40ae-9f35-503a9926ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:20.081633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98d6ee-7726-40ae-9f35-503a9926ec0e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:20.082099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98d6ee-7726-40ae-9f35-503a9926ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:20.082547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98d6ee-7726-40ae-9f35-503a9926ec0e None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:20.083358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98d6ee-7726-40ae-9f35-503a9926ec0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:20.083881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98d6ee-7726-40ae-9f35-503a9926ec0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:20.085514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98d6ee-7726-40ae-9f35-503a9926ec0e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:20.087363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7c5a9-6c65-4e23-882c-7033b939b085 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:20.107588 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 434/852] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:20.108768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98d6ee-7726-40ae-9f35-503a9926ec0e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:20.127571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4046aca-b8e9-4260-bd9b-67a5ed7547c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:20.128241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4046aca-b8e9-4260-bd9b-67a5ed7547c2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:20.128518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4046aca-b8e9-4260-bd9b-67a5ed7547c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:20.128938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4046aca-b8e9-4260-bd9b-67a5ed7547c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:20.130090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:20.142574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4046aca-b8e9-4260-bd9b-67a5ed7547c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:20.144391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4046aca-b8e9-4260-bd9b-67a5ed7547c2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-a4046aca-b8e9-4260-bd9b-67a5ed7547c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:20.162659 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:20.163881 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:20.164900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:20.164900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:20.164900 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:20.166817 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 419/853] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:20.170379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4046aca-b8e9-4260-bd9b-67a5ed7547c2 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:20.231310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98d6ee-7726-40ae-9f35-503a9926ec0e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:20.274577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68007721-bcc9-4678-aaee-4209ac522e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:20.275895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68007721-bcc9-4678-aaee-4209ac522e10 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:20.276578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68007721-bcc9-4678-aaee-4209ac522e10 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:20.277025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68007721-bcc9-4678-aaee-4209ac522e10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:20.286754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68007721-bcc9-4678-aaee-4209ac522e10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:20.288938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68007721-bcc9-4678-aaee-4209ac522e10 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:20.294881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4046aca-b8e9-4260-bd9b-67a5ed7547c2 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:20.297251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-68007721-bcc9-4678-aaee-4209ac522e10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:20.303517 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:20.304395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:20.305250 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:20.305250 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:20.305250 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:20.305250 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:20.305250 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:20.305250 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:20.305250 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:20.305250 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:20.307907 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 435/854] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:20.313508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68007721-bcc9-4678-aaee-4209ac522e10 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:20.337910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1b38d-d246-4bd1-9718-6599ffa5df62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:20.338573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1b38d-d246-4bd1-9718-6599ffa5df62 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:20.338949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1b38d-d246-4bd1-9718-6599ffa5df62 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:20.339226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1b38d-d246-4bd1-9718-6599ffa5df62 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:20.339865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1b38d-d246-4bd1-9718-6599ffa5df62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:20.340344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1b38d-d246-4bd1-9718-6599ffa5df62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:20.341586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1b38d-d246-4bd1-9718-6599ffa5df62 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:20.359568 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 420/855] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:20.361195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1b38d-d246-4bd1-9718-6599ffa5df62 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:20.420170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:20.447467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68007721-bcc9-4678-aaee-4209ac522e10 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:20.480988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1b38d-d246-4bd1-9718-6599ffa5df62 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:20.492419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84182901-8553-4662-9c99-5a1e937bdc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:20.493052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84182901-8553-4662-9c99-5a1e937bdc02 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:20.493338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84182901-8553-4662-9c99-5a1e937bdc02 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:20.493617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84182901-8553-4662-9c99-5a1e937bdc02 None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:20.494382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84182901-8553-4662-9c99-5a1e937bdc02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:20.495126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84182901-8553-4662-9c99-5a1e937bdc02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:20.496894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84182901-8553-4662-9c99-5a1e937bdc02 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:20.514042 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 436/856] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:20.521410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84182901-8553-4662-9c99-5a1e937bdc02 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:20.530159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49afb1-e2e3-4502-b115-3dd6e934d42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:20.530836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49afb1-e2e3-4502-b115-3dd6e934d42e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:20.531107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49afb1-e2e3-4502-b115-3dd6e934d42e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:20.531378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49afb1-e2e3-4502-b115-3dd6e934d42e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:20.540595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49afb1-e2e3-4502-b115-3dd6e934d42e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:20.542578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49afb1-e2e3-4502-b115-3dd6e934d42e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-9c49afb1-e2e3-4502-b115-3dd6e934d42e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:20.557845 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:20.558894 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:20.559867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:20.559867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:20.559867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:20.559867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:20.559867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:20.559867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:20.559867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:20.559867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:20.559867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:37:20.559867 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:20.562812 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 421/857] 10.222.0.70 () {56 vars in 1117 bytes} [Sun Aug 28 18:37:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:20.567919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49afb1-e2e3-4502-b115-3dd6e934d42e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:20.602212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:20.667927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84182901-8553-4662-9c99-5a1e937bdc02 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:20.693423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49afb1-e2e3-4502-b115-3dd6e934d42e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:20.702215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fe630-631f-4818-a1ac-7a37f239ee15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:20.702849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fe630-631f-4818-a1ac-7a37f239ee15 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:20.703126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fe630-631f-4818-a1ac-7a37f239ee15 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:20.703398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fe630-631f-4818-a1ac-7a37f239ee15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:20.704121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fe630-631f-4818-a1ac-7a37f239ee15 None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=8787e53dd76c430e9ebe69b79b69827e) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:20.704491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fe630-631f-4818-a1ac-7a37f239ee15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:20.705910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fe630-631f-4818-a1ac-7a37f239ee15 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:20.711676 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 437/858] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:20 2022] GET /identity/v3/role_assignments?user.id=8787e53dd76c430e9ebe69b79b69827e&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:20.712619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f05deb-5ee4-4bb7-a0af-bd9c915c4820 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:20.712897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f05deb-5ee4-4bb7-a0af-bd9c915c4820 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:20.713166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f05deb-5ee4-4bb7-a0af-bd9c915c4820 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:20.714773 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 438/859] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:20.720656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac0b3a-594b-44c6-b328-5093e9f04734 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:20.721155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac0b3a-594b-44c6-b328-5093e9f04734 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:20.721568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac0b3a-594b-44c6-b328-5093e9f04734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:20.728211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:20.738804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3788bb-af58-4722-b222-86376a282f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:20.739439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3788bb-af58-4722-b222-86376a282f0d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:20.739722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3788bb-af58-4722-b222-86376a282f0d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:20.739998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3788bb-af58-4722-b222-86376a282f0d None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:20.740744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3788bb-af58-4722-b222-86376a282f0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:20.741054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3788bb-af58-4722-b222-86376a282f0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:20.742588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3788bb-af58-4722-b222-86376a282f0d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:20.743215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8dac0b3a-594b-44c6-b328-5093e9f04734 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:20.744580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8dac0b3a-594b-44c6-b328-5093e9f04734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:20.767835 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 422/860] 10.222.0.70 () {56 vars in 1149 bytes} [Sun Aug 28 18:37:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:20.770134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3788bb-af58-4722-b222-86376a282f0d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:20.832677 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 439/861] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:20.877142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:20.900746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3788bb-af58-4722-b222-86376a282f0d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:20.937703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a545-30e3-45d4-a354-86632b34438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:20.938837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a545-30e3-45d4-a354-86632b34438d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:20.939428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a545-30e3-45d4-a354-86632b34438d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:20.940069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a545-30e3-45d4-a354-86632b34438d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:21.009770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483a545-30e3-45d4-a354-86632b34438d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:21.012080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483a545-30e3-45d4-a354-86632b34438d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:21.094514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:21.100949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac0b3a-594b-44c6-b328-5093e9f04734 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:21.116162 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 423/862] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:37:21.121505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a545-30e3-45d4-a354-86632b34438d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:21.234369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac0b3a-594b-44c6-b328-5093e9f04734 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:21.238971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a545-30e3-45d4-a354-86632b34438d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:21.277872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:21.281072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b5118-0379-4244-87c5-b6f378e69afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:21.281747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b5118-0379-4244-87c5-b6f378e69afd None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:21.283186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b5118-0379-4244-87c5-b6f378e69afd None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:21.283479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b5118-0379-4244-87c5-b6f378e69afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:21.290122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f7ffe-e068-472b-b979-939d23f89394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:21.291635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f7ffe-e068-472b-b979-939d23f89394 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:21.291919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f7ffe-e068-472b-b979-939d23f89394 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:21.292198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f7ffe-e068-472b-b979-939d23f89394 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:21.292790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f7ffe-e068-472b-b979-939d23f89394 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:21.294775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f7ffe-e068-472b-b979-939d23f89394 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:21.295763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b5118-0379-4244-87c5-b6f378e69afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:21.297204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b5118-0379-4244-87c5-b6f378e69afd None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-2f9f7ffe-e068-472b-b979-939d23f89394 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:21.306006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:21.306985 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:37:21.308167 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:21.312874 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 440/863] 10.222.0.70 () {56 vars in 1132 bytes} [Sun Aug 28 18:37:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:21.314095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f7ffe-e068-472b-b979-939d23f89394 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-672b5118-0379-4244-87c5-b6f378e69afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:21.318119 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:21.319251 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:21.320293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:21.320293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:21.320293 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:21.325783 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 424/864] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:21.327671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b5118-0379-4244-87c5-b6f378e69afd None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:21.365106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:21.435641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b5118-0379-4244-87c5-b6f378e69afd None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:21.445667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f7ffe-e068-472b-b979-939d23f89394 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:21.471446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af1733-2bcb-4dc1-a62f-4edc4ac7fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:21.472087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1733-2bcb-4dc1-a62f-4edc4ac7fe5e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:21.472371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1733-2bcb-4dc1-a62f-4edc4ac7fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:21.472642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1733-2bcb-4dc1-a62f-4edc4ac7fe5e None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:21.473280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af1733-2bcb-4dc1-a62f-4edc4ac7fe5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:21.473584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af1733-2bcb-4dc1-a62f-4edc4ac7fe5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:21.474967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af1733-2bcb-4dc1-a62f-4edc4ac7fe5e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:21.483514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd3bf8-49d0-450e-ba80-8b6322fa1f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:21.484335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd3bf8-49d0-450e-ba80-8b6322fa1f44 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:21.484835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd3bf8-49d0-450e-ba80-8b6322fa1f44 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:21.485294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd3bf8-49d0-450e-ba80-8b6322fa1f44 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:21.487094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd3bf8-49d0-450e-ba80-8b6322fa1f44 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:21.487659 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 425/865] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:21.487768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd3bf8-49d0-450e-ba80-8b6322fa1f44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:21.488941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578d99a-f51f-47e8-b726-b6e991f7280e None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:21.489227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578d99a-f51f-47e8-b726-b6e991f7280e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:21.489501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578d99a-f51f-47e8-b726-b6e991f7280e None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:21.489801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd3bf8-49d0-450e-ba80-8b6322fa1f44 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:21.491022 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 426/866] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:21.496687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578d99a-f51f-47e8-b726-b6e991f7280e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:21.499056 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 441/867] 10.222.0.70 () {56 vars in 1126 bytes} [Sun Aug 28 18:37:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:21.500441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf72835-0d7d-4bb9-a6b8-f89a859345e3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:21.500725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf72835-0d7d-4bb9-a6b8-f89a859345e3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:21.500991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf72835-0d7d-4bb9-a6b8-f89a859345e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:21.519708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ccf72835-0d7d-4bb9-a6b8-f89a859345e3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:21.520880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ccf72835-0d7d-4bb9-a6b8-f89a859345e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:21.583349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:21.598794 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 442/868] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:21.598794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf72835-0d7d-4bb9-a6b8-f89a859345e3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:21.621453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:21.630066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578d99a-f51f-47e8-b726-b6e991f7280e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:21.668784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081485df-64cc-4b62-9c27-98504a6f3db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:21.669714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081485df-64cc-4b62-9c27-98504a6f3db2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:21.670139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081485df-64cc-4b62-9c27-98504a6f3db2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:21.670581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081485df-64cc-4b62-9c27-98504a6f3db2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:21.677926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081485df-64cc-4b62-9c27-98504a6f3db2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:21.679546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081485df-64cc-4b62-9c27-98504a6f3db2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-081485df-64cc-4b62-9c27-98504a6f3db2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:21.691678 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:21.693604 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:21.694525 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:21.694525 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:21.694525 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:21.694525 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:21.694525 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:21.694525 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:21.694525 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:21.694525 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:21.694525 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 427/869] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:21.699157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081485df-64cc-4b62-9c27-98504a6f3db2 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:21.735703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf72835-0d7d-4bb9-a6b8-f89a859345e3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:21.771244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4558c-b622-4291-9b02-a3e751adfd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:21.771852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4558c-b622-4291-9b02-a3e751adfd2f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:21.772134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4558c-b622-4291-9b02-a3e751adfd2f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:21.772405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4558c-b622-4291-9b02-a3e751adfd2f None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:21.773029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4558c-b622-4291-9b02-a3e751adfd2f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:21.773333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4558c-b622-4291-9b02-a3e751adfd2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:21.774699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4558c-b622-4291-9b02-a3e751adfd2f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:21.787272 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 443/870] 10.222.0.70 () {56 vars in 1126 bytes} [Sun Aug 28 18:37:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:21.823617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081485df-64cc-4b62-9c27-98504a6f3db2 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:21.866268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cd44a-8b67-460d-8fe8-e10b2095dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:21.867343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd44a-8b67-460d-8fe8-e10b2095dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:21.867830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd44a-8b67-460d-8fe8-e10b2095dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:21.868360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd44a-8b67-460d-8fe8-e10b2095dcb4 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:21.869269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cd44a-8b67-460d-8fe8-e10b2095dcb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:21.869800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cd44a-8b67-460d-8fe8-e10b2095dcb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:21.871572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cd44a-8b67-460d-8fe8-e10b2095dcb4 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:21.886538 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 428/871] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:21.897520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4558c-b622-4291-9b02-a3e751adfd2f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:21.900937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cd44a-8b67-460d-8fe8-e10b2095dcb4 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:21.918442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:21.975069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:22.023106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cd44a-8b67-460d-8fe8-e10b2095dcb4 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:22.041182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4558c-b622-4291-9b02-a3e751adfd2f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:22.062824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78398a90-d9ee-43de-8ea6-ca5ec0a28bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:22.063578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78398a90-d9ee-43de-8ea6-ca5ec0a28bcb None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:22.064077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78398a90-d9ee-43de-8ea6-ca5ec0a28bcb None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:22.064618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78398a90-d9ee-43de-8ea6-ca5ec0a28bcb None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:22.065371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78398a90-d9ee-43de-8ea6-ca5ec0a28bcb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:22.066915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78398a90-d9ee-43de-8ea6-ca5ec0a28bcb None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:22.081833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282aac0-fce5-43ee-8d8a-c25546b1d69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:22.082815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282aac0-fce5-43ee-8d8a-c25546b1d69d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:22.083380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282aac0-fce5-43ee-8d8a-c25546b1d69d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:22.083834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282aac0-fce5-43ee-8d8a-c25546b1d69d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:22.089466 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 429/872] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:37:21 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:37:22.089632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282aac0-fce5-43ee-8d8a-c25546b1d69d None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=299bba14d2dd48c997974093cb4f443f) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:22.089632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282aac0-fce5-43ee-8d8a-c25546b1d69d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:22.089632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282aac0-fce5-43ee-8d8a-c25546b1d69d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:22.098069 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 444/873] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:21 2022] GET /identity/v3/role_assignments?user.id=299bba14d2dd48c997974093cb4f443f&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:22.796116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40751adb-fa16-4b88-94b4-d3513e8dd7ef None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:22.796445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40751adb-fa16-4b88-94b4-d3513e8dd7ef None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:22.796670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40751adb-fa16-4b88-94b4-d3513e8dd7ef None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:22.798340 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 430/874] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:22.803663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8e21c-7435-4430-8333-83cc3ce7d032 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:22.804111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8e21c-7435-4430-8333-83cc3ce7d032 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:22.804187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8e21c-7435-4430-8333-83cc3ce7d032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:22.822976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cbb8e21c-7435-4430-8333-83cc3ce7d032 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:22.824148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cbb8e21c-7435-4430-8333-83cc3ce7d032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:22.903115 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 445/875] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:23.176260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40751adb-fa16-4b88-94b4-d3513e8dd7ef None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:23.262582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:23.290964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40751adb-fa16-4b88-94b4-d3513e8dd7ef None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:23.329198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f4ade-a8d0-4d9d-a6d4-6b9fb447428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:23.330730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f4ade-a8d0-4d9d-a6d4-6b9fb447428e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:23.331091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f4ade-a8d0-4d9d-a6d4-6b9fb447428e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:23.331368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f4ade-a8d0-4d9d-a6d4-6b9fb447428e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:23.331958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f4ade-a8d0-4d9d-a6d4-6b9fb447428e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:23.333329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f4ade-a8d0-4d9d-a6d4-6b9fb447428e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-db7f4ade-a8d0-4d9d-a6d4-6b9fb447428e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:23.342398 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:23.343376 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:23.344209 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 431/876] 10.222.0.70 () {56 vars in 1126 bytes} [Sun Aug 28 18:37:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:23.350344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8e21c-7435-4430-8333-83cc3ce7d032 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:23.397139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:23.453715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8e21c-7435-4430-8333-83cc3ce7d032 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:23.489905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d1c3f-bfe0-47d5-9f4f-154b28efbbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:23.490517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1c3f-bfe0-47d5-9f4f-154b28efbbb3 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:23.490820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1c3f-bfe0-47d5-9f4f-154b28efbbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:23.491094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1c3f-bfe0-47d5-9f4f-154b28efbbb3 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:23.491717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d1c3f-bfe0-47d5-9f4f-154b28efbbb3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:23.492016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d1c3f-bfe0-47d5-9f4f-154b28efbbb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:23.493390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d1c3f-bfe0-47d5-9f4f-154b28efbbb3 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:23.498356 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 446/877] 10.222.0.70 () {56 vars in 1122 bytes} [Sun Aug 28 18:37:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:23.504362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f4ade-a8d0-4d9d-a6d4-6b9fb447428e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:23.616473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f4ade-a8d0-4d9d-a6d4-6b9fb447428e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:23.664278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4c9ff-0372-46e9-9ce7-572b16f6d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:23.664895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4c9ff-0372-46e9-9ce7-572b16f6d510 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:23.665183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4c9ff-0372-46e9-9ce7-572b16f6d510 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:23.665463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4c9ff-0372-46e9-9ce7-572b16f6d510 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:23.666099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4c9ff-0372-46e9-9ce7-572b16f6d510 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:23.666408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4c9ff-0372-46e9-9ce7-572b16f6d510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:23.667819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4c9ff-0372-46e9-9ce7-572b16f6d510 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:23.672798 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 432/878] 10.222.0.70 () {56 vars in 1122 bytes} [Sun Aug 28 18:37:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:23.861581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f0db8-7c54-4c58-a455-9a2d120cbdea None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:23.862154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f0db8-7c54-4c58-a455-9a2d120cbdea None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:23.862154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f0db8-7c54-4c58-a455-9a2d120cbdea None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:23.863800 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 447/879] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:23.869080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3581ea0-9662-413f-b170-e6aa73dff2e3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:23.869369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3581ea0-9662-413f-b170-e6aa73dff2e3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:23.869649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3581ea0-9662-413f-b170-e6aa73dff2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:23.875968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:23.889455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e3581ea0-9662-413f-b170-e6aa73dff2e3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:23.890637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e3581ea0-9662-413f-b170-e6aa73dff2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:23.967650 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 433/880] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:24.094908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce82f-bc90-48ce-bb69-a8465c2cea98 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:24.095809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce82f-bc90-48ce-bb69-a8465c2cea98 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:24.095967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce82f-bc90-48ce-bb69-a8465c2cea98 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:24.097526 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 448/881] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:24.104102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56449-3873-441a-b3e6-428c84e114f2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:24.104501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56449-3873-441a-b3e6-428c84e114f2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:24.104901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa56449-3873-441a-b3e6-428c84e114f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:24.123346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-efa56449-3873-441a-b3e6-428c84e114f2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:24.124514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-efa56449-3873-441a-b3e6-428c84e114f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:24.194358 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 434/882] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:24.244059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ce82f-bc90-48ce-bb69-a8465c2cea98 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:24.261256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a05aa-d973-44e9-b48b-a765633dab7d None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:24.261554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a05aa-d973-44e9-b48b-a765633dab7d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:24.261964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a05aa-d973-44e9-b48b-a765633dab7d None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:24.263874 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 435/883] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:37:24.270480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c5e13-a0b2-4d43-950e-b7697cb0efb2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:24.270787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c5e13-a0b2-4d43-950e-b7697cb0efb2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:24.271062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c5e13-a0b2-4d43-950e-b7697cb0efb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:24.292229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-333c5e13-a0b2-4d43-950e-b7697cb0efb2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:24.293419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-333c5e13-a0b2-4d43-950e-b7697cb0efb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:24.355765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ce82f-bc90-48ce-bb69-a8465c2cea98 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:24.366021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:24.368976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:24.385119 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 436/884] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:24.397513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853dab6-57ce-4574-997d-262621f63cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:24.398176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853dab6-57ce-4574-997d-262621f63cfc None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:24.398456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853dab6-57ce-4574-997d-262621f63cfc None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:24.398770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853dab6-57ce-4574-997d-262621f63cfc None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:24.399519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853dab6-57ce-4574-997d-262621f63cfc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:24.401007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853dab6-57ce-4574-997d-262621f63cfc None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:24.418850 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 449/885] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:37:24 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:24.522333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c5e13-a0b2-4d43-950e-b7697cb0efb2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:24.633297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c5e13-a0b2-4d43-950e-b7697cb0efb2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:24.673976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657444b-7720-41f2-8179-558e6fe6531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:24.674514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657444b-7720-41f2-8179-558e6fe6531b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:24.674820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657444b-7720-41f2-8179-558e6fe6531b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:24.675092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657444b-7720-41f2-8179-558e6fe6531b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:24.675664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657444b-7720-41f2-8179-558e6fe6531b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:24.677026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657444b-7720-41f2-8179-558e6fe6531b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:24.683893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853dab6-57ce-4574-997d-262621f63cfc None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-e657444b-7720-41f2-8179-558e6fe6531b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:24.686395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:24.687363 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:37:24.688171 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:24.691308 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 437/886] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:37:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:24.697001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657444b-7720-41f2-8179-558e6fe6531b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:24.762378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:24.804414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853dab6-57ce-4574-997d-262621f63cfc None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:24.820279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657444b-7720-41f2-8179-558e6fe6531b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:24.843811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e828cb1-dc25-481c-afdc-88dde1f5ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:24.844604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e828cb1-dc25-481c-afdc-88dde1f5ea62 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:24.845364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e828cb1-dc25-481c-afdc-88dde1f5ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:24.846045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e828cb1-dc25-481c-afdc-88dde1f5ea62 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:24.858413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093c1f5-c7d1-4500-a7cf-99e25f26ee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:24.859125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093c1f5-c7d1-4500-a7cf-99e25f26ee03 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:24.859410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093c1f5-c7d1-4500-a7cf-99e25f26ee03 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:24.859587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e828cb1-dc25-481c-afdc-88dde1f5ea62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:24.859694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093c1f5-c7d1-4500-a7cf-99e25f26ee03 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:24.860301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093c1f5-c7d1-4500-a7cf-99e25f26ee03 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:24.861135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093c1f5-c7d1-4500-a7cf-99e25f26ee03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:24.862653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093c1f5-c7d1-4500-a7cf-99e25f26ee03 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-2e828cb1-dc25-481c-afdc-88dde1f5ea62 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:24.866465 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:24.868316 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:24.869430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:24.869430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:24.869430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:24.869430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:24.869430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:24.869430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:24.869430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:24.869430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:24.869430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:24.869430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:24.869430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:37:24.869430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:24.870187 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 438/887] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:37:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:24.872865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093c1f5-c7d1-4500-a7cf-99e25f26ee03 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:24.873541 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 450/888] 10.222.0.70 () {56 vars in 1120 bytes} [Sun Aug 28 18:37:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:24.874690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e828cb1-dc25-481c-afdc-88dde1f5ea62 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:24.908252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:24.985053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093c1f5-c7d1-4500-a7cf-99e25f26ee03 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:24.989357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e828cb1-dc25-481c-afdc-88dde1f5ea62 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:25.003399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:25.023714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43d47a-9c1b-4483-806e-ea9707a34f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:25.024677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d47a-9c1b-4483-806e-ea9707a34f49 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:25.025164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d47a-9c1b-4483-806e-ea9707a34f49 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:25.025676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d47a-9c1b-4483-806e-ea9707a34f49 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:25.026646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43d47a-9c1b-4483-806e-ea9707a34f49 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:25.027186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43d47a-9c1b-4483-806e-ea9707a34f49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:25.028099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fdc88-3b89-41e4-8e35-f57b6383705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:25.028779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fdc88-3b89-41e4-8e35-f57b6383705e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:25.029139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fdc88-3b89-41e4-8e35-f57b6383705e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:25.029252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43d47a-9c1b-4483-806e-ea9707a34f49 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:25.029533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fdc88-3b89-41e4-8e35-f57b6383705e None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:25.030265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fdc88-3b89-41e4-8e35-f57b6383705e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:25.030654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fdc88-3b89-41e4-8e35-f57b6383705e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:25.032837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fdc88-3b89-41e4-8e35-f57b6383705e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:25.036237 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 439/889] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:37:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:25.041935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43d47a-9c1b-4483-806e-ea9707a34f49 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:25.045515 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 451/890] 10.222.0.70 () {56 vars in 1115 bytes} [Sun Aug 28 18:37:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:25.051670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fdc88-3b89-41e4-8e35-f57b6383705e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:25.155192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:25.166076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fdc88-3b89-41e4-8e35-f57b6383705e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:25.177032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43d47a-9c1b-4483-806e-ea9707a34f49 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:25.203660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607f381-76cd-499e-88d1-3595e31b173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:25.204707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607f381-76cd-499e-88d1-3595e31b173f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:25.205241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607f381-76cd-499e-88d1-3595e31b173f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:25.205622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607f381-76cd-499e-88d1-3595e31b173f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:25.217407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607f381-76cd-499e-88d1-3595e31b173f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:25.219092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607f381-76cd-499e-88d1-3595e31b173f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:25.220435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c1be1-d418-4941-9e8f-cdc709bddf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:25.221557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c1be1-d418-4941-9e8f-cdc709bddf1a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:25.222158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c1be1-d418-4941-9e8f-cdc709bddf1a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:25.222578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c1be1-d418-4941-9e8f-cdc709bddf1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:25.223775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c1be1-d418-4941-9e8f-cdc709bddf1a None admin] RBAC: Adding query filter params (interface=public, service_id=8c455f07a01f46229dfeedd27b5af38a, region_id=RegionOne) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:25.224234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c1be1-d418-4941-9e8f-cdc709bddf1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:25.225727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c1be1-d418-4941-9e8f-cdc709bddf1a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-0607f381-76cd-499e-88d1-3595e31b173f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:25.237254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:25.238382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:25.239522 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:25.239522 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:25.239522 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:25.240217 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 440/891] 10.222.0.70 () {56 vars in 1251 bytes} [Sun Aug 28 18:37:25 2022] GET /identity/v3/endpoints?service_id=8c455f07a01f46229dfeedd27b5af38a&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:25.241197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c1be1-d418-4941-9e8f-cdc709bddf1a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:25.245507 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 452/892] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:25.246870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607f381-76cd-499e-88d1-3595e31b173f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:25.296674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:25.357381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c1be1-d418-4941-9e8f-cdc709bddf1a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:25.374891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607f381-76cd-499e-88d1-3595e31b173f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:25.399604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b2428-5950-482c-9f39-351c5fbe3b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:25.400269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b2428-5950-482c-9f39-351c5fbe3b9c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:25.400553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b2428-5950-482c-9f39-351c5fbe3b9c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:25.400824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b2428-5950-482c-9f39-351c5fbe3b9c None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:25.401421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b2428-5950-482c-9f39-351c5fbe3b9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:25.402800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b2428-5950-482c-9f39-351c5fbe3b9c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:25.414865 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 441/893] 10.222.0.70 () {56 vars in 1087 bytes} [Sun Aug 28 18:37:25 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:37:25.430332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f912f34-b21a-4b76-927d-034ff605cd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:25.430996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912f34-b21a-4b76-927d-034ff605cd43 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:25.431273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912f34-b21a-4b76-927d-034ff605cd43 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:25.431542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f912f34-b21a-4b76-927d-034ff605cd43 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:25.432193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f912f34-b21a-4b76-927d-034ff605cd43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:25.432736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f912f34-b21a-4b76-927d-034ff605cd43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:25.434141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f912f34-b21a-4b76-927d-034ff605cd43 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:25.453297 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 453/894] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:25.456484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b2428-5950-482c-9f39-351c5fbe3b9c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:25.577877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b2428-5950-482c-9f39-351c5fbe3b9c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:25.589359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:25.622533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f57cd-21c9-430c-b1f8-72bad64c45e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:25.623707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f57cd-21c9-430c-b1f8-72bad64c45e6 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:25.623707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f57cd-21c9-430c-b1f8-72bad64c45e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:25.623914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f57cd-21c9-430c-b1f8-72bad64c45e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:25.636948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f57cd-21c9-430c-b1f8-72bad64c45e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:25.636948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f57cd-21c9-430c-b1f8-72bad64c45e6 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-ab9f57cd-21c9-430c-b1f8-72bad64c45e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:25.649270 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:25.650232 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:25.651401 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:25.651401 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:25.651401 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:25.651401 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:25.651401 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:25.651401 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:25.651401 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:25.651401 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:25.651401 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:37:25.651401 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:25.651401 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 442/895] 10.222.0.70 () {56 vars in 1117 bytes} [Sun Aug 28 18:37:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:25.657965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f912f34-b21a-4b76-927d-034ff605cd43 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:25.661299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:25.709810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a02b0-a0af-463e-b381-c55bb1c2a12f None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:25.710459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a02b0-a0af-463e-b381-c55bb1c2a12f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:25.710981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a02b0-a0af-463e-b381-c55bb1c2a12f None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:25.712827 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 443/896] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:25.718515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e84964-d451-438a-8996-2dcd3126c442 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:25.718838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e84964-d451-438a-8996-2dcd3126c442 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:25.719121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e84964-d451-438a-8996-2dcd3126c442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:25.739500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-70e84964-d451-438a-8996-2dcd3126c442 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:25.740691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-70e84964-d451-438a-8996-2dcd3126c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:25.784880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f912f34-b21a-4b76-927d-034ff605cd43 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:25.822868 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 444/897] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:25.827357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29042a3-c0d6-4bad-8adf-0967fb00be15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:25.828312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29042a3-c0d6-4bad-8adf-0967fb00be15 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:25.828799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29042a3-c0d6-4bad-8adf-0967fb00be15 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:25.830079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29042a3-c0d6-4bad-8adf-0967fb00be15 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:25.831130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29042a3-c0d6-4bad-8adf-0967fb00be15 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:25.831671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29042a3-c0d6-4bad-8adf-0967fb00be15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:25.833343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29042a3-c0d6-4bad-8adf-0967fb00be15 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:25.857312 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 454/898] 10.222.0.70 () {56 vars in 1149 bytes} [Sun Aug 28 18:37:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:25.859066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e84964-d451-438a-8996-2dcd3126c442 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:25.964937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:25.969221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e84964-d451-438a-8996-2dcd3126c442 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:26.006365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82526c4-9a47-4bd0-861a-57f9388b34fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:26.007370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82526c4-9a47-4bd0-861a-57f9388b34fd None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:26.007847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82526c4-9a47-4bd0-861a-57f9388b34fd None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:26.008311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82526c4-9a47-4bd0-861a-57f9388b34fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:26.079851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82526c4-9a47-4bd0-861a-57f9388b34fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:26.081814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82526c4-9a47-4bd0-861a-57f9388b34fd None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:26.097946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29042a3-c0d6-4bad-8adf-0967fb00be15 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:26.170960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:26.211961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:26.216257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29042a3-c0d6-4bad-8adf-0967fb00be15 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:26.222817 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 445/899] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:25 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:37:26.225929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82526c4-9a47-4bd0-861a-57f9388b34fd None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:26.258445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff1190-f185-46b4-af45-027dbb17c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:26.259163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff1190-f185-46b4-af45-027dbb17c12f None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:26.259639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff1190-f185-46b4-af45-027dbb17c12f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:26.259979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff1190-f185-46b4-af45-027dbb17c12f None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:26.260739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff1190-f185-46b4-af45-027dbb17c12f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:26.262204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff1190-f185-46b4-af45-027dbb17c12f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:26.279505 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 455/900] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:37:26 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:37:26.355898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82526c4-9a47-4bd0-861a-57f9388b34fd None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:26.405110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ad53e-cb47-4fab-9a11-10a1f101c756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:26.405750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ad53e-cb47-4fab-9a11-10a1f101c756 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:26.406138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ad53e-cb47-4fab-9a11-10a1f101c756 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:26.406413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ad53e-cb47-4fab-9a11-10a1f101c756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:26.419045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ad53e-cb47-4fab-9a11-10a1f101c756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:26.420548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ad53e-cb47-4fab-9a11-10a1f101c756 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-b91ad53e-cb47-4fab-9a11-10a1f101c756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:26.437772 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:26.438812 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:26.439706 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:26.439706 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:26.439706 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:26.439706 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 446/901] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:26.445961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff1190-f185-46b4-af45-027dbb17c12f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:26.468864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f5262-a4f0-4e80-85a8-c1a43498d241 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:26.469162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f5262-a4f0-4e80-85a8-c1a43498d241 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:26.469422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f5262-a4f0-4e80-85a8-c1a43498d241 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:26.471700 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 447/902] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:26.477001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c37a3-2cd0-459b-a285-737e37c97d0a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:26.477291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c37a3-2cd0-459b-a285-737e37c97d0a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:26.477616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c37a3-2cd0-459b-a285-737e37c97d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:26.497190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ea4c37a3-2cd0-459b-a285-737e37c97d0a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:26.498482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ea4c37a3-2cd0-459b-a285-737e37c97d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:26.547139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:26.565394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff1190-f185-46b4-af45-027dbb17c12f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:26.582718 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 448/903] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:26.592601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:26.608806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa4695-d35f-4d5d-aa84-cc9a4d247e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:26.609761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa4695-d35f-4d5d-aa84-cc9a4d247e6e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:26.610353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa4695-d35f-4d5d-aa84-cc9a4d247e6e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:26.611710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa4695-d35f-4d5d-aa84-cc9a4d247e6e None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:26.612639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa4695-d35f-4d5d-aa84-cc9a4d247e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:26.613166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa4695-d35f-4d5d-aa84-cc9a4d247e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:26.614896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa4695-d35f-4d5d-aa84-cc9a4d247e6e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:26.628959 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 456/904] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:26.636623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c37a3-2cd0-459b-a285-737e37c97d0a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:26.747979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c37a3-2cd0-459b-a285-737e37c97d0a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:26.787229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85f70e-e275-469b-a551-e6d65f3851d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:26.787229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85f70e-e275-469b-a551-e6d65f3851d4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:26.787229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85f70e-e275-469b-a551-e6d65f3851d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:26.787229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85f70e-e275-469b-a551-e6d65f3851d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:26.792809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85f70e-e275-469b-a551-e6d65f3851d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:26.794391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85f70e-e275-469b-a551-e6d65f3851d4 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-cd85f70e-e275-469b-a551-e6d65f3851d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:26.806400 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:26.807728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:26.808801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:26.808801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:26.808801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:26.808801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:26.808801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:26.808801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:26.808801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:26.808801 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:26.810757 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 449/905] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:26.817093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa4695-d35f-4d5d-aa84-cc9a4d247e6e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:26.853371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85f70e-e275-469b-a551-e6d65f3851d4 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:26.891412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:26.947704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa4695-d35f-4d5d-aa84-cc9a4d247e6e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:26.968502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85f70e-e275-469b-a551-e6d65f3851d4 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:26.987035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be25b62-6a99-414e-bd9d-1da955136f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:26.988018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be25b62-6a99-414e-bd9d-1da955136f46 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:26.988495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be25b62-6a99-414e-bd9d-1da955136f46 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:26.988981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be25b62-6a99-414e-bd9d-1da955136f46 None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:26.989872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be25b62-6a99-414e-bd9d-1da955136f46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:26.990371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be25b62-6a99-414e-bd9d-1da955136f46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:26.992088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be25b62-6a99-414e-bd9d-1da955136f46 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:27.005493 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 457/906] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:27.011020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be25b62-6a99-414e-bd9d-1da955136f46 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:27.018544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f9e05-0062-4bd3-945c-1b01806917ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:27.019214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9e05-0062-4bd3-945c-1b01806917ad None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:27.019492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9e05-0062-4bd3-945c-1b01806917ad None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:27.019762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f9e05-0062-4bd3-945c-1b01806917ad None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:27.020344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9e05-0062-4bd3-945c-1b01806917ad None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:27.021709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f9e05-0062-4bd3-945c-1b01806917ad None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-433f9e05-0062-4bd3-945c-1b01806917ad None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:27.035135 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:27.036068 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:27.037479 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 450/907] 10.222.0.70 () {56 vars in 1132 bytes} [Sun Aug 28 18:37:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:27.041931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f9e05-0062-4bd3-945c-1b01806917ad None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:27.065932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:27.132575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be25b62-6a99-414e-bd9d-1da955136f46 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:27.174805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128fb5-395f-4f93-afc5-f30b19310655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:27.175663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:27.176846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128fb5-395f-4f93-afc5-f30b19310655 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:27.177329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128fb5-395f-4f93-afc5-f30b19310655 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:27.177811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128fb5-395f-4f93-afc5-f30b19310655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:27.178326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f9e05-0062-4bd3-945c-1b01806917ad None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:27.179001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60128fb5-395f-4f93-afc5-f30b19310655 None admin] RBAC: Adding query filter params (role.id=19270012435942b6bc9e21008a315761, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=299bba14d2dd48c997974093cb4f443f) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:27.179518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60128fb5-395f-4f93-afc5-f30b19310655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:27.181175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60128fb5-395f-4f93-afc5-f30b19310655 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:27.189253 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 458/908] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:27 2022] GET /identity/v3/role_assignments?user.id=299bba14d2dd48c997974093cb4f443f&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=19270012435942b6bc9e21008a315761 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:27.222114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f50237-eace-40b8-8528-66284602d2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:27.222770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f50237-eace-40b8-8528-66284602d2cd None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:27.223060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f50237-eace-40b8-8528-66284602d2cd None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:27.223594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f50237-eace-40b8-8528-66284602d2cd None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:27.223965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f50237-eace-40b8-8528-66284602d2cd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:27.224270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f50237-eace-40b8-8528-66284602d2cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:27.225670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f50237-eace-40b8-8528-66284602d2cd None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:27.231523 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 451/909] 10.222.0.70 () {56 vars in 1126 bytes} [Sun Aug 28 18:37:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:27.238045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128fb5-395f-4f93-afc5-f30b19310655 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:27.352352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128fb5-395f-4f93-afc5-f30b19310655 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:27.354776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:27.388853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748144bf-92cd-4e76-b6f0-534abefc8aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:27.389466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748144bf-92cd-4e76-b6f0-534abefc8aef None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:27.389748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748144bf-92cd-4e76-b6f0-534abefc8aef None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:27.390019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748144bf-92cd-4e76-b6f0-534abefc8aef None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:27.390652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748144bf-92cd-4e76-b6f0-534abefc8aef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:27.390983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748144bf-92cd-4e76-b6f0-534abefc8aef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:27.392421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748144bf-92cd-4e76-b6f0-534abefc8aef None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:27.398186 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 459/910] 10.222.0.70 () {56 vars in 1126 bytes} [Sun Aug 28 18:37:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:27.403990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f50237-eace-40b8-8528-66284602d2cd None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:27.510885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f50237-eace-40b8-8528-66284602d2cd None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:27.546250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106abf9c-00f2-4370-88ad-c569b0fe3533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:27.546889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106abf9c-00f2-4370-88ad-c569b0fe3533 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:27.547173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106abf9c-00f2-4370-88ad-c569b0fe3533 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:27.547447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106abf9c-00f2-4370-88ad-c569b0fe3533 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:27.548663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106abf9c-00f2-4370-88ad-c569b0fe3533 None admin] RBAC: Adding query filter params (interface=public, service_id=5bcafb990c46459fb442dc6abf5bf708, region_id=RegionOne) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:27.548977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106abf9c-00f2-4370-88ad-c569b0fe3533 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:27.550338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106abf9c-00f2-4370-88ad-c569b0fe3533 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:27.555804 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 452/911] 10.222.0.70 () {56 vars in 1251 bytes} [Sun Aug 28 18:37:27 2022] GET /identity/v3/endpoints?service_id=5bcafb990c46459fb442dc6abf5bf708&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:27.562153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12a7f7-fb5f-4a4e-85e0-0dc501a0755f None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:27.562434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12a7f7-fb5f-4a4e-85e0-0dc501a0755f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:27.562719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12a7f7-fb5f-4a4e-85e0-0dc501a0755f None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:27.567027 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 460/912] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:27.567167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106abf9c-00f2-4370-88ad-c569b0fe3533 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:27.572817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934d27-c370-4300-bfec-e62ffef1ea52 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:27.573326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934d27-c370-4300-bfec-e62ffef1ea52 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:27.573828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934d27-c370-4300-bfec-e62ffef1ea52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:27.599944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0c934d27-c370-4300-bfec-e62ffef1ea52 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:27.601568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0c934d27-c370-4300-bfec-e62ffef1ea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:27.602083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:27.692471 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 461/913] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:27.694248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106abf9c-00f2-4370-88ad-c569b0fe3533 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:27.734606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3874e3-44a6-4eb2-8350-582790e7ed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:27.735246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3874e3-44a6-4eb2-8350-582790e7ed8e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:27.735695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3874e3-44a6-4eb2-8350-582790e7ed8e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:27.735974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3874e3-44a6-4eb2-8350-582790e7ed8e None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:27.736683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3874e3-44a6-4eb2-8350-582790e7ed8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:27.738153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3874e3-44a6-4eb2-8350-582790e7ed8e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:27.745682 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 453/914] 10.222.0.70 () {56 vars in 1087 bytes} [Sun Aug 28 18:37:27 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:37:27.964491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934d27-c370-4300-bfec-e62ffef1ea52 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:28.071705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:28.075781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934d27-c370-4300-bfec-e62ffef1ea52 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:28.113592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0bb3d-93fa-4594-bc6a-8af0fd706cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:28.114227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0bb3d-93fa-4594-bc6a-8af0fd706cb8 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.114508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0bb3d-93fa-4594-bc6a-8af0fd706cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.114802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0bb3d-93fa-4594-bc6a-8af0fd706cb8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.115389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0bb3d-93fa-4594-bc6a-8af0fd706cb8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:28.116755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0bb3d-93fa-4594-bc6a-8af0fd706cb8 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-0ad0bb3d-93fa-4594-bc6a-8af0fd706cb8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:28.125689 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:28.126790 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:28.127714 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 462/915] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:37:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:28.136060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3874e3-44a6-4eb2-8350-582790e7ed8e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:28.238439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:28.247417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3874e3-44a6-4eb2-8350-582790e7ed8e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:28.284278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503c824-cb63-4130-a313-64d3ff7fc760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:28.284889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503c824-cb63-4130-a313-64d3ff7fc760 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.285227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503c824-cb63-4130-a313-64d3ff7fc760 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.285507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503c824-cb63-4130-a313-64d3ff7fc760 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.286148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503c824-cb63-4130-a313-64d3ff7fc760 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:28.286454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503c824-cb63-4130-a313-64d3ff7fc760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:28.287849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503c824-cb63-4130-a313-64d3ff7fc760 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:28.293193 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 454/916] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:37:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:28.299934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0bb3d-93fa-4594-bc6a-8af0fd706cb8 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:28.332414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587428e7-1aae-4a5b-af0e-0d24f1918ed8 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.332703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587428e7-1aae-4a5b-af0e-0d24f1918ed8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.332988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587428e7-1aae-4a5b-af0e-0d24f1918ed8 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.334829 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 455/917] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:28.340645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad138be9-3cdb-4327-a514-05de2fcde546 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.340930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad138be9-3cdb-4327-a514-05de2fcde546 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.341210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad138be9-3cdb-4327-a514-05de2fcde546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.361238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ad138be9-3cdb-4327-a514-05de2fcde546 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:28.362547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ad138be9-3cdb-4327-a514-05de2fcde546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:28.425601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0bb3d-93fa-4594-bc6a-8af0fd706cb8 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:28.446885 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 456/918] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:28.471941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa347b91-3a8a-4fff-8160-648e3298c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:28.472605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa347b91-3a8a-4fff-8160-648e3298c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.472861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa347b91-3a8a-4fff-8160-648e3298c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.473139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa347b91-3a8a-4fff-8160-648e3298c9b5 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.473861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa347b91-3a8a-4fff-8160-648e3298c9b5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:28.474165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa347b91-3a8a-4fff-8160-648e3298c9b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:28.475579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa347b91-3a8a-4fff-8160-648e3298c9b5 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:28.485867 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 463/919] 10.222.0.70 () {56 vars in 1114 bytes} [Sun Aug 28 18:37:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:28.487383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad138be9-3cdb-4327-a514-05de2fcde546 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:28.581133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:28.599434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad138be9-3cdb-4327-a514-05de2fcde546 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:28.634676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d637dd3-2def-4834-bb4f-4d1482d5d1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:28.635388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d637dd3-2def-4834-bb4f-4d1482d5d1e5 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.635667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d637dd3-2def-4834-bb4f-4d1482d5d1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.635938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d637dd3-2def-4834-bb4f-4d1482d5d1e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.636599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d637dd3-2def-4834-bb4f-4d1482d5d1e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:28.637958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d637dd3-2def-4834-bb4f-4d1482d5d1e5 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:28.665311 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 457/920] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:37:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:28.763827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa347b91-3a8a-4fff-8160-648e3298c9b5 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:28.795380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:28.884420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa347b91-3a8a-4fff-8160-648e3298c9b5 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:28.926509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70da90-0d2a-465d-9850-aa5ebb04d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:28.927476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70da90-0d2a-465d-9850-aa5ebb04d139 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:28.927924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70da90-0d2a-465d-9850-aa5ebb04d139 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:28.928399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70da90-0d2a-465d-9850-aa5ebb04d139 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:28.929148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70da90-0d2a-465d-9850-aa5ebb04d139 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:28.930733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70da90-0d2a-465d-9850-aa5ebb04d139 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-cf70da90-0d2a-465d-9850-aa5ebb04d139 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:28.941031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:28.942269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:28.943331 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:28.945799 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 464/921] 10.222.0.70 () {56 vars in 1126 bytes} [Sun Aug 28 18:37:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:28.951873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d637dd3-2def-4834-bb4f-4d1482d5d1e5 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:29.069445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d637dd3-2def-4834-bb4f-4d1482d5d1e5 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:29.104817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524237f-9cbb-4cdf-9b9f-e2e1cb8a4237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:29.105428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524237f-9cbb-4cdf-9b9f-e2e1cb8a4237 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:29.105712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524237f-9cbb-4cdf-9b9f-e2e1cb8a4237 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:29.105988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524237f-9cbb-4cdf-9b9f-e2e1cb8a4237 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:29.106617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524237f-9cbb-4cdf-9b9f-e2e1cb8a4237 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:29.106946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524237f-9cbb-4cdf-9b9f-e2e1cb8a4237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:29.108304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524237f-9cbb-4cdf-9b9f-e2e1cb8a4237 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:29.113948 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 458/922] 10.222.0.70 () {56 vars in 1122 bytes} [Sun Aug 28 18:37:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:29.119608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70da90-0d2a-465d-9850-aa5ebb04d139 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:29.200596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab36a8-b129-4578-b551-ae79e58c2a09 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:29.200899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab36a8-b129-4578-b551-ae79e58c2a09 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:29.201104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab36a8-b129-4578-b551-ae79e58c2a09 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:29.202645 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 459/923] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:37:29.207830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43fad8-d82e-4242-8b59-ea0dbcebd976 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:29.208118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43fad8-d82e-4242-8b59-ea0dbcebd976 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:29.208395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43fad8-d82e-4242-8b59-ea0dbcebd976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:29.215742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:29.222214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:29.227315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ef43fad8-d82e-4242-8b59-ea0dbcebd976 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:29.228702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ef43fad8-d82e-4242-8b59-ea0dbcebd976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:29.238553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70da90-0d2a-465d-9850-aa5ebb04d139 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:29.285252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f700ee-ecd4-47a7-a176-4878f53f8242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:29.286271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f700ee-ecd4-47a7-a176-4878f53f8242 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:29.286558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f700ee-ecd4-47a7-a176-4878f53f8242 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:29.286862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f700ee-ecd4-47a7-a176-4878f53f8242 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:29.287502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f700ee-ecd4-47a7-a176-4878f53f8242 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:29.287874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f700ee-ecd4-47a7-a176-4878f53f8242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:29.289310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f700ee-ecd4-47a7-a176-4878f53f8242 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:29.298793 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 465/924] 10.222.0.70 () {56 vars in 1122 bytes} [Sun Aug 28 18:37:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:29.303685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f700ee-ecd4-47a7-a176-4878f53f8242 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:29.315531 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 460/925] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:29.413287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f700ee-ecd4-47a7-a176-4878f53f8242 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:29.452684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1f642-e1f9-4ff6-9dfa-6288e5583e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:29.453625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1f642-e1f9-4ff6-9dfa-6288e5583e45 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:29.454214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1f642-e1f9-4ff6-9dfa-6288e5583e45 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:29.454685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1f642-e1f9-4ff6-9dfa-6288e5583e45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:29.455600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1f642-e1f9-4ff6-9dfa-6288e5583e45 None admin] RBAC: Adding query filter params (interface=public, service_id=fd0b8086900a4a81955aa22125c7fb44, region_id=RegionOne) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:29.456120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1f642-e1f9-4ff6-9dfa-6288e5583e45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:29.457666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1f642-e1f9-4ff6-9dfa-6288e5583e45 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:29.463252 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 466/926] 10.222.0.70 () {56 vars in 1251 bytes} [Sun Aug 28 18:37:29 2022] GET /identity/v3/endpoints?service_id=fd0b8086900a4a81955aa22125c7fb44&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:29.471474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43fad8-d82e-4242-8b59-ea0dbcebd976 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:29.579315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43fad8-d82e-4242-8b59-ea0dbcebd976 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:29.616581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912dd201-58e0-479c-a1e1-85f1311300dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:29.617193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd201-58e0-479c-a1e1-85f1311300dd None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:29.617471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd201-58e0-479c-a1e1-85f1311300dd None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:29.617743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912dd201-58e0-479c-a1e1-85f1311300dd None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:29.618346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912dd201-58e0-479c-a1e1-85f1311300dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:29.619762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912dd201-58e0-479c-a1e1-85f1311300dd None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:29.621526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:29.627736 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 461/927] 10.222.0.70 () {56 vars in 1087 bytes} [Sun Aug 28 18:37:29 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:37:29.633413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1f642-e1f9-4ff6-9dfa-6288e5583e45 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:29.652203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:29.747052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1f642-e1f9-4ff6-9dfa-6288e5583e45 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:29.775096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cf659-dd04-448c-b468-408e84b56f6d None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:29.775579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cf659-dd04-448c-b468-408e84b56f6d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:29.776066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cf659-dd04-448c-b468-408e84b56f6d None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:29.779011 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 462/928] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:29.784784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54433841-98f6-4f96-bf2f-a95e99015ce1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:29.785131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54433841-98f6-4f96-bf2f-a95e99015ce1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:29.785417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54433841-98f6-4f96-bf2f-a95e99015ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:29.795279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df3993-80e8-4ff2-b1ae-053ae3bd67ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:29.796656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3993-80e8-4ff2-b1ae-053ae3bd67ec None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:29.797145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3993-80e8-4ff2-b1ae-053ae3bd67ec None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:29.797629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df3993-80e8-4ff2-b1ae-053ae3bd67ec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:29.810841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-54433841-98f6-4f96-bf2f-a95e99015ce1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:29.812078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-54433841-98f6-4f96-bf2f-a95e99015ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:29.817155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df3993-80e8-4ff2-b1ae-053ae3bd67ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-52df3993-80e8-4ff2-b1ae-053ae3bd67ec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:29.827623 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:29.828566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:29.829584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:29.829584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:29.829584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:29.829584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:29.829584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:29.829584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:29.829584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:29.829584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:29.829584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:29.829584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:29.829584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:37:29.829584 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:29.829584 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 467/929] 10.222.0.70 () {56 vars in 1120 bytes} [Sun Aug 28 18:37:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:29.835544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df3993-80e8-4ff2-b1ae-053ae3bd67ec None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:29.904795 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 463/930] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:29.923464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:29.953059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df3993-80e8-4ff2-b1ae-053ae3bd67ec None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:29.990432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa472288-6fe2-4bbb-be68-7525cbba7872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:29.991072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa472288-6fe2-4bbb-be68-7525cbba7872 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:29.991354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa472288-6fe2-4bbb-be68-7525cbba7872 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:29.991629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa472288-6fe2-4bbb-be68-7525cbba7872 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:29.992291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa472288-6fe2-4bbb-be68-7525cbba7872 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:29.992599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa472288-6fe2-4bbb-be68-7525cbba7872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:29.993962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa472288-6fe2-4bbb-be68-7525cbba7872 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:30.002554 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 468/931] 10.222.0.70 () {56 vars in 1115 bytes} [Sun Aug 28 18:37:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:30.008045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54433841-98f6-4f96-bf2f-a95e99015ce1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:30.108644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54433841-98f6-4f96-bf2f-a95e99015ce1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:30.142912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:30.148910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a393f6-bbf8-494e-88ec-fde5d9b1de82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:30.149542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a393f6-bbf8-494e-88ec-fde5d9b1de82 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:30.149820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a393f6-bbf8-494e-88ec-fde5d9b1de82 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:30.150984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a393f6-bbf8-494e-88ec-fde5d9b1de82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:30.161214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a393f6-bbf8-494e-88ec-fde5d9b1de82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:30.162932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a393f6-bbf8-494e-88ec-fde5d9b1de82 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-92a393f6-bbf8-494e-88ec-fde5d9b1de82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:30.179627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:30.180800 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:30.181844 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:30.181844 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:30.181844 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:30.183774 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 464/932] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:30.191847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa472288-6fe2-4bbb-be68-7525cbba7872 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:30.204360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a393f6-bbf8-494e-88ec-fde5d9b1de82 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:30.305655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa472288-6fe2-4bbb-be68-7525cbba7872 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:30.340265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a393f6-bbf8-494e-88ec-fde5d9b1de82 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:30.342969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802fbd4-5a15-4c9a-a2d2-4d5b081a2006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:30.343700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802fbd4-5a15-4c9a-a2d2-4d5b081a2006 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:30.344080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802fbd4-5a15-4c9a-a2d2-4d5b081a2006 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:30.344477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802fbd4-5a15-4c9a-a2d2-4d5b081a2006 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:30.346108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802fbd4-5a15-4c9a-a2d2-4d5b081a2006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:30.346563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802fbd4-5a15-4c9a-a2d2-4d5b081a2006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:30.348111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802fbd4-5a15-4c9a-a2d2-4d5b081a2006 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:30.351361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:30.365976 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 469/933] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:30.372418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802fbd4-5a15-4c9a-a2d2-4d5b081a2006 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:30.392917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426f89c-12e5-4963-aa7c-69493cfe9693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:30.394077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426f89c-12e5-4963-aa7c-69493cfe9693 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:30.394373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426f89c-12e5-4963-aa7c-69493cfe9693 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:30.394701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426f89c-12e5-4963-aa7c-69493cfe9693 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:30.395715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426f89c-12e5-4963-aa7c-69493cfe9693 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:30.397405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426f89c-12e5-4963-aa7c-69493cfe9693 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-d426f89c-12e5-4963-aa7c-69493cfe9693 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:30.410627 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:30.412403 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:30.413528 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 465/934] 10.222.0.70 () {56 vars in 1132 bytes} [Sun Aug 28 18:37:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:30.420297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426f89c-12e5-4963-aa7c-69493cfe9693 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:30.482483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:30.517947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802fbd4-5a15-4c9a-a2d2-4d5b081a2006 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:30.542532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426f89c-12e5-4963-aa7c-69493cfe9693 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:30.567800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65c4d6-265d-4dff-9bb1-8eeec31b9d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:30.568857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65c4d6-265d-4dff-9bb1-8eeec31b9d50 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:30.569206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65c4d6-265d-4dff-9bb1-8eeec31b9d50 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:30.569552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65c4d6-265d-4dff-9bb1-8eeec31b9d50 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:30.578288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65c4d6-265d-4dff-9bb1-8eeec31b9d50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:30.581350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65c4d6-265d-4dff-9bb1-8eeec31b9d50 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:30.593905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b089a-c70e-42df-a8d5-b5a264f7b32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:30.595397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b089a-c70e-42df-a8d5-b5a264f7b32b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:30.595858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b089a-c70e-42df-a8d5-b5a264f7b32b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:30.596309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b089a-c70e-42df-a8d5-b5a264f7b32b None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:30.597144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b089a-c70e-42df-a8d5-b5a264f7b32b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-0f65c4d6-265d-4dff-9bb1-8eeec31b9d50 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:30.597543 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:30.598473 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:30.599441 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:30.599441 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:30.599441 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:30.599441 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:30.599441 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:30.599441 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:30.599441 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:30.599441 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:30.599441 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:37:30.599441 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:30.599441 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 470/935] 10.222.0.70 () {56 vars in 1117 bytes} [Sun Aug 28 18:37:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:30.605048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b089a-c70e-42df-a8d5-b5a264f7b32b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:30.605048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b089a-c70e-42df-a8d5-b5a264f7b32b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:30.606543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65c4d6-265d-4dff-9bb1-8eeec31b9d50 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:30.611582 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 466/936] 10.222.0.70 () {56 vars in 1126 bytes} [Sun Aug 28 18:37:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:30.617703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b089a-c70e-42df-a8d5-b5a264f7b32b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:30.676519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:30.727778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65c4d6-265d-4dff-9bb1-8eeec31b9d50 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:30.760813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b089a-c70e-42df-a8d5-b5a264f7b32b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:30.765477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b322eb-adee-4808-8bf5-2c447cf0755d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:30.766339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b322eb-adee-4808-8bf5-2c447cf0755d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:30.766936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b322eb-adee-4808-8bf5-2c447cf0755d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:30.767431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b322eb-adee-4808-8bf5-2c447cf0755d None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:30.768360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b322eb-adee-4808-8bf5-2c447cf0755d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:30.768959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b322eb-adee-4808-8bf5-2c447cf0755d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:30.770637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b322eb-adee-4808-8bf5-2c447cf0755d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:30.773076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:30.796562 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 471/937] 10.222.0.70 () {56 vars in 1149 bytes} [Sun Aug 28 18:37:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:30.798615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b322eb-adee-4808-8bf5-2c447cf0755d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:30.809788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049298d-4591-432c-9676-200672abd075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:30.810403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049298d-4591-432c-9676-200672abd075 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:30.810690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049298d-4591-432c-9676-200672abd075 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:30.811016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049298d-4591-432c-9676-200672abd075 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:30.811649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049298d-4591-432c-9676-200672abd075 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:30.811956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049298d-4591-432c-9676-200672abd075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:30.814393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049298d-4591-432c-9676-200672abd075 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:30.822892 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 467/938] 10.222.0.70 () {56 vars in 1126 bytes} [Sun Aug 28 18:37:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:30.827849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049298d-4591-432c-9676-200672abd075 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:30.921836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b322eb-adee-4808-8bf5-2c447cf0755d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:30.937676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:30.941201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049298d-4591-432c-9676-200672abd075 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:30.960167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29090b-8879-4dbc-805b-ed90a4efa3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:30.960969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29090b-8879-4dbc-805b-ed90a4efa3f9 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:30.961309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29090b-8879-4dbc-805b-ed90a4efa3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:30.961646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29090b-8879-4dbc-805b-ed90a4efa3f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:30.972902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29090b-8879-4dbc-805b-ed90a4efa3f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:30.974560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29090b-8879-4dbc-805b-ed90a4efa3f9 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:30.975180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44030a3e-c733-4347-98f0-d76812db133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:30.975787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44030a3e-c733-4347-98f0-d76812db133b None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:30.976069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44030a3e-c733-4347-98f0-d76812db133b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:30.976347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44030a3e-c733-4347-98f0-d76812db133b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:30.977240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44030a3e-c733-4347-98f0-d76812db133b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:30.978340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44030a3e-c733-4347-98f0-d76812db133b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-2a29090b-8879-4dbc-805b-ed90a4efa3f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:30.991785 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:30.992926 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:30.993983 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:30.993983 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:30.993983 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:30.997742 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 472/939] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:30.998898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945a237-5815-48cd-ad4f-e234834a018a None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:30.999196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945a237-5815-48cd-ad4f-e234834a018a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:30.999536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945a237-5815-48cd-ad4f-e234834a018a None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:31.005208 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 473/940] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:31.005208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945a237-5815-48cd-ad4f-e234834a018a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:31.010959 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 468/941] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:37:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:31.012730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1be5cc-25b3-4fb6-84eb-8d29c1f042be None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:31.013970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1be5cc-25b3-4fb6-84eb-8d29c1f042be None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:31.014460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1be5cc-25b3-4fb6-84eb-8d29c1f042be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:31.041624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cb1be5cc-25b3-4fb6-84eb-8d29c1f042be None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:31.043836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cb1be5cc-25b3-4fb6-84eb-8d29c1f042be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:31.082801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:31.144160 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 469/942] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:31.153492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945a237-5815-48cd-ad4f-e234834a018a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:31.193985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1ced4-a089-4a40-a144-cef31d28d3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:31.194841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1ced4-a089-4a40-a144-cef31d28d3ce None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:31.195225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1ced4-a089-4a40-a144-cef31d28d3ce None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:31.195646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1ced4-a089-4a40-a144-cef31d28d3ce None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:31.196418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1ced4-a089-4a40-a144-cef31d28d3ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:31.196840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1ced4-a089-4a40-a144-cef31d28d3ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:31.198377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1ced4-a089-4a40-a144-cef31d28d3ce None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:31.212763 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 474/943] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:31.218220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1be5cc-25b3-4fb6-84eb-8d29c1f042be None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:31.325369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1be5cc-25b3-4fb6-84eb-8d29c1f042be None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:31.362047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58161d-d67c-4df1-bf9c-664f215069e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:31.362653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58161d-d67c-4df1-bf9c-664f215069e3 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:31.363001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58161d-d67c-4df1-bf9c-664f215069e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:31.363281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58161d-d67c-4df1-bf9c-664f215069e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:31.370250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58161d-d67c-4df1-bf9c-664f215069e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:31.371713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58161d-d67c-4df1-bf9c-664f215069e3 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-9c58161d-d67c-4df1-bf9c-664f215069e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:31.383120 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:31.384024 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:31.384927 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:31.384927 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:31.384927 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:31.384927 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:31.384927 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:31.384927 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:31.384927 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:31.384927 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:31.384927 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 470/944] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:31.390198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1ced4-a089-4a40-a144-cef31d28d3ce None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:31.419832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58161d-d67c-4df1-bf9c-664f215069e3 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:31.422068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:31.439691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:31.505745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1ced4-a089-4a40-a144-cef31d28d3ce None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:31.537259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58161d-d67c-4df1-bf9c-664f215069e3 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:31.554937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3621b6-d4c8-4740-8a66-09b522232e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:31.556064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3621b6-d4c8-4740-8a66-09b522232e4c None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:31.557006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3621b6-d4c8-4740-8a66-09b522232e4c None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:31.557697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3621b6-d4c8-4740-8a66-09b522232e4c None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:31.565489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3621b6-d4c8-4740-8a66-09b522232e4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:31.566073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3621b6-d4c8-4740-8a66-09b522232e4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:31.567739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3621b6-d4c8-4740-8a66-09b522232e4c None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:31.592714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b4925-fbe4-4d95-bbfb-8daeeda62363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:31.593478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b4925-fbe4-4d95-bbfb-8daeeda62363 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:31.593859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b4925-fbe4-4d95-bbfb-8daeeda62363 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:31.594261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b4925-fbe4-4d95-bbfb-8daeeda62363 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:31.595661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b4925-fbe4-4d95-bbfb-8daeeda62363 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:31.596647 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 475/945] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:31.597326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b4925-fbe4-4d95-bbfb-8daeeda62363 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:31.597952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3621b6-d4c8-4740-8a66-09b522232e4c None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:31.600397 n-d-854118-7 devstack@keystone.service[88375]: WARNING keystone.server.flask.common [None req-d01b4925-fbe4-4d95-bbfb-8daeeda62363 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 18:37:31.625241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.sql.core [None req-d01b4925-fbe4-4d95-bbfb-8daeeda62363 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 18:37:31.625241 n-d-854118-7 devstack@keystone.service[88375]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 18:37:31.625241 n-d-854118-7 devstack@keystone.service[88375]: [parameters: {'id': 'd6ce8549fbc94f0abf0a9cc13ce4f4b8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 18:37:31.625241 n-d-854118-7 devstack@keystone.service[88375]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88375) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 18:37:31.648989 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-d01b4925-fbe4-4d95-bbfb-8daeeda62363 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d6ce8549fbc94f0abf0a9cc13ce4f4b8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d6ce8549fbc94f0abf0a9cc13ce4f4b8. Aug 28 18:37:31.648989 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:31.648989 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:37:31.648989 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:37:31.648989 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:37:31.648989 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:37:31.648989 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:37:31.648989 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:37:31.648989 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:37:31.648989 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:37:31.648989 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:37:31.648989 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:37:31.648989 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result.read() Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 18:37:31.649983 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application yield resource Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise self.value Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application session.commit() Aug 28 18:37:31.651110 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.session.flush() Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application compat.raise_( Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 18:37:31.652117 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 18:37:31.653215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result.read() Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:37:31.654172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [parameters: {'id': 'd6ce8549fbc94f0abf0a9cc13ce4f4b8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:31.655181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:31.656191 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:31.657791 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:31.657791 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 28 18:37:31.657791 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 28 18:37:31.657791 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:31.657791 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:31.657791 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 18:37:31.657791 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 18:37:31.657791 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d6ce8549fbc94f0abf0a9cc13ce4f4b8. Aug 28 18:37:31.657791 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:31.657791 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 471/946] 10.222.0.70 () {60 vars in 1140 bytes} [Sun Aug 28 18:37:31 2022] POST /identity/v3/projects => generated 262 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:31.657791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b432fac-cf8b-4c2a-96fb-ab39ff0d664a None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:31.657791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b432fac-cf8b-4c2a-96fb-ab39ff0d664a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:31.658588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b432fac-cf8b-4c2a-96fb-ab39ff0d664a None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:31.666795 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 472/947] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:31.666795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b432fac-cf8b-4c2a-96fb-ab39ff0d664a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:31.709919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:31.726526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3621b6-d4c8-4740-8a66-09b522232e4c None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:31.758807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:31.762125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e94497-a668-43ca-a7c8-6a3e94b98a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:31.762944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94497-a668-43ca-a7c8-6a3e94b98a9d None admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:31.763313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94497-a668-43ca-a7c8-6a3e94b98a9d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:31.763689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94497-a668-43ca-a7c8-6a3e94b98a9d None admin] PATH_INFO: `/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/299bba14d2dd48c997974093cb4f443f/roles/19270012435942b6bc9e21008a315761` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:31.766119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e94497-a668-43ca-a7c8-6a3e94b98a9d None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7555fde9e5404eb3b0dbfa04ee871f, user_id=299bba14d2dd48c997974093cb4f443f, role_id=19270012435942b6bc9e21008a315761)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:31.768767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e94497-a668-43ca-a7c8-6a3e94b98a9d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:31.790783 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 476/948] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:37:31 2022] PUT /identity/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/299bba14d2dd48c997974093cb4f443f/roles/19270012435942b6bc9e21008a315761 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:31.790783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab59325-3b3f-4518-a090-28cc1035a37d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:31.790783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab59325-3b3f-4518-a090-28cc1035a37d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:31.790783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab59325-3b3f-4518-a090-28cc1035a37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:31.806474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b432fac-cf8b-4c2a-96fb-ab39ff0d664a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:31.813123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5ab59325-3b3f-4518-a090-28cc1035a37d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:31.815274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5ab59325-3b3f-4518-a090-28cc1035a37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:31.864459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9226be5-9f9a-4823-87ef-400dea3bd9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:31.865220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9226be5-9f9a-4823-87ef-400dea3bd9a9 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:31.865581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9226be5-9f9a-4823-87ef-400dea3bd9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:31.865930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9226be5-9f9a-4823-87ef-400dea3bd9a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:31.876793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9226be5-9f9a-4823-87ef-400dea3bd9a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:31.879478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9226be5-9f9a-4823-87ef-400dea3bd9a9 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-c9226be5-9f9a-4823-87ef-400dea3bd9a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:31.897187 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:31.898395 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:31.899533 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:31.899533 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:31.899533 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:31.899533 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:31.899533 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:31.899533 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:31.899533 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:31.899533 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:31.900591 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 473/949] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:31.908880 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 477/950] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:31.909295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9226be5-9f9a-4823-87ef-400dea3bd9a9 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:32.022081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9226be5-9f9a-4823-87ef-400dea3bd9a9 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:32.053181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:32.059039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18c37f-4cf4-427e-9b97-2aed75d3a1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:32.059723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18c37f-4cf4-427e-9b97-2aed75d3a1ec None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:32.060115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18c37f-4cf4-427e-9b97-2aed75d3a1ec None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:32.060676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18c37f-4cf4-427e-9b97-2aed75d3a1ec None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:32.061449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18c37f-4cf4-427e-9b97-2aed75d3a1ec None admin] RBAC: Adding query filter params (name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:32.061995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18c37f-4cf4-427e-9b97-2aed75d3a1ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:32.063925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18c37f-4cf4-427e-9b97-2aed75d3a1ec None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:32.087164 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 474/951] 10.222.0.70 () {56 vars in 1112 bytes} [Sun Aug 28 18:37:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:32.184172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab59325-3b3f-4518-a090-28cc1035a37d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:32.276115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:32.308637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab59325-3b3f-4518-a090-28cc1035a37d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:32.347752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8724ee4-bbe7-4442-8814-a6df995627bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:32.348398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8724ee4-bbe7-4442-8814-a6df995627bb None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:32.348683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8724ee4-bbe7-4442-8814-a6df995627bb None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:32.348959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8724ee4-bbe7-4442-8814-a6df995627bb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:32.349545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8724ee4-bbe7-4442-8814-a6df995627bb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:32.350956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8724ee4-bbe7-4442-8814-a6df995627bb None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-a8724ee4-bbe7-4442-8814-a6df995627bb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:32.360099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:32.362190 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:32.363277 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 478/952] 10.222.0.70 () {56 vars in 1126 bytes} [Sun Aug 28 18:37:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:32.367612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18c37f-4cf4-427e-9b97-2aed75d3a1ec None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:32.474882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18c37f-4cf4-427e-9b97-2aed75d3a1ec None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:32.510673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae543064-41c8-4c4e-836f-76b3bfd9f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:32.511326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae543064-41c8-4c4e-836f-76b3bfd9f61a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:32.511605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae543064-41c8-4c4e-836f-76b3bfd9f61a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:32.511880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae543064-41c8-4c4e-836f-76b3bfd9f61a None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:32.512516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae543064-41c8-4c4e-836f-76b3bfd9f61a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:32.512823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae543064-41c8-4c4e-836f-76b3bfd9f61a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:32.514201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae543064-41c8-4c4e-836f-76b3bfd9f61a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:32.520034 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 475/953] 10.222.0.70 () {56 vars in 1122 bytes} [Sun Aug 28 18:37:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:32.527841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8724ee4-bbe7-4442-8814-a6df995627bb None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:32.636561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8724ee4-bbe7-4442-8814-a6df995627bb None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:32.673113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e5fcf-9f20-41f6-9ab5-4c32aef7d572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:32.673730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5fcf-9f20-41f6-9ab5-4c32aef7d572 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:32.674009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5fcf-9f20-41f6-9ab5-4c32aef7d572 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:32.674284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e5fcf-9f20-41f6-9ab5-4c32aef7d572 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:32.674947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e5fcf-9f20-41f6-9ab5-4c32aef7d572 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:32.675252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e5fcf-9f20-41f6-9ab5-4c32aef7d572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:32.676624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e5fcf-9f20-41f6-9ab5-4c32aef7d572 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:32.682220 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 479/954] 10.222.0.70 () {56 vars in 1122 bytes} [Sun Aug 28 18:37:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:32.691819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae543064-41c8-4c4e-836f-76b3bfd9f61a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:32.752070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:32.799633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae543064-41c8-4c4e-836f-76b3bfd9f61a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:32.834574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9852e1-4539-46c4-82fe-e6dfff30dc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:32.835214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9852e1-4539-46c4-82fe-e6dfff30dc1a None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:32.835499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9852e1-4539-46c4-82fe-e6dfff30dc1a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:32.835776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9852e1-4539-46c4-82fe-e6dfff30dc1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:32.836444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9852e1-4539-46c4-82fe-e6dfff30dc1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:32.837824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9852e1-4539-46c4-82fe-e6dfff30dc1a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:32.862635 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 476/955] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:37:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:33.098501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4f2ea-fdea-4984-8bb1-9c493cafd1ce None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:33.098870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4f2ea-fdea-4984-8bb1-9c493cafd1ce None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:33.099056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4f2ea-fdea-4984-8bb1-9c493cafd1ce None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:33.100603 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 480/956] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:33.105757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0a92e-9c5d-480a-8382-afa580400a43 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:33.106048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0a92e-9c5d-480a-8382-afa580400a43 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:33.106327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0a92e-9c5d-480a-8382-afa580400a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:33.124962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-71a0a92e-9c5d-480a-8382-afa580400a43 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:33.127042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-71a0a92e-9c5d-480a-8382-afa580400a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:33.202683 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 477/957] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:33.473896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4f2ea-fdea-4984-8bb1-9c493cafd1ce None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:33.477836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:33.592957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4f2ea-fdea-4984-8bb1-9c493cafd1ce None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:33.627866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52ac1f-7b1a-439c-9051-af1877772fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:33.628509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52ac1f-7b1a-439c-9051-af1877772fe6 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:33.628788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52ac1f-7b1a-439c-9051-af1877772fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:33.629060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52ac1f-7b1a-439c-9051-af1877772fe6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:33.629648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52ac1f-7b1a-439c-9051-af1877772fe6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:33.631046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52ac1f-7b1a-439c-9051-af1877772fe6 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-1d52ac1f-7b1a-439c-9051-af1877772fe6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:33.640014 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:33.641040 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:33.642463 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 481/958] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:33.648019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0a92e-9c5d-480a-8382-afa580400a43 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:33.692387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:33.755982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0a92e-9c5d-480a-8382-afa580400a43 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:33.794044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dab99b-0b00-4253-8886-f43fa65d00a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:33.794668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dab99b-0b00-4253-8886-f43fa65d00a4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:33.794996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dab99b-0b00-4253-8886-f43fa65d00a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:33.795273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dab99b-0b00-4253-8886-f43fa65d00a4 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:33.795909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dab99b-0b00-4253-8886-f43fa65d00a4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:33.796215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dab99b-0b00-4253-8886-f43fa65d00a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:33.797607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dab99b-0b00-4253-8886-f43fa65d00a4 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:33.803720 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 478/959] 10.222.0.70 () {56 vars in 1112 bytes} [Sun Aug 28 18:37:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:33.816028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52ac1f-7b1a-439c-9051-af1877772fe6 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:33.896924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9c8d2-9629-4a51-b7f5-e05bbf18cfde None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:33.897402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9c8d2-9629-4a51-b7f5-e05bbf18cfde None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:33.897783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9c8d2-9629-4a51-b7f5-e05bbf18cfde None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:33.899452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:33.899568 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 479/960] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:33.905041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef1d44-c1ff-4914-b5f5-6baa8674b8c1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:33.905440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef1d44-c1ff-4914-b5f5-6baa8674b8c1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:33.905824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef1d44-c1ff-4914-b5f5-6baa8674b8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:33.924439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-71ef1d44-c1ff-4914-b5f5-6baa8674b8c1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:33.925794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-71ef1d44-c1ff-4914-b5f5-6baa8674b8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:33.939256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52ac1f-7b1a-439c-9051-af1877772fe6 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:33.978680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe65e87-3c09-4058-b0c6-d7816161b76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:33.979665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe65e87-3c09-4058-b0c6-d7816161b76f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:33.980118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe65e87-3c09-4058-b0c6-d7816161b76f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:33.980688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe65e87-3c09-4058-b0c6-d7816161b76f None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:33.981500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe65e87-3c09-4058-b0c6-d7816161b76f None admin] RBAC: Adding query filter params (type=compute) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:33.981949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe65e87-3c09-4058-b0c6-d7816161b76f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:33.983493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe65e87-3c09-4058-b0c6-d7816161b76f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:33.989837 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 482/961] 10.222.0.70 () {56 vars in 1112 bytes} [Sun Aug 28 18:37:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:33.999374 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 480/962] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:34.275976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe65e87-3c09-4058-b0c6-d7816161b76f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:34.285266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09a7f1-6d2f-4f03-bf26-f04667b34ea8 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:34.285549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09a7f1-6d2f-4f03-bf26-f04667b34ea8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:34.285823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09a7f1-6d2f-4f03-bf26-f04667b34ea8 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:34.287487 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 481/963] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:37:34.292596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed621b-a42b-4ed3-aa5b-ff9357a10f4a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:34.292883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed621b-a42b-4ed3-aa5b-ff9357a10f4a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:34.293158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed621b-a42b-4ed3-aa5b-ff9357a10f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:34.312685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-44ed621b-a42b-4ed3-aa5b-ff9357a10f4a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:34.314481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-44ed621b-a42b-4ed3-aa5b-ff9357a10f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:34.340872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:34.385738 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 482/964] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:34.404979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe65e87-3c09-4058-b0c6-d7816161b76f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:34.435688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:34.441533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762cd8f-6197-483b-8050-131b909d6d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:34.442603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762cd8f-6197-483b-8050-131b909d6d79 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:34.443150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762cd8f-6197-483b-8050-131b909d6d79 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:34.443768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762cd8f-6197-483b-8050-131b909d6d79 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:34.455081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762cd8f-6197-483b-8050-131b909d6d79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-2762cd8f-6197-483b-8050-131b909d6d79 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:34.460006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:34.460919 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:34.461764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:34.461764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:34.461764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:34.461764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:34.461764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:34.461764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:34.461764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:34.461764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:34.461764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:34.461764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:34.461764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:37:34.461764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:34.461764 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 483/965] 10.222.0.70 () {56 vars in 1120 bytes} [Sun Aug 28 18:37:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:34.471873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed621b-a42b-4ed3-aa5b-ff9357a10f4a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:34.586761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed621b-a42b-4ed3-aa5b-ff9357a10f4a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:34.618785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f706dde-aa38-4c01-949b-cf098e7d8c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:34.619498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f706dde-aa38-4c01-949b-cf098e7d8c44 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:34.619789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f706dde-aa38-4c01-949b-cf098e7d8c44 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:34.620065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f706dde-aa38-4c01-949b-cf098e7d8c44 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:34.620734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f706dde-aa38-4c01-949b-cf098e7d8c44 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:34.621039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f706dde-aa38-4c01-949b-cf098e7d8c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:34.622403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f706dde-aa38-4c01-949b-cf098e7d8c44 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:34.631812 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 483/966] 10.222.0.70 () {56 vars in 1115 bytes} [Sun Aug 28 18:37:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:34.637466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762cd8f-6197-483b-8050-131b909d6d79 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:34.685208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f706dde-aa38-4c01-949b-cf098e7d8c44 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:34.715871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:34.756021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762cd8f-6197-483b-8050-131b909d6d79 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:34.793170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1d5bd-368f-4e8e-849d-3a6e0957516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:34.793812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1d5bd-368f-4e8e-849d-3a6e0957516b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:34.794098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1d5bd-368f-4e8e-849d-3a6e0957516b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:34.794375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1d5bd-368f-4e8e-849d-3a6e0957516b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:34.795152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f706dde-aa38-4c01-949b-cf098e7d8c44 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:34.805373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1d5bd-368f-4e8e-849d-3a6e0957516b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:34.806926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1d5bd-368f-4e8e-849d-3a6e0957516b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-2fd1d5bd-368f-4e8e-849d-3a6e0957516b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:34.823353 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:34.824340 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:34.825217 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:34.825217 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:34.825217 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:34.829993 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 484/967] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:34.830998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1d5bd-368f-4e8e-849d-3a6e0957516b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:34.833269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32072753-0430-4f92-9e1d-95c7a30b2c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:34.833952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32072753-0430-4f92-9e1d-95c7a30b2c1e None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:34.834302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32072753-0430-4f92-9e1d-95c7a30b2c1e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:34.834647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32072753-0430-4f92-9e1d-95c7a30b2c1e None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:34.835384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32072753-0430-4f92-9e1d-95c7a30b2c1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:34.836892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32072753-0430-4f92-9e1d-95c7a30b2c1e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:34.852519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.sql.core [None req-32072753-0430-4f92-9e1d-95c7a30b2c1e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 18:37:34.852519 n-d-854118-7 devstack@keystone.service[88375]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 18:37:34.852519 n-d-854118-7 devstack@keystone.service[88375]: [parameters: {'user_id': 'ba860399a9e64a7689b6c2173e7c9d3c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 18:37:34.852519 n-d-854118-7 devstack@keystone.service[88375]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88375) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-32072753-0430-4f92-9e1d-95c7a30b2c1e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result.read() Aug 28 18:37:34.862781 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:37:34.864516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application yield resource Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application next(self.gen) Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise self.value Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application session.commit() Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 18:37:34.865716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.session.flush() Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application compat.raise_( Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 18:37:34.866806 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 18:37:34.867880 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application conn.query(q) Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result.read() Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 18:37:34.869020 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ba860399a9e64a7689b6c2173e7c9d3c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:34.870044 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 28 18:37:34.876315 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 28 18:37:34.877416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 28 18:37:34.877416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 28 18:37:34.877416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 18:37:34.877416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 18:37:34.877416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 18:37:34.877416 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:34.877416 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 484/968] 10.222.0.70 () {60 vars in 1131 bytes} [Sun Aug 28 18:37:34 2022] POST /identity/v3/users => generated 160 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:34.882879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32072753-0430-4f92-9e1d-95c7a30b2c1e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:34.892417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:34.955775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1d5bd-368f-4e8e-849d-3a6e0957516b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:34.995158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:34.999130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87b641-3693-48f0-99bc-034d7ddf05fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:34.999806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87b641-3693-48f0-99bc-034d7ddf05fe None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:35.000097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87b641-3693-48f0-99bc-034d7ddf05fe None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:35.000405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87b641-3693-48f0-99bc-034d7ddf05fe None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:35.001103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87b641-3693-48f0-99bc-034d7ddf05fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:35.001399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87b641-3693-48f0-99bc-034d7ddf05fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:35.002797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87b641-3693-48f0-99bc-034d7ddf05fe None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:35.012236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32072753-0430-4f92-9e1d-95c7a30b2c1e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:35.020857 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 485/969] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:35.020857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d1389-c483-44fe-ad24-a64e72900f65 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:35.020857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d1389-c483-44fe-ad24-a64e72900f65 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:35.020857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d1389-c483-44fe-ad24-a64e72900f65 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:35.024218 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 486/970] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:35.024950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d1389-c483-44fe-ad24-a64e72900f65 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:35.051223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c7a41-4828-4baf-9213-f45563335631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:35.052594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c7a41-4828-4baf-9213-f45563335631 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:35.053084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c7a41-4828-4baf-9213-f45563335631 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:35.053768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c7a41-4828-4baf-9213-f45563335631 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:35.063137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c7a41-4828-4baf-9213-f45563335631 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:35.065388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c7a41-4828-4baf-9213-f45563335631 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-f34c7a41-4828-4baf-9213-f45563335631 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:35.079745 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:35.080741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:35.086776 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:35.086776 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:35.086776 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:35.086776 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:35.086776 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:35.086776 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:35.086776 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:35.086776 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:35.086776 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 18:37:35.086776 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:35.086776 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 485/971] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:37:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:35.086776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013f5c9-873b-44db-aef6-519fe1a7c9da None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:35.086776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013f5c9-873b-44db-aef6-519fe1a7c9da None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:35.087510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013f5c9-873b-44db-aef6-519fe1a7c9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:35.104873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1013f5c9-873b-44db-aef6-519fe1a7c9da None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:35.106435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1013f5c9-873b-44db-aef6-519fe1a7c9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:35.156307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d1389-c483-44fe-ad24-a64e72900f65 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:35.160853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:35.182820 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 486/972] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:35.183480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013f5c9-873b-44db-aef6-519fe1a7c9da None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:35.209072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498654e7-a348-4689-8b9a-00d2d4a75372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:35.210325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498654e7-a348-4689-8b9a-00d2d4a75372 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:35.211286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498654e7-a348-4689-8b9a-00d2d4a75372 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:35.212023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498654e7-a348-4689-8b9a-00d2d4a75372 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:35.222592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498654e7-a348-4689-8b9a-00d2d4a75372 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:35.225130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498654e7-a348-4689-8b9a-00d2d4a75372 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-498654e7-a348-4689-8b9a-00d2d4a75372 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:35.240477 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:35.241419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:35.242350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:35.242350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:35.242350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:35.242350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:35.242350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:35.242350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:35.242350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:35.242350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:35.242350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 18:37:35.242350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:35.248872 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 487/973] 10.222.0.70 () {56 vars in 1117 bytes} [Sun Aug 28 18:37:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:35.249410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498654e7-a348-4689-8b9a-00d2d4a75372 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:35.285689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:35.317851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013f5c9-873b-44db-aef6-519fe1a7c9da None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:35.360871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498654e7-a348-4689-8b9a-00d2d4a75372 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:35.365132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa8385-e2c0-450e-9154-e06294f5f4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:35.365981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa8385-e2c0-450e-9154-e06294f5f4b3 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:35.366462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa8385-e2c0-450e-9154-e06294f5f4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:35.366954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa8385-e2c0-450e-9154-e06294f5f4b3 None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:35.368417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa8385-e2c0-450e-9154-e06294f5f4b3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:35.369000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa8385-e2c0-450e-9154-e06294f5f4b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:35.371097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa8385-e2c0-450e-9154-e06294f5f4b3 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:35.401169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe77ec7-0e25-4d6f-8935-7b9fc1fb865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:35.401804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe77ec7-0e25-4d6f-8935-7b9fc1fb865b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:35.402080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe77ec7-0e25-4d6f-8935-7b9fc1fb865b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:35.402349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe77ec7-0e25-4d6f-8935-7b9fc1fb865b None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:35.403254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe77ec7-0e25-4d6f-8935-7b9fc1fb865b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:35.403564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe77ec7-0e25-4d6f-8935-7b9fc1fb865b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:35.405049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe77ec7-0e25-4d6f-8935-7b9fc1fb865b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:35.428935 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 488/974] 10.222.0.70 () {56 vars in 1149 bytes} [Sun Aug 28 18:37:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:35.429166 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 487/975] 10.222.0.70 () {56 vars in 1101 bytes} [Sun Aug 28 18:37:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:35.430355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe77ec7-0e25-4d6f-8935-7b9fc1fb865b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:35.458653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:35.463677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa8385-e2c0-450e-9154-e06294f5f4b3 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:35.578907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe77ec7-0e25-4d6f-8935-7b9fc1fb865b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:35.594023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa8385-e2c0-450e-9154-e06294f5f4b3 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:35.627882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f59bc-e0a0-412f-8ae8-8a9d74762eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:35.628430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f59bc-e0a0-412f-8ae8-8a9d74762eea None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:35.628713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f59bc-e0a0-412f-8ae8-8a9d74762eea None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:35.628986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f59bc-e0a0-412f-8ae8-8a9d74762eea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:35.651357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9ef8d-5ed8-4a85-8443-0759eff4f27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:35.652027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9ef8d-5ed8-4a85-8443-0759eff4f27f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:35.652323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9ef8d-5ed8-4a85-8443-0759eff4f27f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:35.652855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9ef8d-5ed8-4a85-8443-0759eff4f27f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:35.653692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9ef8d-5ed8-4a85-8443-0759eff4f27f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:35.656078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9ef8d-5ed8-4a85-8443-0759eff4f27f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:35.658659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-a5f9ef8d-5ed8-4a85-8443-0759eff4f27f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:35.667910 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:35.668971 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:35.669780 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 488/976] 10.222.0.70 () {56 vars in 1126 bytes} [Sun Aug 28 18:37:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:35.675617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9ef8d-5ed8-4a85-8443-0759eff4f27f None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:35.725158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f59bc-e0a0-412f-8ae8-8a9d74762eea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:35.727063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f59bc-e0a0-412f-8ae8-8a9d74762eea None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:35.752951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:35.791082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9ef8d-5ed8-4a85-8443-0759eff4f27f None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:35.829979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c03ee9-5fbc-451b-82ac-272d2fc228e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:35.830711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c03ee9-5fbc-451b-82ac-272d2fc228e3 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:35.831022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c03ee9-5fbc-451b-82ac-272d2fc228e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:35.831299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c03ee9-5fbc-451b-82ac-272d2fc228e3 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:35.831927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c03ee9-5fbc-451b-82ac-272d2fc228e3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:35.832233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c03ee9-5fbc-451b-82ac-272d2fc228e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:35.833806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c03ee9-5fbc-451b-82ac-272d2fc228e3 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:35.836969 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 489/977] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:35 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:37:35.841791 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 489/978] 10.222.0.70 () {56 vars in 1122 bytes} [Sun Aug 28 18:37:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:35.842515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f59bc-e0a0-412f-8ae8-8a9d74762eea None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:35.845255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c03ee9-5fbc-451b-82ac-272d2fc228e3 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:35.913374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:35.957232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c03ee9-5fbc-451b-82ac-272d2fc228e3 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:35.960340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f59bc-e0a0-412f-8ae8-8a9d74762eea None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:35.985890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:35.992413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249924c-c138-4bc5-a01c-890b25288c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:35.993026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249924c-c138-4bc5-a01c-890b25288c20 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:35.993310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249924c-c138-4bc5-a01c-890b25288c20 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:35.993583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249924c-c138-4bc5-a01c-890b25288c20 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:35.994220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249924c-c138-4bc5-a01c-890b25288c20 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:35.994525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249924c-c138-4bc5-a01c-890b25288c20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:35.995916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249924c-c138-4bc5-a01c-890b25288c20 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:35.999904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304753e2-8951-495f-a6e2-864ca174664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:36.000531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304753e2-8951-495f-a6e2-864ca174664e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.001403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304753e2-8951-495f-a6e2-864ca174664e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.001642 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 490/979] 10.222.0.70 () {56 vars in 1122 bytes} [Sun Aug 28 18:37:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:36.001748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304753e2-8951-495f-a6e2-864ca174664e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.002881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb567402-e16b-4e83-b6ac-6959e6775395 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.003172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb567402-e16b-4e83-b6ac-6959e6775395 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.003448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb567402-e16b-4e83-b6ac-6959e6775395 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.004779 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 491/980] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:36.008065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb567402-e16b-4e83-b6ac-6959e6775395 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:36.015062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304753e2-8951-495f-a6e2-864ca174664e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:36.016512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304753e2-8951-495f-a6e2-864ca174664e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-304753e2-8951-495f-a6e2-864ca174664e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:36.031457 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:36.033220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:36.034696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:36.034696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:36.034696 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:36.034696 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 490/981] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:36.034696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f69cf3-6da0-4a54-8044-4da24af79020 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.034696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f69cf3-6da0-4a54-8044-4da24af79020 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.034696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f69cf3-6da0-4a54-8044-4da24af79020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.055313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-79f69cf3-6da0-4a54-8044-4da24af79020 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:36.056496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-79f69cf3-6da0-4a54-8044-4da24af79020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:36.118329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb567402-e16b-4e83-b6ac-6959e6775395 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:36.124496 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 491/982] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:36.126466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f69cf3-6da0-4a54-8044-4da24af79020 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:36.144786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:36.154393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3540cf-0538-47a6-b02b-54e7ac6cb9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:36.155056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3540cf-0538-47a6-b02b-54e7ac6cb9d4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.155334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3540cf-0538-47a6-b02b-54e7ac6cb9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.155595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3540cf-0538-47a6-b02b-54e7ac6cb9d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.156297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3540cf-0538-47a6-b02b-54e7ac6cb9d4 None admin] RBAC: Adding query filter params (interface=admin, service_id=fd0b8086900a4a81955aa22125c7fb44, region_id=RegionOne) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:36.157383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3540cf-0538-47a6-b02b-54e7ac6cb9d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:36.158696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3540cf-0538-47a6-b02b-54e7ac6cb9d4 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:36.163994 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 492/983] 10.222.0.70 () {56 vars in 1249 bytes} [Sun Aug 28 18:37:36 2022] GET /identity/v3/endpoints?service_id=fd0b8086900a4a81955aa22125c7fb44&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:36.169126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3540cf-0538-47a6-b02b-54e7ac6cb9d4 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:36.235777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f69cf3-6da0-4a54-8044-4da24af79020 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:36.239001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:36.273132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963931aa-e921-424c-945c-679595249e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:36.273749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963931aa-e921-424c-945c-679595249e3a None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.274030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963931aa-e921-424c-945c-679595249e3a None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.274308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963931aa-e921-424c-945c-679595249e3a None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.274976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963931aa-e921-424c-945c-679595249e3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:36.275283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963931aa-e921-424c-945c-679595249e3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:36.276667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963931aa-e921-424c-945c-679595249e3a None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:36.280011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3540cf-0538-47a6-b02b-54e7ac6cb9d4 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:36.288557 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 492/984] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:36.293977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963931aa-e921-424c-945c-679595249e3a None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:36.320774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562a9ea-8e5f-4b12-8586-c1aab151ee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:36.321390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562a9ea-8e5f-4b12-8586-c1aab151ee8f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.321671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562a9ea-8e5f-4b12-8586-c1aab151ee8f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.321948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562a9ea-8e5f-4b12-8586-c1aab151ee8f None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.322779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562a9ea-8e5f-4b12-8586-c1aab151ee8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:36.323960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562a9ea-8e5f-4b12-8586-c1aab151ee8f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:36.338772 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 493/985] 10.222.0.70 () {56 vars in 1087 bytes} [Sun Aug 28 18:37:36 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:37:36.392209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562a9ea-8e5f-4b12-8586-c1aab151ee8f None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:36.423462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963931aa-e921-424c-945c-679595249e3a None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:36.457731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:36.461513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e3b77-c271-4af5-9920-b3b1eacc1361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:36.462171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e3b77-c271-4af5-9920-b3b1eacc1361 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.462458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e3b77-c271-4af5-9920-b3b1eacc1361 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.462852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e3b77-c271-4af5-9920-b3b1eacc1361 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.471224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e3b77-c271-4af5-9920-b3b1eacc1361 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:36.472679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e3b77-c271-4af5-9920-b3b1eacc1361 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-878e3b77-c271-4af5-9920-b3b1eacc1361 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:36.484831 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:36.486724 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:36.487659 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:36.487659 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:36.487659 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:36.487659 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:36.487659 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:36.487659 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:36.487659 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:36.487659 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:36.487659 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 493/986] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:36.492601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e3b77-c271-4af5-9920-b3b1eacc1361 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:36.515110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562a9ea-8e5f-4b12-8586-c1aab151ee8f None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:36.521783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:36.553662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7181c6-d2e4-4688-be9d-3a38e8f8fe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:36.554834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7181c6-d2e4-4688-be9d-3a38e8f8fe61 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.555119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7181c6-d2e4-4688-be9d-3a38e8f8fe61 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.555388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7181c6-d2e4-4688-be9d-3a38e8f8fe61 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.556293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7181c6-d2e4-4688-be9d-3a38e8f8fe61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:36.558613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7181c6-d2e4-4688-be9d-3a38e8f8fe61 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:36.581367 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 494/987] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:37:36 2022] POST /identity/v3/services => generated 242 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:37:36.613311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e3b77-c271-4af5-9920-b3b1eacc1361 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:36.660243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0509050-0bf4-4100-97c3-12938c60d30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:36.660891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0509050-0bf4-4100-97c3-12938c60d30d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.661173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0509050-0bf4-4100-97c3-12938c60d30d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.661445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0509050-0bf4-4100-97c3-12938c60d30d None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.662157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0509050-0bf4-4100-97c3-12938c60d30d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:36.662466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0509050-0bf4-4100-97c3-12938c60d30d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:36.663986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0509050-0bf4-4100-97c3-12938c60d30d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:36.680365 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 494/988] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:36.686296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7181c6-d2e4-4688-be9d-3a38e8f8fe61 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:36.797559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7181c6-d2e4-4688-be9d-3a38e8f8fe61 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:36.821333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:36.844264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3cd9fd-ea50-496e-b080-8e9e65f18cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:36.845698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cd9fd-ea50-496e-b080-8e9e65f18cfd None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:36.845810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cd9fd-ea50-496e-b080-8e9e65f18cfd None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:36.846078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cd9fd-ea50-496e-b080-8e9e65f18cfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:36.846907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3cd9fd-ea50-496e-b080-8e9e65f18cfd None admin] RBAC: Adding query filter params (role.id=19270012435942b6bc9e21008a315761, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=299bba14d2dd48c997974093cb4f443f) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:36.847247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3cd9fd-ea50-496e-b080-8e9e65f18cfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:36.848846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3cd9fd-ea50-496e-b080-8e9e65f18cfd None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:36.855200 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 495/989] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:36 2022] GET /identity/v3/role_assignments?user.id=299bba14d2dd48c997974093cb4f443f&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=19270012435942b6bc9e21008a315761 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:38.251850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd6d1b-ca25-47f1-b33f-07e3b89db60d None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:38.252374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd6d1b-ca25-47f1-b33f-07e3b89db60d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:38.252374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd6d1b-ca25-47f1-b33f-07e3b89db60d None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:38.253869 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 495/990] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:38.259056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7e559-0ba4-4bc5-a0cb-65511d831dc6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:38.259496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7e559-0ba4-4bc5-a0cb-65511d831dc6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:38.259645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7e559-0ba4-4bc5-a0cb-65511d831dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:38.278208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-74b7e559-0ba4-4bc5-a0cb-65511d831dc6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:38.279484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-74b7e559-0ba4-4bc5-a0cb-65511d831dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:38.350141 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 496/991] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:38.549246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a96d9-93ba-43dc-8890-d35ff35ebc3a None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:38.549674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a96d9-93ba-43dc-8890-d35ff35ebc3a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:38.549963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a96d9-93ba-43dc-8890-d35ff35ebc3a None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:38.551501 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 496/992] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:38.556541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8218ef-3f2f-40dd-b71e-5180e7bd254f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:38.556835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8218ef-3f2f-40dd-b71e-5180e7bd254f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:38.557112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8218ef-3f2f-40dd-b71e-5180e7bd254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:38.578707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3c8218ef-3f2f-40dd-b71e-5180e7bd254f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:38.580403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3c8218ef-3f2f-40dd-b71e-5180e7bd254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:38.618929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a96d9-93ba-43dc-8890-d35ff35ebc3a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:38.654983 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 497/993] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:38.707222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:38.728881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a96d9-93ba-43dc-8890-d35ff35ebc3a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:38.764256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99b13d-d6aa-4ff8-baa2-4d2542ec21f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:38.764886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99b13d-d6aa-4ff8-baa2-4d2542ec21f5 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:38.765167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99b13d-d6aa-4ff8-baa2-4d2542ec21f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:38.765442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99b13d-d6aa-4ff8-baa2-4d2542ec21f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:38.766025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99b13d-d6aa-4ff8-baa2-4d2542ec21f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:38.768236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99b13d-d6aa-4ff8-baa2-4d2542ec21f5 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-ce99b13d-d6aa-4ff8-baa2-4d2542ec21f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:38.776978 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:38.777999 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 18:37:38.779348 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:38.783221 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 497/994] 10.222.0.70 () {56 vars in 1126 bytes} [Sun Aug 28 18:37:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:38.784053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8218ef-3f2f-40dd-b71e-5180e7bd254f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:38.801104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e101f-c0c2-4f62-8a7f-78198bf683b2 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:38.801505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e101f-c0c2-4f62-8a7f-78198bf683b2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:38.801788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e101f-c0c2-4f62-8a7f-78198bf683b2 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:38.803812 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 498/995] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:37:38.808815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c70a62-7e6f-4405-b57d-df7db5751df0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:38.809102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c70a62-7e6f-4405-b57d-df7db5751df0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:38.809696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c70a62-7e6f-4405-b57d-df7db5751df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:38.827643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e8c70a62-7e6f-4405-b57d-df7db5751df0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:38.828829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e8c70a62-7e6f-4405-b57d-df7db5751df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:38.831359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:38.898525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8218ef-3f2f-40dd-b71e-5180e7bd254f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:38.902785 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 499/996] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:38.929754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c70a62-7e6f-4405-b57d-df7db5751df0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:38.936093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1947c-44e4-49e1-9c61-1dbbffc4d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:38.936700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1947c-44e4-49e1-9c61-1dbbffc4d4fc None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:38.936978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1947c-44e4-49e1-9c61-1dbbffc4d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:38.937246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1947c-44e4-49e1-9c61-1dbbffc4d4fc None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:38.937863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1947c-44e4-49e1-9c61-1dbbffc4d4fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:38.938862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1947c-44e4-49e1-9c61-1dbbffc4d4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:38.940405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1947c-44e4-49e1-9c61-1dbbffc4d4fc None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:38.945582 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 498/997] 10.222.0.70 () {56 vars in 1122 bytes} [Sun Aug 28 18:37:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:38.950971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1947c-44e4-49e1-9c61-1dbbffc4d4fc None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:39.009729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:39.037824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c70a62-7e6f-4405-b57d-df7db5751df0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:39.066986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1947c-44e4-49e1-9c61-1dbbffc4d4fc None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:39.068553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:39.072453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3995d-453f-4acd-862e-4c36097ccaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:39.073115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3995d-453f-4acd-862e-4c36097ccaae None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:39.073399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3995d-453f-4acd-862e-4c36097ccaae None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:39.073676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3995d-453f-4acd-862e-4c36097ccaae None admin] PATH_INFO: `/v3/services/compute` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:39.074254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3995d-453f-4acd-862e-4c36097ccaae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:39.075676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3995d-453f-4acd-862e-4c36097ccaae None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-8ce3995d-453f-4acd-862e-4c36097ccaae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:39.085466 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:39.086430 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:39.087322 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 500/998] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:39.092343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3995d-453f-4acd-862e-4c36097ccaae None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:39.112380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097997b-ebaa-4d9b-8fcf-0ccbfba9028b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:39.113016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097997b-ebaa-4d9b-8fcf-0ccbfba9028b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:39.113304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097997b-ebaa-4d9b-8fcf-0ccbfba9028b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:39.113578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097997b-ebaa-4d9b-8fcf-0ccbfba9028b None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:39.114214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097997b-ebaa-4d9b-8fcf-0ccbfba9028b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:39.114523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097997b-ebaa-4d9b-8fcf-0ccbfba9028b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:39.117043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097997b-ebaa-4d9b-8fcf-0ccbfba9028b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:39.128594 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 499/999] 10.222.0.70 () {56 vars in 1122 bytes} [Sun Aug 28 18:37:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:39.129959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097997b-ebaa-4d9b-8fcf-0ccbfba9028b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:39.209226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3995d-453f-4acd-862e-4c36097ccaae None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:39.233558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097997b-ebaa-4d9b-8fcf-0ccbfba9028b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:39.244238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9398d6a-fffe-4dea-8d28-23c483135afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:39.244846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398d6a-fffe-4dea-8d28-23c483135afa None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:39.245132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398d6a-fffe-4dea-8d28-23c483135afa None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:39.245410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398d6a-fffe-4dea-8d28-23c483135afa None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:39.246036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9398d6a-fffe-4dea-8d28-23c483135afa None admin] RBAC: Adding query filter params (name=compute) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:39.246342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9398d6a-fffe-4dea-8d28-23c483135afa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:39.247744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9398d6a-fffe-4dea-8d28-23c483135afa None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:39.252522 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 501/1000] 10.222.0.70 () {56 vars in 1112 bytes} [Sun Aug 28 18:37:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:39.253307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9398d6a-fffe-4dea-8d28-23c483135afa None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:39.255839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:39.267341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ecc48-bf9c-4f8e-9a96-34708d2f7b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:39.267955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ecc48-bf9c-4f8e-9a96-34708d2f7b71 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:39.268238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ecc48-bf9c-4f8e-9a96-34708d2f7b71 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:39.268515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ecc48-bf9c-4f8e-9a96-34708d2f7b71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:39.269229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ecc48-bf9c-4f8e-9a96-34708d2f7b71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:39.270588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ecc48-bf9c-4f8e-9a96-34708d2f7b71 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:39.287803 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 500/1001] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:37:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:39.288595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ecc48-bf9c-4f8e-9a96-34708d2f7b71 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:39.334222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:39.370416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9398d6a-fffe-4dea-8d28-23c483135afa None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:39.420865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af246ca-cb0b-47bc-8a55-515acc4ec323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:39.421224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ecc48-bf9c-4f8e-9a96-34708d2f7b71 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:39.421511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af246ca-cb0b-47bc-8a55-515acc4ec323 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:39.421800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af246ca-cb0b-47bc-8a55-515acc4ec323 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:39.422077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af246ca-cb0b-47bc-8a55-515acc4ec323 None admin] PATH_INFO: `/v3/services/image` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:39.423331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af246ca-cb0b-47bc-8a55-515acc4ec323 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:39.425442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af246ca-cb0b-47bc-8a55-515acc4ec323 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-6af246ca-cb0b-47bc-8a55-515acc4ec323 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:39.435408 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:39.436542 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:39.437364 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 502/1002] 10.222.0.70 () {56 vars in 1105 bytes} [Sun Aug 28 18:37:39 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:39.443432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af246ca-cb0b-47bc-8a55-515acc4ec323 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:39.465872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7ef76-1ffb-48a8-9d99-4e32bed78ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:39.466481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7ef76-1ffb-48a8-9d99-4e32bed78ef5 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:39.467086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7ef76-1ffb-48a8-9d99-4e32bed78ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:39.467086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7ef76-1ffb-48a8-9d99-4e32bed78ef5 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:39.467665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7ef76-1ffb-48a8-9d99-4e32bed78ef5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:39.467966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7ef76-1ffb-48a8-9d99-4e32bed78ef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:39.469364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7ef76-1ffb-48a8-9d99-4e32bed78ef5 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:39.475024 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 501/1003] 10.222.0.70 () {56 vars in 1112 bytes} [Sun Aug 28 18:37:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:39.480637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7ef76-1ffb-48a8-9d99-4e32bed78ef5 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:39.517047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:39.565807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af246ca-cb0b-47bc-8a55-515acc4ec323 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:39.577553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:39.588865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7ef76-1ffb-48a8-9d99-4e32bed78ef5 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:39.606269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9c8c4-1945-4c68-8530-9acbdd092d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:39.606936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9c8c4-1945-4c68-8530-9acbdd092d69 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:39.607222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9c8c4-1945-4c68-8530-9acbdd092d69 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:39.607509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9c8c4-1945-4c68-8530-9acbdd092d69 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:39.608125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9c8c4-1945-4c68-8530-9acbdd092d69 None admin] RBAC: Adding query filter params (name=image) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:39.608430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9c8c4-1945-4c68-8530-9acbdd092d69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:39.609801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9c8c4-1945-4c68-8530-9acbdd092d69 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:39.615446 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 503/1004] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:39.621340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9c8c4-1945-4c68-8530-9acbdd092d69 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:39.624777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6722d4a-605c-4a96-80b0-3cd31b378b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:39.625387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6722d4a-605c-4a96-80b0-3cd31b378b14 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:39.626320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6722d4a-605c-4a96-80b0-3cd31b378b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:39.626497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6722d4a-605c-4a96-80b0-3cd31b378b14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:39.627288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6722d4a-605c-4a96-80b0-3cd31b378b14 None admin] RBAC: Adding query filter params (interface=public, service_id=31a2241dacc4479cb0917b6080b51cc6, region_id=RegionOne) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:39.627594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6722d4a-605c-4a96-80b0-3cd31b378b14 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:39.628944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6722d4a-605c-4a96-80b0-3cd31b378b14 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:39.634359 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 502/1005] 10.222.0.70 () {56 vars in 1251 bytes} [Sun Aug 28 18:37:39 2022] GET /identity/v3/endpoints?service_id=31a2241dacc4479cb0917b6080b51cc6&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:39.639624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6722d4a-605c-4a96-80b0-3cd31b378b14 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:39.729936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9c8c4-1945-4c68-8530-9acbdd092d69 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:39.746120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6722d4a-605c-4a96-80b0-3cd31b378b14 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:39.756444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:39.767024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc242e-43ad-4b9a-9f2e-09d2a52260b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:39.767911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc242e-43ad-4b9a-9f2e-09d2a52260b9 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:39.768199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc242e-43ad-4b9a-9f2e-09d2a52260b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:39.768479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc242e-43ad-4b9a-9f2e-09d2a52260b9 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:39.769114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc242e-43ad-4b9a-9f2e-09d2a52260b9 None admin] RBAC: Adding query filter params (type=image) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:39.769420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc242e-43ad-4b9a-9f2e-09d2a52260b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:39.770834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc242e-43ad-4b9a-9f2e-09d2a52260b9 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:39.786795 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 504/1006] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:39.786998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535cdc2-ab53-42ca-913e-563b12069b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:39.786998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535cdc2-ab53-42ca-913e-563b12069b1c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:39.786998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535cdc2-ab53-42ca-913e-563b12069b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:39.786998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535cdc2-ab53-42ca-913e-563b12069b1c None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:39.787302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535cdc2-ab53-42ca-913e-563b12069b1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:39.787302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535cdc2-ab53-42ca-913e-563b12069b1c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:39.793756 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 503/1007] 10.222.0.70 () {56 vars in 1087 bytes} [Sun Aug 28 18:37:39 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:37:41.275957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea2fc3-fa28-4adf-ba1c-82cd65925b6a None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:41.276508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea2fc3-fa28-4adf-ba1c-82cd65925b6a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:41.276508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea2fc3-fa28-4adf-ba1c-82cd65925b6a None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:41.278006 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 505/1008] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:41.283942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10f215-ffe9-4211-a3e6-6a234b7eec92 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:41.284362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10f215-ffe9-4211-a3e6-6a234b7eec92 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:41.284541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10f215-ffe9-4211-a3e6-6a234b7eec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:41.304117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5b10f215-ffe9-4211-a3e6-6a234b7eec92 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:41.305337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5b10f215-ffe9-4211-a3e6-6a234b7eec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:41.320194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:41.386899 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 504/1009] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:41.653993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea2fc3-fa28-4adf-ba1c-82cd65925b6a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:41.723072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728c624-2b2b-4764-8024-8e108d96c730 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:41.723369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728c624-2b2b-4764-8024-8e108d96c730 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:41.723648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728c624-2b2b-4764-8024-8e108d96c730 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:41.724994 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 505/1010] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:37:41.725999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96089d32-647d-43d7-9385-69adc2571fdf None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:41.726293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96089d32-647d-43d7-9385-69adc2571fdf None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:41.726560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96089d32-647d-43d7-9385-69adc2571fdf None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:41.727868 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 506/1011] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:41.730035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd9c74-419a-4305-9125-cec0440c361e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:41.730323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd9c74-419a-4305-9125-cec0440c361e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:41.730596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd9c74-419a-4305-9125-cec0440c361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:41.747857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e2fd9c74-419a-4305-9125-cec0440c361e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:41.749023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e2fd9c74-419a-4305-9125-cec0440c361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:41.762431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea2fc3-fa28-4adf-ba1c-82cd65925b6a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:41.799360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2a666-3c3c-44bb-889f-75abd0b39b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:41.799982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2a666-3c3c-44bb-889f-75abd0b39b26 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:41.800260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2a666-3c3c-44bb-889f-75abd0b39b26 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:41.800530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2a666-3c3c-44bb-889f-75abd0b39b26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:41.801627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2a666-3c3c-44bb-889f-75abd0b39b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:41.803076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2a666-3c3c-44bb-889f-75abd0b39b26 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:41.804623 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 506/1012] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:41.808685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831cffa-881e-459f-938d-68bede2dac15 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:41.808971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831cffa-881e-459f-938d-68bede2dac15 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:41.809575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831cffa-881e-459f-938d-68bede2dac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:41.819659 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 507/1013] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:41.820495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd9c74-419a-4305-9125-cec0440c361e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:41.827511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2831cffa-881e-459f-938d-68bede2dac15 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:41.828698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2831cffa-881e-459f-938d-68bede2dac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:41.889298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:41.905408 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 507/1014] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:41.915282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:41.940094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd9c74-419a-4305-9125-cec0440c361e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:41.975513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a829f2-69dc-41a6-ae10-cbd49f3d458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:41.976347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a829f2-69dc-41a6-ae10-cbd49f3d458d None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:41.976768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a829f2-69dc-41a6-ae10-cbd49f3d458d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:41.977213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a829f2-69dc-41a6-ae10-cbd49f3d458d None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:41.978080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a829f2-69dc-41a6-ae10-cbd49f3d458d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:41.979660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a829f2-69dc-41a6-ae10-cbd49f3d458d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:42.008443 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 508/1015] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:37:41 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:42.089742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831cffa-881e-459f-938d-68bede2dac15 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:42.184163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a829f2-69dc-41a6-ae10-cbd49f3d458d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:42.200426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831cffa-881e-459f-938d-68bede2dac15 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:42.238277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a163a-3941-4fb1-8eca-b0457efc8b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:42.238940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a163a-3941-4fb1-8eca-b0457efc8b1e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:42.239221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a163a-3941-4fb1-8eca-b0457efc8b1e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:42.239493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a163a-3941-4fb1-8eca-b0457efc8b1e None admin] PATH_INFO: `/v3/services/compute` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:42.240069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a163a-3941-4fb1-8eca-b0457efc8b1e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:42.241431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a163a-3941-4fb1-8eca-b0457efc8b1e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-641a163a-3941-4fb1-8eca-b0457efc8b1e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:42.251637 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:42.252657 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:42.253503 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 508/1016] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:42.258552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a163a-3941-4fb1-8eca-b0457efc8b1e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:42.298284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a829f2-69dc-41a6-ae10-cbd49f3d458d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:42.315065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:42.330338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:42.339109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a378384-5e40-4db3-aab4-46ecc8e8699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:42.339741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a378384-5e40-4db3-aab4-46ecc8e8699d None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:42.340002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a378384-5e40-4db3-aab4-46ecc8e8699d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:42.340274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a378384-5e40-4db3-aab4-46ecc8e8699d None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:42.341340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a378384-5e40-4db3-aab4-46ecc8e8699d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:42.343079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a378384-5e40-4db3-aab4-46ecc8e8699d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:42.361879 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 509/1017] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:37:42 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:37:42.376341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a163a-3941-4fb1-8eca-b0457efc8b1e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:42.425308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a09ac-9856-416a-b7fd-4c9ae42e1905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:42.426221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a09ac-9856-416a-b7fd-4c9ae42e1905 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:42.426685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a09ac-9856-416a-b7fd-4c9ae42e1905 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:42.427128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a09ac-9856-416a-b7fd-4c9ae42e1905 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:42.428064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a09ac-9856-416a-b7fd-4c9ae42e1905 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:42.428523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a09ac-9856-416a-b7fd-4c9ae42e1905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:42.430092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a09ac-9856-416a-b7fd-4c9ae42e1905 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:42.436497 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 509/1018] 10.222.0.70 () {56 vars in 1112 bytes} [Sun Aug 28 18:37:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:42.442168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a378384-5e40-4db3-aab4-46ecc8e8699d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:42.552988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a378384-5e40-4db3-aab4-46ecc8e8699d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:42.592318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fe45d-cf52-48e6-9007-69f37df36aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:42.592931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fe45d-cf52-48e6-9007-69f37df36aa8 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:42.593212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fe45d-cf52-48e6-9007-69f37df36aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:42.593488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fe45d-cf52-48e6-9007-69f37df36aa8 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:42.594116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fe45d-cf52-48e6-9007-69f37df36aa8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:42.595053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fe45d-cf52-48e6-9007-69f37df36aa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:42.596415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fe45d-cf52-48e6-9007-69f37df36aa8 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:42.601350 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 510/1019] 10.222.0.70 () {56 vars in 1112 bytes} [Sun Aug 28 18:37:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:42.606784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a09ac-9856-416a-b7fd-4c9ae42e1905 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:42.713084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a09ac-9856-416a-b7fd-4c9ae42e1905 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:42.726651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:42.749809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4a0bd-898f-4e42-b2c1-08ba234a61cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:42.750411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4a0bd-898f-4e42-b2c1-08ba234a61cd None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:42.750890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4a0bd-898f-4e42-b2c1-08ba234a61cd None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:42.751173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4a0bd-898f-4e42-b2c1-08ba234a61cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:42.751844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4a0bd-898f-4e42-b2c1-08ba234a61cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:42.753202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4a0bd-898f-4e42-b2c1-08ba234a61cd None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:42.773790 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 510/1020] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:37:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:37:43.980012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94779ca4-84f3-4322-b498-1f72dd26e54a None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:43.980502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94779ca4-84f3-4322-b498-1f72dd26e54a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:43.980502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94779ca4-84f3-4322-b498-1f72dd26e54a None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:43.981883 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 511/1021] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:43.987368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39fe52-46d2-47c1-a054-6473aed09e0a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:43.987782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39fe52-46d2-47c1-a054-6473aed09e0a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:43.987950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39fe52-46d2-47c1-a054-6473aed09e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:44.006732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2b39fe52-46d2-47c1-a054-6473aed09e0a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:44.007932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2b39fe52-46d2-47c1-a054-6473aed09e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:44.084657 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 511/1022] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:44.287689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13757ed-c97c-4b61-9561-6c8523601d55 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:44.288078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13757ed-c97c-4b61-9561-6c8523601d55 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:44.288263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13757ed-c97c-4b61-9561-6c8523601d55 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:44.289729 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 512/1023] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:44.294634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e39d7c-888d-402f-9d57-8c525370ee65 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:44.294952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e39d7c-888d-402f-9d57-8c525370ee65 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:44.295226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e39d7c-888d-402f-9d57-8c525370ee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:44.314577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a0e39d7c-888d-402f-9d57-8c525370ee65 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:44.315845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a0e39d7c-888d-402f-9d57-8c525370ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:44.357983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13757ed-c97c-4b61-9561-6c8523601d55 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:44.385055 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 512/1024] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:44.417614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:44.465428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13757ed-c97c-4b61-9561-6c8523601d55 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:44.501100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65195400-a632-4d21-b6d2-dda1aea89df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:44.501723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65195400-a632-4d21-b6d2-dda1aea89df4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:44.502003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65195400-a632-4d21-b6d2-dda1aea89df4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:44.502275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65195400-a632-4d21-b6d2-dda1aea89df4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:44.503412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65195400-a632-4d21-b6d2-dda1aea89df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:44.504896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65195400-a632-4d21-b6d2-dda1aea89df4 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:44.506615 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 513/1025] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:44.512288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e39d7c-888d-402f-9d57-8c525370ee65 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:44.538287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:44.626937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e39d7c-888d-402f-9d57-8c525370ee65 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:44.654725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65195400-a632-4d21-b6d2-dda1aea89df4 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:44.662052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c6118-5dcf-4c49-a482-51a47587dac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:44.662810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6118-5dcf-4c49-a482-51a47587dac4 None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:44.663094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6118-5dcf-4c49-a482-51a47587dac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:44.663364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6118-5dcf-4c49-a482-51a47587dac4 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:44.664074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c6118-5dcf-4c49-a482-51a47587dac4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:44.665513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c6118-5dcf-4c49-a482-51a47587dac4 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:44.694783 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 513/1026] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:37:44 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:44.774692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65195400-a632-4d21-b6d2-dda1aea89df4 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:44.786985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109af60-54bb-4903-af35-fd05b530c181 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:44.787315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109af60-54bb-4903-af35-fd05b530c181 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:44.787554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109af60-54bb-4903-af35-fd05b530c181 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:44.788958 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 514/1027] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:37:44.794344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875382d7-8cb2-496f-9d27-18db82cd4514 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:44.794632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875382d7-8cb2-496f-9d27-18db82cd4514 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:44.794934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875382d7-8cb2-496f-9d27-18db82cd4514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:44.801339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:44.814958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-875382d7-8cb2-496f-9d27-18db82cd4514 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:44.815876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c696746-976a-405d-9bc3-218cd77b9c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:44.816170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-875382d7-8cb2-496f-9d27-18db82cd4514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:44.816521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c696746-976a-405d-9bc3-218cd77b9c83 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:44.816798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c696746-976a-405d-9bc3-218cd77b9c83 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:44.817069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c696746-976a-405d-9bc3-218cd77b9c83 None admin] PATH_INFO: `/v3/services/image` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:44.817652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c696746-976a-405d-9bc3-218cd77b9c83 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:44.820220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c696746-976a-405d-9bc3-218cd77b9c83 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-8c696746-976a-405d-9bc3-218cd77b9c83 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:44.832268 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:44.834390 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:44.835262 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 514/1028] 10.222.0.70 () {56 vars in 1105 bytes} [Sun Aug 28 18:37:44 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:44.840966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c696746-976a-405d-9bc3-218cd77b9c83 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:44.901977 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 515/1029] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:44.958002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c696746-976a-405d-9bc3-218cd77b9c83 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:44.993095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba188f-9c78-4f83-bbfd-aae205106afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:44.994525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba188f-9c78-4f83-bbfd-aae205106afb None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:44.995045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba188f-9c78-4f83-bbfd-aae205106afb None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:44.995567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba188f-9c78-4f83-bbfd-aae205106afb None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:44.996406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba188f-9c78-4f83-bbfd-aae205106afb None admin] RBAC: Adding query filter params (name=image) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:44.996908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba188f-9c78-4f83-bbfd-aae205106afb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:44.998464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba188f-9c78-4f83-bbfd-aae205106afb None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:45.004409 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 515/1030] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:45.009775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875382d7-8cb2-496f-9d27-18db82cd4514 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:45.023827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:45.119653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875382d7-8cb2-496f-9d27-18db82cd4514 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:45.154530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec3aac-c973-41a3-ab0c-db2f2cd9ec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:45.155189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec3aac-c973-41a3-ab0c-db2f2cd9ec3d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:45.155473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec3aac-c973-41a3-ab0c-db2f2cd9ec3d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:45.155746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec3aac-c973-41a3-ab0c-db2f2cd9ec3d None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:45.156372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec3aac-c973-41a3-ab0c-db2f2cd9ec3d None admin] RBAC: Adding query filter params (type=image) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:45.157190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec3aac-c973-41a3-ab0c-db2f2cd9ec3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:45.158613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec3aac-c973-41a3-ab0c-db2f2cd9ec3d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:45.168438 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 516/1031] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:45.170068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba188f-9c78-4f83-bbfd-aae205106afb None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:45.170902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec3aac-c973-41a3-ab0c-db2f2cd9ec3d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:45.230716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:45.253095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:45.280241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec3aac-c973-41a3-ab0c-db2f2cd9ec3d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:45.288271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba188f-9c78-4f83-bbfd-aae205106afb None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:45.317838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06db7c-7675-4b84-9eb9-0e5e21b47630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:45.318465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06db7c-7675-4b84-9eb9-0e5e21b47630 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:45.318754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06db7c-7675-4b84-9eb9-0e5e21b47630 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:45.319045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06db7c-7675-4b84-9eb9-0e5e21b47630 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:45.324243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1a2b8-0f34-47be-91b8-7950c4a71d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:45.324853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a2b8-0f34-47be-91b8-7950c4a71d55 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:45.325138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a2b8-0f34-47be-91b8-7950c4a71d55 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:45.325415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1a2b8-0f34-47be-91b8-7950c4a71d55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:45.326110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1a2b8-0f34-47be-91b8-7950c4a71d55 None admin] RBAC: Adding query filter params (interface=public, service_id=f12e414d0caa468c874063959c831e4f, region_id=RegionOne) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:45.326425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1a2b8-0f34-47be-91b8-7950c4a71d55 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:45.327829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1a2b8-0f34-47be-91b8-7950c4a71d55 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:45.330520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06db7c-7675-4b84-9eb9-0e5e21b47630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:45.333218 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 516/1032] 10.222.0.70 () {56 vars in 1251 bytes} [Sun Aug 28 18:37:45 2022] GET /identity/v3/endpoints?service_id=f12e414d0caa468c874063959c831e4f&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-3a06db7c-7675-4b84-9eb9-0e5e21b47630 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:45.335261 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:45.336222 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:45.337074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:45.337074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:45.337074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:45.337074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:45.337074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:45.337074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:45.337074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:45.337074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:45.337074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:45.337074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:45.337074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:37:45.337074 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:45.338811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1a2b8-0f34-47be-91b8-7950c4a71d55 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:45.341121 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 517/1033] 10.222.0.70 () {56 vars in 1120 bytes} [Sun Aug 28 18:37:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:45.341822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06db7c-7675-4b84-9eb9-0e5e21b47630 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:45.447520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1a2b8-0f34-47be-91b8-7950c4a71d55 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:45.450961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06db7c-7675-4b84-9eb9-0e5e21b47630 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:45.462156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:45.485333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373c29a-ee6f-4362-b149-b457594cb26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:45.485916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ef3d5-7a25-4f38-b76c-d967d957d0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:45.486041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373c29a-ee6f-4362-b149-b457594cb26a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:45.486210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373c29a-ee6f-4362-b149-b457594cb26a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:45.486480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373c29a-ee6f-4362-b149-b457594cb26a None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:45.486580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ef3d5-7a25-4f38-b76c-d967d957d0e0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:45.486806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ef3d5-7a25-4f38-b76c-d967d957d0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:45.487074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ef3d5-7a25-4f38-b76c-d967d957d0e0 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:45.487173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373c29a-ee6f-4362-b149-b457594cb26a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:45.487784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ef3d5-7a25-4f38-b76c-d967d957d0e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:45.488090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ef3d5-7a25-4f38-b76c-d967d957d0e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:45.488463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373c29a-ee6f-4362-b149-b457594cb26a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:45.489439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ef3d5-7a25-4f38-b76c-d967d957d0e0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:45.490813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:45.496350 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 517/1034] 10.222.0.70 () {56 vars in 1087 bytes} [Sun Aug 28 18:37:45 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:37:45.499062 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 518/1035] 10.222.0.70 () {56 vars in 1115 bytes} [Sun Aug 28 18:37:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:45.505918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373c29a-ee6f-4362-b149-b457594cb26a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:45.624705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373c29a-ee6f-4362-b149-b457594cb26a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:45.666866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd1d48-e073-474b-a5ee-19e27cda1c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:45.667509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd1d48-e073-474b-a5ee-19e27cda1c60 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:45.667794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd1d48-e073-474b-a5ee-19e27cda1c60 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:45.668071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd1d48-e073-474b-a5ee-19e27cda1c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:45.679661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd1d48-e073-474b-a5ee-19e27cda1c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:45.681109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd1d48-e073-474b-a5ee-19e27cda1c60 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-7fdd1d48-e073-474b-a5ee-19e27cda1c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:45.695815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:45.696782 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:45.697805 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:45.697805 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:45.697805 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:45.697805 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 518/1036] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:45.702817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ef3d5-7a25-4f38-b76c-d967d957d0e0 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:45.811741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ef3d5-7a25-4f38-b76c-d967d957d0e0 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:45.848248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a851a-0c67-4a95-adae-a0c7ec40ca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:45.849254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a851a-0c67-4a95-adae-a0c7ec40ca82 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:45.849769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a851a-0c67-4a95-adae-a0c7ec40ca82 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:45.850291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a851a-0c67-4a95-adae-a0c7ec40ca82 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:45.851256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a851a-0c67-4a95-adae-a0c7ec40ca82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:45.851785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a851a-0c67-4a95-adae-a0c7ec40ca82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:45.853367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a851a-0c67-4a95-adae-a0c7ec40ca82 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:45.866970 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 519/1037] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:45.872311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd1d48-e073-474b-a5ee-19e27cda1c60 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:45.907967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:45.982651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd1d48-e073-474b-a5ee-19e27cda1c60 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:46.016258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e44d9-eca7-48ad-9455-cf531974ff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:46.017039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e44d9-eca7-48ad-9455-cf531974ff5f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:46.017259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e44d9-eca7-48ad-9455-cf531974ff5f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:46.017540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e44d9-eca7-48ad-9455-cf531974ff5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:46.025091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e44d9-eca7-48ad-9455-cf531974ff5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:46.026658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e44d9-eca7-48ad-9455-cf531974ff5f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-523e44d9-eca7-48ad-9455-cf531974ff5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:46.038411 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:46.039402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:46.040365 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:46.040365 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:46.040365 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:46.040365 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:46.040365 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:46.040365 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:46.040365 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:46.040365 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:46.040365 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:37:46.040365 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:46.042812 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 519/1038] 10.222.0.70 () {56 vars in 1093 bytes} [Sun Aug 28 18:37:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:46.045313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a851a-0c67-4a95-adae-a0c7ec40ca82 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:46.105368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:46.151838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a851a-0c67-4a95-adae-a0c7ec40ca82 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:46.188206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825daaf-fe82-4062-934d-fa2a6596e7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:46.188801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825daaf-fe82-4062-934d-fa2a6596e7c7 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:46.189075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825daaf-fe82-4062-934d-fa2a6596e7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:46.189341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825daaf-fe82-4062-934d-fa2a6596e7c7 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:46.190063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825daaf-fe82-4062-934d-fa2a6596e7c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:46.190366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825daaf-fe82-4062-934d-fa2a6596e7c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:46.191883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825daaf-fe82-4062-934d-fa2a6596e7c7 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:46.214060 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 520/1039] 10.222.0.70 () {56 vars in 1133 bytes} [Sun Aug 28 18:37:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:46.215244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e44d9-eca7-48ad-9455-cf531974ff5f None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:46.307546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:46.317517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e44d9-eca7-48ad-9455-cf531974ff5f None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:46.351909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93549d8d-4d08-4aea-83f7-7dbfada7a0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:46.352518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93549d8d-4d08-4aea-83f7-7dbfada7a0f2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:46.352795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93549d8d-4d08-4aea-83f7-7dbfada7a0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:46.353065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93549d8d-4d08-4aea-83f7-7dbfada7a0f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:46.421521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93549d8d-4d08-4aea-83f7-7dbfada7a0f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:46.423780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93549d8d-4d08-4aea-83f7-7dbfada7a0f2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:46.515710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:46.531638 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 520/1040] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:37:46.533487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825daaf-fe82-4062-934d-fa2a6596e7c7 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:46.645338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825daaf-fe82-4062-934d-fa2a6596e7c7 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:46.660703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:46.682126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc668d-a546-47ef-898e-2ed186de6ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:46.683105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc668d-a546-47ef-898e-2ed186de6ea5 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:46.683392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc668d-a546-47ef-898e-2ed186de6ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:46.683669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc668d-a546-47ef-898e-2ed186de6ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:46.693641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839544b-ad03-437b-abf8-79f8a3fe733a None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:46.693948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839544b-ad03-437b-abf8-79f8a3fe733a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:46.694192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839544b-ad03-437b-abf8-79f8a3fe733a None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:46.694622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc668d-a546-47ef-898e-2ed186de6ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:46.695722 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 521/1041] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:37:46.696095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc668d-a546-47ef-898e-2ed186de6ea5 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:46.700281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65e13-fb6f-4ad6-8503-b0a43a318478 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:46.700567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65e13-fb6f-4ad6-8503-b0a43a318478 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:46.700836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65e13-fb6f-4ad6-8503-b0a43a318478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-fecc668d-a546-47ef-898e-2ed186de6ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:46.711570 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:46.712506 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:46.718096 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:46.718096 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:46.718096 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:46.718096 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 521/1042] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:46.720031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc668d-a546-47ef-898e-2ed186de6ea5 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:46.724499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f3d65e13-fb6f-4ad6-8503-b0a43a318478 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:46.725668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f3d65e13-fb6f-4ad6-8503-b0a43a318478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:46.793963 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 522/1043] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:46.823292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc668d-a546-47ef-898e-2ed186de6ea5 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:46.857808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4c000-da5b-426d-8292-1933c6336697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:46.858344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4c000-da5b-426d-8292-1933c6336697 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:46.858624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4c000-da5b-426d-8292-1933c6336697 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:46.858925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4c000-da5b-426d-8292-1933c6336697 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:46.859560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4c000-da5b-426d-8292-1933c6336697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:46.859887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4c000-da5b-426d-8292-1933c6336697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:46.861397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4c000-da5b-426d-8292-1933c6336697 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:46.878329 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 522/1044] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:46.879912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65e13-fb6f-4ad6-8503-b0a43a318478 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:46.979400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65e13-fb6f-4ad6-8503-b0a43a318478 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:46.999960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:47.016068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b595ac-ac5b-421c-8f9b-7277840f9d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:47.017571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b595ac-ac5b-421c-8f9b-7277840f9d46 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:47.018102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b595ac-ac5b-421c-8f9b-7277840f9d46 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:47.018102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b595ac-ac5b-421c-8f9b-7277840f9d46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:47.024970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b595ac-ac5b-421c-8f9b-7277840f9d46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:47.026402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b595ac-ac5b-421c-8f9b-7277840f9d46 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-f9b595ac-ac5b-421c-8f9b-7277840f9d46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:47.039582 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:47.040484 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:47.046352 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:47.046352 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:47.046352 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:47.046352 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:47.046352 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:47.046352 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:47.046352 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:47.046352 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:47.046352 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 523/1045] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:47.049405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4c000-da5b-426d-8292-1933c6336697 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:47.066396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b595ac-ac5b-421c-8f9b-7277840f9d46 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:47.080212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:47.155461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4c000-da5b-426d-8292-1933c6336697 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:47.174994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b595ac-ac5b-421c-8f9b-7277840f9d46 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:47.192304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d077e-5607-491a-8b3e-571d540bf6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:47.192958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d077e-5607-491a-8b3e-571d540bf6cc None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:47.193241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d077e-5607-491a-8b3e-571d540bf6cc None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:47.193518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d077e-5607-491a-8b3e-571d540bf6cc None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:47.194210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d077e-5607-491a-8b3e-571d540bf6cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:47.194522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d077e-5607-491a-8b3e-571d540bf6cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:47.195992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d077e-5607-491a-8b3e-571d540bf6cc None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:47.208154 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 523/1046] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:47.214769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d077e-5607-491a-8b3e-571d540bf6cc None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:47.218271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a380cb-0588-4806-ad79-6be49bab1888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:47.218940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a380cb-0588-4806-ad79-6be49bab1888 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:47.219256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a380cb-0588-4806-ad79-6be49bab1888 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:47.219728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a380cb-0588-4806-ad79-6be49bab1888 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:47.230685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a380cb-0588-4806-ad79-6be49bab1888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-c3a380cb-0588-4806-ad79-6be49bab1888 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:47.236555 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:47.237519 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:47.238853 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:47.238853 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:47.238853 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:47.238853 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:47.238853 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:47.238853 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:47.238853 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:47.238853 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:47.238853 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:47.238853 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:47.238853 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:47.238853 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:47.238853 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 524/1047] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:37:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:47.243492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a380cb-0588-4806-ad79-6be49bab1888 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:47.288840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:47.307797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:47.325152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d077e-5607-491a-8b3e-571d540bf6cc None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:47.355598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a380cb-0588-4806-ad79-6be49bab1888 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:47.360579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35eb749-ab92-4590-9c5d-e64c83676b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:47.361197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35eb749-ab92-4590-9c5d-e64c83676b36 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:47.361481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35eb749-ab92-4590-9c5d-e64c83676b36 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:47.361759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35eb749-ab92-4590-9c5d-e64c83676b36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:47.362488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35eb749-ab92-4590-9c5d-e64c83676b36 None admin] RBAC: Adding query filter params (role.id=19270012435942b6bc9e21008a315761, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=ea8cbbc34aab42a4ada9cbee1772847b) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:47.362831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35eb749-ab92-4590-9c5d-e64c83676b36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:47.364275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35eb749-ab92-4590-9c5d-e64c83676b36 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:47.378777 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 524/1048] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:47 2022] GET /identity/v3/role_assignments?user.id=ea8cbbc34aab42a4ada9cbee1772847b&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=19270012435942b6bc9e21008a315761 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:47.403640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655da3a8-bcd7-450e-882d-5d905e372604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:47.404268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da3a8-bcd7-450e-882d-5d905e372604 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:47.404572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da3a8-bcd7-450e-882d-5d905e372604 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:47.404849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da3a8-bcd7-450e-882d-5d905e372604 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:47.405585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655da3a8-bcd7-450e-882d-5d905e372604 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:47.405837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655da3a8-bcd7-450e-882d-5d905e372604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:47.408020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655da3a8-bcd7-450e-882d-5d905e372604 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:47.418245 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 525/1049] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:37:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:47.425075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35eb749-ab92-4590-9c5d-e64c83676b36 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:47.428162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489f0d5-0afc-4f84-b363-5e48aaeaa044 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:47.428453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489f0d5-0afc-4f84-b363-5e48aaeaa044 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:47.428733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489f0d5-0afc-4f84-b363-5e48aaeaa044 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:47.430094 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 526/1050] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:47.435946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bb88f-1e43-41d6-b5a4-9ac339460155 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:47.436289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bb88f-1e43-41d6-b5a4-9ac339460155 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:47.436562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bb88f-1e43-41d6-b5a4-9ac339460155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:47.455932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e82bb88f-1e43-41d6-b5a4-9ac339460155 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:47.457452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e82bb88f-1e43-41d6-b5a4-9ac339460155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:47.537677 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 527/1051] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:47.538456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35eb749-ab92-4590-9c5d-e64c83676b36 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:47.579914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f46f70-9253-45bd-94fe-5d4bc369302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:47.580207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f46f70-9253-45bd-94fe-5d4bc369302c None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:47.580405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f46f70-9253-45bd-94fe-5d4bc369302c None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:47.580685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f46f70-9253-45bd-94fe-5d4bc369302c None admin] PATH_INFO: `/v3/users/46da516882b7485d98519421c169000f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:47.595291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f46f70-9253-45bd-94fe-5d4bc369302c None admin] RBAC: Authorizing `identity:get_user(user_id=46da516882b7485d98519421c169000f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:47.596783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f46f70-9253-45bd-94fe-5d4bc369302c None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:47.603416 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 525/1052] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:37:47 2022] GET /identity/v3/users/46da516882b7485d98519421c169000f => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:47.604447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bb88f-1e43-41d6-b5a4-9ac339460155 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:47.640097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:47.713133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bb88f-1e43-41d6-b5a4-9ac339460155 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:47.746911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dc4af-e4a7-4113-92dc-d55d96492c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:47.747516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dc4af-e4a7-4113-92dc-d55d96492c0f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:47.747792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dc4af-e4a7-4113-92dc-d55d96492c0f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:47.748072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dc4af-e4a7-4113-92dc-d55d96492c0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:47.814365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f46f70-9253-45bd-94fe-5d4bc369302c None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:47.817263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dc4af-e4a7-4113-92dc-d55d96492c0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:47.818719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dc4af-e4a7-4113-92dc-d55d96492c0f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:47.825550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:47.854617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:47.927355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f46f70-9253-45bd-94fe-5d4bc369302c None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:47.940953 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 528/1053] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:47 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:37:47.942467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dc4af-e4a7-4113-92dc-d55d96492c0f None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:47.966454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbd9ec-8028-4184-8cee-00cf4d0a1ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:47.967033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbd9ec-8028-4184-8cee-00cf4d0a1ba5 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:47.967313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbd9ec-8028-4184-8cee-00cf4d0a1ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:47.967793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbd9ec-8028-4184-8cee-00cf4d0a1ba5 None admin] PATH_INFO: `/v3/services/image` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:47.968157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbd9ec-8028-4184-8cee-00cf4d0a1ba5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:47.969515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbd9ec-8028-4184-8cee-00cf4d0a1ba5 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-4cdbd9ec-8028-4184-8cee-00cf4d0a1ba5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:47.979566 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:47.980588 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:47.981412 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 526/1054] 10.222.0.70 () {56 vars in 1105 bytes} [Sun Aug 28 18:37:47 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:47.991112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbd9ec-8028-4184-8cee-00cf4d0a1ba5 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:48.053031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dc4af-e4a7-4113-92dc-d55d96492c0f None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:48.075748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:48.085268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:48.091300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06910b-5322-45fe-adba-dd78eae1369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:48.091933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06910b-5322-45fe-adba-dd78eae1369f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:48.092208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06910b-5322-45fe-adba-dd78eae1369f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:48.092484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06910b-5322-45fe-adba-dd78eae1369f None admin] PATH_INFO: `/v3/projects/f49bab669cc44e99af7320ecdcbf6349` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:48.093591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06910b-5322-45fe-adba-dd78eae1369f None admin] RBAC: Authorizing `identity:get_project(project_id=f49bab669cc44e99af7320ecdcbf6349)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:48.095205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06910b-5322-45fe-adba-dd78eae1369f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:48.096838 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 529/1055] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:37:47 2022] GET /identity/v3/projects/f49bab669cc44e99af7320ecdcbf6349 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:48.102699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06910b-5322-45fe-adba-dd78eae1369f None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:48.113072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbd9ec-8028-4184-8cee-00cf4d0a1ba5 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:48.149861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e452bd-9311-4e7c-9786-89cd48b5bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:48.150623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e452bd-9311-4e7c-9786-89cd48b5bde2 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:48.150938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e452bd-9311-4e7c-9786-89cd48b5bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:48.151214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e452bd-9311-4e7c-9786-89cd48b5bde2 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:48.151836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e452bd-9311-4e7c-9786-89cd48b5bde2 None admin] RBAC: Adding query filter params (name=image) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:48.152138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e452bd-9311-4e7c-9786-89cd48b5bde2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:48.153547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e452bd-9311-4e7c-9786-89cd48b5bde2 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:48.159621 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 527/1056] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:48.164932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e452bd-9311-4e7c-9786-89cd48b5bde2 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:48.223092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06910b-5322-45fe-adba-dd78eae1369f None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:48.259744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4389f-a3ea-4516-97c0-45ce9a8ab127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:48.260372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4389f-a3ea-4516-97c0-45ce9a8ab127 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:48.260660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4389f-a3ea-4516-97c0-45ce9a8ab127 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:48.260939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4389f-a3ea-4516-97c0-45ce9a8ab127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:48.261654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4389f-a3ea-4516-97c0-45ce9a8ab127 None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=f49bab669cc44e99af7320ecdcbf6349, user.id=46da516882b7485d98519421c169000f) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:48.261964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4389f-a3ea-4516-97c0-45ce9a8ab127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:48.263404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4389f-a3ea-4516-97c0-45ce9a8ab127 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:48.269808 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 530/1057] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:48 2022] GET /identity/v3/role_assignments?user.id=46da516882b7485d98519421c169000f&scope.project.id=f49bab669cc44e99af7320ecdcbf6349&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:48.273539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e452bd-9311-4e7c-9786-89cd48b5bde2 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:48.312424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddb766-5188-446a-a665-3e60b68f1f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:48.313693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddb766-5188-446a-a665-3e60b68f1f5c None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:48.313999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddb766-5188-446a-a665-3e60b68f1f5c None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:48.314260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddb766-5188-446a-a665-3e60b68f1f5c None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:48.314982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddb766-5188-446a-a665-3e60b68f1f5c None admin] RBAC: Adding query filter params (type=image) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:48.315291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddb766-5188-446a-a665-3e60b68f1f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:48.316718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddb766-5188-446a-a665-3e60b68f1f5c None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:48.319820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:48.328344 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 528/1058] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:48.331033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4389f-a3ea-4516-97c0-45ce9a8ab127 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:48.403194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:48.446461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4389f-a3ea-4516-97c0-45ce9a8ab127 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:48.483517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e8e5b-31c7-4b51-b228-69fd0424e329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:48.484050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8e5b-31c7-4b51-b228-69fd0424e329 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:48.484333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8e5b-31c7-4b51-b228-69fd0424e329 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:48.484606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e8e5b-31c7-4b51-b228-69fd0424e329 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:48.486335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e8e5b-31c7-4b51-b228-69fd0424e329 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:48.487695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e8e5b-31c7-4b51-b228-69fd0424e329 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:48.514771 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 531/1059] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:37:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:49.305938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08e276-4ac4-4569-8236-5eec5908bda8 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:49.306482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08e276-4ac4-4569-8236-5eec5908bda8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:49.306482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08e276-4ac4-4569-8236-5eec5908bda8 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:49.308156 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 529/1060] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:49.313788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f7a09-d64e-4a1e-904d-8e4a6339ff3b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:49.314341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f7a09-d64e-4a1e-904d-8e4a6339ff3b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:49.314341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f7a09-d64e-4a1e-904d-8e4a6339ff3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:49.332476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-022f7a09-d64e-4a1e-904d-8e4a6339ff3b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:49.333670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-022f7a09-d64e-4a1e-904d-8e4a6339ff3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:49.409530 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 532/1061] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:49.678906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08e276-4ac4-4569-8236-5eec5908bda8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:49.783088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08e276-4ac4-4569-8236-5eec5908bda8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:49.817107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0965c28-d8e8-4e06-809f-e139bd12676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:49.817741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0965c28-d8e8-4e06-809f-e139bd12676b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:49.818022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0965c28-d8e8-4e06-809f-e139bd12676b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:49.818297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0965c28-d8e8-4e06-809f-e139bd12676b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:49.829631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0965c28-d8e8-4e06-809f-e139bd12676b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-d0965c28-d8e8-4e06-809f-e139bd12676b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:49.834290 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:49.835238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:49.836045 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:49.836045 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:49.836045 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:49.836045 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:49.836045 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:49.836045 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:49.836045 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:49.836045 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:49.836045 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:49.836045 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:49.836045 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:37:49.836045 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:49.839058 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 530/1062] 10.222.0.70 () {56 vars in 1120 bytes} [Sun Aug 28 18:37:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:49.841266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f7a09-d64e-4a1e-904d-8e4a6339ff3b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:49.888438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:49.945848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f7a09-d64e-4a1e-904d-8e4a6339ff3b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:49.980068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648f031-f118-4d24-bdbf-91cc21e4675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:49.980691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648f031-f118-4d24-bdbf-91cc21e4675d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:49.980956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648f031-f118-4d24-bdbf-91cc21e4675d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:49.981227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648f031-f118-4d24-bdbf-91cc21e4675d None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:49.981895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648f031-f118-4d24-bdbf-91cc21e4675d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:49.982199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648f031-f118-4d24-bdbf-91cc21e4675d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:49.983580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648f031-f118-4d24-bdbf-91cc21e4675d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:49.996250 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 533/1063] 10.222.0.70 () {56 vars in 1115 bytes} [Sun Aug 28 18:37:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:49.997594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0965c28-d8e8-4e06-809f-e139bd12676b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:50.068745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:50.112537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0965c28-d8e8-4e06-809f-e139bd12676b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:50.146432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d3496-c9ed-494e-983f-5072f71ce119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:50.147109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d3496-c9ed-494e-983f-5072f71ce119 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:50.147393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d3496-c9ed-494e-983f-5072f71ce119 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:50.147668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d3496-c9ed-494e-983f-5072f71ce119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:50.158948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d3496-c9ed-494e-983f-5072f71ce119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:50.160404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d3496-c9ed-494e-983f-5072f71ce119 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-843d3496-c9ed-494e-983f-5072f71ce119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:50.174552 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:50.175508 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:50.181096 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:50.181096 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:50.181096 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:50.181096 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 531/1064] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:50.181647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648f031-f118-4d24-bdbf-91cc21e4675d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:50.190849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d1286-c823-4afc-a35f-d40731196db8 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:50.191138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d1286-c823-4afc-a35f-d40731196db8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:50.191420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d1286-c823-4afc-a35f-d40731196db8 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:50.192775 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 532/1065] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:50.197824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2ba8e-c636-45a6-a8da-e35401cf03a2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:50.198124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2ba8e-c636-45a6-a8da-e35401cf03a2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:50.198406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2ba8e-c636-45a6-a8da-e35401cf03a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:50.222301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-19c2ba8e-c636-45a6-a8da-e35401cf03a2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:50.223544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-19c2ba8e-c636-45a6-a8da-e35401cf03a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:50.291980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648f031-f118-4d24-bdbf-91cc21e4675d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:50.293955 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 533/1066] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:50.302106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:50.328629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffa280-6665-4d41-978d-d82c7911fc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:50.329358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa280-6665-4d41-978d-d82c7911fc67 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:50.329541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa280-6665-4d41-978d-d82c7911fc67 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:50.329817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffa280-6665-4d41-978d-d82c7911fc67 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:50.330460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffa280-6665-4d41-978d-d82c7911fc67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:50.330855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffa280-6665-4d41-978d-d82c7911fc67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:50.332200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffa280-6665-4d41-978d-d82c7911fc67 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:50.348754 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 534/1067] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:50.350160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2ba8e-c636-45a6-a8da-e35401cf03a2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:50.395147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:50.452530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56f91-c617-4b1c-a55a-05c46aa77935 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:50.452887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56f91-c617-4b1c-a55a-05c46aa77935 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:50.453174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c56f91-c617-4b1c-a55a-05c46aa77935 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:50.455132 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 535/1068] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:37:50.456015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2ba8e-c636-45a6-a8da-e35401cf03a2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:50.460339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc784b-5050-4c79-89f6-3ce3220032ed None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:50.460624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc784b-5050-4c79-89f6-3ce3220032ed None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:50.460896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc784b-5050-4c79-89f6-3ce3220032ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:50.478639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-dccc784b-5050-4c79-89f6-3ce3220032ed None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:50.480010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dccc784b-5050-4c79-89f6-3ce3220032ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:50.495585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cff3d-58a2-4ad6-9f7e-659b64ac2d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:50.496215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cff3d-58a2-4ad6-9f7e-659b64ac2d4f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:50.496492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cff3d-58a2-4ad6-9f7e-659b64ac2d4f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:50.496760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cff3d-58a2-4ad6-9f7e-659b64ac2d4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:50.504758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cff3d-58a2-4ad6-9f7e-659b64ac2d4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:50.506179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669cff3d-58a2-4ad6-9f7e-659b64ac2d4f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-669cff3d-58a2-4ad6-9f7e-659b64ac2d4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:50.518303 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:50.519385 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:50.520649 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:50.520649 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:50.520649 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:50.520649 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:50.520649 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:50.520649 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:50.520649 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:50.520649 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:50.520649 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:37:50.520649 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:50.520649 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 534/1069] 10.222.0.70 () {56 vars in 1093 bytes} [Sun Aug 28 18:37:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:50.524997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cff3d-58a2-4ad6-9f7e-659b64ac2d4f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:50.554791 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 536/1070] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:50.565802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc784b-5050-4c79-89f6-3ce3220032ed None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:50.638940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669cff3d-58a2-4ad6-9f7e-659b64ac2d4f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:50.640606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:50.667243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:50.671189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc784b-5050-4c79-89f6-3ce3220032ed None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:50.676906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a107a-400a-4ed0-87a2-5e800655cc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:50.677516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a107a-400a-4ed0-87a2-5e800655cc7a None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:50.677800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a107a-400a-4ed0-87a2-5e800655cc7a None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:50.678075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a107a-400a-4ed0-87a2-5e800655cc7a None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:50.678834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a107a-400a-4ed0-87a2-5e800655cc7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:50.679202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a107a-400a-4ed0-87a2-5e800655cc7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:50.681121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a107a-400a-4ed0-87a2-5e800655cc7a None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:50.705816 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 535/1071] 10.222.0.70 () {56 vars in 1133 bytes} [Sun Aug 28 18:37:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:50.707248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a107a-400a-4ed0-87a2-5e800655cc7a None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:50.709929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3246f7-4ea0-4945-9c6f-9e84138e69b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:50.711227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3246f7-4ea0-4945-9c6f-9e84138e69b2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:50.711227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3246f7-4ea0-4945-9c6f-9e84138e69b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:50.711227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3246f7-4ea0-4945-9c6f-9e84138e69b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:50.723691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3246f7-4ea0-4945-9c6f-9e84138e69b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-dc3246f7-4ea0-4945-9c6f-9e84138e69b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:50.728498 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:50.729394 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:50.730225 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:50.730225 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:50.730225 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:50.730225 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:50.730225 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:50.730225 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:50.730225 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:50.730225 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:50.730225 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:50.730225 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:50.730225 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:50.730225 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:50.734575 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 537/1072] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:37:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:50.735399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3246f7-4ea0-4945-9c6f-9e84138e69b2 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:50.817444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a107a-400a-4ed0-87a2-5e800655cc7a None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:50.838312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3246f7-4ea0-4945-9c6f-9e84138e69b2 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:50.852517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa6179-54fd-47ef-bd5c-13790c453b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:50.853153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa6179-54fd-47ef-bd5c-13790c453b3d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:50.853438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa6179-54fd-47ef-bd5c-13790c453b3d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:50.853717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa6179-54fd-47ef-bd5c-13790c453b3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:50.864685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa6179-54fd-47ef-bd5c-13790c453b3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:50.866134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa6179-54fd-47ef-bd5c-13790c453b3d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:50.873470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900c01f-0f4a-40e2-8b84-f3d23c4291b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:50.874076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900c01f-0f4a-40e2-8b84-f3d23c4291b4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:50.874362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900c01f-0f4a-40e2-8b84-f3d23c4291b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:50.874646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900c01f-0f4a-40e2-8b84-f3d23c4291b4 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:50.875404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900c01f-0f4a-40e2-8b84-f3d23c4291b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:50.876353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900c01f-0f4a-40e2-8b84-f3d23c4291b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:50.877943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900c01f-0f4a-40e2-8b84-f3d23c4291b4 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-a1fa6179-54fd-47ef-bd5c-13790c453b3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:50.881742 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:50.882833 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:50.883745 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:50.883745 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:50.883745 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:50.883745 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 536/1073] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:50.884001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa6179-54fd-47ef-bd5c-13790c453b3d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:50.887213 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 538/1074] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:37:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:50.888691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900c01f-0f4a-40e2-8b84-f3d23c4291b4 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:50.899522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:50.911830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:50.987940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa6179-54fd-47ef-bd5c-13790c453b3d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:50.988500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900c01f-0f4a-40e2-8b84-f3d23c4291b4 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:51.021454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d339a71-6b57-4989-9670-ba31b8315738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:51.021919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1bc5b-6c02-434d-8d40-50ff1cbe9888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:51.022058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d339a71-6b57-4989-9670-ba31b8315738 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:51.022327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d339a71-6b57-4989-9670-ba31b8315738 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:51.022522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1bc5b-6c02-434d-8d40-50ff1cbe9888 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:51.022637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d339a71-6b57-4989-9670-ba31b8315738 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:51.022835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1bc5b-6c02-434d-8d40-50ff1cbe9888 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:51.023108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1bc5b-6c02-434d-8d40-50ff1cbe9888 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:51.023254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d339a71-6b57-4989-9670-ba31b8315738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:51.023563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d339a71-6b57-4989-9670-ba31b8315738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:51.024913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d339a71-6b57-4989-9670-ba31b8315738 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:51.037097 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 539/1075] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:51.037893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d339a71-6b57-4989-9670-ba31b8315738 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:51.095936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1bc5b-6c02-434d-8d40-50ff1cbe9888 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:51.097389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1bc5b-6c02-434d-8d40-50ff1cbe9888 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:51.111167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:51.119000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:51.138448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d339a71-6b57-4989-9670-ba31b8315738 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:51.172905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e6fe0-cc2d-459b-956c-58ec07b4914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:51.173764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e6fe0-cc2d-459b-956c-58ec07b4914e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:51.174045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e6fe0-cc2d-459b-956c-58ec07b4914e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:51.174579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e6fe0-cc2d-459b-956c-58ec07b4914e None admin] PATH_INFO: `/v3/users/46da516882b7485d98519421c169000f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:51.175484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e6fe0-cc2d-459b-956c-58ec07b4914e None admin] RBAC: Authorizing `identity:get_user(user_id=46da516882b7485d98519421c169000f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:51.176920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e6fe0-cc2d-459b-956c-58ec07b4914e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:51.178512 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 540/1076] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:37:51 2022] GET /identity/v3/users/46da516882b7485d98519421c169000f => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:51.179323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e6fe0-cc2d-459b-956c-58ec07b4914e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:51.199233 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 537/1077] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:37:51.200073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1bc5b-6c02-434d-8d40-50ff1cbe9888 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:51.278583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e6fe0-cc2d-459b-956c-58ec07b4914e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:51.300600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1bc5b-6c02-434d-8d40-50ff1cbe9888 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:51.313141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090f622-2cca-46fb-851d-fcfd01537ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:51.313795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:51.313914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090f622-2cca-46fb-851d-fcfd01537ca7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:51.314076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090f622-2cca-46fb-851d-fcfd01537ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:51.314352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090f622-2cca-46fb-851d-fcfd01537ca7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:51.321685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090f622-2cca-46fb-851d-fcfd01537ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:51.323592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090f622-2cca-46fb-851d-fcfd01537ca7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-d090f622-2cca-46fb-851d-fcfd01537ca7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:51.334899 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:51.336303 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:51.337193 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:51.337193 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:51.337193 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:51.337193 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:51.337193 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:51.337193 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:51.337193 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:51.337193 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:51.337193 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 541/1078] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:51.337193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090f622-2cca-46fb-851d-fcfd01537ca7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:51.338422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcfb52-8196-4987-8a8e-478ca4cd51a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:51.339084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcfb52-8196-4987-8a8e-478ca4cd51a9 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:51.339364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcfb52-8196-4987-8a8e-478ca4cd51a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:51.339636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcfb52-8196-4987-8a8e-478ca4cd51a9 None admin] PATH_INFO: `/v3/projects/f49bab669cc44e99af7320ecdcbf6349` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:51.340777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcfb52-8196-4987-8a8e-478ca4cd51a9 None admin] RBAC: Authorizing `identity:get_project(project_id=f49bab669cc44e99af7320ecdcbf6349)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:51.342203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcfb52-8196-4987-8a8e-478ca4cd51a9 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:51.344744 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 538/1079] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:37:51 2022] GET /identity/v3/projects/f49bab669cc44e99af7320ecdcbf6349 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:51.345243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcfb52-8196-4987-8a8e-478ca4cd51a9 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:51.350385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:51.437176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090f622-2cca-46fb-851d-fcfd01537ca7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:51.446870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcfb52-8196-4987-8a8e-478ca4cd51a9 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:51.470641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2308d7b-a1a0-4bcd-8b88-1e0a1c4fe016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:51.471371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2308d7b-a1a0-4bcd-8b88-1e0a1c4fe016 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:51.471655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2308d7b-a1a0-4bcd-8b88-1e0a1c4fe016 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:51.471930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2308d7b-a1a0-4bcd-8b88-1e0a1c4fe016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:51.481410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f0381-799e-4979-b393-1e3639b9e53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:51.482014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f0381-799e-4979-b393-1e3639b9e53e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:51.482298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f0381-799e-4979-b393-1e3639b9e53e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:51.482414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2308d7b-a1a0-4bcd-8b88-1e0a1c4fe016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:51.482574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f0381-799e-4979-b393-1e3639b9e53e None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:51.483295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f0381-799e-4979-b393-1e3639b9e53e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:51.483604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f0381-799e-4979-b393-1e3639b9e53e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:51.483851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2308d7b-a1a0-4bcd-8b88-1e0a1c4fe016 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:51.486018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f0381-799e-4979-b393-1e3639b9e53e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:51.497707 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 539/1080] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-a2308d7b-a1a0-4bcd-8b88-1e0a1c4fe016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:51.498241 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:51.499184 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:51.500049 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:51.500049 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:51.500049 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:51.500266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f0381-799e-4979-b393-1e3639b9e53e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:51.500353 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 542/1081] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:51.504182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2308d7b-a1a0-4bcd-8b88-1e0a1c4fe016 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:51.542560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:51.567645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:51.606918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f0381-799e-4979-b393-1e3639b9e53e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:51.611293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2308d7b-a1a0-4bcd-8b88-1e0a1c4fe016 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:51.641862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83f6a5-fedc-4fd7-9e34-24fe5f82b9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:51.642581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83f6a5-fedc-4fd7-9e34-24fe5f82b9c9 None admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:51.642919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83f6a5-fedc-4fd7-9e34-24fe5f82b9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:51.643194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83f6a5-fedc-4fd7-9e34-24fe5f82b9c9 None admin] PATH_INFO: `/v3/projects/f49bab669cc44e99af7320ecdcbf6349/users/46da516882b7485d98519421c169000f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:51.645085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83f6a5-fedc-4fd7-9e34-24fe5f82b9c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f49bab669cc44e99af7320ecdcbf6349, user_id=46da516882b7485d98519421c169000f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:51.645334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b29370-dbc3-4627-a8ad-ae69f4360433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:51.645986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b29370-dbc3-4627-a8ad-ae69f4360433 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:51.646271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b29370-dbc3-4627-a8ad-ae69f4360433 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:51.646521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83f6a5-fedc-4fd7-9e34-24fe5f82b9c9 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:51.646613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b29370-dbc3-4627-a8ad-ae69f4360433 None admin] PATH_INFO: `/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/ea8cbbc34aab42a4ada9cbee1772847b/roles/19270012435942b6bc9e21008a315761` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:51.648719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b29370-dbc3-4627-a8ad-ae69f4360433 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7555fde9e5404eb3b0dbfa04ee871f, user_id=ea8cbbc34aab42a4ada9cbee1772847b, role_id=19270012435942b6bc9e21008a315761)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:51.650134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b29370-dbc3-4627-a8ad-ae69f4360433 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:51.661264 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 540/1082] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:37:51 2022] PUT /identity/v3/projects/f49bab669cc44e99af7320ecdcbf6349/users/46da516882b7485d98519421c169000f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:37:51.662059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83f6a5-fedc-4fd7-9e34-24fe5f82b9c9 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:51.674085 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 543/1083] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:37:51 2022] PUT /identity/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/ea8cbbc34aab42a4ada9cbee1772847b/roles/19270012435942b6bc9e21008a315761 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:37:51.781211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:51.786065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83f6a5-fedc-4fd7-9e34-24fe5f82b9c9 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:51.831230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9fa2c-bcd5-4058-a38c-efa26d173fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:51.831768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9fa2c-bcd5-4058-a38c-efa26d173fdb None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:51.832052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9fa2c-bcd5-4058-a38c-efa26d173fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:51.832396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9fa2c-bcd5-4058-a38c-efa26d173fdb None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:51.832976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9fa2c-bcd5-4058-a38c-efa26d173fdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:51.833283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9fa2c-bcd5-4058-a38c-efa26d173fdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:51.834660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9fa2c-bcd5-4058-a38c-efa26d173fdb None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:51.850554 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 541/1084] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:53.599183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d9724-8fe0-4f22-8f32-fab91e686f52 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:53.599672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d9724-8fe0-4f22-8f32-fab91e686f52 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:53.599766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d9724-8fe0-4f22-8f32-fab91e686f52 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:53.601071 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 544/1085] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:53.606433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f1104-c67f-4600-bce2-7312ede9941f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:53.606844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f1104-c67f-4600-bce2-7312ede9941f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:53.607147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f1104-c67f-4600-bce2-7312ede9941f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:53.619879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a79df3-44d9-45bf-917b-da985e78ed73 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:53.620162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a79df3-44d9-45bf-917b-da985e78ed73 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:53.620435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a79df3-44d9-45bf-917b-da985e78ed73 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:53.621739 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 545/1086] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:37:53.625643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6d8f1104-c67f-4600-bce2-7312ede9941f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:53.626849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6d8f1104-c67f-4600-bce2-7312ede9941f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:53.626971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0b17-9290-46fa-be7b-c1c463c24275 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:53.627131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0b17-9290-46fa-be7b-c1c463c24275 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:53.627404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e0b17-9290-46fa-be7b-c1c463c24275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:53.644618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-653e0b17-9290-46fa-be7b-c1c463c24275 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:53.645771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-653e0b17-9290-46fa-be7b-c1c463c24275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:53.694930 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 542/1087] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:53.712916 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 546/1088] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:53.964581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f1104-c67f-4600-bce2-7312ede9941f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:53.981722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e0b17-9290-46fa-be7b-c1c463c24275 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:54.030663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:54.056049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:54.066580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f1104-c67f-4600-bce2-7312ede9941f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:54.084382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e0b17-9290-46fa-be7b-c1c463c24275 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:54.101722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c3636-9ea9-4b89-b048-e3680bcf122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:54.102347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c3636-9ea9-4b89-b048-e3680bcf122e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:54.102625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c3636-9ea9-4b89-b048-e3680bcf122e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:54.102924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c3636-9ea9-4b89-b048-e3680bcf122e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:54.112813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c3636-9ea9-4b89-b048-e3680bcf122e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-bf8c3636-9ea9-4b89-b048-e3680bcf122e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:54.117530 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:54.118524 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:54.119407 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:54.119407 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:54.119407 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:54.119407 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:54.119407 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:54.119407 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:54.119407 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:54.119407 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:54.119407 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:54.119407 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:54.119407 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:37:54.119407 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:54.119407 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 543/1089] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:37:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:54.120102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084ad60-b923-4af9-bfd3-1f269ab46672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:54.120102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084ad60-b923-4af9-bfd3-1f269ab46672 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:54.120102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084ad60-b923-4af9-bfd3-1f269ab46672 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:54.120102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084ad60-b923-4af9-bfd3-1f269ab46672 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:54.124445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c3636-9ea9-4b89-b048-e3680bcf122e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:54.131197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084ad60-b923-4af9-bfd3-1f269ab46672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-5084ad60-b923-4af9-bfd3-1f269ab46672 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:37:54.136006 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:54.137219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:54.138227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:54.138227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:54.138227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:54.138227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:54.138227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:37:54.138227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:37:54.138227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:37:54.138227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:37:54.138227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:37:54.138227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:37:54.138227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 18:37:54.138227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:54.143826 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 547/1090] 10.222.0.70 () {56 vars in 1120 bytes} [Sun Aug 28 18:37:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:54.144633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084ad60-b923-4af9-bfd3-1f269ab46672 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:54.228862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c3636-9ea9-4b89-b048-e3680bcf122e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:54.242356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084ad60-b923-4af9-bfd3-1f269ab46672 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:54.253276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:54.262762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2802ddf-9b00-4fdb-b6f1-7a83fb1d996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:54.263390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2802ddf-9b00-4fdb-b6f1-7a83fb1d996c None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:54.263673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2802ddf-9b00-4fdb-b6f1-7a83fb1d996c None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:54.263947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2802ddf-9b00-4fdb-b6f1-7a83fb1d996c None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:54.264605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2802ddf-9b00-4fdb-b6f1-7a83fb1d996c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:54.264907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2802ddf-9b00-4fdb-b6f1-7a83fb1d996c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:54.266930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2802ddf-9b00-4fdb-b6f1-7a83fb1d996c None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:54.276320 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 544/1091] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:37:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:54.277917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8df23-5e70-4bb0-986e-b7bb0792c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:54.278513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8df23-5e70-4bb0-986e-b7bb0792c34a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:54.278816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8df23-5e70-4bb0-986e-b7bb0792c34a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:54.279093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8df23-5e70-4bb0-986e-b7bb0792c34a None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:54.279730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8df23-5e70-4bb0-986e-b7bb0792c34a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:54.280027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8df23-5e70-4bb0-986e-b7bb0792c34a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:54.281358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8df23-5e70-4bb0-986e-b7bb0792c34a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:54.282666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2802ddf-9b00-4fdb-b6f1-7a83fb1d996c None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:54.289496 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 548/1092] 10.222.0.70 () {56 vars in 1115 bytes} [Sun Aug 28 18:37:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:54.294959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8df23-5e70-4bb0-986e-b7bb0792c34a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:54.297585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:54.386195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2802ddf-9b00-4fdb-b6f1-7a83fb1d996c None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:54.395917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8df23-5e70-4bb0-986e-b7bb0792c34a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:54.419581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e0602-ac2e-4749-8201-13428dbaa7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:54.420209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e0602-ac2e-4749-8201-13428dbaa7c5 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:54.420491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e0602-ac2e-4749-8201-13428dbaa7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:54.420766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e0602-ac2e-4749-8201-13428dbaa7c5 None admin] PATH_INFO: `/v3/users/46da516882b7485d98519421c169000f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:54.421885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e0602-ac2e-4749-8201-13428dbaa7c5 None admin] RBAC: Authorizing `identity:get_user(user_id=46da516882b7485d98519421c169000f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:54.423347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e0602-ac2e-4749-8201-13428dbaa7c5 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:54.424948 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 545/1093] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:37:54 2022] GET /identity/v3/users/46da516882b7485d98519421c169000f => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:54.428554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9a58a-d04b-42d5-adcc-5b1e40c6139e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:54.429178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9a58a-d04b-42d5-adcc-5b1e40c6139e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:54.429456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9a58a-d04b-42d5-adcc-5b1e40c6139e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:54.429725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9a58a-d04b-42d5-adcc-5b1e40c6139e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:54.430763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e0602-ac2e-4749-8201-13428dbaa7c5 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:54.441253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9a58a-d04b-42d5-adcc-5b1e40c6139e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:54.442673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9a58a-d04b-42d5-adcc-5b1e40c6139e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-37f9a58a-d04b-42d5-adcc-5b1e40c6139e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:54.456794 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:54.457941 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:54.459025 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:54.459025 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:54.459025 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:54.459025 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 549/1094] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:54.463535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9a58a-d04b-42d5-adcc-5b1e40c6139e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:54.488052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:54.515089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:54.535833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e0602-ac2e-4749-8201-13428dbaa7c5 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:54.562281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9a58a-d04b-42d5-adcc-5b1e40c6139e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:54.573262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620028f-1672-4b46-832a-0f60a9cf4726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:54.573949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620028f-1672-4b46-832a-0f60a9cf4726 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:54.574297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620028f-1672-4b46-832a-0f60a9cf4726 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:54.574581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620028f-1672-4b46-832a-0f60a9cf4726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:54.600853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0d5d9-222a-42cc-9c73-f5ae49110d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:54.601462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0d5d9-222a-42cc-9c73-f5ae49110d53 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:54.601745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0d5d9-222a-42cc-9c73-f5ae49110d53 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:54.602026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0d5d9-222a-42cc-9c73-f5ae49110d53 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:54.602659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0d5d9-222a-42cc-9c73-f5ae49110d53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:54.602996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0d5d9-222a-42cc-9c73-f5ae49110d53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:54.604356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0d5d9-222a-42cc-9c73-f5ae49110d53 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:54.616254 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 550/1095] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:54.621753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0d5d9-222a-42cc-9c73-f5ae49110d53 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:54.644128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620028f-1672-4b46-832a-0f60a9cf4726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:54.645582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620028f-1672-4b46-832a-0f60a9cf4726 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:54.704103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:54.720816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0d5d9-222a-42cc-9c73-f5ae49110d53 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:54.727576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:54.748125 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 546/1096] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:37:54.753944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f000d-5e21-417e-8e1b-c13cfc4581e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:54.754097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620028f-1672-4b46-832a-0f60a9cf4726 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:54.754573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f000d-5e21-417e-8e1b-c13cfc4581e3 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:54.754882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f000d-5e21-417e-8e1b-c13cfc4581e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:54.755158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f000d-5e21-417e-8e1b-c13cfc4581e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:54.762226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f000d-5e21-417e-8e1b-c13cfc4581e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:54.763680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f000d-5e21-417e-8e1b-c13cfc4581e3 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-871f000d-5e21-417e-8e1b-c13cfc4581e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:37:54.775932 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:54.776888 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:54.777830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:54.777830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:54.777830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:37:54.777830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:37:54.777830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:37:54.777830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:37:54.777830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:37:54.777830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:37:54.777830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 18:37:54.777830 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:37:54.777830 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 551/1097] 10.222.0.70 () {56 vars in 1093 bytes} [Sun Aug 28 18:37:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:37:54.783569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f000d-5e21-417e-8e1b-c13cfc4581e3 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:54.855175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620028f-1672-4b46-832a-0f60a9cf4726 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:54.881190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f000d-5e21-417e-8e1b-c13cfc4581e3 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:54.889562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a6451-d7ce-475b-9eeb-26ce74e3dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:54.890191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a6451-d7ce-475b-9eeb-26ce74e3dc9d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:54.890476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a6451-d7ce-475b-9eeb-26ce74e3dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:54.890806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a6451-d7ce-475b-9eeb-26ce74e3dc9d None admin] PATH_INFO: `/v3/projects/f49bab669cc44e99af7320ecdcbf6349` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:54.892549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a6451-d7ce-475b-9eeb-26ce74e3dc9d None admin] RBAC: Authorizing `identity:get_project(project_id=f49bab669cc44e99af7320ecdcbf6349)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:54.893980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a6451-d7ce-475b-9eeb-26ce74e3dc9d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:54.895637 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 547/1098] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:37:54 2022] GET /identity/v3/projects/f49bab669cc44e99af7320ecdcbf6349 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:54.901610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a6451-d7ce-475b-9eeb-26ce74e3dc9d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:54.915281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d347e-c830-420d-8c8b-b488a04f4641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:54.915885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d347e-c830-420d-8c8b-b488a04f4641 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:54.916165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d347e-c830-420d-8c8b-b488a04f4641 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:54.916440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d347e-c830-420d-8c8b-b488a04f4641 None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:54.917162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d347e-c830-420d-8c8b-b488a04f4641 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:54.917462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d347e-c830-420d-8c8b-b488a04f4641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:54.918887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d347e-c830-420d-8c8b-b488a04f4641 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:54.935991 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 552/1099] 10.222.0.70 () {56 vars in 1133 bytes} [Sun Aug 28 18:37:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:54.942223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d347e-c830-420d-8c8b-b488a04f4641 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:54.944810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:54.950909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:55.003106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a6451-d7ce-475b-9eeb-26ce74e3dc9d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:55.038391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560a59b-30a4-42c1-b83e-c5181a50c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:55.039019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a59b-30a4-42c1-b83e-c5181a50c4fa None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:55.039298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a59b-30a4-42c1-b83e-c5181a50c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:55.039568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a59b-30a4-42c1-b83e-c5181a50c4fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:55.040307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560a59b-30a4-42c1-b83e-c5181a50c4fa None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=f49bab669cc44e99af7320ecdcbf6349, user.id=46da516882b7485d98519421c169000f) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:55.040590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d347e-c830-420d-8c8b-b488a04f4641 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:55.040708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560a59b-30a4-42c1-b83e-c5181a50c4fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:55.042017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560a59b-30a4-42c1-b83e-c5181a50c4fa None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:55.048468 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 548/1100] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:54 2022] GET /identity/v3/role_assignments?user.id=46da516882b7485d98519421c169000f&scope.project.id=f49bab669cc44e99af7320ecdcbf6349&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:55.076530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ee90d-df69-4c06-926b-213f6a8e4486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:55.077157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ee90d-df69-4c06-926b-213f6a8e4486 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:55.077436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ee90d-df69-4c06-926b-213f6a8e4486 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:55.077704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ee90d-df69-4c06-926b-213f6a8e4486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:55.149844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ee90d-df69-4c06-926b-213f6a8e4486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:55.151331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ee90d-df69-4c06-926b-213f6a8e4486 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:55.153329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:55.254934 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 553/1101] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:37:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 18:37:55.260770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560a59b-30a4-42c1-b83e-c5181a50c4fa None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:55.361285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560a59b-30a4-42c1-b83e-c5181a50c4fa None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:55.374010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:55.396416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a67d1-645d-496b-b0e3-2716d993500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:55.397044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a67d1-645d-496b-b0e3-2716d993500b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:55.397332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a67d1-645d-496b-b0e3-2716d993500b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:55.397602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a67d1-645d-496b-b0e3-2716d993500b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:55.407983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a67d1-645d-496b-b0e3-2716d993500b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:55.409429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a67d1-645d-496b-b0e3-2716d993500b None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-730a67d1-645d-496b-b0e3-2716d993500b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:37:55.423877 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:55.429558 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:37:55.430601 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:37:55.430601 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:37:55.430601 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:55.430601 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 549/1102] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:55.430883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ee90d-df69-4c06-926b-213f6a8e4486 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:55.527337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ee90d-df69-4c06-926b-213f6a8e4486 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:55.528793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:55.563344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ec357-bcff-469e-b206-dcf0085163e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:55.563878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ec357-bcff-469e-b206-dcf0085163e7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:55.564148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ec357-bcff-469e-b206-dcf0085163e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:55.564413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ec357-bcff-469e-b206-dcf0085163e7 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:55.565046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ec357-bcff-469e-b206-dcf0085163e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:55.565345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ec357-bcff-469e-b206-dcf0085163e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:55.566697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ec357-bcff-469e-b206-dcf0085163e7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:55.582874 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 554/1103] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:37:55.583848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a67d1-645d-496b-b0e3-2716d993500b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:55.683328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a67d1-645d-496b-b0e3-2716d993500b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:55.715846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b96d6-af46-4599-a237-51bc6616ac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:55.716467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b96d6-af46-4599-a237-51bc6616ac32 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:55.716747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b96d6-af46-4599-a237-51bc6616ac32 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:55.717020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b96d6-af46-4599-a237-51bc6616ac32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:55.724411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b96d6-af46-4599-a237-51bc6616ac32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:55.725851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b96d6-af46-4599-a237-51bc6616ac32 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-a00b96d6-af46-4599-a237-51bc6616ac32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:37:55.738122 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:37:55.739163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:37:55.740388 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:37:55.740388 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:37:55.740388 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:37:55.740388 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:37:55.740388 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:37:55.740388 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:37:55.740388 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:37:55.740388 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:37:55.740388 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 550/1104] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:37:55.745017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ec357-bcff-469e-b206-dcf0085163e7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:55.843035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ec357-bcff-469e-b206-dcf0085163e7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:55.876648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9999ac2-f784-49e6-9103-325be7604bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:55.877232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9999ac2-f784-49e6-9103-325be7604bab None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:55.877508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9999ac2-f784-49e6-9103-325be7604bab None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:55.877778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9999ac2-f784-49e6-9103-325be7604bab None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:55.878461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9999ac2-f784-49e6-9103-325be7604bab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:55.878793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9999ac2-f784-49e6-9103-325be7604bab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:55.880198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9999ac2-f784-49e6-9103-325be7604bab None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:55.892062 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 555/1105] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:37:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:55.898009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b96d6-af46-4599-a237-51bc6616ac32 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:55.925401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:55.999720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b96d6-af46-4599-a237-51bc6616ac32 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:56.034453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec029da-118b-4f34-b4fa-db709523cfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:56.035085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec029da-118b-4f34-b4fa-db709523cfae None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:56.035367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec029da-118b-4f34-b4fa-db709523cfae None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:56.035642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec029da-118b-4f34-b4fa-db709523cfae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:56.036365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec029da-118b-4f34-b4fa-db709523cfae None admin] RBAC: Adding query filter params (role.id=19270012435942b6bc9e21008a315761, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=ea8cbbc34aab42a4ada9cbee1772847b) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:37:56.036674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec029da-118b-4f34-b4fa-db709523cfae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:56.038107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec029da-118b-4f34-b4fa-db709523cfae None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:56.043877 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 551/1106] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:37:55 2022] GET /identity/v3/role_assignments?user.id=ea8cbbc34aab42a4ada9cbee1772847b&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=19270012435942b6bc9e21008a315761 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:57.024901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb378c-43b9-49ab-ac99-ff6c7b877407 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:57.025420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb378c-43b9-49ab-ac99-ff6c7b877407 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:57.025420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb378c-43b9-49ab-ac99-ff6c7b877407 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:57.026809 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 556/1107] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:57.032084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c2e85-ef82-42b7-9e5c-4a4bf43a2302 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:57.032485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c2e85-ef82-42b7-9e5c-4a4bf43a2302 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:57.032634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c2e85-ef82-42b7-9e5c-4a4bf43a2302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:57.051212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-796c2e85-ef82-42b7-9e5c-4a4bf43a2302 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:57.052374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-796c2e85-ef82-42b7-9e5c-4a4bf43a2302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:57.117118 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 552/1108] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:37:57.387687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb378c-43b9-49ab-ac99-ff6c7b877407 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:57.411632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:57.486612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb378c-43b9-49ab-ac99-ff6c7b877407 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:57.519489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fad64-f606-4559-8d49-57c772b79d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:57.520100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fad64-f606-4559-8d49-57c772b79d6e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:57.520379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fad64-f606-4559-8d49-57c772b79d6e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:57.520649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fad64-f606-4559-8d49-57c772b79d6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:57.521735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fad64-f606-4559-8d49-57c772b79d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:57.523181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fad64-f606-4559-8d49-57c772b79d6e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:57.524724 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 557/1109] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:37:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:37:57.530372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c2e85-ef82-42b7-9e5c-4a4bf43a2302 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:37:57.549105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:37:57.628185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c2e85-ef82-42b7-9e5c-4a4bf43a2302 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:37:57.661688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bbdf4-e05a-41b9-9bd7-ddc87d1e6836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:37:57.662220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bbdf4-e05a-41b9-9bd7-ddc87d1e6836 None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:57.662499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bbdf4-e05a-41b9-9bd7-ddc87d1e6836 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:57.662790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bbdf4-e05a-41b9-9bd7-ddc87d1e6836 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:57.663436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bbdf4-e05a-41b9-9bd7-ddc87d1e6836 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:37:57.664846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369bbdf4-e05a-41b9-9bd7-ddc87d1e6836 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:37:57.684917 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 553/1110] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:37:57 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:37:59.599902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deee7b7-1076-49ca-8cc2-9bdcf20fde2d None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:59.600408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deee7b7-1076-49ca-8cc2-9bdcf20fde2d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:59.600509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deee7b7-1076-49ca-8cc2-9bdcf20fde2d None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:59.601777 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 558/1111] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:37:59.606879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c0093-2802-44bf-830f-0f79df0708b0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:37:59.607319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c0093-2802-44bf-830f-0f79df0708b0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:37:59.607415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c0093-2802-44bf-830f-0f79df0708b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:37:59.625851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5a5c0093-2802-44bf-830f-0f79df0708b0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:37:59.627070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5a5c0093-2802-44bf-830f-0f79df0708b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:37:59.691840 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 554/1112] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:37:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:37:59.959928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deee7b7-1076-49ca-8cc2-9bdcf20fde2d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:00.049805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:00.060494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deee7b7-1076-49ca-8cc2-9bdcf20fde2d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:00.093536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac1cdd-21c9-4798-ab43-1a5a951bbd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:00.094796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac1cdd-21c9-4798-ab43-1a5a951bbd0f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:00.095083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac1cdd-21c9-4798-ab43-1a5a951bbd0f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:00.095353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac1cdd-21c9-4798-ab43-1a5a951bbd0f None admin] PATH_INFO: `/v3/roles/9e9271d4f0cd4c5688279b54d26e079f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:00.096748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac1cdd-21c9-4798-ab43-1a5a951bbd0f None admin] RBAC: Authorizing `identity:get_role(role_id=9e9271d4f0cd4c5688279b54d26e079f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:00.098109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac1cdd-21c9-4798-ab43-1a5a951bbd0f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:00.099446 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 559/1113] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:37:59 2022] GET /identity/v3/roles/9e9271d4f0cd4c5688279b54d26e079f => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:00.105229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c0093-2802-44bf-830f-0f79df0708b0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:00.108322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:00.223681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c0093-2802-44bf-830f-0f79df0708b0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:00.256904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f86d5-e15d-444f-9915-1450555b9891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:00.257525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f86d5-e15d-444f-9915-1450555b9891 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:00.257807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f86d5-e15d-444f-9915-1450555b9891 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:00.258081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f86d5-e15d-444f-9915-1450555b9891 None admin] PATH_INFO: `/v3/users/3b3c59a356654a1295b503ea37d5af2a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:00.270784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f86d5-e15d-444f-9915-1450555b9891 None admin] RBAC: Authorizing `identity:get_user(user_id=3b3c59a356654a1295b503ea37d5af2a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:00.272264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f86d5-e15d-444f-9915-1450555b9891 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:00.273884 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 555/1114] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:38:00 2022] GET /identity/v3/users/3b3c59a356654a1295b503ea37d5af2a => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:00.279632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac1cdd-21c9-4798-ab43-1a5a951bbd0f None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:00.377858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac1cdd-21c9-4798-ab43-1a5a951bbd0f None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:00.409937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d681a29-9abc-4366-ac19-2d0c09d0a339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:00.410528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d681a29-9abc-4366-ac19-2d0c09d0a339 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:00.410905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d681a29-9abc-4366-ac19-2d0c09d0a339 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:00.411182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d681a29-9abc-4366-ac19-2d0c09d0a339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:00.437131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:00.476320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d681a29-9abc-4366-ac19-2d0c09d0a339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:00.477681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d681a29-9abc-4366-ac19-2d0c09d0a339 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:00.573262 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 560/1115] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:38:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:38:00.580064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f86d5-e15d-444f-9915-1450555b9891 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:00.640383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:00.679409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f86d5-e15d-444f-9915-1450555b9891 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:00.712815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a089b-b9fc-42aa-b4ad-989848802487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:00.713427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a089b-b9fc-42aa-b4ad-989848802487 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:00.713708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a089b-b9fc-42aa-b4ad-989848802487 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:00.713982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a089b-b9fc-42aa-b4ad-989848802487 None admin] PATH_INFO: `/v3/projects/f49bab669cc44e99af7320ecdcbf6349` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:00.715105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a089b-b9fc-42aa-b4ad-989848802487 None admin] RBAC: Authorizing `identity:get_project(project_id=f49bab669cc44e99af7320ecdcbf6349)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:00.716526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a089b-b9fc-42aa-b4ad-989848802487 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:00.718130 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 556/1116] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:38:00 2022] GET /identity/v3/projects/f49bab669cc44e99af7320ecdcbf6349 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:00.724983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d681a29-9abc-4366-ac19-2d0c09d0a339 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:00.780560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:00.820813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d681a29-9abc-4366-ac19-2d0c09d0a339 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:00.853658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d3e43-6225-464f-a891-46bf2c38ba4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:00.854243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d3e43-6225-464f-a891-46bf2c38ba4e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:00.854520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d3e43-6225-464f-a891-46bf2c38ba4e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:00.854813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d3e43-6225-464f-a891-46bf2c38ba4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:00.855517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d3e43-6225-464f-a891-46bf2c38ba4e None admin] RBAC: Adding query filter params (role.id=9e9271d4f0cd4c5688279b54d26e079f, scope.project.id=f49bab669cc44e99af7320ecdcbf6349, user.id=3b3c59a356654a1295b503ea37d5af2a) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:00.855820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d3e43-6225-464f-a891-46bf2c38ba4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:00.857221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d3e43-6225-464f-a891-46bf2c38ba4e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:00.862547 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 561/1117] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:38:00 2022] GET /identity/v3/role_assignments?user.id=3b3c59a356654a1295b503ea37d5af2a&scope.project.id=f49bab669cc44e99af7320ecdcbf6349&role.id=9e9271d4f0cd4c5688279b54d26e079f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:02.742674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edbd2b-110a-40e6-a0a2-ad3176e03ce7 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:02.743263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edbd2b-110a-40e6-a0a2-ad3176e03ce7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:02.743263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edbd2b-110a-40e6-a0a2-ad3176e03ce7 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:02.744573 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 557/1118] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:02.749577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ccbfc-f2b7-4ea0-a7e6-eeef198c48a5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:02.749976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ccbfc-f2b7-4ea0-a7e6-eeef198c48a5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:02.750202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ccbfc-f2b7-4ea0-a7e6-eeef198c48a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:02.768244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a52ccbfc-f2b7-4ea0-a7e6-eeef198c48a5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:02.769414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a52ccbfc-f2b7-4ea0-a7e6-eeef198c48a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:02.834017 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 562/1119] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:38:03.104995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edbd2b-110a-40e6-a0a2-ad3176e03ce7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:03.207577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edbd2b-110a-40e6-a0a2-ad3176e03ce7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:03.235447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:03.241686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b0d4-0973-49fd-94f2-992fa7321b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:03.242309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b0d4-0973-49fd-94f2-992fa7321b2e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:03.242593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b0d4-0973-49fd-94f2-992fa7321b2e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:03.242907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b0d4-0973-49fd-94f2-992fa7321b2e None admin] PATH_INFO: `/v3/roles/9e9271d4f0cd4c5688279b54d26e079f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:03.244299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95b0d4-0973-49fd-94f2-992fa7321b2e None admin] RBAC: Authorizing `identity:get_role(role_id=9e9271d4f0cd4c5688279b54d26e079f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:03.245667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95b0d4-0973-49fd-94f2-992fa7321b2e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:03.247025 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 558/1120] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:38:03 2022] GET /identity/v3/roles/9e9271d4f0cd4c5688279b54d26e079f => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:03.253409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ccbfc-f2b7-4ea0-a7e6-eeef198c48a5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:03.304168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:03.350957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ccbfc-f2b7-4ea0-a7e6-eeef198c48a5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:03.384283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ddfb4-bc0c-4002-90c6-8ed199646b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:03.384842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ddfb4-bc0c-4002-90c6-8ed199646b49 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:03.385119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ddfb4-bc0c-4002-90c6-8ed199646b49 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:03.385390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ddfb4-bc0c-4002-90c6-8ed199646b49 None admin] PATH_INFO: `/v3/users/3b3c59a356654a1295b503ea37d5af2a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:03.386478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ddfb4-bc0c-4002-90c6-8ed199646b49 None admin] RBAC: Authorizing `identity:get_user(user_id=3b3c59a356654a1295b503ea37d5af2a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:03.387916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ddfb4-bc0c-4002-90c6-8ed199646b49 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:03.389476 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 563/1121] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:38:03 2022] GET /identity/v3/users/3b3c59a356654a1295b503ea37d5af2a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:03.395686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b0d4-0973-49fd-94f2-992fa7321b2e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:03.492536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b0d4-0973-49fd-94f2-992fa7321b2e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:03.526136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18455e-7442-444c-b280-960b9e506c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:03.526776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18455e-7442-444c-b280-960b9e506c22 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:03.527057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18455e-7442-444c-b280-960b9e506c22 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:03.527328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18455e-7442-444c-b280-960b9e506c22 None admin] PATH_INFO: `/v3/projects/f49bab669cc44e99af7320ecdcbf6349` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:03.528423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18455e-7442-444c-b280-960b9e506c22 None admin] RBAC: Authorizing `identity:get_project(project_id=f49bab669cc44e99af7320ecdcbf6349)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:03.529841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18455e-7442-444c-b280-960b9e506c22 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:03.531500 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 559/1122] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:38:03 2022] GET /identity/v3/projects/f49bab669cc44e99af7320ecdcbf6349 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:03.537514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ddfb4-bc0c-4002-90c6-8ed199646b49 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:03.634723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ddfb4-bc0c-4002-90c6-8ed199646b49 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:03.653280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:03.666956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72236c4a-69cd-4330-baf6-5c6d81a5a447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:03.667604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72236c4a-69cd-4330-baf6-5c6d81a5a447 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:03.667886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72236c4a-69cd-4330-baf6-5c6d81a5a447 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:03.668190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72236c4a-69cd-4330-baf6-5c6d81a5a447 None admin] PATH_INFO: `/v3/projects/f49bab669cc44e99af7320ecdcbf6349/users/3b3c59a356654a1295b503ea37d5af2a/roles/9e9271d4f0cd4c5688279b54d26e079f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:03.670288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72236c4a-69cd-4330-baf6-5c6d81a5a447 None admin] RBAC: Authorizing `identity:create_grant(project_id=f49bab669cc44e99af7320ecdcbf6349, user_id=3b3c59a356654a1295b503ea37d5af2a, role_id=9e9271d4f0cd4c5688279b54d26e079f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:03.672231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72236c4a-69cd-4330-baf6-5c6d81a5a447 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:03.684571 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 564/1123] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:38:03 2022] PUT /identity/v3/projects/f49bab669cc44e99af7320ecdcbf6349/users/3b3c59a356654a1295b503ea37d5af2a/roles/9e9271d4f0cd4c5688279b54d26e079f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:38:05.582722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a5e09-b5f0-4cd7-9469-ab5b6b03973a None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:05.583212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a5e09-b5f0-4cd7-9469-ab5b6b03973a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:05.583323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a5e09-b5f0-4cd7-9469-ab5b6b03973a None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:05.584628 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 560/1124] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:05.589823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4df91-cfc9-4e8a-bb72-844be0a507bf None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:05.590243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4df91-cfc9-4e8a-bb72-844be0a507bf None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:05.590378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4df91-cfc9-4e8a-bb72-844be0a507bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:05.608757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c7d4df91-cfc9-4e8a-bb72-844be0a507bf None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:05.610629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c7d4df91-cfc9-4e8a-bb72-844be0a507bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:05.674843 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 565/1125] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:38:05.943396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a5e09-b5f0-4cd7-9469-ab5b6b03973a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:06.011072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:06.048476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a5e09-b5f0-4cd7-9469-ab5b6b03973a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:06.082078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ae0ce-f667-494d-b185-dea16dcf9f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:06.082727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae0ce-f667-494d-b185-dea16dcf9f29 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:06.083041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae0ce-f667-494d-b185-dea16dcf9f29 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:06.083318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae0ce-f667-494d-b185-dea16dcf9f29 None admin] PATH_INFO: `/v3/roles/9e9271d4f0cd4c5688279b54d26e079f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.084706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ae0ce-f667-494d-b185-dea16dcf9f29 None admin] RBAC: Authorizing `identity:get_role(role_id=9e9271d4f0cd4c5688279b54d26e079f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:06.086079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ae0ce-f667-494d-b185-dea16dcf9f29 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:06.087418 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 561/1126] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:38:05 2022] GET /identity/v3/roles/9e9271d4f0cd4c5688279b54d26e079f => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:06.093363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4df91-cfc9-4e8a-bb72-844be0a507bf None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:06.190267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4df91-cfc9-4e8a-bb72-844be0a507bf None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:06.201443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:06.225735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ab163-5dc6-48e7-b120-c9c025a495bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:06.226354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ab163-5dc6-48e7-b120-c9c025a495bd None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:06.226632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ab163-5dc6-48e7-b120-c9c025a495bd None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:06.226936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ab163-5dc6-48e7-b120-c9c025a495bd None admin] PATH_INFO: `/v3/users/3b3c59a356654a1295b503ea37d5af2a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.228035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ab163-5dc6-48e7-b120-c9c025a495bd None admin] RBAC: Authorizing `identity:get_user(user_id=3b3c59a356654a1295b503ea37d5af2a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:06.229447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ab163-5dc6-48e7-b120-c9c025a495bd None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:06.231053 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 566/1127] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:38:06 2022] GET /identity/v3/users/3b3c59a356654a1295b503ea37d5af2a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:06.237466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ae0ce-f667-494d-b185-dea16dcf9f29 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:06.335041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ae0ce-f667-494d-b185-dea16dcf9f29 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:06.369037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172cadc-7646-442a-a8b0-adf676e685ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:06.369630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172cadc-7646-442a-a8b0-adf676e685ea None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:06.369907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172cadc-7646-442a-a8b0-adf676e685ea None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:06.370178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172cadc-7646-442a-a8b0-adf676e685ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.372695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:06.436480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172cadc-7646-442a-a8b0-adf676e685ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:06.438029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172cadc-7646-442a-a8b0-adf676e685ea None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:06.533539 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 562/1128] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:38:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:38:06.539648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ab163-5dc6-48e7-b120-c9c025a495bd None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:06.636725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ab163-5dc6-48e7-b120-c9c025a495bd None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:06.669382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e90879-91a7-4562-832c-e36cfffde1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:06.669998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90879-91a7-4562-832c-e36cfffde1e9 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:06.670275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90879-91a7-4562-832c-e36cfffde1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:06.670540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90879-91a7-4562-832c-e36cfffde1e9 None admin] PATH_INFO: `/v3/projects/f49bab669cc44e99af7320ecdcbf6349` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.671860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e90879-91a7-4562-832c-e36cfffde1e9 None admin] RBAC: Authorizing `identity:get_project(project_id=f49bab669cc44e99af7320ecdcbf6349)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:06.673323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e90879-91a7-4562-832c-e36cfffde1e9 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:06.674943 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 567/1129] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:38:06 2022] GET /identity/v3/projects/f49bab669cc44e99af7320ecdcbf6349 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:06.681074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172cadc-7646-442a-a8b0-adf676e685ea None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:06.714118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:06.780648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172cadc-7646-442a-a8b0-adf676e685ea None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:06.815011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfac4a-f336-47a5-843e-8b213aa07e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:06.815552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfac4a-f336-47a5-843e-8b213aa07e3e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:06.815833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfac4a-f336-47a5-843e-8b213aa07e3e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:06.816108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfac4a-f336-47a5-843e-8b213aa07e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:06.816824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfac4a-f336-47a5-843e-8b213aa07e3e None admin] RBAC: Adding query filter params (role.id=9e9271d4f0cd4c5688279b54d26e079f, scope.project.id=f49bab669cc44e99af7320ecdcbf6349, user.id=3b3c59a356654a1295b503ea37d5af2a) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:06.817136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfac4a-f336-47a5-843e-8b213aa07e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:06.818561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfac4a-f336-47a5-843e-8b213aa07e3e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:06.824207 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 563/1130] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:38:06 2022] GET /identity/v3/role_assignments?user.id=3b3c59a356654a1295b503ea37d5af2a&scope.project.id=f49bab669cc44e99af7320ecdcbf6349&role.id=9e9271d4f0cd4c5688279b54d26e079f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:08.784977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b2297-1ae3-4dad-950c-56bb6a5334ee None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:08.785539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b2297-1ae3-4dad-950c-56bb6a5334ee None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:08.785539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b2297-1ae3-4dad-950c-56bb6a5334ee None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:08.786908 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 568/1131] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:08.792140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ee0a8-932f-4f18-b025-d0ee9bfdc7eb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:08.792557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ee0a8-932f-4f18-b025-d0ee9bfdc7eb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:08.792690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ee0a8-932f-4f18-b025-d0ee9bfdc7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:08.810767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d39ee0a8-932f-4f18-b025-d0ee9bfdc7eb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:08.811988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d39ee0a8-932f-4f18-b025-d0ee9bfdc7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:08.878107 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 564/1132] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:38:09.149081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b2297-1ae3-4dad-950c-56bb6a5334ee None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:09.195869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:09.249487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b2297-1ae3-4dad-950c-56bb6a5334ee None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:09.283485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad97acf-75e7-40b3-895c-310b5da5cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:09.284109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad97acf-75e7-40b3-895c-310b5da5cca0 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:09.284394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad97acf-75e7-40b3-895c-310b5da5cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:09.284669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad97acf-75e7-40b3-895c-310b5da5cca0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:09.285772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad97acf-75e7-40b3-895c-310b5da5cca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:09.287233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad97acf-75e7-40b3-895c-310b5da5cca0 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:09.288780 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 569/1133] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:38:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:09.294529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ee0a8-932f-4f18-b025-d0ee9bfdc7eb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:09.321982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:09.393528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ee0a8-932f-4f18-b025-d0ee9bfdc7eb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:09.426551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e90b4-17ae-4c4d-83c0-34aec7a5d1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:09.427119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e90b4-17ae-4c4d-83c0-34aec7a5d1e0 None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:09.427403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e90b4-17ae-4c4d-83c0-34aec7a5d1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:09.427679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e90b4-17ae-4c4d-83c0-34aec7a5d1e0 None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:09.428332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e90b4-17ae-4c4d-83c0-34aec7a5d1e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:09.429756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e90b4-17ae-4c4d-83c0-34aec7a5d1e0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:09.457732 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 565/1134] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:38:09 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:11.367515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462c56e-d5ed-491d-9e6c-ad5b6b44a49d None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:11.368087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462c56e-d5ed-491d-9e6c-ad5b6b44a49d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:11.368087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462c56e-d5ed-491d-9e6c-ad5b6b44a49d None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:11.369375 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 570/1135] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:11.374674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a41be-b6d4-4477-ac15-88c2dc0dade8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:11.375721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a41be-b6d4-4477-ac15-88c2dc0dade8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:11.375879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a41be-b6d4-4477-ac15-88c2dc0dade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:11.393753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-680a41be-b6d4-4477-ac15-88c2dc0dade8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:11.394970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-680a41be-b6d4-4477-ac15-88c2dc0dade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:11.460751 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 566/1136] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:38:11.736729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462c56e-d5ed-491d-9e6c-ad5b6b44a49d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:11.834971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462c56e-d5ed-491d-9e6c-ad5b6b44a49d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:11.849624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:11.870673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab6368-e36f-4c92-acb0-9dca18652652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:11.871323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6368-e36f-4c92-acb0-9dca18652652 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:11.871613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6368-e36f-4c92-acb0-9dca18652652 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:11.871886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab6368-e36f-4c92-acb0-9dca18652652 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:11.872984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab6368-e36f-4c92-acb0-9dca18652652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:11.874438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab6368-e36f-4c92-acb0-9dca18652652 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:11.876063 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 571/1137] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:38:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:11.881836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a41be-b6d4-4477-ac15-88c2dc0dade8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:11.893759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:11.984705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a41be-b6d4-4477-ac15-88c2dc0dade8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:12.021558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef5d96-b1d9-40b1-a303-f274dc889794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:12.022156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef5d96-b1d9-40b1-a303-f274dc889794 None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:12.022439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef5d96-b1d9-40b1-a303-f274dc889794 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:12.022714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef5d96-b1d9-40b1-a303-f274dc889794 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:12.023389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef5d96-b1d9-40b1-a303-f274dc889794 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:12.024821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef5d96-b1d9-40b1-a303-f274dc889794 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:12.045576 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 567/1138] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:38:11 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:13.988036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ede41-bb8f-48c1-af51-65164d3f6982 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:13.988536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ede41-bb8f-48c1-af51-65164d3f6982 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:13.988536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ede41-bb8f-48c1-af51-65164d3f6982 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:13.989852 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 572/1139] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:13.995097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4a55-4834-482a-82a6-c1010a50f390 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:13.995480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4a55-4834-482a-82a6-c1010a50f390 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:13.995652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4a55-4834-482a-82a6-c1010a50f390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:14.013751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-869f4a55-4834-482a-82a6-c1010a50f390 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:14.014962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-869f4a55-4834-482a-82a6-c1010a50f390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:14.074688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:14.083796 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 568/1140] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:38:14.353519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ede41-bb8f-48c1-af51-65164d3f6982 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:14.451832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ede41-bb8f-48c1-af51-65164d3f6982 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:14.484180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd39fc-92c0-4306-9738-20d59260dd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:14.484868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd39fc-92c0-4306-9738-20d59260dd6b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:14.485151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd39fc-92c0-4306-9738-20d59260dd6b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:14.485423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd39fc-92c0-4306-9738-20d59260dd6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:14.495023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd39fc-92c0-4306-9738-20d59260dd6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-0fcd39fc-92c0-4306-9738-20d59260dd6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:38:14.500263 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:38:14.501511 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:38:14.502773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:38:14.502773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:38:14.502773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:38:14.502773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:38:14.502773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:38:14.502773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:38:14.502773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:38:14.502773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:38:14.502773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:38:14.502773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:38:14.502773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:38:14.502773 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:38:14.502773 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 573/1141] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:38:14.507342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4a55-4834-482a-82a6-c1010a50f390 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:14.606961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4a55-4834-482a-82a6-c1010a50f390 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:14.641017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31eafea-60e6-495a-9174-a352fb6b1621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:14.641811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eafea-60e6-495a-9174-a352fb6b1621 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:14.642095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eafea-60e6-495a-9174-a352fb6b1621 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:14.642377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31eafea-60e6-495a-9174-a352fb6b1621 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:14.643066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31eafea-60e6-495a-9174-a352fb6b1621 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:14.643377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31eafea-60e6-495a-9174-a352fb6b1621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:14.644751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31eafea-60e6-495a-9174-a352fb6b1621 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:14.652595 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 569/1142] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:14.658556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd39fc-92c0-4306-9738-20d59260dd6b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:14.701454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:14.757074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd39fc-92c0-4306-9738-20d59260dd6b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:14.789082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddd976-47f6-48fc-b52b-03bdb42d6523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:14.789703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddd976-47f6-48fc-b52b-03bdb42d6523 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:14.789985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddd976-47f6-48fc-b52b-03bdb42d6523 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:14.790259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddd976-47f6-48fc-b52b-03bdb42d6523 None admin] PATH_INFO: `/v3/users/d9c1e84fb7214609ba3a8c06912d839d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:14.804062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddd976-47f6-48fc-b52b-03bdb42d6523 None admin] RBAC: Authorizing `identity:get_user(user_id=d9c1e84fb7214609ba3a8c06912d839d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:14.805491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddd976-47f6-48fc-b52b-03bdb42d6523 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:14.807368 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 574/1143] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:38:14 2022] GET /identity/v3/users/d9c1e84fb7214609ba3a8c06912d839d => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:14.814212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31eafea-60e6-495a-9174-a352fb6b1621 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:14.872418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:14.914401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31eafea-60e6-495a-9174-a352fb6b1621 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:14.949164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6bdc9-3e03-439c-9023-85aa978dd33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:14.949761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6bdc9-3e03-439c-9023-85aa978dd33f None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:14.950048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6bdc9-3e03-439c-9023-85aa978dd33f None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:14.950325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6bdc9-3e03-439c-9023-85aa978dd33f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:15.019395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6bdc9-3e03-439c-9023-85aa978dd33f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:15.020837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6bdc9-3e03-439c-9023-85aa978dd33f None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:15.076897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:15.118923 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 570/1144] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:38:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 18:38:15.125404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddd976-47f6-48fc-b52b-03bdb42d6523 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:15.217396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:15.220926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddd976-47f6-48fc-b52b-03bdb42d6523 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:15.254760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d5151-29d7-4fbf-b55a-00448ed11725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:15.255419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d5151-29d7-4fbf-b55a-00448ed11725 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:15.255700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d5151-29d7-4fbf-b55a-00448ed11725 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:15.255975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d5151-29d7-4fbf-b55a-00448ed11725 None admin] PATH_INFO: `/v3/projects/d39f302f674f4690a2d76211fe3e211b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:15.257080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d5151-29d7-4fbf-b55a-00448ed11725 None admin] RBAC: Authorizing `identity:get_project(project_id=d39f302f674f4690a2d76211fe3e211b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:15.258496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d5151-29d7-4fbf-b55a-00448ed11725 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:15.260138 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 575/1145] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:38:15 2022] GET /identity/v3/projects/d39f302f674f4690a2d76211fe3e211b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:15.266206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6bdc9-3e03-439c-9023-85aa978dd33f None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:15.365876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6bdc9-3e03-439c-9023-85aa978dd33f None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:15.398048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20935aea-9ce4-4ec5-9470-6914ef2cd981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:15.398578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935aea-9ce4-4ec5-9470-6914ef2cd981 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:15.398885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935aea-9ce4-4ec5-9470-6914ef2cd981 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:15.399158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935aea-9ce4-4ec5-9470-6914ef2cd981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:15.399873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20935aea-9ce4-4ec5-9470-6914ef2cd981 None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=d39f302f674f4690a2d76211fe3e211b, user.id=d9c1e84fb7214609ba3a8c06912d839d) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:15.400178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20935aea-9ce4-4ec5-9470-6914ef2cd981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:15.401592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20935aea-9ce4-4ec5-9470-6914ef2cd981 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:15.407267 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 571/1146] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:38:15 2022] GET /identity/v3/role_assignments?user.id=d9c1e84fb7214609ba3a8c06912d839d&scope.project.id=d39f302f674f4690a2d76211fe3e211b&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:17.269250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0456b3-df60-4f1b-8bf7-d2bd260cf9e0 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:17.269808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0456b3-df60-4f1b-8bf7-d2bd260cf9e0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:17.269808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0456b3-df60-4f1b-8bf7-d2bd260cf9e0 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:17.271237 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 576/1147] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:17.276415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfda599-aab9-43fe-affa-44d8d1c95213 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:17.276813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfda599-aab9-43fe-affa-44d8d1c95213 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:17.276972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfda599-aab9-43fe-affa-44d8d1c95213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:17.294767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fbfda599-aab9-43fe-affa-44d8d1c95213 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:17.295951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fbfda599-aab9-43fe-affa-44d8d1c95213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:17.314774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:17.364391 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 572/1148] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:38:17.633919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0456b3-df60-4f1b-8bf7-d2bd260cf9e0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:17.731795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0456b3-df60-4f1b-8bf7-d2bd260cf9e0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:17.764557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d0f1b-aa27-4d3c-9721-695430fd0d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:17.765172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d0f1b-aa27-4d3c-9721-695430fd0d67 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:17.765984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d0f1b-aa27-4d3c-9721-695430fd0d67 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:17.766328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d0f1b-aa27-4d3c-9721-695430fd0d67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:17.776026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d0f1b-aa27-4d3c-9721-695430fd0d67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-ad2d0f1b-aa27-4d3c-9721-695430fd0d67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:38:17.780751 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:38:17.782366 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:38:17.783402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:38:17.783402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:38:17.783402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:38:17.783402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:38:17.783402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:38:17.783402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:38:17.783402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:38:17.783402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:38:17.783402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:38:17.783402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:38:17.783402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:38:17.783402 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:38:17.783402 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 577/1149] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:38:17.788661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfda599-aab9-43fe-affa-44d8d1c95213 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:17.887372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfda599-aab9-43fe-affa-44d8d1c95213 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:17.919971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f387278-65a8-4403-898a-bf04c65fc955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:17.920563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f387278-65a8-4403-898a-bf04c65fc955 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:17.920836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f387278-65a8-4403-898a-bf04c65fc955 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:17.921105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f387278-65a8-4403-898a-bf04c65fc955 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:17.922359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f387278-65a8-4403-898a-bf04c65fc955 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:17.922657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f387278-65a8-4403-898a-bf04c65fc955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:17.924043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f387278-65a8-4403-898a-bf04c65fc955 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:17.931825 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 573/1150] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:17.938457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d0f1b-aa27-4d3c-9721-695430fd0d67 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:17.966164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:18.036281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d0f1b-aa27-4d3c-9721-695430fd0d67 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:18.070239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ad9db-ac9a-4a8b-b6e4-b052d86bb9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:18.070876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad9db-ac9a-4a8b-b6e4-b052d86bb9d0 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:18.071156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad9db-ac9a-4a8b-b6e4-b052d86bb9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:18.071428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ad9db-ac9a-4a8b-b6e4-b052d86bb9d0 None admin] PATH_INFO: `/v3/users/d9c1e84fb7214609ba3a8c06912d839d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:18.072508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ad9db-ac9a-4a8b-b6e4-b052d86bb9d0 None admin] RBAC: Authorizing `identity:get_user(user_id=d9c1e84fb7214609ba3a8c06912d839d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:18.073919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ad9db-ac9a-4a8b-b6e4-b052d86bb9d0 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:18.075505 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 578/1151] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:38:17 2022] GET /identity/v3/users/d9c1e84fb7214609ba3a8c06912d839d => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:18.081358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f387278-65a8-4403-898a-bf04c65fc955 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:18.097405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:18.181733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f387278-65a8-4403-898a-bf04c65fc955 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:18.213917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b87a4-3870-46a3-a55c-417a46ed2a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:18.214537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b87a4-3870-46a3-a55c-417a46ed2a5d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:18.214851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b87a4-3870-46a3-a55c-417a46ed2a5d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:18.215130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b87a4-3870-46a3-a55c-417a46ed2a5d None admin] PATH_INFO: `/v3/projects/d39f302f674f4690a2d76211fe3e211b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:18.216222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b87a4-3870-46a3-a55c-417a46ed2a5d None admin] RBAC: Authorizing `identity:get_project(project_id=d39f302f674f4690a2d76211fe3e211b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:18.217644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b87a4-3870-46a3-a55c-417a46ed2a5d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:18.219910 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 574/1152] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:38:18 2022] GET /identity/v3/projects/d39f302f674f4690a2d76211fe3e211b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:18.225793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ad9db-ac9a-4a8b-b6e4-b052d86bb9d0 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:18.322677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:18.328828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ad9db-ac9a-4a8b-b6e4-b052d86bb9d0 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:18.361886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87bf103-e399-4940-b469-14d6e28d76b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:18.362520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bf103-e399-4940-b469-14d6e28d76b6 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:18.362896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bf103-e399-4940-b469-14d6e28d76b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:18.363170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87bf103-e399-4940-b469-14d6e28d76b6 None admin] PATH_INFO: `/v3/projects/d39f302f674f4690a2d76211fe3e211b/users/d9c1e84fb7214609ba3a8c06912d839d/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:18.365018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bf103-e399-4940-b469-14d6e28d76b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d39f302f674f4690a2d76211fe3e211b, user_id=d9c1e84fb7214609ba3a8c06912d839d, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:18.366502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87bf103-e399-4940-b469-14d6e28d76b6 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:18.378944 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 579/1153] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:38:18 2022] PUT /identity/v3/projects/d39f302f674f4690a2d76211fe3e211b/users/d9c1e84fb7214609ba3a8c06912d839d/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:20.256511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9c8da-b89a-4717-8082-35b39b41975e None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:20.257036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9c8da-b89a-4717-8082-35b39b41975e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:20.257127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9c8da-b89a-4717-8082-35b39b41975e None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:20.258397 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 575/1154] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:20.263606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eca79-93bd-410f-8cc6-60487c011335 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:20.264048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eca79-93bd-410f-8cc6-60487c011335 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:20.264186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eca79-93bd-410f-8cc6-60487c011335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:20.282942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9e9eca79-93bd-410f-8cc6-60487c011335 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:20.284116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9e9eca79-93bd-410f-8cc6-60487c011335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:20.354622 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 580/1155] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:38:20.629012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9c8da-b89a-4717-8082-35b39b41975e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:20.711022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:20.729647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9c8da-b89a-4717-8082-35b39b41975e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:20.763678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e9e16-8ca3-4bad-9c4b-56cfcbbc44f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:20.764293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e9e16-8ca3-4bad-9c4b-56cfcbbc44f5 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:20.764570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e9e16-8ca3-4bad-9c4b-56cfcbbc44f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:20.764840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e9e16-8ca3-4bad-9c4b-56cfcbbc44f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:20.775019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e9e16-8ca3-4bad-9c4b-56cfcbbc44f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-5f7e9e16-8ca3-4bad-9c4b-56cfcbbc44f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:38:20.779673 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:38:20.780753 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:38:20.782239 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:38:20.782239 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:38:20.782239 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:38:20.782239 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:38:20.782239 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:38:20.782239 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:38:20.782239 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:38:20.782239 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:38:20.782239 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:38:20.782239 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:38:20.782239 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:38:20.782239 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:38:20.782239 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 576/1156] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:38:20.789284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eca79-93bd-410f-8cc6-60487c011335 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:20.873162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:20.888858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eca79-93bd-410f-8cc6-60487c011335 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:20.920900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466fb95-ccf5-4d79-a445-04c3253f2068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:20.922064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466fb95-ccf5-4d79-a445-04c3253f2068 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:20.922343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466fb95-ccf5-4d79-a445-04c3253f2068 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:20.922618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466fb95-ccf5-4d79-a445-04c3253f2068 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:20.923310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466fb95-ccf5-4d79-a445-04c3253f2068 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:20.923614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466fb95-ccf5-4d79-a445-04c3253f2068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:20.924978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466fb95-ccf5-4d79-a445-04c3253f2068 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:20.932981 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 581/1157] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:20.939721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e9e16-8ca3-4bad-9c4b-56cfcbbc44f5 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:21.036800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e9e16-8ca3-4bad-9c4b-56cfcbbc44f5 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:21.070413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fd922-a3c4-4022-8871-e1ccd2c9297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:21.071048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fd922-a3c4-4022-8871-e1ccd2c9297d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:21.071331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fd922-a3c4-4022-8871-e1ccd2c9297d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:21.071609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fd922-a3c4-4022-8871-e1ccd2c9297d None admin] PATH_INFO: `/v3/users/d9c1e84fb7214609ba3a8c06912d839d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:21.072707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fd922-a3c4-4022-8871-e1ccd2c9297d None admin] RBAC: Authorizing `identity:get_user(user_id=d9c1e84fb7214609ba3a8c06912d839d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:21.074131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fd922-a3c4-4022-8871-e1ccd2c9297d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:21.075701 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 577/1158] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:38:20 2022] GET /identity/v3/users/d9c1e84fb7214609ba3a8c06912d839d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:21.081579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466fb95-ccf5-4d79-a445-04c3253f2068 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:21.179426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466fb95-ccf5-4d79-a445-04c3253f2068 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:21.211811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f6a8e-74cf-40a8-83b1-c0e0e9d5bb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:21.212404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f6a8e-74cf-40a8-83b1-c0e0e9d5bb00 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:21.212683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f6a8e-74cf-40a8-83b1-c0e0e9d5bb00 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:21.212955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f6a8e-74cf-40a8-83b1-c0e0e9d5bb00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:21.230305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:21.278281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f6a8e-74cf-40a8-83b1-c0e0e9d5bb00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:21.279752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f6a8e-74cf-40a8-83b1-c0e0e9d5bb00 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:21.374695 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 582/1159] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:38:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:38:21.380636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fd922-a3c4-4022-8871-e1ccd2c9297d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:21.393388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:21.480743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fd922-a3c4-4022-8871-e1ccd2c9297d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:21.513653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c75eb-becf-49f3-b418-90d713acd8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:21.514270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c75eb-becf-49f3-b418-90d713acd8b3 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:21.514553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c75eb-becf-49f3-b418-90d713acd8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:21.514855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c75eb-becf-49f3-b418-90d713acd8b3 None admin] PATH_INFO: `/v3/projects/d39f302f674f4690a2d76211fe3e211b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:21.516539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c75eb-becf-49f3-b418-90d713acd8b3 None admin] RBAC: Authorizing `identity:get_project(project_id=d39f302f674f4690a2d76211fe3e211b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:21.517959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c75eb-becf-49f3-b418-90d713acd8b3 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:21.519586 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 578/1160] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:38:21 2022] GET /identity/v3/projects/d39f302f674f4690a2d76211fe3e211b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:21.525685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f6a8e-74cf-40a8-83b1-c0e0e9d5bb00 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:21.574122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:21.624840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f6a8e-74cf-40a8-83b1-c0e0e9d5bb00 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:21.658224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7dd9c5-ceff-4f91-b1fb-b15749078d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:21.658837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dd9c5-ceff-4f91-b1fb-b15749078d5b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:21.659120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dd9c5-ceff-4f91-b1fb-b15749078d5b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:21.659394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dd9c5-ceff-4f91-b1fb-b15749078d5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:21.660107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dd9c5-ceff-4f91-b1fb-b15749078d5b None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=d39f302f674f4690a2d76211fe3e211b, user.id=d9c1e84fb7214609ba3a8c06912d839d) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:21.660416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dd9c5-ceff-4f91-b1fb-b15749078d5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:21.661838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dd9c5-ceff-4f91-b1fb-b15749078d5b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:21.667389 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 583/1161] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:38:21 2022] GET /identity/v3/role_assignments?user.id=d9c1e84fb7214609ba3a8c06912d839d&scope.project.id=d39f302f674f4690a2d76211fe3e211b&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:38:23.568476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece4656-8a3c-4aaf-83c6-579eb80b0fb4 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:23.568996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece4656-8a3c-4aaf-83c6-579eb80b0fb4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:23.569114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece4656-8a3c-4aaf-83c6-579eb80b0fb4 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:23.570352 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 579/1162] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:23.575592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5c750-c8fd-4b96-99b0-3b04ac0e8e4e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:23.576012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5c750-c8fd-4b96-99b0-3b04ac0e8e4e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:23.576143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5c750-c8fd-4b96-99b0-3b04ac0e8e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:23.594438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4ba5c750-c8fd-4b96-99b0-3b04ac0e8e4e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:23.595631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4ba5c750-c8fd-4b96-99b0-3b04ac0e8e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:23.659483 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 584/1163] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:38:23.929704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece4656-8a3c-4aaf-83c6-579eb80b0fb4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:24.009838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:24.032415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece4656-8a3c-4aaf-83c6-579eb80b0fb4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:24.066134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299d7d-8e0b-409f-b4be-5facfa3ba834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:24.066733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299d7d-8e0b-409f-b4be-5facfa3ba834 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:24.067040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299d7d-8e0b-409f-b4be-5facfa3ba834 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:24.067311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97299d7d-8e0b-409f-b4be-5facfa3ba834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:24.132925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97299d7d-8e0b-409f-b4be-5facfa3ba834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:24.134360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97299d7d-8e0b-409f-b4be-5facfa3ba834 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:24.210815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:24.233485 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 580/1164] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:38:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:38:24.240249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5c750-c8fd-4b96-99b0-3b04ac0e8e4e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:24.281228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:24.341715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5c750-c8fd-4b96-99b0-3b04ac0e8e4e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:24.378068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49177101-075f-4ad7-80cf-28fd26272523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:24.378689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49177101-075f-4ad7-80cf-28fd26272523 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:24.378994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49177101-075f-4ad7-80cf-28fd26272523 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:24.379266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49177101-075f-4ad7-80cf-28fd26272523 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:24.385626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49177101-075f-4ad7-80cf-28fd26272523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:24.387070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49177101-075f-4ad7-80cf-28fd26272523 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-49177101-075f-4ad7-80cf-28fd26272523 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:24.397901 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:38:24.399181 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:38:24.400329 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 585/1165] 10.222.0.70 () {56 vars in 1117 bytes} [Sun Aug 28 18:38:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:38:24.408122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299d7d-8e0b-409f-b4be-5facfa3ba834 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:24.507672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97299d7d-8e0b-409f-b4be-5facfa3ba834 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:24.542243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c632aee-6495-427b-8ed6-5cd49f8bb3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:24.542865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c632aee-6495-427b-8ed6-5cd49f8bb3ee None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:24.543150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c632aee-6495-427b-8ed6-5cd49f8bb3ee None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:24.543427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c632aee-6495-427b-8ed6-5cd49f8bb3ee None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:24.544060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c632aee-6495-427b-8ed6-5cd49f8bb3ee None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:24.544366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c632aee-6495-427b-8ed6-5cd49f8bb3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:24.545723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c632aee-6495-427b-8ed6-5cd49f8bb3ee None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:24.553008 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 581/1166] 10.222.0.70 () {56 vars in 1115 bytes} [Sun Aug 28 18:38:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:26.449970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99484eec-4481-442a-873d-25f16dc783d6 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:26.450530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99484eec-4481-442a-873d-25f16dc783d6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:26.450530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99484eec-4481-442a-873d-25f16dc783d6 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:26.451880 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 586/1167] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:26.457719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4ae84-3c93-4954-852f-7874d0508c75 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:26.458143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4ae84-3c93-4954-852f-7874d0508c75 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:26.458281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4ae84-3c93-4954-852f-7874d0508c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:26.476274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-94c4ae84-3c93-4954-852f-7874d0508c75 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:26.477460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-94c4ae84-3c93-4954-852f-7874d0508c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:26.512515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:26.544490 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 582/1168] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:38:26.815213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99484eec-4481-442a-873d-25f16dc783d6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:26.912248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99484eec-4481-442a-873d-25f16dc783d6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:26.913691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:26.946638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502731c-7a6c-4819-b473-9a02cc0b01d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:26.947267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502731c-7a6c-4819-b473-9a02cc0b01d0 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:26.947546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502731c-7a6c-4819-b473-9a02cc0b01d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:26.947813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502731c-7a6c-4819-b473-9a02cc0b01d0 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:26.948471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502731c-7a6c-4819-b473-9a02cc0b01d0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:26.949809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502731c-7a6c-4819-b473-9a02cc0b01d0 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:26.965043 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 587/1169] 10.222.0.70 () {60 vars in 1138 bytes} [Sun Aug 28 18:38:26 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:28.892876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c6048-474c-4811-8059-36dec89b3dcf None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:28.893466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c6048-474c-4811-8059-36dec89b3dcf None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:28.893466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c6048-474c-4811-8059-36dec89b3dcf None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:28.894689 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 583/1170] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:28.900070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a7b5c-2221-4f4d-9838-3a4c725f2203 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:28.900487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a7b5c-2221-4f4d-9838-3a4c725f2203 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:28.900619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a7b5c-2221-4f4d-9838-3a4c725f2203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:28.918022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-837a7b5c-2221-4f4d-9838-3a4c725f2203 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:28.919209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-837a7b5c-2221-4f4d-9838-3a4c725f2203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:28.983259 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 588/1171] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:38:29.250673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c6048-474c-4811-8059-36dec89b3dcf None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:29.351890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c6048-474c-4811-8059-36dec89b3dcf None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:29.386097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f21a3-0044-4b01-be65-e2729d78ebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:29.386718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f21a3-0044-4b01-be65-e2729d78ebf8 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:29.387036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f21a3-0044-4b01-be65-e2729d78ebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:29.387310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f21a3-0044-4b01-be65-e2729d78ebf8 None admin] PATH_INFO: `/v3/domains/480114699fab4ae9a9ee29fd5153d148` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:29.397489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f21a3-0044-4b01-be65-e2729d78ebf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=480114699fab4ae9a9ee29fd5153d148)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:29.398974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f21a3-0044-4b01-be65-e2729d78ebf8 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:29.400535 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 584/1172] 10.222.0.70 () {56 vars in 1183 bytes} [Sun Aug 28 18:38:29 2022] GET /identity/v3/domains/480114699fab4ae9a9ee29fd5153d148 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:29.406872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a7b5c-2221-4f4d-9838-3a4c725f2203 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:29.492856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:29.501887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a7b5c-2221-4f4d-9838-3a4c725f2203 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:29.534101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc54fa4-86ad-4adf-9fa9-6b19647355fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:29.534697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc54fa4-86ad-4adf-9fa9-6b19647355fa None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:29.535005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc54fa4-86ad-4adf-9fa9-6b19647355fa None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:29.535278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc54fa4-86ad-4adf-9fa9-6b19647355fa None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:29.535921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc54fa4-86ad-4adf-9fa9-6b19647355fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:29.537328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc54fa4-86ad-4adf-9fa9-6b19647355fa None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:29.563110 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 589/1173] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:38:29 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:38:31.475960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e37d5-2226-45d3-9989-425ccb2057f8 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:31.476493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e37d5-2226-45d3-9989-425ccb2057f8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:31.476605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e37d5-2226-45d3-9989-425ccb2057f8 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:31.477864 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 585/1174] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:31.483085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73aa81-8cf4-49cc-ba55-e81047bdcbff None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:31.483475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73aa81-8cf4-49cc-ba55-e81047bdcbff None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:31.483713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73aa81-8cf4-49cc-ba55-e81047bdcbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:31.501291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8c73aa81-8cf4-49cc-ba55-e81047bdcbff None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:31.502453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8c73aa81-8cf4-49cc-ba55-e81047bdcbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:31.567949 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 590/1175] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:38:31.835385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e37d5-2226-45d3-9989-425ccb2057f8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:31.868656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:31.939493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e37d5-2226-45d3-9989-425ccb2057f8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:31.972247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c0e4a-21e1-4a0b-89a7-563eb7a148e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:31.972867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0e4a-21e1-4a0b-89a7-563eb7a148e0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:31.973167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0e4a-21e1-4a0b-89a7-563eb7a148e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:31.973446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c0e4a-21e1-4a0b-89a7-563eb7a148e0 None admin] PATH_INFO: `/v3/domains/480114699fab4ae9a9ee29fd5153d148` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:31.974551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c0e4a-21e1-4a0b-89a7-563eb7a148e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=480114699fab4ae9a9ee29fd5153d148)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:31.976019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c0e4a-21e1-4a0b-89a7-563eb7a148e0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:31.977570 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 586/1176] 10.222.0.70 () {56 vars in 1183 bytes} [Sun Aug 28 18:38:31 2022] GET /identity/v3/domains/480114699fab4ae9a9ee29fd5153d148 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:31.983323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73aa81-8cf4-49cc-ba55-e81047bdcbff None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:32.055776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:32.083272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73aa81-8cf4-49cc-ba55-e81047bdcbff None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:32.116384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fb9c3-d7b8-49ca-930c-3b45ca5f9e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:32.116908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fb9c3-d7b8-49ca-930c-3b45ca5f9e52 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:32.117187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fb9c3-d7b8-49ca-930c-3b45ca5f9e52 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:32.117459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fb9c3-d7b8-49ca-930c-3b45ca5f9e52 None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:32.118095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fb9c3-d7b8-49ca-930c-3b45ca5f9e52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:32.119536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fb9c3-d7b8-49ca-930c-3b45ca5f9e52 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:32.141255 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 591/1177] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:38:31 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:38:34.084744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa311b8-5e40-40a3-a65e-7cbb93db89b5 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:34.085269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa311b8-5e40-40a3-a65e-7cbb93db89b5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:34.085392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa311b8-5e40-40a3-a65e-7cbb93db89b5 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:34.086640 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 587/1178] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:34.091910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbcb59-22a1-4a2f-8d14-0a1e668c9f51 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:34.092340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbcb59-22a1-4a2f-8d14-0a1e668c9f51 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:34.092440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbcb59-22a1-4a2f-8d14-0a1e668c9f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:34.110936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-aacbcb59-22a1-4a2f-8d14-0a1e668c9f51 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:34.112096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aacbcb59-22a1-4a2f-8d14-0a1e668c9f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:34.175465 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 592/1179] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:38:34.443556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa311b8-5e40-40a3-a65e-7cbb93db89b5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:34.546679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:34.550870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa311b8-5e40-40a3-a65e-7cbb93db89b5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:34.585609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c2e55-8e00-4308-8096-af891ef7309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:34.586240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c2e55-8e00-4308-8096-af891ef7309b None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:34.586524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c2e55-8e00-4308-8096-af891ef7309b None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:34.586837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c2e55-8e00-4308-8096-af891ef7309b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:34.598152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c2e55-8e00-4308-8096-af891ef7309b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-5c6c2e55-8e00-4308-8096-af891ef7309b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:38:34.602939 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:38:34.604099 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:38:34.605191 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:38:34.605191 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:38:34.605191 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:38:34.605191 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:38:34.605191 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:38:34.605191 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:38:34.605191 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:38:34.605191 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:38:34.605191 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:38:34.605191 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:38:34.605191 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:38:34.605191 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:38:34.605191 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 588/1180] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:38:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:38:34.610102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbcb59-22a1-4a2f-8d14-0a1e668c9f51 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:34.666907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:34.708372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbcb59-22a1-4a2f-8d14-0a1e668c9f51 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:34.739925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e20b45-4f8a-421c-887e-36b7c9b04b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:34.740518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e20b45-4f8a-421c-887e-36b7c9b04b95 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:34.740794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e20b45-4f8a-421c-887e-36b7c9b04b95 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:34.741064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e20b45-4f8a-421c-887e-36b7c9b04b95 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:34.741714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e20b45-4f8a-421c-887e-36b7c9b04b95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:34.742014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e20b45-4f8a-421c-887e-36b7c9b04b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:34.743394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e20b45-4f8a-421c-887e-36b7c9b04b95 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:34.751616 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 593/1181] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:38:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:34.757401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c2e55-8e00-4308-8096-af891ef7309b None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:34.864167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c2e55-8e00-4308-8096-af891ef7309b None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:34.898009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c26e13-1ef8-4066-91e0-1ff7a30a211d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:34.898631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c26e13-1ef8-4066-91e0-1ff7a30a211d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:34.898959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c26e13-1ef8-4066-91e0-1ff7a30a211d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:34.899236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c26e13-1ef8-4066-91e0-1ff7a30a211d None admin] PATH_INFO: `/v3/users/1333b5d73c894d3794b3f3d8317dea1b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:34.912214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c26e13-1ef8-4066-91e0-1ff7a30a211d None admin] RBAC: Authorizing `identity:get_user(user_id=1333b5d73c894d3794b3f3d8317dea1b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:34.913645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c26e13-1ef8-4066-91e0-1ff7a30a211d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:34.915270 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 589/1182] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:38:34 2022] GET /identity/v3/users/1333b5d73c894d3794b3f3d8317dea1b => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:34.921274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e20b45-4f8a-421c-887e-36b7c9b04b95 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:35.025979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e20b45-4f8a-421c-887e-36b7c9b04b95 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:35.057017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:35.070879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08084f-0161-446c-9495-f4b505aa849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:35.070879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08084f-0161-446c-9495-f4b505aa849b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:35.070879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08084f-0161-446c-9495-f4b505aa849b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:35.070879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08084f-0161-446c-9495-f4b505aa849b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:35.147497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08084f-0161-446c-9495-f4b505aa849b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:35.148955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08084f-0161-446c-9495-f4b505aa849b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:35.245794 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 594/1183] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:38:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:38:35.252412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c26e13-1ef8-4066-91e0-1ff7a30a211d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:35.271010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:35.350284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c26e13-1ef8-4066-91e0-1ff7a30a211d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:35.386848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05b642-ba90-4859-8e72-d5ce91c3cfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:35.387463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b642-ba90-4859-8e72-d5ce91c3cfce None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:35.387739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b642-ba90-4859-8e72-d5ce91c3cfce None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:35.388009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b642-ba90-4859-8e72-d5ce91c3cfce None admin] PATH_INFO: `/v3/projects/8429a27f4bff49b881cdf6560064a5e5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:35.389375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05b642-ba90-4859-8e72-d5ce91c3cfce None admin] RBAC: Authorizing `identity:get_project(project_id=8429a27f4bff49b881cdf6560064a5e5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:35.391604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05b642-ba90-4859-8e72-d5ce91c3cfce None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:35.393934 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 590/1184] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:38:35 2022] GET /identity/v3/projects/8429a27f4bff49b881cdf6560064a5e5 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:35.400252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08084f-0161-446c-9495-f4b505aa849b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:35.424148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:35.500028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08084f-0161-446c-9495-f4b505aa849b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:35.533401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc003f-1052-4c37-a96e-8abb1a516743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:35.533989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc003f-1052-4c37-a96e-8abb1a516743 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:35.534266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc003f-1052-4c37-a96e-8abb1a516743 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:35.534535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc003f-1052-4c37-a96e-8abb1a516743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:35.535273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc003f-1052-4c37-a96e-8abb1a516743 None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=8429a27f4bff49b881cdf6560064a5e5, user.id=1333b5d73c894d3794b3f3d8317dea1b) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:35.535582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc003f-1052-4c37-a96e-8abb1a516743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:35.536991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc003f-1052-4c37-a96e-8abb1a516743 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:35.542166 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 595/1185] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:38:35 2022] GET /identity/v3/role_assignments?user.id=1333b5d73c894d3794b3f3d8317dea1b&scope.project.id=8429a27f4bff49b881cdf6560064a5e5&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:37.398539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b766b-158b-4f6e-9c94-5c3857c5c8e4 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:37.399123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b766b-158b-4f6e-9c94-5c3857c5c8e4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:37.399123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b766b-158b-4f6e-9c94-5c3857c5c8e4 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:37.400436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 591/1186] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:37.406156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b1b08-c420-4651-b2cd-6b299bc28d78 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:37.406559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b1b08-c420-4651-b2cd-6b299bc28d78 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:37.406838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b1b08-c420-4651-b2cd-6b299bc28d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:37.424396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ee0b1b08-c420-4651-b2cd-6b299bc28d78 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:37.425575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ee0b1b08-c420-4651-b2cd-6b299bc28d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:37.491337 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 596/1187] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:38:37.760279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b766b-158b-4f6e-9c94-5c3857c5c8e4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:37.844763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:37.861973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b766b-158b-4f6e-9c94-5c3857c5c8e4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:37.894186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1281d4-097c-42a1-af14-1df5855602d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:37.894822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1281d4-097c-42a1-af14-1df5855602d1 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:37.895104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1281d4-097c-42a1-af14-1df5855602d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:37.895373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1281d4-097c-42a1-af14-1df5855602d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:37.904967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1281d4-097c-42a1-af14-1df5855602d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-4d1281d4-097c-42a1-af14-1df5855602d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:38:37.910289 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:38:37.911434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:38:37.912452 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:38:37.912452 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:38:37.912452 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:38:37.912452 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:38:37.912452 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:38:37.912452 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:38:37.912452 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:38:37.912452 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:38:37.912452 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:38:37.912452 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:38:37.912452 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:38:37.912452 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:38:37.912452 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 592/1188] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:38:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:38:37.917310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b1b08-c420-4651-b2cd-6b299bc28d78 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:37.935130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:38.016416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b1b08-c420-4651-b2cd-6b299bc28d78 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:38.049955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24907a-3b2d-41f4-983c-5dd70f0227f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:38.050555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24907a-3b2d-41f4-983c-5dd70f0227f1 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:38.050868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24907a-3b2d-41f4-983c-5dd70f0227f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:38.051146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24907a-3b2d-41f4-983c-5dd70f0227f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:38.051808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24907a-3b2d-41f4-983c-5dd70f0227f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:38.052115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24907a-3b2d-41f4-983c-5dd70f0227f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:38.053475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24907a-3b2d-41f4-983c-5dd70f0227f1 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:38.061651 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 597/1189] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:38:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:38.067517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1281d4-097c-42a1-af14-1df5855602d1 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:38.170643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1281d4-097c-42a1-af14-1df5855602d1 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:38.204507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b61f7-2060-4c1a-bf0d-41f2a412f3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:38.205111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b61f7-2060-4c1a-bf0d-41f2a412f3d5 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:38.205389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b61f7-2060-4c1a-bf0d-41f2a412f3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:38.205659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b61f7-2060-4c1a-bf0d-41f2a412f3d5 None admin] PATH_INFO: `/v3/users/1333b5d73c894d3794b3f3d8317dea1b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:38.206772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b61f7-2060-4c1a-bf0d-41f2a412f3d5 None admin] RBAC: Authorizing `identity:get_user(user_id=1333b5d73c894d3794b3f3d8317dea1b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:38.208186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b61f7-2060-4c1a-bf0d-41f2a412f3d5 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:38.209710 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 593/1190] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:38:38 2022] GET /identity/v3/users/1333b5d73c894d3794b3f3d8317dea1b => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:38.215458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24907a-3b2d-41f4-983c-5dd70f0227f1 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:38.291194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:38.314076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24907a-3b2d-41f4-983c-5dd70f0227f1 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:38.347006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17346b45-bc1f-4b21-a3e3-6e9d1b8c349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:38.347628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17346b45-bc1f-4b21-a3e3-6e9d1b8c349b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:38.347908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17346b45-bc1f-4b21-a3e3-6e9d1b8c349b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:38.348181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17346b45-bc1f-4b21-a3e3-6e9d1b8c349b None admin] PATH_INFO: `/v3/projects/8429a27f4bff49b881cdf6560064a5e5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:38.349285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17346b45-bc1f-4b21-a3e3-6e9d1b8c349b None admin] RBAC: Authorizing `identity:get_project(project_id=8429a27f4bff49b881cdf6560064a5e5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:38.350710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17346b45-bc1f-4b21-a3e3-6e9d1b8c349b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:38.352350 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 598/1191] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:38:38 2022] GET /identity/v3/projects/8429a27f4bff49b881cdf6560064a5e5 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:38.358202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b61f7-2060-4c1a-bf0d-41f2a412f3d5 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:38.373668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:38.457325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b61f7-2060-4c1a-bf0d-41f2a412f3d5 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:38.490143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8ca75-451f-4b4d-9131-4263f695995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:38.490884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8ca75-451f-4b4d-9131-4263f695995e None admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:38.491170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8ca75-451f-4b4d-9131-4263f695995e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:38.491444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8ca75-451f-4b4d-9131-4263f695995e None admin] PATH_INFO: `/v3/projects/8429a27f4bff49b881cdf6560064a5e5/users/1333b5d73c894d3794b3f3d8317dea1b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:38.493323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8ca75-451f-4b4d-9131-4263f695995e None admin] RBAC: Authorizing `identity:create_grant(project_id=8429a27f4bff49b881cdf6560064a5e5, user_id=1333b5d73c894d3794b3f3d8317dea1b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:38.494761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8ca75-451f-4b4d-9131-4263f695995e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:38.508637 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 594/1192] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:38:38 2022] PUT /identity/v3/projects/8429a27f4bff49b881cdf6560064a5e5/users/1333b5d73c894d3794b3f3d8317dea1b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:38:40.395543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe487-4ea3-4125-913f-b72563cd69cd None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:40.396061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe487-4ea3-4125-913f-b72563cd69cd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:40.396061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe487-4ea3-4125-913f-b72563cd69cd None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:40.397382 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 599/1193] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:38:40.402550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd073-cc63-4b0e-a733-e562fab100cc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:40.402992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd073-cc63-4b0e-a733-e562fab100cc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:40.403100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd073-cc63-4b0e-a733-e562fab100cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:40.421881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-dafdd073-cc63-4b0e-a733-e562fab100cc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:38:40.423113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dafdd073-cc63-4b0e-a733-e562fab100cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:38:40.489848 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 595/1194] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:38:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:38:40.763237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fe487-4ea3-4125-913f-b72563cd69cd None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:40.862327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fe487-4ea3-4125-913f-b72563cd69cd None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:40.895622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98474c-eb6b-4e2d-8b98-d099e1aafd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:40.896224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98474c-eb6b-4e2d-8b98-d099e1aafd44 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:40.896501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98474c-eb6b-4e2d-8b98-d099e1aafd44 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:40.896773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98474c-eb6b-4e2d-8b98-d099e1aafd44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:40.906435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98474c-eb6b-4e2d-8b98-d099e1aafd44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-6f98474c-eb6b-4e2d-8b98-d099e1aafd44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:38:40.911161 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:38:40.912222 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:38:40.913230 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:38:40.913230 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:38:40.913230 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:38:40.913230 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:38:40.913230 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:38:40.913230 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:38:40.913230 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:38:40.913230 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:38:40.913230 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:38:40.913230 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:38:40.913230 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:38:40.913230 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:38:40.913230 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 600/1195] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:38:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:38:40.918320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd073-cc63-4b0e-a733-e562fab100cc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:40.921388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:41.016886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd073-cc63-4b0e-a733-e562fab100cc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:41.051091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254ae3b-b050-4e6b-afa9-9691dc01e578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:41.051693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ae3b-b050-4e6b-afa9-9691dc01e578 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:41.051975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ae3b-b050-4e6b-afa9-9691dc01e578 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:41.052249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ae3b-b050-4e6b-afa9-9691dc01e578 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:41.052901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254ae3b-b050-4e6b-afa9-9691dc01e578 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:41.053204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254ae3b-b050-4e6b-afa9-9691dc01e578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:41.054568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254ae3b-b050-4e6b-afa9-9691dc01e578 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:41.063336 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 596/1196] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:38:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:41.069143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98474c-eb6b-4e2d-8b98-d099e1aafd44 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:41.078412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:41.166096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98474c-eb6b-4e2d-8b98-d099e1aafd44 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:41.200627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8057a-4a18-418e-b873-505612a8d2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:41.201255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8057a-4a18-418e-b873-505612a8d2b4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:41.201540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8057a-4a18-418e-b873-505612a8d2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:41.201814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8057a-4a18-418e-b873-505612a8d2b4 None admin] PATH_INFO: `/v3/users/1333b5d73c894d3794b3f3d8317dea1b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:41.202957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8057a-4a18-418e-b873-505612a8d2b4 None admin] RBAC: Authorizing `identity:get_user(user_id=1333b5d73c894d3794b3f3d8317dea1b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:41.204509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8057a-4a18-418e-b873-505612a8d2b4 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:41.206175 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 601/1197] 10.222.0.70 () {56 vars in 1177 bytes} [Sun Aug 28 18:38:41 2022] GET /identity/v3/users/1333b5d73c894d3794b3f3d8317dea1b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:41.212157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254ae3b-b050-4e6b-afa9-9691dc01e578 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:41.278005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:41.313958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254ae3b-b050-4e6b-afa9-9691dc01e578 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:41.347592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcce41-5b4b-4fa7-be6f-8d8b249ba769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:41.348189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcce41-5b4b-4fa7-be6f-8d8b249ba769 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:41.348472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcce41-5b4b-4fa7-be6f-8d8b249ba769 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:41.348749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcce41-5b4b-4fa7-be6f-8d8b249ba769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:41.415588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcce41-5b4b-4fa7-be6f-8d8b249ba769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:41.417047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcce41-5b4b-4fa7-be6f-8d8b249ba769 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:41.480139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:41.516471 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 597/1198] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:38:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:38:41.522358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8057a-4a18-418e-b873-505612a8d2b4 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:41.596934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:41.621806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8057a-4a18-418e-b873-505612a8d2b4 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:41.655023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d32c4-de23-48b8-b134-df9a76f692d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:41.655645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d32c4-de23-48b8-b134-df9a76f692d3 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:41.655929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d32c4-de23-48b8-b134-df9a76f692d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:41.656318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d32c4-de23-48b8-b134-df9a76f692d3 None admin] PATH_INFO: `/v3/projects/8429a27f4bff49b881cdf6560064a5e5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:41.657316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d32c4-de23-48b8-b134-df9a76f692d3 None admin] RBAC: Authorizing `identity:get_project(project_id=8429a27f4bff49b881cdf6560064a5e5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:41.658733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d32c4-de23-48b8-b134-df9a76f692d3 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:41.660384 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 602/1199] 10.222.0.70 () {56 vars in 1186 bytes} [Sun Aug 28 18:38:41 2022] GET /identity/v3/projects/8429a27f4bff49b881cdf6560064a5e5 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:41.666499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcce41-5b4b-4fa7-be6f-8d8b249ba769 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:38:41.763394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcce41-5b4b-4fa7-be6f-8d8b249ba769 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:38:41.795579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495071c-1248-4e54-a1df-655340db22b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:38:41.796168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495071c-1248-4e54-a1df-655340db22b2 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:38:41.796445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495071c-1248-4e54-a1df-655340db22b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:38:41.796711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495071c-1248-4e54-a1df-655340db22b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:38:41.798067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495071c-1248-4e54-a1df-655340db22b2 None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=8429a27f4bff49b881cdf6560064a5e5, user.id=1333b5d73c894d3794b3f3d8317dea1b) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:38:41.798365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495071c-1248-4e54-a1df-655340db22b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:38:41.799806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495071c-1248-4e54-a1df-655340db22b2 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:38:41.805332 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 598/1200] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:38:41 2022] GET /identity/v3/role_assignments?user.id=1333b5d73c894d3794b3f3d8317dea1b&scope.project.id=8429a27f4bff49b881cdf6560064a5e5&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:38:51.651383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=29 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:38:51.803288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=85 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:37.550006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbc6c3-c22c-4857-8107-51ccbf42b759 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:37.550616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbc6c3-c22c-4857-8107-51ccbf42b759 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:37.550616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbc6c3-c22c-4857-8107-51ccbf42b759 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:37.552200 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 603/1201] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:39:37.561288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e17710-cc21-4ada-99b9-42df1a099dbb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:37.561288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e17710-cc21-4ada-99b9-42df1a099dbb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:37.561288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e17710-cc21-4ada-99b9-42df1a099dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:37.580805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-66e17710-cc21-4ada-99b9-42df1a099dbb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:37.582052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-66e17710-cc21-4ada-99b9-42df1a099dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:37.669781 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 599/1202] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:39:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:39:37.946140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbc6c3-c22c-4857-8107-51ccbf42b759 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:38.067953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbc6c3-c22c-4857-8107-51ccbf42b759 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:38.115710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb630e8-5232-4821-8096-06b6da706379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:38.116506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb630e8-5232-4821-8096-06b6da706379 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:38.116935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb630e8-5232-4821-8096-06b6da706379 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:38.117189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb630e8-5232-4821-8096-06b6da706379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:38.128612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb630e8-5232-4821-8096-06b6da706379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:38.130160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb630e8-5232-4821-8096-06b6da706379 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-bcb630e8-5232-4821-8096-06b6da706379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:39:38.148741 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:38.149887 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:39:38.151359 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:39:38.151359 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:38.151359 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:39:38.151359 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 604/1203] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:39:38.156676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e17710-cc21-4ada-99b9-42df1a099dbb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:38.282569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e17710-cc21-4ada-99b9-42df1a099dbb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:38.328112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:38.335632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b31380-aab7-4aa7-ae22-b50ef93b08c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:38.336423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b31380-aab7-4aa7-ae22-b50ef93b08c2 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:38.336993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b31380-aab7-4aa7-ae22-b50ef93b08c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:38.337323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b31380-aab7-4aa7-ae22-b50ef93b08c2 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:38.343046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b31380-aab7-4aa7-ae22-b50ef93b08c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:38.343046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b31380-aab7-4aa7-ae22-b50ef93b08c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:38.343046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b31380-aab7-4aa7-ae22-b50ef93b08c2 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:38.357376 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 600/1204] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:38.363909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb630e8-5232-4821-8096-06b6da706379 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:38.429386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:38.489893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb630e8-5232-4821-8096-06b6da706379 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:38.534632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa52b3-28cc-4dc2-a757-61c1bebce580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:38.535938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa52b3-28cc-4dc2-a757-61c1bebce580 None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:38.536413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa52b3-28cc-4dc2-a757-61c1bebce580 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:38.536879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa52b3-28cc-4dc2-a757-61c1bebce580 None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:38.537737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa52b3-28cc-4dc2-a757-61c1bebce580 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:38.539433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa52b3-28cc-4dc2-a757-61c1bebce580 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:38.566928 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 605/1205] 10.222.0.70 () {60 vars in 1132 bytes} [Sun Aug 28 18:39:38 2022] POST /identity/v3/users => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:39:40.763225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33c01c-029a-43d8-8625-e4fc5f38f40b None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:40.763748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33c01c-029a-43d8-8625-e4fc5f38f40b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:40.763849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33c01c-029a-43d8-8625-e4fc5f38f40b None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:40.766415 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 601/1206] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:39:40.772236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3d36c-5c78-4536-9144-4c95115101f3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:40.772683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3d36c-5c78-4536-9144-4c95115101f3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:40.772788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3d36c-5c78-4536-9144-4c95115101f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:40.793014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-dbe3d36c-5c78-4536-9144-4c95115101f3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:40.794243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dbe3d36c-5c78-4536-9144-4c95115101f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:40.883745 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 606/1207] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:39:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:39:41.213369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33c01c-029a-43d8-8625-e4fc5f38f40b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:41.340127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33c01c-029a-43d8-8625-e4fc5f38f40b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:41.381290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44052577-7293-4018-bec9-372222c80ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:41.382356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44052577-7293-4018-bec9-372222c80ae0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:41.382900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44052577-7293-4018-bec9-372222c80ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:41.383391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44052577-7293-4018-bec9-372222c80ae0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:41.396301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44052577-7293-4018-bec9-372222c80ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-44052577-7293-4018-bec9-372222c80ae0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:39:41.401371 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:41.402328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:41.403203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:41.403203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:41.403203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:41.403203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:41.403203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:39:41.403203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:39:41.403203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:39:41.403203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:39:41.403203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:39:41.403203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:39:41.403203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:39:41.403203 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:39:41.406973 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 602/1208] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:39:41.413096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3d36c-5c78-4536-9144-4c95115101f3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:41.490377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:41.569938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3d36c-5c78-4536-9144-4c95115101f3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:41.628850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718bd64-6383-4d21-9fa2-9c7520c65ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:41.629668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718bd64-6383-4d21-9fa2-9c7520c65ee7 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:41.630038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718bd64-6383-4d21-9fa2-9c7520c65ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:41.630649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718bd64-6383-4d21-9fa2-9c7520c65ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:41.631456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718bd64-6383-4d21-9fa2-9c7520c65ee7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:41.631834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718bd64-6383-4d21-9fa2-9c7520c65ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:41.633463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f718bd64-6383-4d21-9fa2-9c7520c65ee7 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:41.643758 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 607/1209] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:41.649115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44052577-7293-4018-bec9-372222c80ae0 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:41.709966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:41.772962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44052577-7293-4018-bec9-372222c80ae0 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:41.812998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d332-f12c-45fa-b60f-63cf0bcea265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:41.813670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d332-f12c-45fa-b60f-63cf0bcea265 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:41.814021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d332-f12c-45fa-b60f-63cf0bcea265 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:41.814244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d332-f12c-45fa-b60f-63cf0bcea265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:41.829806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02d332-f12c-45fa-b60f-63cf0bcea265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:41.831350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02d332-f12c-45fa-b60f-63cf0bcea265 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-2a02d332-f12c-45fa-b60f-63cf0bcea265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:39:41.848114 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:41.849220 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:39:41.850377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:39:41.850377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:41.850377 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:39:41.850377 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 603/1210] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:39:41.855912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718bd64-6383-4d21-9fa2-9c7520c65ee7 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:41.986509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:41.990256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718bd64-6383-4d21-9fa2-9c7520c65ee7 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:42.046521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e933d3-dff6-40da-ae22-f587048a5aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:42.048719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e933d3-dff6-40da-ae22-f587048a5aae None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:42.048719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e933d3-dff6-40da-ae22-f587048a5aae None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:42.048719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e933d3-dff6-40da-ae22-f587048a5aae None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:42.049495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e933d3-dff6-40da-ae22-f587048a5aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:42.049995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e933d3-dff6-40da-ae22-f587048a5aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:42.054035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e933d3-dff6-40da-ae22-f587048a5aae None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:42.069006 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 608/1211] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:42.075200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d332-f12c-45fa-b60f-63cf0bcea265 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:42.200657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d332-f12c-45fa-b60f-63cf0bcea265 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:42.203378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:42.243621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996498f8-5001-43c9-8b2b-652d75c31f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:42.244382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996498f8-5001-43c9-8b2b-652d75c31f01 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:42.244783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996498f8-5001-43c9-8b2b-652d75c31f01 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:42.245071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996498f8-5001-43c9-8b2b-652d75c31f01 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:42.254951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996498f8-5001-43c9-8b2b-652d75c31f01 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:42.256522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996498f8-5001-43c9-8b2b-652d75c31f01 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-996498f8-5001-43c9-8b2b-652d75c31f01 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:39:42.269684 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:42.270955 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:42.272131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:42.272131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:42.272131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:39:42.272131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:39:42.272131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:39:42.272131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:39:42.272131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:39:42.272131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:39:42.272131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:39:42.272131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:39:42.272893 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 604/1212] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:39:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:39:42.282795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e933d3-dff6-40da-ae22-f587048a5aae None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:42.397230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e933d3-dff6-40da-ae22-f587048a5aae None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:42.436217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af4cd2-02b3-4609-8824-89027f1d61a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:42.436982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af4cd2-02b3-4609-8824-89027f1d61a8 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:42.437265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af4cd2-02b3-4609-8824-89027f1d61a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:42.437583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af4cd2-02b3-4609-8824-89027f1d61a8 None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:42.438335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af4cd2-02b3-4609-8824-89027f1d61a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:42.438685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af4cd2-02b3-4609-8824-89027f1d61a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:42.440205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af4cd2-02b3-4609-8824-89027f1d61a8 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:42.461345 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 609/1213] 10.222.0.70 () {56 vars in 1143 bytes} [Sun Aug 28 18:39:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:42.469220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996498f8-5001-43c9-8b2b-652d75c31f01 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:42.611620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996498f8-5001-43c9-8b2b-652d75c31f01 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:42.663744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8b789-9617-4827-9644-e8ed9f8406d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:42.663744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8b789-9617-4827-9644-e8ed9f8406d7 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:42.663744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8b789-9617-4827-9644-e8ed9f8406d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:42.664081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8b789-9617-4827-9644-e8ed9f8406d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:42.708993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:42.761165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8b789-9617-4827-9644-e8ed9f8406d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:42.762601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8b789-9617-4827-9644-e8ed9f8406d7 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:42.879509 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 605/1214] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:39:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:39:42.886075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af4cd2-02b3-4609-8824-89027f1d61a8 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:42.914372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:43.023848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af4cd2-02b3-4609-8824-89027f1d61a8 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:43.066661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bd4fd-8844-47ba-91d3-66cbada1819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:43.067545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bd4fd-8844-47ba-91d3-66cbada1819d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:43.067929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bd4fd-8844-47ba-91d3-66cbada1819d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:43.068252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bd4fd-8844-47ba-91d3-66cbada1819d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:43.082344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bd4fd-8844-47ba-91d3-66cbada1819d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:43.084067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bd4fd-8844-47ba-91d3-66cbada1819d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-c78bd4fd-8844-47ba-91d3-66cbada1819d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:39:43.102342 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:43.103645 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:39:43.104836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:39:43.104836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:43.104836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:39:43.104836 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 610/1215] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:39:43.109855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8b789-9617-4827-9644-e8ed9f8406d7 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:43.195072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:43.252436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8b789-9617-4827-9644-e8ed9f8406d7 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:43.298919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5f8fb-f1ec-46a2-9aa9-99c3526f635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:43.299639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5f8fb-f1ec-46a2-9aa9-99c3526f635d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:43.300043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5f8fb-f1ec-46a2-9aa9-99c3526f635d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:43.300362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5f8fb-f1ec-46a2-9aa9-99c3526f635d None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:43.301049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5f8fb-f1ec-46a2-9aa9-99c3526f635d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:43.301406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5f8fb-f1ec-46a2-9aa9-99c3526f635d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:43.302919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5f8fb-f1ec-46a2-9aa9-99c3526f635d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:43.323388 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 606/1216] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:43.324916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bd4fd-8844-47ba-91d3-66cbada1819d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:43.404460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:43.439222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bd4fd-8844-47ba-91d3-66cbada1819d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:43.476913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eea300-ad19-43d4-ae00-34cfb24f7cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:43.477505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eea300-ad19-43d4-ae00-34cfb24f7cbc None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:43.477796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eea300-ad19-43d4-ae00-34cfb24f7cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:43.478093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eea300-ad19-43d4-ae00-34cfb24f7cbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:43.485769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eea300-ad19-43d4-ae00-34cfb24f7cbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:43.487265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eea300-ad19-43d4-ae00-34cfb24f7cbc None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-12eea300-ad19-43d4-ae00-34cfb24f7cbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:39:43.499807 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:43.501005 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:43.501942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:39:43.501942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:39:43.501942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:39:43.501942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:39:43.501942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:39:43.501942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:39:43.501942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:39:43.501942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:39:43.506779 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 611/1217] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:39:43.507102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5f8fb-f1ec-46a2-9aa9-99c3526f635d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:43.638870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5f8fb-f1ec-46a2-9aa9-99c3526f635d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:43.666904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:43.681396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d9285-1159-4c6e-a7a0-cbef0ec6e2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:43.682133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d9285-1159-4c6e-a7a0-cbef0ec6e2d0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:43.682519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d9285-1159-4c6e-a7a0-cbef0ec6e2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:43.682935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d9285-1159-4c6e-a7a0-cbef0ec6e2d0 None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:43.683737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d9285-1159-4c6e-a7a0-cbef0ec6e2d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:43.684148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d9285-1159-4c6e-a7a0-cbef0ec6e2d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:43.686199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d9285-1159-4c6e-a7a0-cbef0ec6e2d0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:43.705158 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 607/1218] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:43.706133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eea300-ad19-43d4-ae00-34cfb24f7cbc None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:43.816380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eea300-ad19-43d4-ae00-34cfb24f7cbc None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:43.849281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:43.856940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf93c47-33b4-4090-9d5c-6bdbe1ff92c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:43.858497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf93c47-33b4-4090-9d5c-6bdbe1ff92c0 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:43.858983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf93c47-33b4-4090-9d5c-6bdbe1ff92c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:43.859362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf93c47-33b4-4090-9d5c-6bdbe1ff92c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:43.860111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf93c47-33b4-4090-9d5c-6bdbe1ff92c0 None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=0055d9c941024cdc894104f1345540fa) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:43.860413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf93c47-33b4-4090-9d5c-6bdbe1ff92c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:43.862018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf93c47-33b4-4090-9d5c-6bdbe1ff92c0 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:43.879158 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 612/1219] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:39:43 2022] GET /identity/v3/role_assignments?user.id=0055d9c941024cdc894104f1345540fa&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:46.025710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167420d-c78c-4800-94be-4f57d5c40b27 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:46.026406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167420d-c78c-4800-94be-4f57d5c40b27 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:46.026406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167420d-c78c-4800-94be-4f57d5c40b27 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:46.027655 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 608/1220] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:39:46.033667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35741c50-f281-44ee-bdac-f8622ba8c7c1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:46.034141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35741c50-f281-44ee-bdac-f8622ba8c7c1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:46.034459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35741c50-f281-44ee-bdac-f8622ba8c7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:46.056147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-35741c50-f281-44ee-bdac-f8622ba8c7c1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:46.057602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-35741c50-f281-44ee-bdac-f8622ba8c7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:46.131631 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 613/1221] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:39:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:39:46.406425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167420d-c78c-4800-94be-4f57d5c40b27 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:46.517577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167420d-c78c-4800-94be-4f57d5c40b27 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:46.552027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b401013-cc6f-47d2-bf4b-77968bcab114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:46.552709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b401013-cc6f-47d2-bf4b-77968bcab114 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:46.553023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b401013-cc6f-47d2-bf4b-77968bcab114 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:46.553240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b401013-cc6f-47d2-bf4b-77968bcab114 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:46.570670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b401013-cc6f-47d2-bf4b-77968bcab114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-2b401013-cc6f-47d2-bf4b-77968bcab114 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:39:46.575778 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:46.583057 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:46.584614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:46.584614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:46.584614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:46.584614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:46.584614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:39:46.584614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:39:46.584614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:39:46.584614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:39:46.584614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:39:46.584614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:39:46.584614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:39:46.584614 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:39:46.584614 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 609/1222] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:39:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:39:46.585469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35741c50-f281-44ee-bdac-f8622ba8c7c1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:46.691073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35741c50-f281-44ee-bdac-f8622ba8c7c1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:46.717279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:46.728155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829fc04-9c85-4491-8992-6358dbc340a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:46.728765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829fc04-9c85-4491-8992-6358dbc340a6 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:46.729046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829fc04-9c85-4491-8992-6358dbc340a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:46.729319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829fc04-9c85-4491-8992-6358dbc340a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:46.729982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829fc04-9c85-4491-8992-6358dbc340a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:46.730288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829fc04-9c85-4491-8992-6358dbc340a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:46.731818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829fc04-9c85-4491-8992-6358dbc340a6 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:46.740921 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 614/1223] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:39:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:46.747095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b401013-cc6f-47d2-bf4b-77968bcab114 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:46.796510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:46.868447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b401013-cc6f-47d2-bf4b-77968bcab114 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:46.914034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d2992-a613-40d9-b8bd-2040c718ac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:46.914671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d2992-a613-40d9-b8bd-2040c718ac18 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:46.914987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d2992-a613-40d9-b8bd-2040c718ac18 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:46.915264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d2992-a613-40d9-b8bd-2040c718ac18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:46.927152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d2992-a613-40d9-b8bd-2040c718ac18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:46.928745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d2992-a613-40d9-b8bd-2040c718ac18 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-b98d2992-a613-40d9-b8bd-2040c718ac18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:39:46.944764 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:46.945807 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:39:46.946699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:39:46.946699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:46.946699 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:39:46.946699 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 610/1224] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:39:46.952710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829fc04-9c85-4491-8992-6358dbc340a6 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:47.059931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829fc04-9c85-4491-8992-6358dbc340a6 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:47.097042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcc6c8-f50f-4903-af34-5221bfd78232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:47.097643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcc6c8-f50f-4903-af34-5221bfd78232 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:47.097921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcc6c8-f50f-4903-af34-5221bfd78232 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:47.098189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcc6c8-f50f-4903-af34-5221bfd78232 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:47.098846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcc6c8-f50f-4903-af34-5221bfd78232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:47.099147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcc6c8-f50f-4903-af34-5221bfd78232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:47.100493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcc6c8-f50f-4903-af34-5221bfd78232 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:47.112165 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 615/1225] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:47.117876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d2992-a613-40d9-b8bd-2040c718ac18 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:47.230325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:47.237505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d2992-a613-40d9-b8bd-2040c718ac18 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:47.277389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fddb4-84e5-4625-bcb6-cde6343255d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:47.278158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fddb4-84e5-4625-bcb6-cde6343255d6 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:47.278438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fddb4-84e5-4625-bcb6-cde6343255d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:47.278710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fddb4-84e5-4625-bcb6-cde6343255d6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:47.287265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fddb4-84e5-4625-bcb6-cde6343255d6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:47.288618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fddb4-84e5-4625-bcb6-cde6343255d6 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-113fddb4-84e5-4625-bcb6-cde6343255d6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:39:47.300179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:47.306301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:47.307328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:47.307328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:47.307328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:39:47.307328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:39:47.307328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:39:47.307328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:39:47.307328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:39:47.307328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:39:47.307328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:39:47.307328 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:39:47.307328 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 611/1226] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:39:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:39:47.307919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcc6c8-f50f-4903-af34-5221bfd78232 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:47.362153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:47.420693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcc6c8-f50f-4903-af34-5221bfd78232 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:47.462138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef721e-884a-4b4f-bdd2-ea6f7aa6790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:47.462763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef721e-884a-4b4f-bdd2-ea6f7aa6790f None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:47.463057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef721e-884a-4b4f-bdd2-ea6f7aa6790f None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:47.463493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef721e-884a-4b4f-bdd2-ea6f7aa6790f None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:47.464422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef721e-884a-4b4f-bdd2-ea6f7aa6790f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:47.464835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef721e-884a-4b4f-bdd2-ea6f7aa6790f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:47.466383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef721e-884a-4b4f-bdd2-ea6f7aa6790f None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:47.488396 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 616/1227] 10.222.0.70 () {56 vars in 1143 bytes} [Sun Aug 28 18:39:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:47.494957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fddb4-84e5-4625-bcb6-cde6343255d6 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:47.619328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fddb4-84e5-4625-bcb6-cde6343255d6 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:47.659468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d23686-9266-4575-9410-5b8fc448be52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:47.660100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23686-9266-4575-9410-5b8fc448be52 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:47.660378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23686-9266-4575-9410-5b8fc448be52 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:47.660649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d23686-9266-4575-9410-5b8fc448be52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:47.675277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d23686-9266-4575-9410-5b8fc448be52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:47.677312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d23686-9266-4575-9410-5b8fc448be52 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-79d23686-9266-4575-9410-5b8fc448be52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:39:47.696133 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:47.697318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:39:47.698233 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:39:47.698233 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:47.698233 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:39:47.698233 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 612/1228] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:39:47.704248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef721e-884a-4b4f-bdd2-ea6f7aa6790f None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:47.817797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef721e-884a-4b4f-bdd2-ea6f7aa6790f None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:47.820343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:47.854836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1ed8f-bb5b-403e-a44d-2a6445ba97ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:47.855504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1ed8f-bb5b-403e-a44d-2a6445ba97ad None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:47.855800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1ed8f-bb5b-403e-a44d-2a6445ba97ad None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:47.856182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1ed8f-bb5b-403e-a44d-2a6445ba97ad None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:47.856841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1ed8f-bb5b-403e-a44d-2a6445ba97ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:47.857163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1ed8f-bb5b-403e-a44d-2a6445ba97ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:47.859571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1ed8f-bb5b-403e-a44d-2a6445ba97ad None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:47.874490 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 617/1229] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:47.881348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d23686-9266-4575-9410-5b8fc448be52 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:47.892655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:48.003086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d23686-9266-4575-9410-5b8fc448be52 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:48.040889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8424bd-e57b-49ed-b1aa-a828f11b25fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:48.041569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8424bd-e57b-49ed-b1aa-a828f11b25fe None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:48.041891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8424bd-e57b-49ed-b1aa-a828f11b25fe None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:48.042182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8424bd-e57b-49ed-b1aa-a828f11b25fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:48.049617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8424bd-e57b-49ed-b1aa-a828f11b25fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:48.051153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8424bd-e57b-49ed-b1aa-a828f11b25fe None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-ae8424bd-e57b-49ed-b1aa-a828f11b25fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:39:48.064238 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:48.065263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:48.066161 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:39:48.066161 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:39:48.066161 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:39:48.066161 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:39:48.066161 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:39:48.066161 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:39:48.066161 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:39:48.066161 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:39:48.066161 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 613/1230] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:39:48.071342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1ed8f-bb5b-403e-a44d-2a6445ba97ad None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:48.191093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1ed8f-bb5b-403e-a44d-2a6445ba97ad None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:48.225371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1f454-2ad5-438f-83b4-46b48833eed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:48.226105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1f454-2ad5-438f-83b4-46b48833eed2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:48.226461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1f454-2ad5-438f-83b4-46b48833eed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:48.226906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1f454-2ad5-438f-83b4-46b48833eed2 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:48.227735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1f454-2ad5-438f-83b4-46b48833eed2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:48.228073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1f454-2ad5-438f-83b4-46b48833eed2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:48.229696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1f454-2ad5-438f-83b4-46b48833eed2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:48.247365 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 618/1231] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:48.255045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8424bd-e57b-49ed-b1aa-a828f11b25fe None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:48.331923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:48.372729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8424bd-e57b-49ed-b1aa-a828f11b25fe None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:48.412165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef441b2-47db-4c39-af4b-8c132fbb23c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:48.412828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef441b2-47db-4c39-af4b-8c132fbb23c2 None admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:48.413126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef441b2-47db-4c39-af4b-8c132fbb23c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:48.413390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef441b2-47db-4c39-af4b-8c132fbb23c2 None admin] PATH_INFO: `/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/0055d9c941024cdc894104f1345540fa/roles/57a3c5c9b870422597e89540164ee502` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:48.430641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef441b2-47db-4c39-af4b-8c132fbb23c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7555fde9e5404eb3b0dbfa04ee871f, user_id=0055d9c941024cdc894104f1345540fa, role_id=57a3c5c9b870422597e89540164ee502)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:48.432710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef441b2-47db-4c39-af4b-8c132fbb23c2 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:48.446344 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 614/1232] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:39:48 2022] PUT /identity/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/0055d9c941024cdc894104f1345540fa/roles/57a3c5c9b870422597e89540164ee502 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:39:50.475690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f566e6-91cd-4b1c-9ffe-1033d54ff22a None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:50.476276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f566e6-91cd-4b1c-9ffe-1033d54ff22a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:50.476276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f566e6-91cd-4b1c-9ffe-1033d54ff22a None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:50.477826 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 619/1233] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:39:50.483808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56e4ed-4ce2-414b-8af1-22f80960b5f4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:50.484262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56e4ed-4ce2-414b-8af1-22f80960b5f4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:50.484407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56e4ed-4ce2-414b-8af1-22f80960b5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:50.504060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bc56e4ed-4ce2-414b-8af1-22f80960b5f4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:50.505466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bc56e4ed-4ce2-414b-8af1-22f80960b5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:50.580408 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 615/1234] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:39:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:39:50.852803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f566e6-91cd-4b1c-9ffe-1033d54ff22a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:50.886445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:50.978794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f566e6-91cd-4b1c-9ffe-1033d54ff22a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:51.020418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15480f-459e-445f-b273-4cc3c5ae1188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:51.021077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15480f-459e-445f-b273-4cc3c5ae1188 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:51.021360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15480f-459e-445f-b273-4cc3c5ae1188 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:51.021635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15480f-459e-445f-b273-4cc3c5ae1188 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:51.033790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15480f-459e-445f-b273-4cc3c5ae1188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-fa15480f-459e-445f-b273-4cc3c5ae1188 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:39:51.039043 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:51.040220 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:51.041040 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:51.041040 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:51.041040 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:51.041040 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:51.041040 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:39:51.041040 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:39:51.041040 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:39:51.041040 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:39:51.041040 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:39:51.041040 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:39:51.041040 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 18:39:51.041040 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:39:51.041040 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 620/1235] 10.222.0.70 () {56 vars in 1102 bytes} [Sun Aug 28 18:39:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:39:51.047255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56e4ed-4ce2-414b-8af1-22f80960b5f4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:51.099805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:51.159103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56e4ed-4ce2-414b-8af1-22f80960b5f4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:51.195339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afb207-458a-4b96-a9cc-c695a0c41071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:51.195945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afb207-458a-4b96-a9cc-c695a0c41071 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:51.196240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afb207-458a-4b96-a9cc-c695a0c41071 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:51.196500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afb207-458a-4b96-a9cc-c695a0c41071 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:51.197158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afb207-458a-4b96-a9cc-c695a0c41071 None admin] RBAC: Adding query filter params (name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:51.197590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afb207-458a-4b96-a9cc-c695a0c41071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:51.198992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afb207-458a-4b96-a9cc-c695a0c41071 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:51.207482 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 616/1236] 10.222.0.70 () {56 vars in 1103 bytes} [Sun Aug 28 18:39:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:51.213378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15480f-459e-445f-b273-4cc3c5ae1188 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:51.318009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:51.336230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15480f-459e-445f-b273-4cc3c5ae1188 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:51.377306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1173e6-dea0-4d6a-af40-b5a2e478426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:51.378162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1173e6-dea0-4d6a-af40-b5a2e478426e None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:51.378448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1173e6-dea0-4d6a-af40-b5a2e478426e None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:51.378723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1173e6-dea0-4d6a-af40-b5a2e478426e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:51.389998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1173e6-dea0-4d6a-af40-b5a2e478426e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:51.391546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1173e6-dea0-4d6a-af40-b5a2e478426e None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-9f1173e6-dea0-4d6a-af40-b5a2e478426e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:39:51.409619 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:51.410949 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:39:51.412101 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:39:51.412101 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:51.412101 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:39:51.412101 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 621/1237] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:39:51.417115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afb207-458a-4b96-a9cc-c695a0c41071 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:51.530374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afb207-458a-4b96-a9cc-c695a0c41071 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:51.540459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:51.570906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7a99a-d37e-4713-93d7-0d67dbf5a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:51.571509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7a99a-d37e-4713-93d7-0d67dbf5a021 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:51.571782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7a99a-d37e-4713-93d7-0d67dbf5a021 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:51.572057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7a99a-d37e-4713-93d7-0d67dbf5a021 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:51.572795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7a99a-d37e-4713-93d7-0d67dbf5a021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:51.573300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7a99a-d37e-4713-93d7-0d67dbf5a021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:51.575041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7a99a-d37e-4713-93d7-0d67dbf5a021 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:51.588315 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 617/1238] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:51.595322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1173e6-dea0-4d6a-af40-b5a2e478426e None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:51.705141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1173e6-dea0-4d6a-af40-b5a2e478426e None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:51.740877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c313f70-acfe-4cbb-85a3-08251ccf1cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:51.741500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c313f70-acfe-4cbb-85a3-08251ccf1cb4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:51.741778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c313f70-acfe-4cbb-85a3-08251ccf1cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:51.742046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c313f70-acfe-4cbb-85a3-08251ccf1cb4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:51.744983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:51.751145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c313f70-acfe-4cbb-85a3-08251ccf1cb4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:51.752737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c313f70-acfe-4cbb-85a3-08251ccf1cb4 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-6c313f70-acfe-4cbb-85a3-08251ccf1cb4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:39:51.765383 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:51.766631 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:51.767942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:51.767942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:51.767942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:39:51.767942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:39:51.767942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:39:51.767942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:39:51.767942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:39:51.767942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:39:51.767942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:39:51.767942 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:39:51.767942 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 622/1239] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:39:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:39:51.772967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7a99a-d37e-4713-93d7-0d67dbf5a021 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:51.892561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7a99a-d37e-4713-93d7-0d67dbf5a021 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:51.934852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aa49a-f8b9-43e2-ab4c-82d15dd1163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:51.936196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa49a-f8b9-43e2-ab4c-82d15dd1163e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:51.936686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa49a-f8b9-43e2-ab4c-82d15dd1163e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:51.936979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa49a-f8b9-43e2-ab4c-82d15dd1163e None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:51.938087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70aa49a-f8b9-43e2-ab4c-82d15dd1163e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:51.938515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70aa49a-f8b9-43e2-ab4c-82d15dd1163e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:51.940467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70aa49a-f8b9-43e2-ab4c-82d15dd1163e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:51.963457 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 618/1240] 10.222.0.70 () {56 vars in 1143 bytes} [Sun Aug 28 18:39:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:51.972749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c313f70-acfe-4cbb-85a3-08251ccf1cb4 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:52.096171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c313f70-acfe-4cbb-85a3-08251ccf1cb4 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:52.131276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a268d30-cec3-481c-b0f7-d3792db13442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:52.131969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a268d30-cec3-481c-b0f7-d3792db13442 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:52.132237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a268d30-cec3-481c-b0f7-d3792db13442 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:52.132555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a268d30-cec3-481c-b0f7-d3792db13442 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:52.197812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:52.206259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a268d30-cec3-481c-b0f7-d3792db13442 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:52.207780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a268d30-cec3-481c-b0f7-d3792db13442 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:52.321388 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 623/1241] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:39:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:39:52.328661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aa49a-f8b9-43e2-ab4c-82d15dd1163e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:52.362350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:52.454347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aa49a-f8b9-43e2-ab4c-82d15dd1163e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:52.496810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71557-4aef-4e38-9fdf-8a75642ebeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:52.497562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71557-4aef-4e38-9fdf-8a75642ebeae None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:52.497853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71557-4aef-4e38-9fdf-8a75642ebeae None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:52.498661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71557-4aef-4e38-9fdf-8a75642ebeae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:52.510501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f71557-4aef-4e38-9fdf-8a75642ebeae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:52.512075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f71557-4aef-4e38-9fdf-8a75642ebeae None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-b3f71557-4aef-4e38-9fdf-8a75642ebeae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:39:52.528963 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:52.530356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:39:52.531712 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:39:52.531712 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:52.531712 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:39:52.531712 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 619/1242] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:39:52.536482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a268d30-cec3-481c-b0f7-d3792db13442 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:52.652740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:52.659454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a268d30-cec3-481c-b0f7-d3792db13442 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:52.693853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3647fb-cb75-462a-89d3-df8a629fcddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:52.694450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3647fb-cb75-462a-89d3-df8a629fcddb None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:52.694726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3647fb-cb75-462a-89d3-df8a629fcddb None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:52.695021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3647fb-cb75-462a-89d3-df8a629fcddb None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:52.695645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3647fb-cb75-462a-89d3-df8a629fcddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:52.695946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3647fb-cb75-462a-89d3-df8a629fcddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:52.697302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3647fb-cb75-462a-89d3-df8a629fcddb None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:52.709848 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 624/1243] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:52.716229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71557-4aef-4e38-9fdf-8a75642ebeae None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:52.802569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:52.828357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71557-4aef-4e38-9fdf-8a75642ebeae None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:52.868678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf11cde-4085-4ee2-bced-4c3f84742a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:52.869295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf11cde-4085-4ee2-bced-4c3f84742a94 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:52.869640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf11cde-4085-4ee2-bced-4c3f84742a94 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:52.870023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf11cde-4085-4ee2-bced-4c3f84742a94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:52.878552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf11cde-4085-4ee2-bced-4c3f84742a94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:52.880394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf11cde-4085-4ee2-bced-4c3f84742a94 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-ccf11cde-4085-4ee2-bced-4c3f84742a94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:39:52.894226 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:52.895275 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:52.896414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:39:52.896414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:39:52.896414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:39:52.896414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:39:52.896414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:39:52.896414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:39:52.896414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:39:52.896414 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:39:52.896414 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 620/1244] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:39:52.901985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3647fb-cb75-462a-89d3-df8a629fcddb None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:53.014314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3647fb-cb75-462a-89d3-df8a629fcddb None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:53.051284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3a511-8a6f-4905-af23-8361785a44ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:53.051892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3a511-8a6f-4905-af23-8361785a44ec None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:53.052176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3a511-8a6f-4905-af23-8361785a44ec None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:53.052449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3a511-8a6f-4905-af23-8361785a44ec None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:53.053134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3a511-8a6f-4905-af23-8361785a44ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:53.053450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3a511-8a6f-4905-af23-8361785a44ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:53.054882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3a511-8a6f-4905-af23-8361785a44ec None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:53.068540 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 625/1245] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:53.075132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf11cde-4085-4ee2-bced-4c3f84742a94 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:53.195151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf11cde-4085-4ee2-bced-4c3f84742a94 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:53.241131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b5532-20ce-4933-9857-2a77b29c25f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:53.241745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b5532-20ce-4933-9857-2a77b29c25f7 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:53.242022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b5532-20ce-4933-9857-2a77b29c25f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:53.242293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b5532-20ce-4933-9857-2a77b29c25f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:53.243233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b5532-20ce-4933-9857-2a77b29c25f7 None admin] RBAC: Adding query filter params (role.id=57a3c5c9b870422597e89540164ee502, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=0055d9c941024cdc894104f1345540fa) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:53.243616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b5532-20ce-4933-9857-2a77b29c25f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:53.245187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b5532-20ce-4933-9857-2a77b29c25f7 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:53.253620 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 621/1246] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:39:53 2022] GET /identity/v3/role_assignments?user.id=0055d9c941024cdc894104f1345540fa&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=57a3c5c9b870422597e89540164ee502 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:55.387624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68e97-48ab-447a-a6f5-afbdeaebd74c None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:55.388192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68e97-48ab-447a-a6f5-afbdeaebd74c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:55.388192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68e97-48ab-447a-a6f5-afbdeaebd74c None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:55.390391 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 626/1247] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:39:55.396845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d5245-32f7-41a7-8997-631965832c33 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:55.397536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d5245-32f7-41a7-8997-631965832c33 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:55.397536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d5245-32f7-41a7-8997-631965832c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:55.405518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:55.421288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-aa3d5245-32f7-41a7-8997-631965832c33 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:39:55.422674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aa3d5245-32f7-41a7-8997-631965832c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:39:55.505632 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 622/1248] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:39:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:39:55.804347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68e97-48ab-447a-a6f5-afbdeaebd74c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:55.825007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:55.930153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68e97-48ab-447a-a6f5-afbdeaebd74c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:55.970818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5dd18-0414-4195-8aea-bf6a1026e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:55.971436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5dd18-0414-4195-8aea-bf6a1026e60d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:55.971739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5dd18-0414-4195-8aea-bf6a1026e60d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:55.972037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5dd18-0414-4195-8aea-bf6a1026e60d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:55.983923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5dd18-0414-4195-8aea-bf6a1026e60d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-dee5dd18-0414-4195-8aea-bf6a1026e60d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:39:55.989762 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:55.990720 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:55.991605 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:55.991605 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:55.991605 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:55.991605 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:55.991605 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:39:55.991605 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:39:55.991605 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:39:55.991605 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:39:55.991605 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:39:55.991605 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:39:55.991605 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:39:55.991605 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:39:55.991605 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 627/1249] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:39:55.997486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d5245-32f7-41a7-8997-631965832c33 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:56.115266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d5245-32f7-41a7-8997-631965832c33 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:56.148770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:56.154881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f8294-73d9-4cc9-9b66-ebf01178db82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:56.155508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f8294-73d9-4cc9-9b66-ebf01178db82 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:56.155795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f8294-73d9-4cc9-9b66-ebf01178db82 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:56.156072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f8294-73d9-4cc9-9b66-ebf01178db82 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:56.156749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f8294-73d9-4cc9-9b66-ebf01178db82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:56.157054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f8294-73d9-4cc9-9b66-ebf01178db82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:56.158471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f8294-73d9-4cc9-9b66-ebf01178db82 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:56.169049 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 623/1250] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:39:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:56.175789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5dd18-0414-4195-8aea-bf6a1026e60d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:56.261696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:56.288477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5dd18-0414-4195-8aea-bf6a1026e60d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:56.324931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de208a-c802-48a3-b785-8411570dc94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:56.325557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de208a-c802-48a3-b785-8411570dc94d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:56.325842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de208a-c802-48a3-b785-8411570dc94d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:56.326196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de208a-c802-48a3-b785-8411570dc94d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:56.337095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de208a-c802-48a3-b785-8411570dc94d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:56.338551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de208a-c802-48a3-b785-8411570dc94d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-c9de208a-c802-48a3-b785-8411570dc94d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:39:56.355508 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:56.362547 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:39:56.363792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:39:56.363792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:56.363792 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:39:56.363792 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 628/1251] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:39:56.364073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f8294-73d9-4cc9-9b66-ebf01178db82 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:56.474705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f8294-73d9-4cc9-9b66-ebf01178db82 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:56.511150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d053d-cbbc-4d61-967c-8fb387d12e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:56.511696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d053d-cbbc-4d61-967c-8fb387d12e52 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:56.511992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d053d-cbbc-4d61-967c-8fb387d12e52 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:56.512285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d053d-cbbc-4d61-967c-8fb387d12e52 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:56.512883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d053d-cbbc-4d61-967c-8fb387d12e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:56.513184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d053d-cbbc-4d61-967c-8fb387d12e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:56.514828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d053d-cbbc-4d61-967c-8fb387d12e52 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:56.526517 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 624/1252] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:39:56.534172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de208a-c802-48a3-b785-8411570dc94d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:56.649912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de208a-c802-48a3-b785-8411570dc94d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:56.681209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:56.689924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb92da-2c3d-4b1b-9925-b489b87a875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:56.690556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb92da-2c3d-4b1b-9925-b489b87a875b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:56.690871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb92da-2c3d-4b1b-9925-b489b87a875b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:56.691148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb92da-2c3d-4b1b-9925-b489b87a875b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:56.698548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb92da-2c3d-4b1b-9925-b489b87a875b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:56.700031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb92da-2c3d-4b1b-9925-b489b87a875b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-04eb92da-2c3d-4b1b-9925-b489b87a875b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:39:56.711468 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:56.712554 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:56.718516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:56.718516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:56.718516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:39:56.718516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:39:56.718516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:39:56.718516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:39:56.718516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:39:56.718516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:39:56.718516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:39:56.718516 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:39:56.718516 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 629/1253] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:39:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:39:56.719414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d053d-cbbc-4d61-967c-8fb387d12e52 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:56.777896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:56.831120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d053d-cbbc-4d61-967c-8fb387d12e52 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:56.874479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ae8d2-237d-40d4-aa56-280cf86e2dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:56.875126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ae8d2-237d-40d4-aa56-280cf86e2dbe None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:56.875422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ae8d2-237d-40d4-aa56-280cf86e2dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:56.875675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ae8d2-237d-40d4-aa56-280cf86e2dbe None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:56.876410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ae8d2-237d-40d4-aa56-280cf86e2dbe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:56.876713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ae8d2-237d-40d4-aa56-280cf86e2dbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:56.878142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ae8d2-237d-40d4-aa56-280cf86e2dbe None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:56.897460 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 625/1254] 10.222.0.70 () {56 vars in 1143 bytes} [Sun Aug 28 18:39:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:56.904106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb92da-2c3d-4b1b-9925-b489b87a875b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:57.017698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb92da-2c3d-4b1b-9925-b489b87a875b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:57.055913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc16e97-07ff-43d3-ba98-4e50bca7f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:57.056425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc16e97-07ff-43d3-ba98-4e50bca7f57a None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:57.056806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc16e97-07ff-43d3-ba98-4e50bca7f57a None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:57.057184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc16e97-07ff-43d3-ba98-4e50bca7f57a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:57.117290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:57.130479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc16e97-07ff-43d3-ba98-4e50bca7f57a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:57.131985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc16e97-07ff-43d3-ba98-4e50bca7f57a None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:57.245139 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 630/1255] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:39:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:39:57.246879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ae8d2-237d-40d4-aa56-280cf86e2dbe None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:57.367456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ae8d2-237d-40d4-aa56-280cf86e2dbe None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:57.382592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:57.404721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763f81d-86d2-4d48-927e-5a074b53a1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:57.405308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763f81d-86d2-4d48-927e-5a074b53a1d5 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:57.405592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763f81d-86d2-4d48-927e-5a074b53a1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:57.405865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763f81d-86d2-4d48-927e-5a074b53a1d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:57.416217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763f81d-86d2-4d48-927e-5a074b53a1d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:57.417847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763f81d-86d2-4d48-927e-5a074b53a1d5 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-4763f81d-86d2-4d48-927e-5a074b53a1d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:39:57.435944 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:57.437207 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:39:57.438257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:39:57.438257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:39:57.438257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:39:57.438257 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 626/1256] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:39:57.443407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc16e97-07ff-43d3-ba98-4e50bca7f57a None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:57.539614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:57.554628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc16e97-07ff-43d3-ba98-4e50bca7f57a None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:57.593172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4bbfc-057a-4737-9f2f-964aca8c040b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:57.593839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4bbfc-057a-4737-9f2f-964aca8c040b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:57.594153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4bbfc-057a-4737-9f2f-964aca8c040b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:57.594451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4bbfc-057a-4737-9f2f-964aca8c040b None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:57.595126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4bbfc-057a-4737-9f2f-964aca8c040b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:57.595432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4bbfc-057a-4737-9f2f-964aca8c040b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:57.596783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4bbfc-057a-4737-9f2f-964aca8c040b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:57.608897 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 631/1257] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:57.614666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763f81d-86d2-4d48-927e-5a074b53a1d5 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:57.726980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763f81d-86d2-4d48-927e-5a074b53a1d5 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:57.765645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0276803-d902-4cf2-8eb4-6b29697f7c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:57.766496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0276803-d902-4cf2-8eb4-6b29697f7c2d None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:57.766729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0276803-d902-4cf2-8eb4-6b29697f7c2d None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:57.767038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0276803-d902-4cf2-8eb4-6b29697f7c2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:57.774402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0276803-d902-4cf2-8eb4-6b29697f7c2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:57.776086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0276803-d902-4cf2-8eb4-6b29697f7c2d None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-d0276803-d902-4cf2-8eb4-6b29697f7c2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:39:57.788488 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:39:57.789533 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:39:57.790731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:39:57.790731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:39:57.790731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:39:57.790731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:39:57.790731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:39:57.790731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:39:57.790731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:39:57.790731 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:39:57.795015 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 627/1258] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:39:57.796427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4bbfc-057a-4737-9f2f-964aca8c040b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:57.924699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4bbfc-057a-4737-9f2f-964aca8c040b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:57.969811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66007586-4444-4aac-8472-54b24a6e6590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:57.970424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66007586-4444-4aac-8472-54b24a6e6590 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:57.970708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66007586-4444-4aac-8472-54b24a6e6590 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:57.971026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66007586-4444-4aac-8472-54b24a6e6590 None admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:57.971720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66007586-4444-4aac-8472-54b24a6e6590 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:57.972030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66007586-4444-4aac-8472-54b24a6e6590 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:57.973619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66007586-4444-4aac-8472-54b24a6e6590 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:57.989209 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 632/1259] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:39:57.995753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0276803-d902-4cf2-8eb4-6b29697f7c2d None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:39:58.024845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:39:58.106327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0276803-d902-4cf2-8eb4-6b29697f7c2d None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:39:58.143355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef19959-3ec3-4279-8a33-b45d27672521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:39:58.143957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19959-3ec3-4279-8a33-b45d27672521 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:39:58.144235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19959-3ec3-4279-8a33-b45d27672521 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:39:58.144600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef19959-3ec3-4279-8a33-b45d27672521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:39:58.145294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef19959-3ec3-4279-8a33-b45d27672521 None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=0055d9c941024cdc894104f1345540fa) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:39:58.145686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef19959-3ec3-4279-8a33-b45d27672521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:39:58.147287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef19959-3ec3-4279-8a33-b45d27672521 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:39:58.153546 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 628/1260] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:39:57 2022] GET /identity/v3/role_assignments?user.id=0055d9c941024cdc894104f1345540fa&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:00.070849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f01524-75d2-4746-9660-57026b5c6856 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:00.071400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f01524-75d2-4746-9660-57026b5c6856 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:00.071400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f01524-75d2-4746-9660-57026b5c6856 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:00.072781 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 633/1261] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:40:00.078443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cac5cc-7222-4c47-930f-ea79a5d5c198 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:00.078895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cac5cc-7222-4c47-930f-ea79a5d5c198 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:00.079042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cac5cc-7222-4c47-930f-ea79a5d5c198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:00.097396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-13cac5cc-7222-4c47-930f-ea79a5d5c198 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:00.098618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-13cac5cc-7222-4c47-930f-ea79a5d5c198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:00.164947 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 629/1262] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:40:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:40:00.433830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f01524-75d2-4746-9660-57026b5c6856 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:00.444759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:00.533279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f01524-75d2-4746-9660-57026b5c6856 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:00.566577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82462a66-d13a-449c-8c5c-17d1bf7d2650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:00.567229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82462a66-d13a-449c-8c5c-17d1bf7d2650 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:00.567513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82462a66-d13a-449c-8c5c-17d1bf7d2650 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:00.567785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82462a66-d13a-449c-8c5c-17d1bf7d2650 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:00.578322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82462a66-d13a-449c-8c5c-17d1bf7d2650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-82462a66-d13a-449c-8c5c-17d1bf7d2650 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:40:00.583134 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:40:00.584215 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:40:00.585441 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:40:00.585441 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:40:00.585441 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:40:00.585441 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:40:00.585441 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:40:00.585441 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:40:00.585441 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:40:00.585441 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:40:00.585441 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:40:00.585441 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:40:00.585441 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:40:00.585441 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:40:00.585441 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 634/1263] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:40:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:40:00.590086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cac5cc-7222-4c47-930f-ea79a5d5c198 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:00.608764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:00.687648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cac5cc-7222-4c47-930f-ea79a5d5c198 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:00.721321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9e908-c05f-46a4-969b-1b322493f618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:00.721921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9e908-c05f-46a4-969b-1b322493f618 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:00.722202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9e908-c05f-46a4-969b-1b322493f618 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:00.722477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9e908-c05f-46a4-969b-1b322493f618 None admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:00.723164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9e908-c05f-46a4-969b-1b322493f618 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:00.723469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9e908-c05f-46a4-969b-1b322493f618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:00.724830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9e908-c05f-46a4-969b-1b322493f618 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:00.732658 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 630/1264] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:40:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:00.738392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82462a66-d13a-449c-8c5c-17d1bf7d2650 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:00.805564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:00.838500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82462a66-d13a-449c-8c5c-17d1bf7d2650 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:00.877886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945abe0e-e52c-4000-a4c6-b68ebc916809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:00.878619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945abe0e-e52c-4000-a4c6-b68ebc916809 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:00.879034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945abe0e-e52c-4000-a4c6-b68ebc916809 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:00.879441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945abe0e-e52c-4000-a4c6-b68ebc916809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:00.894214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945abe0e-e52c-4000-a4c6-b68ebc916809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:00.896111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945abe0e-e52c-4000-a4c6-b68ebc916809 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-945abe0e-e52c-4000-a4c6-b68ebc916809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:40:00.914577 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:40:00.916106 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:40:00.917406 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:40:00.917406 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:40:00.917406 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:40:00.917406 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 635/1265] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:40:00.922719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9e908-c05f-46a4-969b-1b322493f618 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:01.009192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:01.028034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9e908-c05f-46a4-969b-1b322493f618 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:01.061168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa41d0-6b66-42c5-bdd9-d9926e013947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:01.061767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa41d0-6b66-42c5-bdd9-d9926e013947 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:01.062043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa41d0-6b66-42c5-bdd9-d9926e013947 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:01.062309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa41d0-6b66-42c5-bdd9-d9926e013947 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:01.062959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa41d0-6b66-42c5-bdd9-d9926e013947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:01.063258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa41d0-6b66-42c5-bdd9-d9926e013947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:01.064608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa41d0-6b66-42c5-bdd9-d9926e013947 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:01.075851 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 631/1266] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:01.081499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945abe0e-e52c-4000-a4c6-b68ebc916809 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:01.179871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945abe0e-e52c-4000-a4c6-b68ebc916809 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:01.199073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:01.213405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee3228-ba26-457e-bec3-9c66d6d4de3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:01.214019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee3228-ba26-457e-bec3-9c66d6d4de3b None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:01.214299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee3228-ba26-457e-bec3-9c66d6d4de3b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:01.214573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee3228-ba26-457e-bec3-9c66d6d4de3b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:01.222288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee3228-ba26-457e-bec3-9c66d6d4de3b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:01.223751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee3228-ba26-457e-bec3-9c66d6d4de3b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-34ee3228-ba26-457e-bec3-9c66d6d4de3b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:40:01.235264 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:40:01.236364 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:40:01.237396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:40:01.237396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:40:01.237396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:40:01.237396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:40:01.237396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:40:01.237396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:40:01.237396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:40:01.237396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:40:01.237396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:40:01.237396 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:40:01.237396 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 636/1267] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:40:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 18:40:01.242079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa41d0-6b66-42c5-bdd9-d9926e013947 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:01.341188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa41d0-6b66-42c5-bdd9-d9926e013947 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:01.375687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea6c3a-0839-47e3-a9a2-687b39dbe2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:01.376285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea6c3a-0839-47e3-a9a2-687b39dbe2a3 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:01.376566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea6c3a-0839-47e3-a9a2-687b39dbe2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:01.376838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea6c3a-0839-47e3-a9a2-687b39dbe2a3 None admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:01.377560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea6c3a-0839-47e3-a9a2-687b39dbe2a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:01.377869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea6c3a-0839-47e3-a9a2-687b39dbe2a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:01.379327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea6c3a-0839-47e3-a9a2-687b39dbe2a3 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:01.387947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:01.396967 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 632/1268] 10.222.0.70 () {56 vars in 1143 bytes} [Sun Aug 28 18:40:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:01.402585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee3228-ba26-457e-bec3-9c66d6d4de3b None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:01.497894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee3228-ba26-457e-bec3-9c66d6d4de3b None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:01.530401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5fea3-2637-4caa-a808-4aa0d0098b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:01.531041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5fea3-2637-4caa-a808-4aa0d0098b44 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:01.531305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5fea3-2637-4caa-a808-4aa0d0098b44 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:01.531573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5fea3-2637-4caa-a808-4aa0d0098b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:01.541469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5fea3-2637-4caa-a808-4aa0d0098b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:01.542917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5fea3-2637-4caa-a808-4aa0d0098b44 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-e5a5fea3-2637-4caa-a808-4aa0d0098b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:40:01.556671 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:40:01.557771 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:40:01.558728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:40:01.558728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:40:01.558728 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:40:01.558728 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 637/1269] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:40:01.563942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea6c3a-0839-47e3-a9a2-687b39dbe2a3 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:01.662557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea6c3a-0839-47e3-a9a2-687b39dbe2a3 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:01.695651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bc082-92e4-477c-b670-721b5170bdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:01.696247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bc082-92e4-477c-b670-721b5170bdd0 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:01.696523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bc082-92e4-477c-b670-721b5170bdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:01.696792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bc082-92e4-477c-b670-721b5170bdd0 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:01.697424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bc082-92e4-477c-b670-721b5170bdd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:01.697728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bc082-92e4-477c-b670-721b5170bdd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:01.699105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bc082-92e4-477c-b670-721b5170bdd0 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:01.710524 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 633/1270] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:01.716180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5fea3-2637-4caa-a808-4aa0d0098b44 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:01.748021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:01.815367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5fea3-2637-4caa-a808-4aa0d0098b44 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:01.847843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815fbd2-69e5-41fa-80b8-847d9b16a1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:01.848456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815fbd2-69e5-41fa-80b8-847d9b16a1c2 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:01.848736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815fbd2-69e5-41fa-80b8-847d9b16a1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:01.849010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815fbd2-69e5-41fa-80b8-847d9b16a1c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:01.855338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815fbd2-69e5-41fa-80b8-847d9b16a1c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:01.856766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815fbd2-69e5-41fa-80b8-847d9b16a1c2 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-7815fbd2-69e5-41fa-80b8-847d9b16a1c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:40:01.869877 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:40:01.870874 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:40:01.871826 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:40:01.871826 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:40:01.871826 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:40:01.871826 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:40:01.871826 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:40:01.871826 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:40:01.871826 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:40:01.871826 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:40:01.871826 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 638/1271] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:40:01.878149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bc082-92e4-477c-b670-721b5170bdd0 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:01.939056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:01.980241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bc082-92e4-477c-b670-721b5170bdd0 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:02.013908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2ff92-8ad8-454c-a3cf-4b6c05fcdb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:02.014507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2ff92-8ad8-454c-a3cf-4b6c05fcdb21 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.014814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2ff92-8ad8-454c-a3cf-4b6c05fcdb21 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.015091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2ff92-8ad8-454c-a3cf-4b6c05fcdb21 None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.015779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2ff92-8ad8-454c-a3cf-4b6c05fcdb21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:02.016087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2ff92-8ad8-454c-a3cf-4b6c05fcdb21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:02.017519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2ff92-8ad8-454c-a3cf-4b6c05fcdb21 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:02.030117 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 634/1272] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:02.036343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815fbd2-69e5-41fa-80b8-847d9b16a1c2 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:02.123554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:02.132346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815fbd2-69e5-41fa-80b8-847d9b16a1c2 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:02.165330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a087e8-048a-43b5-aeee-1ac9462dfc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:02.165972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a087e8-048a-43b5-aeee-1ac9462dfc66 None admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:02.166256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a087e8-048a-43b5-aeee-1ac9462dfc66 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:02.166527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a087e8-048a-43b5-aeee-1ac9462dfc66 None admin] PATH_INFO: `/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/0055d9c941024cdc894104f1345540fa/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:02.168409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a087e8-048a-43b5-aeee-1ac9462dfc66 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea7555fde9e5404eb3b0dbfa04ee871f, user_id=0055d9c941024cdc894104f1345540fa, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:02.170103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a087e8-048a-43b5-aeee-1ac9462dfc66 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:02.182684 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 639/1273] 10.222.0.70 () {58 vars in 1439 bytes} [Sun Aug 28 18:40:02 2022] PUT /identity/v3/projects/ea7555fde9e5404eb3b0dbfa04ee871f/users/0055d9c941024cdc894104f1345540fa/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:40:04.141241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26527410-5ea0-42cf-b530-20b7c1db1e34 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:04.141791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26527410-5ea0-42cf-b530-20b7c1db1e34 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:04.141887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26527410-5ea0-42cf-b530-20b7c1db1e34 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:04.143219 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 635/1274] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:40:04.148376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74209b57-4c10-412d-bf47-41a0b76bf182 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:04.148813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74209b57-4c10-412d-bf47-41a0b76bf182 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:04.148929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74209b57-4c10-412d-bf47-41a0b76bf182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:04.167106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-74209b57-4c10-412d-bf47-41a0b76bf182 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:04.168315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-74209b57-4c10-412d-bf47-41a0b76bf182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:04.235341 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 640/1275] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:40:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:40:04.511338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26527410-5ea0-42cf-b530-20b7c1db1e34 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:04.616534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26527410-5ea0-42cf-b530-20b7c1db1e34 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:04.634069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:04.652354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f41c77-0e72-4b58-bf81-b44a9e85ccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:04.652981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f41c77-0e72-4b58-bf81-b44a9e85ccc3 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:04.653264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f41c77-0e72-4b58-bf81-b44a9e85ccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:04.653542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f41c77-0e72-4b58-bf81-b44a9e85ccc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:04.663584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f41c77-0e72-4b58-bf81-b44a9e85ccc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-e9f41c77-0e72-4b58-bf81-b44a9e85ccc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 18:40:04.668325 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:40:04.669580 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:40:04.670654 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:40:04.670654 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:40:04.670654 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:40:04.670654 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:40:04.670654 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 18:40:04.670654 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 18:40:04.670654 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 18:40:04.670654 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 18:40:04.670654 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 18:40:04.670654 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 18:40:04.670654 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 18:40:04.670654 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:40:04.670654 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 636/1276] 10.222.0.70 () {56 vars in 1096 bytes} [Sun Aug 28 18:40:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:40:04.675675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74209b57-4c10-412d-bf47-41a0b76bf182 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:04.755175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:04.773325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74209b57-4c10-412d-bf47-41a0b76bf182 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:04.805427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081d14f-113b-41aa-a402-47ab1b31a0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:04.806275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081d14f-113b-41aa-a402-47ab1b31a0a6 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:04.806555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081d14f-113b-41aa-a402-47ab1b31a0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:04.806849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081d14f-113b-41aa-a402-47ab1b31a0a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:04.807497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081d14f-113b-41aa-a402-47ab1b31a0a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:04.807799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081d14f-113b-41aa-a402-47ab1b31a0a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:04.809140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081d14f-113b-41aa-a402-47ab1b31a0a6 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:04.817434 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 641/1277] 10.222.0.70 () {56 vars in 1099 bytes} [Sun Aug 28 18:40:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:04.823145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f41c77-0e72-4b58-bf81-b44a9e85ccc3 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:04.934318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f41c77-0e72-4b58-bf81-b44a9e85ccc3 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:04.967892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304e0a3-0c04-4757-9f8c-b94f049d5b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:04.968510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304e0a3-0c04-4757-9f8c-b94f049d5b2e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:04.968791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304e0a3-0c04-4757-9f8c-b94f049d5b2e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:04.969064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304e0a3-0c04-4757-9f8c-b94f049d5b2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:04.979150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304e0a3-0c04-4757-9f8c-b94f049d5b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:04.980588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304e0a3-0c04-4757-9f8c-b94f049d5b2e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-3304e0a3-0c04-4757-9f8c-b94f049d5b2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:40:04.995690 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:40:04.996789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:40:04.998601 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:40:04.998601 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:40:04.998601 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:40:04.998601 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 637/1278] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:40:05.003739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081d14f-113b-41aa-a402-47ab1b31a0a6 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:05.099474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081d14f-113b-41aa-a402-47ab1b31a0a6 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:05.132116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf8d38-6c85-4278-8ba2-5405c39d8ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:05.132705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf8d38-6c85-4278-8ba2-5405c39d8ce9 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:05.132985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf8d38-6c85-4278-8ba2-5405c39d8ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:05.133257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf8d38-6c85-4278-8ba2-5405c39d8ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:05.133883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf8d38-6c85-4278-8ba2-5405c39d8ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:05.134185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf8d38-6c85-4278-8ba2-5405c39d8ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:05.135562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf8d38-6c85-4278-8ba2-5405c39d8ce9 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:05.146984 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 642/1279] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:05.152605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304e0a3-0c04-4757-9f8c-b94f049d5b2e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:05.184179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:05.254355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304e0a3-0c04-4757-9f8c-b94f049d5b2e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:05.286470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab14c4d-180d-432f-94ff-38f297ae02a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:05.287110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab14c4d-180d-432f-94ff-38f297ae02a8 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:05.287388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab14c4d-180d-432f-94ff-38f297ae02a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:05.287652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab14c4d-180d-432f-94ff-38f297ae02a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:05.295300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab14c4d-180d-432f-94ff-38f297ae02a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:05.296732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab14c4d-180d-432f-94ff-38f297ae02a8 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-eab14c4d-180d-432f-94ff-38f297ae02a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 18:40:05.307787 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:40:05.308893 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:40:05.310002 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:40:05.310002 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:40:05.310002 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 18:40:05.310002 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 18:40:05.310002 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 18:40:05.310002 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 18:40:05.310002 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 18:40:05.310002 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 18:40:05.310002 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 18:40:05.310002 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:40:05.310002 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 638/1280] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:40:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:40:05.315198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf8d38-6c85-4278-8ba2-5405c39d8ce9 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:05.318885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:05.411185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf8d38-6c85-4278-8ba2-5405c39d8ce9 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:05.444567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd34d4-7d99-44b9-8de3-e490b272516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:05.445162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd34d4-7d99-44b9-8de3-e490b272516c None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:05.445439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd34d4-7d99-44b9-8de3-e490b272516c None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:05.445706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd34d4-7d99-44b9-8de3-e490b272516c None admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:05.446416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd34d4-7d99-44b9-8de3-e490b272516c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:05.446719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd34d4-7d99-44b9-8de3-e490b272516c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:05.448163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd34d4-7d99-44b9-8de3-e490b272516c None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:05.464378 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 643/1281] 10.222.0.70 () {56 vars in 1143 bytes} [Sun Aug 28 18:40:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:05.470724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab14c4d-180d-432f-94ff-38f297ae02a8 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:05.559100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:05.569427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab14c4d-180d-432f-94ff-38f297ae02a8 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:05.602360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791070b-996d-44bd-b15c-2dbef9218ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:05.602982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791070b-996d-44bd-b15c-2dbef9218ad4 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:05.603258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791070b-996d-44bd-b15c-2dbef9218ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:05.603525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791070b-996d-44bd-b15c-2dbef9218ad4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:05.668910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791070b-996d-44bd-b15c-2dbef9218ad4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:05.670405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791070b-996d-44bd-b15c-2dbef9218ad4 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:05.757707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:05.768669 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 639/1282] 10.222.0.70 () {58 vars in 1282 bytes} [Sun Aug 28 18:40:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 18:40:05.774458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd34d4-7d99-44b9-8de3-e490b272516c None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:05.836143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:05.877512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd34d4-7d99-44b9-8de3-e490b272516c None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:05.912238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4251d-0255-483a-a67c-31ca1600a1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:05.912861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4251d-0255-483a-a67c-31ca1600a1aa None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:05.913142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4251d-0255-483a-a67c-31ca1600a1aa None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:05.913422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4251d-0255-483a-a67c-31ca1600a1aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:05.923667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4251d-0255-483a-a67c-31ca1600a1aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:05.925055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4251d-0255-483a-a67c-31ca1600a1aa None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-bdd4251d-0255-483a-a67c-31ca1600a1aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 18:40:05.939600 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:40:05.940673 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 18:40:05.941705 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 18:40:05.941705 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 18:40:05.941705 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:40:05.941705 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 644/1283] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:40:05.946494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791070b-996d-44bd-b15c-2dbef9218ad4 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:06.048086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791070b-996d-44bd-b15c-2dbef9218ad4 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:06.081894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab256a75-b993-4f86-a66d-f013f953dab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:06.082489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab256a75-b993-4f86-a66d-f013f953dab1 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:06.082792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab256a75-b993-4f86-a66d-f013f953dab1 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:06.083068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab256a75-b993-4f86-a66d-f013f953dab1 None admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:06.083699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab256a75-b993-4f86-a66d-f013f953dab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:06.083998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab256a75-b993-4f86-a66d-f013f953dab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:06.085352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab256a75-b993-4f86-a66d-f013f953dab1 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:06.096660 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 640/1284] 10.222.0.70 () {56 vars in 1109 bytes} [Sun Aug 28 18:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:06.102288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4251d-0255-483a-a67c-31ca1600a1aa None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:06.205242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4251d-0255-483a-a67c-31ca1600a1aa None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:06.219912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:06.242414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19066cc6-283d-412c-acfc-ccb442e1d228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:06.243065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19066cc6-283d-412c-acfc-ccb442e1d228 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:06.243344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19066cc6-283d-412c-acfc-ccb442e1d228 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:06.243615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19066cc6-283d-412c-acfc-ccb442e1d228 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:06.250403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19066cc6-283d-412c-acfc-ccb442e1d228 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:06.251873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19066cc6-283d-412c-acfc-ccb442e1d228 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-19066cc6-283d-412c-acfc-ccb442e1d228 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 18:40:06.262916 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:40:06.264592 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:40:06.265682 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 18:40:06.265682 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 18:40:06.265682 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 18:40:06.265682 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 18:40:06.265682 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 18:40:06.265682 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 18:40:06.265682 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 18:40:06.265682 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 18:40:06.265682 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 645/1285] 10.222.0.70 () {56 vars in 1111 bytes} [Sun Aug 28 18:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:40:06.273164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab256a75-b993-4f86-a66d-f013f953dab1 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:06.333215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:06.390063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab256a75-b993-4f86-a66d-f013f953dab1 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:06.429746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5e772-b9cf-420f-ac99-3d3bb553c400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:06.430354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5e772-b9cf-420f-ac99-3d3bb553c400 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:06.430921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5e772-b9cf-420f-ac99-3d3bb553c400 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:06.431199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5e772-b9cf-420f-ac99-3d3bb553c400 None admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:06.431889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5e772-b9cf-420f-ac99-3d3bb553c400 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:06.432195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5e772-b9cf-420f-ac99-3d3bb553c400 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:06.433622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5e772-b9cf-420f-ac99-3d3bb553c400 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:06.445797 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 641/1286] 10.222.0.70 () {56 vars in 1148 bytes} [Sun Aug 28 18:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:06.452377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19066cc6-283d-412c-acfc-ccb442e1d228 None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:06.558088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19066cc6-283d-412c-acfc-ccb442e1d228 None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:06.594804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec39de5-9986-4857-b050-aad7689a3bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:06.595498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec39de5-9986-4857-b050-aad7689a3bb4 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:06.595939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec39de5-9986-4857-b050-aad7689a3bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:06.596212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec39de5-9986-4857-b050-aad7689a3bb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:06.596945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec39de5-9986-4857-b050-aad7689a3bb4 None admin] RBAC: Adding query filter params (role.id=9f40fd4221dd48e99cfdb0def78f267a, scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f, user.id=0055d9c941024cdc894104f1345540fa) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:06.597243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec39de5-9986-4857-b050-aad7689a3bb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:06.598655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec39de5-9986-4857-b050-aad7689a3bb4 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:06.604713 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 646/1287] 10.222.0.70 () {56 vars in 1374 bytes} [Sun Aug 28 18:40:06 2022] GET /identity/v3/role_assignments?user.id=0055d9c941024cdc894104f1345540fa&scope.project.id=ea7555fde9e5404eb3b0dbfa04ee871f&role.id=9f40fd4221dd48e99cfdb0def78f267a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:08.546156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ae7f9-bb93-4236-9d6b-47d73a00d9f4 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:08.546712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ae7f9-bb93-4236-9d6b-47d73a00d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:08.546712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ae7f9-bb93-4236-9d6b-47d73a00d9f4 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:08.548068 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 642/1288] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:40:08.553267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b4bb7-d9e7-4e02-92cb-ce55432dc49e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:08.553670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b4bb7-d9e7-4e02-92cb-ce55432dc49e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:08.553813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b4bb7-d9e7-4e02-92cb-ce55432dc49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:08.571996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3a3b4bb7-d9e7-4e02-92cb-ce55432dc49e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:08.573175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3a3b4bb7-d9e7-4e02-92cb-ce55432dc49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:08.602197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:08.639613 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 647/1289] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:40:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:40:08.907648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ae7f9-bb93-4236-9d6b-47d73a00d9f4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:09.017792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ae7f9-bb93-4236-9d6b-47d73a00d9f4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:09.029934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:09.053766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd170f-45d6-42c1-91d4-431e01a4f054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:09.054389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd170f-45d6-42c1-91d4-431e01a4f054 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:09.054671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd170f-45d6-42c1-91d4-431e01a4f054 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:09.054974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd170f-45d6-42c1-91d4-431e01a4f054 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:09.055817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd170f-45d6-42c1-91d4-431e01a4f054 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:09.057186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd170f-45d6-42c1-91d4-431e01a4f054 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-31bd170f-45d6-42c1-91d4-431e01a4f054 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:09.066321 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:40:09.067547 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:40:09.068396 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 643/1290] 10.222.0.70 () {56 vars in 1117 bytes} [Sun Aug 28 18:40:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:40:09.073406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b4bb7-d9e7-4e02-92cb-ce55432dc49e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:09.169730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b4bb7-d9e7-4e02-92cb-ce55432dc49e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:09.203205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9e652-7f01-4208-a24e-fcaea6f035a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:09.203796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e652-7f01-4208-a24e-fcaea6f035a9 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:09.204075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e652-7f01-4208-a24e-fcaea6f035a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:09.204347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9e652-7f01-4208-a24e-fcaea6f035a9 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:09.204961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e652-7f01-4208-a24e-fcaea6f035a9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:09.205263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e652-7f01-4208-a24e-fcaea6f035a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:09.206605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9e652-7f01-4208-a24e-fcaea6f035a9 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:09.211261 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 648/1291] 10.222.0.70 () {56 vars in 1116 bytes} [Sun Aug 28 18:40:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:40:09.217062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd170f-45d6-42c1-91d4-431e01a4f054 None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:09.316225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd170f-45d6-42c1-91d4-431e01a4f054 None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:09.349073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86d715-df50-4f91-83a4-7f8abff22cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:09.349672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86d715-df50-4f91-83a4-7f8abff22cd5 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:09.349956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86d715-df50-4f91-83a4-7f8abff22cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:09.350232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86d715-df50-4f91-83a4-7f8abff22cd5 None admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:09.350892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86d715-df50-4f91-83a4-7f8abff22cd5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:09.351195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86d715-df50-4f91-83a4-7f8abff22cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:09.352553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86d715-df50-4f91-83a4-7f8abff22cd5 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:09.356954 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 644/1292] 10.222.0.70 () {56 vars in 1116 bytes} [Sun Aug 28 18:40:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:11.238687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9d2c5-580d-459e-9686-dddb0d574f15 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:11.239255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9d2c5-580d-459e-9686-dddb0d574f15 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:11.239255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9d2c5-580d-459e-9686-dddb0d574f15 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:11.240614 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 649/1293] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:40:11.245809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4551c2-20c9-45f0-abd3-02e5d919ba02 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:11.246205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4551c2-20c9-45f0-abd3-02e5d919ba02 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:11.246355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4551c2-20c9-45f0-abd3-02e5d919ba02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:11.264654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3e4551c2-20c9-45f0-abd3-02e5d919ba02 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:11.265817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3e4551c2-20c9-45f0-abd3-02e5d919ba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:11.295553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:11.333381 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 645/1294] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:40:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:40:11.607335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9d2c5-580d-459e-9686-dddb0d574f15 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:11.637767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:11.707226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9d2c5-580d-459e-9686-dddb0d574f15 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:11.739537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65c699-fea2-4899-b30d-d7cf8031075b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:11.740124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c699-fea2-4899-b30d-d7cf8031075b None admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:11.740404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c699-fea2-4899-b30d-d7cf8031075b None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:11.740674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c699-fea2-4899-b30d-d7cf8031075b None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:11.741313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65c699-fea2-4899-b30d-d7cf8031075b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:11.742654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65c699-fea2-4899-b30d-d7cf8031075b None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:11.756783 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 650/1295] 10.222.0.70 () {60 vars in 1141 bytes} [Sun Aug 28 18:40:11 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:13.654827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100533-9e02-497f-8244-9a42f9c895a1 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:13.655367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100533-9e02-497f-8244-9a42f9c895a1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:13.655367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100533-9e02-497f-8244-9a42f9c895a1 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:13.656712 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 646/1296] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:40:13.661842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4c70-a0a5-4272-b936-88dbdb1a8c2d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:13.662241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4c70-a0a5-4272-b936-88dbdb1a8c2d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:13.662384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf4c70-a0a5-4272-b936-88dbdb1a8c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:13.680019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-61bf4c70-a0a5-4272-b936-88dbdb1a8c2d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:13.681434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-61bf4c70-a0a5-4272-b936-88dbdb1a8c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:13.752363 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 651/1297] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:40:13 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 18:40:14.024119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac100533-9e02-497f-8244-9a42f9c895a1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:14.123848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac100533-9e02-497f-8244-9a42f9c895a1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:14.156522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74697d17-d8bf-4e50-8c00-0f9f4a6f79ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:14.157143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74697d17-d8bf-4e50-8c00-0f9f4a6f79ad None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:14.157420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74697d17-d8bf-4e50-8c00-0f9f4a6f79ad None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:14.157694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74697d17-d8bf-4e50-8c00-0f9f4a6f79ad None admin] PATH_INFO: `/v3/services/placement` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:14.158321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74697d17-d8bf-4e50-8c00-0f9f4a6f79ad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:14.159700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74697d17-d8bf-4e50-8c00-0f9f4a6f79ad None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-74697d17-d8bf-4e50-8c00-0f9f4a6f79ad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:14.168214 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:40:14.169406 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:40:14.171118 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 647/1298] 10.222.0.70 () {56 vars in 1117 bytes} [Sun Aug 28 18:40:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:40:14.175685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf4c70-a0a5-4272-b936-88dbdb1a8c2d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:14.194007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:14.272246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf4c70-a0a5-4272-b936-88dbdb1a8c2d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:14.304804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3ad14-7e6e-4c54-935f-fa6f942e0f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:14.305334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3ad14-7e6e-4c54-935f-fa6f942e0f6d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:14.305875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3ad14-7e6e-4c54-935f-fa6f942e0f6d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:14.306143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3ad14-7e6e-4c54-935f-fa6f942e0f6d None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:14.306773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3ad14-7e6e-4c54-935f-fa6f942e0f6d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:14.307079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3ad14-7e6e-4c54-935f-fa6f942e0f6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:14.308426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3ad14-7e6e-4c54-935f-fa6f942e0f6d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:14.313960 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 652/1299] 10.222.0.70 () {56 vars in 1116 bytes} [Sun Aug 28 18:40:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:14.319900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74697d17-d8bf-4e50-8c00-0f9f4a6f79ad None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:14.352415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:14.421191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74697d17-d8bf-4e50-8c00-0f9f4a6f79ad None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:14.454125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2900eb-af75-4567-8b5e-90b8f915e1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:14.454721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2900eb-af75-4567-8b5e-90b8f915e1a8 None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:14.455033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2900eb-af75-4567-8b5e-90b8f915e1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:14.455308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2900eb-af75-4567-8b5e-90b8f915e1a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:14.456004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2900eb-af75-4567-8b5e-90b8f915e1a8 None admin] RBAC: Adding query filter params (interface=public, service_id=878201f7eb2848d79a6734fae7fdd87d, region_id=RegionOne) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:14.456314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2900eb-af75-4567-8b5e-90b8f915e1a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:14.457676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2900eb-af75-4567-8b5e-90b8f915e1a8 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:14.462569 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 648/1300] 10.222.0.70 () {56 vars in 1251 bytes} [Sun Aug 28 18:40:14 2022] GET /identity/v3/endpoints?service_id=878201f7eb2848d79a6734fae7fdd87d&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:14.468983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3ad14-7e6e-4c54-935f-fa6f942e0f6d None admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:14.549248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:14.567659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3ad14-7e6e-4c54-935f-fa6f942e0f6d None admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:14.600716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2789a-794e-4881-a42e-2dccfcd21251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:14.601316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2789a-794e-4881-a42e-2dccfcd21251 None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:14.601596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2789a-794e-4881-a42e-2dccfcd21251 None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:14.601869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2789a-794e-4881-a42e-2dccfcd21251 None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:14.602463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2789a-794e-4881-a42e-2dccfcd21251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:14.603855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2789a-794e-4881-a42e-2dccfcd21251 None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:14.611228 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 653/1301] 10.222.0.70 () {56 vars in 1087 bytes} [Sun Aug 28 18:40:14 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:40:16.490166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7873-7033-441c-8a1b-f5dec1499139 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:16.490767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7873-7033-441c-8a1b-f5dec1499139 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:16.490767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7873-7033-441c-8a1b-f5dec1499139 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:16.492079 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 649/1302] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:40:16.497051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa509b5d-c89b-475f-865f-701e1aa1ab7a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:16.497448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa509b5d-c89b-475f-865f-701e1aa1ab7a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:16.497728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa509b5d-c89b-475f-865f-701e1aa1ab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:16.516368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fa509b5d-c89b-475f-865f-701e1aa1ab7a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:40:16.517545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fa509b5d-c89b-475f-865f-701e1aa1ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:40:16.583258 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 654/1303] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:40:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 18:40:16.853985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff7873-7033-441c-8a1b-f5dec1499139 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:16.953253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:16.960253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff7873-7033-441c-8a1b-f5dec1499139 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:16.993077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5bbf4-a359-4ca3-8f8f-5491409b7f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:16.993700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5bbf4-a359-4ca3-8f8f-5491409b7f4e None admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:16.993980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5bbf4-a359-4ca3-8f8f-5491409b7f4e None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:16.994252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5bbf4-a359-4ca3-8f8f-5491409b7f4e None admin] PATH_INFO: `/v3/services/placement` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:16.994857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5bbf4-a359-4ca3-8f8f-5491409b7f4e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:16.996217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5bbf4-a359-4ca3-8f8f-5491409b7f4e None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-9af5bbf4-a359-4ca3-8f8f-5491409b7f4e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 18:40:17.004771 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 18:40:17.005903 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 18:40:17.006759 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 650/1304] 10.222.0.70 () {56 vars in 1117 bytes} [Sun Aug 28 18:40:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 18:40:17.011999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa509b5d-c89b-475f-865f-701e1aa1ab7a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:17.087072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:17.110994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa509b5d-c89b-475f-865f-701e1aa1ab7a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:17.144297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73118f77-e98c-4ffe-b614-6f950e05957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:17.144892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73118f77-e98c-4ffe-b614-6f950e05957d None admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:17.145175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73118f77-e98c-4ffe-b614-6f950e05957d None admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:17.145451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73118f77-e98c-4ffe-b614-6f950e05957d None admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:17.146071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73118f77-e98c-4ffe-b614-6f950e05957d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:40:17.146376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73118f77-e98c-4ffe-b614-6f950e05957d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:17.147767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73118f77-e98c-4ffe-b614-6f950e05957d None admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:17.152739 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 655/1305] 10.222.0.70 () {56 vars in 1116 bytes} [Sun Aug 28 18:40:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:40:17.159230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5bbf4-a359-4ca3-8f8f-5491409b7f4e None admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:40:17.256654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5bbf4-a359-4ca3-8f8f-5491409b7f4e None admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:40:17.290682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b54e7-5a5a-46ac-bb33-0be8e17a71f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:40:17.291302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b54e7-5a5a-46ac-bb33-0be8e17a71f3 None admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:40:17.291607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b54e7-5a5a-46ac-bb33-0be8e17a71f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:40:17.291879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b54e7-5a5a-46ac-bb33-0be8e17a71f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:40:17.292527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b54e7-5a5a-46ac-bb33-0be8e17a71f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:40:17.293875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b54e7-5a5a-46ac-bb33-0be8e17a71f3 None admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:40:17.313181 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 651/1306] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:40:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:40:27.149779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=30 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:40:27.311402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:21.352522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fdd19-4ab3-4a7f-a4b6-8a7b5b2ccd2f None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.353046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fdd19-4ab3-4a7f-a4b6-8a7b5b2ccd2f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.353046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fdd19-4ab3-4a7f-a4b6-8a7b5b2ccd2f None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.354414 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 656/1307] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:21.360926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dd3b1-1517-430e-bb81-9c52be3e47cb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.361829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dd3b1-1517-430e-bb81-9c52be3e47cb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.362367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dd3b1-1517-430e-bb81-9c52be3e47cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.439742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cb1dd3b1-1517-430e-bb81-9c52be3e47cb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:21.441411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cb1dd3b1-1517-430e-bb81-9c52be3e47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:21.578706 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 652/1308] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:21.890154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa29a-6d2c-43f6-b25a-f772579442d5 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.890437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa29a-6d2c-43f6-b25a-f772579442d5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.890915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa29a-6d2c-43f6-b25a-f772579442d5 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.892292 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 657/1309] 10.222.0.70 () {54 vars in 965 bytes} [Sun Aug 28 18:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:21.898613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0f17a-b345-4ca2-9d0a-2c46dd4fce89 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:21.899100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0f17a-b345-4ca2-9d0a-2c46dd4fce89 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:21.899447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0f17a-b345-4ca2-9d0a-2c46dd4fce89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:21.984375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-07c0f17a-b345-4ca2-9d0a-2c46dd4fce89 None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:21.985567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-07c0f17a-b345-4ca2-9d0a-2c46dd4fce89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:22.006878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:22.068993 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 653/1310] 10.222.0.70 () {58 vars in 1062 bytes} [Sun Aug 28 18:41:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:22.078760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992aa29a-6d2c-43f6-b25a-f772579442d5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:22.080611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-992aa29a-6d2c-43f6-b25a-f772579442d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:22.202168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992aa29a-6d2c-43f6-b25a-f772579442d5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:22.281940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928a986-2ed9-4e12-9ad6-7626e48611e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:22.282550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928a986-2ed9-4e12-9ad6-7626e48611e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:22.282860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928a986-2ed9-4e12-9ad6-7626e48611e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:22.283132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928a986-2ed9-4e12-9ad6-7626e48611e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:22.284713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6928a986-2ed9-4e12-9ad6-7626e48611e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:22.343764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:22.409468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928a986-2ed9-4e12-9ad6-7626e48611e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:22.411057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928a986-2ed9-4e12-9ad6-7626e48611e3 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:22.433388 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 658/1311] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:24.680068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e7d5-bf32-47ce-9d7f-3d01a7713991 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:24.680617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e7d5-bf32-47ce-9d7f-3d01a7713991 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:24.680617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e7d5-bf32-47ce-9d7f-3d01a7713991 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:24.682103 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 654/1312] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:24.687946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f1a52-7955-441f-b142-74ba43aac6ff None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:24.688393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f1a52-7955-441f-b142-74ba43aac6ff None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:24.688542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f1a52-7955-441f-b142-74ba43aac6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:24.782910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-718f1a52-7955-441f-b142-74ba43aac6ff None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:24.784277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-718f1a52-7955-441f-b142-74ba43aac6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:24.896961 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 659/1313] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:25.183951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686e7d5-bf32-47ce-9d7f-3d01a7713991 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:25.185536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9686e7d5-bf32-47ce-9d7f-3d01a7713991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:25.305665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686e7d5-bf32-47ce-9d7f-3d01a7713991 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:25.375605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:25.378259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c468737-bf76-4fda-b86d-4928e9ee7870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:25.378961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c468737-bf76-4fda-b86d-4928e9ee7870 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:25.379424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c468737-bf76-4fda-b86d-4928e9ee7870 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:25.379849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c468737-bf76-4fda-b86d-4928e9ee7870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:25.381621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3c468737-bf76-4fda-b86d-4928e9ee7870 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:25.489052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c468737-bf76-4fda-b86d-4928e9ee7870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:25.490410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c468737-bf76-4fda-b86d-4928e9ee7870 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:25.508334 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 655/1314] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:27.711371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce565f46-fe57-4dc0-bc5d-b9678be98970 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:27.711925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce565f46-fe57-4dc0-bc5d-b9678be98970 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:27.711925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce565f46-fe57-4dc0-bc5d-b9678be98970 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:27.713267 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 660/1315] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:27.718974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dec78-5804-4218-8697-139f07d03255 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:27.719379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dec78-5804-4218-8697-139f07d03255 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:27.719569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dec78-5804-4218-8697-139f07d03255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:27.786119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6f0dec78-5804-4218-8697-139f07d03255 None None] MFA Rules not processed for user `0489bf2a330a4690b46f44735ab56fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:27.787352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6f0dec78-5804-4218-8697-139f07d03255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:27.839840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:27.886102 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 656/1316] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:41:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:28.170798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce565f46-fe57-4dc0-bc5d-b9678be98970 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:28.172307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ce565f46-fe57-4dc0-bc5d-b9678be98970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:28.182159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:28.274018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce565f46-fe57-4dc0-bc5d-b9678be98970 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:28.347522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45e689-e44f-4690-856f-c3ddbb12bb83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:28.348122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e689-e44f-4690-856f-c3ddbb12bb83 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:28.348397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e689-e44f-4690-856f-c3ddbb12bb83 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:28.348669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45e689-e44f-4690-856f-c3ddbb12bb83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:28.350241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5e45e689-e44f-4690-856f-c3ddbb12bb83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:28.411208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:28.458591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45e689-e44f-4690-856f-c3ddbb12bb83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:28.459999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45e689-e44f-4690-856f-c3ddbb12bb83 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:28.478436 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 661/1317] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:28 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:30.918165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1812974-478b-4fd4-aa52-e9d0869e8bc7 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:30.918678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1812974-478b-4fd4-aa52-e9d0869e8bc7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:30.918678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1812974-478b-4fd4-aa52-e9d0869e8bc7 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:30.920108 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 657/1318] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:30.925379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b40fb-a82b-43fa-8e8e-284399fb37da None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:30.925804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b40fb-a82b-43fa-8e8e-284399fb37da None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:30.925933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b40fb-a82b-43fa-8e8e-284399fb37da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:30.990638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8b6b40fb-a82b-43fa-8e8e-284399fb37da None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:30.991877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8b6b40fb-a82b-43fa-8e8e-284399fb37da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:31.088712 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 662/1319] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:41:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:31.383748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1812974-478b-4fd4-aa52-e9d0869e8bc7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:31.385280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b1812974-478b-4fd4-aa52-e9d0869e8bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:31.488904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1812974-478b-4fd4-aa52-e9d0869e8bc7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:31.562480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9ab49-658e-41bb-bab6-d4d28e342f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:31.563121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9ab49-658e-41bb-bab6-d4d28e342f03 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:31.563398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9ab49-658e-41bb-bab6-d4d28e342f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:31.563667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9ab49-658e-41bb-bab6-d4d28e342f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:31.565288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-21e9ab49-658e-41bb-bab6-d4d28e342f03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:31.572943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:31.673890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9ab49-658e-41bb-bab6-d4d28e342f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:31.675365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9ab49-658e-41bb-bab6-d4d28e342f03 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:31.693153 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 658/1320] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:34.232124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1c1f2-c786-4c29-b5a3-1a9eb8f8a49c None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.232727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1c1f2-c786-4c29-b5a3-1a9eb8f8a49c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.232727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1c1f2-c786-4c29-b5a3-1a9eb8f8a49c None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.234020 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 663/1321] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:34.239206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bb369-955a-4d2e-984a-30da00845ede None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.239643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bb369-955a-4d2e-984a-30da00845ede None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.239791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bb369-955a-4d2e-984a-30da00845ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.308099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-706bb369-955a-4d2e-984a-30da00845ede None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:34.309301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-706bb369-955a-4d2e-984a-30da00845ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:34.368078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:34.409244 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 659/1322] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:34.696762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1c1f2-c786-4c29-b5a3-1a9eb8f8a49c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:34.698289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b3a1c1f2-c786-4c29-b5a3-1a9eb8f8a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:34.718261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:34.801475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1c1f2-c786-4c29-b5a3-1a9eb8f8a49c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:34.875126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2b051-ede2-4998-9d66-eb8099bd062a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:34.875576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2b051-ede2-4998-9d66-eb8099bd062a service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:34.875824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2b051-ede2-4998-9d66-eb8099bd062a service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:34.876129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2b051-ede2-4998-9d66-eb8099bd062a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:34.877867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c3e2b051-ede2-4998-9d66-eb8099bd062a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:34.949065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:34.988912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2b051-ede2-4998-9d66-eb8099bd062a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:34.990347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2b051-ede2-4998-9d66-eb8099bd062a service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:35.008486 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 664/1323] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:36.975707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617efa5-0218-443f-80d1-e2fa04c59fae None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.976225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617efa5-0218-443f-80d1-e2fa04c59fae None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.976225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617efa5-0218-443f-80d1-e2fa04c59fae None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:36.977549 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 660/1324] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:36.983821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e065b3-dbd1-410f-8d47-e6bba919ea3b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:36.984289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e065b3-dbd1-410f-8d47-e6bba919ea3b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:36.984289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e065b3-dbd1-410f-8d47-e6bba919ea3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:37.049572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-21e065b3-dbd1-410f-8d47-e6bba919ea3b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:37.050796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-21e065b3-dbd1-410f-8d47-e6bba919ea3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:37.147694 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 665/1325] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:37.445158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef701ff-a69a-4be8-a6c3-7ecce73f1f42 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:37.445563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef701ff-a69a-4be8-a6c3-7ecce73f1f42 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:37.445912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef701ff-a69a-4be8-a6c3-7ecce73f1f42 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:37.447361 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 661/1326] 10.222.0.70 () {54 vars in 965 bytes} [Sun Aug 28 18:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:37.453871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2b7bd-e1dd-447c-ae02-84c54b38953f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:37.454157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2b7bd-e1dd-447c-ae02-84c54b38953f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:37.454428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2b7bd-e1dd-447c-ae02-84c54b38953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:37.486330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:37.531543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-76a2b7bd-e1dd-447c-ae02-84c54b38953f None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:37.532810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-76a2b7bd-e1dd-447c-ae02-84c54b38953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:37.615548 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 666/1327] 10.222.0.70 () {58 vars in 1062 bytes} [Sun Aug 28 18:41:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:37.624823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef701ff-a69a-4be8-a6c3-7ecce73f1f42 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:37.626340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1ef701ff-a69a-4be8-a6c3-7ecce73f1f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:37.735925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef701ff-a69a-4be8-a6c3-7ecce73f1f42 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:37.812679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ab218-48ef-4f7f-8d10-c69fd9bd806a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:37.813211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab218-48ef-4f7f-8d10-c69fd9bd806a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:37.813494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab218-48ef-4f7f-8d10-c69fd9bd806a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:37.813765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab218-48ef-4f7f-8d10-c69fd9bd806a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:37.815376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0a9ab218-48ef-4f7f-8d10-c69fd9bd806a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:37.832985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:37.928697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ab218-48ef-4f7f-8d10-c69fd9bd806a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:37.930331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ab218-48ef-4f7f-8d10-c69fd9bd806a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:37.948997 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 662/1328] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:40.258292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a19164-26cf-41e9-aa19-1455f6a3e9d5 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:40.258830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a19164-26cf-41e9-aa19-1455f6a3e9d5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:40.259093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a19164-26cf-41e9-aa19-1455f6a3e9d5 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:40.260932 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 667/1329] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:40.266833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fa730-aae7-46bf-918e-1fa458dffbd6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:40.267304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fa730-aae7-46bf-918e-1fa458dffbd6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:40.267415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fa730-aae7-46bf-918e-1fa458dffbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:40.344780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3f3fa730-aae7-46bf-918e-1fa458dffbd6 None None] MFA Rules not processed for user `0489bf2a330a4690b46f44735ab56fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:40.346028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3f3fa730-aae7-46bf-918e-1fa458dffbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:40.411157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:40.445300 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 663/1330] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:41:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:40.735104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a19164-26cf-41e9-aa19-1455f6a3e9d5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:40.736657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-40a19164-26cf-41e9-aa19-1455f6a3e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:40.846900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a19164-26cf-41e9-aa19-1455f6a3e9d5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:40.869216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:40.926431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89125f15-d98b-4170-a360-003d5d624047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:40.927079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89125f15-d98b-4170-a360-003d5d624047 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:40.927362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89125f15-d98b-4170-a360-003d5d624047 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:40.927634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89125f15-d98b-4170-a360-003d5d624047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:40.929287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-89125f15-d98b-4170-a360-003d5d624047 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:41.046290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89125f15-d98b-4170-a360-003d5d624047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:41.047764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89125f15-d98b-4170-a360-003d5d624047 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:41.066520 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 668/1331] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:43.404202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcff124-4e5b-4c5f-a1f9-e85872bff745 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:43.404747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcff124-4e5b-4c5f-a1f9-e85872bff745 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:43.404747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcff124-4e5b-4c5f-a1f9-e85872bff745 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:43.406095 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 664/1332] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:43.411422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f24ee6-27c6-43a8-b5a4-4abcfd3bd46d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:43.411822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f24ee6-27c6-43a8-b5a4-4abcfd3bd46d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:43.411985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f24ee6-27c6-43a8-b5a4-4abcfd3bd46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:43.476298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:43.479365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-94f24ee6-27c6-43a8-b5a4-4abcfd3bd46d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:43.482022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-94f24ee6-27c6-43a8-b5a4-4abcfd3bd46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:43.579934 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 669/1333] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:43.870030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcff124-4e5b-4c5f-a1f9-e85872bff745 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:43.871850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2bcff124-4e5b-4c5f-a1f9-e85872bff745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:43.975332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcff124-4e5b-4c5f-a1f9-e85872bff745 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:44.047841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76ab98-150c-401d-b0a7-6f322b9cc935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:44.048442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ab98-150c-401d-b0a7-6f322b9cc935 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:44.048723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ab98-150c-401d-b0a7-6f322b9cc935 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:44.048996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ab98-150c-401d-b0a7-6f322b9cc935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:44.050563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7b76ab98-150c-401d-b0a7-6f322b9cc935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:44.077557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:44.159816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76ab98-150c-401d-b0a7-6f322b9cc935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:44.161172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76ab98-150c-401d-b0a7-6f322b9cc935 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:44.178808 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 665/1334] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:46.103026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfc35f-8e1e-4374-9f87-51888a761de1 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:46.103560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfc35f-8e1e-4374-9f87-51888a761de1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:46.103560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfc35f-8e1e-4374-9f87-51888a761de1 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:46.104932 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 670/1335] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:46.110955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab9077-3b3a-46cd-8202-3e3924d5b6e5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:46.111420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab9077-3b3a-46cd-8202-3e3924d5b6e5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:46.111544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab9077-3b3a-46cd-8202-3e3924d5b6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:46.176413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f6ab9077-3b3a-46cd-8202-3e3924d5b6e5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:46.177592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f6ab9077-3b3a-46cd-8202-3e3924d5b6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:46.253126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:46.275666 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 666/1336] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:46.564209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfc35f-8e1e-4374-9f87-51888a761de1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:46.565760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7adfc35f-8e1e-4374-9f87-51888a761de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:46.666976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfc35f-8e1e-4374-9f87-51888a761de1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:46.694758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:46.739036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf2c1f-4893-4434-a2ef-e73c522891b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:46.739639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf2c1f-4893-4434-a2ef-e73c522891b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:46.739919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf2c1f-4893-4434-a2ef-e73c522891b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:46.740195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf2c1f-4893-4434-a2ef-e73c522891b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:46.741907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1caf2c1f-4893-4434-a2ef-e73c522891b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:46.847617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf2c1f-4893-4434-a2ef-e73c522891b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:46.848968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf2c1f-4893-4434-a2ef-e73c522891b6 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:46.867587 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 671/1337] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:49.230168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17f895-083d-40ce-a783-ea9175d0a92b None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:49.230674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17f895-083d-40ce-a783-ea9175d0a92b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:49.230789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17f895-083d-40ce-a783-ea9175d0a92b None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:49.232620 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 667/1338] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:49.237623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe3081-b201-4329-88ee-7e2da7a0f536 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:49.238095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe3081-b201-4329-88ee-7e2da7a0f536 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:49.238193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe3081-b201-4329-88ee-7e2da7a0f536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:49.303931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-89fe3081-b201-4329-88ee-7e2da7a0f536 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:49.305373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-89fe3081-b201-4329-88ee-7e2da7a0f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:49.314243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:49.401496 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 672/1339] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:41:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:49.691378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17f895-083d-40ce-a783-ea9175d0a92b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:49.692928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3f17f895-083d-40ce-a783-ea9175d0a92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:49.796179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17f895-083d-40ce-a783-ea9175d0a92b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:49.869968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc7c3e-c9da-4700-bfb1-8b08a88450a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:49.870573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc7c3e-c9da-4700-bfb1-8b08a88450a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:49.870938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc7c3e-c9da-4700-bfb1-8b08a88450a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:49.871261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc7c3e-c9da-4700-bfb1-8b08a88450a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:49.873421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-acdc7c3e-c9da-4700-bfb1-8b08a88450a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:49.910083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:49.983870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc7c3e-c9da-4700-bfb1-8b08a88450a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:49.985309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc7c3e-c9da-4700-bfb1-8b08a88450a6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:50.003448 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 668/1340] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:53.915715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a23e5-c14d-4316-adee-f79354cdba15 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:53.916244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a23e5-c14d-4316-adee-f79354cdba15 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:53.916244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a23e5-c14d-4316-adee-f79354cdba15 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:53.917685 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 673/1341] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:53.923176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad80706-6431-49cb-b45c-55005c9f7378 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:53.923628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad80706-6431-49cb-b45c-55005c9f7378 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:53.923809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad80706-6431-49cb-b45c-55005c9f7378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:53.991667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1ad80706-6431-49cb-b45c-55005c9f7378 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:53.992888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1ad80706-6431-49cb-b45c-55005c9f7378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:54.080524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:54.092509 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 669/1342] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:41:54.380520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a23e5-c14d-4316-adee-f79354cdba15 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:54.382061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1e3a23e5-c14d-4316-adee-f79354cdba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:54.486444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a23e5-c14d-4316-adee-f79354cdba15 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:54.523977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:54.560293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f3ab6-3461-4eb2-8e54-afebfebe5bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:54.560906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f3ab6-3461-4eb2-8e54-afebfebe5bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:54.561186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f3ab6-3461-4eb2-8e54-afebfebe5bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:54.561456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f3ab6-3461-4eb2-8e54-afebfebe5bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:54.563112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-808f3ab6-3461-4eb2-8e54-afebfebe5bf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:54.680763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f3ab6-3461-4eb2-8e54-afebfebe5bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:54.682112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f3ab6-3461-4eb2-8e54-afebfebe5bf8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:54.701374 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 674/1343] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:41:57.250938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df11828-e370-4f74-b2bd-c6be7d3bddff None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:57.251510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df11828-e370-4f74-b2bd-c6be7d3bddff None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:57.251510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df11828-e370-4f74-b2bd-c6be7d3bddff None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:57.252873 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 670/1344] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:41:57.258885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a90ce-bb89-422b-9742-5d3bdfe9befa None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:57.259407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a90ce-bb89-422b-9742-5d3bdfe9befa None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:57.259522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a90ce-bb89-422b-9742-5d3bdfe9befa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:57.326319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-723a90ce-bb89-422b-9742-5d3bdfe9befa None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:41:57.328035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-723a90ce-bb89-422b-9742-5d3bdfe9befa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:57.346577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:57.427018 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 675/1345] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:41:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:41:57.709658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df11828-e370-4f74-b2bd-c6be7d3bddff None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:41:57.711257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3df11828-e370-4f74-b2bd-c6be7d3bddff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:57.817475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df11828-e370-4f74-b2bd-c6be7d3bddff None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:41:57.904882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd147da4-2609-4862-88e4-8d330b0b0712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:41:57.905482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd147da4-2609-4862-88e4-8d330b0b0712 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:41:57.905882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd147da4-2609-4862-88e4-8d330b0b0712 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:41:57.906163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd147da4-2609-4862-88e4-8d330b0b0712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:41:57.908171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dd147da4-2609-4862-88e4-8d330b0b0712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:41:57.954936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:41:58.024606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd147da4-2609-4862-88e4-8d330b0b0712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:41:58.026057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd147da4-2609-4862-88e4-8d330b0b0712 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:41:58.046605 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 671/1346] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:41:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:01.947932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d419d0-3118-4385-8f41-a6bc8d473f77 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:01.948417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d419d0-3118-4385-8f41-a6bc8d473f77 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:01.948515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d419d0-3118-4385-8f41-a6bc8d473f77 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:01.949888 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 676/1347] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:01.955459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d2442-2871-4854-8574-df05d5207f7b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:01.955875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d2442-2871-4854-8574-df05d5207f7b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:01.956011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d2442-2871-4854-8574-df05d5207f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:02.031993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3e9d2442-2871-4854-8574-df05d5207f7b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:02.033216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3e9d2442-2871-4854-8574-df05d5207f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:02.133238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:02.137275 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 672/1348] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:02.422605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d419d0-3118-4385-8f41-a6bc8d473f77 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:02.424155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-79d419d0-3118-4385-8f41-a6bc8d473f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:02.529159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d419d0-3118-4385-8f41-a6bc8d473f77 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:02.580224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:02.608682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e3cdf-6471-45e6-84f9-3776e345ae6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:02.609310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e3cdf-6471-45e6-84f9-3776e345ae6c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:02.609586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e3cdf-6471-45e6-84f9-3776e345ae6c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:02.609853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e3cdf-6471-45e6-84f9-3776e345ae6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:02.611522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2a9e3cdf-6471-45e6-84f9-3776e345ae6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:02.722590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e3cdf-6471-45e6-84f9-3776e345ae6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:02.724064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e3cdf-6471-45e6-84f9-3776e345ae6c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:02.742337 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 677/1349] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:07.856916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3d009-5c3a-4a95-8964-1cc46834d49c None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:07.857485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3d009-5c3a-4a95-8964-1cc46834d49c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:07.857485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3d009-5c3a-4a95-8964-1cc46834d49c None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:07.864334 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 673/1350] 10.222.0.70 () {54 vars in 921 bytes} [Sun Aug 28 18:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:07.866246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b80901-ced5-493f-b6fa-5db89fd6f6fe None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:07.868417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b80901-ced5-493f-b6fa-5db89fd6f6fe None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:07.868417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b80901-ced5-493f-b6fa-5db89fd6f6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:08.029979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-92b80901-ced5-493f-b6fa-5db89fd6f6fe None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:08.031817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-92b80901-ced5-493f-b6fa-5db89fd6f6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:08.062972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:08.181386 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 678/1351] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:42:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:12.492645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa179c6-1259-4bb8-8e88-8608c60e2d14 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:12.493202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa179c6-1259-4bb8-8e88-8608c60e2d14 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:12.493202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa179c6-1259-4bb8-8e88-8608c60e2d14 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:12.494523 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 674/1352] 10.222.0.70 () {54 vars in 921 bytes} [Sun Aug 28 18:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:12.502552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ae62-b090-413b-9487-7943b4624d46 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:12.503040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ae62-b090-413b-9487-7943b4624d46 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:12.503125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8ae62-b090-413b-9487-7943b4624d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:12.594145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-57b8ae62-b090-413b-9487-7943b4624d46 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:12.595372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-57b8ae62-b090-413b-9487-7943b4624d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:12.671716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:12.711083 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 679/1353] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:42:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:14.044132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba830190-7d93-4b61-912e-3fac1b6aa10c None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:14.044705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba830190-7d93-4b61-912e-3fac1b6aa10c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:14.044705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba830190-7d93-4b61-912e-3fac1b6aa10c None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:14.046148 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 675/1354] 10.222.0.70 () {54 vars in 921 bytes} [Sun Aug 28 18:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:14.051036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463235d-fbca-4431-80c1-91d68cba74c3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:14.051442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463235d-fbca-4431-80c1-91d68cba74c3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:14.051748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463235d-fbca-4431-80c1-91d68cba74c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:14.130368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b463235d-fbca-4431-80c1-91d68cba74c3 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:14.132052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b463235d-fbca-4431-80c1-91d68cba74c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:14.239452 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 680/1355] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:42:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:17.713619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5097744-d507-4bdd-bac5-9a802caaa063 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:17.716287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5097744-d507-4bdd-bac5-9a802caaa063 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:17.716781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5097744-d507-4bdd-bac5-9a802caaa063 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:17.718481 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 676/1356] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:17.724046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434a0d6-5224-412e-855e-a323d2b57fb8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:17.724510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434a0d6-5224-412e-855e-a323d2b57fb8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:17.724652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434a0d6-5224-412e-855e-a323d2b57fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:17.772374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:17.813791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4434a0d6-5224-412e-855e-a323d2b57fb8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:17.815135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4434a0d6-5224-412e-855e-a323d2b57fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:17.932353 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 681/1357] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:18.257712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327e7ea-cce4-4c6d-ab69-e937955cacf5 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:18.258337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327e7ea-cce4-4c6d-ab69-e937955cacf5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:18.258828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327e7ea-cce4-4c6d-ab69-e937955cacf5 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:18.260407 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 677/1358] 10.222.0.70 () {54 vars in 962 bytes} [Sun Aug 28 18:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:18.278449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30669cc-f6a7-487a-8a1a-45db4e3a1c8b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:18.279356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30669cc-f6a7-487a-8a1a-45db4e3a1c8b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:18.279789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30669cc-f6a7-487a-8a1a-45db4e3a1c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:18.368751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f30669cc-f6a7-487a-8a1a-45db4e3a1c8b None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:18.370104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f30669cc-f6a7-487a-8a1a-45db4e3a1c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:18.422214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:18.493595 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 682/1359] 10.222.0.70 () {58 vars in 1059 bytes} [Sun Aug 28 18:42:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:18.501852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327e7ea-cce4-4c6d-ab69-e937955cacf5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:18.503479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f327e7ea-cce4-4c6d-ab69-e937955cacf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:18.661074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327e7ea-cce4-4c6d-ab69-e937955cacf5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:18.737624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:18.782845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aec2b4-48c6-4a57-a6b6-c41b7e3f7f8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:18.783375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec2b4-48c6-4a57-a6b6-c41b7e3f7f8e service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:18.783654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec2b4-48c6-4a57-a6b6-c41b7e3f7f8e service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:18.783929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec2b4-48c6-4a57-a6b6-c41b7e3f7f8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:18.785695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e6aec2b4-48c6-4a57-a6b6-c41b7e3f7f8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:18.889272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aec2b4-48c6-4a57-a6b6-c41b7e3f7f8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:18.891092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aec2b4-48c6-4a57-a6b6-c41b7e3f7f8e service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:18.911067 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 678/1360] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:21.052787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302d1a1-3df1-473e-8609-7a985950347e None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:21.053305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302d1a1-3df1-473e-8609-7a985950347e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:21.053404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302d1a1-3df1-473e-8609-7a985950347e None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:21.057151 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 683/1361] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:21.060284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f621c-b1e6-4a68-b8b0-6526f7049318 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:21.060695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f621c-b1e6-4a68-b8b0-6526f7049318 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:21.060888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f621c-b1e6-4a68-b8b0-6526f7049318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:21.129224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-874f621c-b1e6-4a68-b8b0-6526f7049318 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:21.130340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-874f621c-b1e6-4a68-b8b0-6526f7049318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:21.169916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:21.246798 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 679/1362] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:21.537535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302d1a1-3df1-473e-8609-7a985950347e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:21.539093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6302d1a1-3df1-473e-8609-7a985950347e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:21.698334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302d1a1-3df1-473e-8609-7a985950347e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:21.708228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:21.814902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e74cc-5e6f-430b-aa28-b28af7c5ace9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:21.815512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e74cc-5e6f-430b-aa28-b28af7c5ace9 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:21.815792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e74cc-5e6f-430b-aa28-b28af7c5ace9 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:21.816071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e74cc-5e6f-430b-aa28-b28af7c5ace9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:21.817677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-554e74cc-5e6f-430b-aa28-b28af7c5ace9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:21.918767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e74cc-5e6f-430b-aa28-b28af7c5ace9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:21.920402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e74cc-5e6f-430b-aa28-b28af7c5ace9 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:21.941134 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 684/1363] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:24.223986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43449071-15e8-43de-bce1-0269132f75e4 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:24.224493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43449071-15e8-43de-bce1-0269132f75e4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:24.224578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43449071-15e8-43de-bce1-0269132f75e4 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:24.225879 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 680/1364] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:24.231960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d10343-518b-4714-b6eb-bcd1a81312c4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:24.232851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d10343-518b-4714-b6eb-bcd1a81312c4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:24.233224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d10343-518b-4714-b6eb-bcd1a81312c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:24.251145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:24.319328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-53d10343-518b-4714-b6eb-bcd1a81312c4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:24.320812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-53d10343-518b-4714-b6eb-bcd1a81312c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:24.438044 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 685/1365] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:24.729673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a33409-e54d-4840-a567-653f0a39ae5c None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:24.730002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a33409-e54d-4840-a567-653f0a39ae5c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:24.730493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a33409-e54d-4840-a567-653f0a39ae5c None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:24.732406 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 681/1366] 10.222.0.70 () {54 vars in 962 bytes} [Sun Aug 28 18:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:24.745874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ea7b5-ee96-46ed-b967-b8af7bf0e3e4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:24.746157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ea7b5-ee96-46ed-b967-b8af7bf0e3e4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:24.746434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ea7b5-ee96-46ed-b967-b8af7bf0e3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:24.863313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1f7ea7b5-ee96-46ed-b967-b8af7bf0e3e4 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:24.864429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1f7ea7b5-ee96-46ed-b967-b8af7bf0e3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:24.903913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:25.113743 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 686/1367] 10.222.0.70 () {58 vars in 1059 bytes} [Sun Aug 28 18:42:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:25.121993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a33409-e54d-4840-a567-653f0a39ae5c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:25.123528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d9a33409-e54d-4840-a567-653f0a39ae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:25.320795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a33409-e54d-4840-a567-653f0a39ae5c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:25.342057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:25.443145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b56009-b009-4702-98ba-1971e007581d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:25.443863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b56009-b009-4702-98ba-1971e007581d service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:25.444249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b56009-b009-4702-98ba-1971e007581d service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:25.444623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b56009-b009-4702-98ba-1971e007581d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:25.446433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-74b56009-b009-4702-98ba-1971e007581d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:25.554500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b56009-b009-4702-98ba-1971e007581d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:25.556403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b56009-b009-4702-98ba-1971e007581d service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:25.583043 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 682/1368] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:42:27.761059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019f0b4-33f4-4713-a73a-b0274689d05a None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:27.762610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019f0b4-33f4-4713-a73a-b0274689d05a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:27.763118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019f0b4-33f4-4713-a73a-b0274689d05a None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:27.764685 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 687/1369] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:27.772035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65b62-bf48-4766-a009-a057eb85cc0f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:27.772497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65b62-bf48-4766-a009-a057eb85cc0f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:27.772574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65b62-bf48-4766-a009-a057eb85cc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:27.827429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:27.877882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-dad65b62-bf48-4766-a009-a057eb85cc0f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:27.880131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dad65b62-bf48-4766-a009-a057eb85cc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:28.120260 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 683/1370] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:28.455887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019f0b4-33f4-4713-a73a-b0274689d05a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:28.457668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9019f0b4-33f4-4713-a73a-b0274689d05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:28.626360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:28.633211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019f0b4-33f4-4713-a73a-b0274689d05a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:28.762238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf58c05-c791-4621-bb32-9a44279e7de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:28.763782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf58c05-c791-4621-bb32-9a44279e7de7 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:28.764361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf58c05-c791-4621-bb32-9a44279e7de7 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:28.764844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf58c05-c791-4621-bb32-9a44279e7de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:28.766772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fdf58c05-c791-4621-bb32-9a44279e7de7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:28.874310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf58c05-c791-4621-bb32-9a44279e7de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:28.876202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf58c05-c791-4621-bb32-9a44279e7de7 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:28.895708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:28.912919 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 688/1371] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:29.832259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a289940-0a33-4707-aef4-3b84bcd10258 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:29.832763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a289940-0a33-4707-aef4-3b84bcd10258 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:29.832962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a289940-0a33-4707-aef4-3b84bcd10258 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:29.834436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 684/1372] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:29.840678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524114f-e8e0-4817-a20a-36b4a404f5f0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:29.841134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524114f-e8e0-4817-a20a-36b4a404f5f0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:29.841229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524114f-e8e0-4817-a20a-36b4a404f5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:29.916953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0524114f-e8e0-4817-a20a-36b4a404f5f0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:29.918687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0524114f-e8e0-4817-a20a-36b4a404f5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:30.034105 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 689/1373] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:30.593999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dc3cf-aabe-4d64-a380-a5d597d334db None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:30.594521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dc3cf-aabe-4d64-a380-a5d597d334db None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:30.594991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dc3cf-aabe-4d64-a380-a5d597d334db None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:30.596479 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 685/1374] 10.222.0.70 () {54 vars in 964 bytes} [Sun Aug 28 18:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:30.601534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751e3a2-2719-4d5f-b1c8-b28080925b04 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:30.602006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751e3a2-2719-4d5f-b1c8-b28080925b04 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:30.602434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751e3a2-2719-4d5f-b1c8-b28080925b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:30.687483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3751e3a2-2719-4d5f-b1c8-b28080925b04 None None] MFA Rules not processed for user `afece3fa01d040a1ae8e035ea3ff3219`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:30.688884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3751e3a2-2719-4d5f-b1c8-b28080925b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:30.711059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:30.772038 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 690/1375] 10.222.0.70 () {58 vars in 1061 bytes} [Sun Aug 28 18:42:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:30.781907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dc3cf-aabe-4d64-a380-a5d597d334db None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:30.783939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-824dc3cf-aabe-4d64-a380-a5d597d334db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:30.901713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dc3cf-aabe-4d64-a380-a5d597d334db None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:30.906073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:30.984993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5010c-a80c-4bdd-a88d-0a1dfa80066a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:30.985722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5010c-a80c-4bdd-a88d-0a1dfa80066a service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:30.986009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5010c-a80c-4bdd-a88d-0a1dfa80066a service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:30.986284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5010c-a80c-4bdd-a88d-0a1dfa80066a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:30.988621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f2b5010c-a80c-4bdd-a88d-0a1dfa80066a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:31.020717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52d0d-ec54-4ac8-97bb-3d6d469c3947 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.021274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52d0d-ec54-4ac8-97bb-3d6d469c3947 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.021274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52d0d-ec54-4ac8-97bb-3d6d469c3947 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.022607 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 691/1376] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:42:31.028671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b2af3-6c60-4b75-b9d6-b7c6546511e9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.028960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b2af3-6c60-4b75-b9d6-b7c6546511e9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.029234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b2af3-6c60-4b75-b9d6-b7c6546511e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.104478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-254b2af3-6c60-4b75-b9d6-b7c6546511e9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:31.106362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-254b2af3-6c60-4b75-b9d6-b7c6546511e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:31.118506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5010c-a80c-4bdd-a88d-0a1dfa80066a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.119989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5010c-a80c-4bdd-a88d-0a1dfa80066a service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:31.145503 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 686/1377] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:31.222825 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 692/1378] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:31.511441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5010c-a80c-4bdd-a88d-0a1dfa80066a service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:31.514014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f2b5010c-a80c-4bdd-a88d-0a1dfa80066a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:31.609477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:31.695344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5010c-a80c-4bdd-a88d-0a1dfa80066a service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:31.837931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77afa9-18e6-4014-a42b-6372c61815a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:31.838544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77afa9-18e6-4014-a42b-6372c61815a4 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:31.840892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77afa9-18e6-4014-a42b-6372c61815a4 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:31.840892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77afa9-18e6-4014-a42b-6372c61815a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:31.844249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8c77afa9-18e6-4014-a42b-6372c61815a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:31.907421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:31.953628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77afa9-18e6-4014-a42b-6372c61815a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:31.955294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77afa9-18e6-4014-a42b-6372c61815a4 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:31.974878 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 687/1379] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:33.950528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5d8f4-07f1-48d1-927a-7257c61aefe1 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:33.951547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5d8f4-07f1-48d1-927a-7257c61aefe1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:33.951999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5d8f4-07f1-48d1-927a-7257c61aefe1 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:33.958835 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 693/1380] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:33.959254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39339ec8-e5f6-410d-a230-de2a35d1a1b9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:33.959678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39339ec8-e5f6-410d-a230-de2a35d1a1b9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:33.959794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39339ec8-e5f6-410d-a230-de2a35d1a1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:34.047868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-39339ec8-e5f6-410d-a230-de2a35d1a1b9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:34.049004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-39339ec8-e5f6-410d-a230-de2a35d1a1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:34.151330 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 688/1381] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:34.468947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5d8f4-07f1-48d1-927a-7257c61aefe1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:34.470588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4dd5d8f4-07f1-48d1-927a-7257c61aefe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:34.502565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:34.639496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5d8f4-07f1-48d1-927a-7257c61aefe1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:34.750364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:34.782555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf8f3b-0b1f-4a61-bc3b-146dcd20e222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:34.783229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8f3b-0b1f-4a61-bc3b-146dcd20e222 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:34.783644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8f3b-0b1f-4a61-bc3b-146dcd20e222 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:34.783921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8f3b-0b1f-4a61-bc3b-146dcd20e222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:34.786068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e0bf8f3b-0b1f-4a61-bc3b-146dcd20e222 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:34.920378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf8f3b-0b1f-4a61-bc3b-146dcd20e222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:34.922269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf8f3b-0b1f-4a61-bc3b-146dcd20e222 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:34.949064 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 694/1382] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:37.011668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008aa7-f207-4284-af9e-c68066953308 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:37.012231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008aa7-f207-4284-af9e-c68066953308 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:37.012400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008aa7-f207-4284-af9e-c68066953308 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:37.019292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6bbcd-9943-496c-94eb-1de34b69f1ec None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:37.019778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6bbcd-9943-496c-94eb-1de34b69f1ec None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:37.019778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6bbcd-9943-496c-94eb-1de34b69f1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:37.024240 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 689/1383] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:37 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:37.100097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a1f6bbcd-9943-496c-94eb-1de34b69f1ec None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:37.101331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a1f6bbcd-9943-496c-94eb-1de34b69f1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:37.167066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:37.216215 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 695/1384] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:37.509841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18008aa7-f207-4284-af9e-c68066953308 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:37.512115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-18008aa7-f207-4284-af9e-c68066953308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:37.537979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:37.675692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18008aa7-f207-4284-af9e-c68066953308 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:37.780628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:37.802565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b7c41-ce01-477c-ab52-2d76b0874bce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:37.803216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b7c41-ce01-477c-ab52-2d76b0874bce service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:37.803506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b7c41-ce01-477c-ab52-2d76b0874bce service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:37.804041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b7c41-ce01-477c-ab52-2d76b0874bce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:37.805634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f18b7c41-ce01-477c-ab52-2d76b0874bce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:37.904947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b7c41-ce01-477c-ab52-2d76b0874bce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:37.906479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b7c41-ce01-477c-ab52-2d76b0874bce service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:37.927391 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 690/1385] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:39.879352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3c42-b771-4a49-9897-2c159ae6dabc None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.880033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3c42-b771-4a49-9897-2c159ae6dabc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.880033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3c42-b771-4a49-9897-2c159ae6dabc None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.881177 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 696/1386] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:42:39.887534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dcded-d7fc-4ecb-a944-764283eab61d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:39.888125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dcded-d7fc-4ecb-a944-764283eab61d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:39.888125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dcded-d7fc-4ecb-a944-764283eab61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:39.957118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e69dcded-d7fc-4ecb-a944-764283eab61d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:39.958328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e69dcded-d7fc-4ecb-a944-764283eab61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:40.021149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:40.065061 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 691/1387] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:40.354580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad3c42-b771-4a49-9897-2c159ae6dabc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:40.356551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-20ad3c42-b771-4a49-9897-2c159ae6dabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:40.509026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad3c42-b771-4a49-9897-2c159ae6dabc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:40.555964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:40.626655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf0ee3-4aec-4e3a-8ff7-cd44698b6c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:40.627222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0ee3-4aec-4e3a-8ff7-cd44698b6c1b service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:40.627524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0ee3-4aec-4e3a-8ff7-cd44698b6c1b service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:40.627818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf0ee3-4aec-4e3a-8ff7-cd44698b6c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:40.629336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8cdf0ee3-4aec-4e3a-8ff7-cd44698b6c1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:40.726402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf0ee3-4aec-4e3a-8ff7-cd44698b6c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:40.728688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf0ee3-4aec-4e3a-8ff7-cd44698b6c1b service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:40.748637 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 697/1388] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:42.706788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc2f30-5da2-466e-900c-ecbf0a8b5fa6 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:42.707485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc2f30-5da2-466e-900c-ecbf0a8b5fa6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:42.707485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc2f30-5da2-466e-900c-ecbf0a8b5fa6 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:42.708798 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 692/1389] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:42.715682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a07266-5e24-4010-9ea6-8f6e4f923223 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:42.715682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a07266-5e24-4010-9ea6-8f6e4f923223 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:42.715682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a07266-5e24-4010-9ea6-8f6e4f923223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:42.781838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:42.788719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-83a07266-5e24-4010-9ea6-8f6e4f923223 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:42.791419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-83a07266-5e24-4010-9ea6-8f6e4f923223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:42.934477 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 698/1390] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:42:43.234287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc2f30-5da2-466e-900c-ecbf0a8b5fa6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:43.235905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aafc2f30-5da2-466e-900c-ecbf0a8b5fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:43.399428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc2f30-5da2-466e-900c-ecbf0a8b5fa6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:43.441397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:43.515179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ee0c3-7a63-4406-8392-71b3ff53bf2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:43.515788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ee0c3-7a63-4406-8392-71b3ff53bf2b service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:43.516066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ee0c3-7a63-4406-8392-71b3ff53bf2b service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:43.516337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ee0c3-7a63-4406-8392-71b3ff53bf2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:43.517914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-144ee0c3-7a63-4406-8392-71b3ff53bf2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:43.614506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ee0c3-7a63-4406-8392-71b3ff53bf2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:43.616145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ee0c3-7a63-4406-8392-71b3ff53bf2b service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:43.635070 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 693/1391] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:45.632555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be67a3-37c5-459a-bea8-a1b0e3b1f40a None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:45.633148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be67a3-37c5-459a-bea8-a1b0e3b1f40a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:45.633148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be67a3-37c5-459a-bea8-a1b0e3b1f40a None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:45.634566 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 699/1392] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:45.640516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4419c8-ccfb-4765-b9f9-360da28285a0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:45.641014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4419c8-ccfb-4765-b9f9-360da28285a0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:45.641208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4419c8-ccfb-4765-b9f9-360da28285a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:45.700573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:45.708305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6c4419c8-ccfb-4765-b9f9-360da28285a0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:45.709525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6c4419c8-ccfb-4765-b9f9-360da28285a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:45.806473 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 694/1393] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:46.101882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be67a3-37c5-459a-bea8-a1b0e3b1f40a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:46.103757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c5be67a3-37c5-459a-bea8-a1b0e3b1f40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:46.232245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:46.250181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be67a3-37c5-459a-bea8-a1b0e3b1f40a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:46.362304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de7d1a-e61e-44a2-bcd1-f4212c40a4bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:46.362912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de7d1a-e61e-44a2-bcd1-f4212c40a4bb service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:46.363195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de7d1a-e61e-44a2-bcd1-f4212c40a4bb service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:46.363469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de7d1a-e61e-44a2-bcd1-f4212c40a4bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:46.365032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-97de7d1a-e61e-44a2-bcd1-f4212c40a4bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:46.454405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de7d1a-e61e-44a2-bcd1-f4212c40a4bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:46.456065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de7d1a-e61e-44a2-bcd1-f4212c40a4bb service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:46.460034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:46.475550 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 700/1394] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:42:46.923742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d647f-1697-4e19-8627-08597dcd27d5 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:46.924283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d647f-1697-4e19-8627-08597dcd27d5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:46.924283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d647f-1697-4e19-8627-08597dcd27d5 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:46.925616 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 695/1395] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:46.931241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd982246-9977-476b-a0c3-38b4010cf9e9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:46.931644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd982246-9977-476b-a0c3-38b4010cf9e9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:46.931791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd982246-9977-476b-a0c3-38b4010cf9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:46.999269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-bd982246-9977-476b-a0c3-38b4010cf9e9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:47.000462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bd982246-9977-476b-a0c3-38b4010cf9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:47.099101 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 701/1396] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:47.418951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f13660-09f7-4adb-9440-83bde05c75f8 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:47.419260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f13660-09f7-4adb-9440-83bde05c75f8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:47.419531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f13660-09f7-4adb-9440-83bde05c75f8 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:47.421002 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 696/1397] 10.222.0.70 () {54 vars in 967 bytes} [Sun Aug 28 18:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:42:47.426242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593d68-0650-4f48-8997-9959aec4a04b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:47.426565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593d68-0650-4f48-8997-9959aec4a04b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:47.426885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85593d68-0650-4f48-8997-9959aec4a04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:47.516060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-85593d68-0650-4f48-8997-9959aec4a04b None None] MFA Rules not processed for user `332144d9eb5742498c0c37a70277ce5e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:47.517318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-85593d68-0650-4f48-8997-9959aec4a04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:47.530314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:47.614924 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 702/1398] 10.222.0.70 () {58 vars in 1064 bytes} [Sun Aug 28 18:42:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:47.624997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f13660-09f7-4adb-9440-83bde05c75f8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:47.626539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-41f13660-09f7-4adb-9440-83bde05c75f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:47.739318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f13660-09f7-4adb-9440-83bde05c75f8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:47.766173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:47.813677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db54055-7ca3-4564-bf3d-a2ba702f328d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:47.814277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db54055-7ca3-4564-bf3d-a2ba702f328d service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:47.814555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db54055-7ca3-4564-bf3d-a2ba702f328d service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:47.814858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db54055-7ca3-4564-bf3d-a2ba702f328d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:47.816414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2db54055-7ca3-4564-bf3d-a2ba702f328d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:47.924917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db54055-7ca3-4564-bf3d-a2ba702f328d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:47.926346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db54055-7ca3-4564-bf3d-a2ba702f328d service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:47.944759 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 697/1399] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:42:48.454028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73ed3c-9371-41a4-b49b-130e15e17481 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.454537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73ed3c-9371-41a4-b49b-130e15e17481 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.454646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73ed3c-9371-41a4-b49b-130e15e17481 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.455955 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 703/1400] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:48.461480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f5f5b-5a98-4c80-9d5a-840a3dbae37b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.461770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f5f5b-5a98-4c80-9d5a-840a3dbae37b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.462053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f5f5b-5a98-4c80-9d5a-840a3dbae37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.530250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e23f5f5b-5a98-4c80-9d5a-840a3dbae37b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:48.531534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e23f5f5b-5a98-4c80-9d5a-840a3dbae37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:48.538693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:48.646623 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 698/1401] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:48.699428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d790-8cd3-4515-b3eb-f73cd32841e2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.699710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d790-8cd3-4515-b3eb-f73cd32841e2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.699980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d790-8cd3-4515-b3eb-f73cd32841e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.765554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f994d790-8cd3-4515-b3eb-f73cd32841e2 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:48.766731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f994d790-8cd3-4515-b3eb-f73cd32841e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:48.854094 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 704/1402] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 18:42:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:48.897351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26554ab-ae65-4016-ab67-10a15aabcf9c None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.897777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26554ab-ae65-4016-ab67-10a15aabcf9c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.898142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26554ab-ae65-4016-ab67-10a15aabcf9c None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.899925 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 699/1403] 10.222.0.70 () {54 vars in 943 bytes} [Sun Aug 28 18:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:48.906788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751cf31-19b9-4575-9835-06bd97feb2f6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:48.907155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751cf31-19b9-4575-9835-06bd97feb2f6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:48.907499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751cf31-19b9-4575-9835-06bd97feb2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:48.938187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:48.955617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26554ab-ae65-4016-ab67-10a15aabcf9c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:48.957135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a26554ab-ae65-4016-ab67-10a15aabcf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:48.987032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7751cf31-19b9-4575-9835-06bd97feb2f6 None None] MFA Rules not processed for user `8787e53dd76c430e9ebe69b79b69827e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:48.988234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7751cf31-19b9-4575-9835-06bd97feb2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:49.097898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:49.102579 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 705/1404] 10.222.0.70 () {58 vars in 1040 bytes} [Sun Aug 28 18:42:48 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:49.109815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26554ab-ae65-4016-ab67-10a15aabcf9c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:49.112787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751cf31-19b9-4575-9835-06bd97feb2f6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:49.122772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751cf31-19b9-4575-9835-06bd97feb2f6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:49.200996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:49.242982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be186e5-c7eb-4dc0-b38d-2ff3a129ea60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:49.243696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be186e5-c7eb-4dc0-b38d-2ff3a129ea60 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:49.243980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be186e5-c7eb-4dc0-b38d-2ff3a129ea60 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:49.244254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be186e5-c7eb-4dc0-b38d-2ff3a129ea60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:49.246615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2be186e5-c7eb-4dc0-b38d-2ff3a129ea60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:49.246822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f40e6-b443-4f13-b272-4d34233d5e41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:49.247462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f40e6-b443-4f13-b272-4d34233d5e41 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:49.247724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f40e6-b443-4f13-b272-4d34233d5e41 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:49.247987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f40e6-b443-4f13-b272-4d34233d5e41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:49.249579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7e4f40e6-b443-4f13-b272-4d34233d5e41 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:49.338583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f40e6-b443-4f13-b272-4d34233d5e41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:49.341135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f40e6-b443-4f13-b272-4d34233d5e41 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:49.342515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be186e5-c7eb-4dc0-b38d-2ff3a129ea60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:49.344168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be186e5-c7eb-4dc0-b38d-2ff3a129ea60 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:49.349632 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 706/1405] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 18:42:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 18:42:49.355124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:49.364032 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 700/1406] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:42:51.395126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4cdfb-c9f6-43c0-b458-d1831bf3e50d None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:51.395726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4cdfb-c9f6-43c0-b458-d1831bf3e50d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:51.395726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4cdfb-c9f6-43c0-b458-d1831bf3e50d None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:51.397028 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 707/1407] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:42:51.402910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d81e90-1e14-45e9-b687-9954d5303a99 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:51.403353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d81e90-1e14-45e9-b687-9954d5303a99 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:51.403460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d81e90-1e14-45e9-b687-9954d5303a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:51.478545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-83d81e90-1e14-45e9-b687-9954d5303a99 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:42:51.480568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-83d81e90-1e14-45e9-b687-9954d5303a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:51.606794 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 701/1408] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:42:51.892765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4cdfb-c9f6-43c0-b458-d1831bf3e50d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:42:51.894459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d7d4cdfb-c9f6-43c0-b458-d1831bf3e50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:52.006520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:52.055752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4cdfb-c9f6-43c0-b458-d1831bf3e50d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:42:52.183130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310901a-87ad-4246-b38e-bd1717629a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:42:52.183662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310901a-87ad-4246-b38e-bd1717629a96 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:42:52.183948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310901a-87ad-4246-b38e-bd1717629a96 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:42:52.184218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310901a-87ad-4246-b38e-bd1717629a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:42:52.185886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d310901a-87ad-4246-b38e-bd1717629a96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:42:52.268132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:42:52.287079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310901a-87ad-4246-b38e-bd1717629a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:42:52.288787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310901a-87ad-4246-b38e-bd1717629a96 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:42:52.312297 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 708/1409] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:01.595396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=67 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:02.309192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=13 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:12.742107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e53ddb-7593-4030-961e-9a02cf5ae838 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:12.742727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e53ddb-7593-4030-961e-9a02cf5ae838 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:12.742727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e53ddb-7593-4030-961e-9a02cf5ae838 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:12.744781 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 702/1410] 10.222.0.70 () {54 vars in 918 bytes} [Sun Aug 28 18:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:12.749749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a03f6-6cb9-4e6f-8408-8c7ce5e9a222 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:12.750189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a03f6-6cb9-4e6f-8408-8c7ce5e9a222 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:12.750294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a03f6-6cb9-4e6f-8408-8c7ce5e9a222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:12.825666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cb9a03f6-6cb9-4e6f-8408-8c7ce5e9a222 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:12.826892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cb9a03f6-6cb9-4e6f-8408-8c7ce5e9a222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:12.930828 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 709/1411] 10.222.0.70 () {58 vars in 1015 bytes} [Sun Aug 28 18:43:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:43:12.944979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc8f8f-ca5f-45e8-9747-d7205ae7d19e None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:12.945265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc8f8f-ca5f-45e8-9747-d7205ae7d19e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:12.945537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc8f8f-ca5f-45e8-9747-d7205ae7d19e None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:12.946876 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 703/1412] 10.222.0.70 () {54 vars in 918 bytes} [Sun Aug 28 18:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:12.951450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bafe8-bf69-4f5a-a0b6-06088365b6e4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:12.951762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bafe8-bf69-4f5a-a0b6-06088365b6e4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:12.952037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bafe8-bf69-4f5a-a0b6-06088365b6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:13.024748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:13.028325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-be2bafe8-bf69-4f5a-a0b6-06088365b6e4 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:13.030224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-be2bafe8-bf69-4f5a-a0b6-06088365b6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:13.146726 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 710/1413] 10.222.0.70 () {58 vars in 1015 bytes} [Sun Aug 28 18:43:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:15.508206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dd6c2-b8b5-46ad-a29f-8dc5c786115c None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:15.508759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dd6c2-b8b5-46ad-a29f-8dc5c786115c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:15.508759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dd6c2-b8b5-46ad-a29f-8dc5c786115c None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:15.510931 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:15.516090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c4c62-9719-4827-9fea-0e6f5692d8d4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:15.516522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c4c62-9719-4827-9fea-0e6f5692d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:15.516672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c4c62-9719-4827-9fea-0e6f5692d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:15.584704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d28c4c62-9719-4827-9fea-0e6f5692d8d4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:15.585914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d28c4c62-9719-4827-9fea-0e6f5692d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:15.642061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:15.684088 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:15.983570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dd6c2-b8b5-46ad-a29f-8dc5c786115c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:15.985101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-579dd6c2-b8b5-46ad-a29f-8dc5c786115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:16.131602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dd6c2-b8b5-46ad-a29f-8dc5c786115c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:16.203396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:16.243316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ade4f4-8e9a-4789-9c40-0a2639b81301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:16.244013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ade4f4-8e9a-4789-9c40-0a2639b81301 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:16.244293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ade4f4-8e9a-4789-9c40-0a2639b81301 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:16.244561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ade4f4-8e9a-4789-9c40-0a2639b81301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:16.246121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f2ade4f4-8e9a-4789-9c40-0a2639b81301 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:16.334000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ade4f4-8e9a-4789-9c40-0a2639b81301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:16.335608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ade4f4-8e9a-4789-9c40-0a2639b81301 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:16.353734 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 705/1416] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:17.238902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea83dc2-59dc-47a1-8001-a8700d9568a1 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:17.239335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea83dc2-59dc-47a1-8001-a8700d9568a1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:17.239335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea83dc2-59dc-47a1-8001-a8700d9568a1 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:17.240733 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:17.245942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70959330-f9d2-42d4-8f5f-f7dccaec9202 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:17.246359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70959330-f9d2-42d4-8f5f-f7dccaec9202 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:17.246511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70959330-f9d2-42d4-8f5f-f7dccaec9202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:17.324344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-70959330-f9d2-42d4-8f5f-f7dccaec9202 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:17.325548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-70959330-f9d2-42d4-8f5f-f7dccaec9202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:17.351783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:17.421357 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:17.576039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea83dc2-59dc-47a1-8001-a8700d9568a1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:17.577619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0ea83dc2-59dc-47a1-8001-a8700d9568a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:17.719220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea83dc2-59dc-47a1-8001-a8700d9568a1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:17.759156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:17.832376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b332ff-8986-4ec5-9f9e-bb89a1f94091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:17.832980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b332ff-8986-4ec5-9f9e-bb89a1f94091 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:17.833264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b332ff-8986-4ec5-9f9e-bb89a1f94091 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:17.833539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b332ff-8986-4ec5-9f9e-bb89a1f94091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:17.835161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-98b332ff-8986-4ec5-9f9e-bb89a1f94091 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:17.924511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b332ff-8986-4ec5-9f9e-bb89a1f94091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:17.926098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b332ff-8986-4ec5-9f9e-bb89a1f94091 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:17.944725 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 713/1419] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:18.835163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c72a0-d9c0-491f-8a0e-0f92fa8d53a8 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:18.835689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c72a0-d9c0-491f-8a0e-0f92fa8d53a8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:18.835689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c72a0-d9c0-491f-8a0e-0f92fa8d53a8 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:18.836977 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:18.842414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe751e6-493f-4d33-9040-11675a668e0c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:18.842876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe751e6-493f-4d33-9040-11675a668e0c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:18.842989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe751e6-493f-4d33-9040-11675a668e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:18.896953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:18.920013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cbe751e6-493f-4d33-9040-11675a668e0c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:18.921199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cbe751e6-493f-4d33-9040-11675a668e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:19.016895 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:19.167774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c72a0-d9c0-491f-8a0e-0f92fa8d53a8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:19.169210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a48c72a0-d9c0-491f-8a0e-0f92fa8d53a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:19.317205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c72a0-d9c0-491f-8a0e-0f92fa8d53a8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:19.330308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:19.434097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66e054-dc8d-451e-9471-8540c7f626e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:19.434619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66e054-dc8d-451e-9471-8540c7f626e9 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:19.434932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66e054-dc8d-451e-9471-8540c7f626e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:19.435204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66e054-dc8d-451e-9471-8540c7f626e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:19.436785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cc66e054-dc8d-451e-9471-8540c7f626e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:19.524704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66e054-dc8d-451e-9471-8540c7f626e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:19.526990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66e054-dc8d-451e-9471-8540c7f626e9 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:19.546058 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 708/1422] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:20.401851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3fe2c-5506-41ca-af33-ef5f4e46c7ec None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:20.402393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3fe2c-5506-41ca-af33-ef5f4e46c7ec None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:20.402393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3fe2c-5506-41ca-af33-ef5f4e46c7ec None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:20.403760 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:20.408575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ae7ec-5ce3-4c3c-84de-f7ad0b882371 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:20.408981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ae7ec-5ce3-4c3c-84de-f7ad0b882371 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:20.409126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ae7ec-5ce3-4c3c-84de-f7ad0b882371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:20.429155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:20.487038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-240ae7ec-5ce3-4c3c-84de-f7ad0b882371 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:20.488237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-240ae7ec-5ce3-4c3c-84de-f7ad0b882371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:20.589165 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:20.741090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3fe2c-5506-41ca-af33-ef5f4e46c7ec None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:20.742590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-88a3fe2c-5506-41ca-af33-ef5f4e46c7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:20.851394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:20.888687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3fe2c-5506-41ca-af33-ef5f4e46c7ec None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:21.000129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b31174-05da-404d-ad23-2034f0a863c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:21.000737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b31174-05da-404d-ad23-2034f0a863c1 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:21.001015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b31174-05da-404d-ad23-2034f0a863c1 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:21.001286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b31174-05da-404d-ad23-2034f0a863c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:21.002925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b4b31174-05da-404d-ad23-2034f0a863c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:21.078461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:21.092404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b31174-05da-404d-ad23-2034f0a863c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:21.094006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b31174-05da-404d-ad23-2034f0a863c1 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:21.112282 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 716/1425] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:21.983785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddda9b-289b-4833-9381-fec7d52ea6ef None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:21.984316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddda9b-289b-4833-9381-fec7d52ea6ef None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:21.984316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddda9b-289b-4833-9381-fec7d52ea6ef None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:21.985675 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:21.990725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268814f-deaf-4d81-a427-db56463274a2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:21.991146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268814f-deaf-4d81-a427-db56463274a2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:21.991313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268814f-deaf-4d81-a427-db56463274a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:22.066355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e268814f-deaf-4d81-a427-db56463274a2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:22.067584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e268814f-deaf-4d81-a427-db56463274a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:22.166054 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:22.315767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddda9b-289b-4833-9381-fec7d52ea6ef None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:22.317317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b8ddda9b-289b-4833-9381-fec7d52ea6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:22.401291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:22.464930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddda9b-289b-4833-9381-fec7d52ea6ef None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:22.577648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d7701-b34b-4bc5-8eec-f53a3547f549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:22.578289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7701-b34b-4bc5-8eec-f53a3547f549 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:22.578592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7701-b34b-4bc5-8eec-f53a3547f549 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:22.578901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d7701-b34b-4bc5-8eec-f53a3547f549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:22.580495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5b3d7701-b34b-4bc5-8eec-f53a3547f549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:22.628923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:22.670926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d7701-b34b-4bc5-8eec-f53a3547f549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:22.672526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d7701-b34b-4bc5-8eec-f53a3547f549 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:22.690351 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 711/1428] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:23.494841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedbf4e-af91-4a2d-b187-981b005bf29e None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:23.495410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedbf4e-af91-4a2d-b187-981b005bf29e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:23.495410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedbf4e-af91-4a2d-b187-981b005bf29e None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:23.496729 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:23.501812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebc832-cc91-45b9-b9c0-a29120cf7c7f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:23.502244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebc832-cc91-45b9-b9c0-a29120cf7c7f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:23.502355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebc832-cc91-45b9-b9c0-a29120cf7c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:23.582570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-88ebc832-cc91-45b9-b9c0-a29120cf7c7f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:23.583811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-88ebc832-cc91-45b9-b9c0-a29120cf7c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:23.683629 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:23.835964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedbf4e-af91-4a2d-b187-981b005bf29e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:23.838005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ebedbf4e-af91-4a2d-b187-981b005bf29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:23.887628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:23.986987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedbf4e-af91-4a2d-b187-981b005bf29e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:24.098537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bd72a-2229-4726-8c38-6bdb000b8bb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:24.099086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bd72a-2229-4726-8c38-6bdb000b8bb5 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:24.099391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bd72a-2229-4726-8c38-6bdb000b8bb5 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:24.099660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bd72a-2229-4726-8c38-6bdb000b8bb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:24.101226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c46bd72a-2229-4726-8c38-6bdb000b8bb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:24.108344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:24.190315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bd72a-2229-4726-8c38-6bdb000b8bb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:24.191920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bd72a-2229-4726-8c38-6bdb000b8bb5 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:24.210262 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 719/1431] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:25.015653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c6315-ab8d-4d4f-995f-b7384c2af6cb None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:25.016176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c6315-ab8d-4d4f-995f-b7384c2af6cb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:25.016277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c6315-ab8d-4d4f-995f-b7384c2af6cb None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:25.017592 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:25.022603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14431ec6-01b8-46ad-acfe-a3688dd0fe43 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:25.023050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14431ec6-01b8-46ad-acfe-a3688dd0fe43 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:25.023197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14431ec6-01b8-46ad-acfe-a3688dd0fe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:25.099002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-14431ec6-01b8-46ad-acfe-a3688dd0fe43 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:25.100198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-14431ec6-01b8-46ad-acfe-a3688dd0fe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:25.168660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:25.198376 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:25.350415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c6315-ab8d-4d4f-995f-b7384c2af6cb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:25.351961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1c6c6315-ab8d-4d4f-995f-b7384c2af6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:25.369871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:25.499280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c6315-ab8d-4d4f-995f-b7384c2af6cb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:25.587215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:25.613644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f47990-3848-4e32-b1a0-ea3b63dc0ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:25.614258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f47990-3848-4e32-b1a0-ea3b63dc0ba2 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:25.614541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f47990-3848-4e32-b1a0-ea3b63dc0ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:25.614842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f47990-3848-4e32-b1a0-ea3b63dc0ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:25.616432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c7f47990-3848-4e32-b1a0-ea3b63dc0ba2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:25.707150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f47990-3848-4e32-b1a0-ea3b63dc0ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:25.708734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f47990-3848-4e32-b1a0-ea3b63dc0ba2 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:25.726227 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 714/1434] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:26.530305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a016b6-4ca4-4d2b-9bac-383f11b6170a None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:26.530885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a016b6-4ca4-4d2b-9bac-383f11b6170a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:26.530885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a016b6-4ca4-4d2b-9bac-383f11b6170a None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:26.532250 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:26.537291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43637e-6ef2-46f3-bfeb-f284e6cd524a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:26.537691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43637e-6ef2-46f3-bfeb-f284e6cd524a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:26.537852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43637e-6ef2-46f3-bfeb-f284e6cd524a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:26.616863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bb43637e-6ef2-46f3-bfeb-f284e6cd524a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:26.618064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bb43637e-6ef2-46f3-bfeb-f284e6cd524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:26.659734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:26.716281 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:26.866470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a016b6-4ca4-4d2b-9bac-383f11b6170a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:26.867926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-87a016b6-4ca4-4d2b-9bac-383f11b6170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:27.014410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a016b6-4ca4-4d2b-9bac-383f11b6170a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:27.067364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:27.125965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86084b8c-c199-435c-b000-1ce06e8968dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:27.126530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86084b8c-c199-435c-b000-1ce06e8968dc service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:27.126865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86084b8c-c199-435c-b000-1ce06e8968dc service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:27.127112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86084b8c-c199-435c-b000-1ce06e8968dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:27.128855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-86084b8c-c199-435c-b000-1ce06e8968dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:27.217448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86084b8c-c199-435c-b000-1ce06e8968dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:27.219058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86084b8c-c199-435c-b000-1ce06e8968dc service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:27.236751 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 722/1437] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:28.033455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9de222-2ba9-4353-8856-0f6daee3d041 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:28.034020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9de222-2ba9-4353-8856-0f6daee3d041 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:28.034020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9de222-2ba9-4353-8856-0f6daee3d041 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:28.035463 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:28.041024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a28858-d1ca-4b12-8ba6-083f7cd3feb0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:28.041458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a28858-d1ca-4b12-8ba6-083f7cd3feb0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:28.041622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a28858-d1ca-4b12-8ba6-083f7cd3feb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:28.119946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-00a28858-d1ca-4b12-8ba6-083f7cd3feb0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:28.121138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-00a28858-d1ca-4b12-8ba6-083f7cd3feb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:28.123150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:28.220114 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:28.371766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9de222-2ba9-4353-8856-0f6daee3d041 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:28.373195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ec9de222-2ba9-4353-8856-0f6daee3d041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:28.519896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9de222-2ba9-4353-8856-0f6daee3d041 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:28.548345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:28.637953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c2ada-8a62-4bf4-bf97-2c7607400e88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:28.638483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c2ada-8a62-4bf4-bf97-2c7607400e88 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:28.638787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c2ada-8a62-4bf4-bf97-2c7607400e88 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:28.639068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c2ada-8a62-4bf4-bf97-2c7607400e88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:28.640655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8d5c2ada-8a62-4bf4-bf97-2c7607400e88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:28.731424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c2ada-8a62-4bf4-bf97-2c7607400e88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:28.733018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c2ada-8a62-4bf4-bf97-2c7607400e88 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:28.751357 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 717/1440] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:30.557611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f6011-cf77-4951-8df4-bff26fdcc1fa None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:30.558208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f6011-cf77-4951-8df4-bff26fdcc1fa None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:30.558208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f6011-cf77-4951-8df4-bff26fdcc1fa None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:30.559535 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:30.565041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1412e7-215c-45b6-9f03-7a92fd7322db None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:30.565482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1412e7-215c-45b6-9f03-7a92fd7322db None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:30.565626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1412e7-215c-45b6-9f03-7a92fd7322db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:30.606776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:30.632876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7b1412e7-215c-45b6-9f03-7a92fd7322db None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:30.634190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7b1412e7-215c-45b6-9f03-7a92fd7322db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:30.730303 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:31.014695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f6011-cf77-4951-8df4-bff26fdcc1fa None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:31.016230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fd1f6011-cf77-4951-8df4-bff26fdcc1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:31.120388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f6011-cf77-4951-8df4-bff26fdcc1fa None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:31.152515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:31.194604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e20e3-cb52-45c3-9b3f-ec004b197691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:31.195241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e20e3-cb52-45c3-9b3f-ec004b197691 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:31.195524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e20e3-cb52-45c3-9b3f-ec004b197691 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:31.195800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e20e3-cb52-45c3-9b3f-ec004b197691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:31.197953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2a9e20e3-cb52-45c3-9b3f-ec004b197691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:31.306590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e20e3-cb52-45c3-9b3f-ec004b197691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:31.307984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e20e3-cb52-45c3-9b3f-ec004b197691 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:31.326442 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 725/1443] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:33.428779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce84e7-1140-4c29-95e2-d6087d3f340f None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:33.429372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce84e7-1140-4c29-95e2-d6087d3f340f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:33.429372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce84e7-1140-4c29-95e2-d6087d3f340f None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:33.431413 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:33.436917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04877d9-484a-48da-825f-79a7c3dda73c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:33.437372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04877d9-484a-48da-825f-79a7c3dda73c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:33.437480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04877d9-484a-48da-825f-79a7c3dda73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:33.502533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e04877d9-484a-48da-825f-79a7c3dda73c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:33.503701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e04877d9-484a-48da-825f-79a7c3dda73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:33.516954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:33.605856 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:33.901266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce84e7-1140-4c29-95e2-d6087d3f340f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:33.902876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-57ce84e7-1140-4c29-95e2-d6087d3f340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:34.008416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce84e7-1140-4c29-95e2-d6087d3f340f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:34.020438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:34.084581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a6efd-c58c-4780-bac9-aec6799631d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:34.085191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a6efd-c58c-4780-bac9-aec6799631d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:34.085484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a6efd-c58c-4780-bac9-aec6799631d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:34.085760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a6efd-c58c-4780-bac9-aec6799631d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:34.088201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ec8a6efd-c58c-4780-bac9-aec6799631d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:34.198990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a6efd-c58c-4780-bac9-aec6799631d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:34.200349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a6efd-c58c-4780-bac9-aec6799631d6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:34.219076 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 720/1446] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:36.418909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39941d6c-cf61-4e06-afa0-60113ef5cb2f None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:36.419488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39941d6c-cf61-4e06-afa0-60113ef5cb2f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:36.419488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39941d6c-cf61-4e06-afa0-60113ef5cb2f None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:36.420889 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:36.426085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35325879-ed5a-4888-b6fb-a35defd3c55b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:36.426464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35325879-ed5a-4888-b6fb-a35defd3c55b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:36.426642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35325879-ed5a-4888-b6fb-a35defd3c55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:36.474643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:36.494937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-35325879-ed5a-4888-b6fb-a35defd3c55b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:36.496166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-35325879-ed5a-4888-b6fb-a35defd3c55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:36.592455 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:36.875054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39941d6c-cf61-4e06-afa0-60113ef5cb2f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:36.876605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-39941d6c-cf61-4e06-afa0-60113ef5cb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:36.981231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39941d6c-cf61-4e06-afa0-60113ef5cb2f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:37.021400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:37.056650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c103b6-cd80-4a7b-b396-bc405e41488b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:37.057257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c103b6-cd80-4a7b-b396-bc405e41488b service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:37.057539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c103b6-cd80-4a7b-b396-bc405e41488b service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:37.057816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c103b6-cd80-4a7b-b396-bc405e41488b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:37.059448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-54c103b6-cd80-4a7b-b396-bc405e41488b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:37.169029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c103b6-cd80-4a7b-b396-bc405e41488b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:37.170386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c103b6-cd80-4a7b-b396-bc405e41488b service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:37.189274 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 728/1449] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:39.250356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c5543-4e2f-4e66-8693-df68db0ca28c None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:39.250951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c5543-4e2f-4e66-8693-df68db0ca28c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:39.250951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c5543-4e2f-4e66-8693-df68db0ca28c None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:39.252357 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:39.258003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf0fd-9363-41b5-a324-214b54cda81a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:39.258453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf0fd-9363-41b5-a324-214b54cda81a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:39.258721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cf0fd-9363-41b5-a324-214b54cda81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:39.323520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ab2cf0fd-9363-41b5-a324-214b54cda81a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:39.324714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ab2cf0fd-9363-41b5-a324-214b54cda81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:39.345362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:39.421595 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:39.703205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c5543-4e2f-4e66-8693-df68db0ca28c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:39.704711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-511c5543-4e2f-4e66-8693-df68db0ca28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:39.808687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c5543-4e2f-4e66-8693-df68db0ca28c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:39.827980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:39.885150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64653d95-5f69-4161-9c66-6e03af75adf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:39.885747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64653d95-5f69-4161-9c66-6e03af75adf6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:39.886248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64653d95-5f69-4161-9c66-6e03af75adf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:39.886378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64653d95-5f69-4161-9c66-6e03af75adf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:39.887946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-64653d95-5f69-4161-9c66-6e03af75adf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:40.000265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64653d95-5f69-4161-9c66-6e03af75adf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:40.001713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64653d95-5f69-4161-9c66-6e03af75adf6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:40.020334 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 723/1452] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:41.960906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95386740-d6bd-4c2e-9c8e-bd917273228b None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:41.961987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95386740-d6bd-4c2e-9c8e-bd917273228b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:41.962100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95386740-d6bd-4c2e-9c8e-bd917273228b None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:41.963438 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:41.968694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec4b90-2457-44a9-b9ea-15673374c507 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:41.969139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec4b90-2457-44a9-b9ea-15673374c507 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:41.969262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec4b90-2457-44a9-b9ea-15673374c507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:42.039411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:42.042548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-edec4b90-2457-44a9-b9ea-15673374c507 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:42.044354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-edec4b90-2457-44a9-b9ea-15673374c507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:42.141522 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:42.432418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95386740-d6bd-4c2e-9c8e-bd917273228b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:42.433967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-95386740-d6bd-4c2e-9c8e-bd917273228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:42.536310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95386740-d6bd-4c2e-9c8e-bd917273228b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:42.586801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:42.612034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f796f94-d7ea-437e-9a99-90c0262a4cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:42.612638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f796f94-d7ea-437e-9a99-90c0262a4cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:42.612914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f796f94-d7ea-437e-9a99-90c0262a4cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:42.613179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f796f94-d7ea-437e-9a99-90c0262a4cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:42.614778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7f796f94-d7ea-437e-9a99-90c0262a4cf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:42.723341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f796f94-d7ea-437e-9a99-90c0262a4cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:42.724715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f796f94-d7ea-437e-9a99-90c0262a4cf0 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:42.744728 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 731/1455] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:44.726861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58135c-f2e4-4b8a-8299-af8443b490a4 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:44.727503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58135c-f2e4-4b8a-8299-af8443b490a4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:44.727503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58135c-f2e4-4b8a-8299-af8443b490a4 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:44.728747 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:44.734044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7d15d-a640-4208-8619-ab84e682a0b8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:44.734471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7d15d-a640-4208-8619-ab84e682a0b8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:44.734576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7d15d-a640-4208-8619-ab84e682a0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:44.799195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-dcd7d15d-a640-4208-8619-ab84e682a0b8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:44.800379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dcd7d15d-a640-4208-8619-ab84e682a0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:44.829085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:44.895668 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:45.177250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58135c-f2e4-4b8a-8299-af8443b490a4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:45.178801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8c58135c-f2e4-4b8a-8299-af8443b490a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:45.283349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58135c-f2e4-4b8a-8299-af8443b490a4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:45.313599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:45.360621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0631956-b609-4cd4-8355-5c4f0b67eebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:45.361260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0631956-b609-4cd4-8355-5c4f0b67eebe service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:45.361540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0631956-b609-4cd4-8355-5c4f0b67eebe service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:45.361812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0631956-b609-4cd4-8355-5c4f0b67eebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:45.363445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b0631956-b609-4cd4-8355-5c4f0b67eebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:45.474726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0631956-b609-4cd4-8355-5c4f0b67eebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:45.476150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0631956-b609-4cd4-8355-5c4f0b67eebe service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:45.495217 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 726/1458] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:47.463967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0f89f-f4da-4292-b476-f6625d42ef65 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:47.464493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0f89f-f4da-4292-b476-f6625d42ef65 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:47.464493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0f89f-f4da-4292-b476-f6625d42ef65 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:47.465827 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:47.471247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea948-cc3b-4b5e-91d2-edace0617aa2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:47.471636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea948-cc3b-4b5e-91d2-edace0617aa2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:47.471802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beea948-cc3b-4b5e-91d2-edace0617aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:47.538609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6beea948-cc3b-4b5e-91d2-edace0617aa2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:47.540130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6beea948-cc3b-4b5e-91d2-edace0617aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:47.548388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:47.639919 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:47.923374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0f89f-f4da-4292-b476-f6625d42ef65 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:47.924934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-57f0f89f-f4da-4292-b476-f6625d42ef65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:48.029665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0f89f-f4da-4292-b476-f6625d42ef65 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:48.083792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:48.102938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02af941-f071-478f-bd3a-cf53fec901d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:48.103543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02af941-f071-478f-bd3a-cf53fec901d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:48.103831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02af941-f071-478f-bd3a-cf53fec901d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:48.104104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02af941-f071-478f-bd3a-cf53fec901d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:48.105681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b02af941-f071-478f-bd3a-cf53fec901d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:48.215767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02af941-f071-478f-bd3a-cf53fec901d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:48.217132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02af941-f071-478f-bd3a-cf53fec901d8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:48.236408 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 734/1461] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:50.181592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560545a0-baea-41cb-bcc5-20768fb4c691 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:50.182180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560545a0-baea-41cb-bcc5-20768fb4c691 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:50.182180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560545a0-baea-41cb-bcc5-20768fb4c691 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:50.183506 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:50.188850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362a466-12cb-4839-a94c-e483ceb01f7d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:50.189260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362a466-12cb-4839-a94c-e483ceb01f7d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:50.189434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362a466-12cb-4839-a94c-e483ceb01f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:50.254039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8362a466-12cb-4839-a94c-e483ceb01f7d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:50.255259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8362a466-12cb-4839-a94c-e483ceb01f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:50.293799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:50.352511 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:50.642380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560545a0-baea-41cb-bcc5-20768fb4c691 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:50.643938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-560545a0-baea-41cb-bcc5-20768fb4c691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:50.751361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560545a0-baea-41cb-bcc5-20768fb4c691 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:50.790200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:50.827152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbe02f-75f9-4ad8-9436-b6dade36f9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:50.827767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbe02f-75f9-4ad8-9436-b6dade36f9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:50.828046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbe02f-75f9-4ad8-9436-b6dade36f9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:50.828318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbe02f-75f9-4ad8-9436-b6dade36f9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:50.829940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fffbe02f-75f9-4ad8-9436-b6dade36f9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:50.938392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbe02f-75f9-4ad8-9436-b6dade36f9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:50.939850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbe02f-75f9-4ad8-9436-b6dade36f9c6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:50.957374 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 729/1464] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:52.867505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50652270-020b-4dbb-be48-6d1d3357b0f4 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:52.868138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50652270-020b-4dbb-be48-6d1d3357b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:52.868138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50652270-020b-4dbb-be48-6d1d3357b0f4 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:52.869316 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:52.874575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b132e-a817-42f1-8df8-92755c74bc0f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:52.875011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b132e-a817-42f1-8df8-92755c74bc0f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:52.875167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b132e-a817-42f1-8df8-92755c74bc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:52.942669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-089b132e-a817-42f1-8df8-92755c74bc0f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:52.943913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-089b132e-a817-42f1-8df8-92755c74bc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:52.963331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:53.043009 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:53.329862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50652270-020b-4dbb-be48-6d1d3357b0f4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:53.331454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-50652270-020b-4dbb-be48-6d1d3357b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:53.437749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50652270-020b-4dbb-be48-6d1d3357b0f4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:53.503709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:53.511346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a96808-b268-4ded-b5d4-a80871658422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:53.511952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a96808-b268-4ded-b5d4-a80871658422 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:53.512229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a96808-b268-4ded-b5d4-a80871658422 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:53.512500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a96808-b268-4ded-b5d4-a80871658422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:53.514070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-13a96808-b268-4ded-b5d4-a80871658422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:53.628104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a96808-b268-4ded-b5d4-a80871658422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:53.629531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a96808-b268-4ded-b5d4-a80871658422 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:53.648630 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 737/1467] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:43:55.554633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27439b-f318-4e6c-b1a9-f25911ae0fa6 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:55.555207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27439b-f318-4e6c-b1a9-f25911ae0fa6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:55.555207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27439b-f318-4e6c-b1a9-f25911ae0fa6 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:55.556426 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:43:55.561601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ab579-421c-46bd-bb4d-5ae1c235a515 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:55.562070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ab579-421c-46bd-bb4d-5ae1c235a515 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:55.562294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ab579-421c-46bd-bb4d-5ae1c235a515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:55.627346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-008ab579-421c-46bd-bb4d-5ae1c235a515 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:43:55.628547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-008ab579-421c-46bd-bb4d-5ae1c235a515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:55.675822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:55.724134 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:43:56.005890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27439b-f318-4e6c-b1a9-f25911ae0fa6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:43:56.007602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9d27439b-f318-4e6c-b1a9-f25911ae0fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:56.110227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27439b-f318-4e6c-b1a9-f25911ae0fa6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:43:56.156876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:43:56.183720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abb1f5-cc5e-479f-aabe-c7ca84c84446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:43:56.184321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abb1f5-cc5e-479f-aabe-c7ca84c84446 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:43:56.184598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abb1f5-cc5e-479f-aabe-c7ca84c84446 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:43:56.184869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abb1f5-cc5e-479f-aabe-c7ca84c84446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:43:56.186423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-29abb1f5-cc5e-479f-aabe-c7ca84c84446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:43:56.294846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abb1f5-cc5e-479f-aabe-c7ca84c84446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:43:56.296203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abb1f5-cc5e-479f-aabe-c7ca84c84446 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:43:56.314194 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 732/1470] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:05.722280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=22 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:06.311981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=66 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:16.143493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf490e2-fcb1-440a-a9f6-a65307b8e10f None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:16.144064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf490e2-fcb1-440a-a9f6-a65307b8e10f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:16.144064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf490e2-fcb1-440a-a9f6-a65307b8e10f None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:16.145454 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 739/1471] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:44:16.151547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12589ef-9bc6-4a30-ae9e-6c41100c392f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:16.151998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12589ef-9bc6-4a30-ae9e-6c41100c392f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:16.152143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12589ef-9bc6-4a30-ae9e-6c41100c392f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:16.219413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a12589ef-9bc6-4a30-ae9e-6c41100c392f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:16.220618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a12589ef-9bc6-4a30-ae9e-6c41100c392f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:16.316615 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 733/1472] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:16.620311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ac9db-1626-4385-9844-ae049e60a416 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:16.620603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ac9db-1626-4385-9844-ae049e60a416 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:16.620879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ac9db-1626-4385-9844-ae049e60a416 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:16.622216 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 740/1473] 10.222.0.70 () {54 vars in 967 bytes} [Sun Aug 28 18:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:44:16.627089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99df36a-26ac-42ac-ab1e-2502b4a859c7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:16.627381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99df36a-26ac-42ac-ab1e-2502b4a859c7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:16.627658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99df36a-26ac-42ac-ab1e-2502b4a859c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:16.702995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f99df36a-26ac-42ac-ab1e-2502b4a859c7 None None] MFA Rules not processed for user `332144d9eb5742498c0c37a70277ce5e`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:16.704182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f99df36a-26ac-42ac-ab1e-2502b4a859c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:16.724365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:16.779721 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 734/1474] 10.222.0.70 () {58 vars in 1064 bytes} [Sun Aug 28 18:44:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:16.787973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ac9db-1626-4385-9844-ae049e60a416 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:16.789552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4c7ac9db-1626-4385-9844-ae049e60a416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:16.891222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ac9db-1626-4385-9844-ae049e60a416 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:16.965800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4f991-ce01-4eb3-a4f1-119db0d75d68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:16.966412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4f991-ce01-4eb3-a4f1-119db0d75d68 service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:16.966726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4f991-ce01-4eb3-a4f1-119db0d75d68 service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:16.967037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4f991-ce01-4eb3-a4f1-119db0d75d68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:16.968682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f7b4f991-ce01-4eb3-a4f1-119db0d75d68 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:17.023417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:17.077907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4f991-ce01-4eb3-a4f1-119db0d75d68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:17.079372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4f991-ce01-4eb3-a4f1-119db0d75d68 service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:17.098299 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 741/1475] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:19.097324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68597f3-c5ef-42da-a173-443152d92e9a None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:19.097934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68597f3-c5ef-42da-a173-443152d92e9a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:19.097934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68597f3-c5ef-42da-a173-443152d92e9a None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:19.099275 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 735/1476] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:44:19.105246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1c7e-3bd6-44ee-96d6-33373a694df9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:19.105692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1c7e-3bd6-44ee-96d6-33373a694df9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:19.105808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1c7e-3bd6-44ee-96d6-33373a694df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:19.171337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8d8b1c7e-3bd6-44ee-96d6-33373a694df9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:19.172533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8d8b1c7e-3bd6-44ee-96d6-33373a694df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:19.267843 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 742/1477] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:19.545360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68597f3-c5ef-42da-a173-443152d92e9a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:19.546913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c68597f3-c5ef-42da-a173-443152d92e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:19.679395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68597f3-c5ef-42da-a173-443152d92e9a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:19.729400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:19.775713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30eed4c-3b5d-4161-9839-81d2279472e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:19.776317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eed4c-3b5d-4161-9839-81d2279472e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:19.776597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eed4c-3b5d-4161-9839-81d2279472e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:19.776872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eed4c-3b5d-4161-9839-81d2279472e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:19.777502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30eed4c-3b5d-4161-9839-81d2279472e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:19.779288 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-e30eed4c-3b5d-4161-9839-81d2279472e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:44:19.779288 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 18:44:19.779288 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 18:44:19.780429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30eed4c-3b5d-4161-9839-81d2279472e0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:19.799583 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 736/1478] 10.222.0.70 () {56 vars in 1108 bytes} [Sun Aug 28 18:44:19 2022] GET /identity/v3/projects => generated 2553 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:44:21.733476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef7e27-93e2-40ba-b5cd-2f506807b95e None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:21.734054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef7e27-93e2-40ba-b5cd-2f506807b95e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:21.734054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef7e27-93e2-40ba-b5cd-2f506807b95e None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:21.735417 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 743/1479] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:44:21.740720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113de211-c832-4b5a-9837-0027f1a08043 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:21.741194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113de211-c832-4b5a-9837-0027f1a08043 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:21.741301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113de211-c832-4b5a-9837-0027f1a08043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:21.807787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-113de211-c832-4b5a-9837-0027f1a08043 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:21.808991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-113de211-c832-4b5a-9837-0027f1a08043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:21.909424 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 737/1480] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:22.210266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef7e27-93e2-40ba-b5cd-2f506807b95e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:22.211805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-76ef7e27-93e2-40ba-b5cd-2f506807b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:22.221268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:22.354594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef7e27-93e2-40ba-b5cd-2f506807b95e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:22.433038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:22.465586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ee9ce-a164-4551-bdab-a5e1d61665a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:22.466147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ee9ce-a164-4551-bdab-a5e1d61665a7 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:22.466426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ee9ce-a164-4551-bdab-a5e1d61665a7 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:22.466693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ee9ce-a164-4551-bdab-a5e1d61665a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:22.468334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3b8ee9ce-a164-4551-bdab-a5e1d61665a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:22.555863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ee9ce-a164-4551-bdab-a5e1d61665a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:22.557446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ee9ce-a164-4551-bdab-a5e1d61665a7 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:22.575428 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 744/1481] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:24.661789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f694-85b0-46fe-86f2-7940b0bdcafc None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:24.662423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f694-85b0-46fe-86f2-7940b0bdcafc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:24.662423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f694-85b0-46fe-86f2-7940b0bdcafc None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:24.663742 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 738/1482] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:44:24.669023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef0164-8bfa-4bc3-9a72-ee80a7012ea7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:24.669440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef0164-8bfa-4bc3-9a72-ee80a7012ea7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:24.669577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef0164-8bfa-4bc3-9a72-ee80a7012ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:24.737535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-65ef0164-8bfa-4bc3-9a72-ee80a7012ea7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:24.738733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-65ef0164-8bfa-4bc3-9a72-ee80a7012ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:24.785940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:24.836469 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 745/1483] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:25.130339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3f694-85b0-46fe-86f2-7940b0bdcafc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:25.132710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a5f3f694-85b0-46fe-86f2-7940b0bdcafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:25.155860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:25.239580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3f694-85b0-46fe-86f2-7940b0bdcafc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:25.315131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55940082-e89e-49ce-822f-068a399b4920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:25.315747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55940082-e89e-49ce-822f-068a399b4920 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:25.316028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55940082-e89e-49ce-822f-068a399b4920 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:25.316299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55940082-e89e-49ce-822f-068a399b4920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:25.317880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-55940082-e89e-49ce-822f-068a399b4920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:25.391765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:25.428157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55940082-e89e-49ce-822f-068a399b4920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:25.429736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55940082-e89e-49ce-822f-068a399b4920 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:25.449760 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 739/1484] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:27.410604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbe480-7b9c-47ea-b31d-6357fc5d8d87 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:27.411166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbe480-7b9c-47ea-b31d-6357fc5d8d87 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:27.411166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbe480-7b9c-47ea-b31d-6357fc5d8d87 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:27.413280 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 746/1485] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:44:27.418437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021ad2-6f10-423e-b185-23ad272a2b15 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:27.418851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021ad2-6f10-423e-b185-23ad272a2b15 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:27.419043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00021ad2-6f10-423e-b185-23ad272a2b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:27.483999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-00021ad2-6f10-423e-b185-23ad272a2b15 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:27.485185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-00021ad2-6f10-423e-b185-23ad272a2b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:27.580520 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 740/1486] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:27.869988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbe480-7b9c-47ea-b31d-6357fc5d8d87 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:27.871555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-efbbe480-7b9c-47ea-b31d-6357fc5d8d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:27.974758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbe480-7b9c-47ea-b31d-6357fc5d8d87 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:28.045448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:28.047101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef32876-268a-49f5-9101-21d368e2d013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:28.047829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef32876-268a-49f5-9101-21d368e2d013 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:28.048093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef32876-268a-49f5-9101-21d368e2d013 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:28.048565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef32876-268a-49f5-9101-21d368e2d013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:28.050871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ef32876-268a-49f5-9101-21d368e2d013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:28.158322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef32876-268a-49f5-9101-21d368e2d013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:28.159713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef32876-268a-49f5-9101-21d368e2d013 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:28.181040 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 747/1487] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:30.228256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88675e77-583b-41e1-a92b-48936cee1435 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:30.228815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88675e77-583b-41e1-a92b-48936cee1435 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:30.228815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88675e77-583b-41e1-a92b-48936cee1435 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:30.230208 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 741/1488] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:44:30.235730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d7d21-c255-4e80-9bfd-df6b4e694310 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:30.236505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d7d21-c255-4e80-9bfd-df6b4e694310 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:30.236783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d7d21-c255-4e80-9bfd-df6b4e694310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:30.304072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cb1d7d21-c255-4e80-9bfd-df6b4e694310 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:30.305266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cb1d7d21-c255-4e80-9bfd-df6b4e694310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:30.357869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:30.403316 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 748/1489] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:30.706836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88675e77-583b-41e1-a92b-48936cee1435 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:30.708515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-88675e77-583b-41e1-a92b-48936cee1435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:30.747979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:30.819592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88675e77-583b-41e1-a92b-48936cee1435 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:30.892711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887375e-9a24-4030-a8ba-94b94b1a44d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:30.893319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887375e-9a24-4030-a8ba-94b94b1a44d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:30.893598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887375e-9a24-4030-a8ba-94b94b1a44d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:30.893974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887375e-9a24-4030-a8ba-94b94b1a44d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:30.895590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a887375e-9a24-4030-a8ba-94b94b1a44d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:30.976842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:31.007277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887375e-9a24-4030-a8ba-94b94b1a44d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:31.008849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887375e-9a24-4030-a8ba-94b94b1a44d6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:31.027456 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 742/1490] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:33.200014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cb660-4723-439d-93c0-4738a4a1fc26 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:33.200578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cb660-4723-439d-93c0-4738a4a1fc26 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:33.200578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cb660-4723-439d-93c0-4738a4a1fc26 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:33.201918 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 749/1491] 10.222.0.70 () {54 vars in 927 bytes} [Sun Aug 28 18:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:44:33.207245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f210fdb-aaed-4b03-acbb-a0693af7e9fe None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:33.207631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f210fdb-aaed-4b03-acbb-a0693af7e9fe None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:33.207802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f210fdb-aaed-4b03-acbb-a0693af7e9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:33.275301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6f210fdb-aaed-4b03-acbb-a0693af7e9fe None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:44:33.276503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6f210fdb-aaed-4b03-acbb-a0693af7e9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:33.373799 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 743/1492] 10.222.0.70 () {58 vars in 1024 bytes} [Sun Aug 28 18:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:44:33.671532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cb660-4723-439d-93c0-4738a4a1fc26 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:44:33.673052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-818cb660-4723-439d-93c0-4738a4a1fc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:33.777312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cb660-4723-439d-93c0-4738a4a1fc26 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:44:33.849854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45790d8-25d9-4c38-ab66-d0df54845093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:44:33.850384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45790d8-25d9-4c38-ab66-d0df54845093 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:44:33.850686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45790d8-25d9-4c38-ab66-d0df54845093 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:44:33.851032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45790d8-25d9-4c38-ab66-d0df54845093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:44:33.852612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c45790d8-25d9-4c38-ab66-d0df54845093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:44:33.861538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:33.970046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45790d8-25d9-4c38-ab66-d0df54845093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:44:33.971515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45790d8-25d9-4c38-ab66-d0df54845093 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:44:33.990038 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 750/1493] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:44:43.372158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=82 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:44:43.987266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=50 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:53.422255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f13ad-8595-4475-9944-3bab224aca6a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:53.423095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f13ad-8595-4475-9944-3bab224aca6a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:53.423095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f13ad-8595-4475-9944-3bab224aca6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:53.499302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-862f13ad-8595-4475-9944-3bab224aca6a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:53.501877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-862f13ad-8595-4475-9944-3bab224aca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:53.599969 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 744/1494] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:53.607933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd40804-2df2-4795-9b45-a0613fa784a9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:53.608422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd40804-2df2-4795-9b45-a0613fa784a9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:53.608545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd40804-2df2-4795-9b45-a0613fa784a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:53.683532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7bd40804-2df2-4795-9b45-a0613fa784a9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:53.684838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7bd40804-2df2-4795-9b45-a0613fa784a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:53.779038 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 751/1495] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:53.784195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f13ad-8595-4475-9944-3bab224aca6a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:53.785387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-862f13ad-8595-4475-9944-3bab224aca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:53.796533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f13ad-8595-4475-9944-3bab224aca6a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:53.859468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:53.896451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ee552-2cfe-48e7-ba6d-b02e66456690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:53.897505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ee552-2cfe-48e7-ba6d-b02e66456690 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:53.898016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ee552-2cfe-48e7-ba6d-b02e66456690 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:53.898857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ee552-2cfe-48e7-ba6d-b02e66456690 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:53.899583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ee552-2cfe-48e7-ba6d-b02e66456690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:45:53.900074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ee552-2cfe-48e7-ba6d-b02e66456690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:53.901449 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-a64ee552-2cfe-48e7-ba6d-b02e66456690 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:45:53.901449 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 18:45:53.901449 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 18:45:53.903006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ee552-2cfe-48e7-ba6d-b02e66456690 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:53.915077 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 745/1496] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:45:53.923385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd40804-2df2-4795-9b45-a0613fa784a9 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:53.933165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd40804-2df2-4795-9b45-a0613fa784a9 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:53.993544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:54.026963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9964b38-dd15-4dc9-b9fb-b5e66e7d5b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:54.027574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9964b38-dd15-4dc9-b9fb-b5e66e7d5b62 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:54.027858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9964b38-dd15-4dc9-b9fb-b5e66e7d5b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:54.028134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9964b38-dd15-4dc9-b9fb-b5e66e7d5b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:54.028771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9964b38-dd15-4dc9-b9fb-b5e66e7d5b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:54.030545 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-b9964b38-dd15-4dc9-b9fb-b5e66e7d5b62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:45:54.030545 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 18:45:54.030545 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 18:45:54.031726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9964b38-dd15-4dc9-b9fb-b5e66e7d5b62 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:54.088188 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 752/1497] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:45:53 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:45:54.092321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ee552-2cfe-48e7-ba6d-b02e66456690 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:54.093824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a64ee552-2cfe-48e7-ba6d-b02e66456690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:54.126366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ee552-2cfe-48e7-ba6d-b02e66456690 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:54.220418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff021c7e-b8d1-410e-b8da-394500ca0764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:54.221585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff021c7e-b8d1-410e-b8da-394500ca0764 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:54.221863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff021c7e-b8d1-410e-b8da-394500ca0764 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:54.222129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff021c7e-b8d1-410e-b8da-394500ca0764 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:54.222763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff021c7e-b8d1-410e-b8da-394500ca0764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:54.223775 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-ff021c7e-b8d1-410e-b8da-394500ca0764 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:45:54.223775 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 18:45:54.223775 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 18:45:54.224970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff021c7e-b8d1-410e-b8da-394500ca0764 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:54.265536 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 746/1498] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:45:54 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:45:54.270155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9964b38-dd15-4dc9-b9fb-b5e66e7d5b62 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:54.271690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b9964b38-dd15-4dc9-b9fb-b5e66e7d5b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:54.335234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9964b38-dd15-4dc9-b9fb-b5e66e7d5b62 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:54.419025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:54.431918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8d72c-f9f9-461c-bb15-d33385940507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:54.432527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d72c-f9f9-461c-bb15-d33385940507 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:54.432807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d72c-f9f9-461c-bb15-d33385940507 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:54.433080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d72c-f9f9-461c-bb15-d33385940507 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:54.433721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8d72c-f9f9-461c-bb15-d33385940507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:54.434787 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-76f8d72c-f9f9-461c-bb15-d33385940507 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:45:54.434787 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 18:45:54.434787 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 18:45:54.435687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8d72c-f9f9-461c-bb15-d33385940507 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:54.448053 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 753/1499] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:45:54.452105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff021c7e-b8d1-410e-b8da-394500ca0764 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:54.453642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ff021c7e-b8d1-410e-b8da-394500ca0764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:54.465526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff021c7e-b8d1-410e-b8da-394500ca0764 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:54.491022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:54.563167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2bbce-05bf-4d5a-9b8d-14408b62350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:54.563785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2bbce-05bf-4d5a-9b8d-14408b62350f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:54.564065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2bbce-05bf-4d5a-9b8d-14408b62350f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:54.564375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2bbce-05bf-4d5a-9b8d-14408b62350f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:54.565158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2bbce-05bf-4d5a-9b8d-14408b62350f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:54.566192 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-a1d2bbce-05bf-4d5a-9b8d-14408b62350f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:45:54.566192 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 18:45:54.566192 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 18:45:54.567157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2bbce-05bf-4d5a-9b8d-14408b62350f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:54.581112 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 747/1500] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:45:54.584932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8d72c-f9f9-461c-bb15-d33385940507 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:54.586491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-76f8d72c-f9f9-461c-bb15-d33385940507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:54.620161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8d72c-f9f9-461c-bb15-d33385940507 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:54.712181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3c54a-752b-41a8-9c95-1b44bfc87ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:54.712831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3c54a-752b-41a8-9c95-1b44bfc87ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:54.713115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3c54a-752b-41a8-9c95-1b44bfc87ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:54.713374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3c54a-752b-41a8-9c95-1b44bfc87ee8 admin admin] PATH_INFO: `/v3/projects/6c3df826a01544e4a009ee515ef41343/users/a7d59ba64cf34848b50422737ab4890f/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:54.734680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3c54a-752b-41a8-9c95-1b44bfc87ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3df826a01544e4a009ee515ef41343, user_id=a7d59ba64cf34848b50422737ab4890f, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:54.735733 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-2dd3c54a-752b-41a8-9c95-1b44bfc87ee8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:45:54.735733 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 18:45:54.735733 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 18:45:54.738277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3c54a-752b-41a8-9c95-1b44bfc87ee8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:54.763132 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 754/1501] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:45:54 2022] PUT /identity/v3/projects/6c3df826a01544e4a009ee515ef41343/users/a7d59ba64cf34848b50422737ab4890f/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:54.775475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a4dfe-6391-41f1-b0d7-dd0e9da890c8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:54.775823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a4dfe-6391-41f1-b0d7-dd0e9da890c8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:54.776110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a4dfe-6391-41f1-b0d7-dd0e9da890c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:54.834037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-311a4dfe-6391-41f1-b0d7-dd0e9da890c8 None None] MFA Rules not processed for user `a7d59ba64cf34848b50422737ab4890f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:54.835280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-311a4dfe-6391-41f1-b0d7-dd0e9da890c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:54.915151 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 748/1502] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:45:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:54.928993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90f9ee-58ce-457c-bb35-32c88cbbd656 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:54.929282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90f9ee-58ce-457c-bb35-32c88cbbd656 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:54.929559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90f9ee-58ce-457c-bb35-32c88cbbd656 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:54.930927 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 755/1503] 10.222.0.70 () {54 vars in 964 bytes} [Sun Aug 28 18:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:45:54.935966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a8480-671c-43e2-9d9c-d05a7944e254 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:54.936287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a8480-671c-43e2-9d9c-d05a7944e254 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:54.936631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a8480-671c-43e2-9d9c-d05a7944e254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:54.975156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:55.022994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a89a8480-671c-43e2-9d9c-d05a7944e254 None None] MFA Rules not processed for user `afece3fa01d040a1ae8e035ea3ff3219`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:55.024210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a89a8480-671c-43e2-9d9c-d05a7944e254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:55.100108 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 749/1504] 10.222.0.70 () {58 vars in 1061 bytes} [Sun Aug 28 18:45:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:55.107737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90f9ee-58ce-457c-bb35-32c88cbbd656 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:55.109221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1f90f9ee-58ce-457c-bb35-32c88cbbd656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:55.158480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:55.212432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90f9ee-58ce-457c-bb35-32c88cbbd656 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:55.284828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cc27c-fb1a-4414-90af-0f1d7f4450dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:55.285430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cc27c-fb1a-4414-90af-0f1d7f4450dd service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:55.285711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cc27c-fb1a-4414-90af-0f1d7f4450dd service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:55.285985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cc27c-fb1a-4414-90af-0f1d7f4450dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:55.287596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aa4cc27c-fb1a-4414-90af-0f1d7f4450dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:55.385975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cc27c-fb1a-4414-90af-0f1d7f4450dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:55.387419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cc27c-fb1a-4414-90af-0f1d7f4450dd service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:55.390817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:55.405680 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 756/1505] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:45:55.451231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5763b-ed2f-43b2-81ed-bbba9a0f1473 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:55.451546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5763b-ed2f-43b2-81ed-bbba9a0f1473 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:55.451842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5763b-ed2f-43b2-81ed-bbba9a0f1473 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:55.453058 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 750/1506] 10.222.0.70 () {52 vars in 830 bytes} [Sun Aug 28 18:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:45:55.457171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cc27c-fb1a-4414-90af-0f1d7f4450dd service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:55.458388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aa4cc27c-fb1a-4414-90af-0f1d7f4450dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:55.557659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cc27c-fb1a-4414-90af-0f1d7f4450dd service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:55.651506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:55.652152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:55.652396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:55.652665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] PATH_INFO: `/v3/users/a7d59ba64cf34848b50422737ab4890f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:55.664733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d59ba64cf34848b50422737ab4890f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:55.665748 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:45:55.665748 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 18:45:55.665748 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 18:45:55.666985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:55.676888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:55.732255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d59ba64cf34848b50422737ab4890f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:55.746133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d59ba64cf34848b50422737ab4890f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:55.746674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d59ba64cf34848b50422737ab4890f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:55.757108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d59ba64cf34848b50422737ab4890f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:55.757574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d59ba64cf34848b50422737ab4890f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:55.786825 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 757/1507] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:45:55 2022] DELETE /identity/v3/users/a7d59ba64cf34848b50422737ab4890f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:45:55.791122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194993d5-f907-4b10-b74f-288f8f32f738 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:55.791410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194993d5-f907-4b10-b74f-288f8f32f738 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:55.791687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194993d5-f907-4b10-b74f-288f8f32f738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:55.850043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-194993d5-f907-4b10-b74f-288f8f32f738 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:45:55.851224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-194993d5-f907-4b10-b74f-288f8f32f738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:55.928836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:55.942508 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 751/1508] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:45:55.952259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:55.953461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:56.053165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4ba4-1d43-4b78-835a-d2bea2fad85a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:56.109686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:45:56.129300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421160b-4d2d-4b8b-8a36-15409aea0cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:56.129903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421160b-4d2d-4b8b-8a36-15409aea0cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:56.130186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421160b-4d2d-4b8b-8a36-15409aea0cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:56.130454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421160b-4d2d-4b8b-8a36-15409aea0cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:56.132043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2421160b-4d2d-4b8b-8a36-15409aea0cf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:56.241912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421160b-4d2d-4b8b-8a36-15409aea0cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:56.243390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421160b-4d2d-4b8b-8a36-15409aea0cf7 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:56.261800 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 758/1509] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:45:56.585678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194993d5-f907-4b10-b74f-288f8f32f738 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:45:56.586953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-194993d5-f907-4b10-b74f-288f8f32f738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:45:56.599275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194993d5-f907-4b10-b74f-288f8f32f738 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:45:56.699648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf571d-29c3-440e-8d35-fc9b5e5475e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:45:56.700202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf571d-29c3-440e-8d35-fc9b5e5475e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:45:56.700480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf571d-29c3-440e-8d35-fc9b5e5475e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:45:56.700752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf571d-29c3-440e-8d35-fc9b5e5475e7 admin admin] PATH_INFO: `/v3/projects/6c3df826a01544e4a009ee515ef41343` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:45:56.711225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf571d-29c3-440e-8d35-fc9b5e5475e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3df826a01544e4a009ee515ef41343)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:45:56.712252 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-43cf571d-29c3-440e-8d35-fc9b5e5475e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:45:56.712252 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 18:45:56.712252 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 18:45:56.713478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf571d-29c3-440e-8d35-fc9b5e5475e7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:45:56.774330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43cf571d-29c3-440e-8d35-fc9b5e5475e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3df826a01544e4a009ee515ef41343', 'request_id': 'req-43cf571d-29c3-440e-8d35-fc9b5e5475e7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:56.784502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43cf571d-29c3-440e-8d35-fc9b5e5475e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3df826a01544e4a009ee515ef41343', 'request_id': 'req-43cf571d-29c3-440e-8d35-fc9b5e5475e7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:56.790980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43cf571d-29c3-440e-8d35-fc9b5e5475e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3df826a01544e4a009ee515ef41343', 'request_id': 'req-43cf571d-29c3-440e-8d35-fc9b5e5475e7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:56.821638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43cf571d-29c3-440e-8d35-fc9b5e5475e7 admin admin] The token cache is being invalidate because project 6c3df826a01544e4a009ee515ef41343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:45:56.821932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43cf571d-29c3-440e-8d35-fc9b5e5475e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:56.822456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43cf571d-29c3-440e-8d35-fc9b5e5475e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:45:56.823795 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 752/1510] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:45:56 2022] DELETE /identity/v3/projects/6c3df826a01544e4a009ee515ef41343 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:46:06.259580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=62 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:46:06.819512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:17.577420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e9cc9-3a7b-4790-a5f3-c8214efc116f None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:17.578013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e9cc9-3a7b-4790-a5f3-c8214efc116f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:17.578013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e9cc9-3a7b-4790-a5f3-c8214efc116f None None] PATH_INFO: `/v3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:17.579277 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 759/1511] 10.222.0.55 () {54 vars in 925 bytes} [Sun Aug 28 18:49:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:17.585421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43084b4e-652f-4107-98d4-2e34fe930054 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:17.585839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43084b4e-652f-4107-98d4-2e34fe930054 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:17.585977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43084b4e-652f-4107-98d4-2e34fe930054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:17.670347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-43084b4e-652f-4107-98d4-2e34fe930054 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:17.671619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-43084b4e-652f-4107-98d4-2e34fe930054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:17.783724 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 753/1512] 10.222.0.55 () {58 vars in 1015 bytes} [Sun Aug 28 18:49:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:49:18.361595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff73d-df87-4e3a-ae75-0666aaa99f54 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:18.361881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff73d-df87-4e3a-ae75-0666aaa99f54 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:18.362182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff73d-df87-4e3a-ae75-0666aaa99f54 None None] PATH_INFO: `/v3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:18.363593 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 760/1513] 10.222.0.85 () {54 vars in 925 bytes} [Sun Aug 28 18:49:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:49:18.369628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435bf68-eedf-432e-962a-c84681308d2b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:18.369967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435bf68-eedf-432e-962a-c84681308d2b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:18.370247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435bf68-eedf-432e-962a-c84681308d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:18.389080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2435bf68-eedf-432e-962a-c84681308d2b None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:18.390267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2435bf68-eedf-432e-962a-c84681308d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:18.399293 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 754/1514] 10.222.0.85 () {58 vars in 1015 bytes} [Sun Aug 28 18:49:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:21.361597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ae5c-a50a-4a07-ae3a-5fc5f8f93b45 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:21.362104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ae5c-a50a-4a07-ae3a-5fc5f8f93b45 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:21.362104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1ae5c-a50a-4a07-ae3a-5fc5f8f93b45 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:21.363414 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 761/1515] 10.222.0.70 () {54 vars in 961 bytes} [Sun Aug 28 18:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:49:21.368960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1371340-4c89-4e8b-94cc-cc0127a298a2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:21.369369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1371340-4c89-4e8b-94cc-cc0127a298a2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:21.369520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1371340-4c89-4e8b-94cc-cc0127a298a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:21.389292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c1371340-4c89-4e8b-94cc-cc0127a298a2 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:21.390481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c1371340-4c89-4e8b-94cc-cc0127a298a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:21.399319 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 755/1516] 10.222.0.70 () {58 vars in 1058 bytes} [Sun Aug 28 18:49:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:21.406865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1ae5c-a50a-4a07-ae3a-5fc5f8f93b45 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:21.421341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1ae5c-a50a-4a07-ae3a-5fc5f8f93b45 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:21.426150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401f0c1-c229-4e44-9de3-5199407dd8bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:21.426727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401f0c1-c229-4e44-9de3-5199407dd8bd service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:21.427032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401f0c1-c229-4e44-9de3-5199407dd8bd service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:21.427303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401f0c1-c229-4e44-9de3-5199407dd8bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:21.436061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401f0c1-c229-4e44-9de3-5199407dd8bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:21.437616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401f0c1-c229-4e44-9de3-5199407dd8bd service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:21.448418 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 762/1517] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:49:21.689653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1371340-4c89-4e8b-94cc-cc0127a298a2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:21.699801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1371340-4c89-4e8b-94cc-cc0127a298a2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:21.704936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138e21b-ec33-4972-b7de-aa0da4c36abe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:21.705543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138e21b-ec33-4972-b7de-aa0da4c36abe service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:21.705829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138e21b-ec33-4972-b7de-aa0da4c36abe service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:21.706110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138e21b-ec33-4972-b7de-aa0da4c36abe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:21.714717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138e21b-ec33-4972-b7de-aa0da4c36abe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:21.716333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138e21b-ec33-4972-b7de-aa0da4c36abe service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:21.726611 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 756/1518] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:49:31.443247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:31.722064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:49:59.218114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f96d97-9c6d-4147-81f7-ac39c0823f27 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:59.218711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f96d97-9c6d-4147-81f7-ac39c0823f27 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:59.218711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f96d97-9c6d-4147-81f7-ac39c0823f27 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:59.220094 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 763/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:49:59.225253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b969ba-05be-424a-95f7-a0c15e1d2937 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:59.225671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b969ba-05be-424a-95f7-a0c15e1d2937 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:59.225843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b969ba-05be-424a-95f7-a0c15e1d2937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:59.285054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-89b969ba-05be-424a-95f7-a0c15e1d2937 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:49:59.286966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-89b969ba-05be-424a-95f7-a0c15e1d2937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:59.363232 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 757/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:49:59.518628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f96d97-9c6d-4147-81f7-ac39c0823f27 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:49:59.521251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-69f96d97-9c6d-4147-81f7-ac39c0823f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:49:59.624574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f96d97-9c6d-4147-81f7-ac39c0823f27 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:49:59.630670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e522cda-19ea-48bd-b7fb-a8e6a43f9106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:49:59.631316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e522cda-19ea-48bd-b7fb-a8e6a43f9106 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:49:59.631600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e522cda-19ea-48bd-b7fb-a8e6a43f9106 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:49:59.631875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e522cda-19ea-48bd-b7fb-a8e6a43f9106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:49:59.639797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e522cda-19ea-48bd-b7fb-a8e6a43f9106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:49:59.641369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e522cda-19ea-48bd-b7fb-a8e6a43f9106 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:49:59.650694 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 764/1521] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:50:00.483579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093be68-c696-4b1e-b164-4ec52858df41 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:00.484156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093be68-c696-4b1e-b164-4ec52858df41 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:00.484156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093be68-c696-4b1e-b164-4ec52858df41 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:00.485472 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 18:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:50:00.490521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8702561-a85d-45c5-a606-174667009ab3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:00.491009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8702561-a85d-45c5-a606-174667009ab3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:00.491109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8702561-a85d-45c5-a606-174667009ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:00.510558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c8702561-a85d-45c5-a606-174667009ab3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:00.511758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c8702561-a85d-45c5-a606-174667009ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:00.519434 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 18:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:00.673789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093be68-c696-4b1e-b164-4ec52858df41 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:00.688810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093be68-c696-4b1e-b164-4ec52858df41 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:00.695011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365aef2-ca2e-485b-b316-b864a794199d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:00.695604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365aef2-ca2e-485b-b316-b864a794199d service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:00.695886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365aef2-ca2e-485b-b316-b864a794199d service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:00.696160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365aef2-ca2e-485b-b316-b864a794199d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:00.704370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365aef2-ca2e-485b-b316-b864a794199d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:00.706007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365aef2-ca2e-485b-b316-b864a794199d service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:00.716225 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 759/1524] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:04.489386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b3d6-2bad-48b2-93c1-40353b4e6c39 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:04.490152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b3d6-2bad-48b2-93c1-40353b4e6c39 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:04.490152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b3d6-2bad-48b2-93c1-40353b4e6c39 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:04.491436 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:50:04.496744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abed35-f7d1-4b74-b98d-8e0aec00abcc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:04.497174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abed35-f7d1-4b74-b98d-8e0aec00abcc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:04.497336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abed35-f7d1-4b74-b98d-8e0aec00abcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:04.517127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-85abed35-f7d1-4b74-b98d-8e0aec00abcc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:04.518332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-85abed35-f7d1-4b74-b98d-8e0aec00abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:04.526250 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:04.812837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b3d6-2bad-48b2-93c1-40353b4e6c39 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:04.814504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4f23b3d6-2bad-48b2-93c1-40353b4e6c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:04.892233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b3d6-2bad-48b2-93c1-40353b4e6c39 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:04.896435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1a2af-ad23-42b7-bd69-b6bbbfd7462f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:04.897036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a2af-ad23-42b7-bd69-b6bbbfd7462f service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:04.897313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a2af-ad23-42b7-bd69-b6bbbfd7462f service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:04.897584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a2af-ad23-42b7-bd69-b6bbbfd7462f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:04.906284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1a2af-ad23-42b7-bd69-b6bbbfd7462f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:04.907722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1a2af-ad23-42b7-bd69-b6bbbfd7462f service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:04.918083 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 767/1527] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:06.814689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a69b88-a113-479d-b20d-5a39464f2f1a None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:06.815276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a69b88-a113-479d-b20d-5a39464f2f1a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:06.815276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a69b88-a113-479d-b20d-5a39464f2f1a None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:06.817365 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 18:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:50:06.822680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2a1d8-56fc-450f-8998-8bd55579aa7e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:06.823153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2a1d8-56fc-450f-8998-8bd55579aa7e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:06.823305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2a1d8-56fc-450f-8998-8bd55579aa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:06.843343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-96b2a1d8-56fc-450f-8998-8bd55579aa7e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:06.844457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-96b2a1d8-56fc-450f-8998-8bd55579aa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:06.852373 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 18:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:50:07.147340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a69b88-a113-479d-b20d-5a39464f2f1a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:50:07.157943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a69b88-a113-479d-b20d-5a39464f2f1a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:50:07.161505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab59d79-26d3-48f6-88ac-d039f6ecb4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:50:07.162095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab59d79-26d3-48f6-88ac-d039f6ecb4df service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:07.162375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab59d79-26d3-48f6-88ac-d039f6ecb4df service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:07.162645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab59d79-26d3-48f6-88ac-d039f6ecb4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:07.172771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab59d79-26d3-48f6-88ac-d039f6ecb4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:50:07.174207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab59d79-26d3-48f6-88ac-d039f6ecb4df service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:50:07.184977 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 762/1530] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:50:16.838787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:17.180465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=65 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:50:57.388007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838ab10-8076-41a2-897c-d180f15f2d88 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:57.388540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838ab10-8076-41a2-897c-d180f15f2d88 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:57.388540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838ab10-8076-41a2-897c-d180f15f2d88 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:57.389922 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 769/1531] 10.222.0.70 () {54 vars in 921 bytes} [Sun Aug 28 18:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:50:57.395959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb920e8-1260-4dcb-8d2d-02d3d5a4b48a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:50:57.396386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb920e8-1260-4dcb-8d2d-02d3d5a4b48a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:50:57.396642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb920e8-1260-4dcb-8d2d-02d3d5a4b48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:50:57.418711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6fb920e8-1260-4dcb-8d2d-02d3d5a4b48a None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:50:57.419986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6fb920e8-1260-4dcb-8d2d-02d3d5a4b48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:50:57.429439 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 763/1532] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:50:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:07.412851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:30.370237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1913c-df4f-497d-ac5e-42142bff4c05 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.370902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1913c-df4f-497d-ac5e-42142bff4c05 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.370902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1913c-df4f-497d-ac5e-42142bff4c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.417656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8ff1913c-df4f-497d-ac5e-42142bff4c05 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:30.419051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8ff1913c-df4f-497d-ac5e-42142bff4c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:30.435151 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 770/1533] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:30.444841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35049b0f-f680-492a-a6db-aca6835bc117 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.445487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35049b0f-f680-492a-a6db-aca6835bc117 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.445487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35049b0f-f680-492a-a6db-aca6835bc117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.472240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4cdfe-38a0-4117-ada5-5a11424f6b19 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.472556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4cdfe-38a0-4117-ada5-5a11424f6b19 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.474511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4cdfe-38a0-4117-ada5-5a11424f6b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.483099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-35049b0f-f680-492a-a6db-aca6835bc117 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:30.487441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-35049b0f-f680-492a-a6db-aca6835bc117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:30.513593 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 764/1534] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:51:30.521281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-33d4cdfe-38a0-4117-ada5-5a11424f6b19 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:30.522514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-33d4cdfe-38a0-4117-ada5-5a11424f6b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:30.525361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35049b0f-f680-492a-a6db-aca6835bc117 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:30.540990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35049b0f-f680-492a-a6db-aca6835bc117 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:30.553548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c283e1-b983-474e-af8d-e6abb1d6bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:30.554303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c283e1-b983-474e-af8d-e6abb1d6bb17 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.554633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c283e1-b983-474e-af8d-e6abb1d6bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.558770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c283e1-b983-474e-af8d-e6abb1d6bb17 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.565736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c283e1-b983-474e-af8d-e6abb1d6bb17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:30.565736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c283e1-b983-474e-af8d-e6abb1d6bb17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:30.566009 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 771/1535] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:30.570773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c283e1-b983-474e-af8d-e6abb1d6bb17 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:30.596334 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 765/1536] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:30.602040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4cdfe-38a0-4117-ada5-5a11424f6b19 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:30.624945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e98754-51f0-4418-9ecc-aa29229c48c9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.628804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e98754-51f0-4418-9ecc-aa29229c48c9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.629227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e98754-51f0-4418-9ecc-aa29229c48c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.635685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4cdfe-38a0-4117-ada5-5a11424f6b19 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:30.655528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80753d4-1a8a-41f6-8127-fa56e76da8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:30.658667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80753d4-1a8a-41f6-8127-fa56e76da8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.659010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80753d4-1a8a-41f6-8127-fa56e76da8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.659255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80753d4-1a8a-41f6-8127-fa56e76da8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.659963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80753d4-1a8a-41f6-8127-fa56e76da8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:30.662184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80753d4-1a8a-41f6-8127-fa56e76da8f6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:30.697237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b7e98754-51f0-4418-9ecc-aa29229c48c9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:30.703182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b7e98754-51f0-4418-9ecc-aa29229c48c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:30.731583 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 766/1537] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:30.731784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24bc2d-8b37-4cfd-96b1-42ef221e9cb2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.732042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24bc2d-8b37-4cfd-96b1-42ef221e9cb2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.732421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24bc2d-8b37-4cfd-96b1-42ef221e9cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.776435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2a24bc2d-8b37-4cfd-96b1-42ef221e9cb2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:30.778410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2a24bc2d-8b37-4cfd-96b1-42ef221e9cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:30.792754 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 772/1538] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:30 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:30.794430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d0f83-d4e3-47c4-a6bb-8559f3946862 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:30.798920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d0f83-d4e3-47c4-a6bb-8559f3946862 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:30.798920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d0f83-d4e3-47c4-a6bb-8559f3946862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:30.799537 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 767/1539] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:30.800924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24bc2d-8b37-4cfd-96b1-42ef221e9cb2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:30.824037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24bc2d-8b37-4cfd-96b1-42ef221e9cb2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:30.850506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-818d0f83-d4e3-47c4-a6bb-8559f3946862 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:30.852428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-818d0f83-d4e3-47c4-a6bb-8559f3946862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.002197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b43966-dfeb-4c20-bb9f-175956f64c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.004551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b43966-dfeb-4c20-bb9f-175956f64c9f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.006498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b43966-dfeb-4c20-bb9f-175956f64c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.007623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b43966-dfeb-4c20-bb9f-175956f64c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.008738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b43966-dfeb-4c20-bb9f-175956f64c9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:31.009911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b43966-dfeb-4c20-bb9f-175956f64c9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.011999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b43966-dfeb-4c20-bb9f-175956f64c9f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.031783 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 768/1540] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:31.033190 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 773/1541] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.033529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b43966-dfeb-4c20-bb9f-175956f64c9f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.040651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1402d-a66f-42c8-b0b0-8749e978e37b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.040939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1402d-a66f-42c8-b0b0-8749e978e37b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.041212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1402d-a66f-42c8-b0b0-8749e978e37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.051985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b43966-dfeb-4c20-bb9f-175956f64c9f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.059990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c562e50-b331-4ad5-988a-9a57d46eb8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.060917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c562e50-b331-4ad5-988a-9a57d46eb8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.061411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c562e50-b331-4ad5-988a-9a57d46eb8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.061907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c562e50-b331-4ad5-988a-9a57d46eb8b4 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.062556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c562e50-b331-4ad5-988a-9a57d46eb8b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.065435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c562e50-b331-4ad5-988a-9a57d46eb8b4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.075512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e6e1402d-a66f-42c8-b0b0-8749e978e37b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:31.076826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e6e1402d-a66f-42c8-b0b0-8749e978e37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.090113 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 774/1542] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.092619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2807de4-6d8a-476b-93c9-ad5dddd0488d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.093321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2807de4-6d8a-476b-93c9-ad5dddd0488d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.093792 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 769/1543] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/users => generated 288 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:31.094494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2807de4-6d8a-476b-93c9-ad5dddd0488d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.095023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621268a7-f5ed-462d-a20d-9d3372e4473b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.095315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621268a7-f5ed-462d-a20d-9d3372e4473b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.095610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621268a7-f5ed-462d-a20d-9d3372e4473b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.116781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b2807de4-6d8a-476b-93c9-ad5dddd0488d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:31.117998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b2807de4-6d8a-476b-93c9-ad5dddd0488d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.121516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-621268a7-f5ed-462d-a20d-9d3372e4473b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:31.122761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-621268a7-f5ed-462d-a20d-9d3372e4473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.127453 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 775/1544] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.128056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2807de4-6d8a-476b-93c9-ad5dddd0488d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.133741 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 770/1545] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.135135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d9ec1-3903-4af4-953a-3efcf08a7c88 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.135426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d9ec1-3903-4af4-953a-3efcf08a7c88 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.135741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d9ec1-3903-4af4-953a-3efcf08a7c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.143043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2807de4-6d8a-476b-93c9-ad5dddd0488d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.151546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf26fd-f6be-4efe-bc28-e385816ebd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.152738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf26fd-f6be-4efe-bc28-e385816ebd5d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.153258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf26fd-f6be-4efe-bc28-e385816ebd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.154162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf26fd-f6be-4efe-bc28-e385816ebd5d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.156294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf26fd-f6be-4efe-bc28-e385816ebd5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.159347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf26fd-f6be-4efe-bc28-e385816ebd5d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.174813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-575d9ec1-3903-4af4-953a-3efcf08a7c88 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:31.175751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-575d9ec1-3903-4af4-953a-3efcf08a7c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.194206 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 771/1546] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.202187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d072cc8-84a6-4802-8fa6-900c210b699f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.202493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d072cc8-84a6-4802-8fa6-900c210b699f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.203166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d072cc8-84a6-4802-8fa6-900c210b699f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.224089 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 776/1547] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:31.225793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf26fd-f6be-4efe-bc28-e385816ebd5d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.233117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9d072cc8-84a6-4802-8fa6-900c210b699f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:31.234511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9d072cc8-84a6-4802-8fa6-900c210b699f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.305212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf26fd-f6be-4efe-bc28-e385816ebd5d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.311031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c65db3-8867-45a7-945e-14e848e27dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.312050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c65db3-8867-45a7-945e-14e848e27dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.312402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c65db3-8867-45a7-945e-14e848e27dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.312733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c65db3-8867-45a7-945e-14e848e27dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.313505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c65db3-8867-45a7-945e-14e848e27dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:31.314548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c65db3-8867-45a7-945e-14e848e27dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.315846 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-32c65db3-8867-45a7-945e-14e848e27dd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:51:31.315846 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 18:51:31.315846 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 18:51:31.316984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c65db3-8867-45a7-945e-14e848e27dd6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.317236 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 772/1548] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.318215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d072cc8-84a6-4802-8fa6-900c210b699f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.331154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d072cc8-84a6-4802-8fa6-900c210b699f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.337503 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 777/1549] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:31.338700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d405e-92af-4e64-9576-5dca826f66fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.338852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37b968-3e42-42b8-a969-85d2f7ccda96 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.339080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37b968-3e42-42b8-a969-85d2f7ccda96 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.339358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37b968-3e42-42b8-a969-85d2f7ccda96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.340096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d405e-92af-4e64-9576-5dca826f66fa admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.340586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d405e-92af-4e64-9576-5dca826f66fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.341052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d405e-92af-4e64-9576-5dca826f66fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.341905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d405e-92af-4e64-9576-5dca826f66fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.343867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d405e-92af-4e64-9576-5dca826f66fa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.356545 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 773/1550] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:31.357789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf416d70-b1db-4e8c-b44a-bbb20068ce9f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.358150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf416d70-b1db-4e8c-b44a-bbb20068ce9f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.358493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf416d70-b1db-4e8c-b44a-bbb20068ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.365668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ea37b968-3e42-42b8-a969-85d2f7ccda96 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:31.367038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ea37b968-3e42-42b8-a969-85d2f7ccda96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.377550 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 778/1551] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.379302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a8289-f3f7-4403-8003-c1467d534d19 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.379618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a8289-f3f7-4403-8003-c1467d534d19 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.379934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a8289-f3f7-4403-8003-c1467d534d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.381054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cf416d70-b1db-4e8c-b44a-bbb20068ce9f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:31.382218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cf416d70-b1db-4e8c-b44a-bbb20068ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.395268 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 774/1552] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.395268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf416d70-b1db-4e8c-b44a-bbb20068ce9f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.402734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf416d70-b1db-4e8c-b44a-bbb20068ce9f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.408454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3cc8d-1164-429d-9a93-4d0f111cf3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.409162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3cc8d-1164-429d-9a93-4d0f111cf3ef admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.409536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3cc8d-1164-429d-9a93-4d0f111cf3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.409890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3cc8d-1164-429d-9a93-4d0f111cf3ef admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.410014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-458a8289-f3f7-4403-8003-c1467d534d19 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:31.410884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3cc8d-1164-429d-9a93-4d0f111cf3ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:31.411223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3cc8d-1164-429d-9a93-4d0f111cf3ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.411411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-458a8289-f3f7-4403-8003-c1467d534d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.412990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3cc8d-1164-429d-9a93-4d0f111cf3ef admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.429111 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 779/1553] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.429111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a8289-f3f7-4403-8003-c1467d534d19 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.429362 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 775/1554] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:31.429362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8212e8e-aadc-45e1-9ab3-160b7f604045 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.429362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8212e8e-aadc-45e1-9ab3-160b7f604045 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.429362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8212e8e-aadc-45e1-9ab3-160b7f604045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.431400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:31.440885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:31.448600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a8289-f3f7-4403-8003-c1467d534d19 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.452519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d8212e8e-aadc-45e1-9ab3-160b7f604045 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:31.453734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d8212e8e-aadc-45e1-9ab3-160b7f604045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.456237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfc88a-81fb-441e-b476-d530dcc882d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.457395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfc88a-81fb-441e-b476-d530dcc882d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.457395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfc88a-81fb-441e-b476-d530dcc882d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.457662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfc88a-81fb-441e-b476-d530dcc882d2 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.458484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfc88a-81fb-441e-b476-d530dcc882d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.459603 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-80cfc88a-81fb-441e-b476-d530dcc882d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:51:31.459603 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 18:51:31.459603 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 18:51:31.460996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfc88a-81fb-441e-b476-d530dcc882d2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.463616 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 776/1555] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.464420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8212e8e-aadc-45e1-9ab3-160b7f604045 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.474435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8212e8e-aadc-45e1-9ab3-160b7f604045 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.480302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c0dd7-5e45-43ee-94b0-8a828130a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.481115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c0dd7-5e45-43ee-94b0-8a828130a9be admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.481530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c0dd7-5e45-43ee-94b0-8a828130a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.481857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c0dd7-5e45-43ee-94b0-8a828130a9be admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.482732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c0dd7-5e45-43ee-94b0-8a828130a9be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.483905 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-ca1c0dd7-5e45-43ee-94b0-8a828130a9be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:51:31.483905 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 18:51:31.483905 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 18:51:31.485269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c0dd7-5e45-43ee-94b0-8a828130a9be admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.494208 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 780/1556] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/users => generated 289 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:31.495151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfc88a-81fb-441e-b476-d530dcc882d2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.510300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfc88a-81fb-441e-b476-d530dcc882d2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.516104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a37f0-6129-4823-80f3-2713c16b31de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.517485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a37f0-6129-4823-80f3-2713c16b31de admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.517983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a37f0-6129-4823-80f3-2713c16b31de admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.518433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a37f0-6129-4823-80f3-2713c16b31de admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.519190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a37f0-6129-4823-80f3-2713c16b31de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.521035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a37f0-6129-4823-80f3-2713c16b31de admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.521207 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 777/1557] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:31.522942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c0dd7-5e45-43ee-94b0-8a828130a9be admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.541844 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 781/1558] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:31.541844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a37f0-6129-4823-80f3-2713c16b31de admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.568831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a37f0-6129-4823-80f3-2713c16b31de admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.626348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c0dd7-5e45-43ee-94b0-8a828130a9be admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.633851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb629c-3abb-4903-9724-17717e254e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.634870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb629c-3abb-4903-9724-17717e254e2f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.635077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb629c-3abb-4903-9724-17717e254e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.635323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb629c-3abb-4903-9724-17717e254e2f admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.636101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb629c-3abb-4903-9724-17717e254e2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:31.636620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb629c-3abb-4903-9724-17717e254e2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.638386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb629c-3abb-4903-9724-17717e254e2f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.653188 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 778/1559] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:31.654047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109e823-e43c-4880-a5b1-7100eb479836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.654841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109e823-e43c-4880-a5b1-7100eb479836 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.654997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982c7c6-d7f1-4328-a652-052d87d6f7ef None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.655358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982c7c6-d7f1-4328-a652-052d87d6f7ef None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.655467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109e823-e43c-4880-a5b1-7100eb479836 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.655778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982c7c6-d7f1-4328-a652-052d87d6f7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.655878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109e823-e43c-4880-a5b1-7100eb479836 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.656793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109e823-e43c-4880-a5b1-7100eb479836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:31.657307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109e823-e43c-4880-a5b1-7100eb479836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.659980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109e823-e43c-4880-a5b1-7100eb479836 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.676684 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 782/1560] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:31.677788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109e823-e43c-4880-a5b1-7100eb479836 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.689689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109e823-e43c-4880-a5b1-7100eb479836 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.691543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a982c7c6-d7f1-4328-a652-052d87d6f7ef None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:31.692874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a982c7c6-d7f1-4328-a652-052d87d6f7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:31.694983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18212db-bd8f-48ee-8d07-9a88970288b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.695918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18212db-bd8f-48ee-8d07-9a88970288b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.696210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18212db-bd8f-48ee-8d07-9a88970288b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.696526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18212db-bd8f-48ee-8d07-9a88970288b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.697359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18212db-bd8f-48ee-8d07-9a88970288b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.699343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18212db-bd8f-48ee-8d07-9a88970288b4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.702680 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 779/1561] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:31.708054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982c7c6-d7f1-4328-a652-052d87d6f7ef None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.718402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982c7c6-d7f1-4328-a652-052d87d6f7ef None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.725036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aff66-5463-42ad-a200-266012170e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.725995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aff66-5463-42ad-a200-266012170e05 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.726401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aff66-5463-42ad-a200-266012170e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.726770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aff66-5463-42ad-a200-266012170e05 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.727846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aff66-5463-42ad-a200-266012170e05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:31.728273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aff66-5463-42ad-a200-266012170e05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.730144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aff66-5463-42ad-a200-266012170e05 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.743041 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 783/1562] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:31.743041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18212db-bd8f-48ee-8d07-9a88970288b4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.748513 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 780/1563] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:31.749751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aff66-5463-42ad-a200-266012170e05 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.761595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aff66-5463-42ad-a200-266012170e05 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.828238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18212db-bd8f-48ee-8d07-9a88970288b4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.834454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bd6a1-e303-4af7-be69-0d99f63324af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.834603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f910ec-615b-4050-8935-336da8b05578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.835103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd6a1-e303-4af7-be69-0d99f63324af admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.835241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f910ec-615b-4050-8935-336da8b05578 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.835384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd6a1-e303-4af7-be69-0d99f63324af admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.835526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f910ec-615b-4050-8935-336da8b05578 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.835641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd6a1-e303-4af7-be69-0d99f63324af admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.835793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f910ec-615b-4050-8935-336da8b05578 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.836315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bd6a1-e303-4af7-be69-0d99f63324af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.836435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f910ec-615b-4050-8935-336da8b05578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.837959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bd6a1-e303-4af7-be69-0d99f63324af admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.838474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f910ec-615b-4050-8935-336da8b05578 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.850189 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 784/1564] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:31.851221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bd6a1-e303-4af7-be69-0d99f63324af admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.866056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bd6a1-e303-4af7-be69-0d99f63324af admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.870219 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 781/1565] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:31.871190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f910ec-615b-4050-8935-336da8b05578 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.875942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2beddc2-8d1f-417a-9b41-8eaea8da9c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.877200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2beddc2-8d1f-417a-9b41-8eaea8da9c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.877474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2beddc2-8d1f-417a-9b41-8eaea8da9c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.877805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2beddc2-8d1f-417a-9b41-8eaea8da9c65 admin admin] PATH_INFO: `/v3/projects/dec1f34e09324e2ebca9ca8c3e380c39/users/7e586fda321640db9bbd51f740bc134d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.884303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f910ec-615b-4050-8935-336da8b05578 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:31.889922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446bb95-fa92-4c38-a327-a671a6678e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:31.890625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446bb95-fa92-4c38-a327-a671a6678e05 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:31.890875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446bb95-fa92-4c38-a327-a671a6678e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:31.891157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446bb95-fa92-4c38-a327-a671a6678e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:31.892443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446bb95-fa92-4c38-a327-a671a6678e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.896231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446bb95-fa92-4c38-a327-a671a6678e05 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.899372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2beddc2-8d1f-417a-9b41-8eaea8da9c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec1f34e09324e2ebca9ca8c3e380c39, user_id=7e586fda321640db9bbd51f740bc134d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:31.905307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2beddc2-8d1f-417a-9b41-8eaea8da9c65 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:31.928524 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 785/1566] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:31 2022] PUT /identity/v3/projects/dec1f34e09324e2ebca9ca8c3e380c39/users/7e586fda321640db9bbd51f740bc134d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:31.940824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2beddc2-8d1f-417a-9b41-8eaea8da9c65 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.941549 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 782/1567] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:31.941549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446bb95-fa92-4c38-a327-a671a6678e05 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:31.953459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:31.957030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:32.008282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2beddc2-8d1f-417a-9b41-8eaea8da9c65 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.090546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec226d3-d9a6-4941-ba22-42b41d4d134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.091043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec226d3-d9a6-4941-ba22-42b41d4d134f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.091327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec226d3-d9a6-4941-ba22-42b41d4d134f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.091601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec226d3-d9a6-4941-ba22-42b41d4d134f admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.092237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec226d3-d9a6-4941-ba22-42b41d4d134f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.094150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec226d3-d9a6-4941-ba22-42b41d4d134f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.125035 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 786/1568] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:31 2022] POST /identity/v3/projects => generated 401 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:32.126616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec226d3-d9a6-4941-ba22-42b41d4d134f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.147491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446bb95-fa92-4c38-a327-a671a6678e05 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.193980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec226d3-d9a6-4941-ba22-42b41d4d134f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.199241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0176e-d1bd-45dc-8a3c-b5963d7eaf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.199885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0176e-d1bd-45dc-8a3c-b5963d7eaf97 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.200172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0176e-d1bd-45dc-8a3c-b5963d7eaf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.200442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0176e-d1bd-45dc-8a3c-b5963d7eaf97 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.201115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0176e-d1bd-45dc-8a3c-b5963d7eaf97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.203154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0176e-d1bd-45dc-8a3c-b5963d7eaf97 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.208530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5bab1-f5ea-4fb2-9fc4-9281973f9602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.209238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5bab1-f5ea-4fb2-9fc4-9281973f9602 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.209524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5bab1-f5ea-4fb2-9fc4-9281973f9602 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.209828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5bab1-f5ea-4fb2-9fc4-9281973f9602 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.210483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5bab1-f5ea-4fb2-9fc4-9281973f9602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:32.210830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5bab1-f5ea-4fb2-9fc4-9281973f9602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.212468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5bab1-f5ea-4fb2-9fc4-9281973f9602 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.234185 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 783/1569] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:32.234185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5bab1-f5ea-4fb2-9fc4-9281973f9602 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.234466 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 787/1570] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:32.234466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0176e-d1bd-45dc-8a3c-b5963d7eaf97 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.238984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5bab1-f5ea-4fb2-9fc4-9281973f9602 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.241363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0176e-d1bd-45dc-8a3c-b5963d7eaf97 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.243742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73c506-6212-4124-a16c-6ef7f642a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.244325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73c506-6212-4124-a16c-6ef7f642a6ca admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.244609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73c506-6212-4124-a16c-6ef7f642a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.244888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73c506-6212-4124-a16c-6ef7f642a6ca admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.245531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73c506-6212-4124-a16c-6ef7f642a6ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.246235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe4148-46ef-483c-9fe0-1903d1ad50e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.246859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe4148-46ef-483c-9fe0-1903d1ad50e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.247171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe4148-46ef-483c-9fe0-1903d1ad50e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.247414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe4148-46ef-483c-9fe0-1903d1ad50e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.247580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73c506-6212-4124-a16c-6ef7f642a6ca admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.248044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe4148-46ef-483c-9fe0-1903d1ad50e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.249607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe4148-46ef-483c-9fe0-1903d1ad50e3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.261370 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 788/1571] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:32.262393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe4148-46ef-483c-9fe0-1903d1ad50e3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.273523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe4148-46ef-483c-9fe0-1903d1ad50e3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.278655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56e836-50fd-4f20-b722-be39cf8b8e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.279301 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 784/1572] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:32.279415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56e836-50fd-4f20-b722-be39cf8b8e67 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.279681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56e836-50fd-4f20-b722-be39cf8b8e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.280023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56e836-50fd-4f20-b722-be39cf8b8e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.280671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56e836-50fd-4f20-b722-be39cf8b8e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.280779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d7762-aabc-4a89-b67f-7179f0485976 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.281031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d7762-aabc-4a89-b67f-7179f0485976 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.281310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d7762-aabc-4a89-b67f-7179f0485976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.282444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56e836-50fd-4f20-b722-be39cf8b8e67 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.294285 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 789/1573] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:32.295155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56e836-50fd-4f20-b722-be39cf8b8e67 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.307210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56e836-50fd-4f20-b722-be39cf8b8e67 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.313032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-320d7762-aabc-4a89-b67f-7179f0485976 None None] MFA Rules not processed for user `7e586fda321640db9bbd51f740bc134d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:32.315168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-320d7762-aabc-4a89-b67f-7179f0485976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:32.321947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:32.373679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d117ee-575f-4a1b-9169-52cf0bc3b52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.374222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d117ee-575f-4a1b-9169-52cf0bc3b52a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.374504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d117ee-575f-4a1b-9169-52cf0bc3b52a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.374791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d117ee-575f-4a1b-9169-52cf0bc3b52a admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.375430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d117ee-575f-4a1b-9169-52cf0bc3b52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.377996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d117ee-575f-4a1b-9169-52cf0bc3b52a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.386497 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 785/1574] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:32.387538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d7762-aabc-4a89-b67f-7179f0485976 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.400689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d7762-aabc-4a89-b67f-7179f0485976 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.400974 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 790/1575] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:32.401811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d117ee-575f-4a1b-9169-52cf0bc3b52a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.406126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04289a81-7b23-429d-9c52-70ab0beb09e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.406895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04289a81-7b23-429d-9c52-70ab0beb09e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.407184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04289a81-7b23-429d-9c52-70ab0beb09e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.407629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04289a81-7b23-429d-9c52-70ab0beb09e5 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.408266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04289a81-7b23-429d-9c52-70ab0beb09e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.410410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04289a81-7b23-429d-9c52-70ab0beb09e5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.416846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d117ee-575f-4a1b-9169-52cf0bc3b52a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.421532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00b89d-79da-4314-81d2-9ab55c2e7b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.422267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00b89d-79da-4314-81d2-9ab55c2e7b47 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.422634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00b89d-79da-4314-81d2-9ab55c2e7b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.423629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00b89d-79da-4314-81d2-9ab55c2e7b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.424619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00b89d-79da-4314-81d2-9ab55c2e7b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.426727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00b89d-79da-4314-81d2-9ab55c2e7b47 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.436065 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 786/1576] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/users => generated 301 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:32.436949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04289a81-7b23-429d-9c52-70ab0beb09e5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.441699 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 791/1577] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:32.442620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00b89d-79da-4314-81d2-9ab55c2e7b47 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.446377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:32.450644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04289a81-7b23-429d-9c52-70ab0beb09e5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.453354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00b89d-79da-4314-81d2-9ab55c2e7b47 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.458221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7cf8a-5bb7-4ed8-ad32-f400482bb354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.458914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7cf8a-5bb7-4ed8-ad32-f400482bb354 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.459122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95f043-f6f3-44f2-8446-b370cfbe572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.459676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7cf8a-5bb7-4ed8-ad32-f400482bb354 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.459676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7cf8a-5bb7-4ed8-ad32-f400482bb354 admin admin] PATH_INFO: `/v3/projects/aaf151bf5fc84aa4ab3aff97096b4273/users/0a19f489b51d4b4389969f356b1251a2/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.460137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95f043-f6f3-44f2-8446-b370cfbe572f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.460613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95f043-f6f3-44f2-8446-b370cfbe572f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.461072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95f043-f6f3-44f2-8446-b370cfbe572f admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.462090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95f043-f6f3-44f2-8446-b370cfbe572f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.465402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95f043-f6f3-44f2-8446-b370cfbe572f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.475329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7cf8a-5bb7-4ed8-ad32-f400482bb354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf151bf5fc84aa4ab3aff97096b4273, user_id=0a19f489b51d4b4389969f356b1251a2, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.478194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7cf8a-5bb7-4ed8-ad32-f400482bb354 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.495010 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 792/1578] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:32 2022] PUT /identity/v3/projects/aaf151bf5fc84aa4ab3aff97096b4273/users/0a19f489b51d4b4389969f356b1251a2/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:32.495839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7cf8a-5bb7-4ed8-ad32-f400482bb354 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.512136 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 787/1579] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:32.515767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95f043-f6f3-44f2-8446-b370cfbe572f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.569496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7cf8a-5bb7-4ed8-ad32-f400482bb354 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.586197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95f043-f6f3-44f2-8446-b370cfbe572f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.590915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf81df-9b9d-447e-a43a-9b345f56a621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.591525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf81df-9b9d-447e-a43a-9b345f56a621 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.591801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf81df-9b9d-447e-a43a-9b345f56a621 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.592078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf81df-9b9d-447e-a43a-9b345f56a621 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.592714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf81df-9b9d-447e-a43a-9b345f56a621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.594307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf81df-9b9d-447e-a43a-9b345f56a621 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.605185 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 788/1580] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:32.606005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf81df-9b9d-447e-a43a-9b345f56a621 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.617030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf81df-9b9d-447e-a43a-9b345f56a621 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.622055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6e864-7829-4371-8407-f0de8debbdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.622659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e864-7829-4371-8407-f0de8debbdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.622969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e864-7829-4371-8407-f0de8debbdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.623243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e864-7829-4371-8407-f0de8debbdc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.623922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6e864-7829-4371-8407-f0de8debbdc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.625853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6e864-7829-4371-8407-f0de8debbdc7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.636338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee011ea-78ab-4886-98c3-30df17cb1303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.636956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee011ea-78ab-4886-98c3-30df17cb1303 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.637243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee011ea-78ab-4886-98c3-30df17cb1303 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.637522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee011ea-78ab-4886-98c3-30df17cb1303 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.638147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee011ea-78ab-4886-98c3-30df17cb1303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.640443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee011ea-78ab-4886-98c3-30df17cb1303 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.657121 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 789/1581] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:32.658904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6e864-7829-4371-8407-f0de8debbdc7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.668392 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 793/1582] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:32.669344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee011ea-78ab-4886-98c3-30df17cb1303 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.683499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee011ea-78ab-4886-98c3-30df17cb1303 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.690171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:32.731325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6e864-7829-4371-8407-f0de8debbdc7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.738768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92395957-12c1-4f93-8e41-707247b190fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.739399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92395957-12c1-4f93-8e41-707247b190fb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.739685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92395957-12c1-4f93-8e41-707247b190fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.739967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92395957-12c1-4f93-8e41-707247b190fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.740622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92395957-12c1-4f93-8e41-707247b190fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.742322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92395957-12c1-4f93-8e41-707247b190fb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.752929 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 790/1583] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:32.756061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92395957-12c1-4f93-8e41-707247b190fb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.756157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eff3d1-295d-4581-89e5-bfa82a9b64fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.756157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff3d1-295d-4581-89e5-bfa82a9b64fd admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.756340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff3d1-295d-4581-89e5-bfa82a9b64fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.756663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff3d1-295d-4581-89e5-bfa82a9b64fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.757408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eff3d1-295d-4581-89e5-bfa82a9b64fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.759582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eff3d1-295d-4581-89e5-bfa82a9b64fd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.764776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92395957-12c1-4f93-8e41-707247b190fb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.770839 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 794/1584] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:32.771101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774126d-bb1c-4ac6-9108-07dde2b4a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.771701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774126d-bb1c-4ac6-9108-07dde2b4a7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.771987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774126d-bb1c-4ac6-9108-07dde2b4a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.772193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7ccd-19d4-4a09-be62-839a072d3ee7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.772303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774126d-bb1c-4ac6-9108-07dde2b4a7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.772532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7ccd-19d4-4a09-be62-839a072d3ee7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.772744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c7ccd-19d4-4a09-be62-839a072d3ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.772948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774126d-bb1c-4ac6-9108-07dde2b4a7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.774499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774126d-bb1c-4ac6-9108-07dde2b4a7f5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.790060 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 791/1585] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:32.790060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774126d-bb1c-4ac6-9108-07dde2b4a7f5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.798825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774126d-bb1c-4ac6-9108-07dde2b4a7f5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.803871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fd1b2-abcf-4492-98e6-7ec0b0fcf25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.804480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fd1b2-abcf-4492-98e6-7ec0b0fcf25d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.804764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fd1b2-abcf-4492-98e6-7ec0b0fcf25d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.804902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-370c7ccd-19d4-4a09-be62-839a072d3ee7 None None] MFA Rules not processed for user `0a19f489b51d4b4389969f356b1251a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:32.805036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fd1b2-abcf-4492-98e6-7ec0b0fcf25d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.805674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fd1b2-abcf-4492-98e6-7ec0b0fcf25d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.806189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-370c7ccd-19d4-4a09-be62-839a072d3ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:32.807651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fd1b2-abcf-4492-98e6-7ec0b0fcf25d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.829965 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 792/1586] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:32.830877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fd1b2-abcf-4492-98e6-7ec0b0fcf25d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.841350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fd1b2-abcf-4492-98e6-7ec0b0fcf25d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.847526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac6584-b438-40ea-8562-e35a6ecdf535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.848299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac6584-b438-40ea-8562-e35a6ecdf535 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.848765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac6584-b438-40ea-8562-e35a6ecdf535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.849093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac6584-b438-40ea-8562-e35a6ecdf535 admin admin] PATH_INFO: `/v3/projects/bb2c0f37501f477ebf6c9a862a400420/users/02af8bde3635447fa2d0fb7a613bff05/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.869654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac6584-b438-40ea-8562-e35a6ecdf535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2c0f37501f477ebf6c9a862a400420, user_id=02af8bde3635447fa2d0fb7a613bff05, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.871545 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-81ac6584-b438-40ea-8562-e35a6ecdf535 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:51:32.871545 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 18:51:32.871545 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 18:51:32.875165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac6584-b438-40ea-8562-e35a6ecdf535 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.877759 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 795/1587] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:32.878588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c7ccd-19d4-4a09-be62-839a072d3ee7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.888964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:32.889427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c7ccd-19d4-4a09-be62-839a072d3ee7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.896307 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 793/1588] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:32 2022] PUT /identity/v3/projects/bb2c0f37501f477ebf6c9a862a400420/users/02af8bde3635447fa2d0fb7a613bff05/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:32.910068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac6584-b438-40ea-8562-e35a6ecdf535 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:32.971525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0df482-ac5d-458e-b5b3-382744c62f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.972161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0df482-ac5d-458e-b5b3-382744c62f76 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.972466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0df482-ac5d-458e-b5b3-382744c62f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.972769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0df482-ac5d-458e-b5b3-382744c62f76 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.973438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0df482-ac5d-458e-b5b3-382744c62f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.975674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0df482-ac5d-458e-b5b3-382744c62f76 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:32.981519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac6584-b438-40ea-8562-e35a6ecdf535 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:32.988261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c1f7e-025a-4e76-b5e7-70360df1ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:32.988627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c1f7e-025a-4e76-b5e7-70360df1ec8e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:32.989070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c1f7e-025a-4e76-b5e7-70360df1ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:32.989070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c1f7e-025a-4e76-b5e7-70360df1ec8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:32.990141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c1f7e-025a-4e76-b5e7-70360df1ec8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:32.991789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c1f7e-025a-4e76-b5e7-70360df1ec8e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.002219 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 796/1589] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:32 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:33.003063 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 794/1590] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:33.003949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c1f7e-025a-4e76-b5e7-70360df1ec8e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.004154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0df482-ac5d-458e-b5b3-382744c62f76 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.014665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0df482-ac5d-458e-b5b3-382744c62f76 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.020347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b48d2a-ca34-422c-9701-e301dd4d8664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.020987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b48d2a-ca34-422c-9701-e301dd4d8664 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.021303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b48d2a-ca34-422c-9701-e301dd4d8664 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.021648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b48d2a-ca34-422c-9701-e301dd4d8664 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.022301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b48d2a-ca34-422c-9701-e301dd4d8664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.024113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b48d2a-ca34-422c-9701-e301dd4d8664 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.026179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c1f7e-025a-4e76-b5e7-70360df1ec8e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.033774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39696086-de7d-44ce-9852-0cede52536b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.034533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39696086-de7d-44ce-9852-0cede52536b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.034852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39696086-de7d-44ce-9852-0cede52536b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.035231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39696086-de7d-44ce-9852-0cede52536b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.035978 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 797/1591] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:33.036077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39696086-de7d-44ce-9852-0cede52536b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.036850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b48d2a-ca34-422c-9701-e301dd4d8664 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.037822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39696086-de7d-44ce-9852-0cede52536b3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.047412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b48d2a-ca34-422c-9701-e301dd4d8664 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.053066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742778cb-a018-4702-a5b3-476c2e576b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.053795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742778cb-a018-4702-a5b3-476c2e576b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.054175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742778cb-a018-4702-a5b3-476c2e576b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.054524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742778cb-a018-4702-a5b3-476c2e576b32 admin admin] PATH_INFO: `/v3/projects/7f2247796ddb461ebd25e5e12fbd9420/users/4748d4652d324915bd587fe415a0187e/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.059929 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 795/1592] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:33.059929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39696086-de7d-44ce-9852-0cede52536b3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.067713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:33.072864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39696086-de7d-44ce-9852-0cede52536b3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.073723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742778cb-a018-4702-a5b3-476c2e576b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2247796ddb461ebd25e5e12fbd9420, user_id=4748d4652d324915bd587fe415a0187e, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.076769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742778cb-a018-4702-a5b3-476c2e576b32 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.079471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101520d-fcc9-4070-8ab3-828f38d4d4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.080167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101520d-fcc9-4070-8ab3-828f38d4d4ec admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.080519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101520d-fcc9-4070-8ab3-828f38d4d4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.080866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101520d-fcc9-4070-8ab3-828f38d4d4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.081632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101520d-fcc9-4070-8ab3-828f38d4d4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.083770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101520d-fcc9-4070-8ab3-828f38d4d4ec admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.091427 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 798/1593] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:33 2022] PUT /identity/v3/projects/7f2247796ddb461ebd25e5e12fbd9420/users/4748d4652d324915bd587fe415a0187e/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:33.092719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742778cb-a018-4702-a5b3-476c2e576b32 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.109095 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 796/1594] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:33.111291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e14b02-4125-44fd-b497-f916efa47ce1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.111660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e14b02-4125-44fd-b497-f916efa47ce1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.111952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e14b02-4125-44fd-b497-f916efa47ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.144274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-11e14b02-4125-44fd-b497-f916efa47ce1 None None] MFA Rules not processed for user `02af8bde3635447fa2d0fb7a613bff05`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:33.145395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-11e14b02-4125-44fd-b497-f916efa47ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:33.162930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742778cb-a018-4702-a5b3-476c2e576b32 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.168597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b51bc-53d0-416b-b211-495c4bd81bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.169237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b51bc-53d0-416b-b211-495c4bd81bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.169569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b51bc-53d0-416b-b211-495c4bd81bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.169802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b51bc-53d0-416b-b211-495c4bd81bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.170549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b51bc-53d0-416b-b211-495c4bd81bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.172499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b51bc-53d0-416b-b211-495c4bd81bc9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.205536 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 799/1595] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:33 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:33.205536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b51bc-53d0-416b-b211-495c4bd81bc9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.225797 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 797/1596] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:33.225797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e14b02-4125-44fd-b497-f916efa47ce1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.234169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e14b02-4125-44fd-b497-f916efa47ce1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.284425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b51bc-53d0-416b-b211-495c4bd81bc9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.289812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961d6e2-3667-470b-9e1f-40014d4f0bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.290553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961d6e2-3667-470b-9e1f-40014d4f0bbf admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.290906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961d6e2-3667-470b-9e1f-40014d4f0bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.291227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961d6e2-3667-470b-9e1f-40014d4f0bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.291903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961d6e2-3667-470b-9e1f-40014d4f0bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.293608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961d6e2-3667-470b-9e1f-40014d4f0bbf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.298395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dea9e-7f63-45ca-b8e9-1778e3a71fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.299032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dea9e-7f63-45ca-b8e9-1778e3a71fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.299388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dea9e-7f63-45ca-b8e9-1778e3a71fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.299598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dea9e-7f63-45ca-b8e9-1778e3a71fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.300254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dea9e-7f63-45ca-b8e9-1778e3a71fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.301867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dea9e-7f63-45ca-b8e9-1778e3a71fc6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.308749 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 800/1597] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:33.308749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961d6e2-3667-470b-9e1f-40014d4f0bbf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.309038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:33.319722 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 798/1598] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:33.319965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961d6e2-3667-470b-9e1f-40014d4f0bbf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.320173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dea9e-7f63-45ca-b8e9-1778e3a71fc6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.324577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc8681-e1fc-4512-9c2e-7a76eb6a5e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.325248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc8681-e1fc-4512-9c2e-7a76eb6a5e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.325528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc8681-e1fc-4512-9c2e-7a76eb6a5e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.325803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc8681-e1fc-4512-9c2e-7a76eb6a5e5d admin admin] PATH_INFO: `/v3/projects/7137aa35d5324b9c8d6b7159e010a447/users/34437c5fbe8347cdb634833ce36d98a2/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.333118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dea9e-7f63-45ca-b8e9-1778e3a71fc6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.338231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f712912-d1b7-4adf-8a74-8f4295e509c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.338947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f712912-d1b7-4adf-8a74-8f4295e509c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.339229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f712912-d1b7-4adf-8a74-8f4295e509c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.339506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f712912-d1b7-4adf-8a74-8f4295e509c7 admin admin] PATH_INFO: `/v3/projects/94d7ad68e2f148ce8bb0a8de63a7897f/users/181f661f98964045b1f474672ca42bc1/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.344235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc8681-e1fc-4512-9c2e-7a76eb6a5e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7137aa35d5324b9c8d6b7159e010a447, user_id=34437c5fbe8347cdb634833ce36d98a2, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.348668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc8681-e1fc-4512-9c2e-7a76eb6a5e5d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.356920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f712912-d1b7-4adf-8a74-8f4295e509c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d7ad68e2f148ce8bb0a8de63a7897f, user_id=181f661f98964045b1f474672ca42bc1, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.359811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f712912-d1b7-4adf-8a74-8f4295e509c7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.365183 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 801/1599] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:33 2022] PUT /identity/v3/projects/7137aa35d5324b9c8d6b7159e010a447/users/34437c5fbe8347cdb634833ce36d98a2/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:33.366884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9dc69-ca61-485a-b272-7ec5736bce90 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.367387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9dc69-ca61-485a-b272-7ec5736bce90 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.367387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9dc69-ca61-485a-b272-7ec5736bce90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.381763 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 799/1600] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:33 2022] PUT /identity/v3/projects/94d7ad68e2f148ce8bb0a8de63a7897f/users/181f661f98964045b1f474672ca42bc1/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:33.382692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f712912-d1b7-4adf-8a74-8f4295e509c7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.399794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-80b9dc69-ca61-485a-b272-7ec5736bce90 None None] MFA Rules not processed for user `4748d4652d324915bd587fe415a0187e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:33.400996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-80b9dc69-ca61-485a-b272-7ec5736bce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:33.437406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:33.457750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f712912-d1b7-4adf-8a74-8f4295e509c7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.462485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c196aaf-ae47-436d-8e29-4c76d12f1a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.463137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c196aaf-ae47-436d-8e29-4c76d12f1a98 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.463438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c196aaf-ae47-436d-8e29-4c76d12f1a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.463734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c196aaf-ae47-436d-8e29-4c76d12f1a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.464392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c196aaf-ae47-436d-8e29-4c76d12f1a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.466008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c196aaf-ae47-436d-8e29-4c76d12f1a98 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.477565 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 800/1601] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:33.478391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c196aaf-ae47-436d-8e29-4c76d12f1a98 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.481440 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 802/1602] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:33.482323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9dc69-ca61-485a-b272-7ec5736bce90 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.494660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c196aaf-ae47-436d-8e29-4c76d12f1a98 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.497115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9dc69-ca61-485a-b272-7ec5736bce90 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.499847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676c2f3-9f8c-4981-9b69-3973d791c6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.500460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676c2f3-9f8c-4981-9b69-3973d791c6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.500748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676c2f3-9f8c-4981-9b69-3973d791c6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.501523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676c2f3-9f8c-4981-9b69-3973d791c6b1 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.502163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676c2f3-9f8c-4981-9b69-3973d791c6b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.503849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373852-9bf9-4852-a37b-108d8777405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.504129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676c2f3-9f8c-4981-9b69-3973d791c6b1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.504544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373852-9bf9-4852-a37b-108d8777405c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.505024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373852-9bf9-4852-a37b-108d8777405c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.505488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373852-9bf9-4852-a37b-108d8777405c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.506316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8373852-9bf9-4852-a37b-108d8777405c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.508286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8373852-9bf9-4852-a37b-108d8777405c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.529787 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 801/1603] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:33 2022] POST /identity/v3/users => generated 296 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:33.530603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676c2f3-9f8c-4981-9b69-3973d791c6b1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.542006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676c2f3-9f8c-4981-9b69-3973d791c6b1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.547013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dae820-1c12-4522-b986-65218b39becc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.550942 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 803/1604] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:33 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:33.551099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dae820-1c12-4522-b986-65218b39becc admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.551269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373852-9bf9-4852-a37b-108d8777405c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.551355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dae820-1c12-4522-b986-65218b39becc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.551355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dae820-1c12-4522-b986-65218b39becc admin admin] PATH_INFO: `/v3/projects/aba0a0ace5f34635961f64829237af03/users/796ec6d2b7604625ac1b1a4fe8caec2e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.571477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dae820-1c12-4522-b986-65218b39becc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba0a0ace5f34635961f64829237af03, user_id=796ec6d2b7604625ac1b1a4fe8caec2e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.574282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dae820-1c12-4522-b986-65218b39becc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.593695 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 802/1605] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:33 2022] PUT /identity/v3/projects/aba0a0ace5f34635961f64829237af03/users/796ec6d2b7604625ac1b1a4fe8caec2e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:33.595886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd47f83-591c-4e93-89de-1f7e83833f72 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.596123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd47f83-591c-4e93-89de-1f7e83833f72 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.596398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd47f83-591c-4e93-89de-1f7e83833f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.625482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fcd47f83-591c-4e93-89de-1f7e83833f72 None None] MFA Rules not processed for user `34437c5fbe8347cdb634833ce36d98a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:33.625710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373852-9bf9-4852-a37b-108d8777405c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.627823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fcd47f83-591c-4e93-89de-1f7e83833f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:33.690511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcc5dc-23ae-4324-91df-0fe1d9beac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.691232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcc5dc-23ae-4324-91df-0fe1d9beac49 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.691664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcc5dc-23ae-4324-91df-0fe1d9beac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.691986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcc5dc-23ae-4324-91df-0fe1d9beac49 admin admin] PATH_INFO: `/v3/projects/5e5e948a3a3541528a15b35ffe482b7c/users/7883e1d888b2436c811e69e25f4e4634/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.699754 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 803/1606] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:33.701025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7e39-af3e-4d3d-8ff7-a7ad5d04779b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.701418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7e39-af3e-4d3d-8ff7-a7ad5d04779b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.701568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd7e39-af3e-4d3d-8ff7-a7ad5d04779b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.712040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcc5dc-23ae-4324-91df-0fe1d9beac49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5e948a3a3541528a15b35ffe482b7c, user_id=7883e1d888b2436c811e69e25f4e4634, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.715145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcc5dc-23ae-4324-91df-0fe1d9beac49 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.722130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8fdd7e39-af3e-4d3d-8ff7-a7ad5d04779b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:33.723391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8fdd7e39-af3e-4d3d-8ff7-a7ad5d04779b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:33.731291 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 804/1607] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:33 2022] PUT /identity/v3/projects/5e5e948a3a3541528a15b35ffe482b7c/users/7883e1d888b2436c811e69e25f4e4634/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:33.732241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcc5dc-23ae-4324-91df-0fe1d9beac49 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.743782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:33.791957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:33.794010 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 804/1608] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:33.795108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd7e39-af3e-4d3d-8ff7-a7ad5d04779b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.796418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8fdd7e39-af3e-4d3d-8ff7-a7ad5d04779b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:33.816165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcc5dc-23ae-4324-91df-0fe1d9beac49 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.821316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5679b-5bd2-4fb9-9e41-d52ebc0decb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.821989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5679b-5bd2-4fb9-9e41-d52ebc0decb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.822270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5679b-5bd2-4fb9-9e41-d52ebc0decb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.822543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5679b-5bd2-4fb9-9e41-d52ebc0decb9 admin admin] PATH_INFO: `/v3/projects/74f4c189648b409498539c351c9ca371/users/6574dc5a316949df88504f7bc03b14cb/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.838996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5679b-5bd2-4fb9-9e41-d52ebc0decb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f4c189648b409498539c351c9ca371, user_id=6574dc5a316949df88504f7bc03b14cb, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.841674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5679b-5bd2-4fb9-9e41-d52ebc0decb9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.856176 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 805/1609] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:33 2022] PUT /identity/v3/projects/74f4c189648b409498539c351c9ca371/users/6574dc5a316949df88504f7bc03b14cb/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:33.857009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5679b-5bd2-4fb9-9e41-d52ebc0decb9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.875033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd7e39-af3e-4d3d-8ff7-a7ad5d04779b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.940375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d3a3-d90e-43e5-be84-344d3f47b12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.941104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d3a3-d90e-43e5-be84-344d3f47b12b service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.941323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d3a3-d90e-43e5-be84-344d3f47b12b service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.941602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4d3a3-d90e-43e5-be84-344d3f47b12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.941876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5679b-5bd2-4fb9-9e41-d52ebc0decb9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.949365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb80af-c213-42aa-a5ff-f635912de182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.950427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb80af-c213-42aa-a5ff-f635912de182 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.950895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb80af-c213-42aa-a5ff-f635912de182 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.951415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb80af-c213-42aa-a5ff-f635912de182 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.952660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb80af-c213-42aa-a5ff-f635912de182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.955440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb80af-c213-42aa-a5ff-f635912de182 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:33.968277 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 806/1610] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:33.969190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb80af-c213-42aa-a5ff-f635912de182 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:33.984231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb80af-c213-42aa-a5ff-f635912de182 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:33.991080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e0980-ce2b-4b8e-b305-488cd356cf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:33.991687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e0980-ce2b-4b8e-b305-488cd356cf08 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:33.991979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e0980-ce2b-4b8e-b305-488cd356cf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:33.992247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e0980-ce2b-4b8e-b305-488cd356cf08 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:33.992880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e0980-ce2b-4b8e-b305-488cd356cf08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:33.995069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e0980-ce2b-4b8e-b305-488cd356cf08 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.022253 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 807/1611] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:33 2022] POST /identity/v3/users => generated 297 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:34.022253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e0980-ce2b-4b8e-b305-488cd356cf08 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.028640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4d3a3-d90e-43e5-be84-344d3f47b12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.030116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4d3a3-d90e-43e5-be84-344d3f47b12b service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.030243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e0980-ce2b-4b8e-b305-488cd356cf08 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.036424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b82826-a743-4254-beeb-f2bee25633ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.038259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b82826-a743-4254-beeb-f2bee25633ef admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.038934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b82826-a743-4254-beeb-f2bee25633ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.039714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b82826-a743-4254-beeb-f2bee25633ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.041073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b82826-a743-4254-beeb-f2bee25633ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.041987 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 805/1612] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:34.042851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d3a3-d90e-43e5-be84-344d3f47b12b service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.043368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b82826-a743-4254-beeb-f2bee25633ef admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.056314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4d3a3-d90e-43e5-be84-344d3f47b12b service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.061508 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 808/1613] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:34.061508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3a5e6-7ef4-4f3c-997b-6633e6cf4087 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.061508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3a5e6-7ef4-4f3c-997b-6633e6cf4087 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.061508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3a5e6-7ef4-4f3c-997b-6633e6cf4087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.065368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b3cf0-0655-4da6-bae6-af7508fa21c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.066350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b3cf0-0655-4da6-bae6-af7508fa21c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.066597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b3cf0-0655-4da6-bae6-af7508fa21c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.066910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b3cf0-0655-4da6-bae6-af7508fa21c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.067561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b3cf0-0655-4da6-bae6-af7508fa21c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.069588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b3cf0-0655-4da6-bae6-af7508fa21c6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.092947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-37e3a5e6-7ef4-4f3c-997b-6633e6cf4087 None None] MFA Rules not processed for user `7883e1d888b2436c811e69e25f4e4634`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:34.094235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-37e3a5e6-7ef4-4f3c-997b-6633e6cf4087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:34.105041 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 806/1614] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:34 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:34.106272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b3cf0-0655-4da6-bae6-af7508fa21c6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.118061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:34.171853 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 809/1615] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:34.173849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480b727-f32c-4572-b0c5-bfda8b420426 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.173981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b3cf0-0655-4da6-bae6-af7508fa21c6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.174332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480b727-f32c-4572-b0c5-bfda8b420426 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.174799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480b727-f32c-4572-b0c5-bfda8b420426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.178869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7e297-31eb-48f6-9169-8667413b7839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.179766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7e297-31eb-48f6-9169-8667413b7839 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.180053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7e297-31eb-48f6-9169-8667413b7839 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.180332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7e297-31eb-48f6-9169-8667413b7839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.212221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3480b727-f32c-4572-b0c5-bfda8b420426 None None] MFA Rules not processed for user `6574dc5a316949df88504f7bc03b14cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:34.213425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3480b727-f32c-4572-b0c5-bfda8b420426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:34.229343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:34.254987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7e297-31eb-48f6-9169-8667413b7839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.256886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7e297-31eb-48f6-9169-8667413b7839 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.270059 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 807/1616] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:34.270919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7e297-31eb-48f6-9169-8667413b7839 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.280798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7e297-31eb-48f6-9169-8667413b7839 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.286005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4a360-06bf-456d-b232-492b04edad96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.286787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4a360-06bf-456d-b232-492b04edad96 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.287149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4a360-06bf-456d-b232-492b04edad96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.287490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4a360-06bf-456d-b232-492b04edad96 admin admin] PATH_INFO: `/v3/projects/a936f8401fa64889889a3e0bb60c2515/users/2737db8812e04292b7f0649a99b5174a/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.296516 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 810/1617] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:34.297672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480b727-f32c-4572-b0c5-bfda8b420426 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.310392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480b727-f32c-4572-b0c5-bfda8b420426 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.311782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4a360-06bf-456d-b232-492b04edad96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a936f8401fa64889889a3e0bb60c2515, user_id=2737db8812e04292b7f0649a99b5174a, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.316015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4a360-06bf-456d-b232-492b04edad96 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.317125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2dd77-ab28-418e-99cf-b0d38b36a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.317959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2dd77-ab28-418e-99cf-b0d38b36a934 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.318381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2dd77-ab28-418e-99cf-b0d38b36a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.319141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2dd77-ab28-418e-99cf-b0d38b36a934 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.319767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2dd77-ab28-418e-99cf-b0d38b36a934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.321832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2dd77-ab28-418e-99cf-b0d38b36a934 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.338698 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 811/1618] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:34.338698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2dd77-ab28-418e-99cf-b0d38b36a934 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.339079 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 808/1619] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:34 2022] PUT /identity/v3/projects/a936f8401fa64889889a3e0bb60c2515/users/2737db8812e04292b7f0649a99b5174a/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:34.342491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4a360-06bf-456d-b232-492b04edad96 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.352537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2dd77-ab28-418e-99cf-b0d38b36a934 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.430724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4a360-06bf-456d-b232-492b04edad96 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.435765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031d5db-8a3c-4b41-b1dd-61e10e00f97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.436542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031d5db-8a3c-4b41-b1dd-61e10e00f97f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.436676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e7a7c-25e9-418f-86d7-c292c9ad2ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.436830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031d5db-8a3c-4b41-b1dd-61e10e00f97f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.437091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031d5db-8a3c-4b41-b1dd-61e10e00f97f admin admin] PATH_INFO: `/v3/projects/aba0a0ace5f34635961f64829237af03/users/796ec6d2b7604625ac1b1a4fe8caec2e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.437653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e7a7c-25e9-418f-86d7-c292c9ad2ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.438006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e7a7c-25e9-418f-86d7-c292c9ad2ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.438404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e7a7c-25e9-418f-86d7-c292c9ad2ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.439127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e7a7c-25e9-418f-86d7-c292c9ad2ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.439238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031d5db-8a3c-4b41-b1dd-61e10e00f97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba0a0ace5f34635961f64829237af03, user_id=796ec6d2b7604625ac1b1a4fe8caec2e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.441173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e7a7c-25e9-418f-86d7-c292c9ad2ca1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.441875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031d5db-8a3c-4b41-b1dd-61e10e00f97f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.453183 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 812/1620] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:34 2022] PUT /identity/v3/projects/aba0a0ace5f34635961f64829237af03/users/796ec6d2b7604625ac1b1a4fe8caec2e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:34.455331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031d5db-8a3c-4b41-b1dd-61e10e00f97f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.475001 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 809/1621] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:34 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:34.475001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e7a7c-25e9-418f-86d7-c292c9ad2ca1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.484713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e7a7c-25e9-418f-86d7-c292c9ad2ca1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.511923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:34.546169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031d5db-8a3c-4b41-b1dd-61e10e00f97f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.552250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354e3ee-9c60-4376-8349-ce6f7feffd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.554925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354e3ee-9c60-4376-8349-ce6f7feffd14 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.554925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354e3ee-9c60-4376-8349-ce6f7feffd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.554925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354e3ee-9c60-4376-8349-ce6f7feffd14 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.554925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354e3ee-9c60-4376-8349-ce6f7feffd14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.556256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354e3ee-9c60-4376-8349-ce6f7feffd14 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.580536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4798f-610b-4db5-a294-564775ad4e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.581529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4798f-610b-4db5-a294-564775ad4e70 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.581902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4798f-610b-4db5-a294-564775ad4e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.582274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4798f-610b-4db5-a294-564775ad4e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.583128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4798f-610b-4db5-a294-564775ad4e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.585388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4798f-610b-4db5-a294-564775ad4e70 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.592684 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 813/1622] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:34 2022] POST /identity/v3/projects => generated 399 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:34.593692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354e3ee-9c60-4376-8349-ce6f7feffd14 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.623470 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 810/1623] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:34 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:34.624388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4798f-610b-4db5-a294-564775ad4e70 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.625220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:34.670948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354e3ee-9c60-4376-8349-ce6f7feffd14 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.727466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4798f-610b-4db5-a294-564775ad4e70 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.734670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707c3d7-b4a9-4dfb-a516-f42bb476d8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.736752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707c3d7-b4a9-4dfb-a516-f42bb476d8de admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.737154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707c3d7-b4a9-4dfb-a516-f42bb476d8de admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.737447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707c3d7-b4a9-4dfb-a516-f42bb476d8de admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.738123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707c3d7-b4a9-4dfb-a516-f42bb476d8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.741191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707c3d7-b4a9-4dfb-a516-f42bb476d8de admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.753459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479c55c-89cf-4099-ae63-887a48ea7cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.754340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479c55c-89cf-4099-ae63-887a48ea7cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.754698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479c55c-89cf-4099-ae63-887a48ea7cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.755066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479c55c-89cf-4099-ae63-887a48ea7cfd admin admin] PATH_INFO: `/v3/projects/41d21f9368724568b2e9d69853951ad6/users/28aca1e665ce438e80db8101b41df103/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.758929 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 811/1624] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:34.760506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb3f3d-5588-44ea-a05d-7ddbc2496f00 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.761692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb3f3d-5588-44ea-a05d-7ddbc2496f00 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.762049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb3f3d-5588-44ea-a05d-7ddbc2496f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.779427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479c55c-89cf-4099-ae63-887a48ea7cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d21f9368724568b2e9d69853951ad6, user_id=28aca1e665ce438e80db8101b41df103, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.784143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479c55c-89cf-4099-ae63-887a48ea7cfd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.804857 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 814/1625] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:34 2022] PUT /identity/v3/projects/41d21f9368724568b2e9d69853951ad6/users/28aca1e665ce438e80db8101b41df103/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:34.806600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479c55c-89cf-4099-ae63-887a48ea7cfd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.811150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4afb3f3d-5588-44ea-a05d-7ddbc2496f00 None None] MFA Rules not processed for user `796ec6d2b7604625ac1b1a4fe8caec2e`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:34.812996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4afb3f3d-5588-44ea-a05d-7ddbc2496f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:34.885707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479c55c-89cf-4099-ae63-887a48ea7cfd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.891184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f11ecf-1943-492b-b923-e74dc98f2e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.892226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f11ecf-1943-492b-b923-e74dc98f2e65 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.892803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f11ecf-1943-492b-b923-e74dc98f2e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.893215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f11ecf-1943-492b-b923-e74dc98f2e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.893983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f11ecf-1943-492b-b923-e74dc98f2e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.896000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f11ecf-1943-492b-b923-e74dc98f2e65 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.900365 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 812/1626] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:34.903558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb3f3d-5588-44ea-a05d-7ddbc2496f00 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.918972 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 815/1627] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:34.921741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f11ecf-1943-492b-b923-e74dc98f2e65 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:34.923677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb3f3d-5588-44ea-a05d-7ddbc2496f00 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.928909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.929654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.929935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.930206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] PATH_INFO: `/v3/users/4748d4652d324915bd587fe415a0187e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.931455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4748d4652d324915bd587fe415a0187e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.932572 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:51:34.932572 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 18:51:34.932572 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 18:51:34.933799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.944778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f11ecf-1943-492b-b923-e74dc98f2e65 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:34.958853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0050e55-fb84-418a-8143-2df8f029acf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:34.959480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0050e55-fb84-418a-8143-2df8f029acf7 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:34.959768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0050e55-fb84-418a-8143-2df8f029acf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:34.960125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0050e55-fb84-418a-8143-2df8f029acf7 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:34.961078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0050e55-fb84-418a-8143-2df8f029acf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:34.963133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0050e55-fb84-418a-8143-2df8f029acf7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:34.990042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:34.990212 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 816/1628] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:34 2022] POST /identity/v3/users => generated 306 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:34.994500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0050e55-fb84-418a-8143-2df8f029acf7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.010582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0050e55-fb84-418a-8143-2df8f029acf7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.014624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8113c-a772-469a-a9fe-7172c063cb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.015426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8113c-a772-469a-a9fe-7172c063cb73 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.015907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8113c-a772-469a-a9fe-7172c063cb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.016006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8113c-a772-469a-a9fe-7172c063cb73 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.016710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8113c-a772-469a-a9fe-7172c063cb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.019655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8113c-a772-469a-a9fe-7172c063cb73 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.029854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4748d4652d324915bd587fe415a0187e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:35.044487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4748d4652d324915bd587fe415a0187e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:35.045259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4748d4652d324915bd587fe415a0187e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:35.052403 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 817/1629] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:34 2022] POST /identity/v3/users => generated 293 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:35.052403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8113c-a772-469a-a9fe-7172c063cb73 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.063322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8113c-a772-469a-a9fe-7172c063cb73 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.069166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817cca2-6977-4fa7-96ad-be3f90167f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.069838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817cca2-6977-4fa7-96ad-be3f90167f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.070119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817cca2-6977-4fa7-96ad-be3f90167f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.070397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817cca2-6977-4fa7-96ad-be3f90167f30 admin admin] PATH_INFO: `/v3/projects/a936f8401fa64889889a3e0bb60c2515/users/2737db8812e04292b7f0649a99b5174a/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.072616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817cca2-6977-4fa7-96ad-be3f90167f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a936f8401fa64889889a3e0bb60c2515, user_id=2737db8812e04292b7f0649a99b5174a, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.075968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4748d4652d324915bd587fe415a0187e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:35.076459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817cca2-6977-4fa7-96ad-be3f90167f30 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.077052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4748d4652d324915bd587fe415a0187e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:35.084643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:35.101081 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 813/1630] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:34 2022] DELETE /identity/v3/users/4748d4652d324915bd587fe415a0187e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:35.102163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.106791 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 818/1631] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:35 2022] PUT /identity/v3/projects/a936f8401fa64889889a3e0bb60c2515/users/2737db8812e04292b7f0649a99b5174a/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:35.107807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:35.109516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817cca2-6977-4fa7-96ad-be3f90167f30 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.113442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7817cca2-6977-4fa7-96ad-be3f90167f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:35.224221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038da63-1ed6-49f9-aea0-743e708ed531 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.229164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817cca2-6977-4fa7-96ad-be3f90167f30 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.231695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539720d8-6d9d-47cf-a538-93f8f70a4cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.232553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539720d8-6d9d-47cf-a538-93f8f70a4cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.233154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539720d8-6d9d-47cf-a538-93f8f70a4cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.233260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539720d8-6d9d-47cf-a538-93f8f70a4cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.233916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539720d8-6d9d-47cf-a538-93f8f70a4cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.235755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539720d8-6d9d-47cf-a538-93f8f70a4cc7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.239623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abad3ee-15e8-4543-8407-a8395ad3e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.240752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad3ee-15e8-4543-8407-a8395ad3e28b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.241294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad3ee-15e8-4543-8407-a8395ad3e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.241639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad3ee-15e8-4543-8407-a8395ad3e28b admin admin] PATH_INFO: `/v3/projects/174cae678d774d5a84437ea45d5de394/users/85c4b6d0b82b4d7bb15199424ed0c140/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.249683 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 814/1632] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:35.252967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef55a-1460-47f7-a715-19e1fa289add None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.252967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef55a-1460-47f7-a715-19e1fa289add None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.253645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef55a-1460-47f7-a715-19e1fa289add None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.255849 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 815/1633] 10.222.0.70 () {54 vars in 962 bytes} [Sun Aug 28 18:51:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:51:35.256650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ef55a-1460-47f7-a715-19e1fa289add None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.260568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-128ef55a-1460-47f7-a715-19e1fa289add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:35.271739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abad3ee-15e8-4543-8407-a8395ad3e28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=174cae678d774d5a84437ea45d5de394, user_id=85c4b6d0b82b4d7bb15199424ed0c140, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.275073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abad3ee-15e8-4543-8407-a8395ad3e28b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.281532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ef55a-1460-47f7-a715-19e1fa289add None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.288408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32e71a-4519-48eb-a480-03136abd5a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.290058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32e71a-4519-48eb-a480-03136abd5a6a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.290395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32e71a-4519-48eb-a480-03136abd5a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.290677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32e71a-4519-48eb-a480-03136abd5a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.291669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32e71a-4519-48eb-a480-03136abd5a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.293488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32e71a-4519-48eb-a480-03136abd5a6a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.298117 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 819/1634] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:35 2022] PUT /identity/v3/projects/174cae678d774d5a84437ea45d5de394/users/85c4b6d0b82b4d7bb15199424ed0c140/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:35.299992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abad3ee-15e8-4543-8407-a8395ad3e28b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.304302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6abad3ee-15e8-4543-8407-a8395ad3e28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:35.307269 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 816/1635] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:35.308881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a1035-8e22-426c-a76e-3488f670df51 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.309222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a1035-8e22-426c-a76e-3488f670df51 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.309510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a1035-8e22-426c-a76e-3488f670df51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.334132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-df7a1035-8e22-426c-a76e-3488f670df51 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:35.335554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-df7a1035-8e22-426c-a76e-3488f670df51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:35.394651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abad3ee-15e8-4543-8407-a8395ad3e28b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.404315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a226984-9327-4f0c-8da4-ede8aca71a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.404939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a226984-9327-4f0c-8da4-ede8aca71a24 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.405222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a226984-9327-4f0c-8da4-ede8aca71a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.405549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a226984-9327-4f0c-8da4-ede8aca71a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.406188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a226984-9327-4f0c-8da4-ede8aca71a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.408880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a226984-9327-4f0c-8da4-ede8aca71a24 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.420605 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 820/1636] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:35.421773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7787ba-2e13-4525-b14c-53ec6b273205 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.422100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7787ba-2e13-4525-b14c-53ec6b273205 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.422381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7787ba-2e13-4525-b14c-53ec6b273205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.428997 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 817/1637] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:35.430164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a1035-8e22-426c-a76e-3488f670df51 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.444512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a1035-8e22-426c-a76e-3488f670df51 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.451000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a622c0b-6bc7-4bba-a06a-6c6f231ab57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.451686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a622c0b-6bc7-4bba-a06a-6c6f231ab57a admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.451994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a622c0b-6bc7-4bba-a06a-6c6f231ab57a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.452271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a622c0b-6bc7-4bba-a06a-6c6f231ab57a admin admin] PATH_INFO: `/v3/projects/41d21f9368724568b2e9d69853951ad6/users/28aca1e665ce438e80db8101b41df103/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.454440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a622c0b-6bc7-4bba-a06a-6c6f231ab57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41d21f9368724568b2e9d69853951ad6, user_id=28aca1e665ce438e80db8101b41df103, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.458671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a622c0b-6bc7-4bba-a06a-6c6f231ab57a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.459976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-bb7787ba-2e13-4525-b14c-53ec6b273205 None None] MFA Rules not processed for user `2737db8812e04292b7f0649a99b5174a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:35.461205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bb7787ba-2e13-4525-b14c-53ec6b273205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:35.481385 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 818/1638] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:35 2022] PUT /identity/v3/projects/41d21f9368724568b2e9d69853951ad6/users/28aca1e665ce438e80db8101b41df103/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:35.481385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b0713-035f-481b-b2db-8d3d90d021d5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.481385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b0713-035f-481b-b2db-8d3d90d021d5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.481385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b0713-035f-481b-b2db-8d3d90d021d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.524750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:35.543765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bf3b0713-035f-481b-b2db-8d3d90d021d5 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:35.544861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bf3b0713-035f-481b-b2db-8d3d90d021d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:35.553585 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 821/1639] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:35.554849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7787ba-2e13-4525-b14c-53ec6b273205 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.563279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:35.573977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7787ba-2e13-4525-b14c-53ec6b273205 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.667628 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 819/1640] 10.222.0.70 () {58 vars in 1059 bytes} [Sun Aug 28 18:51:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:35.676705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b0713-035f-481b-b2db-8d3d90d021d5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.713879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad78a3-3ed4-48a1-80b4-f6933fbfc423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.714611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad78a3-3ed4-48a1-80b4-f6933fbfc423 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.714945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad78a3-3ed4-48a1-80b4-f6933fbfc423 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.715889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad78a3-3ed4-48a1-80b4-f6933fbfc423 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.716602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad78a3-3ed4-48a1-80b4-f6933fbfc423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.718948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad78a3-3ed4-48a1-80b4-f6933fbfc423 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.741999 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 822/1641] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:35.743019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad78a3-3ed4-48a1-80b4-f6933fbfc423 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.761276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad78a3-3ed4-48a1-80b4-f6933fbfc423 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.778308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dd1b9-d2f9-4dc9-86fe-dd38c5e15be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.779101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dd1b9-d2f9-4dc9-86fe-dd38c5e15be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.779558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dd1b9-d2f9-4dc9-86fe-dd38c5e15be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.779884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dd1b9-d2f9-4dc9-86fe-dd38c5e15be8 admin admin] PATH_INFO: `/v3/projects/ca49c9c65fb94be1934041946262b745/users/a5d9ed14b1684fcb90962d80f4b7e00f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.792930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b0713-035f-481b-b2db-8d3d90d021d5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:35.798431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9550f-4282-47bb-8231-7cc88b15850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:35.799449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9550f-4282-47bb-8231-7cc88b15850d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.799739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9550f-4282-47bb-8231-7cc88b15850d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.800024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9550f-4282-47bb-8231-7cc88b15850d admin admin] PATH_INFO: `/v3/projects/383c6163263c456fb10363ca5294d7c9/users/48fe0c3410264e16a1a2cf0d6215971c/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.809476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dd1b9-d2f9-4dc9-86fe-dd38c5e15be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca49c9c65fb94be1934041946262b745, user_id=a5d9ed14b1684fcb90962d80f4b7e00f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.815106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dd1b9-d2f9-4dc9-86fe-dd38c5e15be8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.818595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9550f-4282-47bb-8231-7cc88b15850d admin admin] RBAC: Authorizing `identity:create_grant(project_id=383c6163263c456fb10363ca5294d7c9, user_id=48fe0c3410264e16a1a2cf0d6215971c, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:35.821769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9550f-4282-47bb-8231-7cc88b15850d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:35.838399 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 823/1642] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:35 2022] PUT /identity/v3/projects/ca49c9c65fb94be1934041946262b745/users/a5d9ed14b1684fcb90962d80f4b7e00f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:35.839549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dd1b9-d2f9-4dc9-86fe-dd38c5e15be8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:35.841385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d89dd1b9-d2f9-4dc9-86fe-dd38c5e15be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:35.850828 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 820/1643] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:35 2022] PUT /identity/v3/projects/383c6163263c456fb10363ca5294d7c9/users/48fe0c3410264e16a1a2cf0d6215971c/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:35.853053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c21ee-ae5d-4c8e-96ae-6cf541463990 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:35.853745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c21ee-ae5d-4c8e-96ae-6cf541463990 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:35.854255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c21ee-ae5d-4c8e-96ae-6cf541463990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:35.904737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-269c21ee-ae5d-4c8e-96ae-6cf541463990 None None] MFA Rules not processed for user `28aca1e665ce438e80db8101b41df103`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:35.906122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-269c21ee-ae5d-4c8e-96ae-6cf541463990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:35.951423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dd1b9-d2f9-4dc9-86fe-dd38c5e15be8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.031121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac64a4-8ce2-4db1-a687-fc42a53b58aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.031593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac64a4-8ce2-4db1-a687-fc42a53b58aa service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.031938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac64a4-8ce2-4db1-a687-fc42a53b58aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.034814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac64a4-8ce2-4db1-a687-fc42a53b58aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.039063 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 821/1644] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:36.040926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ec718-7d92-49b1-aa76-8c37fb604546 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.041330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ec718-7d92-49b1-aa76-8c37fb604546 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.041787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ec718-7d92-49b1-aa76-8c37fb604546 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.044198 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 822/1645] 10.222.0.70 () {54 vars in 962 bytes} [Sun Aug 28 18:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:51:36.046152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ec718-7d92-49b1-aa76-8c37fb604546 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.055642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:36.105175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:36.136692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac64a4-8ce2-4db1-a687-fc42a53b58aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.138333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac64a4-8ce2-4db1-a687-fc42a53b58aa service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.170063 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 824/1646] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:36.171155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac64a4-8ce2-4db1-a687-fc42a53b58aa service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.181496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ec718-7d92-49b1-aa76-8c37fb604546 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.194485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac64a4-8ce2-4db1-a687-fc42a53b58aa service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.196151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77182c3-1059-4ddf-9d2c-cba269e6f8f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.196865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77182c3-1059-4ddf-9d2c-cba269e6f8f7 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.197155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77182c3-1059-4ddf-9d2c-cba269e6f8f7 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.197491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77182c3-1059-4ddf-9d2c-cba269e6f8f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.203024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a77182c3-1059-4ddf-9d2c-cba269e6f8f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:36.208607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59406ca-cf4e-4877-b32b-f89dcf2a9f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.210562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59406ca-cf4e-4877-b32b-f89dcf2a9f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.211402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59406ca-cf4e-4877-b32b-f89dcf2a9f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.211709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59406ca-cf4e-4877-b32b-f89dcf2a9f68 admin admin] PATH_INFO: `/v3/projects/174cae678d774d5a84437ea45d5de394/users/85c4b6d0b82b4d7bb15199424ed0c140/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.217678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59406ca-cf4e-4877-b32b-f89dcf2a9f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=174cae678d774d5a84437ea45d5de394, user_id=85c4b6d0b82b4d7bb15199424ed0c140, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.222037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59406ca-cf4e-4877-b32b-f89dcf2a9f68 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.259111 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 825/1647] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:36 2022] PUT /identity/v3/projects/174cae678d774d5a84437ea45d5de394/users/85c4b6d0b82b4d7bb15199424ed0c140/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:36.261064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59406ca-cf4e-4877-b32b-f89dcf2a9f68 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.368905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59406ca-cf4e-4877-b32b-f89dcf2a9f68 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.374496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87e87-b76f-4485-9abe-cf6b5544bf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.375180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87e87-b76f-4485-9abe-cf6b5544bf01 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.375484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87e87-b76f-4485-9abe-cf6b5544bf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.375758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87e87-b76f-4485-9abe-cf6b5544bf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.376469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d87e87-b76f-4485-9abe-cf6b5544bf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.378329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d87e87-b76f-4485-9abe-cf6b5544bf01 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.386191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77182c3-1059-4ddf-9d2c-cba269e6f8f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.388237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77182c3-1059-4ddf-9d2c-cba269e6f8f7 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.394289 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 826/1648] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:36.394472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87e87-b76f-4485-9abe-cf6b5544bf01 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.410049 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 823/1649] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:36.411945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa1093-c1dc-4355-8e11-382f4e200ef9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.413530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87e87-b76f-4485-9abe-cf6b5544bf01 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.414037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa1093-c1dc-4355-8e11-382f4e200ef9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.414866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa1093-c1dc-4355-8e11-382f4e200ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.421351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265baa92-379b-48d6-8eb3-66e8487b8e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.424582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265baa92-379b-48d6-8eb3-66e8487b8e6b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.425516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265baa92-379b-48d6-8eb3-66e8487b8e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.425516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265baa92-379b-48d6-8eb3-66e8487b8e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.425837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265baa92-379b-48d6-8eb3-66e8487b8e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.427494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265baa92-379b-48d6-8eb3-66e8487b8e6b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.453049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c7fa1093-c1dc-4355-8e11-382f4e200ef9 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:36.455027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c7fa1093-c1dc-4355-8e11-382f4e200ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:36.455170 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 827/1650] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:36.459968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b712e-393c-43c3-9be9-14b4bb63ecaa None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.460255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b712e-393c-43c3-9be9-14b4bb63ecaa None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.460783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b712e-393c-43c3-9be9-14b4bb63ecaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.508517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b42b712e-393c-43c3-9be9-14b4bb63ecaa None None] MFA Rules not processed for user `85c4b6d0b82b4d7bb15199424ed0c140`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:36.509805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b42b712e-393c-43c3-9be9-14b4bb63ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:36.593249 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 828/1651] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:36.594165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b712e-393c-43c3-9be9-14b4bb63ecaa None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.596576 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 824/1652] 10.222.0.70 () {58 vars in 1059 bytes} [Sun Aug 28 18:51:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:36.598187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa1093-c1dc-4355-8e11-382f4e200ef9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.613746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa1093-c1dc-4355-8e11-382f4e200ef9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.615167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b712e-393c-43c3-9be9-14b4bb63ecaa None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.619403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3b4f8-eb77-4afc-864e-2ca75691c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.620300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3b4f8-eb77-4afc-864e-2ca75691c91c admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.620433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742f7f9-b0ae-4de1-98aa-40d9be0c5741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.620624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3b4f8-eb77-4afc-864e-2ca75691c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.620976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742f7f9-b0ae-4de1-98aa-40d9be0c5741 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.621094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3b4f8-eb77-4afc-864e-2ca75691c91c admin admin] PATH_INFO: `/v3/projects/383c6163263c456fb10363ca5294d7c9/users/48fe0c3410264e16a1a2cf0d6215971c/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.621258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742f7f9-b0ae-4de1-98aa-40d9be0c5741 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.621532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742f7f9-b0ae-4de1-98aa-40d9be0c5741 admin admin] PATH_INFO: `/v3/projects/ca49c9c65fb94be1934041946262b745/users/a5d9ed14b1684fcb90962d80f4b7e00f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.623407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3b4f8-eb77-4afc-864e-2ca75691c91c admin admin] RBAC: Authorizing `identity:create_grant(project_id=383c6163263c456fb10363ca5294d7c9, user_id=48fe0c3410264e16a1a2cf0d6215971c, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.623692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742f7f9-b0ae-4de1-98aa-40d9be0c5741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca49c9c65fb94be1934041946262b745, user_id=a5d9ed14b1684fcb90962d80f4b7e00f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:36.626397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3b4f8-eb77-4afc-864e-2ca75691c91c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.626609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742f7f9-b0ae-4de1-98aa-40d9be0c5741 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:36.642246 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 829/1653] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:36 2022] PUT /identity/v3/projects/ca49c9c65fb94be1934041946262b745/users/a5d9ed14b1684fcb90962d80f4b7e00f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:36.643117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742f7f9-b0ae-4de1-98aa-40d9be0c5741 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:36.651416 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 825/1654] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:36 2022] PUT /identity/v3/projects/383c6163263c456fb10363ca5294d7c9/users/48fe0c3410264e16a1a2cf0d6215971c/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:36.653637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a28268-ba6e-4c08-9813-0a6771524433 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.653965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a28268-ba6e-4c08-9813-0a6771524433 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.654720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a28268-ba6e-4c08-9813-0a6771524433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.685968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:36.697815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:36.706467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b8a28268-ba6e-4c08-9813-0a6771524433 None None] MFA Rules not processed for user `a5d9ed14b1684fcb90962d80f4b7e00f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:36.708121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b8a28268-ba6e-4c08-9813-0a6771524433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:36.753577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742f7f9-b0ae-4de1-98aa-40d9be0c5741 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:36.915052 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 826/1655] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:36.916004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2adfa0-ab97-4e47-860f-3c726e70bc8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:36.916759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2adfa0-ab97-4e47-860f-3c726e70bc8d service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.916891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2616a70-588d-4aaf-a6fc-adda9bc105cf None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:36.917335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2616a70-588d-4aaf-a6fc-adda9bc105cf None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.917529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2adfa0-ab97-4e47-860f-3c726e70bc8d service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:36.917611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2616a70-588d-4aaf-a6fc-adda9bc105cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.918285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2adfa0-ab97-4e47-860f-3c726e70bc8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:36.975380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f2616a70-588d-4aaf-a6fc-adda9bc105cf None None] MFA Rules not processed for user `48fe0c3410264e16a1a2cf0d6215971c`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:36.976846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f2616a70-588d-4aaf-a6fc-adda9bc105cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:37.077909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2adfa0-ab97-4e47-860f-3c726e70bc8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.081153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2adfa0-ab97-4e47-860f-3c726e70bc8d service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.111885 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 830/1656] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:37.114324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2adfa0-ab97-4e47-860f-3c726e70bc8d service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.116631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6e2adfa0-ab97-4e47-860f-3c726e70bc8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:37.149096 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 827/1657] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:36 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:37.156392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2616a70-588d-4aaf-a6fc-adda9bc105cf None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.178088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2616a70-588d-4aaf-a6fc-adda9bc105cf None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:37.190943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977a072-863e-4598-8b5f-6211189acafe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:37.192031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977a072-863e-4598-8b5f-6211189acafe service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.192578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977a072-863e-4598-8b5f-6211189acafe service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.193126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977a072-863e-4598-8b5f-6211189acafe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.244442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:37.255976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2adfa0-ab97-4e47-860f-3c726e70bc8d service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:37.292229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:37.294858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.295438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.295989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145 admin admin] PATH_INFO: `/v3/projects/7f2247796ddb461ebd25e5e12fbd9420` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.299447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2247796ddb461ebd25e5e12fbd9420)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.301709 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 18:51:37.301709 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 18:51:37.301709 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 18:51:37.307831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.325390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977a072-863e-4598-8b5f-6211189acafe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.328536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977a072-863e-4598-8b5f-6211189acafe service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.343630 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 828/1658] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:37.440453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2247796ddb461ebd25e5e12fbd9420', 'request_id': 'req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:37.453246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2247796ddb461ebd25e5e12fbd9420', 'request_id': 'req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:37.469956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977a072-863e-4598-8b5f-6211189acafe service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.470595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2247796ddb461ebd25e5e12fbd9420', 'request_id': 'req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:37.486872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977a072-863e-4598-8b5f-6211189acafe service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:37.489565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145 admin admin] The token cache is being invalidate because project 7f2247796ddb461ebd25e5e12fbd9420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:37.489973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:37.490830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0cf8c7e2-fe70-45cb-a6d9-b2d97fd38145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:37.502827 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 831/1659] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:37 2022] DELETE /identity/v3/projects/7f2247796ddb461ebd25e5e12fbd9420 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:37.505394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbaaf5-90a9-42f4-98b3-919ccfced3a3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.505394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbaaf5-90a9-42f4-98b3-919ccfced3a3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.505749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbaaf5-90a9-42f4-98b3-919ccfced3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.528153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:37.575872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cecbaaf5-90a9-42f4-98b3-919ccfced3a3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:37.584930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cecbaaf5-90a9-42f4-98b3-919ccfced3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:37.622267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe6996-e5d8-4a3f-a7af-0ee56a0c85eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:37.622995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe6996-e5d8-4a3f-a7af-0ee56a0c85eb service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.623403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe6996-e5d8-4a3f-a7af-0ee56a0c85eb service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.623780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe6996-e5d8-4a3f-a7af-0ee56a0c85eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.627321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dcbe6996-e5d8-4a3f-a7af-0ee56a0c85eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:37.724097 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 832/1660] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:51:37.725241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbaaf5-90a9-42f4-98b3-919ccfced3a3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.726648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cecbaaf5-90a9-42f4-98b3-919ccfced3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:37.735182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe6996-e5d8-4a3f-a7af-0ee56a0c85eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.739895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe6996-e5d8-4a3f-a7af-0ee56a0c85eb service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.746608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbaaf5-90a9-42f4-98b3-919ccfced3a3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:37.753426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb02355-0969-40c0-aa75-9e4a3ecce6a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:37.754103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb02355-0969-40c0-aa75-9e4a3ecce6a2 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.754679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb02355-0969-40c0-aa75-9e4a3ecce6a2 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.755023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb02355-0969-40c0-aa75-9e4a3ecce6a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.756263 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 829/1661] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:37.757931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8b22b-a01a-4da1-9d7a-177576127146 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.758256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8b22b-a01a-4da1-9d7a-177576127146 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.758647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8b22b-a01a-4da1-9d7a-177576127146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.773217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4bb02355-0969-40c0-aa75-9e4a3ecce6a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:37.786544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f3c8b22b-a01a-4da1-9d7a-177576127146 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:37.789487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f3c8b22b-a01a-4da1-9d7a-177576127146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:37.806392 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 830/1662] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:37.807648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8b22b-a01a-4da1-9d7a-177576127146 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.820833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8b22b-a01a-4da1-9d7a-177576127146 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:37.827319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b43a7d-daaa-4547-b5ce-20faae1a96e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:37.828202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b43a7d-daaa-4547-b5ce-20faae1a96e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.828487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b43a7d-daaa-4547-b5ce-20faae1a96e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.828809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b43a7d-daaa-4547-b5ce-20faae1a96e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.830620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b43a7d-daaa-4547-b5ce-20faae1a96e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:37.831168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b43a7d-daaa-4547-b5ce-20faae1a96e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.834826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b43a7d-daaa-4547-b5ce-20faae1a96e6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.863703 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 831/1663] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:37.866577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b43a7d-daaa-4547-b5ce-20faae1a96e6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.893828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b43a7d-daaa-4547-b5ce-20faae1a96e6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:37.906591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87884f95-8081-4206-b562-8a66b2fb0f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:37.908007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87884f95-8081-4206-b562-8a66b2fb0f9b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:37.908402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87884f95-8081-4206-b562-8a66b2fb0f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:37.908682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87884f95-8081-4206-b562-8a66b2fb0f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:37.909334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87884f95-8081-4206-b562-8a66b2fb0f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.911471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87884f95-8081-4206-b562-8a66b2fb0f9b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.936989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb02355-0969-40c0-aa75-9e4a3ecce6a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:37.940133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb02355-0969-40c0-aa75-9e4a3ecce6a2 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:37.967621 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 833/1664] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:37.968815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb02355-0969-40c0-aa75-9e4a3ecce6a2 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:37.974410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4bb02355-0969-40c0-aa75-9e4a3ecce6a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:37.980045 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 832/1665] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:37 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:37.983593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87884f95-8081-4206-b562-8a66b2fb0f9b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:38.014177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb02355-0969-40c0-aa75-9e4a3ecce6a2 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:38.077465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:38.151800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae875-cfd7-4b4f-bfc5-0817b1d78307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:38.152727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae875-cfd7-4b4f-bfc5-0817b1d78307 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:38.153227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae875-cfd7-4b4f-bfc5-0817b1d78307 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:38.153828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae875-cfd7-4b4f-bfc5-0817b1d78307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:38.156223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bb2ae875-cfd7-4b4f-bfc5-0817b1d78307 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:38.219052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87884f95-8081-4206-b562-8a66b2fb0f9b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:38.229461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996c57b-e888-4cb2-a610-44196568cca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:38.230099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996c57b-e888-4cb2-a610-44196568cca6 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:38.230385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996c57b-e888-4cb2-a610-44196568cca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:38.230668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996c57b-e888-4cb2-a610-44196568cca6 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:38.232181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996c57b-e888-4cb2-a610-44196568cca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:38.239820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996c57b-e888-4cb2-a610-44196568cca6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:38.267773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:38.280757 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 833/1666] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:37 2022] POST /identity/v3/users => generated 296 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:38.281459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a65b15-0b8c-4dad-9f3f-5037dab9477f None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:38.281837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a65b15-0b8c-4dad-9f3f-5037dab9477f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:38.292778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a65b15-0b8c-4dad-9f3f-5037dab9477f None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:38.294946 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 834/1667] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:51:38 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:51:38.296233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a65b15-0b8c-4dad-9f3f-5037dab9477f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:38.311136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ae875-cfd7-4b4f-bfc5-0817b1d78307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:38.314473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a65b15-0b8c-4dad-9f3f-5037dab9477f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:38.315808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ae875-cfd7-4b4f-bfc5-0817b1d78307 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:38.322298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d15f3-e539-4983-b2ca-eb5319deead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:38.323247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d15f3-e539-4983-b2ca-eb5319deead2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:38.323722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d15f3-e539-4983-b2ca-eb5319deead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:38.324097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d15f3-e539-4983-b2ca-eb5319deead2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:38.324847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d15f3-e539-4983-b2ca-eb5319deead2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:38.326564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d15f3-e539-4983-b2ca-eb5319deead2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:38.331065 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 834/1668] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:38.332185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae875-cfd7-4b4f-bfc5-0817b1d78307 service nova] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:51:38.346594 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 835/1669] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:38.348603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d15f3-e539-4983-b2ca-eb5319deead2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:38.348827 n-d-854118-7 devstack@keystone.service[88375]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae875-cfd7-4b4f-bfc5-0817b1d78307 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 28 18:51:38.349440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae875-cfd7-4b4f-bfc5-0817b1d78307 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:38.351619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bb2ae875-cfd7-4b4f-bfc5-0817b1d78307 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:38.361780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d15f3-e539-4983-b2ca-eb5319deead2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:38.367608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046dd4af-234a-4470-9d29-57df641460f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:38.368461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dd4af-234a-4470-9d29-57df641460f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:38.368989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dd4af-234a-4470-9d29-57df641460f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:38.369381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dd4af-234a-4470-9d29-57df641460f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:38.370241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046dd4af-234a-4470-9d29-57df641460f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:38.371950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046dd4af-234a-4470-9d29-57df641460f3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:38.395217 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 836/1670] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:38.396328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046dd4af-234a-4470-9d29-57df641460f3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:38.408639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046dd4af-234a-4470-9d29-57df641460f3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:38.414354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e43aa7-7043-4930-bbb1-7119593d58d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:38.415584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e43aa7-7043-4930-bbb1-7119593d58d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:38.416011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e43aa7-7043-4930-bbb1-7119593d58d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:38.416405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e43aa7-7043-4930-bbb1-7119593d58d7 admin admin] PATH_INFO: `/v3/projects/b7f428e0ea1f4e6e859f0ed9114ba819/users/75506c260fd04d3b80b0c05b35d7777d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:38.436127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e43aa7-7043-4930-bbb1-7119593d58d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f428e0ea1f4e6e859f0ed9114ba819, user_id=75506c260fd04d3b80b0c05b35d7777d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:38.440544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e43aa7-7043-4930-bbb1-7119593d58d7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:38.473975 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 837/1671] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:38 2022] PUT /identity/v3/projects/b7f428e0ea1f4e6e859f0ed9114ba819/users/75506c260fd04d3b80b0c05b35d7777d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:38.492924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def96817-c866-4f2a-bac9-eb5da838c1ba None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:38.493217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def96817-c866-4f2a-bac9-eb5da838c1ba None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:38.493499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def96817-c866-4f2a-bac9-eb5da838c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:38.523229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae875-cfd7-4b4f-bfc5-0817b1d78307 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:38.565800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-def96817-c866-4f2a-bac9-eb5da838c1ba None None] MFA Rules not processed for user `75506c260fd04d3b80b0c05b35d7777d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:38.567125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-def96817-c866-4f2a-bac9-eb5da838c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:38.665963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:38.683130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b724c-85b7-4489-9023-01442ff3ef9b tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2737db8812e04292b7f0649a99b5174a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a936f8401fa64889889a3e0bb60c2515', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:38.685897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b724c-85b7-4489-9023-01442ff3ef9b tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:38.689437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b724c-85b7-4489-9023-01442ff3ef9b tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:38.689799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b724c-85b7-4489-9023-01442ff3ef9b tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] PATH_INFO: `/v3/projects/aaf151bf5fc84aa4ab3aff97096b4273` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:38.694538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b724c-85b7-4489-9023-01442ff3ef9b tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] RBAC: Authorizing `identity:get_project(project_id=aaf151bf5fc84aa4ab3aff97096b4273)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:38.699564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b724c-85b7-4489-9023-01442ff3ef9b tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:38.703527 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 835/1672] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:51:38 2022] GET /identity/v3/projects/aaf151bf5fc84aa4ab3aff97096b4273 => generated 377 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:38.706498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b724c-85b7-4489-9023-01442ff3ef9b tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:38.770587 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 838/1673] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:38.771721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def96817-c866-4f2a-bac9-eb5da838c1ba None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:38.907865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b724c-85b7-4489-9023-01442ff3ef9b tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:38.917519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a290a0-4681-4313-9965-58e522a3776f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:38.918393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a290a0-4681-4313-9965-58e522a3776f service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:38.918839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a290a0-4681-4313-9965-58e522a3776f service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:38.919158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a290a0-4681-4313-9965-58e522a3776f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:38.921865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-08a290a0-4681-4313-9965-58e522a3776f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:38.940661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def96817-c866-4f2a-bac9-eb5da838c1ba None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:38.949772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fad0b-592b-45d2-b5d5-4ac7013dc13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:38.950631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fad0b-592b-45d2-b5d5-4ac7013dc13a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:38.951094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fad0b-592b-45d2-b5d5-4ac7013dc13a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:38.951664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fad0b-592b-45d2-b5d5-4ac7013dc13a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:38.952660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fad0b-592b-45d2-b5d5-4ac7013dc13a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:38.956650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fad0b-592b-45d2-b5d5-4ac7013dc13a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:39.025875 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 839/1674] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:38 2022] POST /identity/v3/projects => generated 393 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:39.027037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fad0b-592b-45d2-b5d5-4ac7013dc13a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:39.048024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a290a0-4681-4313-9965-58e522a3776f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:39.050607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a290a0-4681-4313-9965-58e522a3776f service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:39.066897 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 836/1675] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:39.069415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a290a0-4681-4313-9965-58e522a3776f service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:39.083463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a290a0-4681-4313-9965-58e522a3776f service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:39.121319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:39.211759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98e726-5f3f-4357-85c4-3ffdb63fde05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:39.212398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98e726-5f3f-4357-85c4-3ffdb63fde05 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:39.214885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98e726-5f3f-4357-85c4-3ffdb63fde05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:39.215228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98e726-5f3f-4357-85c4-3ffdb63fde05 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:39.217154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98e726-5f3f-4357-85c4-3ffdb63fde05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:39.223889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fad0b-592b-45d2-b5d5-4ac7013dc13a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:39.225065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98e726-5f3f-4357-85c4-3ffdb63fde05 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:39.232834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3312f-ec6a-4cf0-a479-4c0c5ed68e22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:39.232834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3312f-ec6a-4cf0-a479-4c0c5ed68e22 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:39.233191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3312f-ec6a-4cf0-a479-4c0c5ed68e22 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:39.233567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3312f-ec6a-4cf0-a479-4c0c5ed68e22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:39.236537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cbf3312f-ec6a-4cf0-a479-4c0c5ed68e22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:39.280241 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 837/1676] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:39 2022] POST /identity/v3/users => generated 303 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:39.286273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98e726-5f3f-4357-85c4-3ffdb63fde05 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:39.314126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98e726-5f3f-4357-85c4-3ffdb63fde05 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:39.333040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135f9f2-c7d8-40b8-8c6c-b6dc0a38be18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:39.334734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135f9f2-c7d8-40b8-8c6c-b6dc0a38be18 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:39.335324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135f9f2-c7d8-40b8-8c6c-b6dc0a38be18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:39.337576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135f9f2-c7d8-40b8-8c6c-b6dc0a38be18 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:39.338466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135f9f2-c7d8-40b8-8c6c-b6dc0a38be18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:39.344051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135f9f2-c7d8-40b8-8c6c-b6dc0a38be18 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:39.392305 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 838/1677] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:39.395692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135f9f2-c7d8-40b8-8c6c-b6dc0a38be18 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:39.411890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135f9f2-c7d8-40b8-8c6c-b6dc0a38be18 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:39.417181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112dd03-fb44-4986-9cb8-2875bba0506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:39.417921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112dd03-fb44-4986-9cb8-2875bba0506c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:39.418202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112dd03-fb44-4986-9cb8-2875bba0506c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:39.418482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112dd03-fb44-4986-9cb8-2875bba0506c admin admin] PATH_INFO: `/v3/projects/807998cdad3e4fe7b7c07bb844c40b54/users/569365815c644f8bba8bc04fb6cc67f0/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:39.419095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3312f-ec6a-4cf0-a479-4c0c5ed68e22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:39.421949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3312f-ec6a-4cf0-a479-4c0c5ed68e22 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:39.434274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:39.441562 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 840/1678] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:39.463930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112dd03-fb44-4986-9cb8-2875bba0506c admin admin] RBAC: Authorizing `identity:create_grant(project_id=807998cdad3e4fe7b7c07bb844c40b54, user_id=569365815c644f8bba8bc04fb6cc67f0, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:39.471958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112dd03-fb44-4986-9cb8-2875bba0506c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:39.504084 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 839/1679] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:39 2022] PUT /identity/v3/projects/807998cdad3e4fe7b7c07bb844c40b54/users/569365815c644f8bba8bc04fb6cc67f0/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:39.504918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3312f-ec6a-4cf0-a479-4c0c5ed68e22 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:39.508578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92a7cf-9489-4783-bfff-eaeb8792b99a None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:39.509069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92a7cf-9489-4783-bfff-eaeb8792b99a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:39.509548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92a7cf-9489-4783-bfff-eaeb8792b99a None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:39.511523 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 840/1680] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:51:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:51:39.525201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ebda1-bb81-46a8-ab70-d8e4954c6f42 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:39.525857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ebda1-bb81-46a8-ab70-d8e4954c6f42 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:39.526055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ebda1-bb81-46a8-ab70-d8e4954c6f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:39.550394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3312f-ec6a-4cf0-a479-4c0c5ed68e22 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:39.590901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-182ebda1-bb81-46a8-ab70-d8e4954c6f42 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:39.593673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-182ebda1-bb81-46a8-ab70-d8e4954c6f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:39.721712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01eada-67a7-4e07-b278-4b7b24e8af91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:39.722416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01eada-67a7-4e07-b278-4b7b24e8af91 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:39.722720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01eada-67a7-4e07-b278-4b7b24e8af91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:39.723154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01eada-67a7-4e07-b278-4b7b24e8af91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:39.723893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01eada-67a7-4e07-b278-4b7b24e8af91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:39.725108 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 841/1681] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 18:51:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:39.726018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01eada-67a7-4e07-b278-4b7b24e8af91 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:39.726935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d4890-98e7-4081-b1ae-8346669659b5 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:39.727444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d4890-98e7-4081-b1ae-8346669659b5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:39.727728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d4890-98e7-4081-b1ae-8346669659b5 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:39.729652 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 842/1682] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:51:39.738267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d4890-98e7-4081-b1ae-8346669659b5 None None] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:51:39.751435 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 841/1683] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:51:39.756077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01eada-67a7-4e07-b278-4b7b24e8af91 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:39.775415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01eada-67a7-4e07-b278-4b7b24e8af91 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:39.783126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b6c74-0023-4b93-903e-cbab261cebbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:39.784121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b6c74-0023-4b93-903e-cbab261cebbc admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:39.784607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b6c74-0023-4b93-903e-cbab261cebbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:39.785050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b6c74-0023-4b93-903e-cbab261cebbc admin admin] PATH_INFO: `/v3/projects/807998cdad3e4fe7b7c07bb844c40b54/users/569365815c644f8bba8bc04fb6cc67f0/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:39.789528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b6c74-0023-4b93-903e-cbab261cebbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=807998cdad3e4fe7b7c07bb844c40b54, user_id=569365815c644f8bba8bc04fb6cc67f0, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:39.796898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b6c74-0023-4b93-903e-cbab261cebbc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:39.814565 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 842/1684] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:39 2022] PUT /identity/v3/projects/807998cdad3e4fe7b7c07bb844c40b54/users/569365815c644f8bba8bc04fb6cc67f0/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:39.815918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b6c74-0023-4b93-903e-cbab261cebbc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:39.820844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d40b6c74-0023-4b93-903e-cbab261cebbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:39.899213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:39.921001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d4890-98e7-4081-b1ae-8346669659b5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:39.949495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b6c74-0023-4b93-903e-cbab261cebbc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:39.958331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb9449-5a6a-4812-9f9d-45a39d5f2987 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:39.959078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9449-5a6a-4812-9f9d-45a39d5f2987 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:39.959403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9449-5a6a-4812-9f9d-45a39d5f2987 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:39.959742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb9449-5a6a-4812-9f9d-45a39d5f2987 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:39.975154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb9449-5a6a-4812-9f9d-45a39d5f2987 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:39.977519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb9449-5a6a-4812-9f9d-45a39d5f2987 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:40.016962 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 843/1685] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:40.020249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57182e68-2dde-4ce8-8ae9-b4fc86e6cec5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:40.020596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57182e68-2dde-4ce8-8ae9-b4fc86e6cec5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:40.020894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57182e68-2dde-4ce8-8ae9-b4fc86e6cec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:40.091456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d4890-98e7-4081-b1ae-8346669659b5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:40.104903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-57182e68-2dde-4ce8-8ae9-b4fc86e6cec5 None None] MFA Rules not processed for user `569365815c644f8bba8bc04fb6cc67f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:40.106381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-57182e68-2dde-4ce8-8ae9-b4fc86e6cec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:40.157945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:40.275084 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 844/1686] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:40.281138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04af1c-6f45-491d-a89c-5b78f75d4754 tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2737db8812e04292b7f0649a99b5174a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a936f8401fa64889889a3e0bb60c2515', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:40.281998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04af1c-6f45-491d-a89c-5b78f75d4754 tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:40.282903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04af1c-6f45-491d-a89c-5b78f75d4754 tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:40.283578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04af1c-6f45-491d-a89c-5b78f75d4754 tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] PATH_INFO: `/v3/projects/aaf151bf5fc84aa4ab3aff97096b4273` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:40.285008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04af1c-6f45-491d-a89c-5b78f75d4754 tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] RBAC: Authorizing `identity:get_project(project_id=aaf151bf5fc84aa4ab3aff97096b4273)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:40.287419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04af1c-6f45-491d-a89c-5b78f75d4754 tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:40.289920 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 843/1687] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:51:39 2022] GET /identity/v3/projects/aaf151bf5fc84aa4ab3aff97096b4273 => generated 377 bytes in 552 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:40.358676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57182e68-2dde-4ce8-8ae9-b4fc86e6cec5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:40.490294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57182e68-2dde-4ce8-8ae9-b4fc86e6cec5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:40.499401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac9412-859a-44e9-aec6-82209d13d082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:40.500460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac9412-859a-44e9-aec6-82209d13d082 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:40.501409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac9412-859a-44e9-aec6-82209d13d082 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:40.501783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac9412-859a-44e9-aec6-82209d13d082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:40.523099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac9412-859a-44e9-aec6-82209d13d082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:40.524886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac9412-859a-44e9-aec6-82209d13d082 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:40.576490 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 845/1688] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:40.662887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04af1c-6f45-491d-a89c-5b78f75d4754 tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:40.667981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ef04af1c-6f45-491d-a89c-5b78f75d4754 tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:40.746254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac9412-859a-44e9-aec6-82209d13d082 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:40.748003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2aac9412-859a-44e9-aec6-82209d13d082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:40.842838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04af1c-6f45-491d-a89c-5b78f75d4754 tempest-FlavorsAccessTestJSON-2106683072 tempest-FlavorsAccessTestJSON-2106683072-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:40.856153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb9ee0-29bf-44dd-bea6-e75e27522c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:40.856948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb9ee0-29bf-44dd-bea6-e75e27522c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:40.857314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb9ee0-29bf-44dd-bea6-e75e27522c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:40.858037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb9ee0-29bf-44dd-bea6-e75e27522c55 admin admin] PATH_INFO: `/v3/users/02af8bde3635447fa2d0fb7a613bff05` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:40.859784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb9ee0-29bf-44dd-bea6-e75e27522c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02af8bde3635447fa2d0fb7a613bff05)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:40.863200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb9ee0-29bf-44dd-bea6-e75e27522c55 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:40.895710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:40.952638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-30fb9ee0-29bf-44dd-bea6-e75e27522c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02af8bde3635447fa2d0fb7a613bff05'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:40.964380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-30fb9ee0-29bf-44dd-bea6-e75e27522c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02af8bde3635447fa2d0fb7a613bff05'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:40.965346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-30fb9ee0-29bf-44dd-bea6-e75e27522c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02af8bde3635447fa2d0fb7a613bff05'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:40.968498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac9412-859a-44e9-aec6-82209d13d082 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:40.981670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-30fb9ee0-29bf-44dd-bea6-e75e27522c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02af8bde3635447fa2d0fb7a613bff05'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:40.982517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-30fb9ee0-29bf-44dd-bea6-e75e27522c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02af8bde3635447fa2d0fb7a613bff05'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:40.987937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c77819-b9e3-4428-8d0b-daacbfcb7ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:40.988536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c77819-b9e3-4428-8d0b-daacbfcb7ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:40.988819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c77819-b9e3-4428-8d0b-daacbfcb7ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:40.989097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c77819-b9e3-4428-8d0b-daacbfcb7ed2 admin admin] PATH_INFO: `/v3/users/6574dc5a316949df88504f7bc03b14cb` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:40.993310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c77819-b9e3-4428-8d0b-daacbfcb7ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6574dc5a316949df88504f7bc03b14cb)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:40.995339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c77819-b9e3-4428-8d0b-daacbfcb7ed2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:41.054428 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 844/1689] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:40 2022] DELETE /identity/v3/users/02af8bde3635447fa2d0fb7a613bff05 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:41.056831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc990f3-8735-43e8-9a4c-6c80638de19b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:41.057304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc990f3-8735-43e8-9a4c-6c80638de19b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:41.057748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc990f3-8735-43e8-9a4c-6c80638de19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:41.084637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2cc990f3-8735-43e8-9a4c-6c80638de19b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:41.088365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2cc990f3-8735-43e8-9a4c-6c80638de19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:41.157419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3c77819-b9e3-4428-8d0b-daacbfcb7ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6574dc5a316949df88504f7bc03b14cb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.183751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3c77819-b9e3-4428-8d0b-daacbfcb7ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6574dc5a316949df88504f7bc03b14cb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.190690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3c77819-b9e3-4428-8d0b-daacbfcb7ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6574dc5a316949df88504f7bc03b14cb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.233650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:41.260648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3c77819-b9e3-4428-8d0b-daacbfcb7ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6574dc5a316949df88504f7bc03b14cb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.261417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3c77819-b9e3-4428-8d0b-daacbfcb7ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6574dc5a316949df88504f7bc03b14cb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.290371 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 846/1690] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:40 2022] DELETE /identity/v3/users/6574dc5a316949df88504f7bc03b14cb => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:51:41.292858 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 845/1691] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:41.296536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8695be-47d6-4701-b50c-47a29242828b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:41.296951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8695be-47d6-4701-b50c-47a29242828b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:41.297894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60d2de-9dd3-4760-9ada-890d278cb647 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:41.298477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8695be-47d6-4701-b50c-47a29242828b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:41.298595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60d2de-9dd3-4760-9ada-890d278cb647 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:41.298833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60d2de-9dd3-4760-9ada-890d278cb647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:41.333523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bc60d2de-9dd3-4760-9ada-890d278cb647 None None] MFA Rules not processed for user `181f661f98964045b1f474672ca42bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:41.334196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ca8695be-47d6-4701-b50c-47a29242828b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:41.335489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bc60d2de-9dd3-4760-9ada-890d278cb647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:41.335743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ca8695be-47d6-4701-b50c-47a29242828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:41.443277 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 846/1692] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:41.444474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8695be-47d6-4701-b50c-47a29242828b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:41.447172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ca8695be-47d6-4701-b50c-47a29242828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:41.469691 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 847/1693] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:41 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:41.469691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60d2de-9dd3-4760-9ada-890d278cb647 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:41.469691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bc60d2de-9dd3-4760-9ada-890d278cb647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:41.487490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60d2de-9dd3-4760-9ada-890d278cb647 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:41.493818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:41.494513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:41.494943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:41.495297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] PATH_INFO: `/v3/users/75506c260fd04d3b80b0c05b35d7777d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:41.497316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] RBAC: Authorizing `identity:delete_user(user_id=75506c260fd04d3b80b0c05b35d7777d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:41.500222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:41.544841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8695be-47d6-4701-b50c-47a29242828b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:41.573142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a71b6-9f26-4b50-a967-651ded955dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:41.574099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a71b6-9f26-4b50-a967-651ded955dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:41.582022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a71b6-9f26-4b50-a967-651ded955dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:41.582382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a71b6-9f26-4b50-a967-651ded955dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:41.592884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75506c260fd04d3b80b0c05b35d7777d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.596989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:41.599793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a71b6-9f26-4b50-a967-651ded955dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:41.601511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a71b6-9f26-4b50-a967-651ded955dc8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:41.613716 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 847/1694] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:41.619292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75506c260fd04d3b80b0c05b35d7777d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.620442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75506c260fd04d3b80b0c05b35d7777d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.638714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75506c260fd04d3b80b0c05b35d7777d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.639572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75506c260fd04d3b80b0c05b35d7777d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.640406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57c32-932d-48dd-96c6-408783ae1920 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:41.640932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57c32-932d-48dd-96c6-408783ae1920 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:41.642780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57c32-932d-48dd-96c6-408783ae1920 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:41.644705 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 848/1695] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:51:41 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:51:41.645590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a57c32-932d-48dd-96c6-408783ae1920 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:41.649084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-49a57c32-932d-48dd-96c6-408783ae1920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:41.666943 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 848/1696] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:41 2022] DELETE /identity/v3/users/75506c260fd04d3b80b0c05b35d7777d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:41.666943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:41.668341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:41.761642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8794aca-b5ec-4a54-ac03-4f9424f0d76d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:41.765245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a57c32-932d-48dd-96c6-408783ae1920 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:41.765785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6db18-14be-41ae-b524-dae6045b860a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:41.766447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6db18-14be-41ae-b524-dae6045b860a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:41.767474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6db18-14be-41ae-b524-dae6045b860a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:41.768151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6db18-14be-41ae-b524-dae6045b860a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:41.770020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9eb6db18-14be-41ae-b524-dae6045b860a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:41.772253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f642-3f6d-497f-b28d-b17cf64174c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:41.773268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f642-3f6d-497f-b28d-b17cf64174c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:41.773568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f642-3f6d-497f-b28d-b17cf64174c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:41.773852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f642-3f6d-497f-b28d-b17cf64174c6 admin admin] PATH_INFO: `/v3/users/0a19f489b51d4b4389969f356b1251a2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:41.775774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00f642-3f6d-497f-b28d-b17cf64174c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a19f489b51d4b4389969f356b1251a2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:41.779034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00f642-3f6d-497f-b28d-b17cf64174c6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:41.789779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6db18-14be-41ae-b524-dae6045b860a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:41.791299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6db18-14be-41ae-b524-dae6045b860a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:41.805872 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 849/1697] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:41.806121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6db18-14be-41ae-b524-dae6045b860a service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:41.808087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9eb6db18-14be-41ae-b524-dae6045b860a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:41.822559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6db18-14be-41ae-b524-dae6045b860a service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:41.827581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05bd0e-2227-403f-bb42-907ae07e479b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:41.828367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05bd0e-2227-403f-bb42-907ae07e479b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:41.828661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05bd0e-2227-403f-bb42-907ae07e479b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:41.829854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05bd0e-2227-403f-bb42-907ae07e479b admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:41.830866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05bd0e-2227-403f-bb42-907ae07e479b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:41.832900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05bd0e-2227-403f-bb42-907ae07e479b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:41.836862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:41.858311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed00f642-3f6d-497f-b28d-b17cf64174c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a19f489b51d4b4389969f356b1251a2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.872125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed00f642-3f6d-497f-b28d-b17cf64174c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a19f489b51d4b4389969f356b1251a2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.873016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed00f642-3f6d-497f-b28d-b17cf64174c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a19f489b51d4b4389969f356b1251a2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.893796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed00f642-3f6d-497f-b28d-b17cf64174c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a19f489b51d4b4389969f356b1251a2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.895950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed00f642-3f6d-497f-b28d-b17cf64174c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a19f489b51d4b4389969f356b1251a2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:41.904239 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 850/1698] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:41 2022] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:41.906033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05bd0e-2227-403f-bb42-907ae07e479b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:41.910855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dd05bd0e-2227-403f-bb42-907ae07e479b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:41.930039 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 849/1699] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:41 2022] DELETE /identity/v3/users/0a19f489b51d4b4389969f356b1251a2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:41.932631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b193fe8-6324-44ee-8854-f004eaa52b1e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:41.933001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b193fe8-6324-44ee-8854-f004eaa52b1e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:41.933527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b193fe8-6324-44ee-8854-f004eaa52b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:41.964610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8b193fe8-6324-44ee-8854-f004eaa52b1e None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:41.966107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8b193fe8-6324-44ee-8854-f004eaa52b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.054076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05bd0e-2227-403f-bb42-907ae07e479b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:42.083615 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 850/1700] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 18:51:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:42.085140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049789b-4da8-4d2b-9a54-98c62da72d53 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:42.085443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049789b-4da8-4d2b-9a54-98c62da72d53 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:42.085809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049789b-4da8-4d2b-9a54-98c62da72d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:42.124222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b049789b-4da8-4d2b-9a54-98c62da72d53 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:42.126649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b049789b-4da8-4d2b-9a54-98c62da72d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.157568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:42.212917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c426f41-ee51-4bcc-81f4-c803311bca53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:42.213563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426f41-ee51-4bcc-81f4-c803311bca53 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:42.214575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426f41-ee51-4bcc-81f4-c803311bca53 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:42.216331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c426f41-ee51-4bcc-81f4-c803311bca53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:42.218528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3c426f41-ee51-4bcc-81f4-c803311bca53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.239476 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 851/1701] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:42.240799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049789b-4da8-4d2b-9a54-98c62da72d53 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:42.249728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b049789b-4da8-4d2b-9a54-98c62da72d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.275731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049789b-4da8-4d2b-9a54-98c62da72d53 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:42.281493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb6af8-94f0-45c3-8a44-27c58f15241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:42.282678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6af8-94f0-45c3-8a44-27c58f15241f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:42.283244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6af8-94f0-45c3-8a44-27c58f15241f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:42.283723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb6af8-94f0-45c3-8a44-27c58f15241f admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:42.284524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb6af8-94f0-45c3-8a44-27c58f15241f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:42.286710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb6af8-94f0-45c3-8a44-27c58f15241f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:42.317482 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 852/1702] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:42 2022] POST /identity/v3/users => generated 308 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:42.317482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892ee91-2ae9-4c2c-9be0-ce6ff9de3653 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:42.317482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892ee91-2ae9-4c2c-9be0-ce6ff9de3653 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:42.317482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892ee91-2ae9-4c2c-9be0-ce6ff9de3653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:42.317854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c426f41-ee51-4bcc-81f4-c803311bca53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:42.319085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c426f41-ee51-4bcc-81f4-c803311bca53 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:42.332936 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 851/1703] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:42.334612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb873f-d311-4c97-8486-7b891d7eac79 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:42.334888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb873f-d311-4c97-8486-7b891d7eac79 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:42.335173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb873f-d311-4c97-8486-7b891d7eac79 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:42.340987 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 852/1704] 10.222.0.70 () {54 vars in 961 bytes} [Sun Aug 28 18:51:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:51:42.341881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb873f-d311-4c97-8486-7b891d7eac79 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:42.342966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6892ee91-2ae9-4c2c-9be0-ce6ff9de3653 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:42.344083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d9fb873f-d311-4c97-8486-7b891d7eac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.344516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6892ee91-2ae9-4c2c-9be0-ce6ff9de3653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.354281 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 853/1705] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:42.365393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892ee91-2ae9-4c2c-9be0-ce6ff9de3653 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:42.366952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb873f-d311-4c97-8486-7b891d7eac79 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:42.367073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6892ee91-2ae9-4c2c-9be0-ce6ff9de3653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.373630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:42.374384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:42.374666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:42.375798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] PATH_INFO: `/v3/projects/bb2c0f37501f477ebf6c9a862a400420` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:42.377294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2c0f37501f477ebf6c9a862a400420)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:42.379578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:42.419270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:42.462539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892ee91-2ae9-4c2c-9be0-ce6ff9de3653 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:42.471202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2c0f37501f477ebf6c9a862a400420', 'request_id': 'req-01e07a22-ad3c-403d-9059-c4060f1cf3e6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:42.487016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2c0f37501f477ebf6c9a862a400420', 'request_id': 'req-01e07a22-ad3c-403d-9059-c4060f1cf3e6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:42.495708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2c0f37501f477ebf6c9a862a400420', 'request_id': 'req-01e07a22-ad3c-403d-9059-c4060f1cf3e6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:42.508781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] The token cache is being invalidate because project bb2c0f37501f477ebf6c9a862a400420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:42.509094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:42.510565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:42.512191 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 853/1706] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:42 2022] DELETE /identity/v3/projects/bb2c0f37501f477ebf6c9a862a400420 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:42.512957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:42.514282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.547368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ba0ce-748f-42cc-9db9-094db3c87638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:42.548861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba0ce-748f-42cc-9db9-094db3c87638 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:42.549350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba0ce-748f-42cc-9db9-094db3c87638 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:42.549656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba0ce-748f-42cc-9db9-094db3c87638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:42.552547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-892ba0ce-748f-42cc-9db9-094db3c87638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.642003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e07a22-ad3c-403d-9059-c4060f1cf3e6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:42.645826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ba0ce-748f-42cc-9db9-094db3c87638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:42.647653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ba0ce-748f-42cc-9db9-094db3c87638 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:42.647984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e517c6-65bb-480a-be4f-74436279b66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:42.648871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e517c6-65bb-480a-be4f-74436279b66f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:42.649071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e517c6-65bb-480a-be4f-74436279b66f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:42.649448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e517c6-65bb-480a-be4f-74436279b66f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:42.650272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e517c6-65bb-480a-be4f-74436279b66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:42.652392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e517c6-65bb-480a-be4f-74436279b66f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:42.661809 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 854/1707] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:42.673939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5bc3-f276-4d5d-bbb3-bd8f971078f7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:42.674321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5bc3-f276-4d5d-bbb3-bd8f971078f7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:42.674504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd5bc3-f276-4d5d-bbb3-bd8f971078f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:42.675817 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 854/1708] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:42.677232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e517c6-65bb-480a-be4f-74436279b66f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:42.679943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-52e517c6-65bb-480a-be4f-74436279b66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.688086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:42.697000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e517c6-65bb-480a-be4f-74436279b66f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:42.706141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dcfa5-7490-4303-a293-06c289cc7e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:42.707405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dcfa5-7490-4303-a293-06c289cc7e67 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:42.707878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dcfa5-7490-4303-a293-06c289cc7e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:42.708351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dcfa5-7490-4303-a293-06c289cc7e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:42.711575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f74dcfa5-7490-4303-a293-06c289cc7e67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.715668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-bfbd5bc3-f276-4d5d-bbb3-bd8f971078f7 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:42.717219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bfbd5bc3-f276-4d5d-bbb3-bd8f971078f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.728970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dcfa5-7490-4303-a293-06c289cc7e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:42.731793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dcfa5-7490-4303-a293-06c289cc7e67 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:42.764385 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 855/1709] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:42.765929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dcfa5-7490-4303-a293-06c289cc7e67 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:42.768356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f74dcfa5-7490-4303-a293-06c289cc7e67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.782534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dcfa5-7490-4303-a293-06c289cc7e67 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:42.790271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:42.791352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:42.792066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:42.792524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] PATH_INFO: `/v3/projects/74f4c189648b409498539c351c9ca371` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:42.800978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f4c189648b409498539c351c9ca371)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:42.806279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:42.808310 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 855/1710] 10.222.0.70 () {58 vars in 1058 bytes} [Sun Aug 28 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:42.809982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd5bc3-f276-4d5d-bbb3-bd8f971078f7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:42.812243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bfbd5bc3-f276-4d5d-bbb3-bd8f971078f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:42.828451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd5bc3-f276-4d5d-bbb3-bd8f971078f7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:42.836141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:42.836891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:42.837247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:42.837638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] PATH_INFO: `/v3/users/28aca1e665ce438e80db8101b41df103` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:42.839363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=28aca1e665ce438e80db8101b41df103)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:42.843552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:42.883061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:42.939295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28aca1e665ce438e80db8101b41df103'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:42.955399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28aca1e665ce438e80db8101b41df103'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:42.958091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f4c189648b409498539c351c9ca371', 'request_id': 'req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:42.958660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28aca1e665ce438e80db8101b41df103'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:42.984699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28aca1e665ce438e80db8101b41df103'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:42.985890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28aca1e665ce438e80db8101b41df103'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:42.989742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f4c189648b409498539c351c9ca371', 'request_id': 'req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:42.998503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f4c189648b409498539c351c9ca371', 'request_id': 'req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:43.024089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] The token cache is being invalidate because project 74f4c189648b409498539c351c9ca371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:43.024398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:43.025055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:43.030079 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 856/1711] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:42 2022] DELETE /identity/v3/projects/74f4c189648b409498539c351c9ca371 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:43.035413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:43.036888 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 856/1712] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:42 2022] DELETE /identity/v3/users/28aca1e665ce438e80db8101b41df103 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:43.039593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:43.040016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:43.043716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:43.222722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d3a46-450d-4e1a-a0a9-b6f92b60299d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:43.254612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313870c-8f4e-4e0c-aed8-6681ae3258fb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:43.276599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074b5b9-87bf-4f3c-a3f6-07deec276504 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:43.279254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074b5b9-87bf-4f3c-a3f6-07deec276504 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:43.281616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074b5b9-87bf-4f3c-a3f6-07deec276504 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:43.284716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074b5b9-87bf-4f3c-a3f6-07deec276504 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:43.286767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9074b5b9-87bf-4f3c-a3f6-07deec276504 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:43.305147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074b5b9-87bf-4f3c-a3f6-07deec276504 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:43.305147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074b5b9-87bf-4f3c-a3f6-07deec276504 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:43.335461 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 857/1713] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:43.336547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074b5b9-87bf-4f3c-a3f6-07deec276504 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:43.338049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9074b5b9-87bf-4f3c-a3f6-07deec276504 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:43.471777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad60c88-b015-4357-86f3-0e207aac9c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:43.472476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad60c88-b015-4357-86f3-0e207aac9c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:43.472759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad60c88-b015-4357-86f3-0e207aac9c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:43.473037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad60c88-b015-4357-86f3-0e207aac9c94 admin admin] PATH_INFO: `/v3/projects/c8dc09198ebf4ec99e6daef78baaa586/users/15c131563ffb47228810fc96d37732a7/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:43.528728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074b5b9-87bf-4f3c-a3f6-07deec276504 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:43.538945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad60c88-b015-4357-86f3-0e207aac9c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dc09198ebf4ec99e6daef78baaa586, user_id=15c131563ffb47228810fc96d37732a7, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:43.548559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad60c88-b015-4357-86f3-0e207aac9c94 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:43.550162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef0644-b876-4b0c-9c53-c72bea4c7999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:43.560144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef0644-b876-4b0c-9c53-c72bea4c7999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:43.560447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef0644-b876-4b0c-9c53-c72bea4c7999 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:43.560876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef0644-b876-4b0c-9c53-c72bea4c7999 admin admin] PATH_INFO: `/v3/users/a5d9ed14b1684fcb90962d80f4b7e00f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:43.571478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef0644-b876-4b0c-9c53-c72bea4c7999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d9ed14b1684fcb90962d80f4b7e00f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:43.575569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef0644-b876-4b0c-9c53-c72bea4c7999 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:43.595683 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 857/1714] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:43 2022] PUT /identity/v3/projects/c8dc09198ebf4ec99e6daef78baaa586/users/15c131563ffb47228810fc96d37732a7/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:43.596308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad60c88-b015-4357-86f3-0e207aac9c94 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:43.606485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8ad60c88-b015-4357-86f3-0e207aac9c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:43.619165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:43.675889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:43.723362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-94ef0644-b876-4b0c-9c53-c72bea4c7999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d9ed14b1684fcb90962d80f4b7e00f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:43.735531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-94ef0644-b876-4b0c-9c53-c72bea4c7999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d9ed14b1684fcb90962d80f4b7e00f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:43.737947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-94ef0644-b876-4b0c-9c53-c72bea4c7999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d9ed14b1684fcb90962d80f4b7e00f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:43.754361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-94ef0644-b876-4b0c-9c53-c72bea4c7999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d9ed14b1684fcb90962d80f4b7e00f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:43.755057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-94ef0644-b876-4b0c-9c53-c72bea4c7999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d9ed14b1684fcb90962d80f4b7e00f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:43.795624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad60c88-b015-4357-86f3-0e207aac9c94 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:43.802828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:43.803436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:43.804054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:43.804395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] PATH_INFO: `/v3/projects/aaf151bf5fc84aa4ab3aff97096b4273` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:43.805714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf151bf5fc84aa4ab3aff97096b4273)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:43.807835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:43.808729 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 858/1715] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:43 2022] DELETE /identity/v3/users/a5d9ed14b1684fcb90962d80f4b7e00f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:43.812274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a45b1f-dfd3-46d2-8a48-2452b5bfcf6b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:43.812768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a45b1f-dfd3-46d2-8a48-2452b5bfcf6b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:43.813591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a45b1f-dfd3-46d2-8a48-2452b5bfcf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:43.856439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d1a45b1f-dfd3-46d2-8a48-2452b5bfcf6b None None] MFA Rules not processed for user `34437c5fbe8347cdb634833ce36d98a2`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:43.860777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d1a45b1f-dfd3-46d2-8a48-2452b5bfcf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:43.920134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf151bf5fc84aa4ab3aff97096b4273', 'request_id': 'req-1ea61ae1-50ec-4540-b837-30cc619cd6f0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:43.940338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf151bf5fc84aa4ab3aff97096b4273', 'request_id': 'req-1ea61ae1-50ec-4540-b837-30cc619cd6f0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:43.974202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf151bf5fc84aa4ab3aff97096b4273', 'request_id': 'req-1ea61ae1-50ec-4540-b837-30cc619cd6f0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.010894 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 859/1716] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:44.012519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a45b1f-dfd3-46d2-8a48-2452b5bfcf6b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:44.014156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d1a45b1f-dfd3-46d2-8a48-2452b5bfcf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:44.015852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] The token cache is being invalidate because project aaf151bf5fc84aa4ab3aff97096b4273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:44.027017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.029775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.034582 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 858/1717] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:43 2022] DELETE /identity/v3/projects/aaf151bf5fc84aa4ab3aff97096b4273 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:44.040880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:44.042662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:44.173714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a45b1f-dfd3-46d2-8a48-2452b5bfcf6b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:44.192207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea61ae1-50ec-4540-b837-30cc619cd6f0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:44.197856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bec9ef-9383-462d-b728-63da3de7ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:44.198168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:44.199289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:44.199766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:44.200220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] PATH_INFO: `/v3/projects/b7f428e0ea1f4e6e859f0ed9114ba819` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:44.202911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f428e0ea1f4e6e859f0ed9114ba819)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:44.206048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:44.211766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bec9ef-9383-462d-b728-63da3de7ce61 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:44.212102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bec9ef-9383-462d-b728-63da3de7ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:44.217926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bec9ef-9383-462d-b728-63da3de7ce61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:44.225046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bec9ef-9383-462d-b728-63da3de7ce61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:44.229430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bec9ef-9383-462d-b728-63da3de7ce61 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:44.245596 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 860/1718] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:44.250616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bec9ef-9383-462d-b728-63da3de7ce61 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:44.253215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-06bec9ef-9383-462d-b728-63da3de7ce61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:44.272945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bec9ef-9383-462d-b728-63da3de7ce61 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:44.280686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:44.281581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:44.282410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:44.282864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] PATH_INFO: `/v3/projects/41d21f9368724568b2e9d69853951ad6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:44.287888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41d21f9368724568b2e9d69853951ad6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:44.291840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:44.296206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:44.325612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f428e0ea1f4e6e859f0ed9114ba819', 'request_id': 'req-6dd28cc4-0246-4095-8997-5b06875eed62'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.342582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f428e0ea1f4e6e859f0ed9114ba819', 'request_id': 'req-6dd28cc4-0246-4095-8997-5b06875eed62'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.365811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f428e0ea1f4e6e859f0ed9114ba819', 'request_id': 'req-6dd28cc4-0246-4095-8997-5b06875eed62'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.384481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] The token cache is being invalidate because project b7f428e0ea1f4e6e859f0ed9114ba819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:44.384481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.385031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.387661 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 859/1719] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:44 2022] DELETE /identity/v3/projects/b7f428e0ea1f4e6e859f0ed9114ba819 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:44.388578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:44.390424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:44.400517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:44.404778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41d21f9368724568b2e9d69853951ad6', 'request_id': 'req-196e0640-ee25-48a7-b79b-34bde135caf8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.426551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41d21f9368724568b2e9d69853951ad6', 'request_id': 'req-196e0640-ee25-48a7-b79b-34bde135caf8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.440172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41d21f9368724568b2e9d69853951ad6', 'request_id': 'req-196e0640-ee25-48a7-b79b-34bde135caf8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.469069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] The token cache is being invalidate because project 41d21f9368724568b2e9d69853951ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:44.470006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.471084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.473552 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 861/1720] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:44 2022] DELETE /identity/v3/projects/41d21f9368724568b2e9d69853951ad6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:44.474412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:44.476153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:44.520809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd28cc4-0246-4095-8997-5b06875eed62 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:44.586435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e0640-ee25-48a7-b79b-34bde135caf8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:44.592097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:44.592826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:44.593193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:44.593527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] PATH_INFO: `/v3/users/2737db8812e04292b7f0649a99b5174a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:44.594980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2737db8812e04292b7f0649a99b5174a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:44.597417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:44.608863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46578c64-de20-4945-8e71-c77c4e438b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:44.609513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46578c64-de20-4945-8e71-c77c4e438b22 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:44.609794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46578c64-de20-4945-8e71-c77c4e438b22 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:44.610645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46578c64-de20-4945-8e71-c77c4e438b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:44.612692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-46578c64-de20-4945-8e71-c77c4e438b22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:44.681916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2737db8812e04292b7f0649a99b5174a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.691070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2737db8812e04292b7f0649a99b5174a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.691793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2737db8812e04292b7f0649a99b5174a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.696813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46578c64-de20-4945-8e71-c77c4e438b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:44.698494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46578c64-de20-4945-8e71-c77c4e438b22 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:44.700601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2737db8812e04292b7f0649a99b5174a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.701366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2737db8812e04292b7f0649a99b5174a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:44.703525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:44.719016 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 860/1721] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:44.721380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46578c64-de20-4945-8e71-c77c4e438b22 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:44.723876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-46578c64-de20-4945-8e71-c77c4e438b22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:44.734636 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 862/1722] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:44 2022] DELETE /identity/v3/users/2737db8812e04292b7f0649a99b5174a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:44.737024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:44.751472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:44.757520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46578c64-de20-4945-8e71-c77c4e438b22 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:44.867949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:44.893088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:44.894707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:44.895246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:44.895824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] PATH_INFO: `/v3/users/7e586fda321640db9bbd51f740bc134d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:44.897825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e586fda321640db9bbd51f740bc134d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:44.900602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:44.901101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4dc09-1095-4b0d-add5-7aaa49c90700 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:44.910992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ce6cd-4ee3-4b15-b76b-48762d72cadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:44.914724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ce6cd-4ee3-4b15-b76b-48762d72cadf admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:44.915125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ce6cd-4ee3-4b15-b76b-48762d72cadf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:44.915470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ce6cd-4ee3-4b15-b76b-48762d72cadf admin admin] PATH_INFO: `/v3/projects/c8dc09198ebf4ec99e6daef78baaa586/users/15c131563ffb47228810fc96d37732a7/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:44.924021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ce6cd-4ee3-4b15-b76b-48762d72cadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dc09198ebf4ec99e6daef78baaa586, user_id=15c131563ffb47228810fc96d37732a7, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:44.932620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ce6cd-4ee3-4b15-b76b-48762d72cadf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:44.954810 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 863/1723] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:44 2022] PUT /identity/v3/projects/c8dc09198ebf4ec99e6daef78baaa586/users/15c131563ffb47228810fc96d37732a7/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:44.955829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ce6cd-4ee3-4b15-b76b-48762d72cadf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:44.962327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-340ce6cd-4ee3-4b15-b76b-48762d72cadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:44.994793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e586fda321640db9bbd51f740bc134d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.029003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e586fda321640db9bbd51f740bc134d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.029935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e586fda321640db9bbd51f740bc134d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.071610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e586fda321640db9bbd51f740bc134d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.072739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e586fda321640db9bbd51f740bc134d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.096171 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 861/1724] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:44 2022] DELETE /identity/v3/users/7e586fda321640db9bbd51f740bc134d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:45.099482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:45.105278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.218907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ce6cd-4ee3-4b15-b76b-48762d72cadf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:45.315225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c0851-75e2-46f8-905d-f375af00a8f4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:45.334480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdccb3d-4834-49ee-b62b-03078803b829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:45.335306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdccb3d-4834-49ee-b62b-03078803b829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.336323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdccb3d-4834-49ee-b62b-03078803b829 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.336623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdccb3d-4834-49ee-b62b-03078803b829 admin admin] PATH_INFO: `/v3/projects/ca49c9c65fb94be1934041946262b745` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.338534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdccb3d-4834-49ee-b62b-03078803b829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca49c9c65fb94be1934041946262b745)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:45.341884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdccb3d-4834-49ee-b62b-03078803b829 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:45.367586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea1d3e-3e14-4fb9-abb7-b340261c7a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:45.369213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea1d3e-3e14-4fb9-abb7-b340261c7a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.369720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea1d3e-3e14-4fb9-abb7-b340261c7a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.370173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea1d3e-3e14-4fb9-abb7-b340261c7a07 admin admin] PATH_INFO: `/v3/users/569365815c644f8bba8bc04fb6cc67f0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.372927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea1d3e-3e14-4fb9-abb7-b340261c7a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=569365815c644f8bba8bc04fb6cc67f0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:45.378033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea1d3e-3e14-4fb9-abb7-b340261c7a07 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:45.396004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:45.463361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0bdccb3d-4834-49ee-b62b-03078803b829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca49c9c65fb94be1934041946262b745', 'request_id': 'req-0bdccb3d-4834-49ee-b62b-03078803b829'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.477727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5aea1d3e-3e14-4fb9-abb7-b340261c7a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569365815c644f8bba8bc04fb6cc67f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.488116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5aea1d3e-3e14-4fb9-abb7-b340261c7a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569365815c644f8bba8bc04fb6cc67f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.489059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5aea1d3e-3e14-4fb9-abb7-b340261c7a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569365815c644f8bba8bc04fb6cc67f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.490887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0bdccb3d-4834-49ee-b62b-03078803b829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca49c9c65fb94be1934041946262b745', 'request_id': 'req-0bdccb3d-4834-49ee-b62b-03078803b829'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.499076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0bdccb3d-4834-49ee-b62b-03078803b829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca49c9c65fb94be1934041946262b745', 'request_id': 'req-0bdccb3d-4834-49ee-b62b-03078803b829'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.503004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5aea1d3e-3e14-4fb9-abb7-b340261c7a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569365815c644f8bba8bc04fb6cc67f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.504455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5aea1d3e-3e14-4fb9-abb7-b340261c7a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569365815c644f8bba8bc04fb6cc67f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.515402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0bdccb3d-4834-49ee-b62b-03078803b829 admin admin] The token cache is being invalidate because project ca49c9c65fb94be1934041946262b745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:45.515871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0bdccb3d-4834-49ee-b62b-03078803b829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.517292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0bdccb3d-4834-49ee-b62b-03078803b829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.524325 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 862/1725] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:45 2022] DELETE /identity/v3/projects/ca49c9c65fb94be1934041946262b745 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:45.526843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c1cac-2143-4248-a7f2-e1fedd8a5bef None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.527214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c1cac-2143-4248-a7f2-e1fedd8a5bef None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.528178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c1cac-2143-4248-a7f2-e1fedd8a5bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.545597 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 864/1726] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:44 2022] DELETE /identity/v3/users/569365815c644f8bba8bc04fb6cc67f0 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:45.545597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b021d2-cac1-40fa-947a-31a956896635 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.545597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b021d2-cac1-40fa-947a-31a956896635 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.545597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b021d2-cac1-40fa-947a-31a956896635 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.561450 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 865/1727] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:51:45 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:51:45.563438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a3df-9560-42fb-9120-b4e47ae7a6e9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.567212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a3df-9560-42fb-9120-b4e47ae7a6e9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.568712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a3df-9560-42fb-9120-b4e47ae7a6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.581560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-597c1cac-2143-4248-a7f2-e1fedd8a5bef None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:45.582974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-597c1cac-2143-4248-a7f2-e1fedd8a5bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.628810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5d42a3df-9560-42fb-9120-b4e47ae7a6e9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:45.633614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5d42a3df-9560-42fb-9120-b4e47ae7a6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.656200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:45.762000 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 863/1728] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:45.763775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c1cac-2143-4248-a7f2-e1fedd8a5bef None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:45.765603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-597c1cac-2143-4248-a7f2-e1fedd8a5bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.774247 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 866/1729] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:45.775835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60025b53-eba6-4687-8f2a-c282bb067837 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.776188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60025b53-eba6-4687-8f2a-c282bb067837 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.776550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60025b53-eba6-4687-8f2a-c282bb067837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.785922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c1cac-2143-4248-a7f2-e1fedd8a5bef None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:45.799939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3862998-0932-4a0f-a872-2106da1ce73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:45.802108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3862998-0932-4a0f-a872-2106da1ce73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.802584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3862998-0932-4a0f-a872-2106da1ce73a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.803430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3862998-0932-4a0f-a872-2106da1ce73a admin admin] PATH_INFO: `/v3/projects/a936f8401fa64889889a3e0bb60c2515` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.804681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-60025b53-eba6-4687-8f2a-c282bb067837 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:45.805671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3862998-0932-4a0f-a872-2106da1ce73a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a936f8401fa64889889a3e0bb60c2515)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:45.806153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-60025b53-eba6-4687-8f2a-c282bb067837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.808229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3862998-0932-4a0f-a872-2106da1ce73a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:45.824604 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 867/1730] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:45.824604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7025a6-5d36-42f0-8419-91f343f9e68d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:45.824604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7025a6-5d36-42f0-8419-91f343f9e68d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:45.824604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7025a6-5d36-42f0-8419-91f343f9e68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:45.871216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1f7025a6-5d36-42f0-8419-91f343f9e68d None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:45.872930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1f7025a6-5d36-42f0-8419-91f343f9e68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:45.973455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3862998-0932-4a0f-a872-2106da1ce73a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a936f8401fa64889889a3e0bb60c2515', 'request_id': 'req-e3862998-0932-4a0f-a872-2106da1ce73a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:45.996757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3862998-0932-4a0f-a872-2106da1ce73a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a936f8401fa64889889a3e0bb60c2515', 'request_id': 'req-e3862998-0932-4a0f-a872-2106da1ce73a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.059947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3862998-0932-4a0f-a872-2106da1ce73a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a936f8401fa64889889a3e0bb60c2515', 'request_id': 'req-e3862998-0932-4a0f-a872-2106da1ce73a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.065950 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 868/1731] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 18:51:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:46.068684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13169336-2e02-4569-b759-ed60b0c8e706 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:46.069049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13169336-2e02-4569-b759-ed60b0c8e706 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:46.070851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13169336-2e02-4569-b759-ed60b0c8e706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:46.093505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3862998-0932-4a0f-a872-2106da1ce73a admin admin] The token cache is being invalidate because project a936f8401fa64889889a3e0bb60c2515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:46.094403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3862998-0932-4a0f-a872-2106da1ce73a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.095546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3862998-0932-4a0f-a872-2106da1ce73a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.097981 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 864/1732] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:45 2022] DELETE /identity/v3/projects/a936f8401fa64889889a3e0bb60c2515 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:46.099705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254534-abdd-4ff2-97e1-55930427bef6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:46.100136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254534-abdd-4ff2-97e1-55930427bef6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:46.100534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254534-abdd-4ff2-97e1-55930427bef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:46.138107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c3254534-abdd-4ff2-97e1-55930427bef6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:46.139697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c3254534-abdd-4ff2-97e1-55930427bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:46.142336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-13169336-2e02-4569-b759-ed60b0c8e706 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:46.149654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-13169336-2e02-4569-b759-ed60b0c8e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:46.176272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:46.242157 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 865/1733] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:46.243606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3254534-abdd-4ff2-97e1-55930427bef6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:46.246717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c3254534-abdd-4ff2-97e1-55930427bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:46.352961 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 869/1734] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:46.352961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13169336-2e02-4569-b759-ed60b0c8e706 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:46.352961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-13169336-2e02-4569-b759-ed60b0c8e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:46.365124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3254534-abdd-4ff2-97e1-55930427bef6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:46.376632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdb336-a9d6-4657-bdad-3646f6e070b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:46.378328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdb336-a9d6-4657-bdad-3646f6e070b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:46.379581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdb336-a9d6-4657-bdad-3646f6e070b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:46.379875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdb336-a9d6-4657-bdad-3646f6e070b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:46.385930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-16bdb336-a9d6-4657-bdad-3646f6e070b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:46.410134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdb336-a9d6-4657-bdad-3646f6e070b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:46.411846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdb336-a9d6-4657-bdad-3646f6e070b8 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:46.424692 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 866/1735] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:46.449616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:46.457430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f32ee-9b35-441e-8f22-27fefc285151 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:46.457776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f32ee-9b35-441e-8f22-27fefc285151 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:46.459198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f32ee-9b35-441e-8f22-27fefc285151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:46.505814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13169336-2e02-4569-b759-ed60b0c8e706 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:46.506390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-531f32ee-9b35-441e-8f22-27fefc285151 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:46.512521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-531f32ee-9b35-441e-8f22-27fefc285151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:46.519101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cf341-1217-44ca-83b2-0bf74bd428cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:46.519988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cf341-1217-44ca-83b2-0bf74bd428cd service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:46.520454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cf341-1217-44ca-83b2-0bf74bd428cd service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:46.520887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cf341-1217-44ca-83b2-0bf74bd428cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:46.526256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d27cf341-1217-44ca-83b2-0bf74bd428cd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:46.528877 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 867/1736] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:46.530027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f32ee-9b35-441e-8f22-27fefc285151 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:46.553262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f32ee-9b35-441e-8f22-27fefc285151 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:46.558397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5593-b9aa-40f4-8101-a0e1a862f076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:46.559087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5593-b9aa-40f4-8101-a0e1a862f076 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:46.559378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5593-b9aa-40f4-8101-a0e1a862f076 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:46.559659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a5593-b9aa-40f4-8101-a0e1a862f076 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:46.565101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a5593-b9aa-40f4-8101-a0e1a862f076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:46.565101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a5593-b9aa-40f4-8101-a0e1a862f076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:46.565101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a5593-b9aa-40f4-8101-a0e1a862f076 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:46.591007 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 868/1737] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:46.595551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5593-b9aa-40f4-8101-a0e1a862f076 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:46.598121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-936a5593-b9aa-40f4-8101-a0e1a862f076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:46.628448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a5593-b9aa-40f4-8101-a0e1a862f076 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:46.635079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:46.635688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:46.636048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:46.636226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] PATH_INFO: `/v3/projects/807998cdad3e4fe7b7c07bb844c40b54` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:46.637531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=807998cdad3e4fe7b7c07bb844c40b54)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:46.640569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:46.722780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807998cdad3e4fe7b7c07bb844c40b54', 'request_id': 'req-69b6ef3b-2af0-4577-9063-2901458d7699'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.739070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807998cdad3e4fe7b7c07bb844c40b54', 'request_id': 'req-69b6ef3b-2af0-4577-9063-2901458d7699'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.755250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807998cdad3e4fe7b7c07bb844c40b54', 'request_id': 'req-69b6ef3b-2af0-4577-9063-2901458d7699'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.781201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cf341-1217-44ca-83b2-0bf74bd428cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:46.785961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cf341-1217-44ca-83b2-0bf74bd428cd service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:46.786176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] The token cache is being invalidate because project 807998cdad3e4fe7b7c07bb844c40b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:46.787448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.790728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:46.800934 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 869/1738] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:46 2022] DELETE /identity/v3/projects/807998cdad3e4fe7b7c07bb844c40b54 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:46.800934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:46.804364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:46.835045 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 870/1739] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:46.836537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cae75-2b9f-44a8-ada6-fd5cd21c6a17 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:46.836829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cae75-2b9f-44a8-ada6-fd5cd21c6a17 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:46.837088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cae75-2b9f-44a8-ada6-fd5cd21c6a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:46.917063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-592cae75-2b9f-44a8-ada6-fd5cd21c6a17 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:46.922301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-592cae75-2b9f-44a8-ada6-fd5cd21c6a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:46.965525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:47.028158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6ef3b-2af0-4577-9063-2901458d7699 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:47.039745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09eda4f-d909-4b80-8f18-31cd05c42abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:47.042097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eda4f-d909-4b80-8f18-31cd05c42abb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:47.043617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eda4f-d909-4b80-8f18-31cd05c42abb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:47.044707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eda4f-d909-4b80-8f18-31cd05c42abb admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:47.046971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09eda4f-d909-4b80-8f18-31cd05c42abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:47.047394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09eda4f-d909-4b80-8f18-31cd05c42abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:47.050226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09eda4f-d909-4b80-8f18-31cd05c42abb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:47.074174 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 870/1740] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:47.075263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09eda4f-d909-4b80-8f18-31cd05c42abb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:47.084516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f09eda4f-d909-4b80-8f18-31cd05c42abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:47.094067 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 871/1741] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:47.096658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440feef-05af-4ae6-acf0-217366d978e8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:47.097891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440feef-05af-4ae6-acf0-217366d978e8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:47.098401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440feef-05af-4ae6-acf0-217366d978e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:47.117700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09eda4f-d909-4b80-8f18-31cd05c42abb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:47.125176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89196df-7ebb-4979-a44e-3d87e329d2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:47.127313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89196df-7ebb-4979-a44e-3d87e329d2dc admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:47.127834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89196df-7ebb-4979-a44e-3d87e329d2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:47.128255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89196df-7ebb-4979-a44e-3d87e329d2dc admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:47.129286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89196df-7ebb-4979-a44e-3d87e329d2dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:47.131841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89196df-7ebb-4979-a44e-3d87e329d2dc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:47.196999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0440feef-05af-4ae6-acf0-217366d978e8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:47.199386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0440feef-05af-4ae6-acf0-217366d978e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:47.222768 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 872/1742] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:47.227004 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 871/1743] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:47 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:47.230255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89196df-7ebb-4979-a44e-3d87e329d2dc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:47.238088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440feef-05af-4ae6-acf0-217366d978e8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:47.265614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440feef-05af-4ae6-acf0-217366d978e8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:47.411428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89196df-7ebb-4979-a44e-3d87e329d2dc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:47.420623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681db1da-177e-4b33-8943-26f5dce44ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:47.422934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681db1da-177e-4b33-8943-26f5dce44ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:47.423233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681db1da-177e-4b33-8943-26f5dce44ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:47.425726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681db1da-177e-4b33-8943-26f5dce44ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:47.426719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681db1da-177e-4b33-8943-26f5dce44ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:47.427168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681db1da-177e-4b33-8943-26f5dce44ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:47.431081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:47.432637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681db1da-177e-4b33-8943-26f5dce44ee9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:47.455355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ab3de-1747-4ba1-9f9a-5df6e0899e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:47.456101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ab3de-1747-4ba1-9f9a-5df6e0899e3c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:47.456819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ab3de-1747-4ba1-9f9a-5df6e0899e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:47.456819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ab3de-1747-4ba1-9f9a-5df6e0899e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:47.462711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ab3de-1747-4ba1-9f9a-5df6e0899e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:47.468595 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 872/1744] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:47.469768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ab3de-1747-4ba1-9f9a-5df6e0899e3c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:47.472531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad95e7-a8eb-49fc-b2d6-b2bab6a26e74 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:47.473283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad95e7-a8eb-49fc-b2d6-b2bab6a26e74 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:47.473968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad95e7-a8eb-49fc-b2d6-b2bab6a26e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:47.509007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cbad95e7-a8eb-49fc-b2d6-b2bab6a26e74 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:47.510448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cbad95e7-a8eb-49fc-b2d6-b2bab6a26e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:47.521519 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 873/1745] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:47 2022] POST /identity/v3/projects => generated 369 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:47.522716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ab3de-1747-4ba1-9f9a-5df6e0899e3c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:47.636846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ab3de-1747-4ba1-9f9a-5df6e0899e3c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:47.645034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6df02-cc98-43f5-90b1-38786f49f956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:47.646322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6df02-cc98-43f5-90b1-38786f49f956 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:47.647294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6df02-cc98-43f5-90b1-38786f49f956 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:47.647836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6df02-cc98-43f5-90b1-38786f49f956 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:47.649139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6df02-cc98-43f5-90b1-38786f49f956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:47.653158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6df02-cc98-43f5-90b1-38786f49f956 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:47.683713 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 874/1746] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:47 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:47.685000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6df02-cc98-43f5-90b1-38786f49f956 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:47.712765 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 873/1747] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:47.712765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad95e7-a8eb-49fc-b2d6-b2bab6a26e74 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:47.714363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cbad95e7-a8eb-49fc-b2d6-b2bab6a26e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:47.721458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6df02-cc98-43f5-90b1-38786f49f956 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:47.740118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b44546-6e5c-4b80-8eba-13bc680ef029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:47.742198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b44546-6e5c-4b80-8eba-13bc680ef029 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:47.746048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b44546-6e5c-4b80-8eba-13bc680ef029 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:47.746782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b44546-6e5c-4b80-8eba-13bc680ef029 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:47.747624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b44546-6e5c-4b80-8eba-13bc680ef029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:47.752585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b44546-6e5c-4b80-8eba-13bc680ef029 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:47.755744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad95e7-a8eb-49fc-b2d6-b2bab6a26e74 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:47.772550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:47.773215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:47.773554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:47.773833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] PATH_INFO: `/v3/projects/dec1f34e09324e2ebca9ca8c3e380c39` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:47.775167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec1f34e09324e2ebca9ca8c3e380c39)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:47.778980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:47.806592 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 875/1748] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:47 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:47.808026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b44546-6e5c-4b80-8eba-13bc680ef029 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:47.851849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:47.869103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec1f34e09324e2ebca9ca8c3e380c39', 'request_id': 'req-7e29f2ec-f4af-4978-b492-865e8b00661d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.881150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec1f34e09324e2ebca9ca8c3e380c39', 'request_id': 'req-7e29f2ec-f4af-4978-b492-865e8b00661d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.897046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec1f34e09324e2ebca9ca8c3e380c39', 'request_id': 'req-7e29f2ec-f4af-4978-b492-865e8b00661d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.942846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] The token cache is being invalidate because project dec1f34e09324e2ebca9ca8c3e380c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:47.943467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.944574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:47.947206 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 874/1749] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:47 2022] DELETE /identity/v3/projects/dec1f34e09324e2ebca9ca8c3e380c39 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:47.948389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:47.950985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.027803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b44546-6e5c-4b80-8eba-13bc680ef029 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.120907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29f2ec-f4af-4978-b492-865e8b00661d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.129611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cf2b3-1522-483b-b750-aa78fc5cbc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.130552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cf2b3-1522-483b-b750-aa78fc5cbc2c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.130552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cf2b3-1522-483b-b750-aa78fc5cbc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.130897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cf2b3-1522-483b-b750-aa78fc5cbc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.131742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cf2b3-1522-483b-b750-aa78fc5cbc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.133340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cf2b3-1522-483b-b750-aa78fc5cbc2c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.148492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:48.149211 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 875/1750] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:48.150567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cf2b3-1522-483b-b750-aa78fc5cbc2c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.153886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aa0cf2b3-1522-483b-b750-aa78fc5cbc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.165389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a51cd-96f1-4bca-a835-60afc056b01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.166028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a51cd-96f1-4bca-a835-60afc056b01e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.166313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a51cd-96f1-4bca-a835-60afc056b01e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.166589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a51cd-96f1-4bca-a835-60afc056b01e admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.167373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a51cd-96f1-4bca-a835-60afc056b01e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.169630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a51cd-96f1-4bca-a835-60afc056b01e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.170263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cf2b3-1522-483b-b750-aa78fc5cbc2c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.176515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71898cb-8c4f-46e9-8a0b-f2df64c47063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.177540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71898cb-8c4f-46e9-8a0b-f2df64c47063 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.177894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71898cb-8c4f-46e9-8a0b-f2df64c47063 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.178244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71898cb-8c4f-46e9-8a0b-f2df64c47063 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.179675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71898cb-8c4f-46e9-8a0b-f2df64c47063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:48.180065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71898cb-8c4f-46e9-8a0b-f2df64c47063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.181877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71898cb-8c4f-46e9-8a0b-f2df64c47063 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.201487 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 876/1751] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:48.202543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71898cb-8c4f-46e9-8a0b-f2df64c47063 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.205473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f71898cb-8c4f-46e9-8a0b-f2df64c47063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.211885 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 876/1752] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:47 2022] POST /identity/v3/users => generated 285 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:48.213350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d1f84-d995-4719-a4ec-b72f249d615d None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.213635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d1f84-d995-4719-a4ec-b72f249d615d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.213912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d1f84-d995-4719-a4ec-b72f249d615d None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.216202 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 877/1753] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:51:48.216971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d1f84-d995-4719-a4ec-b72f249d615d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.218808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-451d1f84-d995-4719-a4ec-b72f249d615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.231619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71898cb-8c4f-46e9-8a0b-f2df64c47063 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.237975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be34fb6-24cf-48aa-9d57-c45bddf5bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.238404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be34fb6-24cf-48aa-9d57-c45bddf5bebb admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.238687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be34fb6-24cf-48aa-9d57-c45bddf5bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.239007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be34fb6-24cf-48aa-9d57-c45bddf5bebb admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.239652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be34fb6-24cf-48aa-9d57-c45bddf5bebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.241772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be34fb6-24cf-48aa-9d57-c45bddf5bebb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.272112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d1f84-d995-4719-a4ec-b72f249d615d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.288173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.291241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.291990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.294785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] PATH_INFO: `/v3/users/796ec6d2b7604625ac1b1a4fe8caec2e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.301333 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 877/1754] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:48 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:48.302219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=796ec6d2b7604625ac1b1a4fe8caec2e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.303565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be34fb6-24cf-48aa-9d57-c45bddf5bebb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.307526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.308525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1be34fb6-24cf-48aa-9d57-c45bddf5bebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.425857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796ec6d2b7604625ac1b1a4fe8caec2e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.435530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796ec6d2b7604625ac1b1a4fe8caec2e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.436684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796ec6d2b7604625ac1b1a4fe8caec2e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.446783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be34fb6-24cf-48aa-9d57-c45bddf5bebb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.448674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796ec6d2b7604625ac1b1a4fe8caec2e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.449760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796ec6d2b7604625ac1b1a4fe8caec2e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:48.452854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506a341-4cb0-4608-9f86-221927f63bea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.454078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a341-4cb0-4608-9f86-221927f63bea service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.454592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a341-4cb0-4608-9f86-221927f63bea service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.455268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a341-4cb0-4608-9f86-221927f63bea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.457500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9506a341-4cb0-4608-9f86-221927f63bea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.472373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506a341-4cb0-4608-9f86-221927f63bea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.473998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506a341-4cb0-4608-9f86-221927f63bea service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.490301 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 878/1756] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:48 2022] DELETE /identity/v3/users/796ec6d2b7604625ac1b1a4fe8caec2e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:48.490537 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 878/1756] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:48.490651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.491017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506a341-4cb0-4608-9f86-221927f63bea service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.491774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.491903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9506a341-4cb0-4608-9f86-221927f63bea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.505321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506a341-4cb0-4608-9f86-221927f63bea service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.534364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:48.612731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381db656-4a8b-4038-89a3-571ec9c9b2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.613569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381db656-4a8b-4038-89a3-571ec9c9b2cd admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.614022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381db656-4a8b-4038-89a3-571ec9c9b2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.614557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381db656-4a8b-4038-89a3-571ec9c9b2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.615407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381db656-4a8b-4038-89a3-571ec9c9b2cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.618622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381db656-4a8b-4038-89a3-571ec9c9b2cd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.646999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36656a5d-0dae-427b-ad77-01a19ee35d0c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.653030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f3026-c642-4c60-8404-92524a7fb7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.653655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f3026-c642-4c60-8404-92524a7fb7df admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.653939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f3026-c642-4c60-8404-92524a7fb7df admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.654212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f3026-c642-4c60-8404-92524a7fb7df admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.655114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f3026-c642-4c60-8404-92524a7fb7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.657484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f3026-c642-4c60-8404-92524a7fb7df admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.669024 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 879/1757] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:48 2022] POST /identity/v3/projects => generated 403 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:48.675029 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 879/1758] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:48.675237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381db656-4a8b-4038-89a3-571ec9c9b2cd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.675678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09567b0-8a70-410a-9524-ade60229d6d2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.676039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09567b0-8a70-410a-9524-ade60229d6d2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.676259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09567b0-8a70-410a-9524-ade60229d6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.680173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-381db656-4a8b-4038-89a3-571ec9c9b2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.713947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a09567b0-8a70-410a-9524-ade60229d6d2 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:48.715548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a09567b0-8a70-410a-9524-ade60229d6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.769200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381db656-4a8b-4038-89a3-571ec9c9b2cd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.775963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1df89-fae8-4dd1-823b-e510b17b187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.776957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1df89-fae8-4dd1-823b-e510b17b187b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.777532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1df89-fae8-4dd1-823b-e510b17b187b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.778008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1df89-fae8-4dd1-823b-e510b17b187b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.778884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1df89-fae8-4dd1-823b-e510b17b187b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.780712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1df89-fae8-4dd1-823b-e510b17b187b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.794711 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 880/1759] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:48.796353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1df89-fae8-4dd1-823b-e510b17b187b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.800163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-faf1df89-fae8-4dd1-823b-e510b17b187b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:48.818375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1df89-fae8-4dd1-823b-e510b17b187b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.824067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:48.826553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec985bf-6cb1-4f26-94f5-ad723230b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.827499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec985bf-6cb1-4f26-94f5-ad723230b97a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.827996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec985bf-6cb1-4f26-94f5-ad723230b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.828377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec985bf-6cb1-4f26-94f5-ad723230b97a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.830046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec985bf-6cb1-4f26-94f5-ad723230b97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.832176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec985bf-6cb1-4f26-94f5-ad723230b97a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.855031 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 881/1760] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:48.856086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec985bf-6cb1-4f26-94f5-ad723230b97a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.869224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec985bf-6cb1-4f26-94f5-ad723230b97a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.877281 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 880/1761] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 18:51:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:48.878813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09567b0-8a70-410a-9524-ade60229d6d2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.881966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2566f-e72f-4516-9a06-65e011c94e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.882624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2566f-e72f-4516-9a06-65e011c94e5a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.882931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2566f-e72f-4516-9a06-65e011c94e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.883205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2566f-e72f-4516-9a06-65e011c94e5a admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.883842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2566f-e72f-4516-9a06-65e011c94e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.885957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2566f-e72f-4516-9a06-65e011c94e5a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.912492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09567b0-8a70-410a-9524-ade60229d6d2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.925249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefc01c-be26-4ec7-ad8e-edaaecc89480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.927260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefc01c-be26-4ec7-ad8e-edaaecc89480 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.928297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefc01c-be26-4ec7-ad8e-edaaecc89480 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.928728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefc01c-be26-4ec7-ad8e-edaaecc89480 admin admin] PATH_INFO: `/v3/projects/40dae9d5701c40d5a71ccdaf1344ee42/users/1274659f6cc8434f8b4679947f39fc84/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.947193 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 882/1762] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:48 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:48.948695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2566f-e72f-4516-9a06-65e011c94e5a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:48.956550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefc01c-be26-4ec7-ad8e-edaaecc89480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40dae9d5701c40d5a71ccdaf1344ee42, user_id=1274659f6cc8434f8b4679947f39fc84, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.961949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefc01c-be26-4ec7-ad8e-edaaecc89480 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:48.973269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2566f-e72f-4516-9a06-65e011c94e5a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:48.980317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d75c8-847b-49c6-a224-d0a1e69022b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:48.981427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d75c8-847b-49c6-a224-d0a1e69022b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:48.981956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d75c8-847b-49c6-a224-d0a1e69022b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:48.982403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d75c8-847b-49c6-a224-d0a1e69022b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:48.983476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d75c8-847b-49c6-a224-d0a1e69022b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:48.985978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d75c8-847b-49c6-a224-d0a1e69022b2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.001757 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 881/1763] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:48 2022] PUT /identity/v3/projects/40dae9d5701c40d5a71ccdaf1344ee42/users/1274659f6cc8434f8b4679947f39fc84/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:49.003120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefc01c-be26-4ec7-ad8e-edaaecc89480 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.003517 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 883/1764] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:49.012722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d75c8-847b-49c6-a224-d0a1e69022b2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.016833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8f6d75c8-847b-49c6-a224-d0a1e69022b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:49.183160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefc01c-be26-4ec7-ad8e-edaaecc89480 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:49.194517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d85fba-5a6f-4f02-8660-45e1a2754608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:49.195145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d75c8-847b-49c6-a224-d0a1e69022b2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:49.195609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d85fba-5a6f-4f02-8660-45e1a2754608 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.195609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d85fba-5a6f-4f02-8660-45e1a2754608 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.195895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d85fba-5a6f-4f02-8660-45e1a2754608 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.202803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d85fba-5a6f-4f02-8660-45e1a2754608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:49.202882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d85fba-5a6f-4f02-8660-45e1a2754608 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.220035 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 882/1765] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:49.222357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d85fba-5a6f-4f02-8660-45e1a2754608 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.244119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d85fba-5a6f-4f02-8660-45e1a2754608 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:49.263600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff24361-0579-4fdd-8127-8fce674b3bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:49.264687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff24361-0579-4fdd-8127-8fce674b3bbe admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.265177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff24361-0579-4fdd-8127-8fce674b3bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.265656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff24361-0579-4fdd-8127-8fce674b3bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.267645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff24361-0579-4fdd-8127-8fce674b3bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:49.269950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff24361-0579-4fdd-8127-8fce674b3bbe admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.280733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:49.322269 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 883/1766] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:49.324343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95ac94-6f7e-46a2-ab61-b20f477d1e7d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.325363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95ac94-6f7e-46a2-ab61-b20f477d1e7d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.325911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95ac94-6f7e-46a2-ab61-b20f477d1e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.373106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d4bb6-0446-47cd-aa98-0b82cf479d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:49.373748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d4bb6-0446-47cd-aa98-0b82cf479d75 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.374018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d4bb6-0446-47cd-aa98-0b82cf479d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.374290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d4bb6-0446-47cd-aa98-0b82cf479d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.397989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3b95ac94-6f7e-46a2-ab61-b20f477d1e7d None None] MFA Rules not processed for user `1274659f6cc8434f8b4679947f39fc84`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:49.399585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3b95ac94-6f7e-46a2-ab61-b20f477d1e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:49.519555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d4bb6-0446-47cd-aa98-0b82cf479d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:49.521602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d4bb6-0446-47cd-aa98-0b82cf479d75 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.568598 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 884/1767] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:49.569524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d4bb6-0446-47cd-aa98-0b82cf479d75 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.587349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d4bb6-0446-47cd-aa98-0b82cf479d75 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:49.596380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01570c4a-3189-4ea5-89c0-def5572c7030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:49.599353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01570c4a-3189-4ea5-89c0-def5572c7030 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.600656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01570c4a-3189-4ea5-89c0-def5572c7030 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.601215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01570c4a-3189-4ea5-89c0-def5572c7030 admin admin] PATH_INFO: `/v3/projects/d0c905ab945e4430af95cc0b53723717/users/5e75ec308b8949da9a99aafe2aaeb69e/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.630724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01570c4a-3189-4ea5-89c0-def5572c7030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c905ab945e4430af95cc0b53723717, user_id=5e75ec308b8949da9a99aafe2aaeb69e, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:49.634277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01570c4a-3189-4ea5-89c0-def5572c7030 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.685082 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 884/1768] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:49.685082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95ac94-6f7e-46a2-ab61-b20f477d1e7d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.693622 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 885/1769] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:49 2022] PUT /identity/v3/projects/d0c905ab945e4430af95cc0b53723717/users/5e75ec308b8949da9a99aafe2aaeb69e/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:49.696208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01570c4a-3189-4ea5-89c0-def5572c7030 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.715051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95ac94-6f7e-46a2-ab61-b20f477d1e7d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:49.848723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:49.879808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01570c4a-3189-4ea5-89c0-def5572c7030 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:49.887450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f46dc-1f92-47f5-b2af-681ef117630c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:49.888333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f46dc-1f92-47f5-b2af-681ef117630c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.888619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f46dc-1f92-47f5-b2af-681ef117630c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.888895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f46dc-1f92-47f5-b2af-681ef117630c admin admin] PATH_INFO: `/v3/projects/06a385fe2f714b8399704b1dd8aadc65/users/b08c1a893a254da8b713871efbec14b1/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.898842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb823d0e-7572-4a44-a5a9-4b51499ea894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:49.902548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb823d0e-7572-4a44-a5a9-4b51499ea894 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:49.902929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb823d0e-7572-4a44-a5a9-4b51499ea894 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:49.903135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb823d0e-7572-4a44-a5a9-4b51499ea894 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:49.910491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb823d0e-7572-4a44-a5a9-4b51499ea894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:49.914913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb823d0e-7572-4a44-a5a9-4b51499ea894 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.917595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f46dc-1f92-47f5-b2af-681ef117630c admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a385fe2f714b8399704b1dd8aadc65, user_id=b08c1a893a254da8b713871efbec14b1, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:49.925678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f46dc-1f92-47f5-b2af-681ef117630c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:49.947064 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 886/1770] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:49.947999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb823d0e-7572-4a44-a5a9-4b51499ea894 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.955948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fb823d0e-7572-4a44-a5a9-4b51499ea894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:49.967263 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 885/1771] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:49 2022] PUT /identity/v3/projects/06a385fe2f714b8399704b1dd8aadc65/users/b08c1a893a254da8b713871efbec14b1/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:49.968497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f46dc-1f92-47f5-b2af-681ef117630c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:49.990963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb823d0e-7572-4a44-a5a9-4b51499ea894 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:50.112708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f46dc-1f92-47f5-b2af-681ef117630c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:50.121238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:50.130075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb55a6-0269-4c63-85b2-314fd62cf4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:50.130863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb55a6-0269-4c63-85b2-314fd62cf4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.132047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb55a6-0269-4c63-85b2-314fd62cf4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.132357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb55a6-0269-4c63-85b2-314fd62cf4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.133031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb55a6-0269-4c63-85b2-314fd62cf4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:50.135535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb55a6-0269-4c63-85b2-314fd62cf4e5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:50.216724 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 886/1772] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:49 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:50.218982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78b75d-bcd7-4c5d-96e0-ee2c00912ffc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.219851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78b75d-bcd7-4c5d-96e0-ee2c00912ffc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.220267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78b75d-bcd7-4c5d-96e0-ee2c00912ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.232861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2684a2c-2a11-423b-9f7c-e9074a0073c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:50.233734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2684a2c-2a11-423b-9f7c-e9074a0073c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.234114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2684a2c-2a11-423b-9f7c-e9074a0073c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.234393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2684a2c-2a11-423b-9f7c-e9074a0073c7 admin admin] PATH_INFO: `/v3/projects/aba0a0ace5f34635961f64829237af03` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.241069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2684a2c-2a11-423b-9f7c-e9074a0073c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba0a0ace5f34635961f64829237af03)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:50.243477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2684a2c-2a11-423b-9f7c-e9074a0073c7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:50.267653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fa78b75d-bcd7-4c5d-96e0-ee2c00912ffc None None] MFA Rules not processed for user `5e75ec308b8949da9a99aafe2aaeb69e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:50.269625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fa78b75d-bcd7-4c5d-96e0-ee2c00912ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:50.400652 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 887/1773] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:50.400652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78b75d-bcd7-4c5d-96e0-ee2c00912ffc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:50.436477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e2684a2c-2a11-423b-9f7c-e9074a0073c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba0a0ace5f34635961f64829237af03', 'request_id': 'req-e2684a2c-2a11-423b-9f7c-e9074a0073c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:50.453304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:50.472746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e2684a2c-2a11-423b-9f7c-e9074a0073c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba0a0ace5f34635961f64829237af03', 'request_id': 'req-e2684a2c-2a11-423b-9f7c-e9074a0073c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:50.489132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e2684a2c-2a11-423b-9f7c-e9074a0073c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba0a0ace5f34635961f64829237af03', 'request_id': 'req-e2684a2c-2a11-423b-9f7c-e9074a0073c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:50.506571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78b75d-bcd7-4c5d-96e0-ee2c00912ffc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:50.531487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e2684a2c-2a11-423b-9f7c-e9074a0073c7 admin admin] The token cache is being invalidate because project aba0a0ace5f34635961f64829237af03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:50.531989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e2684a2c-2a11-423b-9f7c-e9074a0073c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:50.536154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e2684a2c-2a11-423b-9f7c-e9074a0073c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:50.538587 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 887/1774] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:49 2022] DELETE /identity/v3/projects/aba0a0ace5f34635961f64829237af03 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:50.540316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7b23b-95dc-4552-9140-aa75e7295ede None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.540712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7b23b-95dc-4552-9140-aa75e7295ede None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.541063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7b23b-95dc-4552-9140-aa75e7295ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.625362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6166ff6-fa67-484d-bc85-e4bc793c5af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:50.626146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6166ff6-fa67-484d-bc85-e4bc793c5af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.626434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6166ff6-fa67-484d-bc85-e4bc793c5af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.626816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6166ff6-fa67-484d-bc85-e4bc793c5af3 admin admin] PATH_INFO: `/v3/projects/b21f1a27ceee4bea8c612243301824d2/users/e0afcff84398404faf503d2bea46c9af/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.654564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6166ff6-fa67-484d-bc85-e4bc793c5af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21f1a27ceee4bea8c612243301824d2, user_id=e0afcff84398404faf503d2bea46c9af, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:50.658267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6166ff6-fa67-484d-bc85-e4bc793c5af3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:50.663530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5ab7b23b-95dc-4552-9140-aa75e7295ede None None] MFA Rules not processed for user `b08c1a893a254da8b713871efbec14b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:50.665057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5ab7b23b-95dc-4552-9140-aa75e7295ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:50.687369 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 888/1775] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:50 2022] PUT /identity/v3/projects/b21f1a27ceee4bea8c612243301824d2/users/e0afcff84398404faf503d2bea46c9af/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:50.687369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6166ff6-fa67-484d-bc85-e4bc793c5af3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:50.687369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d6166ff6-fa67-484d-bc85-e4bc793c5af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:50.838098 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 888/1776] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:50.839248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7b23b-95dc-4552-9140-aa75e7295ede None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:50.840816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5ab7b23b-95dc-4552-9140-aa75e7295ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:50.843282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6166ff6-fa67-484d-bc85-e4bc793c5af3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:50.854390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd728bc-82b8-485d-b6ba-041378435381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:50.855984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd728bc-82b8-485d-b6ba-041378435381 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.856798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd728bc-82b8-485d-b6ba-041378435381 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.857082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd728bc-82b8-485d-b6ba-041378435381 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.857744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd728bc-82b8-485d-b6ba-041378435381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:50.864203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd728bc-82b8-485d-b6ba-041378435381 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:50.870620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7b23b-95dc-4552-9140-aa75e7295ede None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:50.878252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b228f-9fde-4e53-b893-f52182f3402c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:50.879097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b228f-9fde-4e53-b893-f52182f3402c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.879387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b228f-9fde-4e53-b893-f52182f3402c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.879667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b228f-9fde-4e53-b893-f52182f3402c admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.880819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b228f-9fde-4e53-b893-f52182f3402c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:50.884067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b228f-9fde-4e53-b893-f52182f3402c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:50.925840 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 889/1777] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:50 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:50.930497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bff7f5-cd65-4f8f-a838-6e78bbd9ae9c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.934521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bff7f5-cd65-4f8f-a838-6e78bbd9ae9c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.934521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bff7f5-cd65-4f8f-a838-6e78bbd9ae9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.949434 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 889/1778] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:50 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:50.951495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cdadb-f984-42e6-b1d5-bfba4936ffd5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:50.951946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cdadb-f984-42e6-b1d5-bfba4936ffd5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:50.952361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cdadb-f984-42e6-b1d5-bfba4936ffd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:50.979198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b8bff7f5-cd65-4f8f-a838-6e78bbd9ae9c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:50.981331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b8bff7f5-cd65-4f8f-a838-6e78bbd9ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:51.051890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3d0cdadb-f984-42e6-b1d5-bfba4936ffd5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:51.053153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3d0cdadb-f984-42e6-b1d5-bfba4936ffd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:51.107621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:51.119371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:51.146715 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 890/1779] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:51.148780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bff7f5-cd65-4f8f-a838-6e78bbd9ae9c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.151030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b8bff7f5-cd65-4f8f-a838-6e78bbd9ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:51.183772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bff7f5-cd65-4f8f-a838-6e78bbd9ae9c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.194406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a624c1-c9a2-434d-8fd8-3ad794e751e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.195691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a624c1-c9a2-434d-8fd8-3ad794e751e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.195691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a624c1-c9a2-434d-8fd8-3ad794e751e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.195960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a624c1-c9a2-434d-8fd8-3ad794e751e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.196633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a624c1-c9a2-434d-8fd8-3ad794e751e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.198772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a624c1-c9a2-434d-8fd8-3ad794e751e2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.213488 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 890/1780] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:51.215556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cdadb-f984-42e6-b1d5-bfba4936ffd5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.228218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cdadb-f984-42e6-b1d5-bfba4936ffd5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.234003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf43d15-4d87-41cf-8a20-fc572a01d98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.237646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf43d15-4d87-41cf-8a20-fc572a01d98f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.238446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf43d15-4d87-41cf-8a20-fc572a01d98f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.239552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf43d15-4d87-41cf-8a20-fc572a01d98f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.242093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf43d15-4d87-41cf-8a20-fc572a01d98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.256372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf43d15-4d87-41cf-8a20-fc572a01d98f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.267727 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 891/1781] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:51 2022] POST /identity/v3/projects => generated 393 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:51.269400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a624c1-c9a2-434d-8fd8-3ad794e751e2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.279851 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 891/1782] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:51.282432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe23bee-2351-446b-b59d-77a61bc636ac None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.283007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe23bee-2351-446b-b59d-77a61bc636ac None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.283483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe23bee-2351-446b-b59d-77a61bc636ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.334444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6fe23bee-2351-446b-b59d-77a61bc636ac None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:51.337081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6fe23bee-2351-446b-b59d-77a61bc636ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:51.386638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a624c1-c9a2-434d-8fd8-3ad794e751e2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.405119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70309c-1ff0-4831-93fa-b71206925890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.405949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70309c-1ff0-4831-93fa-b71206925890 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.406294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70309c-1ff0-4831-93fa-b71206925890 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.407314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70309c-1ff0-4831-93fa-b71206925890 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.409150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70309c-1ff0-4831-93fa-b71206925890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.411261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70309c-1ff0-4831-93fa-b71206925890 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.430281 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 892/1783] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:51.431933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe23bee-2351-446b-b59d-77a61bc636ac None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.433379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6fe23bee-2351-446b-b59d-77a61bc636ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:51.465757 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 892/1784] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:51 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:51.470955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70309c-1ff0-4831-93fa-b71206925890 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.483857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70309c-1ff0-4831-93fa-b71206925890 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.489835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bb991-cb52-4dd4-9814-dff704d0d5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.490627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bb991-cb52-4dd4-9814-dff704d0d5ba admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.491057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bb991-cb52-4dd4-9814-dff704d0d5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.491284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bb991-cb52-4dd4-9814-dff704d0d5ba admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.492122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bb991-cb52-4dd4-9814-dff704d0d5ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.494243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bb991-cb52-4dd4-9814-dff704d0d5ba admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.533875 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 893/1785] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:51 2022] POST /identity/v3/users => generated 303 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:51.535050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bb991-cb52-4dd4-9814-dff704d0d5ba admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.548366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bb991-cb52-4dd4-9814-dff704d0d5ba admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.557516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7736c12-d9f6-460d-8266-d031a3269a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.558410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7736c12-d9f6-460d-8266-d031a3269a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.558950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7736c12-d9f6-460d-8266-d031a3269a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.559426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7736c12-d9f6-460d-8266-d031a3269a61 admin admin] PATH_INFO: `/v3/projects/410e93f28b294d5d976940b0b250d597/users/5cae74c0586e4ef4878d43269743d92b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.597332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7736c12-d9f6-460d-8266-d031a3269a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410e93f28b294d5d976940b0b250d597, user_id=5cae74c0586e4ef4878d43269743d92b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.600601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7736c12-d9f6-460d-8266-d031a3269a61 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.600884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe23bee-2351-446b-b59d-77a61bc636ac None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.607643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a31ddf-9221-410a-9d29-e3bc0185fbc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.608288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a31ddf-9221-410a-9d29-e3bc0185fbc4 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.608570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a31ddf-9221-410a-9d29-e3bc0185fbc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.608846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a31ddf-9221-410a-9d29-e3bc0185fbc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.630090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a31ddf-9221-410a-9d29-e3bc0185fbc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.631801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a31ddf-9221-410a-9d29-e3bc0185fbc4 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.656376 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 894/1786] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:51 2022] PUT /identity/v3/projects/410e93f28b294d5d976940b0b250d597/users/5cae74c0586e4ef4878d43269743d92b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:51.658952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7736c12-d9f6-460d-8266-d031a3269a61 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.661751 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 893/1787] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:51.663654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a31ddf-9221-410a-9d29-e3bc0185fbc4 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.694488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a31ddf-9221-410a-9d29-e3bc0185fbc4 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.774452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5248299-d898-4953-a4c3-8caac9dde8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.775247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5248299-d898-4953-a4c3-8caac9dde8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.775878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5248299-d898-4953-a4c3-8caac9dde8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.776105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5248299-d898-4953-a4c3-8caac9dde8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.776972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5248299-d898-4953-a4c3-8caac9dde8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.778683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5248299-d898-4953-a4c3-8caac9dde8b6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.786577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:51.795421 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 894/1788] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:51.799206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5248299-d898-4953-a4c3-8caac9dde8b6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.813599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5248299-d898-4953-a4c3-8caac9dde8b6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.820694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb877ee-9e02-43f0-b71e-5e5b6080064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.822417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb877ee-9e02-43f0-b71e-5e5b6080064f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.822975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb877ee-9e02-43f0-b71e-5e5b6080064f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.823399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb877ee-9e02-43f0-b71e-5e5b6080064f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.824276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb877ee-9e02-43f0-b71e-5e5b6080064f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.827343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb877ee-9e02-43f0-b71e-5e5b6080064f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.836132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7736c12-d9f6-460d-8266-d031a3269a61 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.844615 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 895/1789] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:51.850526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb877ee-9e02-43f0-b71e-5e5b6080064f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.855689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df688daa-9525-4f95-832c-6e57d95e9df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.856339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df688daa-9525-4f95-832c-6e57d95e9df5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.856624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df688daa-9525-4f95-832c-6e57d95e9df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.857185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df688daa-9525-4f95-832c-6e57d95e9df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.857648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df688daa-9525-4f95-832c-6e57d95e9df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:51:51.857963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df688daa-9525-4f95-832c-6e57d95e9df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.865622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb877ee-9e02-43f0-b71e-5e5b6080064f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.866980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df688daa-9525-4f95-832c-6e57d95e9df5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.874056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a2340-0db0-4148-8d23-aeb16aa75069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.875105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a2340-0db0-4148-8d23-aeb16aa75069 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.876122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a2340-0db0-4148-8d23-aeb16aa75069 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.876896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a2340-0db0-4148-8d23-aeb16aa75069 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.878402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a2340-0db0-4148-8d23-aeb16aa75069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.881389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a2340-0db0-4148-8d23-aeb16aa75069 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.897755 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 895/1790] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:51:51.898674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df688daa-9525-4f95-832c-6e57d95e9df5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.899496 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 896/1791] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:51.901675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a2340-0db0-4148-8d23-aeb16aa75069 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:51.916239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a2340-0db0-4148-8d23-aeb16aa75069 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.922053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6420c-ffe9-47c0-a552-183cc78165d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.924083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df688daa-9525-4f95-832c-6e57d95e9df5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:51.924417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6420c-ffe9-47c0-a552-183cc78165d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.925086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6420c-ffe9-47c0-a552-183cc78165d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.925756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6420c-ffe9-47c0-a552-183cc78165d3 admin admin] PATH_INFO: `/v3/projects/f2f1f19e912d4203b52b92d723359dfb/users/87e631685be24bddaef0824b9be11a9b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.943454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda5c9a-bc55-4c71-93d8-8ed17303fe55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:51.944172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda5c9a-bc55-4c71-93d8-8ed17303fe55 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:51.944935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda5c9a-bc55-4c71-93d8-8ed17303fe55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:51.945235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda5c9a-bc55-4c71-93d8-8ed17303fe55 admin admin] PATH_INFO: `/v3/projects/58eea55e23de435299d2a63f3a9e52c2/users/7feba7ba186f4308a89ed7a52ce7f393/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:51.962075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6420c-ffe9-47c0-a552-183cc78165d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f1f19e912d4203b52b92d723359dfb, user_id=87e631685be24bddaef0824b9be11a9b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:51.965345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6420c-ffe9-47c0-a552-183cc78165d3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:51.978175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:51.998232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda5c9a-bc55-4c71-93d8-8ed17303fe55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58eea55e23de435299d2a63f3a9e52c2, user_id=7feba7ba186f4308a89ed7a52ce7f393, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:52.004636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda5c9a-bc55-4c71-93d8-8ed17303fe55 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:52.008061 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 897/1792] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:51 2022] PUT /identity/v3/projects/f2f1f19e912d4203b52b92d723359dfb/users/87e631685be24bddaef0824b9be11a9b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:52.009594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6420c-ffe9-47c0-a552-183cc78165d3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:52.039118 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 896/1793] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:51 2022] PUT /identity/v3/projects/58eea55e23de435299d2a63f3a9e52c2/users/7feba7ba186f4308a89ed7a52ce7f393/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:52.040389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda5c9a-bc55-4c71-93d8-8ed17303fe55 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:52.170568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda5c9a-bc55-4c71-93d8-8ed17303fe55 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:52.185901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca0cf-1120-401c-8bf9-6e050867e53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:52.186870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca0cf-1120-401c-8bf9-6e050867e53d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:52.186995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca0cf-1120-401c-8bf9-6e050867e53d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:52.187231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca0cf-1120-401c-8bf9-6e050867e53d admin admin] PATH_INFO: `/v3/projects/410e93f28b294d5d976940b0b250d597/users/5cae74c0586e4ef4878d43269743d92b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:52.187522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6420c-ffe9-47c0-a552-183cc78165d3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:52.192043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ca0cf-1120-401c-8bf9-6e050867e53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=410e93f28b294d5d976940b0b250d597, user_id=5cae74c0586e4ef4878d43269743d92b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:52.200045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ca0cf-1120-401c-8bf9-6e050867e53d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:52.211356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9bc5b-0b08-457f-9518-74daf7aa32d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:52.213654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9bc5b-0b08-457f-9518-74daf7aa32d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:52.213998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9bc5b-0b08-457f-9518-74daf7aa32d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:52.214412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9bc5b-0b08-457f-9518-74daf7aa32d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:52.214966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9bc5b-0b08-457f-9518-74daf7aa32d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:52.220951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9bc5b-0b08-457f-9518-74daf7aa32d0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:52.223652 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 897/1794] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:52 2022] PUT /identity/v3/projects/410e93f28b294d5d976940b0b250d597/users/5cae74c0586e4ef4878d43269743d92b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:52.224524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca0cf-1120-401c-8bf9-6e050867e53d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:52.299433 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 898/1795] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:52 2022] POST /identity/v3/projects => generated 383 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:52.301107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803168f-d723-48ed-887c-3ecba5c4397c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:52.301393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803168f-d723-48ed-887c-3ecba5c4397c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:52.301666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803168f-d723-48ed-887c-3ecba5c4397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:52.394389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca0cf-1120-401c-8bf9-6e050867e53d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:52.417752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f803168f-d723-48ed-887c-3ecba5c4397c None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:52.419439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f803168f-d723-48ed-887c-3ecba5c4397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:52.529505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40371634-c129-48e0-a42b-0de2bfaea782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:52.538116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40371634-c129-48e0-a42b-0de2bfaea782 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:52.538604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40371634-c129-48e0-a42b-0de2bfaea782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:52.539543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40371634-c129-48e0-a42b-0de2bfaea782 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:52.540683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40371634-c129-48e0-a42b-0de2bfaea782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:52.543416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40371634-c129-48e0-a42b-0de2bfaea782 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:52.560618 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 898/1796] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:52.562391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40371634-c129-48e0-a42b-0de2bfaea782 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:52.579360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40371634-c129-48e0-a42b-0de2bfaea782 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:52.616838 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 899/1797] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 18:51:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:52.621460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce5bb-2c6d-49d7-9bf6-b5a8dbf812b2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:52.621460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce5bb-2c6d-49d7-9bf6-b5a8dbf812b2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:52.621460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cce5bb-2c6d-49d7-9bf6-b5a8dbf812b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:52.637682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c37fee-2398-4a53-a01c-3fa74433a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:52.638337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c37fee-2398-4a53-a01c-3fa74433a917 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:52.638752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c37fee-2398-4a53-a01c-3fa74433a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:52.639025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c37fee-2398-4a53-a01c-3fa74433a917 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:52.639753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c37fee-2398-4a53-a01c-3fa74433a917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:52.642190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c37fee-2398-4a53-a01c-3fa74433a917 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:52.674357 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 899/1798] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:52.680351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c37fee-2398-4a53-a01c-3fa74433a917 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:52.700321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c37fee-2398-4a53-a01c-3fa74433a917 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:52.701040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:52.713248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed490a-d57d-43b8-812c-ba831233b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:52.714334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed490a-d57d-43b8-812c-ba831233b667 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:52.716325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed490a-d57d-43b8-812c-ba831233b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:52.716892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed490a-d57d-43b8-812c-ba831233b667 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:52.717948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed490a-d57d-43b8-812c-ba831233b667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:52.721298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed490a-d57d-43b8-812c-ba831233b667 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:52.723019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-50cce5bb-2c6d-49d7-9bf6-b5a8dbf812b2 None None] MFA Rules not processed for user `5cae74c0586e4ef4878d43269743d92b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:52.724935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-50cce5bb-2c6d-49d7-9bf6-b5a8dbf812b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:52.753244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:52.765565 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 900/1799] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:52 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:52.768485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed490a-d57d-43b8-812c-ba831233b667 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:52.783601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed490a-d57d-43b8-812c-ba831233b667 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:52.791715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1f607-e058-4579-8d26-f80a95bc7cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:52.792586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1f607-e058-4579-8d26-f80a95bc7cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:52.793258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1f607-e058-4579-8d26-f80a95bc7cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:52.794103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1f607-e058-4579-8d26-f80a95bc7cf1 admin admin] PATH_INFO: `/v3/projects/f2f1f19e912d4203b52b92d723359dfb/users/87e631685be24bddaef0824b9be11a9b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:52.802871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1f607-e058-4579-8d26-f80a95bc7cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f1f19e912d4203b52b92d723359dfb, user_id=87e631685be24bddaef0824b9be11a9b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:52.807428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1f607-e058-4579-8d26-f80a95bc7cf1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:52.830529 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 901/1800] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:52 2022] PUT /identity/v3/projects/f2f1f19e912d4203b52b92d723359dfb/users/87e631685be24bddaef0824b9be11a9b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:52.831596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1f607-e058-4579-8d26-f80a95bc7cf1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:52.864863 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 900/1801] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:52.864863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cce5bb-2c6d-49d7-9bf6-b5a8dbf812b2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:52.885527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cce5bb-2c6d-49d7-9bf6-b5a8dbf812b2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:52.976728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1f607-e058-4579-8d26-f80a95bc7cf1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:52.985692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881795a8-18ac-483f-a9c6-699550c4fbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:52.987444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881795a8-18ac-483f-a9c6-699550c4fbd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:52.987976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881795a8-18ac-483f-a9c6-699550c4fbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:52.988627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881795a8-18ac-483f-a9c6-699550c4fbd5 admin admin] PATH_INFO: `/v3/projects/58eea55e23de435299d2a63f3a9e52c2/users/7feba7ba186f4308a89ed7a52ce7f393/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:52.993384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881795a8-18ac-483f-a9c6-699550c4fbd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58eea55e23de435299d2a63f3a9e52c2, user_id=7feba7ba186f4308a89ed7a52ce7f393, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:52.997641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881795a8-18ac-483f-a9c6-699550c4fbd5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:53.025238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97af73a-5a28-44a8-b017-0258418af732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:53.025936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97af73a-5a28-44a8-b017-0258418af732 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:53.026220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97af73a-5a28-44a8-b017-0258418af732 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:53.026540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97af73a-5a28-44a8-b017-0258418af732 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:53.027338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97af73a-5a28-44a8-b017-0258418af732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:53.031424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97af73a-5a28-44a8-b017-0258418af732 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:53.044041 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 902/1802] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:52 2022] PUT /identity/v3/projects/58eea55e23de435299d2a63f3a9e52c2/users/7feba7ba186f4308a89ed7a52ce7f393/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:53.049788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43fad2-8def-44ce-ac1e-2e96b391bbaf None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:53.052286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43fad2-8def-44ce-ac1e-2e96b391bbaf None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:53.052978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43fad2-8def-44ce-ac1e-2e96b391bbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:53.058507 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 901/1803] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:53.059724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97af73a-5a28-44a8-b017-0258418af732 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:53.069300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e97af73a-5a28-44a8-b017-0258418af732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:53.132817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2c43fad2-8def-44ce-ac1e-2e96b391bbaf None None] MFA Rules not processed for user `87e631685be24bddaef0824b9be11a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:53.141774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2c43fad2-8def-44ce-ac1e-2e96b391bbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:53.245603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97af73a-5a28-44a8-b017-0258418af732 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:53.290824 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 903/1804] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:53.290824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43fad2-8def-44ce-ac1e-2e96b391bbaf None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:53.294171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2c43fad2-8def-44ce-ac1e-2e96b391bbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:53.321895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:53.398347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98489ce7-631f-4a05-b463-c4293e8aca26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:53.399023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98489ce7-631f-4a05-b463-c4293e8aca26 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:53.399309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98489ce7-631f-4a05-b463-c4293e8aca26 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:53.399586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98489ce7-631f-4a05-b463-c4293e8aca26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:53.419036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:53.460623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43fad2-8def-44ce-ac1e-2e96b391bbaf None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:53.467478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef71b6e-8e31-498b-9ec0-08214ba9e787 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:53.469032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71b6e-8e31-498b-9ec0-08214ba9e787 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:53.469032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71b6e-8e31-498b-9ec0-08214ba9e787 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:53.469032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef71b6e-8e31-498b-9ec0-08214ba9e787 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:53.529562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98489ce7-631f-4a05-b463-c4293e8aca26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:53.531276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98489ce7-631f-4a05-b463-c4293e8aca26 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:53.549202 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 902/1805] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:53.550893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91547c8a-458c-412a-aa20-9fb10d69fa3f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:53.551278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91547c8a-458c-412a-aa20-9fb10d69fa3f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:53.551566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91547c8a-458c-412a-aa20-9fb10d69fa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:53.560076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef71b6e-8e31-498b-9ec0-08214ba9e787 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:53.563842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef71b6e-8e31-498b-9ec0-08214ba9e787 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:53.582215 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 904/1806] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 18:51:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:51:53.584653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef71b6e-8e31-498b-9ec0-08214ba9e787 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:53.610194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-91547c8a-458c-412a-aa20-9fb10d69fa3f None None] MFA Rules not processed for user `7feba7ba186f4308a89ed7a52ce7f393`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:53.614577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-91547c8a-458c-412a-aa20-9fb10d69fa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:53.795197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef71b6e-8e31-498b-9ec0-08214ba9e787 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:53.812108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f0718-34bf-4d30-9f64-a26f06c1997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:53.813102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0718-34bf-4d30-9f64-a26f06c1997f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:53.813519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0718-34bf-4d30-9f64-a26f06c1997f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:53.814172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0718-34bf-4d30-9f64-a26f06c1997f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:53.815181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f0718-34bf-4d30-9f64-a26f06c1997f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:53.816971 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 903/1807] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:53.818609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbe99a-f4a0-4656-af8e-b6daa545bdf8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:53.819137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbe99a-f4a0-4656-af8e-b6daa545bdf8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:53.819606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbe99a-f4a0-4656-af8e-b6daa545bdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:53.827211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f0718-34bf-4d30-9f64-a26f06c1997f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:53.870325 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 905/1808] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:53.873732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d7cbe99a-f4a0-4656-af8e-b6daa545bdf8 None None] MFA Rules not processed for user `15c131563ffb47228810fc96d37732a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:53.875981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d7cbe99a-f4a0-4656-af8e-b6daa545bdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:53.883912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f0718-34bf-4d30-9f64-a26f06c1997f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:53.926294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f0718-34bf-4d30-9f64-a26f06c1997f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:53.938333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:53.939437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:53.939735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:53.940146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] PATH_INFO: `/v3/users/b08c1a893a254da8b713871efbec14b1` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:53.946074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08c1a893a254da8b713871efbec14b1)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:53.948198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:53.969535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:54.053691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08c1a893a254da8b713871efbec14b1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:54.092994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08c1a893a254da8b713871efbec14b1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:54.096349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08c1a893a254da8b713871efbec14b1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:54.116445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08c1a893a254da8b713871efbec14b1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:54.117650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08c1a893a254da8b713871efbec14b1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:54.124832 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 904/1809] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:54.131852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbe99a-f4a0-4656-af8e-b6daa545bdf8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:54.148954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:54.176356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbe99a-f4a0-4656-af8e-b6daa545bdf8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:54.185292 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 906/1810] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:53 2022] DELETE /identity/v3/users/b08c1a893a254da8b713871efbec14b1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:54.186631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:54.196042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:54.393992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760997b-7646-4d0d-8e76-87b016ffe485 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:54.414049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc24d5-859d-41a6-9963-daf782d52c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:54.430962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc24d5-859d-41a6-9963-daf782d52c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:54.431661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc24d5-859d-41a6-9963-daf782d52c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:54.431889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc24d5-859d-41a6-9963-daf782d52c6c admin admin] PATH_INFO: `/v3/projects/9132e8d8dba04e09b1077b4267bfb8ef/users/1816b780cf3f4feeabfcab7cc2048799/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:54.449467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d680e1-cb0c-42d9-b93b-de2b477952ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:54.453670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d680e1-cb0c-42d9-b93b-de2b477952ce service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:54.453670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d680e1-cb0c-42d9-b93b-de2b477952ce service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:54.453670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d680e1-cb0c-42d9-b93b-de2b477952ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:54.467430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-61d680e1-cb0c-42d9-b93b-de2b477952ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:54.494678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc24d5-859d-41a6-9963-daf782d52c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9132e8d8dba04e09b1077b4267bfb8ef, user_id=1816b780cf3f4feeabfcab7cc2048799, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:54.498291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc24d5-859d-41a6-9963-daf782d52c6c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:54.551774 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 907/1811] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:54 2022] PUT /identity/v3/projects/9132e8d8dba04e09b1077b4267bfb8ef/users/1816b780cf3f4feeabfcab7cc2048799/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:54.552781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc24d5-859d-41a6-9963-daf782d52c6c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:54.562531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8bcc24d5-859d-41a6-9963-daf782d52c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:54.682183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d680e1-cb0c-42d9-b93b-de2b477952ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:54.688896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d680e1-cb0c-42d9-b93b-de2b477952ce service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:54.714479 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 905/1812] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:54.717169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3253949-7f27-499b-ac05-35b42a4d298d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:54.719592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3253949-7f27-499b-ac05-35b42a4d298d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:54.720103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3253949-7f27-499b-ac05-35b42a4d298d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:54.791780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f3253949-7f27-499b-ac05-35b42a4d298d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:54.800822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f3253949-7f27-499b-ac05-35b42a4d298d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:54.818135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc24d5-859d-41a6-9963-daf782d52c6c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:54.834875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a81b5f-a799-4461-b6ed-2b6b0d15dc02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:54.835520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a81b5f-a799-4461-b6ed-2b6b0d15dc02 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:54.835806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a81b5f-a799-4461-b6ed-2b6b0d15dc02 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:54.837892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a81b5f-a799-4461-b6ed-2b6b0d15dc02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:54.843422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a3a81b5f-a799-4461-b6ed-2b6b0d15dc02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:55.004212 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 906/1813] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:55.004212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4205c3-3264-4b54-b7d5-02cf3d2fb831 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:55.004212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4205c3-3264-4b54-b7d5-02cf3d2fb831 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:55.004212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4205c3-3264-4b54-b7d5-02cf3d2fb831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:55.023145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a81b5f-a799-4461-b6ed-2b6b0d15dc02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:55.024795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a81b5f-a799-4461-b6ed-2b6b0d15dc02 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:55.056205 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 908/1814] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:55.059099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a81b5f-a799-4461-b6ed-2b6b0d15dc02 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:55.065294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a3a81b5f-a799-4461-b6ed-2b6b0d15dc02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:55.080270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:55.107095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8c4205c3-3264-4b54-b7d5-02cf3d2fb831 None None] MFA Rules not processed for user `1816b780cf3f4feeabfcab7cc2048799`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:55.112481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8c4205c3-3264-4b54-b7d5-02cf3d2fb831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:55.120443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a81b5f-a799-4461-b6ed-2b6b0d15dc02 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:55.145780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c093-5cc0-42f2-b984-6a21f5556ae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:55.146539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c093-5cc0-42f2-b984-6a21f5556ae1 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:55.146852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c093-5cc0-42f2-b984-6a21f5556ae1 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:55.149782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c093-5cc0-42f2-b984-6a21f5556ae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:55.155499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1ad1c093-5cc0-42f2-b984-6a21f5556ae1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:55.175691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:55.351323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c093-5cc0-42f2-b984-6a21f5556ae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:55.353628 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 907/1815] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:55.355348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741383-89c5-4083-bfbc-0450d8700d78 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:55.355689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741383-89c5-4083-bfbc-0450d8700d78 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:55.356060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17741383-89c5-4083-bfbc-0450d8700d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:55.371910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c093-5cc0-42f2-b984-6a21f5556ae1 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:55.420163 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 909/1816] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:55 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:55.433282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c093-5cc0-42f2-b984-6a21f5556ae1 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:55.444147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1ad1c093-5cc0-42f2-b984-6a21f5556ae1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:55.502359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-17741383-89c5-4083-bfbc-0450d8700d78 None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:55.503880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-17741383-89c5-4083-bfbc-0450d8700d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:55.709536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c093-5cc0-42f2-b984-6a21f5556ae1 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:55.726129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857b965-8e3d-4372-8b30-fa7e839b9198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:55.727582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b965-8e3d-4372-8b30-fa7e839b9198 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:55.728003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b965-8e3d-4372-8b30-fa7e839b9198 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:55.728154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b965-8e3d-4372-8b30-fa7e839b9198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:55.757947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857b965-8e3d-4372-8b30-fa7e839b9198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:55.761839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857b965-8e3d-4372-8b30-fa7e839b9198 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:55.782669 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 908/1817] 10.222.0.55 () {58 vars in 1015 bytes} [Sun Aug 28 18:51:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:55.785876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17741383-89c5-4083-bfbc-0450d8700d78 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:55.794852 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 910/1818] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:55.795817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857b965-8e3d-4372-8b30-fa7e839b9198 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:55.800417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2857b965-8e3d-4372-8b30-fa7e839b9198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:55.806472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17741383-89c5-4083-bfbc-0450d8700d78 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:55.815891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aad86d-49c1-47dd-90ab-1fc6b81872ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:55.817900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aad86d-49c1-47dd-90ab-1fc6b81872ec admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:55.819347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aad86d-49c1-47dd-90ab-1fc6b81872ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:55.819999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aad86d-49c1-47dd-90ab-1fc6b81872ec admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:55.821194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aad86d-49c1-47dd-90ab-1fc6b81872ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:55.825098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aad86d-49c1-47dd-90ab-1fc6b81872ec admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:55.848036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857b965-8e3d-4372-8b30-fa7e839b9198 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:55.885687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:55.886957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:55.888987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:55.888987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] PATH_INFO: `/v3/users/5e75ec308b8949da9a99aafe2aaeb69e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:55.890362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e75ec308b8949da9a99aafe2aaeb69e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:55.905597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:55.927502 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 909/1819] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:51:55 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:55.932088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aad86d-49c1-47dd-90ab-1fc6b81872ec admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:56.106847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e75ec308b8949da9a99aafe2aaeb69e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:56.137390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e75ec308b8949da9a99aafe2aaeb69e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:56.145747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e75ec308b8949da9a99aafe2aaeb69e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:56.174849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e75ec308b8949da9a99aafe2aaeb69e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:56.183220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e75ec308b8949da9a99aafe2aaeb69e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:56.202811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aad86d-49c1-47dd-90ab-1fc6b81872ec admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:56.228340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60853e-f6e4-4284-aaef-754be650b4c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:56.229243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60853e-f6e4-4284-aaef-754be650b4c0 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:56.229674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60853e-f6e4-4284-aaef-754be650b4c0 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:56.234130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60853e-f6e4-4284-aaef-754be650b4c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:56.241560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ef60853e-f6e4-4284-aaef-754be650b4c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:56.248294 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 911/1820] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:55 2022] DELETE /identity/v3/users/5e75ec308b8949da9a99aafe2aaeb69e => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:56.249423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:56.257188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:56.271608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:56.365693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:56.431247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60853e-f6e4-4284-aaef-754be650b4c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:56.435148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60853e-f6e4-4284-aaef-754be650b4c0 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:56.476460 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 910/1821] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:55 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:56.477369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60853e-f6e4-4284-aaef-754be650b4c0 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:56.481576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ef60853e-f6e4-4284-aaef-754be650b4c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:56.498601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00b7e2-57d6-4ace-b6a6-aa3223e02f27 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:56.509851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233d983-c9f9-4537-bfb3-211874f55d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:56.511352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d983-c9f9-4537-bfb3-211874f55d6d service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:56.513115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d983-c9f9-4537-bfb3-211874f55d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:56.514926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233d983-c9f9-4537-bfb3-211874f55d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:56.520301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6233d983-c9f9-4537-bfb3-211874f55d6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:56.570979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233d983-c9f9-4537-bfb3-211874f55d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:56.572713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233d983-c9f9-4537-bfb3-211874f55d6d service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:56.619527 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 912/1822] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:56.621492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72141f41-2e96-4630-9a93-93c406051c1a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:56.622957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72141f41-2e96-4630-9a93-93c406051c1a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:56.623358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72141f41-2e96-4630-9a93-93c406051c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:56.654888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-72141f41-2e96-4630-9a93-93c406051c1a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:56.656941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-72141f41-2e96-4630-9a93-93c406051c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:56.681049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60853e-f6e4-4284-aaef-754be650b4c0 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:56.789022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91f598-8b69-4e93-8f73-f59b3a1fefa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:56.791987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91f598-8b69-4e93-8f73-f59b3a1fefa1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:56.793379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91f598-8b69-4e93-8f73-f59b3a1fefa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:56.794678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91f598-8b69-4e93-8f73-f59b3a1fefa1 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:56.795563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91f598-8b69-4e93-8f73-f59b3a1fefa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:56.800085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91f598-8b69-4e93-8f73-f59b3a1fefa1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:56.854985 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 911/1823] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:51:56 2022] POST /identity/v3/users => generated 299 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:51:56.856307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91f598-8b69-4e93-8f73-f59b3a1fefa1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:56.860240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fc91f598-8b69-4e93-8f73-f59b3a1fefa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:56.884805 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 913/1824] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:56.887019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72141f41-2e96-4630-9a93-93c406051c1a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:56.905631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91f598-8b69-4e93-8f73-f59b3a1fefa1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:56.930212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72141f41-2e96-4630-9a93-93c406051c1a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:56.935189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169ac5f-84f0-4f98-a7ec-35075cc97ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:56.936121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169ac5f-84f0-4f98-a7ec-35075cc97ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:56.936536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169ac5f-84f0-4f98-a7ec-35075cc97ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:56.936990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169ac5f-84f0-4f98-a7ec-35075cc97ea4 admin admin] PATH_INFO: `/v3/users/1274659f6cc8434f8b4679947f39fc84` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:56.956876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169ac5f-84f0-4f98-a7ec-35075cc97ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1274659f6cc8434f8b4679947f39fc84)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:56.960998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574bdbe-cd8b-4e32-8475-6d929c85d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:56.965556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574bdbe-cd8b-4e32-8475-6d929c85d625 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:56.966006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574bdbe-cd8b-4e32-8475-6d929c85d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:56.966397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574bdbe-cd8b-4e32-8475-6d929c85d625 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:56.967288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574bdbe-cd8b-4e32-8475-6d929c85d625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:56.969153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574bdbe-cd8b-4e32-8475-6d929c85d625 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:56.971583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169ac5f-84f0-4f98-a7ec-35075cc97ea4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:56.993054 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 914/1825] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:56.995263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574bdbe-cd8b-4e32-8475-6d929c85d625 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:56.998520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0574bdbe-cd8b-4e32-8475-6d929c85d625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:57.039496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574bdbe-cd8b-4e32-8475-6d929c85d625 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:57.046888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb659e-1b54-48c5-8c29-674110be22dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:57.049804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb659e-1b54-48c5-8c29-674110be22dc service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:57.050117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb659e-1b54-48c5-8c29-674110be22dc service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:57.050440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb659e-1b54-48c5-8c29-674110be22dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:57.096228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb659e-1b54-48c5-8c29-674110be22dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:57.103666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb659e-1b54-48c5-8c29-674110be22dc service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:57.105358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:57.136651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5169ac5f-84f0-4f98-a7ec-35075cc97ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1274659f6cc8434f8b4679947f39fc84'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:57.139304 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 915/1826] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:51:57.140758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb659e-1b54-48c5-8c29-674110be22dc service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:57.153260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5169ac5f-84f0-4f98-a7ec-35075cc97ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1274659f6cc8434f8b4679947f39fc84'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:57.161458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb659e-1b54-48c5-8c29-674110be22dc service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:57.161792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5169ac5f-84f0-4f98-a7ec-35075cc97ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1274659f6cc8434f8b4679947f39fc84'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:57.188143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5169ac5f-84f0-4f98-a7ec-35075cc97ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1274659f6cc8434f8b4679947f39fc84'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:57.189635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5169ac5f-84f0-4f98-a7ec-35075cc97ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1274659f6cc8434f8b4679947f39fc84'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:57.195057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212be2fa-99a3-481d-bd72-d9e5cff78401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:57.195958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212be2fa-99a3-481d-bd72-d9e5cff78401 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:57.196464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212be2fa-99a3-481d-bd72-d9e5cff78401 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:57.196820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212be2fa-99a3-481d-bd72-d9e5cff78401 admin admin] PATH_INFO: `/v3/projects/34d4c48a928f41928055608f49f278f7/users/5ef94f9197e0423994742707180ebe98/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:57.220986 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 912/1827] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:56 2022] DELETE /identity/v3/users/1274659f6cc8434f8b4679947f39fc84 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:57.224022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70114712-c682-4bf0-a2bd-70849f09e685 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:57.224550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70114712-c682-4bf0-a2bd-70849f09e685 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:57.224866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70114712-c682-4bf0-a2bd-70849f09e685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:57.225952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212be2fa-99a3-481d-bd72-d9e5cff78401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d4c48a928f41928055608f49f278f7, user_id=5ef94f9197e0423994742707180ebe98, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:57.229386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212be2fa-99a3-481d-bd72-d9e5cff78401 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:57.267340 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 916/1828] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:57 2022] PUT /identity/v3/projects/34d4c48a928f41928055608f49f278f7/users/5ef94f9197e0423994742707180ebe98/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:57.269964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212be2fa-99a3-481d-bd72-d9e5cff78401 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:57.273400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-212be2fa-99a3-481d-bd72-d9e5cff78401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:57.297588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-70114712-c682-4bf0-a2bd-70849f09e685 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:57.301154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-70114712-c682-4bf0-a2bd-70849f09e685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:57.436182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212be2fa-99a3-481d-bd72-d9e5cff78401 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:57.446702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61f0e9-847e-48b9-bf41-64da68a06dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:57.447793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61f0e9-847e-48b9-bf41-64da68a06dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:57.448462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61f0e9-847e-48b9-bf41-64da68a06dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:57.450595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61f0e9-847e-48b9-bf41-64da68a06dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:57.452328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61f0e9-847e-48b9-bf41-64da68a06dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:57.456819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61f0e9-847e-48b9-bf41-64da68a06dd2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:57.486343 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 917/1829] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:51:57.487773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61f0e9-847e-48b9-bf41-64da68a06dd2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:57.518941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61f0e9-847e-48b9-bf41-64da68a06dd2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:57.524059 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 913/1830] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:57.531289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60259e81-99cb-4329-be6e-156b2915daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:57.532511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60259e81-99cb-4329-be6e-156b2915daf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:57.532966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60259e81-99cb-4329-be6e-156b2915daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:57.534160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60259e81-99cb-4329-be6e-156b2915daf6 admin admin] PATH_INFO: `/v3/projects/34d4c48a928f41928055608f49f278f7/users/5ef94f9197e0423994742707180ebe98/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:57.541260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60259e81-99cb-4329-be6e-156b2915daf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d4c48a928f41928055608f49f278f7, user_id=5ef94f9197e0423994742707180ebe98, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:57.546596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60259e81-99cb-4329-be6e-156b2915daf6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:57.572526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:57.583948 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 918/1831] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:51:57 2022] PUT /identity/v3/projects/34d4c48a928f41928055608f49f278f7/users/5ef94f9197e0423994742707180ebe98/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:57.600901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e55654-0ea9-49eb-8da7-c106f3a6a751 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:57.601184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e55654-0ea9-49eb-8da7-c106f3a6a751 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:57.601663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e55654-0ea9-49eb-8da7-c106f3a6a751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:57.622660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60259e81-99cb-4329-be6e-156b2915daf6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:57.624978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-60259e81-99cb-4329-be6e-156b2915daf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:57.721306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a4e55654-0ea9-49eb-8da7-c106f3a6a751 None None] MFA Rules not processed for user `5ef94f9197e0423994742707180ebe98`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:57.722727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a4e55654-0ea9-49eb-8da7-c106f3a6a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:57.853074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60259e81-99cb-4329-be6e-156b2915daf6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:57.872142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ecd96-45c8-42b3-ae86-24541e50fbc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:57.873227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ecd96-45c8-42b3-ae86-24541e50fbc6 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:57.874273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ecd96-45c8-42b3-ae86-24541e50fbc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:57.880927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ecd96-45c8-42b3-ae86-24541e50fbc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:58.033432 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 914/1832] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:58.035106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e55654-0ea9-49eb-8da7-c106f3a6a751 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:58.036698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a4e55654-0ea9-49eb-8da7-c106f3a6a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:58.133590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ecd96-45c8-42b3-ae86-24541e50fbc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:58.137261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ecd96-45c8-42b3-ae86-24541e50fbc6 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:58.169156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:58.179750 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 919/1833] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:51:58.262152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e55654-0ea9-49eb-8da7-c106f3a6a751 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:58.284448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ab08f-6510-4013-8558-cd0e9360cf92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:58.285375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ab08f-6510-4013-8558-cd0e9360cf92 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:58.285737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ab08f-6510-4013-8558-cd0e9360cf92 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:58.286087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ab08f-6510-4013-8558-cd0e9360cf92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:58.301413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ab08f-6510-4013-8558-cd0e9360cf92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:58.305892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ab08f-6510-4013-8558-cd0e9360cf92 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:58.326552 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 915/1834] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:51:58.950043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ecd96-45c8-42b3-ae86-24541e50fbc6 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:58.974841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ecd96-45c8-42b3-ae86-24541e50fbc6 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:58.989458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62635278-1be8-4bbe-9cc4-f44509bd4250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:58.990151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62635278-1be8-4bbe-9cc4-f44509bd4250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:58.990432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62635278-1be8-4bbe-9cc4-f44509bd4250 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:58.990707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62635278-1be8-4bbe-9cc4-f44509bd4250 admin admin] PATH_INFO: `/v3/users/1816b780cf3f4feeabfcab7cc2048799` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:58.996944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62635278-1be8-4bbe-9cc4-f44509bd4250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1816b780cf3f4feeabfcab7cc2048799)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:59.001384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62635278-1be8-4bbe-9cc4-f44509bd4250 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:59.141048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ab08f-6510-4013-8558-cd0e9360cf92 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:59.143616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f04ab08f-6510-4013-8558-cd0e9360cf92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:59.183829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ab08f-6510-4013-8558-cd0e9360cf92 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:59.198650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:59.199059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-62635278-1be8-4bbe-9cc4-f44509bd4250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1816b780cf3f4feeabfcab7cc2048799'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.200973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:59.202051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:59.202785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] PATH_INFO: `/v3/projects/06a385fe2f714b8399704b1dd8aadc65` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:59.207013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a385fe2f714b8399704b1dd8aadc65)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:59.217419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:59.228595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-62635278-1be8-4bbe-9cc4-f44509bd4250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1816b780cf3f4feeabfcab7cc2048799'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.239093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-62635278-1be8-4bbe-9cc4-f44509bd4250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1816b780cf3f4feeabfcab7cc2048799'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.263455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-62635278-1be8-4bbe-9cc4-f44509bd4250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1816b780cf3f4feeabfcab7cc2048799'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.265285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-62635278-1be8-4bbe-9cc4-f44509bd4250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1816b780cf3f4feeabfcab7cc2048799'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.323399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a385fe2f714b8399704b1dd8aadc65', 'request_id': 'req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.333970 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 920/1835] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:58 2022] DELETE /identity/v3/users/1816b780cf3f4feeabfcab7cc2048799 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:59.335380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a385fe2f714b8399704b1dd8aadc65', 'request_id': 'req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.347925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a385fe2f714b8399704b1dd8aadc65', 'request_id': 'req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.356754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28d8df-90b5-4527-9282-4455f694c119 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:59.358409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28d8df-90b5-4527-9282-4455f694c119 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:59.359661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28d8df-90b5-4527-9282-4455f694c119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:59.367575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] The token cache is being invalidate because project 06a385fe2f714b8399704b1dd8aadc65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:51:59.367575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.368467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.370461 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 916/1836] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:51:59 2022] DELETE /identity/v3/projects/06a385fe2f714b8399704b1dd8aadc65 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:59.375683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:59.377639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:59.445076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7f28d8df-90b5-4527-9282-4455f694c119 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:51:59.446335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7f28d8df-90b5-4527-9282-4455f694c119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:59.498368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:59.506646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d348ce-8a8b-46b5-aec0-d0a1ada61c24 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:51:59.646458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:51:59.662493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c6b21-0c90-4f38-999e-8d4209b830c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:51:59.663255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c6b21-0c90-4f38-999e-8d4209b830c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:51:59.665575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c6b21-0c90-4f38-999e-8d4209b830c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:51:59.666009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c6b21-0c90-4f38-999e-8d4209b830c7 admin admin] PATH_INFO: `/v3/users/87e631685be24bddaef0824b9be11a9b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:51:59.671278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c6b21-0c90-4f38-999e-8d4209b830c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e631685be24bddaef0824b9be11a9b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:51:59.674477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c6b21-0c90-4f38-999e-8d4209b830c7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:51:59.688506 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 921/1837] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:51:59.731303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28d8df-90b5-4527-9282-4455f694c119 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:51:59.733619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7f28d8df-90b5-4527-9282-4455f694c119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:51:59.791217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c5c6b21-0c90-4f38-999e-8d4209b830c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e631685be24bddaef0824b9be11a9b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.804169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c5c6b21-0c90-4f38-999e-8d4209b830c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e631685be24bddaef0824b9be11a9b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.807036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c5c6b21-0c90-4f38-999e-8d4209b830c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e631685be24bddaef0824b9be11a9b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.838630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c5c6b21-0c90-4f38-999e-8d4209b830c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e631685be24bddaef0824b9be11a9b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.839633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c5c6b21-0c90-4f38-999e-8d4209b830c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e631685be24bddaef0824b9be11a9b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:51:59.879746 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 917/1838] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:51:59 2022] DELETE /identity/v3/users/87e631685be24bddaef0824b9be11a9b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:51:59.940051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28d8df-90b5-4527-9282-4455f694c119 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:00.096431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a48396-f79f-4e6e-aead-7c15a028d98d None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:00.097016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a48396-f79f-4e6e-aead-7c15a028d98d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:00.097016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a48396-f79f-4e6e-aead-7c15a028d98d None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:00.099561 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 918/1839] 10.222.0.70 () {54 vars in 921 bytes} [Sun Aug 28 18:52:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:52:00.152128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1618e-27a9-4729-a0bf-d1fb36a2dab9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:00.152128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1618e-27a9-4729-a0bf-d1fb36a2dab9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:00.152690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1618e-27a9-4729-a0bf-d1fb36a2dab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:00.170211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f2709-45c1-493f-a238-79272d886a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:00.171336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f2709-45c1-493f-a238-79272d886a54 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:00.172208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f2709-45c1-493f-a238-79272d886a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:00.173149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f2709-45c1-493f-a238-79272d886a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:00.176860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-da0f2709-45c1-493f-a238-79272d886a54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:00.204482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9dc1618e-27a9-4729-a0bf-d1fb36a2dab9 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:00.209596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9dc1618e-27a9-4729-a0bf-d1fb36a2dab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:00.390197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f2709-45c1-493f-a238-79272d886a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:00.394591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f2709-45c1-493f-a238-79272d886a54 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:00.411395 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 922/1840] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:00.412999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f2709-45c1-493f-a238-79272d886a54 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:00.414717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-da0f2709-45c1-493f-a238-79272d886a54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:00.435443 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 919/1841] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:52:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:00.473405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f2709-45c1-493f-a238-79272d886a54 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:00.494189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:00.495255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:00.496289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:00.497273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] PATH_INFO: `/v3/projects/d0c905ab945e4430af95cc0b53723717` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:00.506758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c905ab945e4430af95cc0b53723717)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:00.512085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:00.512630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1618e-27a9-4729-a0bf-d1fb36a2dab9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:00.514123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9dc1618e-27a9-4729-a0bf-d1fb36a2dab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:00.553018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1618e-27a9-4729-a0bf-d1fb36a2dab9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:00.568453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539ad80-3d0f-45c7-a3ea-bcfa5d644181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:00.569097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539ad80-3d0f-45c7-a3ea-bcfa5d644181 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:00.569437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539ad80-3d0f-45c7-a3ea-bcfa5d644181 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:00.569719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539ad80-3d0f-45c7-a3ea-bcfa5d644181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:00.592576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539ad80-3d0f-45c7-a3ea-bcfa5d644181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:00.597305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539ad80-3d0f-45c7-a3ea-bcfa5d644181 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:00.604980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:00.660204 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 920/1842] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:52:00.692350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c905ab945e4430af95cc0b53723717', 'request_id': 'req-35205460-7044-4d19-83bd-cb3f948361f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:00.712330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c905ab945e4430af95cc0b53723717', 'request_id': 'req-35205460-7044-4d19-83bd-cb3f948361f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:00.754199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c905ab945e4430af95cc0b53723717', 'request_id': 'req-35205460-7044-4d19-83bd-cb3f948361f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:00.789054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] The token cache is being invalidate because project d0c905ab945e4430af95cc0b53723717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:00.790555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:00.810458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:00.820445 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 923/1843] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:00 2022] DELETE /identity/v3/projects/d0c905ab945e4430af95cc0b53723717 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:00.824701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539ad80-3d0f-45c7-a3ea-bcfa5d644181 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:00.846627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539ad80-3d0f-45c7-a3ea-bcfa5d644181 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:01.002345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:01.004306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:01.008120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:01.026594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:01.027229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:01.027520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:01.028432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] PATH_INFO: `/v3/users/7feba7ba186f4308a89ed7a52ce7f393` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:01.034986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7feba7ba186f4308a89ed7a52ce7f393)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:01.037163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:01.132425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7feba7ba186f4308a89ed7a52ce7f393'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:01.148132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7feba7ba186f4308a89ed7a52ce7f393'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:01.151162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7feba7ba186f4308a89ed7a52ce7f393'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:01.197003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7feba7ba186f4308a89ed7a52ce7f393'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:01.205094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7feba7ba186f4308a89ed7a52ce7f393'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:01.232921 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 921/1844] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:00 2022] DELETE /identity/v3/users/7feba7ba186f4308a89ed7a52ce7f393 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:01.317616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35205460-7044-4d19-83bd-cb3f948361f2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:01.536725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:01.538912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:01.540120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:01.540713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] PATH_INFO: `/v3/projects/40dae9d5701c40d5a71ccdaf1344ee42` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:01.545210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40dae9d5701c40d5a71ccdaf1344ee42)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:01.558923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:01.671135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40dae9d5701c40d5a71ccdaf1344ee42', 'request_id': 'req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:01.685822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40dae9d5701c40d5a71ccdaf1344ee42', 'request_id': 'req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:01.693061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:01.710184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40dae9d5701c40d5a71ccdaf1344ee42', 'request_id': 'req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:01.758269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] The token cache is being invalidate because project 40dae9d5701c40d5a71ccdaf1344ee42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:01.758633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:01.760858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:01.764080 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 924/1845] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:01 2022] DELETE /identity/v3/projects/40dae9d5701c40d5a71ccdaf1344ee42 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:01.769206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:01.777217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:01.815940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de863259-8a62-4440-b965-bd5f524faafa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:01.980901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597b2e3a-a59f-4775-9abc-8826a695b8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:01.981584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b2e3a-a59f-4775-9abc-8826a695b8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:01.981850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b2e3a-a59f-4775-9abc-8826a695b8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:01.982125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597b2e3a-a59f-4775-9abc-8826a695b8c4 admin admin] PATH_INFO: `/v3/users/5cae74c0586e4ef4878d43269743d92b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:01.986382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b2e3a-a59f-4775-9abc-8826a695b8c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cae74c0586e4ef4878d43269743d92b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:01.988442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597b2e3a-a59f-4775-9abc-8826a695b8c4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:02.099895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-597b2e3a-a59f-4775-9abc-8826a695b8c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cae74c0586e4ef4878d43269743d92b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:02.120610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-597b2e3a-a59f-4775-9abc-8826a695b8c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cae74c0586e4ef4878d43269743d92b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:02.121380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-597b2e3a-a59f-4775-9abc-8826a695b8c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cae74c0586e4ef4878d43269743d92b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:02.146418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-597b2e3a-a59f-4775-9abc-8826a695b8c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cae74c0586e4ef4878d43269743d92b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:02.152082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-597b2e3a-a59f-4775-9abc-8826a695b8c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cae74c0586e4ef4878d43269743d92b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:02.156114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:02.174312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:02.175781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:02.185940 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 922/1846] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:01 2022] DELETE /identity/v3/users/5cae74c0586e4ef4878d43269743d92b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:02.206828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2085c0-f9bd-4ee4-b00c-b8176a73dd81 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:02.386618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ce035-4471-4470-9dd8-c359b34d441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:02.389764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce035-4471-4470-9dd8-c359b34d441d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:02.397409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce035-4471-4470-9dd8-c359b34d441d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:02.399442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce035-4471-4470-9dd8-c359b34d441d admin admin] PATH_INFO: `/v3/projects/f2f1f19e912d4203b52b92d723359dfb` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:02.403437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ce035-4471-4470-9dd8-c359b34d441d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f1f19e912d4203b52b92d723359dfb)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:02.414576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ce035-4471-4470-9dd8-c359b34d441d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:02.631548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c13ce035-4471-4470-9dd8-c359b34d441d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f1f19e912d4203b52b92d723359dfb', 'request_id': 'req-c13ce035-4471-4470-9dd8-c359b34d441d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:02.646292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c13ce035-4471-4470-9dd8-c359b34d441d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f1f19e912d4203b52b92d723359dfb', 'request_id': 'req-c13ce035-4471-4470-9dd8-c359b34d441d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:02.659345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c13ce035-4471-4470-9dd8-c359b34d441d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f1f19e912d4203b52b92d723359dfb', 'request_id': 'req-c13ce035-4471-4470-9dd8-c359b34d441d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:02.697727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c13ce035-4471-4470-9dd8-c359b34d441d admin admin] The token cache is being invalidate because project f2f1f19e912d4203b52b92d723359dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:02.698934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c13ce035-4471-4470-9dd8-c359b34d441d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:02.701686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c13ce035-4471-4470-9dd8-c359b34d441d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:02.714263 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 925/1847] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:02 2022] DELETE /identity/v3/projects/f2f1f19e912d4203b52b92d723359dfb => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:02.716119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46641d84-67f1-486a-b820-f4210c05309b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:02.716603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46641d84-67f1-486a-b820-f4210c05309b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:02.716693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46641d84-67f1-486a-b820-f4210c05309b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:02.813301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-46641d84-67f1-486a-b820-f4210c05309b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:02.824603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-46641d84-67f1-486a-b820-f4210c05309b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:03.167739 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 923/1848] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:03.170790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a0185-5f9f-41c7-a171-8f8fcc929f0a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:03.171377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a0185-5f9f-41c7-a171-8f8fcc929f0a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:03.171783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a0185-5f9f-41c7-a171-8f8fcc929f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:03.224254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2c9a0185-5f9f-41c7-a171-8f8fcc929f0a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:03.227539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2c9a0185-5f9f-41c7-a171-8f8fcc929f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:03.246860 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 926/1849] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:03.254054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46641d84-67f1-486a-b820-f4210c05309b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:03.284112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46641d84-67f1-486a-b820-f4210c05309b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:03.308238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9369b62-d77d-4ba6-ad8f-2a22c844ea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:03.309834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9369b62-d77d-4ba6-ad8f-2a22c844ea80 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:03.313376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9369b62-d77d-4ba6-ad8f-2a22c844ea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:03.314278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9369b62-d77d-4ba6-ad8f-2a22c844ea80 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:03.317003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9369b62-d77d-4ba6-ad8f-2a22c844ea80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:03.318585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9369b62-d77d-4ba6-ad8f-2a22c844ea80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:03.323691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9369b62-d77d-4ba6-ad8f-2a22c844ea80 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:03.370474 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 924/1850] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:03.376035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a0185-5f9f-41c7-a171-8f8fcc929f0a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:03.396700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a0185-5f9f-41c7-a171-8f8fcc929f0a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:03.410601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6e82a-380b-4d65-8cbf-09cf027b5f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:03.412827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6e82a-380b-4d65-8cbf-09cf027b5f5d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:03.413139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6e82a-380b-4d65-8cbf-09cf027b5f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:03.413426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6e82a-380b-4d65-8cbf-09cf027b5f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:03.417353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6e82a-380b-4d65-8cbf-09cf027b5f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:03.420815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6e82a-380b-4d65-8cbf-09cf027b5f5d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:03.511833 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 927/1851] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:03 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:03.518601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9369b62-d77d-4ba6-ad8f-2a22c844ea80 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:03.549805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9369b62-d77d-4ba6-ad8f-2a22c844ea80 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:03.795661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456acb2-4a04-42a2-aaab-4da23a40087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:03.796367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456acb2-4a04-42a2-aaab-4da23a40087b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:03.796661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456acb2-4a04-42a2-aaab-4da23a40087b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:03.797842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456acb2-4a04-42a2-aaab-4da23a40087b admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:03.799176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456acb2-4a04-42a2-aaab-4da23a40087b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:03.801350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456acb2-4a04-42a2-aaab-4da23a40087b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:03.858850 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 925/1852] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:03 2022] POST /identity/v3/users => generated 287 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:03.860650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6e82a-380b-4d65-8cbf-09cf027b5f5d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:03.875470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6e82a-380b-4d65-8cbf-09cf027b5f5d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:03.899383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0f0a0-c337-4841-916a-76b5054951ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:03.900268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0f0a0-c337-4841-916a-76b5054951ea admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:03.900676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0f0a0-c337-4841-916a-76b5054951ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:03.901079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0f0a0-c337-4841-916a-76b5054951ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:03.907287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0f0a0-c337-4841-916a-76b5054951ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:03.914290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0f0a0-c337-4841-916a-76b5054951ea admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:03.980832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456acb2-4a04-42a2-aaab-4da23a40087b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:03.989713 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 928/1853] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:04.000870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456acb2-4a04-42a2-aaab-4da23a40087b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:04.015178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd412f33-e141-42b1-b8e0-92338adc4acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:04.016392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd412f33-e141-42b1-b8e0-92338adc4acb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:04.016907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd412f33-e141-42b1-b8e0-92338adc4acb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:04.017317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd412f33-e141-42b1-b8e0-92338adc4acb admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:04.018056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd412f33-e141-42b1-b8e0-92338adc4acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:04.019756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd412f33-e141-42b1-b8e0-92338adc4acb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:04.038066 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 926/1854] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:52:04.040215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0f0a0-c337-4841-916a-76b5054951ea admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:04.056826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0f0a0-c337-4841-916a-76b5054951ea admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:04.069951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3930f33-693c-440e-ba6f-5f8723bbe7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:04.070585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3930f33-693c-440e-ba6f-5f8723bbe7d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:04.070888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3930f33-693c-440e-ba6f-5f8723bbe7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:04.071168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3930f33-693c-440e-ba6f-5f8723bbe7d7 admin admin] PATH_INFO: `/v3/projects/e26234e7d0dc44ce823e045b2a1bcc53/users/b05e0387a6b84cdb9b1b59dae6281802/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:04.109510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3930f33-693c-440e-ba6f-5f8723bbe7d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26234e7d0dc44ce823e045b2a1bcc53, user_id=b05e0387a6b84cdb9b1b59dae6281802, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:04.112736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3930f33-693c-440e-ba6f-5f8723bbe7d7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:04.159177 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 929/1855] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:04 2022] PUT /identity/v3/projects/e26234e7d0dc44ce823e045b2a1bcc53/users/b05e0387a6b84cdb9b1b59dae6281802/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:04.164473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c95bc-1737-4ac1-bc5a-20a52d2b1360 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:04.164779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c95bc-1737-4ac1-bc5a-20a52d2b1360 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:04.165112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c95bc-1737-4ac1-bc5a-20a52d2b1360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:04.233021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5e6c95bc-1737-4ac1-bc5a-20a52d2b1360 None None] MFA Rules not processed for user `b05e0387a6b84cdb9b1b59dae6281802`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:04.235361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5e6c95bc-1737-4ac1-bc5a-20a52d2b1360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:04.325707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3930f33-693c-440e-ba6f-5f8723bbe7d7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:04.327927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d3930f33-693c-440e-ba6f-5f8723bbe7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:04.379395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:04.390591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:04.480436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 927/1856] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:04.481659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c95bc-1737-4ac1-bc5a-20a52d2b1360 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:04.512233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5e6c95bc-1737-4ac1-bc5a-20a52d2b1360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:04.525474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3930f33-693c-440e-ba6f-5f8723bbe7d7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:04.556352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:04.557035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:04.557322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:04.557596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] PATH_INFO: `/v3/projects/58eea55e23de435299d2a63f3a9e52c2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:04.560508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58eea55e23de435299d2a63f3a9e52c2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:04.567901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c95bc-1737-4ac1-bc5a-20a52d2b1360 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:04.570066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:04.589715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:04.590613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:04.592011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:04.593185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] PATH_INFO: `/v3/projects/9132e8d8dba04e09b1077b4267bfb8ef` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:04.598487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] RBAC: Authorizing `identity:delete_project(project_id=9132e8d8dba04e09b1077b4267bfb8ef)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:04.602686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:04.717421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9132e8d8dba04e09b1077b4267bfb8ef', 'request_id': 'req-ffc54863-9389-4d6f-bef2-0c4c0062c5db'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:04.722393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58eea55e23de435299d2a63f3a9e52c2', 'request_id': 'req-dcd4a2cb-553b-438c-9cb1-d511217c8e53'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:04.735956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58eea55e23de435299d2a63f3a9e52c2', 'request_id': 'req-dcd4a2cb-553b-438c-9cb1-d511217c8e53'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:04.743415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9132e8d8dba04e09b1077b4267bfb8ef', 'request_id': 'req-ffc54863-9389-4d6f-bef2-0c4c0062c5db'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:04.752170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58eea55e23de435299d2a63f3a9e52c2', 'request_id': 'req-dcd4a2cb-553b-438c-9cb1-d511217c8e53'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:04.760796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9132e8d8dba04e09b1077b4267bfb8ef', 'request_id': 'req-ffc54863-9389-4d6f-bef2-0c4c0062c5db'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:04.794967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] The token cache is being invalidate because project 58eea55e23de435299d2a63f3a9e52c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:04.795577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:04.796421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:04.798416 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 930/1857] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:04 2022] DELETE /identity/v3/projects/58eea55e23de435299d2a63f3a9e52c2 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:04.799445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:04.801079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:04.807946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] The token cache is being invalidate because project 9132e8d8dba04e09b1077b4267bfb8ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:04.809095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:04.811054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:04.823728 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 928/1858] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:04 2022] DELETE /identity/v3/projects/9132e8d8dba04e09b1077b4267bfb8ef => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:04.826124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:04.840341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:05.009070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4a2cb-553b-438c-9cb1-d511217c8e53 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:05.050359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc54863-9389-4d6f-bef2-0c4c0062c5db admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:05.073549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:05.075496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:05.076372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:05.077266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee admin admin] PATH_INFO: `/v3/projects/410e93f28b294d5d976940b0b250d597` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:05.082681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee admin admin] RBAC: Authorizing `identity:delete_project(project_id=410e93f28b294d5d976940b0b250d597)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:05.090250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:05.214812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:05.241887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c197772-aa73-46fe-a384-3487e14d079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:05.260066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c197772-aa73-46fe-a384-3487e14d079f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:05.261392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c197772-aa73-46fe-a384-3487e14d079f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:05.261858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c197772-aa73-46fe-a384-3487e14d079f admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:05.271431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c197772-aa73-46fe-a384-3487e14d079f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:05.285061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c197772-aa73-46fe-a384-3487e14d079f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:05.306251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410e93f28b294d5d976940b0b250d597', 'request_id': 'req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:05.324625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410e93f28b294d5d976940b0b250d597', 'request_id': 'req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:05.335533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410e93f28b294d5d976940b0b250d597', 'request_id': 'req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:05.367145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee admin admin] The token cache is being invalidate because project 410e93f28b294d5d976940b0b250d597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:05.367615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:05.368822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49d5d28c-d2a2-43a4-9b11-cd1b33702cee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:05.371802 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 929/1859] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:04 2022] DELETE /identity/v3/projects/410e93f28b294d5d976940b0b250d597 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:05.373290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4850f-67b2-4cb0-b90b-2fa24edfea49 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:05.377053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4850f-67b2-4cb0-b90b-2fa24edfea49 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:05.377053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4850f-67b2-4cb0-b90b-2fa24edfea49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:05.402403 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 931/1860] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:04 2022] POST /identity/v3/projects => generated 373 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:05.403386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c197772-aa73-46fe-a384-3487e14d079f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:05.408911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:05.427031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8c197772-aa73-46fe-a384-3487e14d079f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:05.449589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-78a4850f-67b2-4cb0-b90b-2fa24edfea49 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:05.452255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-78a4850f-67b2-4cb0-b90b-2fa24edfea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:05.566877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c197772-aa73-46fe-a384-3487e14d079f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:05.572412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:05.579709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:05.580216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:05.580677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] PATH_INFO: `/v3/users/5ef94f9197e0423994742707180ebe98` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:05.582649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef94f9197e0423994742707180ebe98)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:05.585217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:05.699313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef94f9197e0423994742707180ebe98'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:05.715447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef94f9197e0423994742707180ebe98'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:05.716264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef94f9197e0423994742707180ebe98'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:05.728602 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 930/1861] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:05.742313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a85d-703b-4849-bc89-6388dc329180 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:05.743579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a85d-703b-4849-bc89-6388dc329180 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:05.743669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef94f9197e0423994742707180ebe98'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:05.745788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a85d-703b-4849-bc89-6388dc329180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:05.752237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef94f9197e0423994742707180ebe98'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:05.814365 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 932/1862] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:05 2022] DELETE /identity/v3/users/5ef94f9197e0423994742707180ebe98 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:05.814365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:05.814365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:05.831690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3c11a85d-703b-4849-bc89-6388dc329180 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:05.835439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3c11a85d-703b-4849-bc89-6388dc329180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:05.972885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:05.979886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea8abb-c57e-4983-ad60-e0df88a9b7e9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:05.996004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da879e3-47c6-4e40-a0f2-d5eb8b855eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:05.996903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da879e3-47c6-4e40-a0f2-d5eb8b855eca admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:05.997206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da879e3-47c6-4e40-a0f2-d5eb8b855eca admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:05.997511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da879e3-47c6-4e40-a0f2-d5eb8b855eca admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:05.998167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da879e3-47c6-4e40-a0f2-d5eb8b855eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:06.000994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da879e3-47c6-4e40-a0f2-d5eb8b855eca admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:06.050875 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 931/1863] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:06.053660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41327bc5-1766-4821-9935-9497f82e45f1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:06.053992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41327bc5-1766-4821-9935-9497f82e45f1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:06.054347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41327bc5-1766-4821-9935-9497f82e45f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:06.067488 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 933/1864] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:05 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:06.067488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5178bd-fef4-4aea-9b26-b5ddad5950e4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:06.067488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5178bd-fef4-4aea-9b26-b5ddad5950e4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:06.067488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5178bd-fef4-4aea-9b26-b5ddad5950e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:06.102623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-41327bc5-1766-4821-9935-9497f82e45f1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:06.108632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-41327bc5-1766-4821-9935-9497f82e45f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:06.128650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1b5178bd-fef4-4aea-9b26-b5ddad5950e4 None None] MFA Rules not processed for user `181f661f98964045b1f474672ca42bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:06.131259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1b5178bd-fef4-4aea-9b26-b5ddad5950e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:06.132509 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 932/1865] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:06.137497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66cb03-bef3-4f1a-93df-88fe3d445e6e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:06.137793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66cb03-bef3-4f1a-93df-88fe3d445e6e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:06.138075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66cb03-bef3-4f1a-93df-88fe3d445e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:06.192165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5e66cb03-bef3-4f1a-93df-88fe3d445e6e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:06.194478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5e66cb03-bef3-4f1a-93df-88fe3d445e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:06.239049 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 933/1866] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:06.240121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66cb03-bef3-4f1a-93df-88fe3d445e6e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:06.277321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66cb03-bef3-4f1a-93df-88fe3d445e6e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:06.300732 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 934/1867] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:06 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:06.301892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5178bd-fef4-4aea-9b26-b5ddad5950e4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:06.304492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad8f7b-02ea-467d-b556-3144c64e656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:06.307502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad8f7b-02ea-467d-b556-3144c64e656b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:06.309863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad8f7b-02ea-467d-b556-3144c64e656b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:06.310961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad8f7b-02ea-467d-b556-3144c64e656b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:06.313482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad8f7b-02ea-467d-b556-3144c64e656b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:06.315843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad8f7b-02ea-467d-b556-3144c64e656b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:06.334610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5178bd-fef4-4aea-9b26-b5ddad5950e4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:06.346529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbd12a-11cf-42cb-9b96-06fabd3fbdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:06.347263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbd12a-11cf-42cb-9b96-06fabd3fbdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:06.347525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbd12a-11cf-42cb-9b96-06fabd3fbdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:06.347807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbd12a-11cf-42cb-9b96-06fabd3fbdb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:06.348469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbd12a-11cf-42cb-9b96-06fabd3fbdb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:06.348769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbd12a-11cf-42cb-9b96-06fabd3fbdb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:06.350701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbd12a-11cf-42cb-9b96-06fabd3fbdb5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:06.393551 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 934/1868] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:06.395859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad8f7b-02ea-467d-b556-3144c64e656b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:06.411569 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 935/1869] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:06.412848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbd12a-11cf-42cb-9b96-06fabd3fbdb5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:06.427790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad8f7b-02ea-467d-b556-3144c64e656b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:06.447404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce89e05-4856-43e8-924e-1a4b40cc9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:06.449435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce89e05-4856-43e8-924e-1a4b40cc9827 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:06.450821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce89e05-4856-43e8-924e-1a4b40cc9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:06.451182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce89e05-4856-43e8-924e-1a4b40cc9827 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:06.457070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce89e05-4856-43e8-924e-1a4b40cc9827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:06.457070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce89e05-4856-43e8-924e-1a4b40cc9827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:06.461504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce89e05-4856-43e8-924e-1a4b40cc9827 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:06.479321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbd12a-11cf-42cb-9b96-06fabd3fbdb5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:06.502901 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 935/1870] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:06.504095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce89e05-4856-43e8-924e-1a4b40cc9827 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:06.507911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129be6c-dbfd-4181-b000-10a598dce0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:06.509198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129be6c-dbfd-4181-b000-10a598dce0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:06.509535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129be6c-dbfd-4181-b000-10a598dce0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:06.509942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129be6c-dbfd-4181-b000-10a598dce0b4 admin admin] PATH_INFO: `/v3/projects/e1058aee765c49a0abae2cb6693f6251/users/c5f0eae0a7ce47c6845a21491624a5c3/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:06.554967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce89e05-4856-43e8-924e-1a4b40cc9827 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:06.575689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9fcf0-adac-46ee-947b-208d786ed6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:06.575689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9fcf0-adac-46ee-947b-208d786ed6ec admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:06.575971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9fcf0-adac-46ee-947b-208d786ed6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:06.576180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9fcf0-adac-46ee-947b-208d786ed6ec admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:06.576836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9fcf0-adac-46ee-947b-208d786ed6ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:06.580183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9fcf0-adac-46ee-947b-208d786ed6ec admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:06.605161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129be6c-dbfd-4181-b000-10a598dce0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1058aee765c49a0abae2cb6693f6251, user_id=c5f0eae0a7ce47c6845a21491624a5c3, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:06.614050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129be6c-dbfd-4181-b000-10a598dce0b4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:06.643719 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 936/1871] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:06 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:06.644676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9fcf0-adac-46ee-947b-208d786ed6ec admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:06.676789 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 936/1872] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:06 2022] PUT /identity/v3/projects/e1058aee765c49a0abae2cb6693f6251/users/c5f0eae0a7ce47c6845a21491624a5c3/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:06.681914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129be6c-dbfd-4181-b000-10a598dce0b4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:06.880029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:06.935635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129be6c-dbfd-4181-b000-10a598dce0b4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:06.948477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955a2cb-ffb8-4f3e-92cc-04e8103f780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:06.949245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955a2cb-ffb8-4f3e-92cc-04e8103f780a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:06.949533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955a2cb-ffb8-4f3e-92cc-04e8103f780a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:06.949810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955a2cb-ffb8-4f3e-92cc-04e8103f780a admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:06.950614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955a2cb-ffb8-4f3e-92cc-04e8103f780a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:06.954128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955a2cb-ffb8-4f3e-92cc-04e8103f780a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:06.964576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9fcf0-adac-46ee-947b-208d786ed6ec admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:06.975251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bdd31-9e6c-49d9-a614-54afe20d00dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:06.975901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdd31-9e6c-49d9-a614-54afe20d00dd admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:06.976185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdd31-9e6c-49d9-a614-54afe20d00dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:06.976515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdd31-9e6c-49d9-a614-54afe20d00dd admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:06.977115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bdd31-9e6c-49d9-a614-54afe20d00dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:06.988339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bdd31-9e6c-49d9-a614-54afe20d00dd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:07.000828 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 937/1873] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:06 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:07.003028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955a2cb-ffb8-4f3e-92cc-04e8103f780a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:07.022078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955a2cb-ffb8-4f3e-92cc-04e8103f780a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:07.029872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fc851-3f8e-48e5-b390-68ef56ead780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:07.031591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fc851-3f8e-48e5-b390-68ef56ead780 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:07.032609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fc851-3f8e-48e5-b390-68ef56ead780 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:07.033141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fc851-3f8e-48e5-b390-68ef56ead780 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:07.034173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fc851-3f8e-48e5-b390-68ef56ead780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:07.043009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fc851-3f8e-48e5-b390-68ef56ead780 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:07.071408 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 938/1874] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:07.072289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fc851-3f8e-48e5-b390-68ef56ead780 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:07.074424 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 937/1875] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:06 2022] POST /identity/v3/projects => generated 381 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:07.081680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bdd31-9e6c-49d9-a614-54afe20d00dd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:07.088767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fc851-3f8e-48e5-b390-68ef56ead780 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:07.179369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:07.258368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c8bce-8ace-4429-af55-44786bf3532f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:07.259054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c8bce-8ace-4429-af55-44786bf3532f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:07.259343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c8bce-8ace-4429-af55-44786bf3532f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:07.259624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c8bce-8ace-4429-af55-44786bf3532f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:07.260289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c8bce-8ace-4429-af55-44786bf3532f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:07.261911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c8bce-8ace-4429-af55-44786bf3532f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:07.275098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bdd31-9e6c-49d9-a614-54afe20d00dd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:07.288473 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 939/1876] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:07.288473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c8bce-8ace-4429-af55-44786bf3532f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:07.290607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea33207-e8f1-4d77-a9ec-21157c07b965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:07.291342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea33207-e8f1-4d77-a9ec-21157c07b965 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:07.291626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea33207-e8f1-4d77-a9ec-21157c07b965 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:07.291909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea33207-e8f1-4d77-a9ec-21157c07b965 admin admin] PATH_INFO: `/v3/projects/e1058aee765c49a0abae2cb6693f6251/users/c5f0eae0a7ce47c6845a21491624a5c3/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:07.299335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea33207-e8f1-4d77-a9ec-21157c07b965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1058aee765c49a0abae2cb6693f6251, user_id=c5f0eae0a7ce47c6845a21491624a5c3, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:07.302101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea33207-e8f1-4d77-a9ec-21157c07b965 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:07.311718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c8bce-8ace-4429-af55-44786bf3532f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:07.325084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6d30d-61d2-43fc-91fc-5027b80481bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:07.325504 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 938/1877] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:07 2022] PUT /identity/v3/projects/e1058aee765c49a0abae2cb6693f6251/users/c5f0eae0a7ce47c6845a21491624a5c3/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:07.326819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6d30d-61d2-43fc-91fc-5027b80481bc admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:07.327111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6d30d-61d2-43fc-91fc-5027b80481bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:07.327529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea33207-e8f1-4d77-a9ec-21157c07b965 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:07.328568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6d30d-61d2-43fc-91fc-5027b80481bc admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:07.329597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6d30d-61d2-43fc-91fc-5027b80481bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:07.331594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6d30d-61d2-43fc-91fc-5027b80481bc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:07.412248 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 940/1878] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:07 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:07.417145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489dfda-bafb-4e29-8293-55e57c4af2eb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:07.417145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489dfda-bafb-4e29-8293-55e57c4af2eb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:07.417145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489dfda-bafb-4e29-8293-55e57c4af2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:07.486783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3489dfda-bafb-4e29-8293-55e57c4af2eb None None] MFA Rules not processed for user `c5f0eae0a7ce47c6845a21491624a5c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:07.488068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3489dfda-bafb-4e29-8293-55e57c4af2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:07.506112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea33207-e8f1-4d77-a9ec-21157c07b965 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:07.517028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3b26c-31dd-4913-be82-cd449c008ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:07.522663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b26c-31dd-4913-be82-cd449c008ddd admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:07.523252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b26c-31dd-4913-be82-cd449c008ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:07.523694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b26c-31dd-4913-be82-cd449c008ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:07.524551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3b26c-31dd-4913-be82-cd449c008ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:07.526385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3b26c-31dd-4913-be82-cd449c008ddd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:07.549908 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 939/1879] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:07.553383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8a9d1-00b6-463d-9df4-272c323da75e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:07.553927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8a9d1-00b6-463d-9df4-272c323da75e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:07.554399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8a9d1-00b6-463d-9df4-272c323da75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:07.624171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cce8a9d1-00b6-463d-9df4-272c323da75e None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:07.625638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cce8a9d1-00b6-463d-9df4-272c323da75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:07.722940 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 941/1880] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:07.723838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489dfda-bafb-4e29-8293-55e57c4af2eb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:07.736913 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 940/1881] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 18:52:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:07.738552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8a9d1-00b6-463d-9df4-272c323da75e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:07.751558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489dfda-bafb-4e29-8293-55e57c4af2eb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:07.755127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8a9d1-00b6-463d-9df4-272c323da75e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:07.757395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b6ea8-4eb7-4839-b1e4-027eca7cd20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:07.758122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b6ea8-4eb7-4839-b1e4-027eca7cd20d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:07.758957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b6ea8-4eb7-4839-b1e4-027eca7cd20d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:07.758957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b6ea8-4eb7-4839-b1e4-027eca7cd20d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:07.760241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b6ea8-4eb7-4839-b1e4-027eca7cd20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:07.761635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b6ea8-4eb7-4839-b1e4-027eca7cd20d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:07.762429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96067a-89e7-439e-a774-53c21f7f4463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:07.763405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96067a-89e7-439e-a774-53c21f7f4463 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:07.764580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96067a-89e7-439e-a774-53c21f7f4463 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:07.764580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96067a-89e7-439e-a774-53c21f7f4463 admin admin] PATH_INFO: `/v3/projects/bcb9b74ef330480c9a391686f48013d6/users/877f49ad60e9498ca3ea705d3ade4ed1/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:07.774931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:07.779697 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 942/1882] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:07.780593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b6ea8-4eb7-4839-b1e4-027eca7cd20d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:07.786850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a87b6ea8-4eb7-4839-b1e4-027eca7cd20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:07.799802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96067a-89e7-439e-a774-53c21f7f4463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb9b74ef330480c9a391686f48013d6, user_id=877f49ad60e9498ca3ea705d3ade4ed1, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:07.802623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96067a-89e7-439e-a774-53c21f7f4463 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:07.815384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b6ea8-4eb7-4839-b1e4-027eca7cd20d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:07.821187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:07.822014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:07.822439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:07.822834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] PATH_INFO: `/v3/projects/34d4c48a928f41928055608f49f278f7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:07.843113 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 941/1883] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:07 2022] PUT /identity/v3/projects/bcb9b74ef330480c9a391686f48013d6/users/877f49ad60e9498ca3ea705d3ade4ed1/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:07.843113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c82ac-1e7e-4488-93a4-f5f50f7ea42f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:07.843113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c82ac-1e7e-4488-93a4-f5f50f7ea42f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:07.844133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d4c48a928f41928055608f49f278f7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:07.844237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c82ac-1e7e-4488-93a4-f5f50f7ea42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:07.844329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:07.869572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1c3c82ac-1e7e-4488-93a4-f5f50f7ea42f None None] MFA Rules not processed for user `b05e0387a6b84cdb9b1b59dae6281802`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:07.871309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1c3c82ac-1e7e-4488-93a4-f5f50f7ea42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:07.934733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d4c48a928f41928055608f49f278f7', 'request_id': 'req-4e88e65d-9f54-4776-8017-243783d4cec9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:07.947879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d4c48a928f41928055608f49f278f7', 'request_id': 'req-4e88e65d-9f54-4776-8017-243783d4cec9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:07.959210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d4c48a928f41928055608f49f278f7', 'request_id': 'req-4e88e65d-9f54-4776-8017-243783d4cec9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:07.978558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] The token cache is being invalidate because project 34d4c48a928f41928055608f49f278f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:07.979149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:07.979891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:07.982283 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 943/1884] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:07 2022] DELETE /identity/v3/projects/34d4c48a928f41928055608f49f278f7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:07.983539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:07.985139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:07.992308 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 942/1885] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:07.993026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c82ac-1e7e-4488-93a4-f5f50f7ea42f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:07.994620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1c3c82ac-1e7e-4488-93a4-f5f50f7ea42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:07.999243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:08.087970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88e65d-9f54-4776-8017-243783d4cec9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:08.096451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce660c20-67bf-47a3-8543-95d9bcc7fa28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:08.097157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce660c20-67bf-47a3-8543-95d9bcc7fa28 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.098418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c82ac-1e7e-4488-93a4-f5f50f7ea42f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:08.098886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce660c20-67bf-47a3-8543-95d9bcc7fa28 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.099421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce660c20-67bf-47a3-8543-95d9bcc7fa28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.101608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ce660c20-67bf-47a3-8543-95d9bcc7fa28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:08.113280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce660c20-67bf-47a3-8543-95d9bcc7fa28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:08.115201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce660c20-67bf-47a3-8543-95d9bcc7fa28 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:08.127024 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 944/1886] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:08.135510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62b5eb-ee42-4ef6-bcda-7839151d6286 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.136089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62b5eb-ee42-4ef6-bcda-7839151d6286 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.136223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62b5eb-ee42-4ef6-bcda-7839151d6286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.179147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ff62b5eb-ee42-4ef6-bcda-7839151d6286 None None] MFA Rules not processed for user `877f49ad60e9498ca3ea705d3ade4ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:08.180508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ff62b5eb-ee42-4ef6-bcda-7839151d6286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:08.198629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70415ea0-1736-47fa-95bb-30d73a0517fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:08.199577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70415ea0-1736-47fa-95bb-30d73a0517fc admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.200643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70415ea0-1736-47fa-95bb-30d73a0517fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.201085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70415ea0-1736-47fa-95bb-30d73a0517fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.202728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70415ea0-1736-47fa-95bb-30d73a0517fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:08.205988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70415ea0-1736-47fa-95bb-30d73a0517fc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:08.223591 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 943/1887] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:08.224719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763f4d6-adc8-49f3-b673-53c096099e02 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.225111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763f4d6-adc8-49f3-b673-53c096099e02 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.225490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763f4d6-adc8-49f3-b673-53c096099e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.254181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3763f4d6-adc8-49f3-b673-53c096099e02 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:08.255681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3763f4d6-adc8-49f3-b673-53c096099e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:08.270151 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 944/1888] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:08.271037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763f4d6-adc8-49f3-b673-53c096099e02 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:08.272386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3763f4d6-adc8-49f3-b673-53c096099e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:08.323661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:08.340781 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 945/1889] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:08.343793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62b5eb-ee42-4ef6-bcda-7839151d6286 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:08.362143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62b5eb-ee42-4ef6-bcda-7839151d6286 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:08.372397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a97c9-5702-46ce-a4c4-b0efa28e8056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:08.373212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a97c9-5702-46ce-a4c4-b0efa28e8056 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.373564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a97c9-5702-46ce-a4c4-b0efa28e8056 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.373915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a97c9-5702-46ce-a4c4-b0efa28e8056 admin admin] PATH_INFO: `/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b/users/bef3c7a64055432b9df3b3dc33b21282/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.396292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763f4d6-adc8-49f3-b673-53c096099e02 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:08.396991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a97c9-5702-46ce-a4c4-b0efa28e8056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9293ac6dc21d4d8fb06e0b0e7285956b, user_id=bef3c7a64055432b9df3b3dc33b21282, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:08.400444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a97c9-5702-46ce-a4c4-b0efa28e8056 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:08.402633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fba4c-852f-429b-af10-13638637cc46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:08.403449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fba4c-852f-429b-af10-13638637cc46 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.403801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fba4c-852f-429b-af10-13638637cc46 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.404149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fba4c-852f-429b-af10-13638637cc46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.406873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-028fba4c-852f-429b-af10-13638637cc46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:08.425266 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 946/1890] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:08 2022] PUT /identity/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b/users/bef3c7a64055432b9df3b3dc33b21282/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:08.427502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e941a-ba4c-407a-96ed-b7f1cd77806e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.427934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e941a-ba4c-407a-96ed-b7f1cd77806e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.428219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e941a-ba4c-407a-96ed-b7f1cd77806e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.473154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-874e941a-ba4c-407a-96ed-b7f1cd77806e None None] MFA Rules not processed for user `e0afcff84398404faf503d2bea46c9af`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:08.474877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-874e941a-ba4c-407a-96ed-b7f1cd77806e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:08.491564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fba4c-852f-429b-af10-13638637cc46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:08.493553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fba4c-852f-429b-af10-13638637cc46 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:08.509874 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 945/1891] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:08.511328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cb814-593b-445b-9154-5a7e5025e7d1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.511629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cb814-593b-445b-9154-5a7e5025e7d1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.511914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cb814-593b-445b-9154-5a7e5025e7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.536345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5c9cb814-593b-445b-9154-5a7e5025e7d1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:08.537751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5c9cb814-593b-445b-9154-5a7e5025e7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:08.618576 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 947/1892] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:08.619410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e941a-ba4c-407a-96ed-b7f1cd77806e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:08.620852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-874e941a-ba4c-407a-96ed-b7f1cd77806e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:08.632948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:08.690045 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 946/1893] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:08.691491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cbe7b-0565-48fe-bae3-1faeb7445c35 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.692056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cbe7b-0565-48fe-bae3-1faeb7445c35 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.694579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cbe7b-0565-48fe-bae3-1faeb7445c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.747776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e941a-ba4c-407a-96ed-b7f1cd77806e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:08.756077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe64491-3671-4d6d-80f8-cf797535fc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:08.757434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe64491-3671-4d6d-80f8-cf797535fc40 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.759040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe64491-3671-4d6d-80f8-cf797535fc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.760210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-002cbe7b-0565-48fe-bae3-1faeb7445c35 None None] MFA Rules not processed for user `bef3c7a64055432b9df3b3dc33b21282`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:08.760401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe64491-3671-4d6d-80f8-cf797535fc40 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.761230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe64491-3671-4d6d-80f8-cf797535fc40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:08.762837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-002cbe7b-0565-48fe-bae3-1faeb7445c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:08.764666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe64491-3671-4d6d-80f8-cf797535fc40 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:08.813379 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 948/1894] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:08 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:08.814493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe64491-3671-4d6d-80f8-cf797535fc40 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:08.816328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7fe64491-3671-4d6d-80f8-cf797535fc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:08.853824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:08.884790 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 947/1895] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:08.885744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cbe7b-0565-48fe-bae3-1faeb7445c35 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:08.916021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cbe7b-0565-48fe-bae3-1faeb7445c35 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:08.975058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe64491-3671-4d6d-80f8-cf797535fc40 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:08.987300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618d80c-1f41-4956-8a11-9cd8a967a8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:08.987944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618d80c-1f41-4956-8a11-9cd8a967a8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:08.988232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618d80c-1f41-4956-8a11-9cd8a967a8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:08.988584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618d80c-1f41-4956-8a11-9cd8a967a8b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:08.989160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618d80c-1f41-4956-8a11-9cd8a967a8b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:08.994398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618d80c-1f41-4956-8a11-9cd8a967a8b8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.033851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de1fd9-3c7e-42cc-8a41-1ab278d0ef4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:09.034511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de1fd9-3c7e-42cc-8a41-1ab278d0ef4c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.034836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de1fd9-3c7e-42cc-8a41-1ab278d0ef4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.035126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de1fd9-3c7e-42cc-8a41-1ab278d0ef4c admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.035813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de1fd9-3c7e-42cc-8a41-1ab278d0ef4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:09.036120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de1fd9-3c7e-42cc-8a41-1ab278d0ef4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:09.037767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de1fd9-3c7e-42cc-8a41-1ab278d0ef4c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.075864 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 948/1896] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:09.075864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de1fd9-3c7e-42cc-8a41-1ab278d0ef4c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:09.090983 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 949/1897] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:08 2022] POST /identity/v3/projects => generated 405 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:09.096299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618d80c-1f41-4956-8a11-9cd8a967a8b8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:09.098519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de1fd9-3c7e-42cc-8a41-1ab278d0ef4c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:09.248663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618d80c-1f41-4956-8a11-9cd8a967a8b8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:09.259029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d02e34-5df2-4ff1-a7ec-30d272d0ab62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:09.263372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d02e34-5df2-4ff1-a7ec-30d272d0ab62 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.265328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d02e34-5df2-4ff1-a7ec-30d272d0ab62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.267192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d02e34-5df2-4ff1-a7ec-30d272d0ab62 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.269519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d02e34-5df2-4ff1-a7ec-30d272d0ab62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:09.272830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d02e34-5df2-4ff1-a7ec-30d272d0ab62 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.273004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dc5be-8996-42fc-a54d-70966576af0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:09.275571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dc5be-8996-42fc-a54d-70966576af0f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.275962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dc5be-8996-42fc-a54d-70966576af0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.276499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dc5be-8996-42fc-a54d-70966576af0f admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.278918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dc5be-8996-42fc-a54d-70966576af0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:09.286991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53dc5be-8996-42fc-a54d-70966576af0f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.339600 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 950/1898] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:09 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:09.340734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d02e34-5df2-4ff1-a7ec-30d272d0ab62 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:09.341577 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 949/1899] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:09 2022] POST /identity/v3/users => generated 300 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:09.342412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dc5be-8996-42fc-a54d-70966576af0f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:09.357049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:09.368856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53dc5be-8996-42fc-a54d-70966576af0f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:09.456773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d02e34-5df2-4ff1-a7ec-30d272d0ab62 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:09.462164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a14d1-9da6-4d1c-a4c6-bf73cb178871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:09.462982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a14d1-9da6-4d1c-a4c6-bf73cb178871 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.463275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a14d1-9da6-4d1c-a4c6-bf73cb178871 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.463558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a14d1-9da6-4d1c-a4c6-bf73cb178871 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.464357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a14d1-9da6-4d1c-a4c6-bf73cb178871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:09.466539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a14d1-9da6-4d1c-a4c6-bf73cb178871 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.516479 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 951/1900] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:09 2022] POST /identity/v3/projects => generated 391 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:09.516479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a14d1-9da6-4d1c-a4c6-bf73cb178871 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:09.524446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c024b-ffd4-4998-9f13-178f826cc233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:09.525284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c024b-ffd4-4998-9f13-178f826cc233 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.525670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c024b-ffd4-4998-9f13-178f826cc233 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.526272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c024b-ffd4-4998-9f13-178f826cc233 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.528509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c024b-ffd4-4998-9f13-178f826cc233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:09.532236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c024b-ffd4-4998-9f13-178f826cc233 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.607533 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 950/1901] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:09 2022] POST /identity/v3/users => generated 309 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:09.608447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c024b-ffd4-4998-9f13-178f826cc233 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:09.630732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c024b-ffd4-4998-9f13-178f826cc233 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:09.641179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a14d1-9da6-4d1c-a4c6-bf73cb178871 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:09.646376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b0bb7-2721-431a-9243-0eb7f3a24d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:09.647709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b0bb7-2721-431a-9243-0eb7f3a24d26 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.648810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b0bb7-2721-431a-9243-0eb7f3a24d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.650455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b0bb7-2721-431a-9243-0eb7f3a24d26 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.651595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b0bb7-2721-431a-9243-0eb7f3a24d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:09.654955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b0bb7-2721-431a-9243-0eb7f3a24d26 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.660998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a432e-f139-43e6-a39c-64de82b26f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:09.662164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a432e-f139-43e6-a39c-64de82b26f10 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.662492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a432e-f139-43e6-a39c-64de82b26f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.662876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a432e-f139-43e6-a39c-64de82b26f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.668052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a432e-f139-43e6-a39c-64de82b26f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:09.669074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:09.669961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a432e-f139-43e6-a39c-64de82b26f10 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.690889 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 952/1902] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:09.692347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a432e-f139-43e6-a39c-64de82b26f10 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:09.696089 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 951/1903] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:09 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:09.699789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b0bb7-2721-431a-9243-0eb7f3a24d26 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:09.711837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a432e-f139-43e6-a39c-64de82b26f10 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:09.721969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b0bb7-2721-431a-9243-0eb7f3a24d26 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:09.729118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7581615-754b-4689-a962-2af2a51bd168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:09.729883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7581615-754b-4689-a962-2af2a51bd168 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.730291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7581615-754b-4689-a962-2af2a51bd168 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.730687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7581615-754b-4689-a962-2af2a51bd168 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.731539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7581615-754b-4689-a962-2af2a51bd168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:09.733310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7581615-754b-4689-a962-2af2a51bd168 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.733701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180105ce-18cb-4e9d-8fbe-daa873ef2aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:09.735254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180105ce-18cb-4e9d-8fbe-daa873ef2aac admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.735791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180105ce-18cb-4e9d-8fbe-daa873ef2aac admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.736049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180105ce-18cb-4e9d-8fbe-daa873ef2aac admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.736729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180105ce-18cb-4e9d-8fbe-daa873ef2aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:09.738704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180105ce-18cb-4e9d-8fbe-daa873ef2aac admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.751383 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 952/1904] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:09.752532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7581615-754b-4689-a962-2af2a51bd168 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:09.764382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7581615-754b-4689-a962-2af2a51bd168 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:09.771764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d370e5-d256-4956-b295-e759cc79b31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:09.772393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d370e5-d256-4956-b295-e759cc79b31e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.772747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d370e5-d256-4956-b295-e759cc79b31e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.773659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d370e5-d256-4956-b295-e759cc79b31e admin admin] PATH_INFO: `/v3/projects/7049ca5a08ac40e082af0e6f0b54568b/users/7a62fdf3c6504d75baacefa0cf20013e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.795854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d370e5-d256-4956-b295-e759cc79b31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7049ca5a08ac40e082af0e6f0b54568b, user_id=7a62fdf3c6504d75baacefa0cf20013e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:09.800246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d370e5-d256-4956-b295-e759cc79b31e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.801195 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 953/1905] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:09 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:09.802049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180105ce-18cb-4e9d-8fbe-daa873ef2aac admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:09.826181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180105ce-18cb-4e9d-8fbe-daa873ef2aac admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:09.830262 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 953/1906] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:09 2022] PUT /identity/v3/projects/7049ca5a08ac40e082af0e6f0b54568b/users/7a62fdf3c6504d75baacefa0cf20013e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:09.830992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d370e5-d256-4956-b295-e759cc79b31e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:09.985566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1690db-5fa5-4c1e-9b26-424d80104ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:09.985566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1690db-5fa5-4c1e-9b26-424d80104ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:09.986272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1690db-5fa5-4c1e-9b26-424d80104ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:09.986272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1690db-5fa5-4c1e-9b26-424d80104ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:09.987019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1690db-5fa5-4c1e-9b26-424d80104ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:09.989735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1690db-5fa5-4c1e-9b26-424d80104ed7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:09.997021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d370e5-d256-4956-b295-e759cc79b31e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:10.016733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be82f4-bca6-4435-9baa-96e62fa0abdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:10.017668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be82f4-bca6-4435-9baa-96e62fa0abdb admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:10.018777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be82f4-bca6-4435-9baa-96e62fa0abdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:10.031251 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 954/1907] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:10.033144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be82f4-bca6-4435-9baa-96e62fa0abdb admin admin] PATH_INFO: `/v3/projects/068f465abe654f349f2fec1bd9a56fcf/users/766695d4b7c647b6af015b749a881821/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:10.034480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1690db-5fa5-4c1e-9b26-424d80104ed7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:10.062791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:10.077551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1690db-5fa5-4c1e-9b26-424d80104ed7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:10.082033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be82f4-bca6-4435-9baa-96e62fa0abdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=068f465abe654f349f2fec1bd9a56fcf, user_id=766695d4b7c647b6af015b749a881821, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:10.089944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be82f4-bca6-4435-9baa-96e62fa0abdb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:10.094485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f81d0-4890-428c-8757-51261d82fb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:10.095605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f81d0-4890-428c-8757-51261d82fb27 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:10.096038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f81d0-4890-428c-8757-51261d82fb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:10.096519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f81d0-4890-428c-8757-51261d82fb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:10.097324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f81d0-4890-428c-8757-51261d82fb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:10.099132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f81d0-4890-428c-8757-51261d82fb27 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:10.132030 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 955/1908] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:10.132920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f81d0-4890-428c-8757-51261d82fb27 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:10.151556 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 954/1909] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:09 2022] PUT /identity/v3/projects/068f465abe654f349f2fec1bd9a56fcf/users/766695d4b7c647b6af015b749a881821/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:10.151556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be82f4-bca6-4435-9baa-96e62fa0abdb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:10.153222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f81d0-4890-428c-8757-51261d82fb27 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:10.300037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9497ec-622a-40cc-bd84-a0c8872b7fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:10.300709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9497ec-622a-40cc-bd84-a0c8872b7fbb admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:10.301053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9497ec-622a-40cc-bd84-a0c8872b7fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:10.301270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9497ec-622a-40cc-bd84-a0c8872b7fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:10.302280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9497ec-622a-40cc-bd84-a0c8872b7fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:10.304432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9497ec-622a-40cc-bd84-a0c8872b7fbb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:10.336630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be82f4-bca6-4435-9baa-96e62fa0abdb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:10.358311 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 956/1910] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:10.358311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9497ec-622a-40cc-bd84-a0c8872b7fbb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:10.363162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ab887-f1f2-4ad6-a94f-9a82a04ea6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:10.364146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab887-f1f2-4ad6-a94f-9a82a04ea6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:10.364647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab887-f1f2-4ad6-a94f-9a82a04ea6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:10.365026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ab887-f1f2-4ad6-a94f-9a82a04ea6ff admin admin] PATH_INFO: `/v3/projects/41951f1e618345eabb7fdedeacb85865/users/0801adb49e88401dab7ae2257f702ed7/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:10.373758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9497ec-622a-40cc-bd84-a0c8872b7fbb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:10.383238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8076b3-edde-4c39-b371-94b6710e7390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:10.384806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8076b3-edde-4c39-b371-94b6710e7390 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:10.385410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8076b3-edde-4c39-b371-94b6710e7390 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:10.386145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8076b3-edde-4c39-b371-94b6710e7390 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:10.387499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8076b3-edde-4c39-b371-94b6710e7390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:10.390178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ab887-f1f2-4ad6-a94f-9a82a04ea6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=41951f1e618345eabb7fdedeacb85865, user_id=0801adb49e88401dab7ae2257f702ed7, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:10.391081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8076b3-edde-4c39-b371-94b6710e7390 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:10.393553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ab887-f1f2-4ad6-a94f-9a82a04ea6ff admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:10.416270 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 957/1911] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:10.417477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8076b3-edde-4c39-b371-94b6710e7390 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:10.423305 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 955/1912] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:10 2022] PUT /identity/v3/projects/41951f1e618345eabb7fdedeacb85865/users/0801adb49e88401dab7ae2257f702ed7/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:10.427273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ab887-f1f2-4ad6-a94f-9a82a04ea6ff admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:10.439600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8076b3-edde-4c39-b371-94b6710e7390 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:10.492042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:10.598573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ab887-f1f2-4ad6-a94f-9a82a04ea6ff admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:10.610586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457d458-dca8-4b6f-9d61-646678444344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:10.611355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457d458-dca8-4b6f-9d61-646678444344 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:10.611635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457d458-dca8-4b6f-9d61-646678444344 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:10.611913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457d458-dca8-4b6f-9d61-646678444344 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:10.612578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457d458-dca8-4b6f-9d61-646678444344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:10.614222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457d458-dca8-4b6f-9d61-646678444344 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:10.642541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d47344-596b-4fcd-9b87-83dfa18580d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:10.645992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d47344-596b-4fcd-9b87-83dfa18580d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:10.649280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d47344-596b-4fcd-9b87-83dfa18580d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:10.649819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d47344-596b-4fcd-9b87-83dfa18580d4 admin admin] PATH_INFO: `/v3/projects/7049ca5a08ac40e082af0e6f0b54568b/users/7a62fdf3c6504d75baacefa0cf20013e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:10.654391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d47344-596b-4fcd-9b87-83dfa18580d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7049ca5a08ac40e082af0e6f0b54568b, user_id=7a62fdf3c6504d75baacefa0cf20013e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:10.659310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d47344-596b-4fcd-9b87-83dfa18580d4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:10.669485 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 958/1913] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:10.670323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457d458-dca8-4b6f-9d61-646678444344 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:10.682230 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 956/1914] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:10 2022] PUT /identity/v3/projects/7049ca5a08ac40e082af0e6f0b54568b/users/7a62fdf3c6504d75baacefa0cf20013e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:10.684147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d47344-596b-4fcd-9b87-83dfa18580d4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:10.688759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457d458-dca8-4b6f-9d61-646678444344 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:10.823615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64c5af-bef3-4f8c-9224-a9abfd30f0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:10.824556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64c5af-bef3-4f8c-9224-a9abfd30f0d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:10.825254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64c5af-bef3-4f8c-9224-a9abfd30f0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:10.825890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64c5af-bef3-4f8c-9224-a9abfd30f0d9 admin admin] PATH_INFO: `/v3/projects/189b96254be3469db0d0f7eb94908757/users/efb3454a7ecb448e8bba5761c487c0ad/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:10.866641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64c5af-bef3-4f8c-9224-a9abfd30f0d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=189b96254be3469db0d0f7eb94908757, user_id=efb3454a7ecb448e8bba5761c487c0ad, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:10.871068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64c5af-bef3-4f8c-9224-a9abfd30f0d9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:10.875524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d47344-596b-4fcd-9b87-83dfa18580d4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:10.877283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:10.889101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ae295-67e8-4d27-bdcb-bf5b38328471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:10.891239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ae295-67e8-4d27-bdcb-bf5b38328471 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:10.891838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ae295-67e8-4d27-bdcb-bf5b38328471 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:10.892786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ae295-67e8-4d27-bdcb-bf5b38328471 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:10.893695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ae295-67e8-4d27-bdcb-bf5b38328471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:10.896374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ae295-67e8-4d27-bdcb-bf5b38328471 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:10.897066 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 959/1915] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:10 2022] PUT /identity/v3/projects/189b96254be3469db0d0f7eb94908757/users/efb3454a7ecb448e8bba5761c487c0ad/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:10.897904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64c5af-bef3-4f8c-9224-a9abfd30f0d9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:10.917572 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 957/1916] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:10.919004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f40cc5-f4e8-47f1-b21b-51d48078092e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:10.919577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f40cc5-f4e8-47f1-b21b-51d48078092e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:10.919577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f40cc5-f4e8-47f1-b21b-51d48078092e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:10.963822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-11f40cc5-f4e8-47f1-b21b-51d48078092e None None] MFA Rules not processed for user `7a62fdf3c6504d75baacefa0cf20013e`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:10.965898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-11f40cc5-f4e8-47f1-b21b-51d48078092e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:11.036588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64c5af-bef3-4f8c-9224-a9abfd30f0d9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:11.052286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de630d1-8b67-48a3-aa3e-cb3610b55295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:11.053369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de630d1-8b67-48a3-aa3e-cb3610b55295 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:11.053694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de630d1-8b67-48a3-aa3e-cb3610b55295 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:11.054327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de630d1-8b67-48a3-aa3e-cb3610b55295 admin admin] PATH_INFO: `/v3/projects/068f465abe654f349f2fec1bd9a56fcf/users/766695d4b7c647b6af015b749a881821/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:11.056869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de630d1-8b67-48a3-aa3e-cb3610b55295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068f465abe654f349f2fec1bd9a56fcf, user_id=766695d4b7c647b6af015b749a881821, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:11.062491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de630d1-8b67-48a3-aa3e-cb3610b55295 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:11.089659 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 960/1917] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:10 2022] PUT /identity/v3/projects/068f465abe654f349f2fec1bd9a56fcf/users/766695d4b7c647b6af015b749a881821/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:11.089659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976843d-25c7-4819-8629-ed57f78cedc4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:11.089659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976843d-25c7-4819-8629-ed57f78cedc4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:11.089659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976843d-25c7-4819-8629-ed57f78cedc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:11.099780 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 958/1918] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:11.101742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f40cc5-f4e8-47f1-b21b-51d48078092e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:11.115403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f40cc5-f4e8-47f1-b21b-51d48078092e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:11.164845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:11.205401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2d0a3-275a-465a-b795-c7da2dafddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:11.209755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2d0a3-275a-465a-b795-c7da2dafddce admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:11.210471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2d0a3-275a-465a-b795-c7da2dafddce admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:11.211821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2d0a3-275a-465a-b795-c7da2dafddce admin admin] PATH_INFO: `/v3/projects/41951f1e618345eabb7fdedeacb85865/users/0801adb49e88401dab7ae2257f702ed7/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:11.218816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2d0a3-275a-465a-b795-c7da2dafddce admin admin] RBAC: Authorizing `identity:create_grant(project_id=41951f1e618345eabb7fdedeacb85865, user_id=0801adb49e88401dab7ae2257f702ed7, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:11.227573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2d0a3-275a-465a-b795-c7da2dafddce admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:11.228857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4976843d-25c7-4819-8629-ed57f78cedc4 None None] MFA Rules not processed for user `efb3454a7ecb448e8bba5761c487c0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:11.239858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4976843d-25c7-4819-8629-ed57f78cedc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:11.259636 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 959/1919] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:11 2022] PUT /identity/v3/projects/41951f1e618345eabb7fdedeacb85865/users/0801adb49e88401dab7ae2257f702ed7/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:11.262033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2d0a3-275a-465a-b795-c7da2dafddce admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:11.269064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-30d2d0a3-275a-465a-b795-c7da2dafddce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:11.451249 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 961/1920] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:11.454781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc470f-07b3-4dd9-b0b9-ac4aa7cae890 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:11.457149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc470f-07b3-4dd9-b0b9-ac4aa7cae890 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:11.457692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc470f-07b3-4dd9-b0b9-ac4aa7cae890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:11.464564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2d0a3-275a-465a-b795-c7da2dafddce admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:11.483287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3948335-ae96-4f43-b9bd-96244e00e196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:11.484191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3948335-ae96-4f43-b9bd-96244e00e196 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:11.484494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3948335-ae96-4f43-b9bd-96244e00e196 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:11.484779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3948335-ae96-4f43-b9bd-96244e00e196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:11.512890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9dbc470f-07b3-4dd9-b0b9-ac4aa7cae890 None None] MFA Rules not processed for user `0801adb49e88401dab7ae2257f702ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:11.517867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9dbc470f-07b3-4dd9-b0b9-ac4aa7cae890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:11.692089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3948335-ae96-4f43-b9bd-96244e00e196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:11.695964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3948335-ae96-4f43-b9bd-96244e00e196 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:11.711988 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 960/1921] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:11.713288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3948335-ae96-4f43-b9bd-96244e00e196 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:11.748311 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 962/1922] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:11.823716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc470f-07b3-4dd9-b0b9-ac4aa7cae890 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:11.835449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:11.851917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc470f-07b3-4dd9-b0b9-ac4aa7cae890 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:11.872236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2749d-6422-4f8b-98d3-e97473d930ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:11.872957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2749d-6422-4f8b-98d3-e97473d930ac service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:11.873205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2749d-6422-4f8b-98d3-e97473d930ac service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:11.873624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2749d-6422-4f8b-98d3-e97473d930ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:11.894177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2749d-6422-4f8b-98d3-e97473d930ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:11.896381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2749d-6422-4f8b-98d3-e97473d930ac service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:11.909057 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 963/1923] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:11.928528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ef427-b1aa-4e5b-b894-a7c1720a95cb None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:11.928791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ef427-b1aa-4e5b-b894-a7c1720a95cb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:11.929203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ef427-b1aa-4e5b-b894-a7c1720a95cb None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:11.931569 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 964/1924] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:52:11.941465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ef427-b1aa-4e5b-b894-a7c1720a95cb None None] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:52:11.996645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3948335-ae96-4f43-b9bd-96244e00e196 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:12.006142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ef427-b1aa-4e5b-b894-a7c1720a95cb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:12.008185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a90322-f470-4502-8edd-262e48aee4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:12.009135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a90322-f470-4502-8edd-262e48aee4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.009577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a90322-f470-4502-8edd-262e48aee4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.010004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a90322-f470-4502-8edd-262e48aee4e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.010919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a90322-f470-4502-8edd-262e48aee4e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:12.022150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a90322-f470-4502-8edd-262e48aee4e0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:12.042950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:12.052117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ef427-b1aa-4e5b-b894-a7c1720a95cb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:12.083549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd3fe7-745a-49a4-99b6-d1d164cf7b87 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0801adb49e88401dab7ae2257f702ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41951f1e618345eabb7fdedeacb85865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:12.087111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd3fe7-745a-49a4-99b6-d1d164cf7b87 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.087111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd3fe7-745a-49a4-99b6-d1d164cf7b87 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.087502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd3fe7-745a-49a4-99b6-d1d164cf7b87 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] PATH_INFO: `/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.094958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd3fe7-745a-49a4-99b6-d1d164cf7b87 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorizing `identity:get_project(project_id=9293ac6dc21d4d8fb06e0b0e7285956b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:12.099450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd3fe7-745a-49a4-99b6-d1d164cf7b87 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:12.107255 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 965/1925] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:52:11 2022] GET /identity/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b => generated 381 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:52:12.111051 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 961/1926] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:11 2022] POST /identity/v3/projects => generated 391 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:12.117665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd3fe7-745a-49a4-99b6-d1d164cf7b87 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:12.156530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd3fe7-745a-49a4-99b6-d1d164cf7b87 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:12.194069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a90322-f470-4502-8edd-262e48aee4e0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:12.349201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da180b-1df7-4441-8a3d-26a87fec8831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:12.362318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da180b-1df7-4441-8a3d-26a87fec8831 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.362604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da180b-1df7-4441-8a3d-26a87fec8831 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.364241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da180b-1df7-4441-8a3d-26a87fec8831 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.366279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da180b-1df7-4441-8a3d-26a87fec8831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:12.368806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da180b-1df7-4441-8a3d-26a87fec8831 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:12.421037 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 966/1927] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:12 2022] POST /identity/v3/users => generated 302 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:52:12.427959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da180b-1df7-4441-8a3d-26a87fec8831 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:12.457819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da180b-1df7-4441-8a3d-26a87fec8831 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:12.475569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9023c1-0d25-46eb-b483-a3e82d7d6509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:12.480904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a90322-f470-4502-8edd-262e48aee4e0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:12.484646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9023c1-0d25-46eb-b483-a3e82d7d6509 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.485049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9023c1-0d25-46eb-b483-a3e82d7d6509 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.485510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9023c1-0d25-46eb-b483-a3e82d7d6509 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.486318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9023c1-0d25-46eb-b483-a3e82d7d6509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:12.488069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9023c1-0d25-46eb-b483-a3e82d7d6509 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:12.513945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864403bd-d943-43a5-a13a-e23d7ef28c3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:12.514323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864403bd-d943-43a5-a13a-e23d7ef28c3e service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.514437 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 967/1928] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:52:12.517998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864403bd-d943-43a5-a13a-e23d7ef28c3e service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.518198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9023c1-0d25-46eb-b483-a3e82d7d6509 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:12.518313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864403bd-d943-43a5-a13a-e23d7ef28c3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.549175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9023c1-0d25-46eb-b483-a3e82d7d6509 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:12.555185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a831ecf-3a0b-4c1e-b7f7-c4aff7d8e37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:12.556083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a831ecf-3a0b-4c1e-b7f7-c4aff7d8e37e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.556351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a831ecf-3a0b-4c1e-b7f7-c4aff7d8e37e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.556629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a831ecf-3a0b-4c1e-b7f7-c4aff7d8e37e admin admin] PATH_INFO: `/v3/projects/3f456fbce4b74213887ceeb7086bdd74/users/668142dbb6514d65ab9cb80a31cdf964/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.611548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a831ecf-3a0b-4c1e-b7f7-c4aff7d8e37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f456fbce4b74213887ceeb7086bdd74, user_id=668142dbb6514d65ab9cb80a31cdf964, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:12.614256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a831ecf-3a0b-4c1e-b7f7-c4aff7d8e37e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:12.654420 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 968/1929] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:12 2022] PUT /identity/v3/projects/3f456fbce4b74213887ceeb7086bdd74/users/668142dbb6514d65ab9cb80a31cdf964/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:12.655725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a831ecf-3a0b-4c1e-b7f7-c4aff7d8e37e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:12.719706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864403bd-d943-43a5-a13a-e23d7ef28c3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:12.726425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864403bd-d943-43a5-a13a-e23d7ef28c3e service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:12.755010 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 962/1930] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:52:12.760004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cdf75-6be5-4913-8d51-d71a1f94ee0c None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.761214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cdf75-6be5-4913-8d51-d71a1f94ee0c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.761594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cdf75-6be5-4913-8d51-d71a1f94ee0c None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.763580 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 963/1931] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:12.771635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cdf75-6be5-4913-8d51-d71a1f94ee0c None None] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:52:12.886372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a831ecf-3a0b-4c1e-b7f7-c4aff7d8e37e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:12.926844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8f574-a197-4cd5-900a-5a0d7d598897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:12.930287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8f574-a197-4cd5-900a-5a0d7d598897 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:12.930928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8f574-a197-4cd5-900a-5a0d7d598897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:12.933396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8f574-a197-4cd5-900a-5a0d7d598897 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:12.934272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8f574-a197-4cd5-900a-5a0d7d598897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:12.943357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8f574-a197-4cd5-900a-5a0d7d598897 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:12.991543 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 969/1932] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:52:12.992830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8f574-a197-4cd5-900a-5a0d7d598897 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:13.027535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8f574-a197-4cd5-900a-5a0d7d598897 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:13.046899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef378e87-fd0c-41fb-8556-10fc92fbfac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:13.048028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef378e87-fd0c-41fb-8556-10fc92fbfac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:13.048238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef378e87-fd0c-41fb-8556-10fc92fbfac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:13.048654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef378e87-fd0c-41fb-8556-10fc92fbfac4 admin admin] PATH_INFO: `/v3/projects/3f456fbce4b74213887ceeb7086bdd74/users/668142dbb6514d65ab9cb80a31cdf964/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:13.052990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef378e87-fd0c-41fb-8556-10fc92fbfac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f456fbce4b74213887ceeb7086bdd74, user_id=668142dbb6514d65ab9cb80a31cdf964, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:13.064020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef378e87-fd0c-41fb-8556-10fc92fbfac4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:13.071328 n-d-854118-7 devstack@keystone.service[88374]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cdf75-6be5-4913-8d51-d71a1f94ee0c None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 28 18:52:13.071652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cdf75-6be5-4913-8d51-d71a1f94ee0c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:13.112324 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 970/1933] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:12 2022] PUT /identity/v3/projects/3f456fbce4b74213887ceeb7086bdd74/users/668142dbb6514d65ab9cb80a31cdf964/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:13.114140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7c24b-7c50-4a45-8015-0c9d3da4399e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:13.114472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7c24b-7c50-4a45-8015-0c9d3da4399e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:13.114922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7c24b-7c50-4a45-8015-0c9d3da4399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:13.157229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:13.165383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-50e7c24b-7c50-4a45-8015-0c9d3da4399e None None] MFA Rules not processed for user `668142dbb6514d65ab9cb80a31cdf964`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:13.169499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-50e7c24b-7c50-4a45-8015-0c9d3da4399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:13.185065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:13.326913 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 971/1934] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:13 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:13.327423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cdf75-6be5-4913-8d51-d71a1f94ee0c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:13.403489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7c24b-7c50-4a45-8015-0c9d3da4399e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:13.486565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe01afd-25f7-45fd-813c-77648b7e6463 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0801adb49e88401dab7ae2257f702ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41951f1e618345eabb7fdedeacb85865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:13.487340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe01afd-25f7-45fd-813c-77648b7e6463 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:13.487629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe01afd-25f7-45fd-813c-77648b7e6463 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:13.487950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe01afd-25f7-45fd-813c-77648b7e6463 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] PATH_INFO: `/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:13.489610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe01afd-25f7-45fd-813c-77648b7e6463 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorizing `identity:get_project(project_id=9293ac6dc21d4d8fb06e0b0e7285956b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:13.492000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe01afd-25f7-45fd-813c-77648b7e6463 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:13.499342 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 964/1935] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:52:12 2022] GET /identity/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b => generated 381 bytes in 728 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:13.577061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7c24b-7c50-4a45-8015-0c9d3da4399e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:13.592074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff993070-5fc1-4416-8d26-60fb21cff889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:13.592964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff993070-5fc1-4416-8d26-60fb21cff889 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:13.593499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff993070-5fc1-4416-8d26-60fb21cff889 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:13.594611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff993070-5fc1-4416-8d26-60fb21cff889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:13.632871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff993070-5fc1-4416-8d26-60fb21cff889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:13.642478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff993070-5fc1-4416-8d26-60fb21cff889 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:13.667359 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 972/1936] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:13.722544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875fb09-30fd-49bc-8331-8b8d4047d615 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:13.722900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875fb09-30fd-49bc-8331-8b8d4047d615 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:13.723115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875fb09-30fd-49bc-8331-8b8d4047d615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:13.770659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c875fb09-30fd-49bc-8331-8b8d4047d615 None None] MFA Rules not processed for user `bef3c7a64055432b9df3b3dc33b21282`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:13.772021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c875fb09-30fd-49bc-8331-8b8d4047d615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:13.930073 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 965/1937] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:14.157887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff993070-5fc1-4416-8d26-60fb21cff889 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:14.174282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff993070-5fc1-4416-8d26-60fb21cff889 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:14.181232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0789921-10b4-4580-8bba-821c1022cfa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:14.182173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789921-10b4-4580-8bba-821c1022cfa9 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:14.182503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789921-10b4-4580-8bba-821c1022cfa9 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:14.182834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789921-10b4-4580-8bba-821c1022cfa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:14.203288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0789921-10b4-4580-8bba-821c1022cfa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:14.205397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0789921-10b4-4580-8bba-821c1022cfa9 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:14.216630 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 973/1938] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:14.614937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875fb09-30fd-49bc-8331-8b8d4047d615 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:14.765979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875fb09-30fd-49bc-8331-8b8d4047d615 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:14.774653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fe6c2-6d90-45e5-bfcc-78fd378f39f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:14.776053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe6c2-6d90-45e5-bfcc-78fd378f39f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:14.776544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe6c2-6d90-45e5-bfcc-78fd378f39f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:14.777024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe6c2-6d90-45e5-bfcc-78fd378f39f5 admin admin] PATH_INFO: `/v3/users/efb3454a7ecb448e8bba5761c487c0ad` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:14.781312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fe6c2-6d90-45e5-bfcc-78fd378f39f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb3454a7ecb448e8bba5761c487c0ad)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:14.792546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fe6c2-6d90-45e5-bfcc-78fd378f39f5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:14.831094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:14.900032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-360fe6c2-6d90-45e5-bfcc-78fd378f39f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb3454a7ecb448e8bba5761c487c0ad'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:14.917573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-360fe6c2-6d90-45e5-bfcc-78fd378f39f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb3454a7ecb448e8bba5761c487c0ad'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:14.919301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-360fe6c2-6d90-45e5-bfcc-78fd378f39f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb3454a7ecb448e8bba5761c487c0ad'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:14.945493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-360fe6c2-6d90-45e5-bfcc-78fd378f39f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb3454a7ecb448e8bba5761c487c0ad'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:14.946260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-360fe6c2-6d90-45e5-bfcc-78fd378f39f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb3454a7ecb448e8bba5761c487c0ad'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:14.967354 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 966/1939] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:14 2022] DELETE /identity/v3/users/efb3454a7ecb448e8bba5761c487c0ad => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:14.972193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a07c7-88bd-41c0-9b31-4477f17ebd70 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:14.972541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a07c7-88bd-41c0-9b31-4477f17ebd70 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:14.973041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a07c7-88bd-41c0-9b31-4477f17ebd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:15.044671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-457a07c7-88bd-41c0-9b31-4477f17ebd70 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:15.048569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-457a07c7-88bd-41c0-9b31-4477f17ebd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:15.066311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed2aed-c9a3-4e4e-9fb7-75290be977d1 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:15.067180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed2aed-c9a3-4e4e-9fb7-75290be977d1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:15.067900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed2aed-c9a3-4e4e-9fb7-75290be977d1 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:15.071073 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 967/1940] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:52:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:15.080467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed2aed-c9a3-4e4e-9fb7-75290be977d1 None None] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:52:15.084141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0bed2aed-c9a3-4e4e-9fb7-75290be977d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:15.278399 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 974/1941] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:15.281302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a07c7-88bd-41c0-9b31-4477f17ebd70 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:15.283706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-457a07c7-88bd-41c0-9b31-4477f17ebd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:15.357014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:15.412389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed2aed-c9a3-4e4e-9fb7-75290be977d1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:15.420624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0bed2aed-c9a3-4e4e-9fb7-75290be977d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:15.479172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a07c7-88bd-41c0-9b31-4477f17ebd70 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:15.485699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710b005-d12c-448c-a770-82188e2a34ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:15.486720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710b005-d12c-448c-a770-82188e2a34ef service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:15.487304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710b005-d12c-448c-a770-82188e2a34ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:15.494891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710b005-d12c-448c-a770-82188e2a34ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:15.511720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710b005-d12c-448c-a770-82188e2a34ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:15.513304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710b005-d12c-448c-a770-82188e2a34ef service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:15.530890 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 975/1942] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:15.530890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710b005-d12c-448c-a770-82188e2a34ef service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:15.530890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a710b005-d12c-448c-a770-82188e2a34ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:15.547146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710b005-d12c-448c-a770-82188e2a34ef service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:15.553285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02c557-e146-41a5-b03e-9e44a88477f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:15.554381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02c557-e146-41a5-b03e-9e44a88477f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:15.554671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02c557-e146-41a5-b03e-9e44a88477f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:15.555000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02c557-e146-41a5-b03e-9e44a88477f1 admin admin] PATH_INFO: `/v3/users/877f49ad60e9498ca3ea705d3ade4ed1` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:15.556248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02c557-e146-41a5-b03e-9e44a88477f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=877f49ad60e9498ca3ea705d3ade4ed1)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:15.558202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02c557-e146-41a5-b03e-9e44a88477f1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:15.654279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed2aed-c9a3-4e4e-9fb7-75290be977d1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:15.662653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b5ce5-5201-4b98-9089-bfea9e03fad2 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0801adb49e88401dab7ae2257f702ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41951f1e618345eabb7fdedeacb85865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:15.664716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b5ce5-5201-4b98-9089-bfea9e03fad2 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:15.675210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b5ce5-5201-4b98-9089-bfea9e03fad2 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:15.676110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b5ce5-5201-4b98-9089-bfea9e03fad2 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] PATH_INFO: `/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:15.678401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b5ce5-5201-4b98-9089-bfea9e03fad2 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorizing `identity:get_project(project_id=9293ac6dc21d4d8fb06e0b0e7285956b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:15.681318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b5ce5-5201-4b98-9089-bfea9e03fad2 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:15.684400 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 968/1943] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:52:15 2022] GET /identity/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b => generated 381 bytes in 605 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:52:15.701796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c02c557-e146-41a5-b03e-9e44a88477f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877f49ad60e9498ca3ea705d3ade4ed1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:15.727101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c02c557-e146-41a5-b03e-9e44a88477f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877f49ad60e9498ca3ea705d3ade4ed1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:15.728476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c02c557-e146-41a5-b03e-9e44a88477f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877f49ad60e9498ca3ea705d3ade4ed1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:15.760724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c02c557-e146-41a5-b03e-9e44a88477f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877f49ad60e9498ca3ea705d3ade4ed1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:15.761626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c02c557-e146-41a5-b03e-9e44a88477f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877f49ad60e9498ca3ea705d3ade4ed1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:15.818488 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 976/1944] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:15 2022] DELETE /identity/v3/users/877f49ad60e9498ca3ea705d3ade4ed1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:15.824240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d2ed5-4dd4-4aff-8b4f-4a1f0208b482 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:15.824524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d2ed5-4dd4-4aff-8b4f-4a1f0208b482 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:15.824797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d2ed5-4dd4-4aff-8b4f-4a1f0208b482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:15.876497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-dc6d2ed5-4dd4-4aff-8b4f-4a1f0208b482 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:15.878133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dc6d2ed5-4dd4-4aff-8b4f-4a1f0208b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:15.945233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:16.031009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14fe0a-4799-4bbf-99cf-392c7e5f8174 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:16.031910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14fe0a-4799-4bbf-99cf-392c7e5f8174 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:16.034008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14fe0a-4799-4bbf-99cf-392c7e5f8174 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:16.036735 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 977/1945] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:52:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:52:16.054908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14fe0a-4799-4bbf-99cf-392c7e5f8174 None None] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:52:16.056854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bf14fe0a-4799-4bbf-99cf-392c7e5f8174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:16.064839 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 969/1946] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:16.155116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d2ed5-4dd4-4aff-8b4f-4a1f0208b482 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:16.157202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dc6d2ed5-4dd4-4aff-8b4f-4a1f0208b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:16.279018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d2ed5-4dd4-4aff-8b4f-4a1f0208b482 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:16.293042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e95376-e681-4bd2-bb3d-1f36f3fc577c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:16.293657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e95376-e681-4bd2-bb3d-1f36f3fc577c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:16.293940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e95376-e681-4bd2-bb3d-1f36f3fc577c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:16.294275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e95376-e681-4bd2-bb3d-1f36f3fc577c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:16.309537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14fe0a-4799-4bbf-99cf-392c7e5f8174 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:16.311758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bf14fe0a-4799-4bbf-99cf-392c7e5f8174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:16.314330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e95376-e681-4bd2-bb3d-1f36f3fc577c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:16.316443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e95376-e681-4bd2-bb3d-1f36f3fc577c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:16.335791 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 970/1947] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:52:16.337002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e95376-e681-4bd2-bb3d-1f36f3fc577c service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:16.339303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-69e95376-e681-4bd2-bb3d-1f36f3fc577c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:16.363042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e95376-e681-4bd2-bb3d-1f36f3fc577c service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:16.380798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d64e80-4a09-47db-88cd-94e93c266364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:16.380798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d64e80-4a09-47db-88cd-94e93c266364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:16.380798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d64e80-4a09-47db-88cd-94e93c266364 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:16.380798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d64e80-4a09-47db-88cd-94e93c266364 admin admin] PATH_INFO: `/v3/projects/189b96254be3469db0d0f7eb94908757` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:16.381804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d64e80-4a09-47db-88cd-94e93c266364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=189b96254be3469db0d0f7eb94908757)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:16.384398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d64e80-4a09-47db-88cd-94e93c266364 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:16.472045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:16.549754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47d64e80-4a09-47db-88cd-94e93c266364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189b96254be3469db0d0f7eb94908757', 'request_id': 'req-47d64e80-4a09-47db-88cd-94e93c266364'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.587193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14fe0a-4799-4bbf-99cf-392c7e5f8174 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:16.597771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47d64e80-4a09-47db-88cd-94e93c266364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189b96254be3469db0d0f7eb94908757', 'request_id': 'req-47d64e80-4a09-47db-88cd-94e93c266364'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.619456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47d64e80-4a09-47db-88cd-94e93c266364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189b96254be3469db0d0f7eb94908757', 'request_id': 'req-47d64e80-4a09-47db-88cd-94e93c266364'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.664245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47d64e80-4a09-47db-88cd-94e93c266364 admin admin] The token cache is being invalidate because project 189b96254be3469db0d0f7eb94908757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:16.664837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47d64e80-4a09-47db-88cd-94e93c266364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.669660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47d64e80-4a09-47db-88cd-94e93c266364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:16.673098 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 971/1948] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:16 2022] DELETE /identity/v3/projects/189b96254be3469db0d0f7eb94908757 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:16.677719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5052d-1eea-477f-b7f8-9f903f6ef334 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:16.678059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5052d-1eea-477f-b7f8-9f903f6ef334 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:16.678395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5052d-1eea-477f-b7f8-9f903f6ef334 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:16.679903 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 972/1949] 10.222.0.70 () {54 vars in 921 bytes} [Sun Aug 28 18:52:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:16.687746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5052d-1eea-477f-b7f8-9f903f6ef334 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:16.694562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-81c5052d-1eea-477f-b7f8-9f903f6ef334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:16.884117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa174c3c-7514-4343-b60b-3e725542a049 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0801adb49e88401dab7ae2257f702ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41951f1e618345eabb7fdedeacb85865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:16.884828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa174c3c-7514-4343-b60b-3e725542a049 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:16.885211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa174c3c-7514-4343-b60b-3e725542a049 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:16.885542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa174c3c-7514-4343-b60b-3e725542a049 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] PATH_INFO: `/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:16.888005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa174c3c-7514-4343-b60b-3e725542a049 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorizing `identity:get_project(project_id=9293ac6dc21d4d8fb06e0b0e7285956b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:16.892806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa174c3c-7514-4343-b60b-3e725542a049 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:16.896435 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 978/1950] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:52:16 2022] GET /identity/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b => generated 381 bytes in 842 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:16.927797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:16.963335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5052d-1eea-477f-b7f8-9f903f6ef334 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:16.984390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:16.985116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:16.985515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:16.985803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] PATH_INFO: `/v3/users/668142dbb6514d65ab9cb80a31cdf964` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:16.989615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=668142dbb6514d65ab9cb80a31cdf964)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:16.992083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:17.024012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12603b-d77e-4fe1-bca9-a420c2e65c22 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:17.024525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12603b-d77e-4fe1-bca9-a420c2e65c22 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:17.024940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12603b-d77e-4fe1-bca9-a420c2e65c22 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:17.075348 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 979/1951] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:52:17 2022] GET /identity => generated 270 bytes in 57 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:52:17.082560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9fcfe-b0ca-4a2f-8b03-514f320dcdd3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:17.083640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9fcfe-b0ca-4a2f-8b03-514f320dcdd3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:17.084327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9fcfe-b0ca-4a2f-8b03-514f320dcdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:17.156208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668142dbb6514d65ab9cb80a31cdf964'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.158514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-52d9fcfe-b0ca-4a2f-8b03-514f320dcdd3 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:17.160969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-52d9fcfe-b0ca-4a2f-8b03-514f320dcdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:17.191286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668142dbb6514d65ab9cb80a31cdf964'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.193822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668142dbb6514d65ab9cb80a31cdf964'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.245129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668142dbb6514d65ab9cb80a31cdf964'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.246624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668142dbb6514d65ab9cb80a31cdf964'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.297006 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 973/1952] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:16 2022] DELETE /identity/v3/users/668142dbb6514d65ab9cb80a31cdf964 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:17.298718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:52:17.300868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:17.337861 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 980/1953] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:52:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:17.340794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9fcfe-b0ca-4a2f-8b03-514f320dcdd3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:17.347461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-52d9fcfe-b0ca-4a2f-8b03-514f320dcdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:17.387343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9fcfe-b0ca-4a2f-8b03-514f320dcdd3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:17.598588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:17.600448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:17.600792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:17.601003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] PATH_INFO: `/v3/projects/bcb9b74ef330480c9a391686f48013d6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:17.601879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:17.604322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:17.605625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb9b74ef330480c9a391686f48013d6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:17.613306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:17.651444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:17.785110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038c8f2-fc55-4ba4-a624-8b509c3cfc99 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:17.791803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb9b74ef330480c9a391686f48013d6', 'request_id': 'req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.817950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb9b74ef330480c9a391686f48013d6', 'request_id': 'req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.827417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:17.837309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb9b74ef330480c9a391686f48013d6', 'request_id': 'req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.871483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] The token cache is being invalidate because project bcb9b74ef330480c9a391686f48013d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:17.871896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.874270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:17.879446 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 981/1954] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:17 2022] DELETE /identity/v3/projects/bcb9b74ef330480c9a391686f48013d6 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:17.880526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:17.887144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:17.951385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179d74b-f847-4eab-86cf-10b3060362ce tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0801adb49e88401dab7ae2257f702ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41951f1e618345eabb7fdedeacb85865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:17.952336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179d74b-f847-4eab-86cf-10b3060362ce tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:17.952336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179d74b-f847-4eab-86cf-10b3060362ce tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:17.953391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179d74b-f847-4eab-86cf-10b3060362ce tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] PATH_INFO: `/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:17.955422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179d74b-f847-4eab-86cf-10b3060362ce tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorizing `identity:get_project(project_id=9293ac6dc21d4d8fb06e0b0e7285956b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:17.961208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179d74b-f847-4eab-86cf-10b3060362ce tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:17.967316 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 974/1955] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:52:17 2022] GET /identity/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b => generated 381 bytes in 669 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:17.968120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179d74b-f847-4eab-86cf-10b3060362ce tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:17.973255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7179d74b-f847-4eab-86cf-10b3060362ce tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:18.087007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec2c20-eaaf-4267-8ad5-7b376fc79b9e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:18.101250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7525c4-09be-4937-9aa0-a01704bc1791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:18.102284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7525c4-09be-4937-9aa0-a01704bc1791 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:18.103724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7525c4-09be-4937-9aa0-a01704bc1791 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:18.104307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7525c4-09be-4937-9aa0-a01704bc1791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:18.108560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8a7525c4-09be-4937-9aa0-a01704bc1791 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:18.137314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7525c4-09be-4937-9aa0-a01704bc1791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:18.143087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7525c4-09be-4937-9aa0-a01704bc1791 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:18.165744 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 982/1956] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:18.167470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7525c4-09be-4937-9aa0-a01704bc1791 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:18.168921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179d74b-f847-4eab-86cf-10b3060362ce tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:18.169659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8a7525c4-09be-4937-9aa0-a01704bc1791 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:18.177616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d12b17-9361-409d-bfe5-c38a1043a73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:18.179393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d12b17-9361-409d-bfe5-c38a1043a73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:18.180363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d12b17-9361-409d-bfe5-c38a1043a73e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:18.180936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d12b17-9361-409d-bfe5-c38a1043a73e admin admin] PATH_INFO: `/v3/users/7a62fdf3c6504d75baacefa0cf20013e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:18.183125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d12b17-9361-409d-bfe5-c38a1043a73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a62fdf3c6504d75baacefa0cf20013e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:18.187361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d12b17-9361-409d-bfe5-c38a1043a73e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:18.197195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7525c4-09be-4937-9aa0-a01704bc1791 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:18.206429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:18.207455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:18.207911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:18.208532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3 admin admin] PATH_INFO: `/v3/projects/3f456fbce4b74213887ceeb7086bdd74` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:18.212090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f456fbce4b74213887ceeb7086bdd74)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:18.216837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:18.344221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e1d12b17-9361-409d-bfe5-c38a1043a73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a62fdf3c6504d75baacefa0cf20013e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:18.353882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f456fbce4b74213887ceeb7086bdd74', 'request_id': 'req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:18.377230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f456fbce4b74213887ceeb7086bdd74', 'request_id': 'req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:18.384639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e1d12b17-9361-409d-bfe5-c38a1043a73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a62fdf3c6504d75baacefa0cf20013e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:18.386601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e1d12b17-9361-409d-bfe5-c38a1043a73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a62fdf3c6504d75baacefa0cf20013e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:18.401523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f456fbce4b74213887ceeb7086bdd74', 'request_id': 'req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:18.433930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e1d12b17-9361-409d-bfe5-c38a1043a73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a62fdf3c6504d75baacefa0cf20013e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:18.435158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e1d12b17-9361-409d-bfe5-c38a1043a73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a62fdf3c6504d75baacefa0cf20013e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:18.456969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3 admin admin] The token cache is being invalidate because project 3f456fbce4b74213887ceeb7086bdd74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:18.457491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:18.458475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7e78b5ca-ef79-4ead-84ed-37f9043c3bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:18.461106 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 983/1957] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:18 2022] DELETE /identity/v3/projects/3f456fbce4b74213887ceeb7086bdd74 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:18.468514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076ec63-3530-4da0-931f-afcb9575d1a2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:18.468941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076ec63-3530-4da0-931f-afcb9575d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:18.470898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076ec63-3530-4da0-931f-afcb9575d1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:18.483327 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 975/1958] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:17 2022] DELETE /identity/v3/users/7a62fdf3c6504d75baacefa0cf20013e => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:18.486445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5adc8c-7f00-48f0-b575-1567d9c98091 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:18.487088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5adc8c-7f00-48f0-b575-1567d9c98091 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:18.487501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5adc8c-7f00-48f0-b575-1567d9c98091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:18.525595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8b5adc8c-7f00-48f0-b575-1567d9c98091 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:18.527429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8b5adc8c-7f00-48f0-b575-1567d9c98091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:18.528991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:18.554650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8076ec63-3530-4da0-931f-afcb9575d1a2 None None] MFA Rules not processed for user `bef3c7a64055432b9df3b3dc33b21282`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:18.566871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8076ec63-3530-4da0-931f-afcb9575d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:18.623214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:18.684676 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 976/1959] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:18.695521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6f539-10e7-43e2-be20-b010ba20c95f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:18.695902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6f539-10e7-43e2-be20-b010ba20c95f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:18.696285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6f539-10e7-43e2-be20-b010ba20c95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:18.732365 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 984/1960] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:18.738479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-36b6f539-10e7-43e2-be20-b010ba20c95f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:18.740147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-36b6f539-10e7-43e2-be20-b010ba20c95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:18.758483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076ec63-3530-4da0-931f-afcb9575d1a2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:18.769962 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 977/1961] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:18.776048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076ec63-3530-4da0-931f-afcb9575d1a2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:18.784140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba59a4-a772-4e12-8fd5-f07964b56035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:18.784989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba59a4-a772-4e12-8fd5-f07964b56035 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:18.785390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba59a4-a772-4e12-8fd5-f07964b56035 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:18.785732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba59a4-a772-4e12-8fd5-f07964b56035 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:18.786619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba59a4-a772-4e12-8fd5-f07964b56035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:18.787072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba59a4-a772-4e12-8fd5-f07964b56035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:18.790367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba59a4-a772-4e12-8fd5-f07964b56035 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:18.816683 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 985/1962] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:18.817854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6f539-10e7-43e2-be20-b010ba20c95f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:18.832932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6f539-10e7-43e2-be20-b010ba20c95f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:18.838436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227033a-f184-4103-8ed9-ade71bab9263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:18.840359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227033a-f184-4103-8ed9-ade71bab9263 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:18.840739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227033a-f184-4103-8ed9-ade71bab9263 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:18.841375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227033a-f184-4103-8ed9-ade71bab9263 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:18.842176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227033a-f184-4103-8ed9-ade71bab9263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:18.845558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227033a-f184-4103-8ed9-ade71bab9263 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:18.884727 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 978/1963] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:18 2022] POST /identity/v3/projects => generated 393 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:18.889071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba59a4-a772-4e12-8fd5-f07964b56035 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:18.901870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba59a4-a772-4e12-8fd5-f07964b56035 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:18.988424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd08ddf-f206-4d85-956b-14b6bfe2205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:18.989329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd08ddf-f206-4d85-956b-14b6bfe2205f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:18.989750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd08ddf-f206-4d85-956b-14b6bfe2205f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:18.990451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd08ddf-f206-4d85-956b-14b6bfe2205f admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:18.992012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd08ddf-f206-4d85-956b-14b6bfe2205f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:18.995346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd08ddf-f206-4d85-956b-14b6bfe2205f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:19.028879 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 986/1964] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:18 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:19.030504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227033a-f184-4103-8ed9-ade71bab9263 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:19.042413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227033a-f184-4103-8ed9-ade71bab9263 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:19.065096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8053cc0-c1f5-4893-9e5d-99618574ab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:19.066181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8053cc0-c1f5-4893-9e5d-99618574ab24 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.067753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8053cc0-c1f5-4893-9e5d-99618574ab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.068327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8053cc0-c1f5-4893-9e5d-99618574ab24 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.069265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8053cc0-c1f5-4893-9e5d-99618574ab24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:19.071434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8053cc0-c1f5-4893-9e5d-99618574ab24 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:19.087535 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 979/1965] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:19.091286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd08ddf-f206-4d85-956b-14b6bfe2205f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:19.102192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd08ddf-f206-4d85-956b-14b6bfe2205f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:19.118074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12a5d9-6e77-40b3-8e39-43d9de578b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:19.119688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12a5d9-6e77-40b3-8e39-43d9de578b96 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.120366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12a5d9-6e77-40b3-8e39-43d9de578b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.121120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12a5d9-6e77-40b3-8e39-43d9de578b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.122891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12a5d9-6e77-40b3-8e39-43d9de578b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:19.127514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12a5d9-6e77-40b3-8e39-43d9de578b96 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:19.153130 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 987/1966] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:19.159437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8053cc0-c1f5-4893-9e5d-99618574ab24 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:19.181610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8053cc0-c1f5-4893-9e5d-99618574ab24 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:19.206581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555d17-a252-4823-b99e-f8d4d81b084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:19.206581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555d17-a252-4823-b99e-f8d4d81b084e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.206581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555d17-a252-4823-b99e-f8d4d81b084e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.206581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555d17-a252-4823-b99e-f8d4d81b084e admin admin] PATH_INFO: `/v3/projects/ececfbe655bf449c8109550d351c2aa6/users/88729e1bdd7d4fb0b9dee5054b51487f/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.238096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03555d17-a252-4823-b99e-f8d4d81b084e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ececfbe655bf449c8109550d351c2aa6, user_id=88729e1bdd7d4fb0b9dee5054b51487f, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:19.241038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03555d17-a252-4823-b99e-f8d4d81b084e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:19.281414 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 980/1967] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:19 2022] PUT /identity/v3/projects/ececfbe655bf449c8109550d351c2aa6/users/88729e1bdd7d4fb0b9dee5054b51487f/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:19.284410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb379d6-278f-463a-b12a-84a7c0748e05 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.284717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb379d6-278f-463a-b12a-84a7c0748e05 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.285024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb379d6-278f-463a-b12a-84a7c0748e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.328758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7eb379d6-278f-463a-b12a-84a7c0748e05 None None] MFA Rules not processed for user `88729e1bdd7d4fb0b9dee5054b51487f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:19.330038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7eb379d6-278f-463a-b12a-84a7c0748e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:19.420712 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 988/1968] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:19.425616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555d17-a252-4823-b99e-f8d4d81b084e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:19.560849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555d17-a252-4823-b99e-f8d4d81b084e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:19.569829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0504bf1-9195-41bb-8ca7-06e05bf4e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:19.571536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0504bf1-9195-41bb-8ca7-06e05bf4e148 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.573211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0504bf1-9195-41bb-8ca7-06e05bf4e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.573834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0504bf1-9195-41bb-8ca7-06e05bf4e148 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.575157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0504bf1-9195-41bb-8ca7-06e05bf4e148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:19.578079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0504bf1-9195-41bb-8ca7-06e05bf4e148 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:19.618701 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 981/1969] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:19 2022] POST /identity/v3/projects => generated 393 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:19.623060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb379d6-278f-463a-b12a-84a7c0748e05 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:19.647373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb379d6-278f-463a-b12a-84a7c0748e05 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:19.651919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:19.697228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2062a-9c56-4e5c-837e-2d32c906722a None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.698050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2062a-9c56-4e5c-837e-2d32c906722a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.698050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2062a-9c56-4e5c-837e-2d32c906722a None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.699236 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 982/1970] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:19.705017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2062a-9c56-4e5c-837e-2d32c906722a None None] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:52:19.707861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eda2062a-9c56-4e5c-837e-2d32c906722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:19.747228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3e466-1574-4ff6-84a4-82cede6876c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:19.748352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3e466-1574-4ff6-84a4-82cede6876c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.749878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3e466-1574-4ff6-84a4-82cede6876c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.751027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3e466-1574-4ff6-84a4-82cede6876c9 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.751897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3e466-1574-4ff6-84a4-82cede6876c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:19.754448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3e466-1574-4ff6-84a4-82cede6876c9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:19.786493 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 989/1971] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:19 2022] POST /identity/v3/users => generated 303 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:19.792909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3e466-1574-4ff6-84a4-82cede6876c9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:19.797095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:19.808988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3e466-1574-4ff6-84a4-82cede6876c9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:19.817768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f225ef4-fdc5-4f46-85cf-b710f67451ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:19.818680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225ef4-fdc5-4f46-85cf-b710f67451ad admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.819140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225ef4-fdc5-4f46-85cf-b710f67451ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.819583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225ef4-fdc5-4f46-85cf-b710f67451ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.822875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2062a-9c56-4e5c-837e-2d32c906722a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:19.824055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f225ef4-fdc5-4f46-85cf-b710f67451ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:19.825130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eda2062a-9c56-4e5c-837e-2d32c906722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:19.828460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f225ef4-fdc5-4f46-85cf-b710f67451ad admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:19.845608 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 990/1972] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:19.847240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cb663-3fe7-4401-a8e7-d3cd5cdfa65b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.847531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cb663-3fe7-4401-a8e7-d3cd5cdfa65b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.847812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cb663-3fe7-4401-a8e7-d3cd5cdfa65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.896381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-313cb663-3fe7-4401-a8e7-d3cd5cdfa65b None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:19.898490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-313cb663-3fe7-4401-a8e7-d3cd5cdfa65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:19.956545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2062a-9c56-4e5c-837e-2d32c906722a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:19.962543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421967-070f-4cfd-94c5-53d5edfa030d tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0801adb49e88401dab7ae2257f702ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41951f1e618345eabb7fdedeacb85865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:19.963885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421967-070f-4cfd-94c5-53d5edfa030d tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:19.964213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421967-070f-4cfd-94c5-53d5edfa030d tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:19.964730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421967-070f-4cfd-94c5-53d5edfa030d tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] PATH_INFO: `/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:19.966309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d421967-070f-4cfd-94c5-53d5edfa030d tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorizing `identity:get_project(project_id=9293ac6dc21d4d8fb06e0b0e7285956b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:19.969606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d421967-070f-4cfd-94c5-53d5edfa030d tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:19.974990 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 983/1973] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:52:19 2022] GET /identity/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b => generated 381 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:19.976430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421967-070f-4cfd-94c5-53d5edfa030d tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:20.010986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421967-070f-4cfd-94c5-53d5edfa030d tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:20.025164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7469bb-0651-4e73-98da-fc05820e0086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:20.026319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7469bb-0651-4e73-98da-fc05820e0086 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.026619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7469bb-0651-4e73-98da-fc05820e0086 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.026959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7469bb-0651-4e73-98da-fc05820e0086 admin admin] PATH_INFO: `/v3/projects/ccaaa443f3aa485ca267a6da070710f8/users/4307456cfca34e7f810c69578e4a3edf/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.030352 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 991/1974] 10.222.0.85 () {58 vars in 1015 bytes} [Sun Aug 28 18:52:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:20.032906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cb663-3fe7-4401-a8e7-d3cd5cdfa65b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:20.035954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-313cb663-3fe7-4401-a8e7-d3cd5cdfa65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:20.083128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7469bb-0651-4e73-98da-fc05820e0086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccaaa443f3aa485ca267a6da070710f8, user_id=4307456cfca34e7f810c69578e4a3edf, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:20.104027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cb663-3fe7-4401-a8e7-d3cd5cdfa65b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:20.104546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7469bb-0651-4e73-98da-fc05820e0086 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:20.117350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:20.119154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.119566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.120823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] PATH_INFO: `/v3/projects/7049ca5a08ac40e082af0e6f0b54568b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.125545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7049ca5a08ac40e082af0e6f0b54568b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:20.136983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:20.151090 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 984/1975] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:19 2022] PUT /identity/v3/projects/ccaaa443f3aa485ca267a6da070710f8/users/4307456cfca34e7f810c69578e4a3edf/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:20.152722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7469bb-0651-4e73-98da-fc05820e0086 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:20.158646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ac7469bb-0651-4e73-98da-fc05820e0086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:20.264118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7049ca5a08ac40e082af0e6f0b54568b', 'request_id': 'req-85e1733d-f992-44e0-8346-03a1b4202833'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:20.280278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7049ca5a08ac40e082af0e6f0b54568b', 'request_id': 'req-85e1733d-f992-44e0-8346-03a1b4202833'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:20.287532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7469bb-0651-4e73-98da-fc05820e0086 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:20.291238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7049ca5a08ac40e082af0e6f0b54568b', 'request_id': 'req-85e1733d-f992-44e0-8346-03a1b4202833'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:20.321919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] The token cache is being invalidate because project 7049ca5a08ac40e082af0e6f0b54568b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:20.322314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:20.324625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:20.339047 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 992/1976] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:20 2022] DELETE /identity/v3/projects/7049ca5a08ac40e082af0e6f0b54568b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:20.344637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:20.348890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:20.399712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:20.412064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d3fc-7501-495b-adc1-e7e6d067e19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:20.412710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d3fc-7501-495b-adc1-e7e6d067e19f service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.413084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d3fc-7501-495b-adc1-e7e6d067e19f service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.413622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d3fc-7501-495b-adc1-e7e6d067e19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.418427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dd62d3fc-7501-495b-adc1-e7e6d067e19f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:20.440160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62d3fc-7501-495b-adc1-e7e6d067e19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:20.441633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62d3fc-7501-495b-adc1-e7e6d067e19f service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:20.460177 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 985/1977] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:20.462481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c337-7087-469d-8388-9170ef840c98 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.464043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c337-7087-469d-8388-9170ef840c98 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.464326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c337-7087-469d-8388-9170ef840c98 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.465695 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 986/1978] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:52:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:20.466858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28261091-f0bf-4fcb-9569-9d6cf6bf8364 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.468304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28261091-f0bf-4fcb-9569-9d6cf6bf8364 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.469469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28261091-f0bf-4fcb-9569-9d6cf6bf8364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.506731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1733d-f992-44e0-8346-03a1b4202833 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:20.516441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-28261091-f0bf-4fcb-9569-9d6cf6bf8364 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:20.517610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28261091-f0bf-4fcb-9569-9d6cf6bf8364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:20.519179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e7c16-9e14-4480-bf8a-7664ce04a464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:20.519979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e7c16-9e14-4480-bf8a-7664ce04a464 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.520408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e7c16-9e14-4480-bf8a-7664ce04a464 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.520855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e7c16-9e14-4480-bf8a-7664ce04a464 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.521995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e7c16-9e14-4480-bf8a-7664ce04a464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:20.523747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e7c16-9e14-4480-bf8a-7664ce04a464 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:20.546946 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 987/1979] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:20.548452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28261091-f0bf-4fcb-9569-9d6cf6bf8364 None None] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:52:20.552410 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 993/1980] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:20.555663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28261091-f0bf-4fcb-9569-9d6cf6bf8364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:20.556853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649b62a-cd11-467a-a617-aa14c539fc2e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.557143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649b62a-cd11-467a-a617-aa14c539fc2e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.557422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649b62a-cd11-467a-a617-aa14c539fc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.616672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e649b62a-cd11-467a-a617-aa14c539fc2e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:20.618091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e649b62a-cd11-467a-a617-aa14c539fc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:20.633732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:20.642536 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 994/1981] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:20.643649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649b62a-cd11-467a-a617-aa14c539fc2e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:20.682548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649b62a-cd11-467a-a617-aa14c539fc2e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:20.697636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e052d5-fc75-4991-861b-8eaa50d4672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:20.698499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e052d5-fc75-4991-861b-8eaa50d4672a admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.698811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e052d5-fc75-4991-861b-8eaa50d4672a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.699094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e052d5-fc75-4991-861b-8eaa50d4672a admin admin] PATH_INFO: `/v3/projects/ccaaa443f3aa485ca267a6da070710f8/users/4307456cfca34e7f810c69578e4a3edf/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.703835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e052d5-fc75-4991-861b-8eaa50d4672a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccaaa443f3aa485ca267a6da070710f8, user_id=4307456cfca34e7f810c69578e4a3edf, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:20.710987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e052d5-fc75-4991-861b-8eaa50d4672a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:20.723875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28261091-f0bf-4fcb-9569-9d6cf6bf8364 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:20.731617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28261091-f0bf-4fcb-9569-9d6cf6bf8364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:20.766326 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 995/1982] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:20 2022] PUT /identity/v3/projects/ccaaa443f3aa485ca267a6da070710f8/users/4307456cfca34e7f810c69578e4a3edf/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:20.767539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e052d5-fc75-4991-861b-8eaa50d4672a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:20.884721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e052d5-fc75-4991-861b-8eaa50d4672a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:20.891277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58689a-fa41-413f-9547-24cc18d2dc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:20.892014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28261091-f0bf-4fcb-9569-9d6cf6bf8364 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:20.892455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58689a-fa41-413f-9547-24cc18d2dc40 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.892543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58689a-fa41-413f-9547-24cc18d2dc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.894229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58689a-fa41-413f-9547-24cc18d2dc40 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.894999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58689a-fa41-413f-9547-24cc18d2dc40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:20.895310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58689a-fa41-413f-9547-24cc18d2dc40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:20.896949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58689a-fa41-413f-9547-24cc18d2dc40 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:20.930762 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 996/1983] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:20.932287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7ace5-ade4-4568-99d6-52d3cd8430c8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.932580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7ace5-ade4-4568-99d6-52d3cd8430c8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.932969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7ace5-ade4-4568-99d6-52d3cd8430c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.979954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36888258-8d2e-4e72-bdee-e5fca7b28b98 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0801adb49e88401dab7ae2257f702ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41951f1e618345eabb7fdedeacb85865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:20.980626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36888258-8d2e-4e72-bdee-e5fca7b28b98 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:20.980913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36888258-8d2e-4e72-bdee-e5fca7b28b98 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:20.981190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36888258-8d2e-4e72-bdee-e5fca7b28b98 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] PATH_INFO: `/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:20.982355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36888258-8d2e-4e72-bdee-e5fca7b28b98 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorizing `identity:get_project(project_id=9293ac6dc21d4d8fb06e0b0e7285956b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:20.986315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36888258-8d2e-4e72-bdee-e5fca7b28b98 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:20.988553 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 988/1984] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:52:20 2022] GET /identity/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b => generated 381 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:20.989589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36888258-8d2e-4e72-bdee-e5fca7b28b98 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:21.014815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36888258-8d2e-4e72-bdee-e5fca7b28b98 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:21.023384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-53a7ace5-ade4-4568-99d6-52d3cd8430c8 None None] MFA Rules not processed for user `4307456cfca34e7f810c69578e4a3edf`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:21.026167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f6e00-24d7-4610-998c-557623ace604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:21.026447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-53a7ace5-ade4-4568-99d6-52d3cd8430c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:21.027914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f6e00-24d7-4610-998c-557623ace604 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:21.028351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f6e00-24d7-4610-998c-557623ace604 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:21.028821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f6e00-24d7-4610-998c-557623ace604 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:21.030372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f6e00-24d7-4610-998c-557623ace604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:21.034412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f6e00-24d7-4610-998c-557623ace604 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:21.112191 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 989/1985] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:20 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:21.116906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f6e00-24d7-4610-998c-557623ace604 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:21.189453 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 997/1986] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:20 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:21.289022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:21.331061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f6e00-24d7-4610-998c-557623ace604 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:21.346570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a84ac6-a37f-4249-be27-2cc60a980725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:21.347273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a84ac6-a37f-4249-be27-2cc60a980725 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:21.347557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a84ac6-a37f-4249-be27-2cc60a980725 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:21.347835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a84ac6-a37f-4249-be27-2cc60a980725 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:21.349318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a84ac6-a37f-4249-be27-2cc60a980725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:21.350443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a84ac6-a37f-4249-be27-2cc60a980725 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:21.387419 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 990/1987] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:21 2022] POST /identity/v3/users => generated 302 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:52:21.389367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7ace5-ade4-4568-99d6-52d3cd8430c8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:21.405363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7ace5-ade4-4568-99d6-52d3cd8430c8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:21.427091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4c8eb-611e-48c1-8b6a-e9fa9f6a0484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:21.428511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4c8eb-611e-48c1-8b6a-e9fa9f6a0484 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:21.428797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4c8eb-611e-48c1-8b6a-e9fa9f6a0484 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:21.429077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4c8eb-611e-48c1-8b6a-e9fa9f6a0484 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:21.430774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4c8eb-611e-48c1-8b6a-e9fa9f6a0484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:21.432881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4c8eb-611e-48c1-8b6a-e9fa9f6a0484 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:21.456529 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 998/1988] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:21.456868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a84ac6-a37f-4249-be27-2cc60a980725 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:21.462932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ca425-2fca-4676-80b7-936c11816b43 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:21.463665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ca425-2fca-4676-80b7-936c11816b43 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:21.464092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ca425-2fca-4676-80b7-936c11816b43 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:21.466578 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 999/1989] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:52:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:21.471899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a84ac6-a37f-4249-be27-2cc60a980725 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:21.474275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ca425-2fca-4676-80b7-936c11816b43 None None] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:52:21.480394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:21.486160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab3bbb-3b9c-4d23-8fab-f91686d52433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:21.486815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3bbb-3b9c-4d23-8fab-f91686d52433 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:21.487105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3bbb-3b9c-4d23-8fab-f91686d52433 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:21.487388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3bbb-3b9c-4d23-8fab-f91686d52433 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:21.488222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab3bbb-3b9c-4d23-8fab-f91686d52433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:21.490004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab3bbb-3b9c-4d23-8fab-f91686d52433 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:21.524188 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 991/1990] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:21.552746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab3bbb-3b9c-4d23-8fab-f91686d52433 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:21.576513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab3bbb-3b9c-4d23-8fab-f91686d52433 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:21.586733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde683ab-3dee-479d-922e-86330301d4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:21.587915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde683ab-3dee-479d-922e-86330301d4de admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:21.588344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde683ab-3dee-479d-922e-86330301d4de admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:21.588723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde683ab-3dee-479d-922e-86330301d4de admin admin] PATH_INFO: `/v3/projects/87c71023c65d4647873583ffed33f227/users/2237a6a81df946efba3d930cda39e2fc/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:21.618978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde683ab-3dee-479d-922e-86330301d4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c71023c65d4647873583ffed33f227, user_id=2237a6a81df946efba3d930cda39e2fc, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:21.623195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde683ab-3dee-479d-922e-86330301d4de admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:21.681851 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 992/1991] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:21 2022] PUT /identity/v3/projects/87c71023c65d4647873583ffed33f227/users/2237a6a81df946efba3d930cda39e2fc/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:21.693106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ed88-f548-403b-bcdd-7ca69bc19c34 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:21.693400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ed88-f548-403b-bcdd-7ca69bc19c34 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:21.693677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ed88-f548-403b-bcdd-7ca69bc19c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:21.715517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ca425-2fca-4676-80b7-936c11816b43 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:21.750709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-81f2ed88-f548-403b-bcdd-7ca69bc19c34 None None] MFA Rules not processed for user `2237a6a81df946efba3d930cda39e2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:21.754256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-81f2ed88-f548-403b-bcdd-7ca69bc19c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:21.855740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ca425-2fca-4676-80b7-936c11816b43 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:21.933527 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 993/1992] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:21 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:21.938024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2ed88-f548-403b-bcdd-7ca69bc19c34 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:21.941660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-81f2ed88-f548-403b-bcdd-7ca69bc19c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:22.029431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dde910-10d4-461c-94ec-c6ccbdeae230 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0801adb49e88401dab7ae2257f702ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41951f1e618345eabb7fdedeacb85865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:22.030138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dde910-10d4-461c-94ec-c6ccbdeae230 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:22.030725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dde910-10d4-461c-94ec-c6ccbdeae230 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:22.031648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dde910-10d4-461c-94ec-c6ccbdeae230 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] PATH_INFO: `/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:22.033033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dde910-10d4-461c-94ec-c6ccbdeae230 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorizing `identity:get_project(project_id=9293ac6dc21d4d8fb06e0b0e7285956b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:22.035482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dde910-10d4-461c-94ec-c6ccbdeae230 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:22.043080 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1000/1993] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:52:21 2022] GET /identity/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b => generated 381 bytes in 569 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:22.043950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dde910-10d4-461c-94ec-c6ccbdeae230 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:22.118486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2ed88-f548-403b-bcdd-7ca69bc19c34 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:22.128289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1eaf30-7f72-4f1c-9651-18698b67279d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:22.128983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1eaf30-7f72-4f1c-9651-18698b67279d service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:22.129278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1eaf30-7f72-4f1c-9651-18698b67279d service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:22.129605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1eaf30-7f72-4f1c-9651-18698b67279d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:22.195117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:22.205084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:22.239080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dde910-10d4-461c-94ec-c6ccbdeae230 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:22.249016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad356e37-1b7e-4059-9f76-3c664f26ab3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:22.250870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad356e37-1b7e-4059-9f76-3c664f26ab3c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:22.251585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad356e37-1b7e-4059-9f76-3c664f26ab3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:22.251585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad356e37-1b7e-4059-9f76-3c664f26ab3c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:22.252323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad356e37-1b7e-4059-9f76-3c664f26ab3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:22.254337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad356e37-1b7e-4059-9f76-3c664f26ab3c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:22.289660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1eaf30-7f72-4f1c-9651-18698b67279d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:22.291752 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1001/1994] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:22 2022] POST /identity/v3/projects => generated 401 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:22.295331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1eaf30-7f72-4f1c-9651-18698b67279d service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:22.298251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1778c-9545-4ab6-8f08-9660d6360f1b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:22.298835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1778c-9545-4ab6-8f08-9660d6360f1b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:22.299397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1778c-9545-4ab6-8f08-9660d6360f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:22.327877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b1a1778c-9545-4ab6-8f08-9660d6360f1b None None] MFA Rules not processed for user `bef3c7a64055432b9df3b3dc33b21282`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:22.329522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b1a1778c-9545-4ab6-8f08-9660d6360f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:22.330035 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 994/1995] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:22.333028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1eaf30-7f72-4f1c-9651-18698b67279d service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:22.356823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1eaf30-7f72-4f1c-9651-18698b67279d service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:22.445572 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1002/1996] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:22.446593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1778c-9545-4ab6-8f08-9660d6360f1b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:22.541500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcaedd-4c6a-4583-9509-d5e16476efe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:22.543424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcaedd-4c6a-4583-9509-d5e16476efe9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:22.543677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcaedd-4c6a-4583-9509-d5e16476efe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:22.544332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcaedd-4c6a-4583-9509-d5e16476efe9 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:22.546806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcaedd-4c6a-4583-9509-d5e16476efe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:22.552533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcaedd-4c6a-4583-9509-d5e16476efe9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:22.599959 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 995/1997] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:22 2022] POST /identity/v3/users => generated 307 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:22.609441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcaedd-4c6a-4583-9509-d5e16476efe9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:22.630638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1778c-9545-4ab6-8f08-9660d6360f1b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:22.643738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcaedd-4c6a-4583-9509-d5e16476efe9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:22.650535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d95cf-418c-4b82-a282-1f823be1003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:22.652675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d95cf-418c-4b82-a282-1f823be1003b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:22.653089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d95cf-418c-4b82-a282-1f823be1003b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:22.653717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d95cf-418c-4b82-a282-1f823be1003b admin admin] PATH_INFO: `/v3/users/88729e1bdd7d4fb0b9dee5054b51487f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:22.655081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d95cf-418c-4b82-a282-1f823be1003b admin admin] RBAC: Authorizing `identity:delete_user(user_id=88729e1bdd7d4fb0b9dee5054b51487f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:22.658566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d95cf-418c-4b82-a282-1f823be1003b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:22.662538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b54fa-4292-4832-a965-92bc06a7871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:22.664084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b54fa-4292-4832-a965-92bc06a7871b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:22.664604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b54fa-4292-4832-a965-92bc06a7871b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:22.665111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b54fa-4292-4832-a965-92bc06a7871b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:22.666397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b54fa-4292-4832-a965-92bc06a7871b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:22.693029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b54fa-4292-4832-a965-92bc06a7871b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:22.744446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6d1d95cf-418c-4b82-a282-1f823be1003b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88729e1bdd7d4fb0b9dee5054b51487f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:22.767702 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 996/1998] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:22.768333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b54fa-4292-4832-a965-92bc06a7871b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:22.771738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6d1d95cf-418c-4b82-a282-1f823be1003b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88729e1bdd7d4fb0b9dee5054b51487f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:22.773615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6d1d95cf-418c-4b82-a282-1f823be1003b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88729e1bdd7d4fb0b9dee5054b51487f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:22.791851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6d1d95cf-418c-4b82-a282-1f823be1003b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88729e1bdd7d4fb0b9dee5054b51487f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:22.795528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b54fa-4292-4832-a965-92bc06a7871b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:22.798508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6d1d95cf-418c-4b82-a282-1f823be1003b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88729e1bdd7d4fb0b9dee5054b51487f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:22.804202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc7b3-09a5-4cf6-84f5-2c43698d0e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:22.805126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc7b3-09a5-4cf6-84f5-2c43698d0e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:22.805518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc7b3-09a5-4cf6-84f5-2c43698d0e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:22.805898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc7b3-09a5-4cf6-84f5-2c43698d0e37 admin admin] PATH_INFO: `/v3/projects/b1b363f8ae7644e7a8e4af875f20a954/users/7ed0fb2ab0e74e83b6daeb176724c3f9/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:22.824260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:22.833459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cc7b3-09a5-4cf6-84f5-2c43698d0e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b363f8ae7644e7a8e4af875f20a954, user_id=7ed0fb2ab0e74e83b6daeb176724c3f9, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:22.837413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cc7b3-09a5-4cf6-84f5-2c43698d0e37 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:22.841961 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1003/1999] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:22 2022] DELETE /identity/v3/users/88729e1bdd7d4fb0b9dee5054b51487f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:22.847571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfec13f-4dcc-4e0f-9aec-984621638746 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:22.847571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfec13f-4dcc-4e0f-9aec-984621638746 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:22.847844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfec13f-4dcc-4e0f-9aec-984621638746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:22.862143 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 997/2000] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:22 2022] PUT /identity/v3/projects/b1b363f8ae7644e7a8e4af875f20a954/users/7ed0fb2ab0e74e83b6daeb176724c3f9/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:22.865711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc7b3-09a5-4cf6-84f5-2c43698d0e37 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:22.867749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b02cc7b3-09a5-4cf6-84f5-2c43698d0e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:22.887728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4cfec13f-4dcc-4e0f-9aec-984621638746 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:22.888978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4cfec13f-4dcc-4e0f-9aec-984621638746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:23.010395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc7b3-09a5-4cf6-84f5-2c43698d0e37 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:23.025403 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1004/2001] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:52:23.029789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688ac09-aba0-4deb-a6a4-cadb4a187049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:23.030957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688ac09-aba0-4deb-a6a4-cadb4a187049 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:23.031449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688ac09-aba0-4deb-a6a4-cadb4a187049 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:23.031925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688ac09-aba0-4deb-a6a4-cadb4a187049 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:23.032996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688ac09-aba0-4deb-a6a4-cadb4a187049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:23.035318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688ac09-aba0-4deb-a6a4-cadb4a187049 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:23.057134 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 998/2002] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:23.061127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfec13f-4dcc-4e0f-9aec-984621638746 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:23.067613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688ac09-aba0-4deb-a6a4-cadb4a187049 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:23.071797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d688ac09-aba0-4deb-a6a4-cadb4a187049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:23.074216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfec13f-4dcc-4e0f-9aec-984621638746 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:23.085042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140c16e-d1f5-45be-8452-b6e37c09e760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:23.085724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140c16e-d1f5-45be-8452-b6e37c09e760 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:23.086009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140c16e-d1f5-45be-8452-b6e37c09e760 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:23.086285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140c16e-d1f5-45be-8452-b6e37c09e760 admin admin] PATH_INFO: `/v3/projects/b1b363f8ae7644e7a8e4af875f20a954/users/7ed0fb2ab0e74e83b6daeb176724c3f9/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:23.089285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140c16e-d1f5-45be-8452-b6e37c09e760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b363f8ae7644e7a8e4af875f20a954, user_id=7ed0fb2ab0e74e83b6daeb176724c3f9, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:23.091991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140c16e-d1f5-45be-8452-b6e37c09e760 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:23.107877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:23.113237 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1005/2003] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:23 2022] PUT /identity/v3/projects/b1b363f8ae7644e7a8e4af875f20a954/users/7ed0fb2ab0e74e83b6daeb176724c3f9/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:23.136842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5391eb5-9efa-457a-855a-84832cb9e619 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:23.139338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5391eb5-9efa-457a-855a-84832cb9e619 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:23.140107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5391eb5-9efa-457a-855a-84832cb9e619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:23.224462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a5391eb5-9efa-457a-855a-84832cb9e619 None None] MFA Rules not processed for user `7ed0fb2ab0e74e83b6daeb176724c3f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:23.225713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a5391eb5-9efa-457a-855a-84832cb9e619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:23.236811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688ac09-aba0-4deb-a6a4-cadb4a187049 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:23.346610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bb0e9-1cad-4334-8fde-40ea5933f37b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:23.347389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bb0e9-1cad-4334-8fde-40ea5933f37b service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:23.347730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bb0e9-1cad-4334-8fde-40ea5933f37b service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:23.348074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bb0e9-1cad-4334-8fde-40ea5933f37b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:23.365717 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1006/2004] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:23 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:23.367978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b597-07be-4d58-8ab6-d6e5c7b2d15f None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:23.368401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b597-07be-4d58-8ab6-d6e5c7b2d15f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:23.368925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b597-07be-4d58-8ab6-d6e5c7b2d15f None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:23.371533 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1007/2005] 10.222.0.70 () {54 vars in 921 bytes} [Sun Aug 28 18:52:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:23.416987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8f673-305c-4dae-97c2-b6a5ea826263 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:23.417408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8f673-305c-4dae-97c2-b6a5ea826263 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:23.418416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8f673-305c-4dae-97c2-b6a5ea826263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:23.442430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bb0e9-1cad-4334-8fde-40ea5933f37b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:23.445030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bb0e9-1cad-4334-8fde-40ea5933f37b service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:23.470152 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 999/2006] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:23.474647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7fd8f673-305c-4dae-97c2-b6a5ea826263 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:23.476422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7fd8f673-305c-4dae-97c2-b6a5ea826263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:23.543522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a1224-f608-4d06-8d64-7b7ec20f5814 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:23.543825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a1224-f608-4d06-8d64-7b7ec20f5814 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:23.544193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a1224-f608-4d06-8d64-7b7ec20f5814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:23.605591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-279a1224-f608-4d06-8d64-7b7ec20f5814 None None] MFA Rules not processed for user `766695d4b7c647b6af015b749a881821`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:23.607032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-279a1224-f608-4d06-8d64-7b7ec20f5814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:23.667380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:23.694889 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1008/2007] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:52:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:23.732693 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1000/2008] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:23 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:52:23.866900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8f673-305c-4dae-97c2-b6a5ea826263 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:23.868418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7fd8f673-305c-4dae-97c2-b6a5ea826263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:23.880087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a1224-f608-4d06-8d64-7b7ec20f5814 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:23.881795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-279a1224-f608-4d06-8d64-7b7ec20f5814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:23.891158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8f673-305c-4dae-97c2-b6a5ea826263 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:23.895127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:23.901883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a1224-f608-4d06-8d64-7b7ec20f5814 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:23.908673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f92de-a2c0-4230-a692-6b643f3a80de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:23.909317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f92de-a2c0-4230-a692-6b643f3a80de service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:23.909632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f92de-a2c0-4230-a692-6b643f3a80de service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:23.910002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f92de-a2c0-4230-a692-6b643f3a80de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:23.911612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fc0b7-d46c-4aca-8f37-3dfc66a222ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:23.912072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc0b7-d46c-4aca-8f37-3dfc66a222ad service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:23.912742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc0b7-d46c-4aca-8f37-3dfc66a222ad service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:23.913146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc0b7-d46c-4aca-8f37-3dfc66a222ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:23.928719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fc0b7-d46c-4aca-8f37-3dfc66a222ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:23.929634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f92de-a2c0-4230-a692-6b643f3a80de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:23.930816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fc0b7-d46c-4aca-8f37-3dfc66a222ad service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:23.931272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f92de-a2c0-4230-a692-6b643f3a80de service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:23.946803 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1001/2009] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:52:23.962789 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1009/2010] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:23 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:24.151326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9d1b8-285b-4ffd-8cc5-91af1fc710d3 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:24.152379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9d1b8-285b-4ffd-8cc5-91af1fc710d3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:24.152910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9d1b8-285b-4ffd-8cc5-91af1fc710d3 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:24.156262 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1002/2011] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:52:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:24.162477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f92de-a2c0-4230-a692-6b643f3a80de service nova] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:52:24.178401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f92de-a2c0-4230-a692-6b643f3a80de service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:24.187895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4c3f92de-a2c0-4230-a692-6b643f3a80de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:24.309142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f92de-a2c0-4230-a692-6b643f3a80de service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:24.316083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76358e-c73e-4f1f-b246-5f379866d724 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0801adb49e88401dab7ae2257f702ed7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41951f1e618345eabb7fdedeacb85865', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:24.316999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76358e-c73e-4f1f-b246-5f379866d724 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:24.316999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76358e-c73e-4f1f-b246-5f379866d724 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:24.317295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76358e-c73e-4f1f-b246-5f379866d724 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] PATH_INFO: `/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:24.319061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76358e-c73e-4f1f-b246-5f379866d724 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorizing `identity:get_project(project_id=9293ac6dc21d4d8fb06e0b0e7285956b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:24.324898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76358e-c73e-4f1f-b246-5f379866d724 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:24.333991 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1010/2012] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:52:24 2022] GET /identity/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b => generated 381 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:24.743148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9d1b8-285b-4ffd-8cc5-91af1fc710d3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:24.763650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9d1b8-285b-4ffd-8cc5-91af1fc710d3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:24.776733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813075-f058-4e70-823e-714defe9bfc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:24.778712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813075-f058-4e70-823e-714defe9bfc0 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:24.780504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813075-f058-4e70-823e-714defe9bfc0 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:24.781251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813075-f058-4e70-823e-714defe9bfc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:24.785837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-95813075-f058-4e70-823e-714defe9bfc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:24.832952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76358e-c73e-4f1f-b246-5f379866d724 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:24.834822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4b76358e-c73e-4f1f-b246-5f379866d724 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:24.857420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76358e-c73e-4f1f-b246-5f379866d724 tempest-QuotasAdminNegativeTest-126456868 tempest-QuotasAdminNegativeTest-126456868-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:24.883211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:24.886425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:24.887200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:24.887200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] PATH_INFO: `/v3/projects/ececfbe655bf449c8109550d351c2aa6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:24.889519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ececfbe655bf449c8109550d351c2aa6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:24.904421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:24.915522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95813075-f058-4e70-823e-714defe9bfc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:24.917318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95813075-f058-4e70-823e-714defe9bfc0 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:24.948526 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1003/2013] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:24 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:25.008938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813075-f058-4e70-823e-714defe9bfc0 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:25.010387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-95813075-f058-4e70-823e-714defe9bfc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:25.017927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ececfbe655bf449c8109550d351c2aa6', 'request_id': 'req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.036528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ececfbe655bf449c8109550d351c2aa6', 'request_id': 'req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.038849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813075-f058-4e70-823e-714defe9bfc0 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:25.047317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ececfbe655bf449c8109550d351c2aa6', 'request_id': 'req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.073012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] The token cache is being invalidate because project ececfbe655bf449c8109550d351c2aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:25.073511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.074675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.080715 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1011/2014] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:24 2022] DELETE /identity/v3/projects/ececfbe655bf449c8109550d351c2aa6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:25.084512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:25.087038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:25.162118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ab61a-9aeb-4075-add6-9cdff2abe789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:25.162814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ab61a-9aeb-4075-add6-9cdff2abe789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:25.163102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ab61a-9aeb-4075-add6-9cdff2abe789 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:25.163629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ab61a-9aeb-4075-add6-9cdff2abe789 admin admin] PATH_INFO: `/v3/users/bef3c7a64055432b9df3b3dc33b21282` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:25.164871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ab61a-9aeb-4075-add6-9cdff2abe789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef3c7a64055432b9df3b3dc33b21282)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:25.167035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ab61a-9aeb-4075-add6-9cdff2abe789 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:25.240110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-229ab61a-9aeb-4075-add6-9cdff2abe789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef3c7a64055432b9df3b3dc33b21282'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.263874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe57da-103c-4d14-9f49-2e465c6bf2d6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:25.279493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-229ab61a-9aeb-4075-add6-9cdff2abe789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef3c7a64055432b9df3b3dc33b21282'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.281302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-229ab61a-9aeb-4075-add6-9cdff2abe789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef3c7a64055432b9df3b3dc33b21282'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.281511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:25.285918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:25.285918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:25.285918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] PATH_INFO: `/v3/users/4307456cfca34e7f810c69578e4a3edf` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:25.285918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4307456cfca34e7f810c69578e4a3edf)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:25.291684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:25.323043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:25.330995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-229ab61a-9aeb-4075-add6-9cdff2abe789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef3c7a64055432b9df3b3dc33b21282'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.334537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-229ab61a-9aeb-4075-add6-9cdff2abe789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef3c7a64055432b9df3b3dc33b21282'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.360445 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1004/2015] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:25 2022] DELETE /identity/v3/users/bef3c7a64055432b9df3b3dc33b21282 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:25.368615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf71915-7afd-46ee-a37d-474348d5b44a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:25.370047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf71915-7afd-46ee-a37d-474348d5b44a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:25.370416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf71915-7afd-46ee-a37d-474348d5b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:25.385087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4307456cfca34e7f810c69578e4a3edf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.397624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4307456cfca34e7f810c69578e4a3edf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.398398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4307456cfca34e7f810c69578e4a3edf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.410785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4307456cfca34e7f810c69578e4a3edf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.411664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4307456cfca34e7f810c69578e4a3edf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:25.422128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1cf71915-7afd-46ee-a37d-474348d5b44a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:25.423578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1cf71915-7afd-46ee-a37d-474348d5b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:25.433334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:25.461041 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1012/2016] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:25 2022] DELETE /identity/v3/users/4307456cfca34e7f810c69578e4a3edf => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:25.620311 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1005/2017] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:25.668249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:25.673880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:25.846168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db470d-b7f9-4e00-b36c-9d1cfaf402cd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:25.851177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb81ef6-447b-4f52-b312-a1f258afdc8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:25.851865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81ef6-447b-4f52-b312-a1f258afdc8b service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:25.852154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81ef6-447b-4f52-b312-a1f258afdc8b service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:25.852429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81ef6-447b-4f52-b312-a1f258afdc8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:25.958470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb81ef6-447b-4f52-b312-a1f258afdc8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:25.960144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb81ef6-447b-4f52-b312-a1f258afdc8b service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:25.981046 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1013/2018] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:26.259846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf71915-7afd-46ee-a37d-474348d5b44a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:26.275388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1cf71915-7afd-46ee-a37d-474348d5b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:26.290363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf71915-7afd-46ee-a37d-474348d5b44a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:26.295480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:26.296331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:26.296609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:26.296890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] PATH_INFO: `/v3/users/2237a6a81df946efba3d930cda39e2fc` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:26.298079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2237a6a81df946efba3d930cda39e2fc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:26.300124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:26.414977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2237a6a81df946efba3d930cda39e2fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:26.437656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2237a6a81df946efba3d930cda39e2fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:26.440109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2237a6a81df946efba3d930cda39e2fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:26.468279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2237a6a81df946efba3d930cda39e2fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:26.471278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2237a6a81df946efba3d930cda39e2fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:26.491609 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1006/2019] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:26 2022] DELETE /identity/v3/users/2237a6a81df946efba3d930cda39e2fc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:26.493473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfbd5c-2d04-4128-80c6-15c6e3b7d7e4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:26.493769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfbd5c-2d04-4128-80c6-15c6e3b7d7e4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:26.494050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfbd5c-2d04-4128-80c6-15c6e3b7d7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:26.544217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:26.545756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:26.555004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c2dfbd5c-2d04-4128-80c6-15c6e3b7d7e4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:26.557320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c2dfbd5c-2d04-4128-80c6-15c6e3b7d7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:26.664111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:26.750824 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1014/2020] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:26.797925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ada04-c040-4b79-9456-13ef36832d39 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:26.807474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f6840-50c2-43a5-add9-494b9c782ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:26.808766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6840-50c2-43a5-add9-494b9c782ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:26.809804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6840-50c2-43a5-add9-494b9c782ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:26.810382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6840-50c2-43a5-add9-494b9c782ff9 admin admin] PATH_INFO: `/v3/projects/ccaaa443f3aa485ca267a6da070710f8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:26.813620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f6840-50c2-43a5-add9-494b9c782ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccaaa443f3aa485ca267a6da070710f8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:26.818164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f6840-50c2-43a5-add9-494b9c782ff9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:26.872974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:26.882778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfbd5c-2d04-4128-80c6-15c6e3b7d7e4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:26.885356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c2dfbd5c-2d04-4128-80c6-15c6e3b7d7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:26.970871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cb5f6840-50c2-43a5-add9-494b9c782ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccaaa443f3aa485ca267a6da070710f8', 'request_id': 'req-cb5f6840-50c2-43a5-add9-494b9c782ff9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:27.000817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cb5f6840-50c2-43a5-add9-494b9c782ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccaaa443f3aa485ca267a6da070710f8', 'request_id': 'req-cb5f6840-50c2-43a5-add9-494b9c782ff9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:27.023138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cb5f6840-50c2-43a5-add9-494b9c782ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccaaa443f3aa485ca267a6da070710f8', 'request_id': 'req-cb5f6840-50c2-43a5-add9-494b9c782ff9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:27.081461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cb5f6840-50c2-43a5-add9-494b9c782ff9 admin admin] The token cache is being invalidate because project ccaaa443f3aa485ca267a6da070710f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:27.083999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cb5f6840-50c2-43a5-add9-494b9c782ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:27.086887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cb5f6840-50c2-43a5-add9-494b9c782ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:27.099540 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1007/2021] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:26 2022] DELETE /identity/v3/projects/ccaaa443f3aa485ca267a6da070710f8 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:27.101932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adede0d-5aa1-41f5-b717-893e3e490ff1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:27.102386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adede0d-5aa1-41f5-b717-893e3e490ff1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:27.102856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adede0d-5aa1-41f5-b717-893e3e490ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:27.152794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfbd5c-2d04-4128-80c6-15c6e3b7d7e4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:27.184360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8adede0d-5aa1-41f5-b717-893e3e490ff1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:27.186347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8adede0d-5aa1-41f5-b717-893e3e490ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:27.281291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bee21-0eb0-46d7-b476-cbaf71cb8b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:27.282187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bee21-0eb0-46d7-b476-cbaf71cb8b41 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:27.282914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bee21-0eb0-46d7-b476-cbaf71cb8b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:27.283488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bee21-0eb0-46d7-b476-cbaf71cb8b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:27.289809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-643bee21-0eb0-46d7-b476-cbaf71cb8b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:27.432411 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1008/2022] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:27.442896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffee8b4-fcdc-418c-866a-b8e0e0fa5870 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:27.442896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffee8b4-fcdc-418c-866a-b8e0e0fa5870 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:27.443271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffee8b4-fcdc-418c-866a-b8e0e0fa5870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:27.483191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0ffee8b4-fcdc-418c-866a-b8e0e0fa5870 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:27.485266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0ffee8b4-fcdc-418c-866a-b8e0e0fa5870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:27.488107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bee21-0eb0-46d7-b476-cbaf71cb8b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:27.489949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bee21-0eb0-46d7-b476-cbaf71cb8b41 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:27.507618 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1015/2023] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:27.507836 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1009/2024] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:52:27.512039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bee21-0eb0-46d7-b476-cbaf71cb8b41 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:27.523584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bee21-0eb0-46d7-b476-cbaf71cb8b41 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:27.529338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bca7d7-f931-43a9-95d5-3957fac544a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:27.531290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bca7d7-f931-43a9-95d5-3957fac544a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:27.531878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bca7d7-f931-43a9-95d5-3957fac544a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:27.532556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bca7d7-f931-43a9-95d5-3957fac544a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:27.533434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bca7d7-f931-43a9-95d5-3957fac544a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:27.533972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bca7d7-f931-43a9-95d5-3957fac544a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:27.536829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bca7d7-f931-43a9-95d5-3957fac544a8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:27.563931 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1016/2025] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:27.565110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffee8b4-fcdc-418c-866a-b8e0e0fa5870 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:27.580024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffee8b4-fcdc-418c-866a-b8e0e0fa5870 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:27.608899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984ee35-3608-47c1-aeee-0c2450b8c091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:27.609567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984ee35-3608-47c1-aeee-0c2450b8c091 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:27.609852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984ee35-3608-47c1-aeee-0c2450b8c091 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:27.610123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984ee35-3608-47c1-aeee-0c2450b8c091 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:27.616093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984ee35-3608-47c1-aeee-0c2450b8c091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:27.625379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984ee35-3608-47c1-aeee-0c2450b8c091 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:27.741415 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1010/2026] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:27 2022] POST /identity/v3/projects => generated 409 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:27.743346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bca7d7-f931-43a9-95d5-3957fac544a8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:27.766333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bca7d7-f931-43a9-95d5-3957fac544a8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:27.857869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:27.909159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633764d4-d46e-4074-8a7d-cb3730ecfc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:27.909934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633764d4-d46e-4074-8a7d-cb3730ecfc1c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:27.910341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633764d4-d46e-4074-8a7d-cb3730ecfc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:27.910858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633764d4-d46e-4074-8a7d-cb3730ecfc1c admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:27.912335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633764d4-d46e-4074-8a7d-cb3730ecfc1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:27.914810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633764d4-d46e-4074-8a7d-cb3730ecfc1c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:27.968738 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1017/2027] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:27 2022] POST /identity/v3/users => generated 305 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:27.969618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984ee35-3608-47c1-aeee-0c2450b8c091 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:27.991914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984ee35-3608-47c1-aeee-0c2450b8c091 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:28.006822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584fd76-96ec-47ae-a6fc-89495b1d5cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:28.008667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584fd76-96ec-47ae-a6fc-89495b1d5cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:28.010080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584fd76-96ec-47ae-a6fc-89495b1d5cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:28.010570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584fd76-96ec-47ae-a6fc-89495b1d5cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:28.013004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584fd76-96ec-47ae-a6fc-89495b1d5cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:28.018832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584fd76-96ec-47ae-a6fc-89495b1d5cb4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:28.056942 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1011/2028] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:28.057547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633764d4-d46e-4074-8a7d-cb3730ecfc1c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:28.081985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633764d4-d46e-4074-8a7d-cb3730ecfc1c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:28.095129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328e7e4-b360-409c-9234-7002844173e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:28.097799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328e7e4-b360-409c-9234-7002844173e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:28.098996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328e7e4-b360-409c-9234-7002844173e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:28.100280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328e7e4-b360-409c-9234-7002844173e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:28.101101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328e7e4-b360-409c-9234-7002844173e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:28.103397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328e7e4-b360-409c-9234-7002844173e3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:28.148403 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1018/2029] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:28.150230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584fd76-96ec-47ae-a6fc-89495b1d5cb4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:28.167430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328e7e4-b360-409c-9234-7002844173e3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:28.170695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9328e7e4-b360-409c-9234-7002844173e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:28.184347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584fd76-96ec-47ae-a6fc-89495b1d5cb4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:28.199423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14431528-792d-4771-8641-e74621252648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:28.200167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14431528-792d-4771-8641-e74621252648 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:28.200516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14431528-792d-4771-8641-e74621252648 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:28.201038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14431528-792d-4771-8641-e74621252648 admin admin] PATH_INFO: `/v3/projects/54f1d497acb640dd9152914e3ef3f3cf/users/6affa4c1f5ec447d9e0f2695ac006d27/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:28.209164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328e7e4-b360-409c-9234-7002844173e3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:28.225368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:28.229379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:28.230124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:28.231136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] PATH_INFO: `/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:28.233322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9293ac6dc21d4d8fb06e0b0e7285956b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:28.235581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14431528-792d-4771-8641-e74621252648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f1d497acb640dd9152914e3ef3f3cf, user_id=6affa4c1f5ec447d9e0f2695ac006d27, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:28.238592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14431528-792d-4771-8641-e74621252648 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:28.240690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:28.283858 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1012/2030] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:28 2022] PUT /identity/v3/projects/54f1d497acb640dd9152914e3ef3f3cf/users/6affa4c1f5ec447d9e0f2695ac006d27/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:28.295446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84e4f2-e657-4c3c-a310-cf52ebc760bd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:28.296660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84e4f2-e657-4c3c-a310-cf52ebc760bd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:28.296913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84e4f2-e657-4c3c-a310-cf52ebc760bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:28.372073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1e84e4f2-e657-4c3c-a310-cf52ebc760bd None None] MFA Rules not processed for user `6affa4c1f5ec447d9e0f2695ac006d27`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:28.373452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1e84e4f2-e657-4c3c-a310-cf52ebc760bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:28.395464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9293ac6dc21d4d8fb06e0b0e7285956b', 'request_id': 'req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:28.419524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9293ac6dc21d4d8fb06e0b0e7285956b', 'request_id': 'req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:28.442084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9293ac6dc21d4d8fb06e0b0e7285956b', 'request_id': 'req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:28.471447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] The token cache is being invalidate because project 9293ac6dc21d4d8fb06e0b0e7285956b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:28.472059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:28.474606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:28.478543 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1019/2031] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:28 2022] DELETE /identity/v3/projects/9293ac6dc21d4d8fb06e0b0e7285956b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:28.482603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:28.487512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:28.504917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:28.584168 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1013/2032] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:28 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:28.592877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84e4f2-e657-4c3c-a310-cf52ebc760bd None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:28.596559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1e84e4f2-e657-4c3c-a310-cf52ebc760bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:28.635327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05cb9b-8c54-43f0-be41-6b84b6472dd1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:28.652681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:28.654019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:28.654325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:28.654895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] PATH_INFO: `/v3/users/0801adb49e88401dab7ae2257f702ed7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:28.658109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0801adb49e88401dab7ae2257f702ed7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:28.664604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:28.769497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:28.785948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84e4f2-e657-4c3c-a310-cf52ebc760bd None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:28.805236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0801adb49e88401dab7ae2257f702ed7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:28.808006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7340b58-e968-4081-9f65-c3f7b4777737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:28.808647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7340b58-e968-4081-9f65-c3f7b4777737 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:28.808945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7340b58-e968-4081-9f65-c3f7b4777737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:28.809227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7340b58-e968-4081-9f65-c3f7b4777737 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:28.809880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7340b58-e968-4081-9f65-c3f7b4777737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:28.812495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7340b58-e968-4081-9f65-c3f7b4777737 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:28.817110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0801adb49e88401dab7ae2257f702ed7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:28.818457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0801adb49e88401dab7ae2257f702ed7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:28.831303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0801adb49e88401dab7ae2257f702ed7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:28.834492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0801adb49e88401dab7ae2257f702ed7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:28.864107 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1020/2033] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:28 2022] DELETE /identity/v3/users/0801adb49e88401dab7ae2257f702ed7 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:28.869489 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1014/2034] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:28 2022] POST /identity/v3/projects => generated 411 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:28.870557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:28.872439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:29.017150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976da3f9-9947-40d1-a955-edd07ac98d44 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:29.140199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffca0b8-24b9-4c92-b3a4-c21086ef31c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:29.140843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffca0b8-24b9-4c92-b3a4-c21086ef31c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:29.141127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffca0b8-24b9-4c92-b3a4-c21086ef31c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:29.141398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffca0b8-24b9-4c92-b3a4-c21086ef31c5 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:29.142045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffca0b8-24b9-4c92-b3a4-c21086ef31c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:29.156043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffca0b8-24b9-4c92-b3a4-c21086ef31c5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:29.211407 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1021/2035] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:28 2022] POST /identity/v3/users => generated 312 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:29.219605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7340b58-e968-4081-9f65-c3f7b4777737 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:29.277687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7340b58-e968-4081-9f65-c3f7b4777737 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:29.299682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92545ca6-f047-44dc-89da-afea38e298c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:29.302460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92545ca6-f047-44dc-89da-afea38e298c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:29.304235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92545ca6-f047-44dc-89da-afea38e298c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:29.305917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92545ca6-f047-44dc-89da-afea38e298c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:29.308232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92545ca6-f047-44dc-89da-afea38e298c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:29.313718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92545ca6-f047-44dc-89da-afea38e298c1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:29.319902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffca0b8-24b9-4c92-b3a4-c21086ef31c5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:29.328856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8ffca0b8-24b9-4c92-b3a4-c21086ef31c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:29.357352 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1015/2036] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:29.360075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92545ca6-f047-44dc-89da-afea38e298c1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:29.374870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffca0b8-24b9-4c92-b3a4-c21086ef31c5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:29.394165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92545ca6-f047-44dc-89da-afea38e298c1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:29.405151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:29.406471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:29.407176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:29.407295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] PATH_INFO: `/v3/projects/87c71023c65d4647873583ffed33f227` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:29.410366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c71023c65d4647873583ffed33f227)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:29.412634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:29.415702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb529cf-59de-4a2e-a0fa-b2390810f6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:29.418446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb529cf-59de-4a2e-a0fa-b2390810f6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:29.419956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb529cf-59de-4a2e-a0fa-b2390810f6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:29.420260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb529cf-59de-4a2e-a0fa-b2390810f6dc admin admin] PATH_INFO: `/v3/projects/6a14fad0236c4eabbea2d074b3c15f5b/users/4bbce206109b4a8aa7978cf5edec02db/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:29.509383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb529cf-59de-4a2e-a0fa-b2390810f6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a14fad0236c4eabbea2d074b3c15f5b, user_id=4bbce206109b4a8aa7978cf5edec02db, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:29.514193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb529cf-59de-4a2e-a0fa-b2390810f6dc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:29.591505 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1016/2037] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:29 2022] PUT /identity/v3/projects/6a14fad0236c4eabbea2d074b3c15f5b/users/4bbce206109b4a8aa7978cf5edec02db/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:29.596748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb529cf-59de-4a2e-a0fa-b2390810f6dc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:29.629306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:29.640869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c71023c65d4647873583ffed33f227', 'request_id': 'req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:29.666139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c71023c65d4647873583ffed33f227', 'request_id': 'req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:29.690881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c71023c65d4647873583ffed33f227', 'request_id': 'req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:29.729587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] The token cache is being invalidate because project 87c71023c65d4647873583ffed33f227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:29.729894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:29.731120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:29.737207 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1022/2038] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:29 2022] DELETE /identity/v3/projects/87c71023c65d4647873583ffed33f227 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:29.738836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:29.741820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:29.819784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb529cf-59de-4a2e-a0fa-b2390810f6dc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:29.876557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a113cf5-a61f-4c72-bc5c-80dd89f92de1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:29.883009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:29.883929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:29.884348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:29.884779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] PATH_INFO: `/v3/users/7ed0fb2ab0e74e83b6daeb176724c3f9` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:29.886506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed0fb2ab0e74e83b6daeb176724c3f9)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:29.889034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:29.903107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:30.010073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed0fb2ab0e74e83b6daeb176724c3f9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.013037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6332e-9003-4a2d-af95-04d826daa515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:30.013838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6332e-9003-4a2d-af95-04d826daa515 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:30.016151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6332e-9003-4a2d-af95-04d826daa515 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:30.016496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6332e-9003-4a2d-af95-04d826daa515 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:30.018609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6332e-9003-4a2d-af95-04d826daa515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:30.021764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6332e-9003-4a2d-af95-04d826daa515 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:30.024206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed0fb2ab0e74e83b6daeb176724c3f9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.025870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed0fb2ab0e74e83b6daeb176724c3f9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.046465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed0fb2ab0e74e83b6daeb176724c3f9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.047399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed0fb2ab0e74e83b6daeb176724c3f9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.048282 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1017/2039] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:30.052365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6332e-9003-4a2d-af95-04d826daa515 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:30.054869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b0d6332e-9003-4a2d-af95-04d826daa515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:30.080463 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1023/2040] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:29 2022] DELETE /identity/v3/users/7ed0fb2ab0e74e83b6daeb176724c3f9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:30.081873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6332e-9003-4a2d-af95-04d826daa515 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:30.223560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:30.225858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:30.293676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174cbe3-1de9-4f15-b22e-654e78aa53af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:30.294478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174cbe3-1de9-4f15-b22e-654e78aa53af admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:30.294770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174cbe3-1de9-4f15-b22e-654e78aa53af admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:30.297002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174cbe3-1de9-4f15-b22e-654e78aa53af admin admin] PATH_INFO: `/v3/projects/6a14fad0236c4eabbea2d074b3c15f5b/users/4bbce206109b4a8aa7978cf5edec02db/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:30.302416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174cbe3-1de9-4f15-b22e-654e78aa53af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a14fad0236c4eabbea2d074b3c15f5b, user_id=4bbce206109b4a8aa7978cf5edec02db, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:30.307193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174cbe3-1de9-4f15-b22e-654e78aa53af admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:30.353274 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1018/2041] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:30 2022] PUT /identity/v3/projects/6a14fad0236c4eabbea2d074b3c15f5b/users/4bbce206109b4a8aa7978cf5edec02db/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:30.367290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3886127-e146-4dc5-a2b9-42eddcf9dbdd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:30.367653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3886127-e146-4dc5-a2b9-42eddcf9dbdd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:30.368003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3886127-e146-4dc5-a2b9-42eddcf9dbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:30.418364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:30.454499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc404ad-ec2d-49d7-907e-c9f03bef4e48 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:30.461904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d3886127-e146-4dc5-a2b9-42eddcf9dbdd None None] MFA Rules not processed for user `4bbce206109b4a8aa7978cf5edec02db`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:30.465920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d3886127-e146-4dc5-a2b9-42eddcf9dbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:30.650365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd021f27-1c12-438e-be4a-2617261e0be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:30.651210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd021f27-1c12-438e-be4a-2617261e0be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:30.651499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd021f27-1c12-438e-be4a-2617261e0be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:30.651780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd021f27-1c12-438e-be4a-2617261e0be3 admin admin] PATH_INFO: `/v3/projects/41951f1e618345eabb7fdedeacb85865` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:30.655776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd021f27-1c12-438e-be4a-2617261e0be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41951f1e618345eabb7fdedeacb85865)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:30.657734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd021f27-1c12-438e-be4a-2617261e0be3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:30.712608 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1019/2042] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:30 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:52:30.729141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3886127-e146-4dc5-a2b9-42eddcf9dbdd None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:30.731101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d3886127-e146-4dc5-a2b9-42eddcf9dbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:30.774855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd021f27-1c12-438e-be4a-2617261e0be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41951f1e618345eabb7fdedeacb85865', 'request_id': 'req-dd021f27-1c12-438e-be4a-2617261e0be3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.790880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd021f27-1c12-438e-be4a-2617261e0be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41951f1e618345eabb7fdedeacb85865', 'request_id': 'req-dd021f27-1c12-438e-be4a-2617261e0be3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.806070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd021f27-1c12-438e-be4a-2617261e0be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41951f1e618345eabb7fdedeacb85865', 'request_id': 'req-dd021f27-1c12-438e-be4a-2617261e0be3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.832639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd021f27-1c12-438e-be4a-2617261e0be3 admin admin] The token cache is being invalidate because project 41951f1e618345eabb7fdedeacb85865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:30.832943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd021f27-1c12-438e-be4a-2617261e0be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.833638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd021f27-1c12-438e-be4a-2617261e0be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:30.839616 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1024/2043] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:30 2022] DELETE /identity/v3/projects/41951f1e618345eabb7fdedeacb85865 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:30.841232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3291a-aa13-4086-967a-8cacf1be4dd6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:30.841510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3291a-aa13-4086-967a-8cacf1be4dd6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:30.841790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3291a-aa13-4086-967a-8cacf1be4dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:30.888392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-70a3291a-aa13-4086-967a-8cacf1be4dd6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:30.890413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-70a3291a-aa13-4086-967a-8cacf1be4dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:30.924667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:31.003406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3886127-e146-4dc5-a2b9-42eddcf9dbdd None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:31.045896 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1025/2044] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:52:31.055237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb87a1-62b8-4780-9830-751ce2350c80 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:31.055545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb87a1-62b8-4780-9830-751ce2350c80 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:31.055811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb87a1-62b8-4780-9830-751ce2350c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:31.109440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cafb87a1-62b8-4780-9830-751ce2350c80 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:31.110878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cafb87a1-62b8-4780-9830-751ce2350c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:31.131507 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1026/2045] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:31.135571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb87a1-62b8-4780-9830-751ce2350c80 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:31.160981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb87a1-62b8-4780-9830-751ce2350c80 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:31.165468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa131314-eba0-4aaa-911e-c0940e5d8052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:31.166077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa131314-eba0-4aaa-911e-c0940e5d8052 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:31.166359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa131314-eba0-4aaa-911e-c0940e5d8052 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:31.166633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa131314-eba0-4aaa-911e-c0940e5d8052 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:31.167367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa131314-eba0-4aaa-911e-c0940e5d8052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:31.167721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa131314-eba0-4aaa-911e-c0940e5d8052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:31.171910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa131314-eba0-4aaa-911e-c0940e5d8052 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:31.175101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac524f1-4bb3-4f2f-b093-b5ad4e1519fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:31.176061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac524f1-4bb3-4f2f-b093-b5ad4e1519fd service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:31.176549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac524f1-4bb3-4f2f-b093-b5ad4e1519fd service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:31.177142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac524f1-4bb3-4f2f-b093-b5ad4e1519fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:31.179209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2ac524f1-4bb3-4f2f-b093-b5ad4e1519fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:31.202998 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1027/2046] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:52:31.206246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa131314-eba0-4aaa-911e-c0940e5d8052 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:31.221480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa131314-eba0-4aaa-911e-c0940e5d8052 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:31.237376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b67fab-3d8a-458e-ab35-d9372715edca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:31.238055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b67fab-3d8a-458e-ab35-d9372715edca admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:31.238265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b67fab-3d8a-458e-ab35-d9372715edca admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:31.238553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b67fab-3d8a-458e-ab35-d9372715edca admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:31.239274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b67fab-3d8a-458e-ab35-d9372715edca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:31.241339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b67fab-3d8a-458e-ab35-d9372715edca admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:31.258464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:31.310149 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1028/2047] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:31 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:52:31.310601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b67fab-3d8a-458e-ab35-d9372715edca admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:31.314557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-42b67fab-3d8a-458e-ab35-d9372715edca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:31.362321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac524f1-4bb3-4f2f-b093-b5ad4e1519fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:31.364187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac524f1-4bb3-4f2f-b093-b5ad4e1519fd service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:31.398863 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1020/2048] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:30 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:52:31.401185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac524f1-4bb3-4f2f-b093-b5ad4e1519fd service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:31.449179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac524f1-4bb3-4f2f-b093-b5ad4e1519fd service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:31.466241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b67fab-3d8a-458e-ab35-d9372715edca admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:31.469067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d93d92-1cd3-4b4b-a2af-bc6198ac4e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:31.469918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d93d92-1cd3-4b4b-a2af-bc6198ac4e3b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:31.470321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d93d92-1cd3-4b4b-a2af-bc6198ac4e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:31.470709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d93d92-1cd3-4b4b-a2af-bc6198ac4e3b admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:31.472307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d93d92-1cd3-4b4b-a2af-bc6198ac4e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:31.476792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d93d92-1cd3-4b4b-a2af-bc6198ac4e3b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:31.477922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:31.478577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:31.478892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:31.479171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] PATH_INFO: `/v3/projects/b1b363f8ae7644e7a8e4af875f20a954` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:31.484751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1b363f8ae7644e7a8e4af875f20a954)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:31.486695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:31.527734 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1021/2049] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:31 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:31.528899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d93d92-1cd3-4b4b-a2af-bc6198ac4e3b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:31.534833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-60d93d92-1cd3-4b4b-a2af-bc6198ac4e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:31.599697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b363f8ae7644e7a8e4af875f20a954', 'request_id': 'req-83ec4dcc-eae2-4d68-8070-460c67ed1000'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:31.608546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b363f8ae7644e7a8e4af875f20a954', 'request_id': 'req-83ec4dcc-eae2-4d68-8070-460c67ed1000'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:31.618590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b363f8ae7644e7a8e4af875f20a954', 'request_id': 'req-83ec4dcc-eae2-4d68-8070-460c67ed1000'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:31.644166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:31.654585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d93d92-1cd3-4b4b-a2af-bc6198ac4e3b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:31.664514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] The token cache is being invalidate because project b1b363f8ae7644e7a8e4af875f20a954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:31.664824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:31.667930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:31.676261 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1029/2050] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:31 2022] DELETE /identity/v3/projects/b1b363f8ae7644e7a8e4af875f20a954 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:31.677029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:31.684315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:31.837850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec4dcc-eae2-4d68-8070-460c67ed1000 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:31.841371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa81e5a-cc13-4c99-b263-12767ba514a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:31.842149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81e5a-cc13-4c99-b263-12767ba514a3 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:31.842630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81e5a-cc13-4c99-b263-12767ba514a3 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:31.845786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81e5a-cc13-4c99-b263-12767ba514a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:31.845922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe54808-0b1b-46bd-8924-c8d13a231001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:31.846514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe54808-0b1b-46bd-8924-c8d13a231001 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:31.846831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe54808-0b1b-46bd-8924-c8d13a231001 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:31.847109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe54808-0b1b-46bd-8924-c8d13a231001 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:31.847990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe54808-0b1b-46bd-8924-c8d13a231001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:31.849113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3fa81e5a-cc13-4c99-b263-12767ba514a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:31.850042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe54808-0b1b-46bd-8924-c8d13a231001 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:31.863784 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1030/2051] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:31.865082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75d7f-3877-4ccc-bd5b-1d6a5a583c13 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:31.865431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75d7f-3877-4ccc-bd5b-1d6a5a583c13 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:31.865709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75d7f-3877-4ccc-bd5b-1d6a5a583c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:31.914053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a3b75d7f-3877-4ccc-bd5b-1d6a5a583c13 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:31.915852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a3b75d7f-3877-4ccc-bd5b-1d6a5a583c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:31.949179 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1031/2052] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:31.950304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b75d7f-3877-4ccc-bd5b-1d6a5a583c13 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:31.974804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b75d7f-3877-4ccc-bd5b-1d6a5a583c13 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:31.985344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645c98b-c9fb-4b11-8a7a-37a66b61f289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:31.986582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c98b-c9fb-4b11-8a7a-37a66b61f289 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:31.988138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c98b-c9fb-4b11-8a7a-37a66b61f289 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:31.989480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c98b-c9fb-4b11-8a7a-37a66b61f289 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:31.990381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645c98b-c9fb-4b11-8a7a-37a66b61f289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:31.997287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645c98b-c9fb-4b11-8a7a-37a66b61f289 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:31.999737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:32.011943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa81e5a-cc13-4c99-b263-12767ba514a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.019615 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1032/2053] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:32.020023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa81e5a-cc13-4c99-b263-12767ba514a3 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.021523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c47536-4840-4b2f-b5cd-0b1fe8e9ba63 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.021914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c47536-4840-4b2f-b5cd-0b1fe8e9ba63 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.022290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c47536-4840-4b2f-b5cd-0b1fe8e9ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.044156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-37c47536-4840-4b2f-b5cd-0b1fe8e9ba63 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:32.045397 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1022/2054] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:31 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:32.047051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-37c47536-4840-4b2f-b5cd-0b1fe8e9ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:32.049393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa81e5a-cc13-4c99-b263-12767ba514a3 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.065146 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1033/2055] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:32.066209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c47536-4840-4b2f-b5cd-0b1fe8e9ba63 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.072829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa81e5a-cc13-4c99-b263-12767ba514a3 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.080113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c47536-4840-4b2f-b5cd-0b1fe8e9ba63 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.085345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949337b-0187-402b-9dea-eca8676d9b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.086069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949337b-0187-402b-9dea-eca8676d9b45 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.086495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949337b-0187-402b-9dea-eca8676d9b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.087052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949337b-0187-402b-9dea-eca8676d9b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.087193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6d1e7-6486-4f24-a2c7-06419ca7f725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.087865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d1e7-6486-4f24-a2c7-06419ca7f725 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.088149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d1e7-6486-4f24-a2c7-06419ca7f725 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.088300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949337b-0187-402b-9dea-eca8676d9b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:32.088477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6d1e7-6486-4f24-a2c7-06419ca7f725 admin admin] PATH_INFO: `/v3/projects/ee8d80d31e72456b9c75b93b14b69077/users/17f0024362414fb29af577c3d6019347/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.088735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949337b-0187-402b-9dea-eca8676d9b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.090430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949337b-0187-402b-9dea-eca8676d9b45 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.111010 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1034/2056] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:32.115893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949337b-0187-402b-9dea-eca8676d9b45 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.133066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949337b-0187-402b-9dea-eca8676d9b45 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.133554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6d1e7-6486-4f24-a2c7-06419ca7f725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8d80d31e72456b9c75b93b14b69077, user_id=17f0024362414fb29af577c3d6019347, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.138907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6d1e7-6486-4f24-a2c7-06419ca7f725 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.139143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22a903-f45e-416d-9221-04885edaf773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.140432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22a903-f45e-416d-9221-04885edaf773 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.140816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22a903-f45e-416d-9221-04885edaf773 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.141271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22a903-f45e-416d-9221-04885edaf773 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.142029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22a903-f45e-416d-9221-04885edaf773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.144622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22a903-f45e-416d-9221-04885edaf773 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.183543 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1023/2057] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:32 2022] PUT /identity/v3/projects/ee8d80d31e72456b9c75b93b14b69077/users/17f0024362414fb29af577c3d6019347/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:32.196811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb0f55-32dd-418a-8c2e-bd8d10765cc4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.197100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb0f55-32dd-418a-8c2e-bd8d10765cc4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.197397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb0f55-32dd-418a-8c2e-bd8d10765cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.198834 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1035/2058] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:32 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:32.199888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22a903-f45e-416d-9221-04885edaf773 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.279678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-decb0f55-32dd-418a-8c2e-bd8d10765cc4 None None] MFA Rules not processed for user `17f0024362414fb29af577c3d6019347`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:32.281843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-decb0f55-32dd-418a-8c2e-bd8d10765cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:32.322488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22a903-f45e-416d-9221-04885edaf773 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.332714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5fa44-4417-450a-9903-f71dbb735c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.333454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5fa44-4417-450a-9903-f71dbb735c37 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.333890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5fa44-4417-450a-9903-f71dbb735c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.334239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5fa44-4417-450a-9903-f71dbb735c37 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.335068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5fa44-4417-450a-9903-f71dbb735c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.337075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5fa44-4417-450a-9903-f71dbb735c37 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.366966 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1036/2059] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:32 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:32.368431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5fa44-4417-450a-9903-f71dbb735c37 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.372217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cce5fa44-4417-450a-9903-f71dbb735c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:32.394318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5fa44-4417-450a-9903-f71dbb735c37 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.398067 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1024/2060] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:52:32.404930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a92f77-defb-4196-8703-d52678442087 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.406571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a92f77-defb-4196-8703-d52678442087 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.407771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a92f77-defb-4196-8703-d52678442087 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.411260 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1025/2061] 10.222.0.70 () {54 vars in 921 bytes} [Sun Aug 28 18:52:32 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:32.415333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a92f77-defb-4196-8703-d52678442087 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.418801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.419998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.420292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.420772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] PATH_INFO: `/v3/users/6affa4c1f5ec447d9e0f2695ac006d27` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.427159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=6affa4c1f5ec447d9e0f2695ac006d27)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.429631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.448342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:32.464896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a92f77-defb-4196-8703-d52678442087 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.472530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff09911-0a95-463f-9f3d-24a812806694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.474573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09911-0a95-463f-9f3d-24a812806694 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.475987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09911-0a95-463f-9f3d-24a812806694 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.478624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff09911-0a95-463f-9f3d-24a812806694 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.479400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff09911-0a95-463f-9f3d-24a812806694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.481046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff09911-0a95-463f-9f3d-24a812806694 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.508277 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1026/2062] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:32.514500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff09911-0a95-463f-9f3d-24a812806694 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.528886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff09911-0a95-463f-9f3d-24a812806694 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.536259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d8914-ab0c-426b-8ff7-7b6c5095684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.537086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6affa4c1f5ec447d9e0f2695ac006d27'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:32.537203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d8914-ab0c-426b-8ff7-7b6c5095684d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.537709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d8914-ab0c-426b-8ff7-7b6c5095684d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.537926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d8914-ab0c-426b-8ff7-7b6c5095684d admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.538966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d8914-ab0c-426b-8ff7-7b6c5095684d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.541194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d8914-ab0c-426b-8ff7-7b6c5095684d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.559408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6affa4c1f5ec447d9e0f2695ac006d27'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:32.564049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6affa4c1f5ec447d9e0f2695ac006d27'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:32.583273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6affa4c1f5ec447d9e0f2695ac006d27'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:32.584011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6affa4c1f5ec447d9e0f2695ac006d27'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:32.591328 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1027/2063] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:32 2022] POST /identity/v3/projects => generated 393 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:32.594255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060d4ac-717d-48e0-877b-9d7aa9600637 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.594563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060d4ac-717d-48e0-877b-9d7aa9600637 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.594931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060d4ac-717d-48e0-877b-9d7aa9600637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.619856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0060d4ac-717d-48e0-877b-9d7aa9600637 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:32.620695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0060d4ac-717d-48e0-877b-9d7aa9600637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:32.633231 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1037/2064] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:32 2022] DELETE /identity/v3/users/6affa4c1f5ec447d9e0f2695ac006d27 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:32.633969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.636635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:32.691979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:32.733134 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1028/2065] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:52:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:32.735500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060d4ac-717d-48e0-877b-9d7aa9600637 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.737483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0060d4ac-717d-48e0-877b-9d7aa9600637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:32.820700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108de7a-040c-4851-95fd-4bc52f0105ac admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.828088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7d6cf-4755-4820-a6ff-0c3879259b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.829390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7d6cf-4755-4820-a6ff-0c3879259b3b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.829772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7d6cf-4755-4820-a6ff-0c3879259b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.830178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7d6cf-4755-4820-a6ff-0c3879259b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.830943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7d6cf-4755-4820-a6ff-0c3879259b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.832774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7d6cf-4755-4820-a6ff-0c3879259b3b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.854575 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1038/2066] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:32.855337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d110a6-da3a-4ace-92c4-97fd93002daa None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.855689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d110a6-da3a-4ace-92c4-97fd93002daa None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.856049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d110a6-da3a-4ace-92c4-97fd93002daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.884053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060d4ac-717d-48e0-877b-9d7aa9600637 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.889919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e7776-acf8-4498-b2cb-bb4f7441b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.892228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e7776-acf8-4498-b2cb-bb4f7441b4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.892589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e7776-acf8-4498-b2cb-bb4f7441b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.892937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e7776-acf8-4498-b2cb-bb4f7441b4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:32.893814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e7776-acf8-4498-b2cb-bb4f7441b4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:32.895253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-07d110a6-da3a-4ace-92c4-97fd93002daa None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:32.896150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e7776-acf8-4498-b2cb-bb4f7441b4a1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:32.904095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-07d110a6-da3a-4ace-92c4-97fd93002daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:32.916437 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1039/2067] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:32.917349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d110a6-da3a-4ace-92c4-97fd93002daa None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.918780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-07d110a6-da3a-4ace-92c4-97fd93002daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:32.957271 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1029/2068] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:32 2022] POST /identity/v3/users => generated 303 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:32.957271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e7776-acf8-4498-b2cb-bb4f7441b4a1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:32.978227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e7776-acf8-4498-b2cb-bb4f7441b4a1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:32.985676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24406b4-d60f-455c-a769-8632d10251ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:32.987487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24406b4-d60f-455c-a769-8632d10251ee admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:32.987963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24406b4-d60f-455c-a769-8632d10251ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:32.988465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24406b4-d60f-455c-a769-8632d10251ee admin admin] PATH_INFO: `/v3/projects/d4f39b1ad378464b938e63be69a9c00d/users/dc06cf033926436085c6ebc5a8264433/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.010261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24406b4-d60f-455c-a769-8632d10251ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f39b1ad378464b938e63be69a9c00d, user_id=dc06cf033926436085c6ebc5a8264433, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.020807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24406b4-d60f-455c-a769-8632d10251ee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.033235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d110a6-da3a-4ace-92c4-97fd93002daa None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.054839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1e271-e2f7-4dba-aab6-4471da1005d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.055540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1e271-e2f7-4dba-aab6-4471da1005d5 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.055889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1e271-e2f7-4dba-aab6-4471da1005d5 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.056232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1e271-e2f7-4dba-aab6-4471da1005d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.060344 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1030/2069] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:32 2022] PUT /identity/v3/projects/d4f39b1ad378464b938e63be69a9c00d/users/dc06cf033926436085c6ebc5a8264433/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:33.061066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24406b4-d60f-455c-a769-8632d10251ee admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.066691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e24406b4-d60f-455c-a769-8632d10251ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:33.067459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1e271-e2f7-4dba-aab6-4471da1005d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.069205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1e271-e2f7-4dba-aab6-4471da1005d5 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.091811 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1040/2070] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:33.095327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1e271-e2f7-4dba-aab6-4471da1005d5 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.132769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1e271-e2f7-4dba-aab6-4471da1005d5 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.158945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:33.213389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24406b4-d60f-455c-a769-8632d10251ee admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.243246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e992dbf-a61b-4fa8-851b-355035394e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.244189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e992dbf-a61b-4fa8-851b-355035394e41 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.244689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e992dbf-a61b-4fa8-851b-355035394e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.245078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e992dbf-a61b-4fa8-851b-355035394e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.259479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b80f15-4c36-4345-8bc1-c4aecd6f8f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.260173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80f15-4c36-4345-8bc1-c4aecd6f8f60 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.260446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80f15-4c36-4345-8bc1-c4aecd6f8f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.260733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b80f15-4c36-4345-8bc1-c4aecd6f8f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.261399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b80f15-4c36-4345-8bc1-c4aecd6f8f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.263042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b80f15-4c36-4345-8bc1-c4aecd6f8f60 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.301001 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1041/2071] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:33.302889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156ebb-af15-4fd9-aafc-accccb1ca999 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.303339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156ebb-af15-4fd9-aafc-accccb1ca999 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.303837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef156ebb-af15-4fd9-aafc-accccb1ca999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.381041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ef156ebb-af15-4fd9-aafc-accccb1ca999 None None] MFA Rules not processed for user `dc06cf033926436085c6ebc5a8264433`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:33.382653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ef156ebb-af15-4fd9-aafc-accccb1ca999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:33.384863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e992dbf-a61b-4fa8-851b-355035394e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.388765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e992dbf-a61b-4fa8-851b-355035394e41 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.425236 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1031/2072] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:33.426183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e992dbf-a61b-4fa8-851b-355035394e41 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.444498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:33.453530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e992dbf-a61b-4fa8-851b-355035394e41 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.469616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449f0a5-632c-4563-a42d-57f48242dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.471025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449f0a5-632c-4563-a42d-57f48242dbbb admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.471340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449f0a5-632c-4563-a42d-57f48242dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.471699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449f0a5-632c-4563-a42d-57f48242dbbb admin admin] PATH_INFO: `/v3/projects/cb42a98c296f463693359088bc0d5302/users/4ee00ea8403c4894bbceb4fa7207a21f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.497134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449f0a5-632c-4563-a42d-57f48242dbbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb42a98c296f463693359088bc0d5302, user_id=4ee00ea8403c4894bbceb4fa7207a21f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.501915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449f0a5-632c-4563-a42d-57f48242dbbb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.533627 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1032/2073] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:33 2022] PUT /identity/v3/projects/cb42a98c296f463693359088bc0d5302/users/4ee00ea8403c4894bbceb4fa7207a21f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:33.541080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449f0a5-632c-4563-a42d-57f48242dbbb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.585263 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1042/2074] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:33.589947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef156ebb-af15-4fd9-aafc-accccb1ca999 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.644630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef156ebb-af15-4fd9-aafc-accccb1ca999 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.755462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449f0a5-632c-4563-a42d-57f48242dbbb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.760760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed5fe0-6515-4075-9bbb-eac3c240cfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.761550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed5fe0-6515-4075-9bbb-eac3c240cfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.762079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed5fe0-6515-4075-9bbb-eac3c240cfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.762359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed5fe0-6515-4075-9bbb-eac3c240cfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.763249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed5fe0-6515-4075-9bbb-eac3c240cfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.767148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed5fe0-6515-4075-9bbb-eac3c240cfa4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.793729 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1033/2075] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:33.794788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed5fe0-6515-4075-9bbb-eac3c240cfa4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.794902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503c44a-9a4d-40a4-b493-acca40c404f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.795575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503c44a-9a4d-40a4-b493-acca40c404f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.796944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503c44a-9a4d-40a4-b493-acca40c404f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.797236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503c44a-9a4d-40a4-b493-acca40c404f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.798837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503c44a-9a4d-40a4-b493-acca40c404f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.800801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503c44a-9a4d-40a4-b493-acca40c404f2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.808259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed5fe0-6515-4075-9bbb-eac3c240cfa4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.823356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b83004-4698-4eaa-a233-8a1d59969195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:33.824445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b83004-4698-4eaa-a233-8a1d59969195 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.824838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b83004-4698-4eaa-a233-8a1d59969195 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.825257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b83004-4698-4eaa-a233-8a1d59969195 admin admin] PATH_INFO: `/v3/projects/cb42a98c296f463693359088bc0d5302/users/4ee00ea8403c4894bbceb4fa7207a21f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.828122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b83004-4698-4eaa-a233-8a1d59969195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb42a98c296f463693359088bc0d5302, user_id=4ee00ea8403c4894bbceb4fa7207a21f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:33.832195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b83004-4698-4eaa-a233-8a1d59969195 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:33.847220 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1034/2076] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:33 2022] PUT /identity/v3/projects/cb42a98c296f463693359088bc0d5302/users/4ee00ea8403c4894bbceb4fa7207a21f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:33.860218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736c19c-8c3b-4b4a-a2a1-be72b0b213a8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:33.860308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736c19c-8c3b-4b4a-a2a1-be72b0b213a8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:33.860594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736c19c-8c3b-4b4a-a2a1-be72b0b213a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:33.863884 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1043/2077] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:33 2022] POST /identity/v3/projects => generated 383 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:52:33.864672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503c44a-9a4d-40a4-b493-acca40c404f2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:33.917122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1736c19c-8c3b-4b4a-a2a1-be72b0b213a8 None None] MFA Rules not processed for user `4ee00ea8403c4894bbceb4fa7207a21f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:33.921993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1736c19c-8c3b-4b4a-a2a1-be72b0b213a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:33.988946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503c44a-9a4d-40a4-b493-acca40c404f2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:33.991092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:34.003191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f47e1-61eb-486d-85b0-cbad64919317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.004949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f47e1-61eb-486d-85b0-cbad64919317 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.005582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f47e1-61eb-486d-85b0-cbad64919317 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.006009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f47e1-61eb-486d-85b0-cbad64919317 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.006935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f47e1-61eb-486d-85b0-cbad64919317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.009467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f47e1-61eb-486d-85b0-cbad64919317 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.044223 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1044/2078] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:33 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:34.048999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f47e1-61eb-486d-85b0-cbad64919317 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.074348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f47e1-61eb-486d-85b0-cbad64919317 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.078788 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1035/2079] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:52:34.092843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754821e2-4f2f-4ab5-9598-9af6532854bc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.097917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b2fcf-0cc4-450d-92f1-fae355bda3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.099298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b2fcf-0cc4-450d-92f1-fae355bda3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.099672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b2fcf-0cc4-450d-92f1-fae355bda3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.100071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b2fcf-0cc4-450d-92f1-fae355bda3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.101648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b2fcf-0cc4-450d-92f1-fae355bda3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.104427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b2fcf-0cc4-450d-92f1-fae355bda3d4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.111401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754821e2-4f2f-4ab5-9598-9af6532854bc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.112418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754821e2-4f2f-4ab5-9598-9af6532854bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.120253 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1045/2080] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:34.126984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b2fcf-0cc4-450d-92f1-fae355bda3d4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.154304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b2fcf-0cc4-450d-92f1-fae355bda3d4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.159721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-754821e2-4f2f-4ab5-9598-9af6532854bc None None] MFA Rules not processed for user `17f0024362414fb29af577c3d6019347`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:34.162847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-754821e2-4f2f-4ab5-9598-9af6532854bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:34.172325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2785792-ff87-40b8-a673-c726cb864cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.173068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785792-ff87-40b8-a673-c726cb864cce admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.173352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785792-ff87-40b8-a673-c726cb864cce admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.173629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785792-ff87-40b8-a673-c726cb864cce admin admin] PATH_INFO: `/v3/projects/39a2f22a14754d81975f7c8192891d1d/users/5790c85d15ef4aff96a1457b3c444973/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.220334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2785792-ff87-40b8-a673-c726cb864cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a2f22a14754d81975f7c8192891d1d, user_id=5790c85d15ef4aff96a1457b3c444973, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.223320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2785792-ff87-40b8-a673-c726cb864cce admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.246904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:34.266146 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1046/2081] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:34 2022] PUT /identity/v3/projects/39a2f22a14754d81975f7c8192891d1d/users/5790c85d15ef4aff96a1457b3c444973/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:34.270144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2785792-ff87-40b8-a673-c726cb864cce admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.272524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a2785792-ff87-40b8-a673-c726cb864cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:34.288418 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1036/2082] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:34.288418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754821e2-4f2f-4ab5-9598-9af6532854bc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.312427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754821e2-4f2f-4ab5-9598-9af6532854bc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.402806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d21c1-fb47-4e54-99f0-32b9da7d7a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.404252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d21c1-fb47-4e54-99f0-32b9da7d7a19 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.404539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d21c1-fb47-4e54-99f0-32b9da7d7a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.405133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2785792-ff87-40b8-a673-c726cb864cce admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.406257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d21c1-fb47-4e54-99f0-32b9da7d7a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.408499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d21c1-fb47-4e54-99f0-32b9da7d7a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.412487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d21c1-fb47-4e54-99f0-32b9da7d7a19 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.413632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.414381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.414914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.415263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] PATH_INFO: `/v3/projects/54f1d497acb640dd9152914e3ef3f3cf` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.416908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54f1d497acb640dd9152914e3ef3f3cf)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.419177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.430084 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1037/2083] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:34.435705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d21c1-fb47-4e54-99f0-32b9da7d7a19 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.438230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-301d21c1-fb47-4e54-99f0-32b9da7d7a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:34.500851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54f1d497acb640dd9152914e3ef3f3cf', 'request_id': 'req-7d899979-a53c-4f3f-b920-aa2c182ba768'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:34.521910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54f1d497acb640dd9152914e3ef3f3cf', 'request_id': 'req-7d899979-a53c-4f3f-b920-aa2c182ba768'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:34.537939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54f1d497acb640dd9152914e3ef3f3cf', 'request_id': 'req-7d899979-a53c-4f3f-b920-aa2c182ba768'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:34.569129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] The token cache is being invalidate because project 54f1d497acb640dd9152914e3ef3f3cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:34.569439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:34.570142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:34.575197 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1047/2084] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:34 2022] DELETE /identity/v3/projects/54f1d497acb640dd9152914e3ef3f3cf => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:34.575972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d21c1-fb47-4e54-99f0-32b9da7d7a19 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.576133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.579747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:34.585947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:34.681969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d899979-a53c-4f3f-b920-aa2c182ba768 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.683339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4f7ab-3b4d-4584-8fe3-5a7f5e21bbea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.684135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4f7ab-3b4d-4584-8fe3-5a7f5e21bbea service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.684550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4f7ab-3b4d-4584-8fe3-5a7f5e21bbea service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.684957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4f7ab-3b4d-4584-8fe3-5a7f5e21bbea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.687579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-20e4f7ab-3b4d-4584-8fe3-5a7f5e21bbea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:34.694468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731445a-82b0-40eb-b82c-99f516d75fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.695196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731445a-82b0-40eb-b82c-99f516d75fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.695480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731445a-82b0-40eb-b82c-99f516d75fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.695764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731445a-82b0-40eb-b82c-99f516d75fa7 admin admin] PATH_INFO: `/v3/projects/39a2f22a14754d81975f7c8192891d1d/users/5790c85d15ef4aff96a1457b3c444973/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.698237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731445a-82b0-40eb-b82c-99f516d75fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a2f22a14754d81975f7c8192891d1d, user_id=5790c85d15ef4aff96a1457b3c444973, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.700984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731445a-82b0-40eb-b82c-99f516d75fa7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.715010 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1048/2085] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:34 2022] PUT /identity/v3/projects/39a2f22a14754d81975f7c8192891d1d/users/5790c85d15ef4aff96a1457b3c444973/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:34.715938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731445a-82b0-40eb-b82c-99f516d75fa7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:34.726064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3731445a-82b0-40eb-b82c-99f516d75fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:34.777721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:34.804218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4f7ab-3b4d-4584-8fe3-5a7f5e21bbea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.806210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4f7ab-3b4d-4584-8fe3-5a7f5e21bbea service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:34.818868 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1038/2086] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:34.820505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71061dbf-b23a-4505-9e0a-ea7344d8ab89 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.820898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71061dbf-b23a-4505-9e0a-ea7344d8ab89 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.821276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71061dbf-b23a-4505-9e0a-ea7344d8ab89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.861370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731445a-82b0-40eb-b82c-99f516d75fa7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:34.870073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-71061dbf-b23a-4505-9e0a-ea7344d8ab89 None None] MFA Rules not processed for user `5790c85d15ef4aff96a1457b3c444973`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:34.872632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-71061dbf-b23a-4505-9e0a-ea7344d8ab89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:34.885560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:34.886216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:34.886493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:34.886797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] PATH_INFO: `/v3/users/4bbce206109b4a8aa7978cf5edec02db` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:34.888029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbce206109b4a8aa7978cf5edec02db)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:34.891348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:35.014661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbce206109b4a8aa7978cf5edec02db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:35.030292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbce206109b4a8aa7978cf5edec02db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:35.030540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbce206109b4a8aa7978cf5edec02db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:35.044811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbce206109b4a8aa7978cf5edec02db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:35.046450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbce206109b4a8aa7978cf5edec02db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:35.081919 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1039/2087] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:35.100111 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1049/2088] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:34 2022] DELETE /identity/v3/users/4bbce206109b4a8aa7978cf5edec02db => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:35.352806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71061dbf-b23a-4505-9e0a-ea7344d8ab89 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:35.354881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-71061dbf-b23a-4505-9e0a-ea7344d8ab89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:35.413385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:35.505512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71061dbf-b23a-4505-9e0a-ea7344d8ab89 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:35.682987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85f4ae-589e-4d5e-8dc4-af1535235daf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:35.683628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85f4ae-589e-4d5e-8dc4-af1535235daf service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:35.684001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85f4ae-589e-4d5e-8dc4-af1535235daf service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:35.684283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85f4ae-589e-4d5e-8dc4-af1535235daf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:35.837316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85f4ae-589e-4d5e-8dc4-af1535235daf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:35.839663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85f4ae-589e-4d5e-8dc4-af1535235daf service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:35.851833 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1040/2089] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:52:35.920118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:35.922670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:36.060534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd6925-b0cb-47d6-9087-e36436f1bf87 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:36.071452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:36.075874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:36.077077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:36.077921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] PATH_INFO: `/v3/projects/6a14fad0236c4eabbea2d074b3c15f5b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:36.080453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a14fad0236c4eabbea2d074b3c15f5b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:36.082683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:36.188138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:36.205742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a14fad0236c4eabbea2d074b3c15f5b', 'request_id': 'req-6835e7cd-91f0-4401-89ca-ddbb97ace09c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:36.229558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a14fad0236c4eabbea2d074b3c15f5b', 'request_id': 'req-6835e7cd-91f0-4401-89ca-ddbb97ace09c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:36.257641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a14fad0236c4eabbea2d074b3c15f5b', 'request_id': 'req-6835e7cd-91f0-4401-89ca-ddbb97ace09c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:36.299630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] The token cache is being invalidate because project 6a14fad0236c4eabbea2d074b3c15f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:36.303521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:36.305945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:36.312487 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1050/2090] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:35 2022] DELETE /identity/v3/projects/6a14fad0236c4eabbea2d074b3c15f5b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:36.315035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4885-64d7-468d-a66e-847c3049ff63 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:36.315900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4885-64d7-468d-a66e-847c3049ff63 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:36.316198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4885-64d7-468d-a66e-847c3049ff63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:36.373266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fd7d4885-64d7-468d-a66e-847c3049ff63 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:36.381034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fd7d4885-64d7-468d-a66e-847c3049ff63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:36.410701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:36.412197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:36.553025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:36.579596 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1041/2091] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:36.594458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec037f2-e0c3-40a9-962e-abb6aab6ff0e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:36.595186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec037f2-e0c3-40a9-962e-abb6aab6ff0e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:36.596675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec037f2-e0c3-40a9-962e-abb6aab6ff0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:36.632460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835e7cd-91f0-4401-89ca-ddbb97ace09c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:36.644841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1ec037f2-e0c3-40a9-962e-abb6aab6ff0e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:36.645566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6c56c-bca1-4682-8b3b-659561b5d3bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:36.646208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6c56c-bca1-4682-8b3b-659561b5d3bd service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:36.646495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1ec037f2-e0c3-40a9-962e-abb6aab6ff0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:36.646657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6c56c-bca1-4682-8b3b-659561b5d3bd service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:36.647160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6c56c-bca1-4682-8b3b-659561b5d3bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:36.652381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d3b6c56c-bca1-4682-8b3b-659561b5d3bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:36.659177 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1042/2092] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:36.667084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec037f2-e0c3-40a9-962e-abb6aab6ff0e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:36.698586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec037f2-e0c3-40a9-962e-abb6aab6ff0e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:36.713212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4870b3-1837-43cb-b15d-7a52207619f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:36.714641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4870b3-1837-43cb-b15d-7a52207619f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:36.715514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4870b3-1837-43cb-b15d-7a52207619f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:36.715671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4870b3-1837-43cb-b15d-7a52207619f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:36.716809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4870b3-1837-43cb-b15d-7a52207619f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:36.717176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4870b3-1837-43cb-b15d-7a52207619f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:36.719441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4870b3-1837-43cb-b15d-7a52207619f9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:36.744014 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1043/2093] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:36.751879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4870b3-1837-43cb-b15d-7a52207619f9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:36.786310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6c56c-bca1-4682-8b3b-659561b5d3bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:36.788389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6c56c-bca1-4682-8b3b-659561b5d3bd service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:36.790274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4870b3-1837-43cb-b15d-7a52207619f9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:36.806034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a440b-2f4d-484d-9488-02d2c1945cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:36.808220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a440b-2f4d-484d-9488-02d2c1945cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:36.819764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a440b-2f4d-484d-9488-02d2c1945cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:36.820074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a440b-2f4d-484d-9488-02d2c1945cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:36.822459 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1051/2094] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:36 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:52:36.822579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a440b-2f4d-484d-9488-02d2c1945cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:36.825567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a440b-2f4d-484d-9488-02d2c1945cc7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:36.902344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6c56c-bca1-4682-8b3b-659561b5d3bd service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:36.908658 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1044/2095] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:36 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:36.921880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6c56c-bca1-4682-8b3b-659561b5d3bd service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.055195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1c383-8c03-4271-aea2-99725d21ed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.055933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1c383-8c03-4271-aea2-99725d21ed71 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.056343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1c383-8c03-4271-aea2-99725d21ed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.056696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1c383-8c03-4271-aea2-99725d21ed71 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.057990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1c383-8c03-4271-aea2-99725d21ed71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.060714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1c383-8c03-4271-aea2-99725d21ed71 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.088211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:37.108850 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1052/2096] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:36 2022] POST /identity/v3/users => generated 281 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:37.116258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a440b-2f4d-484d-9488-02d2c1945cc7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.138077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a440b-2f4d-484d-9488-02d2c1945cc7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.146601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bcf2e-63bd-45e7-ac03-e2fc4dabc8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.147551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bcf2e-63bd-45e7-ac03-e2fc4dabc8de admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.147951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bcf2e-63bd-45e7-ac03-e2fc4dabc8de admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.148328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bcf2e-63bd-45e7-ac03-e2fc4dabc8de admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.149837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bcf2e-63bd-45e7-ac03-e2fc4dabc8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.151645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bcf2e-63bd-45e7-ac03-e2fc4dabc8de admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.181215 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1045/2097] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:37.182488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1c383-8c03-4271-aea2-99725d21ed71 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.215303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1c383-8c03-4271-aea2-99725d21ed71 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.229829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f4b32-9a39-47b9-949d-a7260ff5256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.230462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f4b32-9a39-47b9-949d-a7260ff5256e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.230761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f4b32-9a39-47b9-949d-a7260ff5256e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.231032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f4b32-9a39-47b9-949d-a7260ff5256e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.231690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f4b32-9a39-47b9-949d-a7260ff5256e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.237174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f4b32-9a39-47b9-949d-a7260ff5256e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.255872 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1053/2098] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:37.257082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bcf2e-63bd-45e7-ac03-e2fc4dabc8de admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.282967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bcf2e-63bd-45e7-ac03-e2fc4dabc8de admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.292639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae01832-821b-41fa-8c0f-cae1eca7b132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.293346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae01832-821b-41fa-8c0f-cae1eca7b132 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.293734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae01832-821b-41fa-8c0f-cae1eca7b132 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.294023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae01832-821b-41fa-8c0f-cae1eca7b132 admin admin] PATH_INFO: `/v3/projects/3fcdd3d1cd9d4206a8448151ce2453b9/users/c6db05a03fb648a69b4cc7945deb38bd/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.328957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae01832-821b-41fa-8c0f-cae1eca7b132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fcdd3d1cd9d4206a8448151ce2453b9, user_id=c6db05a03fb648a69b4cc7945deb38bd, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.331930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae01832-821b-41fa-8c0f-cae1eca7b132 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.357211 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1046/2099] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:37 2022] PUT /identity/v3/projects/3fcdd3d1cd9d4206a8448151ce2453b9/users/c6db05a03fb648a69b4cc7945deb38bd/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:37.369046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2bd29-ce79-470e-992a-9ffae23cd736 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.369523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2bd29-ce79-470e-992a-9ffae23cd736 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.369904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2bd29-ce79-470e-992a-9ffae23cd736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.411650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f5b2bd29-ce79-470e-992a-9ffae23cd736 None None] MFA Rules not processed for user `c6db05a03fb648a69b4cc7945deb38bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:37.413500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f5b2bd29-ce79-470e-992a-9ffae23cd736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:37.542329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae01832-821b-41fa-8c0f-cae1eca7b132 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.544200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eae01832-821b-41fa-8c0f-cae1eca7b132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:37.560487 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1054/2100] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:37.561876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2bd29-ce79-470e-992a-9ffae23cd736 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:37.750602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae01832-821b-41fa-8c0f-cae1eca7b132 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.758749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e2ba8-f5cf-488e-a907-23aaed891a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.759400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e2ba8-f5cf-488e-a907-23aaed891a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.759734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e2ba8-f5cf-488e-a907-23aaed891a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.760706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e2ba8-f5cf-488e-a907-23aaed891a59 admin admin] PATH_INFO: `/v3/users/dc06cf033926436085c6ebc5a8264433` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.761974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e2ba8-f5cf-488e-a907-23aaed891a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc06cf033926436085c6ebc5a8264433)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.766835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e2ba8-f5cf-488e-a907-23aaed891a59 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.877517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-649e2ba8-f5cf-488e-a907-23aaed891a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc06cf033926436085c6ebc5a8264433'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:37.894971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-649e2ba8-f5cf-488e-a907-23aaed891a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc06cf033926436085c6ebc5a8264433'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:37.895915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-649e2ba8-f5cf-488e-a907-23aaed891a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc06cf033926436085c6ebc5a8264433'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:37.914770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2bd29-ce79-470e-992a-9ffae23cd736 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:37.933265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47a02a-920b-45dd-b990-9c27d12cdd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:37.935315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47a02a-920b-45dd-b990-9c27d12cdd64 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.935609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47a02a-920b-45dd-b990-9c27d12cdd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.935892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47a02a-920b-45dd-b990-9c27d12cdd64 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.936806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-649e2ba8-f5cf-488e-a907-23aaed891a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc06cf033926436085c6ebc5a8264433'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:37.938848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-649e2ba8-f5cf-488e-a907-23aaed891a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc06cf033926436085c6ebc5a8264433'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:37.943739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47a02a-920b-45dd-b990-9c27d12cdd64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:37.945716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47a02a-920b-45dd-b990-9c27d12cdd64 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:37.962448 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1047/2101] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:37 2022] DELETE /identity/v3/users/dc06cf033926436085c6ebc5a8264433 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:37.968150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d33d6d-d9f7-4dc4-8672-e6c6ba3bf177 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:37.968515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d33d6d-d9f7-4dc4-8672-e6c6ba3bf177 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:37.968862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d33d6d-d9f7-4dc4-8672-e6c6ba3bf177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:37.989454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:38.033763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-24d33d6d-d9f7-4dc4-8672-e6c6ba3bf177 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:38.035358 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1055/2102] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:37 2022] POST /identity/v3/projects => generated 359 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:38.036038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-24d33d6d-d9f7-4dc4-8672-e6c6ba3bf177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:38.036583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47a02a-920b-45dd-b990-9c27d12cdd64 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:38.042542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cf47a02a-920b-45dd-b990-9c27d12cdd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:38.189571 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1048/2103] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:38.230134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47a02a-920b-45dd-b990-9c27d12cdd64 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:38.248541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dde71-dd73-4fec-91f7-1a3e82f6f72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:38.249021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d33d6d-d9f7-4dc4-8672-e6c6ba3bf177 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:38.249210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dde71-dd73-4fec-91f7-1a3e82f6f72c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.249496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dde71-dd73-4fec-91f7-1a3e82f6f72c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.249775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dde71-dd73-4fec-91f7-1a3e82f6f72c admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.250429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dde71-dd73-4fec-91f7-1a3e82f6f72c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:38.250534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-24d33d6d-d9f7-4dc4-8672-e6c6ba3bf177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:38.253337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dde71-dd73-4fec-91f7-1a3e82f6f72c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:38.285038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:38.326188 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1056/2104] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:38 2022] POST /identity/v3/users => generated 286 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:38.331332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dde71-dd73-4fec-91f7-1a3e82f6f72c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:38.371505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dde71-dd73-4fec-91f7-1a3e82f6f72c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:38.392748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a813ee-d69b-40c1-9dbf-d73cce2a9c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:38.393150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a813ee-d69b-40c1-9dbf-d73cce2a9c8f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.393438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a813ee-d69b-40c1-9dbf-d73cce2a9c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.393779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a813ee-d69b-40c1-9dbf-d73cce2a9c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.394442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a813ee-d69b-40c1-9dbf-d73cce2a9c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:38.394648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d33d6d-d9f7-4dc4-8672-e6c6ba3bf177 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:38.396405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a813ee-d69b-40c1-9dbf-d73cce2a9c8f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:38.402381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ac80e-49b0-4d76-9e24-5e5aa6ccd299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:38.403963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac80e-49b0-4d76-9e24-5e5aa6ccd299 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.405562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac80e-49b0-4d76-9e24-5e5aa6ccd299 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.406376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac80e-49b0-4d76-9e24-5e5aa6ccd299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.423332 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1057/2105] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:38.425894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ac80e-49b0-4d76-9e24-5e5aa6ccd299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:38.428623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a813ee-d69b-40c1-9dbf-d73cce2a9c8f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:38.428766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ac80e-49b0-4d76-9e24-5e5aa6ccd299 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:38.443667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a813ee-d69b-40c1-9dbf-d73cce2a9c8f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:38.456634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaa55d-6c48-4ca1-a90a-c07975f881d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:38.457644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaa55d-6c48-4ca1-a90a-c07975f881d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.457945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaa55d-6c48-4ca1-a90a-c07975f881d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.458211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abaa55d-6c48-4ca1-a90a-c07975f881d2 admin admin] PATH_INFO: `/v3/projects/f27a7321abef423cbb3baf3ca4f63f0e/users/0c841ad5625d453ba800ff348c7ef734/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.458569 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1049/2106] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:38.484336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abaa55d-6c48-4ca1-a90a-c07975f881d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27a7321abef423cbb3baf3ca4f63f0e, user_id=0c841ad5625d453ba800ff348c7ef734, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:38.487440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abaa55d-6c48-4ca1-a90a-c07975f881d2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:38.515066 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1058/2107] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:38 2022] PUT /identity/v3/projects/f27a7321abef423cbb3baf3ca4f63f0e/users/0c841ad5625d453ba800ff348c7ef734/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:38.519651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ac80e-49b0-4d76-9e24-5e5aa6ccd299 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:38.540857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ac80e-49b0-4d76-9e24-5e5aa6ccd299 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:38.657060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad562ba-512e-462c-867b-66d52778c771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:38.660755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad562ba-512e-462c-867b-66d52778c771 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.662677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad562ba-512e-462c-867b-66d52778c771 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.663529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad562ba-512e-462c-867b-66d52778c771 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.664375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad562ba-512e-462c-867b-66d52778c771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:38.673730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad562ba-512e-462c-867b-66d52778c771 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:38.709922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaa55d-6c48-4ca1-a90a-c07975f881d2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:38.714304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5abaa55d-6c48-4ca1-a90a-c07975f881d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:38.716303 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1050/2108] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:38.720917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad562ba-512e-462c-867b-66d52778c771 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:38.744481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abaa55d-6c48-4ca1-a90a-c07975f881d2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:38.768364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:38.769097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.769388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.769753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad562ba-512e-462c-867b-66d52778c771 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:38.769881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] PATH_INFO: `/v3/users/34437c5fbe8347cdb634833ce36d98a2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.772791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34437c5fbe8347cdb634833ce36d98a2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:38.775432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:38.778452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6fd4b0-7684-494c-83e6-f340f982c9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:38.779711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fd4b0-7684-494c-83e6-f340f982c9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.780109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fd4b0-7684-494c-83e6-f340f982c9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.780800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fd4b0-7684-494c-83e6-f340f982c9cd admin admin] PATH_INFO: `/v3/projects/f27a7321abef423cbb3baf3ca4f63f0e/users/0c841ad5625d453ba800ff348c7ef734/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.784585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6fd4b0-7684-494c-83e6-f340f982c9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27a7321abef423cbb3baf3ca4f63f0e, user_id=0c841ad5625d453ba800ff348c7ef734, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:38.790702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6fd4b0-7684-494c-83e6-f340f982c9cd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:38.814013 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1051/2109] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:38 2022] PUT /identity/v3/projects/f27a7321abef423cbb3baf3ca4f63f0e/users/0c841ad5625d453ba800ff348c7ef734/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:38.824492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ab65-03bf-4638-9213-6a04eb357a31 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:38.824860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ab65-03bf-4638-9213-6a04eb357a31 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:38.825238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ab65-03bf-4638-9213-6a04eb357a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:38.873252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9ae3ab65-03bf-4638-9213-6a04eb357a31 None None] MFA Rules not processed for user `0c841ad5625d453ba800ff348c7ef734`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:38.876138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9ae3ab65-03bf-4638-9213-6a04eb357a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:38.908651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:38.927287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34437c5fbe8347cdb634833ce36d98a2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:38.937882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34437c5fbe8347cdb634833ce36d98a2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:38.938964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34437c5fbe8347cdb634833ce36d98a2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:38.962642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34437c5fbe8347cdb634833ce36d98a2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:38.963860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34437c5fbe8347cdb634833ce36d98a2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.020558 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1059/2110] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:38 2022] DELETE /identity/v3/users/34437c5fbe8347cdb634833ce36d98a2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:39.022915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.024599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:39.133651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6fb52-3ba8-4690-aaa6-30d0bb6dc976 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.140751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051b181-0739-4441-a34a-6b659df2018d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.141460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051b181-0739-4441-a34a-6b659df2018d service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.141803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051b181-0739-4441-a34a-6b659df2018d service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.142094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051b181-0739-4441-a34a-6b659df2018d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.143668 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1052/2111] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:38 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:39.144388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8051b181-0739-4441-a34a-6b659df2018d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:39.145108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad7a7f-84ff-4978-841d-9b00e78da34e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.145401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad7a7f-84ff-4978-841d-9b00e78da34e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.145684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad7a7f-84ff-4978-841d-9b00e78da34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.180582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-59ad7a7f-84ff-4978-841d-9b00e78da34e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:39.181859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-59ad7a7f-84ff-4978-841d-9b00e78da34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:39.183588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:39.239862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051b181-0739-4441-a34a-6b659df2018d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.241468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051b181-0739-4441-a34a-6b659df2018d service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.256849 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1060/2112] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:39.302204 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1053/2113] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:39.316503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051b181-0739-4441-a34a-6b659df2018d service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.317678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8051b181-0739-4441-a34a-6b659df2018d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:39.335036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051b181-0739-4441-a34a-6b659df2018d service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.340959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8f962-8f80-40e4-941f-f4b5baca74f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.341575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8f962-8f80-40e4-941f-f4b5baca74f9 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.341857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8f962-8f80-40e4-941f-f4b5baca74f9 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.342159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8f962-8f80-40e4-941f-f4b5baca74f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.394923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad7a7f-84ff-4978-841d-9b00e78da34e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.398043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-59ad7a7f-84ff-4978-841d-9b00e78da34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:39.433541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad7a7f-84ff-4978-841d-9b00e78da34e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.441439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.442039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.442150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.442404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] PATH_INFO: `/v3/projects/d4f39b1ad378464b938e63be69a9c00d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.443832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f39b1ad378464b938e63be69a9c00d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.446164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.471399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8f962-8f80-40e4-941f-f4b5baca74f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.473050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8f962-8f80-40e4-941f-f4b5baca74f9 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.488410 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1061/2114] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:39.489472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8f962-8f80-40e4-941f-f4b5baca74f9 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.490830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0ce8f962-8f80-40e4-941f-f4b5baca74f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:39.523513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f39b1ad378464b938e63be69a9c00d', 'request_id': 'req-2af3e817-1462-4c1e-976f-c416d901ea44'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.535920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f39b1ad378464b938e63be69a9c00d', 'request_id': 'req-2af3e817-1462-4c1e-976f-c416d901ea44'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.544500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f39b1ad378464b938e63be69a9c00d', 'request_id': 'req-2af3e817-1462-4c1e-976f-c416d901ea44'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.557843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8f962-8f80-40e4-941f-f4b5baca74f9 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.559861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] The token cache is being invalidate because project d4f39b1ad378464b938e63be69a9c00d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:39.560046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.560902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.566370 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1054/2115] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:39 2022] DELETE /identity/v3/projects/d4f39b1ad378464b938e63be69a9c00d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:39.567622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.569229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:39.627220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:39.633737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d8050-1c7f-4e5c-a752-c67f648b19de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.634623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d8050-1c7f-4e5c-a752-c67f648b19de service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.635044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d8050-1c7f-4e5c-a752-c67f648b19de service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.635539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d8050-1c7f-4e5c-a752-c67f648b19de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.637947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-956d8050-1c7f-4e5c-a752-c67f648b19de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:39.660398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e817-1462-4c1e-976f-c416d901ea44 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.665937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.666594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.666901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.667181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] PATH_INFO: `/v3/users/e0afcff84398404faf503d2bea46c9af` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.668326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0afcff84398404faf503d2bea46c9af)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.672494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:39.673108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.718554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d8050-1c7f-4e5c-a752-c67f648b19de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.721123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d8050-1c7f-4e5c-a752-c67f648b19de service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.732703 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1062/2116] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:39.733993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d8050-1c7f-4e5c-a752-c67f648b19de service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:39.735835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-956d8050-1c7f-4e5c-a752-c67f648b19de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:39.745102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0afcff84398404faf503d2bea46c9af'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.753689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d8050-1c7f-4e5c-a752-c67f648b19de service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:39.756716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0afcff84398404faf503d2bea46c9af'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.757664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0afcff84398404faf503d2bea46c9af'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.760252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:39.760976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:39.761280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:39.761594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] PATH_INFO: `/v3/users/5790c85d15ef4aff96a1457b3c444973` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:39.762794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5790c85d15ef4aff96a1457b3c444973)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:39.765520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:39.776081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0afcff84398404faf503d2bea46c9af'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.777007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0afcff84398404faf503d2bea46c9af'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.794793 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1055/2117] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:39 2022] DELETE /identity/v3/users/e0afcff84398404faf503d2bea46c9af => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:39.829137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5790c85d15ef4aff96a1457b3c444973'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.837572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5790c85d15ef4aff96a1457b3c444973'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.838306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5790c85d15ef4aff96a1457b3c444973'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.851296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5790c85d15ef4aff96a1457b3c444973'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.852055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5790c85d15ef4aff96a1457b3c444973'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:39.877763 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1063/2118] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:39 2022] DELETE /identity/v3/users/5790c85d15ef4aff96a1457b3c444973 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:40.102950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.104420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:40.216512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e42a2a-6062-49e8-b527-ac86525ac9ea admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.301887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.302567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.302885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.303184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] PATH_INFO: `/v3/projects/b21f1a27ceee4bea8c612243301824d2` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.304981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21f1a27ceee4bea8c612243301824d2)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.306964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:40.320020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:40.363840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.367001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:40.403906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd2fcd-122d-4585-9a24-dc0609eadc86 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.437986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21f1a27ceee4bea8c612243301824d2', 'request_id': 'req-a2ac2019-1286-4b16-941d-2fa461c22131'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.458541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21f1a27ceee4bea8c612243301824d2', 'request_id': 'req-a2ac2019-1286-4b16-941d-2fa461c22131'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.473364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21f1a27ceee4bea8c612243301824d2', 'request_id': 'req-a2ac2019-1286-4b16-941d-2fa461c22131'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.489469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] The token cache is being invalidate because project b21f1a27ceee4bea8c612243301824d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:40.489658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.490363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.495034 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1056/2119] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:40 2022] DELETE /identity/v3/projects/b21f1a27ceee4bea8c612243301824d2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:40.496867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.499501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:40.518307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.518997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.519343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.519623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] PATH_INFO: `/v3/projects/7137aa35d5324b9c8d6b7159e010a447` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.521576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=7137aa35d5324b9c8d6b7159e010a447)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.528586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:40.580577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac2019-1286-4b16-941d-2fa461c22131 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.586126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.587003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.587360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.587702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] PATH_INFO: `/v3/projects/39a2f22a14754d81975f7c8192891d1d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.588931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a2f22a14754d81975f7c8192891d1d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.590986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:40.595069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:40.606894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7137aa35d5324b9c8d6b7159e010a447', 'request_id': 'req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.616250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7137aa35d5324b9c8d6b7159e010a447', 'request_id': 'req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.625503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7137aa35d5324b9c8d6b7159e010a447', 'request_id': 'req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.641544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] The token cache is being invalidate because project 7137aa35d5324b9c8d6b7159e010a447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:40.642002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.642696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.645047 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1064/2120] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:40 2022] DELETE /identity/v3/projects/7137aa35d5324b9c8d6b7159e010a447 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:40.645831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.647179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:40.657448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a2f22a14754d81975f7c8192891d1d', 'request_id': 'req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.666313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a2f22a14754d81975f7c8192891d1d', 'request_id': 'req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.673404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a2f22a14754d81975f7c8192891d1d', 'request_id': 'req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.688729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] The token cache is being invalidate because project 39a2f22a14754d81975f7c8192891d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:40.689131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.689723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.691299 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1057/2121] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:40 2022] DELETE /identity/v3/projects/39a2f22a14754d81975f7c8192891d1d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:40.692073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:40.693600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:40.728898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:40.730250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f2faa-98a9-4eb7-9a8f-b5f3a40971ff admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.774769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d71ac-4fc1-43d9-8425-e1c101ef5a1d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:40.780980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9b915-89e5-4570-81c2-402dcfac028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.781626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9b915-89e5-4570-81c2-402dcfac028e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.781910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9b915-89e5-4570-81c2-402dcfac028e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.782190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9b915-89e5-4570-81c2-402dcfac028e admin admin] PATH_INFO: `/v3/users/85c4b6d0b82b4d7bb15199424ed0c140` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.783518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9b915-89e5-4570-81c2-402dcfac028e admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c4b6d0b82b4d7bb15199424ed0c140)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.785308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9b915-89e5-4570-81c2-402dcfac028e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:40.823884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf306f-69cc-4d51-9ba3-92abe62349de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:40.825036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf306f-69cc-4d51-9ba3-92abe62349de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.825345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf306f-69cc-4d51-9ba3-92abe62349de admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.825734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf306f-69cc-4d51-9ba3-92abe62349de admin admin] PATH_INFO: `/v3/users/766695d4b7c647b6af015b749a881821` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.827205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf306f-69cc-4d51-9ba3-92abe62349de admin admin] RBAC: Authorizing `identity:delete_user(user_id=766695d4b7c647b6af015b749a881821)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:40.829303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf306f-69cc-4d51-9ba3-92abe62349de admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:40.865283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2ee9b915-89e5-4570-81c2-402dcfac028e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c4b6d0b82b4d7bb15199424ed0c140'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.877566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2ee9b915-89e5-4570-81c2-402dcfac028e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c4b6d0b82b4d7bb15199424ed0c140'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.878528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2ee9b915-89e5-4570-81c2-402dcfac028e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c4b6d0b82b4d7bb15199424ed0c140'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.897713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2ee9b915-89e5-4570-81c2-402dcfac028e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c4b6d0b82b4d7bb15199424ed0c140'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.898437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2ee9b915-89e5-4570-81c2-402dcfac028e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c4b6d0b82b4d7bb15199424ed0c140'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.921512 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1058/2122] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:40 2022] DELETE /identity/v3/users/85c4b6d0b82b4d7bb15199424ed0c140 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:40.924532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31b650-452c-4c34-b33e-9fcbce545155 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:40.925172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31b650-452c-4c34-b33e-9fcbce545155 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:40.925584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31b650-452c-4c34-b33e-9fcbce545155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:40.952979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-45cf306f-69cc-4d51-9ba3-92abe62349de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766695d4b7c647b6af015b749a881821'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.956738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6f31b650-452c-4c34-b33e-9fcbce545155 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:40.958556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6f31b650-452c-4c34-b33e-9fcbce545155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:40.974052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-45cf306f-69cc-4d51-9ba3-92abe62349de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766695d4b7c647b6af015b749a881821'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.974913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-45cf306f-69cc-4d51-9ba3-92abe62349de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766695d4b7c647b6af015b749a881821'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.986108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-45cf306f-69cc-4d51-9ba3-92abe62349de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766695d4b7c647b6af015b749a881821'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.987213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-45cf306f-69cc-4d51-9ba3-92abe62349de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766695d4b7c647b6af015b749a881821'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:40.998378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:41.015877 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1065/2123] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:40 2022] DELETE /identity/v3/users/766695d4b7c647b6af015b749a881821 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:41.104566 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1059/2124] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:41.106699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba5856-42c2-4241-a763-0fd84253f9f2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.107178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba5856-42c2-4241-a763-0fd84253f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.107538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba5856-42c2-4241-a763-0fd84253f9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.153656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f9ba5856-42c2-4241-a763-0fd84253f9f2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:41.156592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f9ba5856-42c2-4241-a763-0fd84253f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:41.271597 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1066/2125] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:41.273320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31b650-452c-4c34-b33e-9fcbce545155 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:41.292592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31b650-452c-4c34-b33e-9fcbce545155 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:41.300287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a6526-6396-446a-a488-29f55610ee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:41.301686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a6526-6396-446a-a488-29f55610ee20 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.302188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a6526-6396-446a-a488-29f55610ee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.302670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a6526-6396-446a-a488-29f55610ee20 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.303871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a6526-6396-446a-a488-29f55610ee20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:41.304394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a6526-6396-446a-a488-29f55610ee20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:41.307481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a6526-6396-446a-a488-29f55610ee20 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:41.326043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba5856-42c2-4241-a763-0fd84253f9f2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:41.330875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f9ba5856-42c2-4241-a763-0fd84253f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:41.392449 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1060/2126] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:41.399737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a6526-6396-446a-a488-29f55610ee20 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:41.402557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba5856-42c2-4241-a763-0fd84253f9f2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:41.434553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:41.438450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.441542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.443656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3 admin admin] PATH_INFO: `/v3/projects/174cae678d774d5a84437ea45d5de394` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.446721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=174cae678d774d5a84437ea45d5de394)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:41.454493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:41.457029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a6526-6396-446a-a488-29f55610ee20 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:41.479856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31127b-b8c8-4239-9889-65a3399b20a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:41.480771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31127b-b8c8-4239-9889-65a3399b20a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.481201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31127b-b8c8-4239-9889-65a3399b20a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.481638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31127b-b8c8-4239-9889-65a3399b20a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.482699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31127b-b8c8-4239-9889-65a3399b20a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:41.488719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31127b-b8c8-4239-9889-65a3399b20a8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:41.532864 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1061/2127] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:41 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:52:41.535860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254f013-f156-4697-9d89-b8ddec35eda1 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.536628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254f013-f156-4697-9d89-b8ddec35eda1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.537223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254f013-f156-4697-9d89-b8ddec35eda1 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.539380 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1062/2128] 10.222.0.70 () {54 vars in 921 bytes} [Sun Aug 28 18:52:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:41.540099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254f013-f156-4697-9d89-b8ddec35eda1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:41.557248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '174cae678d774d5a84437ea45d5de394', 'request_id': 'req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:41.558045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:41.575532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '174cae678d774d5a84437ea45d5de394', 'request_id': 'req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:41.584137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '174cae678d774d5a84437ea45d5de394', 'request_id': 'req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:41.602172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3 admin admin] The token cache is being invalidate because project 174cae678d774d5a84437ea45d5de394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:41.602798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:41.603945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a4c3a84-4231-4538-8de3-0b6a6bf961d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:41.613662 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1067/2129] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:41 2022] DELETE /identity/v3/projects/174cae678d774d5a84437ea45d5de394 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:41.613662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f65f19-408a-4aa0-aa1d-ed2560346242 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.613662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f65f19-408a-4aa0-aa1d-ed2560346242 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.613662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f65f19-408a-4aa0-aa1d-ed2560346242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.645092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-63f65f19-408a-4aa0-aa1d-ed2560346242 None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:41.648083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-63f65f19-408a-4aa0-aa1d-ed2560346242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:41.663680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254f013-f156-4697-9d89-b8ddec35eda1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:41.675328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab279554-ddbb-4906-9062-f360892205e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:41.677021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab279554-ddbb-4906-9062-f360892205e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.677505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab279554-ddbb-4906-9062-f360892205e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.678013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab279554-ddbb-4906-9062-f360892205e2 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.679084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab279554-ddbb-4906-9062-f360892205e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:41.681697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab279554-ddbb-4906-9062-f360892205e2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:41.724240 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1063/2130] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:41 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:41.725094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab279554-ddbb-4906-9062-f360892205e2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:41.732572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ab279554-ddbb-4906-9062-f360892205e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:41.750270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab279554-ddbb-4906-9062-f360892205e2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:41.751249 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1068/2131] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:52:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:41.755119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ea36b-dab2-47f0-8263-b310ebeb2ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:41.755745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ea36b-dab2-47f0-8263-b310ebeb2ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.756025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ea36b-dab2-47f0-8263-b310ebeb2ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.756291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ea36b-dab2-47f0-8263-b310ebeb2ed7 admin admin] PATH_INFO: `/v3/users/c6db05a03fb648a69b4cc7945deb38bd` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.757406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ea36b-dab2-47f0-8263-b310ebeb2ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6db05a03fb648a69b4cc7945deb38bd)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:41.759503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ea36b-dab2-47f0-8263-b310ebeb2ed7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:41.759641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc47f14-4923-4c0d-b82b-96f75ca3f5d9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.759789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc47f14-4923-4c0d-b82b-96f75ca3f5d9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.760325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc47f14-4923-4c0d-b82b-96f75ca3f5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.797983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7cc47f14-4923-4c0d-b82b-96f75ca3f5d9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:41.800449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7cc47f14-4923-4c0d-b82b-96f75ca3f5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:41.818621 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1069/2132] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:41.820076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc47f14-4923-4c0d-b82b-96f75ca3f5d9 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:41.821690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7cc47f14-4923-4c0d-b82b-96f75ca3f5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:41.823798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e91ea36b-dab2-47f0-8263-b310ebeb2ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6db05a03fb648a69b4cc7945deb38bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:41.833695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e91ea36b-dab2-47f0-8263-b310ebeb2ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6db05a03fb648a69b4cc7945deb38bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:41.835088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e91ea36b-dab2-47f0-8263-b310ebeb2ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6db05a03fb648a69b4cc7945deb38bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:41.836825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc47f14-4923-4c0d-b82b-96f75ca3f5d9 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:41.845273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727f396-250a-4d44-878f-0a48d1ca2a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:41.846017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727f396-250a-4d44-878f-0a48d1ca2a7c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.846506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727f396-250a-4d44-878f-0a48d1ca2a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.846666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727f396-250a-4d44-878f-0a48d1ca2a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.847416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727f396-250a-4d44-878f-0a48d1ca2a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:41.849032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727f396-250a-4d44-878f-0a48d1ca2a7c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:41.855009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e91ea36b-dab2-47f0-8263-b310ebeb2ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6db05a03fb648a69b4cc7945deb38bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:41.855860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e91ea36b-dab2-47f0-8263-b310ebeb2ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6db05a03fb648a69b4cc7945deb38bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:41.862939 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1070/2133] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:41.862939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727f396-250a-4d44-878f-0a48d1ca2a7c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:41.866978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b727f396-250a-4d44-878f-0a48d1ca2a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:41.878783 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1064/2134] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:41 2022] DELETE /identity/v3/users/c6db05a03fb648a69b4cc7945deb38bd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:41.880592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35013c23-800b-4fb6-a6f7-b82190f820f4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:41.881406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35013c23-800b-4fb6-a6f7-b82190f820f4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:41.881778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35013c23-800b-4fb6-a6f7-b82190f820f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:41.888118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727f396-250a-4d44-878f-0a48d1ca2a7c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:41.896607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:41.919781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-35013c23-800b-4fb6-a6f7-b82190f820f4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:41.924159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-35013c23-800b-4fb6-a6f7-b82190f820f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:42.007317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9b92a-beaf-44d6-bb92-24a7bd1d21c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.008160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9b92a-beaf-44d6-bb92-24a7bd1d21c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.008443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9b92a-beaf-44d6-bb92-24a7bd1d21c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.008715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9b92a-beaf-44d6-bb92-24a7bd1d21c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.014907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1dd9b92a-beaf-44d6-bb92-24a7bd1d21c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:42.037148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9b92a-beaf-44d6-bb92-24a7bd1d21c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.037806 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1065/2135] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:42.038810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9b92a-beaf-44d6-bb92-24a7bd1d21c4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.039078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35013c23-800b-4fb6-a6f7-b82190f820f4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:42.041153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-35013c23-800b-4fb6-a6f7-b82190f820f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:42.049881 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1071/2136] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:42.051455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc0610-5df6-41d0-a488-6974c36bd9d6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.051773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc0610-5df6-41d0-a488-6974c36bd9d6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.052113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc0610-5df6-41d0-a488-6974c36bd9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.055177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35013c23-800b-4fb6-a6f7-b82190f820f4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.062586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a500297-032a-4508-8751-caa7b9a4af07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.062930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a500297-032a-4508-8751-caa7b9a4af07 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.063444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a500297-032a-4508-8751-caa7b9a4af07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.063793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a500297-032a-4508-8751-caa7b9a4af07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.064569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a500297-032a-4508-8751-caa7b9a4af07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.066326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a500297-032a-4508-8751-caa7b9a4af07 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.074079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:42.078914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7ebc0610-5df6-41d0-a488-6974c36bd9d6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:42.082848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7ebc0610-5df6-41d0-a488-6974c36bd9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:42.083668 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1066/2137] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:42.085148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a500297-032a-4508-8751-caa7b9a4af07 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:42.089712 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1072/2138] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:42.090433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc0610-5df6-41d0-a488-6974c36bd9d6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:42.103866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc0610-5df6-41d0-a488-6974c36bd9d6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.111097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a500297-032a-4508-8751-caa7b9a4af07 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.117521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54230c33-4785-44ca-9b28-2031825bef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.118210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54230c33-4785-44ca-9b28-2031825bef42 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.118493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54230c33-4785-44ca-9b28-2031825bef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.118793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54230c33-4785-44ca-9b28-2031825bef42 admin admin] PATH_INFO: `/v3/projects/53b4bff7483e47bdb3e3876f9882875b/users/b8517ba855f9403291d1dbc792ba2b1a/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.119801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0d676-23ba-42a1-af86-af0bd03d85fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.120662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0d676-23ba-42a1-af86-af0bd03d85fe admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.121587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0d676-23ba-42a1-af86-af0bd03d85fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.122260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0d676-23ba-42a1-af86-af0bd03d85fe admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.123146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0d676-23ba-42a1-af86-af0bd03d85fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:42.124314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0d676-23ba-42a1-af86-af0bd03d85fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.126477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0d676-23ba-42a1-af86-af0bd03d85fe admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.147746 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1067/2139] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:42.148882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0d676-23ba-42a1-af86-af0bd03d85fe admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:42.160792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54230c33-4785-44ca-9b28-2031825bef42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b4bff7483e47bdb3e3876f9882875b, user_id=b8517ba855f9403291d1dbc792ba2b1a, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.164850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54230c33-4785-44ca-9b28-2031825bef42 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.174163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0d676-23ba-42a1-af86-af0bd03d85fe admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.185334 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1073/2140] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:42 2022] PUT /identity/v3/projects/53b4bff7483e47bdb3e3876f9882875b/users/b8517ba855f9403291d1dbc792ba2b1a/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:42.187617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54230c33-4785-44ca-9b28-2031825bef42 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:42.187806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8285007-0ba1-46f6-85eb-00b584a982ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.188594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285007-0ba1-46f6-85eb-00b584a982ce service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.190193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285007-0ba1-46f6-85eb-00b584a982ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.190488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285007-0ba1-46f6-85eb-00b584a982ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.210340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8285007-0ba1-46f6-85eb-00b584a982ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.211831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8285007-0ba1-46f6-85eb-00b584a982ce service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.231519 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1068/2141] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:42.234367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8285007-0ba1-46f6-85eb-00b584a982ce service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:42.246797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a8285007-0ba1-46f6-85eb-00b584a982ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:42.315072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8285007-0ba1-46f6-85eb-00b584a982ce service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.399491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54230c33-4785-44ca-9b28-2031825bef42 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.414572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37d7f9-d1a3-415b-bd1d-6ad24c3b5e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.416046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37d7f9-d1a3-415b-bd1d-6ad24c3b5e79 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.416046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37d7f9-d1a3-415b-bd1d-6ad24c3b5e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.416262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37d7f9-d1a3-415b-bd1d-6ad24c3b5e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.416868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37d7f9-d1a3-415b-bd1d-6ad24c3b5e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.418922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37d7f9-d1a3-415b-bd1d-6ad24c3b5e79 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.469893 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1074/2142] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:42 2022] POST /identity/v3/projects => generated 383 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:42.469893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594341c-f212-4b60-a38b-139d55e507a7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.469893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594341c-f212-4b60-a38b-139d55e507a7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.469893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594341c-f212-4b60-a38b-139d55e507a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.490895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.498948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.498948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.498948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] PATH_INFO: `/v3/projects/068f465abe654f349f2fec1bd9a56fcf` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.500890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068f465abe654f349f2fec1bd9a56fcf)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.505008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.520999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d594341c-f212-4b60-a38b-139d55e507a7 None None] MFA Rules not processed for user `b8517ba855f9403291d1dbc792ba2b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:42.524952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d594341c-f212-4b60-a38b-139d55e507a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:42.642672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068f465abe654f349f2fec1bd9a56fcf', 'request_id': 'req-233a9b76-19e3-4301-b626-a816cb68be26'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:42.658100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068f465abe654f349f2fec1bd9a56fcf', 'request_id': 'req-233a9b76-19e3-4301-b626-a816cb68be26'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:42.719078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068f465abe654f349f2fec1bd9a56fcf', 'request_id': 'req-233a9b76-19e3-4301-b626-a816cb68be26'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:42.731998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] The token cache is being invalidate because project 068f465abe654f349f2fec1bd9a56fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:42.732669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:42.735311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:42.737322 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1069/2143] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:42 2022] DELETE /identity/v3/projects/068f465abe654f349f2fec1bd9a56fcf => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:42.738133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:42.739535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:42.750905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:42.780108 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1075/2144] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:42.785082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594341c-f212-4b60-a38b-139d55e507a7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:42.861405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9b76-19e3-4301-b626-a816cb68be26 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.868853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a6930-1c6f-4919-afd5-42cd51b97402 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:42.870586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a6930-1c6f-4919-afd5-42cd51b97402 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.871691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a6930-1c6f-4919-afd5-42cd51b97402 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.871994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a6930-1c6f-4919-afd5-42cd51b97402 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.876003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8b5a6930-1c6f-4919-afd5-42cd51b97402 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:42.896207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:42.905534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a6930-1c6f-4919-afd5-42cd51b97402 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:42.908427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a6930-1c6f-4919-afd5-42cd51b97402 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:42.933449 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1070/2145] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:42.935770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b7790-ff9c-483d-b8e2-a56bfa34ff21 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:42.937607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b7790-ff9c-483d-b8e2-a56bfa34ff21 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:42.938141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b7790-ff9c-483d-b8e2-a56bfa34ff21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:42.953707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594341c-f212-4b60-a38b-139d55e507a7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:42.978665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a91b7790-ff9c-483d-b8e2-a56bfa34ff21 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:42.985010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a91b7790-ff9c-483d-b8e2-a56bfa34ff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.078921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0294f-b1e0-4d9b-8997-19716ff882ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:43.079482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0294f-b1e0-4d9b-8997-19716ff882ad admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.079771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0294f-b1e0-4d9b-8997-19716ff882ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.080177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0294f-b1e0-4d9b-8997-19716ff882ad admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.080898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0294f-b1e0-4d9b-8997-19716ff882ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:43.085592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0294f-b1e0-4d9b-8997-19716ff882ad admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:43.123228 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1071/2146] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:43.124965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b7790-ff9c-483d-b8e2-a56bfa34ff21 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:43.129862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a91b7790-ff9c-483d-b8e2-a56bfa34ff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.133721 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1076/2147] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:42 2022] POST /identity/v3/users => generated 292 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:43.134753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0294f-b1e0-4d9b-8997-19716ff882ad admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:43.138601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-05d0294f-b1e0-4d9b-8997-19716ff882ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.163973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0294f-b1e0-4d9b-8997-19716ff882ad admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:43.165291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b7790-ff9c-483d-b8e2-a56bfa34ff21 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:43.173915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:43.175103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.176307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.176943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] PATH_INFO: `/v3/users/7883e1d888b2436c811e69e25f4e4634` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.178541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7883e1d888b2436c811e69e25f4e4634)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:43.179025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31975b01-af8d-4e08-95f4-b308cf17b4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:43.180254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31975b01-af8d-4e08-95f4-b308cf17b4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.180254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31975b01-af8d-4e08-95f4-b308cf17b4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.182399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:43.184299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31975b01-af8d-4e08-95f4-b308cf17b4d0 admin admin] PATH_INFO: `/v3/projects/3fcdd3d1cd9d4206a8448151ce2453b9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.188185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31975b01-af8d-4e08-95f4-b308cf17b4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fcdd3d1cd9d4206a8448151ce2453b9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:43.189856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31975b01-af8d-4e08-95f4-b308cf17b4d0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:43.261636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7883e1d888b2436c811e69e25f4e4634'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.274961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7883e1d888b2436c811e69e25f4e4634'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.276563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7883e1d888b2436c811e69e25f4e4634'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.288908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7883e1d888b2436c811e69e25f4e4634'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.290129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7883e1d888b2436c811e69e25f4e4634'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.321860 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1077/2148] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:43 2022] DELETE /identity/v3/users/7883e1d888b2436c811e69e25f4e4634 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:43.323152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:43.324873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.325850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-31975b01-af8d-4e08-95f4-b308cf17b4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fcdd3d1cd9d4206a8448151ce2453b9', 'request_id': 'req-31975b01-af8d-4e08-95f4-b308cf17b4d0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.333753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:43.345899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-31975b01-af8d-4e08-95f4-b308cf17b4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fcdd3d1cd9d4206a8448151ce2453b9', 'request_id': 'req-31975b01-af8d-4e08-95f4-b308cf17b4d0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.354288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-31975b01-af8d-4e08-95f4-b308cf17b4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fcdd3d1cd9d4206a8448151ce2453b9', 'request_id': 'req-31975b01-af8d-4e08-95f4-b308cf17b4d0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.377768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-31975b01-af8d-4e08-95f4-b308cf17b4d0 admin admin] The token cache is being invalidate because project 3fcdd3d1cd9d4206a8448151ce2453b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:43.378128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-31975b01-af8d-4e08-95f4-b308cf17b4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.378944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-31975b01-af8d-4e08-95f4-b308cf17b4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.381419 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1072/2149] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:43 2022] DELETE /identity/v3/projects/3fcdd3d1cd9d4206a8448151ce2453b9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:43.383002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a2b31-f26b-44fe-8ac5-e0aade329cd5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.383342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a2b31-f26b-44fe-8ac5-e0aade329cd5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.383627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a2b31-f26b-44fe-8ac5-e0aade329cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.412544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-824a2b31-f26b-44fe-8ac5-e0aade329cd5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:43.414499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-824a2b31-f26b-44fe-8ac5-e0aade329cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.442530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcd584-86ce-415f-ba80-bed33267a24d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:43.448170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0e81f-1c0d-4538-849a-31426a3331b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:43.448807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0e81f-1c0d-4538-849a-31426a3331b9 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.449089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0e81f-1c0d-4538-849a-31426a3331b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.449363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0e81f-1c0d-4538-849a-31426a3331b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.450021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0e81f-1c0d-4538-849a-31426a3331b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:43.452508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0e81f-1c0d-4538-849a-31426a3331b9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:43.491840 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1078/2150] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:43 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:43.491840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0e81f-1c0d-4538-849a-31426a3331b9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:43.494342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-24d0e81f-1c0d-4538-849a-31426a3331b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.509207 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1073/2151] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:43.510490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ce56e-a360-4238-a78c-4634400a63d3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.510931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ce56e-a360-4238-a78c-4634400a63d3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.511281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ce56e-a360-4238-a78c-4634400a63d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.534395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e05ce56e-a360-4238-a78c-4634400a63d3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:43.536130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e05ce56e-a360-4238-a78c-4634400a63d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.552599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:43.606323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0e81f-1c0d-4538-849a-31426a3331b9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:43.613743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fb2b5-be96-48c1-ba9d-44fce0acc186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:43.614538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fb2b5-be96-48c1-ba9d-44fce0acc186 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.614875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fb2b5-be96-48c1-ba9d-44fce0acc186 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.615763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fb2b5-be96-48c1-ba9d-44fce0acc186 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.616662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fb2b5-be96-48c1-ba9d-44fce0acc186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:43.618418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fb2b5-be96-48c1-ba9d-44fce0acc186 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:43.628759 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1074/2152] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:43.629890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ce56e-a360-4238-a78c-4634400a63d3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:43.631428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e05ce56e-a360-4238-a78c-4634400a63d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.647039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ce56e-a360-4238-a78c-4634400a63d3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:43.651243 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1079/2153] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:43.654397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e83544-6b95-4c00-bdbc-865ee6e51387 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.656205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e83544-6b95-4c00-bdbc-865ee6e51387 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.656981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e83544-6b95-4c00-bdbc-865ee6e51387 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.658683 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1080/2154] 10.222.0.70 () {54 vars in 921 bytes} [Sun Aug 28 18:52:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:43.661030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:43.661976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.662333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.662616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] PATH_INFO: `/v3/users/0c841ad5625d453ba800ff348c7ef734` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.666364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c841ad5625d453ba800ff348c7ef734)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:43.667455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e83544-6b95-4c00-bdbc-865ee6e51387 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:43.669766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-49e83544-6b95-4c00-bdbc-865ee6e51387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.673373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:43.696954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e83544-6b95-4c00-bdbc-865ee6e51387 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:43.710641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd3999-0475-44d7-8f6c-47d9173f073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:43.711289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd3999-0475-44d7-8f6c-47d9173f073b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.713228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd3999-0475-44d7-8f6c-47d9173f073b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.714113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd3999-0475-44d7-8f6c-47d9173f073b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.714796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd3999-0475-44d7-8f6c-47d9173f073b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:43.720535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd3999-0475-44d7-8f6c-47d9173f073b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:43.767021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c841ad5625d453ba800ff348c7ef734'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.770587 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1081/2155] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:43 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:43.770587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd3999-0475-44d7-8f6c-47d9173f073b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:43.782499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd3999-0475-44d7-8f6c-47d9173f073b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:43.785151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c841ad5625d453ba800ff348c7ef734'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.786430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c841ad5625d453ba800ff348c7ef734'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.788457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09745f4-fa9d-4e31-9729-65b5fad28a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:43.789074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09745f4-fa9d-4e31-9729-65b5fad28a3f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.789365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09745f4-fa9d-4e31-9729-65b5fad28a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.789644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09745f4-fa9d-4e31-9729-65b5fad28a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.790411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09745f4-fa9d-4e31-9729-65b5fad28a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:43.790970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09745f4-fa9d-4e31-9729-65b5fad28a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:43.792588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09745f4-fa9d-4e31-9729-65b5fad28a3f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:43.811379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c841ad5625d453ba800ff348c7ef734'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.811644 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1082/2156] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:43.815410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c841ad5625d453ba800ff348c7ef734'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:43.815884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09745f4-fa9d-4e31-9729-65b5fad28a3f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:43.820730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d09745f4-fa9d-4e31-9729-65b5fad28a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.838138 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1075/2157] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:43 2022] DELETE /identity/v3/users/0c841ad5625d453ba800ff348c7ef734 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:43.839744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:43.841883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:43.950337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26e67f-092a-4b6b-898e-ba650e0330ed admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:43.960315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00f4f3-d036-44a7-9329-57f0581fbdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:43.961007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00f4f3-d036-44a7-9329-57f0581fbdef admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.961294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00f4f3-d036-44a7-9329-57f0581fbdef admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.961565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00f4f3-d036-44a7-9329-57f0581fbdef admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.962316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00f4f3-d036-44a7-9329-57f0581fbdef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:43.966485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00f4f3-d036-44a7-9329-57f0581fbdef admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:43.986203 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1076/2158] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:43.988286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d9316-ea30-4d12-afab-3dff89816297 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:43.988580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d9316-ea30-4d12-afab-3dff89816297 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:43.988911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d9316-ea30-4d12-afab-3dff89816297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:43.994492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09745f4-fa9d-4e31-9729-65b5fad28a3f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:44.008069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:44.021259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-989d9316-ea30-4d12-afab-3dff89816297 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:44.022671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-989d9316-ea30-4d12-afab-3dff89816297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:44.075192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:44.128318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0432f73-dfd4-4355-a6d3-7143708bd5d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:44.129147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0432f73-dfd4-4355-a6d3-7143708bd5d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.129525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0432f73-dfd4-4355-a6d3-7143708bd5d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.129925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0432f73-dfd4-4355-a6d3-7143708bd5d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.132201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e0432f73-dfd4-4355-a6d3-7143708bd5d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:44.171214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0432f73-dfd4-4355-a6d3-7143708bd5d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:44.172887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0432f73-dfd4-4355-a6d3-7143708bd5d6 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:44.201007 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1077/2159] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:52:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:44.204282 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1083/2160] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:44.204762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0432f73-dfd4-4355-a6d3-7143708bd5d6 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.205666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d9316-ea30-4d12-afab-3dff89816297 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.207453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-989d9316-ea30-4d12-afab-3dff89816297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:44.209030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e0432f73-dfd4-4355-a6d3-7143708bd5d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:44.227256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0432f73-dfd4-4355-a6d3-7143708bd5d6 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:44.233309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75847fd9-c26e-425a-9019-c5dd82fbbbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:44.234245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75847fd9-c26e-425a-9019-c5dd82fbbbfb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.234625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75847fd9-c26e-425a-9019-c5dd82fbbbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.234968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75847fd9-c26e-425a-9019-c5dd82fbbbfb admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.235616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75847fd9-c26e-425a-9019-c5dd82fbbbfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:44.237542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75847fd9-c26e-425a-9019-c5dd82fbbbfb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:44.242515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d9316-ea30-4d12-afab-3dff89816297 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:44.251005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700f6c9-870f-4ee9-9f5b-1d3fb387047c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:44.251628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700f6c9-870f-4ee9-9f5b-1d3fb387047c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.252271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700f6c9-870f-4ee9-9f5b-1d3fb387047c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.252271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700f6c9-870f-4ee9-9f5b-1d3fb387047c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.252985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700f6c9-870f-4ee9-9f5b-1d3fb387047c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:44.254618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700f6c9-870f-4ee9-9f5b-1d3fb387047c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:44.271628 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1078/2161] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:44.272553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700f6c9-870f-4ee9-9f5b-1d3fb387047c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.286116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700f6c9-870f-4ee9-9f5b-1d3fb387047c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:44.293331 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1084/2162] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:44 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:44.293331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75847fd9-c26e-425a-9019-c5dd82fbbbfb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.297602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89057ae-0408-4500-8ac2-82753a4c86b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:44.298367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89057ae-0408-4500-8ac2-82753a4c86b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.299314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89057ae-0408-4500-8ac2-82753a4c86b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.299314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89057ae-0408-4500-8ac2-82753a4c86b1 admin admin] PATH_INFO: `/v3/projects/5f17a741f87a420980407e965a26ba45/users/716e9bc8984c4669a7f26381920b8cf7/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.319369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89057ae-0408-4500-8ac2-82753a4c86b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f17a741f87a420980407e965a26ba45, user_id=716e9bc8984c4669a7f26381920b8cf7, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:44.322800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89057ae-0408-4500-8ac2-82753a4c86b1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:44.352546 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1079/2163] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:44 2022] PUT /identity/v3/projects/5f17a741f87a420980407e965a26ba45/users/716e9bc8984c4669a7f26381920b8cf7/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:44.353617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89057ae-0408-4500-8ac2-82753a4c86b1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.387883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75847fd9-c26e-425a-9019-c5dd82fbbbfb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:44.488557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89057ae-0408-4500-8ac2-82753a4c86b1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:44.496200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ae6c1-165e-4782-b1b5-715e457b6eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:44.496934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ae6c1-165e-4782-b1b5-715e457b6eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.497223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ae6c1-165e-4782-b1b5-715e457b6eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.497502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ae6c1-165e-4782-b1b5-715e457b6eb1 admin admin] PATH_INFO: `/v3/projects/1aaf8595fa6f491e918b58185c258120/users/4e0ce2ba8fd34a6d8e9c9137385cce44/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.515487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ae6c1-165e-4782-b1b5-715e457b6eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aaf8595fa6f491e918b58185c258120, user_id=4e0ce2ba8fd34a6d8e9c9137385cce44, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:44.518375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ae6c1-165e-4782-b1b5-715e457b6eb1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:44.519789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6736f-dc21-4fe4-ab0f-058d5249d7ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:44.520428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6736f-dc21-4fe4-ab0f-058d5249d7ac service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.520710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6736f-dc21-4fe4-ab0f-058d5249d7ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.520982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6736f-dc21-4fe4-ab0f-058d5249d7ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.548829 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1080/2164] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:44 2022] PUT /identity/v3/projects/1aaf8595fa6f491e918b58185c258120/users/4e0ce2ba8fd34a6d8e9c9137385cce44/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:44.549519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ae6c1-165e-4782-b1b5-715e457b6eb1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.641366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:44.694209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6736f-dc21-4fe4-ab0f-058d5249d7ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:44.698128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6736f-dc21-4fe4-ab0f-058d5249d7ac service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:44.699513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ae6c1-165e-4782-b1b5-715e457b6eb1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:44.705704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e0e5f-09fb-474f-abb1-ea7fdc0328e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:44.706394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e0e5f-09fb-474f-abb1-ea7fdc0328e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.706687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e0e5f-09fb-474f-abb1-ea7fdc0328e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.707092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e0e5f-09fb-474f-abb1-ea7fdc0328e6 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.707749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e0e5f-09fb-474f-abb1-ea7fdc0328e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:44.710529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e0e5f-09fb-474f-abb1-ea7fdc0328e6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:44.726806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:44.728113 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1085/2165] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:44.730292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d28e4-6b2c-4ba8-a55f-71f938840abd None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.730587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d28e4-6b2c-4ba8-a55f-71f938840abd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.730963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d28e4-6b2c-4ba8-a55f-71f938840abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.759375 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1081/2166] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:44 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:44.761860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e0e5f-09fb-474f-abb1-ea7fdc0328e6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.766278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b72e0e5f-09fb-474f-abb1-ea7fdc0328e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:44.789492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e0e5f-09fb-474f-abb1-ea7fdc0328e6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:44.796177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:44.797524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:44.797524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:44.797740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] PATH_INFO: `/v3/projects/f27a7321abef423cbb3baf3ca4f63f0e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:44.799088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27a7321abef423cbb3baf3ca4f63f0e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:44.801148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:44.812555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b07d28e4-6b2c-4ba8-a55f-71f938840abd None None] MFA Rules not processed for user `716e9bc8984c4669a7f26381920b8cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:44.814480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b07d28e4-6b2c-4ba8-a55f-71f938840abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:44.885577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27a7321abef423cbb3baf3ca4f63f0e', 'request_id': 'req-8ea21ffe-2837-4541-b051-aad4389f7c5f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.900888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27a7321abef423cbb3baf3ca4f63f0e', 'request_id': 'req-8ea21ffe-2837-4541-b051-aad4389f7c5f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.914186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27a7321abef423cbb3baf3ca4f63f0e', 'request_id': 'req-8ea21ffe-2837-4541-b051-aad4389f7c5f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.931908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] The token cache is being invalidate because project f27a7321abef423cbb3baf3ca4f63f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:44.932262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.935147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:44.938129 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1082/2167] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:44 2022] DELETE /identity/v3/projects/f27a7321abef423cbb3baf3ca4f63f0e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:44.939559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.941675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:44.943512 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1086/2168] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:44.944377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d28e4-6b2c-4ba8-a55f-71f938840abd None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:44.977998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d28e4-6b2c-4ba8-a55f-71f938840abd None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.145351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea21ffe-2837-4541-b051-aad4389f7c5f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.173274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c45037-bf77-4e45-ad10-503460e43fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.173681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c45037-bf77-4e45-ad10-503460e43fda admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.173955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c45037-bf77-4e45-ad10-503460e43fda admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.174220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c45037-bf77-4e45-ad10-503460e43fda admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.177195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c45037-bf77-4e45-ad10-503460e43fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.182771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c45037-bf77-4e45-ad10-503460e43fda admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.194503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4c802-b17c-4297-acc5-6db2822aa99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.195599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4c802-b17c-4297-acc5-6db2822aa99f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.197078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4c802-b17c-4297-acc5-6db2822aa99f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.197583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4c802-b17c-4297-acc5-6db2822aa99f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.199080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4c802-b17c-4297-acc5-6db2822aa99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.202375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4c802-b17c-4297-acc5-6db2822aa99f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.229879 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1087/2169] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:45.232023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68139b-9e5d-4206-89e7-3d50fc607690 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.232327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68139b-9e5d-4206-89e7-3d50fc607690 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.232621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68139b-9e5d-4206-89e7-3d50fc607690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.241571 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1083/2170] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:45.242779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c45037-bf77-4e45-ad10-503460e43fda admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.246708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-97c45037-bf77-4e45-ad10-503460e43fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:45.256415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9a68139b-9e5d-4206-89e7-3d50fc607690 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:45.257503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9a68139b-9e5d-4206-89e7-3d50fc607690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:45.261170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c45037-bf77-4e45-ad10-503460e43fda admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.266664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc846d34-7d4d-413c-929d-da23c7e01e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.267289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846d34-7d4d-413c-929d-da23c7e01e4f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.267571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846d34-7d4d-413c-929d-da23c7e01e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.267849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846d34-7d4d-413c-929d-da23c7e01e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.268559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc846d34-7d4d-413c-929d-da23c7e01e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.269814 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1088/2171] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:45.270941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68139b-9e5d-4206-89e7-3d50fc607690 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.273258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9a68139b-9e5d-4206-89e7-3d50fc607690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:45.278261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc846d34-7d4d-413c-929d-da23c7e01e4f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.290186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68139b-9e5d-4206-89e7-3d50fc607690 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.295925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.296922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.297206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.297661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] PATH_INFO: `/v3/projects/5e5e948a3a3541528a15b35ffe482b7c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.298860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5e948a3a3541528a15b35ffe482b7c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.300764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.321948 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1084/2172] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:45 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:45.323051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc846d34-7d4d-413c-929d-da23c7e01e4f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.331551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fc846d34-7d4d-413c-929d-da23c7e01e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:45.361563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5e948a3a3541528a15b35ffe482b7c', 'request_id': 'req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:45.367476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5e948a3a3541528a15b35ffe482b7c', 'request_id': 'req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:45.369396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:45.375120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5e948a3a3541528a15b35ffe482b7c', 'request_id': 'req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:45.399136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] The token cache is being invalidate because project 5e5e948a3a3541528a15b35ffe482b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:45.399487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:45.400333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:45.402146 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1089/2173] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:45 2022] DELETE /identity/v3/projects/5e5e948a3a3541528a15b35ffe482b7c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:45.402735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.404142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:45.421325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:45.438486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc846d34-7d4d-413c-929d-da23c7e01e4f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.493859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f17a8c-d9a4-4d96-9faa-4c3d36e77e16 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.499086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad31cc4-996f-47da-8939-01462954e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.499769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad31cc4-996f-47da-8939-01462954e775 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.500279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad31cc4-996f-47da-8939-01462954e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.500279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad31cc4-996f-47da-8939-01462954e775 admin admin] PATH_INFO: `/v3/projects/1aaf8595fa6f491e918b58185c258120/users/4e0ce2ba8fd34a6d8e9c9137385cce44/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.502320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad31cc4-996f-47da-8939-01462954e775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aaf8595fa6f491e918b58185c258120, user_id=4e0ce2ba8fd34a6d8e9c9137385cce44, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.505086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad31cc4-996f-47da-8939-01462954e775 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.505954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6a6e5-badc-490d-85d6-caaccb8b6670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.506567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6a6e5-badc-490d-85d6-caaccb8b6670 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.506882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6a6e5-badc-490d-85d6-caaccb8b6670 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.507158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6a6e5-badc-490d-85d6-caaccb8b6670 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.507795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6a6e5-badc-490d-85d6-caaccb8b6670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.509378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6a6e5-badc-490d-85d6-caaccb8b6670 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.518430 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1090/2174] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:45 2022] PUT /identity/v3/projects/1aaf8595fa6f491e918b58185c258120/users/4e0ce2ba8fd34a6d8e9c9137385cce44/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:45.519743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dde3ef-39f1-49df-8e92-64854ef562e3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.520105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dde3ef-39f1-49df-8e92-64854ef562e3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.520678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dde3ef-39f1-49df-8e92-64854ef562e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.530829 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1085/2175] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:45.531684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6a6e5-badc-490d-85d6-caaccb8b6670 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.535271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-37f6a6e5-badc-490d-85d6-caaccb8b6670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:45.548097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d3dde3ef-39f1-49df-8e92-64854ef562e3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:45.549296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6a6e5-badc-490d-85d6-caaccb8b6670 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.549472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d3dde3ef-39f1-49df-8e92-64854ef562e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:45.613567 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1091/2176] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:45.614264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dde3ef-39f1-49df-8e92-64854ef562e3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.615832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d3dde3ef-39f1-49df-8e92-64854ef562e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:45.617376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cea8e6-8ae4-4fd0-ad85-fddac6bdcc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.618016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cea8e6-8ae4-4fd0-ad85-fddac6bdcc67 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.618279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cea8e6-8ae4-4fd0-ad85-fddac6bdcc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.618630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cea8e6-8ae4-4fd0-ad85-fddac6bdcc67 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.619210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cea8e6-8ae4-4fd0-ad85-fddac6bdcc67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.621140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cea8e6-8ae4-4fd0-ad85-fddac6bdcc67 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.629675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dde3ef-39f1-49df-8e92-64854ef562e3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.634495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.635211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.635546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.635823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] PATH_INFO: `/v3/users/48fe0c3410264e16a1a2cf0d6215971c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.637138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48fe0c3410264e16a1a2cf0d6215971c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.639456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.645239 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1086/2177] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:45 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:45.646709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250af04-7fb9-4e81-829a-f77a8f2e2fdd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.647023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250af04-7fb9-4e81-829a-f77a8f2e2fdd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.647325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250af04-7fb9-4e81-829a-f77a8f2e2fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.680749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4250af04-7fb9-4e81-829a-f77a8f2e2fdd None None] MFA Rules not processed for user `4e0ce2ba8fd34a6d8e9c9137385cce44`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:45.682303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4250af04-7fb9-4e81-829a-f77a8f2e2fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:45.697000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48fe0c3410264e16a1a2cf0d6215971c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:45.704703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48fe0c3410264e16a1a2cf0d6215971c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:45.705722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48fe0c3410264e16a1a2cf0d6215971c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:45.714290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48fe0c3410264e16a1a2cf0d6215971c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:45.714991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48fe0c3410264e16a1a2cf0d6215971c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:45.727628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:45.738624 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1092/2178] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:45 2022] DELETE /identity/v3/users/48fe0c3410264e16a1a2cf0d6215971c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:45.739707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.742550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:45.775460 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1087/2179] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:45.780054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250af04-7fb9-4e81-829a-f77a8f2e2fdd None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.782163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4250af04-7fb9-4e81-829a-f77a8f2e2fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:45.797908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250af04-7fb9-4e81-829a-f77a8f2e2fdd None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.807485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:45.833920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cdae6-c594-4a9f-be7e-ee051c458064 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:45.838762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4812672-b77d-4f53-b9b8-1f3c822440fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.839460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4812672-b77d-4f53-b9b8-1f3c822440fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.840130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4812672-b77d-4f53-b9b8-1f3c822440fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.840130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4812672-b77d-4f53-b9b8-1f3c822440fc admin admin] PATH_INFO: `/v3/projects/aedf7771145c49e2948ef4283ace2e65/users/71b53d4e00654b789316eca5cfc55372/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.857096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4812672-b77d-4f53-b9b8-1f3c822440fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aedf7771145c49e2948ef4283ace2e65, user_id=71b53d4e00654b789316eca5cfc55372, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.860820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4812672-b77d-4f53-b9b8-1f3c822440fc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.873078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e23187-eb61-44a5-b812-c90f20f71888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:45.875215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e23187-eb61-44a5-b812-c90f20f71888 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:45.875760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e23187-eb61-44a5-b812-c90f20f71888 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:45.876059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e23187-eb61-44a5-b812-c90f20f71888 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:45.876746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e23187-eb61-44a5-b812-c90f20f71888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:45.877060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e23187-eb61-44a5-b812-c90f20f71888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:45.878705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e23187-eb61-44a5-b812-c90f20f71888 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:45.882423 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1093/2180] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:45 2022] PUT /identity/v3/projects/aedf7771145c49e2948ef4283ace2e65/users/71b53d4e00654b789316eca5cfc55372/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:45.883531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4812672-b77d-4f53-b9b8-1f3c822440fc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.905548 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1088/2181] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:45.906809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e23187-eb61-44a5-b812-c90f20f71888 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:45.909013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-59e23187-eb61-44a5-b812-c90f20f71888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:45.909616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b4812672-b77d-4f53-b9b8-1f3c822440fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:46.044231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e23187-eb61-44a5-b812-c90f20f71888 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.045288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4812672-b77d-4f53-b9b8-1f3c822440fc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.050396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6286d-4b16-4c67-a88b-ead6d71415d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.051062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6286d-4b16-4c67-a88b-ead6d71415d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.051342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6286d-4b16-4c67-a88b-ead6d71415d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.051617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6286d-4b16-4c67-a88b-ead6d71415d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.052275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6286d-4b16-4c67-a88b-ead6d71415d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.053892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6286d-4b16-4c67-a88b-ead6d71415d8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.068070 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1094/2182] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:46.070245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a858b9-0a7f-4b92-b2c9-a93400baa9ac None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.070538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a858b9-0a7f-4b92-b2c9-a93400baa9ac None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.071113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a858b9-0a7f-4b92-b2c9-a93400baa9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.105453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c2a858b9-0a7f-4b92-b2c9-a93400baa9ac None None] MFA Rules not processed for user `71b53d4e00654b789316eca5cfc55372`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:46.106931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c2a858b9-0a7f-4b92-b2c9-a93400baa9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:46.186972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356aaae-fce0-41b7-9761-bc931a1e6fe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.187159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356aaae-fce0-41b7-9761-bc931a1e6fe9 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.187532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356aaae-fce0-41b7-9761-bc931a1e6fe9 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.187817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356aaae-fce0-41b7-9761-bc931a1e6fe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.209473 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1095/2183] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:46.210718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a858b9-0a7f-4b92-b2c9-a93400baa9ac None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.219336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:46.224565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a858b9-0a7f-4b92-b2c9-a93400baa9ac None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.243649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c25491-c690-4013-9bb5-524dfd9a610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.244295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25491-c690-4013-9bb5-524dfd9a610f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.244583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25491-c690-4013-9bb5-524dfd9a610f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.244728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:46.244882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25491-c690-4013-9bb5-524dfd9a610f admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.246976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c25491-c690-4013-9bb5-524dfd9a610f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.254402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c25491-c690-4013-9bb5-524dfd9a610f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.277817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356aaae-fce0-41b7-9761-bc931a1e6fe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.281820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356aaae-fce0-41b7-9761-bc931a1e6fe9 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.296504 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1089/2184] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:46.298409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356aaae-fce0-41b7-9761-bc931a1e6fe9 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.310665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356aaae-fce0-41b7-9761-bc931a1e6fe9 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.317078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cd861-ea32-4421-839a-2503396b0689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.317964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cd861-ea32-4421-839a-2503396b0689 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.318253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cd861-ea32-4421-839a-2503396b0689 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.318534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cd861-ea32-4421-839a-2503396b0689 admin admin] PATH_INFO: `/v3/projects/c12094d8578943e5aae96ea7f8fc258a/users/08b59c14ebf547838edacbaceecb9f29/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.322024 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1096/2185] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:46 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:46.323219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c25491-c690-4013-9bb5-524dfd9a610f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.325447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-80c25491-c690-4013-9bb5-524dfd9a610f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:46.342902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cd861-ea32-4421-839a-2503396b0689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12094d8578943e5aae96ea7f8fc258a, user_id=08b59c14ebf547838edacbaceecb9f29, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.346201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cd861-ea32-4421-839a-2503396b0689 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.366678 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1090/2186] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:46 2022] PUT /identity/v3/projects/c12094d8578943e5aae96ea7f8fc258a/users/08b59c14ebf547838edacbaceecb9f29/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:46.369779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cd861-ea32-4421-839a-2503396b0689 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.419142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c25491-c690-4013-9bb5-524dfd9a610f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.476648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cd861-ea32-4421-839a-2503396b0689 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.483846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842144b4-75ef-424f-a1c6-94bcb7a2c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.484808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842144b4-75ef-424f-a1c6-94bcb7a2c74d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.485187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842144b4-75ef-424f-a1c6-94bcb7a2c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.486241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842144b4-75ef-424f-a1c6-94bcb7a2c74d admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.487404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842144b4-75ef-424f-a1c6-94bcb7a2c74d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.489604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842144b4-75ef-424f-a1c6-94bcb7a2c74d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.539418 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1091/2187] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:46 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:46.541720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842144b4-75ef-424f-a1c6-94bcb7a2c74d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.546997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.547903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.548014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.548336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] PATH_INFO: `/v3/projects/383c6163263c456fb10363ca5294d7c9` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.549986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=383c6163263c456fb10363ca5294d7c9)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.551603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.616385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '383c6163263c456fb10363ca5294d7c9', 'request_id': 'req-1fab6e11-374f-4909-807a-e2162be39c88'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:46.626534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '383c6163263c456fb10363ca5294d7c9', 'request_id': 'req-1fab6e11-374f-4909-807a-e2162be39c88'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:46.635482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '383c6163263c456fb10363ca5294d7c9', 'request_id': 'req-1fab6e11-374f-4909-807a-e2162be39c88'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:46.660797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] The token cache is being invalidate because project 383c6163263c456fb10363ca5294d7c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:46.661147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:46.664263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:46.667697 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1097/2188] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:46 2022] DELETE /identity/v3/projects/383c6163263c456fb10363ca5294d7c9 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:46.674538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.680587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:46.704534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842144b4-75ef-424f-a1c6-94bcb7a2c74d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.720237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:46.765026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:46.800096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e08a-edc7-47b2-b6ce-0373a87afc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.800727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e08a-edc7-47b2-b6ce-0373a87afc9e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.801006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e08a-edc7-47b2-b6ce-0373a87afc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.801277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e08a-edc7-47b2-b6ce-0373a87afc9e admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.801905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5e08a-edc7-47b2-b6ce-0373a87afc9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.804068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5e08a-edc7-47b2-b6ce-0373a87afc9e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.830404 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1092/2189] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:46 2022] POST /identity/v3/users => generated 292 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:46.831397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e08a-edc7-47b2-b6ce-0373a87afc9e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.833178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2bf5e08a-edc7-47b2-b6ce-0373a87afc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:46.836542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab6e11-374f-4909-807a-e2162be39c88 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.841613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0fa38-c27a-40dc-a51e-469e1c2f58a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.843392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0fa38-c27a-40dc-a51e-469e1c2f58a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.843901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0fa38-c27a-40dc-a51e-469e1c2f58a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.844416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0fa38-c27a-40dc-a51e-469e1c2f58a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.845257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0fa38-c27a-40dc-a51e-469e1c2f58a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.846633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e08a-edc7-47b2-b6ce-0373a87afc9e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.847253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0fa38-c27a-40dc-a51e-469e1c2f58a3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.851472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb45cf-7ff2-42d6-8a6b-11c8fbf88b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.852136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb45cf-7ff2-42d6-8a6b-11c8fbf88b4c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.852448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb45cf-7ff2-42d6-8a6b-11c8fbf88b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.852721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb45cf-7ff2-42d6-8a6b-11c8fbf88b4c admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.853455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb45cf-7ff2-42d6-8a6b-11c8fbf88b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.856166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb45cf-7ff2-42d6-8a6b-11c8fbf88b4c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.862782 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1098/2190] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:46.871258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a35ac-3fac-45d9-a5f0-f2a222881578 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.871593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a35ac-3fac-45d9-a5f0-f2a222881578 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.871900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a35ac-3fac-45d9-a5f0-f2a222881578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.880261 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1093/2191] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:46 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:46.881246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb45cf-7ff2-42d6-8a6b-11c8fbf88b4c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.884136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-62fb45cf-7ff2-42d6-8a6b-11c8fbf88b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:46.897195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6c4a35ac-3fac-45d9-a5f0-f2a222881578 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:46.898002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb45cf-7ff2-42d6-8a6b-11c8fbf88b4c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.898534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6c4a35ac-3fac-45d9-a5f0-f2a222881578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:46.902503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d725e7-468c-489c-8f76-44a46680b746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.903197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d725e7-468c-489c-8f76-44a46680b746 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.903398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d725e7-468c-489c-8f76-44a46680b746 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.903665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d725e7-468c-489c-8f76-44a46680b746 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.904302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d725e7-468c-489c-8f76-44a46680b746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.906545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d725e7-468c-489c-8f76-44a46680b746 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.909269 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1099/2192] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:46.909962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a35ac-3fac-45d9-a5f0-f2a222881578 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.921425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a35ac-3fac-45d9-a5f0-f2a222881578 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.929209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7715959-d3fe-42e8-aa12-a34339b29ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:46.929999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7715959-d3fe-42e8-aa12-a34339b29ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.930135 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1094/2193] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:46.930328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7715959-d3fe-42e8-aa12-a34339b29ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.930660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7715959-d3fe-42e8-aa12-a34339b29ec3 admin admin] PATH_INFO: `/v3/projects/c12094d8578943e5aae96ea7f8fc258a/users/08b59c14ebf547838edacbaceecb9f29/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.931056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d725e7-468c-489c-8f76-44a46680b746 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:46.934916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7715959-d3fe-42e8-aa12-a34339b29ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12094d8578943e5aae96ea7f8fc258a, user_id=08b59c14ebf547838edacbaceecb9f29, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:46.938283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7715959-d3fe-42e8-aa12-a34339b29ec3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:46.944852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d725e7-468c-489c-8f76-44a46680b746 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:46.954638 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1100/2194] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:46 2022] PUT /identity/v3/projects/c12094d8578943e5aae96ea7f8fc258a/users/08b59c14ebf547838edacbaceecb9f29/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:46.956103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0a732-ed68-4bae-a6ed-6e25c34ba9f4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:46.956393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0a732-ed68-4bae-a6ed-6e25c34ba9f4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:46.956695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0a732-ed68-4bae-a6ed-6e25c34ba9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:46.980213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b6c0a732-ed68-4bae-a6ed-6e25c34ba9f4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:46.981462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b6c0a732-ed68-4bae-a6ed-6e25c34ba9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:47.032606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf2bc7-5d77-4077-82e1-2d1a00a50aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.033253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf2bc7-5d77-4077-82e1-2d1a00a50aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.033541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf2bc7-5d77-4077-82e1-2d1a00a50aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.034094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf2bc7-5d77-4077-82e1-2d1a00a50aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.034760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf2bc7-5d77-4077-82e1-2d1a00a50aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.036560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf2bc7-5d77-4077-82e1-2d1a00a50aa1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.050727 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1095/2195] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:47.050727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf2bc7-5d77-4077-82e1-2d1a00a50aa1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.050727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28bf2bc7-5d77-4077-82e1-2d1a00a50aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:47.059932 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1101/2196] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:47.059932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0a732-ed68-4bae-a6ed-6e25c34ba9f4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.064910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf2bc7-5d77-4077-82e1-2d1a00a50aa1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.069908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.070588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.070702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0a732-ed68-4bae-a6ed-6e25c34ba9f4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.070906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.071180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] PATH_INFO: `/v3/users/b8517ba855f9403291d1dbc792ba2b1a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.072315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8517ba855f9403291d1dbc792ba2b1a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.074258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.075687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67665c1-99b6-4465-95b0-40f2e333c719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.077375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67665c1-99b6-4465-95b0-40f2e333c719 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.077669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67665c1-99b6-4465-95b0-40f2e333c719 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.078302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67665c1-99b6-4465-95b0-40f2e333c719 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.079026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67665c1-99b6-4465-95b0-40f2e333c719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.080818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67665c1-99b6-4465-95b0-40f2e333c719 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.094166 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1102/2197] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:47.095482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a05a73-6f37-4080-96e0-ca23bbac8626 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.095766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a05a73-6f37-4080-96e0-ca23bbac8626 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.096040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a05a73-6f37-4080-96e0-ca23bbac8626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.128028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e1a05a73-6f37-4080-96e0-ca23bbac8626 None None] MFA Rules not processed for user `08b59c14ebf547838edacbaceecb9f29`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:47.129245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e1a05a73-6f37-4080-96e0-ca23bbac8626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:47.142245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8517ba855f9403291d1dbc792ba2b1a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:47.151149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8517ba855f9403291d1dbc792ba2b1a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:47.151830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8517ba855f9403291d1dbc792ba2b1a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:47.171078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8517ba855f9403291d1dbc792ba2b1a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:47.171813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8517ba855f9403291d1dbc792ba2b1a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:47.187809 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1096/2198] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:47 2022] DELETE /identity/v3/users/b8517ba855f9403291d1dbc792ba2b1a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:47.189045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.192042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:47.208106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:47.220725 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1103/2199] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:47.220725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a05a73-6f37-4080-96e0-ca23bbac8626 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.221030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e1a05a73-6f37-4080-96e0-ca23bbac8626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:47.236607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a05a73-6f37-4080-96e0-ca23bbac8626 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.244922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:47.295845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceb035-a76a-4a51-b5ae-9a6ff62521b8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.302590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fccc4-085b-4029-b58e-d4dc1273db7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.303356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fccc4-085b-4029-b58e-d4dc1273db7b admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.303645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fccc4-085b-4029-b58e-d4dc1273db7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.303954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fccc4-085b-4029-b58e-d4dc1273db7b admin admin] PATH_INFO: `/v3/projects/b69125820c19410cb213865b963b346c/users/5f2b6636e33844b6bac12b6815440b22/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.321636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fccc4-085b-4029-b58e-d4dc1273db7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b69125820c19410cb213865b963b346c, user_id=5f2b6636e33844b6bac12b6815440b22, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.324403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fccc4-085b-4029-b58e-d4dc1273db7b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.325323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2bda2-5891-4958-a805-69a68f8bb19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.326113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2bda2-5891-4958-a805-69a68f8bb19b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.327513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2bda2-5891-4958-a805-69a68f8bb19b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.328481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2bda2-5891-4958-a805-69a68f8bb19b admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.329314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2bda2-5891-4958-a805-69a68f8bb19b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:47.329831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2bda2-5891-4958-a805-69a68f8bb19b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.331897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2bda2-5891-4958-a805-69a68f8bb19b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.343234 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1097/2200] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:47 2022] PUT /identity/v3/projects/b69125820c19410cb213865b963b346c/users/5f2b6636e33844b6bac12b6815440b22/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:47.344616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fccc4-085b-4029-b58e-d4dc1273db7b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.350011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-934fccc4-085b-4029-b58e-d4dc1273db7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:47.355293 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1104/2201] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:47.357033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c98fc3-ac29-4aa1-885a-9e1f30aa6fff None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.357584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c98fc3-ac29-4aa1-885a-9e1f30aa6fff None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.358655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c98fc3-ac29-4aa1-885a-9e1f30aa6fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.387041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-23c98fc3-ac29-4aa1-885a-9e1f30aa6fff None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:47.388885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-23c98fc3-ac29-4aa1-885a-9e1f30aa6fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:47.443678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fccc4-085b-4029-b58e-d4dc1273db7b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.449672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33e793-a183-4815-b534-d4bba90cd408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.450492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33e793-a183-4815-b534-d4bba90cd408 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.450802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33e793-a183-4815-b534-d4bba90cd408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.451082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33e793-a183-4815-b534-d4bba90cd408 admin admin] PATH_INFO: `/v3/projects/b6bbebcf7d7046679635438031941e3a/users/96265ca648444ff8bf45a45c26b7679e/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.469615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33e793-a183-4815-b534-d4bba90cd408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bbebcf7d7046679635438031941e3a, user_id=96265ca648444ff8bf45a45c26b7679e, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.472557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33e793-a183-4815-b534-d4bba90cd408 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.480798 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1105/2202] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:47.481825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c98fc3-ac29-4aa1-885a-9e1f30aa6fff None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.485951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-23c98fc3-ac29-4aa1-885a-9e1f30aa6fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:47.492921 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1098/2203] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:47 2022] PUT /identity/v3/projects/b6bbebcf7d7046679635438031941e3a/users/96265ca648444ff8bf45a45c26b7679e/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:47.493780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33e793-a183-4815-b534-d4bba90cd408 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.606251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33e793-a183-4815-b534-d4bba90cd408 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.611686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c98fc3-ac29-4aa1-885a-9e1f30aa6fff None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.615665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4c9c-9a2b-4d7e-95aa-4ffad4c26a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.617992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4c9c-9a2b-4d7e-95aa-4ffad4c26a33 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.619050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4c9c-9a2b-4d7e-95aa-4ffad4c26a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.619575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4c9c-9a2b-4d7e-95aa-4ffad4c26a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.620321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4c9c-9a2b-4d7e-95aa-4ffad4c26a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.623128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4c9c-9a2b-4d7e-95aa-4ffad4c26a33 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.643738 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1099/2204] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:47.644952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4c9c-9a2b-4d7e-95aa-4ffad4c26a33 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.659088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4c9c-9a2b-4d7e-95aa-4ffad4c26a33 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.664616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2889c6-a68a-41c7-9c51-110e25e2f5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.665237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2889c6-a68a-41c7-9c51-110e25e2f5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.665683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2889c6-a68a-41c7-9c51-110e25e2f5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.665959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2889c6-a68a-41c7-9c51-110e25e2f5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.666597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2889c6-a68a-41c7-9c51-110e25e2f5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.668617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2889c6-a68a-41c7-9c51-110e25e2f5d9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.672760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:47.691586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:47.702522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbdb86-068e-4a60-95c9-4bd9d359510d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.703888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbdb86-068e-4a60-95c9-4bd9d359510d service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.704362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbdb86-068e-4a60-95c9-4bd9d359510d service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.704637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbdb86-068e-4a60-95c9-4bd9d359510d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.711007 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1100/2205] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:47 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:47.711784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2889c6-a68a-41c7-9c51-110e25e2f5d9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.714000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3c2889c6-a68a-41c7-9c51-110e25e2f5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:47.800838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbdb86-068e-4a60-95c9-4bd9d359510d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.802416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbdb86-068e-4a60-95c9-4bd9d359510d service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.804427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2889c6-a68a-41c7-9c51-110e25e2f5d9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.809908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a8213-e543-46fe-a3de-ab5fb6b6ee26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:47.811130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a8213-e543-46fe-a3de-ab5fb6b6ee26 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.811468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a8213-e543-46fe-a3de-ab5fb6b6ee26 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.811780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a8213-e543-46fe-a3de-ab5fb6b6ee26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.814266 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1106/2206] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:47.815365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04eda7-ae7f-4137-9737-c3a7aff31664 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:47.815658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04eda7-ae7f-4137-9737-c3a7aff31664 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:47.815997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04eda7-ae7f-4137-9737-c3a7aff31664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:47.843524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4d04eda7-ae7f-4137-9737-c3a7aff31664 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:47.844893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4d04eda7-ae7f-4137-9737-c3a7aff31664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:47.955401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a8213-e543-46fe-a3de-ab5fb6b6ee26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:47.956916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a8213-e543-46fe-a3de-ab5fb6b6ee26 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:47.961419 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1107/2207] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:47.965011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04eda7-ae7f-4137-9737-c3a7aff31664 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.978796 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1101/2208] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:47.979825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a8213-e543-46fe-a3de-ab5fb6b6ee26 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:47.989186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04eda7-ae7f-4137-9737-c3a7aff31664 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:47.995560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a8213-e543-46fe-a3de-ab5fb6b6ee26 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.005766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabf000-bf4a-4819-b887-99f5cdab93db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.007448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf000-bf4a-4819-b887-99f5cdab93db admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.008528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf000-bf4a-4819-b887-99f5cdab93db admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.010706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf000-bf4a-4819-b887-99f5cdab93db admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.011329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a21df-5354-4718-b54d-2c7ab13164af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.012029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a21df-5354-4718-b54d-2c7ab13164af admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.012386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a21df-5354-4718-b54d-2c7ab13164af admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.012670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a21df-5354-4718-b54d-2c7ab13164af admin admin] PATH_INFO: `/v3/projects/b69125820c19410cb213865b963b346c/users/5f2b6636e33844b6bac12b6815440b22/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.013497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabf000-bf4a-4819-b887-99f5cdab93db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.015817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a21df-5354-4718-b54d-2c7ab13164af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b69125820c19410cb213865b963b346c, user_id=5f2b6636e33844b6bac12b6815440b22, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.018554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a21df-5354-4718-b54d-2c7ab13164af admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:48.019513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabf000-bf4a-4819-b887-99f5cdab93db admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:48.034864 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1108/2209] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:47 2022] PUT /identity/v3/projects/b69125820c19410cb213865b963b346c/users/5f2b6636e33844b6bac12b6815440b22/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:48.036852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a21df-5354-4718-b54d-2c7ab13164af admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:48.040187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5c7a21df-5354-4718-b54d-2c7ab13164af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:48.054832 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1102/2210] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:47 2022] POST /identity/v3/users => generated 292 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:48.056103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabf000-bf4a-4819-b887-99f5cdab93db admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:48.099154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabf000-bf4a-4819-b887-99f5cdab93db admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.176464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dcf29-02b9-4318-8d86-7f517d49097d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.177122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dcf29-02b9-4318-8d86-7f517d49097d service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.177430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dcf29-02b9-4318-8d86-7f517d49097d service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.177723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dcf29-02b9-4318-8d86-7f517d49097d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.184134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a21df-5354-4718-b54d-2c7ab13164af admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.192064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.192311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dcf29-02b9-4318-8d86-7f517d49097d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.192733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.192984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.193490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] PATH_INFO: `/v3/users/716e9bc8984c4669a7f26381920b8cf7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.194595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dcf29-02b9-4318-8d86-7f517d49097d service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:48.195114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=716e9bc8984c4669a7f26381920b8cf7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.197115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:48.205533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:48.213550 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1103/2211] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:48.216849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8399893-654c-4c81-a2b1-6a612f1bb31d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.217864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8399893-654c-4c81-a2b1-6a612f1bb31d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.218460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8399893-654c-4c81-a2b1-6a612f1bb31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.261927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d8399893-654c-4c81-a2b1-6a612f1bb31d None None] MFA Rules not processed for user `5f2b6636e33844b6bac12b6815440b22`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:48.263257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d8399893-654c-4c81-a2b1-6a612f1bb31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:48.272657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716e9bc8984c4669a7f26381920b8cf7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.285559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716e9bc8984c4669a7f26381920b8cf7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.286990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716e9bc8984c4669a7f26381920b8cf7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.298500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716e9bc8984c4669a7f26381920b8cf7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.299448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716e9bc8984c4669a7f26381920b8cf7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.306285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:48.349917 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1109/2212] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:48 2022] DELETE /identity/v3/users/716e9bc8984c4669a7f26381920b8cf7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:48.351341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:48.354409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:48.429316 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1104/2213] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:48.433585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed972909-b746-4f1d-82d0-9abc3f4a85fc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.434468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed972909-b746-4f1d-82d0-9abc3f4a85fc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.434928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed972909-b746-4f1d-82d0-9abc3f4a85fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.475759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ed972909-b746-4f1d-82d0-9abc3f4a85fc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:48.479084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ed972909-b746-4f1d-82d0-9abc3f4a85fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:48.497095 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1105/2214] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:48.497831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed972909-b746-4f1d-82d0-9abc3f4a85fc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:48.499673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985096a9-5c1f-4bcb-9ac9-ee2306c063fe admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.524667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6671b77-4308-4917-8c2f-874769f031d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.525442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6671b77-4308-4917-8c2f-874769f031d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.525588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6671b77-4308-4917-8c2f-874769f031d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.527032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6671b77-4308-4917-8c2f-874769f031d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.527032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6671b77-4308-4917-8c2f-874769f031d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.528348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6671b77-4308-4917-8c2f-874769f031d3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:48.555054 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1110/2215] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:48.555810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6671b77-4308-4917-8c2f-874769f031d3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:48.557720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a6671b77-4308-4917-8c2f-874769f031d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:48.598910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6671b77-4308-4917-8c2f-874769f031d3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.619229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.620323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.620704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.621079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] PATH_INFO: `/v3/projects/53b4bff7483e47bdb3e3876f9882875b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.622532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b4bff7483e47bdb3e3876f9882875b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.625761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:48.652662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed972909-b746-4f1d-82d0-9abc3f4a85fc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.663930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9ebc5-b5b3-4de5-b4ca-decbb6bd7a7e tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2b6636e33844b6bac12b6815440b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b69125820c19410cb213865b963b346c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.664982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9ebc5-b5b3-4de5-b4ca-decbb6bd7a7e tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.665479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9ebc5-b5b3-4de5-b4ca-decbb6bd7a7e tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.665976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9ebc5-b5b3-4de5-b4ca-decbb6bd7a7e tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.667625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9ebc5-b5b3-4de5-b4ca-decbb6bd7a7e tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:48.668343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9ebc5-b5b3-4de5-b4ca-decbb6bd7a7e tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.672806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9ebc5-b5b3-4de5-b4ca-decbb6bd7a7e tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:48.705765 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1106/2216] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:48.707255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9ebc5-b5b3-4de5-b4ca-decbb6bd7a7e tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:48.710496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8bf9ebc5-b5b3-4de5-b4ca-decbb6bd7a7e tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:48.720675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b4bff7483e47bdb3e3876f9882875b', 'request_id': 'req-f88b97b8-355b-4c12-8b0a-ac51114288a8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.733612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b4bff7483e47bdb3e3876f9882875b', 'request_id': 'req-f88b97b8-355b-4c12-8b0a-ac51114288a8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.749065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b4bff7483e47bdb3e3876f9882875b', 'request_id': 'req-f88b97b8-355b-4c12-8b0a-ac51114288a8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.780250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] The token cache is being invalidate because project 53b4bff7483e47bdb3e3876f9882875b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:48.781175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.782853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:48.786543 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1111/2217] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:48 2022] DELETE /identity/v3/projects/53b4bff7483e47bdb3e3876f9882875b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:48.788480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:48.792057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:48.803332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:48.826264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9ebc5-b5b3-4de5-b4ca-decbb6bd7a7e tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.940379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766caa2-b48d-45b8-8a89-d250e459aa06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.941403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766caa2-b48d-45b8-8a89-d250e459aa06 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.941904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766caa2-b48d-45b8-8a89-d250e459aa06 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.942424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766caa2-b48d-45b8-8a89-d250e459aa06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.943742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b97b8-355b-4c12-8b0a-ac51114288a8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:48.947393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1766caa2-b48d-45b8-8a89-d250e459aa06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:48.950207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459166c-f7f7-4890-8646-d74d0f35f677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:48.950917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459166c-f7f7-4890-8646-d74d0f35f677 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:48.951219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459166c-f7f7-4890-8646-d74d0f35f677 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:48.951541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459166c-f7f7-4890-8646-d74d0f35f677 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:48.952754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459166c-f7f7-4890-8646-d74d0f35f677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.954433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459166c-f7f7-4890-8646-d74d0f35f677 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:48.979344 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1112/2218] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:48.980573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459166c-f7f7-4890-8646-d74d0f35f677 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:48.984272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7459166c-f7f7-4890-8646-d74d0f35f677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:48.989645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766caa2-b48d-45b8-8a89-d250e459aa06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:48.993019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766caa2-b48d-45b8-8a89-d250e459aa06 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.006979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:49.019847 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1107/2219] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:49.021954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766caa2-b48d-45b8-8a89-d250e459aa06 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.024852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1766caa2-b48d-45b8-8a89-d250e459aa06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:49.052502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766caa2-b48d-45b8-8a89-d250e459aa06 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.062335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.063496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.064010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.064522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] PATH_INFO: `/v3/users/4e0ce2ba8fd34a6d8e9c9137385cce44` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.067120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0ce2ba8fd34a6d8e9c9137385cce44)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.071120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.110439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459166c-f7f7-4890-8646-d74d0f35f677 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.120550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88b040-34ac-44bd-8aab-673b13683fab tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2b6636e33844b6bac12b6815440b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b69125820c19410cb213865b963b346c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.121678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88b040-34ac-44bd-8aab-673b13683fab tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.122270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88b040-34ac-44bd-8aab-673b13683fab tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.122887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88b040-34ac-44bd-8aab-673b13683fab tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.124903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88b040-34ac-44bd-8aab-673b13683fab tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.127557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88b040-34ac-44bd-8aab-673b13683fab tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.182615 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1113/2220] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:48 2022] POST /identity/v3/projects => generated 371 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:49.187577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0ce2ba8fd34a6d8e9c9137385cce44'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:49.192152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88b040-34ac-44bd-8aab-673b13683fab tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.197256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0ce2ba8fd34a6d8e9c9137385cce44'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:49.205969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0ce2ba8fd34a6d8e9c9137385cce44'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:49.240300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0ce2ba8fd34a6d8e9c9137385cce44'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:49.241472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0ce2ba8fd34a6d8e9c9137385cce44'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:49.302023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88b040-34ac-44bd-8aab-673b13683fab tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.307345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd86d5-5097-4551-a8ad-91679d80632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.308115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd86d5-5097-4551-a8ad-91679d80632d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.308442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd86d5-5097-4551-a8ad-91679d80632d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.308669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd86d5-5097-4551-a8ad-91679d80632d admin admin] PATH_INFO: `/v3/projects/240f32c857b142a2b12d787d34b2258a/users/c44de5181d0642308c764ec20b7bd5ed/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.335384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd86d5-5097-4551-a8ad-91679d80632d admin admin] RBAC: Authorizing `identity:create_grant(project_id=240f32c857b142a2b12d787d34b2258a, user_id=c44de5181d0642308c764ec20b7bd5ed, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.338931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd86d5-5097-4551-a8ad-91679d80632d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.441928 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1108/2221] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:49 2022] DELETE /identity/v3/users/4e0ce2ba8fd34a6d8e9c9137385cce44 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:49.443512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.445280 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1114/2222] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:49 2022] PUT /identity/v3/projects/240f32c857b142a2b12d787d34b2258a/users/c44de5181d0642308c764ec20b7bd5ed/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:49.460144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4a0fc-dd6f-40cf-9c5c-233ebc7d9683 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.460447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4a0fc-dd6f-40cf-9c5c-233ebc7d9683 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.460746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4a0fc-dd6f-40cf-9c5c-233ebc7d9683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.470841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:49.497449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:49.553271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-46c4a0fc-dd6f-40cf-9c5c-233ebc7d9683 None None] MFA Rules not processed for user `c44de5181d0642308c764ec20b7bd5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:49.568843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-46c4a0fc-dd6f-40cf-9c5c-233ebc7d9683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:49.635755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037a9be-00ca-4a82-81d1-52fdc1b4f049 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.649032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3382e-204d-4547-91ca-0f0b55d185c6 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2b6636e33844b6bac12b6815440b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b69125820c19410cb213865b963b346c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.649396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3382e-204d-4547-91ca-0f0b55d185c6 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.649779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3382e-204d-4547-91ca-0f0b55d185c6 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.650454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3382e-204d-4547-91ca-0f0b55d185c6 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.651276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3382e-204d-4547-91ca-0f0b55d185c6 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:49.651657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3382e-204d-4547-91ca-0f0b55d185c6 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.653378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3382e-204d-4547-91ca-0f0b55d185c6 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.674521 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1109/2223] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:49.690997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3382e-204d-4547-91ca-0f0b55d185c6 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.694003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dbe3382e-204d-4547-91ca-0f0b55d185c6 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:49.741794 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1115/2224] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:49.748710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4a0fc-dd6f-40cf-9c5c-233ebc7d9683 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.753480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-46c4a0fc-dd6f-40cf-9c5c-233ebc7d9683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:49.815790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:49.828320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3382e-204d-4547-91ca-0f0b55d185c6 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.848081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973c1ab-52f7-4afa-9b5c-952fbe8cc693 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.848734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973c1ab-52f7-4afa-9b5c-952fbe8cc693 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.849018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973c1ab-52f7-4afa-9b5c-952fbe8cc693 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.849502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973c1ab-52f7-4afa-9b5c-952fbe8cc693 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.862127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973c1ab-52f7-4afa-9b5c-952fbe8cc693 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.863897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973c1ab-52f7-4afa-9b5c-952fbe8cc693 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.881001 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1110/2225] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:49.919894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4a0fc-dd6f-40cf-9c5c-233ebc7d9683 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:49.930870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f696ca-7b24-43b6-a9e1-a02222259659 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.931656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f696ca-7b24-43b6-a9e1-a02222259659 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.931977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d907e8c-b3da-4679-9779-b3935554da19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:49.932149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f696ca-7b24-43b6-a9e1-a02222259659 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.934688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907e8c-b3da-4679-9779-b3935554da19 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:49.935078 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1111/2226] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:52:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:52:49.936259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907e8c-b3da-4679-9779-b3935554da19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:49.939084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907e8c-b3da-4679-9779-b3935554da19 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:49.940323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d907e8c-b3da-4679-9779-b3935554da19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:49.944803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f696ca-7b24-43b6-a9e1-a02222259659 None None] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:52:49.945374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d907e8c-b3da-4679-9779-b3935554da19 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:49.973416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f696ca-7b24-43b6-a9e1-a02222259659 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:49.994612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f696ca-7b24-43b6-a9e1-a02222259659 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:50.005439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4dea-2ee9-4c46-9440-9519dc0b00f7 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2b6636e33844b6bac12b6815440b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b69125820c19410cb213865b963b346c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.007033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4dea-2ee9-4c46-9440-9519dc0b00f7 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.007793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4dea-2ee9-4c46-9440-9519dc0b00f7 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.008884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4dea-2ee9-4c46-9440-9519dc0b00f7 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] PATH_INFO: `/v3/projects/d6abb2b3f51e41c3935f295a4a3f46e7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.011591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d4dea-2ee9-4c46-9440-9519dc0b00f7 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorizing `identity:get_project(project_id=d6abb2b3f51e41c3935f295a4a3f46e7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.013299 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1116/2227] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:49 2022] POST /identity/v3/projects => generated 383 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:50.016939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d4dea-2ee9-4c46-9440-9519dc0b00f7 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.018696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d907e8c-b3da-4679-9779-b3935554da19 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.032572 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1112/2228] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:52:49 2022] GET /identity/v3/projects/d6abb2b3f51e41c3935f295a4a3f46e7 => generated 371 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:50.138334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d907e8c-b3da-4679-9779-b3935554da19 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:50.145710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac0116-b5cd-4f6f-ad42-6c1e04fe0654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.146519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac0116-b5cd-4f6f-ad42-6c1e04fe0654 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.146831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac0116-b5cd-4f6f-ad42-6c1e04fe0654 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.147276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac0116-b5cd-4f6f-ad42-6c1e04fe0654 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.148357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac0116-b5cd-4f6f-ad42-6c1e04fe0654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.151099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac0116-b5cd-4f6f-ad42-6c1e04fe0654 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.187636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4dea-2ee9-4c46-9440-9519dc0b00f7 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.191220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ce4d4dea-2ee9-4c46-9440-9519dc0b00f7 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:50.240726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4dea-2ee9-4c46-9440-9519dc0b00f7 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:50.244534 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1117/2229] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:50 2022] POST /identity/v3/users => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:50.246872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856a638-482e-4e02-8bef-2b31a61e4e11 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.247950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856a638-482e-4e02-8bef-2b31a61e4e11 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.249530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856a638-482e-4e02-8bef-2b31a61e4e11 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.265990 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1118/2230] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:52:50 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:50.268190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.269678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.270448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.271269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] PATH_INFO: `/v3/projects/5f17a741f87a420980407e965a26ba45` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.271878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856a638-482e-4e02-8bef-2b31a61e4e11 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.284177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f17a741f87a420980407e965a26ba45)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.288595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.319003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856a638-482e-4e02-8bef-2b31a61e4e11 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:50.340995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005f2a6-e32a-4b10-938e-96bb849ff53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.344623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005f2a6-e32a-4b10-938e-96bb849ff53c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.345915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005f2a6-e32a-4b10-938e-96bb849ff53c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.346510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005f2a6-e32a-4b10-938e-96bb849ff53c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.347766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005f2a6-e32a-4b10-938e-96bb849ff53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.351591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005f2a6-e32a-4b10-938e-96bb849ff53c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.362938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:50.387205 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1119/2231] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:50.387205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005f2a6-e32a-4b10-938e-96bb849ff53c admin admin] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:52:50.388461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6005f2a6-e32a-4b10-938e-96bb849ff53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:50.421782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f17a741f87a420980407e965a26ba45', 'request_id': 'req-388f1e93-d06e-4264-95aa-d0796c010442'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:50.434446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f17a741f87a420980407e965a26ba45', 'request_id': 'req-388f1e93-d06e-4264-95aa-d0796c010442'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:50.449367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f17a741f87a420980407e965a26ba45', 'request_id': 'req-388f1e93-d06e-4264-95aa-d0796c010442'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:50.478155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] The token cache is being invalidate because project 5f17a741f87a420980407e965a26ba45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:50.478855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:50.480777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:50.484774 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1113/2232] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:50 2022] DELETE /identity/v3/projects/5f17a741f87a420980407e965a26ba45 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:50.486561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.491860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:50.575408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005f2a6-e32a-4b10-938e-96bb849ff53c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.643856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f1e93-d06e-4264-95aa-d0796c010442 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:50.649377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.650301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.650790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.651281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] PATH_INFO: `/v3/projects/1aaf8595fa6f491e918b58185c258120` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.652649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aaf8595fa6f491e918b58185c258120)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.655800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.714560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005f2a6-e32a-4b10-938e-96bb849ff53c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:50.766033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aaf8595fa6f491e918b58185c258120', 'request_id': 'req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:50.777050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aaf8595fa6f491e918b58185c258120', 'request_id': 'req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:50.789508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aaf8595fa6f491e918b58185c258120', 'request_id': 'req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:50.793402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:50.820510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] The token cache is being invalidate because project 1aaf8595fa6f491e918b58185c258120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:50.821909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:50.822822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:50.825186 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1114/2233] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:50 2022] DELETE /identity/v3/projects/1aaf8595fa6f491e918b58185c258120 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:50.828061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.830181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:50.870402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed42c2d-d635-4477-ad80-d99d0eafe263 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2b6636e33844b6bac12b6815440b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b69125820c19410cb213865b963b346c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:50.872631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42c2d-d635-4477-ad80-d99d0eafe263 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:50.873123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42c2d-d635-4477-ad80-d99d0eafe263 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:50.873904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42c2d-d635-4477-ad80-d99d0eafe263 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] PATH_INFO: `/v3/projects/d6abb2b3f51e41c3935f295a4a3f46e7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:50.876448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed42c2d-d635-4477-ad80-d99d0eafe263 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorizing `identity:get_project(project_id=d6abb2b3f51e41c3935f295a4a3f46e7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:50.885298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed42c2d-d635-4477-ad80-d99d0eafe263 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:50.888282 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1120/2234] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:52:50 2022] GET /identity/v3/projects/d6abb2b3f51e41c3935f295a4a3f46e7 => generated 371 bytes in 505 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:50.892665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed42c2d-d635-4477-ad80-d99d0eafe263 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:50.903204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2ed42c2d-d635-4477-ad80-d99d0eafe263 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:50.995459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37c2e8-b560-4f60-9da0-8b1e9c07c9c2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:51.014683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9b3d9-709e-408a-84a9-7624f0e63e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:51.016197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b3d9-709e-408a-84a9-7624f0e63e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:51.018547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b3d9-709e-408a-84a9-7624f0e63e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:51.019106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9b3d9-709e-408a-84a9-7624f0e63e69 admin admin] PATH_INFO: `/v3/projects/6813a4efcabf4cda9590f166c8d6bd81/users/8de57f0f51e04871a70af837efa75c15/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:51.025601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:51.075730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9b3d9-709e-408a-84a9-7624f0e63e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6813a4efcabf4cda9590f166c8d6bd81, user_id=8de57f0f51e04871a70af837efa75c15, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:51.078078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed42c2d-d635-4477-ad80-d99d0eafe263 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:51.086629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:51.086948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9b3d9-709e-408a-84a9-7624f0e63e69 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:51.087432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:51.087907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:51.088270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] PATH_INFO: `/v3/users/08b59c14ebf547838edacbaceecb9f29` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:51.089721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b59c14ebf547838edacbaceecb9f29)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:51.092404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:51.116913 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1115/2235] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:50 2022] PUT /identity/v3/projects/6813a4efcabf4cda9590f166c8d6bd81/users/8de57f0f51e04871a70af837efa75c15/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:51.118284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad3cc9-e4cc-4dfd-b0c8-f5e5437b250d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:51.118579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad3cc9-e4cc-4dfd-b0c8-f5e5437b250d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:51.118890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad3cc9-e4cc-4dfd-b0c8-f5e5437b250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:51.153821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-34ad3cc9-e4cc-4dfd-b0c8-f5e5437b250d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:51.156768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-34ad3cc9-e4cc-4dfd-b0c8-f5e5437b250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:51.221198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b59c14ebf547838edacbaceecb9f29'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:51.261098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b59c14ebf547838edacbaceecb9f29'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:51.263383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b59c14ebf547838edacbaceecb9f29'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:51.291119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b59c14ebf547838edacbaceecb9f29'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:51.291819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b59c14ebf547838edacbaceecb9f29'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:51.295800 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1116/2236] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:51.297112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad3cc9-e4cc-4dfd-b0c8-f5e5437b250d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:51.300658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-34ad3cc9-e4cc-4dfd-b0c8-f5e5437b250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:51.341554 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1121/2237] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:50 2022] DELETE /identity/v3/users/08b59c14ebf547838edacbaceecb9f29 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:51.343183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:51.349500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:51.462545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad3cc9-e4cc-4dfd-b0c8-f5e5437b250d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:51.511889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee942ce-03ea-442c-9fb8-198e39795224 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:51.526759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:51.531038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcb9fc-317e-41ab-8d34-683e3a827982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:51.531695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcb9fc-317e-41ab-8d34-683e3a827982 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:51.531994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcb9fc-317e-41ab-8d34-683e3a827982 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:51.532288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcb9fc-317e-41ab-8d34-683e3a827982 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:51.542871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcb9fc-317e-41ab-8d34-683e3a827982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:51.542871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcb9fc-317e-41ab-8d34-683e3a827982 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:51.557544 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1122/2238] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:51.557544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca452c6-f0a4-4823-939d-d297d8664a4d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:51.557544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca452c6-f0a4-4823-939d-d297d8664a4d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:51.558872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca452c6-f0a4-4823-939d-d297d8664a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:51.624711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e860a7-bc4b-44a9-9ba5-53e669034491 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2b6636e33844b6bac12b6815440b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b69125820c19410cb213865b963b346c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:51.626102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e860a7-bc4b-44a9-9ba5-53e669034491 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:51.628092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e860a7-bc4b-44a9-9ba5-53e669034491 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:51.628435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e860a7-bc4b-44a9-9ba5-53e669034491 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:51.629217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e860a7-bc4b-44a9-9ba5-53e669034491 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:51.631043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e860a7-bc4b-44a9-9ba5-53e669034491 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:51.637277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e860a7-bc4b-44a9-9ba5-53e669034491 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:51.647176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5ca452c6-f0a4-4823-939d-d297d8664a4d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:51.648538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5ca452c6-f0a4-4823-939d-d297d8664a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:51.665916 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1117/2239] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:51.667241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e860a7-bc4b-44a9-9ba5-53e669034491 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:51.673773 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1123/2240] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:51.674686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca452c6-f0a4-4823-939d-d297d8664a4d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:51.677359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5ca452c6-f0a4-4823-939d-d297d8664a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:51.683672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e860a7-bc4b-44a9-9ba5-53e669034491 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:51.692759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc601bd-6dd8-42f5-aa30-8e5f08f17b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:51.695815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc601bd-6dd8-42f5-aa30-8e5f08f17b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:51.696288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc601bd-6dd8-42f5-aa30-8e5f08f17b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:51.698116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc601bd-6dd8-42f5-aa30-8e5f08f17b56 admin admin] PATH_INFO: `/v3/projects/6813a4efcabf4cda9590f166c8d6bd81/users/8de57f0f51e04871a70af837efa75c15/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:51.709550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc601bd-6dd8-42f5-aa30-8e5f08f17b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6813a4efcabf4cda9590f166c8d6bd81, user_id=8de57f0f51e04871a70af837efa75c15, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:51.713034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca452c6-f0a4-4823-939d-d297d8664a4d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:51.717594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc601bd-6dd8-42f5-aa30-8e5f08f17b56 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:51.728757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6fb04-2848-4724-a859-ed4a144a0e21 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2b6636e33844b6bac12b6815440b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b69125820c19410cb213865b963b346c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:51.730768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6fb04-2848-4724-a859-ed4a144a0e21 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:51.731646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6fb04-2848-4724-a859-ed4a144a0e21 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:51.737099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6fb04-2848-4724-a859-ed4a144a0e21 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:51.739107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6fb04-2848-4724-a859-ed4a144a0e21 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:51.741532 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1118/2241] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:51 2022] PUT /identity/v3/projects/6813a4efcabf4cda9590f166c8d6bd81/users/8de57f0f51e04871a70af837efa75c15/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:51.745783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6fb04-2848-4724-a859-ed4a144a0e21 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:51.750322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc601bd-6dd8-42f5-aa30-8e5f08f17b56 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:51.855032 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1124/2242] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:51 2022] POST /identity/v3/users => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:51.872225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d6001-40db-410c-8eec-2852001287c7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:51.873994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d6001-40db-410c-8eec-2852001287c7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:51.874489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d6001-40db-410c-8eec-2852001287c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:51.954150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a73d6001-40db-410c-8eec-2852001287c7 None None] MFA Rules not processed for user `8de57f0f51e04871a70af837efa75c15`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:51.963194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a73d6001-40db-410c-8eec-2852001287c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:52.015455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:52.040687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc601bd-6dd8-42f5-aa30-8e5f08f17b56 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:52.051717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a724f6-d775-4d61-baee-8c6a397ca34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:52.052398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a724f6-d775-4d61-baee-8c6a397ca34f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:52.052716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a724f6-d775-4d61-baee-8c6a397ca34f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:52.053021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a724f6-d775-4d61-baee-8c6a397ca34f admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:52.053691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a724f6-d775-4d61-baee-8c6a397ca34f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:52.054005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a724f6-d775-4d61-baee-8c6a397ca34f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:52.063987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a724f6-d775-4d61-baee-8c6a397ca34f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:52.095992 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1119/2243] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:52.097719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a724f6-d775-4d61-baee-8c6a397ca34f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:52.107799 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1125/2244] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:52.110143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d6001-40db-410c-8eec-2852001287c7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:52.152216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d6001-40db-410c-8eec-2852001287c7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:52.166513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3edf5-fd03-472f-9f6f-e157abffaa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:52.177055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3edf5-fd03-472f-9f6f-e157abffaa93 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:52.177055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3edf5-fd03-472f-9f6f-e157abffaa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:52.177055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3edf5-fd03-472f-9f6f-e157abffaa93 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:52.179041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3edf5-fd03-472f-9f6f-e157abffaa93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:52.184746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3edf5-fd03-472f-9f6f-e157abffaa93 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:52.227001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a724f6-d775-4d61-baee-8c6a397ca34f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:52.231569 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1126/2245] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:52 2022] POST /identity/v3/projects => generated 397 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:52.233700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3edf5-fd03-472f-9f6f-e157abffaa93 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:52.236403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-66b3edf5-fd03-472f-9f6f-e157abffaa93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:52.238101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a1426-67ed-4210-9b6c-6afaf8902385 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2b6636e33844b6bac12b6815440b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b69125820c19410cb213865b963b346c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:52.239040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a1426-67ed-4210-9b6c-6afaf8902385 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:52.239563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a1426-67ed-4210-9b6c-6afaf8902385 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:52.240321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a1426-67ed-4210-9b6c-6afaf8902385 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:52.241198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a1426-67ed-4210-9b6c-6afaf8902385 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:52.241928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a1426-67ed-4210-9b6c-6afaf8902385 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:52.243880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a1426-67ed-4210-9b6c-6afaf8902385 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:52.259264 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1120/2246] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:52.260964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a1426-67ed-4210-9b6c-6afaf8902385 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:52.302615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a1426-67ed-4210-9b6c-6afaf8902385 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:52.368511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:52.406729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3edf5-fd03-472f-9f6f-e157abffaa93 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:52.411041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9b22c-263a-47b9-bff6-813d65adb376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:52.411723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9b22c-263a-47b9-bff6-813d65adb376 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:52.412016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9b22c-263a-47b9-bff6-813d65adb376 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:52.412300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9b22c-263a-47b9-bff6-813d65adb376 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:52.413191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9b22c-263a-47b9-bff6-813d65adb376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:52.413995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430c84b-fb2b-4ff2-b4a4-68dc97db2728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:52.414618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430c84b-fb2b-4ff2-b4a4-68dc97db2728 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:52.414927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430c84b-fb2b-4ff2-b4a4-68dc97db2728 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:52.415206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430c84b-fb2b-4ff2-b4a4-68dc97db2728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:52.415369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9b22c-263a-47b9-bff6-813d65adb376 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:52.417504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e430c84b-fb2b-4ff2-b4a4-68dc97db2728 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:52.446600 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1121/2247] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:52 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:52.448340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9b22c-263a-47b9-bff6-813d65adb376 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:52.451106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-55d9b22c-263a-47b9-bff6-813d65adb376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:52.465303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9b22c-263a-47b9-bff6-813d65adb376 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:52.482948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:52.486274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:52.487688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:52.488031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] PATH_INFO: `/v3/projects/c12094d8578943e5aae96ea7f8fc258a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:52.489632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c12094d8578943e5aae96ea7f8fc258a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:52.491770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:52.533742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430c84b-fb2b-4ff2-b4a4-68dc97db2728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:52.536928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e430c84b-fb2b-4ff2-b4a4-68dc97db2728 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:52.550852 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1127/2248] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:52.552314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdbf23-a792-4f25-b5e7-4c52089ec61a None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:52.552710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdbf23-a792-4f25-b5e7-4c52089ec61a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:52.553081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdbf23-a792-4f25-b5e7-4c52089ec61a None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:52.554859 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1128/2249] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:52.555904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdbf23-a792-4f25-b5e7-4c52089ec61a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:52.580672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdbf23-a792-4f25-b5e7-4c52089ec61a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:52.615268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c12094d8578943e5aae96ea7f8fc258a', 'request_id': 'req-5630d949-3a08-4899-befa-1f45dd55c943'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.633889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c12094d8578943e5aae96ea7f8fc258a', 'request_id': 'req-5630d949-3a08-4899-befa-1f45dd55c943'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.651495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c12094d8578943e5aae96ea7f8fc258a', 'request_id': 'req-5630d949-3a08-4899-befa-1f45dd55c943'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.666471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:52.687728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] The token cache is being invalidate because project c12094d8578943e5aae96ea7f8fc258a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:52.688309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.689119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.694785 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1122/2250] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:52 2022] DELETE /identity/v3/projects/c12094d8578943e5aae96ea7f8fc258a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:52.698244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:52:52.700504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:52.718996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27436aa-a19b-4dda-abdc-a897f5e24b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:52.720463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27436aa-a19b-4dda-abdc-a897f5e24b12 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:52.721181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27436aa-a19b-4dda-abdc-a897f5e24b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:52.721897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27436aa-a19b-4dda-abdc-a897f5e24b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:52.723446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27436aa-a19b-4dda-abdc-a897f5e24b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:52.727476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27436aa-a19b-4dda-abdc-a897f5e24b12 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:52.754618 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1129/2251] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:52.756188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27436aa-a19b-4dda-abdc-a897f5e24b12 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:52.759875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c27436aa-a19b-4dda-abdc-a897f5e24b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:52.790150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27436aa-a19b-4dda-abdc-a897f5e24b12 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:52.798589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf53bbc-1bbb-45ff-ae18-0dfee94a8238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:52.800448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf53bbc-1bbb-45ff-ae18-0dfee94a8238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:52.801048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf53bbc-1bbb-45ff-ae18-0dfee94a8238 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:52.801534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf53bbc-1bbb-45ff-ae18-0dfee94a8238 admin admin] PATH_INFO: `/v3/users/c44de5181d0642308c764ec20b7bd5ed` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:52.803415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf53bbc-1bbb-45ff-ae18-0dfee94a8238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44de5181d0642308c764ec20b7bd5ed)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:52.807586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf53bbc-1bbb-45ff-ae18-0dfee94a8238 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:52.900219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:52.901573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:52.910271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bbf53bbc-1bbb-45ff-ae18-0dfee94a8238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44de5181d0642308c764ec20b7bd5ed'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.925438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bbf53bbc-1bbb-45ff-ae18-0dfee94a8238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44de5181d0642308c764ec20b7bd5ed'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.926500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bbf53bbc-1bbb-45ff-ae18-0dfee94a8238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44de5181d0642308c764ec20b7bd5ed'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.943473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bbf53bbc-1bbb-45ff-ae18-0dfee94a8238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44de5181d0642308c764ec20b7bd5ed'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.944126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bbf53bbc-1bbb-45ff-ae18-0dfee94a8238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44de5181d0642308c764ec20b7bd5ed'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:52.979225 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1130/2252] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:52 2022] DELETE /identity/v3/users/c44de5181d0642308c764ec20b7bd5ed => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:52.980340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030123d9-54b4-4545-a91a-e54bd50dfd93 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:52.980770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030123d9-54b4-4545-a91a-e54bd50dfd93 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:52.981153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030123d9-54b4-4545-a91a-e54bd50dfd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:52.989896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:53.028630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-030123d9-54b4-4545-a91a-e54bd50dfd93 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:53.030189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-030123d9-54b4-4545-a91a-e54bd50dfd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:53.039576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630d949-3a08-4899-befa-1f45dd55c943 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:53.163529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d55d38-6311-41ab-ab30-062f40f00cd8 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2b6636e33844b6bac12b6815440b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b69125820c19410cb213865b963b346c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:53.164724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d55d38-6311-41ab-ab30-062f40f00cd8 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:53.165632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d55d38-6311-41ab-ab30-062f40f00cd8 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:53.166145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d55d38-6311-41ab-ab30-062f40f00cd8 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] PATH_INFO: `/v3/projects/d6abb2b3f51e41c3935f295a4a3f46e7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:53.169786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d55d38-6311-41ab-ab30-062f40f00cd8 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorizing `identity:get_project(project_id=d6abb2b3f51e41c3935f295a4a3f46e7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:53.174310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d55d38-6311-41ab-ab30-062f40f00cd8 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:53.177082 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1131/2253] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:53.178101 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1123/2254] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:52:52 2022] GET /identity/v3/projects/d6abb2b3f51e41c3935f295a4a3f46e7 => generated 371 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:53.178661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030123d9-54b4-4545-a91a-e54bd50dfd93 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:53.180287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d55d38-6311-41ab-ab30-062f40f00cd8 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:53.180968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-030123d9-54b4-4545-a91a-e54bd50dfd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:53.182837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d3d55d38-6311-41ab-ab30-062f40f00cd8 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:53.200326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030123d9-54b4-4545-a91a-e54bd50dfd93 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:53.224118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc124e-0c84-4053-b90a-9bc70e859264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:53.225208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc124e-0c84-4053-b90a-9bc70e859264 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:53.225718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc124e-0c84-4053-b90a-9bc70e859264 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:53.226211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc124e-0c84-4053-b90a-9bc70e859264 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:53.227463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc124e-0c84-4053-b90a-9bc70e859264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:53.230985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc124e-0c84-4053-b90a-9bc70e859264 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:53.257942 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1132/2255] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:53.260443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a21db-ddd8-4157-ada7-d1a9abd05cc8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:53.261308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a21db-ddd8-4157-ada7-d1a9abd05cc8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:53.261830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a21db-ddd8-4157-ada7-d1a9abd05cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:53.307981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fa6a21db-ddd8-4157-ada7-d1a9abd05cc8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:53.311779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fa6a21db-ddd8-4157-ada7-d1a9abd05cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:53.339508 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1133/2256] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:53.342760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e5c4b-192a-48bb-be24-b34c3944a575 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:53.343510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e5c4b-192a-48bb-be24-b34c3944a575 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:53.344001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e5c4b-192a-48bb-be24-b34c3944a575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:53.393781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d55d38-6311-41ab-ab30-062f40f00cd8 tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:53.398334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3f4e5c4b-192a-48bb-be24-b34c3944a575 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:53.401142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3f4e5c4b-192a-48bb-be24-b34c3944a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:53.406521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920735c-9b5e-4ae5-b71d-173d0c5820d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:53.408228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920735c-9b5e-4ae5-b71d-173d0c5820d4 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:53.409634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920735c-9b5e-4ae5-b71d-173d0c5820d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:53.410316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920735c-9b5e-4ae5-b71d-173d0c5820d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:53.414968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d920735c-9b5e-4ae5-b71d-173d0c5820d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:53.421717 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1134/2257] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:53.421717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e5c4b-192a-48bb-be24-b34c3944a575 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:53.450373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e5c4b-192a-48bb-be24-b34c3944a575 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:53.474648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3954b4-b572-41a4-8dc1-4861cc542720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:53.475373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3954b4-b572-41a4-8dc1-4861cc542720 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:53.478591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3954b4-b572-41a4-8dc1-4861cc542720 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:53.479034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3954b4-b572-41a4-8dc1-4861cc542720 admin admin] PATH_INFO: `/v3/projects/99992536b70f41aa9dbdbf358cd6b2bb/users/3b738496864a4b04bc885b75980e2341/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:53.533064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3954b4-b572-41a4-8dc1-4861cc542720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99992536b70f41aa9dbdbf358cd6b2bb, user_id=3b738496864a4b04bc885b75980e2341, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:53.540573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3954b4-b572-41a4-8dc1-4861cc542720 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:53.552283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:53.581772 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1135/2258] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:53 2022] PUT /identity/v3/projects/99992536b70f41aa9dbdbf358cd6b2bb/users/3b738496864a4b04bc885b75980e2341/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:53.582658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3954b4-b572-41a4-8dc1-4861cc542720 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:53.588713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0b3954b4-b572-41a4-8dc1-4861cc542720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:53.589929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920735c-9b5e-4ae5-b71d-173d0c5820d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:53.593966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920735c-9b5e-4ae5-b71d-173d0c5820d4 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:53.615414 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1124/2259] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:53 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:53.616781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920735c-9b5e-4ae5-b71d-173d0c5820d4 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:53.674478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920735c-9b5e-4ae5-b71d-173d0c5820d4 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:53.738854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:53.812065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3954b4-b572-41a4-8dc1-4861cc542720 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:53.830143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e871e6d-4a22-4433-9c48-b5b7dd41a97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:53.831195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e871e6d-4a22-4433-9c48-b5b7dd41a97a service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:53.831659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e871e6d-4a22-4433-9c48-b5b7dd41a97a service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:53.832167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e871e6d-4a22-4433-9c48-b5b7dd41a97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:53.895315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc37113-4343-4b94-b7e5-2c5fd00f10a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:53.896329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc37113-4343-4b94-b7e5-2c5fd00f10a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:53.896691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc37113-4343-4b94-b7e5-2c5fd00f10a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:53.897143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc37113-4343-4b94-b7e5-2c5fd00f10a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:53.902086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc37113-4343-4b94-b7e5-2c5fd00f10a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:53.902548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc37113-4343-4b94-b7e5-2c5fd00f10a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:53.911539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc37113-4343-4b94-b7e5-2c5fd00f10a8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:53.939050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e871e6d-4a22-4433-9c48-b5b7dd41a97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:53.940693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e871e6d-4a22-4433-9c48-b5b7dd41a97a service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:53.955715 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1136/2260] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:53.958063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3ec6a-ae7e-4dbc-9089-7c4ffebe609d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:53.958503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3ec6a-ae7e-4dbc-9089-7c4ffebe609d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:53.959063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3ec6a-ae7e-4dbc-9089-7c4ffebe609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:53.964388 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1125/2261] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:53.966043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5e05-a77a-4fac-a86e-7e8cd77a5e1d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:53.966408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5e05-a77a-4fac-a86e-7e8cd77a5e1d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:53.966596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f5e05-a77a-4fac-a86e-7e8cd77a5e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.019413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-53f3ec6a-ae7e-4dbc-9089-7c4ffebe609d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:54.023187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-53f3ec6a-ae7e-4dbc-9089-7c4ffebe609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:54.025382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-167f5e05-a77a-4fac-a86e-7e8cd77a5e1d None None] MFA Rules not processed for user `17f0024362414fb29af577c3d6019347`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:54.030978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-167f5e05-a77a-4fac-a86e-7e8cd77a5e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:54.052804 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1137/2262] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:54.052804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb892a-f289-4be5-86d1-3c0111304775 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:54.053089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb892a-f289-4be5-86d1-3c0111304775 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:54.053955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb892a-f289-4be5-86d1-3c0111304775 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.062765 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1138/2263] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:52:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:52:54.063895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb892a-f289-4be5-86d1-3c0111304775 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:54.094292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb892a-f289-4be5-86d1-3c0111304775 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:54.100369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f49cf-4d26-4dbd-907a-f70b4c1cc255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:54.100987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f49cf-4d26-4dbd-907a-f70b4c1cc255 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:54.101264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f49cf-4d26-4dbd-907a-f70b4c1cc255 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:54.101535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f49cf-4d26-4dbd-907a-f70b4c1cc255 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.102377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f49cf-4d26-4dbd-907a-f70b4c1cc255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:54.104448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f49cf-4d26-4dbd-907a-f70b4c1cc255 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:54.155750 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1139/2264] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:54 2022] POST /identity/v3/projects => generated 409 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:54.157164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f49cf-4d26-4dbd-907a-f70b4c1cc255 admin admin] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:52:54.198601 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1126/2265] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:54.199749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f5e05-a77a-4fac-a86e-7e8cd77a5e1d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:54.225957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f5e05-a77a-4fac-a86e-7e8cd77a5e1d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:54.325402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f49cf-4d26-4dbd-907a-f70b4c1cc255 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:54.327542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07350923-0507-4735-9098-def62e29b8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:54.327774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07350923-0507-4735-9098-def62e29b8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:54.328267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07350923-0507-4735-9098-def62e29b8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:54.328669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07350923-0507-4735-9098-def62e29b8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.332238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-498f49cf-4d26-4dbd-907a-f70b4c1cc255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:54.368850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:54.435014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07350923-0507-4735-9098-def62e29b8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:54.436595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07350923-0507-4735-9098-def62e29b8d2 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:54.465942 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1127/2266] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:54.466693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07350923-0507-4735-9098-def62e29b8d2 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:54.491520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07350923-0507-4735-9098-def62e29b8d2 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:54.505854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135d67-afb3-48aa-8a6b-ce827a863736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:54.506491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135d67-afb3-48aa-8a6b-ce827a863736 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:54.506904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135d67-afb3-48aa-8a6b-ce827a863736 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:54.507182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135d67-afb3-48aa-8a6b-ce827a863736 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.507834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135d67-afb3-48aa-8a6b-ce827a863736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:54.512610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f49cf-4d26-4dbd-907a-f70b4c1cc255 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:54.513775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135d67-afb3-48aa-8a6b-ce827a863736 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:54.523062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd9f9-c849-4743-ad65-7ac88f6b166c tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2b6636e33844b6bac12b6815440b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b69125820c19410cb213865b963b346c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:54.523722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd9f9-c849-4743-ad65-7ac88f6b166c tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:54.524006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd9f9-c849-4743-ad65-7ac88f6b166c tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:54.524278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd9f9-c849-4743-ad65-7ac88f6b166c tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] PATH_INFO: `/v3/projects/d6abb2b3f51e41c3935f295a4a3f46e7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.531327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cd9f9-c849-4743-ad65-7ac88f6b166c tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorizing `identity:get_project(project_id=d6abb2b3f51e41c3935f295a4a3f46e7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:54.533440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cd9f9-c849-4743-ad65-7ac88f6b166c tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:54.540561 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1140/2267] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:52:54 2022] GET /identity/v3/projects/d6abb2b3f51e41c3935f295a4a3f46e7 => generated 371 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:54.540788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:54.582955 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1128/2268] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:54 2022] POST /identity/v3/users => generated 305 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:54.588100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd9f9-c849-4743-ad65-7ac88f6b166c tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:54.603658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd9f9-c849-4743-ad65-7ac88f6b166c tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:54.611015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135d67-afb3-48aa-8a6b-ce827a863736 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:54.629924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135d67-afb3-48aa-8a6b-ce827a863736 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:54.635044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081528c-d671-422f-a382-a817a3940d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:54.636008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081528c-d671-422f-a382-a817a3940d6b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:54.636120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081528c-d671-422f-a382-a817a3940d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:54.636434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081528c-d671-422f-a382-a817a3940d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.637300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081528c-d671-422f-a382-a817a3940d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:54.641851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081528c-d671-422f-a382-a817a3940d6b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:54.651086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2b6636e33844b6bac12b6815440b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b69125820c19410cb213865b963b346c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:54.651980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:54.652369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:54.653067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] PATH_INFO: `/v3/users/c3842b55d4c24112b1ce51fe01d0541a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.683063 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1141/2269] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:54.692503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081528c-d671-422f-a382-a817a3940d6b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:54.713204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c3842b55d4c24112b1ce51fe01d0541a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:54.716247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:54.733755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081528c-d671-422f-a382-a817a3940d6b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:54.756304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46118d53-c4f0-4e2d-8e6f-20a815654b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:54.757140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46118d53-c4f0-4e2d-8e6f-20a815654b01 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:54.757532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46118d53-c4f0-4e2d-8e6f-20a815654b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:54.757906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46118d53-c4f0-4e2d-8e6f-20a815654b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.763202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46118d53-c4f0-4e2d-8e6f-20a815654b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:54.771587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46118d53-c4f0-4e2d-8e6f-20a815654b01 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:54.805081 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1142/2270] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:54.807029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46118d53-c4f0-4e2d-8e6f-20a815654b01 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:54.812086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-46118d53-c4f0-4e2d-8e6f-20a815654b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:54.860004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46118d53-c4f0-4e2d-8e6f-20a815654b01 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:54.871270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3842b55d4c24112b1ce51fe01d0541a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.878711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:54.880768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:54.882478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:54.883024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] PATH_INFO: `/v3/projects/240f32c857b142a2b12d787d34b2258a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:54.887750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=240f32c857b142a2b12d787d34b2258a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:54.890326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:54.898305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3842b55d4c24112b1ce51fe01d0541a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.899758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3842b55d4c24112b1ce51fe01d0541a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.948412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3842b55d4c24112b1ce51fe01d0541a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.949324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3842b55d4c24112b1ce51fe01d0541a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:54.977134 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1129/2271] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:54 2022] DELETE /identity/v3/users/c3842b55d4c24112b1ce51fe01d0541a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:52:54.979475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:54.984694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:55.041411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '240f32c857b142a2b12d787d34b2258a', 'request_id': 'req-0e522f74-3b5c-429f-b580-a8ebfe96ba27'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.057609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '240f32c857b142a2b12d787d34b2258a', 'request_id': 'req-0e522f74-3b5c-429f-b580-a8ebfe96ba27'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.076900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '240f32c857b142a2b12d787d34b2258a', 'request_id': 'req-0e522f74-3b5c-429f-b580-a8ebfe96ba27'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.100794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] The token cache is being invalidate because project 240f32c857b142a2b12d787d34b2258a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:55.102173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.104617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.108348 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1143/2272] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:54 2022] DELETE /identity/v3/projects/240f32c857b142a2b12d787d34b2258a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:55.109680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:55.117020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:55.206229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d688d9-6c28-42bc-b1a3-78326d6fdafa tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:55.337972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e522f74-3b5c-429f-b580-a8ebfe96ba27 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:55.366327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd6ee3-01fd-42da-9bfc-e494875981ac tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2b6636e33844b6bac12b6815440b22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b69125820c19410cb213865b963b346c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:55.368458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd6ee3-01fd-42da-9bfc-e494875981ac tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:55.368752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd6ee3-01fd-42da-9bfc-e494875981ac tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:55.370521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd6ee3-01fd-42da-9bfc-e494875981ac tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] PATH_INFO: `/v3/projects/d6abb2b3f51e41c3935f295a4a3f46e7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:55.377054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb78f3-d231-4dc6-8476-cb13069ffa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:55.378034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb78f3-d231-4dc6-8476-cb13069ffa4e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:55.378436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb78f3-d231-4dc6-8476-cb13069ffa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:55.378847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb78f3-d231-4dc6-8476-cb13069ffa4e admin admin] PATH_INFO: `/v3/projects/54d666e2641c4f978bdebaf42a87cfc9/users/fd4f1fe87a7d4e5aac567139735f5b2b/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:55.392040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd6ee3-01fd-42da-9bfc-e494875981ac tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d6abb2b3f51e41c3935f295a4a3f46e7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:55.394841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd6ee3-01fd-42da-9bfc-e494875981ac tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:55.402098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:55.424212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb78f3-d231-4dc6-8476-cb13069ffa4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d666e2641c4f978bdebaf42a87cfc9, user_id=fd4f1fe87a7d4e5aac567139735f5b2b, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:55.429047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb78f3-d231-4dc6-8476-cb13069ffa4e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:55.444765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:55.462810 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1130/2273] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:54 2022] PUT /identity/v3/projects/54d666e2641c4f978bdebaf42a87cfc9/users/fd4f1fe87a7d4e5aac567139735f5b2b/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:55.462810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb78f3-d231-4dc6-8476-cb13069ffa4e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:55.462810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0feb78f3-d231-4dc6-8476-cb13069ffa4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:55.588721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8ebd6ee3-01fd-42da-9bfc-e494875981ac tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6abb2b3f51e41c3935f295a4a3f46e7', 'request_id': 'req-8ebd6ee3-01fd-42da-9bfc-e494875981ac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.622168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8ebd6ee3-01fd-42da-9bfc-e494875981ac tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6abb2b3f51e41c3935f295a4a3f46e7', 'request_id': 'req-8ebd6ee3-01fd-42da-9bfc-e494875981ac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.641995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb78f3-d231-4dc6-8476-cb13069ffa4e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:55.656724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8ebd6ee3-01fd-42da-9bfc-e494875981ac tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6abb2b3f51e41c3935f295a4a3f46e7', 'request_id': 'req-8ebd6ee3-01fd-42da-9bfc-e494875981ac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.703330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8ebd6ee3-01fd-42da-9bfc-e494875981ac tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] The token cache is being invalidate because project d6abb2b3f51e41c3935f295a4a3f46e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:55.703873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8ebd6ee3-01fd-42da-9bfc-e494875981ac tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.711245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8ebd6ee3-01fd-42da-9bfc-e494875981ac tempest-QuotasAdminTestV257-454151880 tempest-QuotasAdminTestV257-454151880-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.716375 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1144/2274] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:55 2022] DELETE /identity/v3/projects/d6abb2b3f51e41c3935f295a4a3f46e7 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:55.718238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d63d02-7195-469d-8631-fb4bcf6c1fb6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:55.719911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d63d02-7195-469d-8631-fb4bcf6c1fb6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:55.720800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d63d02-7195-469d-8631-fb4bcf6c1fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:55.729297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:55.730120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:55.730407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:55.730818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] PATH_INFO: `/v3/users/8de57f0f51e04871a70af837efa75c15` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:55.732142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de57f0f51e04871a70af837efa75c15)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:55.735333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:55.822411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c4d63d02-7195-469d-8631-fb4bcf6c1fb6 None None] MFA Rules not processed for user `fd4f1fe87a7d4e5aac567139735f5b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:55.828219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de57f0f51e04871a70af837efa75c15'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.837430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c4d63d02-7195-469d-8631-fb4bcf6c1fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:55.841309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de57f0f51e04871a70af837efa75c15'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.843776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de57f0f51e04871a70af837efa75c15'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.872782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de57f0f51e04871a70af837efa75c15'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.874184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de57f0f51e04871a70af837efa75c15'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:55.935202 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1131/2275] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:55 2022] DELETE /identity/v3/users/8de57f0f51e04871a70af837efa75c15 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:55.938097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:55.952022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:56.013739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:56.044154 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1145/2276] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:55 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:56.048956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d63d02-7195-469d-8631-fb4bcf6c1fb6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:56.056902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c4d63d02-7195-469d-8631-fb4bcf6c1fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:56.096915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d63d02-7195-469d-8631-fb4bcf6c1fb6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:56.189884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ecd87-2634-4dad-9f4d-f4f60754b550 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:56.225108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283b03c-b5e0-42a4-ad92-b0f02b6ba142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:56.227738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283b03c-b5e0-42a4-ad92-b0f02b6ba142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:56.227738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283b03c-b5e0-42a4-ad92-b0f02b6ba142 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:56.227738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283b03c-b5e0-42a4-ad92-b0f02b6ba142 admin admin] PATH_INFO: `/v3/users/71b53d4e00654b789316eca5cfc55372` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:56.231318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283b03c-b5e0-42a4-ad92-b0f02b6ba142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b53d4e00654b789316eca5cfc55372)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:56.238705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283b03c-b5e0-42a4-ad92-b0f02b6ba142 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:56.307366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d73de9-4e84-40d4-84ea-f746b4940dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:56.308797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d73de9-4e84-40d4-84ea-f746b4940dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:56.309315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d73de9-4e84-40d4-84ea-f746b4940dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:56.323300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d73de9-4e84-40d4-84ea-f746b4940dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:56.327137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d73de9-4e84-40d4-84ea-f746b4940dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:56.336162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d73de9-4e84-40d4-84ea-f746b4940dd8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:56.376575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c283b03c-b5e0-42a4-ad92-b0f02b6ba142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b53d4e00654b789316eca5cfc55372'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:56.391501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c283b03c-b5e0-42a4-ad92-b0f02b6ba142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b53d4e00654b789316eca5cfc55372'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:56.393062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c283b03c-b5e0-42a4-ad92-b0f02b6ba142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b53d4e00654b789316eca5cfc55372'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:56.419047 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1146/2277] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:56 2022] POST /identity/v3/projects => generated 407 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:52:56.420182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d73de9-4e84-40d4-84ea-f746b4940dd8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:56.421746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c283b03c-b5e0-42a4-ad92-b0f02b6ba142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b53d4e00654b789316eca5cfc55372'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:56.422928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c283b03c-b5e0-42a4-ad92-b0f02b6ba142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b53d4e00654b789316eca5cfc55372'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:56.457906 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1132/2278] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:55 2022] DELETE /identity/v3/users/71b53d4e00654b789316eca5cfc55372 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:56.475295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82189118-3654-40b2-bb3b-965e9e7b46e9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:56.475919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82189118-3654-40b2-bb3b-965e9e7b46e9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:56.476639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82189118-3654-40b2-bb3b-965e9e7b46e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:56.489155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:56.562438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-82189118-3654-40b2-bb3b-965e9e7b46e9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:56.568002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-82189118-3654-40b2-bb3b-965e9e7b46e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:56.625277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d73de9-4e84-40d4-84ea-f746b4940dd8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:56.789066 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1133/2279] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:52:56.790270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82189118-3654-40b2-bb3b-965e9e7b46e9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:56.794115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-82189118-3654-40b2-bb3b-965e9e7b46e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:56.831466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82189118-3654-40b2-bb3b-965e9e7b46e9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:56.852422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:56.853098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:56.853479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:56.854186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] PATH_INFO: `/v3/projects/6813a4efcabf4cda9590f166c8d6bd81` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:56.856721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6813a4efcabf4cda9590f166c8d6bd81)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:56.859516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:56.872803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1951e-fed3-4d25-8ea1-a217fe8dbe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:56.875152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1951e-fed3-4d25-8ea1-a217fe8dbe56 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:56.875619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1951e-fed3-4d25-8ea1-a217fe8dbe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:56.876058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1951e-fed3-4d25-8ea1-a217fe8dbe56 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:56.876936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1951e-fed3-4d25-8ea1-a217fe8dbe56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:56.879522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1951e-fed3-4d25-8ea1-a217fe8dbe56 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:56.927652 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1147/2280] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:56 2022] POST /identity/v3/users => generated 310 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:56.928833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1951e-fed3-4d25-8ea1-a217fe8dbe56 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:56.937348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f6b1951e-fed3-4d25-8ea1-a217fe8dbe56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:56.956745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:56.993315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6813a4efcabf4cda9590f166c8d6bd81', 'request_id': 'req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.008587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6813a4efcabf4cda9590f166c8d6bd81', 'request_id': 'req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.021649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6813a4efcabf4cda9590f166c8d6bd81', 'request_id': 'req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.040243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1951e-fed3-4d25-8ea1-a217fe8dbe56 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:57.046793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] The token cache is being invalidate because project 6813a4efcabf4cda9590f166c8d6bd81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:57.047084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.050211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:57.052418 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1134/2281] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:56 2022] DELETE /identity/v3/projects/6813a4efcabf4cda9590f166c8d6bd81 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:57.053252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:57.061634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:57.124350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dceada-2286-49ee-b804-7c3bed3e8b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:57.125137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dceada-2286-49ee-b804-7c3bed3e8b19 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:57.125439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dceada-2286-49ee-b804-7c3bed3e8b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:57.125826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dceada-2286-49ee-b804-7c3bed3e8b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:57.128151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-32dceada-2286-49ee-b804-7c3bed3e8b19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:57.173627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:57.215269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad03e72-ff93-4f9e-98d2-ade8b47fe183 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:57.232489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484ff87-478c-4c79-b02c-4fef8655ce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:57.233222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484ff87-478c-4c79-b02c-4fef8655ce6c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:57.233603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484ff87-478c-4c79-b02c-4fef8655ce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:57.233896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484ff87-478c-4c79-b02c-4fef8655ce6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:57.234540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484ff87-478c-4c79-b02c-4fef8655ce6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:57.236355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484ff87-478c-4c79-b02c-4fef8655ce6c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:57.263000 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1135/2282] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:57.269101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3f74b-a1ea-44ea-8fb8-5084624262ae None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:57.269375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3f74b-a1ea-44ea-8fb8-5084624262ae None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:57.269657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3f74b-a1ea-44ea-8fb8-5084624262ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:57.290305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dceada-2286-49ee-b804-7c3bed3e8b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:57.292094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dceada-2286-49ee-b804-7c3bed3e8b19 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:57.303480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-37f3f74b-a1ea-44ea-8fb8-5084624262ae None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:57.305042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-37f3f74b-a1ea-44ea-8fb8-5084624262ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:57.307547 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1148/2283] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:57.308817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dceada-2286-49ee-b804-7c3bed3e8b19 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:57.315734 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1136/2284] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:57.324780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1db931-9a59-487c-9262-7cc5b7568bd9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:57.325081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1db931-9a59-487c-9262-7cc5b7568bd9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:57.325363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1db931-9a59-487c-9262-7cc5b7568bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:57.328504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dceada-2286-49ee-b804-7c3bed3e8b19 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:57.341722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb02724-effd-41c3-a132-c8a2a2792208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:57.343162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb02724-effd-41c3-a132-c8a2a2792208 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:57.343706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb02724-effd-41c3-a132-c8a2a2792208 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:57.344162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb02724-effd-41c3-a132-c8a2a2792208 admin admin] PATH_INFO: `/v3/projects/4b0a77113b8743e2bae8ebde3be01686/users/d203de5bd17d4cccbdf91a3e0ac7813e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:57.363838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3a1db931-9a59-487c-9262-7cc5b7568bd9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:57.365913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3a1db931-9a59-487c-9262-7cc5b7568bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:57.370115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb02724-effd-41c3-a132-c8a2a2792208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0a77113b8743e2bae8ebde3be01686, user_id=d203de5bd17d4cccbdf91a3e0ac7813e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:57.379606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb02724-effd-41c3-a132-c8a2a2792208 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:57.380249 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1137/2285] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:52:57.391687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1db931-9a59-487c-9262-7cc5b7568bd9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:57.411666 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1149/2286] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:57 2022] PUT /identity/v3/projects/4b0a77113b8743e2bae8ebde3be01686/users/d203de5bd17d4cccbdf91a3e0ac7813e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:57.412199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1db931-9a59-487c-9262-7cc5b7568bd9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:57.414076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb02724-effd-41c3-a132-c8a2a2792208 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:57.615629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb02724-effd-41c3-a132-c8a2a2792208 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:57.628570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72241e3d-d382-4092-bbe4-9b669b6e9097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:57.629234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72241e3d-d382-4092-bbe4-9b669b6e9097 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:57.629525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72241e3d-d382-4092-bbe4-9b669b6e9097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:57.629801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72241e3d-d382-4092-bbe4-9b669b6e9097 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:57.630978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72241e3d-d382-4092-bbe4-9b669b6e9097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:57.634273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72241e3d-d382-4092-bbe4-9b669b6e9097 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:57.635322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654214a-bf2b-40c1-85ba-41f2917bd321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:57.653618 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1150/2287] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:57.653754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654214a-bf2b-40c1-85ba-41f2917bd321 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:57.658081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654214a-bf2b-40c1-85ba-41f2917bd321 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:57.658510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654214a-bf2b-40c1-85ba-41f2917bd321 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:57.659585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654214a-bf2b-40c1-85ba-41f2917bd321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:52:57.660154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72241e3d-d382-4092-bbe4-9b669b6e9097 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:57.664259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654214a-bf2b-40c1-85ba-41f2917bd321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:57.673199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654214a-bf2b-40c1-85ba-41f2917bd321 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:57.687834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72241e3d-d382-4092-bbe4-9b669b6e9097 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:57.697576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f5667-864c-44d0-bb74-2395ff25423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:57.698539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f5667-864c-44d0-bb74-2395ff25423d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:57.700258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f5667-864c-44d0-bb74-2395ff25423d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:57.700779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f5667-864c-44d0-bb74-2395ff25423d admin admin] PATH_INFO: `/v3/projects/4b0a77113b8743e2bae8ebde3be01686/users/d203de5bd17d4cccbdf91a3e0ac7813e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:57.708323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f5667-864c-44d0-bb74-2395ff25423d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0a77113b8743e2bae8ebde3be01686, user_id=d203de5bd17d4cccbdf91a3e0ac7813e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:57.712058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f5667-864c-44d0-bb74-2395ff25423d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:57.736552 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1151/2288] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:57 2022] PUT /identity/v3/projects/4b0a77113b8743e2bae8ebde3be01686/users/d203de5bd17d4cccbdf91a3e0ac7813e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:57.747719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aa93f-7a60-48a7-9a5f-0380f08703ab None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:57.748620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aa93f-7a60-48a7-9a5f-0380f08703ab None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:57.751809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aa93f-7a60-48a7-9a5f-0380f08703ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:57.753594 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1138/2289] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:52:57.755059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654214a-bf2b-40c1-85ba-41f2917bd321 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:57.774086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654214a-bf2b-40c1-85ba-41f2917bd321 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:57.843858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ee4aa93f-7a60-48a7-9a5f-0380f08703ab None None] MFA Rules not processed for user `d203de5bd17d4cccbdf91a3e0ac7813e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:57.845127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ee4aa93f-7a60-48a7-9a5f-0380f08703ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:57.862326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:57.960229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adb987-8226-4ae4-bd71-6fe3d0e7424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:57.961637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adb987-8226-4ae4-bd71-6fe3d0e7424a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:57.962264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adb987-8226-4ae4-bd71-6fe3d0e7424a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:57.962798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adb987-8226-4ae4-bd71-6fe3d0e7424a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:57.963612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adb987-8226-4ae4-bd71-6fe3d0e7424a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:57.969352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adb987-8226-4ae4-bd71-6fe3d0e7424a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:58.016493 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1139/2290] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:57 2022] POST /identity/v3/projects => generated 389 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:58.023045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adb987-8226-4ae4-bd71-6fe3d0e7424a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:58.115737 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1152/2291] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:57 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:58.128814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4aa93f-7a60-48a7-9a5f-0380f08703ab None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:58.130666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ee4aa93f-7a60-48a7-9a5f-0380f08703ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:58.161054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:58.211599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adb987-8226-4ae4-bd71-6fe3d0e7424a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:58.233674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48cd2b-7505-4ba9-9dab-e3a07251d7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:58.235676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cd2b-7505-4ba9-9dab-e3a07251d7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:58.236550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cd2b-7505-4ba9-9dab-e3a07251d7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:58.237276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cd2b-7505-4ba9-9dab-e3a07251d7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:58.238526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48cd2b-7505-4ba9-9dab-e3a07251d7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:58.244069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48cd2b-7505-4ba9-9dab-e3a07251d7d9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:58.335318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4aa93f-7a60-48a7-9a5f-0380f08703ab None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:58.346022 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1140/2292] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:58 2022] POST /identity/v3/users => generated 295 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:58.351212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48cd2b-7505-4ba9-9dab-e3a07251d7d9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:58.403022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48cd2b-7505-4ba9-9dab-e3a07251d7d9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:58.421218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cba79c-2ae2-444d-9fcf-fbe9b8e59e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:58.422181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cba79c-2ae2-444d-9fcf-fbe9b8e59e11 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:58.422897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cba79c-2ae2-444d-9fcf-fbe9b8e59e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:58.423885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cba79c-2ae2-444d-9fcf-fbe9b8e59e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:58.424985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cba79c-2ae2-444d-9fcf-fbe9b8e59e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:58.426155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3337b3e-3e1c-4862-8815-128be87d49aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:58.427767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cba79c-2ae2-444d-9fcf-fbe9b8e59e11 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:58.427921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3337b3e-3e1c-4862-8815-128be87d49aa service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:58.428114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3337b3e-3e1c-4862-8815-128be87d49aa service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:58.428398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3337b3e-3e1c-4862-8815-128be87d49aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:58.476638 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1141/2293] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:58.478154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cba79c-2ae2-444d-9fcf-fbe9b8e59e11 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:58.554014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cba79c-2ae2-444d-9fcf-fbe9b8e59e11 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:58.584904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca0409-3695-433e-a124-17d392048eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:58.585931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0409-3695-433e-a124-17d392048eff admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:58.586399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0409-3695-433e-a124-17d392048eff admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:58.586952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0409-3695-433e-a124-17d392048eff admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:58.587783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca0409-3695-433e-a124-17d392048eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:58.590220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca0409-3695-433e-a124-17d392048eff admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:58.631267 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1142/2294] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:52:58.632674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca0409-3695-433e-a124-17d392048eff admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:58.666934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca0409-3695-433e-a124-17d392048eff admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:58.683998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713814d-d42e-4ed6-b311-c80a67cbdbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:58.686794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713814d-d42e-4ed6-b311-c80a67cbdbf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:58.692292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713814d-d42e-4ed6-b311-c80a67cbdbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:58.693098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713814d-d42e-4ed6-b311-c80a67cbdbf0 admin admin] PATH_INFO: `/v3/projects/1fdc1531264a457cb7ee733ee3f221dc/users/7386b4ccca7f47a2b4a021a5d14836c9/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:58.764667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713814d-d42e-4ed6-b311-c80a67cbdbf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdc1531264a457cb7ee733ee3f221dc, user_id=7386b4ccca7f47a2b4a021a5d14836c9, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:58.780699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3337b3e-3e1c-4862-8815-128be87d49aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:58.783968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713814d-d42e-4ed6-b311-c80a67cbdbf0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:58.789941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3337b3e-3e1c-4862-8815-128be87d49aa service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:58.831265 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1153/2295] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:58 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:52:58.855791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3337b3e-3e1c-4862-8815-128be87d49aa service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:58.858096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d3337b3e-3e1c-4862-8815-128be87d49aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:58.866126 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1143/2296] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:52:58 2022] PUT /identity/v3/projects/1fdc1531264a457cb7ee733ee3f221dc/users/7386b4ccca7f47a2b4a021a5d14836c9/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:58.884268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072537a0-0134-48c0-a65f-651cddaa20f0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:58.884816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072537a0-0134-48c0-a65f-651cddaa20f0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:58.885762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072537a0-0134-48c0-a65f-651cddaa20f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:58.901108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3337b3e-3e1c-4862-8815-128be87d49aa service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:58.987535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-072537a0-0134-48c0-a65f-651cddaa20f0 None None] MFA Rules not processed for user `7386b4ccca7f47a2b4a021a5d14836c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:52:58.989574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-072537a0-0134-48c0-a65f-651cddaa20f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:59.012658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:59.059625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:59.062619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:59.063119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:59.063817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] PATH_INFO: `/v3/projects/aedf7771145c49e2948ef4283ace2e65` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:59.067440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aedf7771145c49e2948ef4283ace2e65)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:59.071592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:59.097070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:59.140870 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1144/2297] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:52:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:52:59.142964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072537a0-0134-48c0-a65f-651cddaa20f0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:59.155339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aedf7771145c49e2948ef4283ace2e65', 'request_id': 'req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.172108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aedf7771145c49e2948ef4283ace2e65', 'request_id': 'req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.199811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aedf7771145c49e2948ef4283ace2e65', 'request_id': 'req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.240099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] The token cache is being invalidate because project aedf7771145c49e2948ef4283ace2e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:52:59.240816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.241835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.248003 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1154/2298] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:52:58 2022] DELETE /identity/v3/projects/aedf7771145c49e2948ef4283ace2e65 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:59.250857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:59.254223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:59.350381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072537a0-0134-48c0-a65f-651cddaa20f0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:59.389130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6c2a5-e4cc-4233-8c8a-7dd6cbc8853e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:59.403926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea872c-673b-4683-bf0d-617543af9003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:59.407738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea872c-673b-4683-bf0d-617543af9003 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:59.410046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea872c-673b-4683-bf0d-617543af9003 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:59.410706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea872c-673b-4683-bf0d-617543af9003 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:59.411911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea872c-673b-4683-bf0d-617543af9003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:59.416798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea872c-673b-4683-bf0d-617543af9003 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:59.502451 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1155/2299] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:52:59 2022] POST /identity/v3/projects => generated 387 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:59.503284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea872c-673b-4683-bf0d-617543af9003 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:59.510773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-91ea872c-673b-4683-bf0d-617543af9003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:59.512246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea66d6-0a1a-4703-aba5-99a127cd7158 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:59.512896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea66d6-0a1a-4703-aba5-99a127cd7158 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:59.513184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea66d6-0a1a-4703-aba5-99a127cd7158 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:59.513630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea66d6-0a1a-4703-aba5-99a127cd7158 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:59.519120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-15ea66d6-0a1a-4703-aba5-99a127cd7158 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:52:59.589123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:52:59.607353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea872c-673b-4683-bf0d-617543af9003 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:59.624472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:59.627916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:59.630175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:59.630822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] PATH_INFO: `/v3/users/5f2b6636e33844b6bac12b6815440b22` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:59.634936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2b6636e33844b6bac12b6815440b22)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:59.641280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:59.691410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea66d6-0a1a-4703-aba5-99a127cd7158 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:59.694000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea66d6-0a1a-4703-aba5-99a127cd7158 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:59.724122 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1145/2300] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:52:59 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:52:59.739296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea66d6-0a1a-4703-aba5-99a127cd7158 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:59.742829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2b6636e33844b6bac12b6815440b22'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.788152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2b6636e33844b6bac12b6815440b22'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.795737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2b6636e33844b6bac12b6815440b22'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.797940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea66d6-0a1a-4703-aba5-99a127cd7158 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:52:59.806840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d8fc9-e34f-4c6e-87c5-5073bc4c0ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:52:59.808851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d8fc9-e34f-4c6e-87c5-5073bc4c0ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:52:59.808974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d8fc9-e34f-4c6e-87c5-5073bc4c0ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:52:59.809590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2b6636e33844b6bac12b6815440b22'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.811796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2b6636e33844b6bac12b6815440b22'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:52:59.813875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d8fc9-e34f-4c6e-87c5-5073bc4c0ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:52:59.814593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d8fc9-e34f-4c6e-87c5-5073bc4c0ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:52:59.818868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d8fc9-e34f-4c6e-87c5-5073bc4c0ff9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:52:59.875394 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1156/2301] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:52:59 2022] DELETE /identity/v3/users/5f2b6636e33844b6bac12b6815440b22 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:52:59.883848 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1146/2302] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:52:59 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:52:59.885918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:52:59.888831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:00.070385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227caf11-13ba-4e38-85a3-bd8cacf01cba admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.104776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d8fc9-e34f-4c6e-87c5-5073bc4c0ff9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:00.108296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-921d8fc9-e34f-4c6e-87c5-5073bc4c0ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:00.111303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52938f-e70d-422e-b6d4-0af636c0638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.114701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52938f-e70d-422e-b6d4-0af636c0638a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.114701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52938f-e70d-422e-b6d4-0af636c0638a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.114964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52938f-e70d-422e-b6d4-0af636c0638a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.117233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52938f-e70d-422e-b6d4-0af636c0638a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:00.119279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52938f-e70d-422e-b6d4-0af636c0638a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.137265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d8fc9-e34f-4c6e-87c5-5073bc4c0ff9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.138595 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1157/2303] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:00.144238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52938f-e70d-422e-b6d4-0af636c0638a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:00.172194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814042f4-15f3-4c22-96da-1030b7a34cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.173313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814042f4-15f3-4c22-96da-1030b7a34cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.173815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814042f4-15f3-4c22-96da-1030b7a34cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.174307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814042f4-15f3-4c22-96da-1030b7a34cfd admin admin] PATH_INFO: `/v3/users/fd4f1fe87a7d4e5aac567139735f5b2b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.177124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52938f-e70d-422e-b6d4-0af636c0638a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.188192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814042f4-15f3-4c22-96da-1030b7a34cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4f1fe87a7d4e5aac567139735f5b2b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:00.191976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814042f4-15f3-4c22-96da-1030b7a34cfd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.193804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdf390-af70-4f83-b2af-7b2c8a82cc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.194821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdf390-af70-4f83-b2af-7b2c8a82cc08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.195359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdf390-af70-4f83-b2af-7b2c8a82cc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.195848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdf390-af70-4f83-b2af-7b2c8a82cc08 admin admin] PATH_INFO: `/v3/projects/8fa964f2f29c4d9a935101a40fb11ef4/users/16b89b35d080409d82d4a8f3ae794e80/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.203216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:00.265153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdf390-af70-4f83-b2af-7b2c8a82cc08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa964f2f29c4d9a935101a40fb11ef4, user_id=16b89b35d080409d82d4a8f3ae794e80, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:00.277113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdf390-af70-4f83-b2af-7b2c8a82cc08 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.320332 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1158/2304] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:00 2022] PUT /identity/v3/projects/8fa964f2f29c4d9a935101a40fb11ef4/users/16b89b35d080409d82d4a8f3ae794e80/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:00.324895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdf390-af70-4f83-b2af-7b2c8a82cc08 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:00.362811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814042f4-15f3-4c22-96da-1030b7a34cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4f1fe87a7d4e5aac567139735f5b2b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:00.375991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814042f4-15f3-4c22-96da-1030b7a34cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4f1fe87a7d4e5aac567139735f5b2b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:00.377674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814042f4-15f3-4c22-96da-1030b7a34cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4f1fe87a7d4e5aac567139735f5b2b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:00.414315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814042f4-15f3-4c22-96da-1030b7a34cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4f1fe87a7d4e5aac567139735f5b2b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:00.415603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814042f4-15f3-4c22-96da-1030b7a34cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4f1fe87a7d4e5aac567139735f5b2b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:00.448727 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1147/2305] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:00 2022] DELETE /identity/v3/users/fd4f1fe87a7d4e5aac567139735f5b2b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:00.455670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fba97e-c65d-409d-8a50-200ddf9fbf27 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.456109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fba97e-c65d-409d-8a50-200ddf9fbf27 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.456442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fba97e-c65d-409d-8a50-200ddf9fbf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.483977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-93fba97e-c65d-409d-8a50-200ddf9fbf27 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:00.485277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-93fba97e-c65d-409d-8a50-200ddf9fbf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:00.487594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:00.522104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdf390-af70-4f83-b2af-7b2c8a82cc08 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.633086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0f162-5bc1-4bbf-a5b9-b9d61f33a61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.633989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0f162-5bc1-4bbf-a5b9-b9d61f33a61e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.634319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0f162-5bc1-4bbf-a5b9-b9d61f33a61e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.634600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0f162-5bc1-4bbf-a5b9-b9d61f33a61e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.635398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0f162-5bc1-4bbf-a5b9-b9d61f33a61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:00.637063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0f162-5bc1-4bbf-a5b9-b9d61f33a61e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.642037 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1148/2306] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:00.649937 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1159/2307] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:00.656383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fba97e-c65d-409d-8a50-200ddf9fbf27 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:00.657883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-93fba97e-c65d-409d-8a50-200ddf9fbf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:00.673714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fba97e-c65d-409d-8a50-200ddf9fbf27 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.680106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a6683-3d2d-45c4-b46d-47a7c5967de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.680937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a6683-3d2d-45c4-b46d-47a7c5967de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.681461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a6683-3d2d-45c4-b46d-47a7c5967de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.682341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a6683-3d2d-45c4-b46d-47a7c5967de7 admin admin] PATH_INFO: `/v3/projects/8fa964f2f29c4d9a935101a40fb11ef4/users/16b89b35d080409d82d4a8f3ae794e80/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.685359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a6683-3d2d-45c4-b46d-47a7c5967de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa964f2f29c4d9a935101a40fb11ef4, user_id=16b89b35d080409d82d4a8f3ae794e80, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:00.689742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a6683-3d2d-45c4-b46d-47a7c5967de7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:00.690694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0f162-5bc1-4bbf-a5b9-b9d61f33a61e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:00.695976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a9b0f162-5bc1-4bbf-a5b9-b9d61f33a61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:00.716436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1149/2308] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:00 2022] PUT /identity/v3/projects/8fa964f2f29c4d9a935101a40fb11ef4/users/16b89b35d080409d82d4a8f3ae794e80/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:00.740817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b51cb4-dd8b-4628-8442-3478af17f232 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.741393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b51cb4-dd8b-4628-8442-3478af17f232 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.741829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b51cb4-dd8b-4628-8442-3478af17f232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:00.807281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-96b51cb4-dd8b-4628-8442-3478af17f232 None None] MFA Rules not processed for user `16b89b35d080409d82d4a8f3ae794e80`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:00.809984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-96b51cb4-dd8b-4628-8442-3478af17f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:00.830768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0f162-5bc1-4bbf-a5b9-b9d61f33a61e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:00.924862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f963f0-695c-4bd2-a2b4-525dde1a8763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:00.928079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f963f0-695c-4bd2-a2b4-525dde1a8763 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:00.931460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f963f0-695c-4bd2-a2b4-525dde1a8763 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:00.937609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f963f0-695c-4bd2-a2b4-525dde1a8763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.011790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:01.052467 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1150/2309] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:01.054176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0d187-96b2-423a-a83d-a343f706cb29 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.054475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0d187-96b2-423a-a83d-a343f706cb29 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.054809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0d187-96b2-423a-a83d-a343f706cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.081416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:01.085963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-65d0d187-96b2-423a-a83d-a343f706cb29 None None] MFA Rules not processed for user `7386b4ccca7f47a2b4a021a5d14836c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:01.087476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-65d0d187-96b2-423a-a83d-a343f706cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:01.096127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f963f0-695c-4bd2-a2b4-525dde1a8763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.100247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f963f0-695c-4bd2-a2b4-525dde1a8763 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.117342 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1160/2310] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:01.142593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6449c-7fa7-4287-ac2e-90ad8046fd65 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.142897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6449c-7fa7-4287-ac2e-90ad8046fd65 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.143167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6449c-7fa7-4287-ac2e-90ad8046fd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.196683 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1151/2311] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:01.210607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0d187-96b2-423a-a83d-a343f706cb29 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.212771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-65d0d187-96b2-423a-a83d-a343f706cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:01.249224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-34f6449c-7fa7-4287-ac2e-90ad8046fd65 None None] MFA Rules not processed for user `96265ca648444ff8bf45a45c26b7679e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:01.251783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-34f6449c-7fa7-4287-ac2e-90ad8046fd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:01.360611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0d187-96b2-423a-a83d-a343f706cb29 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:01.370627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d54373-2aa9-4b86-83e7-69ee45970e31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:01.371316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d54373-2aa9-4b86-83e7-69ee45970e31 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.371607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d54373-2aa9-4b86-83e7-69ee45970e31 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.371940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d54373-2aa9-4b86-83e7-69ee45970e31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.374764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-77d54373-2aa9-4b86-83e7-69ee45970e31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:01.388186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d54373-2aa9-4b86-83e7-69ee45970e31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.390953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d54373-2aa9-4b86-83e7-69ee45970e31 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.408469 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1152/2312] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:01.429387 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1161/2313] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:01.434610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d54373-2aa9-4b86-83e7-69ee45970e31 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.436187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-77d54373-2aa9-4b86-83e7-69ee45970e31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:01.475186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d54373-2aa9-4b86-83e7-69ee45970e31 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:01.494043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1474d76-8117-429f-a913-4a0ec28b4e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:01.494893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1474d76-8117-429f-a913-4a0ec28b4e53 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.495255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1474d76-8117-429f-a913-4a0ec28b4e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.495605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1474d76-8117-429f-a913-4a0ec28b4e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.496433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1474d76-8117-429f-a913-4a0ec28b4e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.500417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1474d76-8117-429f-a913-4a0ec28b4e53 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.553173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6449c-7fa7-4287-ac2e-90ad8046fd65 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.569672 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1153/2314] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:01 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:53:01.574167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6449c-7fa7-4287-ac2e-90ad8046fd65 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:01.700174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d759c2c-4645-48c0-acd0-0db41f08bd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:01.702372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d759c2c-4645-48c0-acd0-0db41f08bd5b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.703006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d759c2c-4645-48c0-acd0-0db41f08bd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.703473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d759c2c-4645-48c0-acd0-0db41f08bd5b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.704309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d759c2c-4645-48c0-acd0-0db41f08bd5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.706918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d759c2c-4645-48c0-acd0-0db41f08bd5b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.760411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1474d76-8117-429f-a913-4a0ec28b4e53 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.771289 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1162/2315] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:01 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:01.775667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1474d76-8117-429f-a913-4a0ec28b4e53 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:01.786349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10d526-7333-4776-9643-b072dc98ebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:01.787813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10d526-7333-4776-9643-b072dc98ebb9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.788361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10d526-7333-4776-9643-b072dc98ebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.788748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10d526-7333-4776-9643-b072dc98ebb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.789705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10d526-7333-4776-9643-b072dc98ebb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.791609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10d526-7333-4776-9643-b072dc98ebb9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.810792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d759c2c-4645-48c0-acd0-0db41f08bd5b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:01.834413 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1154/2316] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:01.854762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d759c2c-4645-48c0-acd0-0db41f08bd5b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:01.877685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fea02-a65c-46c5-bff7-abe5c4256aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:01.878842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fea02-a65c-46c5-bff7-abe5c4256aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:01.879380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fea02-a65c-46c5-bff7-abe5c4256aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:01.880292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fea02-a65c-46c5-bff7-abe5c4256aa5 admin admin] PATH_INFO: `/v3/projects/d18a7752b52741b19cbbea6f12f23d76/users/3a8b891911af4a8c9f04941a6a112c4f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:01.934971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fea02-a65c-46c5-bff7-abe5c4256aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18a7752b52741b19cbbea6f12f23d76, user_id=3a8b891911af4a8c9f04941a6a112c4f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:01.939580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fea02-a65c-46c5-bff7-abe5c4256aa5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:01.991439 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1163/2317] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:01 2022] PUT /identity/v3/projects/d18a7752b52741b19cbbea6f12f23d76/users/3a8b891911af4a8c9f04941a6a112c4f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:01.999475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10d526-7333-4776-9643-b072dc98ebb9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:02.032762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10d526-7333-4776-9643-b072dc98ebb9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:02.152972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fea02-a65c-46c5-bff7-abe5c4256aa5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:02.157267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c40fea02-a65c-46c5-bff7-abe5c4256aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:02.190477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:02.228075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10b5dc-3591-4232-8ff5-75a13434443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:02.231966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10b5dc-3591-4232-8ff5-75a13434443b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:02.232888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10b5dc-3591-4232-8ff5-75a13434443b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:02.236831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10b5dc-3591-4232-8ff5-75a13434443b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:02.238135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10b5dc-3591-4232-8ff5-75a13434443b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:02.243674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10b5dc-3591-4232-8ff5-75a13434443b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:02.287329 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1155/2318] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:02.288622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10b5dc-3591-4232-8ff5-75a13434443b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:02.312553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10b5dc-3591-4232-8ff5-75a13434443b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:02.324433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:02.333904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769c5ca-4e6c-44c0-9732-7b05a5930c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:02.334836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769c5ca-4e6c-44c0-9732-7b05a5930c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:02.335622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769c5ca-4e6c-44c0-9732-7b05a5930c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:02.336467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769c5ca-4e6c-44c0-9732-7b05a5930c0d admin admin] PATH_INFO: `/v3/projects/d18a7752b52741b19cbbea6f12f23d76/users/3a8b891911af4a8c9f04941a6a112c4f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:02.343566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769c5ca-4e6c-44c0-9732-7b05a5930c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18a7752b52741b19cbbea6f12f23d76, user_id=3a8b891911af4a8c9f04941a6a112c4f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:02.348370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769c5ca-4e6c-44c0-9732-7b05a5930c0d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:02.389058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fea02-a65c-46c5-bff7-abe5c4256aa5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:02.405084 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1156/2319] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:02 2022] PUT /identity/v3/projects/d18a7752b52741b19cbbea6f12f23d76/users/3a8b891911af4a8c9f04941a6a112c4f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:02.494100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef04c1-e56a-435d-95bf-d5faeea6736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:02.495005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef04c1-e56a-435d-95bf-d5faeea6736e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:02.495404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef04c1-e56a-435d-95bf-d5faeea6736e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:02.495940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef04c1-e56a-435d-95bf-d5faeea6736e admin admin] PATH_INFO: `/v3/projects/b69125820c19410cb213865b963b346c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:02.501642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef04c1-e56a-435d-95bf-d5faeea6736e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b69125820c19410cb213865b963b346c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:02.504592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef04c1-e56a-435d-95bf-d5faeea6736e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:02.695196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5cef04c1-e56a-435d-95bf-d5faeea6736e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b69125820c19410cb213865b963b346c', 'request_id': 'req-5cef04c1-e56a-435d-95bf-d5faeea6736e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:02.719176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5cef04c1-e56a-435d-95bf-d5faeea6736e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b69125820c19410cb213865b963b346c', 'request_id': 'req-5cef04c1-e56a-435d-95bf-d5faeea6736e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:02.749795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5cef04c1-e56a-435d-95bf-d5faeea6736e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b69125820c19410cb213865b963b346c', 'request_id': 'req-5cef04c1-e56a-435d-95bf-d5faeea6736e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:02.781634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5cef04c1-e56a-435d-95bf-d5faeea6736e admin admin] The token cache is being invalidate because project b69125820c19410cb213865b963b346c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:02.782004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5cef04c1-e56a-435d-95bf-d5faeea6736e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:02.782763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5cef04c1-e56a-435d-95bf-d5faeea6736e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:02.789363 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1164/2320] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:02 2022] DELETE /identity/v3/projects/b69125820c19410cb213865b963b346c => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:02.791411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39717020-f0a5-4b15-8bb9-d58875c20437 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:02.791890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39717020-f0a5-4b15-8bb9-d58875c20437 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:02.792238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39717020-f0a5-4b15-8bb9-d58875c20437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:02.843683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-39717020-f0a5-4b15-8bb9-d58875c20437 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:02.845086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-39717020-f0a5-4b15-8bb9-d58875c20437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:03.017990 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1157/2321] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:03.026312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ffbbe-814f-427f-8945-7253ed6d4693 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:03.026621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ffbbe-814f-427f-8945-7253ed6d4693 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:03.026975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ffbbe-814f-427f-8945-7253ed6d4693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:03.066478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-739ffbbe-814f-427f-8945-7253ed6d4693 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:03.072413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-739ffbbe-814f-427f-8945-7253ed6d4693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:03.098043 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1165/2322] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:03.102990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39717020-f0a5-4b15-8bb9-d58875c20437 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:03.117236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39717020-f0a5-4b15-8bb9-d58875c20437 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:03.125133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79625-ac2d-4b82-96fe-f4af3f0a392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:03.126342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79625-ac2d-4b82-96fe-f4af3f0a392e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:03.126842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79625-ac2d-4b82-96fe-f4af3f0a392e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:03.127302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79625-ac2d-4b82-96fe-f4af3f0a392e admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:03.128149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f79625-ac2d-4b82-96fe-f4af3f0a392e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:03.128670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f79625-ac2d-4b82-96fe-f4af3f0a392e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:03.131619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f79625-ac2d-4b82-96fe-f4af3f0a392e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:03.148174 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1158/2323] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:53:03.153112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ffbbe-814f-427f-8945-7253ed6d4693 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:03.172042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ffbbe-814f-427f-8945-7253ed6d4693 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:03.189487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae3fa7-9737-4140-9445-76584193d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:03.193445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae3fa7-9737-4140-9445-76584193d381 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:03.193941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae3fa7-9737-4140-9445-76584193d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:03.194638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae3fa7-9737-4140-9445-76584193d381 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:03.195998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae3fa7-9737-4140-9445-76584193d381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:03.198243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae3fa7-9737-4140-9445-76584193d381 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:03.270111 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1166/2324] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:03 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:03.274725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79625-ac2d-4b82-96fe-f4af3f0a392e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:03.301926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79625-ac2d-4b82-96fe-f4af3f0a392e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:03.424632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae3fa7-9737-4140-9445-76584193d381 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:03.428286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ddae3fa7-9737-4140-9445-76584193d381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:03.431432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b76e78-7c00-4a0c-b3e7-46221641c031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:03.432202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b76e78-7c00-4a0c-b3e7-46221641c031 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:03.432501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b76e78-7c00-4a0c-b3e7-46221641c031 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:03.432782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b76e78-7c00-4a0c-b3e7-46221641c031 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:03.433447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b76e78-7c00-4a0c-b3e7-46221641c031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:03.435994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b76e78-7c00-4a0c-b3e7-46221641c031 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:03.462034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae3fa7-9737-4140-9445-76584193d381 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:03.465135 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1159/2325] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:03 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:03.471135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b76e78-7c00-4a0c-b3e7-46221641c031 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:03.485856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:03.488584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:03.488584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:03.488584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] PATH_INFO: `/v3/projects/54d666e2641c4f978bdebaf42a87cfc9` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:03.491562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d666e2641c4f978bdebaf42a87cfc9)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:03.497231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:03.504568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b76e78-7c00-4a0c-b3e7-46221641c031 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:03.524549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ce06f-ff4e-4644-8bfc-acf8e355ea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:03.525274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ce06f-ff4e-4644-8bfc-acf8e355ea77 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:03.526187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ce06f-ff4e-4644-8bfc-acf8e355ea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:03.528164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ce06f-ff4e-4644-8bfc-acf8e355ea77 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:03.529030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ce06f-ff4e-4644-8bfc-acf8e355ea77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:03.533460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ce06f-ff4e-4644-8bfc-acf8e355ea77 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:03.593002 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1160/2326] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:03.602013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ce06f-ff4e-4644-8bfc-acf8e355ea77 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:03.628671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ce06f-ff4e-4644-8bfc-acf8e355ea77 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:03.652308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d666e2641c4f978bdebaf42a87cfc9', 'request_id': 'req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.661244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:03.672283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d666e2641c4f978bdebaf42a87cfc9', 'request_id': 'req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.680528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d666e2641c4f978bdebaf42a87cfc9', 'request_id': 'req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.705345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] The token cache is being invalidate because project 54d666e2641c4f978bdebaf42a87cfc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:03.707094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.708234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:03.711885 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1167/2327] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:03 2022] DELETE /identity/v3/projects/54d666e2641c4f978bdebaf42a87cfc9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:03.719179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:03.720891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:03.744043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:03.805897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dfa0d-5774-43a4-aa38-111d3a090615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:03.808374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dfa0d-5774-43a4-aa38-111d3a090615 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:03.808833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dfa0d-5774-43a4-aa38-111d3a090615 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:03.810172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dfa0d-5774-43a4-aa38-111d3a090615 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:03.811729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84dfa0d-5774-43a4-aa38-111d3a090615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:03.816021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84dfa0d-5774-43a4-aa38-111d3a090615 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:03.843486 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1161/2328] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:03.844914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dfa0d-5774-43a4-aa38-111d3a090615 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:03.860330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f84dfa0d-5774-43a4-aa38-111d3a090615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:03.874398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a2f9a-fbf1-429b-8bcd-4e5b0a63d419 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:03.888082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:03.890718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dfa0d-5774-43a4-aa38-111d3a090615 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:03.891960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:03.893113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:03.893113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] PATH_INFO: `/v3/users/d203de5bd17d4cccbdf91a3e0ac7813e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:03.897017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d203de5bd17d4cccbdf91a3e0ac7813e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:03.904008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393ae34-879d-4d60-9bdd-32bb3ebbb652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:03.906774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:03.908015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393ae34-879d-4d60-9bdd-32bb3ebbb652 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:03.908410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393ae34-879d-4d60-9bdd-32bb3ebbb652 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:03.908621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393ae34-879d-4d60-9bdd-32bb3ebbb652 admin admin] PATH_INFO: `/v3/projects/9c20fc4649384146aab671486a0ec75a/users/0b1f017f7d3443048f9ca52a69557e70/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:03.992814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393ae34-879d-4d60-9bdd-32bb3ebbb652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c20fc4649384146aab671486a0ec75a, user_id=0b1f017f7d3443048f9ca52a69557e70, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:04.020584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393ae34-879d-4d60-9bdd-32bb3ebbb652 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:04.070812 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1162/2329] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:03 2022] PUT /identity/v3/projects/9c20fc4649384146aab671486a0ec75a/users/0b1f017f7d3443048f9ca52a69557e70/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:04.083559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e948-0bd2-4396-b794-d5ce899caebf None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:04.084013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e948-0bd2-4396-b794-d5ce899caebf None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:04.084420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e948-0bd2-4396-b794-d5ce899caebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:04.099435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd203de5bd17d4cccbdf91a3e0ac7813e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:04.113124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd203de5bd17d4cccbdf91a3e0ac7813e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:04.114633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd203de5bd17d4cccbdf91a3e0ac7813e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:04.138183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd203de5bd17d4cccbdf91a3e0ac7813e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:04.138583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd203de5bd17d4cccbdf91a3e0ac7813e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:04.191956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d153e948-0bd2-4396-b794-d5ce899caebf None None] MFA Rules not processed for user `0b1f017f7d3443048f9ca52a69557e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:04.196583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d153e948-0bd2-4396-b794-d5ce899caebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:04.201261 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1168/2330] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:03 2022] DELETE /identity/v3/users/d203de5bd17d4cccbdf91a3e0ac7813e => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:04.449554 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1163/2331] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:04.451751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:04.454477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:04.737176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce440405-f9c6-4e2e-bce5-08b464006f34 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:04.757693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f055e0a-289c-43bd-bfdf-637b483f152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:04.758650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f055e0a-289c-43bd-bfdf-637b483f152b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:04.758650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f055e0a-289c-43bd-bfdf-637b483f152b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:04.759113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f055e0a-289c-43bd-bfdf-637b483f152b admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:04.759577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f055e0a-289c-43bd-bfdf-637b483f152b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:04.761547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f055e0a-289c-43bd-bfdf-637b483f152b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:04.777818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:04.829603 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1169/2332] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:04 2022] POST /identity/v3/projects => generated 393 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:04.834313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153e948-0bd2-4396-b794-d5ce899caebf None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:04.860927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153e948-0bd2-4396-b794-d5ce899caebf None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:05.133585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2357ff-c1a7-4dc5-93bc-b33a8a4b1151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:05.139574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2357ff-c1a7-4dc5-93bc-b33a8a4b1151 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:05.143090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2357ff-c1a7-4dc5-93bc-b33a8a4b1151 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:05.143408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2357ff-c1a7-4dc5-93bc-b33a8a4b1151 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:05.144338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2357ff-c1a7-4dc5-93bc-b33a8a4b1151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:05.151871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2357ff-c1a7-4dc5-93bc-b33a8a4b1151 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:05.239957 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1164/2333] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:04 2022] POST /identity/v3/users => generated 303 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:05.243749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f055e0a-289c-43bd-bfdf-637b483f152b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:05.266922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f055e0a-289c-43bd-bfdf-637b483f152b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:05.286616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b45f72-24b8-4dea-8fa8-0af04c65d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:05.287303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b45f72-24b8-4dea-8fa8-0af04c65d825 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:05.287832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b45f72-24b8-4dea-8fa8-0af04c65d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:05.288115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b45f72-24b8-4dea-8fa8-0af04c65d825 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:05.288778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b45f72-24b8-4dea-8fa8-0af04c65d825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:05.290476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b45f72-24b8-4dea-8fa8-0af04c65d825 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:05.332696 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1170/2334] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:05.338900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2357ff-c1a7-4dc5-93bc-b33a8a4b1151 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:05.363969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2357ff-c1a7-4dc5-93bc-b33a8a4b1151 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:05.379784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b818897-d8e6-4d22-b6c3-37b81bc8435c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:05.380385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b818897-d8e6-4d22-b6c3-37b81bc8435c admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:05.380684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b818897-d8e6-4d22-b6c3-37b81bc8435c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:05.380970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b818897-d8e6-4d22-b6c3-37b81bc8435c admin admin] PATH_INFO: `/v3/projects/87225230c37846e6af39897eeb7d063e/users/b9cccefafaa847888a01a79b2502aee4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:05.420728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b818897-d8e6-4d22-b6c3-37b81bc8435c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87225230c37846e6af39897eeb7d063e, user_id=b9cccefafaa847888a01a79b2502aee4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:05.423519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b818897-d8e6-4d22-b6c3-37b81bc8435c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:05.458392 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1165/2335] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:05 2022] PUT /identity/v3/projects/87225230c37846e6af39897eeb7d063e/users/b9cccefafaa847888a01a79b2502aee4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:05.464439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b45f72-24b8-4dea-8fa8-0af04c65d825 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:05.499174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b45f72-24b8-4dea-8fa8-0af04c65d825 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:05.691972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e57820-f739-47b2-85c9-50599ff32a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:05.692960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e57820-f739-47b2-85c9-50599ff32a22 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:05.693402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e57820-f739-47b2-85c9-50599ff32a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:05.693898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e57820-f739-47b2-85c9-50599ff32a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:05.694821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e57820-f739-47b2-85c9-50599ff32a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:05.697563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e57820-f739-47b2-85c9-50599ff32a22 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:05.723424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b818897-d8e6-4d22-b6c3-37b81bc8435c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:05.724593 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1171/2336] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:05.750632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b818897-d8e6-4d22-b6c3-37b81bc8435c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:05.769168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b40b0-d56c-4576-ab25-1d28fa57b4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:05.777963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b40b0-d56c-4576-ab25-1d28fa57b4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:05.777963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b40b0-d56c-4576-ab25-1d28fa57b4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:05.777963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b40b0-d56c-4576-ab25-1d28fa57b4f7 admin admin] PATH_INFO: `/v3/projects/87225230c37846e6af39897eeb7d063e/users/b9cccefafaa847888a01a79b2502aee4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:05.781109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b40b0-d56c-4576-ab25-1d28fa57b4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87225230c37846e6af39897eeb7d063e, user_id=b9cccefafaa847888a01a79b2502aee4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:05.785863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b40b0-d56c-4576-ab25-1d28fa57b4f7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:05.819194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:05.840054 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1166/2337] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:05 2022] PUT /identity/v3/projects/87225230c37846e6af39897eeb7d063e/users/b9cccefafaa847888a01a79b2502aee4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:05.849291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e637d80-0c36-47d7-96a8-3e2ac33b0647 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:05.849825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e637d80-0c36-47d7-96a8-3e2ac33b0647 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:05.850278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e637d80-0c36-47d7-96a8-3e2ac33b0647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:05.894890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7e637d80-0c36-47d7-96a8-3e2ac33b0647 None None] MFA Rules not processed for user `b9cccefafaa847888a01a79b2502aee4`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:05.896154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7e637d80-0c36-47d7-96a8-3e2ac33b0647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:06.074438 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1172/2338] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:05 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:06.075055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d1d7-9e58-47d1-9bab-2d95a9f4aa89 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:06.075525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d1d7-9e58-47d1-9bab-2d95a9f4aa89 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:06.076552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d1d7-9e58-47d1-9bab-2d95a9f4aa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:06.140706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d374d1d7-9e58-47d1-9bab-2d95a9f4aa89 None None] MFA Rules not processed for user `0b1f017f7d3443048f9ca52a69557e70`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:06.142215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d374d1d7-9e58-47d1-9bab-2d95a9f4aa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:06.254307 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1167/2339] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:06.269550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e637d80-0c36-47d7-96a8-3e2ac33b0647 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:06.271322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7e637d80-0c36-47d7-96a8-3e2ac33b0647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:06.290998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d1d7-9e58-47d1-9bab-2d95a9f4aa89 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:06.294037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d374d1d7-9e58-47d1-9bab-2d95a9f4aa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:06.419173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d1d7-9e58-47d1-9bab-2d95a9f4aa89 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:06.429665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:06.430945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a0706-7b71-4a57-af8e-47541468e59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:06.432055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a0706-7b71-4a57-af8e-47541468e59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:06.432983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a0706-7b71-4a57-af8e-47541468e59c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:06.434054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a0706-7b71-4a57-af8e-47541468e59c admin admin] PATH_INFO: `/v3/projects/4b0a77113b8743e2bae8ebde3be01686` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:06.438035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a0706-7b71-4a57-af8e-47541468e59c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0a77113b8743e2bae8ebde3be01686)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:06.448970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a0706-7b71-4a57-af8e-47541468e59c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:06.469803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e637d80-0c36-47d7-96a8-3e2ac33b0647 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:06.477189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0cf8f7-2c8d-44fa-a47c-611862ad67ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:06.478118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cf8f7-2c8d-44fa-a47c-611862ad67ce service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:06.478494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cf8f7-2c8d-44fa-a47c-611862ad67ce service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:06.478796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cf8f7-2c8d-44fa-a47c-611862ad67ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:06.491392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cf8f7-2c8d-44fa-a47c-611862ad67ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:06.493691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0cf8f7-2c8d-44fa-a47c-611862ad67ce service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:06.539045 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1173/2340] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:06.625154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-876a0706-7b71-4a57-af8e-47541468e59c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0a77113b8743e2bae8ebde3be01686', 'request_id': 'req-876a0706-7b71-4a57-af8e-47541468e59c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:06.673348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-876a0706-7b71-4a57-af8e-47541468e59c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0a77113b8743e2bae8ebde3be01686', 'request_id': 'req-876a0706-7b71-4a57-af8e-47541468e59c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:06.693932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-876a0706-7b71-4a57-af8e-47541468e59c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0a77113b8743e2bae8ebde3be01686', 'request_id': 'req-876a0706-7b71-4a57-af8e-47541468e59c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:06.723190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-876a0706-7b71-4a57-af8e-47541468e59c admin admin] The token cache is being invalidate because project 4b0a77113b8743e2bae8ebde3be01686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:06.723752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-876a0706-7b71-4a57-af8e-47541468e59c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:06.724524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-876a0706-7b71-4a57-af8e-47541468e59c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:06.728191 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1168/2341] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:06 2022] DELETE /identity/v3/projects/4b0a77113b8743e2bae8ebde3be01686 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:06.733137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361170a-3598-4d2c-8c7c-e0289c5b8269 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:06.733426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361170a-3598-4d2c-8c7c-e0289c5b8269 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:06.733718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361170a-3598-4d2c-8c7c-e0289c5b8269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:06.770642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6361170a-3598-4d2c-8c7c-e0289c5b8269 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:06.772084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6361170a-3598-4d2c-8c7c-e0289c5b8269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:06.986159 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1174/2342] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:06.994609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08553c43-d1f9-47c8-8001-cbba049ed175 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:06.994945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08553c43-d1f9-47c8-8001-cbba049ed175 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:06.995209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08553c43-d1f9-47c8-8001-cbba049ed175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:07.052715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-08553c43-d1f9-47c8-8001-cbba049ed175 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:07.060795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-08553c43-d1f9-47c8-8001-cbba049ed175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:07.087028 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1169/2343] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:07.092903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361170a-3598-4d2c-8c7c-e0289c5b8269 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:07.110155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361170a-3598-4d2c-8c7c-e0289c5b8269 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:07.126080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc924490-ca1a-474a-af7c-cebd62072ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:07.126723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc924490-ca1a-474a-af7c-cebd62072ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:07.128533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc924490-ca1a-474a-af7c-cebd62072ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:07.128823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc924490-ca1a-474a-af7c-cebd62072ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:07.129507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc924490-ca1a-474a-af7c-cebd62072ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:07.129822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc924490-ca1a-474a-af7c-cebd62072ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:07.135878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc924490-ca1a-474a-af7c-cebd62072ea1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:07.175188 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1175/2344] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:07.177539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08553c43-d1f9-47c8-8001-cbba049ed175 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:07.236504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08553c43-d1f9-47c8-8001-cbba049ed175 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:07.260667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d80439-aa41-4f97-86ce-de36c1472917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:07.264981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d80439-aa41-4f97-86ce-de36c1472917 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:07.265745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d80439-aa41-4f97-86ce-de36c1472917 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:07.266837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d80439-aa41-4f97-86ce-de36c1472917 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:07.275346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d80439-aa41-4f97-86ce-de36c1472917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:07.285296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d80439-aa41-4f97-86ce-de36c1472917 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:07.333714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:07.364508 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1170/2345] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:07 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:07.369942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc924490-ca1a-474a-af7c-cebd62072ea1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:07.401925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc924490-ca1a-474a-af7c-cebd62072ea1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:07.578919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef9fa1-6a95-47dd-a612-d250fee10d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:07.578919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef9fa1-6a95-47dd-a612-d250fee10d36 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:07.579710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef9fa1-6a95-47dd-a612-d250fee10d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:07.579710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef9fa1-6a95-47dd-a612-d250fee10d36 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:07.580306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef9fa1-6a95-47dd-a612-d250fee10d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:07.585644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef9fa1-6a95-47dd-a612-d250fee10d36 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:07.614813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f367d-827b-4925-b7c7-a0d6b476f0ca None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:07.615188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f367d-827b-4925-b7c7-a0d6b476f0ca None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:07.615536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f367d-827b-4925-b7c7-a0d6b476f0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:07.650307 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1176/2346] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:07 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:07.667050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef9fa1-6a95-47dd-a612-d250fee10d36 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:07.716598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef9fa1-6a95-47dd-a612-d250fee10d36 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:07.736605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c62f367d-827b-4925-b7c7-a0d6b476f0ca None None] MFA Rules not processed for user `3b738496864a4b04bc885b75980e2341`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:07.737923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c62f367d-827b-4925-b7c7-a0d6b476f0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:07.739185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dad48-ab5e-4536-88c5-899e746ca898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:07.739987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dad48-ab5e-4536-88c5-899e746ca898 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:07.740275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dad48-ab5e-4536-88c5-899e746ca898 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:07.740551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dad48-ab5e-4536-88c5-899e746ca898 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:07.741214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4dad48-ab5e-4536-88c5-899e746ca898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:07.744197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4dad48-ab5e-4536-88c5-899e746ca898 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:07.769787 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1177/2347] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:07.774012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dad48-ab5e-4536-88c5-899e746ca898 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:07.803897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dad48-ab5e-4536-88c5-899e746ca898 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:07.818895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2743127-cd61-4ec0-ad86-38f34b433211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:07.820266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2743127-cd61-4ec0-ad86-38f34b433211 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:07.820675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2743127-cd61-4ec0-ad86-38f34b433211 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:07.821288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2743127-cd61-4ec0-ad86-38f34b433211 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:07.822097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2743127-cd61-4ec0-ad86-38f34b433211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:07.824834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2743127-cd61-4ec0-ad86-38f34b433211 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:07.866259 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1178/2348] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:07.869152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2743127-cd61-4ec0-ad86-38f34b433211 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:07.882835 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1171/2349] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:07.887311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f367d-827b-4925-b7c7-a0d6b476f0ca None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:07.890890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c62f367d-827b-4925-b7c7-a0d6b476f0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:07.909113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2743127-cd61-4ec0-ad86-38f34b433211 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:07.923793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eaf6ad-58bf-4aab-941b-e002c8236801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:07.924404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaf6ad-58bf-4aab-941b-e002c8236801 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:07.924687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaf6ad-58bf-4aab-941b-e002c8236801 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:07.925033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaf6ad-58bf-4aab-941b-e002c8236801 admin admin] PATH_INFO: `/v3/projects/43cf5b3df74449f1b9d7bb3d3b6d98e5/users/6955de0752b644b8aa32fe4ca724fb2e/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:07.926225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f367d-827b-4925-b7c7-a0d6b476f0ca None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:07.938649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb52855-0b55-4117-aac3-e17f6034683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:07.940190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52855-0b55-4117-aac3-e17f6034683d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:07.940821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52855-0b55-4117-aac3-e17f6034683d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:07.943035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52855-0b55-4117-aac3-e17f6034683d admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:07.945371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb52855-0b55-4117-aac3-e17f6034683d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:07.949966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb52855-0b55-4117-aac3-e17f6034683d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:07.963765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eaf6ad-58bf-4aab-941b-e002c8236801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43cf5b3df74449f1b9d7bb3d3b6d98e5, user_id=6955de0752b644b8aa32fe4ca724fb2e, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:07.973587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eaf6ad-58bf-4aab-941b-e002c8236801 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:07.998248 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1179/2350] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:07 2022] PUT /identity/v3/projects/43cf5b3df74449f1b9d7bb3d3b6d98e5/users/6955de0752b644b8aa32fe4ca724fb2e/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:08.009394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc986bb-85af-47ed-80ff-a4b60091ba92 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:08.009818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc986bb-85af-47ed-80ff-a4b60091ba92 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:08.010231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc986bb-85af-47ed-80ff-a4b60091ba92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:08.028992 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1172/2351] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:07 2022] POST /identity/v3/projects => generated 395 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:08.033644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb52855-0b55-4117-aac3-e17f6034683d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:08.065343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:08.080196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5dc986bb-85af-47ed-80ff-a4b60091ba92 None None] MFA Rules not processed for user `6955de0752b644b8aa32fe4ca724fb2e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:08.085186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5dc986bb-85af-47ed-80ff-a4b60091ba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:08.193715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb52855-0b55-4117-aac3-e17f6034683d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:08.205330 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1180/2352] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:08.206796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963e186-4a43-459e-8886-afac0db1440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:08.207508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc986bb-85af-47ed-80ff-a4b60091ba92 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:08.208078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963e186-4a43-459e-8886-afac0db1440b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:08.208581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963e186-4a43-459e-8886-afac0db1440b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:08.209067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963e186-4a43-459e-8886-afac0db1440b admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:08.210181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963e186-4a43-459e-8886-afac0db1440b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:08.213476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963e186-4a43-459e-8886-afac0db1440b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:08.240055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc986bb-85af-47ed-80ff-a4b60091ba92 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:08.255498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c888d-37b5-4ccf-8245-ffbcbf755736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:08.256182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c888d-37b5-4ccf-8245-ffbcbf755736 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:08.256395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c888d-37b5-4ccf-8245-ffbcbf755736 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:08.256672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c888d-37b5-4ccf-8245-ffbcbf755736 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:08.257340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c888d-37b5-4ccf-8245-ffbcbf755736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:08.259292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c888d-37b5-4ccf-8245-ffbcbf755736 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:08.268392 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1173/2353] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:08 2022] POST /identity/v3/users => generated 304 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:08.272462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963e186-4a43-459e-8886-afac0db1440b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:08.313953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963e186-4a43-459e-8886-afac0db1440b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:08.328773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51193ac7-0c1f-425d-a9f5-19103b1d7b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:08.329410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51193ac7-0c1f-425d-a9f5-19103b1d7b67 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:08.329695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51193ac7-0c1f-425d-a9f5-19103b1d7b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:08.330075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51193ac7-0c1f-425d-a9f5-19103b1d7b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:08.333273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51193ac7-0c1f-425d-a9f5-19103b1d7b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:08.338886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51193ac7-0c1f-425d-a9f5-19103b1d7b67 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:08.384957 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1174/2354] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:08.389026 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1181/2355] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:08 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:08.393139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51193ac7-0c1f-425d-a9f5-19103b1d7b67 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:08.393353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c888d-37b5-4ccf-8245-ffbcbf755736 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:08.436482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51193ac7-0c1f-425d-a9f5-19103b1d7b67 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:08.593074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:08.625713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c888d-37b5-4ccf-8245-ffbcbf755736 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:08.635236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e30327-1038-4fce-b790-3c6a4589ef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:08.636003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e30327-1038-4fce-b790-3c6a4589ef6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:08.637089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e30327-1038-4fce-b790-3c6a4589ef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:08.637602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e30327-1038-4fce-b790-3c6a4589ef6e admin admin] PATH_INFO: `/v3/projects/f07ae6bb187449309af5c09566b05b66/users/51c756406a9742b49cde4945e9553236/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:08.644768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5736b6-57ec-4705-b0be-40118f1ccdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:08.646470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5736b6-57ec-4705-b0be-40118f1ccdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:08.646785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5736b6-57ec-4705-b0be-40118f1ccdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:08.648214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5736b6-57ec-4705-b0be-40118f1ccdf8 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:08.649293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5736b6-57ec-4705-b0be-40118f1ccdf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:08.651156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5736b6-57ec-4705-b0be-40118f1ccdf8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:08.690694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e30327-1038-4fce-b790-3c6a4589ef6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07ae6bb187449309af5c09566b05b66, user_id=51c756406a9742b49cde4945e9553236, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:08.695513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e30327-1038-4fce-b790-3c6a4589ef6e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:08.712156 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1182/2356] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:08 2022] POST /identity/v3/users => generated 299 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:08.718555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5736b6-57ec-4705-b0be-40118f1ccdf8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:08.744226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5736b6-57ec-4705-b0be-40118f1ccdf8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:08.767601 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1175/2357] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:08 2022] PUT /identity/v3/projects/f07ae6bb187449309af5c09566b05b66/users/51c756406a9742b49cde4945e9553236/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:08.775299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e30327-1038-4fce-b790-3c6a4589ef6e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:08.932162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e30327-1038-4fce-b790-3c6a4589ef6e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:08.940699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae517fd-50e2-4f7e-a740-cac4656a76b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:08.942691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae517fd-50e2-4f7e-a740-cac4656a76b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:08.943593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae517fd-50e2-4f7e-a740-cac4656a76b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:08.944244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae517fd-50e2-4f7e-a740-cac4656a76b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:08.954023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae517fd-50e2-4f7e-a740-cac4656a76b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:08.970218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae517fd-50e2-4f7e-a740-cac4656a76b3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:08.981107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd71f5d-9649-4a59-b8d7-f00c06c46632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:08.982585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd71f5d-9649-4a59-b8d7-f00c06c46632 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:08.983067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd71f5d-9649-4a59-b8d7-f00c06c46632 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:08.983534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd71f5d-9649-4a59-b8d7-f00c06c46632 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:08.985951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd71f5d-9649-4a59-b8d7-f00c06c46632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:08.988492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd71f5d-9649-4a59-b8d7-f00c06c46632 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:09.008930 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1176/2358] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:09.009957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae517fd-50e2-4f7e-a740-cac4656a76b3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:09.030334 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1183/2359] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:09.032367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd71f5d-9649-4a59-b8d7-f00c06c46632 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:09.038387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae517fd-50e2-4f7e-a740-cac4656a76b3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:09.053651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:09.058479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4dc8f-7d7e-4fd6-80f6-e00c8e30f462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:09.062880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4dc8f-7d7e-4fd6-80f6-e00c8e30f462 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:09.064068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4dc8f-7d7e-4fd6-80f6-e00c8e30f462 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:09.064268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4dc8f-7d7e-4fd6-80f6-e00c8e30f462 admin admin] PATH_INFO: `/v3/projects/f07ae6bb187449309af5c09566b05b66/users/51c756406a9742b49cde4945e9553236/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:09.064904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd71f5d-9649-4a59-b8d7-f00c06c46632 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:09.080461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2adf5e-b2b9-46f1-95e8-ddb1a37cb36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:09.087369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2adf5e-b2b9-46f1-95e8-ddb1a37cb36c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:09.087794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2adf5e-b2b9-46f1-95e8-ddb1a37cb36c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:09.088169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2adf5e-b2b9-46f1-95e8-ddb1a37cb36c admin admin] PATH_INFO: `/v3/projects/bdea946438504e1eb3e70ac5c0160dae/users/b93ea10813ed4f96aabb4dbe25cfa6bd/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:09.094145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4dc8f-7d7e-4fd6-80f6-e00c8e30f462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07ae6bb187449309af5c09566b05b66, user_id=51c756406a9742b49cde4945e9553236, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:09.099573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4dc8f-7d7e-4fd6-80f6-e00c8e30f462 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:09.130816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2adf5e-b2b9-46f1-95e8-ddb1a37cb36c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdea946438504e1eb3e70ac5c0160dae, user_id=b93ea10813ed4f96aabb4dbe25cfa6bd, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:09.133741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2adf5e-b2b9-46f1-95e8-ddb1a37cb36c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:09.142061 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1177/2360] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:09 2022] PUT /identity/v3/projects/f07ae6bb187449309af5c09566b05b66/users/51c756406a9742b49cde4945e9553236/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:09.174666 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1184/2361] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:09 2022] PUT /identity/v3/projects/bdea946438504e1eb3e70ac5c0160dae/users/b93ea10813ed4f96aabb4dbe25cfa6bd/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:09.175827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4dc8f-7d7e-4fd6-80f6-e00c8e30f462 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:09.315404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4dc8f-7d7e-4fd6-80f6-e00c8e30f462 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:09.475462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdac9e-df6e-4c18-81e0-a0046bd8f6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:09.476291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdac9e-df6e-4c18-81e0-a0046bd8f6ba admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:09.476674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdac9e-df6e-4c18-81e0-a0046bd8f6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:09.477051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdac9e-df6e-4c18-81e0-a0046bd8f6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:09.479232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdac9e-df6e-4c18-81e0-a0046bd8f6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:09.481484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdac9e-df6e-4c18-81e0-a0046bd8f6ba admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:09.483352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:09.501044 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1178/2362] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:09.502366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2adf5e-b2b9-46f1-95e8-ddb1a37cb36c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:09.528626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2adf5e-b2b9-46f1-95e8-ddb1a37cb36c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:09.556442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaec90-447e-44dd-940e-4b2008675423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:09.557577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaec90-447e-44dd-940e-4b2008675423 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:09.558109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaec90-447e-44dd-940e-4b2008675423 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:09.558629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaec90-447e-44dd-940e-4b2008675423 admin admin] PATH_INFO: `/v3/projects/bdea946438504e1eb3e70ac5c0160dae/users/b93ea10813ed4f96aabb4dbe25cfa6bd/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:09.561847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaec90-447e-44dd-940e-4b2008675423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdea946438504e1eb3e70ac5c0160dae, user_id=b93ea10813ed4f96aabb4dbe25cfa6bd, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:09.565391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeaec90-447e-44dd-940e-4b2008675423 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:09.578837 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1185/2363] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:09 2022] PUT /identity/v3/projects/bdea946438504e1eb3e70ac5c0160dae/users/b93ea10813ed4f96aabb4dbe25cfa6bd/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:09.589680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbf0ba-32a8-492a-8c4c-02bc2b68bbe5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:09.590695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbf0ba-32a8-492a-8c4c-02bc2b68bbe5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:09.591487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbf0ba-32a8-492a-8c4c-02bc2b68bbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:09.636334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0ecbf0ba-32a8-492a-8c4c-02bc2b68bbe5 None None] MFA Rules not processed for user `b93ea10813ed4f96aabb4dbe25cfa6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:09.638790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0ecbf0ba-32a8-492a-8c4c-02bc2b68bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:09.874202 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1179/2364] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:09.884663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaec90-447e-44dd-940e-4b2008675423 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:09.887296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4aeaec90-447e-44dd-940e-4b2008675423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:10.173056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaec90-447e-44dd-940e-4b2008675423 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:10.184014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85681622-610e-4251-a987-db728a25aa2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:10.184820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681622-610e-4251-a987-db728a25aa2a service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:10.185332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681622-610e-4251-a987-db728a25aa2a service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:10.185673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85681622-610e-4251-a987-db728a25aa2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:10.203471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85681622-610e-4251-a987-db728a25aa2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:10.205402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85681622-610e-4251-a987-db728a25aa2a service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:10.231300 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1186/2365] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:12.661649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbf0ba-32a8-492a-8c4c-02bc2b68bbe5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:12.856053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbf0ba-32a8-492a-8c4c-02bc2b68bbe5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:12.869222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:12.870052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:12.870337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:12.870612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] PATH_INFO: `/v3/users/6955de0752b644b8aa32fe4ca724fb2e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:12.873797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6955de0752b644b8aa32fe4ca724fb2e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:12.875816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:13.030408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6955de0752b644b8aa32fe4ca724fb2e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.050159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6955de0752b644b8aa32fe4ca724fb2e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.051519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6955de0752b644b8aa32fe4ca724fb2e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.102107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6955de0752b644b8aa32fe4ca724fb2e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.102402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6955de0752b644b8aa32fe4ca724fb2e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:13.121564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:13.131080 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1180/2366] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:12 2022] DELETE /identity/v3/users/6955de0752b644b8aa32fe4ca724fb2e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:13.137236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01b143-f484-49cd-8a86-f1c604386f8f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:13.138074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01b143-f484-49cd-8a86-f1c604386f8f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:13.138074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01b143-f484-49cd-8a86-f1c604386f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:13.198295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6b01b143-f484-49cd-8a86-f1c604386f8f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:13.199582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6b01b143-f484-49cd-8a86-f1c604386f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:13.483156 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1187/2367] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:13.506405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:13.513836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:13.699432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f971d-a728-4a3a-898d-281c081706b5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:13.709246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb13c4d-f786-474a-9886-1e65ae0c4a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:13.711460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb13c4d-f786-474a-9886-1e65ae0c4a18 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:13.713031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb13c4d-f786-474a-9886-1e65ae0c4a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:13.713531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb13c4d-f786-474a-9886-1e65ae0c4a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:13.743134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb13c4d-f786-474a-9886-1e65ae0c4a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:13.753415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb13c4d-f786-474a-9886-1e65ae0c4a18 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:13.776812 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1181/2368] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:16.148331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01b143-f484-49cd-8a86-f1c604386f8f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:16.150511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6b01b143-f484-49cd-8a86-f1c604386f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:16.178561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01b143-f484-49cd-8a86-f1c604386f8f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:16.201444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fe15b-ccf8-43da-8751-7607c60bb3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:16.203016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fe15b-ccf8-43da-8751-7607c60bb3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:16.203510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fe15b-ccf8-43da-8751-7607c60bb3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:16.204297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fe15b-ccf8-43da-8751-7607c60bb3b2 admin admin] PATH_INFO: `/v3/projects/43cf5b3df74449f1b9d7bb3d3b6d98e5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:16.206430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fe15b-ccf8-43da-8751-7607c60bb3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43cf5b3df74449f1b9d7bb3d3b6d98e5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:16.209747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fe15b-ccf8-43da-8751-7607c60bb3b2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:16.344131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:16.359850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c63fe15b-ccf8-43da-8751-7607c60bb3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43cf5b3df74449f1b9d7bb3d3b6d98e5', 'request_id': 'req-c63fe15b-ccf8-43da-8751-7607c60bb3b2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.387437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c63fe15b-ccf8-43da-8751-7607c60bb3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43cf5b3df74449f1b9d7bb3d3b6d98e5', 'request_id': 'req-c63fe15b-ccf8-43da-8751-7607c60bb3b2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.406089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c63fe15b-ccf8-43da-8751-7607c60bb3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43cf5b3df74449f1b9d7bb3d3b6d98e5', 'request_id': 'req-c63fe15b-ccf8-43da-8751-7607c60bb3b2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.453689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c63fe15b-ccf8-43da-8751-7607c60bb3b2 admin admin] The token cache is being invalidate because project 43cf5b3df74449f1b9d7bb3d3b6d98e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:16.454137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c63fe15b-ccf8-43da-8751-7607c60bb3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.456904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c63fe15b-ccf8-43da-8751-7607c60bb3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.459536 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1188/2369] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:16 2022] DELETE /identity/v3/projects/43cf5b3df74449f1b9d7bb3d3b6d98e5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:16.465192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb13c4d-f786-474a-9886-1e65ae0c4a18 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:16.478149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb13c4d-f786-474a-9886-1e65ae0c4a18 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:16.584718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:16.589454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:16.589852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:16.590240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] PATH_INFO: `/v3/users/b93ea10813ed4f96aabb4dbe25cfa6bd` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:16.592556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93ea10813ed4f96aabb4dbe25cfa6bd)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:16.595686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:16.737243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93ea10813ed4f96aabb4dbe25cfa6bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.749555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93ea10813ed4f96aabb4dbe25cfa6bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.751919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93ea10813ed4f96aabb4dbe25cfa6bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.776946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93ea10813ed4f96aabb4dbe25cfa6bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.778489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93ea10813ed4f96aabb4dbe25cfa6bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:16.817669 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1182/2370] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:16 2022] DELETE /identity/v3/users/b93ea10813ed4f96aabb4dbe25cfa6bd => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:17.102293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8436-f301-4e8c-bbf6-d5487b9c4b70 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:17.102798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8436-f301-4e8c-bbf6-d5487b9c4b70 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:17.103182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c8436-f301-4e8c-bbf6-d5487b9c4b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:17.191736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-556c8436-f301-4e8c-bbf6-d5487b9c4b70 None None] MFA Rules not processed for user `3a8b891911af4a8c9f04941a6a112c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:17.193508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-556c8436-f301-4e8c-bbf6-d5487b9c4b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:17.356148 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1189/2371] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:17.379580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:17.381161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:17.492619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:17.665962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed740bf-4f35-42f0-95c2-d77f862f39ed admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:17.691230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec6b4d-bc45-4860-90c8-c5de3b28f0f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:17.691883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec6b4d-bc45-4860-90c8-c5de3b28f0f1 service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:17.692172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec6b4d-bc45-4860-90c8-c5de3b28f0f1 service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:17.692454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec6b4d-bc45-4860-90c8-c5de3b28f0f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:17.801880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec6b4d-bc45-4860-90c8-c5de3b28f0f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:17.812880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec6b4d-bc45-4860-90c8-c5de3b28f0f1 service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:17.859507 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1183/2372] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:21.948460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c8436-f301-4e8c-bbf6-d5487b9c4b70 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:21.955969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-556c8436-f301-4e8c-bbf6-d5487b9c4b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:22.215196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c8436-f301-4e8c-bbf6-d5487b9c4b70 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:22.231185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:22.233266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:22.234920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:22.235374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b admin admin] PATH_INFO: `/v3/projects/bdea946438504e1eb3e70ac5c0160dae` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:22.239306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdea946438504e1eb3e70ac5c0160dae)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:22.245057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:22.328476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdea946438504e1eb3e70ac5c0160dae', 'request_id': 'req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:22.344710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdea946438504e1eb3e70ac5c0160dae', 'request_id': 'req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:22.353970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdea946438504e1eb3e70ac5c0160dae', 'request_id': 'req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:22.357452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:22.393696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b admin admin] The token cache is being invalidate because project bdea946438504e1eb3e70ac5c0160dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:22.394414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:22.395333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-425e9f36-fd01-4e82-83b2-b2a89d5ef16b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:22.397096 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1190/2373] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:21 2022] DELETE /identity/v3/projects/bdea946438504e1eb3e70ac5c0160dae => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:22.404700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938f466-b314-43b2-b832-6ae76e064b52 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:22.406109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938f466-b314-43b2-b832-6ae76e064b52 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:22.406539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938f466-b314-43b2-b832-6ae76e064b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:22.463410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0938f466-b314-43b2-b832-6ae76e064b52 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:22.467778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0938f466-b314-43b2-b832-6ae76e064b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:22.600740 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1184/2374] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:22.613388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0a781-21c2-4b83-86fc-30e1d9cb5d1e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:22.614205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0a781-21c2-4b83-86fc-30e1d9cb5d1e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:22.614426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0a781-21c2-4b83-86fc-30e1d9cb5d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:22.647352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fcb0a781-21c2-4b83-86fc-30e1d9cb5d1e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:22.649097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fcb0a781-21c2-4b83-86fc-30e1d9cb5d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:22.663164 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1191/2375] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:22.664888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938f466-b314-43b2-b832-6ae76e064b52 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:22.685462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938f466-b314-43b2-b832-6ae76e064b52 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:22.692055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922d117-3463-41cc-83ac-000dae2c25df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:22.692055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922d117-3463-41cc-83ac-000dae2c25df admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:22.692343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922d117-3463-41cc-83ac-000dae2c25df admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:22.692628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922d117-3463-41cc-83ac-000dae2c25df admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:22.693347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922d117-3463-41cc-83ac-000dae2c25df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:22.693660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922d117-3463-41cc-83ac-000dae2c25df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:22.695589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922d117-3463-41cc-83ac-000dae2c25df admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:22.718714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0a781-21c2-4b83-86fc-30e1d9cb5d1e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:22.730980 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1185/2376] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:22.732304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0a781-21c2-4b83-86fc-30e1d9cb5d1e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:22.739531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8e407-d5ca-47a2-919a-4d7b9f37d64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:22.740301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8e407-d5ca-47a2-919a-4d7b9f37d64d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:22.740585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8e407-d5ca-47a2-919a-4d7b9f37d64d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:22.740871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8e407-d5ca-47a2-919a-4d7b9f37d64d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:22.741492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8e407-d5ca-47a2-919a-4d7b9f37d64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:22.745999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8e407-d5ca-47a2-919a-4d7b9f37d64d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:22.791510 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1192/2377] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:22 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:22.796230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922d117-3463-41cc-83ac-000dae2c25df admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:22.813168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922d117-3463-41cc-83ac-000dae2c25df admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:22.927482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb57ac-72cc-4658-94e6-d8a950bae86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:22.931450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb57ac-72cc-4658-94e6-d8a950bae86e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:22.932458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb57ac-72cc-4658-94e6-d8a950bae86e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:22.932753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb57ac-72cc-4658-94e6-d8a950bae86e admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:22.933426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb57ac-72cc-4658-94e6-d8a950bae86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:22.943247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb57ac-72cc-4658-94e6-d8a950bae86e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:22.981060 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1186/2378] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:22 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:22.985163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8e407-d5ca-47a2-919a-4d7b9f37d64d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:23.000136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8e407-d5ca-47a2-919a-4d7b9f37d64d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:23.023129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbb358-d23f-4a3f-9bbc-d87803b5bb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:23.023129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbb358-d23f-4a3f-9bbc-d87803b5bb26 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:23.023129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbb358-d23f-4a3f-9bbc-d87803b5bb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:23.023129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbb358-d23f-4a3f-9bbc-d87803b5bb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:23.023834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbb358-d23f-4a3f-9bbc-d87803b5bb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:23.025414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbb358-d23f-4a3f-9bbc-d87803b5bb26 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:23.053099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb57ac-72cc-4658-94e6-d8a950bae86e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:23.058945 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1193/2379] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:23.078199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb57ac-72cc-4658-94e6-d8a950bae86e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:23.084489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c37c2-1cee-45c4-b081-d8675a65cb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:23.085725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c37c2-1cee-45c4-b081-d8675a65cb5d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:23.085725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c37c2-1cee-45c4-b081-d8675a65cb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:23.085725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c37c2-1cee-45c4-b081-d8675a65cb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:23.086214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c37c2-1cee-45c4-b081-d8675a65cb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:23.087831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c37c2-1cee-45c4-b081-d8675a65cb5d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:23.136042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbb358-d23f-4a3f-9bbc-d87803b5bb26 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:23.143882 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1187/2380] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:53:23.153065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbb358-d23f-4a3f-9bbc-d87803b5bb26 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:23.170268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afdfde-b57d-4732-b178-801fb09bb4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:23.170268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afdfde-b57d-4732-b178-801fb09bb4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:23.170268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afdfde-b57d-4732-b178-801fb09bb4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:23.170982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afdfde-b57d-4732-b178-801fb09bb4d5 admin admin] PATH_INFO: `/v3/projects/e30ab21f2f0c4febab26d4cdcd709da0/users/3b60bdd35de444978f81b8f4ffc14c18/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:23.280316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afdfde-b57d-4732-b178-801fb09bb4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e30ab21f2f0c4febab26d4cdcd709da0, user_id=3b60bdd35de444978f81b8f4ffc14c18, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:23.283074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afdfde-b57d-4732-b178-801fb09bb4d5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:23.326655 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1194/2381] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:23 2022] PUT /identity/v3/projects/e30ab21f2f0c4febab26d4cdcd709da0/users/3b60bdd35de444978f81b8f4ffc14c18/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:23.334591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36518353-a1ad-4350-82e9-dfb8b23f06c0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:23.335194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36518353-a1ad-4350-82e9-dfb8b23f06c0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:23.335646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36518353-a1ad-4350-82e9-dfb8b23f06c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:23.396009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-36518353-a1ad-4350-82e9-dfb8b23f06c0 None None] MFA Rules not processed for user `3b60bdd35de444978f81b8f4ffc14c18`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:23.413303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-36518353-a1ad-4350-82e9-dfb8b23f06c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:23.487979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:23.752992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afdfde-b57d-4732-b178-801fb09bb4d5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:23.763456 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1188/2382] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:23.932096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afdfde-b57d-4732-b178-801fb09bb4d5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:23.945213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a23641-c7da-4323-b48d-2b2849149638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:23.945741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a23641-c7da-4323-b48d-2b2849149638 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:23.946023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a23641-c7da-4323-b48d-2b2849149638 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:23.946298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a23641-c7da-4323-b48d-2b2849149638 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:23.946975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a23641-c7da-4323-b48d-2b2849149638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:23.958884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a23641-c7da-4323-b48d-2b2849149638 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:24.057776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36518353-a1ad-4350-82e9-dfb8b23f06c0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:24.067100 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1195/2383] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:23 2022] POST /identity/v3/projects => generated 373 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:24.075029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36518353-a1ad-4350-82e9-dfb8b23f06c0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:24.262310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80110ad9-f3f7-4873-9530-2841e3a440a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:24.263698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80110ad9-f3f7-4873-9530-2841e3a440a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:24.263985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80110ad9-f3f7-4873-9530-2841e3a440a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:24.264262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80110ad9-f3f7-4873-9530-2841e3a440a5 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:24.266773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80110ad9-f3f7-4873-9530-2841e3a440a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:24.277148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80110ad9-f3f7-4873-9530-2841e3a440a5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:24.335812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a23641-c7da-4323-b48d-2b2849149638 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:24.344027 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1189/2384] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:24 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:24.350460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a23641-c7da-4323-b48d-2b2849149638 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:24.362940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49523c7-4d39-473e-a0c2-21400bf7075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:24.363573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49523c7-4d39-473e-a0c2-21400bf7075c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:24.363855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49523c7-4d39-473e-a0c2-21400bf7075c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:24.364131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49523c7-4d39-473e-a0c2-21400bf7075c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:24.364849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49523c7-4d39-473e-a0c2-21400bf7075c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:24.370614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49523c7-4d39-473e-a0c2-21400bf7075c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:24.407452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80110ad9-f3f7-4873-9530-2841e3a440a5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:24.415757 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1196/2385] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:24.422937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80110ad9-f3f7-4873-9530-2841e3a440a5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:24.437598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c965e-cb87-4006-9524-42ea55469ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:24.438348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c965e-cb87-4006-9524-42ea55469ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:24.438637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c965e-cb87-4006-9524-42ea55469ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:24.439139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c965e-cb87-4006-9524-42ea55469ef4 admin admin] PATH_INFO: `/v3/projects/e6ba0e1b6f084b72b935b22161c2d1e3/users/0dca93ccc29841e68db969946e0ee79d/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:24.476852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c965e-cb87-4006-9524-42ea55469ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ba0e1b6f084b72b935b22161c2d1e3, user_id=0dca93ccc29841e68db969946e0ee79d, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:24.479945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c965e-cb87-4006-9524-42ea55469ef4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:24.518875 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1190/2386] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:24 2022] PUT /identity/v3/projects/e6ba0e1b6f084b72b935b22161c2d1e3/users/0dca93ccc29841e68db969946e0ee79d/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:24.519093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49523c7-4d39-473e-a0c2-21400bf7075c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:24.530701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49523c7-4d39-473e-a0c2-21400bf7075c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:24.725623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d8575-42a6-4388-83ec-6cf7b0cfe78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:24.726268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8575-42a6-4388-83ec-6cf7b0cfe78f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:24.726629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8575-42a6-4388-83ec-6cf7b0cfe78f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:24.726867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8575-42a6-4388-83ec-6cf7b0cfe78f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:24.727602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d8575-42a6-4388-83ec-6cf7b0cfe78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:24.729200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d8575-42a6-4388-83ec-6cf7b0cfe78f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:24.740586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:24.773043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c965e-cb87-4006-9524-42ea55469ef4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:24.774248 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1197/2387] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:24.796507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c965e-cb87-4006-9524-42ea55469ef4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:24.802999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93d955-7a3e-4f45-8dd5-c0efc7d1a515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:24.803675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93d955-7a3e-4f45-8dd5-c0efc7d1a515 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:24.803958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93d955-7a3e-4f45-8dd5-c0efc7d1a515 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:24.804382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93d955-7a3e-4f45-8dd5-c0efc7d1a515 admin admin] PATH_INFO: `/v3/projects/e6ba0e1b6f084b72b935b22161c2d1e3/users/0dca93ccc29841e68db969946e0ee79d/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:24.813532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93d955-7a3e-4f45-8dd5-c0efc7d1a515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ba0e1b6f084b72b935b22161c2d1e3, user_id=0dca93ccc29841e68db969946e0ee79d, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:24.816508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93d955-7a3e-4f45-8dd5-c0efc7d1a515 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:24.857810 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1191/2388] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:24 2022] PUT /identity/v3/projects/e6ba0e1b6f084b72b935b22161c2d1e3/users/0dca93ccc29841e68db969946e0ee79d/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:24.861850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ee4bd-a116-4be9-a284-98623f7b0c7f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:24.862213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ee4bd-a116-4be9-a284-98623f7b0c7f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:24.862400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ee4bd-a116-4be9-a284-98623f7b0c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:24.954966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8c3ee4bd-a116-4be9-a284-98623f7b0c7f None None] MFA Rules not processed for user `0dca93ccc29841e68db969946e0ee79d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:24.956318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8c3ee4bd-a116-4be9-a284-98623f7b0c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:25.152500 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1198/2389] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:25.172398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93d955-7a3e-4f45-8dd5-c0efc7d1a515 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:25.199797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93d955-7a3e-4f45-8dd5-c0efc7d1a515 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:25.206320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d15f23-53da-42ec-9fab-52120578b601 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dca93ccc29841e68db969946e0ee79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:25.207013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15f23-53da-42ec-9fab-52120578b601 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:25.207304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15f23-53da-42ec-9fab-52120578b601 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:25.207582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15f23-53da-42ec-9fab-52120578b601 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:25.208246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d15f23-53da-42ec-9fab-52120578b601 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:25.208558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d15f23-53da-42ec-9fab-52120578b601 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:25.214757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d15f23-53da-42ec-9fab-52120578b601 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:25.247142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ee4bd-a116-4be9-a284-98623f7b0c7f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:25.260220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ee4bd-a116-4be9-a284-98623f7b0c7f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:25.277875 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1192/2390] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:25.281516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314a247-e360-4438-b2b0-f5ba5338b47b tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dca93ccc29841e68db969946e0ee79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:25.282270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314a247-e360-4438-b2b0-f5ba5338b47b tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:25.282557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314a247-e360-4438-b2b0-f5ba5338b47b tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:25.282848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314a247-e360-4438-b2b0-f5ba5338b47b tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:25.283493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314a247-e360-4438-b2b0-f5ba5338b47b tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:25.286996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314a247-e360-4438-b2b0-f5ba5338b47b tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:25.377099 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1199/2391] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:25 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:25.379309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d15f23-53da-42ec-9fab-52120578b601 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:25.399531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d15f23-53da-42ec-9fab-52120578b601 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:25.552978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3834e2-4339-48b2-8f1f-9ba5ad88f25e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dca93ccc29841e68db969946e0ee79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:25.554151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3834e2-4339-48b2-8f1f-9ba5ad88f25e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:25.554831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3834e2-4339-48b2-8f1f-9ba5ad88f25e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:25.558427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3834e2-4339-48b2-8f1f-9ba5ad88f25e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:25.569006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3834e2-4339-48b2-8f1f-9ba5ad88f25e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:25.569476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3834e2-4339-48b2-8f1f-9ba5ad88f25e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:25.571342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3834e2-4339-48b2-8f1f-9ba5ad88f25e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:25.582081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:25.612989 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1193/2392] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:25.614528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314a247-e360-4438-b2b0-f5ba5338b47b tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:25.616405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b314a247-e360-4438-b2b0-f5ba5338b47b tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:25.820105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314a247-e360-4438-b2b0-f5ba5338b47b tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:25.834865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3709daa-845d-4fac-bcd6-a8873d7f63d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:25.835501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3709daa-845d-4fac-bcd6-a8873d7f63d1 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:25.835953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3709daa-845d-4fac-bcd6-a8873d7f63d1 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:25.836064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3709daa-845d-4fac-bcd6-a8873d7f63d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:25.855167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3709daa-845d-4fac-bcd6-a8873d7f63d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:25.857520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3709daa-845d-4fac-bcd6-a8873d7f63d1 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:25.885184 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1200/2393] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:25.940380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3359-edd5-4890-bfac-e36c9832a4da None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:25.940672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3359-edd5-4890-bfac-e36c9832a4da None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:25.942606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb3359-edd5-4890-bfac-e36c9832a4da None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:25.948314 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1194/2394] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:53:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:53:25.952148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3709daa-845d-4fac-bcd6-a8873d7f63d1 service nova] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:53:25.972574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3709daa-845d-4fac-bcd6-a8873d7f63d1 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:26.002893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3709daa-845d-4fac-bcd6-a8873d7f63d1 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:26.026512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a0d76-f5ff-4ac6-a755-9f3d94e4b3cb tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dca93ccc29841e68db969946e0ee79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:26.027253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a0d76-f5ff-4ac6-a755-9f3d94e4b3cb tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:26.027501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a0d76-f5ff-4ac6-a755-9f3d94e4b3cb tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:26.027782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a0d76-f5ff-4ac6-a755-9f3d94e4b3cb tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] PATH_INFO: `/v3/projects/e55b0f0f6a854f81bbb33cb0aed054fd` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:26.036937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a0d76-f5ff-4ac6-a755-9f3d94e4b3cb tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorizing `identity:get_project(project_id=e55b0f0f6a854f81bbb33cb0aed054fd)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:26.046288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a0d76-f5ff-4ac6-a755-9f3d94e4b3cb tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:26.070487 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1201/2395] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:53:25 2022] GET /identity/v3/projects/e55b0f0f6a854f81bbb33cb0aed054fd => generated 371 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:27.940701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174d9bf-8d50-4cd9-86bb-ccf6c8d073af None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:27.940701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174d9bf-8d50-4cd9-86bb-ccf6c8d073af None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:27.940701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174d9bf-8d50-4cd9-86bb-ccf6c8d073af None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:27.940701 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1195/2396] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:53:27.976019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a0d76-f5ff-4ac6-a755-9f3d94e4b3cb tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:53:28.007379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a0d76-f5ff-4ac6-a755-9f3d94e4b3cb tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:28.038678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a0d76-f5ff-4ac6-a755-9f3d94e4b3cb tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:28.046026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010645ef-a243-49e1-8bca-fd652da58cb1 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dca93ccc29841e68db969946e0ee79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:28.047045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010645ef-a243-49e1-8bca-fd652da58cb1 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:28.047473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010645ef-a243-49e1-8bca-fd652da58cb1 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:28.047931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010645ef-a243-49e1-8bca-fd652da58cb1 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] PATH_INFO: `/v3/projects/e55b0f0f6a854f81bbb33cb0aed054fd` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:28.055162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010645ef-a243-49e1-8bca-fd652da58cb1 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorizing `identity:get_project(project_id=e55b0f0f6a854f81bbb33cb0aed054fd)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:28.058393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010645ef-a243-49e1-8bca-fd652da58cb1 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:28.061529 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1202/2397] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:53:27 2022] GET /identity/v3/projects/e55b0f0f6a854f81bbb33cb0aed054fd => generated 371 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:53:28.298608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174d9bf-8d50-4cd9-86bb-ccf6c8d073af None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:28.371577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174d9bf-8d50-4cd9-86bb-ccf6c8d073af None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:28.400651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5de3b-a986-4b46-b85e-9d82326f18aa tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dca93ccc29841e68db969946e0ee79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:28.403901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5de3b-a986-4b46-b85e-9d82326f18aa tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:28.404181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5de3b-a986-4b46-b85e-9d82326f18aa tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:28.406353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5de3b-a986-4b46-b85e-9d82326f18aa tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:28.407946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5de3b-a986-4b46-b85e-9d82326f18aa tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:28.408485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5de3b-a986-4b46-b85e-9d82326f18aa tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:28.416669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5de3b-a986-4b46-b85e-9d82326f18aa tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:28.490134 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1196/2398] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:28.493369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010645ef-a243-49e1-8bca-fd652da58cb1 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:28.504340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010645ef-a243-49e1-8bca-fd652da58cb1 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:28.531603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79c545-9e33-46a2-87be-058b751c62ce tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dca93ccc29841e68db969946e0ee79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:28.532234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79c545-9e33-46a2-87be-058b751c62ce tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:28.532517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79c545-9e33-46a2-87be-058b751c62ce tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:28.532792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79c545-9e33-46a2-87be-058b751c62ce tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:28.533575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79c545-9e33-46a2-87be-058b751c62ce tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:28.536631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79c545-9e33-46a2-87be-058b751c62ce tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:28.618499 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1203/2399] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:28 2022] POST /identity/v3/users => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:28.625055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5de3b-a986-4b46-b85e-9d82326f18aa tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:28.660101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5de3b-a986-4b46-b85e-9d82326f18aa tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:28.673266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e6dba-4197-4bbd-a2dc-c90945e0823e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dca93ccc29841e68db969946e0ee79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:28.674157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e6dba-4197-4bbd-a2dc-c90945e0823e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:28.674650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e6dba-4197-4bbd-a2dc-c90945e0823e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:28.675186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e6dba-4197-4bbd-a2dc-c90945e0823e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:28.676067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e6dba-4197-4bbd-a2dc-c90945e0823e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:28.676581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e6dba-4197-4bbd-a2dc-c90945e0823e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:28.678421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e6dba-4197-4bbd-a2dc-c90945e0823e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:28.711148 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1197/2400] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:29.156676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162451e-52d9-4ddb-84aa-0dee510a7995 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:29.157609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162451e-52d9-4ddb-84aa-0dee510a7995 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:29.158113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162451e-52d9-4ddb-84aa-0dee510a7995 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:29.159877 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1204/2401] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:53:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:53:29.173108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e6dba-4197-4bbd-a2dc-c90945e0823e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:53:29.196538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e6dba-4197-4bbd-a2dc-c90945e0823e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:29.224322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e6dba-4197-4bbd-a2dc-c90945e0823e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:29.240352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8f9d7-8168-42dd-af99-8ca6c71e506e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dca93ccc29841e68db969946e0ee79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:29.241390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8f9d7-8168-42dd-af99-8ca6c71e506e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:29.241879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8f9d7-8168-42dd-af99-8ca6c71e506e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:29.242360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8f9d7-8168-42dd-af99-8ca6c71e506e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] PATH_INFO: `/v3/projects/e55b0f0f6a854f81bbb33cb0aed054fd` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:29.243841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8f9d7-8168-42dd-af99-8ca6c71e506e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorizing `identity:get_project(project_id=e55b0f0f6a854f81bbb33cb0aed054fd)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:29.248471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8f9d7-8168-42dd-af99-8ca6c71e506e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:29.254284 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1198/2402] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:53:29 2022] GET /identity/v3/projects/e55b0f0f6a854f81bbb33cb0aed054fd => generated 371 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:29.869104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7308870-e98f-43d9-9e6d-404507abe9f5 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:29.869817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7308870-e98f-43d9-9e6d-404507abe9f5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:29.870310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7308870-e98f-43d9-9e6d-404507abe9f5 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:29.875238 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1205/2403] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:53:29 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:53:29.880462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8f9d7-8168-42dd-af99-8ca6c71e506e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:53:29.883324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-21f8f9d7-8168-42dd-af99-8ca6c71e506e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:29.911831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8f9d7-8168-42dd-af99-8ca6c71e506e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:29.950106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8f9d7-8168-42dd-af99-8ca6c71e506e tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:29.963543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ff50a-af36-4d0f-b3a1-6769ced906b9 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dca93ccc29841e68db969946e0ee79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:29.964164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ff50a-af36-4d0f-b3a1-6769ced906b9 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:29.964461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ff50a-af36-4d0f-b3a1-6769ced906b9 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:29.964737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ff50a-af36-4d0f-b3a1-6769ced906b9 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] PATH_INFO: `/v3/projects/e55b0f0f6a854f81bbb33cb0aed054fd` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:29.970561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ff50a-af36-4d0f-b3a1-6769ced906b9 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorizing `identity:get_project(project_id=e55b0f0f6a854f81bbb33cb0aed054fd)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:29.972753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ff50a-af36-4d0f-b3a1-6769ced906b9 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:30.004987 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1199/2404] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:53:29 2022] GET /identity/v3/projects/e55b0f0f6a854f81bbb33cb0aed054fd => generated 371 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:30.058704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7308870-e98f-43d9-9e6d-404507abe9f5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:30.101511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7308870-e98f-43d9-9e6d-404507abe9f5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:30.140898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dd86f-5f71-4ae1-86f9-4699d0aadc42 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:30.141166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dd86f-5f71-4ae1-86f9-4699d0aadc42 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:30.141446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dd86f-5f71-4ae1-86f9-4699d0aadc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:30.182909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b3960-2cf8-4638-9f25-de79a6ed6c73 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dca93ccc29841e68db969946e0ee79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:30.188082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b3960-2cf8-4638-9f25-de79a6ed6c73 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:30.188442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b3960-2cf8-4638-9f25-de79a6ed6c73 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:30.188731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b3960-2cf8-4638-9f25-de79a6ed6c73 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] PATH_INFO: `/v3/users/ccd57cbf627c456da3c7a44c7fb52122` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:30.221622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:30.239169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b3960-2cf8-4638-9f25-de79a6ed6c73 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ccd57cbf627c456da3c7a44c7fb52122)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:30.260642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-259dd86f-5f71-4ae1-86f9-4699d0aadc42 None None] MFA Rules not processed for user `51c756406a9742b49cde4945e9553236`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:30.265055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-259dd86f-5f71-4ae1-86f9-4699d0aadc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:30.266883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b3960-2cf8-4638-9f25-de79a6ed6c73 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:30.474599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-271b3960-2cf8-4638-9f25-de79a6ed6c73 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd57cbf627c456da3c7a44c7fb52122'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:30.516776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-271b3960-2cf8-4638-9f25-de79a6ed6c73 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd57cbf627c456da3c7a44c7fb52122'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:30.519441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-271b3960-2cf8-4638-9f25-de79a6ed6c73 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd57cbf627c456da3c7a44c7fb52122'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:30.530562 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1200/2405] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:30 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:30.537504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9db837-b3a6-44d6-9886-a547ac986e3f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:30.538292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9db837-b3a6-44d6-9886-a547ac986e3f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:30.538731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9db837-b3a6-44d6-9886-a547ac986e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:30.557207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-271b3960-2cf8-4638-9f25-de79a6ed6c73 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd57cbf627c456da3c7a44c7fb52122'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:30.558197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-271b3960-2cf8-4638-9f25-de79a6ed6c73 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd57cbf627c456da3c7a44c7fb52122'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:30.611697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2b9db837-b3a6-44d6-9886-a547ac986e3f None None] MFA Rules not processed for user `3b738496864a4b04bc885b75980e2341`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:30.614541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2b9db837-b3a6-44d6-9886-a547ac986e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:30.634934 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1206/2406] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:30 2022] DELETE /identity/v3/users/ccd57cbf627c456da3c7a44c7fb52122 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:30.639534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b786f-2914-4c3b-a8d4-7f32c3dcfc9c None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:30.639828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b786f-2914-4c3b-a8d4-7f32c3dcfc9c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:30.640113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b786f-2914-4c3b-a8d4-7f32c3dcfc9c None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:30.648003 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1207/2407] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:53:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:53:30.648905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b786f-2914-4c3b-a8d4-7f32c3dcfc9c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:30.661788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4b8b786f-2914-4c3b-a8d4-7f32c3dcfc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:30.845535 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1201/2408] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:30 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:30.851952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90e646-0e0f-44ce-b9e5-9d26ed9d234e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:30.852267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90e646-0e0f-44ce-b9e5-9d26ed9d234e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:30.852539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90e646-0e0f-44ce-b9e5-9d26ed9d234e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:30.901504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b786f-2914-4c3b-a8d4-7f32c3dcfc9c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:30.918200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dca93ccc29841e68db969946e0ee79d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:30.919158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:30.919576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:30.919857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] PATH_INFO: `/v3/projects/e55b0f0f6a854f81bbb33cb0aed054fd` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:30.920759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6b90e646-0e0f-44ce-b9e5-9d26ed9d234e None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:30.921999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6b90e646-0e0f-44ce-b9e5-9d26ed9d234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:30.927006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e55b0f0f6a854f81bbb33cb0aed054fd)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:30.930108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:31.046159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:31.058947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e55b0f0f6a854f81bbb33cb0aed054fd', 'request_id': 'req-45a3b025-8553-4eb0-badb-bef8fbac04a8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:31.072732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e55b0f0f6a854f81bbb33cb0aed054fd', 'request_id': 'req-45a3b025-8553-4eb0-badb-bef8fbac04a8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:31.090646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e55b0f0f6a854f81bbb33cb0aed054fd', 'request_id': 'req-45a3b025-8553-4eb0-badb-bef8fbac04a8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:31.124740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] The token cache is being invalidate because project e55b0f0f6a854f81bbb33cb0aed054fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:31.124740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:31.124740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:31.124740 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1208/2409] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:30 2022] DELETE /identity/v3/projects/e55b0f0f6a854f81bbb33cb0aed054fd => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:31.138601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:31.139236 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1202/2410] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 18:53:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:31.140096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:31.146600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:31.271266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90e646-0e0f-44ce-b9e5-9d26ed9d234e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:31.273610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6b90e646-0e0f-44ce-b9e5-9d26ed9d234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:31.300471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90e646-0e0f-44ce-b9e5-9d26ed9d234e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:31.321995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3b025-8553-4eb0-badb-bef8fbac04a8 tempest-QuotasAdminTestV236-562535295 tempest-QuotasAdminTestV236-562535295-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:31.334487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:31.335289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:31.335643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:31.335991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] PATH_INFO: `/v3/users/3b60bdd35de444978f81b8f4ffc14c18` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:31.337857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b60bdd35de444978f81b8f4ffc14c18)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:31.339984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:31.448875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe2881-dda2-48c2-9bf1-4645211e9a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:31.451555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe2881-dda2-48c2-9bf1-4645211e9a69 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:31.451951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe2881-dda2-48c2-9bf1-4645211e9a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:31.452236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe2881-dda2-48c2-9bf1-4645211e9a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:31.457610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8afe2881-dda2-48c2-9bf1-4645211e9a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:31.470401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe2881-dda2-48c2-9bf1-4645211e9a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:31.472001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe2881-dda2-48c2-9bf1-4645211e9a69 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:31.484262 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1203/2411] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:31.484971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b60bdd35de444978f81b8f4ffc14c18'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:31.502329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b60bdd35de444978f81b8f4ffc14c18'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:31.503199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b60bdd35de444978f81b8f4ffc14c18'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:31.512610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b60bdd35de444978f81b8f4ffc14c18'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:31.513434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b60bdd35de444978f81b8f4ffc14c18'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:31.536350 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1209/2412] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:31 2022] DELETE /identity/v3/users/3b60bdd35de444978f81b8f4ffc14c18 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:31.541029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc737e9-4a72-4a52-9050-f739b23834aa None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:31.541323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc737e9-4a72-4a52-9050-f739b23834aa None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:31.542631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc737e9-4a72-4a52-9050-f739b23834aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:31.593202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cbc737e9-4a72-4a52-9050-f739b23834aa None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:31.594450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cbc737e9-4a72-4a52-9050-f739b23834aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:31.698797 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1204/2413] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:31.733401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:31.735008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:31.766917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc737e9-4a72-4a52-9050-f739b23834aa None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:31.766917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cbc737e9-4a72-4a52-9050-f739b23834aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:32.030273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc737e9-4a72-4a52-9050-f739b23834aa None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:32.040462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142c389-6152-4fcd-acb0-eff93b654203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:32.041140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c389-6152-4fcd-acb0-eff93b654203 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:32.041664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c389-6152-4fcd-acb0-eff93b654203 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:32.041920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142c389-6152-4fcd-acb0-eff93b654203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:32.050935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de569bdf-707c-4eff-aa23-efc2afd46076 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:32.074791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb33a9-dfb6-48b0-8266-abbe10d92c41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:32.074791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb33a9-dfb6-48b0-8266-abbe10d92c41 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:32.074791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb33a9-dfb6-48b0-8266-abbe10d92c41 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:32.074791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb33a9-dfb6-48b0-8266-abbe10d92c41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:32.077535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8fbb33a9-dfb6-48b0-8266-abbe10d92c41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:32.080251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142c389-6152-4fcd-acb0-eff93b654203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:32.081741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142c389-6152-4fcd-acb0-eff93b654203 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:32.112255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:32.115258 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1205/2414] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:32.247102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb33a9-dfb6-48b0-8266-abbe10d92c41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:32.249273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb33a9-dfb6-48b0-8266-abbe10d92c41 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:32.292737 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1210/2415] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:32.714320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74d32b-70a7-47b5-a88b-e2c73f91d54d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:32.714912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74d32b-70a7-47b5-a88b-e2c73f91d54d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:32.714912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74d32b-70a7-47b5-a88b-e2c73f91d54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:32.752340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7d74d32b-70a7-47b5-a88b-e2c73f91d54d None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:32.753581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7d74d32b-70a7-47b5-a88b-e2c73f91d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:32.834897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:32.880897 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1206/2416] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 18:53:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:32.989401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb33a9-dfb6-48b0-8266-abbe10d92c41 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:32.991037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8fbb33a9-dfb6-48b0-8266-abbe10d92c41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:33.115330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74d32b-70a7-47b5-a88b-e2c73f91d54d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:33.117059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7d74d32b-70a7-47b5-a88b-e2c73f91d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:33.147584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74d32b-70a7-47b5-a88b-e2c73f91d54d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:33.158947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:33.159996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:33.160642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:33.161084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] PATH_INFO: `/v3/projects/e30ab21f2f0c4febab26d4cdcd709da0` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:33.163626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb33a9-dfb6-48b0-8266-abbe10d92c41 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:33.164555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e30ab21f2f0c4febab26d4cdcd709da0)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:33.166526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:33.172972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb573a-d2a2-4130-9c70-779ed1227848 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:33.174064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb573a-d2a2-4130-9c70-779ed1227848 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:33.174272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb573a-d2a2-4130-9c70-779ed1227848 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:33.174666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb573a-d2a2-4130-9c70-779ed1227848 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:33.188002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb573a-d2a2-4130-9c70-779ed1227848 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:33.190240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb573a-d2a2-4130-9c70-779ed1227848 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:33.203473 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1211/2417] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 18:53:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:53:33.272504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e30ab21f2f0c4febab26d4cdcd709da0', 'request_id': 'req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.284947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e30ab21f2f0c4febab26d4cdcd709da0', 'request_id': 'req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.295101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e30ab21f2f0c4febab26d4cdcd709da0', 'request_id': 'req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.316834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] The token cache is being invalidate because project e30ab21f2f0c4febab26d4cdcd709da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:33.317332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.318300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.324591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb573a-d2a2-4130-9c70-779ed1227848 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:33.330563 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1207/2418] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:33 2022] DELETE /identity/v3/projects/e30ab21f2f0c4febab26d4cdcd709da0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:33.336873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb573a-d2a2-4130-9c70-779ed1227848 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:33.475094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33008159-ec49-4aa6-9720-64985357e050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:33.476043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008159-ec49-4aa6-9720-64985357e050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:33.477032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008159-ec49-4aa6-9720-64985357e050 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:33.477523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008159-ec49-4aa6-9720-64985357e050 admin admin] PATH_INFO: `/v3/users/0dca93ccc29841e68db969946e0ee79d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:33.478926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008159-ec49-4aa6-9720-64985357e050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dca93ccc29841e68db969946e0ee79d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:33.482254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008159-ec49-4aa6-9720-64985357e050 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:33.641777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-33008159-ec49-4aa6-9720-64985357e050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dca93ccc29841e68db969946e0ee79d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.647705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:33.672033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-33008159-ec49-4aa6-9720-64985357e050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dca93ccc29841e68db969946e0ee79d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.672931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-33008159-ec49-4aa6-9720-64985357e050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dca93ccc29841e68db969946e0ee79d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.692296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-33008159-ec49-4aa6-9720-64985357e050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dca93ccc29841e68db969946e0ee79d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.693263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-33008159-ec49-4aa6-9720-64985357e050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dca93ccc29841e68db969946e0ee79d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:33.730105 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1212/2419] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:33 2022] DELETE /identity/v3/users/0dca93ccc29841e68db969946e0ee79d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:35.046814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:35.049254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:35.086594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e1625-6fc5-4f4d-9c58-7a4adfa160f7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:35.259496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:35.260196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:35.260479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:35.260763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] PATH_INFO: `/v3/projects/e6ba0e1b6f084b72b935b22161c2d1e3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:35.265797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ba0e1b6f084b72b935b22161c2d1e3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:35.270732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:35.434613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'request_id': 'req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:35.457863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'request_id': 'req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:35.470213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ba0e1b6f084b72b935b22161c2d1e3', 'request_id': 'req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:35.471290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:35.488799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] The token cache is being invalidate because project e6ba0e1b6f084b72b935b22161c2d1e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:35.489381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:35.490480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:35.495930 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1208/2420] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:35 2022] DELETE /identity/v3/projects/e6ba0e1b6f084b72b935b22161c2d1e3 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:35.503445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0307c5-6039-4567-9b5a-f5ff6dd87587 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:35.503912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0307c5-6039-4567-9b5a-f5ff6dd87587 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:35.504007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0307c5-6039-4567-9b5a-f5ff6dd87587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:35.527218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fe0307c5-6039-4567-9b5a-f5ff6dd87587 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:35.529496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fe0307c5-6039-4567-9b5a-f5ff6dd87587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:35.573113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:35.578172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:35.624067 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1213/2421] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:35.625844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decfea2-6656-47e5-9c04-d907c9115021 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:35.626371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decfea2-6656-47e5-9c04-d907c9115021 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:35.626886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decfea2-6656-47e5-9c04-d907c9115021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:35.680708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6decfea2-6656-47e5-9c04-d907c9115021 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:35.683384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6decfea2-6656-47e5-9c04-d907c9115021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:35.716234 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1214/2422] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:35.718887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decfea2-6656-47e5-9c04-d907c9115021 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:35.734919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decfea2-6656-47e5-9c04-d907c9115021 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:35.752702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105336c9-7f82-4210-a90f-c09bba42e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:35.753888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105336c9-7f82-4210-a90f-c09bba42e304 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:35.755247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105336c9-7f82-4210-a90f-c09bba42e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:35.755864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105336c9-7f82-4210-a90f-c09bba42e304 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:35.757797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105336c9-7f82-4210-a90f-c09bba42e304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:35.759029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105336c9-7f82-4210-a90f-c09bba42e304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:35.768800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105336c9-7f82-4210-a90f-c09bba42e304 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:35.809189 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1215/2423] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:35.814433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105336c9-7f82-4210-a90f-c09bba42e304 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:35.816977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce116f-5dd6-4b40-8f27-4d47b4162d68 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:35.829846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85b131-6090-4e0a-954b-f63e6228194d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:35.832241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b131-6090-4e0a-954b-f63e6228194d service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:35.832607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b131-6090-4e0a-954b-f63e6228194d service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:35.832976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b131-6090-4e0a-954b-f63e6228194d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:35.834541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105336c9-7f82-4210-a90f-c09bba42e304 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:35.838223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3f85b131-6090-4e0a-954b-f63e6228194d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:35.856970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa070b4-4bb4-4dbf-9707-a26949e21304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:35.857958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa070b4-4bb4-4dbf-9707-a26949e21304 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:35.859971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa070b4-4bb4-4dbf-9707-a26949e21304 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:35.860341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa070b4-4bb4-4dbf-9707-a26949e21304 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:35.861487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa070b4-4bb4-4dbf-9707-a26949e21304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:35.866311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa070b4-4bb4-4dbf-9707-a26949e21304 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:35.933835 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1216/2424] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:35 2022] POST /identity/v3/projects => generated 403 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:35.941853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa070b4-4bb4-4dbf-9707-a26949e21304 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:36.004270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85b131-6090-4e0a-954b-f63e6228194d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:36.005399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85b131-6090-4e0a-954b-f63e6228194d service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:36.027184 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1209/2425] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:36.188786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa070b4-4bb4-4dbf-9707-a26949e21304 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:36.218911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567509d-6b39-480c-a581-4ce297761beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:36.219866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567509d-6b39-480c-a581-4ce297761beb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:36.220283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567509d-6b39-480c-a581-4ce297761beb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:36.220626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567509d-6b39-480c-a581-4ce297761beb admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:36.221310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567509d-6b39-480c-a581-4ce297761beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:36.224725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567509d-6b39-480c-a581-4ce297761beb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:36.324447 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1217/2426] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:35 2022] POST /identity/v3/users => generated 302 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:36.329228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85b131-6090-4e0a-954b-f63e6228194d service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:36.347779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85b131-6090-4e0a-954b-f63e6228194d service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:36.372476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cccae-ed94-4d66-818a-16095967d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:36.373449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cccae-ed94-4d66-818a-16095967d8dc admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:36.375290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cccae-ed94-4d66-818a-16095967d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:36.375803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cccae-ed94-4d66-818a-16095967d8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:36.376658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cccae-ed94-4d66-818a-16095967d8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:36.381435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cccae-ed94-4d66-818a-16095967d8dc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:36.413100 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1210/2427] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:36.418243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567509d-6b39-480c-a581-4ce297761beb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:36.443751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567509d-6b39-480c-a581-4ce297761beb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:36.462667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65580b5f-eb8f-4f8c-96c7-f70e4a89a1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:36.464830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580b5f-eb8f-4f8c-96c7-f70e4a89a1aa admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:36.465162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580b5f-eb8f-4f8c-96c7-f70e4a89a1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:36.473480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65580b5f-eb8f-4f8c-96c7-f70e4a89a1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:36.474448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65580b5f-eb8f-4f8c-96c7-f70e4a89a1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:36.476096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65580b5f-eb8f-4f8c-96c7-f70e4a89a1aa admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:36.505887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cccae-ed94-4d66-818a-16095967d8dc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:36.506332 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1218/2428] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:36.525682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cccae-ed94-4d66-818a-16095967d8dc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:36.541310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ce212-01cb-4f75-a2f5-078aaa7cda6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:36.542008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ce212-01cb-4f75-a2f5-078aaa7cda6b admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:36.542291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ce212-01cb-4f75-a2f5-078aaa7cda6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:36.542569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ce212-01cb-4f75-a2f5-078aaa7cda6b admin admin] PATH_INFO: `/v3/projects/39d738552b6f41ee8af212d1faa11859/users/d83bf202401b4532b8c0b8167d3060b5/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:36.569000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ce212-01cb-4f75-a2f5-078aaa7cda6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d738552b6f41ee8af212d1faa11859, user_id=d83bf202401b4532b8c0b8167d3060b5, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:36.572528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ce212-01cb-4f75-a2f5-078aaa7cda6b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:36.604076 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1211/2429] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:36 2022] PUT /identity/v3/projects/39d738552b6f41ee8af212d1faa11859/users/d83bf202401b4532b8c0b8167d3060b5/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:36.616365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5f11c-751e-4a3d-b62d-0f8e78779b27 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:36.616652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5f11c-751e-4a3d-b62d-0f8e78779b27 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:36.616940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5f11c-751e-4a3d-b62d-0f8e78779b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:36.630238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:36.692418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-61b5f11c-751e-4a3d-b62d-0f8e78779b27 None None] MFA Rules not processed for user `d83bf202401b4532b8c0b8167d3060b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:36.693808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-61b5f11c-751e-4a3d-b62d-0f8e78779b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:36.866145 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1219/2430] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:36 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:36.866459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ce212-01cb-4f75-a2f5-078aaa7cda6b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:36.948713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:36.970376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ce212-01cb-4f75-a2f5-078aaa7cda6b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:36.975641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b73c41-226e-408a-84e5-62a5f64286ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:36.976275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b73c41-226e-408a-84e5-62a5f64286ef admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:36.976566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b73c41-226e-408a-84e5-62a5f64286ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:36.976846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b73c41-226e-408a-84e5-62a5f64286ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:36.977563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b73c41-226e-408a-84e5-62a5f64286ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:36.979951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b73c41-226e-408a-84e5-62a5f64286ef admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:37.031128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5f11c-751e-4a3d-b62d-0f8e78779b27 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:37.037724 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1212/2431] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:36 2022] POST /identity/v3/projects => generated 403 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:37.047995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5f11c-751e-4a3d-b62d-0f8e78779b27 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:37.150417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d90b3-a27a-4ca4-8c85-b974373b12a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:37.151301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d90b3-a27a-4ca4-8c85-b974373b12a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:37.151634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d90b3-a27a-4ca4-8c85-b974373b12a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:37.151910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d90b3-a27a-4ca4-8c85-b974373b12a2 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:37.152833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d90b3-a27a-4ca4-8c85-b974373b12a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:37.157441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d90b3-a27a-4ca4-8c85-b974373b12a2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:37.216089 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1220/2432] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:37 2022] POST /identity/v3/users => generated 308 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:37.220794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b73c41-226e-408a-84e5-62a5f64286ef admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:37.247591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b73c41-226e-408a-84e5-62a5f64286ef admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:37.253883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15d9bd-83c0-48dd-b748-749741bd7528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:37.255187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15d9bd-83c0-48dd-b748-749741bd7528 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:37.255697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15d9bd-83c0-48dd-b748-749741bd7528 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:37.256173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15d9bd-83c0-48dd-b748-749741bd7528 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:37.257044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15d9bd-83c0-48dd-b748-749741bd7528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:37.259008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15d9bd-83c0-48dd-b748-749741bd7528 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:37.281969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d90b3-a27a-4ca4-8c85-b974373b12a2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:37.296807 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1213/2433] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:37.298402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d90b3-a27a-4ca4-8c85-b974373b12a2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:37.307254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb89e62-c9a5-48bb-8c42-140ec033365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:37.308564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89e62-c9a5-48bb-8c42-140ec033365d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:37.308564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89e62-c9a5-48bb-8c42-140ec033365d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:37.310029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb89e62-c9a5-48bb-8c42-140ec033365d admin admin] PATH_INFO: `/v3/projects/fe40a7ae2fa444cb85594bf281bb37de/users/1410409090334200913fb4406dc46f0a/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:37.344602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb89e62-c9a5-48bb-8c42-140ec033365d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe40a7ae2fa444cb85594bf281bb37de, user_id=1410409090334200913fb4406dc46f0a, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:37.347441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb89e62-c9a5-48bb-8c42-140ec033365d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:37.370448 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1221/2434] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:37 2022] PUT /identity/v3/projects/fe40a7ae2fa444cb85594bf281bb37de/users/1410409090334200913fb4406dc46f0a/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:37.372156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15d9bd-83c0-48dd-b748-749741bd7528 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:37.395873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15d9bd-83c0-48dd-b748-749741bd7528 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:37.539681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0af740-a73e-4e07-b3fb-b7e4e97f82c2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:37.541053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0af740-a73e-4e07-b3fb-b7e4e97f82c2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:37.541053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0af740-a73e-4e07-b3fb-b7e4e97f82c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:37.603922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-db0af740-a73e-4e07-b3fb-b7e4e97f82c2 None None] MFA Rules not processed for user `b05e0387a6b84cdb9b1b59dae6281802`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:37.605204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-db0af740-a73e-4e07-b3fb-b7e4e97f82c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:37.618011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dec623-c47a-48f8-aa12-ddbf79a619d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:37.618728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dec623-c47a-48f8-aa12-ddbf79a619d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:37.619138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dec623-c47a-48f8-aa12-ddbf79a619d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:37.619419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dec623-c47a-48f8-aa12-ddbf79a619d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:37.620132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dec623-c47a-48f8-aa12-ddbf79a619d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:37.623232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dec623-c47a-48f8-aa12-ddbf79a619d9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:37.637959 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1214/2435] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:37.642169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dec623-c47a-48f8-aa12-ddbf79a619d9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:37.666291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dec623-c47a-48f8-aa12-ddbf79a619d9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:37.694898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5964f04-ee9d-465a-aac1-bee36bc21d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:37.701737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5964f04-ee9d-465a-aac1-bee36bc21d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:37.702343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5964f04-ee9d-465a-aac1-bee36bc21d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:37.702726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5964f04-ee9d-465a-aac1-bee36bc21d5e admin admin] PATH_INFO: `/v3/projects/fe40a7ae2fa444cb85594bf281bb37de/users/1410409090334200913fb4406dc46f0a/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:37.706295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5964f04-ee9d-465a-aac1-bee36bc21d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe40a7ae2fa444cb85594bf281bb37de, user_id=1410409090334200913fb4406dc46f0a, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:37.712628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5964f04-ee9d-465a-aac1-bee36bc21d5e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:37.767755 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1215/2436] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:37 2022] PUT /identity/v3/projects/fe40a7ae2fa444cb85594bf281bb37de/users/1410409090334200913fb4406dc46f0a/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:37.785025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037432e7-4662-4a86-aaca-0b14a19cbda0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:37.785454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037432e7-4662-4a86-aaca-0b14a19cbda0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:37.785846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037432e7-4662-4a86-aaca-0b14a19cbda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:37.789286 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1222/2437] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:37.851351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-037432e7-4662-4a86-aaca-0b14a19cbda0 None None] MFA Rules not processed for user `1410409090334200913fb4406dc46f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:37.852784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-037432e7-4662-4a86-aaca-0b14a19cbda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:38.009567 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1216/2438] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:37 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:38.941905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0af740-a73e-4e07-b3fb-b7e4e97f82c2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:38.943678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-db0af740-a73e-4e07-b3fb-b7e4e97f82c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:38.958656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:39.127501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0af740-a73e-4e07-b3fb-b7e4e97f82c2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:39.236410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2954427-cf94-417c-9845-7da0f58b088a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:39.237132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2954427-cf94-417c-9845-7da0f58b088a service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:39.237477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2954427-cf94-417c-9845-7da0f58b088a service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:39.238152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2954427-cf94-417c-9845-7da0f58b088a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:39.249405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2954427-cf94-417c-9845-7da0f58b088a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:39.252433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2954427-cf94-417c-9845-7da0f58b088a service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:39.265697 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1223/2439] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:38 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:40.695271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037432e7-4662-4a86-aaca-0b14a19cbda0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:40.697072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-037432e7-4662-4a86-aaca-0b14a19cbda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:40.787240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:40.870464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037432e7-4662-4a86-aaca-0b14a19cbda0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:40.893349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:40.894553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:40.895090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:40.895573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] PATH_INFO: `/v3/users/0b1f017f7d3443048f9ca52a69557e70` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:40.898190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1f017f7d3443048f9ca52a69557e70)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:40.908286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:41.025508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1f017f7d3443048f9ca52a69557e70'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:41.041143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1f017f7d3443048f9ca52a69557e70'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:41.052708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1f017f7d3443048f9ca52a69557e70'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:41.080960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1f017f7d3443048f9ca52a69557e70'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:41.082241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1f017f7d3443048f9ca52a69557e70'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:41.102654 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1217/2440] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:40 2022] DELETE /identity/v3/users/0b1f017f7d3443048f9ca52a69557e70 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:41.104738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957baf3-6fbc-4794-bad0-c6a7d3efcc50 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:41.105614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957baf3-6fbc-4794-bad0-c6a7d3efcc50 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:41.106896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957baf3-6fbc-4794-bad0-c6a7d3efcc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:41.132050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3957baf3-6fbc-4794-bad0-c6a7d3efcc50 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:41.133620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3957baf3-6fbc-4794-bad0-c6a7d3efcc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:41.244459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:41.247928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:41.284183 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1224/2441] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:41.297668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957baf3-6fbc-4794-bad0-c6a7d3efcc50 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:41.299735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3957baf3-6fbc-4794-bad0-c6a7d3efcc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:41.400455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:41.410453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c2c37-94a3-4ca7-beff-2de633f87e0a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:41.425783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a6d6-c4b1-4cb0-9a30-4a2a8f944cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:41.427118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a6d6-c4b1-4cb0-9a30-4a2a8f944cf9 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:41.427690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a6d6-c4b1-4cb0-9a30-4a2a8f944cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:41.428233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a6d6-c4b1-4cb0-9a30-4a2a8f944cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:41.431782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-85b2a6d6-c4b1-4cb0-9a30-4a2a8f944cf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:41.465858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957baf3-6fbc-4794-bad0-c6a7d3efcc50 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:41.479363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7789de8-6ec3-476e-bb8c-4f02760619bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:41.480530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7789de8-6ec3-476e-bb8c-4f02760619bb service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:41.486562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7789de8-6ec3-476e-bb8c-4f02760619bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:41.487234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7789de8-6ec3-476e-bb8c-4f02760619bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:41.523760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7789de8-6ec3-476e-bb8c-4f02760619bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:41.525557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7789de8-6ec3-476e-bb8c-4f02760619bb service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:41.555788 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1225/2442] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:41.641233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:41.660334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a6d6-c4b1-4cb0-9a30-4a2a8f944cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:41.662916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a6d6-c4b1-4cb0-9a30-4a2a8f944cf9 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:41.676459 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1218/2443] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:41 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:53:41.705625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7789de8-6ec3-476e-bb8c-4f02760619bb service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:41.707402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b7789de8-6ec3-476e-bb8c-4f02760619bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:41.728885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7789de8-6ec3-476e-bb8c-4f02760619bb service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:41.742405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:41.743267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:41.743794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:41.744285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] PATH_INFO: `/v3/users/d83bf202401b4532b8c0b8167d3060b5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:41.751406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83bf202401b4532b8c0b8167d3060b5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:41.753818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:41.869539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83bf202401b4532b8c0b8167d3060b5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:41.889988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83bf202401b4532b8c0b8167d3060b5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:41.891848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83bf202401b4532b8c0b8167d3060b5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:41.906530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83bf202401b4532b8c0b8167d3060b5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:41.907375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83bf202401b4532b8c0b8167d3060b5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:41.957754 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1226/2444] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:41 2022] DELETE /identity/v3/users/d83bf202401b4532b8c0b8167d3060b5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:41.959745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58c722-c014-448e-80f2-0ade236241f7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:41.960277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58c722-c014-448e-80f2-0ade236241f7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:41.960436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58c722-c014-448e-80f2-0ade236241f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:42.003331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0d58c722-c014-448e-80f2-0ade236241f7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:42.006400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0d58c722-c014-448e-80f2-0ade236241f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:42.139837 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1219/2445] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:42.151477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:42.157023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:42.241044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b516d03-3f93-4906-a35e-3418879574a1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:42.247526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49910e-4016-4546-8e23-7d5c81953561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:42.248902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49910e-4016-4546-8e23-7d5c81953561 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:42.249483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49910e-4016-4546-8e23-7d5c81953561 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:42.250236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49910e-4016-4546-8e23-7d5c81953561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:42.267672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49910e-4016-4546-8e23-7d5c81953561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:42.269892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49910e-4016-4546-8e23-7d5c81953561 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:42.302932 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1227/2446] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:42.320416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58c722-c014-448e-80f2-0ade236241f7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:42.322855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0d58c722-c014-448e-80f2-0ade236241f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:42.357728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58c722-c014-448e-80f2-0ade236241f7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:42.368460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:42.369822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:42.369822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:42.370049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] PATH_INFO: `/v3/projects/9c20fc4649384146aab671486a0ec75a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:42.372422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c20fc4649384146aab671486a0ec75a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:42.376721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:42.461602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c20fc4649384146aab671486a0ec75a', 'request_id': 'req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:42.479349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c20fc4649384146aab671486a0ec75a', 'request_id': 'req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:42.493944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c20fc4649384146aab671486a0ec75a', 'request_id': 'req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:42.518129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] The token cache is being invalidate because project 9c20fc4649384146aab671486a0ec75a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:42.518702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:42.527325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:42.532456 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1220/2447] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:42 2022] DELETE /identity/v3/projects/9c20fc4649384146aab671486a0ec75a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:42.537035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49910e-4016-4546-8e23-7d5c81953561 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:42.556800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49910e-4016-4546-8e23-7d5c81953561 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:42.664279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:42.691324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10150800-bc89-4a71-bf45-f38f0d6dcd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:42.694006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10150800-bc89-4a71-bf45-f38f0d6dcd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:42.694434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10150800-bc89-4a71-bf45-f38f0d6dcd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:42.695213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10150800-bc89-4a71-bf45-f38f0d6dcd52 admin admin] PATH_INFO: `/v3/users/b9cccefafaa847888a01a79b2502aee4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:42.697576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10150800-bc89-4a71-bf45-f38f0d6dcd52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9cccefafaa847888a01a79b2502aee4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:42.701695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10150800-bc89-4a71-bf45-f38f0d6dcd52 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:42.783378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10150800-bc89-4a71-bf45-f38f0d6dcd52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9cccefafaa847888a01a79b2502aee4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:42.798421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10150800-bc89-4a71-bf45-f38f0d6dcd52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9cccefafaa847888a01a79b2502aee4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:42.799835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10150800-bc89-4a71-bf45-f38f0d6dcd52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9cccefafaa847888a01a79b2502aee4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:42.812252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10150800-bc89-4a71-bf45-f38f0d6dcd52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9cccefafaa847888a01a79b2502aee4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:42.813128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10150800-bc89-4a71-bf45-f38f0d6dcd52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9cccefafaa847888a01a79b2502aee4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:42.850999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:42.852867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:42.859388 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1228/2448] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:42 2022] DELETE /identity/v3/users/b9cccefafaa847888a01a79b2502aee4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:42.882644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c47e0e-eaa9-420d-9ecb-fc6eb6cc7e36 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:42.913721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bcf84-9154-4296-bd6a-d9dcb870e3f1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:42.914039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bcf84-9154-4296-bd6a-d9dcb870e3f1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:42.914290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bcf84-9154-4296-bd6a-d9dcb870e3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:42.953843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a93bcf84-9154-4296-bd6a-d9dcb870e3f1 None None] MFA Rules not processed for user `7386b4ccca7f47a2b4a021a5d14836c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:42.957661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a93bcf84-9154-4296-bd6a-d9dcb870e3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:43.060671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:43.061490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:43.061620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:43.061870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] PATH_INFO: `/v3/projects/39d738552b6f41ee8af212d1faa11859` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:43.067666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d738552b6f41ee8af212d1faa11859)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:43.070649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:43.103098 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1229/2449] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:43.122110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:43.200253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d738552b6f41ee8af212d1faa11859', 'request_id': 'req-cb769d1c-b252-4c1d-92c5-662770294bb8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.219081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d738552b6f41ee8af212d1faa11859', 'request_id': 'req-cb769d1c-b252-4c1d-92c5-662770294bb8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.235834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d738552b6f41ee8af212d1faa11859', 'request_id': 'req-cb769d1c-b252-4c1d-92c5-662770294bb8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.261948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] The token cache is being invalidate because project 39d738552b6f41ee8af212d1faa11859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:43.263233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.264270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.267053 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1221/2450] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:42 2022] DELETE /identity/v3/projects/39d738552b6f41ee8af212d1faa11859 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:43.271072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bcf84-9154-4296-bd6a-d9dcb870e3f1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:43.272567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a93bcf84-9154-4296-bd6a-d9dcb870e3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:43.295482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bcf84-9154-4296-bd6a-d9dcb870e3f1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:43.403249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ce90b-edb9-4468-8e47-814573c12926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:43.404364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ce90b-edb9-4468-8e47-814573c12926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:43.404836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ce90b-edb9-4468-8e47-814573c12926 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:43.405373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ce90b-edb9-4468-8e47-814573c12926 admin admin] PATH_INFO: `/v3/users/1410409090334200913fb4406dc46f0a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:43.408069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ce90b-edb9-4468-8e47-814573c12926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1410409090334200913fb4406dc46f0a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:43.413036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ce90b-edb9-4468-8e47-814573c12926 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:43.437356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:43.536163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f07ce90b-edb9-4468-8e47-814573c12926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1410409090334200913fb4406dc46f0a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.552401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f07ce90b-edb9-4468-8e47-814573c12926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1410409090334200913fb4406dc46f0a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.553220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f07ce90b-edb9-4468-8e47-814573c12926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1410409090334200913fb4406dc46f0a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.570211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f07ce90b-edb9-4468-8e47-814573c12926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1410409090334200913fb4406dc46f0a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.571063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f07ce90b-edb9-4468-8e47-814573c12926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1410409090334200913fb4406dc46f0a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.582484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:43.584445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:43.608809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb769d1c-b252-4c1d-92c5-662770294bb8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:43.616147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c06d87-ba4c-4695-b004-6aad8750c635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:43.616798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c06d87-ba4c-4695-b004-6aad8750c635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:43.617082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c06d87-ba4c-4695-b004-6aad8750c635 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:43.617357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c06d87-ba4c-4695-b004-6aad8750c635 admin admin] PATH_INFO: `/v3/projects/87225230c37846e6af39897eeb7d063e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:43.618542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c06d87-ba4c-4695-b004-6aad8750c635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87225230c37846e6af39897eeb7d063e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:43.620910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c06d87-ba4c-4695-b004-6aad8750c635 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:43.622596 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1230/2451] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:43 2022] DELETE /identity/v3/users/1410409090334200913fb4406dc46f0a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:43.741559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d1c06d87-ba4c-4695-b004-6aad8750c635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87225230c37846e6af39897eeb7d063e', 'request_id': 'req-d1c06d87-ba4c-4695-b004-6aad8750c635'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.764881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d1c06d87-ba4c-4695-b004-6aad8750c635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87225230c37846e6af39897eeb7d063e', 'request_id': 'req-d1c06d87-ba4c-4695-b004-6aad8750c635'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.781899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d1c06d87-ba4c-4695-b004-6aad8750c635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87225230c37846e6af39897eeb7d063e', 'request_id': 'req-d1c06d87-ba4c-4695-b004-6aad8750c635'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.804783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d1c06d87-ba4c-4695-b004-6aad8750c635 admin admin] The token cache is being invalidate because project 87225230c37846e6af39897eeb7d063e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:43.805089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d1c06d87-ba4c-4695-b004-6aad8750c635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.805879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d1c06d87-ba4c-4695-b004-6aad8750c635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:43.808862 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1222/2452] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:43 2022] DELETE /identity/v3/projects/87225230c37846e6af39897eeb7d063e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:43.815464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536228b5-8e4d-4511-a342-047aa9804324 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:43.816019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536228b5-8e4d-4511-a342-047aa9804324 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:43.816378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536228b5-8e4d-4511-a342-047aa9804324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:43.894895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-536228b5-8e4d-4511-a342-047aa9804324 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:43.896157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-536228b5-8e4d-4511-a342-047aa9804324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:44.143768 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1231/2453] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:44.148119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363d0ad-e464-4bfb-99a0-06f48a2888a1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.148628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363d0ad-e464-4bfb-99a0-06f48a2888a1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.148923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363d0ad-e464-4bfb-99a0-06f48a2888a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.194965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0363d0ad-e464-4bfb-99a0-06f48a2888a1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:44.200533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0363d0ad-e464-4bfb-99a0-06f48a2888a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:44.204371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536228b5-8e4d-4511-a342-047aa9804324 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:44.205807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-536228b5-8e4d-4511-a342-047aa9804324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:44.227521 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1223/2454] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:44.231516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363d0ad-e464-4bfb-99a0-06f48a2888a1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:44.231736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536228b5-8e4d-4511-a342-047aa9804324 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:44.252757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921711b-10a7-4ba4-bb1d-952b0ffbf964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:44.253439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921711b-10a7-4ba4-bb1d-952b0ffbf964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.253706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921711b-10a7-4ba4-bb1d-952b0ffbf964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.253984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921711b-10a7-4ba4-bb1d-952b0ffbf964 admin admin] PATH_INFO: `/v3/projects/fe40a7ae2fa444cb85594bf281bb37de` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.255568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363d0ad-e464-4bfb-99a0-06f48a2888a1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:44.257402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921711b-10a7-4ba4-bb1d-952b0ffbf964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe40a7ae2fa444cb85594bf281bb37de)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:44.259393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921711b-10a7-4ba4-bb1d-952b0ffbf964 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:44.263345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad42e2-7b86-4220-bbfc-9a4b6e780b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:44.264527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad42e2-7b86-4220-bbfc-9a4b6e780b3d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.264824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad42e2-7b86-4220-bbfc-9a4b6e780b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.265157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad42e2-7b86-4220-bbfc-9a4b6e780b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.267105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad42e2-7b86-4220-bbfc-9a4b6e780b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:44.267415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad42e2-7b86-4220-bbfc-9a4b6e780b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:44.271124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad42e2-7b86-4220-bbfc-9a4b6e780b3d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:44.299213 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1224/2455] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:53:44.303635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad42e2-7b86-4220-bbfc-9a4b6e780b3d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:44.344107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad42e2-7b86-4220-bbfc-9a4b6e780b3d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:44.352070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1921711b-10a7-4ba4-bb1d-952b0ffbf964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe40a7ae2fa444cb85594bf281bb37de', 'request_id': 'req-1921711b-10a7-4ba4-bb1d-952b0ffbf964'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:44.358927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1921711b-10a7-4ba4-bb1d-952b0ffbf964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe40a7ae2fa444cb85594bf281bb37de', 'request_id': 'req-1921711b-10a7-4ba4-bb1d-952b0ffbf964'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:44.366537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1921711b-10a7-4ba4-bb1d-952b0ffbf964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe40a7ae2fa444cb85594bf281bb37de', 'request_id': 'req-1921711b-10a7-4ba4-bb1d-952b0ffbf964'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:44.385304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1921711b-10a7-4ba4-bb1d-952b0ffbf964 admin admin] The token cache is being invalidate because project fe40a7ae2fa444cb85594bf281bb37de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:44.385598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1921711b-10a7-4ba4-bb1d-952b0ffbf964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:44.386367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1921711b-10a7-4ba4-bb1d-952b0ffbf964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:44.396689 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1232/2456] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:44 2022] DELETE /identity/v3/projects/fe40a7ae2fa444cb85594bf281bb37de => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:44.398901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1073c-f5ac-45c9-991c-8e137d74f6ef None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.399127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1073c-f5ac-45c9-991c-8e137d74f6ef None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.399410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1073c-f5ac-45c9-991c-8e137d74f6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.462424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6df1073c-f5ac-45c9-991c-8e137d74f6ef None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:44.463685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6df1073c-f5ac-45c9-991c-8e137d74f6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:44.490911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:44.511918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20eb685-9455-4bb4-870a-d4b95edc8859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:44.513326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20eb685-9455-4bb4-870a-d4b95edc8859 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.513696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20eb685-9455-4bb4-870a-d4b95edc8859 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.514040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20eb685-9455-4bb4-870a-d4b95edc8859 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.515171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20eb685-9455-4bb4-870a-d4b95edc8859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:44.517508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20eb685-9455-4bb4-870a-d4b95edc8859 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:44.549188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:44.590604 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1225/2457] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:44 2022] POST /identity/v3/projects => generated 375 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:44.591767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20eb685-9455-4bb4-870a-d4b95edc8859 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:44.594369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f20eb685-9455-4bb4-870a-d4b95edc8859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:44.688319 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1233/2458] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:44.697298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa9110-156f-48bf-8b18-4ddc5d1fbd80 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.697814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa9110-156f-48bf-8b18-4ddc5d1fbd80 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.698222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa9110-156f-48bf-8b18-4ddc5d1fbd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.709194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20eb685-9455-4bb4-870a-d4b95edc8859 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:44.722032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216154f-f9b7-4b06-80b1-079e816a54bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:44.723211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216154f-f9b7-4b06-80b1-079e816a54bd admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.723211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216154f-f9b7-4b06-80b1-079e816a54bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.723514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216154f-f9b7-4b06-80b1-079e816a54bd admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.724092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216154f-f9b7-4b06-80b1-079e816a54bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:44.726609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216154f-f9b7-4b06-80b1-079e816a54bd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:44.763605 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1226/2459] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:44 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:44.765451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216154f-f9b7-4b06-80b1-079e816a54bd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:44.780240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216154f-f9b7-4b06-80b1-079e816a54bd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:44.788499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c5aa9110-156f-48bf-8b18-4ddc5d1fbd80 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:44.789874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c5aa9110-156f-48bf-8b18-4ddc5d1fbd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:44.790689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14949fa-9d1b-4cfd-8cb7-cad41f85c36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:44.791658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14949fa-9d1b-4cfd-8cb7-cad41f85c36a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.791947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14949fa-9d1b-4cfd-8cb7-cad41f85c36a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.792851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14949fa-9d1b-4cfd-8cb7-cad41f85c36a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.794331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14949fa-9d1b-4cfd-8cb7-cad41f85c36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:44.796600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14949fa-9d1b-4cfd-8cb7-cad41f85c36a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:44.817676 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1234/2460] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:44.818655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa9110-156f-48bf-8b18-4ddc5d1fbd80 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:44.819682 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1227/2461] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:44.820634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14949fa-9d1b-4cfd-8cb7-cad41f85c36a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:44.832554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14949fa-9d1b-4cfd-8cb7-cad41f85c36a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:44.839858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa9110-156f-48bf-8b18-4ddc5d1fbd80 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:44.840839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dc22c-340c-48a7-bfde-052de18a23e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:44.842051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc22c-340c-48a7-bfde-052de18a23e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.842544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc22c-340c-48a7-bfde-052de18a23e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.843098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dc22c-340c-48a7-bfde-052de18a23e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.844369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dc22c-340c-48a7-bfde-052de18a23e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:44.846875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dc22c-340c-48a7-bfde-052de18a23e9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:44.855573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dc5ef-7476-4b5b-aaf2-988b86f3444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:44.856774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc5ef-7476-4b5b-aaf2-988b86f3444b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.857285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc5ef-7476-4b5b-aaf2-988b86f3444b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.857546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc5ef-7476-4b5b-aaf2-988b86f3444b admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.862801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dc5ef-7476-4b5b-aaf2-988b86f3444b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:44.863151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dc5ef-7476-4b5b-aaf2-988b86f3444b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:44.865991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dc5ef-7476-4b5b-aaf2-988b86f3444b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:44.867650 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1228/2462] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:44.869258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dc22c-340c-48a7-bfde-052de18a23e9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:44.896187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dc22c-340c-48a7-bfde-052de18a23e9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:44.908530 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1235/2463] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:53:44.910367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55135c7-9f15-4317-aa31-784a993c78f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:44.911370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55135c7-9f15-4317-aa31-784a993c78f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.912916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dc5ef-7476-4b5b-aaf2-988b86f3444b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:44.914295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55135c7-9f15-4317-aa31-784a993c78f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.918949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55135c7-9f15-4317-aa31-784a993c78f1 admin admin] PATH_INFO: `/v3/projects/6fd866b4069e4bc7b6aae5b52a41b8fc/users/20d7f3a28ac042b0830aec3c51d64849/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.950891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dc5ef-7476-4b5b-aaf2-988b86f3444b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:44.964051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6f850-832a-4d71-b16d-2c242139b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:44.972035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55135c7-9f15-4317-aa31-784a993c78f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd866b4069e4bc7b6aae5b52a41b8fc, user_id=20d7f3a28ac042b0830aec3c51d64849, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:44.974857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6f850-832a-4d71-b16d-2c242139b682 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:44.975237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6f850-832a-4d71-b16d-2c242139b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:44.975646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6f850-832a-4d71-b16d-2c242139b682 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:44.976129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55135c7-9f15-4317-aa31-784a993c78f1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:44.976372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6f850-832a-4d71-b16d-2c242139b682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:44.986454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6f850-832a-4d71-b16d-2c242139b682 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:45.008258 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1229/2464] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:44 2022] PUT /identity/v3/projects/6fd866b4069e4bc7b6aae5b52a41b8fc/users/20d7f3a28ac042b0830aec3c51d64849/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:45.021438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d1cf0-11f7-4116-93e3-388f3e3076de None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.021438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d1cf0-11f7-4116-93e3-388f3e3076de None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.021438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d1cf0-11f7-4116-93e3-388f3e3076de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.059963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e15d1cf0-11f7-4116-93e3-388f3e3076de None None] MFA Rules not processed for user `20d7f3a28ac042b0830aec3c51d64849`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:45.061406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e15d1cf0-11f7-4116-93e3-388f3e3076de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:45.113642 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1236/2465] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:44 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:45.115076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6f850-832a-4d71-b16d-2c242139b682 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:45.201834 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1230/2466] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:45.206903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d1cf0-11f7-4116-93e3-388f3e3076de None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:45.293543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6f850-832a-4d71-b16d-2c242139b682 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:45.311922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:45.313833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c2ab9-77f2-49ab-aa83-b19e79b78b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:45.314655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c2ab9-77f2-49ab-aa83-b19e79b78b2f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.315370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c2ab9-77f2-49ab-aa83-b19e79b78b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.315825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c2ab9-77f2-49ab-aa83-b19e79b78b2f admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.316631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c2ab9-77f2-49ab-aa83-b19e79b78b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:45.318782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c2ab9-77f2-49ab-aa83-b19e79b78b2f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:45.382947 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1237/2467] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:45 2022] POST /identity/v3/users => generated 289 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:45.387381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c2ab9-77f2-49ab-aa83-b19e79b78b2f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:45.417399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c2ab9-77f2-49ab-aa83-b19e79b78b2f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:45.429191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d1cf0-11f7-4116-93e3-388f3e3076de None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:45.442219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bbdd8-7e82-4722-ada0-f941465e38c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:45.443314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bbdd8-7e82-4722-ada0-f941465e38c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.444232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bbdd8-7e82-4722-ada0-f941465e38c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.444544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b6216-409d-4f91-8b8b-ddd1684f9a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:45.445182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b6216-409d-4f91-8b8b-ddd1684f9a15 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.445464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b6216-409d-4f91-8b8b-ddd1684f9a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.445757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b6216-409d-4f91-8b8b-ddd1684f9a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.446387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b6216-409d-4f91-8b8b-ddd1684f9a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:45.446983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bbdd8-7e82-4722-ada0-f941465e38c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.447854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bbdd8-7e82-4722-ada0-f941465e38c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:45.452222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b6216-409d-4f91-8b8b-ddd1684f9a15 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:45.482891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bbdd8-7e82-4722-ada0-f941465e38c2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:45.527810 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1238/2468] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:45.531893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bbdd8-7e82-4722-ada0-f941465e38c2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:45.532822 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1231/2469] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:45 2022] POST /identity/v3/projects => generated 373 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:45.539051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b6216-409d-4f91-8b8b-ddd1684f9a15 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:45.563992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bbdd8-7e82-4722-ada0-f941465e38c2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:45.675823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b6216-409d-4f91-8b8b-ddd1684f9a15 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:45.692390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcb774-8dc1-4ccd-9fcc-8d5fab41fe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:45.693232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcb774-8dc1-4ccd-9fcc-8d5fab41fe92 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.693747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcb774-8dc1-4ccd-9fcc-8d5fab41fe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.694119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcb774-8dc1-4ccd-9fcc-8d5fab41fe92 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.694893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcb774-8dc1-4ccd-9fcc-8d5fab41fe92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:45.698801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcb774-8dc1-4ccd-9fcc-8d5fab41fe92 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:45.728284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:45.743515 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1232/2470] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:45 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:53:45.754618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686f8fb-3ed1-4941-a409-9b5998929d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:45.755279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcb774-8dc1-4ccd-9fcc-8d5fab41fe92 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:45.755968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686f8fb-3ed1-4941-a409-9b5998929d97 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.756421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686f8fb-3ed1-4941-a409-9b5998929d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.756855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686f8fb-3ed1-4941-a409-9b5998929d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.757956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686f8fb-3ed1-4941-a409-9b5998929d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:45.760413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686f8fb-3ed1-4941-a409-9b5998929d97 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:45.771956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcb774-8dc1-4ccd-9fcc-8d5fab41fe92 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:45.783846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40991fa8-7b4a-4701-9e76-02ca83b4c3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:45.785603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40991fa8-7b4a-4701-9e76-02ca83b4c3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.785603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40991fa8-7b4a-4701-9e76-02ca83b4c3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.785603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40991fa8-7b4a-4701-9e76-02ca83b4c3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.786452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40991fa8-7b4a-4701-9e76-02ca83b4c3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:45.788574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40991fa8-7b4a-4701-9e76-02ca83b4c3a6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:45.790109 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1239/2471] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:45.794870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686f8fb-3ed1-4941-a409-9b5998929d97 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:45.815254 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1233/2472] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:45.819810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40991fa8-7b4a-4701-9e76-02ca83b4c3a6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:45.821125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686f8fb-3ed1-4941-a409-9b5998929d97 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:45.835434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40991fa8-7b4a-4701-9e76-02ca83b4c3a6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:45.836710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aeda16-1364-4c33-a357-4b6ff4824e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:45.837486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aeda16-1364-4c33-a357-4b6ff4824e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.838221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aeda16-1364-4c33-a357-4b6ff4824e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.838503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aeda16-1364-4c33-a357-4b6ff4824e07 admin admin] PATH_INFO: `/v3/projects/4793cf96c17f464fa00d0e9bc10a1d54/users/4804652ca68040dfbeb96e6770cd24b8/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.842869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2aa50-ac2e-4bde-b408-5b3ace948a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:45.843967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2aa50-ac2e-4bde-b408-5b3ace948a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.844393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2aa50-ac2e-4bde-b408-5b3ace948a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.844966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2aa50-ac2e-4bde-b408-5b3ace948a30 admin admin] PATH_INFO: `/v3/projects/e80e9d576d744773b91bb5d30f69b8d9/users/33d56d8d987b438fb2bfaf9a7a93a378/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:45.877423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2aa50-ac2e-4bde-b408-5b3ace948a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80e9d576d744773b91bb5d30f69b8d9, user_id=33d56d8d987b438fb2bfaf9a7a93a378, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:45.881560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2aa50-ac2e-4bde-b408-5b3ace948a30 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:45.906794 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1234/2473] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:45 2022] PUT /identity/v3/projects/e80e9d576d744773b91bb5d30f69b8d9/users/33d56d8d987b438fb2bfaf9a7a93a378/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:45.908132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aeda16-1364-4c33-a357-4b6ff4824e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4793cf96c17f464fa00d0e9bc10a1d54, user_id=4804652ca68040dfbeb96e6770cd24b8, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:45.909303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2aa50-ac2e-4bde-b408-5b3ace948a30 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:45.913417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aeda16-1364-4c33-a357-4b6ff4824e07 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:45.961921 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1240/2474] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:45 2022] PUT /identity/v3/projects/4793cf96c17f464fa00d0e9bc10a1d54/users/4804652ca68040dfbeb96e6770cd24b8/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:45.969695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b6e47-01e3-4f6d-a50d-a598de7b1543 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:45.970192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b6e47-01e3-4f6d-a50d-a598de7b1543 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:45.970649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b6e47-01e3-4f6d-a50d-a598de7b1543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.033513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2aa50-ac2e-4bde-b408-5b3ace948a30 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:46.036928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cc4b6e47-01e3-4f6d-a50d-a598de7b1543 None None] MFA Rules not processed for user `4804652ca68040dfbeb96e6770cd24b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:46.038215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cc4b6e47-01e3-4f6d-a50d-a598de7b1543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:46.048202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:46.126901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6816b4-0159-4391-abe2-5b8b5280bcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:46.127952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6816b4-0159-4391-abe2-5b8b5280bcbd admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.128349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6816b4-0159-4391-abe2-5b8b5280bcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.128868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6816b4-0159-4391-abe2-5b8b5280bcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.129662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6816b4-0159-4391-abe2-5b8b5280bcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:46.131776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6816b4-0159-4391-abe2-5b8b5280bcbd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:46.150800 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1235/2475] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:46.163836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6816b4-0159-4391-abe2-5b8b5280bcbd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:46.198292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6816b4-0159-4391-abe2-5b8b5280bcbd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:46.205175 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1241/2476] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:46.208587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b6e47-01e3-4f6d-a50d-a598de7b1543 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:46.216770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cad38-4e3d-4eea-9cc2-9c553c9c336d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:46.219554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cad38-4e3d-4eea-9cc2-9c553c9c336d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.222784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cad38-4e3d-4eea-9cc2-9c553c9c336d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.223313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cad38-4e3d-4eea-9cc2-9c553c9c336d admin admin] PATH_INFO: `/v3/projects/e80e9d576d744773b91bb5d30f69b8d9/users/33d56d8d987b438fb2bfaf9a7a93a378/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.228918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cad38-4e3d-4eea-9cc2-9c553c9c336d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80e9d576d744773b91bb5d30f69b8d9, user_id=33d56d8d987b438fb2bfaf9a7a93a378, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:46.239196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cad38-4e3d-4eea-9cc2-9c553c9c336d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:46.248774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b6e47-01e3-4f6d-a50d-a598de7b1543 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:46.264170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb52fb-834b-4d46-994f-942e4a4a7b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:46.265121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb52fb-834b-4d46-994f-942e4a4a7b71 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.265264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb52fb-834b-4d46-994f-942e4a4a7b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.265432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb52fb-834b-4d46-994f-942e4a4a7b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.266864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb52fb-834b-4d46-994f-942e4a4a7b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:46.269024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb52fb-834b-4d46-994f-942e4a4a7b71 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:46.298023 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1236/2477] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:46 2022] PUT /identity/v3/projects/e80e9d576d744773b91bb5d30f69b8d9/users/33d56d8d987b438fb2bfaf9a7a93a378/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:46.318718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fecf52-59fb-4533-a582-dd63fc071e35 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.323650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fecf52-59fb-4533-a582-dd63fc071e35 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.323955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fecf52-59fb-4533-a582-dd63fc071e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.337031 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1242/2478] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:46 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:46.337031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede06e1-9431-40de-824b-0fe584276a5e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.337031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede06e1-9431-40de-824b-0fe584276a5e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.337031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede06e1-9431-40de-824b-0fe584276a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.388802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fede06e1-9431-40de-824b-0fe584276a5e None None] MFA Rules not processed for user `181f661f98964045b1f474672ca42bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:46.391153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fede06e1-9431-40de-824b-0fe584276a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:46.449205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e5fecf52-59fb-4533-a582-dd63fc071e35 None None] MFA Rules not processed for user `33d56d8d987b438fb2bfaf9a7a93a378`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:46.454044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e5fecf52-59fb-4533-a582-dd63fc071e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:46.506957 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1243/2479] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:46 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:46.508141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede06e1-9431-40de-824b-0fe584276a5e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:46.566294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:46.595023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede06e1-9431-40de-824b-0fe584276a5e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:46.600355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75451b-e5e2-4ea3-a2f1-571c278097e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:46.601046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75451b-e5e2-4ea3-a2f1-571c278097e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.601331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75451b-e5e2-4ea3-a2f1-571c278097e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.601695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75451b-e5e2-4ea3-a2f1-571c278097e5 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.602394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75451b-e5e2-4ea3-a2f1-571c278097e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:46.604543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75451b-e5e2-4ea3-a2f1-571c278097e5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:46.631366 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1237/2480] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:46.632511 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1244/2481] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:46 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:46.636076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15d833-0c59-470f-b6bf-2f5c665f1257 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.636076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15d833-0c59-470f-b6bf-2f5c665f1257 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.636076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15d833-0c59-470f-b6bf-2f5c665f1257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.637993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75451b-e5e2-4ea3-a2f1-571c278097e5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:46.650188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75451b-e5e2-4ea3-a2f1-571c278097e5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:46.657264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a60ec5-159c-4023-ae6b-0a353e1f33d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:46.658253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60ec5-159c-4023-ae6b-0a353e1f33d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.658403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60ec5-159c-4023-ae6b-0a353e1f33d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.667943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a60ec5-159c-4023-ae6b-0a353e1f33d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.669149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a60ec5-159c-4023-ae6b-0a353e1f33d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:46.677321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a60ec5-159c-4023-ae6b-0a353e1f33d5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:46.679193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-be15d833-0c59-470f-b6bf-2f5c665f1257 None None] MFA Rules not processed for user `20d7f3a28ac042b0830aec3c51d64849`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:46.688164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-be15d833-0c59-470f-b6bf-2f5c665f1257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:46.694826 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1245/2482] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:46.697894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a60ec5-159c-4023-ae6b-0a353e1f33d5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:46.732317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a60ec5-159c-4023-ae6b-0a353e1f33d5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:46.747922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91341e69-5d71-4fb8-8e77-7bd5cdf51bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:46.748810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91341e69-5d71-4fb8-8e77-7bd5cdf51bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.749103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91341e69-5d71-4fb8-8e77-7bd5cdf51bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.749477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91341e69-5d71-4fb8-8e77-7bd5cdf51bdf admin admin] PATH_INFO: `/v3/projects/10e6bb01a0e249dfb19364407825d99b/users/cc6412cca70d49c38e7eab08a6f6cd15/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.787800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91341e69-5d71-4fb8-8e77-7bd5cdf51bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e6bb01a0e249dfb19364407825d99b, user_id=cc6412cca70d49c38e7eab08a6f6cd15, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:46.790694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91341e69-5d71-4fb8-8e77-7bd5cdf51bdf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:46.822099 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1246/2483] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:46 2022] PUT /identity/v3/projects/10e6bb01a0e249dfb19364407825d99b/users/cc6412cca70d49c38e7eab08a6f6cd15/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:46.824142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91341e69-5d71-4fb8-8e77-7bd5cdf51bdf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:46.868884 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1238/2484] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:46.936924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91341e69-5d71-4fb8-8e77-7bd5cdf51bdf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:46.943071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9841e0f-368f-4b63-841d-026836aff758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:46.944176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9841e0f-368f-4b63-841d-026836aff758 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.944446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9841e0f-368f-4b63-841d-026836aff758 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.944730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9841e0f-368f-4b63-841d-026836aff758 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.945388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9841e0f-368f-4b63-841d-026836aff758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:46.947632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9841e0f-368f-4b63-841d-026836aff758 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:46.969724 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1247/2485] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:46.970484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15d833-0c59-470f-b6bf-2f5c665f1257 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:46.987815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15d833-0c59-470f-b6bf-2f5c665f1257 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:46.993747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9e956-a1d6-41cb-9f8e-bf9ce7d8cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:46.994701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9e956-a1d6-41cb-9f8e-bf9ce7d8cab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:46.995198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9e956-a1d6-41cb-9f8e-bf9ce7d8cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:46.995772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9e956-a1d6-41cb-9f8e-bf9ce7d8cab6 admin admin] PATH_INFO: `/v3/projects/10e6bb01a0e249dfb19364407825d99b/users/cc6412cca70d49c38e7eab08a6f6cd15/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:46.999925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9e956-a1d6-41cb-9f8e-bf9ce7d8cab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e6bb01a0e249dfb19364407825d99b, user_id=cc6412cca70d49c38e7eab08a6f6cd15, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:47.004613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9e956-a1d6-41cb-9f8e-bf9ce7d8cab6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:47.020908 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1239/2486] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:46 2022] PUT /identity/v3/projects/10e6bb01a0e249dfb19364407825d99b/users/cc6412cca70d49c38e7eab08a6f6cd15/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:53:47.032617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e3b91-3534-4901-800f-8af23e56b735 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:47.032902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e3b91-3534-4901-800f-8af23e56b735 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:47.033093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e3b91-3534-4901-800f-8af23e56b735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:47.071167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ef8e3b91-3534-4901-800f-8af23e56b735 None None] MFA Rules not processed for user `cc6412cca70d49c38e7eab08a6f6cd15`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:47.074455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ef8e3b91-3534-4901-800f-8af23e56b735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:47.144879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9e956-a1d6-41cb-9f8e-bf9ce7d8cab6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:47.147139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bea9e956-a1d6-41cb-9f8e-bf9ce7d8cab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:47.165021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:47.172115 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1248/2487] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:47.176386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d1cb6-2228-4712-9653-f6f2ab8ad2bf None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:47.176676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d1cb6-2228-4712-9653-f6f2ab8ad2bf None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:47.177973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d1cb6-2228-4712-9653-f6f2ab8ad2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:47.202097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3c6d1cb6-2228-4712-9653-f6f2ab8ad2bf None None] MFA Rules not processed for user `4804652ca68040dfbeb96e6770cd24b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:47.203379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3c6d1cb6-2228-4712-9653-f6f2ab8ad2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:47.209798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:47.323032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9e956-a1d6-41cb-9f8e-bf9ce7d8cab6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:47.329652 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1249/2488] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:47.342695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7997669-37e2-426c-8a59-ab79cb7a3d9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:47.343406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7997669-37e2-426c-8a59-ab79cb7a3d9a service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:47.343684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7997669-37e2-426c-8a59-ab79cb7a3d9a service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:47.343958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7997669-37e2-426c-8a59-ab79cb7a3d9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:47.537682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7997669-37e2-426c-8a59-ab79cb7a3d9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:47.541304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7997669-37e2-426c-8a59-ab79cb7a3d9a service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:47.611104 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1240/2489] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:49.221026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d1cb6-2228-4712-9653-f6f2ab8ad2bf None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:49.260804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d1cb6-2228-4712-9653-f6f2ab8ad2bf None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:49.299754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bf52e-3140-4581-b1f5-fe39b64c35f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:49.300671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bf52e-3140-4581-b1f5-fe39b64c35f7 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:49.301098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bf52e-3140-4581-b1f5-fe39b64c35f7 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:49.301455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bf52e-3140-4581-b1f5-fe39b64c35f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:49.312895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bf52e-3140-4581-b1f5-fe39b64c35f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:49.315387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bf52e-3140-4581-b1f5-fe39b64c35f7 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:49.328525 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1250/2490] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:51.743780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7997669-37e2-426c-8a59-ab79cb7a3d9a service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:51.745214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a7997669-37e2-426c-8a59-ab79cb7a3d9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:51.932913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7997669-37e2-426c-8a59-ab79cb7a3d9a service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:51.965880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:51.966718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:51.967031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:51.967470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] PATH_INFO: `/v3/users/17f0024362414fb29af577c3d6019347` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:51.968890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f0024362414fb29af577c3d6019347)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:51.971048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:52.129345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f0024362414fb29af577c3d6019347'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:52.134766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:52.160755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f0024362414fb29af577c3d6019347'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:52.162155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f0024362414fb29af577c3d6019347'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:52.191294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f0024362414fb29af577c3d6019347'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:52.193739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f0024362414fb29af577c3d6019347'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:52.220063 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1241/2491] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:51 2022] DELETE /identity/v3/users/17f0024362414fb29af577c3d6019347 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:52.224222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02060846-efa6-4d2a-92e9-2f8f2f0902b6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:52.224666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02060846-efa6-4d2a-92e9-2f8f2f0902b6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:52.224890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02060846-efa6-4d2a-92e9-2f8f2f0902b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:52.334423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-02060846-efa6-4d2a-92e9-2f8f2f0902b6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:52.340964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-02060846-efa6-4d2a-92e9-2f8f2f0902b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:52.483777 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1251/2492] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:52.495510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:52.508573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:52.763156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac356c-cfba-4eaa-b492-521431aa0ac7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:52.785458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977500e-dd63-4d17-937f-d1e253cbff28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:52.786479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977500e-dd63-4d17-937f-d1e253cbff28 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:52.787229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977500e-dd63-4d17-937f-d1e253cbff28 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:52.787686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977500e-dd63-4d17-937f-d1e253cbff28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:52.829879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977500e-dd63-4d17-937f-d1e253cbff28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:52.833217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977500e-dd63-4d17-937f-d1e253cbff28 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:52.864305 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1242/2493] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:53.788878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02060846-efa6-4d2a-92e9-2f8f2f0902b6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:53.793472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-02060846-efa6-4d2a-92e9-2f8f2f0902b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:53.822530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02060846-efa6-4d2a-92e9-2f8f2f0902b6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:53.836385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:53.837143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:53.837435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:53.838817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] PATH_INFO: `/v3/projects/ee8d80d31e72456b9c75b93b14b69077` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:53.844961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8d80d31e72456b9c75b93b14b69077)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:53.850660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:53.924071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8d80d31e72456b9c75b93b14b69077', 'request_id': 'req-e92975ce-edcd-47e9-a341-93ccec2a4401'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:53.932337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8d80d31e72456b9c75b93b14b69077', 'request_id': 'req-e92975ce-edcd-47e9-a341-93ccec2a4401'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:53.944624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8d80d31e72456b9c75b93b14b69077', 'request_id': 'req-e92975ce-edcd-47e9-a341-93ccec2a4401'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:53.970239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] The token cache is being invalidate because project ee8d80d31e72456b9c75b93b14b69077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:53.970524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:53.992872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:54.005983 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1252/2494] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:53 2022] DELETE /identity/v3/projects/ee8d80d31e72456b9c75b93b14b69077 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:54.007532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977500e-dd63-4d17-937f-d1e253cbff28 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:54.025607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977500e-dd63-4d17-937f-d1e253cbff28 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:54.181261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c7110-8aff-428c-846a-fd298f0476fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:54.182371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c7110-8aff-428c-846a-fd298f0476fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:54.182371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c7110-8aff-428c-846a-fd298f0476fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:54.182648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c7110-8aff-428c-846a-fd298f0476fd admin admin] PATH_INFO: `/v3/users/4ee00ea8403c4894bbceb4fa7207a21f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:54.184696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c7110-8aff-428c-846a-fd298f0476fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee00ea8403c4894bbceb4fa7207a21f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:54.202134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c7110-8aff-428c-846a-fd298f0476fd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:54.374123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a16c7110-8aff-428c-846a-fd298f0476fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee00ea8403c4894bbceb4fa7207a21f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:54.394594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a16c7110-8aff-428c-846a-fd298f0476fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee00ea8403c4894bbceb4fa7207a21f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:54.395740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a16c7110-8aff-428c-846a-fd298f0476fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee00ea8403c4894bbceb4fa7207a21f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:54.422478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:54.424801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a16c7110-8aff-428c-846a-fd298f0476fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee00ea8403c4894bbceb4fa7207a21f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:54.426380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a16c7110-8aff-428c-846a-fd298f0476fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee00ea8403c4894bbceb4fa7207a21f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:54.461140 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1243/2495] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:54 2022] DELETE /identity/v3/users/4ee00ea8403c4894bbceb4fa7207a21f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:56.286028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:56.286028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:56.326621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92975ce-edcd-47e9-a341-93ccec2a4401 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:56.453016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:56.585392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be4112-62ec-4f5d-a517-817329c41f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:56.586061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be4112-62ec-4f5d-a517-817329c41f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:56.586502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be4112-62ec-4f5d-a517-817329c41f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:56.586824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be4112-62ec-4f5d-a517-817329c41f3a admin admin] PATH_INFO: `/v3/projects/cb42a98c296f463693359088bc0d5302` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:56.591519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be4112-62ec-4f5d-a517-817329c41f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb42a98c296f463693359088bc0d5302)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:56.605182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be4112-62ec-4f5d-a517-817329c41f3a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:56.802283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-41be4112-62ec-4f5d-a517-817329c41f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb42a98c296f463693359088bc0d5302', 'request_id': 'req-41be4112-62ec-4f5d-a517-817329c41f3a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:56.818650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-41be4112-62ec-4f5d-a517-817329c41f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb42a98c296f463693359088bc0d5302', 'request_id': 'req-41be4112-62ec-4f5d-a517-817329c41f3a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:56.832857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-41be4112-62ec-4f5d-a517-817329c41f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb42a98c296f463693359088bc0d5302', 'request_id': 'req-41be4112-62ec-4f5d-a517-817329c41f3a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:56.867370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-41be4112-62ec-4f5d-a517-817329c41f3a admin admin] The token cache is being invalidate because project cb42a98c296f463693359088bc0d5302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:53:56.867955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-41be4112-62ec-4f5d-a517-817329c41f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:56.868892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-41be4112-62ec-4f5d-a517-817329c41f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:53:56.876299 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1253/2496] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:53:56 2022] DELETE /identity/v3/projects/cb42a98c296f463693359088bc0d5302 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:56.877460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670818b9-5827-4f56-b172-3104e506649d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:56.877906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670818b9-5827-4f56-b172-3104e506649d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:56.878010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670818b9-5827-4f56-b172-3104e506649d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:56.934756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-670818b9-5827-4f56-b172-3104e506649d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:56.941347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-670818b9-5827-4f56-b172-3104e506649d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:57.126384 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1244/2497] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:53:57.130962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fce10-96f2-4185-8d3e-12955be1a506 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:57.132083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fce10-96f2-4185-8d3e-12955be1a506 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:57.135841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fce10-96f2-4185-8d3e-12955be1a506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:57.175777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-601fce10-96f2-4185-8d3e-12955be1a506 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:57.177287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-601fce10-96f2-4185-8d3e-12955be1a506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:57.192460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670818b9-5827-4f56-b172-3104e506649d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:57.193158 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1254/2498] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:57.209982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670818b9-5827-4f56-b172-3104e506649d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:57.221428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb412b-a992-4f5a-96f9-a9981348f3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:57.222313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb412b-a992-4f5a-96f9-a9981348f3ef admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:57.223676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb412b-a992-4f5a-96f9-a9981348f3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:57.224072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb412b-a992-4f5a-96f9-a9981348f3ef admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:57.224896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb412b-a992-4f5a-96f9-a9981348f3ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:53:57.225541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb412b-a992-4f5a-96f9-a9981348f3ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:57.228037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb412b-a992-4f5a-96f9-a9981348f3ef admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:57.251965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fce10-96f2-4185-8d3e-12955be1a506 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:57.297539 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1245/2499] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:53:57.311194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fce10-96f2-4185-8d3e-12955be1a506 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:57.332595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602038b4-f114-411a-93a9-2522b2fa4855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:57.333221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602038b4-f114-411a-93a9-2522b2fa4855 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:57.333502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602038b4-f114-411a-93a9-2522b2fa4855 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:57.333778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602038b4-f114-411a-93a9-2522b2fa4855 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:57.334417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602038b4-f114-411a-93a9-2522b2fa4855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:57.336413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602038b4-f114-411a-93a9-2522b2fa4855 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:57.385282 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1255/2500] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:53:57 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:53:57.389693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb412b-a992-4f5a-96f9-a9981348f3ef admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:57.403465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb412b-a992-4f5a-96f9-a9981348f3ef admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:57.528909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f56210-f25c-4d6c-bfc5-f2e5342f0845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:57.529727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f56210-f25c-4d6c-bfc5-f2e5342f0845 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:57.530033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f56210-f25c-4d6c-bfc5-f2e5342f0845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:57.531330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f56210-f25c-4d6c-bfc5-f2e5342f0845 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:57.532510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f56210-f25c-4d6c-bfc5-f2e5342f0845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:57.536952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f56210-f25c-4d6c-bfc5-f2e5342f0845 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:57.571147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602038b4-f114-411a-93a9-2522b2fa4855 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:57.573618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-602038b4-f114-411a-93a9-2522b2fa4855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:57.586707 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1246/2501] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:53:57 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:53:57.587913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f56210-f25c-4d6c-bfc5-f2e5342f0845 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:57.611806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f56210-f25c-4d6c-bfc5-f2e5342f0845 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:57.619576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12c53a-b358-4587-b49d-46d721acbea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:57.620214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12c53a-b358-4587-b49d-46d721acbea3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:57.620516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12c53a-b358-4587-b49d-46d721acbea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:57.620911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12c53a-b358-4587-b49d-46d721acbea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:57.622774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12c53a-b358-4587-b49d-46d721acbea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:57.625383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12c53a-b358-4587-b49d-46d721acbea3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:57.645736 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1247/2502] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:53:57.647259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12c53a-b358-4587-b49d-46d721acbea3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:57.666989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12c53a-b358-4587-b49d-46d721acbea3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:57.687380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5d9a7-1ee6-4446-a29e-2e19c12733d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:57.688330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d9a7-1ee6-4446-a29e-2e19c12733d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:57.688681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d9a7-1ee6-4446-a29e-2e19c12733d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:57.689032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d9a7-1ee6-4446-a29e-2e19c12733d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:57.690061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5d9a7-1ee6-4446-a29e-2e19c12733d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:57.692457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5d9a7-1ee6-4446-a29e-2e19c12733d2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:57.714130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602038b4-f114-411a-93a9-2522b2fa4855 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:57.725589 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1248/2503] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:53:57.726504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e59f5-32bf-4a3b-aad5-9063320f9a0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:57.727236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5d9a7-1ee6-4446-a29e-2e19c12733d2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:57.752348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e59f5-32bf-4a3b-aad5-9063320f9a0a service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:57.752916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e59f5-32bf-4a3b-aad5-9063320f9a0a service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:57.753892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5d9a7-1ee6-4446-a29e-2e19c12733d2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:57.757052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e59f5-32bf-4a3b-aad5-9063320f9a0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:57.762268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-544e59f5-32bf-4a3b-aad5-9063320f9a0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:57.768556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7623e-a7ad-491f-944a-fa3ae627bc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:57.769481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7623e-a7ad-491f-944a-fa3ae627bc6f admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:57.769964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7623e-a7ad-491f-944a-fa3ae627bc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:57.770444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7623e-a7ad-491f-944a-fa3ae627bc6f admin admin] PATH_INFO: `/v3/projects/637fd7c162b847ef9e5a85f0d53827c7/users/0ba60b8a9d5d4af994ce39927fee0425/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:57.819581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7623e-a7ad-491f-944a-fa3ae627bc6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=637fd7c162b847ef9e5a85f0d53827c7, user_id=0ba60b8a9d5d4af994ce39927fee0425, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:57.822487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7623e-a7ad-491f-944a-fa3ae627bc6f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:57.831295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:57.859560 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1249/2504] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:53:57 2022] PUT /identity/v3/projects/637fd7c162b847ef9e5a85f0d53827c7/users/0ba60b8a9d5d4af994ce39927fee0425/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:53:57.869683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cb5de-e861-4ddc-b3f1-7347ff3df310 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:57.870311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cb5de-e861-4ddc-b3f1-7347ff3df310 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:57.870538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cb5de-e861-4ddc-b3f1-7347ff3df310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:57.928814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e59f5-32bf-4a3b-aad5-9063320f9a0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:57.935546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e59f5-32bf-4a3b-aad5-9063320f9a0a service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:57.948257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-677cb5de-e861-4ddc-b3f1-7347ff3df310 None None] MFA Rules not processed for user `0ba60b8a9d5d4af994ce39927fee0425`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:53:57.952576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-677cb5de-e861-4ddc-b3f1-7347ff3df310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:57.974632 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1256/2505] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:57.994775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:53:58.007150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e59f5-32bf-4a3b-aad5-9063320f9a0a service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:58.008994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-544e59f5-32bf-4a3b-aad5-9063320f9a0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:58.038076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e59f5-32bf-4a3b-aad5-9063320f9a0a service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:58.086053 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1250/2506] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:53:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:53:58.267959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea79265-3e5d-4d56-ade7-3367448f347f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:58.269295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea79265-3e5d-4d56-ade7-3367448f347f service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:58.271342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea79265-3e5d-4d56-ade7-3367448f347f service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:58.271991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea79265-3e5d-4d56-ade7-3367448f347f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:58.275895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aea79265-3e5d-4d56-ade7-3367448f347f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:53:58.428329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea79265-3e5d-4d56-ade7-3367448f347f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:58.431453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea79265-3e5d-4d56-ade7-3367448f347f service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:58.451101 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1257/2507] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:58 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:53:58.954690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cb5de-e861-4ddc-b3f1-7347ff3df310 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:53:58.972681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cb5de-e861-4ddc-b3f1-7347ff3df310 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:53:58.979160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc3ee3-8d5a-4033-8b29-df5ffe9e550d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:53:58.979782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc3ee3-8d5a-4033-8b29-df5ffe9e550d service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:53:58.980419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc3ee3-8d5a-4033-8b29-df5ffe9e550d service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:53:58.980854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc3ee3-8d5a-4033-8b29-df5ffe9e550d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:53:58.990158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc3ee3-8d5a-4033-8b29-df5ffe9e550d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:53:58.991985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc3ee3-8d5a-4033-8b29-df5ffe9e550d service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:53:59.006714 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1251/2508] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:53:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:53:59.891898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea79265-3e5d-4d56-ade7-3367448f347f service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:00.001838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:00.010065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea79265-3e5d-4d56-ade7-3367448f347f service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:00.020916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581f093-bb3a-4df6-a87c-04874ca5c7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:00.021963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581f093-bb3a-4df6-a87c-04874ca5c7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:00.023178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581f093-bb3a-4df6-a87c-04874ca5c7df admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:00.023178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581f093-bb3a-4df6-a87c-04874ca5c7df admin admin] PATH_INFO: `/v3/users/0ba60b8a9d5d4af994ce39927fee0425` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:00.024367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581f093-bb3a-4df6-a87c-04874ca5c7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba60b8a9d5d4af994ce39927fee0425)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:00.026425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581f093-bb3a-4df6-a87c-04874ca5c7df admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:00.112477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4581f093-bb3a-4df6-a87c-04874ca5c7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba60b8a9d5d4af994ce39927fee0425'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:00.126955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4581f093-bb3a-4df6-a87c-04874ca5c7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba60b8a9d5d4af994ce39927fee0425'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:00.127964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4581f093-bb3a-4df6-a87c-04874ca5c7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba60b8a9d5d4af994ce39927fee0425'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:00.141138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4581f093-bb3a-4df6-a87c-04874ca5c7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba60b8a9d5d4af994ce39927fee0425'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:00.141950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4581f093-bb3a-4df6-a87c-04874ca5c7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba60b8a9d5d4af994ce39927fee0425'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:00.168970 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1258/2509] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:53:59 2022] DELETE /identity/v3/users/0ba60b8a9d5d4af994ce39927fee0425 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:00.170448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84beeac-b66e-459c-bd3e-d8aeea301983 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:00.171837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84beeac-b66e-459c-bd3e-d8aeea301983 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:00.172269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84beeac-b66e-459c-bd3e-d8aeea301983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:00.208361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f84beeac-b66e-459c-bd3e-d8aeea301983 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:00.211301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f84beeac-b66e-459c-bd3e-d8aeea301983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:00.265594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26b54-2c32-4a11-935c-e10673e1e789 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:00.266682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26b54-2c32-4a11-935c-e10673e1e789 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:00.266999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26b54-2c32-4a11-935c-e10673e1e789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:00.298039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-dfe26b54-2c32-4a11-935c-e10673e1e789 None None] MFA Rules not processed for user `96265ca648444ff8bf45a45c26b7679e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:00.299726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dfe26b54-2c32-4a11-935c-e10673e1e789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:00.303048 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1252/2510] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:00.314776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84beeac-b66e-459c-bd3e-d8aeea301983 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:00.317157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f84beeac-b66e-459c-bd3e-d8aeea301983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:00.394071 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1259/2511] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:00.404606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84beeac-b66e-459c-bd3e-d8aeea301983 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:00.410006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fce725-8b66-4395-919a-9280330ab173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:00.411082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fce725-8b66-4395-919a-9280330ab173 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:00.411694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fce725-8b66-4395-919a-9280330ab173 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:00.412042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fce725-8b66-4395-919a-9280330ab173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:00.424818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fce725-8b66-4395-919a-9280330ab173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:00.426875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fce725-8b66-4395-919a-9280330ab173 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:00.442035 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1253/2512] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:01.330178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe26b54-2c32-4a11-935c-e10673e1e789 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:01.331692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dfe26b54-2c32-4a11-935c-e10673e1e789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:01.356997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe26b54-2c32-4a11-935c-e10673e1e789 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:01.364231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00134f93-e545-4840-9557-eebcb95b9ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:01.365603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00134f93-e545-4840-9557-eebcb95b9ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:01.365898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00134f93-e545-4840-9557-eebcb95b9ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:01.366173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00134f93-e545-4840-9557-eebcb95b9ee5 admin admin] PATH_INFO: `/v3/projects/637fd7c162b847ef9e5a85f0d53827c7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:01.367941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00134f93-e545-4840-9557-eebcb95b9ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=637fd7c162b847ef9e5a85f0d53827c7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:01.370007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00134f93-e545-4840-9557-eebcb95b9ee5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:01.424060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-00134f93-e545-4840-9557-eebcb95b9ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637fd7c162b847ef9e5a85f0d53827c7', 'request_id': 'req-00134f93-e545-4840-9557-eebcb95b9ee5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:01.429875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-00134f93-e545-4840-9557-eebcb95b9ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637fd7c162b847ef9e5a85f0d53827c7', 'request_id': 'req-00134f93-e545-4840-9557-eebcb95b9ee5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:01.436934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-00134f93-e545-4840-9557-eebcb95b9ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637fd7c162b847ef9e5a85f0d53827c7', 'request_id': 'req-00134f93-e545-4840-9557-eebcb95b9ee5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:01.451305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-00134f93-e545-4840-9557-eebcb95b9ee5 admin admin] The token cache is being invalidate because project 637fd7c162b847ef9e5a85f0d53827c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:01.451606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-00134f93-e545-4840-9557-eebcb95b9ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:01.452482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-00134f93-e545-4840-9557-eebcb95b9ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:01.453998 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1260/2513] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:01 2022] DELETE /identity/v3/projects/637fd7c162b847ef9e5a85f0d53827c7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:01.459100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dab3a-3d16-4e3b-9a43-332256e09bd2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:01.459554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dab3a-3d16-4e3b-9a43-332256e09bd2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:01.459666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dab3a-3d16-4e3b-9a43-332256e09bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:01.481582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-468dab3a-3d16-4e3b-9a43-332256e09bd2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:01.482956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-468dab3a-3d16-4e3b-9a43-332256e09bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:01.531405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:01.566025 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1254/2514] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:01.576306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27d3a3-3581-4f62-98dc-81a4c25f604e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:01.576949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27d3a3-3581-4f62-98dc-81a4c25f604e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:01.577420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27d3a3-3581-4f62-98dc-81a4c25f604e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:01.591132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:01.604660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8a27d3a3-3581-4f62-98dc-81a4c25f604e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:01.607101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8a27d3a3-3581-4f62-98dc-81a4c25f604e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:01.616065 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1261/2515] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:01.620550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dab3a-3d16-4e3b-9a43-332256e09bd2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:01.637665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dab3a-3d16-4e3b-9a43-332256e09bd2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:01.643196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbeca0-5773-478c-8e6f-d458062a14f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:01.643826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbeca0-5773-478c-8e6f-d458062a14f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:01.644113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbeca0-5773-478c-8e6f-d458062a14f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:01.644491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbeca0-5773-478c-8e6f-d458062a14f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:01.645081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbeca0-5773-478c-8e6f-d458062a14f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:01.645438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbeca0-5773-478c-8e6f-d458062a14f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:01.647402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbeca0-5773-478c-8e6f-d458062a14f1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:01.666890 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1255/2516] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:01.668061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27d3a3-3581-4f62-98dc-81a4c25f604e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:01.682148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27d3a3-3581-4f62-98dc-81a4c25f604e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:01.692638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797790c1-46aa-4a95-ad05-ed74eb693776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:01.694107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797790c1-46aa-4a95-ad05-ed74eb693776 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:01.695003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797790c1-46aa-4a95-ad05-ed74eb693776 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:01.695479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797790c1-46aa-4a95-ad05-ed74eb693776 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:01.696307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797790c1-46aa-4a95-ad05-ed74eb693776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:01.700404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797790c1-46aa-4a95-ad05-ed74eb693776 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:01.757707 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1262/2517] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:01 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:54:01.763389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbeca0-5773-478c-8e6f-d458062a14f1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:01.776061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbeca0-5773-478c-8e6f-d458062a14f1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:01.818160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b984e-21c6-4b2c-8306-7fb83bf75cb9 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:01.818836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b984e-21c6-4b2c-8306-7fb83bf75cb9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:01.819157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b984e-21c6-4b2c-8306-7fb83bf75cb9 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:01.820799 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1263/2518] 10.222.0.70 () {54 vars in 921 bytes} [Sun Aug 28 18:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:54:01.836342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640836d2-73ba-45b0-81ae-439f921176d4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:01.836910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640836d2-73ba-45b0-81ae-439f921176d4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:01.837609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640836d2-73ba-45b0-81ae-439f921176d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:01.873942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-640836d2-73ba-45b0-81ae-439f921176d4 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:01.875849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-640836d2-73ba-45b0-81ae-439f921176d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:01.893865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa969e-51ed-4dbc-af54-d0b10d701fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:01.895594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa969e-51ed-4dbc-af54-d0b10d701fbb admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:01.896182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa969e-51ed-4dbc-af54-d0b10d701fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:01.898945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa969e-51ed-4dbc-af54-d0b10d701fbb admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:01.900466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa969e-51ed-4dbc-af54-d0b10d701fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:01.903295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa969e-51ed-4dbc-af54-d0b10d701fbb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:01.953782 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1256/2519] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:01 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:01.958584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa969e-51ed-4dbc-af54-d0b10d701fbb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:01.973798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa969e-51ed-4dbc-af54-d0b10d701fbb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:01.983240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283d146-b478-416d-beef-b5e6a2de3ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:01.984028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283d146-b478-416d-beef-b5e6a2de3ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:01.984415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283d146-b478-416d-beef-b5e6a2de3ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:01.984841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283d146-b478-416d-beef-b5e6a2de3ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:01.985738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283d146-b478-416d-beef-b5e6a2de3ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:01.987932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283d146-b478-416d-beef-b5e6a2de3ae8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:01.996182 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1264/2520] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:54:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:02.006622 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1257/2521] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:54:02.010761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640836d2-73ba-45b0-81ae-439f921176d4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:02.024309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640836d2-73ba-45b0-81ae-439f921176d4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:02.030763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37d160-dab0-4503-bb6b-f7ddb5857086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:02.031666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d160-dab0-4503-bb6b-f7ddb5857086 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:02.032076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d160-dab0-4503-bb6b-f7ddb5857086 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:02.032476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d160-dab0-4503-bb6b-f7ddb5857086 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:02.033434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37d160-dab0-4503-bb6b-f7ddb5857086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:02.035193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37d160-dab0-4503-bb6b-f7ddb5857086 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:02.047779 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1265/2522] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:54:02.051923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283d146-b478-416d-beef-b5e6a2de3ae8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:02.057631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37d160-dab0-4503-bb6b-f7ddb5857086 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:02.064383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dc37d160-dab0-4503-bb6b-f7ddb5857086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:02.068682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283d146-b478-416d-beef-b5e6a2de3ae8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:02.080017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b43939-47a5-4ba2-8a75-214111c7f70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:02.081050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b43939-47a5-4ba2-8a75-214111c7f70e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:02.081278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b43939-47a5-4ba2-8a75-214111c7f70e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:02.081756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b43939-47a5-4ba2-8a75-214111c7f70e admin admin] PATH_INFO: `/v3/projects/a3722784b4ee4b559224c3ae95b68d7a/users/ab5a8ada5990410fadf0c76d23765486/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:02.130818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b43939-47a5-4ba2-8a75-214111c7f70e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3722784b4ee4b559224c3ae95b68d7a, user_id=ab5a8ada5990410fadf0c76d23765486, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:02.133704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b43939-47a5-4ba2-8a75-214111c7f70e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:02.172305 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1258/2523] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:02 2022] PUT /identity/v3/projects/a3722784b4ee4b559224c3ae95b68d7a/users/ab5a8ada5990410fadf0c76d23765486/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:02.184918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813c4eb-8d7a-402c-8b1c-45d353ff8436 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:02.185211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813c4eb-8d7a-402c-8b1c-45d353ff8436 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:02.185490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813c4eb-8d7a-402c-8b1c-45d353ff8436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:02.218647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37d160-dab0-4503-bb6b-f7ddb5857086 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:02.256852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4813c4eb-8d7a-402c-8b1c-45d353ff8436 None None] MFA Rules not processed for user `ab5a8ada5990410fadf0c76d23765486`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:02.258384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4813c4eb-8d7a-402c-8b1c-45d353ff8436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:02.343212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87b812-4066-46f5-9a93-3c960c18b6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:02.344063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87b812-4066-46f5-9a93-3c960c18b6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:02.344224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87b812-4066-46f5-9a93-3c960c18b6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:02.346143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87b812-4066-46f5-9a93-3c960c18b6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:02.396053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:02.422101 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1259/2524] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:02.472592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87b812-4066-46f5-9a93-3c960c18b6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:02.474338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87b812-4066-46f5-9a93-3c960c18b6e8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:02.489480 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1266/2525] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:02.515216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f08817-86a2-40d2-8caa-e2b0fc0463fc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:02.516785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f08817-86a2-40d2-8caa-e2b0fc0463fc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:02.517486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f08817-86a2-40d2-8caa-e2b0fc0463fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:02.552380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-08f08817-86a2-40d2-8caa-e2b0fc0463fc None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:02.553950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-08f08817-86a2-40d2-8caa-e2b0fc0463fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:02.564136 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1260/2526] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:54:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:02.577257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87b812-4066-46f5-9a93-3c960c18b6e8 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:02.587313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87b812-4066-46f5-9a93-3c960c18b6e8 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:02.591538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16afef-15f6-41c1-9711-84a6d9c4c4cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:02.592244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16afef-15f6-41c1-9711-84a6d9c4c4cf service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:02.592609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16afef-15f6-41c1-9711-84a6d9c4c4cf service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:02.592958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16afef-15f6-41c1-9711-84a6d9c4c4cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:02.602240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16afef-15f6-41c1-9711-84a6d9c4c4cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:02.603875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16afef-15f6-41c1-9711-84a6d9c4c4cf service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:02.613517 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1267/2527] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:02.796880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f08817-86a2-40d2-8caa-e2b0fc0463fc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:02.798817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-08f08817-86a2-40d2-8caa-e2b0fc0463fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:02.811368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:02.816831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f08817-86a2-40d2-8caa-e2b0fc0463fc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:02.823631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0d68f-6b49-4e64-9733-dab50d3ccfeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:02.824496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0d68f-6b49-4e64-9733-dab50d3ccfeb service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:02.824829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0d68f-6b49-4e64-9733-dab50d3ccfeb service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:02.825148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0d68f-6b49-4e64-9733-dab50d3ccfeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:02.834471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0d68f-6b49-4e64-9733-dab50d3ccfeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:02.836127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0d68f-6b49-4e64-9733-dab50d3ccfeb service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:02.847140 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1261/2528] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:03.401572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89a22-ae53-42cc-ab22-cff34398e564 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:03.402160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89a22-ae53-42cc-ab22-cff34398e564 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:03.402413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89a22-ae53-42cc-ab22-cff34398e564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:03.437657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f1a89a22-ae53-42cc-ab22-cff34398e564 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:03.439037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f1a89a22-ae53-42cc-ab22-cff34398e564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:03.541257 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1268/2529] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 18:54:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:03.561785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0d68f-6b49-4e64-9733-dab50d3ccfeb service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:03.563183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-98c0d68f-6b49-4e64-9733-dab50d3ccfeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:03.699481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0d68f-6b49-4e64-9733-dab50d3ccfeb service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:03.706158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019f0dc-6a20-436a-93b0-eaa17ed65f9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:03.707104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019f0dc-6a20-436a-93b0-eaa17ed65f9a service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:03.707495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019f0dc-6a20-436a-93b0-eaa17ed65f9a service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:03.708535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019f0dc-6a20-436a-93b0-eaa17ed65f9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:03.719942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019f0dc-6a20-436a-93b0-eaa17ed65f9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:03.721742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019f0dc-6a20-436a-93b0-eaa17ed65f9a service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:03.751280 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1262/2530] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 18:54:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:54:05.052092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d7e3-d9ca-461c-a46c-ae163f550346 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:05.052661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d7e3-d9ca-461c-a46c-ae163f550346 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:05.052661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3d7e3-d9ca-461c-a46c-ae163f550346 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:05.054582 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1269/2531] 10.222.0.70 () {54 vars in 921 bytes} [Sun Aug 28 18:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:54:05.071993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36acf1-ba5b-4a8d-9029-a0046eac927c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:05.072495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36acf1-ba5b-4a8d-9029-a0046eac927c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:05.073012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36acf1-ba5b-4a8d-9029-a0046eac927c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:05.101522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bb36acf1-ba5b-4a8d-9029-a0046eac927c None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:05.103041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bb36acf1-ba5b-4a8d-9029-a0046eac927c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:05.119194 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1263/2532] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:54:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:05.144014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3d7e3-d9ca-461c-a46c-ae163f550346 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:05.159074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3d7e3-d9ca-461c-a46c-ae163f550346 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:05.173331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94072bd4-75de-40ce-b575-f18091daa2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:05.174013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94072bd4-75de-40ce-b575-f18091daa2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:05.174296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94072bd4-75de-40ce-b575-f18091daa2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:05.174566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94072bd4-75de-40ce-b575-f18091daa2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:05.202262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94072bd4-75de-40ce-b575-f18091daa2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:05.205377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94072bd4-75de-40ce-b575-f18091daa2c8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:05.248584 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1270/2533] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:11.953337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36acf1-ba5b-4a8d-9029-a0046eac927c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:12.070491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36acf1-ba5b-4a8d-9029-a0046eac927c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:12.088908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:12.089939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:12.090377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:12.090668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] PATH_INFO: `/v3/users/ab5a8ada5990410fadf0c76d23765486` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:12.091969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5a8ada5990410fadf0c76d23765486)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:12.093955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:12.217853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5a8ada5990410fadf0c76d23765486'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:12.240539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5a8ada5990410fadf0c76d23765486'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:12.241315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5a8ada5990410fadf0c76d23765486'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:12.259030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5a8ada5990410fadf0c76d23765486'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:12.259715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5a8ada5990410fadf0c76d23765486'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:12.268322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:12.309568 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1264/2534] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:11 2022] DELETE /identity/v3/users/ab5a8ada5990410fadf0c76d23765486 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:12.315912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9013a8-1b5e-4e59-b4d6-aaae16877bfa None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:12.316448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9013a8-1b5e-4e59-b4d6-aaae16877bfa None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:12.316755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9013a8-1b5e-4e59-b4d6-aaae16877bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:12.359336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fc9013a8-1b5e-4e59-b4d6-aaae16877bfa None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:12.361415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fc9013a8-1b5e-4e59-b4d6-aaae16877bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:12.513030 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1271/2535] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:12.522282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:12.524064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:12.591194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9013a8-1b5e-4e59-b4d6-aaae16877bfa None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:12.592811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fc9013a8-1b5e-4e59-b4d6-aaae16877bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:12.675059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:12.725859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8f1d0-5629-4ef9-a0af-074dc2fa0368 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:12.732560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65035113-441c-498a-92e9-b849fe6c4e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:12.734374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65035113-441c-498a-92e9-b849fe6c4e4f service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:12.735007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65035113-441c-498a-92e9-b849fe6c4e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:12.735548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65035113-441c-498a-92e9-b849fe6c4e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:12.756114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9013a8-1b5e-4e59-b4d6-aaae16877bfa None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:12.762541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65035113-441c-498a-92e9-b849fe6c4e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:12.763579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5233fd-fe05-4aed-b928-563ae614cd20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:12.764109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5233fd-fe05-4aed-b928-563ae614cd20 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:12.764395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5233fd-fe05-4aed-b928-563ae614cd20 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:12.764749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5233fd-fe05-4aed-b928-563ae614cd20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:12.765712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65035113-441c-498a-92e9-b849fe6c4e4f service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:12.766631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5a5233fd-fe05-4aed-b928-563ae614cd20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:12.792847 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1265/2536] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:12.858129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5233fd-fe05-4aed-b928-563ae614cd20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:12.860755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5233fd-fe05-4aed-b928-563ae614cd20 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:12.909919 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1272/2537] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:54:13.916641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65035113-441c-498a-92e9-b849fe6c4e4f service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:13.918788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-65035113-441c-498a-92e9-b849fe6c4e4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:13.951265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65035113-441c-498a-92e9-b849fe6c4e4f service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:13.963822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfff26-f774-462f-aef3-033fcc19fd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:13.966364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfff26-f774-462f-aef3-033fcc19fd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:13.966702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfff26-f774-462f-aef3-033fcc19fd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:13.968137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfff26-f774-462f-aef3-033fcc19fd4d admin admin] PATH_INFO: `/v3/projects/a3722784b4ee4b559224c3ae95b68d7a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:13.999646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfff26-f774-462f-aef3-033fcc19fd4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3722784b4ee4b559224c3ae95b68d7a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:14.004842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfff26-f774-462f-aef3-033fcc19fd4d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:14.143828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3bbfff26-f774-462f-aef3-033fcc19fd4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3722784b4ee4b559224c3ae95b68d7a', 'request_id': 'req-3bbfff26-f774-462f-aef3-033fcc19fd4d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:14.167659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3bbfff26-f774-462f-aef3-033fcc19fd4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3722784b4ee4b559224c3ae95b68d7a', 'request_id': 'req-3bbfff26-f774-462f-aef3-033fcc19fd4d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:14.175723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3bbfff26-f774-462f-aef3-033fcc19fd4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3722784b4ee4b559224c3ae95b68d7a', 'request_id': 'req-3bbfff26-f774-462f-aef3-033fcc19fd4d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:14.226609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3bbfff26-f774-462f-aef3-033fcc19fd4d admin admin] The token cache is being invalidate because project a3722784b4ee4b559224c3ae95b68d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:14.227251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3bbfff26-f774-462f-aef3-033fcc19fd4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:14.228166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3bbfff26-f774-462f-aef3-033fcc19fd4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:14.240195 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1266/2538] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:13 2022] DELETE /identity/v3/projects/a3722784b4ee4b559224c3ae95b68d7a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:14.241810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08867c-f008-4131-ba2a-202e07726e34 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:14.242621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08867c-f008-4131-ba2a-202e07726e34 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:14.243086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08867c-f008-4131-ba2a-202e07726e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:14.285997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2e08867c-f008-4131-ba2a-202e07726e34 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:14.287695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2e08867c-f008-4131-ba2a-202e07726e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:14.414985 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1273/2539] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:14.423864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c35b5-415e-4e15-ac6c-d3e22e8c077a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:14.424101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c35b5-415e-4e15-ac6c-d3e22e8c077a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:14.424361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c35b5-415e-4e15-ac6c-d3e22e8c077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:14.473640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f92c35b5-415e-4e15-ac6c-d3e22e8c077a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:14.476181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f92c35b5-415e-4e15-ac6c-d3e22e8c077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:14.513529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08867c-f008-4131-ba2a-202e07726e34 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:14.523986 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1267/2540] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:14.529898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08867c-f008-4131-ba2a-202e07726e34 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:14.554720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27088d93-b459-4212-aecc-7f6204cec998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:14.555546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27088d93-b459-4212-aecc-7f6204cec998 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:14.555546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27088d93-b459-4212-aecc-7f6204cec998 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:14.555780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27088d93-b459-4212-aecc-7f6204cec998 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:14.556422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27088d93-b459-4212-aecc-7f6204cec998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:14.556802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27088d93-b459-4212-aecc-7f6204cec998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:14.559798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27088d93-b459-4212-aecc-7f6204cec998 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:14.599710 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1274/2541] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:54:14.605795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c35b5-415e-4e15-ac6c-d3e22e8c077a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:14.616996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c35b5-415e-4e15-ac6c-d3e22e8c077a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:14.628858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346efb06-b05d-4ca5-b5a4-975de61cf360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:14.631746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346efb06-b05d-4ca5-b5a4-975de61cf360 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:14.632215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346efb06-b05d-4ca5-b5a4-975de61cf360 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:14.632659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346efb06-b05d-4ca5-b5a4-975de61cf360 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:14.634408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346efb06-b05d-4ca5-b5a4-975de61cf360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:14.637179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346efb06-b05d-4ca5-b5a4-975de61cf360 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:14.701213 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1268/2542] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:14 2022] POST /identity/v3/projects => generated 361 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:14.705391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27088d93-b459-4212-aecc-7f6204cec998 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:14.720295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27088d93-b459-4212-aecc-7f6204cec998 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:14.807437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:14.844465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd06f1-442a-4ae2-85b7-1877b190c016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:14.845454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd06f1-442a-4ae2-85b7-1877b190c016 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:14.845944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd06f1-442a-4ae2-85b7-1877b190c016 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:14.846480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd06f1-442a-4ae2-85b7-1877b190c016 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:14.847814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd06f1-442a-4ae2-85b7-1877b190c016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:14.851152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd06f1-442a-4ae2-85b7-1877b190c016 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:14.905997 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1275/2543] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:14 2022] POST /identity/v3/users => generated 281 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:14.909526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346efb06-b05d-4ca5-b5a4-975de61cf360 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:14.922084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346efb06-b05d-4ca5-b5a4-975de61cf360 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:14.927601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be45625-0a4b-409a-9f26-99ca5238b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:14.928372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be45625-0a4b-409a-9f26-99ca5238b65a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:14.928655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be45625-0a4b-409a-9f26-99ca5238b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:14.928931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be45625-0a4b-409a-9f26-99ca5238b65a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:14.929579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be45625-0a4b-409a-9f26-99ca5238b65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:14.931735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be45625-0a4b-409a-9f26-99ca5238b65a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:14.950572 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1269/2544] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:14.951993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd06f1-442a-4ae2-85b7-1877b190c016 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:14.962335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd06f1-442a-4ae2-85b7-1877b190c016 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:14.967400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ad9b4-e89b-430d-b535-9d708fbbd929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:14.967907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad9b4-e89b-430d-b535-9d708fbbd929 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:14.968141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad9b4-e89b-430d-b535-9d708fbbd929 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:14.968433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ad9b4-e89b-430d-b535-9d708fbbd929 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:14.969049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ad9b4-e89b-430d-b535-9d708fbbd929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:14.970639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ad9b4-e89b-430d-b535-9d708fbbd929 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:14.983492 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1276/2545] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:54:14.987867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be45625-0a4b-409a-9f26-99ca5238b65a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:14.999494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be45625-0a4b-409a-9f26-99ca5238b65a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:15.005053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8242d2d-7768-4254-a9ba-4fed66c12ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:15.005762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8242d2d-7768-4254-a9ba-4fed66c12ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:15.006037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8242d2d-7768-4254-a9ba-4fed66c12ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:15.006320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8242d2d-7768-4254-a9ba-4fed66c12ac2 admin admin] PATH_INFO: `/v3/projects/97c36428297c4f3889bd43c86cc1d3e7/users/42b14c7b9aba4b8a8eb102ff70b71044/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:15.022628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8242d2d-7768-4254-a9ba-4fed66c12ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c36428297c4f3889bd43c86cc1d3e7, user_id=42b14c7b9aba4b8a8eb102ff70b71044, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:15.025391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8242d2d-7768-4254-a9ba-4fed66c12ac2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:15.039614 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1270/2546] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:14 2022] PUT /identity/v3/projects/97c36428297c4f3889bd43c86cc1d3e7/users/42b14c7b9aba4b8a8eb102ff70b71044/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:15.052138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb16fa-74f0-41f9-895b-654e1026363e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:15.052423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb16fa-74f0-41f9-895b-654e1026363e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:15.052704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb16fa-74f0-41f9-895b-654e1026363e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:15.083536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f1fb16fa-74f0-41f9-895b-654e1026363e None None] MFA Rules not processed for user `42b14c7b9aba4b8a8eb102ff70b71044`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:15.084763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f1fb16fa-74f0-41f9-895b-654e1026363e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:15.197235 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1277/2547] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:15.207948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8242d2d-7768-4254-a9ba-4fed66c12ac2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:15.209728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f8242d2d-7768-4254-a9ba-4fed66c12ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:15.231675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:15.292549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8242d2d-7768-4254-a9ba-4fed66c12ac2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:15.298141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e4a4c-97de-4ce6-9679-3529bd19da51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:15.298770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e4a4c-97de-4ce6-9679-3529bd19da51 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:15.299058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e4a4c-97de-4ce6-9679-3529bd19da51 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:15.299330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e4a4c-97de-4ce6-9679-3529bd19da51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:15.307321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e4a4c-97de-4ce6-9679-3529bd19da51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:15.309948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e4a4c-97de-4ce6-9679-3529bd19da51 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:15.318734 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1271/2548] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:15.361342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb16fa-74f0-41f9-895b-654e1026363e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:15.427782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb16fa-74f0-41f9-895b-654e1026363e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:15.432401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:15.433542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:15.433820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:15.434093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] PATH_INFO: `/v3/users/42b14c7b9aba4b8a8eb102ff70b71044` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:15.435285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b14c7b9aba4b8a8eb102ff70b71044)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:15.437194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:15.488706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b14c7b9aba4b8a8eb102ff70b71044'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:15.496306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b14c7b9aba4b8a8eb102ff70b71044'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:15.497057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b14c7b9aba4b8a8eb102ff70b71044'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:15.504899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b14c7b9aba4b8a8eb102ff70b71044'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:15.505616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b14c7b9aba4b8a8eb102ff70b71044'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:15.506900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:15.527707 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1278/2549] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:15 2022] DELETE /identity/v3/users/42b14c7b9aba4b8a8eb102ff70b71044 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:15.532194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d219c2-77bf-43c5-a134-6b506f19b5f9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:15.532489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d219c2-77bf-43c5-a134-6b506f19b5f9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:15.532773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d219c2-77bf-43c5-a134-6b506f19b5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:15.552454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e6d219c2-77bf-43c5-a134-6b506f19b5f9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:15.553664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e6d219c2-77bf-43c5-a134-6b506f19b5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:15.623372 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1272/2550] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:15.633885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:15.635398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:15.695433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a39a5-3309-4367-beda-3dba91612da1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:15.700024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1fd88-a2b0-4722-b16a-b2ce94b7a0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:15.700630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1fd88-a2b0-4722-b16a-b2ce94b7a0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:15.700910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1fd88-a2b0-4722-b16a-b2ce94b7a0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:15.701181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1fd88-a2b0-4722-b16a-b2ce94b7a0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:15.710408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1fd88-a2b0-4722-b16a-b2ce94b7a0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:15.711870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1fd88-a2b0-4722-b16a-b2ce94b7a0f6 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:15.722382 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1279/2551] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:16.174909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d219c2-77bf-43c5-a134-6b506f19b5f9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:16.176436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e6d219c2-77bf-43c5-a134-6b506f19b5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:16.190052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d219c2-77bf-43c5-a134-6b506f19b5f9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:16.196072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ca502-acca-4d23-8ed7-3047848c9de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:16.197119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca502-acca-4d23-8ed7-3047848c9de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:16.197773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca502-acca-4d23-8ed7-3047848c9de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:16.199661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca502-acca-4d23-8ed7-3047848c9de1 admin admin] PATH_INFO: `/v3/projects/97c36428297c4f3889bd43c86cc1d3e7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:16.202176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ca502-acca-4d23-8ed7-3047848c9de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c36428297c4f3889bd43c86cc1d3e7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:16.204556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ca502-acca-4d23-8ed7-3047848c9de1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:16.272984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-122ca502-acca-4d23-8ed7-3047848c9de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c36428297c4f3889bd43c86cc1d3e7', 'request_id': 'req-122ca502-acca-4d23-8ed7-3047848c9de1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:16.283976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-122ca502-acca-4d23-8ed7-3047848c9de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c36428297c4f3889bd43c86cc1d3e7', 'request_id': 'req-122ca502-acca-4d23-8ed7-3047848c9de1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:16.290773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-122ca502-acca-4d23-8ed7-3047848c9de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c36428297c4f3889bd43c86cc1d3e7', 'request_id': 'req-122ca502-acca-4d23-8ed7-3047848c9de1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:16.304784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-122ca502-acca-4d23-8ed7-3047848c9de1 admin admin] The token cache is being invalidate because project 97c36428297c4f3889bd43c86cc1d3e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:16.305169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-122ca502-acca-4d23-8ed7-3047848c9de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:16.305942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-122ca502-acca-4d23-8ed7-3047848c9de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:16.307759 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1273/2552] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:16 2022] DELETE /identity/v3/projects/97c36428297c4f3889bd43c86cc1d3e7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:16.313200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d031235-97d5-471a-8a9f-15133788e6d0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:16.313872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d031235-97d5-471a-8a9f-15133788e6d0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:16.314657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d031235-97d5-471a-8a9f-15133788e6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:16.340605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2d031235-97d5-471a-8a9f-15133788e6d0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:16.342129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2d031235-97d5-471a-8a9f-15133788e6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:16.412075 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1280/2553] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:16.420883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42d683-6706-4448-99a0-592268b2443c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:16.421205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42d683-6706-4448-99a0-592268b2443c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:16.421483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42d683-6706-4448-99a0-592268b2443c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:16.442979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8b42d683-6706-4448-99a0-592268b2443c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:16.444221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8b42d683-6706-4448-99a0-592268b2443c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:16.452681 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1274/2554] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:16.457218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d031235-97d5-471a-8a9f-15133788e6d0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:16.468937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d031235-97d5-471a-8a9f-15133788e6d0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:16.474189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b4a47-e5a9-42bb-852f-11f34845b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:16.474896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b4a47-e5a9-42bb-852f-11f34845b809 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:16.475180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b4a47-e5a9-42bb-852f-11f34845b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:16.475454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b4a47-e5a9-42bb-852f-11f34845b809 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:16.476116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b4a47-e5a9-42bb-852f-11f34845b809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:16.476422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b4a47-e5a9-42bb-852f-11f34845b809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:16.478061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b4a47-e5a9-42bb-852f-11f34845b809 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:16.491862 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1281/2555] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:16.497203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42d683-6706-4448-99a0-592268b2443c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:16.506920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42d683-6706-4448-99a0-592268b2443c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:16.512296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e4769-c9a2-407f-b98e-b6eff8dde324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:16.512962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e4769-c9a2-407f-b98e-b6eff8dde324 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:16.513251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e4769-c9a2-407f-b98e-b6eff8dde324 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:16.513528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e4769-c9a2-407f-b98e-b6eff8dde324 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:16.514231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e4769-c9a2-407f-b98e-b6eff8dde324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:16.516252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e4769-c9a2-407f-b98e-b6eff8dde324 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:16.534483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:16.558462 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1275/2556] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:16 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:16.560724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b4a47-e5a9-42bb-852f-11f34845b809 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:16.586149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b4a47-e5a9-42bb-852f-11f34845b809 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:16.695239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636fd2f-a941-4957-827a-d5bb16419ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:16.696204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636fd2f-a941-4957-827a-d5bb16419ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:16.696204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636fd2f-a941-4957-827a-d5bb16419ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:16.696456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636fd2f-a941-4957-827a-d5bb16419ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:16.697110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636fd2f-a941-4957-827a-d5bb16419ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:16.699491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636fd2f-a941-4957-827a-d5bb16419ea9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:16.721954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:16.728970 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1282/2557] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:16 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:54:16.733692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e4769-c9a2-407f-b98e-b6eff8dde324 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:16.746815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e4769-c9a2-407f-b98e-b6eff8dde324 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:16.754297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419df620-a0ee-41fc-b6b4-4837b838ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:16.756074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419df620-a0ee-41fc-b6b4-4837b838ea4c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:16.756371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419df620-a0ee-41fc-b6b4-4837b838ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:16.756658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419df620-a0ee-41fc-b6b4-4837b838ea4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:16.757313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419df620-a0ee-41fc-b6b4-4837b838ea4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:16.759200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419df620-a0ee-41fc-b6b4-4837b838ea4c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:16.770856 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1276/2558] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:16.775259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636fd2f-a941-4957-827a-d5bb16419ea9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:16.786562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636fd2f-a941-4957-827a-d5bb16419ea9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:16.793365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478957c8-e432-4d77-9306-582a035e85e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:16.794587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478957c8-e432-4d77-9306-582a035e85e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:16.794587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478957c8-e432-4d77-9306-582a035e85e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:16.794818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478957c8-e432-4d77-9306-582a035e85e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:16.795348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478957c8-e432-4d77-9306-582a035e85e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:16.797017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478957c8-e432-4d77-9306-582a035e85e9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:16.832980 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1283/2559] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:16.837625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419df620-a0ee-41fc-b6b4-4837b838ea4c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:16.857597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419df620-a0ee-41fc-b6b4-4837b838ea4c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:16.869112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5665308-4b9a-4fea-889c-db35ddb66524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:16.870964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5665308-4b9a-4fea-889c-db35ddb66524 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:16.871641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5665308-4b9a-4fea-889c-db35ddb66524 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:16.872077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5665308-4b9a-4fea-889c-db35ddb66524 admin admin] PATH_INFO: `/v3/projects/0ea2056822224e538256f6c7af973496/users/5f263343f35e42a49cd4991c1011f412/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:16.900379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5665308-4b9a-4fea-889c-db35ddb66524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea2056822224e538256f6c7af973496, user_id=5f263343f35e42a49cd4991c1011f412, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:16.906520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5665308-4b9a-4fea-889c-db35ddb66524 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:16.935420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6a159-550c-46d6-b604-35fdb87d22b3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:16.935759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6a159-550c-46d6-b604-35fdb87d22b3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:16.936131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6a159-550c-46d6-b604-35fdb87d22b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:16.939007 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1277/2560] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:16 2022] PUT /identity/v3/projects/0ea2056822224e538256f6c7af973496/users/5f263343f35e42a49cd4991c1011f412/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:16.962710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d9e6a159-550c-46d6-b604-35fdb87d22b3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:16.964556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d9e6a159-550c-46d6-b604-35fdb87d22b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:17.094703 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1284/2561] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:17.451650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5665308-4b9a-4fea-889c-db35ddb66524 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:17.454119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d5665308-4b9a-4fea-889c-db35ddb66524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:17.591609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5665308-4b9a-4fea-889c-db35ddb66524 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:17.602527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386618a-c25a-49a2-bee9-32600f334642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:17.603196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386618a-c25a-49a2-bee9-32600f334642 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:17.603477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386618a-c25a-49a2-bee9-32600f334642 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:17.603757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386618a-c25a-49a2-bee9-32600f334642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:17.648668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386618a-c25a-49a2-bee9-32600f334642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:17.650959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386618a-c25a-49a2-bee9-32600f334642 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:17.690774 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1278/2562] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:18.872633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6a159-550c-46d6-b604-35fdb87d22b3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:18.874247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d9e6a159-550c-46d6-b604-35fdb87d22b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:18.887431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6a159-550c-46d6-b604-35fdb87d22b3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:18.892125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:18.892763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:18.893052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:18.893330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] PATH_INFO: `/v3/users/7386b4ccca7f47a2b4a021a5d14836c9` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:18.894637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7386b4ccca7f47a2b4a021a5d14836c9)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:18.896725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:18.952350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7386b4ccca7f47a2b4a021a5d14836c9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:18.963290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7386b4ccca7f47a2b4a021a5d14836c9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:18.972508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7386b4ccca7f47a2b4a021a5d14836c9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:18.983295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7386b4ccca7f47a2b4a021a5d14836c9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:18.984061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7386b4ccca7f47a2b4a021a5d14836c9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:19.005927 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1285/2563] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:18 2022] DELETE /identity/v3/users/7386b4ccca7f47a2b4a021a5d14836c9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:19.011515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db6b8f-783f-4e43-bea0-3430f381663a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:19.012033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db6b8f-783f-4e43-bea0-3430f381663a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:19.012286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db6b8f-783f-4e43-bea0-3430f381663a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:19.031818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e7db6b8f-783f-4e43-bea0-3430f381663a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:19.033114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e7db6b8f-783f-4e43-bea0-3430f381663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:19.153759 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1279/2564] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:19.225032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:19.226930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:19.309204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df06085-df0a-4ce7-bd0c-0bb32dfc7640 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:19.331169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92b876-aed2-44c1-ab14-6395f5445f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:19.331804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92b876-aed2-44c1-ab14-6395f5445f82 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:19.332092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92b876-aed2-44c1-ab14-6395f5445f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:19.332360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92b876-aed2-44c1-ab14-6395f5445f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:19.349133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92b876-aed2-44c1-ab14-6395f5445f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:19.352669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92b876-aed2-44c1-ab14-6395f5445f82 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:19.368679 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1286/2565] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:19.772211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db6b8f-783f-4e43-bea0-3430f381663a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:19.781471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e7db6b8f-783f-4e43-bea0-3430f381663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:19.816358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db6b8f-783f-4e43-bea0-3430f381663a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:19.816358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:19.816358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:19.816358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:19.820268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] PATH_INFO: `/v3/projects/1fdc1531264a457cb7ee733ee3f221dc` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:19.821085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fdc1531264a457cb7ee733ee3f221dc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:19.823153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:19.904189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92b876-aed2-44c1-ab14-6395f5445f82 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:19.905851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cd92b876-aed2-44c1-ab14-6395f5445f82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:19.916472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:19.921668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92b876-aed2-44c1-ab14-6395f5445f82 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:19.924095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fdc1531264a457cb7ee733ee3f221dc', 'request_id': 'req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:19.944337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fdc1531264a457cb7ee733ee3f221dc', 'request_id': 'req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:19.951504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:19.962345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fdc1531264a457cb7ee733ee3f221dc', 'request_id': 'req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:19.985180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] The token cache is being invalidate because project 1fdc1531264a457cb7ee733ee3f221dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:19.985500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:19.987941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:19.996128 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1280/2566] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:19 2022] DELETE /identity/v3/projects/1fdc1531264a457cb7ee733ee3f221dc => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:19.999383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:20.001449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:20.062726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4772f61-d994-461b-9067-53668e601862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:20.063408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4772f61-d994-461b-9067-53668e601862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:20.063690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4772f61-d994-461b-9067-53668e601862 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:20.063960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4772f61-d994-461b-9067-53668e601862 admin admin] PATH_INFO: `/v3/users/4804652ca68040dfbeb96e6770cd24b8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:20.065194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4772f61-d994-461b-9067-53668e601862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4804652ca68040dfbeb96e6770cd24b8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:20.067167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4772f61-d994-461b-9067-53668e601862 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:20.108242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7595aa-7ea7-4f38-9fd9-9a1497bf16a9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:20.114705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:20.115518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:20.116144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:20.116742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] PATH_INFO: `/v3/users/16b89b35d080409d82d4a8f3ae794e80` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:20.118677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b89b35d080409d82d4a8f3ae794e80)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:20.121708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:20.136230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a4772f61-d994-461b-9067-53668e601862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4804652ca68040dfbeb96e6770cd24b8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:20.147833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a4772f61-d994-461b-9067-53668e601862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4804652ca68040dfbeb96e6770cd24b8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:20.148780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a4772f61-d994-461b-9067-53668e601862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4804652ca68040dfbeb96e6770cd24b8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:20.172840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a4772f61-d994-461b-9067-53668e601862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4804652ca68040dfbeb96e6770cd24b8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:20.173796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a4772f61-d994-461b-9067-53668e601862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4804652ca68040dfbeb96e6770cd24b8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:20.202437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b89b35d080409d82d4a8f3ae794e80'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:20.212302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b89b35d080409d82d4a8f3ae794e80'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:20.213417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b89b35d080409d82d4a8f3ae794e80'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:20.221312 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1287/2567] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:19 2022] DELETE /identity/v3/users/4804652ca68040dfbeb96e6770cd24b8 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:20.226281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334dabb-ab47-4f79-b40f-64c82f16a37f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:20.226690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334dabb-ab47-4f79-b40f-64c82f16a37f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:20.227823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334dabb-ab47-4f79-b40f-64c82f16a37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:20.235686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b89b35d080409d82d4a8f3ae794e80'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:20.236713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b89b35d080409d82d4a8f3ae794e80'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:20.263213 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1281/2568] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:19 2022] DELETE /identity/v3/users/16b89b35d080409d82d4a8f3ae794e80 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:20.263420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5334dabb-ab47-4f79-b40f-64c82f16a37f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:20.264542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5334dabb-ab47-4f79-b40f-64c82f16a37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:20.352910 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1288/2569] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:20.367448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:20.368911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:20.471326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef4fec-9995-4d36-b920-ce439552174d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:20.477299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84ff54-c53d-4de9-bd93-5202d3ba4973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:20.478315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84ff54-c53d-4de9-bd93-5202d3ba4973 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:20.478812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84ff54-c53d-4de9-bd93-5202d3ba4973 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:20.479252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84ff54-c53d-4de9-bd93-5202d3ba4973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:20.493546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84ff54-c53d-4de9-bd93-5202d3ba4973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:20.495902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84ff54-c53d-4de9-bd93-5202d3ba4973 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:20.512250 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1282/2570] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:20.889624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334dabb-ab47-4f79-b40f-64c82f16a37f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:20.891311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5334dabb-ab47-4f79-b40f-64c82f16a37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:20.907756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84ff54-c53d-4de9-bd93-5202d3ba4973 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:20.909204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5f84ff54-c53d-4de9-bd93-5202d3ba4973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:20.912335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334dabb-ab47-4f79-b40f-64c82f16a37f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:20.919357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb41fb2-d423-47b1-af93-0d589381ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:20.920680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb41fb2-d423-47b1-af93-0d589381ae56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:20.921422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb41fb2-d423-47b1-af93-0d589381ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:20.934160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84ff54-c53d-4de9-bd93-5202d3ba4973 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:20.943302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb41fb2-d423-47b1-af93-0d589381ae56 admin admin] PATH_INFO: `/v3/projects/8fa964f2f29c4d9a935101a40fb11ef4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:20.946384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:20.946777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb41fb2-d423-47b1-af93-0d589381ae56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa964f2f29c4d9a935101a40fb11ef4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:20.947211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:20.947559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:20.947937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] PATH_INFO: `/v3/projects/4793cf96c17f464fa00d0e9bc10a1d54` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:20.950267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4793cf96c17f464fa00d0e9bc10a1d54)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:20.952898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb41fb2-d423-47b1-af93-0d589381ae56 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:20.956758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:20.961523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:21.016515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:21.044084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4793cf96c17f464fa00d0e9bc10a1d54', 'request_id': 'req-d8195350-c605-47cd-9386-f0d0445356cb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.055347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4793cf96c17f464fa00d0e9bc10a1d54', 'request_id': 'req-d8195350-c605-47cd-9386-f0d0445356cb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.061066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cfb41fb2-d423-47b1-af93-0d589381ae56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa964f2f29c4d9a935101a40fb11ef4', 'request_id': 'req-cfb41fb2-d423-47b1-af93-0d589381ae56'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.066632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4793cf96c17f464fa00d0e9bc10a1d54', 'request_id': 'req-d8195350-c605-47cd-9386-f0d0445356cb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.069526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cfb41fb2-d423-47b1-af93-0d589381ae56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa964f2f29c4d9a935101a40fb11ef4', 'request_id': 'req-cfb41fb2-d423-47b1-af93-0d589381ae56'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.078378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cfb41fb2-d423-47b1-af93-0d589381ae56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa964f2f29c4d9a935101a40fb11ef4', 'request_id': 'req-cfb41fb2-d423-47b1-af93-0d589381ae56'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.084497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] The token cache is being invalidate because project 4793cf96c17f464fa00d0e9bc10a1d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:21.084882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.085498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.087417 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1283/2571] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:20 2022] DELETE /identity/v3/projects/4793cf96c17f464fa00d0e9bc10a1d54 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:21.091678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:21.093539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:21.095114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cfb41fb2-d423-47b1-af93-0d589381ae56 admin admin] The token cache is being invalidate because project 8fa964f2f29c4d9a935101a40fb11ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:21.095501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cfb41fb2-d423-47b1-af93-0d589381ae56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.096161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cfb41fb2-d423-47b1-af93-0d589381ae56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.102059 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1289/2572] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:20 2022] DELETE /identity/v3/projects/8fa964f2f29c4d9a935101a40fb11ef4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:21.103720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee30e-0ee4-4d7a-ba19-514bfb147d57 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:21.104169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee30e-0ee4-4d7a-ba19-514bfb147d57 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:21.105159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee30e-0ee4-4d7a-ba19-514bfb147d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:21.138802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c95ee30e-0ee4-4d7a-ba19-514bfb147d57 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:21.140791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c95ee30e-0ee4-4d7a-ba19-514bfb147d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:21.177996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8195350-c605-47cd-9386-f0d0445356cb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:21.229767 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1290/2573] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:21.231664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d67f97-5497-4b82-8f5e-9fa901560592 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:21.231958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d67f97-5497-4b82-8f5e-9fa901560592 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:21.232235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d67f97-5497-4b82-8f5e-9fa901560592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:21.254033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b008db-5c63-450e-815d-865c3f26a8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:21.254685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b008db-5c63-450e-815d-865c3f26a8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:21.254990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b008db-5c63-450e-815d-865c3f26a8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:21.255274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b008db-5c63-450e-815d-865c3f26a8d3 admin admin] PATH_INFO: `/v3/users/cc6412cca70d49c38e7eab08a6f6cd15` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:21.256114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a9d67f97-5497-4b82-8f5e-9fa901560592 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:21.256780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b008db-5c63-450e-815d-865c3f26a8d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc6412cca70d49c38e7eab08a6f6cd15)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:21.257649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a9d67f97-5497-4b82-8f5e-9fa901560592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:21.258823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b008db-5c63-450e-815d-865c3f26a8d3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:21.287616 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1291/2574] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:21.288965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d67f97-5497-4b82-8f5e-9fa901560592 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:21.304881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d67f97-5497-4b82-8f5e-9fa901560592 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:21.312770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fd9b7-5e50-4cf4-a1f0-e0eec665a2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:21.314563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fd9b7-5e50-4cf4-a1f0-e0eec665a2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:21.315097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fd9b7-5e50-4cf4-a1f0-e0eec665a2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:21.315676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fd9b7-5e50-4cf4-a1f0-e0eec665a2a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:21.316484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fd9b7-5e50-4cf4-a1f0-e0eec665a2a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:21.316779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fd9b7-5e50-4cf4-a1f0-e0eec665a2a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:21.318944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fd9b7-5e50-4cf4-a1f0-e0eec665a2a4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:21.334509 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1292/2575] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:21.340422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fd9b7-5e50-4cf4-a1f0-e0eec665a2a4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:21.342394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:21.358575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fd9b7-5e50-4cf4-a1f0-e0eec665a2a4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:21.359111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-17b008db-5c63-450e-815d-865c3f26a8d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc6412cca70d49c38e7eab08a6f6cd15'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.364082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3b849-7094-4d9e-ab27-6857bdd23660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:21.364700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3b849-7094-4d9e-ab27-6857bdd23660 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:21.364980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3b849-7094-4d9e-ab27-6857bdd23660 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:21.365256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3b849-7094-4d9e-ab27-6857bdd23660 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:21.366906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3b849-7094-4d9e-ab27-6857bdd23660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:21.369013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3b849-7094-4d9e-ab27-6857bdd23660 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:21.377217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-17b008db-5c63-450e-815d-865c3f26a8d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc6412cca70d49c38e7eab08a6f6cd15'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.377998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-17b008db-5c63-450e-815d-865c3f26a8d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc6412cca70d49c38e7eab08a6f6cd15'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.400124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-17b008db-5c63-450e-815d-865c3f26a8d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc6412cca70d49c38e7eab08a6f6cd15'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.401083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-17b008db-5c63-450e-815d-865c3f26a8d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc6412cca70d49c38e7eab08a6f6cd15'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:21.419416 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1293/2576] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:21 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:21.422227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3b849-7094-4d9e-ab27-6857bdd23660 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:21.427978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-39d3b849-7094-4d9e-ab27-6857bdd23660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:21.436875 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1284/2577] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:21 2022] DELETE /identity/v3/users/cc6412cca70d49c38e7eab08a6f6cd15 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:21.576956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3b849-7094-4d9e-ab27-6857bdd23660 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:21.605172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:21.689027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b75258-f24d-4122-b393-5abcfdcb5043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:21.689631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b75258-f24d-4122-b393-5abcfdcb5043 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:21.689916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b75258-f24d-4122-b393-5abcfdcb5043 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:21.690189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b75258-f24d-4122-b393-5abcfdcb5043 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:21.690908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b75258-f24d-4122-b393-5abcfdcb5043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:21.693078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b75258-f24d-4122-b393-5abcfdcb5043 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:21.725636 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1294/2578] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:21 2022] POST /identity/v3/users => generated 288 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:21.730338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b008db-5c63-450e-815d-865c3f26a8d3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:21.747884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b008db-5c63-450e-815d-865c3f26a8d3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:21.761392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff7f9a-f87b-49e4-971d-6eea7424ac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:21.762284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7f9a-f87b-49e4-971d-6eea7424ac6d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:21.762570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7f9a-f87b-49e4-971d-6eea7424ac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:21.762914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7f9a-f87b-49e4-971d-6eea7424ac6d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:21.763590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff7f9a-f87b-49e4-971d-6eea7424ac6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:21.765229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff7f9a-f87b-49e4-971d-6eea7424ac6d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:21.785087 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1285/2579] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:21.789111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b75258-f24d-4122-b393-5abcfdcb5043 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:21.806961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b75258-f24d-4122-b393-5abcfdcb5043 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:21.818777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba04cb2-169b-42cc-abff-5212cae2ea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:21.819483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba04cb2-169b-42cc-abff-5212cae2ea65 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:21.819770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba04cb2-169b-42cc-abff-5212cae2ea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:21.820054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba04cb2-169b-42cc-abff-5212cae2ea65 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:21.820707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba04cb2-169b-42cc-abff-5212cae2ea65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:21.822332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba04cb2-169b-42cc-abff-5212cae2ea65 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:21.837190 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1295/2580] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:21.842164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff7f9a-f87b-49e4-971d-6eea7424ac6d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:21.859904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff7f9a-f87b-49e4-971d-6eea7424ac6d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:21.869205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7c383-df83-4ad4-a650-60b403f682e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:21.869934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7c383-df83-4ad4-a650-60b403f682e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:21.870855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7c383-df83-4ad4-a650-60b403f682e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:21.871139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7c383-df83-4ad4-a650-60b403f682e3 admin admin] PATH_INFO: `/v3/projects/75af4b62da054adba8b0ecd3d99473f8/users/29bfc6d61f5a456b996efc636eea1219/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:21.895046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7c383-df83-4ad4-a650-60b403f682e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75af4b62da054adba8b0ecd3d99473f8, user_id=29bfc6d61f5a456b996efc636eea1219, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:21.898811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7c383-df83-4ad4-a650-60b403f682e3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:21.947379 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1286/2581] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:21 2022] PUT /identity/v3/projects/75af4b62da054adba8b0ecd3d99473f8/users/29bfc6d61f5a456b996efc636eea1219/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:21.948806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac451-e942-41b2-b6a1-6f7b959b92a1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:21.949332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac451-e942-41b2-b6a1-6f7b959b92a1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:21.949505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac451-e942-41b2-b6a1-6f7b959b92a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:21.993001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7c383-df83-4ad4-a650-60b403f682e3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:22.001738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bff7c383-df83-4ad4-a650-60b403f682e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:22.042723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-45aac451-e942-41b2-b6a1-6f7b959b92a1 None None] MFA Rules not processed for user `29bfc6d61f5a456b996efc636eea1219`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:22.044004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-45aac451-e942-41b2-b6a1-6f7b959b92a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:22.190841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7c383-df83-4ad4-a650-60b403f682e3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:22.197730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:22.199137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:22.199423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:22.199699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] PATH_INFO: `/v3/projects/10e6bb01a0e249dfb19364407825d99b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:22.206872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e6bb01a0e249dfb19364407825d99b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:22.209546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:22.249692 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1296/2582] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:22.250878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac451-e942-41b2-b6a1-6f7b959b92a1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:22.252755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-45aac451-e942-41b2-b6a1-6f7b959b92a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:22.298694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e6bb01a0e249dfb19364407825d99b', 'request_id': 'req-f8f18ef1-f193-4364-a07c-87472990ab9b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:22.316056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e6bb01a0e249dfb19364407825d99b', 'request_id': 'req-f8f18ef1-f193-4364-a07c-87472990ab9b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:22.324233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e6bb01a0e249dfb19364407825d99b', 'request_id': 'req-f8f18ef1-f193-4364-a07c-87472990ab9b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:22.341873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] The token cache is being invalidate because project 10e6bb01a0e249dfb19364407825d99b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:22.342234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:22.342930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:22.345020 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1287/2583] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:21 2022] DELETE /identity/v3/projects/10e6bb01a0e249dfb19364407825d99b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:22.346248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:22.348343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:22.367176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:22.377493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac451-e942-41b2-b6a1-6f7b959b92a1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:22.412842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:22.447130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f18ef1-f193-4364-a07c-87472990ab9b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:22.456891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e305635-d299-48d6-bec5-1ee313b500af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:22.457545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e305635-d299-48d6-bec5-1ee313b500af admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:22.457828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e305635-d299-48d6-bec5-1ee313b500af admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:22.458104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e305635-d299-48d6-bec5-1ee313b500af admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:22.458777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e305635-d299-48d6-bec5-1ee313b500af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:22.461151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e305635-d299-48d6-bec5-1ee313b500af admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:22.507012 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1288/2584] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:22 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:22.516344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b718a7-c374-46c1-b154-9edafcae9f92 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:22.516708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b718a7-c374-46c1-b154-9edafcae9f92 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:22.516982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b718a7-c374-46c1-b154-9edafcae9f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:22.532786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10f9cd-2aca-4c93-8095-e9050e3d3a0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:22.533421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10f9cd-2aca-4c93-8095-e9050e3d3a0d service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:22.533699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10f9cd-2aca-4c93-8095-e9050e3d3a0d service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:22.533970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10f9cd-2aca-4c93-8095-e9050e3d3a0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:22.535816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fa10f9cd-2aca-4c93-8095-e9050e3d3a0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:22.554144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-73b718a7-c374-46c1-b154-9edafcae9f92 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:22.555513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-73b718a7-c374-46c1-b154-9edafcae9f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:22.585055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10f9cd-2aca-4c93-8095-e9050e3d3a0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:22.587029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10f9cd-2aca-4c93-8095-e9050e3d3a0d service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:22.603366 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1297/2585] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:22.604095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10f9cd-2aca-4c93-8095-e9050e3d3a0d service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:22.620081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10f9cd-2aca-4c93-8095-e9050e3d3a0d service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:22.680204 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1289/2586] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:22.689332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b31add-dacb-41dc-8d79-82d9289fc668 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:22.689619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b31add-dacb-41dc-8d79-82d9289fc668 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:22.689879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b31add-dacb-41dc-8d79-82d9289fc668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:22.704320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6168c8-d258-4c36-abfb-c8a2bc448c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:22.704952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6168c8-d258-4c36-abfb-c8a2bc448c31 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:22.705812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6168c8-d258-4c36-abfb-c8a2bc448c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:22.705812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6168c8-d258-4c36-abfb-c8a2bc448c31 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:22.706348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6168c8-d258-4c36-abfb-c8a2bc448c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:22.708458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6168c8-d258-4c36-abfb-c8a2bc448c31 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:22.722526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-09b31add-dacb-41dc-8d79-82d9289fc668 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:22.723968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-09b31add-dacb-41dc-8d79-82d9289fc668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:22.737252 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1290/2587] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:22.741517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b31add-dacb-41dc-8d79-82d9289fc668 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:22.744374 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1298/2588] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:22 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:22.745993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6168c8-d258-4c36-abfb-c8a2bc448c31 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:22.757669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6168c8-d258-4c36-abfb-c8a2bc448c31 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:22.763564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7436a4e-00e5-4f5a-9e8a-dbe47c4180ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:22.764175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7436a4e-00e5-4f5a-9e8a-dbe47c4180ca admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:22.764453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7436a4e-00e5-4f5a-9e8a-dbe47c4180ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:22.764725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7436a4e-00e5-4f5a-9e8a-dbe47c4180ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:22.765365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7436a4e-00e5-4f5a-9e8a-dbe47c4180ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:22.767211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7436a4e-00e5-4f5a-9e8a-dbe47c4180ca admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:22.777196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b31add-dacb-41dc-8d79-82d9289fc668 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:22.788795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f2d2e-0c9f-4ace-836d-7a4148926e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:22.790011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f2d2e-0c9f-4ace-836d-7a4148926e4e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:22.790979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f2d2e-0c9f-4ace-836d-7a4148926e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:22.791509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f2d2e-0c9f-4ace-836d-7a4148926e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:22.793200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f2d2e-0c9f-4ace-836d-7a4148926e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:22.793787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f2d2e-0c9f-4ace-836d-7a4148926e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:22.795833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f2d2e-0c9f-4ace-836d-7a4148926e4e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:22.800246 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1299/2589] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:22.802453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7436a4e-00e5-4f5a-9e8a-dbe47c4180ca admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:22.813419 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1291/2590] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:22.819041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f2d2e-0c9f-4ace-836d-7a4148926e4e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:22.830830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7436a4e-00e5-4f5a-9e8a-dbe47c4180ca admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:22.836703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f44b2f-2cef-4c07-bcae-8f966eba24b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:22.838377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f44b2f-2cef-4c07-bcae-8f966eba24b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:22.839243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f44b2f-2cef-4c07-bcae-8f966eba24b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:22.839415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f2d2e-0c9f-4ace-836d-7a4148926e4e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:22.839563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f44b2f-2cef-4c07-bcae-8f966eba24b3 admin admin] PATH_INFO: `/v3/projects/8aeb3824a7c44868a97e77fd63ada27e/users/f9f573bb375149ceb8c6e696e2c9061d/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:22.849248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77ee74-95b9-4fae-b461-95faf6386bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:22.849896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77ee74-95b9-4fae-b461-95faf6386bbf admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:22.850269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77ee74-95b9-4fae-b461-95faf6386bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:22.850615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77ee74-95b9-4fae-b461-95faf6386bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:22.851244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77ee74-95b9-4fae-b461-95faf6386bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:22.854273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77ee74-95b9-4fae-b461-95faf6386bbf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:22.878551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f44b2f-2cef-4c07-bcae-8f966eba24b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aeb3824a7c44868a97e77fd63ada27e, user_id=f9f573bb375149ceb8c6e696e2c9061d, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:22.886673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f44b2f-2cef-4c07-bcae-8f966eba24b3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:22.895058 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1292/2591] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:22 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:22.909011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77ee74-95b9-4fae-b461-95faf6386bbf admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:22.927601 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1300/2592] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:22 2022] PUT /identity/v3/projects/8aeb3824a7c44868a97e77fd63ada27e/users/f9f573bb375149ceb8c6e696e2c9061d/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:22.934583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f44b2f-2cef-4c07-bcae-8f966eba24b3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:23.033857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:23.039694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77ee74-95b9-4fae-b461-95faf6386bbf admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:23.101271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f44b2f-2cef-4c07-bcae-8f966eba24b3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:23.107001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322d392-86c2-4f57-b705-c4daa17936c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:23.107867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322d392-86c2-4f57-b705-c4daa17936c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:23.107985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322d392-86c2-4f57-b705-c4daa17936c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:23.108152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322d392-86c2-4f57-b705-c4daa17936c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:23.108803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322d392-86c2-4f57-b705-c4daa17936c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:23.110447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322d392-86c2-4f57-b705-c4daa17936c1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:23.123134 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1301/2593] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:23.127367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322d392-86c2-4f57-b705-c4daa17936c1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:23.133740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:23.140116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322d392-86c2-4f57-b705-c4daa17936c1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:23.148212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddaa7c-5480-411a-a99d-ac20e09e0ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:23.149256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddaa7c-5480-411a-a99d-ac20e09e0ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:23.149489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddaa7c-5480-411a-a99d-ac20e09e0ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:23.149860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddaa7c-5480-411a-a99d-ac20e09e0ffc admin admin] PATH_INFO: `/v3/projects/8aeb3824a7c44868a97e77fd63ada27e/users/f9f573bb375149ceb8c6e696e2c9061d/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:23.152049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddaa7c-5480-411a-a99d-ac20e09e0ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aeb3824a7c44868a97e77fd63ada27e, user_id=f9f573bb375149ceb8c6e696e2c9061d, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:23.152333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180dbb-84f8-4292-aa66-e458c19491ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:23.152803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180dbb-84f8-4292-aa66-e458c19491ef admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:23.153160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180dbb-84f8-4292-aa66-e458c19491ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:23.153449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180dbb-84f8-4292-aa66-e458c19491ef admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:23.154146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180dbb-84f8-4292-aa66-e458c19491ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:23.155275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddaa7c-5480-411a-a99d-ac20e09e0ffc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:23.156162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180dbb-84f8-4292-aa66-e458c19491ef admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:23.174877 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1302/2594] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:23 2022] PUT /identity/v3/projects/8aeb3824a7c44868a97e77fd63ada27e/users/f9f573bb375149ceb8c6e696e2c9061d/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:23.181253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a0d4d-3353-4a1b-af61-72c29332fd14 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:23.183749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a0d4d-3353-4a1b-af61-72c29332fd14 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:23.184250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a0d4d-3353-4a1b-af61-72c29332fd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:23.204587 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1293/2595] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:22 2022] POST /identity/v3/users => generated 296 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:23.208546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180dbb-84f8-4292-aa66-e458c19491ef admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:23.232470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180dbb-84f8-4292-aa66-e458c19491ef admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:23.240006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-bc3a0d4d-3353-4a1b-af61-72c29332fd14 None None] MFA Rules not processed for user `f9f573bb375149ceb8c6e696e2c9061d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:23.241334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bc3a0d4d-3353-4a1b-af61-72c29332fd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:23.311104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d981146-0857-4f05-8adc-30afc5bdfa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:23.311825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d981146-0857-4f05-8adc-30afc5bdfa20 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:23.312174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d981146-0857-4f05-8adc-30afc5bdfa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:23.312692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d981146-0857-4f05-8adc-30afc5bdfa20 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:23.313249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d981146-0857-4f05-8adc-30afc5bdfa20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:23.315294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d981146-0857-4f05-8adc-30afc5bdfa20 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:23.334158 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1294/2596] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:23.335747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d981146-0857-4f05-8adc-30afc5bdfa20 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:23.348611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d981146-0857-4f05-8adc-30afc5bdfa20 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:23.357513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac64e1-c958-4ad1-a989-1cc59acb7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:23.358299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac64e1-c958-4ad1-a989-1cc59acb7933 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:23.358683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac64e1-c958-4ad1-a989-1cc59acb7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:23.359097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac64e1-c958-4ad1-a989-1cc59acb7933 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:23.360875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac64e1-c958-4ad1-a989-1cc59acb7933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:23.363194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac64e1-c958-4ad1-a989-1cc59acb7933 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:23.364020 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1303/2597] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:23.377837 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1295/2598] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:23.382469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a0d4d-3353-4a1b-af61-72c29332fd14 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:23.394794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a0d4d-3353-4a1b-af61-72c29332fd14 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:23.400840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff63e29-866b-4bc1-842b-6c2ee9ee439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:23.402424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff63e29-866b-4bc1-842b-6c2ee9ee439d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:23.402735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff63e29-866b-4bc1-842b-6c2ee9ee439d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:23.403025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff63e29-866b-4bc1-842b-6c2ee9ee439d admin admin] PATH_INFO: `/v3/projects/29dcbd265c9947f799e8835f0fdf3b41/users/aa1ba12e324d48c3b872f46660272618/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:23.421790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff63e29-866b-4bc1-842b-6c2ee9ee439d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29dcbd265c9947f799e8835f0fdf3b41, user_id=aa1ba12e324d48c3b872f46660272618, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:23.424524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff63e29-866b-4bc1-842b-6c2ee9ee439d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:23.440572 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1304/2599] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:23 2022] PUT /identity/v3/projects/29dcbd265c9947f799e8835f0fdf3b41/users/aa1ba12e324d48c3b872f46660272618/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:23.513401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c770b-eeb7-4785-80ae-b0d7ca93b9c3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:23.513691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c770b-eeb7-4785-80ae-b0d7ca93b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:23.513966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c770b-eeb7-4785-80ae-b0d7ca93b9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:23.546343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-196c770b-eeb7-4785-80ae-b0d7ca93b9c3 None None] MFA Rules not processed for user `aa1ba12e324d48c3b872f46660272618`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:23.548127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-196c770b-eeb7-4785-80ae-b0d7ca93b9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:23.616173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff63e29-866b-4bc1-842b-6c2ee9ee439d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:23.621531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4ff63e29-866b-4bc1-842b-6c2ee9ee439d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:23.659852 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1296/2600] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:23.665221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c770b-eeb7-4785-80ae-b0d7ca93b9c3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:23.678146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:23.729006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff63e29-866b-4bc1-842b-6c2ee9ee439d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:23.736495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02383595-2ba8-4926-944b-44fa6ff2e727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:23.737729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02383595-2ba8-4926-944b-44fa6ff2e727 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:23.738165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02383595-2ba8-4926-944b-44fa6ff2e727 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:23.738598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02383595-2ba8-4926-944b-44fa6ff2e727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:23.761007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c770b-eeb7-4785-80ae-b0d7ca93b9c3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:23.768477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7fa91-926a-4baf-8156-c87a144143c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:23.769258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7fa91-926a-4baf-8156-c87a144143c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:23.769645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7fa91-926a-4baf-8156-c87a144143c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:23.769942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7fa91-926a-4baf-8156-c87a144143c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:23.770598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7fa91-926a-4baf-8156-c87a144143c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:23.773543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7fa91-926a-4baf-8156-c87a144143c5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:23.804233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:23.812572 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1297/2601] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:23 2022] POST /identity/v3/projects => generated 391 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:54:23.814130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7fa91-926a-4baf-8156-c87a144143c5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:23.831402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02383595-2ba8-4926-944b-44fa6ff2e727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:23.833027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02383595-2ba8-4926-944b-44fa6ff2e727 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:23.852744 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1305/2602] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:23.938310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7fa91-926a-4baf-8156-c87a144143c5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:23.945945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b119a56-60af-475d-bb47-15296fc6e0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:23.946588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b119a56-60af-475d-bb47-15296fc6e0bc admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:23.946916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b119a56-60af-475d-bb47-15296fc6e0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:23.947232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b119a56-60af-475d-bb47-15296fc6e0bc admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:23.947851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b119a56-60af-475d-bb47-15296fc6e0bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:23.950853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b119a56-60af-475d-bb47-15296fc6e0bc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:24.014520 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1298/2603] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:23 2022] POST /identity/v3/users => generated 302 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:24.018680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02383595-2ba8-4926-944b-44fa6ff2e727 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:24.034652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02383595-2ba8-4926-944b-44fa6ff2e727 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:24.042656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0281893-62b1-43e0-b528-a38d7a913424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:24.043330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281893-62b1-43e0-b528-a38d7a913424 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:24.043626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281893-62b1-43e0-b528-a38d7a913424 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:24.043882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281893-62b1-43e0-b528-a38d7a913424 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:24.044796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0281893-62b1-43e0-b528-a38d7a913424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:24.047349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0281893-62b1-43e0-b528-a38d7a913424 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:24.063609 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1306/2604] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:24.067705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b119a56-60af-475d-bb47-15296fc6e0bc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:24.081111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b119a56-60af-475d-bb47-15296fc6e0bc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:24.086966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45d020-ee29-4bc1-a973-d20bf9c9556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:24.088119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45d020-ee29-4bc1-a973-d20bf9c9556e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:24.088657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45d020-ee29-4bc1-a973-d20bf9c9556e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:24.089351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45d020-ee29-4bc1-a973-d20bf9c9556e admin admin] PATH_INFO: `/v3/projects/8093498107f946e4a5e228a33e0e18a9/users/d58ad7a18c4a438eb61c2080286641ae/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:24.123670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45d020-ee29-4bc1-a973-d20bf9c9556e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8093498107f946e4a5e228a33e0e18a9, user_id=d58ad7a18c4a438eb61c2080286641ae, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:24.129353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45d020-ee29-4bc1-a973-d20bf9c9556e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:24.153681 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1299/2605] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:24 2022] PUT /identity/v3/projects/8093498107f946e4a5e228a33e0e18a9/users/d58ad7a18c4a438eb61c2080286641ae/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:24.162994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0281893-62b1-43e0-b528-a38d7a913424 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:24.185278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0281893-62b1-43e0-b528-a38d7a913424 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:24.201951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45d020-ee29-4bc1-a973-d20bf9c9556e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:24.304215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f8ffb-8861-4c58-88e1-33bf47119b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:24.313373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:24.319567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f8ffb-8861-4c58-88e1-33bf47119b36 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:24.320012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f8ffb-8861-4c58-88e1-33bf47119b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:24.320304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f8ffb-8861-4c58-88e1-33bf47119b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:24.321037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f8ffb-8861-4c58-88e1-33bf47119b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:24.328536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f8ffb-8861-4c58-88e1-33bf47119b36 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:24.343568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45d020-ee29-4bc1-a973-d20bf9c9556e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:24.345639 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1307/2606] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:24.349566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f8ffb-8861-4c58-88e1-33bf47119b36 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:24.351280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360f334-fc57-4f33-869c-d05b9926869a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:24.351990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360f334-fc57-4f33-869c-d05b9926869a service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:24.352477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360f334-fc57-4f33-869c-d05b9926869a service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:24.352827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360f334-fc57-4f33-869c-d05b9926869a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:24.358200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b360f334-fc57-4f33-869c-d05b9926869a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:24.368581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f8ffb-8861-4c58-88e1-33bf47119b36 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:24.374595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba15256-988d-4015-a0ee-ff1523f5875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:24.375534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba15256-988d-4015-a0ee-ff1523f5875e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:24.375650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba15256-988d-4015-a0ee-ff1523f5875e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:24.375924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba15256-988d-4015-a0ee-ff1523f5875e admin admin] PATH_INFO: `/v3/projects/8093498107f946e4a5e228a33e0e18a9/users/d58ad7a18c4a438eb61c2080286641ae/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:24.378346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba15256-988d-4015-a0ee-ff1523f5875e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8093498107f946e4a5e228a33e0e18a9, user_id=d58ad7a18c4a438eb61c2080286641ae, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:24.387081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba15256-988d-4015-a0ee-ff1523f5875e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:24.423436 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1308/2607] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:24 2022] PUT /identity/v3/projects/8093498107f946e4a5e228a33e0e18a9/users/d58ad7a18c4a438eb61c2080286641ae/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:24.427391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4af7d-e940-4891-9d63-6eacf0b40c0f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:24.428123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4af7d-e940-4891-9d63-6eacf0b40c0f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:24.429141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4af7d-e940-4891-9d63-6eacf0b40c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:24.473466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360f334-fc57-4f33-869c-d05b9926869a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:24.475740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360f334-fc57-4f33-869c-d05b9926869a service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:24.485762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7ee4af7d-e940-4891-9d63-6eacf0b40c0f None None] MFA Rules not processed for user `d58ad7a18c4a438eb61c2080286641ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:24.487264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7ee4af7d-e940-4891-9d63-6eacf0b40c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:24.489283 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1300/2608] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:54:24.619329 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1309/2609] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:24 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:24.634447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360f334-fc57-4f33-869c-d05b9926869a service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:24.649266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360f334-fc57-4f33-869c-d05b9926869a service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:24.783031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b548d0-cb73-4a7d-b63c-6e11ca741f98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:24.783586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b548d0-cb73-4a7d-b63c-6e11ca741f98 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:24.783869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b548d0-cb73-4a7d-b63c-6e11ca741f98 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:24.784252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b548d0-cb73-4a7d-b63c-6e11ca741f98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:24.796101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b548d0-cb73-4a7d-b63c-6e11ca741f98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:24.797978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b548d0-cb73-4a7d-b63c-6e11ca741f98 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:24.811033 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1301/2610] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:24.812571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4af7d-e940-4891-9d63-6eacf0b40c0f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:24.814127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7ee4af7d-e940-4891-9d63-6eacf0b40c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:24.910148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:24.938905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b548d0-cb73-4a7d-b63c-6e11ca741f98 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:24.945853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4af7d-e940-4891-9d63-6eacf0b40c0f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:24.951725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b548d0-cb73-4a7d-b63c-6e11ca741f98 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:24.955006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b377b-9024-4aea-88af-7f591e003486 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:24.956498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b377b-9024-4aea-88af-7f591e003486 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:24.957108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b377b-9024-4aea-88af-7f591e003486 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:24.957398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b377b-9024-4aea-88af-7f591e003486 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:24.959479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944156ed-f8f6-4dd9-b232-1bfcc5192b87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:24.959896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bf8b377b-9024-4aea-88af-7f591e003486 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:24.960445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944156ed-f8f6-4dd9-b232-1bfcc5192b87 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:24.960688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944156ed-f8f6-4dd9-b232-1bfcc5192b87 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:24.961223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944156ed-f8f6-4dd9-b232-1bfcc5192b87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:24.981380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b377b-9024-4aea-88af-7f591e003486 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:24.983284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b377b-9024-4aea-88af-7f591e003486 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:24.998206 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1310/2611] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:25.046237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944156ed-f8f6-4dd9-b232-1bfcc5192b87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:25.048684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944156ed-f8f6-4dd9-b232-1bfcc5192b87 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:25.077502 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1302/2612] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:25.095904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b377b-9024-4aea-88af-7f591e003486 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:25.156993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944156ed-f8f6-4dd9-b232-1bfcc5192b87 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:25.185011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:25.225720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b377b-9024-4aea-88af-7f591e003486 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:25.235384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d12606-eca1-4541-9591-32cb7188eb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:25.236318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d12606-eca1-4541-9591-32cb7188eb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:25.236702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d12606-eca1-4541-9591-32cb7188eb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:25.237165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d12606-eca1-4541-9591-32cb7188eb44 admin admin] PATH_INFO: `/v3/users/aa1ba12e324d48c3b872f46660272618` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:25.238999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944156ed-f8f6-4dd9-b232-1bfcc5192b87 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:25.239484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d12606-eca1-4541-9591-32cb7188eb44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1ba12e324d48c3b872f46660272618)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:25.241900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d12606-eca1-4541-9591-32cb7188eb44 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:25.243900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4302ffd-3fb4-41c4-80b0-43842c2feb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:25.244549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4302ffd-3fb4-41c4-80b0-43842c2feb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:25.245359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4302ffd-3fb4-41c4-80b0-43842c2feb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:25.245776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4302ffd-3fb4-41c4-80b0-43842c2feb05 admin admin] PATH_INFO: `/v3/users/29bfc6d61f5a456b996efc636eea1219` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:25.247830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4302ffd-3fb4-41c4-80b0-43842c2feb05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29bfc6d61f5a456b996efc636eea1219)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:25.250232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4302ffd-3fb4-41c4-80b0-43842c2feb05 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:25.345784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c4302ffd-3fb4-41c4-80b0-43842c2feb05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29bfc6d61f5a456b996efc636eea1219'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:25.351452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-14d12606-eca1-4541-9591-32cb7188eb44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1ba12e324d48c3b872f46660272618'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:25.359578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c4302ffd-3fb4-41c4-80b0-43842c2feb05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29bfc6d61f5a456b996efc636eea1219'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:25.361142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-14d12606-eca1-4541-9591-32cb7188eb44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1ba12e324d48c3b872f46660272618'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:25.361287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c4302ffd-3fb4-41c4-80b0-43842c2feb05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29bfc6d61f5a456b996efc636eea1219'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:25.361902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-14d12606-eca1-4541-9591-32cb7188eb44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1ba12e324d48c3b872f46660272618'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:25.383340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-14d12606-eca1-4541-9591-32cb7188eb44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1ba12e324d48c3b872f46660272618'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:25.384328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-14d12606-eca1-4541-9591-32cb7188eb44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1ba12e324d48c3b872f46660272618'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:25.392813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c4302ffd-3fb4-41c4-80b0-43842c2feb05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29bfc6d61f5a456b996efc636eea1219'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:25.395147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c4302ffd-3fb4-41c4-80b0-43842c2feb05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29bfc6d61f5a456b996efc636eea1219'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:25.422627 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1303/2613] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:25 2022] DELETE /identity/v3/users/29bfc6d61f5a456b996efc636eea1219 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:25.427343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b962e6-e808-4e7c-a8d7-3440f49febff None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:25.427717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b962e6-e808-4e7c-a8d7-3440f49febff None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:25.427998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b962e6-e808-4e7c-a8d7-3440f49febff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:25.446991 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1311/2614] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:25 2022] DELETE /identity/v3/users/aa1ba12e324d48c3b872f46660272618 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:25.446991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53403277-17db-452d-8a41-e365b046a946 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:25.446991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53403277-17db-452d-8a41-e365b046a946 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:25.446991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53403277-17db-452d-8a41-e365b046a946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:25.462330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b7b962e6-e808-4e7c-a8d7-3440f49febff None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:25.463995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-53403277-17db-452d-8a41-e365b046a946 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:25.464215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b7b962e6-e808-4e7c-a8d7-3440f49febff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:25.466171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-53403277-17db-452d-8a41-e365b046a946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:25.536575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:25.549918 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1304/2615] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:25.569092 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1312/2616] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:25.582166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b962e6-e808-4e7c-a8d7-3440f49febff None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:25.584201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b7b962e6-e808-4e7c-a8d7-3440f49febff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:25.589759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53403277-17db-452d-8a41-e365b046a946 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:25.592663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-53403277-17db-452d-8a41-e365b046a946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:25.688483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:25.723959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b962e6-e808-4e7c-a8d7-3440f49febff None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:25.736452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d626f32-4e69-45bc-884b-3af6578e5e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:25.737021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53403277-17db-452d-8a41-e365b046a946 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:25.737573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d626f32-4e69-45bc-884b-3af6578e5e31 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:25.738044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d626f32-4e69-45bc-884b-3af6578e5e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:25.738496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d626f32-4e69-45bc-884b-3af6578e5e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:25.741213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a579909-e609-4e14-be1c-2a10d6819d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:25.742165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a579909-e609-4e14-be1c-2a10d6819d8c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:25.742544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a579909-e609-4e14-be1c-2a10d6819d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:25.743012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a579909-e609-4e14-be1c-2a10d6819d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:25.755197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a579909-e609-4e14-be1c-2a10d6819d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:25.757148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a579909-e609-4e14-be1c-2a10d6819d8c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:25.764688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d626f32-4e69-45bc-884b-3af6578e5e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:25.765831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d626f32-4e69-45bc-884b-3af6578e5e31 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:25.770659 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1313/2617] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:25.789203 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1305/2618] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:26.388804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a579909-e609-4e14-be1c-2a10d6819d8c service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:26.390359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9a579909-e609-4e14-be1c-2a10d6819d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:26.405387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a579909-e609-4e14-be1c-2a10d6819d8c service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:26.431562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:26.432218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:26.433235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:26.433602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] PATH_INFO: `/v3/projects/75af4b62da054adba8b0ecd3d99473f8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:26.434834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=75af4b62da054adba8b0ecd3d99473f8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:26.437142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:26.555994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d626f32-4e69-45bc-884b-3af6578e5e31 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:26.559918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4d626f32-4e69-45bc-884b-3af6578e5e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:26.586020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d626f32-4e69-45bc-884b-3af6578e5e31 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:26.609975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75af4b62da054adba8b0ecd3d99473f8', 'request_id': 'req-f8d6886c-c8c9-42ba-b61d-d632c649a58d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:26.630759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75af4b62da054adba8b0ecd3d99473f8', 'request_id': 'req-f8d6886c-c8c9-42ba-b61d-d632c649a58d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:26.647380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75af4b62da054adba8b0ecd3d99473f8', 'request_id': 'req-f8d6886c-c8c9-42ba-b61d-d632c649a58d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:26.694806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] The token cache is being invalidate because project 75af4b62da054adba8b0ecd3d99473f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:26.696046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:26.699589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:26.715151 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1314/2619] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:26 2022] DELETE /identity/v3/projects/75af4b62da054adba8b0ecd3d99473f8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:26.715151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:26.717684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:26.775547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:26.777088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:26.778947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:26.780250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] PATH_INFO: `/v3/projects/29dcbd265c9947f799e8835f0fdf3b41` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:26.783787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=29dcbd265c9947f799e8835f0fdf3b41)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:26.786179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:26.929593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6886c-c8c9-42ba-b61d-d632c649a58d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:26.950888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29dcbd265c9947f799e8835f0fdf3b41', 'request_id': 'req-c224c4d2-6090-4710-bf8a-69a434632d5b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:26.965732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29dcbd265c9947f799e8835f0fdf3b41', 'request_id': 'req-c224c4d2-6090-4710-bf8a-69a434632d5b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:26.990899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29dcbd265c9947f799e8835f0fdf3b41', 'request_id': 'req-c224c4d2-6090-4710-bf8a-69a434632d5b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:26.999496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:27.025143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] The token cache is being invalidate because project 29dcbd265c9947f799e8835f0fdf3b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:27.025440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.029716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.037363 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1306/2620] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:26 2022] DELETE /identity/v3/projects/29dcbd265c9947f799e8835f0fdf3b41 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:27.038952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:27.040881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:27.155388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bc523-4e73-4c8e-8e3a-c787615c7d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:27.156491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc523-4e73-4c8e-8e3a-c787615c7d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:27.157011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc523-4e73-4c8e-8e3a-c787615c7d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:27.157674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc523-4e73-4c8e-8e3a-c787615c7d06 admin admin] PATH_INFO: `/v3/users/f9f573bb375149ceb8c6e696e2c9061d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:27.159339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bc523-4e73-4c8e-8e3a-c787615c7d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f573bb375149ceb8c6e696e2c9061d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:27.161935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bc523-4e73-4c8e-8e3a-c787615c7d06 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:27.286941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c48bc523-4e73-4c8e-8e3a-c787615c7d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f573bb375149ceb8c6e696e2c9061d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.314164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c48bc523-4e73-4c8e-8e3a-c787615c7d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f573bb375149ceb8c6e696e2c9061d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.316300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c48bc523-4e73-4c8e-8e3a-c787615c7d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f573bb375149ceb8c6e696e2c9061d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.318279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224c4d2-6090-4710-bf8a-69a434632d5b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:27.329649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:27.331265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:27.332654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:27.332978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] PATH_INFO: `/v3/users/d58ad7a18c4a438eb61c2080286641ae` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:27.336805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58ad7a18c4a438eb61c2080286641ae)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:27.338373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c48bc523-4e73-4c8e-8e3a-c787615c7d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f573bb375149ceb8c6e696e2c9061d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.340042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c48bc523-4e73-4c8e-8e3a-c787615c7d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f573bb375149ceb8c6e696e2c9061d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.341978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:27.380991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:27.381296 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1315/2621] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:26 2022] DELETE /identity/v3/users/f9f573bb375149ceb8c6e696e2c9061d => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:27.383185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e493257-fc34-42e5-940d-89fb8bce0ab4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:27.387756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e493257-fc34-42e5-940d-89fb8bce0ab4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:27.387756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e493257-fc34-42e5-940d-89fb8bce0ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:27.449311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5e493257-fc34-42e5-940d-89fb8bce0ab4 None None] MFA Rules not processed for user `3b738496864a4b04bc885b75980e2341`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:27.452334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5e493257-fc34-42e5-940d-89fb8bce0ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:27.479056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58ad7a18c4a438eb61c2080286641ae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.507218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58ad7a18c4a438eb61c2080286641ae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.508797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58ad7a18c4a438eb61c2080286641ae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.534029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58ad7a18c4a438eb61c2080286641ae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.535214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58ad7a18c4a438eb61c2080286641ae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:27.585569 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1307/2622] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:27 2022] DELETE /identity/v3/users/d58ad7a18c4a438eb61c2080286641ae => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:27.630446 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1316/2623] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:28.705742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:28.707572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:28.795247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e493257-fc34-42e5-940d-89fb8bce0ab4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:28.798180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5e493257-fc34-42e5-940d-89fb8bce0ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:28.870582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4597fe-363b-4002-bc0d-56377aefdca6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:28.884093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d39508-5f4d-4e1a-8e09-d844b24e5880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:28.884093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d39508-5f4d-4e1a-8e09-d844b24e5880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:28.884093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d39508-5f4d-4e1a-8e09-d844b24e5880 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:28.884821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d39508-5f4d-4e1a-8e09-d844b24e5880 admin admin] PATH_INFO: `/v3/projects/8093498107f946e4a5e228a33e0e18a9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:28.887494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d39508-5f4d-4e1a-8e09-d844b24e5880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8093498107f946e4a5e228a33e0e18a9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:28.890026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d39508-5f4d-4e1a-8e09-d844b24e5880 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:28.925905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:28.952561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e493257-fc34-42e5-940d-89fb8bce0ab4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:28.966298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2d39508-5f4d-4e1a-8e09-d844b24e5880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8093498107f946e4a5e228a33e0e18a9', 'request_id': 'req-a2d39508-5f4d-4e1a-8e09-d844b24e5880'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:28.987641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2d39508-5f4d-4e1a-8e09-d844b24e5880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8093498107f946e4a5e228a33e0e18a9', 'request_id': 'req-a2d39508-5f4d-4e1a-8e09-d844b24e5880'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.000232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2d39508-5f4d-4e1a-8e09-d844b24e5880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8093498107f946e4a5e228a33e0e18a9', 'request_id': 'req-a2d39508-5f4d-4e1a-8e09-d844b24e5880'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.017557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2d39508-5f4d-4e1a-8e09-d844b24e5880 admin admin] The token cache is being invalidate because project 8093498107f946e4a5e228a33e0e18a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:29.017930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2d39508-5f4d-4e1a-8e09-d844b24e5880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.018587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2d39508-5f4d-4e1a-8e09-d844b24e5880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.020523 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1308/2624] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:28 2022] DELETE /identity/v3/projects/8093498107f946e4a5e228a33e0e18a9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:29.027989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6f46-31ae-4c02-8352-6fbb98582517 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.028384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6f46-31ae-4c02-8352-6fbb98582517 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.028524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a6f46-31ae-4c02-8352-6fbb98582517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.049688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b6cde-4211-412f-b97c-e3a49fd1d336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:29.050982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b6cde-4211-412f-b97c-e3a49fd1d336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.051555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b6cde-4211-412f-b97c-e3a49fd1d336 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.052555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b6cde-4211-412f-b97c-e3a49fd1d336 admin admin] PATH_INFO: `/v3/projects/8aeb3824a7c44868a97e77fd63ada27e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.054410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b6cde-4211-412f-b97c-e3a49fd1d336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aeb3824a7c44868a97e77fd63ada27e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:29.056921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b6cde-4211-412f-b97c-e3a49fd1d336 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:29.058104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-786a6f46-31ae-4c02-8352-6fbb98582517 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:29.068311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-786a6f46-31ae-4c02-8352-6fbb98582517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:29.078838 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1309/2625] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:29.090633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0947c2-c183-499f-8b3e-7f4ffc21ff21 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.090945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0947c2-c183-499f-8b3e-7f4ffc21ff21 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.091698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0947c2-c183-499f-8b3e-7f4ffc21ff21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.168196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3b0947c2-c183-499f-8b3e-7f4ffc21ff21 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:29.169456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3b0947c2-c183-499f-8b3e-7f4ffc21ff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:29.180100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-197b6cde-4211-412f-b97c-e3a49fd1d336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aeb3824a7c44868a97e77fd63ada27e', 'request_id': 'req-197b6cde-4211-412f-b97c-e3a49fd1d336'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.196281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:29.201301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-197b6cde-4211-412f-b97c-e3a49fd1d336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aeb3824a7c44868a97e77fd63ada27e', 'request_id': 'req-197b6cde-4211-412f-b97c-e3a49fd1d336'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.227277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-197b6cde-4211-412f-b97c-e3a49fd1d336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aeb3824a7c44868a97e77fd63ada27e', 'request_id': 'req-197b6cde-4211-412f-b97c-e3a49fd1d336'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.262967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-197b6cde-4211-412f-b97c-e3a49fd1d336 admin admin] The token cache is being invalidate because project 8aeb3824a7c44868a97e77fd63ada27e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:29.262967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-197b6cde-4211-412f-b97c-e3a49fd1d336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.263494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-197b6cde-4211-412f-b97c-e3a49fd1d336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:29.265546 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1317/2626] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:28 2022] DELETE /identity/v3/projects/8aeb3824a7c44868a97e77fd63ada27e => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:29.272638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2955-2f49-417c-8a8a-5cf66fb14890 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.272918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2955-2f49-417c-8a8a-5cf66fb14890 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.273200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2955-2f49-417c-8a8a-5cf66fb14890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.312907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-70fd2955-2f49-417c-8a8a-5cf66fb14890 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:29.315047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-70fd2955-2f49-417c-8a8a-5cf66fb14890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:29.391366 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1310/2627] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:29.403732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0947c2-c183-499f-8b3e-7f4ffc21ff21 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:29.419010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0947c2-c183-499f-8b3e-7f4ffc21ff21 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:29.426395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3768e6-a9ab-4cc6-b237-335e4a1496a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:29.427242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3768e6-a9ab-4cc6-b237-335e4a1496a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.427930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3768e6-a9ab-4cc6-b237-335e4a1496a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.428510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3768e6-a9ab-4cc6-b237-335e4a1496a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.429642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3768e6-a9ab-4cc6-b237-335e4a1496a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:29.430314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3768e6-a9ab-4cc6-b237-335e4a1496a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:29.434500 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1318/2628] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:29.439323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3768e6-a9ab-4cc6-b237-335e4a1496a9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:29.445090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d95ba-f3af-47e9-b7c9-78ef6f622109 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.445788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d95ba-f3af-47e9-b7c9-78ef6f622109 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.446275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d95ba-f3af-47e9-b7c9-78ef6f622109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.465556 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1311/2629] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:54:29.473245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3768e6-a9ab-4cc6-b237-335e4a1496a9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:29.490655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9e8d95ba-f3af-47e9-b7c9-78ef6f622109 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:29.492211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9e8d95ba-f3af-47e9-b7c9-78ef6f622109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:29.502621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3768e6-a9ab-4cc6-b237-335e4a1496a9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:29.503277 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1319/2630] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:29.507297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d95ba-f3af-47e9-b7c9-78ef6f622109 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:29.520380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb48d4b-3121-4a54-8e28-977fbf647c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:29.520706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d95ba-f3af-47e9-b7c9-78ef6f622109 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:29.521025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48d4b-3121-4a54-8e28-977fbf647c71 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.521312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48d4b-3121-4a54-8e28-977fbf647c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.521618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb48d4b-3121-4a54-8e28-977fbf647c71 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.528892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb48d4b-3121-4a54-8e28-977fbf647c71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:29.531771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb48d4b-3121-4a54-8e28-977fbf647c71 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:29.532795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92523b-1c23-43c1-9740-84ce28de6212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:29.533636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92523b-1c23-43c1-9740-84ce28de6212 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.534001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92523b-1c23-43c1-9740-84ce28de6212 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.534205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92523b-1c23-43c1-9740-84ce28de6212 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.535053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92523b-1c23-43c1-9740-84ce28de6212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:29.535361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92523b-1c23-43c1-9740-84ce28de6212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:29.537260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92523b-1c23-43c1-9740-84ce28de6212 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:29.582922 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1320/2631] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:29.583841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92523b-1c23-43c1-9740-84ce28de6212 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:29.596007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92523b-1c23-43c1-9740-84ce28de6212 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:29.598417 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1312/2632] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:29 2022] POST /identity/v3/projects => generated 395 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:29.599337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb48d4b-3121-4a54-8e28-977fbf647c71 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:29.602323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:29.729960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8febb-f945-4878-887e-4bcea0b40c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:29.730675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8febb-f945-4878-887e-4bcea0b40c6b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:29.730892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8febb-f945-4878-887e-4bcea0b40c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:29.731164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8febb-f945-4878-887e-4bcea0b40c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:29.731807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8febb-f945-4878-887e-4bcea0b40c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:29.742501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8febb-f945-4878-887e-4bcea0b40c6b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:29.834241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb48d4b-3121-4a54-8e28-977fbf647c71 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:29.840626 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1321/2633] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:29 2022] POST /identity/v3/projects => generated 369 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:29.841616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8febb-f945-4878-887e-4bcea0b40c6b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.044305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8febb-f945-4878-887e-4bcea0b40c6b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.049175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62eab4-b1b8-4691-b96f-6398bf31a4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.049913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62eab4-b1b8-4691-b96f-6398bf31a4ee admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.050200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62eab4-b1b8-4691-b96f-6398bf31a4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.050478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62eab4-b1b8-4691-b96f-6398bf31a4ee admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.051397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62eab4-b1b8-4691-b96f-6398bf31a4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.054954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62eab4-b1b8-4691-b96f-6398bf31a4ee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.062862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47347015-0248-4374-925d-5a04eacae128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.065776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47347015-0248-4374-925d-5a04eacae128 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.066145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47347015-0248-4374-925d-5a04eacae128 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.066511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47347015-0248-4374-925d-5a04eacae128 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.067279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47347015-0248-4374-925d-5a04eacae128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.073506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47347015-0248-4374-925d-5a04eacae128 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.095906 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1313/2634] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:29 2022] POST /identity/v3/users => generated 298 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:30.101029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62eab4-b1b8-4691-b96f-6398bf31a4ee admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.134944 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1322/2635] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:29 2022] POST /identity/v3/users => generated 285 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:30.139861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62eab4-b1b8-4691-b96f-6398bf31a4ee admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.140223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47347015-0248-4374-925d-5a04eacae128 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.149125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668111-c7ad-4ab9-b9c1-97a6deeb3a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.150173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668111-c7ad-4ab9-b9c1-97a6deeb3a74 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.151821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668111-c7ad-4ab9-b9c1-97a6deeb3a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.152783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668111-c7ad-4ab9-b9c1-97a6deeb3a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.153568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47347015-0248-4374-925d-5a04eacae128 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.154695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10668111-c7ad-4ab9-b9c1-97a6deeb3a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.158597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10668111-c7ad-4ab9-b9c1-97a6deeb3a74 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.163386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac8693-e8a5-4c90-9076-7842213d2d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.164771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac8693-e8a5-4c90-9076-7842213d2d40 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.165287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac8693-e8a5-4c90-9076-7842213d2d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.165857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac8693-e8a5-4c90-9076-7842213d2d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.166911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac8693-e8a5-4c90-9076-7842213d2d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.169375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac8693-e8a5-4c90-9076-7842213d2d40 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.186313 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1323/2636] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:30.187644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac8693-e8a5-4c90-9076-7842213d2d40 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.192145 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1314/2637] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:30.196101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668111-c7ad-4ab9-b9c1-97a6deeb3a74 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.200631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac8693-e8a5-4c90-9076-7842213d2d40 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.206669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c666a-e792-4574-9641-a0bd0724cbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.207517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c666a-e792-4574-9641-a0bd0724cbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.207902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c666a-e792-4574-9641-a0bd0724cbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.208277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c666a-e792-4574-9641-a0bd0724cbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.209201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c666a-e792-4574-9641-a0bd0724cbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.211165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c666a-e792-4574-9641-a0bd0724cbb6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.219695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668111-c7ad-4ab9-b9c1-97a6deeb3a74 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.251116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b0ba8-5440-43ef-ad0b-588c51917233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.252447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b0ba8-5440-43ef-ad0b-588c51917233 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.252939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b0ba8-5440-43ef-ad0b-588c51917233 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.253341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b0ba8-5440-43ef-ad0b-588c51917233 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.254440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b0ba8-5440-43ef-ad0b-588c51917233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.254790 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1324/2638] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:30.256324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b0ba8-5440-43ef-ad0b-588c51917233 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.256706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c666a-e792-4574-9641-a0bd0724cbb6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.257925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:30.283420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c666a-e792-4574-9641-a0bd0724cbb6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.284593 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1315/2639] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:54:30.287232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b0ba8-5440-43ef-ad0b-588c51917233 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.297313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b294c3-3b7a-4ff0-a9cd-7a61c9571cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.298378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b294c3-3b7a-4ff0-a9cd-7a61c9571cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.298915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b294c3-3b7a-4ff0-a9cd-7a61c9571cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.299426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b294c3-3b7a-4ff0-a9cd-7a61c9571cc9 admin admin] PATH_INFO: `/v3/projects/11b9f7d531b84edf8ad146c63f0e7aab/users/53603fbcb723402a88ac193bed705d4d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.302402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b0ba8-5440-43ef-ad0b-588c51917233 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.317416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f14f6-5f1d-4dd5-9672-cca481325f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.318617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f14f6-5f1d-4dd5-9672-cca481325f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.319089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f14f6-5f1d-4dd5-9672-cca481325f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.319581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f14f6-5f1d-4dd5-9672-cca481325f31 admin admin] PATH_INFO: `/v3/projects/55d0fcc0048e4ce3a4b4947c86173c5a/users/e11cd64b58da4d539986dd47e8cf77d3/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.342026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f14f6-5f1d-4dd5-9672-cca481325f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d0fcc0048e4ce3a4b4947c86173c5a, user_id=e11cd64b58da4d539986dd47e8cf77d3, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.346700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f14f6-5f1d-4dd5-9672-cca481325f31 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.369720 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1316/2640] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:30 2022] PUT /identity/v3/projects/55d0fcc0048e4ce3a4b4947c86173c5a/users/e11cd64b58da4d539986dd47e8cf77d3/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:30.374782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b294c3-3b7a-4ff0-a9cd-7a61c9571cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b9f7d531b84edf8ad146c63f0e7aab, user_id=53603fbcb723402a88ac193bed705d4d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.375399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fc772-6be0-4572-974b-e89ec81315ee None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.375700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fc772-6be0-4572-974b-e89ec81315ee None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.376115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fc772-6be0-4572-974b-e89ec81315ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.382895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b294c3-3b7a-4ff0-a9cd-7a61c9571cc9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.412586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4a5fc772-6be0-4572-974b-e89ec81315ee None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:30.413791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4a5fc772-6be0-4572-974b-e89ec81315ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:30.426035 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1325/2641] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:30 2022] PUT /identity/v3/projects/11b9f7d531b84edf8ad146c63f0e7aab/users/53603fbcb723402a88ac193bed705d4d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:30.428025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbaadb-14db-4f81-9841-9f3b14aec451 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.428320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbaadb-14db-4f81-9841-9f3b14aec451 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.428603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbaadb-14db-4f81-9841-9f3b14aec451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.505204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c5cbaadb-14db-4f81-9841-9f3b14aec451 None None] MFA Rules not processed for user `53603fbcb723402a88ac193bed705d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:30.514382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c5cbaadb-14db-4f81-9841-9f3b14aec451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:30.540003 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1317/2642] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:30.543545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fc772-6be0-4572-974b-e89ec81315ee None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.546974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4a5fc772-6be0-4572-974b-e89ec81315ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:30.591109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:30.727275 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1326/2643] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:30.732930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbaadb-14db-4f81-9841-9f3b14aec451 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.735128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fc772-6be0-4572-974b-e89ec81315ee None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.739886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873b3f9-f178-4f50-a06b-ae89b623c541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.740696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873b3f9-f178-4f50-a06b-ae89b623c541 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.740988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873b3f9-f178-4f50-a06b-ae89b623c541 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.741267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873b3f9-f178-4f50-a06b-ae89b623c541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.765775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbaadb-14db-4f81-9841-9f3b14aec451 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.773752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873b3f9-f178-4f50-a06b-ae89b623c541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.774685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873b3f9-f178-4f50-a06b-ae89b623c541 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.787284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1de37-652e-4408-85b8-798ae5f646f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:30.788365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1de37-652e-4408-85b8-798ae5f646f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.788365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1de37-652e-4408-85b8-798ae5f646f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.788751 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1318/2644] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:30.789593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1de37-652e-4408-85b8-798ae5f646f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.791411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1de37-652e-4408-85b8-798ae5f646f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:30.794379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1de37-652e-4408-85b8-798ae5f646f7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:30.840356 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1327/2645] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:30 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:30.844159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873b3f9-f178-4f50-a06b-ae89b623c541 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:30.873838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873b3f9-f178-4f50-a06b-ae89b623c541 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:30.875447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e8220-6619-4a23-b09d-0915927d0d07 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:30.875930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e8220-6619-4a23-b09d-0915927d0d07 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:30.876621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e8220-6619-4a23-b09d-0915927d0d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:30.948492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-332e8220-6619-4a23-b09d-0915927d0d07 None None] MFA Rules not processed for user `5f263343f35e42a49cd4991c1011f412`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:30.951961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-332e8220-6619-4a23-b09d-0915927d0d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:31.021273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980be4e-97e8-4221-bec4-c2f41bb6fca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:31.022261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980be4e-97e8-4221-bec4-c2f41bb6fca8 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.022697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980be4e-97e8-4221-bec4-c2f41bb6fca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.023145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980be4e-97e8-4221-bec4-c2f41bb6fca8 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.023931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980be4e-97e8-4221-bec4-c2f41bb6fca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:31.029741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980be4e-97e8-4221-bec4-c2f41bb6fca8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:31.078708 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1319/2646] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:30 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:31.082650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980be4e-97e8-4221-bec4-c2f41bb6fca8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:31.094271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:31.115720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980be4e-97e8-4221-bec4-c2f41bb6fca8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:31.130840 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1328/2647] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:31.165702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b7663-5ae7-4716-9d02-dcabe1efff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:31.165702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b7663-5ae7-4716-9d02-dcabe1efff43 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.165702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b7663-5ae7-4716-9d02-dcabe1efff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.165702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b7663-5ae7-4716-9d02-dcabe1efff43 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.166261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b7663-5ae7-4716-9d02-dcabe1efff43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:31.166261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b7663-5ae7-4716-9d02-dcabe1efff43 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:31.207564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e8220-6619-4a23-b09d-0915927d0d07 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:31.208590 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1320/2648] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:54:31.210463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1daa9-3a4d-47bc-a7d4-443532cc4906 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.217249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1daa9-3a4d-47bc-a7d4-443532cc4906 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.217566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1daa9-3a4d-47bc-a7d4-443532cc4906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.226165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e8220-6619-4a23-b09d-0915927d0d07 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:31.233416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a6cb6-a772-4711-86b4-cbbdfc64bb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:31.234498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a6cb6-a772-4711-86b4-cbbdfc64bb33 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.235860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a6cb6-a772-4711-86b4-cbbdfc64bb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.236535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a6cb6-a772-4711-86b4-cbbdfc64bb33 admin admin] PATH_INFO: `/v3/projects/7e77521cdfd5455f8d3a374519631605/users/9150df824f284415b74c958bf9cef166/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.272527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a6cb6-a772-4711-86b4-cbbdfc64bb33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e77521cdfd5455f8d3a374519631605, user_id=9150df824f284415b74c958bf9cef166, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:31.272756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9ce1daa9-3a4d-47bc-a7d4-443532cc4906 None None] MFA Rules not processed for user `5f263343f35e42a49cd4991c1011f412`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:31.273924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9ce1daa9-3a4d-47bc-a7d4-443532cc4906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:31.281540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a6cb6-a772-4711-86b4-cbbdfc64bb33 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:31.301724 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1321/2649] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:31.314404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1daa9-3a4d-47bc-a7d4-443532cc4906 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:31.315867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9ce1daa9-3a4d-47bc-a7d4-443532cc4906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:31.317759 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1329/2650] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:31 2022] PUT /identity/v3/projects/7e77521cdfd5455f8d3a374519631605/users/9150df824f284415b74c958bf9cef166/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:31.321591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a6cb6-a772-4711-86b4-cbbdfc64bb33 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:31.453698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a6cb6-a772-4711-86b4-cbbdfc64bb33 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:31.459229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924c298-cb91-432d-86c4-a71154a65d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:31.461611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c298-cb91-432d-86c4-a71154a65d84 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.462086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c298-cb91-432d-86c4-a71154a65d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.462602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c298-cb91-432d-86c4-a71154a65d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.465127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924c298-cb91-432d-86c4-a71154a65d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:31.467252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924c298-cb91-432d-86c4-a71154a65d84 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:31.501912 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1330/2651] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:31.504756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924c298-cb91-432d-86c4-a71154a65d84 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:31.519526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:31.532078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924c298-cb91-432d-86c4-a71154a65d84 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:31.546798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b34ff-1e04-480b-90e6-88032deb6534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:31.547759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b34ff-1e04-480b-90e6-88032deb6534 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.548187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b34ff-1e04-480b-90e6-88032deb6534 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.548607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b34ff-1e04-480b-90e6-88032deb6534 admin admin] PATH_INFO: `/v3/projects/7e77521cdfd5455f8d3a374519631605/users/9150df824f284415b74c958bf9cef166/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.552572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b34ff-1e04-480b-90e6-88032deb6534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e77521cdfd5455f8d3a374519631605, user_id=9150df824f284415b74c958bf9cef166, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:31.558648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b34ff-1e04-480b-90e6-88032deb6534 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:31.559569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1daa9-3a4d-47bc-a7d4-443532cc4906 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:31.593742 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1331/2652] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:31 2022] PUT /identity/v3/projects/7e77521cdfd5455f8d3a374519631605/users/9150df824f284415b74c958bf9cef166/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:31.615790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884c81-422c-443c-8d98-b99da11489ab None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.616259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884c81-422c-443c-8d98-b99da11489ab None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.616537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884c81-422c-443c-8d98-b99da11489ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.662475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5c884c81-422c-443c-8d98-b99da11489ab None None] MFA Rules not processed for user `9150df824f284415b74c958bf9cef166`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:31.663735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5c884c81-422c-443c-8d98-b99da11489ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:31.765511 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1332/2653] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:54:31.794298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520abe3b-8add-4309-9298-390912dd1ada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:31.795030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520abe3b-8add-4309-9298-390912dd1ada service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:31.795318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520abe3b-8add-4309-9298-390912dd1ada service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:31.795594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520abe3b-8add-4309-9298-390912dd1ada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:31.876483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520abe3b-8add-4309-9298-390912dd1ada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:31.878136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520abe3b-8add-4309-9298-390912dd1ada service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:31.904743 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1322/2654] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:54:33.088248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c884c81-422c-443c-8d98-b99da11489ab None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:33.090956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5c884c81-422c-443c-8d98-b99da11489ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:33.203565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c884c81-422c-443c-8d98-b99da11489ab None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:33.212216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdf9dc-4c43-45de-8935-ecb7ad12d4a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:33.212961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf9dc-4c43-45de-8935-ecb7ad12d4a9 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:33.213343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf9dc-4c43-45de-8935-ecb7ad12d4a9 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:33.213692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf9dc-4c43-45de-8935-ecb7ad12d4a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:33.231993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdf9dc-4c43-45de-8935-ecb7ad12d4a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:33.234385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdf9dc-4c43-45de-8935-ecb7ad12d4a9 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:33.269964 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1333/2655] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:33.583183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520abe3b-8add-4309-9298-390912dd1ada service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:33.602255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520abe3b-8add-4309-9298-390912dd1ada service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:33.627632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9bab5-448c-4a5f-8005-7715b4cf6eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:33.629797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9bab5-448c-4a5f-8005-7715b4cf6eac service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:33.631156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9bab5-448c-4a5f-8005-7715b4cf6eac service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:33.631660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9bab5-448c-4a5f-8005-7715b4cf6eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:33.637699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28c9bab5-448c-4a5f-8005-7715b4cf6eac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:33.685783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:33.809887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9bab5-448c-4a5f-8005-7715b4cf6eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:33.814977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9bab5-448c-4a5f-8005-7715b4cf6eac service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:33.863774 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1323/2656] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:35.851627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdf9dc-4c43-45de-8935-ecb7ad12d4a9 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:36.000319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdf9dc-4c43-45de-8935-ecb7ad12d4a9 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:36.007611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:36.008123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:36.008408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:36.008669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] PATH_INFO: `/v3/users/53603fbcb723402a88ac193bed705d4d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:36.012959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53603fbcb723402a88ac193bed705d4d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:36.021597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:36.030473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:36.135675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53603fbcb723402a88ac193bed705d4d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:36.158519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53603fbcb723402a88ac193bed705d4d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:36.161301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53603fbcb723402a88ac193bed705d4d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:36.186935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53603fbcb723402a88ac193bed705d4d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:36.187811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53603fbcb723402a88ac193bed705d4d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:36.212386 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1334/2657] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:35 2022] DELETE /identity/v3/users/53603fbcb723402a88ac193bed705d4d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:36.216914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea9f9d-7b76-4712-9823-6edf651eb33a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:36.217399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea9f9d-7b76-4712-9823-6edf651eb33a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:36.217481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea9f9d-7b76-4712-9823-6edf651eb33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:36.255487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e4ea9f9d-7b76-4712-9823-6edf651eb33a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:36.257375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e4ea9f9d-7b76-4712-9823-6edf651eb33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:36.426896 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1324/2658] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:36.442980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:36.444618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:36.554863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b60166-1a80-4ae2-aac6-39b1657f199b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:36.569059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd180fb7-8954-4e24-bb3b-ef8f9682a96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:36.570902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd180fb7-8954-4e24-bb3b-ef8f9682a96d service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:36.571210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd180fb7-8954-4e24-bb3b-ef8f9682a96d service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:36.572004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd180fb7-8954-4e24-bb3b-ef8f9682a96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:36.602693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd180fb7-8954-4e24-bb3b-ef8f9682a96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:36.605646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd180fb7-8954-4e24-bb3b-ef8f9682a96d service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:36.629556 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1335/2659] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:37.549250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea9f9d-7b76-4712-9823-6edf651eb33a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:37.553110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e4ea9f9d-7b76-4712-9823-6edf651eb33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:37.571786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea9f9d-7b76-4712-9823-6edf651eb33a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:37.580448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:37.590941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:37.593538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:37.595410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] PATH_INFO: `/v3/projects/11b9f7d531b84edf8ad146c63f0e7aab` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:37.599226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b9f7d531b84edf8ad146c63f0e7aab)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:37.602933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:37.699366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b9f7d531b84edf8ad146c63f0e7aab', 'request_id': 'req-bf990b00-9306-47b9-9aea-fe11f3a1f34a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:37.712630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b9f7d531b84edf8ad146c63f0e7aab', 'request_id': 'req-bf990b00-9306-47b9-9aea-fe11f3a1f34a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:37.725340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b9f7d531b84edf8ad146c63f0e7aab', 'request_id': 'req-bf990b00-9306-47b9-9aea-fe11f3a1f34a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:37.742606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] The token cache is being invalidate because project 11b9f7d531b84edf8ad146c63f0e7aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:37.743047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:37.745887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:37.746574 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1325/2660] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:37 2022] DELETE /identity/v3/projects/11b9f7d531b84edf8ad146c63f0e7aab => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:37.750634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd180fb7-8954-4e24-bb3b-ef8f9682a96d service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:37.765033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd180fb7-8954-4e24-bb3b-ef8f9682a96d service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:37.862415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af04b71-26dd-4e48-a9af-444b59d6295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:37.865128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af04b71-26dd-4e48-a9af-444b59d6295f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:37.865670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af04b71-26dd-4e48-a9af-444b59d6295f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:37.866059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af04b71-26dd-4e48-a9af-444b59d6295f admin admin] PATH_INFO: `/v3/users/9150df824f284415b74c958bf9cef166` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:37.875877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af04b71-26dd-4e48-a9af-444b59d6295f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9150df824f284415b74c958bf9cef166)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:37.878050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af04b71-26dd-4e48-a9af-444b59d6295f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:37.948585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:37.998398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8af04b71-26dd-4e48-a9af-444b59d6295f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9150df824f284415b74c958bf9cef166'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:38.016594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8af04b71-26dd-4e48-a9af-444b59d6295f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9150df824f284415b74c958bf9cef166'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:38.018463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8af04b71-26dd-4e48-a9af-444b59d6295f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9150df824f284415b74c958bf9cef166'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:38.037175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8af04b71-26dd-4e48-a9af-444b59d6295f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9150df824f284415b74c958bf9cef166'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:38.039033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8af04b71-26dd-4e48-a9af-444b59d6295f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9150df824f284415b74c958bf9cef166'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:38.098795 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1336/2661] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:54:37 2022] DELETE /identity/v3/users/9150df824f284415b74c958bf9cef166 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:39.037192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:39.038699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:39.053301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf990b00-9306-47b9-9aea-fe11f3a1f34a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:39.148359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:39.179027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:39.179876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.180169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.180456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe admin admin] PATH_INFO: `/v3/projects/7e77521cdfd5455f8d3a374519631605` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.181658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e77521cdfd5455f8d3a374519631605)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:39.184460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:39.315024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e77521cdfd5455f8d3a374519631605', 'request_id': 'req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.330915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e77521cdfd5455f8d3a374519631605', 'request_id': 'req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.342243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e77521cdfd5455f8d3a374519631605', 'request_id': 'req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.363633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe admin admin] The token cache is being invalidate because project 7e77521cdfd5455f8d3a374519631605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:54:39.364221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.365075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6b3be0e6-b1f0-46f7-8c0a-0df037dd88fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:54:39.370550 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1326/2662] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:54:39 2022] DELETE /identity/v3/projects/7e77521cdfd5455f8d3a374519631605 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:39.372371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b040b30-030e-483d-a7b0-431c0723cc7c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.372835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b040b30-030e-483d-a7b0-431c0723cc7c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.372954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b040b30-030e-483d-a7b0-431c0723cc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.399682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1b040b30-030e-483d-a7b0-431c0723cc7c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:39.402013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1b040b30-030e-483d-a7b0-431c0723cc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:39.426060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2315329-cd35-4026-9c33-1cb1d7d052b3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.426345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2315329-cd35-4026-9c33-1cb1d7d052b3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.426702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2315329-cd35-4026-9c33-1cb1d7d052b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.464110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f2315329-cd35-4026-9c33-1cb1d7d052b3 None None] MFA Rules not processed for user `e11cd64b58da4d539986dd47e8cf77d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:39.465602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f2315329-cd35-4026-9c33-1cb1d7d052b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:39.488991 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1337/2663] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:39.500513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be339a0-5f52-44db-8657-815dbf4d3727 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.500802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be339a0-5f52-44db-8657-815dbf4d3727 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.501269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be339a0-5f52-44db-8657-815dbf4d3727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.525622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2be339a0-5f52-44db-8657-815dbf4d3727 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:39.527345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2be339a0-5f52-44db-8657-815dbf4d3727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:39.542342 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1338/2664] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:39.543622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be339a0-5f52-44db-8657-815dbf4d3727 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:39.553391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be339a0-5f52-44db-8657-815dbf4d3727 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:39.561420 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1327/2665] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:39.563170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d4df2-c77f-4754-b2f2-75e6ee4b8700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:39.564010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d4df2-c77f-4754-b2f2-75e6ee4b8700 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.564429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d4df2-c77f-4754-b2f2-75e6ee4b8700 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.564835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d4df2-c77f-4754-b2f2-75e6ee4b8700 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.565627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d4df2-c77f-4754-b2f2-75e6ee4b8700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:54:39.566081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d4df2-c77f-4754-b2f2-75e6ee4b8700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:39.568627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d4df2-c77f-4754-b2f2-75e6ee4b8700 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:39.573119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcdd0f-93f1-4535-9f52-288eb77a7493 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.573453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcdd0f-93f1-4535-9f52-288eb77a7493 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.573876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcdd0f-93f1-4535-9f52-288eb77a7493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.585081 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1339/2666] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:54:39.590032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d4df2-c77f-4754-b2f2-75e6ee4b8700 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:39.601335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d4df2-c77f-4754-b2f2-75e6ee4b8700 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:39.605756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d8fcdd0f-93f1-4535-9f52-288eb77a7493 None None] MFA Rules not processed for user `e11cd64b58da4d539986dd47e8cf77d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:39.607313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d8fcdd0f-93f1-4535-9f52-288eb77a7493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:39.607635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9296ab-611d-434a-9e48-b788fedca944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:39.608344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9296ab-611d-434a-9e48-b788fedca944 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.608854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9296ab-611d-434a-9e48-b788fedca944 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.609508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9296ab-611d-434a-9e48-b788fedca944 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.610367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9296ab-611d-434a-9e48-b788fedca944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:39.612656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9296ab-611d-434a-9e48-b788fedca944 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:39.617584 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1328/2667] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:39.629805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcdd0f-93f1-4535-9f52-288eb77a7493 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:39.631286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d8fcdd0f-93f1-4535-9f52-288eb77a7493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:39.653097 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1340/2668] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:39 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:39.657534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9296ab-611d-434a-9e48-b788fedca944 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:39.706253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:39.735721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcdd0f-93f1-4535-9f52-288eb77a7493 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:39.754118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9296ab-611d-434a-9e48-b788fedca944 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:39.759061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea72a5-fd80-4731-8f4d-aee3cb32e3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:39.759677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea72a5-fd80-4731-8f4d-aee3cb32e3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.759993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea72a5-fd80-4731-8f4d-aee3cb32e3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.760780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea72a5-fd80-4731-8f4d-aee3cb32e3a4 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.761409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea72a5-fd80-4731-8f4d-aee3cb32e3a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:39.763405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea72a5-fd80-4731-8f4d-aee3cb32e3a4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:39.772664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:39.792754 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1341/2669] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:39 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:39.797875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea72a5-fd80-4731-8f4d-aee3cb32e3a4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:39.812050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea72a5-fd80-4731-8f4d-aee3cb32e3a4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:39.817149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6ea0b-7f3f-443e-b5fc-39ace2b402a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:39.818115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6ea0b-7f3f-443e-b5fc-39ace2b402a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.818397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6ea0b-7f3f-443e-b5fc-39ace2b402a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.818670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6ea0b-7f3f-443e-b5fc-39ace2b402a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.819359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6ea0b-7f3f-443e-b5fc-39ace2b402a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:39.820971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6ea0b-7f3f-443e-b5fc-39ace2b402a0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:39.835082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574463f-ac94-431c-9cdb-807d5bb652fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:39.836000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574463f-ac94-431c-9cdb-807d5bb652fb service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.836537 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1342/2670] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:54:39.838998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574463f-ac94-431c-9cdb-807d5bb652fb service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.839520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574463f-ac94-431c-9cdb-807d5bb652fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.841603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6ea0b-7f3f-443e-b5fc-39ace2b402a0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:39.853055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6ea0b-7f3f-443e-b5fc-39ace2b402a0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:39.859131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132e31e-dcb9-4573-9395-978a8059e49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:39.859847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132e31e-dcb9-4573-9395-978a8059e49a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.860200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132e31e-dcb9-4573-9395-978a8059e49a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.861254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132e31e-dcb9-4573-9395-978a8059e49a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.861254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132e31e-dcb9-4573-9395-978a8059e49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:39.862965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132e31e-dcb9-4573-9395-978a8059e49a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:39.878801 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1343/2671] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:39.881014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132e31e-dcb9-4573-9395-978a8059e49a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:39.891492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132e31e-dcb9-4573-9395-978a8059e49a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:39.896458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b75ec-d3c4-4439-aff4-6ecd1635b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:39.897258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b75ec-d3c4-4439-aff4-6ecd1635b88f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.897684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b75ec-d3c4-4439-aff4-6ecd1635b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.898056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b75ec-d3c4-4439-aff4-6ecd1635b88f admin admin] PATH_INFO: `/v3/projects/97155fa05bd54cdba8f7d3cd850eea60/users/c596f795fe394f5a9b3b0054eded0d4b/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:39.914892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574463f-ac94-431c-9cdb-807d5bb652fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:39.918498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574463f-ac94-431c-9cdb-807d5bb652fb service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:39.919249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b75ec-d3c4-4439-aff4-6ecd1635b88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=97155fa05bd54cdba8f7d3cd850eea60, user_id=c596f795fe394f5a9b3b0054eded0d4b, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:39.922183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b75ec-d3c4-4439-aff4-6ecd1635b88f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:39.931106 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1329/2672] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:39 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:54:39.938827 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1344/2673] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:39 2022] PUT /identity/v3/projects/97155fa05bd54cdba8f7d3cd850eea60/users/c596f795fe394f5a9b3b0054eded0d4b/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:39.950912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b59fa-f9ba-4744-8ba4-4d06506c27a6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:39.951553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b59fa-f9ba-4744-8ba4-4d06506c27a6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:39.953267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b59fa-f9ba-4744-8ba4-4d06506c27a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:40.016832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ed5b59fa-f9ba-4744-8ba4-4d06506c27a6 None None] MFA Rules not processed for user `c596f795fe394f5a9b3b0054eded0d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:40.020350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ed5b59fa-f9ba-4744-8ba4-4d06506c27a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:40.100767 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1330/2674] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:40.106196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b75ec-d3c4-4439-aff4-6ecd1635b88f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:40.205607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b75ec-d3c4-4439-aff4-6ecd1635b88f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:40.211285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a4ec9-c592-4292-a41f-b36bbfefc0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:40.212013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4ec9-c592-4292-a41f-b36bbfefc0cf admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:40.212530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4ec9-c592-4292-a41f-b36bbfefc0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:40.212807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4ec9-c592-4292-a41f-b36bbfefc0cf admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:40.213569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a4ec9-c592-4292-a41f-b36bbfefc0cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:40.216901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a4ec9-c592-4292-a41f-b36bbfefc0cf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:40.254466 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1345/2675] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:54:40 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:54:40.258426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b59fa-f9ba-4744-8ba4-4d06506c27a6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:40.274654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b59fa-f9ba-4744-8ba4-4d06506c27a6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:40.290459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:40.346248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16659a-45f9-483d-b575-bfb15d5bc3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:40.346962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16659a-45f9-483d-b575-bfb15d5bc3cc admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:40.347258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16659a-45f9-483d-b575-bfb15d5bc3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:40.347545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16659a-45f9-483d-b575-bfb15d5bc3cc admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:40.348232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16659a-45f9-483d-b575-bfb15d5bc3cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:40.350388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16659a-45f9-483d-b575-bfb15d5bc3cc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:40.381045 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1331/2676] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:54:40 2022] POST /identity/v3/users => generated 300 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:54:40.384929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a4ec9-c592-4292-a41f-b36bbfefc0cf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:40.399048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a4ec9-c592-4292-a41f-b36bbfefc0cf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:40.407265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae04bb-b65c-46e3-a211-f5a04b9ace5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:40.408186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae04bb-b65c-46e3-a211-f5a04b9ace5c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:40.408486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae04bb-b65c-46e3-a211-f5a04b9ace5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:40.408888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae04bb-b65c-46e3-a211-f5a04b9ace5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:40.409863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae04bb-b65c-46e3-a211-f5a04b9ace5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:40.413471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae04bb-b65c-46e3-a211-f5a04b9ace5c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:40.447577 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1346/2677] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:40.451499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16659a-45f9-483d-b575-bfb15d5bc3cc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:40.462348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16659a-45f9-483d-b575-bfb15d5bc3cc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:40.468516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56c165-db0e-4629-b3c0-7de01bc2e1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:40.469393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56c165-db0e-4629-b3c0-7de01bc2e1a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:40.472335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56c165-db0e-4629-b3c0-7de01bc2e1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:40.472335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56c165-db0e-4629-b3c0-7de01bc2e1a2 admin admin] PATH_INFO: `/v3/projects/ee4613d9c2a046c0a68eef5eeb27b45e/users/1de43a45e1264129a1dd2e167c322d71/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:40.498490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56c165-db0e-4629-b3c0-7de01bc2e1a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee4613d9c2a046c0a68eef5eeb27b45e, user_id=1de43a45e1264129a1dd2e167c322d71, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:40.503138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56c165-db0e-4629-b3c0-7de01bc2e1a2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:40.535118 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1332/2678] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:40 2022] PUT /identity/v3/projects/ee4613d9c2a046c0a68eef5eeb27b45e/users/1de43a45e1264129a1dd2e167c322d71/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:54:40.539667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae04bb-b65c-46e3-a211-f5a04b9ace5c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:40.551613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae04bb-b65c-46e3-a211-f5a04b9ace5c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:40.646099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0f3ab-3a6d-4590-83f7-cc892720bc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:40.646915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0f3ab-3a6d-4590-83f7-cc892720bc15 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:40.647301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0f3ab-3a6d-4590-83f7-cc892720bc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:40.647684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0f3ab-3a6d-4590-83f7-cc892720bc15 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:40.648453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0f3ab-3a6d-4590-83f7-cc892720bc15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:40.650269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0f3ab-3a6d-4590-83f7-cc892720bc15 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:40.663589 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1347/2679] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:54:40.668058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56c165-db0e-4629-b3c0-7de01bc2e1a2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:40.678628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56c165-db0e-4629-b3c0-7de01bc2e1a2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:40.684409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aae432-0866-4fc7-97e6-3d83d87f9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:40.685091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aae432-0866-4fc7-97e6-3d83d87f9f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:40.685376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aae432-0866-4fc7-97e6-3d83d87f9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:40.685655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aae432-0866-4fc7-97e6-3d83d87f9f4f admin admin] PATH_INFO: `/v3/projects/ee4613d9c2a046c0a68eef5eeb27b45e/users/1de43a45e1264129a1dd2e167c322d71/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:40.688035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aae432-0866-4fc7-97e6-3d83d87f9f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee4613d9c2a046c0a68eef5eeb27b45e, user_id=1de43a45e1264129a1dd2e167c322d71, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:40.690909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aae432-0866-4fc7-97e6-3d83d87f9f4f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:40.705900 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1333/2680] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:54:40 2022] PUT /identity/v3/projects/ee4613d9c2a046c0a68eef5eeb27b45e/users/1de43a45e1264129a1dd2e167c322d71/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:54:40.716189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f05c17-76c0-4ed8-b880-1114f93f1718 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:40.716378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f05c17-76c0-4ed8-b880-1114f93f1718 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:40.716657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f05c17-76c0-4ed8-b880-1114f93f1718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:40.772000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-27f05c17-76c0-4ed8-b880-1114f93f1718 None None] MFA Rules not processed for user `1de43a45e1264129a1dd2e167c322d71`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:40.774378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-27f05c17-76c0-4ed8-b880-1114f93f1718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:40.782621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:40.929443 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1348/2681] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:40.931259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a64dd-7269-4401-9bb1-80e9e03f3eca None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:40.932638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a64dd-7269-4401-9bb1-80e9e03f3eca None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:40.932638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a64dd-7269-4401-9bb1-80e9e03f3eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:40.955797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d52a64dd-7269-4401-9bb1-80e9e03f3eca None None] MFA Rules not processed for user `c596f795fe394f5a9b3b0054eded0d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:54:40.957359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d52a64dd-7269-4401-9bb1-80e9e03f3eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:41.083378 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1334/2682] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:54:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:54:41.284090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f05c17-76c0-4ed8-b880-1114f93f1718 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:41.436885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f05c17-76c0-4ed8-b880-1114f93f1718 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:41.445581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708822fd-ef0f-43a6-ba5c-91a78e730395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:41.446482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708822fd-ef0f-43a6-ba5c-91a78e730395 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:41.447257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708822fd-ef0f-43a6-ba5c-91a78e730395 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:41.448575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708822fd-ef0f-43a6-ba5c-91a78e730395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:41.464424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708822fd-ef0f-43a6-ba5c-91a78e730395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:41.474037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708822fd-ef0f-43a6-ba5c-91a78e730395 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:41.488939 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1349/2683] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:54:51.066400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=61,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:51.481400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=61 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:54:59.662772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a64dd-7269-4401-9bb1-80e9e03f3eca None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:54:59.664285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d52a64dd-7269-4401-9bb1-80e9e03f3eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:54:59.693997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a64dd-7269-4401-9bb1-80e9e03f3eca None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:54:59.709366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8bdd8-8d41-4b4b-9854-fcf5a4ba8026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:54:59.711143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8bdd8-8d41-4b4b-9854-fcf5a4ba8026 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:54:59.713496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8bdd8-8d41-4b4b-9854-fcf5a4ba8026 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:54:59.714145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8bdd8-8d41-4b4b-9854-fcf5a4ba8026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:54:59.743019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8bdd8-8d41-4b4b-9854-fcf5a4ba8026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:54:59.745366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8bdd8-8d41-4b4b-9854-fcf5a4ba8026 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:54:59.794956 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1335/2684] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:54:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:00.213881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c212a-cb3c-454c-ad77-3963e4a00865 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:00.215599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c212a-cb3c-454c-ad77-3963e4a00865 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:00.216237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c212a-cb3c-454c-ad77-3963e4a00865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:00.264712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f68c212a-cb3c-454c-ad77-3963e4a00865 None None] MFA Rules not processed for user `c596f795fe394f5a9b3b0054eded0d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:00.270776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f68c212a-cb3c-454c-ad77-3963e4a00865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:00.306801 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1350/2685] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:01.855638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2ac09-9bca-446b-9f84-78c041fc2a3a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:01.856196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2ac09-9bca-446b-9f84-78c041fc2a3a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:01.856640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2ac09-9bca-446b-9f84-78c041fc2a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:01.882533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b0c2ac09-9bca-446b-9f84-78c041fc2a3a None None] MFA Rules not processed for user `b05e0387a6b84cdb9b1b59dae6281802`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:01.883867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b0c2ac09-9bca-446b-9f84-78c041fc2a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:01.964412 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1336/2686] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:10.234172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:11.649222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3401c82-8806-4d78-b439-33177d70c9ac None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:11.651212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3401c82-8806-4d78-b439-33177d70c9ac None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:11.651665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3401c82-8806-4d78-b439-33177d70c9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:11.696128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f3401c82-8806-4d78-b439-33177d70c9ac None None] MFA Rules not processed for user `e11cd64b58da4d539986dd47e8cf77d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:11.701645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f3401c82-8806-4d78-b439-33177d70c9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:11.825000 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1351/2687] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:11 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:11.956897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=31 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:12.198994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2ac09-9bca-446b-9f84-78c041fc2a3a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:12.201759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b0c2ac09-9bca-446b-9f84-78c041fc2a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:12.308563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2ac09-9bca-446b-9f84-78c041fc2a3a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:12.315598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:12.316597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:12.317143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:12.317653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] PATH_INFO: `/v3/users/5f263343f35e42a49cd4991c1011f412` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:12.319080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f263343f35e42a49cd4991c1011f412)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:12.323140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:12.404234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f263343f35e42a49cd4991c1011f412'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:12.425777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f263343f35e42a49cd4991c1011f412'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:12.427660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f263343f35e42a49cd4991c1011f412'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:12.464318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f263343f35e42a49cd4991c1011f412'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:12.465376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f263343f35e42a49cd4991c1011f412'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:12.485612 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1337/2688] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:12 2022] DELETE /identity/v3/users/5f263343f35e42a49cd4991c1011f412 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:14.159413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3401c82-8806-4d78-b439-33177d70c9ac None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:14.186597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3401c82-8806-4d78-b439-33177d70c9ac None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:14.284255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a24967-af9c-4ded-922c-47350eb3e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:14.285307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a24967-af9c-4ded-922c-47350eb3e29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:14.295309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a24967-af9c-4ded-922c-47350eb3e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:14.295612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a24967-af9c-4ded-922c-47350eb3e29e admin admin] PATH_INFO: `/v3/projects/0ea2056822224e538256f6c7af973496` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:14.297870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a24967-af9c-4ded-922c-47350eb3e29e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea2056822224e538256f6c7af973496)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:14.300420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a24967-af9c-4ded-922c-47350eb3e29e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:14.511943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c5a24967-af9c-4ded-922c-47350eb3e29e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea2056822224e538256f6c7af973496', 'request_id': 'req-c5a24967-af9c-4ded-922c-47350eb3e29e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:14.539186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c5a24967-af9c-4ded-922c-47350eb3e29e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea2056822224e538256f6c7af973496', 'request_id': 'req-c5a24967-af9c-4ded-922c-47350eb3e29e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:14.567933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:14.569274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c5a24967-af9c-4ded-922c-47350eb3e29e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea2056822224e538256f6c7af973496', 'request_id': 'req-c5a24967-af9c-4ded-922c-47350eb3e29e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:14.587326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:14.608535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c5a24967-af9c-4ded-922c-47350eb3e29e admin admin] The token cache is being invalidate because project 0ea2056822224e538256f6c7af973496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:14.608823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c5a24967-af9c-4ded-922c-47350eb3e29e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:14.609647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c5a24967-af9c-4ded-922c-47350eb3e29e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:14.615554 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1352/2689] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:14 2022] DELETE /identity/v3/projects/0ea2056822224e538256f6c7af973496 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:14.619361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b77c0f-293a-41d7-a397-bf8f057a71c7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:14.646613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4894e75-1bbf-423b-a6e6-10b0e5188bb2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:14.647148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4894e75-1bbf-423b-a6e6-10b0e5188bb2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:14.648346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4894e75-1bbf-423b-a6e6-10b0e5188bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:14.718562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e4894e75-1bbf-423b-a6e6-10b0e5188bb2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:14.722004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e4894e75-1bbf-423b-a6e6-10b0e5188bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:14.773406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4724b1-a518-49ab-9bd5-60365f299849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:14.775695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4724b1-a518-49ab-9bd5-60365f299849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:14.776143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4724b1-a518-49ab-9bd5-60365f299849 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:14.776429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4724b1-a518-49ab-9bd5-60365f299849 admin admin] PATH_INFO: `/v3/users/20d7f3a28ac042b0830aec3c51d64849` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:14.779148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4724b1-a518-49ab-9bd5-60365f299849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d7f3a28ac042b0830aec3c51d64849)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:14.784842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4724b1-a518-49ab-9bd5-60365f299849 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:14.816639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:14.840263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:14.888206 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1353/2690] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:14.894016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007aa809-e772-4941-92f9-dd352c838505 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:14.895266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007aa809-e772-4941-92f9-dd352c838505 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:14.896724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007aa809-e772-4941-92f9-dd352c838505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:14.924967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9a4724b1-a518-49ab-9bd5-60365f299849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d7f3a28ac042b0830aec3c51d64849'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:14.929283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-007aa809-e772-4941-92f9-dd352c838505 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:14.931922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-007aa809-e772-4941-92f9-dd352c838505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:14.939458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9a4724b1-a518-49ab-9bd5-60365f299849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d7f3a28ac042b0830aec3c51d64849'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:14.940525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9a4724b1-a518-49ab-9bd5-60365f299849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d7f3a28ac042b0830aec3c51d64849'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:14.948125 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1354/2691] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:14.951622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007aa809-e772-4941-92f9-dd352c838505 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:14.962704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9a4724b1-a518-49ab-9bd5-60365f299849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d7f3a28ac042b0830aec3c51d64849'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:14.963868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9a4724b1-a518-49ab-9bd5-60365f299849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d7f3a28ac042b0830aec3c51d64849'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:14.970321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007aa809-e772-4941-92f9-dd352c838505 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:14.978682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa287be1-a890-4bdb-a46f-1ccb969c3391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:14.979641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa287be1-a890-4bdb-a46f-1ccb969c3391 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:14.980215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa287be1-a890-4bdb-a46f-1ccb969c3391 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:14.980749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa287be1-a890-4bdb-a46f-1ccb969c3391 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:14.981791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa287be1-a890-4bdb-a46f-1ccb969c3391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:14.982290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa287be1-a890-4bdb-a46f-1ccb969c3391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:14.983446 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1338/2692] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:14 2022] DELETE /identity/v3/users/20d7f3a28ac042b0830aec3c51d64849 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:14.984948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa287be1-a890-4bdb-a46f-1ccb969c3391 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:14.988810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93f46b-d731-4de7-aefe-d222b69bcdd0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:14.989389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93f46b-d731-4de7-aefe-d222b69bcdd0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:14.989867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93f46b-d731-4de7-aefe-d222b69bcdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:15.002893 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1355/2693] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:15.004770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa287be1-a890-4bdb-a46f-1ccb969c3391 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:15.009506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aa287be1-a890-4bdb-a46f-1ccb969c3391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:15.023280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-af93f46b-d731-4de7-aefe-d222b69bcdd0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:15.026072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-af93f46b-d731-4de7-aefe-d222b69bcdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:15.030603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa287be1-a890-4bdb-a46f-1ccb969c3391 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:15.138017 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1339/2694] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:15.140440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ac65-3602-47aa-a5f7-5aa1abb18a2f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:15.140832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ac65-3602-47aa-a5f7-5aa1abb18a2f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:15.141538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ac65-3602-47aa-a5f7-5aa1abb18a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:15.163072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43adc50-e041-4653-8d31-d02c5447aa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:15.163974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43adc50-e041-4653-8d31-d02c5447aa72 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:15.165028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43adc50-e041-4653-8d31-d02c5447aa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:15.166146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43adc50-e041-4653-8d31-d02c5447aa72 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:15.168472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43adc50-e041-4653-8d31-d02c5447aa72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:15.171765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43adc50-e041-4653-8d31-d02c5447aa72 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:15.173544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-60a7ac65-3602-47aa-a5f7-5aa1abb18a2f None None] MFA Rules not processed for user `3b738496864a4b04bc885b75980e2341`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:15.175330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-60a7ac65-3602-47aa-a5f7-5aa1abb18a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:15.255311 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1356/2695] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:15 2022] POST /identity/v3/projects => generated 399 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:15.259526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43adc50-e041-4653-8d31-d02c5447aa72 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:15.276443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b43adc50-e041-4653-8d31-d02c5447aa72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:15.293118 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1340/2696] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:15.294407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7ac65-3602-47aa-a5f7-5aa1abb18a2f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:15.309793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7ac65-3602-47aa-a5f7-5aa1abb18a2f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:15.406470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43adc50-e041-4653-8d31-d02c5447aa72 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:15.413813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176c39d-2b1f-45cf-84b5-bc6169b7fe93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:15.415086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176c39d-2b1f-45cf-84b5-bc6169b7fe93 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:15.416192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176c39d-2b1f-45cf-84b5-bc6169b7fe93 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:15.416652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176c39d-2b1f-45cf-84b5-bc6169b7fe93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:15.431952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:15.470491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6582fe-0425-4184-81ff-9da17bb411dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:15.471238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6582fe-0425-4184-81ff-9da17bb411dd admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:15.471716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6582fe-0425-4184-81ff-9da17bb411dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:15.472683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6582fe-0425-4184-81ff-9da17bb411dd admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:15.476002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6582fe-0425-4184-81ff-9da17bb411dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:15.479393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6582fe-0425-4184-81ff-9da17bb411dd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:15.507671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:15.532539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176c39d-2b1f-45cf-84b5-bc6169b7fe93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:15.534442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176c39d-2b1f-45cf-84b5-bc6169b7fe93 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:15.543933 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1341/2697] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:15 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:15.544908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6582fe-0425-4184-81ff-9da17bb411dd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:15.547746 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1357/2698] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:15.557044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6582fe-0425-4184-81ff-9da17bb411dd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:15.567805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f44c1e-0256-44fe-92bf-15a72cd70596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:15.568432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f44c1e-0256-44fe-92bf-15a72cd70596 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:15.569008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f44c1e-0256-44fe-92bf-15a72cd70596 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:15.569008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f44c1e-0256-44fe-92bf-15a72cd70596 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:15.569674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f44c1e-0256-44fe-92bf-15a72cd70596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:15.572023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f44c1e-0256-44fe-92bf-15a72cd70596 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:15.597571 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1342/2699] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:15.601624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176c39d-2b1f-45cf-84b5-bc6169b7fe93 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:15.620583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176c39d-2b1f-45cf-84b5-bc6169b7fe93 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:15.630941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b27c70-7ba8-4780-b1ca-84f8290d6969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:15.631725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27c70-7ba8-4780-b1ca-84f8290d6969 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:15.631981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27c70-7ba8-4780-b1ca-84f8290d6969 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:15.632257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b27c70-7ba8-4780-b1ca-84f8290d6969 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:15.633420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b27c70-7ba8-4780-b1ca-84f8290d6969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:15.635212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b27c70-7ba8-4780-b1ca-84f8290d6969 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:15.646784 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1358/2700] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:15.651359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f44c1e-0256-44fe-92bf-15a72cd70596 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:15.661960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f44c1e-0256-44fe-92bf-15a72cd70596 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:15.668092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00aa4f2-ae56-4e17-9de0-371149a9f97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:15.668673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00aa4f2-ae56-4e17-9de0-371149a9f97c admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:15.668951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00aa4f2-ae56-4e17-9de0-371149a9f97c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:15.669228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00aa4f2-ae56-4e17-9de0-371149a9f97c admin admin] PATH_INFO: `/v3/projects/056db27589c84317a79c4426d8e8436a/users/102d38fe9024425e951b363a86012209/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:15.687076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00aa4f2-ae56-4e17-9de0-371149a9f97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=056db27589c84317a79c4426d8e8436a, user_id=102d38fe9024425e951b363a86012209, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:15.689803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00aa4f2-ae56-4e17-9de0-371149a9f97c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:15.714459 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1343/2701] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:15 2022] PUT /identity/v3/projects/056db27589c84317a79c4426d8e8436a/users/102d38fe9024425e951b363a86012209/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:15.719919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67430-30b5-4745-8d9f-1293fcb15dec None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:15.720278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67430-30b5-4745-8d9f-1293fcb15dec None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:15.720618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67430-30b5-4745-8d9f-1293fcb15dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:15.742986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1ca67430-30b5-4745-8d9f-1293fcb15dec None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:15.745720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1ca67430-30b5-4745-8d9f-1293fcb15dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:15.824877 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1359/2702] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:15.851465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00aa4f2-ae56-4e17-9de0-371149a9f97c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:15.853795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c00aa4f2-ae56-4e17-9de0-371149a9f97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:15.933486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00aa4f2-ae56-4e17-9de0-371149a9f97c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:15.937489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec5231-4957-4f5a-8a98-0f60c4cded57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:15.938398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec5231-4957-4f5a-8a98-0f60c4cded57 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:15.938941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec5231-4957-4f5a-8a98-0f60c4cded57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:15.939311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec5231-4957-4f5a-8a98-0f60c4cded57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:15.954058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec5231-4957-4f5a-8a98-0f60c4cded57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:15.955539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec5231-4957-4f5a-8a98-0f60c4cded57 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:15.968778 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1344/2703] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:16.420104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca67430-30b5-4745-8d9f-1293fcb15dec None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:16.421997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1ca67430-30b5-4745-8d9f-1293fcb15dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:16.439974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca67430-30b5-4745-8d9f-1293fcb15dec None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:16.448996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:16.450126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:16.450645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:16.451232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] PATH_INFO: `/v3/projects/6fd866b4069e4bc7b6aae5b52a41b8fc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:16.453726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd866b4069e4bc7b6aae5b52a41b8fc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:16.457958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:16.548647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd866b4069e4bc7b6aae5b52a41b8fc', 'request_id': 'req-e51bf983-14a4-42a9-b20c-a60357a91040'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:16.561724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd866b4069e4bc7b6aae5b52a41b8fc', 'request_id': 'req-e51bf983-14a4-42a9-b20c-a60357a91040'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:16.578316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd866b4069e4bc7b6aae5b52a41b8fc', 'request_id': 'req-e51bf983-14a4-42a9-b20c-a60357a91040'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:16.624175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] The token cache is being invalidate because project 6fd866b4069e4bc7b6aae5b52a41b8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:16.624600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:16.625422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:16.630239 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1360/2704] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:16 2022] DELETE /identity/v3/projects/6fd866b4069e4bc7b6aae5b52a41b8fc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:16.631814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec5231-4957-4f5a-8a98-0f60c4cded57 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:16.648013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec5231-4957-4f5a-8a98-0f60c4cded57 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:16.775434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beffa91-25ba-4042-bca1-ab7984c4e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:16.776155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beffa91-25ba-4042-bca1-ab7984c4e932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:16.778857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beffa91-25ba-4042-bca1-ab7984c4e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:16.779166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beffa91-25ba-4042-bca1-ab7984c4e932 admin admin] PATH_INFO: `/v3/users/33d56d8d987b438fb2bfaf9a7a93a378` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:16.785670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beffa91-25ba-4042-bca1-ab7984c4e932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d56d8d987b438fb2bfaf9a7a93a378)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:16.787898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beffa91-25ba-4042-bca1-ab7984c4e932 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:16.985506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:17.007542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0beffa91-25ba-4042-bca1-ab7984c4e932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d56d8d987b438fb2bfaf9a7a93a378'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:17.037825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0beffa91-25ba-4042-bca1-ab7984c4e932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d56d8d987b438fb2bfaf9a7a93a378'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:17.039046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0beffa91-25ba-4042-bca1-ab7984c4e932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d56d8d987b438fb2bfaf9a7a93a378'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:17.056652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0beffa91-25ba-4042-bca1-ab7984c4e932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d56d8d987b438fb2bfaf9a7a93a378'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:17.057418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0beffa91-25ba-4042-bca1-ab7984c4e932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d56d8d987b438fb2bfaf9a7a93a378'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:17.089991 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1345/2705] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:16 2022] DELETE /identity/v3/users/33d56d8d987b438fb2bfaf9a7a93a378 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:18.348043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:18.350019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:18.374047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf983-14a4-42a9-b20c-a60357a91040 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:18.476018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc490d-e073-444f-8cc9-005caba07061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:18.478720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc490d-e073-444f-8cc9-005caba07061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:18.480290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc490d-e073-444f-8cc9-005caba07061 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:18.480786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc490d-e073-444f-8cc9-005caba07061 admin admin] PATH_INFO: `/v3/projects/e80e9d576d744773b91bb5d30f69b8d9` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:18.482459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc490d-e073-444f-8cc9-005caba07061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80e9d576d744773b91bb5d30f69b8d9)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:18.484937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc490d-e073-444f-8cc9-005caba07061 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:18.517516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:18.694311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3fc490d-e073-444f-8cc9-005caba07061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80e9d576d744773b91bb5d30f69b8d9', 'request_id': 'req-d3fc490d-e073-444f-8cc9-005caba07061'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:18.712409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3fc490d-e073-444f-8cc9-005caba07061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80e9d576d744773b91bb5d30f69b8d9', 'request_id': 'req-d3fc490d-e073-444f-8cc9-005caba07061'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:18.728638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3fc490d-e073-444f-8cc9-005caba07061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80e9d576d744773b91bb5d30f69b8d9', 'request_id': 'req-d3fc490d-e073-444f-8cc9-005caba07061'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:18.768951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3fc490d-e073-444f-8cc9-005caba07061 admin admin] The token cache is being invalidate because project e80e9d576d744773b91bb5d30f69b8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:18.769420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3fc490d-e073-444f-8cc9-005caba07061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:18.771779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3fc490d-e073-444f-8cc9-005caba07061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:18.779066 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1361/2706] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:18 2022] DELETE /identity/v3/projects/e80e9d576d744773b91bb5d30f69b8d9 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:18.784766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33f7ee-51c3-4f55-b737-bd42711c6e36 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:18.785537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33f7ee-51c3-4f55-b737-bd42711c6e36 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:18.785655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33f7ee-51c3-4f55-b737-bd42711c6e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:18.828685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-eb33f7ee-51c3-4f55-b737-bd42711c6e36 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:18.829968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eb33f7ee-51c3-4f55-b737-bd42711c6e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:18.969457 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1346/2707] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:18.979801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a4d6a-aa7f-4d63-a2be-468da58d3ed7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:18.980211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a4d6a-aa7f-4d63-a2be-468da58d3ed7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:18.980726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a4d6a-aa7f-4d63-a2be-468da58d3ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:19.049259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-215a4d6a-aa7f-4d63-a2be-468da58d3ed7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:19.051381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-215a4d6a-aa7f-4d63-a2be-468da58d3ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:19.080496 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1362/2708] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:19.081940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33f7ee-51c3-4f55-b737-bd42711c6e36 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:19.099461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33f7ee-51c3-4f55-b737-bd42711c6e36 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:19.114000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765b780-eef8-4f6e-bc66-4e4b97288d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:19.114653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765b780-eef8-4f6e-bc66-4e4b97288d13 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:19.114964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765b780-eef8-4f6e-bc66-4e4b97288d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:19.115242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765b780-eef8-4f6e-bc66-4e4b97288d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:19.120761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765b780-eef8-4f6e-bc66-4e4b97288d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:19.121079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765b780-eef8-4f6e-bc66-4e4b97288d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:19.126308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765b780-eef8-4f6e-bc66-4e4b97288d13 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:19.182571 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1347/2709] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:19.187715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a4d6a-aa7f-4d63-a2be-468da58d3ed7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:19.205811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a4d6a-aa7f-4d63-a2be-468da58d3ed7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:19.223438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2543b8-343b-4989-b55b-a6bd315c31cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:19.224072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2543b8-343b-4989-b55b-a6bd315c31cb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:19.224358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2543b8-343b-4989-b55b-a6bd315c31cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:19.224633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2543b8-343b-4989-b55b-a6bd315c31cb admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:19.225287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2543b8-343b-4989-b55b-a6bd315c31cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:19.227264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2543b8-343b-4989-b55b-a6bd315c31cb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:19.292728 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1363/2710] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:19 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:19.297486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765b780-eef8-4f6e-bc66-4e4b97288d13 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:19.337534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765b780-eef8-4f6e-bc66-4e4b97288d13 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:19.474996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43fc7c-58f0-48ac-81b0-02d04966284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:19.475879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43fc7c-58f0-48ac-81b0-02d04966284c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:19.476229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43fc7c-58f0-48ac-81b0-02d04966284c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:19.476568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43fc7c-58f0-48ac-81b0-02d04966284c admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:19.477897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43fc7c-58f0-48ac-81b0-02d04966284c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:19.481399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43fc7c-58f0-48ac-81b0-02d04966284c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:19.520725 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1348/2711] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:19 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:19.521529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2543b8-343b-4989-b55b-a6bd315c31cb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:19.539246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2543b8-343b-4989-b55b-a6bd315c31cb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:19.546532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a5f03-ef89-469e-a8b2-817254492e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:19.548139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a5f03-ef89-469e-a8b2-817254492e90 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:19.548599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a5f03-ef89-469e-a8b2-817254492e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:19.549040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a5f03-ef89-469e-a8b2-817254492e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:19.549885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a5f03-ef89-469e-a8b2-817254492e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:19.551993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a5f03-ef89-469e-a8b2-817254492e90 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:19.600081 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1364/2712] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:55:19.600464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43fc7c-58f0-48ac-81b0-02d04966284c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:19.630632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43fc7c-58f0-48ac-81b0-02d04966284c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:19.646023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b5e17-8a74-467e-a587-d8ef30069e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:19.648338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b5e17-8a74-467e-a587-d8ef30069e19 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:19.648338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b5e17-8a74-467e-a587-d8ef30069e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:19.648338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b5e17-8a74-467e-a587-d8ef30069e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:19.648688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b5e17-8a74-467e-a587-d8ef30069e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:19.657872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b5e17-8a74-467e-a587-d8ef30069e19 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:19.677182 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1349/2713] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:55:19.681204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a5f03-ef89-469e-a8b2-817254492e90 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:19.694275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a5f03-ef89-469e-a8b2-817254492e90 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:19.701173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5896ff5-70ca-43fd-8d9e-1f813d99939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:19.701844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5896ff5-70ca-43fd-8d9e-1f813d99939f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:19.702130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5896ff5-70ca-43fd-8d9e-1f813d99939f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:19.702405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5896ff5-70ca-43fd-8d9e-1f813d99939f admin admin] PATH_INFO: `/v3/projects/fcbb3c3cc4d64bcba74f4e258e1abbda/users/d9214e808a314352ac9cd5715ea62e16/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:19.728552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5896ff5-70ca-43fd-8d9e-1f813d99939f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbb3c3cc4d64bcba74f4e258e1abbda, user_id=d9214e808a314352ac9cd5715ea62e16, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:19.733376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5896ff5-70ca-43fd-8d9e-1f813d99939f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:19.770515 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1365/2714] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:19 2022] PUT /identity/v3/projects/fcbb3c3cc4d64bcba74f4e258e1abbda/users/d9214e808a314352ac9cd5715ea62e16/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:19.783504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8140cb-af83-4868-8373-599c8fe06f75 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:19.784087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8140cb-af83-4868-8373-599c8fe06f75 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:19.784553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8140cb-af83-4868-8373-599c8fe06f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:19.861373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9e8140cb-af83-4868-8373-599c8fe06f75 None None] MFA Rules not processed for user `d9214e808a314352ac9cd5715ea62e16`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:19.863145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9e8140cb-af83-4868-8373-599c8fe06f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:19.894937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:20.027639 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1350/2715] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:20.252734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5896ff5-70ca-43fd-8d9e-1f813d99939f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:20.254575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c5896ff5-70ca-43fd-8d9e-1f813d99939f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:20.490924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5896ff5-70ca-43fd-8d9e-1f813d99939f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:20.502846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4eacdf-a7e3-4a44-a3b2-9fcecff4e3f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:20.504353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4eacdf-a7e3-4a44-a3b2-9fcecff4e3f9 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:20.505972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4eacdf-a7e3-4a44-a3b2-9fcecff4e3f9 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:20.506284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4eacdf-a7e3-4a44-a3b2-9fcecff4e3f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:20.519539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4eacdf-a7e3-4a44-a3b2-9fcecff4e3f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:20.521279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4eacdf-a7e3-4a44-a3b2-9fcecff4e3f9 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:20.544617 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1366/2716] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:21.411712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8140cb-af83-4868-8373-599c8fe06f75 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:21.415882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9e8140cb-af83-4868-8373-599c8fe06f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:21.599547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8140cb-af83-4868-8373-599c8fe06f75 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:21.611571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa60212-4931-491d-bbd1-09c7f27a6e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:21.612471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa60212-4931-491d-bbd1-09c7f27a6e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:21.612941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa60212-4931-491d-bbd1-09c7f27a6e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:21.624341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa60212-4931-491d-bbd1-09c7f27a6e34 admin admin] PATH_INFO: `/v3/users/181f661f98964045b1f474672ca42bc1` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:21.625880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa60212-4931-491d-bbd1-09c7f27a6e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=181f661f98964045b1f474672ca42bc1)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:21.628759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa60212-4931-491d-bbd1-09c7f27a6e34 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:21.751084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4aa60212-4931-491d-bbd1-09c7f27a6e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181f661f98964045b1f474672ca42bc1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:21.760402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4aa60212-4931-491d-bbd1-09c7f27a6e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181f661f98964045b1f474672ca42bc1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:21.761318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4aa60212-4931-491d-bbd1-09c7f27a6e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181f661f98964045b1f474672ca42bc1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:21.778727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4aa60212-4931-491d-bbd1-09c7f27a6e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181f661f98964045b1f474672ca42bc1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:21.779793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4aa60212-4931-491d-bbd1-09c7f27a6e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181f661f98964045b1f474672ca42bc1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:21.802255 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1351/2717] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:21 2022] DELETE /identity/v3/users/181f661f98964045b1f474672ca42bc1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:23.251662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4eacdf-a7e3-4a44-a3b2-9fcecff4e3f9 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:23.269680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4eacdf-a7e3-4a44-a3b2-9fcecff4e3f9 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:23.294396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:23.373458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:23.374115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:23.374399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:23.374674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] PATH_INFO: `/v3/users/d9214e808a314352ac9cd5715ea62e16` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:23.376351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9214e808a314352ac9cd5715ea62e16)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:23.378346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:23.435261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9214e808a314352ac9cd5715ea62e16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:23.442350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9214e808a314352ac9cd5715ea62e16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:23.443270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9214e808a314352ac9cd5715ea62e16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:23.453318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9214e808a314352ac9cd5715ea62e16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:23.454287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9214e808a314352ac9cd5715ea62e16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:23.473878 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1367/2718] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:23 2022] DELETE /identity/v3/users/d9214e808a314352ac9cd5715ea62e16 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:23.478557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49c8d4-fcef-44b7-a504-ebde6981b420 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:23.479123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49c8d4-fcef-44b7-a504-ebde6981b420 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:23.479376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49c8d4-fcef-44b7-a504-ebde6981b420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:23.503435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6d49c8d4-fcef-44b7-a504-ebde6981b420 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:23.504725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6d49c8d4-fcef-44b7-a504-ebde6981b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:23.572359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:23.618380 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1352/2719] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:23.634764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:23.645567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:23.746554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730357d-bf36-4baf-b7b0-b7dd59f075d4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:23.751613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61293-a683-436b-a5ec-6e441e6ba317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:23.752245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61293-a683-436b-a5ec-6e441e6ba317 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:23.752532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61293-a683-436b-a5ec-6e441e6ba317 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:23.752802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61293-a683-436b-a5ec-6e441e6ba317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:23.766545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab61293-a683-436b-a5ec-6e441e6ba317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:23.768077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab61293-a683-436b-a5ec-6e441e6ba317 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:23.779455 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1368/2720] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:23.828681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49c8d4-fcef-44b7-a504-ebde6981b420 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:23.830172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6d49c8d4-fcef-44b7-a504-ebde6981b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:23.849004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49c8d4-fcef-44b7-a504-ebde6981b420 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:23.856596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:23.858111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:23.858111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:23.858347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] PATH_INFO: `/v3/projects/94d7ad68e2f148ce8bb0a8de63a7897f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:23.860410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d7ad68e2f148ce8bb0a8de63a7897f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:23.874393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:23.961241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d7ad68e2f148ce8bb0a8de63a7897f', 'request_id': 'req-0a00b043-d5e3-4b36-ac92-864942584a89'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:23.973286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d7ad68e2f148ce8bb0a8de63a7897f', 'request_id': 'req-0a00b043-d5e3-4b36-ac92-864942584a89'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:23.983966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d7ad68e2f148ce8bb0a8de63a7897f', 'request_id': 'req-0a00b043-d5e3-4b36-ac92-864942584a89'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.030861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] The token cache is being invalidate because project 94d7ad68e2f148ce8bb0a8de63a7897f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:24.031321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.032342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.040438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61293-a683-436b-a5ec-6e441e6ba317 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:24.042843 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1353/2721] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:23 2022] DELETE /identity/v3/projects/94d7ad68e2f148ce8bb0a8de63a7897f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:24.069497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61293-a683-436b-a5ec-6e441e6ba317 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:24.136431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:24.184631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a7ef4-0fbb-4561-831a-33f058edc35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:24.185859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a7ef4-0fbb-4561-831a-33f058edc35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:24.186455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a7ef4-0fbb-4561-831a-33f058edc35e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:24.186455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a7ef4-0fbb-4561-831a-33f058edc35e admin admin] PATH_INFO: `/v3/users/15c131563ffb47228810fc96d37732a7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:24.188878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a7ef4-0fbb-4561-831a-33f058edc35e admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c131563ffb47228810fc96d37732a7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:24.200145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a7ef4-0fbb-4561-831a-33f058edc35e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:24.284212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:24.285990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:24.307718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9f7a7ef4-0fbb-4561-831a-33f058edc35e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c131563ffb47228810fc96d37732a7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.317223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00b043-d5e3-4b36-ac92-864942584a89 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:24.324783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f90c2-cc60-425a-a84b-26349e63f581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:24.326001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f90c2-cc60-425a-a84b-26349e63f581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:24.326480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f90c2-cc60-425a-a84b-26349e63f581 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:24.326859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f90c2-cc60-425a-a84b-26349e63f581 admin admin] PATH_INFO: `/v3/projects/fcbb3c3cc4d64bcba74f4e258e1abbda` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:24.328072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f90c2-cc60-425a-a84b-26349e63f581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbb3c3cc4d64bcba74f4e258e1abbda)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:24.331445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f90c2-cc60-425a-a84b-26349e63f581 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:24.343765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9f7a7ef4-0fbb-4561-831a-33f058edc35e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c131563ffb47228810fc96d37732a7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.345788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9f7a7ef4-0fbb-4561-831a-33f058edc35e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c131563ffb47228810fc96d37732a7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.360030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9f7a7ef4-0fbb-4561-831a-33f058edc35e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c131563ffb47228810fc96d37732a7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.362516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9f7a7ef4-0fbb-4561-831a-33f058edc35e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c131563ffb47228810fc96d37732a7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.395688 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1369/2722] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:24 2022] DELETE /identity/v3/users/15c131563ffb47228810fc96d37732a7 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:24.427354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-800f90c2-cc60-425a-a84b-26349e63f581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbb3c3cc4d64bcba74f4e258e1abbda', 'request_id': 'req-800f90c2-cc60-425a-a84b-26349e63f581'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.439214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-800f90c2-cc60-425a-a84b-26349e63f581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbb3c3cc4d64bcba74f4e258e1abbda', 'request_id': 'req-800f90c2-cc60-425a-a84b-26349e63f581'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.456046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-800f90c2-cc60-425a-a84b-26349e63f581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbb3c3cc4d64bcba74f4e258e1abbda', 'request_id': 'req-800f90c2-cc60-425a-a84b-26349e63f581'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.474965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-800f90c2-cc60-425a-a84b-26349e63f581 admin admin] The token cache is being invalidate because project fcbb3c3cc4d64bcba74f4e258e1abbda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:24.475296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-800f90c2-cc60-425a-a84b-26349e63f581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.475940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-800f90c2-cc60-425a-a84b-26349e63f581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.477795 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1354/2723] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:24 2022] DELETE /identity/v3/projects/fcbb3c3cc4d64bcba74f4e258e1abbda => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:24.483096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731bdeb-255d-4f60-9a05-67fbaaa2605c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:24.483385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731bdeb-255d-4f60-9a05-67fbaaa2605c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:24.483893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731bdeb-255d-4f60-9a05-67fbaaa2605c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:24.512436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9731bdeb-255d-4f60-9a05-67fbaaa2605c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:24.514579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9731bdeb-255d-4f60-9a05-67fbaaa2605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:24.612703 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1370/2724] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:24.623326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3820c9-a642-4149-92b9-8d6e987e3364 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:24.624222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3820c9-a642-4149-92b9-8d6e987e3364 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:24.624222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3820c9-a642-4149-92b9-8d6e987e3364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:24.655562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fc3820c9-a642-4149-92b9-8d6e987e3364 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:24.657527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fc3820c9-a642-4149-92b9-8d6e987e3364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:24.663437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731bdeb-255d-4f60-9a05-67fbaaa2605c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:24.669384 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1355/2725] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:24.673527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3820c9-a642-4149-92b9-8d6e987e3364 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:24.673926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9731bdeb-255d-4f60-9a05-67fbaaa2605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:24.686012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3820c9-a642-4149-92b9-8d6e987e3364 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:24.688561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731bdeb-255d-4f60-9a05-67fbaaa2605c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:24.691579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda68c8-9012-4675-8bee-1963cc14f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:24.692425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda68c8-9012-4675-8bee-1963cc14f932 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:24.692917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda68c8-9012-4675-8bee-1963cc14f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:24.693363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda68c8-9012-4675-8bee-1963cc14f932 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:24.694857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda68c8-9012-4675-8bee-1963cc14f932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:24.695219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda68c8-9012-4675-8bee-1963cc14f932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:24.697091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b256b09-45c0-4048-ad3f-efc4bd74f542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:24.697911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b256b09-45c0-4048-ad3f-efc4bd74f542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:24.698017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda68c8-9012-4675-8bee-1963cc14f932 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:24.698196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b256b09-45c0-4048-ad3f-efc4bd74f542 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:24.698420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b256b09-45c0-4048-ad3f-efc4bd74f542 admin admin] PATH_INFO: `/v3/projects/c8dc09198ebf4ec99e6daef78baaa586` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:24.699837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b256b09-45c0-4048-ad3f-efc4bd74f542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8dc09198ebf4ec99e6daef78baaa586)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:24.701866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b256b09-45c0-4048-ad3f-efc4bd74f542 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:24.719950 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1356/2726] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:24.721470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda68c8-9012-4675-8bee-1963cc14f932 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:24.735121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda68c8-9012-4675-8bee-1963cc14f932 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:24.745239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb7251-e03c-430a-9ab9-ff3108b859b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:24.746804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb7251-e03c-430a-9ab9-ff3108b859b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:24.746804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb7251-e03c-430a-9ab9-ff3108b859b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:24.747267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb7251-e03c-430a-9ab9-ff3108b859b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:24.748350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb7251-e03c-430a-9ab9-ff3108b859b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:24.750788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb7251-e03c-430a-9ab9-ff3108b859b0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:24.787088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6b256b09-45c0-4048-ad3f-efc4bd74f542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8dc09198ebf4ec99e6daef78baaa586', 'request_id': 'req-6b256b09-45c0-4048-ad3f-efc4bd74f542'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.790358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:24.791374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:24.799126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6b256b09-45c0-4048-ad3f-efc4bd74f542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8dc09198ebf4ec99e6daef78baaa586', 'request_id': 'req-6b256b09-45c0-4048-ad3f-efc4bd74f542'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.802118 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1357/2727] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:24 2022] POST /identity/v3/projects => generated 413 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:55:24.807479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb7251-e03c-430a-9ab9-ff3108b859b0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:24.815228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6b256b09-45c0-4048-ad3f-efc4bd74f542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8dc09198ebf4ec99e6daef78baaa586', 'request_id': 'req-6b256b09-45c0-4048-ad3f-efc4bd74f542'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.845014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6b256b09-45c0-4048-ad3f-efc4bd74f542 admin admin] The token cache is being invalidate because project c8dc09198ebf4ec99e6daef78baaa586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:24.846033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6b256b09-45c0-4048-ad3f-efc4bd74f542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.847215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6b256b09-45c0-4048-ad3f-efc4bd74f542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:24.850057 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1371/2728] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:24 2022] DELETE /identity/v3/projects/c8dc09198ebf4ec99e6daef78baaa586 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:24.856405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790b96e-3053-4bd1-bfdc-b999549c897e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:24.856941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790b96e-3053-4bd1-bfdc-b999549c897e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:24.857447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790b96e-3053-4bd1-bfdc-b999549c897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:24.896723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4790b96e-3053-4bd1-bfdc-b999549c897e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:24.898346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4790b96e-3053-4bd1-bfdc-b999549c897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:24.944126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb7251-e03c-430a-9ab9-ff3108b859b0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:24.951406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bca907-2570-4270-9a8c-6ca94b10cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:24.952308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bca907-2570-4270-9a8c-6ca94b10cdcc admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:24.953659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bca907-2570-4270-9a8c-6ca94b10cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:24.953659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bca907-2570-4270-9a8c-6ca94b10cdcc admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:24.953659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bca907-2570-4270-9a8c-6ca94b10cdcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:24.955605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bca907-2570-4270-9a8c-6ca94b10cdcc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:24.987351 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1358/2729] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:24 2022] POST /identity/v3/users => generated 307 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:24.988509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bca907-2570-4270-9a8c-6ca94b10cdcc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:24.991721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b3bca907-2570-4270-9a8c-6ca94b10cdcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:24.997511 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1372/2730] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:25.006568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034d79e-f21f-4d95-a0c9-5599cf3b9bfb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.006955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034d79e-f21f-4d95-a0c9-5599cf3b9bfb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.007056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034d79e-f21f-4d95-a0c9-5599cf3b9bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.013973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bca907-2570-4270-9a8c-6ca94b10cdcc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:25.020957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f0633-be1b-47a4-bd22-7fc396fc0bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:25.021886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f0633-be1b-47a4-bd22-7fc396fc0bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.022310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f0633-be1b-47a4-bd22-7fc396fc0bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.022725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f0633-be1b-47a4-bd22-7fc396fc0bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.023764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f0633-be1b-47a4-bd22-7fc396fc0bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:25.026573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f0633-be1b-47a4-bd22-7fc396fc0bd5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:25.030434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d034d79e-f21f-4d95-a0c9-5599cf3b9bfb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:25.031753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d034d79e-f21f-4d95-a0c9-5599cf3b9bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:25.044512 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1359/2731] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:25.045647 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1373/2732] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:25.046443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f0633-be1b-47a4-bd22-7fc396fc0bd5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:25.047142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034d79e-f21f-4d95-a0c9-5599cf3b9bfb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:25.058549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f0633-be1b-47a4-bd22-7fc396fc0bd5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:25.060657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034d79e-f21f-4d95-a0c9-5599cf3b9bfb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:25.064680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf0f5a-10e6-45c4-bd5a-1a4df40a9aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:25.064991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf0f5a-10e6-45c4-bd5a-1a4df40a9aaf admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.065305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf0f5a-10e6-45c4-bd5a-1a4df40a9aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.065531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf0f5a-10e6-45c4-bd5a-1a4df40a9aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.066117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5acc2-c8fe-4eba-97e0-0c2ed4d4ebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:25.066241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf0f5a-10e6-45c4-bd5a-1a4df40a9aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:25.066763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5acc2-c8fe-4eba-97e0-0c2ed4d4ebab admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.067414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5acc2-c8fe-4eba-97e0-0c2ed4d4ebab admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.067414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5acc2-c8fe-4eba-97e0-0c2ed4d4ebab admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.068004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5acc2-c8fe-4eba-97e0-0c2ed4d4ebab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:25.068116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf0f5a-10e6-45c4-bd5a-1a4df40a9aaf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:25.068314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5acc2-c8fe-4eba-97e0-0c2ed4d4ebab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:25.071846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5acc2-c8fe-4eba-97e0-0c2ed4d4ebab admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:25.083270 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1360/2733] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:25.088632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf0f5a-10e6-45c4-bd5a-1a4df40a9aaf admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:25.089084 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1374/2734] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:25.092791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5acc2-c8fe-4eba-97e0-0c2ed4d4ebab admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:25.103862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf0f5a-10e6-45c4-bd5a-1a4df40a9aaf admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:25.106093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5acc2-c8fe-4eba-97e0-0c2ed4d4ebab admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:25.109249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4659c-fb98-4314-95eb-055ede9fd2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:25.109844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4659c-fb98-4314-95eb-055ede9fd2d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.110120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4659c-fb98-4314-95eb-055ede9fd2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.110403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4659c-fb98-4314-95eb-055ede9fd2d5 admin admin] PATH_INFO: `/v3/projects/256d73676f094adba353bef4cdda536a/users/143cd5206a5f40e28b8b6e6cef408826/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.111478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28a8da-3abc-4476-b8fd-447adfce75c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:25.112275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28a8da-3abc-4476-b8fd-447adfce75c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.112512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28a8da-3abc-4476-b8fd-447adfce75c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.113133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28a8da-3abc-4476-b8fd-447adfce75c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.113567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28a8da-3abc-4476-b8fd-447adfce75c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:25.118774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28a8da-3abc-4476-b8fd-447adfce75c8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:25.139605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4659c-fb98-4314-95eb-055ede9fd2d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256d73676f094adba353bef4cdda536a, user_id=143cd5206a5f40e28b8b6e6cef408826, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:25.142768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4659c-fb98-4314-95eb-055ede9fd2d5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:25.154392 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1375/2735] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:25 2022] POST /identity/v3/projects => generated 393 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:25.158391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28a8da-3abc-4476-b8fd-447adfce75c8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:25.166144 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1361/2736] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:25 2022] PUT /identity/v3/projects/256d73676f094adba353bef4cdda536a/users/143cd5206a5f40e28b8b6e6cef408826/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:25.172326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe4f5f-3253-4ca7-b8f5-8ee6536ab677 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.172682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe4f5f-3253-4ca7-b8f5-8ee6536ab677 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.172892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe4f5f-3253-4ca7-b8f5-8ee6536ab677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.199339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4bfe4f5f-3253-4ca7-b8f5-8ee6536ab677 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:25.200718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4bfe4f5f-3253-4ca7-b8f5-8ee6536ab677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:25.275203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28a8da-3abc-4476-b8fd-447adfce75c8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:25.292917 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1362/2737] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:25.306675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe4f5f-3253-4ca7-b8f5-8ee6536ab677 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:25.309014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4bfe4f5f-3253-4ca7-b8f5-8ee6536ab677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:25.341474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:25.361239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd228525-1065-42fd-8619-2ceb860f5e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:25.361969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd228525-1065-42fd-8619-2ceb860f5e85 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.362727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd228525-1065-42fd-8619-2ceb860f5e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.363620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd228525-1065-42fd-8619-2ceb860f5e85 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.364913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd228525-1065-42fd-8619-2ceb860f5e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:25.367643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd228525-1065-42fd-8619-2ceb860f5e85 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:25.388021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:25.402357 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1376/2738] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:25 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:55:25.404014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd228525-1065-42fd-8619-2ceb860f5e85 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:25.408132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe4f5f-3253-4ca7-b8f5-8ee6536ab677 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:25.413412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71858d0-bcb9-4a8d-804f-b0e44218e2ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:25.413412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71858d0-bcb9-4a8d-804f-b0e44218e2ba service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.413412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71858d0-bcb9-4a8d-804f-b0e44218e2ba service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.413774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71858d0-bcb9-4a8d-804f-b0e44218e2ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.420321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd228525-1065-42fd-8619-2ceb860f5e85 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:25.424489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71858d0-bcb9-4a8d-804f-b0e44218e2ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:25.426071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71858d0-bcb9-4a8d-804f-b0e44218e2ba service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:25.427890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2761ce-0a92-40b5-9fd9-389f8bd238f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:25.428565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2761ce-0a92-40b5-9fd9-389f8bd238f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.428850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2761ce-0a92-40b5-9fd9-389f8bd238f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.429129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2761ce-0a92-40b5-9fd9-389f8bd238f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.429783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2761ce-0a92-40b5-9fd9-389f8bd238f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:25.431945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2761ce-0a92-40b5-9fd9-389f8bd238f7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:25.437669 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1363/2739] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:25.444249 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1377/2740] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:55:25.449339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71858d0-bcb9-4a8d-804f-b0e44218e2ba service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:25.464883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71858d0-bcb9-4a8d-804f-b0e44218e2ba service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:25.473983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3df68-e064-43f4-8dc4-450474f687e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:25.475332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3df68-e064-43f4-8dc4-450474f687e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.475776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3df68-e064-43f4-8dc4-450474f687e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.476436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3df68-e064-43f4-8dc4-450474f687e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.477853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3df68-e064-43f4-8dc4-450474f687e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:25.479808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3df68-e064-43f4-8dc4-450474f687e4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:25.492649 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1364/2741] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:25.498170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2761ce-0a92-40b5-9fd9-389f8bd238f7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:25.517608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2761ce-0a92-40b5-9fd9-389f8bd238f7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:25.525621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde7fa9-0033-4a78-92d4-4776849f22f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:25.526315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde7fa9-0033-4a78-92d4-4776849f22f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.526605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde7fa9-0033-4a78-92d4-4776849f22f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.526934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde7fa9-0033-4a78-92d4-4776849f22f2 admin admin] PATH_INFO: `/v3/projects/8a4e3cc3762c4fa6909c65f180184b85/users/3b87e333edd94d2f9cb2c1fa42e6a689/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.547690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde7fa9-0033-4a78-92d4-4776849f22f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4e3cc3762c4fa6909c65f180184b85, user_id=3b87e333edd94d2f9cb2c1fa42e6a689, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:25.550818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde7fa9-0033-4a78-92d4-4776849f22f2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:25.570809 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1378/2742] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:25 2022] PUT /identity/v3/projects/8a4e3cc3762c4fa6909c65f180184b85/users/3b87e333edd94d2f9cb2c1fa42e6a689/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:25.585157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22b1cf-4cc2-4991-87a2-5be417041890 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.585411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22b1cf-4cc2-4991-87a2-5be417041890 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.585637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22b1cf-4cc2-4991-87a2-5be417041890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.623000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8d22b1cf-4cc2-4991-87a2-5be417041890 None None] MFA Rules not processed for user `3b87e333edd94d2f9cb2c1fa42e6a689`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:25.624126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8d22b1cf-4cc2-4991-87a2-5be417041890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:25.717475 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1365/2743] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:25.721944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde7fa9-0033-4a78-92d4-4776849f22f2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:25.829067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde7fa9-0033-4a78-92d4-4776849f22f2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:25.834512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d15eb-b682-484a-9b89-74c735342520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:25.835220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d15eb-b682-484a-9b89-74c735342520 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:25.835509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d15eb-b682-484a-9b89-74c735342520 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:25.835790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d15eb-b682-484a-9b89-74c735342520 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:25.837165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d15eb-b682-484a-9b89-74c735342520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:25.840914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d15eb-b682-484a-9b89-74c735342520 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:25.883030 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1379/2744] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:25 2022] POST /identity/v3/projects => generated 393 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:55:25.889380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22b1cf-4cc2-4991-87a2-5be417041890 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:25.906718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22b1cf-4cc2-4991-87a2-5be417041890 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:26.012871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e5d7a-a1d6-4fd1-b150-14ca6f5584c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:26.014769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e5d7a-a1d6-4fd1-b150-14ca6f5584c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:26.015242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e5d7a-a1d6-4fd1-b150-14ca6f5584c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:26.015711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e5d7a-a1d6-4fd1-b150-14ca6f5584c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:26.016911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e5d7a-a1d6-4fd1-b150-14ca6f5584c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:26.020420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e5d7a-a1d6-4fd1-b150-14ca6f5584c1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:26.062092 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1366/2745] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:25 2022] POST /identity/v3/users => generated 303 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:26.063690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d15eb-b682-484a-9b89-74c735342520 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:26.079541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d15eb-b682-484a-9b89-74c735342520 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:26.084672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367ce7f-ebcd-48af-a4e9-42c4af9f85ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:26.085314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367ce7f-ebcd-48af-a4e9-42c4af9f85ed admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:26.085600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367ce7f-ebcd-48af-a4e9-42c4af9f85ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:26.085882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367ce7f-ebcd-48af-a4e9-42c4af9f85ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:26.087407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367ce7f-ebcd-48af-a4e9-42c4af9f85ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:26.089404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367ce7f-ebcd-48af-a4e9-42c4af9f85ed admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:26.103288 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1380/2746] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:26.107454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e5d7a-a1d6-4fd1-b150-14ca6f5584c1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:26.125739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e5d7a-a1d6-4fd1-b150-14ca6f5584c1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:26.131019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62b70f-a20e-4b57-baa6-68279a961d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:26.132278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62b70f-a20e-4b57-baa6-68279a961d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:26.132278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62b70f-a20e-4b57-baa6-68279a961d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:26.132278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62b70f-a20e-4b57-baa6-68279a961d7a admin admin] PATH_INFO: `/v3/projects/934837958fd0424abf3085ecd5b26091/users/a866a9e0140144f2995fbe971d5b9a19/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:26.161953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62b70f-a20e-4b57-baa6-68279a961d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=934837958fd0424abf3085ecd5b26091, user_id=a866a9e0140144f2995fbe971d5b9a19, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:26.165407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62b70f-a20e-4b57-baa6-68279a961d7a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:26.185129 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1367/2747] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:26 2022] PUT /identity/v3/projects/934837958fd0424abf3085ecd5b26091/users/a866a9e0140144f2995fbe971d5b9a19/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:26.188748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367ce7f-ebcd-48af-a4e9-42c4af9f85ed admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:26.213672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367ce7f-ebcd-48af-a4e9-42c4af9f85ed admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:26.346556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbf064-c6d9-40b8-bd23-8de056cf4097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:26.348456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbf064-c6d9-40b8-bd23-8de056cf4097 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:26.348735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbf064-c6d9-40b8-bd23-8de056cf4097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:26.349906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbf064-c6d9-40b8-bd23-8de056cf4097 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:26.350854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbf064-c6d9-40b8-bd23-8de056cf4097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:26.354372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbf064-c6d9-40b8-bd23-8de056cf4097 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:26.389479 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1381/2748] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:26.393663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62b70f-a20e-4b57-baa6-68279a961d7a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:26.434518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62b70f-a20e-4b57-baa6-68279a961d7a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:26.443572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0ad0-716d-445d-b3d5-637168b4d940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:26.444722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0ad0-716d-445d-b3d5-637168b4d940 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:26.445347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0ad0-716d-445d-b3d5-637168b4d940 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:26.445517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d0ad0-716d-445d-b3d5-637168b4d940 admin admin] PATH_INFO: `/v3/projects/934837958fd0424abf3085ecd5b26091/users/a866a9e0140144f2995fbe971d5b9a19/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:26.449233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d0ad0-716d-445d-b3d5-637168b4d940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934837958fd0424abf3085ecd5b26091, user_id=a866a9e0140144f2995fbe971d5b9a19, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:26.455558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d0ad0-716d-445d-b3d5-637168b4d940 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:26.472946 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1368/2749] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:26 2022] PUT /identity/v3/projects/934837958fd0424abf3085ecd5b26091/users/a866a9e0140144f2995fbe971d5b9a19/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:26.485119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3339a19-9bd9-473b-9f93-81c4dbeba90c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:26.485439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3339a19-9bd9-473b-9f93-81c4dbeba90c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:26.485731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3339a19-9bd9-473b-9f93-81c4dbeba90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:26.532061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:26.535272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c3339a19-9bd9-473b-9f93-81c4dbeba90c None None] MFA Rules not processed for user `a866a9e0140144f2995fbe971d5b9a19`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:26.536675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c3339a19-9bd9-473b-9f93-81c4dbeba90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:26.698185 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1382/2750] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:26.698650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0ad0-716d-445d-b3d5-637168b4d940 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:26.735745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:26.800891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d0ad0-716d-445d-b3d5-637168b4d940 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:26.812201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860ff36-7ca7-4b5b-bab4-f23bd28763e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:26.813497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860ff36-7ca7-4b5b-bab4-f23bd28763e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:26.814022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860ff36-7ca7-4b5b-bab4-f23bd28763e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:26.814522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860ff36-7ca7-4b5b-bab4-f23bd28763e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:26.815480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860ff36-7ca7-4b5b-bab4-f23bd28763e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:26.818218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860ff36-7ca7-4b5b-bab4-f23bd28763e1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:26.875927 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1369/2751] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:26 2022] POST /identity/v3/projects => generated 395 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:26.879987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3339a19-9bd9-473b-9f93-81c4dbeba90c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:26.891500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3339a19-9bd9-473b-9f93-81c4dbeba90c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:26.967087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755148f-094f-4c71-a64c-5170990c73a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:26.968115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755148f-094f-4c71-a64c-5170990c73a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:26.968596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755148f-094f-4c71-a64c-5170990c73a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:26.969094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755148f-094f-4c71-a64c-5170990c73a4 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:26.970079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755148f-094f-4c71-a64c-5170990c73a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:26.972765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755148f-094f-4c71-a64c-5170990c73a4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:27.020553 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1383/2752] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:26 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:27.026618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860ff36-7ca7-4b5b-bab4-f23bd28763e1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:27.042346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860ff36-7ca7-4b5b-bab4-f23bd28763e1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:27.067125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cac257-421f-4769-b592-2f2c7ac39049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:27.068180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cac257-421f-4769-b592-2f2c7ac39049 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:27.068814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cac257-421f-4769-b592-2f2c7ac39049 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:27.069413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cac257-421f-4769-b592-2f2c7ac39049 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:27.070573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cac257-421f-4769-b592-2f2c7ac39049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:27.074701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cac257-421f-4769-b592-2f2c7ac39049 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:27.097738 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1370/2753] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:27.101842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755148f-094f-4c71-a64c-5170990c73a4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:27.116796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755148f-094f-4c71-a64c-5170990c73a4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:27.126062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73117892-6cf8-45ad-9caa-02f1f081430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:27.126719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73117892-6cf8-45ad-9caa-02f1f081430a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:27.127031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73117892-6cf8-45ad-9caa-02f1f081430a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:27.127306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73117892-6cf8-45ad-9caa-02f1f081430a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:27.127981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73117892-6cf8-45ad-9caa-02f1f081430a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:27.130055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73117892-6cf8-45ad-9caa-02f1f081430a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:27.152285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cac257-421f-4769-b592-2f2c7ac39049 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:27.155025 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1384/2754] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:27.168326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cac257-421f-4769-b592-2f2c7ac39049 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:27.178064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daddea-e932-450f-852c-3a4470f635f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:27.179722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daddea-e932-450f-852c-3a4470f635f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:27.181497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daddea-e932-450f-852c-3a4470f635f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:27.182115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daddea-e932-450f-852c-3a4470f635f7 admin admin] PATH_INFO: `/v3/projects/dd0a1d33fe7641f7ac8c7d30bc0d9358/users/5c62db188892490681120826358573b9/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:27.205971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daddea-e932-450f-852c-3a4470f635f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0a1d33fe7641f7ac8c7d30bc0d9358, user_id=5c62db188892490681120826358573b9, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:27.209269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daddea-e932-450f-852c-3a4470f635f7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:27.262163 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1371/2755] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:27 2022] PUT /identity/v3/projects/dd0a1d33fe7641f7ac8c7d30bc0d9358/users/5c62db188892490681120826358573b9/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:27.274384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f90f1-bf7d-4753-abe7-bc7167cf7d81 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:27.275403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f90f1-bf7d-4753-abe7-bc7167cf7d81 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:27.275712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f90f1-bf7d-4753-abe7-bc7167cf7d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:27.334024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3e2f90f1-bf7d-4753-abe7-bc7167cf7d81 None None] MFA Rules not processed for user `5c62db188892490681120826358573b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:27.335776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3e2f90f1-bf7d-4753-abe7-bc7167cf7d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:27.586657 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1385/2756] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:28.078551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daddea-e932-450f-852c-3a4470f635f7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:28.087525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c3daddea-e932-450f-852c-3a4470f635f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:28.251894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daddea-e932-450f-852c-3a4470f635f7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:28.261873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0d44b-5374-42f3-902c-92bb1264284b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:28.264159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0d44b-5374-42f3-902c-92bb1264284b service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:28.264983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0d44b-5374-42f3-902c-92bb1264284b service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:28.265869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0d44b-5374-42f3-902c-92bb1264284b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:28.459926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0d44b-5374-42f3-902c-92bb1264284b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:28.472718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc0d44b-5374-42f3-902c-92bb1264284b service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:28.506057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:28.539360 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1372/2757] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:28.712621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0aac5-9473-4120-b2b9-584d65fdb945 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:28.713199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0aac5-9473-4120-b2b9-584d65fdb945 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:28.713427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0aac5-9473-4120-b2b9-584d65fdb945 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:28.718246 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1386/2758] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:55:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:55:28.730053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0d44b-5374-42f3-902c-92bb1264284b service nova] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:55:28.733031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6dc0d44b-5374-42f3-902c-92bb1264284b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:28.761250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0d44b-5374-42f3-902c-92bb1264284b service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:28.781532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0d44b-5374-42f3-902c-92bb1264284b service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:28.792005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02f054-0e97-4eaa-bd2c-8af4bc9e8dbc tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a866a9e0140144f2995fbe971d5b9a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '934837958fd0424abf3085ecd5b26091', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:28.792846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02f054-0e97-4eaa-bd2c-8af4bc9e8dbc tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:28.793232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02f054-0e97-4eaa-bd2c-8af4bc9e8dbc tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:28.794172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02f054-0e97-4eaa-bd2c-8af4bc9e8dbc tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] PATH_INFO: `/v3/projects/8a4e3cc3762c4fa6909c65f180184b85` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:28.795857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02f054-0e97-4eaa-bd2c-8af4bc9e8dbc tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: Authorizing `identity:get_project(project_id=8a4e3cc3762c4fa6909c65f180184b85)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:28.799429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02f054-0e97-4eaa-bd2c-8af4bc9e8dbc tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:28.808344 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1373/2759] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:55:28 2022] GET /identity/v3/projects/8a4e3cc3762c4fa6909c65f180184b85 => generated 393 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:29.223166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44aa75-3c31-48e0-9d68-767db22a7f39 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:29.223866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44aa75-3c31-48e0-9d68-767db22a7f39 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:29.224367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44aa75-3c31-48e0-9d68-767db22a7f39 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:29.226113 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1387/2760] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:55:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:55:29.237700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02f054-0e97-4eaa-bd2c-8af4bc9e8dbc tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:55:29.267711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02f054-0e97-4eaa-bd2c-8af4bc9e8dbc tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:29.292600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02f054-0e97-4eaa-bd2c-8af4bc9e8dbc tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:29.300416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410cbd7-ed9c-4df1-99b9-3f87fcd9d775 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a866a9e0140144f2995fbe971d5b9a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '934837958fd0424abf3085ecd5b26091', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:29.301365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410cbd7-ed9c-4df1-99b9-3f87fcd9d775 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:29.301815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410cbd7-ed9c-4df1-99b9-3f87fcd9d775 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:29.302283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410cbd7-ed9c-4df1-99b9-3f87fcd9d775 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] PATH_INFO: `/v3/projects/8a4e3cc3762c4fa6909c65f180184b85` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:29.303951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410cbd7-ed9c-4df1-99b9-3f87fcd9d775 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: Authorizing `identity:get_project(project_id=8a4e3cc3762c4fa6909c65f180184b85)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:29.308090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410cbd7-ed9c-4df1-99b9-3f87fcd9d775 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:29.319455 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1374/2761] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:55:29 2022] GET /identity/v3/projects/8a4e3cc3762c4fa6909c65f180184b85 => generated 393 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:29.516957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be105ca-3bde-4a0f-89aa-2ac6fcbf067c None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:29.517447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be105ca-3bde-4a0f-89aa-2ac6fcbf067c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:29.517909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be105ca-3bde-4a0f-89aa-2ac6fcbf067c None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:29.519814 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1388/2762] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:55:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:55:29.540299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410cbd7-ed9c-4df1-99b9-3f87fcd9d775 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:55:29.584138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410cbd7-ed9c-4df1-99b9-3f87fcd9d775 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:29.597772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410cbd7-ed9c-4df1-99b9-3f87fcd9d775 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:29.605286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e8dc3-85d3-46cf-afd9-c1709cfb2f2a tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a866a9e0140144f2995fbe971d5b9a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '934837958fd0424abf3085ecd5b26091', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:29.606392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e8dc3-85d3-46cf-afd9-c1709cfb2f2a tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:29.607202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e8dc3-85d3-46cf-afd9-c1709cfb2f2a tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:29.608111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e8dc3-85d3-46cf-afd9-c1709cfb2f2a tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] PATH_INFO: `/v3/projects/8a4e3cc3762c4fa6909c65f180184b85` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:29.609600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e8dc3-85d3-46cf-afd9-c1709cfb2f2a tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: Authorizing `identity:get_project(project_id=8a4e3cc3762c4fa6909c65f180184b85)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:29.612251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e8dc3-85d3-46cf-afd9-c1709cfb2f2a tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:29.619672 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1375/2763] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:55:29 2022] GET /identity/v3/projects/8a4e3cc3762c4fa6909c65f180184b85 => generated 393 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:33.382407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701eaf9-4c1f-43fb-a679-2f3b6fec57c5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:33.382926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701eaf9-4c1f-43fb-a679-2f3b6fec57c5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:33.383008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701eaf9-4c1f-43fb-a679-2f3b6fec57c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:33.394201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:33.468572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9701eaf9-4c1f-43fb-a679-2f3b6fec57c5 None None] MFA Rules not processed for user `143cd5206a5f40e28b8b6e6cef408826`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:33.471060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9701eaf9-4c1f-43fb-a679-2f3b6fec57c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:33.652008 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1389/2764] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:33 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:33.664072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62449cb-bf1f-4866-9b6b-6afbd3b3f045 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:33.665297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62449cb-bf1f-4866-9b6b-6afbd3b3f045 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:33.665297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62449cb-bf1f-4866-9b6b-6afbd3b3f045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:33.716092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c62449cb-bf1f-4866-9b6b-6afbd3b3f045 None None] MFA Rules not processed for user `143cd5206a5f40e28b8b6e6cef408826`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:33.718802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c62449cb-bf1f-4866-9b6b-6afbd3b3f045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:33.740332 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1376/2765] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:33 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:33.755733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701eaf9-4c1f-43fb-a679-2f3b6fec57c5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:33.783967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701eaf9-4c1f-43fb-a679-2f3b6fec57c5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:33.804043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86eb9d-7b54-498e-a6c9-7eaa3d0a7525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:33.804629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86eb9d-7b54-498e-a6c9-7eaa3d0a7525 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:33.804916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86eb9d-7b54-498e-a6c9-7eaa3d0a7525 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:33.805426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86eb9d-7b54-498e-a6c9-7eaa3d0a7525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:33.820301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86eb9d-7b54-498e-a6c9-7eaa3d0a7525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:33.822898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86eb9d-7b54-498e-a6c9-7eaa3d0a7525 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:33.855376 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1390/2766] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:33 2022] GET /identity/v3/auth/tokens => generated 3290 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:55:34.243005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62449cb-bf1f-4866-9b6b-6afbd3b3f045 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:34.266650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62449cb-bf1f-4866-9b6b-6afbd3b3f045 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:34.277236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36f77a-f115-4e87-8e30-34ead4e95f3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:34.278372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36f77a-f115-4e87-8e30-34ead4e95f3a service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:34.278957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36f77a-f115-4e87-8e30-34ead4e95f3a service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:34.281227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36f77a-f115-4e87-8e30-34ead4e95f3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:34.460085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36f77a-f115-4e87-8e30-34ead4e95f3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:34.468947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36f77a-f115-4e87-8e30-34ead4e95f3a service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:34.485311 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1377/2767] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:34 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:35.112982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0179ac0-adc4-4967-b59f-7f50d15b1129 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:35.113534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0179ac0-adc4-4967-b59f-7f50d15b1129 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:35.113534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0179ac0-adc4-4967-b59f-7f50d15b1129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:35.166015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c0179ac0-adc4-4967-b59f-7f50d15b1129 None None] MFA Rules not processed for user `102d38fe9024425e951b363a86012209`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:35.167295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c0179ac0-adc4-4967-b59f-7f50d15b1129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:35.280483 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1391/2768] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:35.291099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520a301-d07e-4dbe-b007-390c43e32bf1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:35.291620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520a301-d07e-4dbe-b007-390c43e32bf1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:35.291710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520a301-d07e-4dbe-b007-390c43e32bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:35.323990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0520a301-d07e-4dbe-b007-390c43e32bf1 None None] MFA Rules not processed for user `102d38fe9024425e951b363a86012209`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:35.325605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0520a301-d07e-4dbe-b007-390c43e32bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:35.337426 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1378/2769] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:35.352305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0179ac0-adc4-4967-b59f-7f50d15b1129 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:35.353860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c0179ac0-adc4-4967-b59f-7f50d15b1129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:35.464322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0179ac0-adc4-4967-b59f-7f50d15b1129 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:35.477409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:35.478522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:35.479059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:35.479556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] PATH_INFO: `/v3/users/c596f795fe394f5a9b3b0054eded0d4b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:35.481293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c596f795fe394f5a9b3b0054eded0d4b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:35.484343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:35.506535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:35.619929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c596f795fe394f5a9b3b0054eded0d4b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:35.630682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c596f795fe394f5a9b3b0054eded0d4b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:35.631776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c596f795fe394f5a9b3b0054eded0d4b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:35.653073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c596f795fe394f5a9b3b0054eded0d4b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:35.653772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c596f795fe394f5a9b3b0054eded0d4b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:35.698897 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1392/2770] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:35 2022] DELETE /identity/v3/users/c596f795fe394f5a9b3b0054eded0d4b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:35.703100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f15811-70c6-4e5a-8a78-a35bfebacf70 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:35.703328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f15811-70c6-4e5a-8a78-a35bfebacf70 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:35.703614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f15811-70c6-4e5a-8a78-a35bfebacf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:35.741504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-64f15811-70c6-4e5a-8a78-a35bfebacf70 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:35.745484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-64f15811-70c6-4e5a-8a78-a35bfebacf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:35.864482 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1379/2771] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:35.875098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:35.876553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:35.982534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5bff5-7d81-422e-b3e1-6426414dd5a5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:35.987832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfd377-f308-4399-93ca-c9566c1de78e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:35.988879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfd377-f308-4399-93ca-c9566c1de78e service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:35.989170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfd377-f308-4399-93ca-c9566c1de78e service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:35.989448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfd377-f308-4399-93ca-c9566c1de78e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:36.006180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfd377-f308-4399-93ca-c9566c1de78e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:36.009223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfd377-f308-4399-93ca-c9566c1de78e service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:36.024268 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1393/2772] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:36.316093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f15811-70c6-4e5a-8a78-a35bfebacf70 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:36.318008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-64f15811-70c6-4e5a-8a78-a35bfebacf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:36.352492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f15811-70c6-4e5a-8a78-a35bfebacf70 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:36.365805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:36.366764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:36.367524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:36.368004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] PATH_INFO: `/v3/projects/97155fa05bd54cdba8f7d3cd850eea60` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:36.373743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97155fa05bd54cdba8f7d3cd850eea60)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:36.376112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:36.491273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97155fa05bd54cdba8f7d3cd850eea60', 'request_id': 'req-3e8e2048-78b7-46d1-97f7-74cefcd260d2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:36.497804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:36.511616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97155fa05bd54cdba8f7d3cd850eea60', 'request_id': 'req-3e8e2048-78b7-46d1-97f7-74cefcd260d2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:36.522552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97155fa05bd54cdba8f7d3cd850eea60', 'request_id': 'req-3e8e2048-78b7-46d1-97f7-74cefcd260d2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:36.552034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] The token cache is being invalidate because project 97155fa05bd54cdba8f7d3cd850eea60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:36.552362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:36.555416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:36.557603 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1380/2773] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:36 2022] DELETE /identity/v3/projects/97155fa05bd54cdba8f7d3cd850eea60 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:36.561771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfd377-f308-4399-93ca-c9566c1de78e service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:36.595092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfd377-f308-4399-93ca-c9566c1de78e service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:36.629788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:36.631428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:36.842205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e2048-78b7-46d1-97f7-74cefcd260d2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:36.848394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8fe20-a93e-4e88-8bec-f7646b167b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:36.850174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8fe20-a93e-4e88-8bec-f7646b167b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:36.851834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8fe20-a93e-4e88-8bec-f7646b167b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:36.852441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8fe20-a93e-4e88-8bec-f7646b167b74 admin admin] PATH_INFO: `/v3/users/1de43a45e1264129a1dd2e167c322d71` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:36.855451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc773d-a69c-4cf5-9c48-7eff1ef5b12a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:36.855677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8fe20-a93e-4e88-8bec-f7646b167b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de43a45e1264129a1dd2e167c322d71)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:36.856843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc773d-a69c-4cf5-9c48-7eff1ef5b12a service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:36.858534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc773d-a69c-4cf5-9c48-7eff1ef5b12a service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:36.858954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc773d-a69c-4cf5-9c48-7eff1ef5b12a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:36.860114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8fe20-a93e-4e88-8bec-f7646b167b74 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:36.868509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f4bc773d-a69c-4cf5-9c48-7eff1ef5b12a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:36.955809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:36.975298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-49f8fe20-a93e-4e88-8bec-f7646b167b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de43a45e1264129a1dd2e167c322d71'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:36.993938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-49f8fe20-a93e-4e88-8bec-f7646b167b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de43a45e1264129a1dd2e167c322d71'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:36.995162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-49f8fe20-a93e-4e88-8bec-f7646b167b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de43a45e1264129a1dd2e167c322d71'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.006433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc773d-a69c-4cf5-9c48-7eff1ef5b12a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:37.008817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc773d-a69c-4cf5-9c48-7eff1ef5b12a service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:37.015961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-49f8fe20-a93e-4e88-8bec-f7646b167b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de43a45e1264129a1dd2e167c322d71'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.016965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-49f8fe20-a93e-4e88-8bec-f7646b167b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de43a45e1264129a1dd2e167c322d71'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.044425 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1381/2774] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:37.050893 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1394/2775] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:36 2022] DELETE /identity/v3/users/1de43a45e1264129a1dd2e167c322d71 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:37.364159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc773d-a69c-4cf5-9c48-7eff1ef5b12a service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:37.366455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f4bc773d-a69c-4cf5-9c48-7eff1ef5b12a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:37.401420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc773d-a69c-4cf5-9c48-7eff1ef5b12a service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:37.615632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:37.620294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:37.622392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:37.635237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4 admin admin] PATH_INFO: `/v3/projects/ee4613d9c2a046c0a68eef5eeb27b45e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:37.642642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee4613d9c2a046c0a68eef5eeb27b45e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:37.649436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:37.716628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:37.765756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee4613d9c2a046c0a68eef5eeb27b45e', 'request_id': 'req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.780055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee4613d9c2a046c0a68eef5eeb27b45e', 'request_id': 'req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.791153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee4613d9c2a046c0a68eef5eeb27b45e', 'request_id': 'req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.807747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4 admin admin] The token cache is being invalidate because project ee4613d9c2a046c0a68eef5eeb27b45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:37.808056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.818931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f04b1712-95ed-4ee9-a0f7-ba99397d5ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:37.822460 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1382/2776] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:37 2022] DELETE /identity/v3/projects/ee4613d9c2a046c0a68eef5eeb27b45e => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:37.828558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12fe31-8ab7-4ee5-b028-b844e455cafa None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:37.829041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12fe31-8ab7-4ee5-b028-b844e455cafa None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:37.829126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12fe31-8ab7-4ee5-b028-b844e455cafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:37.879967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9f12fe31-8ab7-4ee5-b028-b844e455cafa None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:37.881496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9f12fe31-8ab7-4ee5-b028-b844e455cafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:38.006658 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1395/2777] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:38.009081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b0d3b-81a7-442f-a7d2-ab804a513d14 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:38.009400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b0d3b-81a7-442f-a7d2-ab804a513d14 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:38.009676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b0d3b-81a7-442f-a7d2-ab804a513d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:38.077235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a98b0d3b-81a7-442f-a7d2-ab804a513d14 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:38.077235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a98b0d3b-81a7-442f-a7d2-ab804a513d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:38.093795 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1383/2778] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:38.097836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12fe31-8ab7-4ee5-b028-b844e455cafa None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:38.131922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12fe31-8ab7-4ee5-b028-b844e455cafa None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:38.147451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b89f8-e234-485b-952a-47dc8edd90e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:38.149515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b89f8-e234-485b-952a-47dc8edd90e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:38.153516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b89f8-e234-485b-952a-47dc8edd90e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:38.155842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b89f8-e234-485b-952a-47dc8edd90e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:38.159499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b89f8-e234-485b-952a-47dc8edd90e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:38.163928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b89f8-e234-485b-952a-47dc8edd90e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:38.169660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b89f8-e234-485b-952a-47dc8edd90e3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:38.217100 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1396/2779] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:38.217263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b0d3b-81a7-442f-a7d2-ab804a513d14 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:38.241522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b0d3b-81a7-442f-a7d2-ab804a513d14 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:38.259344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee5222-cfdc-4882-9dc9-4bdd0469ccb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:38.260073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5222-cfdc-4882-9dc9-4bdd0469ccb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:38.260428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5222-cfdc-4882-9dc9-4bdd0469ccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:38.260819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5222-cfdc-4882-9dc9-4bdd0469ccb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:38.261677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee5222-cfdc-4882-9dc9-4bdd0469ccb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:38.264077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee5222-cfdc-4882-9dc9-4bdd0469ccb0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:38.316228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b89f8-e234-485b-952a-47dc8edd90e3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:38.323549 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1384/2780] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:38 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:38.329579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b89f8-e234-485b-952a-47dc8edd90e3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:38.416918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478abe94-642e-4add-8b08-cd1d5ef0e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:38.417488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478abe94-642e-4add-8b08-cd1d5ef0e52a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:38.417771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478abe94-642e-4add-8b08-cd1d5ef0e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:38.419207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478abe94-642e-4add-8b08-cd1d5ef0e52a admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:38.428220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478abe94-642e-4add-8b08-cd1d5ef0e52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:38.430974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478abe94-642e-4add-8b08-cd1d5ef0e52a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:38.491770 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1397/2781] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:38 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:38.493976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee5222-cfdc-4882-9dc9-4bdd0469ccb0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:38.508983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee5222-cfdc-4882-9dc9-4bdd0469ccb0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:38.514570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1086b-b00a-41ee-9877-f41ede2eeeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:38.515438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1086b-b00a-41ee-9877-f41ede2eeeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:38.515873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1086b-b00a-41ee-9877-f41ede2eeeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:38.516517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1086b-b00a-41ee-9877-f41ede2eeeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:38.517316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1086b-b00a-41ee-9877-f41ede2eeeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:38.520209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1086b-b00a-41ee-9877-f41ede2eeeb1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:38.544532 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1385/2782] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:55:38.556513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478abe94-642e-4add-8b08-cd1d5ef0e52a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:38.579674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478abe94-642e-4add-8b08-cd1d5ef0e52a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:38.600349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6c039-958c-4901-9f10-675529dcbcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:38.603339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6c039-958c-4901-9f10-675529dcbcda admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:38.606340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6c039-958c-4901-9f10-675529dcbcda admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:38.608207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6c039-958c-4901-9f10-675529dcbcda admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:38.613715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6c039-958c-4901-9f10-675529dcbcda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:38.619082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6c039-958c-4901-9f10-675529dcbcda admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:38.662998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1086b-b00a-41ee-9877-f41ede2eeeb1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:38.673814 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1398/2783] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:38.687720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1086b-b00a-41ee-9877-f41ede2eeeb1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:38.704738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab2c80-d10b-4e29-8928-867cd5705680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:38.706876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab2c80-d10b-4e29-8928-867cd5705680 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:38.713639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab2c80-d10b-4e29-8928-867cd5705680 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:38.714375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab2c80-d10b-4e29-8928-867cd5705680 admin admin] PATH_INFO: `/v3/projects/1fced88c646649f59f68ea0f51ae2395/users/e45eae1f303c4bff9f4823a25c1f9d55/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:38.738345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e1bb6-f5c7-4389-8b1a-32dd5aa93ea9 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:38.738802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e1bb6-f5c7-4389-8b1a-32dd5aa93ea9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:38.739371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e1bb6-f5c7-4389-8b1a-32dd5aa93ea9 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:38.741670 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1399/2784] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:55:38.749837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e1bb6-f5c7-4389-8b1a-32dd5aa93ea9 None None] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:55:38.754761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-af0e1bb6-f5c7-4389-8b1a-32dd5aa93ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:38.807362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab2c80-d10b-4e29-8928-867cd5705680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fced88c646649f59f68ea0f51ae2395, user_id=e45eae1f303c4bff9f4823a25c1f9d55, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:38.807362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab2c80-d10b-4e29-8928-867cd5705680 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:38.852927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:38.890391 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1386/2785] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:38 2022] PUT /identity/v3/projects/1fced88c646649f59f68ea0f51ae2395/users/e45eae1f303c4bff9f4823a25c1f9d55/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:38.894467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a061e2-13b8-40c1-86c5-dff7787387c4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:38.895872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a061e2-13b8-40c1-86c5-dff7787387c4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:38.896173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a061e2-13b8-40c1-86c5-dff7787387c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:38.985182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c8a061e2-13b8-40c1-86c5-dff7787387c4 None None] MFA Rules not processed for user `e45eae1f303c4bff9f4823a25c1f9d55`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:38.988458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c8a061e2-13b8-40c1-86c5-dff7787387c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:39.035746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e1bb6-f5c7-4389-8b1a-32dd5aa93ea9 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:39.038953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-af0e1bb6-f5c7-4389-8b1a-32dd5aa93ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:39.205050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e1bb6-f5c7-4389-8b1a-32dd5aa93ea9 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:39.267616 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1387/2786] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:39.272996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a061e2-13b8-40c1-86c5-dff7787387c4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:39.343768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23050ce2-adc0-456d-9593-55eb7064e3de tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a866a9e0140144f2995fbe971d5b9a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '934837958fd0424abf3085ecd5b26091', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:39.344458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23050ce2-adc0-456d-9593-55eb7064e3de tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:39.344783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23050ce2-adc0-456d-9593-55eb7064e3de tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:39.345065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23050ce2-adc0-456d-9593-55eb7064e3de tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] PATH_INFO: `/v3/projects/8a4e3cc3762c4fa6909c65f180184b85` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:39.346729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23050ce2-adc0-456d-9593-55eb7064e3de tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: Authorizing `identity:get_project(project_id=8a4e3cc3762c4fa6909c65f180184b85)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:39.349163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23050ce2-adc0-456d-9593-55eb7064e3de tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:39.363357 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1400/2787] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:55:38 2022] GET /identity/v3/projects/8a4e3cc3762c4fa6909c65f180184b85 => generated 393 bytes in 614 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:39.393203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:39.441021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a061e2-13b8-40c1-86c5-dff7787387c4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:39.449650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b3486-d84f-41d9-b6c4-b2ac286f9fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:39.450561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b3486-d84f-41d9-b6c4-b2ac286f9fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:39.450998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b3486-d84f-41d9-b6c4-b2ac286f9fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:39.451787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b3486-d84f-41d9-b6c4-b2ac286f9fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:39.452145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b3486-d84f-41d9-b6c4-b2ac286f9fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:39.454316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b3486-d84f-41d9-b6c4-b2ac286f9fb8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:39.533219 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1388/2788] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:39 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:39.534054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23050ce2-adc0-456d-9593-55eb7064e3de tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:39.559026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23050ce2-adc0-456d-9593-55eb7064e3de tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:39.727469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30029813-37fc-442b-9833-97356fb76c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:39.728095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029813-37fc-442b-9833-97356fb76c26 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:39.728378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029813-37fc-442b-9833-97356fb76c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:39.728948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30029813-37fc-442b-9833-97356fb76c26 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:39.729606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30029813-37fc-442b-9833-97356fb76c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:39.731651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30029813-37fc-442b-9833-97356fb76c26 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:39.755255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:39.787173 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1401/2789] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:39 2022] POST /identity/v3/users => generated 295 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:55:39.794382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b3486-d84f-41d9-b6c4-b2ac286f9fb8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:39.835789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b3486-d84f-41d9-b6c4-b2ac286f9fb8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:39.846565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568edae-568a-4982-ad59-798562bf8a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:39.847519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568edae-568a-4982-ad59-798562bf8a77 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:39.847967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568edae-568a-4982-ad59-798562bf8a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:39.848630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568edae-568a-4982-ad59-798562bf8a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:39.849830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568edae-568a-4982-ad59-798562bf8a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:39.853567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568edae-568a-4982-ad59-798562bf8a77 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:39.874793 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1389/2790] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:39.875525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30029813-37fc-442b-9833-97356fb76c26 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:39.892006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30029813-37fc-442b-9833-97356fb76c26 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:39.898046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618773f4-6dbb-4c8b-89cc-ea47093d86b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:39.900334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618773f4-6dbb-4c8b-89cc-ea47093d86b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:39.901336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618773f4-6dbb-4c8b-89cc-ea47093d86b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:39.902449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618773f4-6dbb-4c8b-89cc-ea47093d86b2 admin admin] PATH_INFO: `/v3/projects/fc14acdcf50346d8a74fb64b1c229323/users/b0b04d63ade4424db1975b07d9a6753d/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:39.929842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618773f4-6dbb-4c8b-89cc-ea47093d86b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc14acdcf50346d8a74fb64b1c229323, user_id=b0b04d63ade4424db1975b07d9a6753d, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:39.933548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618773f4-6dbb-4c8b-89cc-ea47093d86b2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:39.962846 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1402/2791] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:39 2022] PUT /identity/v3/projects/fc14acdcf50346d8a74fb64b1c229323/users/b0b04d63ade4424db1975b07d9a6753d/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:39.963692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568edae-568a-4982-ad59-798562bf8a77 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:39.977823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568edae-568a-4982-ad59-798562bf8a77 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:40.060167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f6ae8-0d10-44f9-8ef4-1ab6d2eb3e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:40.060938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f6ae8-0d10-44f9-8ef4-1ab6d2eb3e87 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.061448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f6ae8-0d10-44f9-8ef4-1ab6d2eb3e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.062399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f6ae8-0d10-44f9-8ef4-1ab6d2eb3e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.062660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f6ae8-0d10-44f9-8ef4-1ab6d2eb3e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:40.066693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f6ae8-0d10-44f9-8ef4-1ab6d2eb3e87 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:40.086495 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1390/2792] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:40.087602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618773f4-6dbb-4c8b-89cc-ea47093d86b2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:40.108309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659e1b8-7d11-446d-aca8-d64ff65dc420 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.108837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659e1b8-7d11-446d-aca8-d64ff65dc420 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.109118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659e1b8-7d11-446d-aca8-d64ff65dc420 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.111168 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1391/2793] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 18:55:40.111878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618773f4-6dbb-4c8b-89cc-ea47093d86b2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:40.117341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659e1b8-7d11-446d-aca8-d64ff65dc420 None None] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:55:40.119430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d538fd-dbeb-4202-b9c9-ab13036ed2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:40.120405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d538fd-dbeb-4202-b9c9-ab13036ed2d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.120848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d538fd-dbeb-4202-b9c9-ab13036ed2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.121292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d538fd-dbeb-4202-b9c9-ab13036ed2d4 admin admin] PATH_INFO: `/v3/projects/fc14acdcf50346d8a74fb64b1c229323/users/b0b04d63ade4424db1975b07d9a6753d/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.123445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d538fd-dbeb-4202-b9c9-ab13036ed2d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc14acdcf50346d8a74fb64b1c229323, user_id=b0b04d63ade4424db1975b07d9a6753d, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:40.126248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d538fd-dbeb-4202-b9c9-ab13036ed2d4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:40.152860 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1403/2794] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:40 2022] PUT /identity/v3/projects/fc14acdcf50346d8a74fb64b1c229323/users/b0b04d63ade4424db1975b07d9a6753d/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:40.228148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edd542-77ce-459a-a94c-855328c68644 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.228416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edd542-77ce-459a-a94c-855328c68644 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.228793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edd542-77ce-459a-a94c-855328c68644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.249843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659e1b8-7d11-446d-aca8-d64ff65dc420 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:40.275614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-73edd542-77ce-459a-a94c-855328c68644 None None] MFA Rules not processed for user `b0b04d63ade4424db1975b07d9a6753d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:40.277140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-73edd542-77ce-459a-a94c-855328c68644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:40.321983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:40.376432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659e1b8-7d11-446d-aca8-d64ff65dc420 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:40.427410 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1404/2795] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:40.459365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ade5c-9e0c-44ab-ba5a-40f9994772e3 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a866a9e0140144f2995fbe971d5b9a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '934837958fd0424abf3085ecd5b26091', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:40.460649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ade5c-9e0c-44ab-ba5a-40f9994772e3 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.461096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ade5c-9e0c-44ab-ba5a-40f9994772e3 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.462136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ade5c-9e0c-44ab-ba5a-40f9994772e3 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] PATH_INFO: `/v3/projects/8a4e3cc3762c4fa6909c65f180184b85` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.463674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ade5c-9e0c-44ab-ba5a-40f9994772e3 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: Authorizing `identity:get_project(project_id=8a4e3cc3762c4fa6909c65f180184b85)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:40.466300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ade5c-9e0c-44ab-ba5a-40f9994772e3 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:40.468576 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1392/2796] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:55:40 2022] GET /identity/v3/projects/8a4e3cc3762c4fa6909c65f180184b85 => generated 393 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:55:40.503722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edd542-77ce-459a-a94c-855328c68644 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:40.609153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edd542-77ce-459a-a94c-855328c68644 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:40.616787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e163968-3056-45f4-af66-ca8521824a3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:40.618159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e163968-3056-45f4-af66-ca8521824a3e service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:40.618456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e163968-3056-45f4-af66-ca8521824a3e service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:40.618734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e163968-3056-45f4-af66-ca8521824a3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:40.628651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e163968-3056-45f4-af66-ca8521824a3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:40.631172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e163968-3056-45f4-af66-ca8521824a3e service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:40.659040 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1405/2797] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:43.669612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ade5c-9e0c-44ab-ba5a-40f9994772e3 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:43.756033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ade5c-9e0c-44ab-ba5a-40f9994772e3 tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:43.761233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:43.761916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:43.762347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:43.762633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] PATH_INFO: `/v3/users/e45eae1f303c4bff9f4823a25c1f9d55` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:43.763864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45eae1f303c4bff9f4823a25c1f9d55)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:43.768144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:43.832611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45eae1f303c4bff9f4823a25c1f9d55'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:43.841173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45eae1f303c4bff9f4823a25c1f9d55'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:43.841882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45eae1f303c4bff9f4823a25c1f9d55'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:43.858158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45eae1f303c4bff9f4823a25c1f9d55'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:43.859365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45eae1f303c4bff9f4823a25c1f9d55'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:43.878355 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1393/2798] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:43 2022] DELETE /identity/v3/users/e45eae1f303c4bff9f4823a25c1f9d55 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:43.883030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829d342-85fa-44a4-9fe0-b4fa29d3cae2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:43.883559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829d342-85fa-44a4-9fe0-b4fa29d3cae2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:43.883980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829d342-85fa-44a4-9fe0-b4fa29d3cae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:43.905474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f829d342-85fa-44a4-9fe0-b4fa29d3cae2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:43.906694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f829d342-85fa-44a4-9fe0-b4fa29d3cae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:43.931076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:44.046721 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1406/2799] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:44.075416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:44.078089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:44.098626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:44.185900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20b342-9155-4fd1-bbaa-939ec4c23a76 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:44.196431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c626c8b-8810-44cf-b923-576f68856133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:44.197770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c626c8b-8810-44cf-b923-576f68856133 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:44.198251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c626c8b-8810-44cf-b923-576f68856133 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:44.198734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c626c8b-8810-44cf-b923-576f68856133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:44.216611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c626c8b-8810-44cf-b923-576f68856133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:44.219366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c626c8b-8810-44cf-b923-576f68856133 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:44.233012 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1394/2800] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:44.288306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8eef93-e1e8-4ffa-a545-02c64c40445d None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:44.288569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8eef93-e1e8-4ffa-a545-02c64c40445d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:44.288846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8eef93-e1e8-4ffa-a545-02c64c40445d None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:44.291420 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1407/2801] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 18:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:55:44.298703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c626c8b-8810-44cf-b923-576f68856133 service neutron] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 18:55:44.303800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4c626c8b-8810-44cf-b923-576f68856133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:44.464084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c626c8b-8810-44cf-b923-576f68856133 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:44.465195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4c626c8b-8810-44cf-b923-576f68856133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:44.616891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c626c8b-8810-44cf-b923-576f68856133 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:44.627317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2729b1-2994-415c-adb1-c28786f1d3da tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a866a9e0140144f2995fbe971d5b9a19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '934837958fd0424abf3085ecd5b26091', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:44.628151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2729b1-2994-415c-adb1-c28786f1d3da tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:44.628544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2729b1-2994-415c-adb1-c28786f1d3da tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:44.628933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2729b1-2994-415c-adb1-c28786f1d3da tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] PATH_INFO: `/v3/projects/dd0a1d33fe7641f7ac8c7d30bc0d9358` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:44.632428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2729b1-2994-415c-adb1-c28786f1d3da tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd0a1d33fe7641f7ac8c7d30bc0d9358)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:44.638957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2729b1-2994-415c-adb1-c28786f1d3da tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:44.643239 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1395/2802] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 18:55:44 2022] GET /identity/v3/projects/dd0a1d33fe7641f7ac8c7d30bc0d9358 => generated 395 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:44.861526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8eef93-e1e8-4ffa-a545-02c64c40445d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:44.864558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cc8eef93-e1e8-4ffa-a545-02c64c40445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:44.891756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8eef93-e1e8-4ffa-a545-02c64c40445d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:44.900348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:44.901945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:44.902447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:44.902986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] PATH_INFO: `/v3/projects/1fced88c646649f59f68ea0f51ae2395` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:44.906129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fced88c646649f59f68ea0f51ae2395)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:44.908728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:45.025331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fced88c646649f59f68ea0f51ae2395', 'request_id': 'req-10b8e95f-4c3a-4685-89f8-047d8651df9e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:45.040246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fced88c646649f59f68ea0f51ae2395', 'request_id': 'req-10b8e95f-4c3a-4685-89f8-047d8651df9e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:45.055843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fced88c646649f59f68ea0f51ae2395', 'request_id': 'req-10b8e95f-4c3a-4685-89f8-047d8651df9e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:45.083265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] The token cache is being invalidate because project 1fced88c646649f59f68ea0f51ae2395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:45.083725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:45.084821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:45.088051 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1408/2803] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:44 2022] DELETE /identity/v3/projects/1fced88c646649f59f68ea0f51ae2395 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:45.092526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2729b1-2994-415c-adb1-c28786f1d3da tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:45.096004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bf2729b1-2994-415c-adb1-c28786f1d3da tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:45.123967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2729b1-2994-415c-adb1-c28786f1d3da tempest-FlavorsAccessNegativeTestJSON-376711008 tempest-FlavorsAccessNegativeTestJSON-376711008-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:45.212287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:45.229589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:45.230474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:45.230715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:45.231026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] PATH_INFO: `/v3/users/b0b04d63ade4424db1975b07d9a6753d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:45.232253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b04d63ade4424db1975b07d9a6753d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:45.234276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:45.351820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b04d63ade4424db1975b07d9a6753d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:45.374026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b04d63ade4424db1975b07d9a6753d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:45.378453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b04d63ade4424db1975b07d9a6753d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:45.414344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b04d63ade4424db1975b07d9a6753d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:45.417296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b04d63ade4424db1975b07d9a6753d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:45.448264 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1396/2804] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:45 2022] DELETE /identity/v3/users/b0b04d63ade4424db1975b07d9a6753d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:45.882187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:45.894688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8e95f-4c3a-4685-89f8-047d8651df9e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:45.974682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4888042-53d9-47ed-8453-2d0c09326a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:45.975990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4888042-53d9-47ed-8453-2d0c09326a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:45.975990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4888042-53d9-47ed-8453-2d0c09326a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:45.976284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4888042-53d9-47ed-8453-2d0c09326a73 admin admin] PATH_INFO: `/v3/projects/fc14acdcf50346d8a74fb64b1c229323` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:45.978075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4888042-53d9-47ed-8453-2d0c09326a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc14acdcf50346d8a74fb64b1c229323)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:45.981215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4888042-53d9-47ed-8453-2d0c09326a73 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:46.064048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:46.065521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:46.070107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4888042-53d9-47ed-8453-2d0c09326a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc14acdcf50346d8a74fb64b1c229323', 'request_id': 'req-d4888042-53d9-47ed-8453-2d0c09326a73'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.071710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:46.079166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68987cf7-9a07-4fb0-9ee7-1c451c46de9f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:46.084877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4888042-53d9-47ed-8453-2d0c09326a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc14acdcf50346d8a74fb64b1c229323', 'request_id': 'req-d4888042-53d9-47ed-8453-2d0c09326a73'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.094951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4888042-53d9-47ed-8453-2d0c09326a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc14acdcf50346d8a74fb64b1c229323', 'request_id': 'req-d4888042-53d9-47ed-8453-2d0c09326a73'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.115248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4888042-53d9-47ed-8453-2d0c09326a73 admin admin] The token cache is being invalidate because project fc14acdcf50346d8a74fb64b1c229323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:46.115539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4888042-53d9-47ed-8453-2d0c09326a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.116289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4888042-53d9-47ed-8453-2d0c09326a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.122563 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1409/2805] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:45 2022] DELETE /identity/v3/projects/fc14acdcf50346d8a74fb64b1c229323 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:46.124176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0c75-f8a9-43bf-a47a-dfb4bf8ea2c6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.124401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0c75-f8a9-43bf-a47a-dfb4bf8ea2c6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:46.124844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0c75-f8a9-43bf-a47a-dfb4bf8ea2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:46.148638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-bb2b0c75-f8a9-43bf-a47a-dfb4bf8ea2c6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:46.150316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bb2b0c75-f8a9-43bf-a47a-dfb4bf8ea2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:46.158696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfacac-3e28-41b7-85be-6ae4c0b4709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:46.159967 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1410/2806] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:46.160918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfacac-3e28-41b7-85be-6ae4c0b4709f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.161221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfacac-3e28-41b7-85be-6ae4c0b4709f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:46.161617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfacac-3e28-41b7-85be-6ae4c0b4709f admin admin] PATH_INFO: `/v3/users/3b87e333edd94d2f9cb2c1fa42e6a689` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:46.163150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfacac-3e28-41b7-85be-6ae4c0b4709f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b87e333edd94d2f9cb2c1fa42e6a689)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:46.165815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfacac-3e28-41b7-85be-6ae4c0b4709f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:46.169109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afab05-20ec-46d5-97dc-87778799d0d6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.169813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afab05-20ec-46d5-97dc-87778799d0d6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:46.170355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afab05-20ec-46d5-97dc-87778799d0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:46.195746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-78afab05-20ec-46d5-97dc-87778799d0d6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:46.197430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-78afab05-20ec-46d5-97dc-87778799d0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:46.216277 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1411/2807] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:46.220682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afab05-20ec-46d5-97dc-87778799d0d6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:46.232672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afab05-20ec-46d5-97dc-87778799d0d6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:46.237615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ecca0-ef16-4847-929e-4bc67239f93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:46.238665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ecca0-ef16-4847-929e-4bc67239f93e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.238665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ecca0-ef16-4847-929e-4bc67239f93e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:46.239166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ecca0-ef16-4847-929e-4bc67239f93e admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:46.239737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ecca0-ef16-4847-929e-4bc67239f93e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:46.240128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ecca0-ef16-4847-929e-4bc67239f93e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:46.240885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-45cfacac-3e28-41b7-85be-6ae4c0b4709f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b87e333edd94d2f9cb2c1fa42e6a689'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.241895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ecca0-ef16-4847-929e-4bc67239f93e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:46.251692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-45cfacac-3e28-41b7-85be-6ae4c0b4709f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b87e333edd94d2f9cb2c1fa42e6a689'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.252500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-45cfacac-3e28-41b7-85be-6ae4c0b4709f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b87e333edd94d2f9cb2c1fa42e6a689'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.261820 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1412/2808] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:55:46.263389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ecca0-ef16-4847-929e-4bc67239f93e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:46.265666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:46.268530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-45cfacac-3e28-41b7-85be-6ae4c0b4709f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b87e333edd94d2f9cb2c1fa42e6a689'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.275667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ecca0-ef16-4847-929e-4bc67239f93e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:46.276583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-45cfacac-3e28-41b7-85be-6ae4c0b4709f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b87e333edd94d2f9cb2c1fa42e6a689'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:46.281023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87ce1e-9145-4390-9285-398a5500712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:46.281567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87ce1e-9145-4390-9285-398a5500712b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.281857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87ce1e-9145-4390-9285-398a5500712b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:46.282304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87ce1e-9145-4390-9285-398a5500712b admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:46.283055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87ce1e-9145-4390-9285-398a5500712b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:46.285584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87ce1e-9145-4390-9285-398a5500712b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:46.298583 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1397/2809] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:46 2022] DELETE /identity/v3/users/3b87e333edd94d2f9cb2c1fa42e6a689 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:46.303087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e0277-837f-4b5c-8a27-b3ca84ea469f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.303493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e0277-837f-4b5c-8a27-b3ca84ea469f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:46.303869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e0277-837f-4b5c-8a27-b3ca84ea469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:46.329540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-036e0277-837f-4b5c-8a27-b3ca84ea469f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:46.330880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-036e0277-837f-4b5c-8a27-b3ca84ea469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:46.335113 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1413/2810] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:46 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:46.338455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87ce1e-9145-4390-9285-398a5500712b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:46.340343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3c87ce1e-9145-4390-9285-398a5500712b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:46.404420 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1398/2811] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:46.414699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e0277-837f-4b5c-8a27-b3ca84ea469f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:46.417209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-036e0277-837f-4b5c-8a27-b3ca84ea469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:46.437875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87ce1e-9145-4390-9285-398a5500712b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:46.443215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb18a4-bceb-4505-93fb-1276c7630293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:46.443810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb18a4-bceb-4505-93fb-1276c7630293 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.444117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb18a4-bceb-4505-93fb-1276c7630293 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:46.444400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb18a4-bceb-4505-93fb-1276c7630293 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:46.444973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb18a4-bceb-4505-93fb-1276c7630293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:46.447838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb18a4-bceb-4505-93fb-1276c7630293 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:46.481679 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1414/2812] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:46 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:46.486057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb18a4-bceb-4505-93fb-1276c7630293 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:46.501113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e0277-837f-4b5c-8a27-b3ca84ea469f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:46.502807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb18a4-bceb-4505-93fb-1276c7630293 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:46.507852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdda03-bbe4-4fc8-bd37-ac32e1268f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:46.508944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e80fee-6747-4824-84ee-a4b0e59ae3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:46.509545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80fee-6747-4824-84ee-a4b0e59ae3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.509826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80fee-6747-4824-84ee-a4b0e59ae3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:46.510094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80fee-6747-4824-84ee-a4b0e59ae3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:46.510358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdda03-bbe4-4fc8-bd37-ac32e1268f92 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.510771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e80fee-6747-4824-84ee-a4b0e59ae3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:46.511300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdda03-bbe4-4fc8-bd37-ac32e1268f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:46.512021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdda03-bbe4-4fc8-bd37-ac32e1268f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:46.512468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e80fee-6747-4824-84ee-a4b0e59ae3f7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:46.526930 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1415/2813] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:46.527155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdda03-bbe4-4fc8-bd37-ac32e1268f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:46.528419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e80fee-6747-4824-84ee-a4b0e59ae3f7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:46.529027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdda03-bbe4-4fc8-bd37-ac32e1268f92 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:46.540408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e80fee-6747-4824-84ee-a4b0e59ae3f7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:46.545638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f9287-02a2-45d6-ba20-17f91f82e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:46.546260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9287-02a2-45d6-ba20-17f91f82e7be admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.546544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9287-02a2-45d6-ba20-17f91f82e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:46.546852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9287-02a2-45d6-ba20-17f91f82e7be admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:46.547564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f9287-02a2-45d6-ba20-17f91f82e7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:46.549260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f9287-02a2-45d6-ba20-17f91f82e7be admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:46.551101 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1399/2814] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:55:46.586836 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1416/2815] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:46.588745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdda03-bbe4-4fc8-bd37-ac32e1268f92 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:46.611280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdda03-bbe4-4fc8-bd37-ac32e1268f92 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:46.623894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3706b-5462-4251-969f-a7333037b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:46.625018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3706b-5462-4251-969f-a7333037b65a admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.625693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3706b-5462-4251-969f-a7333037b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:46.626177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3706b-5462-4251-969f-a7333037b65a admin admin] PATH_INFO: `/v3/projects/992f9c68f1dc45c4ac6662d03417339e/users/13d33648c2754ecdb00578d8256087ed/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:46.668850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3706b-5462-4251-969f-a7333037b65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=992f9c68f1dc45c4ac6662d03417339e, user_id=13d33648c2754ecdb00578d8256087ed, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:46.674942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3706b-5462-4251-969f-a7333037b65a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:46.706232 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1400/2816] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:46 2022] PUT /identity/v3/projects/992f9c68f1dc45c4ac6662d03417339e/users/13d33648c2754ecdb00578d8256087ed/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:46.708813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ac51a-6326-4399-9c20-42490c4f6d47 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.709222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ac51a-6326-4399-9c20-42490c4f6d47 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:46.709720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ac51a-6326-4399-9c20-42490c4f6d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:46.745878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6c4ac51a-6326-4399-9c20-42490c4f6d47 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:46.745878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6c4ac51a-6326-4399-9c20-42490c4f6d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:46.830368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:46.851348 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1417/2817] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:46.873798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3706b-5462-4251-969f-a7333037b65a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:46.991732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3706b-5462-4251-969f-a7333037b65a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:46.997958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a55bc-c051-4ab9-8a11-f4d6fb1df3a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:46.998854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a55bc-c051-4ab9-8a11-f4d6fb1df3a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:46.999209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a55bc-c051-4ab9-8a11-f4d6fb1df3a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:47.000005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a55bc-c051-4ab9-8a11-f4d6fb1df3a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:47.013509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a55bc-c051-4ab9-8a11-f4d6fb1df3a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:47.016057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a55bc-c051-4ab9-8a11-f4d6fb1df3a0 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:47.029889 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1401/2818] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:47.053236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ac51a-6326-4399-9c20-42490c4f6d47 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:47.055141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6c4ac51a-6326-4399-9c20-42490c4f6d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:47.070711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ac51a-6326-4399-9c20-42490c4f6d47 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:47.076933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:47.077605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:47.077890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:47.083450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] PATH_INFO: `/v3/projects/8a4e3cc3762c4fa6909c65f180184b85` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:47.085227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4e3cc3762c4fa6909c65f180184b85)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:47.092294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:47.162106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4e3cc3762c4fa6909c65f180184b85', 'request_id': 'req-817938c7-694f-4a09-a9c3-8a38a12a0498'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.169561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4e3cc3762c4fa6909c65f180184b85', 'request_id': 'req-817938c7-694f-4a09-a9c3-8a38a12a0498'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.179052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4e3cc3762c4fa6909c65f180184b85', 'request_id': 'req-817938c7-694f-4a09-a9c3-8a38a12a0498'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.200864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] The token cache is being invalidate because project 8a4e3cc3762c4fa6909c65f180184b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:47.201218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.201855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.203904 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1418/2819] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:47 2022] DELETE /identity/v3/projects/8a4e3cc3762c4fa6909c65f180184b85 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:47.208135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a55bc-c051-4ab9-8a11-f4d6fb1df3a0 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:47.222200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a55bc-c051-4ab9-8a11-f4d6fb1df3a0 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:47.228222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:47.314998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:47.315922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:47.316374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:47.316949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] PATH_INFO: `/v3/users/a866a9e0140144f2995fbe971d5b9a19` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:47.318541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a866a9e0140144f2995fbe971d5b9a19)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:47.321432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:47.474169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a866a9e0140144f2995fbe971d5b9a19'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.488935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a866a9e0140144f2995fbe971d5b9a19'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.489937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a866a9e0140144f2995fbe971d5b9a19'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.516744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a866a9e0140144f2995fbe971d5b9a19'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.522352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a866a9e0140144f2995fbe971d5b9a19'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:47.580453 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1402/2820] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:47 2022] DELETE /identity/v3/users/a866a9e0140144f2995fbe971d5b9a19 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:48.728631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:48.730324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:48.759949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817938c7-694f-4a09-a9c3-8a38a12a0498 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:48.848862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:48.849678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:48.850068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:48.850565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] PATH_INFO: `/v3/projects/934837958fd0424abf3085ecd5b26091` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:48.852198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=934837958fd0424abf3085ecd5b26091)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:48.854849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:48.920546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934837958fd0424abf3085ecd5b26091', 'request_id': 'req-9e7f13da-97c3-4d73-9961-c3045e833444'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:48.931109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934837958fd0424abf3085ecd5b26091', 'request_id': 'req-9e7f13da-97c3-4d73-9961-c3045e833444'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:48.940889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934837958fd0424abf3085ecd5b26091', 'request_id': 'req-9e7f13da-97c3-4d73-9961-c3045e833444'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:48.961896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] The token cache is being invalidate because project 934837958fd0424abf3085ecd5b26091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:48.962556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:48.963748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:48.969050 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1419/2821] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:48 2022] DELETE /identity/v3/projects/934837958fd0424abf3085ecd5b26091 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:48.969901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:48.971481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:48.997735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60187190-18bb-4172-8598-5299872ef978 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:49.100895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9a6b8-d675-4873-8df2-9ba2862d2c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:49.102729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9a6b8-d675-4873-8df2-9ba2862d2c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:49.103365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9a6b8-d675-4873-8df2-9ba2862d2c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:49.103932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9a6b8-d675-4873-8df2-9ba2862d2c75 admin admin] PATH_INFO: `/v3/users/5c62db188892490681120826358573b9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:49.106379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9a6b8-d675-4873-8df2-9ba2862d2c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c62db188892490681120826358573b9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:49.109288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9a6b8-d675-4873-8df2-9ba2862d2c75 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:49.183111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:49.213349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bdf9a6b8-d675-4873-8df2-9ba2862d2c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c62db188892490681120826358573b9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:49.243272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bdf9a6b8-d675-4873-8df2-9ba2862d2c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c62db188892490681120826358573b9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:49.244691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bdf9a6b8-d675-4873-8df2-9ba2862d2c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c62db188892490681120826358573b9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:49.264158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bdf9a6b8-d675-4873-8df2-9ba2862d2c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c62db188892490681120826358573b9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:49.265272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bdf9a6b8-d675-4873-8df2-9ba2862d2c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c62db188892490681120826358573b9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:49.294957 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1403/2822] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:55:48 2022] DELETE /identity/v3/users/5c62db188892490681120826358573b9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:50.048808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:50.050944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:50.078775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f13da-97c3-4d73-9961-c3045e833444 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:50.098049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:50.241725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:50.243882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:50.244399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:50.245128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8 admin admin] PATH_INFO: `/v3/projects/dd0a1d33fe7641f7ac8c7d30bc0d9358` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:50.247898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0a1d33fe7641f7ac8c7d30bc0d9358)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:50.252466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:50.438840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0a1d33fe7641f7ac8c7d30bc0d9358', 'request_id': 'req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:50.458277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0a1d33fe7641f7ac8c7d30bc0d9358', 'request_id': 'req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:50.475137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0a1d33fe7641f7ac8c7d30bc0d9358', 'request_id': 'req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:50.504890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8 admin admin] The token cache is being invalidate because project dd0a1d33fe7641f7ac8c7d30bc0d9358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:55:50.505191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:50.508746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-693d042c-a4d8-41b5-80a9-78f3d2c22ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:55:50.511745 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1420/2823] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:55:50 2022] DELETE /identity/v3/projects/dd0a1d33fe7641f7ac8c7d30bc0d9358 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:50.517943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0433c-50db-4df4-bc5c-18ceb8c793d4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:50.518878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0433c-50db-4df4-bc5c-18ceb8c793d4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:50.518878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0433c-50db-4df4-bc5c-18ceb8c793d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:50.573533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-69b0433c-50db-4df4-bc5c-18ceb8c793d4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:50.575513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-69b0433c-50db-4df4-bc5c-18ceb8c793d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:50.714723 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1404/2824] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:50.729124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7810b7-3d64-49f4-b320-ceac9ff729e6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:50.729591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7810b7-3d64-49f4-b320-ceac9ff729e6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:50.730086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7810b7-3d64-49f4-b320-ceac9ff729e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:50.766556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2c7810b7-3d64-49f4-b320-ceac9ff729e6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:50.768051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2c7810b7-3d64-49f4-b320-ceac9ff729e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:50.780326 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1421/2825] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:50.785802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0433c-50db-4df4-bc5c-18ceb8c793d4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:50.799808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0433c-50db-4df4-bc5c-18ceb8c793d4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:50.807641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914036f-ea8d-444e-8afc-f337b2ae07aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:50.808465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914036f-ea8d-444e-8afc-f337b2ae07aa admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:50.808847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914036f-ea8d-444e-8afc-f337b2ae07aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:50.809219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914036f-ea8d-444e-8afc-f337b2ae07aa admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:50.810119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914036f-ea8d-444e-8afc-f337b2ae07aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:55:50.810574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914036f-ea8d-444e-8afc-f337b2ae07aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:50.812601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914036f-ea8d-444e-8afc-f337b2ae07aa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:50.837960 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1405/2826] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:55:50.839232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7810b7-3d64-49f4-b320-ceac9ff729e6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:50.849955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7810b7-3d64-49f4-b320-ceac9ff729e6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:50.858621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6fe67-3dbf-4536-9d42-a3b6903ca341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:50.860430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6fe67-3dbf-4536-9d42-a3b6903ca341 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:50.860430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6fe67-3dbf-4536-9d42-a3b6903ca341 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:50.860430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6fe67-3dbf-4536-9d42-a3b6903ca341 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:50.861032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6fe67-3dbf-4536-9d42-a3b6903ca341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:50.863445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6fe67-3dbf-4536-9d42-a3b6903ca341 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:50.915752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914036f-ea8d-444e-8afc-f337b2ae07aa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:50.916959 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1422/2827] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:50 2022] POST /identity/v3/projects => generated 399 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:55:50.932173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914036f-ea8d-444e-8afc-f337b2ae07aa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:51.028954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6bc19-0e0a-49d4-8b17-152f099829ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:51.029971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6bc19-0e0a-49d4-8b17-152f099829ff admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:51.030395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6bc19-0e0a-49d4-8b17-152f099829ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:51.030977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6bc19-0e0a-49d4-8b17-152f099829ff admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:51.031615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6bc19-0e0a-49d4-8b17-152f099829ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:51.033726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6bc19-0e0a-49d4-8b17-152f099829ff admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:51.062421 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1406/2828] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:50 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:51.066733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6fe67-3dbf-4536-9d42-a3b6903ca341 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:51.081056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6fe67-3dbf-4536-9d42-a3b6903ca341 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:51.088102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e1f54-9314-45d3-a1f4-1e6405ab395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:51.089058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e1f54-9314-45d3-a1f4-1e6405ab395e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:51.089425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e1f54-9314-45d3-a1f4-1e6405ab395e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:51.089711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e1f54-9314-45d3-a1f4-1e6405ab395e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:51.090385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e1f54-9314-45d3-a1f4-1e6405ab395e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:51.092260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e1f54-9314-45d3-a1f4-1e6405ab395e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:51.105041 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1423/2829] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:55:51.109380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6bc19-0e0a-49d4-8b17-152f099829ff admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:51.122989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6bc19-0e0a-49d4-8b17-152f099829ff admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:51.128902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f66eb6-f243-4a81-8da0-71d2a39a3dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:51.129714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f66eb6-f243-4a81-8da0-71d2a39a3dcb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:51.129851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f66eb6-f243-4a81-8da0-71d2a39a3dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:51.130091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f66eb6-f243-4a81-8da0-71d2a39a3dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:51.131009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f66eb6-f243-4a81-8da0-71d2a39a3dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:51.135656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f66eb6-f243-4a81-8da0-71d2a39a3dcb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:51.159837 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1407/2830] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:51.160935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e1f54-9314-45d3-a1f4-1e6405ab395e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:51.176949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e1f54-9314-45d3-a1f4-1e6405ab395e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:51.191303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002918f2-3178-4784-aeb8-5348e5ab9fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:51.192006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002918f2-3178-4784-aeb8-5348e5ab9fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:51.192483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002918f2-3178-4784-aeb8-5348e5ab9fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:51.192759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002918f2-3178-4784-aeb8-5348e5ab9fd3 admin admin] PATH_INFO: `/v3/projects/7b350af2d9b04fc89f76252eec333d7d/users/8acfdba9d71b4e3da063f7e0a2af1bb8/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:51.218272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002918f2-3178-4784-aeb8-5348e5ab9fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b350af2d9b04fc89f76252eec333d7d, user_id=8acfdba9d71b4e3da063f7e0a2af1bb8, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:51.221225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002918f2-3178-4784-aeb8-5348e5ab9fd3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:51.254770 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1424/2831] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:51 2022] PUT /identity/v3/projects/7b350af2d9b04fc89f76252eec333d7d/users/8acfdba9d71b4e3da063f7e0a2af1bb8/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:55:51.263046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628c90-4e9a-4a8a-81ef-86c42370372e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:51.263384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628c90-4e9a-4a8a-81ef-86c42370372e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:51.263618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628c90-4e9a-4a8a-81ef-86c42370372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:51.309267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:51.313028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-38628c90-4e9a-4a8a-81ef-86c42370372e None None] MFA Rules not processed for user `8acfdba9d71b4e3da063f7e0a2af1bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:51.314872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-38628c90-4e9a-4a8a-81ef-86c42370372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:51.446706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002918f2-3178-4784-aeb8-5348e5ab9fd3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:51.453688 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1408/2832] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:55:51.598077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:51.613642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002918f2-3178-4784-aeb8-5348e5ab9fd3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:51.623966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186c235-c2ff-4332-ad82-5e11ff085c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:51.624700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186c235-c2ff-4332-ad82-5e11ff085c60 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:51.625072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186c235-c2ff-4332-ad82-5e11ff085c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:51.625450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186c235-c2ff-4332-ad82-5e11ff085c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:51.626318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186c235-c2ff-4332-ad82-5e11ff085c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:51.631649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186c235-c2ff-4332-ad82-5e11ff085c60 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:51.700441 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1425/2833] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:51 2022] POST /identity/v3/projects => generated 397 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:51.704791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628c90-4e9a-4a8a-81ef-86c42370372e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:51.717204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628c90-4e9a-4a8a-81ef-86c42370372e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:51.838471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c406b8-717d-4b92-86ff-6d1648c0b43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:51.839567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c406b8-717d-4b92-86ff-6d1648c0b43a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:51.840052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c406b8-717d-4b92-86ff-6d1648c0b43a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:51.840529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c406b8-717d-4b92-86ff-6d1648c0b43a admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:51.841755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c406b8-717d-4b92-86ff-6d1648c0b43a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:51.849002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c406b8-717d-4b92-86ff-6d1648c0b43a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:51.914049 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1409/2834] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:51 2022] POST /identity/v3/users => generated 305 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:51.915113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186c235-c2ff-4332-ad82-5e11ff085c60 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:51.927916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186c235-c2ff-4332-ad82-5e11ff085c60 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:51.936477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae7746-2622-402f-8cda-ab911463e3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:51.937101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae7746-2622-402f-8cda-ab911463e3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:51.937385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae7746-2622-402f-8cda-ab911463e3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:51.937663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae7746-2622-402f-8cda-ab911463e3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:51.938347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae7746-2622-402f-8cda-ab911463e3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:51.940201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae7746-2622-402f-8cda-ab911463e3e9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:51.955865 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1426/2835] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:51.959592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c406b8-717d-4b92-86ff-6d1648c0b43a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:51.972624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c406b8-717d-4b92-86ff-6d1648c0b43a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:51.984380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55a267-e1c5-4034-870e-8cf6e506ce59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:51.985419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55a267-e1c5-4034-870e-8cf6e506ce59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:51.985933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55a267-e1c5-4034-870e-8cf6e506ce59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:51.986279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55a267-e1c5-4034-870e-8cf6e506ce59 admin admin] PATH_INFO: `/v3/projects/a21ad685432b436bb54779ab4a7a51a6/users/8ef4c9c43ab14136a3733d0462286d7f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:52.013002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55a267-e1c5-4034-870e-8cf6e506ce59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21ad685432b436bb54779ab4a7a51a6, user_id=8ef4c9c43ab14136a3733d0462286d7f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:52.016073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55a267-e1c5-4034-870e-8cf6e506ce59 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:52.047321 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1410/2836] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:51 2022] PUT /identity/v3/projects/a21ad685432b436bb54779ab4a7a51a6/users/8ef4c9c43ab14136a3733d0462286d7f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:52.051187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae7746-2622-402f-8cda-ab911463e3e9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:52.062671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae7746-2622-402f-8cda-ab911463e3e9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:52.151015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9e7b8-d5d8-43e8-a465-eeb00b3b75b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:52.151702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9e7b8-d5d8-43e8-a465-eeb00b3b75b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:52.151914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9e7b8-d5d8-43e8-a465-eeb00b3b75b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:52.152189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9e7b8-d5d8-43e8-a465-eeb00b3b75b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:52.152958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9e7b8-d5d8-43e8-a465-eeb00b3b75b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:52.154785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9e7b8-d5d8-43e8-a465-eeb00b3b75b2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:52.174323 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1427/2837] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:55:52.179619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55a267-e1c5-4034-870e-8cf6e506ce59 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:52.200840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55a267-e1c5-4034-870e-8cf6e506ce59 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:52.211525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fcd5f-6a35-40dd-b9d5-946374a8381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:52.212163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fcd5f-6a35-40dd-b9d5-946374a8381d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:52.212675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fcd5f-6a35-40dd-b9d5-946374a8381d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:52.212961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fcd5f-6a35-40dd-b9d5-946374a8381d admin admin] PATH_INFO: `/v3/projects/a21ad685432b436bb54779ab4a7a51a6/users/8ef4c9c43ab14136a3733d0462286d7f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:52.216720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fcd5f-6a35-40dd-b9d5-946374a8381d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21ad685432b436bb54779ab4a7a51a6, user_id=8ef4c9c43ab14136a3733d0462286d7f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:52.225200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fcd5f-6a35-40dd-b9d5-946374a8381d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:52.239109 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1411/2838] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:52 2022] PUT /identity/v3/projects/a21ad685432b436bb54779ab4a7a51a6/users/8ef4c9c43ab14136a3733d0462286d7f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:52.249378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831e49-af9c-462a-8483-4be1c7215f77 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:52.249659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831e49-af9c-462a-8483-4be1c7215f77 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:52.249937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831e49-af9c-462a-8483-4be1c7215f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:52.289430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ac831e49-af9c-462a-8483-4be1c7215f77 None None] MFA Rules not processed for user `8ef4c9c43ab14136a3733d0462286d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:52.291244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ac831e49-af9c-462a-8483-4be1c7215f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:52.397226 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1428/2839] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:52 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:53.863113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fcd5f-6a35-40dd-b9d5-946374a8381d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:53.869384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-586fcd5f-6a35-40dd-b9d5-946374a8381d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:54.018598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:54.066764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fcd5f-6a35-40dd-b9d5-946374a8381d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:54.074448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c7b35-0727-439c-8cda-9fafc0d95374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:54.075734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c7b35-0727-439c-8cda-9fafc0d95374 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:54.076215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c7b35-0727-439c-8cda-9fafc0d95374 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:54.076732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c7b35-0727-439c-8cda-9fafc0d95374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:54.158600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c7b35-0727-439c-8cda-9fafc0d95374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:54.161843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c7b35-0727-439c-8cda-9fafc0d95374 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:54.216803 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1412/2840] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:55:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:55:57.688182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b752fdd-3e9f-4645-9a07-d13237033e99 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:57.689380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b752fdd-3e9f-4645-9a07-d13237033e99 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:57.689883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b752fdd-3e9f-4645-9a07-d13237033e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:57.744893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7b752fdd-3e9f-4645-9a07-d13237033e99 None None] MFA Rules not processed for user `13d33648c2754ecdb00578d8256087ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:55:57.746163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7b752fdd-3e9f-4645-9a07-d13237033e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:57.794207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:55:57.896104 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1429/2841] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:55:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:55:57.897300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c7b35-0727-439c-8cda-9fafc0d95374 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:57.898846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-283c7b35-0727-439c-8cda-9fafc0d95374 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:55:58.006478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c7b35-0727-439c-8cda-9fafc0d95374 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:58.017018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5295ec-8c39-49ce-ad59-af3bdfed5d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:58.018413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5295ec-8c39-49ce-ad59-af3bdfed5d01 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:58.019373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5295ec-8c39-49ce-ad59-af3bdfed5d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:58.019828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5295ec-8c39-49ce-ad59-af3bdfed5d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:58.021257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5295ec-8c39-49ce-ad59-af3bdfed5d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:58.028334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5295ec-8c39-49ce-ad59-af3bdfed5d01 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:58.074391 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1413/2842] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:55:57 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:58.075760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b752fdd-3e9f-4645-9a07-d13237033e99 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:58.094193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b752fdd-3e9f-4645-9a07-d13237033e99 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:58.192633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880998c-7e7a-4b23-81ce-e89802d41658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:58.193771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880998c-7e7a-4b23-81ce-e89802d41658 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:58.193771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880998c-7e7a-4b23-81ce-e89802d41658 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:58.194079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880998c-7e7a-4b23-81ce-e89802d41658 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:58.194991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880998c-7e7a-4b23-81ce-e89802d41658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:58.198886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880998c-7e7a-4b23-81ce-e89802d41658 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:58.232918 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1430/2843] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:55:58 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:55:58.234255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5295ec-8c39-49ce-ad59-af3bdfed5d01 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:58.250479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5295ec-8c39-49ce-ad59-af3bdfed5d01 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:58.255537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6979d7-8580-48f0-8788-034fdacd1458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:58.256175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6979d7-8580-48f0-8788-034fdacd1458 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:58.256458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6979d7-8580-48f0-8788-034fdacd1458 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:58.256732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6979d7-8580-48f0-8788-034fdacd1458 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:58.257690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6979d7-8580-48f0-8788-034fdacd1458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:58.259852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6979d7-8580-48f0-8788-034fdacd1458 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:58.277592 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1414/2844] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:58.279163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880998c-7e7a-4b23-81ce-e89802d41658 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:58.325135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880998c-7e7a-4b23-81ce-e89802d41658 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:58.343346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2a558-5ea1-4911-8f11-cdbb8ab1bd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:58.346308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2a558-5ea1-4911-8f11-cdbb8ab1bd4e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:58.346830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2a558-5ea1-4911-8f11-cdbb8ab1bd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:58.347121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2a558-5ea1-4911-8f11-cdbb8ab1bd4e admin admin] PATH_INFO: `/v3/projects/8abcb355b5694afa997acce55aa6fad8/users/f9dc6636547a499b9c7b9fd13afd11e1/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:58.384187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2a558-5ea1-4911-8f11-cdbb8ab1bd4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abcb355b5694afa997acce55aa6fad8, user_id=f9dc6636547a499b9c7b9fd13afd11e1, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:58.386974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2a558-5ea1-4911-8f11-cdbb8ab1bd4e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:58.408643 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1431/2845] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:58 2022] PUT /identity/v3/projects/8abcb355b5694afa997acce55aa6fad8/users/f9dc6636547a499b9c7b9fd13afd11e1/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:55:58.412944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6979d7-8580-48f0-8788-034fdacd1458 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:58.425050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6979d7-8580-48f0-8788-034fdacd1458 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:58.506608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f1f9f-9482-4e1e-ac7b-f3626eaad75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:58.508355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f1f9f-9482-4e1e-ac7b-f3626eaad75e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:58.508697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f1f9f-9482-4e1e-ac7b-f3626eaad75e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:58.509159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f1f9f-9482-4e1e-ac7b-f3626eaad75e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:58.509834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f1f9f-9482-4e1e-ac7b-f3626eaad75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:58.511532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f1f9f-9482-4e1e-ac7b-f3626eaad75e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:58.525026 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1415/2846] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:55:58.528517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2a558-5ea1-4911-8f11-cdbb8ab1bd4e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:55:58.542190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2a558-5ea1-4911-8f11-cdbb8ab1bd4e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:55:58.552025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a11993-f5e9-4475-bb36-f50bac0b4585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:55:58.553119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a11993-f5e9-4475-bb36-f50bac0b4585 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:55:58.553565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a11993-f5e9-4475-bb36-f50bac0b4585 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:55:58.554024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a11993-f5e9-4475-bb36-f50bac0b4585 admin admin] PATH_INFO: `/v3/projects/8abcb355b5694afa997acce55aa6fad8/users/f9dc6636547a499b9c7b9fd13afd11e1/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:55:58.561186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a11993-f5e9-4475-bb36-f50bac0b4585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abcb355b5694afa997acce55aa6fad8, user_id=f9dc6636547a499b9c7b9fd13afd11e1, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:55:58.564475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a11993-f5e9-4475-bb36-f50bac0b4585 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:55:58.595466 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1432/2847] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:55:58 2022] PUT /identity/v3/projects/8abcb355b5694afa997acce55aa6fad8/users/f9dc6636547a499b9c7b9fd13afd11e1/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:00.627703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f1f9f-9482-4e1e-ac7b-f3626eaad75e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:00.635941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:00.922284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f1f9f-9482-4e1e-ac7b-f3626eaad75e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:01.064774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58612-d14b-4ef4-95ef-f3bf8ddfd03f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:01.065931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58612-d14b-4ef4-95ef-f3bf8ddfd03f service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:01.067423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58612-d14b-4ef4-95ef-f3bf8ddfd03f service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:01.067885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58612-d14b-4ef4-95ef-f3bf8ddfd03f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:01.179132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df58612-d14b-4ef4-95ef-f3bf8ddfd03f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:01.185378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df58612-d14b-4ef4-95ef-f3bf8ddfd03f service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:01.201800 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1416/2848] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:00 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:08.587588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=61,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:08.748106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43567563-7499-43dc-a628-e23b5e1d390f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:08.748563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43567563-7499-43dc-a628-e23b5e1d390f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:08.748989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43567563-7499-43dc-a628-e23b5e1d390f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:08.800154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-43567563-7499-43dc-a628-e23b5e1d390f None None] MFA Rules not processed for user `f9dc6636547a499b9c7b9fd13afd11e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:08.801119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-43567563-7499-43dc-a628-e23b5e1d390f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:08.971481 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1433/2849] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:09.135474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58612-d14b-4ef4-95ef-f3bf8ddfd03f service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:09.136794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1df58612-d14b-4ef4-95ef-f3bf8ddfd03f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:09.158138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58612-d14b-4ef4-95ef-f3bf8ddfd03f service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:09.171714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a566c5-63d5-475a-848f-485a8c507584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:09.172669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a566c5-63d5-475a-848f-485a8c507584 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:09.173124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a566c5-63d5-475a-848f-485a8c507584 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:09.173640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a566c5-63d5-475a-848f-485a8c507584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:09.233923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:09.281880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a566c5-63d5-475a-848f-485a8c507584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:09.284530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a566c5-63d5-475a-848f-485a8c507584 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:09.324423 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1417/2850] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:11.827200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6d814-8591-43ac-8cae-b761410b6f8c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:11.828276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6d814-8591-43ac-8cae-b761410b6f8c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:11.828588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6d814-8591-43ac-8cae-b761410b6f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:11.861286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5ea6d814-8591-43ac-8cae-b761410b6f8c None None] MFA Rules not processed for user `13d33648c2754ecdb00578d8256087ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:11.863126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5ea6d814-8591-43ac-8cae-b761410b6f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:11.874070 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1434/2851] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:12.448838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a566c5-63d5-475a-848f-485a8c507584 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:12.486641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030d810-8b49-442d-a6c5-69dbc10e690f None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:12.487596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030d810-8b49-442d-a6c5-69dbc10e690f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:12.487887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030d810-8b49-442d-a6c5-69dbc10e690f None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:12.494916 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1435/2852] 10.222.0.70 () {54 vars in 921 bytes} [Sun Aug 28 18:56:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 18:56:12.526062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f76701-bbbe-45dc-8752-2c9281a741f2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:12.527029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f76701-bbbe-45dc-8752-2c9281a741f2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:12.527409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f76701-bbbe-45dc-8752-2c9281a741f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:12.565690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a566c5-63d5-475a-848f-485a8c507584 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:12.568828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-01f76701-bbbe-45dc-8752-2c9281a741f2 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:12.576669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-01f76701-bbbe-45dc-8752-2c9281a741f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:12.585575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7288d8e-56b6-4c4a-a30e-baea1d70c2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:12.586400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7288d8e-56b6-4c4a-a30e-baea1d70c2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:12.587992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7288d8e-56b6-4c4a-a30e-baea1d70c2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:12.588277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7288d8e-56b6-4c4a-a30e-baea1d70c2cd admin admin] PATH_INFO: `/v3/users/8acfdba9d71b4e3da063f7e0a2af1bb8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:12.592068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7288d8e-56b6-4c4a-a30e-baea1d70c2cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8acfdba9d71b4e3da063f7e0a2af1bb8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:12.595242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7288d8e-56b6-4c4a-a30e-baea1d70c2cd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:12.700084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f7288d8e-56b6-4c4a-a30e-baea1d70c2cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8acfdba9d71b4e3da063f7e0a2af1bb8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.709781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f7288d8e-56b6-4c4a-a30e-baea1d70c2cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8acfdba9d71b4e3da063f7e0a2af1bb8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.710788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f7288d8e-56b6-4c4a-a30e-baea1d70c2cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8acfdba9d71b4e3da063f7e0a2af1bb8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.727986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f7288d8e-56b6-4c4a-a30e-baea1d70c2cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8acfdba9d71b4e3da063f7e0a2af1bb8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.731679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f7288d8e-56b6-4c4a-a30e-baea1d70c2cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8acfdba9d71b4e3da063f7e0a2af1bb8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:12.738344 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1436/2853] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:56:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:12.742275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f76701-bbbe-45dc-8752-2c9281a741f2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:12.743806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-01f76701-bbbe-45dc-8752-2c9281a741f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:12.749479 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1418/2854] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:56:12 2022] DELETE /identity/v3/users/8acfdba9d71b4e3da063f7e0a2af1bb8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:12.753663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd533e34-2dae-4683-a7f1-3483d5761917 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:12.753955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd533e34-2dae-4683-a7f1-3483d5761917 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:12.754238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd533e34-2dae-4683-a7f1-3483d5761917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:12.777084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f76701-bbbe-45dc-8752-2c9281a741f2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:12.808001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-dd533e34-2dae-4683-a7f1-3483d5761917 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:12.810915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dd533e34-2dae-4683-a7f1-3483d5761917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:12.896931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:12.938880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:12.939757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:12.940047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:12.940383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] PATH_INFO: `/v3/users/102d38fe9024425e951b363a86012209` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:12.941750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=102d38fe9024425e951b363a86012209)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:12.946031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:12.951636 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1419/2855] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:12.952777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd533e34-2dae-4683-a7f1-3483d5761917 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:12.955196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dd533e34-2dae-4683-a7f1-3483d5761917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:12.993213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:13.071481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102d38fe9024425e951b363a86012209'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:13.089305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102d38fe9024425e951b363a86012209'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:13.090920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102d38fe9024425e951b363a86012209'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:13.111989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102d38fe9024425e951b363a86012209'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:13.112742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102d38fe9024425e951b363a86012209'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:13.143745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd533e34-2dae-4683-a7f1-3483d5761917 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:13.150092 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1437/2856] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:56:12 2022] DELETE /identity/v3/users/102d38fe9024425e951b363a86012209 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:13.151042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f21dca-a744-4422-8dc7-da4bd728a9b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:13.151183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:13.151673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f21dca-a744-4422-8dc7-da4bd728a9b2 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:13.151957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f21dca-a744-4422-8dc7-da4bd728a9b2 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:13.152232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f21dca-a744-4422-8dc7-da4bd728a9b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:13.152470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:13.154081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-97f21dca-a744-4422-8dc7-da4bd728a9b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:13.182341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f21dca-a744-4422-8dc7-da4bd728a9b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:13.184152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f21dca-a744-4422-8dc7-da4bd728a9b2 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:13.231523 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1420/2857] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:13.268241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9440460-9346-43a1-a118-dd0db96f9849 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:13.281550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a04a93-dde2-4a49-9f02-08e4231866df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:13.282193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a04a93-dde2-4a49-9f02-08e4231866df service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:13.282481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a04a93-dde2-4a49-9f02-08e4231866df service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:13.283242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a04a93-dde2-4a49-9f02-08e4231866df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:13.290033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-67a04a93-dde2-4a49-9f02-08e4231866df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:13.459806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a04a93-dde2-4a49-9f02-08e4231866df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:13.462330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a04a93-dde2-4a49-9f02-08e4231866df service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:13.482333 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1438/2858] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:13.674377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f21dca-a744-4422-8dc7-da4bd728a9b2 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:13.676390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-97f21dca-a744-4422-8dc7-da4bd728a9b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:13.718995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f21dca-a744-4422-8dc7-da4bd728a9b2 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:13.725951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7a414-159e-496f-9f62-808a498f416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:13.726895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7a414-159e-496f-9f62-808a498f416d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:13.728025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7a414-159e-496f-9f62-808a498f416d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:13.728567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7a414-159e-496f-9f62-808a498f416d admin admin] PATH_INFO: `/v3/projects/056db27589c84317a79c4426d8e8436a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:13.729984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7a414-159e-496f-9f62-808a498f416d admin admin] RBAC: Authorizing `identity:delete_project(project_id=056db27589c84317a79c4426d8e8436a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:13.732147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7a414-159e-496f-9f62-808a498f416d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:13.831851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9b7a414-159e-496f-9f62-808a498f416d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056db27589c84317a79c4426d8e8436a', 'request_id': 'req-f9b7a414-159e-496f-9f62-808a498f416d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:13.844391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9b7a414-159e-496f-9f62-808a498f416d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056db27589c84317a79c4426d8e8436a', 'request_id': 'req-f9b7a414-159e-496f-9f62-808a498f416d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:13.851940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9b7a414-159e-496f-9f62-808a498f416d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056db27589c84317a79c4426d8e8436a', 'request_id': 'req-f9b7a414-159e-496f-9f62-808a498f416d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:13.864079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9b7a414-159e-496f-9f62-808a498f416d admin admin] The token cache is being invalidate because project 056db27589c84317a79c4426d8e8436a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:56:13.865127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9b7a414-159e-496f-9f62-808a498f416d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:13.865444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9b7a414-159e-496f-9f62-808a498f416d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:13.868271 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1421/2859] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:56:13 2022] DELETE /identity/v3/projects/056db27589c84317a79c4426d8e8436a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:13.874773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aed82b-95a5-4918-8c94-2a8b036bdd45 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:13.875068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aed82b-95a5-4918-8c94-2a8b036bdd45 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:13.875348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aed82b-95a5-4918-8c94-2a8b036bdd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:13.896402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e4aed82b-95a5-4918-8c94-2a8b036bdd45 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:13.898136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e4aed82b-95a5-4918-8c94-2a8b036bdd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:13.946455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:13.970878 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1439/2860] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:13.979375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23691b57-eab3-478e-b005-53769c308ff6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:13.980035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23691b57-eab3-478e-b005-53769c308ff6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:13.980558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23691b57-eab3-478e-b005-53769c308ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.010103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-23691b57-eab3-478e-b005-53769c308ff6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:14.011935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-23691b57-eab3-478e-b005-53769c308ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:14.028168 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1422/2861] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:56:14.032884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aed82b-95a5-4918-8c94-2a8b036bdd45 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:14.045469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aed82b-95a5-4918-8c94-2a8b036bdd45 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:14.050797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39224d-2eec-467d-9890-3c009716f3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:14.051414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39224d-2eec-467d-9890-3c009716f3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:14.051721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39224d-2eec-467d-9890-3c009716f3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:14.051969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39224d-2eec-467d-9890-3c009716f3d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.052609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39224d-2eec-467d-9890-3c009716f3d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:56:14.052913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39224d-2eec-467d-9890-3c009716f3d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:14.055430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39224d-2eec-467d-9890-3c009716f3d3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:14.071866 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1440/2862] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:56:14.077096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23691b57-eab3-478e-b005-53769c308ff6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:14.094574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23691b57-eab3-478e-b005-53769c308ff6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:14.103510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691185c0-b58f-4859-9e6f-7cc9129579e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:14.104900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691185c0-b58f-4859-9e6f-7cc9129579e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:14.105322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691185c0-b58f-4859-9e6f-7cc9129579e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:14.105696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691185c0-b58f-4859-9e6f-7cc9129579e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.106457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691185c0-b58f-4859-9e6f-7cc9129579e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:14.108710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691185c0-b58f-4859-9e6f-7cc9129579e7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:14.157163 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1423/2863] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:56:14 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:14.162301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39224d-2eec-467d-9890-3c009716f3d3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:14.180540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39224d-2eec-467d-9890-3c009716f3d3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:14.282486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84387436-b91b-43a4-a366-4df5a2f45fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:14.283464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84387436-b91b-43a4-a366-4df5a2f45fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:14.283746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84387436-b91b-43a4-a366-4df5a2f45fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:14.284373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84387436-b91b-43a4-a366-4df5a2f45fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.284970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84387436-b91b-43a4-a366-4df5a2f45fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:14.287028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84387436-b91b-43a4-a366-4df5a2f45fc6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:14.315950 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1441/2864] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:56:14 2022] POST /identity/v3/users => generated 284 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:14.318381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691185c0-b58f-4859-9e6f-7cc9129579e7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:14.343732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691185c0-b58f-4859-9e6f-7cc9129579e7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:14.349140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411f28b-4d92-48c0-bc94-520d4f421c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:14.349791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411f28b-4d92-48c0-bc94-520d4f421c50 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:14.350079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411f28b-4d92-48c0-bc94-520d4f421c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:14.350373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411f28b-4d92-48c0-bc94-520d4f421c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.352444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411f28b-4d92-48c0-bc94-520d4f421c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:14.354293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411f28b-4d92-48c0-bc94-520d4f421c50 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:14.370805 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1424/2865] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:14.372154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84387436-b91b-43a4-a366-4df5a2f45fc6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:14.384824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84387436-b91b-43a4-a366-4df5a2f45fc6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:14.394807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859a0bf-99d8-48bd-9eef-227f0fae28f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:14.396257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859a0bf-99d8-48bd-9eef-227f0fae28f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:14.396558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859a0bf-99d8-48bd-9eef-227f0fae28f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:14.397091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859a0bf-99d8-48bd-9eef-227f0fae28f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.400516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859a0bf-99d8-48bd-9eef-227f0fae28f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:14.404538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859a0bf-99d8-48bd-9eef-227f0fae28f4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:14.426402 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1442/2866] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:14.428344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411f28b-4d92-48c0-bc94-520d4f421c50 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:14.443351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411f28b-4d92-48c0-bc94-520d4f421c50 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:14.455393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb40052-f46e-4117-8c8e-7a758c22b9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:14.456887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb40052-f46e-4117-8c8e-7a758c22b9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:14.457180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb40052-f46e-4117-8c8e-7a758c22b9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:14.457465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb40052-f46e-4117-8c8e-7a758c22b9b3 admin admin] PATH_INFO: `/v3/projects/a71cd8d737d7477f8c4536defbf8f39d/users/d049efd2598f4a528d68972936643fd5/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.658534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb40052-f46e-4117-8c8e-7a758c22b9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a71cd8d737d7477f8c4536defbf8f39d, user_id=d049efd2598f4a528d68972936643fd5, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:14.662061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb40052-f46e-4117-8c8e-7a758c22b9b3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:14.683218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:14.692068 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1425/2867] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:14 2022] PUT /identity/v3/projects/a71cd8d737d7477f8c4536defbf8f39d/users/d049efd2598f4a528d68972936643fd5/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:56:14.697952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f31b9-9dbe-41db-9cd1-5eddaae292dc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:14.698458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f31b9-9dbe-41db-9cd1-5eddaae292dc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:14.698902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f31b9-9dbe-41db-9cd1-5eddaae292dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.724292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-748f31b9-9dbe-41db-9cd1-5eddaae292dc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:14.726125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-748f31b9-9dbe-41db-9cd1-5eddaae292dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:14.812093 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1443/2868] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:14.841730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb40052-f46e-4117-8c8e-7a758c22b9b3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:14.843690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8bb40052-f46e-4117-8c8e-7a758c22b9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:14.918093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb40052-f46e-4117-8c8e-7a758c22b9b3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:14.921958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0af72-2192-41c7-94b4-1ec38d71549b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:14.922592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0af72-2192-41c7-94b4-1ec38d71549b service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:14.922949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0af72-2192-41c7-94b4-1ec38d71549b service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:14.923175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0af72-2192-41c7-94b4-1ec38d71549b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:14.933680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0af72-2192-41c7-94b4-1ec38d71549b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:14.935292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0af72-2192-41c7-94b4-1ec38d71549b service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:14.946778 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1426/2869] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:56:15.637398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f31b9-9dbe-41db-9cd1-5eddaae292dc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:15.638960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-748f31b9-9dbe-41db-9cd1-5eddaae292dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:15.666888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f31b9-9dbe-41db-9cd1-5eddaae292dc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:15.674351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:15.675055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:15.675373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:15.675628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] PATH_INFO: `/v3/projects/7b350af2d9b04fc89f76252eec333d7d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:15.679992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b350af2d9b04fc89f76252eec333d7d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:15.688707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:15.779789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:15.784765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b350af2d9b04fc89f76252eec333d7d', 'request_id': 'req-050045f3-3c18-46c1-9858-0eb3b2c8fe15'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:15.799448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b350af2d9b04fc89f76252eec333d7d', 'request_id': 'req-050045f3-3c18-46c1-9858-0eb3b2c8fe15'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:15.808199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b350af2d9b04fc89f76252eec333d7d', 'request_id': 'req-050045f3-3c18-46c1-9858-0eb3b2c8fe15'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:15.828001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] The token cache is being invalidate because project 7b350af2d9b04fc89f76252eec333d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:56:15.828324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:15.829034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:15.831499 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1444/2870] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:56:15 2022] DELETE /identity/v3/projects/7b350af2d9b04fc89f76252eec333d7d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:15.838693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0af72-2192-41c7-94b4-1ec38d71549b service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:15.852177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0af72-2192-41c7-94b4-1ec38d71549b service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:15.935229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef02fb-b290-4fd8-908e-be0ab84621e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:15.936934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef02fb-b290-4fd8-908e-be0ab84621e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:15.937108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef02fb-b290-4fd8-908e-be0ab84621e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:15.937569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef02fb-b290-4fd8-908e-be0ab84621e3 admin admin] PATH_INFO: `/v3/users/8ef4c9c43ab14136a3733d0462286d7f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:15.939081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef02fb-b290-4fd8-908e-be0ab84621e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef4c9c43ab14136a3733d0462286d7f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:15.941455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef02fb-b290-4fd8-908e-be0ab84621e3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:16.027109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-88ef02fb-b290-4fd8-908e-be0ab84621e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef4c9c43ab14136a3733d0462286d7f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:16.040342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-88ef02fb-b290-4fd8-908e-be0ab84621e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef4c9c43ab14136a3733d0462286d7f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:16.042575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-88ef02fb-b290-4fd8-908e-be0ab84621e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef4c9c43ab14136a3733d0462286d7f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:16.065269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-88ef02fb-b290-4fd8-908e-be0ab84621e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef4c9c43ab14136a3733d0462286d7f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:16.066294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-88ef02fb-b290-4fd8-908e-be0ab84621e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef4c9c43ab14136a3733d0462286d7f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:16.108841 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1427/2871] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:56:15 2022] DELETE /identity/v3/users/8ef4c9c43ab14136a3733d0462286d7f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:17.083986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:17.085550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:17.108570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050045f3-3c18-46c1-9858-0eb3b2c8fe15 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:17.186856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fad1f5-bbfa-4208-b84b-4f8559196217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:17.187923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fad1f5-bbfa-4208-b84b-4f8559196217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:17.188442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fad1f5-bbfa-4208-b84b-4f8559196217 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:17.188925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fad1f5-bbfa-4208-b84b-4f8559196217 admin admin] PATH_INFO: `/v3/projects/a21ad685432b436bb54779ab4a7a51a6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:17.190583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fad1f5-bbfa-4208-b84b-4f8559196217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21ad685432b436bb54779ab4a7a51a6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:17.193047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fad1f5-bbfa-4208-b84b-4f8559196217 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:17.252717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-34fad1f5-bbfa-4208-b84b-4f8559196217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21ad685432b436bb54779ab4a7a51a6', 'request_id': 'req-34fad1f5-bbfa-4208-b84b-4f8559196217'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:17.259971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-34fad1f5-bbfa-4208-b84b-4f8559196217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21ad685432b436bb54779ab4a7a51a6', 'request_id': 'req-34fad1f5-bbfa-4208-b84b-4f8559196217'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:17.268757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-34fad1f5-bbfa-4208-b84b-4f8559196217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21ad685432b436bb54779ab4a7a51a6', 'request_id': 'req-34fad1f5-bbfa-4208-b84b-4f8559196217'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:17.310926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-34fad1f5-bbfa-4208-b84b-4f8559196217 admin admin] The token cache is being invalidate because project a21ad685432b436bb54779ab4a7a51a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:56:17.311271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-34fad1f5-bbfa-4208-b84b-4f8559196217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:17.312183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-34fad1f5-bbfa-4208-b84b-4f8559196217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:17.320254 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1445/2872] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:56:17 2022] DELETE /identity/v3/projects/a21ad685432b436bb54779ab4a7a51a6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:17.320819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe8854-04d5-4c20-885b-c57f69f01688 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:17.321326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe8854-04d5-4c20-885b-c57f69f01688 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:17.321410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe8854-04d5-4c20-885b-c57f69f01688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:17.361722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6afe8854-04d5-4c20-885b-c57f69f01688 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:17.363232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6afe8854-04d5-4c20-885b-c57f69f01688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:17.393155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:17.503114 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1428/2873] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:56:17.510436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95cda-0f36-4970-a8f0-f0e60f333787 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:17.510724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95cda-0f36-4970-a8f0-f0e60f333787 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:17.511035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95cda-0f36-4970-a8f0-f0e60f333787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:17.552495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ccf95cda-0f36-4970-a8f0-f0e60f333787 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:17.554770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ccf95cda-0f36-4970-a8f0-f0e60f333787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:17.580522 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1446/2874] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:17.584589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe8854-04d5-4c20-885b-c57f69f01688 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:17.599748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe8854-04d5-4c20-885b-c57f69f01688 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:17.617906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ace76-e39b-41c3-9b07-2c89f175d626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:17.620347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ace76-e39b-41c3-9b07-2c89f175d626 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:17.623073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ace76-e39b-41c3-9b07-2c89f175d626 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:17.623407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ace76-e39b-41c3-9b07-2c89f175d626 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:17.625357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ace76-e39b-41c3-9b07-2c89f175d626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:56:17.625731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ace76-e39b-41c3-9b07-2c89f175d626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:17.628523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ace76-e39b-41c3-9b07-2c89f175d626 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:17.663763 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1429/2875] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:56:17.664645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf95cda-0f36-4970-a8f0-f0e60f333787 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:17.686489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf95cda-0f36-4970-a8f0-f0e60f333787 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:17.693108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d2d94-23d8-4e21-89a3-4b953b465320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:17.694343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d2d94-23d8-4e21-89a3-4b953b465320 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:17.694649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d2d94-23d8-4e21-89a3-4b953b465320 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:17.695010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d2d94-23d8-4e21-89a3-4b953b465320 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:17.695684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d2d94-23d8-4e21-89a3-4b953b465320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:17.699323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d2d94-23d8-4e21-89a3-4b953b465320 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:17.782881 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1447/2876] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:56:17 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:56:17.785026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ace76-e39b-41c3-9b07-2c89f175d626 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:17.798002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ace76-e39b-41c3-9b07-2c89f175d626 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:17.904592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9fb28-8ec9-49cb-a97f-9905c349c837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:17.905952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9fb28-8ec9-49cb-a97f-9905c349c837 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:17.906412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9fb28-8ec9-49cb-a97f-9905c349c837 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:17.906893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9fb28-8ec9-49cb-a97f-9905c349c837 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:17.907778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9fb28-8ec9-49cb-a97f-9905c349c837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:17.911276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9fb28-8ec9-49cb-a97f-9905c349c837 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:17.954102 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1430/2877] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:56:17 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:17.958983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d2d94-23d8-4e21-89a3-4b953b465320 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:17.976069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d2d94-23d8-4e21-89a3-4b953b465320 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:17.985573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b74b9-544b-437b-b657-d06180660bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:17.986366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b74b9-544b-437b-b657-d06180660bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:17.986672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b74b9-544b-437b-b657-d06180660bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:17.987026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b74b9-544b-437b-b657-d06180660bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:17.988000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b74b9-544b-437b-b657-d06180660bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:17.990342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b74b9-544b-437b-b657-d06180660bb5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:18.010933 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1448/2878] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:18.012685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9fb28-8ec9-49cb-a97f-9905c349c837 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:18.041242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9fb28-8ec9-49cb-a97f-9905c349c837 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:18.067682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4302bf-d538-4059-8bb8-7e8972d783a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:18.070035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4302bf-d538-4059-8bb8-7e8972d783a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:18.070505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4302bf-d538-4059-8bb8-7e8972d783a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:18.076843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4302bf-d538-4059-8bb8-7e8972d783a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:18.077826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4302bf-d538-4059-8bb8-7e8972d783a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:18.079907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4302bf-d538-4059-8bb8-7e8972d783a7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:18.122395 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1431/2879] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:18.123105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b74b9-544b-437b-b657-d06180660bb5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:18.138077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b74b9-544b-437b-b657-d06180660bb5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:18.151919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8885618-872d-421c-9052-6552f89d85a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:18.152883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8885618-872d-421c-9052-6552f89d85a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:18.153496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8885618-872d-421c-9052-6552f89d85a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:18.154048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8885618-872d-421c-9052-6552f89d85a6 admin admin] PATH_INFO: `/v3/projects/e7bcb4bc729448d0a6e6913d89f76e78/users/ab694f38b57c4283be1582ce02008978/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:18.183344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8885618-872d-421c-9052-6552f89d85a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7bcb4bc729448d0a6e6913d89f76e78, user_id=ab694f38b57c4283be1582ce02008978, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:18.189491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8885618-872d-421c-9052-6552f89d85a6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:18.207092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:18.219796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e67414-950d-47c4-9ead-b41645619a57 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:18.220291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e67414-950d-47c4-9ead-b41645619a57 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:18.220901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e67414-950d-47c4-9ead-b41645619a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:18.224702 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1449/2880] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:18 2022] PUT /identity/v3/projects/e7bcb4bc729448d0a6e6913d89f76e78/users/ab694f38b57c4283be1582ce02008978/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:18.265875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-50e67414-950d-47c4-9ead-b41645619a57 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:18.268042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-50e67414-950d-47c4-9ead-b41645619a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:18.385122 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1432/2881] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:18.390573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8885618-872d-421c-9052-6552f89d85a6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:18.394852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e8885618-872d-421c-9052-6552f89d85a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:18.579825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8885618-872d-421c-9052-6552f89d85a6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:18.596728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72db63-536e-4117-b34f-6a6b14391c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:18.598294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72db63-536e-4117-b34f-6a6b14391c1e service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:18.598810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72db63-536e-4117-b34f-6a6b14391c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:18.599248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72db63-536e-4117-b34f-6a6b14391c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:18.618462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72db63-536e-4117-b34f-6a6b14391c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:18.621690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72db63-536e-4117-b34f-6a6b14391c1e service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:18.644394 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1450/2882] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:23.063360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771628ea-a329-4ddb-9d49-139c169e707d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:23.063928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771628ea-a329-4ddb-9d49-139c169e707d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:23.063928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771628ea-a329-4ddb-9d49-139c169e707d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:23.140532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-771628ea-a329-4ddb-9d49-139c169e707d None None] MFA Rules not processed for user `d049efd2598f4a528d68972936643fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:23.144994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-771628ea-a329-4ddb-9d49-139c169e707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:23.187254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:23.313380 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1433/2883] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:23.326058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f2df3-31d8-4957-80f6-33ff2a127e90 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:23.327243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f2df3-31d8-4957-80f6-33ff2a127e90 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:23.327692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f2df3-31d8-4957-80f6-33ff2a127e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:23.356387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1a1f2df3-31d8-4957-80f6-33ff2a127e90 None None] MFA Rules not processed for user `d049efd2598f4a528d68972936643fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:23.357993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1a1f2df3-31d8-4957-80f6-33ff2a127e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:23.372802 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1451/2884] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:26.062338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771628ea-a329-4ddb-9d49-139c169e707d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:26.066119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-771628ea-a329-4ddb-9d49-139c169e707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:26.388752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771628ea-a329-4ddb-9d49-139c169e707d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:26.411615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64fc5d-5946-4985-9074-df7145912742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:26.413383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64fc5d-5946-4985-9074-df7145912742 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:26.414106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64fc5d-5946-4985-9074-df7145912742 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:26.414619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64fc5d-5946-4985-9074-df7145912742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:26.433423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64fc5d-5946-4985-9074-df7145912742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:26.435394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64fc5d-5946-4985-9074-df7145912742 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:26.480572 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1434/2885] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:30.734866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57850ea8-b781-40c3-b27c-a47418501869 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:30.735913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57850ea8-b781-40c3-b27c-a47418501869 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:30.736390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57850ea8-b781-40c3-b27c-a47418501869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:30.770813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-57850ea8-b781-40c3-b27c-a47418501869 None None] MFA Rules not processed for user `ab694f38b57c4283be1582ce02008978`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:30.773119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-57850ea8-b781-40c3-b27c-a47418501869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:30.881217 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1452/2886] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:30.883388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64fc5d-5946-4985-9074-df7145912742 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:30.895955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64fc5d-5946-4985-9074-df7145912742 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:30.902692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df6e84-5272-4f69-8108-0b5fdb60627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:30.903574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6e84-5272-4f69-8108-0b5fdb60627a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:30.904006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6e84-5272-4f69-8108-0b5fdb60627a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:30.904562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df6e84-5272-4f69-8108-0b5fdb60627a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:30.905357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df6e84-5272-4f69-8108-0b5fdb60627a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:30.908063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df6e84-5272-4f69-8108-0b5fdb60627a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:30.962825 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1435/2887] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:56:30 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:30.967388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57850ea8-b781-40c3-b27c-a47418501869 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:30.999727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57850ea8-b781-40c3-b27c-a47418501869 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:31.072525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73424e2b-bb6b-424a-9ba5-79088e7d22e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:31.073657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73424e2b-bb6b-424a-9ba5-79088e7d22e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:31.073657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73424e2b-bb6b-424a-9ba5-79088e7d22e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:31.073893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73424e2b-bb6b-424a-9ba5-79088e7d22e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:31.074909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73424e2b-bb6b-424a-9ba5-79088e7d22e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:31.077410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73424e2b-bb6b-424a-9ba5-79088e7d22e3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:31.152643 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1453/2888] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:56:30 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:31.153706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df6e84-5272-4f69-8108-0b5fdb60627a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:31.171498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df6e84-5272-4f69-8108-0b5fdb60627a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:31.178944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2813d-4062-48ce-9eaa-c310e5c82b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:31.179955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2813d-4062-48ce-9eaa-c310e5c82b0e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:31.180320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2813d-4062-48ce-9eaa-c310e5c82b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:31.180665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2813d-4062-48ce-9eaa-c310e5c82b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:31.181394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2813d-4062-48ce-9eaa-c310e5c82b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:31.189004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2813d-4062-48ce-9eaa-c310e5c82b0e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:31.214407 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1436/2889] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:31.218466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73424e2b-bb6b-424a-9ba5-79088e7d22e3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:31.233267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73424e2b-bb6b-424a-9ba5-79088e7d22e3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:31.248374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a5c5c-7ab5-4b29-a938-3a66a2882307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:31.249082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a5c5c-7ab5-4b29-a938-3a66a2882307 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:31.249354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a5c5c-7ab5-4b29-a938-3a66a2882307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:31.249639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a5c5c-7ab5-4b29-a938-3a66a2882307 admin admin] PATH_INFO: `/v3/projects/c7a7280abc094c989fb691fdbc1fa57e/users/b55fc4046f834aa0b2e34c08d5e1b096/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:31.274998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:31.281461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a5c5c-7ab5-4b29-a938-3a66a2882307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a7280abc094c989fb691fdbc1fa57e, user_id=b55fc4046f834aa0b2e34c08d5e1b096, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:31.288452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a5c5c-7ab5-4b29-a938-3a66a2882307 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:31.324963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2813d-4062-48ce-9eaa-c310e5c82b0e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:31.330805 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1454/2890] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:31 2022] PUT /identity/v3/projects/c7a7280abc094c989fb691fdbc1fa57e/users/b55fc4046f834aa0b2e34c08d5e1b096/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:56:31.342332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2813d-4062-48ce-9eaa-c310e5c82b0e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:31.484036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681a0ab-1a5f-4716-a32a-15f09ec0aabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:31.484773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681a0ab-1a5f-4716-a32a-15f09ec0aabd admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:31.485028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681a0ab-1a5f-4716-a32a-15f09ec0aabd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:31.485318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681a0ab-1a5f-4716-a32a-15f09ec0aabd admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:31.486574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681a0ab-1a5f-4716-a32a-15f09ec0aabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:31.489207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681a0ab-1a5f-4716-a32a-15f09ec0aabd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:31.509063 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1437/2891] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:31.510327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a5c5c-7ab5-4b29-a938-3a66a2882307 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:31.529027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a5c5c-7ab5-4b29-a938-3a66a2882307 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:31.537863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e12ab1-b7eb-4d9d-9e22-e92b6e800b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:31.538823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e12ab1-b7eb-4d9d-9e22-e92b6e800b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:31.539106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e12ab1-b7eb-4d9d-9e22-e92b6e800b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:31.539380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e12ab1-b7eb-4d9d-9e22-e92b6e800b45 admin admin] PATH_INFO: `/v3/projects/c7a7280abc094c989fb691fdbc1fa57e/users/b55fc4046f834aa0b2e34c08d5e1b096/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:31.541505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e12ab1-b7eb-4d9d-9e22-e92b6e800b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a7280abc094c989fb691fdbc1fa57e, user_id=b55fc4046f834aa0b2e34c08d5e1b096, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:31.544439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e12ab1-b7eb-4d9d-9e22-e92b6e800b45 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:31.582703 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1455/2892] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:31 2022] PUT /identity/v3/projects/c7a7280abc094c989fb691fdbc1fa57e/users/b55fc4046f834aa0b2e34c08d5e1b096/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:39.223687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8825736-0596-4544-9aeb-2e7b934b6d23 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:39.224431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8825736-0596-4544-9aeb-2e7b934b6d23 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:39.224431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8825736-0596-4544-9aeb-2e7b934b6d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:39.245157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:39.274513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f8825736-0596-4544-9aeb-2e7b934b6d23 None None] MFA Rules not processed for user `b55fc4046f834aa0b2e34c08d5e1b096`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:39.276301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f8825736-0596-4544-9aeb-2e7b934b6d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:39.449148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de78bc-adb4-48b7-a536-d66e3594dddb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:39.449661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de78bc-adb4-48b7-a536-d66e3594dddb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:39.449748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de78bc-adb4-48b7-a536-d66e3594dddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:39.455055 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1438/2893] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:39.492473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-66de78bc-adb4-48b7-a536-d66e3594dddb None None] MFA Rules not processed for user `ab694f38b57c4283be1582ce02008978`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:39.495147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-66de78bc-adb4-48b7-a536-d66e3594dddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:39.610013 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1456/2894] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:42.960383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8825736-0596-4544-9aeb-2e7b934b6d23 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:42.962181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f8825736-0596-4544-9aeb-2e7b934b6d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:43.109847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8825736-0596-4544-9aeb-2e7b934b6d23 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:43.116768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f526e9e-d08d-4663-9e7a-842b5edccdaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:43.117599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f526e9e-d08d-4663-9e7a-842b5edccdaa service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:43.117979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f526e9e-d08d-4663-9e7a-842b5edccdaa service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:43.118368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f526e9e-d08d-4663-9e7a-842b5edccdaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:43.131821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f526e9e-d08d-4663-9e7a-842b5edccdaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:43.135427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f526e9e-d08d-4663-9e7a-842b5edccdaa service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:43.167161 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1439/2895] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:45.512995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce63da-cab5-4613-aa39-bb02cfef2a11 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:45.515169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce63da-cab5-4613-aa39-bb02cfef2a11 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:45.515664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce63da-cab5-4613-aa39-bb02cfef2a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:45.559391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-34ce63da-cab5-4613-aa39-bb02cfef2a11 None None] MFA Rules not processed for user `b05e0387a6b84cdb9b1b59dae6281802`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:45.560669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-34ce63da-cab5-4613-aa39-bb02cfef2a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:45.700885 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1457/2896] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:46.830531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f526e9e-d08d-4663-9e7a-842b5edccdaa service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:46.906147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f526e9e-d08d-4663-9e7a-842b5edccdaa service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:46.911594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1181385-5f76-47a6-9555-6523c332b1f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:46.913533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1181385-5f76-47a6-9555-6523c332b1f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:46.914047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1181385-5f76-47a6-9555-6523c332b1f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:46.914546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1181385-5f76-47a6-9555-6523c332b1f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:46.919125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b1181385-5f76-47a6-9555-6523c332b1f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:46.938018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1181385-5f76-47a6-9555-6523c332b1f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:46.938288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1181385-5f76-47a6-9555-6523c332b1f1 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:46.952583 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1440/2897] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:49.524045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce63da-cab5-4613-aa39-bb02cfef2a11 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:49.541073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce63da-cab5-4613-aa39-bb02cfef2a11 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:49.548191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded4855-fa44-4b25-b260-cd5f78732591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:49.568114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded4855-fa44-4b25-b260-cd5f78732591 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:49.570528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded4855-fa44-4b25-b260-cd5f78732591 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:49.570852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded4855-fa44-4b25-b260-cd5f78732591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:49.578459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ded4855-fa44-4b25-b260-cd5f78732591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:49.621142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded4855-fa44-4b25-b260-cd5f78732591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:49.625361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded4855-fa44-4b25-b260-cd5f78732591 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:49.703137 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1458/2898] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:49.986290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf87420-f114-4934-92d3-c3a67e315f0d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:49.987329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf87420-f114-4934-92d3-c3a67e315f0d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:49.987547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf87420-f114-4934-92d3-c3a67e315f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.024669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ccf87420-f114-4934-92d3-c3a67e315f0d None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:50.026394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ccf87420-f114-4934-92d3-c3a67e315f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:50.055165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:50.135641 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1441/2899] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:56:50.215414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded4855-fa44-4b25-b260-cd5f78732591 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:50.218170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ded4855-fa44-4b25-b260-cd5f78732591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:50.352768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded4855-fa44-4b25-b260-cd5f78732591 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:50.359782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaef3a-c1b2-4a6d-8a78-70d6615cf3c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:50.360591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaef3a-c1b2-4a6d-8a78-70d6615cf3c0 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:50.360892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaef3a-c1b2-4a6d-8a78-70d6615cf3c0 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:50.361165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaef3a-c1b2-4a6d-8a78-70d6615cf3c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:50.370832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaef3a-c1b2-4a6d-8a78-70d6615cf3c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:50.372778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaef3a-c1b2-4a6d-8a78-70d6615cf3c0 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:50.400699 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1459/2900] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 18:56:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 18:56:55.779577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf87420-f114-4934-92d3-c3a67e315f0d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:55.781537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ccf87420-f114-4934-92d3-c3a67e315f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:55.931714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf87420-f114-4934-92d3-c3a67e315f0d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:55.938039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db194421-f4b2-4d71-8432-632df11ea81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:55.938990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db194421-f4b2-4d71-8432-632df11ea81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:55.939454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db194421-f4b2-4d71-8432-632df11ea81c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:55.939908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db194421-f4b2-4d71-8432-632df11ea81c admin admin] PATH_INFO: `/v3/users/143cd5206a5f40e28b8b6e6cef408826` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:55.941322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db194421-f4b2-4d71-8432-632df11ea81c admin admin] RBAC: Authorizing `identity:delete_user(user_id=143cd5206a5f40e28b8b6e6cef408826)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:55.944520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db194421-f4b2-4d71-8432-632df11ea81c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:56.051461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db194421-f4b2-4d71-8432-632df11ea81c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143cd5206a5f40e28b8b6e6cef408826'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:56.068372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db194421-f4b2-4d71-8432-632df11ea81c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143cd5206a5f40e28b8b6e6cef408826'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:56.069509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db194421-f4b2-4d71-8432-632df11ea81c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143cd5206a5f40e28b8b6e6cef408826'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:56.088392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db194421-f4b2-4d71-8432-632df11ea81c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143cd5206a5f40e28b8b6e6cef408826'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:56.089106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db194421-f4b2-4d71-8432-632df11ea81c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143cd5206a5f40e28b8b6e6cef408826'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:56.121316 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1442/2901] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:56:55 2022] DELETE /identity/v3/users/143cd5206a5f40e28b8b6e6cef408826 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:56.471277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaef3a-c1b2-4a6d-8a78-70d6615cf3c0 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:56.483152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:56.488251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaef3a-c1b2-4a6d-8a78-70d6615cf3c0 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:56.616787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:56.617452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:56.617735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:56.618052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] PATH_INFO: `/v3/projects/256d73676f094adba353bef4cdda536a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:56.620741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=256d73676f094adba353bef4cdda536a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:56.623002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:56.714254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256d73676f094adba353bef4cdda536a', 'request_id': 'req-47786ab3-b431-4ac1-b7e0-0ba7c876f950'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:56.722527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256d73676f094adba353bef4cdda536a', 'request_id': 'req-47786ab3-b431-4ac1-b7e0-0ba7c876f950'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:56.731077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256d73676f094adba353bef4cdda536a', 'request_id': 'req-47786ab3-b431-4ac1-b7e0-0ba7c876f950'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:56.748647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] The token cache is being invalidate because project 256d73676f094adba353bef4cdda536a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:56:56.748960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:56.749926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:56:56.755264 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1460/2902] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:56:56 2022] DELETE /identity/v3/projects/256d73676f094adba353bef4cdda536a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:56:56.757790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38c181-825b-4047-96bf-8cb748d48e63 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:56.758524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38c181-825b-4047-96bf-8cb748d48e63 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:56.758840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38c181-825b-4047-96bf-8cb748d48e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:56.782898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ae38c181-825b-4047-96bf-8cb748d48e63 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:56.784453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ae38c181-825b-4047-96bf-8cb748d48e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:56.836151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:56.870376 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1443/2903] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:56:56.919755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:56.921821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:56.939182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b681b1-48bc-42d5-bdcd-81f0aaef61f9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:56.939496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b681b1-48bc-42d5-bdcd-81f0aaef61f9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:56.939897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b681b1-48bc-42d5-bdcd-81f0aaef61f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:56.969224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-24b681b1-48bc-42d5-bdcd-81f0aaef61f9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:56.970463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-24b681b1-48bc-42d5-bdcd-81f0aaef61f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:56.998961 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1444/2904] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:56:57.003014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b681b1-48bc-42d5-bdcd-81f0aaef61f9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:57.040913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b681b1-48bc-42d5-bdcd-81f0aaef61f9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:57.054281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280efe3a-5d63-4d5f-8602-2235fc189d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:57.057817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280efe3a-5d63-4d5f-8602-2235fc189d19 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:57.058330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280efe3a-5d63-4d5f-8602-2235fc189d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:57.058480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47786ab3-b431-4ac1-b7e0-0ba7c876f950 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:57.058950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280efe3a-5d63-4d5f-8602-2235fc189d19 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:57.059905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280efe3a-5d63-4d5f-8602-2235fc189d19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:56:57.062438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280efe3a-5d63-4d5f-8602-2235fc189d19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:57.064475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280efe3a-5d63-4d5f-8602-2235fc189d19 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:57.066008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a002a8e-1d73-440d-9937-d19eb670ffad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:57.067095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a002a8e-1d73-440d-9937-d19eb670ffad service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:57.067728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a002a8e-1d73-440d-9937-d19eb670ffad service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:57.068184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a002a8e-1d73-440d-9937-d19eb670ffad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:57.070731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3a002a8e-1d73-440d-9937-d19eb670ffad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:57.088124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a002a8e-1d73-440d-9937-d19eb670ffad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:57.090199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a002a8e-1d73-440d-9937-d19eb670ffad service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:57.109152 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1461/2905] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:57.113853 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1445/2906] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:56:57.115819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a002a8e-1d73-440d-9937-d19eb670ffad service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:57.134022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a002a8e-1d73-440d-9937-d19eb670ffad service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:57.136635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cdbcc-f5a2-4f23-9949-f5aaa6f6b264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:57.138581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cdbcc-f5a2-4f23-9949-f5aaa6f6b264 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:57.139232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cdbcc-f5a2-4f23-9949-f5aaa6f6b264 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:57.139511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cdbcc-f5a2-4f23-9949-f5aaa6f6b264 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:57.140737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cdbcc-f5a2-4f23-9949-f5aaa6f6b264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:57.143978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cdbcc-f5a2-4f23-9949-f5aaa6f6b264 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:57.184688 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1462/2907] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:56:57 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:57.186039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280efe3a-5d63-4d5f-8602-2235fc189d19 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:57.197628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280efe3a-5d63-4d5f-8602-2235fc189d19 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:57.383321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf31b0-b27b-40ff-af86-5ed9f70a31fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:57.383954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf31b0-b27b-40ff-af86-5ed9f70a31fa admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:57.384242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf31b0-b27b-40ff-af86-5ed9f70a31fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:57.384521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf31b0-b27b-40ff-af86-5ed9f70a31fa admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:57.385175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf31b0-b27b-40ff-af86-5ed9f70a31fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:57.387175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf31b0-b27b-40ff-af86-5ed9f70a31fa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:57.416853 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1446/2908] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:56:57 2022] POST /identity/v3/users => generated 295 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:56:57.420766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cdbcc-f5a2-4f23-9949-f5aaa6f6b264 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:57.433968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cdbcc-f5a2-4f23-9949-f5aaa6f6b264 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:57.443520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb704-0f2c-4980-a9b1-58ee880322bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:57.444296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb704-0f2c-4980-a9b1-58ee880322bc admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:57.444718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb704-0f2c-4980-a9b1-58ee880322bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:57.444998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb704-0f2c-4980-a9b1-58ee880322bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:57.446434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb704-0f2c-4980-a9b1-58ee880322bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:57.448311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb704-0f2c-4980-a9b1-58ee880322bc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:57.466564 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1463/2909] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:57.467449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf31b0-b27b-40ff-af86-5ed9f70a31fa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:57.479186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf31b0-b27b-40ff-af86-5ed9f70a31fa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:57.484342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3a7f8-8e4e-4c5c-9614-4f07790bab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:57.484954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3a7f8-8e4e-4c5c-9614-4f07790bab5f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:57.485241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3a7f8-8e4e-4c5c-9614-4f07790bab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:57.485521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3a7f8-8e4e-4c5c-9614-4f07790bab5f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:57.486504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3a7f8-8e4e-4c5c-9614-4f07790bab5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:57.487820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3a7f8-8e4e-4c5c-9614-4f07790bab5f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:57.505003 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1447/2910] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:56:57.506536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb704-0f2c-4980-a9b1-58ee880322bc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:57.513497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:57.517942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb704-0f2c-4980-a9b1-58ee880322bc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:57.525488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6eb6ed-2a83-4c07-a5e0-5d856490973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:57.526194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6eb6ed-2a83-4c07-a5e0-5d856490973e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:57.526466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6eb6ed-2a83-4c07-a5e0-5d856490973e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:57.526769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6eb6ed-2a83-4c07-a5e0-5d856490973e admin admin] PATH_INFO: `/v3/projects/5cc1e69df5374b8485bb645cb6e6c789/users/e35a6214968d4ef68bb3346cc5c37c52/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:57.547944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6eb6ed-2a83-4c07-a5e0-5d856490973e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc1e69df5374b8485bb645cb6e6c789, user_id=e35a6214968d4ef68bb3346cc5c37c52, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:57.551275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6eb6ed-2a83-4c07-a5e0-5d856490973e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:57.578647 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1464/2911] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:56:57 2022] PUT /identity/v3/projects/5cc1e69df5374b8485bb645cb6e6c789/users/e35a6214968d4ef68bb3346cc5c37c52/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:56:57.582655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac6a09-1604-4223-a95a-560780fb28e9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:57.582655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac6a09-1604-4223-a95a-560780fb28e9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:57.582655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac6a09-1604-4223-a95a-560780fb28e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:57.605325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a8ac6a09-1604-4223-a95a-560780fb28e9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:57.607004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a8ac6a09-1604-4223-a95a-560780fb28e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:57.721651 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1448/2912] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:56:57.737972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6eb6ed-2a83-4c07-a5e0-5d856490973e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:56:57.739850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7c6eb6ed-2a83-4c07-a5e0-5d856490973e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:57.823798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6eb6ed-2a83-4c07-a5e0-5d856490973e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:56:57.827825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef5e3c-296e-45e7-9dfd-adcbe6a91a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:56:57.829023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef5e3c-296e-45e7-9dfd-adcbe6a91a9d service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:57.829482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef5e3c-296e-45e7-9dfd-adcbe6a91a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:57.830040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef5e3c-296e-45e7-9dfd-adcbe6a91a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:57.842038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef5e3c-296e-45e7-9dfd-adcbe6a91a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:56:57.844018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef5e3c-296e-45e7-9dfd-adcbe6a91a9d service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:56:57.861310 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1465/2913] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:56:58.828756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423626c-dd59-4d03-bbad-2e93d87cbca9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:56:58.829621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423626c-dd59-4d03-bbad-2e93d87cbca9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:56:58.830050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423626c-dd59-4d03-bbad-2e93d87cbca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:56:58.865619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c423626c-dd59-4d03-bbad-2e93d87cbca9 None None] MFA Rules not processed for user `d049efd2598f4a528d68972936643fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:56:58.872471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c423626c-dd59-4d03-bbad-2e93d87cbca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:56:58.960592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:56:58.998790 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1449/2914] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:56:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:57:01.870381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef5e3c-296e-45e7-9dfd-adcbe6a91a9d service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:01.872614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f4ef5e3c-296e-45e7-9dfd-adcbe6a91a9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:02.031248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef5e3c-296e-45e7-9dfd-adcbe6a91a9d service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:02.044929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b55545-b302-43d3-8b74-c796c590c853 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:02.045557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b55545-b302-43d3-8b74-c796c590c853 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:02.045843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b55545-b302-43d3-8b74-c796c590c853 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:02.046164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b55545-b302-43d3-8b74-c796c590c853 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:02.052468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b0b55545-b302-43d3-8b74-c796c590c853 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:02.080626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b55545-b302-43d3-8b74-c796c590c853 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:02.082354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b55545-b302-43d3-8b74-c796c590c853 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:02.112691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423626c-dd59-4d03-bbad-2e93d87cbca9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:02.114348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c423626c-dd59-4d03-bbad-2e93d87cbca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:02.123640 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1466/2915] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:02.157287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423626c-dd59-4d03-bbad-2e93d87cbca9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:02.180671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffc0bb-3b16-4eea-bc6a-10b5d9842124 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:02.181305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffc0bb-3b16-4eea-bc6a-10b5d9842124 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:02.181594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffc0bb-3b16-4eea-bc6a-10b5d9842124 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:02.181875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffc0bb-3b16-4eea-bc6a-10b5d9842124 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:02.189365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-03ffc0bb-3b16-4eea-bc6a-10b5d9842124 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:02.216609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffc0bb-3b16-4eea-bc6a-10b5d9842124 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:02.221424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffc0bb-3b16-4eea-bc6a-10b5d9842124 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:02.264911 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1450/2916] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:57:02.423390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ac6f6-8e1b-4b8a-9d3f-c584fc332ee1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:02.423390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ac6f6-8e1b-4b8a-9d3f-c584fc332ee1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:02.423390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ac6f6-8e1b-4b8a-9d3f-c584fc332ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:02.513183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0e0ac6f6-8e1b-4b8a-9d3f-c584fc332ee1 None None] MFA Rules not processed for user `d049efd2598f4a528d68972936643fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:02.527686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0e0ac6f6-8e1b-4b8a-9d3f-c584fc332ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:02.558595 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1467/2917] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:05.124906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffc0bb-3b16-4eea-bc6a-10b5d9842124 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:05.126631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-03ffc0bb-3b16-4eea-bc6a-10b5d9842124 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:05.156420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffc0bb-3b16-4eea-bc6a-10b5d9842124 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:05.168637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce33c48-88ea-4e7e-9836-b6accfdc3da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:05.169931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce33c48-88ea-4e7e-9836-b6accfdc3da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:05.172051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce33c48-88ea-4e7e-9836-b6accfdc3da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:05.172701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce33c48-88ea-4e7e-9836-b6accfdc3da8 admin admin] PATH_INFO: `/v3/users/e11cd64b58da4d539986dd47e8cf77d3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:05.178160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce33c48-88ea-4e7e-9836-b6accfdc3da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e11cd64b58da4d539986dd47e8cf77d3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:05.183147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce33c48-88ea-4e7e-9836-b6accfdc3da8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:05.312196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4ce33c48-88ea-4e7e-9836-b6accfdc3da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e11cd64b58da4d539986dd47e8cf77d3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:05.368624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4ce33c48-88ea-4e7e-9836-b6accfdc3da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e11cd64b58da4d539986dd47e8cf77d3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:05.369794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4ce33c48-88ea-4e7e-9836-b6accfdc3da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e11cd64b58da4d539986dd47e8cf77d3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:05.407162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4ce33c48-88ea-4e7e-9836-b6accfdc3da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e11cd64b58da4d539986dd47e8cf77d3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:05.409036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4ce33c48-88ea-4e7e-9836-b6accfdc3da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e11cd64b58da4d539986dd47e8cf77d3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:05.443431 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1451/2918] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:57:05 2022] DELETE /identity/v3/users/e11cd64b58da4d539986dd47e8cf77d3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:06.389465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ac6f6-8e1b-4b8a-9d3f-c584fc332ee1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:06.414051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ac6f6-8e1b-4b8a-9d3f-c584fc332ee1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:06.671446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996f847-4666-4ec3-8c13-5a4274e46987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:06.674250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996f847-4666-4ec3-8c13-5a4274e46987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:06.674566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996f847-4666-4ec3-8c13-5a4274e46987 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:06.674898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996f847-4666-4ec3-8c13-5a4274e46987 admin admin] PATH_INFO: `/v3/projects/55d0fcc0048e4ce3a4b4947c86173c5a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:06.684835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996f847-4666-4ec3-8c13-5a4274e46987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d0fcc0048e4ce3a4b4947c86173c5a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:06.686913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996f847-4666-4ec3-8c13-5a4274e46987 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:06.726011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:06.801107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d996f847-4666-4ec3-8c13-5a4274e46987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d0fcc0048e4ce3a4b4947c86173c5a', 'request_id': 'req-d996f847-4666-4ec3-8c13-5a4274e46987'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:06.808747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d996f847-4666-4ec3-8c13-5a4274e46987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d0fcc0048e4ce3a4b4947c86173c5a', 'request_id': 'req-d996f847-4666-4ec3-8c13-5a4274e46987'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:06.818870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d996f847-4666-4ec3-8c13-5a4274e46987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d0fcc0048e4ce3a4b4947c86173c5a', 'request_id': 'req-d996f847-4666-4ec3-8c13-5a4274e46987'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:06.854436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d996f847-4666-4ec3-8c13-5a4274e46987 admin admin] The token cache is being invalidate because project 55d0fcc0048e4ce3a4b4947c86173c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:57:06.855117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d996f847-4666-4ec3-8c13-5a4274e46987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:06.857436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d996f847-4666-4ec3-8c13-5a4274e46987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:06.860247 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1468/2919] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:57:06 2022] DELETE /identity/v3/projects/55d0fcc0048e4ce3a4b4947c86173c5a => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:57:06.865528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6681d-68ec-4bf0-9ea9-a55e23422b77 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:06.866389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6681d-68ec-4bf0-9ea9-a55e23422b77 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:06.866674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6681d-68ec-4bf0-9ea9-a55e23422b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:06.909758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9ef6681d-68ec-4bf0-9ea9-a55e23422b77 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:06.912257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9ef6681d-68ec-4bf0-9ea9-a55e23422b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:07.047279 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1452/2920] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:07.052517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ac92a-11b3-49fb-9de0-da4f373bf342 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.052807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ac92a-11b3-49fb-9de0-da4f373bf342 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.053076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ac92a-11b3-49fb-9de0-da4f373bf342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:07.090790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f64ac92a-11b3-49fb-9de0-da4f373bf342 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:07.093234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f64ac92a-11b3-49fb-9de0-da4f373bf342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:07.116157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f6ee5-9d47-4b9f-a1b8-b9c22f0bd438 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.120121 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1469/2921] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:07.120844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f6ee5-9d47-4b9f-a1b8-b9c22f0bd438 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.121054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f6ee5-9d47-4b9f-a1b8-b9c22f0bd438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:07.124169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ac92a-11b3-49fb-9de0-da4f373bf342 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:07.168535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ac92a-11b3-49fb-9de0-da4f373bf342 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:07.181771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341ff39-35dc-4d62-9ed2-4ec419a5fa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:07.183083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341ff39-35dc-4d62-9ed2-4ec419a5fa7f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.183677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341ff39-35dc-4d62-9ed2-4ec419a5fa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.184139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341ff39-35dc-4d62-9ed2-4ec419a5fa7f admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:07.184956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341ff39-35dc-4d62-9ed2-4ec419a5fa7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:57:07.185420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341ff39-35dc-4d62-9ed2-4ec419a5fa7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:07.188647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341ff39-35dc-4d62-9ed2-4ec419a5fa7f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:07.188959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bc3f6ee5-9d47-4b9f-a1b8-b9c22f0bd438 None None] MFA Rules not processed for user `e35a6214968d4ef68bb3346cc5c37c52`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:07.190190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bc3f6ee5-9d47-4b9f-a1b8-b9c22f0bd438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:07.213599 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1470/2922] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:57:07.217603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341ff39-35dc-4d62-9ed2-4ec419a5fa7f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:07.276212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341ff39-35dc-4d62-9ed2-4ec419a5fa7f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:07.292262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:07.295853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d6ef2-fea0-410f-b07c-1fe78020f1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:07.300105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d6ef2-fea0-410f-b07c-1fe78020f1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.303808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d6ef2-fea0-410f-b07c-1fe78020f1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.305005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d6ef2-fea0-410f-b07c-1fe78020f1a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:07.306115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d6ef2-fea0-410f-b07c-1fe78020f1a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:07.308504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d6ef2-fea0-410f-b07c-1fe78020f1a4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:07.372470 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1453/2923] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:07.384925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f6ee5-9d47-4b9f-a1b8-b9c22f0bd438 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:07.389645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bc3f6ee5-9d47-4b9f-a1b8-b9c22f0bd438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:07.395378 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1471/2924] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:57:07 2022] POST /identity/v3/projects => generated 403 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:07.401200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d6ef2-fea0-410f-b07c-1fe78020f1a4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:07.600686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f6ee5-9d47-4b9f-a1b8-b9c22f0bd438 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:07.617419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d6ef2-fea0-410f-b07c-1fe78020f1a4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:07.629159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3d003-a9c2-46bd-a9b2-7dd14413d321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:07.629795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3d003-a9c2-46bd-a9b2-7dd14413d321 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.632718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3d003-a9c2-46bd-a9b2-7dd14413d321 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.633267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3d003-a9c2-46bd-a9b2-7dd14413d321 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:07.637337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3d003-a9c2-46bd-a9b2-7dd14413d321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:07.642935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3d003-a9c2-46bd-a9b2-7dd14413d321 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:07.696336 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1472/2925] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:57:07 2022] POST /identity/v3/users => generated 302 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:57:07.712712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3d003-a9c2-46bd-a9b2-7dd14413d321 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:07.727008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3d003-a9c2-46bd-a9b2-7dd14413d321 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:07.733727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4e400-b09c-4a9e-bd3a-597aea073387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:07.734442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4e400-b09c-4a9e-bd3a-597aea073387 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.735437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4e400-b09c-4a9e-bd3a-597aea073387 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.735782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4e400-b09c-4a9e-bd3a-597aea073387 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:07.736465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4e400-b09c-4a9e-bd3a-597aea073387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:07.738365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4e400-b09c-4a9e-bd3a-597aea073387 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:07.757002 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1473/2926] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:07.759992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4e400-b09c-4a9e-bd3a-597aea073387 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:07.772801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e5574-963a-4a3e-bb57-13b40e2c8c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:07.774777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e5574-963a-4a3e-bb57-13b40e2c8c23 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.775318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e5574-963a-4a3e-bb57-13b40e2c8c23 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.775848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e5574-963a-4a3e-bb57-13b40e2c8c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:07.787910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4e400-b09c-4a9e-bd3a-597aea073387 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:07.808413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042052a-93e8-4320-a018-2485c62b35f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:07.808413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042052a-93e8-4320-a018-2485c62b35f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.808413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042052a-93e8-4320-a018-2485c62b35f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.808413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042052a-93e8-4320-a018-2485c62b35f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:07.809122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042052a-93e8-4320-a018-2485c62b35f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:07.810654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042052a-93e8-4320-a018-2485c62b35f2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:07.844691 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1474/2927] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:07.849784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042052a-93e8-4320-a018-2485c62b35f2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:07.864819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e5574-963a-4a3e-bb57-13b40e2c8c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:07.869089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e5574-963a-4a3e-bb57-13b40e2c8c23 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:07.871136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042052a-93e8-4320-a018-2485c62b35f2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:07.884597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63009892-fb76-41d3-8e6b-1cb7a7c2867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:07.885579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63009892-fb76-41d3-8e6b-1cb7a7c2867e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.885579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63009892-fb76-41d3-8e6b-1cb7a7c2867e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.885897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63009892-fb76-41d3-8e6b-1cb7a7c2867e admin admin] PATH_INFO: `/v3/projects/65592da9dff048ac99b6a0dd63048264/users/a0d0b057f9bf44d3a7aef294aa58142f/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:07.916771 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1454/2928] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:07.934597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63009892-fb76-41d3-8e6b-1cb7a7c2867e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65592da9dff048ac99b6a0dd63048264, user_id=a0d0b057f9bf44d3a7aef294aa58142f, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:07.941531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63009892-fb76-41d3-8e6b-1cb7a7c2867e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:07.967603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:07.977845 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1475/2929] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:57:07 2022] PUT /identity/v3/projects/65592da9dff048ac99b6a0dd63048264/users/a0d0b057f9bf44d3a7aef294aa58142f/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:07.984419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6847113-4317-41bc-a641-7918cef73d72 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:07.984738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6847113-4317-41bc-a641-7918cef73d72 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:07.986327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6847113-4317-41bc-a641-7918cef73d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:08.020056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d6847113-4317-41bc-a641-7918cef73d72 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:08.022551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d6847113-4317-41bc-a641-7918cef73d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:08.036964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:08.115822 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1455/2930] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:08.122409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63009892-fb76-41d3-8e6b-1cb7a7c2867e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:08.124210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-63009892-fb76-41d3-8e6b-1cb7a7c2867e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:08.151788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6847113-4317-41bc-a641-7918cef73d72 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:08.244902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63009892-fb76-41d3-8e6b-1cb7a7c2867e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:08.260230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2622cd-b5b0-4253-900a-0f648bc01073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:08.260871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2622cd-b5b0-4253-900a-0f648bc01073 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:08.261156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2622cd-b5b0-4253-900a-0f648bc01073 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:08.261496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2622cd-b5b0-4253-900a-0f648bc01073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:08.282925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2622cd-b5b0-4253-900a-0f648bc01073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:08.285684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2622cd-b5b0-4253-900a-0f648bc01073 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:08.304143 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1476/2931] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:08.312985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6847113-4317-41bc-a641-7918cef73d72 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:08.334033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3f6eb-8066-451a-ab76-836f281f4053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:08.334724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3f6eb-8066-451a-ab76-836f281f4053 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:08.335039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3f6eb-8066-451a-ab76-836f281f4053 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:08.335314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3f6eb-8066-451a-ab76-836f281f4053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:08.337575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4df3f6eb-8066-451a-ab76-836f281f4053 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:08.438106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3f6eb-8066-451a-ab76-836f281f4053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:08.440312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3f6eb-8066-451a-ab76-836f281f4053 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:08.456615 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1456/2932] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:10.473404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2622cd-b5b0-4253-900a-0f648bc01073 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:10.480811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6b2622cd-b5b0-4253-900a-0f648bc01073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:10.529534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2622cd-b5b0-4253-900a-0f648bc01073 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:10.549302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148e1eb-31d9-468b-be14-c18dccd7e84e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:10.550401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148e1eb-31d9-468b-be14-c18dccd7e84e service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:10.550401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148e1eb-31d9-468b-be14-c18dccd7e84e service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:10.550595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148e1eb-31d9-468b-be14-c18dccd7e84e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:10.555206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c148e1eb-31d9-468b-be14-c18dccd7e84e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:10.804490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148e1eb-31d9-468b-be14-c18dccd7e84e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:10.807543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148e1eb-31d9-468b-be14-c18dccd7e84e service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:10.861069 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1477/2933] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:14.587270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3f6eb-8066-451a-ab76-836f281f4053 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:14.619088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3f6eb-8066-451a-ab76-836f281f4053 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:14.650464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3813d65-7ec5-4589-b1cd-8e2990a84cff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:14.651729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3813d65-7ec5-4589-b1cd-8e2990a84cff service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:14.653863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3813d65-7ec5-4589-b1cd-8e2990a84cff service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:14.655127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3813d65-7ec5-4589-b1cd-8e2990a84cff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:14.667346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e3813d65-7ec5-4589-b1cd-8e2990a84cff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:14.762888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3813d65-7ec5-4589-b1cd-8e2990a84cff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:14.769628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3813d65-7ec5-4589-b1cd-8e2990a84cff service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:14.818025 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1457/2934] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:14.974601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148e1eb-31d9-468b-be14-c18dccd7e84e service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:14.977301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c148e1eb-31d9-468b-be14-c18dccd7e84e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:15.156374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148e1eb-31d9-468b-be14-c18dccd7e84e service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:15.166972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447696b-27b8-4d4a-8326-67da43623b4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:15.167636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447696b-27b8-4d4a-8326-67da43623b4e service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:15.167920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447696b-27b8-4d4a-8326-67da43623b4e service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:15.168198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447696b-27b8-4d4a-8326-67da43623b4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:15.172248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3447696b-27b8-4d4a-8326-67da43623b4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:15.203661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447696b-27b8-4d4a-8326-67da43623b4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:15.205321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447696b-27b8-4d4a-8326-67da43623b4e service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:15.236219 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1478/2935] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:20.810656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3813d65-7ec5-4589-b1cd-8e2990a84cff service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:20.812790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e3813d65-7ec5-4589-b1cd-8e2990a84cff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:20.818829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447696b-27b8-4d4a-8326-67da43623b4e service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:20.821381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3447696b-27b8-4d4a-8326-67da43623b4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:20.852109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3813d65-7ec5-4589-b1cd-8e2990a84cff service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:20.863185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:20.864715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:20.871502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:20.872558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] PATH_INFO: `/v3/users/e35a6214968d4ef68bb3346cc5c37c52` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:20.874100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35a6214968d4ef68bb3346cc5c37c52)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:20.878212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447696b-27b8-4d4a-8326-67da43623b4e service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:20.880171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:20.901282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21840862-998e-471e-91ff-3ccde31ab618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:20.923057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21840862-998e-471e-91ff-3ccde31ab618 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:20.924335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21840862-998e-471e-91ff-3ccde31ab618 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:20.927182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21840862-998e-471e-91ff-3ccde31ab618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:20.930894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-21840862-998e-471e-91ff-3ccde31ab618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:20.947906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21840862-998e-471e-91ff-3ccde31ab618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:20.950694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21840862-998e-471e-91ff-3ccde31ab618 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:20.960633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:20.975829 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1479/2936] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:20.977271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21840862-998e-471e-91ff-3ccde31ab618 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:20.979185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-21840862-998e-471e-91ff-3ccde31ab618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:20.993757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35a6214968d4ef68bb3346cc5c37c52'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:21.014697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35a6214968d4ef68bb3346cc5c37c52'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:21.016920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35a6214968d4ef68bb3346cc5c37c52'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:21.021973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21840862-998e-471e-91ff-3ccde31ab618 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:21.030505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:21.031697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:21.032240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:21.032738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] PATH_INFO: `/v3/users/96265ca648444ff8bf45a45c26b7679e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:21.034623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] RBAC: Authorizing `identity:delete_user(user_id=96265ca648444ff8bf45a45c26b7679e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:21.038053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35a6214968d4ef68bb3346cc5c37c52'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:21.039312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35a6214968d4ef68bb3346cc5c37c52'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:21.041845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:21.067992 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1458/2937] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:57:20 2022] DELETE /identity/v3/users/e35a6214968d4ef68bb3346cc5c37c52 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:21.074841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:21.076222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:21.084109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:21.197757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96265ca648444ff8bf45a45c26b7679e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:21.210194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96265ca648444ff8bf45a45c26b7679e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:21.211096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96265ca648444ff8bf45a45c26b7679e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:21.222125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96265ca648444ff8bf45a45c26b7679e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:21.222944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96265ca648444ff8bf45a45c26b7679e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:21.243414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf1c04-6b03-4143-ba81-d8ed88509f93 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:21.254647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ffc7-70e0-4403-8a2c-646f7962c758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:21.255921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ffc7-70e0-4403-8a2c-646f7962c758 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:21.256269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ffc7-70e0-4403-8a2c-646f7962c758 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:21.256780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580ffc7-70e0-4403-8a2c-646f7962c758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:21.260123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3580ffc7-70e0-4403-8a2c-646f7962c758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:21.262533 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1480/2938] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:57:20 2022] DELETE /identity/v3/users/96265ca648444ff8bf45a45c26b7679e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:21.286720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ffc7-70e0-4403-8a2c-646f7962c758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:21.288257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580ffc7-70e0-4403-8a2c-646f7962c758 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:21.305381 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1459/2939] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:21.706703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:21.709871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:21.828077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ffc7-70e0-4403-8a2c-646f7962c758 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:21.829679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3580ffc7-70e0-4403-8a2c-646f7962c758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:21.925915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fd1c9-9d4b-4404-b191-d76fb195114b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:21.943372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:21.944774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:21.945293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:21.945964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] PATH_INFO: `/v3/projects/5cc1e69df5374b8485bb645cb6e6c789` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:21.966681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc1e69df5374b8485bb645cb6e6c789)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:21.971169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:22.030539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580ffc7-70e0-4403-8a2c-646f7962c758 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:22.039086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c3882-e239-4fe3-ab6f-579d92a84c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:22.039835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c3882-e239-4fe3-ab6f-579d92a84c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:22.040191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c3882-e239-4fe3-ab6f-579d92a84c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:22.040542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c3882-e239-4fe3-ab6f-579d92a84c59 admin admin] PATH_INFO: `/v3/projects/b6bbebcf7d7046679635438031941e3a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:22.042497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c3882-e239-4fe3-ab6f-579d92a84c59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6bbebcf7d7046679635438031941e3a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:22.047585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c3882-e239-4fe3-ab6f-579d92a84c59 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:22.117719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-290c3882-e239-4fe3-ab6f-579d92a84c59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6bbebcf7d7046679635438031941e3a', 'request_id': 'req-290c3882-e239-4fe3-ab6f-579d92a84c59'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.120284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:22.138352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-290c3882-e239-4fe3-ab6f-579d92a84c59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6bbebcf7d7046679635438031941e3a', 'request_id': 'req-290c3882-e239-4fe3-ab6f-579d92a84c59'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.148036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc1e69df5374b8485bb645cb6e6c789', 'request_id': 'req-1c264245-612b-4054-b6ca-a12e5d51e84c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.154263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-290c3882-e239-4fe3-ab6f-579d92a84c59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6bbebcf7d7046679635438031941e3a', 'request_id': 'req-290c3882-e239-4fe3-ab6f-579d92a84c59'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.166726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc1e69df5374b8485bb645cb6e6c789', 'request_id': 'req-1c264245-612b-4054-b6ca-a12e5d51e84c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.175305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-290c3882-e239-4fe3-ab6f-579d92a84c59 admin admin] The token cache is being invalidate because project b6bbebcf7d7046679635438031941e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:57:22.175504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-290c3882-e239-4fe3-ab6f-579d92a84c59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.176965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-290c3882-e239-4fe3-ab6f-579d92a84c59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.179333 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1460/2940] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:57:21 2022] DELETE /identity/v3/projects/b6bbebcf7d7046679635438031941e3a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:22.180871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63b9e0-6a5b-4f29-98f9-ef06b1bfdbb9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:22.182249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63b9e0-6a5b-4f29-98f9-ef06b1bfdbb9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:22.182666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63b9e0-6a5b-4f29-98f9-ef06b1bfdbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:22.185146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc1e69df5374b8485bb645cb6e6c789', 'request_id': 'req-1c264245-612b-4054-b6ca-a12e5d51e84c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.241433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5b63b9e0-6a5b-4f29-98f9-ef06b1bfdbb9 None None] MFA Rules not processed for user `a0d0b057f9bf44d3a7aef294aa58142f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:22.246876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5b63b9e0-6a5b-4f29-98f9-ef06b1bfdbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:22.249116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] The token cache is being invalidate because project 5cc1e69df5374b8485bb645cb6e6c789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:57:22.249645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.251056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.257380 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1481/2941] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:57:21 2022] DELETE /identity/v3/projects/5cc1e69df5374b8485bb645cb6e6c789 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:22.261129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:22.266058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:22.343301 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1461/2942] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:22 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:22.344907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c513219-c76c-440b-836b-5bbdf833387b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:22.345655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c513219-c76c-440b-836b-5bbdf833387b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:22.346092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c513219-c76c-440b-836b-5bbdf833387b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:22.362140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:22.389550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1c513219-c76c-440b-836b-5bbdf833387b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:22.390943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1c513219-c76c-440b-836b-5bbdf833387b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:22.470504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264245-612b-4054-b6ca-a12e5d51e84c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:22.472693 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1462/2943] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:22.480697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4bf7-48e7-4bef-8f0c-f8460d6f6a9b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:22.484029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4bf7-48e7-4bef-8f0c-f8460d6f6a9b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:22.484448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4bf7-48e7-4bef-8f0c-f8460d6f6a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:22.490659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:22.492113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:22.492821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:22.493738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] PATH_INFO: `/v3/users/3a8b891911af4a8c9f04941a6a112c4f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:22.500926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8b891911af4a8c9f04941a6a112c4f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:22.507195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:22.523874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5c2f4bf7-48e7-4bef-8f0c-f8460d6f6a9b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:22.526306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5c2f4bf7-48e7-4bef-8f0c-f8460d6f6a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:22.538786 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1463/2944] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:22.543268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f4bf7-48e7-4bef-8f0c-f8460d6f6a9b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:22.561321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f4bf7-48e7-4bef-8f0c-f8460d6f6a9b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:22.579939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf02e0-9bfc-4ce3-9f5f-762317a40519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:22.581093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf02e0-9bfc-4ce3-9f5f-762317a40519 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:22.582150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf02e0-9bfc-4ce3-9f5f-762317a40519 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:22.584110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf02e0-9bfc-4ce3-9f5f-762317a40519 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:22.585065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf02e0-9bfc-4ce3-9f5f-762317a40519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:57:22.586578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf02e0-9bfc-4ce3-9f5f-762317a40519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:22.590201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf02e0-9bfc-4ce3-9f5f-762317a40519 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:22.619753 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1464/2945] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:57:22.622421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf02e0-9bfc-4ce3-9f5f-762317a40519 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:22.653714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8b891911af4a8c9f04941a6a112c4f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.665194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8b891911af4a8c9f04941a6a112c4f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.665954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8b891911af4a8c9f04941a6a112c4f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.678102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf02e0-9bfc-4ce3-9f5f-762317a40519 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:22.679666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8b891911af4a8c9f04941a6a112c4f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.680606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8b891911af4a8c9f04941a6a112c4f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:22.697040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438203c9-472d-490c-a691-0177e17d2403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:22.697856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438203c9-472d-490c-a691-0177e17d2403 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:22.698145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438203c9-472d-490c-a691-0177e17d2403 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:22.698423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438203c9-472d-490c-a691-0177e17d2403 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:22.699282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438203c9-472d-490c-a691-0177e17d2403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:22.701230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438203c9-472d-490c-a691-0177e17d2403 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:22.729154 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1482/2946] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:57:22 2022] DELETE /identity/v3/users/3a8b891911af4a8c9f04941a6a112c4f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:22.794366 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1465/2947] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:57:22 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:22.799338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:22.802393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:22.915240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5e77d-9219-4d81-8a46-172323029129 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:22.972676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:23.011133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef9b8d-f231-4708-9a95-97154101d5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:23.012065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef9b8d-f231-4708-9a95-97154101d5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:23.012256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef9b8d-f231-4708-9a95-97154101d5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:23.012920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef9b8d-f231-4708-9a95-97154101d5d0 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:23.013893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef9b8d-f231-4708-9a95-97154101d5d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:23.016109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef9b8d-f231-4708-9a95-97154101d5d0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:23.065566 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1483/2948] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:57:22 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:57:23.071644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438203c9-472d-490c-a691-0177e17d2403 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:23.139133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438203c9-472d-490c-a691-0177e17d2403 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:23.154054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef058d-8c18-4f61-8383-d4127bb46a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:23.154893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef058d-8c18-4f61-8383-d4127bb46a1d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:23.155234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef058d-8c18-4f61-8383-d4127bb46a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:23.155531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef058d-8c18-4f61-8383-d4127bb46a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:23.156370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef058d-8c18-4f61-8383-d4127bb46a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:23.158426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef058d-8c18-4f61-8383-d4127bb46a1d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:23.183940 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1466/2949] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:23.196753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef058d-8c18-4f61-8383-d4127bb46a1d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:23.198707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-18ef058d-8c18-4f61-8383-d4127bb46a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:23.206261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef9b8d-f231-4708-9a95-97154101d5d0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:23.243369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef9b8d-f231-4708-9a95-97154101d5d0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:23.251530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:23.259295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6a371-26f6-4a4d-b6bd-642184c896dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:23.266709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6a371-26f6-4a4d-b6bd-642184c896dc admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:23.267200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6a371-26f6-4a4d-b6bd-642184c896dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:23.267533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6a371-26f6-4a4d-b6bd-642184c896dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:23.268617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6a371-26f6-4a4d-b6bd-642184c896dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:23.270790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6a371-26f6-4a4d-b6bd-642184c896dc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:23.283938 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1484/2950] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:23.284942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6a371-26f6-4a4d-b6bd-642184c896dc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:23.287199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d3b6a371-26f6-4a4d-b6bd-642184c896dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:23.330206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6a371-26f6-4a4d-b6bd-642184c896dc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:23.338589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:23.339623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:23.339970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:23.340790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] PATH_INFO: `/v3/projects/d18a7752b52741b19cbbea6f12f23d76` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:23.342124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18a7752b52741b19cbbea6f12f23d76)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:23.347099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:23.418231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef058d-8c18-4f61-8383-d4127bb46a1d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:23.436720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d76ea6-3080-4f5e-a52c-fc53d5f4cab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:23.437361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d76ea6-3080-4f5e-a52c-fc53d5f4cab8 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:23.437651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d76ea6-3080-4f5e-a52c-fc53d5f4cab8 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:23.437932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d76ea6-3080-4f5e-a52c-fc53d5f4cab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:23.439790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-64d76ea6-3080-4f5e-a52c-fc53d5f4cab8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:23.514301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18a7752b52741b19cbbea6f12f23d76', 'request_id': 'req-79e0e17b-3e0c-45c7-9536-143aa9815b25'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:23.531059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18a7752b52741b19cbbea6f12f23d76', 'request_id': 'req-79e0e17b-3e0c-45c7-9536-143aa9815b25'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:23.552146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18a7752b52741b19cbbea6f12f23d76', 'request_id': 'req-79e0e17b-3e0c-45c7-9536-143aa9815b25'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:23.587568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] The token cache is being invalidate because project d18a7752b52741b19cbbea6f12f23d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:57:23.587898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:23.588773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:23.593459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d76ea6-3080-4f5e-a52c-fc53d5f4cab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:23.595666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d76ea6-3080-4f5e-a52c-fc53d5f4cab8 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:23.598864 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1485/2951] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:57:23 2022] DELETE /identity/v3/projects/d18a7752b52741b19cbbea6f12f23d76 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:23.599737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:23.601454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:23.644416 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1467/2952] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:23 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:23.657394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61fca8-df1e-4c60-a5b6-5ef070a1c010 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:23.660200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61fca8-df1e-4c60-a5b6-5ef070a1c010 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:23.663886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61fca8-df1e-4c60-a5b6-5ef070a1c010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:23.708424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ce61fca8-df1e-4c60-a5b6-5ef070a1c010 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:23.709551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ce61fca8-df1e-4c60-a5b6-5ef070a1c010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:23.788063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0e17b-3e0c-45c7-9536-143aa9815b25 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:23.799187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea893013-9e82-4934-8705-e2c64975e726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:23.805334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea893013-9e82-4934-8705-e2c64975e726 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:23.805716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea893013-9e82-4934-8705-e2c64975e726 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:23.806015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea893013-9e82-4934-8705-e2c64975e726 admin admin] PATH_INFO: `/v3/projects/0b5959f5bf14403ca7be274025ace123/users/5c6a6357990a409b923387e093effc5a/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:23.843425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea893013-9e82-4934-8705-e2c64975e726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5959f5bf14403ca7be274025ace123, user_id=5c6a6357990a409b923387e093effc5a, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:23.851313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea893013-9e82-4934-8705-e2c64975e726 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:23.867217 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1468/2953] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:23.888477 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1486/2954] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:57:23 2022] PUT /identity/v3/projects/0b5959f5bf14403ca7be274025ace123/users/5c6a6357990a409b923387e093effc5a/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:23.888702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30e9b7-4bb8-4a16-89aa-24925b930e9e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:23.888702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30e9b7-4bb8-4a16-89aa-24925b930e9e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:23.888702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30e9b7-4bb8-4a16-89aa-24925b930e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:23.891133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071fa21-0271-4cec-b2c9-74f767728de3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:23.891493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071fa21-0271-4cec-b2c9-74f767728de3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:23.891884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071fa21-0271-4cec-b2c9-74f767728de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:23.913655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-de30e9b7-4bb8-4a16-89aa-24925b930e9e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:23.915814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-de30e9b7-4bb8-4a16-89aa-24925b930e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:23.962979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4071fa21-0271-4cec-b2c9-74f767728de3 None None] MFA Rules not processed for user `5c6a6357990a409b923387e093effc5a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:23.964150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4071fa21-0271-4cec-b2c9-74f767728de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:23.999698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:24.002994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:24.037261 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1469/2955] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:24.038295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30e9b7-4bb8-4a16-89aa-24925b930e9e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:24.049753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30e9b7-4bb8-4a16-89aa-24925b930e9e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:24.064278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c2118-aabd-4a33-87da-3e2ed74ffde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:24.065830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c2118-aabd-4a33-87da-3e2ed74ffde1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.068858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c2118-aabd-4a33-87da-3e2ed74ffde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.069328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c2118-aabd-4a33-87da-3e2ed74ffde1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.071696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c2118-aabd-4a33-87da-3e2ed74ffde1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:57:24.072275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c2118-aabd-4a33-87da-3e2ed74ffde1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:24.076449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c2118-aabd-4a33-87da-3e2ed74ffde1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:24.105115 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1487/2956] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:57:24.116936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fa775-bd02-4a84-abdd-0fd99db6d910 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.117316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fa775-bd02-4a84-abdd-0fd99db6d910 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.117670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fa775-bd02-4a84-abdd-0fd99db6d910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.122368 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1470/2957] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:57:24.123806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c2118-aabd-4a33-87da-3e2ed74ffde1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:24.135781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c2118-aabd-4a33-87da-3e2ed74ffde1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:24.144196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d19fa775-bd02-4a84-abdd-0fd99db6d910 None None] MFA Rules not processed for user `5c6a6357990a409b923387e093effc5a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:24.146643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d19fa775-bd02-4a84-abdd-0fd99db6d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:24.151389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b2287-9501-47a9-bb6f-5ae088ada6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:24.152103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b2287-9501-47a9-bb6f-5ae088ada6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.152385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b2287-9501-47a9-bb6f-5ae088ada6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.152659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b2287-9501-47a9-bb6f-5ae088ada6f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.153301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b2287-9501-47a9-bb6f-5ae088ada6f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:24.155296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b2287-9501-47a9-bb6f-5ae088ada6f9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:24.160168 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1488/2958] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:24.173027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fa775-bd02-4a84-abdd-0fd99db6d910 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:24.174676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d19fa775-bd02-4a84-abdd-0fd99db6d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:24.246881 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1471/2959] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:57:24 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:24.248032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b2287-9501-47a9-bb6f-5ae088ada6f9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:24.348568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fa775-bd02-4a84-abdd-0fd99db6d910 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:24.416552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b2287-9501-47a9-bb6f-5ae088ada6f9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:24.423579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fb285-60f8-4a9b-996f-534c8cacea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:24.426439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fb285-60f8-4a9b-996f-534c8cacea71 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.427846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fb285-60f8-4a9b-996f-534c8cacea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.428152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fb285-60f8-4a9b-996f-534c8cacea71 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.429126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fb285-60f8-4a9b-996f-534c8cacea71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:24.433047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fb285-60f8-4a9b-996f-534c8cacea71 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:24.492830 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1472/2960] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:57:24 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:24.494303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fb285-60f8-4a9b-996f-534c8cacea71 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:24.533236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fb285-60f8-4a9b-996f-534c8cacea71 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:24.545047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f7e5d-5285-45d8-978d-11851869390e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:24.545691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f7e5d-5285-45d8-978d-11851869390e service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.545975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f7e5d-5285-45d8-978d-11851869390e service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.546593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f7e5d-5285-45d8-978d-11851869390e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.547437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a394c-2956-46a6-8c40-650b50b1c58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:24.548105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a394c-2956-46a6-8c40-650b50b1c58e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.548377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a394c-2956-46a6-8c40-650b50b1c58e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.548652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a394c-2956-46a6-8c40-650b50b1c58e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.554636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a394c-2956-46a6-8c40-650b50b1c58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:24.569536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a394c-2956-46a6-8c40-650b50b1c58e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:24.608972 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1473/2961] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:24.611946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a394c-2956-46a6-8c40-650b50b1c58e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:24.632507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a394c-2956-46a6-8c40-650b50b1c58e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:24.638995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735d823-8fd7-405b-a994-7d2f53580c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:24.639616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735d823-8fd7-405b-a994-7d2f53580c34 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.639900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735d823-8fd7-405b-a994-7d2f53580c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.640172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735d823-8fd7-405b-a994-7d2f53580c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.641308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735d823-8fd7-405b-a994-7d2f53580c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:24.645608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735d823-8fd7-405b-a994-7d2f53580c34 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:24.665254 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1474/2962] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:24.669392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735d823-8fd7-405b-a994-7d2f53580c34 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:24.671928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:24.685736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f7e5d-5285-45d8-978d-11851869390e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:24.688617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f7e5d-5285-45d8-978d-11851869390e service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:24.698683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735d823-8fd7-405b-a994-7d2f53580c34 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:24.706627 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1489/2963] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:57:24.714159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312cfd6-cf7b-4e5f-828b-8efdcd4207ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:24.715143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312cfd6-cf7b-4e5f-828b-8efdcd4207ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.715694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312cfd6-cf7b-4e5f-828b-8efdcd4207ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.716273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312cfd6-cf7b-4e5f-828b-8efdcd4207ed admin admin] PATH_INFO: `/v3/projects/2aada9e76ee24e31a0049ebe09fb5eca/users/b05ce3893f9046cebd1c2cb728f57130/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.746077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312cfd6-cf7b-4e5f-828b-8efdcd4207ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aada9e76ee24e31a0049ebe09fb5eca, user_id=b05ce3893f9046cebd1c2cb728f57130, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:24.749758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312cfd6-cf7b-4e5f-828b-8efdcd4207ed admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:24.772675 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1475/2964] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:57:24 2022] PUT /identity/v3/projects/2aada9e76ee24e31a0049ebe09fb5eca/users/b05ce3893f9046cebd1c2cb728f57130/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:57:24.778219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aadbe7-e912-40b0-bdc1-28d6279c3add None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:24.778506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aadbe7-e912-40b0-bdc1-28d6279c3add None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:24.778830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aadbe7-e912-40b0-bdc1-28d6279c3add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:24.809691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d7aadbe7-e912-40b0-bdc1-28d6279c3add None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:24.811484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d7aadbe7-e912-40b0-bdc1-28d6279c3add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:24.910272 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1490/2965] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:57:24.922177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312cfd6-cf7b-4e5f-828b-8efdcd4207ed admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:24.929009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f312cfd6-cf7b-4e5f-828b-8efdcd4207ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:25.048424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312cfd6-cf7b-4e5f-828b-8efdcd4207ed admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:25.055300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb27c28-1eba-4a26-9b33-13a9b1ae29fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:25.056341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb27c28-1eba-4a26-9b33-13a9b1ae29fe service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:25.056900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb27c28-1eba-4a26-9b33-13a9b1ae29fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:25.057387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb27c28-1eba-4a26-9b33-13a9b1ae29fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:25.072722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb27c28-1eba-4a26-9b33-13a9b1ae29fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:25.075603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb27c28-1eba-4a26-9b33-13a9b1ae29fe service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:25.120084 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1476/2966] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:27.943355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aadbe7-e912-40b0-bdc1-28d6279c3add None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:27.945962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d7aadbe7-e912-40b0-bdc1-28d6279c3add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:28.073742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aadbe7-e912-40b0-bdc1-28d6279c3add None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:28.080350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44eb59-9deb-4d96-9d37-0656b6e9643d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:28.081484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44eb59-9deb-4d96-9d37-0656b6e9643d service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:28.082014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44eb59-9deb-4d96-9d37-0656b6e9643d service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:28.082548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44eb59-9deb-4d96-9d37-0656b6e9643d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:28.085086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9a44eb59-9deb-4d96-9d37-0656b6e9643d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:28.105793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44eb59-9deb-4d96-9d37-0656b6e9643d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:28.107641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44eb59-9deb-4d96-9d37-0656b6e9643d service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:28.122617 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1491/2967] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:30.730895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15185366-8ddd-438b-943b-7cff1bddce49 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:30.731495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15185366-8ddd-438b-943b-7cff1bddce49 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:30.731599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15185366-8ddd-438b-943b-7cff1bddce49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:30.760744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:30.809564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-15185366-8ddd-438b-943b-7cff1bddce49 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:30.815691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-15185366-8ddd-438b-943b-7cff1bddce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:30.855502 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1477/2968] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:31.011970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44eb59-9deb-4d96-9d37-0656b6e9643d service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:31.028445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44eb59-9deb-4d96-9d37-0656b6e9643d service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:31.043436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62edd5e-4c56-4051-b8c3-151046183078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:31.044384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62edd5e-4c56-4051-b8c3-151046183078 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:31.050419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62edd5e-4c56-4051-b8c3-151046183078 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:31.051005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62edd5e-4c56-4051-b8c3-151046183078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:31.083766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62edd5e-4c56-4051-b8c3-151046183078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:31.087267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62edd5e-4c56-4051-b8c3-151046183078 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:31.121910 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1492/2969] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:36.651783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15185366-8ddd-438b-943b-7cff1bddce49 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:36.653914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-15185366-8ddd-438b-943b-7cff1bddce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:36.813272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62edd5e-4c56-4051-b8c3-151046183078 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:36.815443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d62edd5e-4c56-4051-b8c3-151046183078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:36.839593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15185366-8ddd-438b-943b-7cff1bddce49 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:36.839727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62edd5e-4c56-4051-b8c3-151046183078 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:36.846323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0801d-3870-45bd-ab4b-bbcf065df70c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:36.847316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0801d-3870-45bd-ab4b-bbcf065df70c service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:36.849830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0801d-3870-45bd-ab4b-bbcf065df70c service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:36.851157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0801d-3870-45bd-ab4b-bbcf065df70c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:36.853655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7ee0801d-3870-45bd-ab4b-bbcf065df70c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:36.871216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:36.871657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:36.871934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:36.872209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] PATH_INFO: `/v3/users/a0d0b057f9bf44d3a7aef294aa58142f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:36.873495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d0b057f9bf44d3a7aef294aa58142f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:36.875575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:36.898078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0801d-3870-45bd-ab4b-bbcf065df70c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:36.900273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0801d-3870-45bd-ab4b-bbcf065df70c service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:36.954314 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1478/2970] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:36.976952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d0b057f9bf44d3a7aef294aa58142f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:37.005704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:37.009372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d0b057f9bf44d3a7aef294aa58142f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:37.010906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d0b057f9bf44d3a7aef294aa58142f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:37.054113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d0b057f9bf44d3a7aef294aa58142f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:37.056635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d0b057f9bf44d3a7aef294aa58142f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:37.152096 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1493/2971] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:57:36 2022] DELETE /identity/v3/users/a0d0b057f9bf44d3a7aef294aa58142f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:57:37.500681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bd074-759d-4a28-8d45-fa20e2106df0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:37.501062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bd074-759d-4a28-8d45-fa20e2106df0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:37.501416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bd074-759d-4a28-8d45-fa20e2106df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:37.541134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-589bd074-759d-4a28-8d45-fa20e2106df0 None None] MFA Rules not processed for user `b05ce3893f9046cebd1c2cb728f57130`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:37.544062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-589bd074-759d-4a28-8d45-fa20e2106df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:37.600302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:37.601852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:37.796373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b241a31-bf7b-41af-8ec2-5817fab89773 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:37.799453 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1479/2972] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:37.806880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:37.808414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:37.809160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:37.809601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571 admin admin] PATH_INFO: `/v3/projects/65592da9dff048ac99b6a0dd63048264` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:37.812395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65592da9dff048ac99b6a0dd63048264)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:37.815043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:37.935353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65592da9dff048ac99b6a0dd63048264', 'request_id': 'req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:37.950383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65592da9dff048ac99b6a0dd63048264', 'request_id': 'req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:37.959930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65592da9dff048ac99b6a0dd63048264', 'request_id': 'req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:37.980849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571 admin admin] The token cache is being invalidate because project 65592da9dff048ac99b6a0dd63048264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:57:37.981047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:37.981756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1720f95-e6ea-4d5d-ae73-4726e3b6a571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:37.984927 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1494/2973] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:57:37 2022] DELETE /identity/v3/projects/65592da9dff048ac99b6a0dd63048264 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:37.991219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac206d60-cdbb-442a-ac63-e5dec8bde328 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:37.992837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac206d60-cdbb-442a-ac63-e5dec8bde328 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:37.993406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac206d60-cdbb-442a-ac63-e5dec8bde328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:38.024041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ac206d60-cdbb-442a-ac63-e5dec8bde328 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:38.026392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ac206d60-cdbb-442a-ac63-e5dec8bde328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:38.165093 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1480/2974] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:38.166315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fbee6-1bc0-4533-b81f-7851c288335b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:38.166713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fbee6-1bc0-4533-b81f-7851c288335b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:38.167130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fbee6-1bc0-4533-b81f-7851c288335b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:38.211533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1f7fbee6-1bc0-4533-b81f-7851c288335b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:38.212819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1f7fbee6-1bc0-4533-b81f-7851c288335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:38.233836 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1495/2975] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:38.240101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac206d60-cdbb-442a-ac63-e5dec8bde328 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:38.260503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac206d60-cdbb-442a-ac63-e5dec8bde328 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:38.267559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fffc95-69ac-404b-b53b-06b715bf82c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:38.268439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fffc95-69ac-404b-b53b-06b715bf82c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:38.269413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fffc95-69ac-404b-b53b-06b715bf82c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:38.270233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fffc95-69ac-404b-b53b-06b715bf82c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:38.271172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fffc95-69ac-404b-b53b-06b715bf82c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:57:38.271564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fffc95-69ac-404b-b53b-06b715bf82c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:38.273309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fffc95-69ac-404b-b53b-06b715bf82c9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:38.293558 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1481/2976] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:57:38.297341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fbee6-1bc0-4533-b81f-7851c288335b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:38.322256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fbee6-1bc0-4533-b81f-7851c288335b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:38.347221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2ad62-9557-47c2-8f80-756450bbda58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:38.347221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ad62-9557-47c2-8f80-756450bbda58 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:38.347221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ad62-9557-47c2-8f80-756450bbda58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:38.347221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2ad62-9557-47c2-8f80-756450bbda58 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:38.348069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2ad62-9557-47c2-8f80-756450bbda58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:38.360184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2ad62-9557-47c2-8f80-756450bbda58 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:38.429894 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1496/2977] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:57:38 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:38.436050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fffc95-69ac-404b-b53b-06b715bf82c9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:38.445256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:38.451122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fffc95-69ac-404b-b53b-06b715bf82c9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:38.504515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2ad62-9557-47c2-8f80-756450bbda58 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:38.507356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aee2ad62-9557-47c2-8f80-756450bbda58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:38.569452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65bea-1daf-4d9e-aa93-d13eaea5e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:38.570095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65bea-1daf-4d9e-aa93-d13eaea5e975 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:38.570378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65bea-1daf-4d9e-aa93-d13eaea5e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:38.570650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65bea-1daf-4d9e-aa93-d13eaea5e975 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:38.572119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65bea-1daf-4d9e-aa93-d13eaea5e975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:38.579864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65bea-1daf-4d9e-aa93-d13eaea5e975 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:38.617264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:38.625832 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1482/2978] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:57:38 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:38.626882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65bea-1daf-4d9e-aa93-d13eaea5e975 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:38.654669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65bea-1daf-4d9e-aa93-d13eaea5e975 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:38.672816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2b0fe-ab95-4242-b85d-ce5bcf98dec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:38.673666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2b0fe-ab95-4242-b85d-ce5bcf98dec7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:38.673953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2b0fe-ab95-4242-b85d-ce5bcf98dec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:38.674231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2b0fe-ab95-4242-b85d-ce5bcf98dec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:38.675022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2b0fe-ab95-4242-b85d-ce5bcf98dec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:38.677549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2b0fe-ab95-4242-b85d-ce5bcf98dec7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:38.708821 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1483/2979] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:38.709861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2b0fe-ab95-4242-b85d-ce5bcf98dec7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:38.722317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2b0fe-ab95-4242-b85d-ce5bcf98dec7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:38.729898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19f94b-f849-4d81-b5f7-908b57f09074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:38.730604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f94b-f849-4d81-b5f7-908b57f09074 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:38.730977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f94b-f849-4d81-b5f7-908b57f09074 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:38.731324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f94b-f849-4d81-b5f7-908b57f09074 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:38.732040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19f94b-f849-4d81-b5f7-908b57f09074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:38.736218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19f94b-f849-4d81-b5f7-908b57f09074 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:38.737513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2ad62-9557-47c2-8f80-756450bbda58 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:38.751055 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1484/2980] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:38.752088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95973c95-6534-44a4-851d-85cbd37be6c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:38.752785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95973c95-6534-44a4-851d-85cbd37be6c8 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:38.753261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95973c95-6534-44a4-851d-85cbd37be6c8 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:38.754357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95973c95-6534-44a4-851d-85cbd37be6c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:38.756309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19f94b-f849-4d81-b5f7-908b57f09074 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:38.764840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-95973c95-6534-44a4-851d-85cbd37be6c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:38.768566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19f94b-f849-4d81-b5f7-908b57f09074 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:38.776809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc18bb1-0947-48d5-9553-cf486ed5f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:38.777648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18bb1-0947-48d5-9553-cf486ed5f471 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:38.778725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18bb1-0947-48d5-9553-cf486ed5f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:38.779131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc18bb1-0947-48d5-9553-cf486ed5f471 admin admin] PATH_INFO: `/v3/projects/ec45f120c2d340be95053096f264c551/users/abc7968b48134e99b313e433feebb46c/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:38.804649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc18bb1-0947-48d5-9553-cf486ed5f471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec45f120c2d340be95053096f264c551, user_id=abc7968b48134e99b313e433feebb46c, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:38.812142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc18bb1-0947-48d5-9553-cf486ed5f471 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:38.863032 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1485/2981] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:57:38 2022] PUT /identity/v3/projects/ec45f120c2d340be95053096f264c551/users/abc7968b48134e99b313e433feebb46c/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:38.878450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906d27f-9e03-4df2-b5df-b7e71a2c7ee5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:38.881330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906d27f-9e03-4df2-b5df-b7e71a2c7ee5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:38.881886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906d27f-9e03-4df2-b5df-b7e71a2c7ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:38.921820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95973c95-6534-44a4-851d-85cbd37be6c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:38.926617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95973c95-6534-44a4-851d-85cbd37be6c8 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:38.955458 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1497/2982] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:38.968960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9906d27f-9e03-4df2-b5df-b7e71a2c7ee5 None None] MFA Rules not processed for user `abc7968b48134e99b313e433feebb46c`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:38.970342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9906d27f-9e03-4df2-b5df-b7e71a2c7ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:39.073833 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1486/2983] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:40.219938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95973c95-6534-44a4-851d-85cbd37be6c8 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:40.222066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-95973c95-6534-44a4-851d-85cbd37be6c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:40.246827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95973c95-6534-44a4-851d-85cbd37be6c8 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:40.399136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af518a5-6faa-431f-94d5-4c646dde9630 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:40.399136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af518a5-6faa-431f-94d5-4c646dde9630 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:40.399462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af518a5-6faa-431f-94d5-4c646dde9630 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:40.399556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af518a5-6faa-431f-94d5-4c646dde9630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:40.412731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af518a5-6faa-431f-94d5-4c646dde9630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:40.417352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af518a5-6faa-431f-94d5-4c646dde9630 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:40.435281 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1498/2984] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:44.301578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30ac6a-7ce6-455e-8b1b-4f8c113bf399 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:44.302413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30ac6a-7ce6-455e-8b1b-4f8c113bf399 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:44.302892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30ac6a-7ce6-455e-8b1b-4f8c113bf399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:44.325520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9a30ac6a-7ce6-455e-8b1b-4f8c113bf399 None None] MFA Rules not processed for user `d049efd2598f4a528d68972936643fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:44.326779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9a30ac6a-7ce6-455e-8b1b-4f8c113bf399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:44.366486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:44.391505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af518a5-6faa-431f-94d5-4c646dde9630 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:44.411151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af518a5-6faa-431f-94d5-4c646dde9630 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:44.412319 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1487/2985] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:44.413877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd1911-e07a-4477-bd1f-df534130fe6c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:44.414284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd1911-e07a-4477-bd1f-df534130fe6c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:44.414624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd1911-e07a-4477-bd1f-df534130fe6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:44.424487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce90c09-400f-49cb-8401-a97e36e899f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:44.425216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce90c09-400f-49cb-8401-a97e36e899f0 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:44.425900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce90c09-400f-49cb-8401-a97e36e899f0 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:44.426291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce90c09-400f-49cb-8401-a97e36e899f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:44.428287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fce90c09-400f-49cb-8401-a97e36e899f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:44.436329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-eedd1911-e07a-4477-bd1f-df534130fe6c None None] MFA Rules not processed for user `ab694f38b57c4283be1582ce02008978`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:44.438645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eedd1911-e07a-4477-bd1f-df534130fe6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:44.496658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:44.516542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce90c09-400f-49cb-8401-a97e36e899f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:44.518215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce90c09-400f-49cb-8401-a97e36e899f0 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:44.521790 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1488/2986] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:44.531418 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1499/2987] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:57:51.481468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd1911-e07a-4477-bd1f-df534130fe6c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:51.495692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd1911-e07a-4477-bd1f-df534130fe6c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:51.501838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4296d5f-404b-4593-a121-93573e959051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:51.502470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296d5f-404b-4593-a121-93573e959051 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:51.502953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296d5f-404b-4593-a121-93573e959051 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:51.503241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296d5f-404b-4593-a121-93573e959051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:51.505991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d4296d5f-404b-4593-a121-93573e959051 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:51.521860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4296d5f-404b-4593-a121-93573e959051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:51.524537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4296d5f-404b-4593-a121-93573e959051 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:51.538666 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1489/2988] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:51.618942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce90c09-400f-49cb-8401-a97e36e899f0 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:51.757274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce90c09-400f-49cb-8401-a97e36e899f0 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:51.762620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:51.763587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:51.764043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:51.764488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] PATH_INFO: `/v3/users/abc7968b48134e99b313e433feebb46c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:51.765988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc7968b48134e99b313e433feebb46c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:51.768755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:51.842414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc7968b48134e99b313e433feebb46c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:51.853396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc7968b48134e99b313e433feebb46c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:51.854423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc7968b48134e99b313e433feebb46c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:51.869430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc7968b48134e99b313e433feebb46c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:51.870309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc7968b48134e99b313e433feebb46c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:51.897603 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1500/2989] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:57:51 2022] DELETE /identity/v3/users/abc7968b48134e99b313e433feebb46c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:51.901775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92106f95-144a-4d71-a608-860972b3ec08 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:51.902331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92106f95-144a-4d71-a608-860972b3ec08 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:51.902801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92106f95-144a-4d71-a608-860972b3ec08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:51.932414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-92106f95-144a-4d71-a608-860972b3ec08 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:51.934433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-92106f95-144a-4d71-a608-860972b3ec08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:52.038593 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1490/2990] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:57:52.052741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:52.055415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:52.259831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff906998-bdb9-4c45-b878-52cb57317ade admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:52.269788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e9fad-1587-4ade-a453-a24a1ca26199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:52.271116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e9fad-1587-4ade-a453-a24a1ca26199 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:52.271779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e9fad-1587-4ade-a453-a24a1ca26199 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:52.272174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e9fad-1587-4ade-a453-a24a1ca26199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:52.287191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e9fad-1587-4ade-a453-a24a1ca26199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:52.288934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e9fad-1587-4ade-a453-a24a1ca26199 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:52.322934 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1501/2991] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:53.084543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92106f95-144a-4d71-a608-860972b3ec08 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:53.086992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-92106f95-144a-4d71-a608-860972b3ec08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:53.103616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92106f95-144a-4d71-a608-860972b3ec08 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:53.109041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:53.109687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:53.110071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:53.110435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb admin admin] PATH_INFO: `/v3/projects/ec45f120c2d340be95053096f264c551` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:53.111726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec45f120c2d340be95053096f264c551)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:53.114829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:53.187590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec45f120c2d340be95053096f264c551', 'request_id': 'req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:53.199979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec45f120c2d340be95053096f264c551', 'request_id': 'req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:53.217440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec45f120c2d340be95053096f264c551', 'request_id': 'req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:53.232251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:53.239087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb admin admin] The token cache is being invalidate because project ec45f120c2d340be95053096f264c551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:57:53.239791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:53.240969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b25690ae-ebe8-46a9-854d-fcfe2a25fbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:53.243243 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1491/2992] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:57:53 2022] DELETE /identity/v3/projects/ec45f120c2d340be95053096f264c551 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:53.248258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a120b-f0ac-478b-84f7-21e365a23041 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:53.249070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a120b-f0ac-478b-84f7-21e365a23041 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:53.249070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a120b-f0ac-478b-84f7-21e365a23041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:53.278497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cc7a120b-f0ac-478b-84f7-21e365a23041 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:53.280835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cc7a120b-f0ac-478b-84f7-21e365a23041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:53.291555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:53.371254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a7d29-1ef2-4b7a-9129-ef2bee797750 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:53.371640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a7d29-1ef2-4b7a-9129-ef2bee797750 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:53.372057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a7d29-1ef2-4b7a-9129-ef2bee797750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:53.386492 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1502/2993] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:53.395139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febe5cd-640f-4b3f-afeb-f8d323632b95 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:53.395789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febe5cd-640f-4b3f-afeb-f8d323632b95 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:53.396135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febe5cd-640f-4b3f-afeb-f8d323632b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:53.398107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-074a7d29-1ef2-4b7a-9129-ef2bee797750 None None] MFA Rules not processed for user `13d33648c2754ecdb00578d8256087ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:53.399721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-074a7d29-1ef2-4b7a-9129-ef2bee797750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:53.422886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1febe5cd-640f-4b3f-afeb-f8d323632b95 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:53.424942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1febe5cd-640f-4b3f-afeb-f8d323632b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:53.440866 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1503/2994] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:53.444855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febe5cd-640f-4b3f-afeb-f8d323632b95 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:53.455398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febe5cd-640f-4b3f-afeb-f8d323632b95 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:53.461961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79627f-ea7c-41b2-b946-4c069f7962e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:53.462756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79627f-ea7c-41b2-b946-4c069f7962e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:53.463172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79627f-ea7c-41b2-b946-4c069f7962e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:53.463553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79627f-ea7c-41b2-b946-4c069f7962e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:53.464524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79627f-ea7c-41b2-b946-4c069f7962e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:57:53.465047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79627f-ea7c-41b2-b946-4c069f7962e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:53.466804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79627f-ea7c-41b2-b946-4c069f7962e9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:53.482917 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1492/2995] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:57:53.483165 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1504/2996] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:57:53.485537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a7d29-1ef2-4b7a-9129-ef2bee797750 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:53.497443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a7d29-1ef2-4b7a-9129-ef2bee797750 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:53.502626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d40f1-ae75-47db-92ca-3362d8902bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:53.502987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d40f1-ae75-47db-92ca-3362d8902bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:53.503107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d40f1-ae75-47db-92ca-3362d8902bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:53.503815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d40f1-ae75-47db-92ca-3362d8902bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:53.504729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d40f1-ae75-47db-92ca-3362d8902bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:53.506688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d40f1-ae75-47db-92ca-3362d8902bc0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:53.539620 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1493/2997] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:57:53 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:53.546565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79627f-ea7c-41b2-b946-4c069f7962e9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:53.560905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79627f-ea7c-41b2-b946-4c069f7962e9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:53.651239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044e820-8481-438f-b633-be13ba8ee0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:53.655275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e820-8481-438f-b633-be13ba8ee0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:53.657130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e820-8481-438f-b633-be13ba8ee0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:53.657250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e820-8481-438f-b633-be13ba8ee0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:53.658160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044e820-8481-438f-b633-be13ba8ee0e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:53.664855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044e820-8481-438f-b633-be13ba8ee0e8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:53.705153 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1505/2998] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:57:53 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:53.711880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d40f1-ae75-47db-92ca-3362d8902bc0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:53.726174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d40f1-ae75-47db-92ca-3362d8902bc0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:53.731481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7423b1-3a3e-4249-842c-396edc36e4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:53.732144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7423b1-3a3e-4249-842c-396edc36e4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:53.732425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7423b1-3a3e-4249-842c-396edc36e4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:53.732700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7423b1-3a3e-4249-842c-396edc36e4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:53.733371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7423b1-3a3e-4249-842c-396edc36e4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:53.735087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7423b1-3a3e-4249-842c-396edc36e4a5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:53.747671 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1494/2999] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:53.751962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044e820-8481-438f-b633-be13ba8ee0e8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:53.764517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044e820-8481-438f-b633-be13ba8ee0e8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:53.770361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9f005-70b8-4aca-8d44-4508d23c5e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:53.771057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9f005-70b8-4aca-8d44-4508d23c5e06 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:53.771347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9f005-70b8-4aca-8d44-4508d23c5e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:53.771614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9f005-70b8-4aca-8d44-4508d23c5e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:53.772271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9f005-70b8-4aca-8d44-4508d23c5e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:53.773911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9f005-70b8-4aca-8d44-4508d23c5e06 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:53.787331 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1506/3000] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:53.791876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7423b1-3a3e-4249-842c-396edc36e4a5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:53.803409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7423b1-3a3e-4249-842c-396edc36e4a5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:53.808517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b56e8-2150-4668-9d7d-54649ae4fe10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:53.809235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b56e8-2150-4668-9d7d-54649ae4fe10 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:53.809575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b56e8-2150-4668-9d7d-54649ae4fe10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:53.809852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b56e8-2150-4668-9d7d-54649ae4fe10 admin admin] PATH_INFO: `/v3/projects/d52a2fca74c84bdda62f19c434860c6d/users/f3ff4bf1e445490b924914521d500c20/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:53.828237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b56e8-2150-4668-9d7d-54649ae4fe10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52a2fca74c84bdda62f19c434860c6d, user_id=f3ff4bf1e445490b924914521d500c20, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:53.831184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b56e8-2150-4668-9d7d-54649ae4fe10 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:53.860446 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1495/3001] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:57:53 2022] PUT /identity/v3/projects/d52a2fca74c84bdda62f19c434860c6d/users/f3ff4bf1e445490b924914521d500c20/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:53.873824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48659ca-4789-491a-85d2-70c3c50ac08c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:53.874110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48659ca-4789-491a-85d2-70c3c50ac08c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:53.874374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48659ca-4789-491a-85d2-70c3c50ac08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:53.929048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d48659ca-4789-491a-85d2-70c3c50ac08c None None] MFA Rules not processed for user `f3ff4bf1e445490b924914521d500c20`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:53.930416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d48659ca-4789-491a-85d2-70c3c50ac08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:54.039943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:54.046793 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1507/3002] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:57:54.342353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc2695-e1b3-49e5-aa73-0c54b62240aa None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:54.343349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc2695-e1b3-49e5-aa73-0c54b62240aa None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:54.343869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc2695-e1b3-49e5-aa73-0c54b62240aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:54.365259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-16fc2695-e1b3-49e5-aa73-0c54b62240aa None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:54.366425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-16fc2695-e1b3-49e5-aa73-0c54b62240aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:54.490946 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1496/3003] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 18:57:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:54.642710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48659ca-4789-491a-85d2-70c3c50ac08c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:54.644868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d48659ca-4789-491a-85d2-70c3c50ac08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:54.742555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48659ca-4789-491a-85d2-70c3c50ac08c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:54.747757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de85bf-73de-4e16-aee2-766ee6dd2347 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:54.748377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de85bf-73de-4e16-aee2-766ee6dd2347 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:54.748675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de85bf-73de-4e16-aee2-766ee6dd2347 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:54.748919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de85bf-73de-4e16-aee2-766ee6dd2347 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:54.759512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de85bf-73de-4e16-aee2-766ee6dd2347 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:54.761489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de85bf-73de-4e16-aee2-766ee6dd2347 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:54.774250 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1508/3004] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 18:57:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:57:55.120970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc2695-e1b3-49e5-aa73-0c54b62240aa None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:55.122641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-16fc2695-e1b3-49e5-aa73-0c54b62240aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:55.201218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:55.234798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de85bf-73de-4e16-aee2-766ee6dd2347 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:55.236356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f7de85bf-73de-4e16-aee2-766ee6dd2347 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:55.246921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc2695-e1b3-49e5-aa73-0c54b62240aa None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:55.255199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3f279-5711-4730-88f4-d244f3bd17be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:55.260021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3f279-5711-4730-88f4-d244f3bd17be service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:55.260712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3f279-5711-4730-88f4-d244f3bd17be service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:55.261159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3f279-5711-4730-88f4-d244f3bd17be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:55.293389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3f279-5711-4730-88f4-d244f3bd17be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:55.295411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3f279-5711-4730-88f4-d244f3bd17be service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:55.322714 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1497/3005] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:55.387536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3f279-5711-4730-88f4-d244f3bd17be service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:55.400810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de85bf-73de-4e16-aee2-766ee6dd2347 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:55.410139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39586119-5a1c-4619-a9ef-667b001d0c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:55.411211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586119-5a1c-4619-a9ef-667b001d0c3b service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:55.411598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586119-5a1c-4619-a9ef-667b001d0c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:55.412040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39586119-5a1c-4619-a9ef-667b001d0c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:55.414490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-39586119-5a1c-4619-a9ef-667b001d0c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:55.429186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39586119-5a1c-4619-a9ef-667b001d0c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:55.431063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39586119-5a1c-4619-a9ef-667b001d0c3b service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:55.443219 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1509/3006] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:57:55.526529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3f279-5711-4730-88f4-d244f3bd17be service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:55.532842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:55.533647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:55.534034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:55.534433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] PATH_INFO: `/v3/users/f3ff4bf1e445490b924914521d500c20` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:55.536122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ff4bf1e445490b924914521d500c20)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:55.538418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:55.653350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ff4bf1e445490b924914521d500c20'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:55.673276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ff4bf1e445490b924914521d500c20'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:55.674055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ff4bf1e445490b924914521d500c20'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:55.691603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ff4bf1e445490b924914521d500c20'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:55.692834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ff4bf1e445490b924914521d500c20'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:55.724784 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1498/3007] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:57:55 2022] DELETE /identity/v3/users/f3ff4bf1e445490b924914521d500c20 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:57:55.727287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9de700-a84d-4a77-8bdd-192eaf15e159 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:55.727827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9de700-a84d-4a77-8bdd-192eaf15e159 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:55.728122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9de700-a84d-4a77-8bdd-192eaf15e159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:55.756863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-bd9de700-a84d-4a77-8bdd-192eaf15e159 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:55.759032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bd9de700-a84d-4a77-8bdd-192eaf15e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:55.861888 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1510/3008] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:57:55.873107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:55.874586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:55.978615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f53ad-24f1-41fa-bc0b-9e2b9e3d4ca3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:55.985717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4378c-ede9-4d04-abcd-6703ec83ce59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:55.986922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4378c-ede9-4d04-abcd-6703ec83ce59 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:55.988505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4378c-ede9-4d04-abcd-6703ec83ce59 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:55.988841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4378c-ede9-4d04-abcd-6703ec83ce59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:56.007021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4378c-ede9-4d04-abcd-6703ec83ce59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:56.008781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4378c-ede9-4d04-abcd-6703ec83ce59 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:56.014881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:56.023763 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1499/3009] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:57:56.666448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9de700-a84d-4a77-8bdd-192eaf15e159 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:56.668908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bd9de700-a84d-4a77-8bdd-192eaf15e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:56.699493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9de700-a84d-4a77-8bdd-192eaf15e159 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:56.714237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74edab-3f19-4759-acc1-8e36513099ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:56.714914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74edab-3f19-4759-acc1-8e36513099ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:56.715197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74edab-3f19-4759-acc1-8e36513099ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:56.715468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74edab-3f19-4759-acc1-8e36513099ce admin admin] PATH_INFO: `/v3/projects/d52a2fca74c84bdda62f19c434860c6d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:56.718998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74edab-3f19-4759-acc1-8e36513099ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52a2fca74c84bdda62f19c434860c6d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:56.720940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74edab-3f19-4759-acc1-8e36513099ce admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:56.771059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:57:56.806013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0d74edab-3f19-4759-acc1-8e36513099ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52a2fca74c84bdda62f19c434860c6d', 'request_id': 'req-0d74edab-3f19-4759-acc1-8e36513099ce'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:56.813003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0d74edab-3f19-4759-acc1-8e36513099ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52a2fca74c84bdda62f19c434860c6d', 'request_id': 'req-0d74edab-3f19-4759-acc1-8e36513099ce'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:56.821571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0d74edab-3f19-4759-acc1-8e36513099ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52a2fca74c84bdda62f19c434860c6d', 'request_id': 'req-0d74edab-3f19-4759-acc1-8e36513099ce'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:56.842411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0d74edab-3f19-4759-acc1-8e36513099ce admin admin] The token cache is being invalidate because project d52a2fca74c84bdda62f19c434860c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:57:56.843136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0d74edab-3f19-4759-acc1-8e36513099ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:56.844273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0d74edab-3f19-4759-acc1-8e36513099ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:57:56.847071 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1511/3010] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:57:56 2022] DELETE /identity/v3/projects/d52a2fca74c84bdda62f19c434860c6d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:57:56.851993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47aff6-813b-40f2-9d94-1e33a40b5e78 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:56.860657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47aff6-813b-40f2-9d94-1e33a40b5e78 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:56.860657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47aff6-813b-40f2-9d94-1e33a40b5e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:56.895858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1b47aff6-813b-40f2-9d94-1e33a40b5e78 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:56.898680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1b47aff6-813b-40f2-9d94-1e33a40b5e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:57.001604 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1500/3011] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:57.003119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eea38-ad2f-4bc6-811d-b1a447e045a5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:57.004031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eea38-ad2f-4bc6-811d-b1a447e045a5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:57.004316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eea38-ad2f-4bc6-811d-b1a447e045a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:57.032853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-af8eea38-ad2f-4bc6-811d-b1a447e045a5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:57.034180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-af8eea38-ad2f-4bc6-811d-b1a447e045a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:57.047358 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1512/3012] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:57.054067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47aff6-813b-40f2-9d94-1e33a40b5e78 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:57.069912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47aff6-813b-40f2-9d94-1e33a40b5e78 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:57.082647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748ccfd-a583-4e95-bafc-fbc221c2ca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:57.083483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748ccfd-a583-4e95-bafc-fbc221c2ca50 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:57.083746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748ccfd-a583-4e95-bafc-fbc221c2ca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:57.084053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748ccfd-a583-4e95-bafc-fbc221c2ca50 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:57.084809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748ccfd-a583-4e95-bafc-fbc221c2ca50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:57:57.089327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748ccfd-a583-4e95-bafc-fbc221c2ca50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:57.091177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748ccfd-a583-4e95-bafc-fbc221c2ca50 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:57.125083 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1501/3013] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:57:57.132622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8eea38-ad2f-4bc6-811d-b1a447e045a5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:57.148622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8eea38-ad2f-4bc6-811d-b1a447e045a5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:57.154638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec9166-15c4-4445-adaf-4980b0471fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:57.155327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec9166-15c4-4445-adaf-4980b0471fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:57.155637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec9166-15c4-4445-adaf-4980b0471fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:57.156169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec9166-15c4-4445-adaf-4980b0471fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:57.156823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec9166-15c4-4445-adaf-4980b0471fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:57.159037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec9166-15c4-4445-adaf-4980b0471fd0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:57.227374 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1513/3014] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:57:57 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:57:57.231590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748ccfd-a583-4e95-bafc-fbc221c2ca50 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:57.250647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748ccfd-a583-4e95-bafc-fbc221c2ca50 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:57.402791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f2cd5-b992-4056-bed0-183357f78eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:57.403426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2cd5-b992-4056-bed0-183357f78eda admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:57.403711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2cd5-b992-4056-bed0-183357f78eda admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:57.403990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f2cd5-b992-4056-bed0-183357f78eda admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:57.404635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f2cd5-b992-4056-bed0-183357f78eda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:57.406820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f2cd5-b992-4056-bed0-183357f78eda admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:57.455228 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1502/3015] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:57:57 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:57:57.458000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec9166-15c4-4445-adaf-4980b0471fd0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:57.474537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec9166-15c4-4445-adaf-4980b0471fd0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:57.485916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41557f11-3afe-4f12-8b2f-216b66168bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:57.493900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41557f11-3afe-4f12-8b2f-216b66168bca admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:57.494245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41557f11-3afe-4f12-8b2f-216b66168bca admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:57.494983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41557f11-3afe-4f12-8b2f-216b66168bca admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:57.495660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41557f11-3afe-4f12-8b2f-216b66168bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:57.501920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41557f11-3afe-4f12-8b2f-216b66168bca admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:57.545142 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1514/3016] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:57.546684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f2cd5-b992-4056-bed0-183357f78eda admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:57.571685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f2cd5-b992-4056-bed0-183357f78eda admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:57.583088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2211305-9caa-4ad4-8608-2cf45d026b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:57.584150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2211305-9caa-4ad4-8608-2cf45d026b2b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:57.584796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2211305-9caa-4ad4-8608-2cf45d026b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:57.585820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2211305-9caa-4ad4-8608-2cf45d026b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:57.586794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2211305-9caa-4ad4-8608-2cf45d026b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:57.589085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2211305-9caa-4ad4-8608-2cf45d026b2b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:57.621491 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1503/3017] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:57:57.627247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41557f11-3afe-4f12-8b2f-216b66168bca admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:57.645156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41557f11-3afe-4f12-8b2f-216b66168bca admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:57.656622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e58fbc-2743-454b-bd7b-c02ed9547900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:57.658125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e58fbc-2743-454b-bd7b-c02ed9547900 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:57.658694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e58fbc-2743-454b-bd7b-c02ed9547900 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:57.660538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e58fbc-2743-454b-bd7b-c02ed9547900 admin admin] PATH_INFO: `/v3/projects/a5f39b47021a482695c4b4da4c68086d/users/88c918ba482f487686ebd95158a9a9a3/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:57.694525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e58fbc-2743-454b-bd7b-c02ed9547900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f39b47021a482695c4b4da4c68086d, user_id=88c918ba482f487686ebd95158a9a9a3, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:57.697887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e58fbc-2743-454b-bd7b-c02ed9547900 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:57.746831 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1515/3018] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:57:57 2022] PUT /identity/v3/projects/a5f39b47021a482695c4b4da4c68086d/users/88c918ba482f487686ebd95158a9a9a3/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:57:57.749585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4027e4-0f08-4148-9616-a9ee97e6583c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:57.750700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4027e4-0f08-4148-9616-a9ee97e6583c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:57.751272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4027e4-0f08-4148-9616-a9ee97e6583c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:57.804709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ce4027e4-0f08-4148-9616-a9ee97e6583c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:57:57.806007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ce4027e4-0f08-4148-9616-a9ee97e6583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:57.944342 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1504/3019] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:57:57.956224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e58fbc-2743-454b-bd7b-c02ed9547900 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:57:57.958238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-38e58fbc-2743-454b-bd7b-c02ed9547900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:57:58.113873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e58fbc-2743-454b-bd7b-c02ed9547900 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:57:58.118603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2db235-4038-4acf-b7f5-ce8a7ec19ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:57:58.119747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db235-4038-4acf-b7f5-ce8a7ec19ecb service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:57:58.120190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db235-4038-4acf-b7f5-ce8a7ec19ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:57:58.120639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db235-4038-4acf-b7f5-ce8a7ec19ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:57:58.132878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2db235-4038-4acf-b7f5-ce8a7ec19ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:57:58.135870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2db235-4038-4acf-b7f5-ce8a7ec19ecb service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:57:58.151023 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1516/3020] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:58:06.400833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe260c-1f5c-4ec2-a994-afc8b87b0b84 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:06.401345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe260c-1f5c-4ec2-a994-afc8b87b0b84 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:06.401436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe260c-1f5c-4ec2-a994-afc8b87b0b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:06.418673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:06.523702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-89fe260c-1f5c-4ec2-a994-afc8b87b0b84 None None] MFA Rules not processed for user `88c918ba482f487686ebd95158a9a9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:06.525614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-89fe260c-1f5c-4ec2-a994-afc8b87b0b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:06.763381 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1505/3021] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:07.551678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2db235-4038-4acf-b7f5-ce8a7ec19ecb service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:07.559060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8a2db235-4038-4acf-b7f5-ce8a7ec19ecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:07.687186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:07.757712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2db235-4038-4acf-b7f5-ce8a7ec19ecb service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:07.768764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9ea14-7d98-4488-b09e-5090814b2235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:07.769544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9ea14-7d98-4488-b09e-5090814b2235 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:07.769871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9ea14-7d98-4488-b09e-5090814b2235 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:07.770674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9ea14-7d98-4488-b09e-5090814b2235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:07.798299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9ea14-7d98-4488-b09e-5090814b2235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:07.801217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9ea14-7d98-4488-b09e-5090814b2235 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:07.819140 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1517/3022] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:58:16.750084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=30 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:17.812473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=9 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:18.876366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719e74f-b6c9-4d89-a2e5-a4d3e722e8c3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:18.877398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719e74f-b6c9-4d89-a2e5-a4d3e722e8c3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:18.879911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719e74f-b6c9-4d89-a2e5-a4d3e722e8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:18.933516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5719e74f-b6c9-4d89-a2e5-a4d3e722e8c3 None None] MFA Rules not processed for user `d049efd2598f4a528d68972936643fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:18.934783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5719e74f-b6c9-4d89-a2e5-a4d3e722e8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:18.985211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb74111-924c-4380-845a-7b195dda4263 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:18.985728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb74111-924c-4380-845a-7b195dda4263 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:18.985835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb74111-924c-4380-845a-7b195dda4263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:19.057171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ffb74111-924c-4380-845a-7b195dda4263 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:19.059903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ffb74111-924c-4380-845a-7b195dda4263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:19.135639 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1506/3023] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:19.212002 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1518/3024] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 28 18:58:19.247456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719e74f-b6c9-4d89-a2e5-a4d3e722e8c3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:19.250417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5719e74f-b6c9-4d89-a2e5-a4d3e722e8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:19.338488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb74111-924c-4380-845a-7b195dda4263 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:19.340186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ffb74111-924c-4380-845a-7b195dda4263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:19.362039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719e74f-b6c9-4d89-a2e5-a4d3e722e8c3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:19.383897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446271a-a132-4653-96da-be19ac567f05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:19.384169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446271a-a132-4653-96da-be19ac567f05 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:19.384429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446271a-a132-4653-96da-be19ac567f05 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:19.384741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446271a-a132-4653-96da-be19ac567f05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:19.398900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446271a-a132-4653-96da-be19ac567f05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:19.401036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446271a-a132-4653-96da-be19ac567f05 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:19.412711 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1507/3025] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 18:58:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:58:19.466196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb74111-924c-4380-845a-7b195dda4263 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:19.472512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76599e-766c-4b65-a303-7f6004a6c934 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:19.472980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76599e-766c-4b65-a303-7f6004a6c934 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:19.473278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76599e-766c-4b65-a303-7f6004a6c934 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:19.473549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76599e-766c-4b65-a303-7f6004a6c934 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:19.475499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1d76599e-766c-4b65-a303-7f6004a6c934 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:19.491966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76599e-766c-4b65-a303-7f6004a6c934 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:19.493991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76599e-766c-4b65-a303-7f6004a6c934 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:19.522345 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1519/3026] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:58:20.845873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446271a-a132-4653-96da-be19ac567f05 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:20.847909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0446271a-a132-4653-96da-be19ac567f05 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:20.880653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446271a-a132-4653-96da-be19ac567f05 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:20.886265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e43ec7-38b6-482b-8885-984461e02216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:20.887100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e43ec7-38b6-482b-8885-984461e02216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:20.887476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e43ec7-38b6-482b-8885-984461e02216 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:20.887884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e43ec7-38b6-482b-8885-984461e02216 admin admin] PATH_INFO: `/v3/users/b05ce3893f9046cebd1c2cb728f57130` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:20.889155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e43ec7-38b6-482b-8885-984461e02216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05ce3893f9046cebd1c2cb728f57130)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:20.891477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e43ec7-38b6-482b-8885-984461e02216 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:20.966060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c7e43ec7-38b6-482b-8885-984461e02216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05ce3893f9046cebd1c2cb728f57130'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:20.976198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c7e43ec7-38b6-482b-8885-984461e02216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05ce3893f9046cebd1c2cb728f57130'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:20.977289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c7e43ec7-38b6-482b-8885-984461e02216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05ce3893f9046cebd1c2cb728f57130'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:20.997743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c7e43ec7-38b6-482b-8885-984461e02216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05ce3893f9046cebd1c2cb728f57130'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:20.998787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c7e43ec7-38b6-482b-8885-984461e02216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05ce3893f9046cebd1c2cb728f57130'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:21.025235 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1508/3027] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:58:20 2022] DELETE /identity/v3/users/b05ce3893f9046cebd1c2cb728f57130 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:58:21.334657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76599e-766c-4b65-a303-7f6004a6c934 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:21.353019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76599e-766c-4b65-a303-7f6004a6c934 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:21.531621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:21.535610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:21.537277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:21.543130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] PATH_INFO: `/v3/projects/2aada9e76ee24e31a0049ebe09fb5eca` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:21.546503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aada9e76ee24e31a0049ebe09fb5eca)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:21.550157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:21.671547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:21.717769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aada9e76ee24e31a0049ebe09fb5eca', 'request_id': 'req-3a4e8940-6283-43a7-adb6-b5fb83dccec1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:21.746974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aada9e76ee24e31a0049ebe09fb5eca', 'request_id': 'req-3a4e8940-6283-43a7-adb6-b5fb83dccec1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:21.765369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aada9e76ee24e31a0049ebe09fb5eca', 'request_id': 'req-3a4e8940-6283-43a7-adb6-b5fb83dccec1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:21.798780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] The token cache is being invalidate because project 2aada9e76ee24e31a0049ebe09fb5eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:58:21.799800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:21.801037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:21.804531 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1520/3028] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:58:21 2022] DELETE /identity/v3/projects/2aada9e76ee24e31a0049ebe09fb5eca => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:58:21.809373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe04bc-442b-4149-abe4-11db18b083b4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:21.809657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe04bc-442b-4149-abe4-11db18b083b4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:21.809933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe04bc-442b-4149-abe4-11db18b083b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:21.842452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:21.920277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ccbe04bc-442b-4149-abe4-11db18b083b4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:21.933218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ccbe04bc-442b-4149-abe4-11db18b083b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:22.093988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:22.095773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:22.132674 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1509/3029] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:22.141929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e31de4-2eb1-405b-a12d-98d986f2e02b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:22.142368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e31de4-2eb1-405b-a12d-98d986f2e02b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:22.142784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e31de4-2eb1-405b-a12d-98d986f2e02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:22.183902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e5e31de4-2eb1-405b-a12d-98d986f2e02b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:22.185569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e5e31de4-2eb1-405b-a12d-98d986f2e02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:22.219518 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1510/3030] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:22.226174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e31de4-2eb1-405b-a12d-98d986f2e02b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:22.239555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e31de4-2eb1-405b-a12d-98d986f2e02b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:22.246984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb4ec4-fb1a-420e-a65c-6d852440c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:22.247765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb4ec4-fb1a-420e-a65c-6d852440c632 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:22.248351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb4ec4-fb1a-420e-a65c-6d852440c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:22.248747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb4ec4-fb1a-420e-a65c-6d852440c632 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:22.249750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb4ec4-fb1a-420e-a65c-6d852440c632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:58:22.250136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb4ec4-fb1a-420e-a65c-6d852440c632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:22.257473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb4ec4-fb1a-420e-a65c-6d852440c632 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:22.293404 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1511/3031] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:58:22.302202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e8940-6283-43a7-adb6-b5fb83dccec1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:22.302473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb4ec4-fb1a-420e-a65c-6d852440c632 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:22.314404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21d62f-2a32-4065-858c-9ff7fd04ad4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:22.315812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21d62f-2a32-4065-858c-9ff7fd04ad4c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:22.316172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21d62f-2a32-4065-858c-9ff7fd04ad4c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:22.316631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21d62f-2a32-4065-858c-9ff7fd04ad4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:22.335888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ca21d62f-2a32-4065-858c-9ff7fd04ad4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:22.350524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb4ec4-fb1a-420e-a65c-6d852440c632 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:22.359229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21d62f-2a32-4065-858c-9ff7fd04ad4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:22.360717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21d62f-2a32-4065-858c-9ff7fd04ad4c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:22.370523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db534012-13a7-4962-b2b7-d27fa3d306ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:22.371592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db534012-13a7-4962-b2b7-d27fa3d306ff admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:22.374706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db534012-13a7-4962-b2b7-d27fa3d306ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:22.375251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db534012-13a7-4962-b2b7-d27fa3d306ff admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:22.378088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db534012-13a7-4962-b2b7-d27fa3d306ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:22.382816 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1521/3032] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:58:22.384699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db534012-13a7-4962-b2b7-d27fa3d306ff admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:22.464222 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1512/3033] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:58:22 2022] POST /identity/v3/projects => generated 391 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:58:22.470466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21d62f-2a32-4065-858c-9ff7fd04ad4c service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:22.491545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21d62f-2a32-4065-858c-9ff7fd04ad4c service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:22.663205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33124ea1-19c8-47d1-b87a-9077d2a0e391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:22.666035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33124ea1-19c8-47d1-b87a-9077d2a0e391 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:22.667347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33124ea1-19c8-47d1-b87a-9077d2a0e391 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:22.669615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33124ea1-19c8-47d1-b87a-9077d2a0e391 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:22.672672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33124ea1-19c8-47d1-b87a-9077d2a0e391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:22.679304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33124ea1-19c8-47d1-b87a-9077d2a0e391 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:22.774999 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1522/3034] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:58:22 2022] POST /identity/v3/users => generated 296 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:58:22.781077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db534012-13a7-4962-b2b7-d27fa3d306ff admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:22.794510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db534012-13a7-4962-b2b7-d27fa3d306ff admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:22.802066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422075e-87e8-4d41-b772-9d9cb803be48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:22.802388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422075e-87e8-4d41-b772-9d9cb803be48 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:22.802805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422075e-87e8-4d41-b772-9d9cb803be48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:22.803180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422075e-87e8-4d41-b772-9d9cb803be48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:22.803943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422075e-87e8-4d41-b772-9d9cb803be48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:22.806083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422075e-87e8-4d41-b772-9d9cb803be48 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:22.834962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33124ea1-19c8-47d1-b87a-9077d2a0e391 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:22.847425 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1513/3035] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:58:22.852176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33124ea1-19c8-47d1-b87a-9077d2a0e391 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:22.859887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482e434-c1af-4048-a272-542f9c0d3312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:22.861628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482e434-c1af-4048-a272-542f9c0d3312 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:22.862348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482e434-c1af-4048-a272-542f9c0d3312 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:22.862988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482e434-c1af-4048-a272-542f9c0d3312 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:22.864987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482e434-c1af-4048-a272-542f9c0d3312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:22.867550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482e434-c1af-4048-a272-542f9c0d3312 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:22.886626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422075e-87e8-4d41-b772-9d9cb803be48 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:22.895658 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1523/3036] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:58:22.901082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422075e-87e8-4d41-b772-9d9cb803be48 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:22.912145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b0404-882e-489d-afc5-193b05d9fd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:22.913172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b0404-882e-489d-afc5-193b05d9fd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:22.913604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b0404-882e-489d-afc5-193b05d9fd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:22.914158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b0404-882e-489d-afc5-193b05d9fd0e admin admin] PATH_INFO: `/v3/projects/e2a470fda7d84665a08deccfe686b039/users/5f20720deea24b0b80c1c474e7ddbea3/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:22.957737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b0404-882e-489d-afc5-193b05d9fd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a470fda7d84665a08deccfe686b039, user_id=5f20720deea24b0b80c1c474e7ddbea3, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:22.964815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b0404-882e-489d-afc5-193b05d9fd0e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:23.010725 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1514/3037] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:58:22 2022] PUT /identity/v3/projects/e2a470fda7d84665a08deccfe686b039/users/5f20720deea24b0b80c1c474e7ddbea3/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:58:23.012759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91857cd-c0ac-4b82-9c8c-02a243e4e950 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:23.013254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91857cd-c0ac-4b82-9c8c-02a243e4e950 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:23.013571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91857cd-c0ac-4b82-9c8c-02a243e4e950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:23.095607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c91857cd-c0ac-4b82-9c8c-02a243e4e950 None None] MFA Rules not processed for user `5f20720deea24b0b80c1c474e7ddbea3`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:23.100001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c91857cd-c0ac-4b82-9c8c-02a243e4e950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:23.208063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:23.297972 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1524/3038] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:25.021417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b0404-882e-489d-afc5-193b05d9fd0e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:25.024306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ac9b0404-882e-489d-afc5-193b05d9fd0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:25.053320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91857cd-c0ac-4b82-9c8c-02a243e4e950 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:25.055428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c91857cd-c0ac-4b82-9c8c-02a243e4e950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:25.230724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b0404-882e-489d-afc5-193b05d9fd0e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:25.238492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387c768-fc4a-4304-a494-01cb2cb6146e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:25.239443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c768-fc4a-4304-a494-01cb2cb6146e service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:25.239902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c768-fc4a-4304-a494-01cb2cb6146e service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:25.240338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c768-fc4a-4304-a494-01cb2cb6146e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:25.250257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387c768-fc4a-4304-a494-01cb2cb6146e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:25.252212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387c768-fc4a-4304-a494-01cb2cb6146e service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:25.262960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91857cd-c0ac-4b82-9c8c-02a243e4e950 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:25.267467 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1515/3039] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:58:25.284752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acaed77-e417-4dd7-bc1a-d9c03b0bc374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:25.285764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaed77-e417-4dd7-bc1a-d9c03b0bc374 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:25.286253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaed77-e417-4dd7-bc1a-d9c03b0bc374 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:25.286769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acaed77-e417-4dd7-bc1a-d9c03b0bc374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:25.295048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1acaed77-e417-4dd7-bc1a-d9c03b0bc374 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:25.419318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaed77-e417-4dd7-bc1a-d9c03b0bc374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:25.420909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acaed77-e417-4dd7-bc1a-d9c03b0bc374 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:25.433607 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1525/3040] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:58:25.842341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb517ed-3f5d-4c65-9758-aaa0b729117b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:25.843052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb517ed-3f5d-4c65-9758-aaa0b729117b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:25.843625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb517ed-3f5d-4c65-9758-aaa0b729117b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:25.883175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9fb517ed-3f5d-4c65-9758-aaa0b729117b None None] MFA Rules not processed for user `3b738496864a4b04bc885b75980e2341`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:25.890704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9fb517ed-3f5d-4c65-9758-aaa0b729117b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:25.921814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:25.983449 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1516/3041] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:58:28.094380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d524c9-12fb-44e6-af6c-ca45328f02be None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:28.095088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d524c9-12fb-44e6-af6c-ca45328f02be None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:28.095088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d524c9-12fb-44e6-af6c-ca45328f02be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:28.141179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f6d524c9-12fb-44e6-af6c-ca45328f02be None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:28.142626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f6d524c9-12fb-44e6-af6c-ca45328f02be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:28.240396 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1526/3042] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 18:58:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:28.255398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb517ed-3f5d-4c65-9758-aaa0b729117b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:28.257319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9fb517ed-3f5d-4c65-9758-aaa0b729117b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:28.396213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb517ed-3f5d-4c65-9758-aaa0b729117b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:28.402993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ad69d-a273-42cf-9bb4-bba3d41a667d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:28.404233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ad69d-a273-42cf-9bb4-bba3d41a667d service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:28.404682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ad69d-a273-42cf-9bb4-bba3d41a667d service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:28.405171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ad69d-a273-42cf-9bb4-bba3d41a667d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:28.421167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ad69d-a273-42cf-9bb4-bba3d41a667d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:28.424641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ad69d-a273-42cf-9bb4-bba3d41a667d service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:28.437722 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1517/3043] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 18:58:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:58:32.154462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d524c9-12fb-44e6-af6c-ca45328f02be None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:32.159356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f6d524c9-12fb-44e6-af6c-ca45328f02be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:32.201628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:32.341175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d524c9-12fb-44e6-af6c-ca45328f02be None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:32.344899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c94197-c90a-4cd6-b987-cff30bf8787e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:32.345506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c94197-c90a-4cd6-b987-cff30bf8787e service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:32.346154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c94197-c90a-4cd6-b987-cff30bf8787e service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:32.346477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c94197-c90a-4cd6-b987-cff30bf8787e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:32.348796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-83c94197-c90a-4cd6-b987-cff30bf8787e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:32.363387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c94197-c90a-4cd6-b987-cff30bf8787e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:32.364827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c94197-c90a-4cd6-b987-cff30bf8787e service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:32.381766 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1527/3044] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:32 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:58:38.431234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=50 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:40.679359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ad69d-a273-42cf-9bb4-bba3d41a667d service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:40.788811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ad69d-a273-42cf-9bb4-bba3d41a667d service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:40.794062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:40.794939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:40.795292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:40.795648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] PATH_INFO: `/v3/users/5f20720deea24b0b80c1c474e7ddbea3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:40.796875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f20720deea24b0b80c1c474e7ddbea3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:40.799415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:40.873939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f20720deea24b0b80c1c474e7ddbea3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:40.885679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f20720deea24b0b80c1c474e7ddbea3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:40.886540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f20720deea24b0b80c1c474e7ddbea3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:40.905261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f20720deea24b0b80c1c474e7ddbea3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:40.907648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f20720deea24b0b80c1c474e7ddbea3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:40.935198 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1518/3045] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:58:40 2022] DELETE /identity/v3/users/5f20720deea24b0b80c1c474e7ddbea3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:58:40.942788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab918e6-592c-41a0-8a20-0af90d455f75 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:40.942788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab918e6-592c-41a0-8a20-0af90d455f75 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:40.942788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab918e6-592c-41a0-8a20-0af90d455f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:40.968085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0ab918e6-592c-41a0-8a20-0af90d455f75 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:40.969633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0ab918e6-592c-41a0-8a20-0af90d455f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:41.093366 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1528/3046] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:41.105168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:41.107698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:41.225079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f17fc2-bd3e-4c45-9853-b9e5e590fa90 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:41.230140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e7922-4f2e-4176-8d14-f958118b96af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:41.230140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e7922-4f2e-4176-8d14-f958118b96af service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:41.230444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e7922-4f2e-4176-8d14-f958118b96af service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:41.230597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e7922-4f2e-4176-8d14-f958118b96af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:41.244016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e7922-4f2e-4176-8d14-f958118b96af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:41.245604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e7922-4f2e-4176-8d14-f958118b96af service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:41.259261 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1519/3047] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:58:41.619660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab918e6-592c-41a0-8a20-0af90d455f75 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:41.621509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0ab918e6-592c-41a0-8a20-0af90d455f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:41.635873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab918e6-592c-41a0-8a20-0af90d455f75 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:41.643029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d069eb-bcbf-42b9-a433-ea98743afe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:41.643908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d069eb-bcbf-42b9-a433-ea98743afe8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:41.644383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d069eb-bcbf-42b9-a433-ea98743afe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:41.644863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d069eb-bcbf-42b9-a433-ea98743afe8d admin admin] PATH_INFO: `/v3/projects/e2a470fda7d84665a08deccfe686b039` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:41.646519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d069eb-bcbf-42b9-a433-ea98743afe8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a470fda7d84665a08deccfe686b039)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:41.649099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d069eb-bcbf-42b9-a433-ea98743afe8d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:41.722231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-29d069eb-bcbf-42b9-a433-ea98743afe8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a470fda7d84665a08deccfe686b039', 'request_id': 'req-29d069eb-bcbf-42b9-a433-ea98743afe8d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:41.730308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-29d069eb-bcbf-42b9-a433-ea98743afe8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a470fda7d84665a08deccfe686b039', 'request_id': 'req-29d069eb-bcbf-42b9-a433-ea98743afe8d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:41.739516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-29d069eb-bcbf-42b9-a433-ea98743afe8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a470fda7d84665a08deccfe686b039', 'request_id': 'req-29d069eb-bcbf-42b9-a433-ea98743afe8d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:41.758230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-29d069eb-bcbf-42b9-a433-ea98743afe8d admin admin] The token cache is being invalidate because project e2a470fda7d84665a08deccfe686b039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:58:41.758656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-29d069eb-bcbf-42b9-a433-ea98743afe8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:41.759482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-29d069eb-bcbf-42b9-a433-ea98743afe8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:41.767020 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1529/3048] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:58:41 2022] DELETE /identity/v3/projects/e2a470fda7d84665a08deccfe686b039 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:58:41.769481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4172294-7fb2-4fff-b6a2-af2c26f1e623 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:41.770003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4172294-7fb2-4fff-b6a2-af2c26f1e623 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:41.770225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4172294-7fb2-4fff-b6a2-af2c26f1e623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:41.800959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d4172294-7fb2-4fff-b6a2-af2c26f1e623 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:41.802338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d4172294-7fb2-4fff-b6a2-af2c26f1e623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:41.837791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:41.904673 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1520/3049] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:41.913473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a0902-80b4-4698-9496-cb6ace0cdc5a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:41.914708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a0902-80b4-4698-9496-cb6ace0cdc5a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:41.915025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a0902-80b4-4698-9496-cb6ace0cdc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:41.945388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f36a0902-80b4-4698-9496-cb6ace0cdc5a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:41.946724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f36a0902-80b4-4698-9496-cb6ace0cdc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:41.961961 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1530/3050] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:41.963532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4172294-7fb2-4fff-b6a2-af2c26f1e623 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:41.980704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4172294-7fb2-4fff-b6a2-af2c26f1e623 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:41.985925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adf642-928a-4c92-ba82-855b6e282222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:41.987462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adf642-928a-4c92-ba82-855b6e282222 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:41.987763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adf642-928a-4c92-ba82-855b6e282222 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:41.988042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69adf642-928a-4c92-ba82-855b6e282222 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:41.988736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adf642-928a-4c92-ba82-855b6e282222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:58:41.989036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adf642-928a-4c92-ba82-855b6e282222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:41.991290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69adf642-928a-4c92-ba82-855b6e282222 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:42.008514 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1521/3051] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:58:42.012983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a0902-80b4-4698-9496-cb6ace0cdc5a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:42.038299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a0902-80b4-4698-9496-cb6ace0cdc5a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:42.044624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d66aa-883f-4cac-b835-577ed92a6bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:42.044624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d66aa-883f-4cac-b835-577ed92a6bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:42.044624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d66aa-883f-4cac-b835-577ed92a6bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:42.044624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d66aa-883f-4cac-b835-577ed92a6bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:42.045346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d66aa-883f-4cac-b835-577ed92a6bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:42.047513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d66aa-883f-4cac-b835-577ed92a6bc9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:42.064875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:42.097204 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1531/3052] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:58:42 2022] POST /identity/v3/projects => generated 399 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:58:42.101059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adf642-928a-4c92-ba82-855b6e282222 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:42.112901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69adf642-928a-4c92-ba82-855b6e282222 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:42.205169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0860f9-0dd3-43ec-b300-74bd711573f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:42.206264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0860f9-0dd3-43ec-b300-74bd711573f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:42.206699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0860f9-0dd3-43ec-b300-74bd711573f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:42.207163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0860f9-0dd3-43ec-b300-74bd711573f2 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:42.208242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0860f9-0dd3-43ec-b300-74bd711573f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:42.214781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0860f9-0dd3-43ec-b300-74bd711573f2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:42.251468 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1522/3053] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:58:42 2022] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:58:42.254009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d66aa-883f-4cac-b835-577ed92a6bc9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:42.274144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d66aa-883f-4cac-b835-577ed92a6bc9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:42.282625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4c35-6382-4f5b-b6a9-9a799c5eb542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:42.284525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4c35-6382-4f5b-b6a9-9a799c5eb542 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:42.284737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4c35-6382-4f5b-b6a9-9a799c5eb542 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:42.285021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea4c35-6382-4f5b-b6a9-9a799c5eb542 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:42.285774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea4c35-6382-4f5b-b6a9-9a799c5eb542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:42.287845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea4c35-6382-4f5b-b6a9-9a799c5eb542 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:42.300854 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1532/3054] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:58:42.305782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0860f9-0dd3-43ec-b300-74bd711573f2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:42.319717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0860f9-0dd3-43ec-b300-74bd711573f2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:42.326390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302d483-2d15-4769-8267-086c02f7a0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:42.327883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302d483-2d15-4769-8267-086c02f7a0ce admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:42.327883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302d483-2d15-4769-8267-086c02f7a0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:42.328310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302d483-2d15-4769-8267-086c02f7a0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:42.329115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302d483-2d15-4769-8267-086c02f7a0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:42.332181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302d483-2d15-4769-8267-086c02f7a0ce admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:42.349897 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1523/3055] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:58:42.352978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4c35-6382-4f5b-b6a9-9a799c5eb542 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:42.383065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea4c35-6382-4f5b-b6a9-9a799c5eb542 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:42.384058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dff5a0-b353-4dc3-bd17-cc05a6c141ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:42.388787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dff5a0-b353-4dc3-bd17-cc05a6c141ec admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:42.388787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dff5a0-b353-4dc3-bd17-cc05a6c141ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:42.388787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dff5a0-b353-4dc3-bd17-cc05a6c141ec admin admin] PATH_INFO: `/v3/projects/5803a49dd7fc49fc944395a73a48db22/users/dde58a9a43c749bba5f2015e0f476975/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:42.418252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dff5a0-b353-4dc3-bd17-cc05a6c141ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5803a49dd7fc49fc944395a73a48db22, user_id=dde58a9a43c749bba5f2015e0f476975, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:42.423433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dff5a0-b353-4dc3-bd17-cc05a6c141ec admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:42.445099 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1533/3056] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:58:42 2022] PUT /identity/v3/projects/5803a49dd7fc49fc944395a73a48db22/users/dde58a9a43c749bba5f2015e0f476975/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:58:42.456189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155be06-2a81-4376-b5a9-12534f472dc2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:42.456468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155be06-2a81-4376-b5a9-12534f472dc2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:42.456740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155be06-2a81-4376-b5a9-12534f472dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:42.494977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3155be06-2a81-4376-b5a9-12534f472dc2 None None] MFA Rules not processed for user `dde58a9a43c749bba5f2015e0f476975`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:42.496900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3155be06-2a81-4376-b5a9-12534f472dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:42.642884 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1524/3057] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:42.710670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e6209-9aab-44e4-97af-d9146ce8a2bc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:42.711275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e6209-9aab-44e4-97af-d9146ce8a2bc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:42.711660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e6209-9aab-44e4-97af-d9146ce8a2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:42.734083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-dc5e6209-9aab-44e4-97af-d9146ce8a2bc None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:42.735707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dc5e6209-9aab-44e4-97af-d9146ce8a2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:42.817848 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1534/3058] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 18:58:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:42.840964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155be06-2a81-4376-b5a9-12534f472dc2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:42.843600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3155be06-2a81-4376-b5a9-12534f472dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:42.872118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:42.954850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155be06-2a81-4376-b5a9-12534f472dc2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:42.963124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e6209-9aab-44e4-97af-d9146ce8a2bc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:42.964615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dc5e6209-9aab-44e4-97af-d9146ce8a2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:42.968795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef630cc-987e-491f-856f-a8d6c57fa877 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:42.969544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef630cc-987e-491f-856f-a8d6c57fa877 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:42.969901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef630cc-987e-491f-856f-a8d6c57fa877 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:42.970131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef630cc-987e-491f-856f-a8d6c57fa877 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:42.992074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef630cc-987e-491f-856f-a8d6c57fa877 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:42.993718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef630cc-987e-491f-856f-a8d6c57fa877 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:43.005811 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1525/3059] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 18:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 18:58:43.096954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e6209-9aab-44e4-97af-d9146ce8a2bc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:43.104425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7701d-4e98-4e5e-9af4-d8e91c347bd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:43.105054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7701d-4e98-4e5e-9af4-d8e91c347bd4 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:43.105333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7701d-4e98-4e5e-9af4-d8e91c347bd4 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:43.105607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7701d-4e98-4e5e-9af4-d8e91c347bd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:43.115599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7701d-4e98-4e5e-9af4-d8e91c347bd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:43.117303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7701d-4e98-4e5e-9af4-d8e91c347bd4 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:43.127730 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1535/3060] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:58:43.188408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef630cc-987e-491f-856f-a8d6c57fa877 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:43.321955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef630cc-987e-491f-856f-a8d6c57fa877 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:43.334263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:43.336181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:43.337654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:43.338020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] PATH_INFO: `/v3/users/dde58a9a43c749bba5f2015e0f476975` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:43.339820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde58a9a43c749bba5f2015e0f476975)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:43.342099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:43.423340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde58a9a43c749bba5f2015e0f476975'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:43.443899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde58a9a43c749bba5f2015e0f476975'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:43.444593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde58a9a43c749bba5f2015e0f476975'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:43.469877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde58a9a43c749bba5f2015e0f476975'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:43.472709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde58a9a43c749bba5f2015e0f476975'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:43.502937 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1526/3061] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:58:43 2022] DELETE /identity/v3/users/dde58a9a43c749bba5f2015e0f476975 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:58:43.508409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffc8be-e15f-4ed3-8a58-7f5536660b6d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:43.508808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffc8be-e15f-4ed3-8a58-7f5536660b6d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:43.509346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffc8be-e15f-4ed3-8a58-7f5536660b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:43.548194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-23ffc8be-e15f-4ed3-8a58-7f5536660b6d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:43.551330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-23ffc8be-e15f-4ed3-8a58-7f5536660b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:43.672072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:43.719839 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1536/3062] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:58:43.749971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:43.752275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:43.848183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:43.891254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daccce5-b818-4733-9d8f-acbd7055e3d6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:43.896720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398da9c-5957-480e-b807-fc5f80008b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:43.897611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398da9c-5957-480e-b807-fc5f80008b60 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:43.899617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398da9c-5957-480e-b807-fc5f80008b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:43.900098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398da9c-5957-480e-b807-fc5f80008b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:43.912520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398da9c-5957-480e-b807-fc5f80008b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:43.914601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398da9c-5957-480e-b807-fc5f80008b60 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:43.929362 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1527/3063] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:58:44.542647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffc8be-e15f-4ed3-8a58-7f5536660b6d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:44.544692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-23ffc8be-e15f-4ed3-8a58-7f5536660b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:44.563826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffc8be-e15f-4ed3-8a58-7f5536660b6d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:44.570288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:44.571227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:44.571706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:44.572145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a admin admin] PATH_INFO: `/v3/projects/5803a49dd7fc49fc944395a73a48db22` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:44.573712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5803a49dd7fc49fc944395a73a48db22)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:44.576040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:44.665567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5803a49dd7fc49fc944395a73a48db22', 'request_id': 'req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:44.675597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5803a49dd7fc49fc944395a73a48db22', 'request_id': 'req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:44.684234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5803a49dd7fc49fc944395a73a48db22', 'request_id': 'req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:44.707863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a admin admin] The token cache is being invalidate because project 5803a49dd7fc49fc944395a73a48db22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:58:44.708490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:44.709607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cf3dd1e2-79b1-4dd9-a978-d9b8c2c4756a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:44.712142 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1537/3064] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:58:44 2022] DELETE /identity/v3/projects/5803a49dd7fc49fc944395a73a48db22 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:58:44.717454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675e4d3-fdc1-45c8-9e04-2317b06cc929 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:44.718098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675e4d3-fdc1-45c8-9e04-2317b06cc929 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:44.718557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675e4d3-fdc1-45c8-9e04-2317b06cc929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:44.740804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6675e4d3-fdc1-45c8-9e04-2317b06cc929 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:44.743021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6675e4d3-fdc1-45c8-9e04-2317b06cc929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:44.827526 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1528/3065] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:44.828969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2789d9-872b-4b80-9c3b-bd5f0b390d1b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:44.829261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2789d9-872b-4b80-9c3b-bd5f0b390d1b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:44.829570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2789d9-872b-4b80-9c3b-bd5f0b390d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:44.862581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ac2789d9-872b-4b80-9c3b-bd5f0b390d1b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:44.865047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ac2789d9-872b-4b80-9c3b-bd5f0b390d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:44.881556 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1538/3066] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:44.885174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675e4d3-fdc1-45c8-9e04-2317b06cc929 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:44.900120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675e4d3-fdc1-45c8-9e04-2317b06cc929 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:44.907113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56641c5c-04b5-4f25-acd9-36d2466b8f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:44.908232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641c5c-04b5-4f25-acd9-36d2466b8f26 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:44.909243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641c5c-04b5-4f25-acd9-36d2466b8f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:44.910300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641c5c-04b5-4f25-acd9-36d2466b8f26 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:44.911235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56641c5c-04b5-4f25-acd9-36d2466b8f26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:58:44.911711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56641c5c-04b5-4f25-acd9-36d2466b8f26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:44.913688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56641c5c-04b5-4f25-acd9-36d2466b8f26 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:44.941064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2789d9-872b-4b80-9c3b-bd5f0b390d1b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:44.941321 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1529/3067] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:58:44.952850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2789d9-872b-4b80-9c3b-bd5f0b390d1b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:44.969773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742792-3a0d-450d-ae2d-bda16f156edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:44.971316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742792-3a0d-450d-ae2d-bda16f156edc admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:44.971604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742792-3a0d-450d-ae2d-bda16f156edc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:44.971881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8742792-3a0d-450d-ae2d-bda16f156edc admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:44.972658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8742792-3a0d-450d-ae2d-bda16f156edc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:44.974866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8742792-3a0d-450d-ae2d-bda16f156edc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:45.049726 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1539/3068] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:58:44 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:58:45.052022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56641c5c-04b5-4f25-acd9-36d2466b8f26 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:45.075743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56641c5c-04b5-4f25-acd9-36d2466b8f26 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:45.269632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055df16-ef92-41c2-868f-480f83e9e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:45.270183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055df16-ef92-41c2-868f-480f83e9e765 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:45.270465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055df16-ef92-41c2-868f-480f83e9e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:45.270768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055df16-ef92-41c2-868f-480f83e9e765 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:45.271399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055df16-ef92-41c2-868f-480f83e9e765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:45.273373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055df16-ef92-41c2-868f-480f83e9e765 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:45.333664 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1530/3069] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:58:45 2022] POST /identity/v3/users => generated 288 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:58:45.338314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742792-3a0d-450d-ae2d-bda16f156edc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:45.352027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8742792-3a0d-450d-ae2d-bda16f156edc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:45.357286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f3682-4247-47ad-9c6a-39b6ae6b78bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:45.358081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f3682-4247-47ad-9c6a-39b6ae6b78bf admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:45.358365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f3682-4247-47ad-9c6a-39b6ae6b78bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:45.358641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f3682-4247-47ad-9c6a-39b6ae6b78bf admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:45.359608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f3682-4247-47ad-9c6a-39b6ae6b78bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:45.361370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f3682-4247-47ad-9c6a-39b6ae6b78bf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:45.379181 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1540/3070] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:58:45.383544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055df16-ef92-41c2-868f-480f83e9e765 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:45.401449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055df16-ef92-41c2-868f-480f83e9e765 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:45.437198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae3715-6023-436a-86e9-6667873628bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:45.438108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3715-6023-436a-86e9-6667873628bb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:45.438549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3715-6023-436a-86e9-6667873628bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:45.439912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae3715-6023-436a-86e9-6667873628bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:45.446972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae3715-6023-436a-86e9-6667873628bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:45.453355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae3715-6023-436a-86e9-6667873628bb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:45.488276 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1531/3071] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:58:45.492394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f3682-4247-47ad-9c6a-39b6ae6b78bf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:45.511847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f3682-4247-47ad-9c6a-39b6ae6b78bf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:45.531627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa3e74-ea71-48ca-8c60-195538e46cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:45.532601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa3e74-ea71-48ca-8c60-195538e46cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:45.533459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa3e74-ea71-48ca-8c60-195538e46cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:45.534329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa3e74-ea71-48ca-8c60-195538e46cf0 admin admin] PATH_INFO: `/v3/projects/da7078e87a8a4ccbae0dfbfc71d448e5/users/26726afc7c1746949ff868d5046efcdf/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:45.572001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa3e74-ea71-48ca-8c60-195538e46cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7078e87a8a4ccbae0dfbfc71d448e5, user_id=26726afc7c1746949ff868d5046efcdf, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:45.575982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa3e74-ea71-48ca-8c60-195538e46cf0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:45.606554 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1541/3072] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:58:45 2022] PUT /identity/v3/projects/da7078e87a8a4ccbae0dfbfc71d448e5/users/26726afc7c1746949ff868d5046efcdf/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:58:45.612311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698adb1-a1b6-4778-b239-29beca27ac17 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:45.613324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698adb1-a1b6-4778-b239-29beca27ac17 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:45.613838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698adb1-a1b6-4778-b239-29beca27ac17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:45.646049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3698adb1-a1b6-4778-b239-29beca27ac17 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:45.648551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3698adb1-a1b6-4778-b239-29beca27ac17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:45.761933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:45.776059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5054c55-73f3-49a4-a95e-15c4ee86c611 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:45.777241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5054c55-73f3-49a4-a95e-15c4ee86c611 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:45.778700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5054c55-73f3-49a4-a95e-15c4ee86c611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:45.836041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f5054c55-73f3-49a4-a95e-15c4ee86c611 None None] MFA Rules not processed for user `ab694f38b57c4283be1582ce02008978`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:45.840559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f5054c55-73f3-49a4-a95e-15c4ee86c611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:45.855106 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1532/3073] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:45.862628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698adb1-a1b6-4778-b239-29beca27ac17 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:45.865083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3698adb1-a1b6-4778-b239-29beca27ac17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:46.016089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698adb1-a1b6-4778-b239-29beca27ac17 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:46.026558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b632d9-466c-4aad-a5e1-51873d6e7f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:46.028155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b632d9-466c-4aad-a5e1-51873d6e7f8d service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:46.035106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b632d9-466c-4aad-a5e1-51873d6e7f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:46.035106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b632d9-466c-4aad-a5e1-51873d6e7f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:46.035389 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1542/3074] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:58:46.045376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b632d9-466c-4aad-a5e1-51873d6e7f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:46.047003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b632d9-466c-4aad-a5e1-51873d6e7f8d service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:46.066173 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1533/3075] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:58:49.381268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f75a5-57ee-4faf-87a0-875c55c8b8c0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:49.381894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f75a5-57ee-4faf-87a0-875c55c8b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:49.381894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f75a5-57ee-4faf-87a0-875c55c8b8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:49.424614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ff7f75a5-57ee-4faf-87a0-875c55c8b8c0 None None] MFA Rules not processed for user `d049efd2598f4a528d68972936643fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:49.426784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ff7f75a5-57ee-4faf-87a0-875c55c8b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:49.449441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:49.684315 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1543/3076] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:58:51.320379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b632d9-466c-4aad-a5e1-51873d6e7f8d service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:51.321961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b9b632d9-466c-4aad-a5e1-51873d6e7f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:51.366503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b632d9-466c-4aad-a5e1-51873d6e7f8d service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:51.381829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15680e30-7ef3-4af9-9f04-2bb0a2f5116f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:51.383857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680e30-7ef3-4af9-9f04-2bb0a2f5116f service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:51.384352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680e30-7ef3-4af9-9f04-2bb0a2f5116f service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:51.384802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680e30-7ef3-4af9-9f04-2bb0a2f5116f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:51.390490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-15680e30-7ef3-4af9-9f04-2bb0a2f5116f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:51.452993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15680e30-7ef3-4af9-9f04-2bb0a2f5116f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:51.457128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15680e30-7ef3-4af9-9f04-2bb0a2f5116f service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:51.460648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f75a5-57ee-4faf-87a0-875c55c8b8c0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:51.462233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ff7f75a5-57ee-4faf-87a0-875c55c8b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:51.476952 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1534/3077] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:58:51.507430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f75a5-57ee-4faf-87a0-875c55c8b8c0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:51.528309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:51.530094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:51.530508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:51.530967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] PATH_INFO: `/v3/users/5c6a6357990a409b923387e093effc5a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:51.542094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6a6357990a409b923387e093effc5a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:51.544112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:51.723886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6a6357990a409b923387e093effc5a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:51.742033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6a6357990a409b923387e093effc5a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:51.745843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6a6357990a409b923387e093effc5a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:51.775874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6a6357990a409b923387e093effc5a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:51.777244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6a6357990a409b923387e093effc5a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:51.809651 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1544/3078] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:58:51 2022] DELETE /identity/v3/users/5c6a6357990a409b923387e093effc5a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:58:51.814984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeb7d5-0cbd-417e-874d-2be73dcb5a15 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:51.815494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeb7d5-0cbd-417e-874d-2be73dcb5a15 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:51.816005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeb7d5-0cbd-417e-874d-2be73dcb5a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:51.858400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-20eeb7d5-0cbd-417e-874d-2be73dcb5a15 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:51.860836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-20eeb7d5-0cbd-417e-874d-2be73dcb5a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:52.065545 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1535/3079] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:52.087057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:52.089078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:52.330187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa6a1c-8c21-4e7f-9c0f-0a4840c402ba admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:52.364697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8cd05-4b33-4de3-b381-a07dc064af67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:52.368366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8cd05-4b33-4de3-b381-a07dc064af67 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:52.369088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8cd05-4b33-4de3-b381-a07dc064af67 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:52.369692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8cd05-4b33-4de3-b381-a07dc064af67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:52.420099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8cd05-4b33-4de3-b381-a07dc064af67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:52.426112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8cd05-4b33-4de3-b381-a07dc064af67 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:52.488315 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1545/3080] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:58:53.286821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eeb7d5-0cbd-417e-874d-2be73dcb5a15 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:53.288312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-20eeb7d5-0cbd-417e-874d-2be73dcb5a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:53.317092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eeb7d5-0cbd-417e-874d-2be73dcb5a15 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:53.337548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179548ca-898e-42be-92d5-2d046742a9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:53.338297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179548ca-898e-42be-92d5-2d046742a9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:53.338588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179548ca-898e-42be-92d5-2d046742a9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:53.338898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179548ca-898e-42be-92d5-2d046742a9ea admin admin] PATH_INFO: `/v3/projects/0b5959f5bf14403ca7be274025ace123` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:53.343976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179548ca-898e-42be-92d5-2d046742a9ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5959f5bf14403ca7be274025ace123)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:53.351867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179548ca-898e-42be-92d5-2d046742a9ea admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:53.480997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-179548ca-898e-42be-92d5-2d046742a9ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5959f5bf14403ca7be274025ace123', 'request_id': 'req-179548ca-898e-42be-92d5-2d046742a9ea'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:53.496353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-179548ca-898e-42be-92d5-2d046742a9ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5959f5bf14403ca7be274025ace123', 'request_id': 'req-179548ca-898e-42be-92d5-2d046742a9ea'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:53.503229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:53.510297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-179548ca-898e-42be-92d5-2d046742a9ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5959f5bf14403ca7be274025ace123', 'request_id': 'req-179548ca-898e-42be-92d5-2d046742a9ea'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:53.544424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-179548ca-898e-42be-92d5-2d046742a9ea admin admin] The token cache is being invalidate because project 0b5959f5bf14403ca7be274025ace123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:58:53.545383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-179548ca-898e-42be-92d5-2d046742a9ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:53.546881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-179548ca-898e-42be-92d5-2d046742a9ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:58:53.550072 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1536/3081] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:58:53 2022] DELETE /identity/v3/projects/0b5959f5bf14403ca7be274025ace123 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:58:53.558772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3690b-41e2-4ed1-a397-eafd54f9557e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:53.559358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3690b-41e2-4ed1-a397-eafd54f9557e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:53.560041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3690b-41e2-4ed1-a397-eafd54f9557e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:53.638662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a5f3690b-41e2-4ed1-a397-eafd54f9557e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:53.647746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a5f3690b-41e2-4ed1-a397-eafd54f9557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:53.710887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:58:53.791959 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1546/3082] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:53.794273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc0409-c8ae-4d86-b067-4aa5a197fa87 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:53.794876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc0409-c8ae-4d86-b067-4aa5a197fa87 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:53.795560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc0409-c8ae-4d86-b067-4aa5a197fa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:53.880224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-32cc0409-c8ae-4d86-b067-4aa5a197fa87 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:53.884005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-32cc0409-c8ae-4d86-b067-4aa5a197fa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:53.924779 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1537/3083] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:58:53.930540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3690b-41e2-4ed1-a397-eafd54f9557e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:53.954136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3690b-41e2-4ed1-a397-eafd54f9557e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:53.971311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deb577-bd8c-4019-939d-5d695ec5a5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:53.974292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deb577-bd8c-4019-939d-5d695ec5a5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:53.974581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deb577-bd8c-4019-939d-5d695ec5a5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:53.974933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99deb577-bd8c-4019-939d-5d695ec5a5e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:53.976245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99deb577-bd8c-4019-939d-5d695ec5a5e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:58:53.976561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99deb577-bd8c-4019-939d-5d695ec5a5e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:53.978327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99deb577-bd8c-4019-939d-5d695ec5a5e1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:54.001111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc0409-c8ae-4d86-b067-4aa5a197fa87 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:54.003265 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1547/3084] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:58:54.023988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc0409-c8ae-4d86-b067-4aa5a197fa87 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:54.050582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb5808-8ccd-451c-b4b6-6ae425c7c746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:54.050582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb5808-8ccd-451c-b4b6-6ae425c7c746 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:54.050582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb5808-8ccd-451c-b4b6-6ae425c7c746 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:54.050582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb5808-8ccd-451c-b4b6-6ae425c7c746 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:54.054127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb5808-8ccd-451c-b4b6-6ae425c7c746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:54.055616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb5808-8ccd-451c-b4b6-6ae425c7c746 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:54.158653 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1538/3085] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:58:54 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:58:54.164263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deb577-bd8c-4019-939d-5d695ec5a5e1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:54.181359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99deb577-bd8c-4019-939d-5d695ec5a5e1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:54.359501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8241d-828a-49a3-807c-4296c30fb542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:54.360255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8241d-828a-49a3-807c-4296c30fb542 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:54.361167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8241d-828a-49a3-807c-4296c30fb542 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:54.361803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8241d-828a-49a3-807c-4296c30fb542 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:54.362725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8241d-828a-49a3-807c-4296c30fb542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:54.367013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8241d-828a-49a3-807c-4296c30fb542 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:54.430124 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1548/3086] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:58:54 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:58:54.431714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb5808-8ccd-451c-b4b6-6ae425c7c746 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:54.450959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb5808-8ccd-451c-b4b6-6ae425c7c746 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:54.458222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529b106-3e8f-439c-9b3c-b1515d9377d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:54.459168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529b106-3e8f-439c-9b3c-b1515d9377d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:54.459619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529b106-3e8f-439c-9b3c-b1515d9377d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:54.460060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529b106-3e8f-439c-9b3c-b1515d9377d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:54.460919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529b106-3e8f-439c-9b3c-b1515d9377d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:54.462821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529b106-3e8f-439c-9b3c-b1515d9377d3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:54.475464 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1539/3087] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:58:54.480126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8241d-828a-49a3-807c-4296c30fb542 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:54.509197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8241d-828a-49a3-807c-4296c30fb542 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:54.514940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e50760-8f70-406f-934b-1c9828c36af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:54.515822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e50760-8f70-406f-934b-1c9828c36af7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:54.516148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e50760-8f70-406f-934b-1c9828c36af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:54.516538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e50760-8f70-406f-934b-1c9828c36af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:54.518338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e50760-8f70-406f-934b-1c9828c36af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:54.521271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e50760-8f70-406f-934b-1c9828c36af7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:54.544698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529b106-3e8f-439c-9b3c-b1515d9377d3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:54.544972 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1549/3088] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:58:54.574931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529b106-3e8f-439c-9b3c-b1515d9377d3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:54.583654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba81bb5-cfba-4e7b-8b84-e7cb8aec9a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:54.584917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81bb5-cfba-4e7b-8b84-e7cb8aec9a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:54.585697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81bb5-cfba-4e7b-8b84-e7cb8aec9a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:54.586143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81bb5-cfba-4e7b-8b84-e7cb8aec9a5f admin admin] PATH_INFO: `/v3/projects/c384c6b548a849ff949da659c2138ce0/users/9ce380dc51d24674b870aebf8ee6a793/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:54.607174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba81bb5-cfba-4e7b-8b84-e7cb8aec9a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c384c6b548a849ff949da659c2138ce0, user_id=9ce380dc51d24674b870aebf8ee6a793, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:54.610064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba81bb5-cfba-4e7b-8b84-e7cb8aec9a5f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:54.637733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ede5d7-5bee-4036-af23-59d4242b4b05 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:54.638190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ede5d7-5bee-4036-af23-59d4242b4b05 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:54.638427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ede5d7-5bee-4036-af23-59d4242b4b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:54.639206 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1540/3089] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:58:54 2022] PUT /identity/v3/projects/c384c6b548a849ff949da659c2138ce0/users/9ce380dc51d24674b870aebf8ee6a793/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:58:54.688631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e3ede5d7-5bee-4036-af23-59d4242b4b05 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:58:54.695407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e3ede5d7-5bee-4036-af23-59d4242b4b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:54.858624 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1550/3090] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:58:54.975223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba81bb5-cfba-4e7b-8b84-e7cb8aec9a5f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:58:54.978715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4ba81bb5-cfba-4e7b-8b84-e7cb8aec9a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:58:55.163831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba81bb5-cfba-4e7b-8b84-e7cb8aec9a5f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:58:55.172513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fac34d-e46d-4b9b-9e9d-557e3b3d28bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:58:55.173572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fac34d-e46d-4b9b-9e9d-557e3b3d28bf service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:58:55.174627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fac34d-e46d-4b9b-9e9d-557e3b3d28bf service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:58:55.175121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fac34d-e46d-4b9b-9e9d-557e3b3d28bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:58:55.198489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fac34d-e46d-4b9b-9e9d-557e3b3d28bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:58:55.200975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fac34d-e46d-4b9b-9e9d-557e3b3d28bf service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:58:55.230974 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1541/3091] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:01.327751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33135eb-aeb6-4efd-8c6b-7f5f71e0d450 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:01.328277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33135eb-aeb6-4efd-8c6b-7f5f71e0d450 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:01.328401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33135eb-aeb6-4efd-8c6b-7f5f71e0d450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:01.434319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f33135eb-aeb6-4efd-8c6b-7f5f71e0d450 None None] MFA Rules not processed for user `26726afc7c1746949ff868d5046efcdf`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:01.436488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f33135eb-aeb6-4efd-8c6b-7f5f71e0d450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:01.550787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:01.728959 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1551/3092] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:01.797868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fac34d-e46d-4b9b-9e9d-557e3b3d28bf service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:01.808832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fac34d-e46d-4b9b-9e9d-557e3b3d28bf service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:01.824098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6e1db-a07d-431d-9e81-f2dbc851ca1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:01.824732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6e1db-a07d-431d-9e81-f2dbc851ca1e service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:01.825166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6e1db-a07d-431d-9e81-f2dbc851ca1e service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:01.825448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6e1db-a07d-431d-9e81-f2dbc851ca1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:01.843136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6e1db-a07d-431d-9e81-f2dbc851ca1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:01.844589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6e1db-a07d-431d-9e81-f2dbc851ca1e service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:01.877024 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1542/3093] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:09.486444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33135eb-aeb6-4efd-8c6b-7f5f71e0d450 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:09.489691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f33135eb-aeb6-4efd-8c6b-7f5f71e0d450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:09.520074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33135eb-aeb6-4efd-8c6b-7f5f71e0d450 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:09.528693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837807e-fc6b-44bf-8ce0-c125fbd05874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:09.530143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837807e-fc6b-44bf-8ce0-c125fbd05874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:09.531244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837807e-fc6b-44bf-8ce0-c125fbd05874 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:09.532047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837807e-fc6b-44bf-8ce0-c125fbd05874 admin admin] PATH_INFO: `/v3/users/88c918ba482f487686ebd95158a9a9a3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:09.534395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837807e-fc6b-44bf-8ce0-c125fbd05874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c918ba482f487686ebd95158a9a9a3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:09.539001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837807e-fc6b-44bf-8ce0-c125fbd05874 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:09.647507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2837807e-fc6b-44bf-8ce0-c125fbd05874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c918ba482f487686ebd95158a9a9a3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:09.667290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2837807e-fc6b-44bf-8ce0-c125fbd05874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c918ba482f487686ebd95158a9a9a3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:09.668690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2837807e-fc6b-44bf-8ce0-c125fbd05874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c918ba482f487686ebd95158a9a9a3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:09.684499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2837807e-fc6b-44bf-8ce0-c125fbd05874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c918ba482f487686ebd95158a9a9a3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:09.686430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2837807e-fc6b-44bf-8ce0-c125fbd05874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c918ba482f487686ebd95158a9a9a3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:09.737527 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1552/3094] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:09 2022] DELETE /identity/v3/users/88c918ba482f487686ebd95158a9a9a3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:09.871585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6e1db-a07d-431d-9e81-f2dbc851ca1e service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:09.873507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-72a6e1db-a07d-431d-9e81-f2dbc851ca1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:09.895790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6e1db-a07d-431d-9e81-f2dbc851ca1e service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:10.015258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:10.020074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:10.021561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:10.021561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] PATH_INFO: `/v3/users/b05e0387a6b84cdb9b1b59dae6281802` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:10.036192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05e0387a6b84cdb9b1b59dae6281802)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:10.042449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:10.086818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:10.149693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05e0387a6b84cdb9b1b59dae6281802'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:10.160454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05e0387a6b84cdb9b1b59dae6281802'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:10.161515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05e0387a6b84cdb9b1b59dae6281802'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:10.179835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05e0387a6b84cdb9b1b59dae6281802'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:10.180648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05e0387a6b84cdb9b1b59dae6281802'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:10.211999 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1543/3095] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:09 2022] DELETE /identity/v3/users/b05e0387a6b84cdb9b1b59dae6281802 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:10.216248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f652ba-7733-4fc1-a8d1-0c2b2e886430 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:10.216534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f652ba-7733-4fc1-a8d1-0c2b2e886430 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:10.216816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f652ba-7733-4fc1-a8d1-0c2b2e886430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:10.225677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:10.228847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:10.248458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c2f652ba-7733-4fc1-a8d1-0c2b2e886430 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:10.254635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c2f652ba-7733-4fc1-a8d1-0c2b2e886430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:10.430567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d08882-a373-4854-9437-a76f90219c8f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:10.443237 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1553/3096] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:10.443463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae2917-df29-40c4-9e85-0a1159ca723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:10.443463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae2917-df29-40c4-9e85-0a1159ca723a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:10.443463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae2917-df29-40c4-9e85-0a1159ca723a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:10.443837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae2917-df29-40c4-9e85-0a1159ca723a admin admin] PATH_INFO: `/v3/projects/a5f39b47021a482695c4b4da4c68086d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:10.444815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae2917-df29-40c4-9e85-0a1159ca723a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f39b47021a482695c4b4da4c68086d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:10.447027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae2917-df29-40c4-9e85-0a1159ca723a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:10.473436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f652ba-7733-4fc1-a8d1-0c2b2e886430 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:10.475554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c2f652ba-7733-4fc1-a8d1-0c2b2e886430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:10.575338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8cae2917-df29-40c4-9e85-0a1159ca723a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f39b47021a482695c4b4da4c68086d', 'request_id': 'req-8cae2917-df29-40c4-9e85-0a1159ca723a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:10.585855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:10.592000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8cae2917-df29-40c4-9e85-0a1159ca723a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f39b47021a482695c4b4da4c68086d', 'request_id': 'req-8cae2917-df29-40c4-9e85-0a1159ca723a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:10.601612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8cae2917-df29-40c4-9e85-0a1159ca723a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f39b47021a482695c4b4da4c68086d', 'request_id': 'req-8cae2917-df29-40c4-9e85-0a1159ca723a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:10.628761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f652ba-7733-4fc1-a8d1-0c2b2e886430 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:10.636559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8cae2917-df29-40c4-9e85-0a1159ca723a admin admin] The token cache is being invalidate because project a5f39b47021a482695c4b4da4c68086d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:10.636836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8cae2917-df29-40c4-9e85-0a1159ca723a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:10.639672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8cae2917-df29-40c4-9e85-0a1159ca723a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:10.644804 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1544/3097] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:10 2022] DELETE /identity/v3/projects/a5f39b47021a482695c4b4da4c68086d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:10.651594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c9ed4-624b-4733-8256-6b9b6b187c72 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:10.651889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c9ed4-624b-4733-8256-6b9b6b187c72 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:10.652717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c9ed4-624b-4733-8256-6b9b6b187c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:10.727387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b97c9ed4-624b-4733-8256-6b9b6b187c72 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:10.732253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b97c9ed4-624b-4733-8256-6b9b6b187c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:10.751529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da0a78-751c-4343-a69e-cde3d5748326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:10.752357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da0a78-751c-4343-a69e-cde3d5748326 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:10.752882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da0a78-751c-4343-a69e-cde3d5748326 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:10.753342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da0a78-751c-4343-a69e-cde3d5748326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:10.756970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b4da0a78-751c-4343-a69e-cde3d5748326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:10.762280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:10.835402 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1545/3098] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:10.848199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08986d31-cca4-480d-8149-623b4c77a2dd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:10.848199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08986d31-cca4-480d-8149-623b4c77a2dd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:10.849646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08986d31-cca4-480d-8149-623b4c77a2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:10.899074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-08986d31-cca4-480d-8149-623b4c77a2dd None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:10.903554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-08986d31-cca4-480d-8149-623b4c77a2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:10.927749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da0a78-751c-4343-a69e-cde3d5748326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:10.931057 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1546/3099] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:10.933203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8153d2-f452-49b8-b4a7-8223653d276a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:10.933920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8153d2-f452-49b8-b4a7-8223653d276a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:10.934301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8153d2-f452-49b8-b4a7-8223653d276a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:10.938947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da0a78-751c-4343-a69e-cde3d5748326 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:10.976031 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1554/3100] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:59:10.977517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da0a78-751c-4343-a69e-cde3d5748326 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:10.997389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da0a78-751c-4343-a69e-cde3d5748326 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:11.003919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cf8153d2-f452-49b8-b4a7-8223653d276a None None] MFA Rules not processed for user `26726afc7c1746949ff868d5046efcdf`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:11.004611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7946bb-df56-498d-8049-9090c29362b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:11.005174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cf8153d2-f452-49b8-b4a7-8223653d276a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:11.005683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7946bb-df56-498d-8049-9090c29362b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:11.006143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7946bb-df56-498d-8049-9090c29362b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:11.006594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7946bb-df56-498d-8049-9090c29362b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:11.007480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7946bb-df56-498d-8049-9090c29362b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:59:11.007968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7946bb-df56-498d-8049-9090c29362b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:11.009909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7946bb-df56-498d-8049-9090c29362b8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:11.037251 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1555/3101] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:59:11.038669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7946bb-df56-498d-8049-9090c29362b8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:11.053063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7946bb-df56-498d-8049-9090c29362b8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:11.058958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941338e-9436-4928-bcfa-b77e766cebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:11.060317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941338e-9436-4928-bcfa-b77e766cebd0 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:11.060516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941338e-9436-4928-bcfa-b77e766cebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:11.060803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941338e-9436-4928-bcfa-b77e766cebd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:11.061748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941338e-9436-4928-bcfa-b77e766cebd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:11.065842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941338e-9436-4928-bcfa-b77e766cebd0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:11.108784 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1556/3102] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:59:11 2022] POST /identity/v3/projects => generated 403 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:11.113369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941338e-9436-4928-bcfa-b77e766cebd0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:11.146412 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1547/3103] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:11.238102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941338e-9436-4928-bcfa-b77e766cebd0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:11.251700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2103b59-8e94-4040-9c67-fb1d63277280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:11.252397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2103b59-8e94-4040-9c67-fb1d63277280 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:11.252685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2103b59-8e94-4040-9c67-fb1d63277280 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:11.253115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2103b59-8e94-4040-9c67-fb1d63277280 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:11.253909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2103b59-8e94-4040-9c67-fb1d63277280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:11.258484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2103b59-8e94-4040-9c67-fb1d63277280 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:11.288125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:11.298800 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1557/3104] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:59:11 2022] POST /identity/v3/users => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:11.301793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8153d2-f452-49b8-b4a7-8223653d276a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:11.321671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8153d2-f452-49b8-b4a7-8223653d276a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:11.327410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a375c-2b9b-4e15-a7a3-1b3661f728e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:11.328436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a375c-2b9b-4e15-a7a3-1b3661f728e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:11.329776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a375c-2b9b-4e15-a7a3-1b3661f728e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:11.330636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a375c-2b9b-4e15-a7a3-1b3661f728e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:11.331522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a375c-2b9b-4e15-a7a3-1b3661f728e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:11.333311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a375c-2b9b-4e15-a7a3-1b3661f728e5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:11.354427 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1548/3105] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:11.358396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2103b59-8e94-4040-9c67-fb1d63277280 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:11.370906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2103b59-8e94-4040-9c67-fb1d63277280 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:11.379880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbf3a6-bd0a-4e11-8016-4e714bae03ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:11.380513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf3a6-bd0a-4e11-8016-4e714bae03ee admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:11.380802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf3a6-bd0a-4e11-8016-4e714bae03ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:11.381082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf3a6-bd0a-4e11-8016-4e714bae03ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:11.382458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbf3a6-bd0a-4e11-8016-4e714bae03ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:11.384289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbf3a6-bd0a-4e11-8016-4e714bae03ee admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:11.417828 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1558/3106] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:11.420011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a375c-2b9b-4e15-a7a3-1b3661f728e5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:11.437195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a375c-2b9b-4e15-a7a3-1b3661f728e5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:11.448063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a127484-936f-4197-9297-2d57d7ed65cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:11.448762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a127484-936f-4197-9297-2d57d7ed65cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:11.449046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a127484-936f-4197-9297-2d57d7ed65cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:11.449323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a127484-936f-4197-9297-2d57d7ed65cd admin admin] PATH_INFO: `/v3/projects/df712555bc304e319ecdb8615649661b/users/fcd1f4b070634a1a802d35289c3b74e0/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:11.492969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a127484-936f-4197-9297-2d57d7ed65cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=df712555bc304e319ecdb8615649661b, user_id=fcd1f4b070634a1a802d35289c3b74e0, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:11.496075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a127484-936f-4197-9297-2d57d7ed65cd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:11.517732 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1549/3107] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:11 2022] PUT /identity/v3/projects/df712555bc304e319ecdb8615649661b/users/fcd1f4b070634a1a802d35289c3b74e0/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:11.523397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ed5c7-5f50-4874-bbb5-8c2e5e140d83 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:11.523969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ed5c7-5f50-4874-bbb5-8c2e5e140d83 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:11.524718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ed5c7-5f50-4874-bbb5-8c2e5e140d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:11.553423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-390ed5c7-5f50-4874-bbb5-8c2e5e140d83 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:11.555385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-390ed5c7-5f50-4874-bbb5-8c2e5e140d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:11.706184 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1559/3108] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:59:11.724822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a127484-936f-4197-9297-2d57d7ed65cd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:11.731687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8a127484-936f-4197-9297-2d57d7ed65cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:11.739667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ed5c7-5f50-4874-bbb5-8c2e5e140d83 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:11.746589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-390ed5c7-5f50-4874-bbb5-8c2e5e140d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:11.810521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ed5c7-5f50-4874-bbb5-8c2e5e140d83 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:11.822716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:11.823406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:11.823686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:11.825364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] PATH_INFO: `/v3/projects/e26234e7d0dc44ce823e045b2a1bcc53` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:11.827056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26234e7d0dc44ce823e045b2a1bcc53)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:11.834090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:11.952127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a127484-936f-4197-9297-2d57d7ed65cd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:11.964044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecbf8a-d370-4e60-a0bd-9bbef46832a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:11.965012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecbf8a-d370-4e60-a0bd-9bbef46832a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:11.965455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecbf8a-d370-4e60-a0bd-9bbef46832a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:11.965896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecbf8a-d370-4e60-a0bd-9bbef46832a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:11.989422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecbf8a-d370-4e60-a0bd-9bbef46832a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:11.991009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecbf8a-d370-4e60-a0bd-9bbef46832a8 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:11.999687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26234e7d0dc44ce823e045b2a1bcc53', 'request_id': 'req-c7ca26b2-4606-410e-994e-42375b5c2069'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:12.009267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26234e7d0dc44ce823e045b2a1bcc53', 'request_id': 'req-c7ca26b2-4606-410e-994e-42375b5c2069'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:12.019109 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1550/3109] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:12.032431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26234e7d0dc44ce823e045b2a1bcc53', 'request_id': 'req-c7ca26b2-4606-410e-994e-42375b5c2069'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:12.064454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] The token cache is being invalidate because project e26234e7d0dc44ce823e045b2a1bcc53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:12.065063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:12.066155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:12.068338 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1560/3110] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:11 2022] DELETE /identity/v3/projects/e26234e7d0dc44ce823e045b2a1bcc53 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:12.072178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecbf8a-d370-4e60-a0bd-9bbef46832a8 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:12.088245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecbf8a-d370-4e60-a0bd-9bbef46832a8 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:12.159751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:12.242304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ec667-235b-465a-8e7c-3981bf78de19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:12.243014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ec667-235b-465a-8e7c-3981bf78de19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:12.243759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ec667-235b-465a-8e7c-3981bf78de19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:12.243759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ec667-235b-465a-8e7c-3981bf78de19 admin admin] PATH_INFO: `/v3/users/c5f0eae0a7ce47c6845a21491624a5c3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:12.244788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ec667-235b-465a-8e7c-3981bf78de19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f0eae0a7ce47c6845a21491624a5c3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:12.246792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ec667-235b-465a-8e7c-3981bf78de19 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:12.380925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1a9ec667-235b-465a-8e7c-3981bf78de19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f0eae0a7ce47c6845a21491624a5c3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:12.394039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1a9ec667-235b-465a-8e7c-3981bf78de19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f0eae0a7ce47c6845a21491624a5c3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:12.395302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1a9ec667-235b-465a-8e7c-3981bf78de19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f0eae0a7ce47c6845a21491624a5c3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:12.413977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1a9ec667-235b-465a-8e7c-3981bf78de19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f0eae0a7ce47c6845a21491624a5c3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:12.415231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1a9ec667-235b-465a-8e7c-3981bf78de19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f0eae0a7ce47c6845a21491624a5c3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:12.466154 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1551/3111] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:12 2022] DELETE /identity/v3/users/c5f0eae0a7ce47c6845a21491624a5c3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:13.361999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:13.364665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:13.389128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca26b2-4606-410e-994e-42375b5c2069 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:13.516118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:13.518323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:13.518866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:13.519381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1 admin admin] PATH_INFO: `/v3/projects/e1058aee765c49a0abae2cb6693f6251` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:13.522021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1058aee765c49a0abae2cb6693f6251)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:13.529624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:13.587057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:13.648445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1058aee765c49a0abae2cb6693f6251', 'request_id': 'req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:13.696761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1058aee765c49a0abae2cb6693f6251', 'request_id': 'req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:13.729595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1058aee765c49a0abae2cb6693f6251', 'request_id': 'req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:13.761528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1 admin admin] The token cache is being invalidate because project e1058aee765c49a0abae2cb6693f6251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:13.763173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:13.768636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2591b1fc-b8bb-4fbc-a8c7-46e7d91ce3d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:13.778081 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1561/3112] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:13 2022] DELETE /identity/v3/projects/e1058aee765c49a0abae2cb6693f6251 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:13.781951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f04879-91eb-435c-bd12-60680e1258d4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:13.783230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f04879-91eb-435c-bd12-60680e1258d4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:13.783745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f04879-91eb-435c-bd12-60680e1258d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:13.823601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-30f04879-91eb-435c-bd12-60680e1258d4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:13.833394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-30f04879-91eb-435c-bd12-60680e1258d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:13.952270 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1552/3113] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:13.960626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05fe0f-d183-400f-90ef-75d4d8ac9770 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:13.960988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05fe0f-d183-400f-90ef-75d4d8ac9770 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:13.961413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05fe0f-d183-400f-90ef-75d4d8ac9770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:13.996645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1e05fe0f-d183-400f-90ef-75d4d8ac9770 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:14.000009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1e05fe0f-d183-400f-90ef-75d4d8ac9770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:14.042421 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1562/3114] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:14.049619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f04879-91eb-435c-bd12-60680e1258d4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:14.068099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f04879-91eb-435c-bd12-60680e1258d4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:14.089629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50e868-2e2d-40fa-b5f4-8df9c695d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:14.093342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e868-2e2d-40fa-b5f4-8df9c695d3ed admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:14.094229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e868-2e2d-40fa-b5f4-8df9c695d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:14.095577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e868-2e2d-40fa-b5f4-8df9c695d3ed admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:14.121706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50e868-2e2d-40fa-b5f4-8df9c695d3ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:59:14.122014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50e868-2e2d-40fa-b5f4-8df9c695d3ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:14.133239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50e868-2e2d-40fa-b5f4-8df9c695d3ed admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:14.169612 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1553/3115] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:59:14.174884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05fe0f-d183-400f-90ef-75d4d8ac9770 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:14.202106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05fe0f-d183-400f-90ef-75d4d8ac9770 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:14.210361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888662c-4c5f-484e-a87c-e648e2e833a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:14.211513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888662c-4c5f-484e-a87c-e648e2e833a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:14.212016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888662c-4c5f-484e-a87c-e648e2e833a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:14.212419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888662c-4c5f-484e-a87c-e648e2e833a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:14.216496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888662c-4c5f-484e-a87c-e648e2e833a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:14.218900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888662c-4c5f-484e-a87c-e648e2e833a0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:14.297806 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1563/3116] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:59:14 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:14.303444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50e868-2e2d-40fa-b5f4-8df9c695d3ed admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:14.316785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50e868-2e2d-40fa-b5f4-8df9c695d3ed admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:14.399273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:14.443711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fe499-bc73-478d-ba19-8d646105b2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:14.444790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fe499-bc73-478d-ba19-8d646105b2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:14.444968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fe499-bc73-478d-ba19-8d646105b2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:14.446801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fe499-bc73-478d-ba19-8d646105b2e5 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:14.446801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fe499-bc73-478d-ba19-8d646105b2e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:14.448178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fe499-bc73-478d-ba19-8d646105b2e5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:14.508543 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1554/3117] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:59:14 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:59:14.508838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888662c-4c5f-484e-a87c-e648e2e833a0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:14.527574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888662c-4c5f-484e-a87c-e648e2e833a0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:14.537926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab16d5-6ff0-40ab-b6fc-12813361cc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:14.539049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab16d5-6ff0-40ab-b6fc-12813361cc99 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:14.539584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab16d5-6ff0-40ab-b6fc-12813361cc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:14.540719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab16d5-6ff0-40ab-b6fc-12813361cc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:14.541722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab16d5-6ff0-40ab-b6fc-12813361cc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:14.545125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab16d5-6ff0-40ab-b6fc-12813361cc99 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:14.585730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fe499-bc73-478d-ba19-8d646105b2e5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:14.587253 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1564/3118] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:14.601981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fe499-bc73-478d-ba19-8d646105b2e5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:14.613478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267617af-9a7c-4491-a0dc-fd7eeb54a858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:14.615075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267617af-9a7c-4491-a0dc-fd7eeb54a858 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:14.616939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267617af-9a7c-4491-a0dc-fd7eeb54a858 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:14.617412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267617af-9a7c-4491-a0dc-fd7eeb54a858 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:14.618936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267617af-9a7c-4491-a0dc-fd7eeb54a858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:14.623178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267617af-9a7c-4491-a0dc-fd7eeb54a858 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:14.651426 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1555/3119] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:59:14.656800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab16d5-6ff0-40ab-b6fc-12813361cc99 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:14.677612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab16d5-6ff0-40ab-b6fc-12813361cc99 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:14.687388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859283e-39aa-46fc-a945-709d3540aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:14.691012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859283e-39aa-46fc-a945-709d3540aa10 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:14.692233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859283e-39aa-46fc-a945-709d3540aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:14.693346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859283e-39aa-46fc-a945-709d3540aa10 admin admin] PATH_INFO: `/v3/projects/4b189ceff1b5481c86c63e0760ca656d/users/b00ba5fa7e2a407b8b4652e49306fcac/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:14.718788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859283e-39aa-46fc-a945-709d3540aa10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b189ceff1b5481c86c63e0760ca656d, user_id=b00ba5fa7e2a407b8b4652e49306fcac, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:14.726109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859283e-39aa-46fc-a945-709d3540aa10 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:14.758713 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1565/3120] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:14 2022] PUT /identity/v3/projects/4b189ceff1b5481c86c63e0760ca656d/users/b00ba5fa7e2a407b8b4652e49306fcac/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:14.771329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3803ab-a31e-4cde-87da-4b5174b0e5c5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:14.771631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3803ab-a31e-4cde-87da-4b5174b0e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:14.771956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3803ab-a31e-4cde-87da-4b5174b0e5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:14.819994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fd3803ab-a31e-4cde-87da-4b5174b0e5c5 None None] MFA Rules not processed for user `b00ba5fa7e2a407b8b4652e49306fcac`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:14.822039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fd3803ab-a31e-4cde-87da-4b5174b0e5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:14.967442 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1556/3121] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:14.972269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859283e-39aa-46fc-a945-709d3540aa10 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:15.104992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa953e-6933-4098-9ebf-33877a45491b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:15.105357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa953e-6933-4098-9ebf-33877a45491b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:15.105706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa953e-6933-4098-9ebf-33877a45491b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:15.133800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859283e-39aa-46fc-a945-709d3540aa10 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:15.160664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23358930-2c1e-4797-9457-2331791b1263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:15.161604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23358930-2c1e-4797-9457-2331791b1263 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:15.163021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23358930-2c1e-4797-9457-2331791b1263 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:15.163402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23358930-2c1e-4797-9457-2331791b1263 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:15.165752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23358930-2c1e-4797-9457-2331791b1263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:15.178397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23358930-2c1e-4797-9457-2331791b1263 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:15.343844 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1566/3122] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:59:14 2022] POST /identity/v3/projects => generated 385 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:15.344888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23358930-2c1e-4797-9457-2331791b1263 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:15.347079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7caa953e-6933-4098-9ebf-33877a45491b None None] MFA Rules not processed for user `9ce380dc51d24674b870aebf8ee6a793`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:15.350988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7caa953e-6933-4098-9ebf-33877a45491b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:15.448944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:15.589080 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1557/3123] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:15.591850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23358930-2c1e-4797-9457-2331791b1263 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:15.612126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec2582-2252-4725-8ef8-989ca6ff8614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:15.612763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec2582-2252-4725-8ef8-989ca6ff8614 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:15.613042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec2582-2252-4725-8ef8-989ca6ff8614 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:15.613317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec2582-2252-4725-8ef8-989ca6ff8614 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:15.613963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec2582-2252-4725-8ef8-989ca6ff8614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:15.615978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec2582-2252-4725-8ef8-989ca6ff8614 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:15.761767 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1567/3124] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:59:15 2022] POST /identity/v3/users => generated 299 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:15.768514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa953e-6933-4098-9ebf-33877a45491b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:15.808740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa953e-6933-4098-9ebf-33877a45491b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:15.824837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9f595-d850-41bf-afb2-7e06c200c438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:15.825500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9f595-d850-41bf-afb2-7e06c200c438 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:15.825717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9f595-d850-41bf-afb2-7e06c200c438 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:15.825993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9f595-d850-41bf-afb2-7e06c200c438 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:15.826899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9f595-d850-41bf-afb2-7e06c200c438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:15.829495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9f595-d850-41bf-afb2-7e06c200c438 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:15.845482 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1558/3125] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:15.849961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec2582-2252-4725-8ef8-989ca6ff8614 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:15.861999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec2582-2252-4725-8ef8-989ca6ff8614 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:15.872264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa5ac7-0aa6-4ac6-94f7-f5b5409ae154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:15.873077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa5ac7-0aa6-4ac6-94f7-f5b5409ae154 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:15.873355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa5ac7-0aa6-4ac6-94f7-f5b5409ae154 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:15.873831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa5ac7-0aa6-4ac6-94f7-f5b5409ae154 admin admin] PATH_INFO: `/v3/projects/3d4ed3dc70d440bbb22b71f5e0e8a1b0/users/2994eb4a0ae047f69a1b78e96e28479b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:15.920739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa5ac7-0aa6-4ac6-94f7-f5b5409ae154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4ed3dc70d440bbb22b71f5e0e8a1b0, user_id=2994eb4a0ae047f69a1b78e96e28479b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:15.925262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa5ac7-0aa6-4ac6-94f7-f5b5409ae154 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:15.963072 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1568/3126] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:15 2022] PUT /identity/v3/projects/3d4ed3dc70d440bbb22b71f5e0e8a1b0/users/2994eb4a0ae047f69a1b78e96e28479b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:15.964342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9f595-d850-41bf-afb2-7e06c200c438 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:15.987369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9f595-d850-41bf-afb2-7e06c200c438 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:16.055244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:16.170897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d8f5a-a5f6-424a-bc9e-c287ae10cb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:16.171667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d8f5a-a5f6-424a-bc9e-c287ae10cb55 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:16.171987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d8f5a-a5f6-424a-bc9e-c287ae10cb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:16.172322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d8f5a-a5f6-424a-bc9e-c287ae10cb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:16.173715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d8f5a-a5f6-424a-bc9e-c287ae10cb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:16.178601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d8f5a-a5f6-424a-bc9e-c287ae10cb55 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:16.220573 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1559/3127] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:16.224760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa5ac7-0aa6-4ac6-94f7-f5b5409ae154 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:16.240685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa5ac7-0aa6-4ac6-94f7-f5b5409ae154 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:16.256185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd648437-d7c0-4259-9333-62800f74e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:16.257707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd648437-d7c0-4259-9333-62800f74e021 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:16.258728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd648437-d7c0-4259-9333-62800f74e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:16.259289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd648437-d7c0-4259-9333-62800f74e021 admin admin] PATH_INFO: `/v3/projects/3d4ed3dc70d440bbb22b71f5e0e8a1b0/users/2994eb4a0ae047f69a1b78e96e28479b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:16.261734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd648437-d7c0-4259-9333-62800f74e021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4ed3dc70d440bbb22b71f5e0e8a1b0, user_id=2994eb4a0ae047f69a1b78e96e28479b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:16.265470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd648437-d7c0-4259-9333-62800f74e021 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:16.303592 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1569/3128] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:16 2022] PUT /identity/v3/projects/3d4ed3dc70d440bbb22b71f5e0e8a1b0/users/2994eb4a0ae047f69a1b78e96e28479b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:59:16.313903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d91e-c66e-4c35-93ce-46803e02135d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:16.315684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d91e-c66e-4c35-93ce-46803e02135d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:16.316256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1d91e-c66e-4c35-93ce-46803e02135d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:16.370211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6ff1d91e-c66e-4c35-93ce-46803e02135d None None] MFA Rules not processed for user `2994eb4a0ae047f69a1b78e96e28479b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:16.372774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6ff1d91e-c66e-4c35-93ce-46803e02135d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:16.589488 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1560/3129] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:17.311749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd648437-d7c0-4259-9333-62800f74e021 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:17.314665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bd648437-d7c0-4259-9333-62800f74e021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:17.607013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd648437-d7c0-4259-9333-62800f74e021 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:17.646838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5921cb-c484-42b6-9be4-620c6f0f783c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:17.647697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5921cb-c484-42b6-9be4-620c6f0f783c service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:17.648106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5921cb-c484-42b6-9be4-620c6f0f783c service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:17.648560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5921cb-c484-42b6-9be4-620c6f0f783c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:17.809323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5921cb-c484-42b6-9be4-620c6f0f783c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:17.811176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5921cb-c484-42b6-9be4-620c6f0f783c service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:17.828289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:17.861078 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1570/3130] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:18.087260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1d91e-c66e-4c35-93ce-46803e02135d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:18.269457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1d91e-c66e-4c35-93ce-46803e02135d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:18.286044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc35e0a-2098-458b-a772-46091e9ea913 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:18.287145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc35e0a-2098-458b-a772-46091e9ea913 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:18.287663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc35e0a-2098-458b-a772-46091e9ea913 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:18.288182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc35e0a-2098-458b-a772-46091e9ea913 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:18.301378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc35e0a-2098-458b-a772-46091e9ea913 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:18.304028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc35e0a-2098-458b-a772-46091e9ea913 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:18.370230 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1561/3131] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:20.865397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5921cb-c484-42b6-9be4-620c6f0f783c service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:21.048410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5921cb-c484-42b6-9be4-620c6f0f783c service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:21.057299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:21.058410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:21.058941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:21.059405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] PATH_INFO: `/v3/users/b00ba5fa7e2a407b8b4652e49306fcac` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:21.060854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00ba5fa7e2a407b8b4652e49306fcac)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:21.065670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:21.210127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00ba5fa7e2a407b8b4652e49306fcac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:21.224195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00ba5fa7e2a407b8b4652e49306fcac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:21.226050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00ba5fa7e2a407b8b4652e49306fcac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:21.254842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00ba5fa7e2a407b8b4652e49306fcac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:21.256807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00ba5fa7e2a407b8b4652e49306fcac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:21.327865 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1571/3132] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:20 2022] DELETE /identity/v3/users/b00ba5fa7e2a407b8b4652e49306fcac => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:21.333309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d81cd-1591-4f83-b380-71c01fbf4573 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:21.333870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d81cd-1591-4f83-b380-71c01fbf4573 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:21.333870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d81cd-1591-4f83-b380-71c01fbf4573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:21.393875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2d7d81cd-1591-4f83-b380-71c01fbf4573 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:21.395275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2d7d81cd-1591-4f83-b380-71c01fbf4573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:21.664919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:21.724528 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1562/3133] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:21.817742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:21.819356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:21.989406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e6608-056d-4cbe-956f-86e80ad487f4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:21.998296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d216ea5-a08b-46a0-bf55-aebaf37545cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:21.999116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d216ea5-a08b-46a0-bf55-aebaf37545cd service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:21.999519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d216ea5-a08b-46a0-bf55-aebaf37545cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:21.999895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d216ea5-a08b-46a0-bf55-aebaf37545cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:22.035165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d216ea5-a08b-46a0-bf55-aebaf37545cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:22.036751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d216ea5-a08b-46a0-bf55-aebaf37545cd service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:22.063658 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1572/3134] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:23.998000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec7d90-efd1-4838-bed9-2aea85fb43fa None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:23.999064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec7d90-efd1-4838-bed9-2aea85fb43fa None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:23.999528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec7d90-efd1-4838-bed9-2aea85fb43fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:24.068663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1eec7d90-efd1-4838-bed9-2aea85fb43fa None None] MFA Rules not processed for user `9ce380dc51d24674b870aebf8ee6a793`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:24.070370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1eec7d90-efd1-4838-bed9-2aea85fb43fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:24.250012 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1563/3135] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:24.297356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849973-111c-41a2-9c23-2d1a2f6d46d4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:24.298051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849973-111c-41a2-9c23-2d1a2f6d46d4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:24.298051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849973-111c-41a2-9c23-2d1a2f6d46d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:24.308096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:24.340406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-10849973-111c-41a2-9c23-2d1a2f6d46d4 None None] MFA Rules not processed for user `fcd1f4b070634a1a802d35289c3b74e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:24.341633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-10849973-111c-41a2-9c23-2d1a2f6d46d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:24.429858 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1573/3136] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:24 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:25.017226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec7d90-efd1-4838-bed9-2aea85fb43fa None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:25.019599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1eec7d90-efd1-4838-bed9-2aea85fb43fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:25.045943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849973-111c-41a2-9c23-2d1a2f6d46d4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:25.048583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-10849973-111c-41a2-9c23-2d1a2f6d46d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:25.065580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849973-111c-41a2-9c23-2d1a2f6d46d4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:25.072388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:25.073313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:25.073789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:25.074307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] PATH_INFO: `/v3/projects/4b189ceff1b5481c86c63e0760ca656d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:25.075965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b189ceff1b5481c86c63e0760ca656d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:25.078572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:25.166822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b189ceff1b5481c86c63e0760ca656d', 'request_id': 'req-6f810e13-5a2b-4454-8d75-6d76c671316c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:25.168130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec7d90-efd1-4838-bed9-2aea85fb43fa None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:25.221713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b189ceff1b5481c86c63e0760ca656d', 'request_id': 'req-6f810e13-5a2b-4454-8d75-6d76c671316c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:25.243392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b189ceff1b5481c86c63e0760ca656d', 'request_id': 'req-6f810e13-5a2b-4454-8d75-6d76c671316c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:25.284628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] The token cache is being invalidate because project 4b189ceff1b5481c86c63e0760ca656d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:25.291301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:25.295309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:25.303581 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1574/3137] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:25 2022] DELETE /identity/v3/projects/4b189ceff1b5481c86c63e0760ca656d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:25.305730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:25.309071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:25.399170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e601ec0-00e6-43a3-8164-ff63aafdd2ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:25.399808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e601ec0-00e6-43a3-8164-ff63aafdd2ec service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:25.400091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e601ec0-00e6-43a3-8164-ff63aafdd2ec service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:25.400730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e601ec0-00e6-43a3-8164-ff63aafdd2ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:25.402693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0e601ec0-00e6-43a3-8164-ff63aafdd2ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:25.476090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:25.515512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f810e13-5a2b-4454-8d75-6d76c671316c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:25.518774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e601ec0-00e6-43a3-8164-ff63aafdd2ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:25.520651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e601ec0-00e6-43a3-8164-ff63aafdd2ec service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:25.532551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:25.533454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:25.533749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:25.534033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] PATH_INFO: `/v3/users/2994eb4a0ae047f69a1b78e96e28479b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:25.535312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=2994eb4a0ae047f69a1b78e96e28479b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:25.542298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:25.545864 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1564/3138] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:25 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:25.594337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:25.619555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e601ec0-00e6-43a3-8164-ff63aafdd2ec service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:25.621004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0e601ec0-00e6-43a3-8164-ff63aafdd2ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:25.671877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2994eb4a0ae047f69a1b78e96e28479b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:25.685196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2994eb4a0ae047f69a1b78e96e28479b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:25.686241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2994eb4a0ae047f69a1b78e96e28479b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:25.699868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2994eb4a0ae047f69a1b78e96e28479b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:25.701163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2994eb4a0ae047f69a1b78e96e28479b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:25.751731 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1575/3139] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:25 2022] DELETE /identity/v3/users/2994eb4a0ae047f69a1b78e96e28479b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:25.901747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e601ec0-00e6-43a3-8164-ff63aafdd2ec service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:26.126873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17c263-d2d8-4d3f-a5ef-4d085ac77511 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:26.127595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17c263-d2d8-4d3f-a5ef-4d085ac77511 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:26.127859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17c263-d2d8-4d3f-a5ef-4d085ac77511 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:26.129056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17c263-d2d8-4d3f-a5ef-4d085ac77511 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:26.147350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4e17c263-d2d8-4d3f-a5ef-4d085ac77511 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:26.186697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17c263-d2d8-4d3f-a5ef-4d085ac77511 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:26.194558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17c263-d2d8-4d3f-a5ef-4d085ac77511 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:26.233586 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1565/3140] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:59:26.529004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:26.531086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:26.775367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb735d-95a0-4f23-af0e-2b4e43044fda admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:26.789165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85649a-5a51-4495-be06-9cd72f8e8d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:26.790622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85649a-5a51-4495-be06-9cd72f8e8d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:26.791186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85649a-5a51-4495-be06-9cd72f8e8d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:26.791626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85649a-5a51-4495-be06-9cd72f8e8d83 admin admin] PATH_INFO: `/v3/projects/3d4ed3dc70d440bbb22b71f5e0e8a1b0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:26.793166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85649a-5a51-4495-be06-9cd72f8e8d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4ed3dc70d440bbb22b71f5e0e8a1b0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:26.796217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85649a-5a51-4495-be06-9cd72f8e8d83 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:26.903227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17c263-d2d8-4d3f-a5ef-4d085ac77511 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:26.905154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4e17c263-d2d8-4d3f-a5ef-4d085ac77511 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:26.947016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17c263-d2d8-4d3f-a5ef-4d085ac77511 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:26.953211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e85649a-5a51-4495-be06-9cd72f8e8d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4ed3dc70d440bbb22b71f5e0e8a1b0', 'request_id': 'req-4e85649a-5a51-4495-be06-9cd72f8e8d83'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:26.983942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e85649a-5a51-4495-be06-9cd72f8e8d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4ed3dc70d440bbb22b71f5e0e8a1b0', 'request_id': 'req-4e85649a-5a51-4495-be06-9cd72f8e8d83'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:26.997909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e85649a-5a51-4495-be06-9cd72f8e8d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4ed3dc70d440bbb22b71f5e0e8a1b0', 'request_id': 'req-4e85649a-5a51-4495-be06-9cd72f8e8d83'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:27.021808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e85649a-5a51-4495-be06-9cd72f8e8d83 admin admin] The token cache is being invalidate because project 3d4ed3dc70d440bbb22b71f5e0e8a1b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:27.022107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e85649a-5a51-4495-be06-9cd72f8e8d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:27.022857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e85649a-5a51-4495-be06-9cd72f8e8d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:27.024676 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1576/3141] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:26 2022] DELETE /identity/v3/projects/3d4ed3dc70d440bbb22b71f5e0e8a1b0 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:27.029275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e762-6673-4da9-8ed5-9eced3489d84 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:27.031188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e762-6673-4da9-8ed5-9eced3489d84 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:27.032163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e762-6673-4da9-8ed5-9eced3489d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:27.065657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:27.103221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4808f-cc0c-40c7-ad84-eac55a002726 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:27.104685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4808f-cc0c-40c7-ad84-eac55a002726 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:27.105164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4808f-cc0c-40c7-ad84-eac55a002726 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:27.105757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4808f-cc0c-40c7-ad84-eac55a002726 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:27.108773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d9c4808f-cc0c-40c7-ad84-eac55a002726 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:27.127957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7fe2e762-6673-4da9-8ed5-9eced3489d84 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:27.129357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7fe2e762-6673-4da9-8ed5-9eced3489d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:27.147940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4808f-cc0c-40c7-ad84-eac55a002726 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:27.151312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4808f-cc0c-40c7-ad84-eac55a002726 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:27.169866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:27.199858 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1566/3142] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:27.318286 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1577/3143] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:27.327079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb748-21eb-4030-98f6-a309992138bb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:27.327645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb748-21eb-4030-98f6-a309992138bb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:27.328112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdb748-21eb-4030-98f6-a309992138bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:27.373698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-14bdb748-21eb-4030-98f6-a309992138bb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:27.377400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-14bdb748-21eb-4030-98f6-a309992138bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:27.409753 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1567/3144] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:27.412319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e762-6673-4da9-8ed5-9eced3489d84 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:27.425378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e762-6673-4da9-8ed5-9eced3489d84 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:27.432248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86808e-76f2-40cb-b221-94cfdf3931ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:27.433552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86808e-76f2-40cb-b221-94cfdf3931ad admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:27.434033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86808e-76f2-40cb-b221-94cfdf3931ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:27.434397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86808e-76f2-40cb-b221-94cfdf3931ad admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:27.435913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86808e-76f2-40cb-b221-94cfdf3931ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:59:27.436180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86808e-76f2-40cb-b221-94cfdf3931ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:27.439565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86808e-76f2-40cb-b221-94cfdf3931ad admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:27.485486 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1578/3145] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:59:27.486657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdb748-21eb-4030-98f6-a309992138bb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:27.505626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdb748-21eb-4030-98f6-a309992138bb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:27.539749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae68e-f66a-4ae1-b18e-7d21abe91864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:27.542877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae68e-f66a-4ae1-b18e-7d21abe91864 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:27.543184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae68e-f66a-4ae1-b18e-7d21abe91864 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:27.543449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae68e-f66a-4ae1-b18e-7d21abe91864 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:27.544114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae68e-f66a-4ae1-b18e-7d21abe91864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:27.546067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae68e-f66a-4ae1-b18e-7d21abe91864 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:27.610854 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1568/3146] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:59:27 2022] POST /identity/v3/projects => generated 389 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:27.612612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86808e-76f2-40cb-b221-94cfdf3931ad admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:27.629816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86808e-76f2-40cb-b221-94cfdf3931ad admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:27.751075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c51043-e647-4a33-a8f4-34ac655e7c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:27.751780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c51043-e647-4a33-a8f4-34ac655e7c9b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:27.752070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c51043-e647-4a33-a8f4-34ac655e7c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:27.752404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c51043-e647-4a33-a8f4-34ac655e7c9b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:27.753082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c51043-e647-4a33-a8f4-34ac655e7c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:27.755561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c51043-e647-4a33-a8f4-34ac655e7c9b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:27.797558 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1579/3147] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:59:27 2022] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:27.802311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae68e-f66a-4ae1-b18e-7d21abe91864 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:27.816433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae68e-f66a-4ae1-b18e-7d21abe91864 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:27.824081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef3497-7118-41df-9ff9-feaa45179a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:27.824896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef3497-7118-41df-9ff9-feaa45179a7c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:27.825318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef3497-7118-41df-9ff9-feaa45179a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:27.825692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef3497-7118-41df-9ff9-feaa45179a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:27.826647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef3497-7118-41df-9ff9-feaa45179a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:27.836621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef3497-7118-41df-9ff9-feaa45179a7c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:27.851016 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1569/3148] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:27.855183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c51043-e647-4a33-a8f4-34ac655e7c9b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:27.869800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c51043-e647-4a33-a8f4-34ac655e7c9b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:27.880274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f3f4e-f047-423b-8c00-164e6cb5fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:27.881105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3f4e-f047-423b-8c00-164e6cb5fec5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:27.881612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3f4e-f047-423b-8c00-164e6cb5fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:27.882003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3f4e-f047-423b-8c00-164e6cb5fec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:27.882937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f3f4e-f047-423b-8c00-164e6cb5fec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:27.885810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f3f4e-f047-423b-8c00-164e6cb5fec5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:27.904328 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1580/3149] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:27.920137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef3497-7118-41df-9ff9-feaa45179a7c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:27.934145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef3497-7118-41df-9ff9-feaa45179a7c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:27.942534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c25714-c832-4cd9-b8d1-184d45de3bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:27.943263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25714-c832-4cd9-b8d1-184d45de3bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:27.943549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25714-c832-4cd9-b8d1-184d45de3bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:27.943832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c25714-c832-4cd9-b8d1-184d45de3bcb admin admin] PATH_INFO: `/v3/projects/6311cdac7b2b494287158aa293e56779/users/b36cfd57c20d4357b889c66d95117c0d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:27.981011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c25714-c832-4cd9-b8d1-184d45de3bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6311cdac7b2b494287158aa293e56779, user_id=b36cfd57c20d4357b889c66d95117c0d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:27.985675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c25714-c832-4cd9-b8d1-184d45de3bcb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:28.021008 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1570/3150] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:27 2022] PUT /identity/v3/projects/6311cdac7b2b494287158aa293e56779/users/b36cfd57c20d4357b889c66d95117c0d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:28.031252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e0178-11a0-4eb8-8571-413e780b5dd0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:28.031495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e0178-11a0-4eb8-8571-413e780b5dd0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:28.032024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e0178-11a0-4eb8-8571-413e780b5dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:28.097079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4c9e0178-11a0-4eb8-8571-413e780b5dd0 None None] MFA Rules not processed for user `b36cfd57c20d4357b889c66d95117c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:28.099433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4c9e0178-11a0-4eb8-8571-413e780b5dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:28.249126 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1581/3151] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:28.254776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c25714-c832-4cd9-b8d1-184d45de3bcb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:28.399205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c25714-c832-4cd9-b8d1-184d45de3bcb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:28.408436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41576c-34d1-428a-b911-703f747223e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:28.409577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41576c-34d1-428a-b911-703f747223e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:28.409872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41576c-34d1-428a-b911-703f747223e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:28.410332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41576c-34d1-428a-b911-703f747223e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:28.411044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41576c-34d1-428a-b911-703f747223e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:28.413475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41576c-34d1-428a-b911-703f747223e7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:28.457885 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1571/3152] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:59:28 2022] POST /identity/v3/projects => generated 389 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:28.462103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e0178-11a0-4eb8-8571-413e780b5dd0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:28.494969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e0178-11a0-4eb8-8571-413e780b5dd0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:28.508319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:28.614063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd810668-5327-4dd0-8336-7636634861b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:28.614934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd810668-5327-4dd0-8336-7636634861b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:28.615546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd810668-5327-4dd0-8336-7636634861b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:28.616654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd810668-5327-4dd0-8336-7636634861b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:28.616919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd810668-5327-4dd0-8336-7636634861b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:28.620208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd810668-5327-4dd0-8336-7636634861b3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:28.654725 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1582/3153] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:59:28 2022] POST /identity/v3/users => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:28.660129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41576c-34d1-428a-b911-703f747223e7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:28.683590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41576c-34d1-428a-b911-703f747223e7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:28.694385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7a34e-67b7-4e22-82b7-1e160cb80dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:28.695143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7a34e-67b7-4e22-82b7-1e160cb80dca admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:28.695540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7a34e-67b7-4e22-82b7-1e160cb80dca admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:28.695879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7a34e-67b7-4e22-82b7-1e160cb80dca admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:28.696580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7a34e-67b7-4e22-82b7-1e160cb80dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:28.699299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7a34e-67b7-4e22-82b7-1e160cb80dca admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:28.735617 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1572/3154] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:28.741097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd810668-5327-4dd0-8336-7636634861b3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:28.756937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd810668-5327-4dd0-8336-7636634861b3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:28.764547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b72908-bcf0-49bb-8b20-2f0e17174fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:28.765533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b72908-bcf0-49bb-8b20-2f0e17174fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:28.766793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b72908-bcf0-49bb-8b20-2f0e17174fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:28.767297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b72908-bcf0-49bb-8b20-2f0e17174fd7 admin admin] PATH_INFO: `/v3/projects/55b8dbde17f9493dbf245747549e294b/users/6b7726d3860d457ba850cfde31a61789/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:28.812139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b72908-bcf0-49bb-8b20-2f0e17174fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b8dbde17f9493dbf245747549e294b, user_id=6b7726d3860d457ba850cfde31a61789, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:28.823143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b72908-bcf0-49bb-8b20-2f0e17174fd7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:28.857025 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1583/3155] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:28 2022] PUT /identity/v3/projects/55b8dbde17f9493dbf245747549e294b/users/6b7726d3860d457ba850cfde31a61789/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:59:28.863717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7a34e-67b7-4e22-82b7-1e160cb80dca admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:28.895214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7a34e-67b7-4e22-82b7-1e160cb80dca admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:29.005097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:29.030102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5add1-6505-4cf6-9efb-9daa2879ac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:29.031890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5add1-6505-4cf6-9efb-9daa2879ac3e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:29.032630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5add1-6505-4cf6-9efb-9daa2879ac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:29.033331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5add1-6505-4cf6-9efb-9daa2879ac3e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:29.035397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5add1-6505-4cf6-9efb-9daa2879ac3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:29.038091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5add1-6505-4cf6-9efb-9daa2879ac3e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:29.069496 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1573/3156] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:29.070173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b72908-bcf0-49bb-8b20-2f0e17174fd7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:29.086546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b72908-bcf0-49bb-8b20-2f0e17174fd7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:29.125858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c78feb-9da3-422b-bccf-47fa21036f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:29.130584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c78feb-9da3-422b-bccf-47fa21036f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:29.131267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c78feb-9da3-422b-bccf-47fa21036f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:29.131626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c78feb-9da3-422b-bccf-47fa21036f17 admin admin] PATH_INFO: `/v3/projects/55b8dbde17f9493dbf245747549e294b/users/6b7726d3860d457ba850cfde31a61789/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:29.133840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c78feb-9da3-422b-bccf-47fa21036f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b8dbde17f9493dbf245747549e294b, user_id=6b7726d3860d457ba850cfde31a61789, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:29.138970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c78feb-9da3-422b-bccf-47fa21036f17 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:29.181247 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1584/3157] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:29 2022] PUT /identity/v3/projects/55b8dbde17f9493dbf245747549e294b/users/6b7726d3860d457ba850cfde31a61789/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:59:29.194781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f19a0-5c5f-49ed-91ef-d1b3705c6a7e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:29.195097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f19a0-5c5f-49ed-91ef-d1b3705c6a7e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:29.195386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f19a0-5c5f-49ed-91ef-d1b3705c6a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:29.252671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-232f19a0-5c5f-49ed-91ef-d1b3705c6a7e None None] MFA Rules not processed for user `6b7726d3860d457ba850cfde31a61789`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:29.253747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-232f19a0-5c5f-49ed-91ef-d1b3705c6a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:29.373388 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1574/3158] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:30.786776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c78feb-9da3-422b-bccf-47fa21036f17 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:30.789931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-55c78feb-9da3-422b-bccf-47fa21036f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:31.018329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c78feb-9da3-422b-bccf-47fa21036f17 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:31.027040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34c834-e206-4ab2-afb5-b12f4a0775e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:31.027926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34c834-e206-4ab2-afb5-b12f4a0775e5 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:31.028214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34c834-e206-4ab2-afb5-b12f4a0775e5 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:31.028488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34c834-e206-4ab2-afb5-b12f4a0775e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:31.150848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34c834-e206-4ab2-afb5-b12f4a0775e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:31.154130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34c834-e206-4ab2-afb5-b12f4a0775e5 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:31.163710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:31.172165 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1585/3159] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:34.248944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f19a0-5c5f-49ed-91ef-d1b3705c6a7e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:34.252623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-232f19a0-5c5f-49ed-91ef-d1b3705c6a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:34.303561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f19a0-5c5f-49ed-91ef-d1b3705c6a7e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:34.316856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a07b21-a2cb-4bb1-8146-d8b599621e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:34.327980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a07b21-a2cb-4bb1-8146-d8b599621e63 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:34.328979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a07b21-a2cb-4bb1-8146-d8b599621e63 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:34.329262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a07b21-a2cb-4bb1-8146-d8b599621e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:34.345515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c4a07b21-a2cb-4bb1-8146-d8b599621e63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:34.460544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a07b21-a2cb-4bb1-8146-d8b599621e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:34.462890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a07b21-a2cb-4bb1-8146-d8b599621e63 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:34.478587 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1575/3160] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:34 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:35.685082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34c834-e206-4ab2-afb5-b12f4a0775e5 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:35.702316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34c834-e206-4ab2-afb5-b12f4a0775e5 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:35.715266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968976f-8a45-4f84-8ae1-56cf42e07f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:35.715896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968976f-8a45-4f84-8ae1-56cf42e07f34 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:35.716177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968976f-8a45-4f84-8ae1-56cf42e07f34 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:35.716449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968976f-8a45-4f84-8ae1-56cf42e07f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:35.732042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968976f-8a45-4f84-8ae1-56cf42e07f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:35.738323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968976f-8a45-4f84-8ae1-56cf42e07f34 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:35.753361 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1586/3161] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:38.279776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a07b21-a2cb-4bb1-8146-d8b599621e63 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:38.282142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c4a07b21-a2cb-4bb1-8146-d8b599621e63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:38.612391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a07b21-a2cb-4bb1-8146-d8b599621e63 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:38.626558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:38.627283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:38.627719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:38.628519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] PATH_INFO: `/v3/users/13d33648c2754ecdb00578d8256087ed` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:38.633420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d33648c2754ecdb00578d8256087ed)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:38.636033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:38.639338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:38.717490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d33648c2754ecdb00578d8256087ed'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:38.727129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d33648c2754ecdb00578d8256087ed'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:38.728131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d33648c2754ecdb00578d8256087ed'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:38.748781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d33648c2754ecdb00578d8256087ed'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:38.751420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d33648c2754ecdb00578d8256087ed'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:38.793798 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1576/3162] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:38 2022] DELETE /identity/v3/users/13d33648c2754ecdb00578d8256087ed => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:39.167615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968976f-8a45-4f84-8ae1-56cf42e07f34 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:39.169706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5968976f-8a45-4f84-8ae1-56cf42e07f34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:39.252969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968976f-8a45-4f84-8ae1-56cf42e07f34 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:39.309530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8fc87-d393-4092-969e-e92c64d71340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:39.310168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8fc87-d393-4092-969e-e92c64d71340 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:39.310452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8fc87-d393-4092-969e-e92c64d71340 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:39.310724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8fc87-d393-4092-969e-e92c64d71340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:39.313615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-52c8fc87-d393-4092-969e-e92c64d71340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:39.413554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8fc87-d393-4092-969e-e92c64d71340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:39.415109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8fc87-d393-4092-969e-e92c64d71340 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:39.430857 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1587/3163] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:39.456093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:39.458938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:39.472353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aee2a-d38d-4c86-a005-3aa4a65b5186 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:39.481442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546d62f-81e7-454e-8a8c-3e0c1a8a76aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:39.482173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d62f-81e7-454e-8a8c-3e0c1a8a76aa service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:39.482555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d62f-81e7-454e-8a8c-3e0c1a8a76aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:39.482972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d62f-81e7-454e-8a8c-3e0c1a8a76aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:39.486024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d546d62f-81e7-454e-8a8c-3e0c1a8a76aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:39.497658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546d62f-81e7-454e-8a8c-3e0c1a8a76aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:39.499179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546d62f-81e7-454e-8a8c-3e0c1a8a76aa service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:39.508483 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1577/3164] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:39.756744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8fc87-d393-4092-969e-e92c64d71340 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:39.758465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-52c8fc87-d393-4092-969e-e92c64d71340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:39.846961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:39.916822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8fc87-d393-4092-969e-e92c64d71340 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:39.931452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:39.932217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:39.932541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:39.932830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] PATH_INFO: `/v3/projects/992f9c68f1dc45c4ac6662d03417339e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:39.934355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=992f9c68f1dc45c4ac6662d03417339e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:39.936517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:40.047575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992f9c68f1dc45c4ac6662d03417339e', 'request_id': 'req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.055368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992f9c68f1dc45c4ac6662d03417339e', 'request_id': 'req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.066795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992f9c68f1dc45c4ac6662d03417339e', 'request_id': 'req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.093498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] The token cache is being invalidate because project 992f9c68f1dc45c4ac6662d03417339e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:40.094430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.097125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.102989 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1588/3165] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:39 2022] DELETE /identity/v3/projects/992f9c68f1dc45c4ac6662d03417339e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:40.103992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546d62f-81e7-454e-8a8c-3e0c1a8a76aa service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:40.123486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546d62f-81e7-454e-8a8c-3e0c1a8a76aa service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:40.210561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a45693-fe12-470f-ac7d-3b579c5cb810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:40.211356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a45693-fe12-470f-ac7d-3b579c5cb810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:40.211710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a45693-fe12-470f-ac7d-3b579c5cb810 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:40.212059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a45693-fe12-470f-ac7d-3b579c5cb810 admin admin] PATH_INFO: `/v3/users/f9dc6636547a499b9c7b9fd13afd11e1` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:40.213524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a45693-fe12-470f-ac7d-3b579c5cb810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9dc6636547a499b9c7b9fd13afd11e1)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:40.215684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a45693-fe12-470f-ac7d-3b579c5cb810 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:40.295174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-32a45693-fe12-470f-ac7d-3b579c5cb810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9dc6636547a499b9c7b9fd13afd11e1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.307730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-32a45693-fe12-470f-ac7d-3b579c5cb810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9dc6636547a499b9c7b9fd13afd11e1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.308505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-32a45693-fe12-470f-ac7d-3b579c5cb810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9dc6636547a499b9c7b9fd13afd11e1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.322769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:40.326107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-32a45693-fe12-470f-ac7d-3b579c5cb810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9dc6636547a499b9c7b9fd13afd11e1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.327513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-32a45693-fe12-470f-ac7d-3b579c5cb810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9dc6636547a499b9c7b9fd13afd11e1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.355695 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1578/3166] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:40 2022] DELETE /identity/v3/users/f9dc6636547a499b9c7b9fd13afd11e1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:59:40.590061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:40.594028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:40.636604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43b5df-332a-4b6b-87c9-ccd11fe0a6d9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:40.746795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:40.747468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:40.747751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:40.748027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af admin admin] PATH_INFO: `/v3/projects/8abcb355b5694afa997acce55aa6fad8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:40.749204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af admin admin] RBAC: Authorizing `identity:delete_project(project_id=8abcb355b5694afa997acce55aa6fad8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:40.753227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:40.853356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8abcb355b5694afa997acce55aa6fad8', 'request_id': 'req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.864017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8abcb355b5694afa997acce55aa6fad8', 'request_id': 'req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.871201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8abcb355b5694afa997acce55aa6fad8', 'request_id': 'req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.894439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af admin admin] The token cache is being invalidate because project 8abcb355b5694afa997acce55aa6fad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:40.894896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.895572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2eb5373d-4490-4d4f-a6d6-ce01b5c243af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:40.897286 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1589/3167] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:40 2022] DELETE /identity/v3/projects/8abcb355b5694afa997acce55aa6fad8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:40.902118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72397877-6e08-4a98-9d77-9fc7ccabc166 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:40.902630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72397877-6e08-4a98-9d77-9fc7ccabc166 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:40.902816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72397877-6e08-4a98-9d77-9fc7ccabc166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:40.925852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-72397877-6e08-4a98-9d77-9fc7ccabc166 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:40.927136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-72397877-6e08-4a98-9d77-9fc7ccabc166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:40.999529 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1579/3168] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:41.008552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663acf43-361b-4167-9dee-56c927353ccf None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:41.008952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663acf43-361b-4167-9dee-56c927353ccf None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:41.009391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663acf43-361b-4167-9dee-56c927353ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:41.020175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:41.035848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-663acf43-361b-4167-9dee-56c927353ccf None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:41.037683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-663acf43-361b-4167-9dee-56c927353ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:41.050930 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1590/3169] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:41.052643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72397877-6e08-4a98-9d77-9fc7ccabc166 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:41.067175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72397877-6e08-4a98-9d77-9fc7ccabc166 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:41.072969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f137e0-c17d-47b2-a8cc-ad0de14ab802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:41.073681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f137e0-c17d-47b2-a8cc-ad0de14ab802 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:41.074202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f137e0-c17d-47b2-a8cc-ad0de14ab802 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:41.074485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f137e0-c17d-47b2-a8cc-ad0de14ab802 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:41.075248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f137e0-c17d-47b2-a8cc-ad0de14ab802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:59:41.081806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f137e0-c17d-47b2-a8cc-ad0de14ab802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:41.087380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f137e0-c17d-47b2-a8cc-ad0de14ab802 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:41.111345 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1580/3170] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 18:59:41.114889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663acf43-361b-4167-9dee-56c927353ccf None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:41.136402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663acf43-361b-4167-9dee-56c927353ccf None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:41.150623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63d81c-f7f3-4168-8c48-f1ed2367e587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:41.151295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63d81c-f7f3-4168-8c48-f1ed2367e587 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:41.151720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63d81c-f7f3-4168-8c48-f1ed2367e587 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:41.151864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63d81c-f7f3-4168-8c48-f1ed2367e587 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:41.152625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63d81c-f7f3-4168-8c48-f1ed2367e587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:41.155212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63d81c-f7f3-4168-8c48-f1ed2367e587 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:41.214174 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1591/3171] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:59:41 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:41.215516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f137e0-c17d-47b2-a8cc-ad0de14ab802 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:41.235335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f137e0-c17d-47b2-a8cc-ad0de14ab802 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:41.386789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5b0f8-d6dd-4b09-a3a9-fe9b62bfa4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:41.387427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5b0f8-d6dd-4b09-a3a9-fe9b62bfa4bf admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:41.387729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5b0f8-d6dd-4b09-a3a9-fe9b62bfa4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:41.389741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5b0f8-d6dd-4b09-a3a9-fe9b62bfa4bf admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:41.390364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5b0f8-d6dd-4b09-a3a9-fe9b62bfa4bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:41.401201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5b0f8-d6dd-4b09-a3a9-fe9b62bfa4bf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:41.455595 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1581/3172] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:59:41 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:41.456843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63d81c-f7f3-4168-8c48-f1ed2367e587 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:41.474348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63d81c-f7f3-4168-8c48-f1ed2367e587 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:41.482146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d19464-82a4-46c1-99ee-ab428684384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:41.482969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d19464-82a4-46c1-99ee-ab428684384e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:41.483381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d19464-82a4-46c1-99ee-ab428684384e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:41.483664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d19464-82a4-46c1-99ee-ab428684384e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:41.484873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d19464-82a4-46c1-99ee-ab428684384e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:41.487828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d19464-82a4-46c1-99ee-ab428684384e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:41.505385 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1592/3173] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:41.509941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5b0f8-d6dd-4b09-a3a9-fe9b62bfa4bf admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:41.521449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5b0f8-d6dd-4b09-a3a9-fe9b62bfa4bf admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:41.526676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b80db-cd68-4bbd-a000-270374518e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:41.527291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b80db-cd68-4bbd-a000-270374518e74 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:41.527576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b80db-cd68-4bbd-a000-270374518e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:41.527852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b80db-cd68-4bbd-a000-270374518e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:41.528541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b80db-cd68-4bbd-a000-270374518e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:41.530118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b80db-cd68-4bbd-a000-270374518e74 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:41.551989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d19464-82a4-46c1-99ee-ab428684384e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:41.552409 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1582/3174] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:41.564226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d19464-82a4-46c1-99ee-ab428684384e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:41.573568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8563a5-4bbd-444d-b899-cc5ec92da79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:41.574633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8563a5-4bbd-444d-b899-cc5ec92da79c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:41.575139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8563a5-4bbd-444d-b899-cc5ec92da79c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:41.575599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8563a5-4bbd-444d-b899-cc5ec92da79c admin admin] PATH_INFO: `/v3/projects/cf70d78b8e664d4bbaf609210ddfe302/users/230bec6ae37b4edbbc3599bdac758ddb/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:41.605917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8563a5-4bbd-444d-b899-cc5ec92da79c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf70d78b8e664d4bbaf609210ddfe302, user_id=230bec6ae37b4edbbc3599bdac758ddb, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:41.608701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8563a5-4bbd-444d-b899-cc5ec92da79c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:41.629430 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1593/3175] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:41 2022] PUT /identity/v3/projects/cf70d78b8e664d4bbaf609210ddfe302/users/230bec6ae37b4edbbc3599bdac758ddb/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:59:41.635230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cdcf7-b307-4d2b-9aa5-248b709d01f4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:41.635855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cdcf7-b307-4d2b-9aa5-248b709d01f4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:41.636295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cdcf7-b307-4d2b-9aa5-248b709d01f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:41.664880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-711cdcf7-b307-4d2b-9aa5-248b709d01f4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:41.666891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-711cdcf7-b307-4d2b-9aa5-248b709d01f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:41.738150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:41.785650 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1583/3176] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:41.796568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8563a5-4bbd-444d-b899-cc5ec92da79c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:41.799202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1b8563a5-4bbd-444d-b899-cc5ec92da79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:41.901949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8563a5-4bbd-444d-b899-cc5ec92da79c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:41.907366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0d319-786c-42ef-8253-daff1cc6fb7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:41.909043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0d319-786c-42ef-8253-daff1cc6fb7c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:41.909043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0d319-786c-42ef-8253-daff1cc6fb7c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:41.909043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0d319-786c-42ef-8253-daff1cc6fb7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:41.926080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0d319-786c-42ef-8253-daff1cc6fb7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:41.927515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0d319-786c-42ef-8253-daff1cc6fb7c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:41.941812 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1594/3177] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 18:59:44.116784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f13f76-bd7b-4964-a841-dce2e4a95200 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:44.117855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f13f76-bd7b-4964-a841-dce2e4a95200 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:44.118989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f13f76-bd7b-4964-a841-dce2e4a95200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:44.170935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b9f13f76-bd7b-4964-a841-dce2e4a95200 None None] MFA Rules not processed for user `d049efd2598f4a528d68972936643fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:44.175746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b9f13f76-bd7b-4964-a841-dce2e4a95200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:44.335544 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1584/3178] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:48.459051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ae54a-bbec-4ad6-918a-50798e78cf85 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:48.459608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ae54a-bbec-4ad6-918a-50798e78cf85 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:48.459928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ae54a-bbec-4ad6-918a-50798e78cf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:48.513424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3b2ae54a-bbec-4ad6-918a-50798e78cf85 None None] MFA Rules not processed for user `230bec6ae37b4edbbc3599bdac758ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:48.515225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3b2ae54a-bbec-4ad6-918a-50798e78cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:48.621239 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1595/3179] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:49.321826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f13f76-bd7b-4964-a841-dce2e4a95200 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:49.323972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b9f13f76-bd7b-4964-a841-dce2e4a95200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:49.442042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f13f76-bd7b-4964-a841-dce2e4a95200 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:49.448918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899555b4-ec3b-44f5-b9d7-6d5a681f6cec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:49.449557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899555b4-ec3b-44f5-b9d7-6d5a681f6cec service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:49.449848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899555b4-ec3b-44f5-b9d7-6d5a681f6cec service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:49.450127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899555b4-ec3b-44f5-b9d7-6d5a681f6cec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:49.487856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899555b4-ec3b-44f5-b9d7-6d5a681f6cec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:49.489734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899555b4-ec3b-44f5-b9d7-6d5a681f6cec service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:49.519344 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1585/3180] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:56.610607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ae54a-bbec-4ad6-918a-50798e78cf85 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:56.612310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3b2ae54a-bbec-4ad6-918a-50798e78cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:56.627857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ae54a-bbec-4ad6-918a-50798e78cf85 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:56.633044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:56.633763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:56.634107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:56.634447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] PATH_INFO: `/v3/users/b36cfd57c20d4357b889c66d95117c0d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:56.635954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b36cfd57c20d4357b889c66d95117c0d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:56.637910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:56.683307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:56.712947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b36cfd57c20d4357b889c66d95117c0d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:56.721685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b36cfd57c20d4357b889c66d95117c0d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:56.722448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b36cfd57c20d4357b889c66d95117c0d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:56.735379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b36cfd57c20d4357b889c66d95117c0d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:56.736146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b36cfd57c20d4357b889c66d95117c0d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:56.764775 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1596/3181] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:56 2022] DELETE /identity/v3/users/b36cfd57c20d4357b889c66d95117c0d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:56.770501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbd9fd-2492-4ea9-9e4a-8c215a48b9a8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:56.771090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbd9fd-2492-4ea9-9e4a-8c215a48b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:56.771261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbd9fd-2492-4ea9-9e4a-8c215a48b9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:56.794349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-60dbd9fd-2492-4ea9-9e4a-8c215a48b9a8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:56.795858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-60dbd9fd-2492-4ea9-9e4a-8c215a48b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:56.860450 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1586/3182] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:56.870940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:56.872710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:56.940491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20871b5c-a8a4-4691-807a-8329c8fd7ac2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:56.944441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd77d87-ed4b-4f49-80a3-d90e61cf1465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:56.945118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd77d87-ed4b-4f49-80a3-d90e61cf1465 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:56.945418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd77d87-ed4b-4f49-80a3-d90e61cf1465 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:56.945696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd77d87-ed4b-4f49-80a3-d90e61cf1465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:56.956931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd77d87-ed4b-4f49-80a3-d90e61cf1465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:56.958385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd77d87-ed4b-4f49-80a3-d90e61cf1465 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:56.970503 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1597/3183] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 18:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 18:59:57.158645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbd9fd-2492-4ea9-9e4a-8c215a48b9a8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:57.160924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-60dbd9fd-2492-4ea9-9e4a-8c215a48b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:57.191464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbd9fd-2492-4ea9-9e4a-8c215a48b9a8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:57.202918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:57.204016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:57.205952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:57.207324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] PATH_INFO: `/v3/projects/6311cdac7b2b494287158aa293e56779` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:57.210636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6311cdac7b2b494287158aa293e56779)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:57.214922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:57.251010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:57.283030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6311cdac7b2b494287158aa293e56779', 'request_id': 'req-21a371c6-56ed-465a-8cae-09f6e8a34f6f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:57.299205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6311cdac7b2b494287158aa293e56779', 'request_id': 'req-21a371c6-56ed-465a-8cae-09f6e8a34f6f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:57.307616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6311cdac7b2b494287158aa293e56779', 'request_id': 'req-21a371c6-56ed-465a-8cae-09f6e8a34f6f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:57.324917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] The token cache is being invalidate because project 6311cdac7b2b494287158aa293e56779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:57.325281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:57.326063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:57.328016 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1587/3184] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:57 2022] DELETE /identity/v3/projects/6311cdac7b2b494287158aa293e56779 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:57.333531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd77d87-ed4b-4f49-80a3-d90e61cf1465 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:57.353269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd77d87-ed4b-4f49-80a3-d90e61cf1465 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:57.423228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedee7e-4282-46d5-9e47-df6389456238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:57.423228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedee7e-4282-46d5-9e47-df6389456238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:57.426100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedee7e-4282-46d5-9e47-df6389456238 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:57.426100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedee7e-4282-46d5-9e47-df6389456238 admin admin] PATH_INFO: `/v3/users/6b7726d3860d457ba850cfde31a61789` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:57.426100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedee7e-4282-46d5-9e47-df6389456238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7726d3860d457ba850cfde31a61789)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:57.427585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedee7e-4282-46d5-9e47-df6389456238 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:57.505860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7fedee7e-4282-46d5-9e47-df6389456238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7726d3860d457ba850cfde31a61789'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:57.509405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:57.524903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7fedee7e-4282-46d5-9e47-df6389456238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7726d3860d457ba850cfde31a61789'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:57.526100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7fedee7e-4282-46d5-9e47-df6389456238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7726d3860d457ba850cfde31a61789'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:57.538952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7fedee7e-4282-46d5-9e47-df6389456238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7726d3860d457ba850cfde31a61789'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:57.539896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7fedee7e-4282-46d5-9e47-df6389456238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7726d3860d457ba850cfde31a61789'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:57.585074 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1598/3185] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 18:59:57 2022] DELETE /identity/v3/users/6b7726d3860d457ba850cfde31a61789 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:57.908536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:57.911023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:57.979255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a371c6-56ed-465a-8cae-09f6e8a34f6f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:58.090453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:58.091916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:58.092506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:58.093931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f admin admin] PATH_INFO: `/v3/projects/55b8dbde17f9493dbf245747549e294b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:58.096752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b8dbde17f9493dbf245747549e294b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:58.101862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:58.212089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b8dbde17f9493dbf245747549e294b', 'request_id': 'req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:58.237501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b8dbde17f9493dbf245747549e294b', 'request_id': 'req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:58.251874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b8dbde17f9493dbf245747549e294b', 'request_id': 'req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:58.278877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f admin admin] The token cache is being invalidate because project 55b8dbde17f9493dbf245747549e294b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 18:59:58.282254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:58.283565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dad3cf7a-2bb6-4e5d-b4f9-d2afe5e8c89f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 18:59:58.286629 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1588/3186] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 18:59:57 2022] DELETE /identity/v3/projects/55b8dbde17f9493dbf245747549e294b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:59:58.293415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66215d-3425-49df-b2e2-b6128025ac7c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:58.294172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66215d-3425-49df-b2e2-b6128025ac7c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:58.294879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66215d-3425-49df-b2e2-b6128025ac7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:58.341051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2a66215d-3425-49df-b2e2-b6128025ac7c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:58.344725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2a66215d-3425-49df-b2e2-b6128025ac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:58.535323 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1599/3187] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:58.548076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f853-3bb8-4dfe-890c-327e0bb45f59 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:58.548940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f853-3bb8-4dfe-890c-327e0bb45f59 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:58.549551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88f853-3bb8-4dfe-890c-327e0bb45f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:58.599304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4d88f853-3bb8-4dfe-890c-327e0bb45f59 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:58.600516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4d88f853-3bb8-4dfe-890c-327e0bb45f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:58.619857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66215d-3425-49df-b2e2-b6128025ac7c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:58.624968 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1589/3188] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 18:59:58.650519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66215d-3425-49df-b2e2-b6128025ac7c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:58.686383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150bf40-cafd-423c-a5f5-a936b2f64a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:58.687511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150bf40-cafd-423c-a5f5-a936b2f64a81 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:58.687813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150bf40-cafd-423c-a5f5-a936b2f64a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:58.688133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150bf40-cafd-423c-a5f5-a936b2f64a81 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:58.692591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150bf40-cafd-423c-a5f5-a936b2f64a81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 18:59:58.692928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150bf40-cafd-423c-a5f5-a936b2f64a81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:58.695864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150bf40-cafd-423c-a5f5-a936b2f64a81 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:58.713271 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1600/3189] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 18:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 18:59:58.717566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88f853-3bb8-4dfe-890c-327e0bb45f59 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:58.731621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88f853-3bb8-4dfe-890c-327e0bb45f59 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:58.742381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540a50a-8b0d-4e06-9d0b-b33b2ad7faa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:58.743057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540a50a-8b0d-4e06-9d0b-b33b2ad7faa4 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:58.743393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540a50a-8b0d-4e06-9d0b-b33b2ad7faa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:58.743678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540a50a-8b0d-4e06-9d0b-b33b2ad7faa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:58.744381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540a50a-8b0d-4e06-9d0b-b33b2ad7faa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:58.747213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540a50a-8b0d-4e06-9d0b-b33b2ad7faa4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:58.800000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150bf40-cafd-423c-a5f5-a936b2f64a81 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:58.800954 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1590/3190] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:59:58 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:59:58.813991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150bf40-cafd-423c-a5f5-a936b2f64a81 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:58.914165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0618a-e81c-4190-b15d-2a7d5dadf472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:58.914856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0618a-e81c-4190-b15d-2a7d5dadf472 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:58.915195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0618a-e81c-4190-b15d-2a7d5dadf472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:58.915475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0618a-e81c-4190-b15d-2a7d5dadf472 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:58.916108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0618a-e81c-4190-b15d-2a7d5dadf472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:58.918991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0618a-e81c-4190-b15d-2a7d5dadf472 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:58.950354 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1601/3191] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:59:58 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:58.957387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540a50a-8b0d-4e06-9d0b-b33b2ad7faa4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:58.985963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540a50a-8b0d-4e06-9d0b-b33b2ad7faa4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:58.996593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d0b9e-0317-4cb1-b91d-009d68790a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:58.997233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d0b9e-0317-4cb1-b91d-009d68790a2b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:58.997712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d0b9e-0317-4cb1-b91d-009d68790a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:58.997995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d0b9e-0317-4cb1-b91d-009d68790a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:58.998659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d0b9e-0317-4cb1-b91d-009d68790a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:59.001514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d0b9e-0317-4cb1-b91d-009d68790a2b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:59.004543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:59.015589 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1591/3192] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:59.019718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0618a-e81c-4190-b15d-2a7d5dadf472 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:59.035129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0618a-e81c-4190-b15d-2a7d5dadf472 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:59.043326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0420e35-5a0d-4ba8-a597-7bcc78b1b2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:59.044093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420e35-5a0d-4ba8-a597-7bcc78b1b2fd admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:59.044620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420e35-5a0d-4ba8-a597-7bcc78b1b2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:59.044987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0420e35-5a0d-4ba8-a597-7bcc78b1b2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:59.046531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0420e35-5a0d-4ba8-a597-7bcc78b1b2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:59.050993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0420e35-5a0d-4ba8-a597-7bcc78b1b2fd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:59.073495 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1602/3193] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:59.077580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d0b9e-0317-4cb1-b91d-009d68790a2b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:59.094876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d0b9e-0317-4cb1-b91d-009d68790a2b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:59.114108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181964-0afd-4b85-a853-425a7ab56667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:59.114978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181964-0afd-4b85-a853-425a7ab56667 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:59.115158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181964-0afd-4b85-a853-425a7ab56667 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:59.115404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181964-0afd-4b85-a853-425a7ab56667 admin admin] PATH_INFO: `/v3/projects/97973e718908435199990fb614f1ee39/users/3afd4b10403a452e81f60f30ed5690f0/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:59.157878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181964-0afd-4b85-a853-425a7ab56667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97973e718908435199990fb614f1ee39, user_id=3afd4b10403a452e81f60f30ed5690f0, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:59.162501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181964-0afd-4b85-a853-425a7ab56667 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:59.186299 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1592/3194] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:59 2022] PUT /identity/v3/projects/97973e718908435199990fb614f1ee39/users/3afd4b10403a452e81f60f30ed5690f0/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 18:59:59.197954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f7443-9a56-4031-90b6-9ca01b43135f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:59.198406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f7443-9a56-4031-90b6-9ca01b43135f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:59.199038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f7443-9a56-4031-90b6-9ca01b43135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:59.246067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-856f7443-9a56-4031-90b6-9ca01b43135f None None] MFA Rules not processed for user `3afd4b10403a452e81f60f30ed5690f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 18:59:59.247549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-856f7443-9a56-4031-90b6-9ca01b43135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 18:59:59.274213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 18:59:59.342728 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1603/3195] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 18:59:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 18:59:59.344569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181964-0afd-4b85-a853-425a7ab56667 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:59.448544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181964-0afd-4b85-a853-425a7ab56667 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:59.454434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154f94f-5409-4848-a48a-9d65f0c4bda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:59.455295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f94f-5409-4848-a48a-9d65f0c4bda6 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:59.455621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f94f-5409-4848-a48a-9d65f0c4bda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:59.456025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f94f-5409-4848-a48a-9d65f0c4bda6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:59.456764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154f94f-5409-4848-a48a-9d65f0c4bda6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:59.458815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154f94f-5409-4848-a48a-9d65f0c4bda6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:59.512850 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1593/3196] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 18:59:59 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 18:59:59.516947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f7443-9a56-4031-90b6-9ca01b43135f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:59.535298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f7443-9a56-4031-90b6-9ca01b43135f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:59.652254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ce1d1-ebbb-4b6a-bb42-0131a5dcbb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:59.652939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ce1d1-ebbb-4b6a-bb42-0131a5dcbb3e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:59.653226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ce1d1-ebbb-4b6a-bb42-0131a5dcbb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:59.653559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ce1d1-ebbb-4b6a-bb42-0131a5dcbb3e admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:59.654841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ce1d1-ebbb-4b6a-bb42-0131a5dcbb3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:59.657635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ce1d1-ebbb-4b6a-bb42-0131a5dcbb3e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:59.692448 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1604/3197] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 18:59:59 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 18:59:59.697216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154f94f-5409-4848-a48a-9d65f0c4bda6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:59.710512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154f94f-5409-4848-a48a-9d65f0c4bda6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:59.715464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccede63-9f58-4fc1-81a7-6bf475ce8050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:59.716092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccede63-9f58-4fc1-81a7-6bf475ce8050 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:59.716374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccede63-9f58-4fc1-81a7-6bf475ce8050 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:59.716648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccede63-9f58-4fc1-81a7-6bf475ce8050 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:59.717332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccede63-9f58-4fc1-81a7-6bf475ce8050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:59.719534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccede63-9f58-4fc1-81a7-6bf475ce8050 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:59.732391 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1594/3198] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 18:59:59.736948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ce1d1-ebbb-4b6a-bb42-0131a5dcbb3e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:59.749925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ce1d1-ebbb-4b6a-bb42-0131a5dcbb3e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:59.755967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db6725-f7ac-4564-b255-e05c819a2605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:59.756738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db6725-f7ac-4564-b255-e05c819a2605 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:59.757085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db6725-f7ac-4564-b255-e05c819a2605 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:59.757457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db6725-f7ac-4564-b255-e05c819a2605 admin admin] PATH_INFO: `/v3/projects/928860326a0943b8abc556bb25895bff/users/3d2b6ed161814d26a139d219533bf8b3/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:59.776287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db6725-f7ac-4564-b255-e05c819a2605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928860326a0943b8abc556bb25895bff, user_id=3d2b6ed161814d26a139d219533bf8b3, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:59.779118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db6725-f7ac-4564-b255-e05c819a2605 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:59.799584 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1605/3199] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:59 2022] PUT /identity/v3/projects/928860326a0943b8abc556bb25895bff/users/3d2b6ed161814d26a139d219533bf8b3/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 18:59:59.803850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccede63-9f58-4fc1-81a7-6bf475ce8050 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:59.815546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccede63-9f58-4fc1-81a7-6bf475ce8050 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:59.911601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085fe6e-72eb-434c-b430-96eb4c05c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:59.912266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085fe6e-72eb-434c-b430-96eb4c05c1bd admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:59.912566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085fe6e-72eb-434c-b430-96eb4c05c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:59.912828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085fe6e-72eb-434c-b430-96eb4c05c1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:59.913524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085fe6e-72eb-434c-b430-96eb4c05c1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:59.915321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085fe6e-72eb-434c-b430-96eb4c05c1bd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:59.931282 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1595/3200] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 18:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 18:59:59.932647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db6725-f7ac-4564-b255-e05c819a2605 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 18:59:59.947095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db6725-f7ac-4564-b255-e05c819a2605 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 18:59:59.954197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d51bf-fa31-44fa-96ef-4c180bb05182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 18:59:59.955299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d51bf-fa31-44fa-96ef-4c180bb05182 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 18:59:59.955524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d51bf-fa31-44fa-96ef-4c180bb05182 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 18:59:59.955798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d51bf-fa31-44fa-96ef-4c180bb05182 admin admin] PATH_INFO: `/v3/projects/928860326a0943b8abc556bb25895bff/users/3d2b6ed161814d26a139d219533bf8b3/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 18:59:59.958695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d51bf-fa31-44fa-96ef-4c180bb05182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928860326a0943b8abc556bb25895bff, user_id=3d2b6ed161814d26a139d219533bf8b3, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 18:59:59.961837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d51bf-fa31-44fa-96ef-4c180bb05182 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 18:59:59.982545 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1606/3201] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 18:59:59 2022] PUT /identity/v3/projects/928860326a0943b8abc556bb25895bff/users/3d2b6ed161814d26a139d219533bf8b3/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:00.056252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbd3a4-8f82-4000-91d9-1bda1065f91c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:00.057265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbd3a4-8f82-4000-91d9-1bda1065f91c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:00.057716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbd3a4-8f82-4000-91d9-1bda1065f91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:00.096848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-11cbd3a4-8f82-4000-91d9-1bda1065f91c None None] MFA Rules not processed for user `3d2b6ed161814d26a139d219533bf8b3`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:00.098402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-11cbd3a4-8f82-4000-91d9-1bda1065f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:00.103681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:00.228558 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1596/3202] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:00.245339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339efc4-cdf6-4eb2-b431-dc58e1e7835e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:00.245711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339efc4-cdf6-4eb2-b431-dc58e1e7835e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:00.246240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339efc4-cdf6-4eb2-b431-dc58e1e7835e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:00.273605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1339efc4-cdf6-4eb2-b431-dc58e1e7835e None None] MFA Rules not processed for user `3afd4b10403a452e81f60f30ed5690f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:00.275289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1339efc4-cdf6-4eb2-b431-dc58e1e7835e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:00.351863 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1607/3203] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:01.420514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbd3a4-8f82-4000-91d9-1bda1065f91c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:01.422550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-11cbd3a4-8f82-4000-91d9-1bda1065f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:01.571760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbd3a4-8f82-4000-91d9-1bda1065f91c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:01.583754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aedaf9-b6ba-4922-aff9-7e4932988ab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:01.585916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aedaf9-b6ba-4922-aff9-7e4932988ab8 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:01.586089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aedaf9-b6ba-4922-aff9-7e4932988ab8 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:01.586462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aedaf9-b6ba-4922-aff9-7e4932988ab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:01.597548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aedaf9-b6ba-4922-aff9-7e4932988ab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:01.599681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aedaf9-b6ba-4922-aff9-7e4932988ab8 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:01.613803 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1597/3204] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:00:10.340538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:10.968751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339efc4-cdf6-4eb2-b431-dc58e1e7835e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:10.970436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1339efc4-cdf6-4eb2-b431-dc58e1e7835e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:11.079450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339efc4-cdf6-4eb2-b431-dc58e1e7835e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:11.085541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e5307-f931-49a9-b51d-73ad41b2683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:11.086206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e5307-f931-49a9-b51d-73ad41b2683f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:11.086487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e5307-f931-49a9-b51d-73ad41b2683f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:11.086991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e5307-f931-49a9-b51d-73ad41b2683f admin admin] PATH_INFO: `/v3/users/230bec6ae37b4edbbc3599bdac758ddb` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:11.088158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e5307-f931-49a9-b51d-73ad41b2683f admin admin] RBAC: Authorizing `identity:delete_user(user_id=230bec6ae37b4edbbc3599bdac758ddb)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:11.090422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e5307-f931-49a9-b51d-73ad41b2683f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:11.158460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ae2e5307-f931-49a9-b51d-73ad41b2683f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230bec6ae37b4edbbc3599bdac758ddb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:11.166376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ae2e5307-f931-49a9-b51d-73ad41b2683f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230bec6ae37b4edbbc3599bdac758ddb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:11.167180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ae2e5307-f931-49a9-b51d-73ad41b2683f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230bec6ae37b4edbbc3599bdac758ddb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:11.175915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ae2e5307-f931-49a9-b51d-73ad41b2683f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230bec6ae37b4edbbc3599bdac758ddb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:11.176638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ae2e5307-f931-49a9-b51d-73ad41b2683f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230bec6ae37b4edbbc3599bdac758ddb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:11.210774 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1608/3205] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:00:10 2022] DELETE /identity/v3/users/230bec6ae37b4edbbc3599bdac758ddb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:11.447731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aedaf9-b6ba-4922-aff9-7e4932988ab8 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:11.479561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aedaf9-b6ba-4922-aff9-7e4932988ab8 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:11.613550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63c38c-1b8e-453b-8457-97fe2a07f70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:11.614507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63c38c-1b8e-453b-8457-97fe2a07f70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:11.614906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63c38c-1b8e-453b-8457-97fe2a07f70a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:11.615324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63c38c-1b8e-453b-8457-97fe2a07f70a admin admin] PATH_INFO: `/v3/projects/cf70d78b8e664d4bbaf609210ddfe302` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:11.616853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63c38c-1b8e-453b-8457-97fe2a07f70a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf70d78b8e664d4bbaf609210ddfe302)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:11.619832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63c38c-1b8e-453b-8457-97fe2a07f70a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:11.642976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:11.829766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aa63c38c-1b8e-453b-8457-97fe2a07f70a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf70d78b8e664d4bbaf609210ddfe302', 'request_id': 'req-aa63c38c-1b8e-453b-8457-97fe2a07f70a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:11.861554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aa63c38c-1b8e-453b-8457-97fe2a07f70a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf70d78b8e664d4bbaf609210ddfe302', 'request_id': 'req-aa63c38c-1b8e-453b-8457-97fe2a07f70a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:11.881015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aa63c38c-1b8e-453b-8457-97fe2a07f70a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf70d78b8e664d4bbaf609210ddfe302', 'request_id': 'req-aa63c38c-1b8e-453b-8457-97fe2a07f70a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:11.929842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aa63c38c-1b8e-453b-8457-97fe2a07f70a admin admin] The token cache is being invalidate because project cf70d78b8e664d4bbaf609210ddfe302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:00:11.932572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aa63c38c-1b8e-453b-8457-97fe2a07f70a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:11.938697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aa63c38c-1b8e-453b-8457-97fe2a07f70a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:11.957420 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1598/3206] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:00:11 2022] DELETE /identity/v3/projects/cf70d78b8e664d4bbaf609210ddfe302 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:11.963357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22c9b-e180-4baf-be05-1117a288f1c6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:11.965300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22c9b-e180-4baf-be05-1117a288f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:11.965657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22c9b-e180-4baf-be05-1117a288f1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:12.099192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8fd22c9b-e180-4baf-be05-1117a288f1c6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:12.100840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8fd22c9b-e180-4baf-be05-1117a288f1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:12.202191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:12.245767 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1609/3207] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:12.250518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34582d-d99c-4a0a-b5f6-f103ce11ea7d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:12.251052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34582d-d99c-4a0a-b5f6-f103ce11ea7d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:12.251535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34582d-d99c-4a0a-b5f6-f103ce11ea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:12.293794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2a34582d-d99c-4a0a-b5f6-f103ce11ea7d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:12.295965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2a34582d-d99c-4a0a-b5f6-f103ce11ea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:12.315176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd22c9b-e180-4baf-be05-1117a288f1c6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:12.320762 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1599/3208] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:12.326867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd22c9b-e180-4baf-be05-1117a288f1c6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:12.333512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dce00-a613-4c83-a394-3fb869f5de1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:12.334203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dce00-a613-4c83-a394-3fb869f5de1a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:12.334575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dce00-a613-4c83-a394-3fb869f5de1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:12.335063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dce00-a613-4c83-a394-3fb869f5de1a admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:12.335740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dce00-a613-4c83-a394-3fb869f5de1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:00:12.336159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dce00-a613-4c83-a394-3fb869f5de1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:12.338022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3dce00-a613-4c83-a394-3fb869f5de1a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:12.358987 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1610/3209] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:00:12.359561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34582d-d99c-4a0a-b5f6-f103ce11ea7d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:12.370387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34582d-d99c-4a0a-b5f6-f103ce11ea7d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:12.376997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e56362-a4b4-4ff1-b328-f7c082410e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:12.377874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e56362-a4b4-4ff1-b328-f7c082410e95 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:12.378162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e56362-a4b4-4ff1-b328-f7c082410e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:12.378439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e56362-a4b4-4ff1-b328-f7c082410e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:12.379435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e56362-a4b4-4ff1-b328-f7c082410e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:12.381239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e56362-a4b4-4ff1-b328-f7c082410e95 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:12.418811 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1600/3210] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:12 2022] POST /identity/v3/projects => generated 397 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:12.420263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dce00-a613-4c83-a394-3fb869f5de1a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:12.431552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dce00-a613-4c83-a394-3fb869f5de1a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:12.519169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c994d4-5302-4d31-b716-6dc045a4d69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:12.520021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c994d4-5302-4d31-b716-6dc045a4d69a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:12.521828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c994d4-5302-4d31-b716-6dc045a4d69a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:12.521828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c994d4-5302-4d31-b716-6dc045a4d69a admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:12.521828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c994d4-5302-4d31-b716-6dc045a4d69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:12.524968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c994d4-5302-4d31-b716-6dc045a4d69a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:12.552319 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1611/3211] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:12 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:00:12.553685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e56362-a4b4-4ff1-b328-f7c082410e95 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:12.566451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e56362-a4b4-4ff1-b328-f7c082410e95 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:12.571871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082393fd-2241-460e-9865-9868211b8f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:12.573473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082393fd-2241-460e-9865-9868211b8f7d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:12.574138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082393fd-2241-460e-9865-9868211b8f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:12.574897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082393fd-2241-460e-9865-9868211b8f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:12.575562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082393fd-2241-460e-9865-9868211b8f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:12.577802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082393fd-2241-460e-9865-9868211b8f7d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:12.614719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c994d4-5302-4d31-b716-6dc045a4d69a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:12.622832 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1601/3212] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:12.631372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c994d4-5302-4d31-b716-6dc045a4d69a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:12.644095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c0b02-7341-496f-9e9a-2854f8e8116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:12.645713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c0b02-7341-496f-9e9a-2854f8e8116a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:12.646705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c0b02-7341-496f-9e9a-2854f8e8116a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:12.647027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c0b02-7341-496f-9e9a-2854f8e8116a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:12.647864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c0b02-7341-496f-9e9a-2854f8e8116a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:12.649503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c0b02-7341-496f-9e9a-2854f8e8116a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:12.672707 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1612/3213] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:00:12.673933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082393fd-2241-460e-9865-9868211b8f7d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:12.688045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082393fd-2241-460e-9865-9868211b8f7d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:12.704712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482741a-b712-4546-b4a7-163e82253209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:12.705766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482741a-b712-4546-b4a7-163e82253209 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:12.706229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482741a-b712-4546-b4a7-163e82253209 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:12.706673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482741a-b712-4546-b4a7-163e82253209 admin admin] PATH_INFO: `/v3/projects/2327500057004806994b6f190e12cc9a/users/00032c0e6b684875bc8f4d9a4e07a118/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:12.729123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482741a-b712-4546-b4a7-163e82253209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2327500057004806994b6f190e12cc9a, user_id=00032c0e6b684875bc8f4d9a4e07a118, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:12.732168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482741a-b712-4546-b4a7-163e82253209 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:12.767925 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1602/3214] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:12 2022] PUT /identity/v3/projects/2327500057004806994b6f190e12cc9a/users/00032c0e6b684875bc8f4d9a4e07a118/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:00:12.784407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd25e4-74b4-456a-a4a5-05bc56a5ec30 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:12.784711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd25e4-74b4-456a-a4a5-05bc56a5ec30 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:12.785171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd25e4-74b4-456a-a4a5-05bc56a5ec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:12.860097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d5cd25e4-74b4-456a-a4a5-05bc56a5ec30 None None] MFA Rules not processed for user `00032c0e6b684875bc8f4d9a4e07a118`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:12.861447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d5cd25e4-74b4-456a-a4a5-05bc56a5ec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:12.869198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482741a-b712-4546-b4a7-163e82253209 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:12.872805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f482741a-b712-4546-b4a7-163e82253209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:13.050716 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1613/3215] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:13.057746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b049a-fbdf-49e5-980c-ead20e6c72c6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:13.058326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b049a-fbdf-49e5-980c-ead20e6c72c6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:13.058913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b049a-fbdf-49e5-980c-ead20e6c72c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:13.081588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482741a-b712-4546-b4a7-163e82253209 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:13.085712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7c9b049a-fbdf-49e5-980c-ead20e6c72c6 None None] MFA Rules not processed for user `d049efd2598f4a528d68972936643fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:13.087880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7c9b049a-fbdf-49e5-980c-ead20e6c72c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:13.096847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:13.097525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:13.100677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:13.100967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] PATH_INFO: `/v3/users/fcd1f4b070634a1a802d35289c3b74e0` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:13.103084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd1f4b070634a1a802d35289c3b74e0)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:13.109710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:13.170852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:13.179245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:13.187427 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1614/3216] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:13.215765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd1f4b070634a1a802d35289c3b74e0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:13.228017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd1f4b070634a1a802d35289c3b74e0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:13.228893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd1f4b070634a1a802d35289c3b74e0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:13.250227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd1f4b070634a1a802d35289c3b74e0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:13.251402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd1f4b070634a1a802d35289c3b74e0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:13.275830 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1603/3217] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:00:12 2022] DELETE /identity/v3/users/fcd1f4b070634a1a802d35289c3b74e0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:13.605333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b049a-fbdf-49e5-980c-ead20e6c72c6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:13.607129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7c9b049a-fbdf-49e5-980c-ead20e6c72c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:13.693950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:13.695494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:13.721754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b049a-fbdf-49e5-980c-ead20e6c72c6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:13.819304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1235c4-6903-452c-be5b-d6eed12c34a9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:13.829101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3ebc2-2883-4d36-9266-70cec7a70173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:13.830227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3ebc2-2883-4d36-9266-70cec7a70173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:13.830706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3ebc2-2883-4d36-9266-70cec7a70173 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:13.831218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3ebc2-2883-4d36-9266-70cec7a70173 admin admin] PATH_INFO: `/v3/projects/df712555bc304e319ecdb8615649661b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:13.832521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b5b77-b965-46e6-9058-b3355641a76c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:13.832732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3ebc2-2883-4d36-9266-70cec7a70173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df712555bc304e319ecdb8615649661b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:13.833588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b5b77-b965-46e6-9058-b3355641a76c service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:13.834008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b5b77-b965-46e6-9058-b3355641a76c service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:13.834379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b5b77-b965-46e6-9058-b3355641a76c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:13.834523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3ebc2-2883-4d36-9266-70cec7a70173 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:13.836674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ac6b5b77-b965-46e6-9058-b3355641a76c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:13.946836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7ea3ebc2-2883-4d36-9266-70cec7a70173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df712555bc304e319ecdb8615649661b', 'request_id': 'req-7ea3ebc2-2883-4d36-9266-70cec7a70173'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:13.951239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b5b77-b965-46e6-9058-b3355641a76c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:13.953657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b5b77-b965-46e6-9058-b3355641a76c service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:13.965565 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1615/3218] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:13 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:13.969757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7ea3ebc2-2883-4d36-9266-70cec7a70173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df712555bc304e319ecdb8615649661b', 'request_id': 'req-7ea3ebc2-2883-4d36-9266-70cec7a70173'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:13.981303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7ea3ebc2-2883-4d36-9266-70cec7a70173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df712555bc304e319ecdb8615649661b', 'request_id': 'req-7ea3ebc2-2883-4d36-9266-70cec7a70173'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:14.004689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7ea3ebc2-2883-4d36-9266-70cec7a70173 admin admin] The token cache is being invalidate because project df712555bc304e319ecdb8615649661b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:00:14.005160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7ea3ebc2-2883-4d36-9266-70cec7a70173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:14.006257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7ea3ebc2-2883-4d36-9266-70cec7a70173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:14.010514 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1604/3219] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:00:13 2022] DELETE /identity/v3/projects/df712555bc304e319ecdb8615649661b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:14.013389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31b2a7-0849-43c0-9b76-d3ee33bcd6b5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:14.013830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31b2a7-0849-43c0-9b76-d3ee33bcd6b5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:14.014129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31b2a7-0849-43c0-9b76-d3ee33bcd6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:14.067094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2c31b2a7-0849-43c0-9b76-d3ee33bcd6b5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:14.069899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2c31b2a7-0849-43c0-9b76-d3ee33bcd6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:14.127388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:14.198937 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1616/3220] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:14.202810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd964a3-a731-406b-b313-4086b4a47383 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:14.203106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd964a3-a731-406b-b313-4086b4a47383 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:14.203381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd964a3-a731-406b-b313-4086b4a47383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:14.233385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2bd964a3-a731-406b-b313-4086b4a47383 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:14.234796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2bd964a3-a731-406b-b313-4086b4a47383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:14.244584 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1605/3221] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:14.248517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31b2a7-0849-43c0-9b76-d3ee33bcd6b5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:14.262335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31b2a7-0849-43c0-9b76-d3ee33bcd6b5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:14.269463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c53c0f-3462-45e2-bb93-4bc154f50b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:14.270276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c53c0f-3462-45e2-bb93-4bc154f50b97 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:14.270669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c53c0f-3462-45e2-bb93-4bc154f50b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:14.271039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c53c0f-3462-45e2-bb93-4bc154f50b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:14.272798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c53c0f-3462-45e2-bb93-4bc154f50b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:00:14.273154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c53c0f-3462-45e2-bb93-4bc154f50b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:14.276088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c53c0f-3462-45e2-bb93-4bc154f50b97 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:14.299122 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1617/3222] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:00:14.299584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd964a3-a731-406b-b313-4086b4a47383 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:14.311830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd964a3-a731-406b-b313-4086b4a47383 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:14.317887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317af80a-dc5a-4d98-9416-82f265ef4a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:14.318836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317af80a-dc5a-4d98-9416-82f265ef4a57 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:14.319380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317af80a-dc5a-4d98-9416-82f265ef4a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:14.319683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317af80a-dc5a-4d98-9416-82f265ef4a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:14.320306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317af80a-dc5a-4d98-9416-82f265ef4a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:14.322723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317af80a-dc5a-4d98-9416-82f265ef4a57 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:14.370566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c53c0f-3462-45e2-bb93-4bc154f50b97 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:14.377393 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1606/3223] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:14 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:00:14.384070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c53c0f-3462-45e2-bb93-4bc154f50b97 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:14.462795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffa2a0-a3fb-4fc4-8448-393d09e95e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:14.463422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffa2a0-a3fb-4fc4-8448-393d09e95e5e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:14.463704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffa2a0-a3fb-4fc4-8448-393d09e95e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:14.463977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffa2a0-a3fb-4fc4-8448-393d09e95e5e admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:14.464627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffa2a0-a3fb-4fc4-8448-393d09e95e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:14.466631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffa2a0-a3fb-4fc4-8448-393d09e95e5e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:14.497655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317af80a-dc5a-4d98-9416-82f265ef4a57 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:14.499853 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1618/3224] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:14 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:14.510565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317af80a-dc5a-4d98-9416-82f265ef4a57 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:14.519739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc433b26-7ac5-49b1-aaa9-7fb89d93a07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:14.520608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc433b26-7ac5-49b1-aaa9-7fb89d93a07c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:14.520931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc433b26-7ac5-49b1-aaa9-7fb89d93a07c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:14.521212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc433b26-7ac5-49b1-aaa9-7fb89d93a07c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:14.521953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc433b26-7ac5-49b1-aaa9-7fb89d93a07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:14.523658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc433b26-7ac5-49b1-aaa9-7fb89d93a07c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:14.525372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:14.541074 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1607/3225] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:00:14.546462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffa2a0-a3fb-4fc4-8448-393d09e95e5e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:14.567084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffa2a0-a3fb-4fc4-8448-393d09e95e5e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:14.573005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764433f2-ab4d-4a78-8685-ebf05c5a5333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:14.573705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764433f2-ab4d-4a78-8685-ebf05c5a5333 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:14.574064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764433f2-ab4d-4a78-8685-ebf05c5a5333 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:14.574959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764433f2-ab4d-4a78-8685-ebf05c5a5333 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:14.575721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764433f2-ab4d-4a78-8685-ebf05c5a5333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:14.578636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764433f2-ab4d-4a78-8685-ebf05c5a5333 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:14.594645 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1619/3226] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:14.595942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc433b26-7ac5-49b1-aaa9-7fb89d93a07c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:14.610088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc433b26-7ac5-49b1-aaa9-7fb89d93a07c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:14.619438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661efe8b-2d7b-4f9f-b2f1-14cb1d60c95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:14.620422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661efe8b-2d7b-4f9f-b2f1-14cb1d60c95a admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:14.620716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661efe8b-2d7b-4f9f-b2f1-14cb1d60c95a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:14.621167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661efe8b-2d7b-4f9f-b2f1-14cb1d60c95a admin admin] PATH_INFO: `/v3/projects/8ca5a9d29cc64f20a63465f335012cd6/users/8c74321e1a114e3094d2f69930037505/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:14.638989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661efe8b-2d7b-4f9f-b2f1-14cb1d60c95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca5a9d29cc64f20a63465f335012cd6, user_id=8c74321e1a114e3094d2f69930037505, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:14.642571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661efe8b-2d7b-4f9f-b2f1-14cb1d60c95a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:14.663024 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1608/3227] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:14 2022] PUT /identity/v3/projects/8ca5a9d29cc64f20a63465f335012cd6/users/8c74321e1a114e3094d2f69930037505/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:00:14.667217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cdd10-4a1e-4eae-8a86-7027883c6ba5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:14.667509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cdd10-4a1e-4eae-8a86-7027883c6ba5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:14.668131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cdd10-4a1e-4eae-8a86-7027883c6ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:14.691588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-501cdd10-4a1e-4eae-8a86-7027883c6ba5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:14.692819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-501cdd10-4a1e-4eae-8a86-7027883c6ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:14.796755 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1620/3228] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:14.808565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661efe8b-2d7b-4f9f-b2f1-14cb1d60c95a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:14.811018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-661efe8b-2d7b-4f9f-b2f1-14cb1d60c95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:15.019754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661efe8b-2d7b-4f9f-b2f1-14cb1d60c95a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:15.031828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13846667-599f-4015-abbc-7d2da0585e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:15.032815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13846667-599f-4015-abbc-7d2da0585e35 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:15.033298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13846667-599f-4015-abbc-7d2da0585e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:15.033798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13846667-599f-4015-abbc-7d2da0585e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:15.060264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13846667-599f-4015-abbc-7d2da0585e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:15.065861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13846667-599f-4015-abbc-7d2da0585e35 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:15.091158 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1609/3229] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:16.840577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cdd10-4a1e-4eae-8a86-7027883c6ba5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:16.840577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-501cdd10-4a1e-4eae-8a86-7027883c6ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:16.863367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cdd10-4a1e-4eae-8a86-7027883c6ba5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:16.882859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:16.883904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:16.883904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:16.884122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] PATH_INFO: `/v3/users/00032c0e6b684875bc8f4d9a4e07a118` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:16.896632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00032c0e6b684875bc8f4d9a4e07a118)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:16.901455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:16.997491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:17.017275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00032c0e6b684875bc8f4d9a4e07a118'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:17.031204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00032c0e6b684875bc8f4d9a4e07a118'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:17.032602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00032c0e6b684875bc8f4d9a4e07a118'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:17.048207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00032c0e6b684875bc8f4d9a4e07a118'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:17.049148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00032c0e6b684875bc8f4d9a4e07a118'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:17.130592 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1621/3230] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:00:16 2022] DELETE /identity/v3/users/00032c0e6b684875bc8f4d9a4e07a118 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:17.132408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04166e9-c6e6-4872-b203-f249e1c03725 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:17.132886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04166e9-c6e6-4872-b203-f249e1c03725 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:17.133077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04166e9-c6e6-4872-b203-f249e1c03725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:17.188100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d04166e9-c6e6-4872-b203-f249e1c03725 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:17.189336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d04166e9-c6e6-4872-b203-f249e1c03725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:17.395013 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1610/3231] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:17.402689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:17.404536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:17.498854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8eedc-c2a7-4534-a7dc-d1030bd5bb88 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:17.504700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dc6dc-7192-4d19-9cec-6878384b5ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:17.505764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dc6dc-7192-4d19-9cec-6878384b5ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:17.506247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dc6dc-7192-4d19-9cec-6878384b5ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:17.506729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dc6dc-7192-4d19-9cec-6878384b5ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:17.518416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dc6dc-7192-4d19-9cec-6878384b5ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:17.520481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dc6dc-7192-4d19-9cec-6878384b5ea8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:17.558835 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1622/3232] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:18.528549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04166e9-c6e6-4872-b203-f249e1c03725 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:18.531317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d04166e9-c6e6-4872-b203-f249e1c03725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:18.549629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04166e9-c6e6-4872-b203-f249e1c03725 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:18.555788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b361a92-2869-4d2c-a119-30a6fc12e0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:18.556446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b361a92-2869-4d2c-a119-30a6fc12e0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:18.556729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b361a92-2869-4d2c-a119-30a6fc12e0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:18.557157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b361a92-2869-4d2c-a119-30a6fc12e0f4 admin admin] PATH_INFO: `/v3/projects/2327500057004806994b6f190e12cc9a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:18.558864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b361a92-2869-4d2c-a119-30a6fc12e0f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2327500057004806994b6f190e12cc9a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:18.563064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b361a92-2869-4d2c-a119-30a6fc12e0f4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:18.650499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5b361a92-2869-4d2c-a119-30a6fc12e0f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2327500057004806994b6f190e12cc9a', 'request_id': 'req-5b361a92-2869-4d2c-a119-30a6fc12e0f4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:18.653839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:18.669906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5b361a92-2869-4d2c-a119-30a6fc12e0f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2327500057004806994b6f190e12cc9a', 'request_id': 'req-5b361a92-2869-4d2c-a119-30a6fc12e0f4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:18.684012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5b361a92-2869-4d2c-a119-30a6fc12e0f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2327500057004806994b6f190e12cc9a', 'request_id': 'req-5b361a92-2869-4d2c-a119-30a6fc12e0f4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:18.719447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5b361a92-2869-4d2c-a119-30a6fc12e0f4 admin admin] The token cache is being invalidate because project 2327500057004806994b6f190e12cc9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:00:18.720571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5b361a92-2869-4d2c-a119-30a6fc12e0f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:18.722062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5b361a92-2869-4d2c-a119-30a6fc12e0f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:18.726461 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1611/3233] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:00:18 2022] DELETE /identity/v3/projects/2327500057004806994b6f190e12cc9a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:18.734806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056581b-fc99-4219-8f34-7f08c9c6c8cb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:18.735388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056581b-fc99-4219-8f34-7f08c9c6c8cb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:18.736434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056581b-fc99-4219-8f34-7f08c9c6c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:18.760945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a056581b-fc99-4219-8f34-7f08c9c6c8cb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:18.762518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a056581b-fc99-4219-8f34-7f08c9c6c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:18.838621 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1623/3234] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:18.847142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c894f6-ad69-43e5-bc1d-760384e78f92 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:18.847492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c894f6-ad69-43e5-bc1d-760384e78f92 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:18.847744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c894f6-ad69-43e5-bc1d-760384e78f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:18.874388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b6c894f6-ad69-43e5-bc1d-760384e78f92 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:18.876440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b6c894f6-ad69-43e5-bc1d-760384e78f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:18.889260 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1612/3235] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:18.894457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056581b-fc99-4219-8f34-7f08c9c6c8cb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:18.916943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056581b-fc99-4219-8f34-7f08c9c6c8cb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:18.928432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8f576-d583-48de-b714-460ee898d4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:18.929516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8f576-d583-48de-b714-460ee898d4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:18.930034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8f576-d583-48de-b714-460ee898d4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:18.930556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8f576-d583-48de-b714-460ee898d4c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:18.932243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8f576-d583-48de-b714-460ee898d4c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:00:18.932824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8f576-d583-48de-b714-460ee898d4c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:18.937273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8f576-d583-48de-b714-460ee898d4c0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:18.967180 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1624/3236] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:00:18.973307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c894f6-ad69-43e5-bc1d-760384e78f92 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:19.008103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c894f6-ad69-43e5-bc1d-760384e78f92 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:19.070007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b22551-ed90-480c-9dfd-eab4e68c90fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:19.070907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b22551-ed90-480c-9dfd-eab4e68c90fb admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:19.080290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b22551-ed90-480c-9dfd-eab4e68c90fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:19.080936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b22551-ed90-480c-9dfd-eab4e68c90fb admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:19.081746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b22551-ed90-480c-9dfd-eab4e68c90fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:19.089836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b22551-ed90-480c-9dfd-eab4e68c90fb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:19.185517 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1613/3237] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:18 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:19.190335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8f576-d583-48de-b714-460ee898d4c0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:19.219989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8f576-d583-48de-b714-460ee898d4c0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:19.381700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:19.529706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd12d-3903-47a8-84cb-966b9bcd3ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:19.531448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd12d-3903-47a8-84cb-966b9bcd3ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:19.531791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd12d-3903-47a8-84cb-966b9bcd3ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:19.532139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd12d-3903-47a8-84cb-966b9bcd3ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:19.532857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cd12d-3903-47a8-84cb-966b9bcd3ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:19.534960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cd12d-3903-47a8-84cb-966b9bcd3ac0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:19.586781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b22551-ed90-480c-9dfd-eab4e68c90fb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:19.604677 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1625/3238] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:19 2022] POST /identity/v3/users => generated 290 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:00:19.618611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b22551-ed90-480c-9dfd-eab4e68c90fb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:19.627821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5382e-6661-4ab6-959e-989c2d5f5a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:19.628829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5382e-6661-4ab6-959e-989c2d5f5a6e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:19.630826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5382e-6661-4ab6-959e-989c2d5f5a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:19.631478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5382e-6661-4ab6-959e-989c2d5f5a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:19.633227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5382e-6661-4ab6-959e-989c2d5f5a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:19.642709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5382e-6661-4ab6-959e-989c2d5f5a6e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:19.661107 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1614/3239] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:19.664988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd12d-3903-47a8-84cb-966b9bcd3ac0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:19.679282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cd12d-3903-47a8-84cb-966b9bcd3ac0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:19.687261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b0954-c0d9-4de3-bef1-2d17fbfc08de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:19.687961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b0954-c0d9-4de3-bef1-2d17fbfc08de admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:19.689957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b0954-c0d9-4de3-bef1-2d17fbfc08de admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:19.689957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b0954-c0d9-4de3-bef1-2d17fbfc08de admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:19.690366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b0954-c0d9-4de3-bef1-2d17fbfc08de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:19.692184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b0954-c0d9-4de3-bef1-2d17fbfc08de admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:19.711616 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1626/3240] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:19.712323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5382e-6661-4ab6-959e-989c2d5f5a6e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:19.746055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5382e-6661-4ab6-959e-989c2d5f5a6e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:19.775765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18cebb-7fae-4ce9-88ac-1f4dcbeea634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:19.786584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18cebb-7fae-4ce9-88ac-1f4dcbeea634 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:19.786988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18cebb-7fae-4ce9-88ac-1f4dcbeea634 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:19.789405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18cebb-7fae-4ce9-88ac-1f4dcbeea634 admin admin] PATH_INFO: `/v3/projects/ec82aa58d032474e8d3257b4652b1dd0/users/a23efd87fea548e7a3a48d08d23812c7/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:19.838195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18cebb-7fae-4ce9-88ac-1f4dcbeea634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec82aa58d032474e8d3257b4652b1dd0, user_id=a23efd87fea548e7a3a48d08d23812c7, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:19.881024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18cebb-7fae-4ce9-88ac-1f4dcbeea634 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:19.942114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46567e42-d651-46e4-b2ca-bf378849aa0c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:19.942694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46567e42-d651-46e4-b2ca-bf378849aa0c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:19.942694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46567e42-d651-46e4-b2ca-bf378849aa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:19.948051 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1615/3241] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:19 2022] PUT /identity/v3/projects/ec82aa58d032474e8d3257b4652b1dd0/users/a23efd87fea548e7a3a48d08d23812c7/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:00:19.971693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-46567e42-d651-46e4-b2ca-bf378849aa0c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:19.973032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-46567e42-d651-46e4-b2ca-bf378849aa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:20.103001 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1627/3242] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:20.138971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18cebb-7fae-4ce9-88ac-1f4dcbeea634 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:20.143758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dd18cebb-7fae-4ce9-88ac-1f4dcbeea634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:20.257193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18cebb-7fae-4ce9-88ac-1f4dcbeea634 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:20.262013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8367946-47d6-4037-9ae6-236a9230f5b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:20.262834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8367946-47d6-4037-9ae6-236a9230f5b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:20.263217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8367946-47d6-4037-9ae6-236a9230f5b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:20.263590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8367946-47d6-4037-9ae6-236a9230f5b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:20.277825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8367946-47d6-4037-9ae6-236a9230f5b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:20.280569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8367946-47d6-4037-9ae6-236a9230f5b6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:20.300007 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1616/3243] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:26.423518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46567e42-d651-46e4-b2ca-bf378849aa0c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:26.425403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-46567e42-d651-46e4-b2ca-bf378849aa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:26.581316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46567e42-d651-46e4-b2ca-bf378849aa0c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:26.589214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c621f-8fc7-4c17-b493-dcd955fd4185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:26.590041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c621f-8fc7-4c17-b493-dcd955fd4185 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:26.590524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c621f-8fc7-4c17-b493-dcd955fd4185 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:26.590872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c621f-8fc7-4c17-b493-dcd955fd4185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:26.594001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9d8c621f-8fc7-4c17-b493-dcd955fd4185 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:26.681465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:26.686773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c621f-8fc7-4c17-b493-dcd955fd4185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:26.688783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c621f-8fc7-4c17-b493-dcd955fd4185 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:26.709043 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1628/3244] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:00:29.523702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b59c9-5eff-450b-b4bf-98ec411f590a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:29.524259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b59c9-5eff-450b-b4bf-98ec411f590a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:29.524259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b59c9-5eff-450b-b4bf-98ec411f590a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:29.571052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-536b59c9-5eff-450b-b4bf-98ec411f590a None None] MFA Rules not processed for user `3afd4b10403a452e81f60f30ed5690f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:29.572358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-536b59c9-5eff-450b-b4bf-98ec411f590a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:29.751019 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1617/3245] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:31.196230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d510d4a-7b23-4c5f-bc7d-3603077c74ac None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:31.196661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d510d4a-7b23-4c5f-bc7d-3603077c74ac None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:31.196808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d510d4a-7b23-4c5f-bc7d-3603077c74ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:31.258387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0d510d4a-7b23-4c5f-bc7d-3603077c74ac None None] MFA Rules not processed for user `26726afc7c1746949ff868d5046efcdf`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:31.263567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0d510d4a-7b23-4c5f-bc7d-3603077c74ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:31.543714 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1629/3246] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:00:32.451362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edb09a-05c5-4177-a860-4c036c26457d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:32.451952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edb09a-05c5-4177-a860-4c036c26457d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:32.451952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edb09a-05c5-4177-a860-4c036c26457d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:32.596036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-35edb09a-05c5-4177-a860-4c036c26457d None None] MFA Rules not processed for user `8c74321e1a114e3094d2f69930037505`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:32.597347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-35edb09a-05c5-4177-a860-4c036c26457d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:32.646287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:32.802269 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1618/3247] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:32.803883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af153d-a4d2-413c-b5eb-eb05e62e110a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:32.804384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af153d-a4d2-413c-b5eb-eb05e62e110a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:32.804633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af153d-a4d2-413c-b5eb-eb05e62e110a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:32.848576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-58af153d-a4d2-413c-b5eb-eb05e62e110a None None] MFA Rules not processed for user `8c74321e1a114e3094d2f69930037505`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:32.860082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-58af153d-a4d2-413c-b5eb-eb05e62e110a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:32.885987 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1630/3248] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:00:35.309432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edb09a-05c5-4177-a860-4c036c26457d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:35.312056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-35edb09a-05c5-4177-a860-4c036c26457d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:35.336553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edb09a-05c5-4177-a860-4c036c26457d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:35.344049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee702ea-51f0-413a-8026-1f2d8af61a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:35.345657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee702ea-51f0-413a-8026-1f2d8af61a08 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:35.346204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee702ea-51f0-413a-8026-1f2d8af61a08 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:35.346721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee702ea-51f0-413a-8026-1f2d8af61a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:35.359766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee702ea-51f0-413a-8026-1f2d8af61a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:35.362398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee702ea-51f0-413a-8026-1f2d8af61a08 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:35.375947 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1619/3249] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:42.836847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=31 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:45.382055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=28 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:47.700296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fbabb-4e7e-4172-b771-88923e564c65 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:47.700833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fbabb-4e7e-4172-b771-88923e564c65 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:47.701097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fbabb-4e7e-4172-b771-88923e564c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:47.791856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7d6fbabb-4e7e-4172-b771-88923e564c65 None None] MFA Rules not processed for user `a23efd87fea548e7a3a48d08d23812c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:47.793457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7d6fbabb-4e7e-4172-b771-88923e564c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:47.977512 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1631/3250] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:47.989932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8bc61-a869-4dea-861c-d126d9cf0899 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:47.990938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8bc61-a869-4dea-861c-d126d9cf0899 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:47.991361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8bc61-a869-4dea-861c-d126d9cf0899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:48.030113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c6d8bc61-a869-4dea-861c-d126d9cf0899 None None] MFA Rules not processed for user `a23efd87fea548e7a3a48d08d23812c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:48.038805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c6d8bc61-a869-4dea-861c-d126d9cf0899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:48.055753 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1620/3251] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:49.709864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fbabb-4e7e-4172-b771-88923e564c65 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:49.729607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fbabb-4e7e-4172-b771-88923e564c65 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:49.743980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a8471-6efd-450c-8403-35a1c6a50819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:49.744630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a8471-6efd-450c-8403-35a1c6a50819 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:49.744911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a8471-6efd-450c-8403-35a1c6a50819 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:49.745358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a8471-6efd-450c-8403-35a1c6a50819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:49.770117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a8471-6efd-450c-8403-35a1c6a50819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:49.771813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a8471-6efd-450c-8403-35a1c6a50819 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:49.791957 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1632/3252] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:00:56.613305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8bc61-a869-4dea-861c-d126d9cf0899 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:56.615195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c6d8bc61-a869-4dea-861c-d126d9cf0899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:56.643488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8bc61-a869-4dea-861c-d126d9cf0899 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:56.653899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebacdcb-6f25-416b-bdab-d5d2535cad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:56.657085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebacdcb-6f25-416b-bdab-d5d2535cad62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:56.659262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebacdcb-6f25-416b-bdab-d5d2535cad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:56.659655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebacdcb-6f25-416b-bdab-d5d2535cad62 admin admin] PATH_INFO: `/v3/users/9ce380dc51d24674b870aebf8ee6a793` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:56.663086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebacdcb-6f25-416b-bdab-d5d2535cad62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce380dc51d24674b870aebf8ee6a793)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:56.665175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebacdcb-6f25-416b-bdab-d5d2535cad62 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:56.737683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0ebacdcb-6f25-416b-bdab-d5d2535cad62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce380dc51d24674b870aebf8ee6a793'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:56.752460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0ebacdcb-6f25-416b-bdab-d5d2535cad62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce380dc51d24674b870aebf8ee6a793'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:56.753468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0ebacdcb-6f25-416b-bdab-d5d2535cad62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce380dc51d24674b870aebf8ee6a793'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:56.772373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0ebacdcb-6f25-416b-bdab-d5d2535cad62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce380dc51d24674b870aebf8ee6a793'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:56.773889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0ebacdcb-6f25-416b-bdab-d5d2535cad62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce380dc51d24674b870aebf8ee6a793'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:56.799071 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1621/3253] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:00:56 2022] DELETE /identity/v3/users/9ce380dc51d24674b870aebf8ee6a793 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:57.193432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a8471-6efd-450c-8403-35a1c6a50819 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:57.211651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a8471-6efd-450c-8403-35a1c6a50819 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:57.307841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edec2a-7957-4fd9-bf50-9c04fc81d202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:57.309088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edec2a-7957-4fd9-bf50-9c04fc81d202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:57.309573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edec2a-7957-4fd9-bf50-9c04fc81d202 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:57.310280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edec2a-7957-4fd9-bf50-9c04fc81d202 admin admin] PATH_INFO: `/v3/projects/c384c6b548a849ff949da659c2138ce0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:57.312710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edec2a-7957-4fd9-bf50-9c04fc81d202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c384c6b548a849ff949da659c2138ce0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:57.314936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edec2a-7957-4fd9-bf50-9c04fc81d202 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:57.382483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1edec2a-7957-4fd9-bf50-9c04fc81d202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c384c6b548a849ff949da659c2138ce0', 'request_id': 'req-f1edec2a-7957-4fd9-bf50-9c04fc81d202'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:57.389062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1edec2a-7957-4fd9-bf50-9c04fc81d202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c384c6b548a849ff949da659c2138ce0', 'request_id': 'req-f1edec2a-7957-4fd9-bf50-9c04fc81d202'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:57.396504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1edec2a-7957-4fd9-bf50-9c04fc81d202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c384c6b548a849ff949da659c2138ce0', 'request_id': 'req-f1edec2a-7957-4fd9-bf50-9c04fc81d202'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:57.416174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1edec2a-7957-4fd9-bf50-9c04fc81d202 admin admin] The token cache is being invalidate because project c384c6b548a849ff949da659c2138ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:00:57.417270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1edec2a-7957-4fd9-bf50-9c04fc81d202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:57.418078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1edec2a-7957-4fd9-bf50-9c04fc81d202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:00:57.420880 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1633/3254] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:00:57 2022] DELETE /identity/v3/projects/c384c6b548a849ff949da659c2138ce0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:00:57.425785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d493ac2-4351-4aba-aa8c-053df85dc868 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:57.426367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d493ac2-4351-4aba-aa8c-053df85dc868 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:57.426648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d493ac2-4351-4aba-aa8c-053df85dc868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:57.449374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4d493ac2-4351-4aba-aa8c-053df85dc868 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:57.450928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4d493ac2-4351-4aba-aa8c-053df85dc868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:57.532779 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1622/3255] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:57.533918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654920-2613-4dca-9ae8-3ab834f97316 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:57.534279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654920-2613-4dca-9ae8-3ab834f97316 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:57.534629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e654920-2613-4dca-9ae8-3ab834f97316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:57.552096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:57.559808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0e654920-2613-4dca-9ae8-3ab834f97316 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:57.563622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0e654920-2613-4dca-9ae8-3ab834f97316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:57.582725 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1634/3256] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:00:57.586283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d493ac2-4351-4aba-aa8c-053df85dc868 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:57.599335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d493ac2-4351-4aba-aa8c-053df85dc868 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:57.604544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbdd38-8edf-4bcc-b937-4f1331049d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:57.605491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbdd38-8edf-4bcc-b937-4f1331049d12 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:57.605981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbdd38-8edf-4bcc-b937-4f1331049d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:57.606485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbdd38-8edf-4bcc-b937-4f1331049d12 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:57.608344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbdd38-8edf-4bcc-b937-4f1331049d12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:00:57.609083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbdd38-8edf-4bcc-b937-4f1331049d12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:57.611486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbdd38-8edf-4bcc-b937-4f1331049d12 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:57.628138 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1623/3257] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:00:57.632686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654920-2613-4dca-9ae8-3ab834f97316 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:57.644477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e654920-2613-4dca-9ae8-3ab834f97316 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:57.650044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e723448-8dc5-4b91-8b3e-04440d0eea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:57.651010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e723448-8dc5-4b91-8b3e-04440d0eea7d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:57.651439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e723448-8dc5-4b91-8b3e-04440d0eea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:57.651859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e723448-8dc5-4b91-8b3e-04440d0eea7d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:57.653326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e723448-8dc5-4b91-8b3e-04440d0eea7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:57.656058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e723448-8dc5-4b91-8b3e-04440d0eea7d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:57.694463 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1635/3258] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:00:57 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:00:57.697900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbdd38-8edf-4bcc-b937-4f1331049d12 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:57.709984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbdd38-8edf-4bcc-b937-4f1331049d12 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:57.769830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:00:57.784369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2d4b2-80e4-49b0-ae14-815302a7306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:57.785491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d4b2-80e4-49b0-ae14-815302a7306c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:57.786051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d4b2-80e4-49b0-ae14-815302a7306c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:57.786582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d4b2-80e4-49b0-ae14-815302a7306c admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:57.787508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2d4b2-80e4-49b0-ae14-815302a7306c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:57.790703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2d4b2-80e4-49b0-ae14-815302a7306c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:57.824709 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1624/3259] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:00:57 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:00:57.826017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e723448-8dc5-4b91-8b3e-04440d0eea7d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:57.839787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e723448-8dc5-4b91-8b3e-04440d0eea7d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:57.846790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd3987-d8bd-41bd-9398-62d8990e36a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:57.847519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd3987-d8bd-41bd-9398-62d8990e36a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:57.847873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd3987-d8bd-41bd-9398-62d8990e36a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:57.848212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd3987-d8bd-41bd-9398-62d8990e36a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:57.848935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd3987-d8bd-41bd-9398-62d8990e36a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:57.851231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd3987-d8bd-41bd-9398-62d8990e36a8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:57.868341 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1636/3260] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:57.869525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2d4b2-80e4-49b0-ae14-815302a7306c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:57.899169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2d4b2-80e4-49b0-ae14-815302a7306c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:57.908728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3b442-45c4-45ed-9e2e-f907d193f416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:57.910000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3b442-45c4-45ed-9e2e-f907d193f416 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:57.910572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3b442-45c4-45ed-9e2e-f907d193f416 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:57.911068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3b442-45c4-45ed-9e2e-f907d193f416 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:57.912572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3b442-45c4-45ed-9e2e-f907d193f416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:57.917157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3b442-45c4-45ed-9e2e-f907d193f416 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:57.930832 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1625/3261] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:00:57.934954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd3987-d8bd-41bd-9398-62d8990e36a8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:57.951044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd3987-d8bd-41bd-9398-62d8990e36a8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:57.957916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac1c04-b8b2-48da-b741-0d19eb82d7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:57.959400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac1c04-b8b2-48da-b741-0d19eb82d7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:57.960208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac1c04-b8b2-48da-b741-0d19eb82d7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:57.960503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac1c04-b8b2-48da-b741-0d19eb82d7ed admin admin] PATH_INFO: `/v3/projects/016ddf77ac91421a883bbc8787204d42/users/8dbb8a95851248bfabd9a1afe40fc11b/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:57.987771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac1c04-b8b2-48da-b741-0d19eb82d7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=016ddf77ac91421a883bbc8787204d42, user_id=8dbb8a95851248bfabd9a1afe40fc11b, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:57.991690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac1c04-b8b2-48da-b741-0d19eb82d7ed admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:58.014797 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1637/3262] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:00:57 2022] PUT /identity/v3/projects/016ddf77ac91421a883bbc8787204d42/users/8dbb8a95851248bfabd9a1afe40fc11b/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:00:58.019849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59cfa3-a7a3-4ffb-a08b-c06fcc693e96 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:58.020477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59cfa3-a7a3-4ffb-a08b-c06fcc693e96 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:58.020891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59cfa3-a7a3-4ffb-a08b-c06fcc693e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:58.050154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7d59cfa3-a7a3-4ffb-a08b-c06fcc693e96 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:00:58.051740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7d59cfa3-a7a3-4ffb-a08b-c06fcc693e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:58.179523 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1626/3263] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:00:58.190979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac1c04-b8b2-48da-b741-0d19eb82d7ed admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:00:58.192777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-83ac1c04-b8b2-48da-b741-0d19eb82d7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:00:58.298509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac1c04-b8b2-48da-b741-0d19eb82d7ed admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:00:58.304403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e6bca-d5f8-4c8d-b61e-63c4151b683e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:00:58.305107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e6bca-d5f8-4c8d-b61e-63c4151b683e service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:00:58.305460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e6bca-d5f8-4c8d-b61e-63c4151b683e service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:00:58.305747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e6bca-d5f8-4c8d-b61e-63c4151b683e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:00:58.317936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e6bca-d5f8-4c8d-b61e-63c4151b683e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:00:58.319501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e6bca-d5f8-4c8d-b61e-63c4151b683e service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:00:58.332380 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1638/3264] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:05.650788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a159e-7e01-4e87-8ec8-6b2fe399929b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:05.651341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a159e-7e01-4e87-8ec8-6b2fe399929b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:05.651503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a159e-7e01-4e87-8ec8-6b2fe399929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:05.720913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-099a159e-7e01-4e87-8ec8-6b2fe399929b None None] MFA Rules not processed for user `8dbb8a95851248bfabd9a1afe40fc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:05.722183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-099a159e-7e01-4e87-8ec8-6b2fe399929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:05.894564 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1627/3265] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:05.897617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bff0c-3eb1-49ab-9bcc-1a1fcf3461d5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:05.898098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bff0c-3eb1-49ab-9bcc-1a1fcf3461d5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:05.898283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bff0c-3eb1-49ab-9bcc-1a1fcf3461d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:05.937989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-051bff0c-3eb1-49ab-9bcc-1a1fcf3461d5 None None] MFA Rules not processed for user `8dbb8a95851248bfabd9a1afe40fc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:05.939392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-051bff0c-3eb1-49ab-9bcc-1a1fcf3461d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:05.959399 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1639/3266] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:07.211267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a159e-7e01-4e87-8ec8-6b2fe399929b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:07.215036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-099a159e-7e01-4e87-8ec8-6b2fe399929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:07.289063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:07.308244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a159e-7e01-4e87-8ec8-6b2fe399929b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:07.315595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecafb57c-67d6-41bf-86f8-113500160779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:07.316755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafb57c-67d6-41bf-86f8-113500160779 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:07.316888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafb57c-67d6-41bf-86f8-113500160779 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:07.317180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecafb57c-67d6-41bf-86f8-113500160779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:07.331775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafb57c-67d6-41bf-86f8-113500160779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:07.334115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecafb57c-67d6-41bf-86f8-113500160779 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:07.346016 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1628/3267] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:09.380173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bff0c-3eb1-49ab-9bcc-1a1fcf3461d5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:09.394038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bff0c-3eb1-49ab-9bcc-1a1fcf3461d5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:09.400746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724331c6-39f4-4cd8-9eaa-095eec557aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:09.401387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724331c6-39f4-4cd8-9eaa-095eec557aea service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:09.401683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724331c6-39f4-4cd8-9eaa-095eec557aea service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:09.402023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724331c6-39f4-4cd8-9eaa-095eec557aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:09.415427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-724331c6-39f4-4cd8-9eaa-095eec557aea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:09.444601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724331c6-39f4-4cd8-9eaa-095eec557aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:09.446402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724331c6-39f4-4cd8-9eaa-095eec557aea service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:09.460647 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1640/3268] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:14.148527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0881e-0e96-48cd-9302-eb079e3d2dee None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:14.149009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0881e-0e96-48cd-9302-eb079e3d2dee None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:14.149333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0881e-0e96-48cd-9302-eb079e3d2dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:14.216008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fbc0881e-0e96-48cd-9302-eb079e3d2dee None None] MFA Rules not processed for user `3afd4b10403a452e81f60f30ed5690f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:14.223826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fbc0881e-0e96-48cd-9302-eb079e3d2dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:14.389996 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1629/3269] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:18.247016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b4f4b-87f0-4342-baaa-ccf255a16932 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:18.248428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b4f4b-87f0-4342-baaa-ccf255a16932 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:18.249268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b4f4b-87f0-4342-baaa-ccf255a16932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:18.286189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-568b4f4b-87f0-4342-baaa-ccf255a16932 None None] MFA Rules not processed for user `ab694f38b57c4283be1582ce02008978`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:18.288140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-568b4f4b-87f0-4342-baaa-ccf255a16932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:18.432202 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1641/3270] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:22.517287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0881e-0e96-48cd-9302-eb079e3d2dee None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:22.524152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fbc0881e-0e96-48cd-9302-eb079e3d2dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:22.581712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0881e-0e96-48cd-9302-eb079e3d2dee None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:22.598044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92704698-4dda-4cdc-9ba5-0cdbf48db6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:22.603061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704698-4dda-4cdc-9ba5-0cdbf48db6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:22.604045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704698-4dda-4cdc-9ba5-0cdbf48db6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:22.605224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704698-4dda-4cdc-9ba5-0cdbf48db6c9 admin admin] PATH_INFO: `/v3/users/3b738496864a4b04bc885b75980e2341` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:22.609806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92704698-4dda-4cdc-9ba5-0cdbf48db6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b738496864a4b04bc885b75980e2341)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:22.615725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92704698-4dda-4cdc-9ba5-0cdbf48db6c9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:22.789714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-92704698-4dda-4cdc-9ba5-0cdbf48db6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b738496864a4b04bc885b75980e2341'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:22.815686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-92704698-4dda-4cdc-9ba5-0cdbf48db6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b738496864a4b04bc885b75980e2341'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:22.820308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-92704698-4dda-4cdc-9ba5-0cdbf48db6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b738496864a4b04bc885b75980e2341'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:22.863424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-92704698-4dda-4cdc-9ba5-0cdbf48db6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b738496864a4b04bc885b75980e2341'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:22.870770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-92704698-4dda-4cdc-9ba5-0cdbf48db6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b738496864a4b04bc885b75980e2341'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:22.905862 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1630/3271] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:01:22 2022] DELETE /identity/v3/users/3b738496864a4b04bc885b75980e2341 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:23.600550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b4f4b-87f0-4342-baaa-ccf255a16932 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:23.621356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b4f4b-87f0-4342-baaa-ccf255a16932 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:23.711602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:23.807250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:23.808216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:23.808611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:23.809024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] PATH_INFO: `/v3/projects/99992536b70f41aa9dbdbf358cd6b2bb` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:23.812168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99992536b70f41aa9dbdbf358cd6b2bb)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:23.814851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:23.888943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eec209-6272-4e68-b4ee-b963b6f71c2f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:23.890414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eec209-6272-4e68-b4ee-b963b6f71c2f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:23.890705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eec209-6272-4e68-b4ee-b963b6f71c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:23.964058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99992536b70f41aa9dbdbf358cd6b2bb', 'request_id': 'req-963c0c5d-6ef6-463e-90a6-b8168f909456'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:23.972322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-23eec209-6272-4e68-b4ee-b963b6f71c2f None None] MFA Rules not processed for user `a23efd87fea548e7a3a48d08d23812c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:23.975093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-23eec209-6272-4e68-b4ee-b963b6f71c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:23.978357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99992536b70f41aa9dbdbf358cd6b2bb', 'request_id': 'req-963c0c5d-6ef6-463e-90a6-b8168f909456'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:23.989288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99992536b70f41aa9dbdbf358cd6b2bb', 'request_id': 'req-963c0c5d-6ef6-463e-90a6-b8168f909456'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:24.029526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] The token cache is being invalidate because project 99992536b70f41aa9dbdbf358cd6b2bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:24.039293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:24.040261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:24.042622 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1642/3272] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:23 2022] DELETE /identity/v3/projects/99992536b70f41aa9dbdbf358cd6b2bb => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:24.050384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:24.054575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:24.104502 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1631/3273] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:01:24.222398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c0c5d-6ef6-463e-90a6-b8168f909456 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:24.232249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8101ce-4399-4bf0-99ec-1c323c26f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:24.233583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8101ce-4399-4bf0-99ec-1c323c26f16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:24.233832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8101ce-4399-4bf0-99ec-1c323c26f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:24.234394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8101ce-4399-4bf0-99ec-1c323c26f16c admin admin] PATH_INFO: `/v3/users/51c756406a9742b49cde4945e9553236` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:24.235714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8101ce-4399-4bf0-99ec-1c323c26f16c admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c756406a9742b49cde4945e9553236)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:24.238992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8101ce-4399-4bf0-99ec-1c323c26f16c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:24.314401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c8101ce-4399-4bf0-99ec-1c323c26f16c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c756406a9742b49cde4945e9553236'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:24.322770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c8101ce-4399-4bf0-99ec-1c323c26f16c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c756406a9742b49cde4945e9553236'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:24.323659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c8101ce-4399-4bf0-99ec-1c323c26f16c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c756406a9742b49cde4945e9553236'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:24.337353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c8101ce-4399-4bf0-99ec-1c323c26f16c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c756406a9742b49cde4945e9553236'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:24.341453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c8101ce-4399-4bf0-99ec-1c323c26f16c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c756406a9742b49cde4945e9553236'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:24.343515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:24.373787 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1643/3274] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:01:24 2022] DELETE /identity/v3/users/51c756406a9742b49cde4945e9553236 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:24.823880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eec209-6272-4e68-b4ee-b963b6f71c2f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:24.861707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eec209-6272-4e68-b4ee-b963b6f71c2f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:24.895474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:24.971743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11452dd-4e56-41f7-926e-123e96ee3c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:24.972467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11452dd-4e56-41f7-926e-123e96ee3c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:24.973014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11452dd-4e56-41f7-926e-123e96ee3c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:24.973427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11452dd-4e56-41f7-926e-123e96ee3c59 admin admin] PATH_INFO: `/v3/projects/f07ae6bb187449309af5c09566b05b66` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:24.974817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11452dd-4e56-41f7-926e-123e96ee3c59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07ae6bb187449309af5c09566b05b66)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:24.976848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11452dd-4e56-41f7-926e-123e96ee3c59 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:25.056053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c11452dd-4e56-41f7-926e-123e96ee3c59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07ae6bb187449309af5c09566b05b66', 'request_id': 'req-c11452dd-4e56-41f7-926e-123e96ee3c59'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:25.071604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c11452dd-4e56-41f7-926e-123e96ee3c59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07ae6bb187449309af5c09566b05b66', 'request_id': 'req-c11452dd-4e56-41f7-926e-123e96ee3c59'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:25.089920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c11452dd-4e56-41f7-926e-123e96ee3c59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07ae6bb187449309af5c09566b05b66', 'request_id': 'req-c11452dd-4e56-41f7-926e-123e96ee3c59'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:25.113486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c11452dd-4e56-41f7-926e-123e96ee3c59 admin admin] The token cache is being invalidate because project f07ae6bb187449309af5c09566b05b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:25.114342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c11452dd-4e56-41f7-926e-123e96ee3c59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:25.115215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c11452dd-4e56-41f7-926e-123e96ee3c59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:25.117815 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1632/3275] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:24 2022] DELETE /identity/v3/projects/f07ae6bb187449309af5c09566b05b66 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:25.122079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981779-7632-47a9-ad69-56828c4a8da6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:25.123265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981779-7632-47a9-ad69-56828c4a8da6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:25.123481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981779-7632-47a9-ad69-56828c4a8da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:25.144337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e4981779-7632-47a9-ad69-56828c4a8da6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:25.145583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e4981779-7632-47a9-ad69-56828c4a8da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:25.226805 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1644/3276] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:25.237761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff017c-19eb-4499-baef-21eea89744be None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:25.238473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff017c-19eb-4499-baef-21eea89744be None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:25.238473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff017c-19eb-4499-baef-21eea89744be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:25.269074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-23ff017c-19eb-4499-baef-21eea89744be None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:25.270345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-23ff017c-19eb-4499-baef-21eea89744be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:25.282093 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1633/3277] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:01:25.284225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4981779-7632-47a9-ad69-56828c4a8da6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:25.295501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4981779-7632-47a9-ad69-56828c4a8da6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:25.301244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d51d29-02c7-419e-9453-062264f272fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:25.301956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d51d29-02c7-419e-9453-062264f272fc admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:25.302304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d51d29-02c7-419e-9453-062264f272fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:25.302671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d51d29-02c7-419e-9453-062264f272fc admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:25.303427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d51d29-02c7-419e-9453-062264f272fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:25.303798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d51d29-02c7-419e-9453-062264f272fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:25.305511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d51d29-02c7-419e-9453-062264f272fc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:25.320994 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1645/3278] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:25.326302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff017c-19eb-4499-baef-21eea89744be None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:25.338566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff017c-19eb-4499-baef-21eea89744be None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:25.347643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1dd58-8903-4fcd-97cc-3ed18ba27e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:25.348526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1dd58-8903-4fcd-97cc-3ed18ba27e92 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:25.348958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1dd58-8903-4fcd-97cc-3ed18ba27e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:25.349975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1dd58-8903-4fcd-97cc-3ed18ba27e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:25.350848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1dd58-8903-4fcd-97cc-3ed18ba27e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:25.353208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1dd58-8903-4fcd-97cc-3ed18ba27e92 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:25.418731 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1634/3279] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:01:25 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:25.420916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d51d29-02c7-419e-9453-062264f272fc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:25.437370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d51d29-02c7-419e-9453-062264f272fc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:25.527917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba696d2-fa00-413a-80e8-a1df7efbc1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:25.527917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba696d2-fa00-413a-80e8-a1df7efbc1eb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:25.528207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba696d2-fa00-413a-80e8-a1df7efbc1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:25.528533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba696d2-fa00-413a-80e8-a1df7efbc1eb admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:25.531034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba696d2-fa00-413a-80e8-a1df7efbc1eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:25.534509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba696d2-fa00-413a-80e8-a1df7efbc1eb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:25.569465 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1646/3280] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:01:25 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:25.571517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1dd58-8903-4fcd-97cc-3ed18ba27e92 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:25.586896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1dd58-8903-4fcd-97cc-3ed18ba27e92 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:25.599079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304966a-4cc8-4d39-8fa8-cb02fa7fbadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:25.599700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304966a-4cc8-4d39-8fa8-cb02fa7fbadc admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:25.599986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304966a-4cc8-4d39-8fa8-cb02fa7fbadc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:25.600267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304966a-4cc8-4d39-8fa8-cb02fa7fbadc admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:25.601080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304966a-4cc8-4d39-8fa8-cb02fa7fbadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:25.602709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304966a-4cc8-4d39-8fa8-cb02fa7fbadc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:25.616655 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1635/3281] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:25.620754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba696d2-fa00-413a-80e8-a1df7efbc1eb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:25.643430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba696d2-fa00-413a-80e8-a1df7efbc1eb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:25.652835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd76b4-b323-47ff-9916-ac994c972c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:25.653630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd76b4-b323-47ff-9916-ac994c972c7e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:25.653960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd76b4-b323-47ff-9916-ac994c972c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:25.654647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd76b4-b323-47ff-9916-ac994c972c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:25.657458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd76b4-b323-47ff-9916-ac994c972c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:25.659314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd76b4-b323-47ff-9916-ac994c972c7e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:25.673663 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1647/3282] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:01:25.678402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304966a-4cc8-4d39-8fa8-cb02fa7fbadc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:25.692141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304966a-4cc8-4d39-8fa8-cb02fa7fbadc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:25.697055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d54e9-5954-4753-84ee-b27a66986a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:25.697735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d54e9-5954-4753-84ee-b27a66986a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:25.698066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d54e9-5954-4753-84ee-b27a66986a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:25.698400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d54e9-5954-4753-84ee-b27a66986a8c admin admin] PATH_INFO: `/v3/projects/6aac4f0f62414384a38fdf86e99ad9a1/users/16adde7bae3b45ec978d488f3813888b/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:25.722312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d54e9-5954-4753-84ee-b27a66986a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aac4f0f62414384a38fdf86e99ad9a1, user_id=16adde7bae3b45ec978d488f3813888b, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:25.726205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d54e9-5954-4753-84ee-b27a66986a8c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:25.764242 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1636/3283] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:25 2022] PUT /identity/v3/projects/6aac4f0f62414384a38fdf86e99ad9a1/users/16adde7bae3b45ec978d488f3813888b/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:25.777375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec57a5-d6ef-4017-a6e6-8451145fd16a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:25.777952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec57a5-d6ef-4017-a6e6-8451145fd16a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:25.778453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec57a5-d6ef-4017-a6e6-8451145fd16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:25.820933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4fec57a5-d6ef-4017-a6e6-8451145fd16a None None] MFA Rules not processed for user `16adde7bae3b45ec978d488f3813888b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:25.822893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4fec57a5-d6ef-4017-a6e6-8451145fd16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:25.873906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:25.951002 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1648/3284] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:25.955554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d54e9-5954-4753-84ee-b27a66986a8c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:26.043380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:26.087662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d54e9-5954-4753-84ee-b27a66986a8c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:26.095207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cca229-9167-42c3-bc0e-56443df3f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:26.095991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cca229-9167-42c3-bc0e-56443df3f376 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:26.096347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cca229-9167-42c3-bc0e-56443df3f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:26.096691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cca229-9167-42c3-bc0e-56443df3f376 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:26.097402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cca229-9167-42c3-bc0e-56443df3f376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:26.100205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cca229-9167-42c3-bc0e-56443df3f376 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:26.160156 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1637/3285] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:01:25 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:26.160353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec57a5-d6ef-4017-a6e6-8451145fd16a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:26.178115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec57a5-d6ef-4017-a6e6-8451145fd16a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:26.306728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a02cd1-f62b-407a-8f19-f02cefc219af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:26.307468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a02cd1-f62b-407a-8f19-f02cefc219af admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:26.307757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a02cd1-f62b-407a-8f19-f02cefc219af admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:26.308030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a02cd1-f62b-407a-8f19-f02cefc219af admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:26.308682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a02cd1-f62b-407a-8f19-f02cefc219af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:26.311734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a02cd1-f62b-407a-8f19-f02cefc219af admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:26.340254 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1649/3286] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:01:26 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:01:26.344975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cca229-9167-42c3-bc0e-56443df3f376 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:26.359543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cca229-9167-42c3-bc0e-56443df3f376 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:26.369447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e852f0e-9d58-40e1-8949-67c06dbdb1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:26.371161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e852f0e-9d58-40e1-8949-67c06dbdb1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:26.375546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e852f0e-9d58-40e1-8949-67c06dbdb1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:26.376330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e852f0e-9d58-40e1-8949-67c06dbdb1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:26.377322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e852f0e-9d58-40e1-8949-67c06dbdb1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:26.380592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e852f0e-9d58-40e1-8949-67c06dbdb1a7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:26.431117 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1638/3287] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:26.432058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a02cd1-f62b-407a-8f19-f02cefc219af admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:26.448659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a02cd1-f62b-407a-8f19-f02cefc219af admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:26.483196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9e586-810c-4d51-ac03-731fef501c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:26.484870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9e586-810c-4d51-ac03-731fef501c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:26.487480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9e586-810c-4d51-ac03-731fef501c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:26.490180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9e586-810c-4d51-ac03-731fef501c31 admin admin] PATH_INFO: `/v3/projects/cc3b4d697ead402dbb4b7a66fe7d18e8/users/03c75fa5391445bcb94b24bafdc0828a/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:26.576781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9e586-810c-4d51-ac03-731fef501c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3b4d697ead402dbb4b7a66fe7d18e8, user_id=03c75fa5391445bcb94b24bafdc0828a, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:26.580259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9e586-810c-4d51-ac03-731fef501c31 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:26.622090 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1650/3288] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:26 2022] PUT /identity/v3/projects/cc3b4d697ead402dbb4b7a66fe7d18e8/users/03c75fa5391445bcb94b24bafdc0828a/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:01:26.626673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e852f0e-9d58-40e1-8949-67c06dbdb1a7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:26.647419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e852f0e-9d58-40e1-8949-67c06dbdb1a7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:26.787565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9c289-2a14-4f50-a83d-dd88f87b74da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:26.789728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9c289-2a14-4f50-a83d-dd88f87b74da admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:26.790665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9c289-2a14-4f50-a83d-dd88f87b74da admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:26.793024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9c289-2a14-4f50-a83d-dd88f87b74da admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:26.795589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9c289-2a14-4f50-a83d-dd88f87b74da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:26.800506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9c289-2a14-4f50-a83d-dd88f87b74da admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:26.818365 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1639/3289] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:26.822724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9e586-810c-4d51-ac03-731fef501c31 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:26.842360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9e586-810c-4d51-ac03-731fef501c31 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:26.869031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a05ca-e9e7-4e4a-8ca6-ddfa414c01a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:26.872231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a05ca-e9e7-4e4a-8ca6-ddfa414c01a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:26.872647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a05ca-e9e7-4e4a-8ca6-ddfa414c01a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:26.872933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a05ca-e9e7-4e4a-8ca6-ddfa414c01a3 admin admin] PATH_INFO: `/v3/projects/cc3b4d697ead402dbb4b7a66fe7d18e8/users/03c75fa5391445bcb94b24bafdc0828a/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:26.881475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a05ca-e9e7-4e4a-8ca6-ddfa414c01a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3b4d697ead402dbb4b7a66fe7d18e8, user_id=03c75fa5391445bcb94b24bafdc0828a, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:26.894240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a05ca-e9e7-4e4a-8ca6-ddfa414c01a3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:26.951935 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1651/3290] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:26 2022] PUT /identity/v3/projects/cc3b4d697ead402dbb4b7a66fe7d18e8/users/03c75fa5391445bcb94b24bafdc0828a/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:26.962978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ae167-ebb8-499f-833e-3c639d0ea8ed None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:26.963519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ae167-ebb8-499f-833e-3c639d0ea8ed None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:26.963707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ae167-ebb8-499f-833e-3c639d0ea8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:27.095658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e85ae167-ebb8-499f-833e-3c639d0ea8ed None None] MFA Rules not processed for user `03c75fa5391445bcb94b24bafdc0828a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:27.097614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e85ae167-ebb8-499f-833e-3c639d0ea8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:27.260905 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1640/3291] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:27.270141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a05ca-e9e7-4e4a-8ca6-ddfa414c01a3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:27.303042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a05ca-e9e7-4e4a-8ca6-ddfa414c01a3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:27.313717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d13e2-0ed6-4677-ab63-0aeefcfb2fda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:27.314666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d13e2-0ed6-4677-ab63-0aeefcfb2fda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:27.315152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d13e2-0ed6-4677-ab63-0aeefcfb2fda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:27.315574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d13e2-0ed6-4677-ab63-0aeefcfb2fda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:27.316378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d13e2-0ed6-4677-ab63-0aeefcfb2fda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:27.316834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d13e2-0ed6-4677-ab63-0aeefcfb2fda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:27.318633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d13e2-0ed6-4677-ab63-0aeefcfb2fda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:27.385388 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1652/3292] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:27.386532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ae167-ebb8-499f-833e-3c639d0ea8ed None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:27.418430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ae167-ebb8-499f-833e-3c639d0ea8ed None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:27.433235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cd66f-cb4a-484c-8c25-708e8230effa tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:27.436010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cd66f-cb4a-484c-8c25-708e8230effa tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:27.436557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cd66f-cb4a-484c-8c25-708e8230effa tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:27.437264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cd66f-cb4a-484c-8c25-708e8230effa tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:27.438418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cd66f-cb4a-484c-8c25-708e8230effa tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:27.440921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cd66f-cb4a-484c-8c25-708e8230effa tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:27.525179 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1641/3293] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:01:27 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:27.531216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d13e2-0ed6-4677-ab63-0aeefcfb2fda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:27.555102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d13e2-0ed6-4677-ab63-0aeefcfb2fda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:27.672281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e650c13-7ee2-4463-9199-262eeedbc9c6 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:27.672926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e650c13-7ee2-4463-9199-262eeedbc9c6 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:27.673191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e650c13-7ee2-4463-9199-262eeedbc9c6 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:27.673737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e650c13-7ee2-4463-9199-262eeedbc9c6 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:27.674478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e650c13-7ee2-4463-9199-262eeedbc9c6 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:27.674907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e650c13-7ee2-4463-9199-262eeedbc9c6 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:27.676493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e650c13-7ee2-4463-9199-262eeedbc9c6 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:27.696087 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1653/3294] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:28.403566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cd66f-cb4a-484c-8c25-708e8230effa tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:28.407905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-291cd66f-cb4a-484c-8c25-708e8230effa tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:28.450192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:28.674274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cd66f-cb4a-484c-8c25-708e8230effa tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:28.700895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ae619-5787-4bd6-b3c4-cb91076af625 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:28.701534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ae619-5787-4bd6-b3c4-cb91076af625 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:28.702008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ae619-5787-4bd6-b3c4-cb91076af625 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:28.702519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ae619-5787-4bd6-b3c4-cb91076af625 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:28.707808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-831ae619-5787-4bd6-b3c4-cb91076af625 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:28.793950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e650c13-7ee2-4463-9199-262eeedbc9c6 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:28.799903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6e650c13-7ee2-4463-9199-262eeedbc9c6 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:28.837572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e650c13-7ee2-4463-9199-262eeedbc9c6 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:28.847853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b55c8-c5bb-4b03-ae38-f18c91682d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:28.849567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b55c8-c5bb-4b03-ae38-f18c91682d39 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:28.849851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b55c8-c5bb-4b03-ae38-f18c91682d39 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:28.850127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b55c8-c5bb-4b03-ae38-f18c91682d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:28.860440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:28.884266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b55c8-c5bb-4b03-ae38-f18c91682d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:28.887552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b55c8-c5bb-4b03-ae38-f18c91682d39 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:28.891106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ae619-5787-4bd6-b3c4-cb91076af625 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:28.893202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ae619-5787-4bd6-b3c4-cb91076af625 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:28.907974 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1642/3295] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:28.909914 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1654/3296] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:01:28.926582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ba90b-cb1b-4dfd-9a01-207341a0ade3 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:28.927125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ba90b-cb1b-4dfd-9a01-207341a0ade3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:28.927412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ba90b-cb1b-4dfd-9a01-207341a0ade3 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:28.929759 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1643/3297] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:01:28.936976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b55c8-c5bb-4b03-ae38-f18c91682d39 service nova] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:01:28.952983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b55c8-c5bb-4b03-ae38-f18c91682d39 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:28.970828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b55c8-c5bb-4b03-ae38-f18c91682d39 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:28.987685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97587fa7-7fd0-4660-9da4-af963f295866 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:28.988363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97587fa7-7fd0-4660-9da4-af963f295866 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:28.988851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97587fa7-7fd0-4660-9da4-af963f295866 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:28.989326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97587fa7-7fd0-4660-9da4-af963f295866 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects/c240bce13e994c2fa502eb73aa3f1a9f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:28.993493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97587fa7-7fd0-4660-9da4-af963f295866 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:get_project(project_id=c240bce13e994c2fa502eb73aa3f1a9f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:29.001872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97587fa7-7fd0-4660-9da4-af963f295866 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:29.007141 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1655/3298] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:01:28 2022] GET /identity/v3/projects/c240bce13e994c2fa502eb73aa3f1a9f => generated 369 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:29.745268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ac66-045a-484e-a21a-4512bdd7face None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:29.746144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ac66-045a-484e-a21a-4512bdd7face None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:29.746620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ac66-045a-484e-a21a-4512bdd7face None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:29.748975 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1644/3299] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:01:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:01:29.754604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97587fa7-7fd0-4660-9da4-af963f295866 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:01:29.777456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97587fa7-7fd0-4660-9da4-af963f295866 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:29.792103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97587fa7-7fd0-4660-9da4-af963f295866 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:29.800595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a2e7d-b14d-4ae1-8c9f-b9935645d961 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:29.801958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a2e7d-b14d-4ae1-8c9f-b9935645d961 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:29.802421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a2e7d-b14d-4ae1-8c9f-b9935645d961 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:29.802890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a2e7d-b14d-4ae1-8c9f-b9935645d961 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects/c240bce13e994c2fa502eb73aa3f1a9f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:29.804280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a2e7d-b14d-4ae1-8c9f-b9935645d961 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:get_project(project_id=c240bce13e994c2fa502eb73aa3f1a9f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:29.806938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a2e7d-b14d-4ae1-8c9f-b9935645d961 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:29.810261 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1656/3300] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:01:29 2022] GET /identity/v3/projects/c240bce13e994c2fa502eb73aa3f1a9f => generated 369 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:30.835001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6ac66-045a-484e-a21a-4512bdd7face None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:30.837677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-01d6ac66-045a-484e-a21a-4512bdd7face None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:31.001853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47198b1-dcc6-4373-af1a-7dbc8716f514 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:31.002403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47198b1-dcc6-4373-af1a-7dbc8716f514 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:31.002403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47198b1-dcc6-4373-af1a-7dbc8716f514 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:31.004289 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1657/3301] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:01:31.012632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47198b1-dcc6-4373-af1a-7dbc8716f514 None None] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:01:31.034042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6ac66-045a-484e-a21a-4512bdd7face None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:31.045670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c11e9-c59e-4cf2-a976-8340b7ee1acb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:31.046617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c11e9-c59e-4cf2-a976-8340b7ee1acb service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:31.047326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c11e9-c59e-4cf2-a976-8340b7ee1acb service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:31.047791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c11e9-c59e-4cf2-a976-8340b7ee1acb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:31.050441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5b7c11e9-c59e-4cf2-a976-8340b7ee1acb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:31.085737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47198b1-dcc6-4373-af1a-7dbc8716f514 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:31.100619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c11e9-c59e-4cf2-a976-8340b7ee1acb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:31.102692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c11e9-c59e-4cf2-a976-8340b7ee1acb service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:31.118836 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1645/3302] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:31.155074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47198b1-dcc6-4373-af1a-7dbc8716f514 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:31.170655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5e76b-80fa-4811-8d22-f2d195968ae7 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:31.171524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e76b-80fa-4811-8d22-f2d195968ae7 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:31.171817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e76b-80fa-4811-8d22-f2d195968ae7 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:31.172097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5e76b-80fa-4811-8d22-f2d195968ae7 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects/c240bce13e994c2fa502eb73aa3f1a9f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:31.175631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5e76b-80fa-4811-8d22-f2d195968ae7 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:get_project(project_id=c240bce13e994c2fa502eb73aa3f1a9f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:31.179261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5e76b-80fa-4811-8d22-f2d195968ae7 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:31.181800 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1658/3303] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:01:31 2022] GET /identity/v3/projects/c240bce13e994c2fa502eb73aa3f1a9f => generated 369 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:01:31.234010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c11e9-c59e-4cf2-a976-8340b7ee1acb service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:31.251262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c11e9-c59e-4cf2-a976-8340b7ee1acb service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:31.260688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:31.262519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:31.263651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:31.264559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects/c240bce13e994c2fa502eb73aa3f1a9f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:31.265774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c240bce13e994c2fa502eb73aa3f1a9f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:31.268524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:31.339341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:31.367568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c240bce13e994c2fa502eb73aa3f1a9f', 'request_id': 'req-24850db3-41ab-45b5-a3bb-bac22df24dc5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:31.386143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c240bce13e994c2fa502eb73aa3f1a9f', 'request_id': 'req-24850db3-41ab-45b5-a3bb-bac22df24dc5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:31.403711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c240bce13e994c2fa502eb73aa3f1a9f', 'request_id': 'req-24850db3-41ab-45b5-a3bb-bac22df24dc5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:31.437171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] The token cache is being invalidate because project c240bce13e994c2fa502eb73aa3f1a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:31.437467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:31.439141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:31.449115 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1646/3304] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:31 2022] DELETE /identity/v3/projects/c240bce13e994c2fa502eb73aa3f1a9f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:31.469660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a332016-3db5-48bf-b8c5-9bff9b8b5024 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:31.469968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a332016-3db5-48bf-b8c5-9bff9b8b5024 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:31.470279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a332016-3db5-48bf-b8c5-9bff9b8b5024 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:31.471818 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1659/3305] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:01:31.478382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:01:31.480689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:31.700963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:31.702580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:31.845791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24850db3-41ab-45b5-a3bb-bac22df24dc5 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:31.853909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b804e1-10f1-4a8f-9b21-e0e2acc3d598 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:31.854583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b804e1-10f1-4a8f-9b21-e0e2acc3d598 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:31.854906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b804e1-10f1-4a8f-9b21-e0e2acc3d598 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:31.855191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b804e1-10f1-4a8f-9b21-e0e2acc3d598 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects/6aac4f0f62414384a38fdf86e99ad9a1` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:31.856390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b804e1-10f1-4a8f-9b21-e0e2acc3d598 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:get_project(project_id=6aac4f0f62414384a38fdf86e99ad9a1)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:31.862299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b804e1-10f1-4a8f-9b21-e0e2acc3d598 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:31.864426 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1647/3306] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:01:31 2022] GET /identity/v3/projects/6aac4f0f62414384a38fdf86e99ad9a1 => generated 373 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:31.885730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a332016-3db5-48bf-b8c5-9bff9b8b5024 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:31.910137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a332016-3db5-48bf-b8c5-9bff9b8b5024 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:31.944528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa143d-e0c2-488e-a90c-86153c0818b3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:31.945941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa143d-e0c2-488e-a90c-86153c0818b3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:31.959491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa143d-e0c2-488e-a90c-86153c0818b3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:31.960736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa143d-e0c2-488e-a90c-86153c0818b3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:31.962374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa143d-e0c2-488e-a90c-86153c0818b3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:31.963505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa143d-e0c2-488e-a90c-86153c0818b3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:31.967476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa143d-e0c2-488e-a90c-86153c0818b3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:31.994926 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1660/3307] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:01:31.999434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b804e1-10f1-4a8f-9b21-e0e2acc3d598 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:32.016354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b804e1-10f1-4a8f-9b21-e0e2acc3d598 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:32.022794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292ef8a-c565-4559-85fc-ee11682c7298 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:32.023593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292ef8a-c565-4559-85fc-ee11682c7298 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:32.024026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292ef8a-c565-4559-85fc-ee11682c7298 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:32.024454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292ef8a-c565-4559-85fc-ee11682c7298 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:32.025257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292ef8a-c565-4559-85fc-ee11682c7298 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:32.027421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292ef8a-c565-4559-85fc-ee11682c7298 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:32.113201 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1648/3308] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:01:31 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:32.117835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa143d-e0c2-488e-a90c-86153c0818b3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:32.143729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa143d-e0c2-488e-a90c-86153c0818b3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:32.237801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb062-103a-4777-b47f-4be236a781d1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:32.240016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb062-103a-4777-b47f-4be236a781d1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:32.240524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb062-103a-4777-b47f-4be236a781d1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:32.241305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb062-103a-4777-b47f-4be236a781d1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:32.242201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fb062-103a-4777-b47f-4be236a781d1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:32.242766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fb062-103a-4777-b47f-4be236a781d1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:32.245645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fb062-103a-4777-b47f-4be236a781d1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:32.269669 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1661/3309] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:32.321449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967c15-f5c0-4c27-af47-73a146bd51d4 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:32.321734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967c15-f5c0-4c27-af47-73a146bd51d4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:32.322017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967c15-f5c0-4c27-af47-73a146bd51d4 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:32.323944 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1649/3310] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:01:32.336381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb062-103a-4777-b47f-4be236a781d1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:01:32.338865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f17fb062-103a-4777-b47f-4be236a781d1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:32.455105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb062-103a-4777-b47f-4be236a781d1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:32.465345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb062-103a-4777-b47f-4be236a781d1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:32.473775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe1c4c-63c1-4e8c-8e9f-8bbc7c8f2404 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:32.474610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1c4c-63c1-4e8c-8e9f-8bbc7c8f2404 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:32.475033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1c4c-63c1-4e8c-8e9f-8bbc7c8f2404 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:32.475421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1c4c-63c1-4e8c-8e9f-8bbc7c8f2404 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects/413dde3664954c269ae17e61b0a3bc21` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:32.477858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe1c4c-63c1-4e8c-8e9f-8bbc7c8f2404 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:get_project(project_id=413dde3664954c269ae17e61b0a3bc21)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:32.481101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe1c4c-63c1-4e8c-8e9f-8bbc7c8f2404 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:32.504564 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1662/3311] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:01:32 2022] GET /identity/v3/projects/413dde3664954c269ae17e61b0a3bc21 => generated 371 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:32.853405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be394fdd-64fd-4220-994c-b84124dacc8b None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:32.854211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be394fdd-64fd-4220-994c-b84124dacc8b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:32.854663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be394fdd-64fd-4220-994c-b84124dacc8b None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:32.856606 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1650/3312] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:01:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:01:32.871509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe1c4c-63c1-4e8c-8e9f-8bbc7c8f2404 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:01:32.897548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe1c4c-63c1-4e8c-8e9f-8bbc7c8f2404 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:32.940502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe1c4c-63c1-4e8c-8e9f-8bbc7c8f2404 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:32.956578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39d40d-3e8a-4a73-a7fc-8d6270c0daba tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:32.959184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39d40d-3e8a-4a73-a7fc-8d6270c0daba tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:32.959911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39d40d-3e8a-4a73-a7fc-8d6270c0daba tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:32.960414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39d40d-3e8a-4a73-a7fc-8d6270c0daba tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects/413dde3664954c269ae17e61b0a3bc21` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:32.962232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39d40d-3e8a-4a73-a7fc-8d6270c0daba tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:get_project(project_id=413dde3664954c269ae17e61b0a3bc21)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:32.971838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39d40d-3e8a-4a73-a7fc-8d6270c0daba tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:32.990598 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1663/3313] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:01:32 2022] GET /identity/v3/projects/413dde3664954c269ae17e61b0a3bc21 => generated 371 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:33.101558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be394fdd-64fd-4220-994c-b84124dacc8b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:33.136400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be394fdd-64fd-4220-994c-b84124dacc8b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:33.161183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77289e6b-a4ea-47d2-ab49-dabeef22e949 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:33.164403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77289e6b-a4ea-47d2-ab49-dabeef22e949 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:33.165257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77289e6b-a4ea-47d2-ab49-dabeef22e949 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:33.166925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77289e6b-a4ea-47d2-ab49-dabeef22e949 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:33.170163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77289e6b-a4ea-47d2-ab49-dabeef22e949 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:33.171111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77289e6b-a4ea-47d2-ab49-dabeef22e949 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:33.181146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77289e6b-a4ea-47d2-ab49-dabeef22e949 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:33.241517 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1651/3314] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:33.244202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39d40d-3e8a-4a73-a7fc-8d6270c0daba tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:33.278192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39d40d-3e8a-4a73-a7fc-8d6270c0daba tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:33.310508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac284be-8b0b-49be-a9bb-b4c95d056b11 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:33.314039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac284be-8b0b-49be-a9bb-b4c95d056b11 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:33.314586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac284be-8b0b-49be-a9bb-b4c95d056b11 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:33.315561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac284be-8b0b-49be-a9bb-b4c95d056b11 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:33.318110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac284be-8b0b-49be-a9bb-b4c95d056b11 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:33.323955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac284be-8b0b-49be-a9bb-b4c95d056b11 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:33.387981 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1664/3315] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:01:33 2022] POST /identity/v3/users => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:33.390043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77289e6b-a4ea-47d2-ab49-dabeef22e949 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:33.427265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77289e6b-a4ea-47d2-ab49-dabeef22e949 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:33.443742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434d7ee-885f-4036-b871-b2e89f352d26 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:33.444574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434d7ee-885f-4036-b871-b2e89f352d26 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:33.445366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434d7ee-885f-4036-b871-b2e89f352d26 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:33.445866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434d7ee-885f-4036-b871-b2e89f352d26 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:33.447282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434d7ee-885f-4036-b871-b2e89f352d26 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:33.447841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434d7ee-885f-4036-b871-b2e89f352d26 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:33.454907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434d7ee-885f-4036-b871-b2e89f352d26 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:33.484657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:33.495041 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1652/3316] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:34.143591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be69dd-5811-48c8-9030-617f7876ab99 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:34.144990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be69dd-5811-48c8-9030-617f7876ab99 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:34.146436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be69dd-5811-48c8-9030-617f7876ab99 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:34.149331 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1665/3317] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:01:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:01:34.158644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434d7ee-885f-4036-b871-b2e89f352d26 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:01:34.177975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434d7ee-885f-4036-b871-b2e89f352d26 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:34.203814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434d7ee-885f-4036-b871-b2e89f352d26 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:34.215196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf5c10-de1f-483e-a7e8-c30c3ed3f3d0 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:34.217370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf5c10-de1f-483e-a7e8-c30c3ed3f3d0 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:34.219008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf5c10-de1f-483e-a7e8-c30c3ed3f3d0 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:34.219188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf5c10-de1f-483e-a7e8-c30c3ed3f3d0 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects/413dde3664954c269ae17e61b0a3bc21` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:34.224666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf5c10-de1f-483e-a7e8-c30c3ed3f3d0 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:get_project(project_id=413dde3664954c269ae17e61b0a3bc21)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:34.227419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf5c10-de1f-483e-a7e8-c30c3ed3f3d0 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:34.229660 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1653/3318] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:01:34 2022] GET /identity/v3/projects/413dde3664954c269ae17e61b0a3bc21 => generated 371 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:34.795982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cc26a-7cea-43da-bad1-8e0a52078435 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:34.796509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cc26a-7cea-43da-bad1-8e0a52078435 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:34.796509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cc26a-7cea-43da-bad1-8e0a52078435 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:34.797909 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1666/3319] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:01:34.817631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf5c10-de1f-483e-a7e8-c30c3ed3f3d0 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:01:34.840069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf5c10-de1f-483e-a7e8-c30c3ed3f3d0 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:34.866508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf5c10-de1f-483e-a7e8-c30c3ed3f3d0 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:34.890698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088bc17-c1ea-4f4a-a67a-38ac6b1232a3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:34.893732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088bc17-c1ea-4f4a-a67a-38ac6b1232a3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:34.896414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088bc17-c1ea-4f4a-a67a-38ac6b1232a3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:34.896935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088bc17-c1ea-4f4a-a67a-38ac6b1232a3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects/413dde3664954c269ae17e61b0a3bc21` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:34.900647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088bc17-c1ea-4f4a-a67a-38ac6b1232a3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:get_project(project_id=413dde3664954c269ae17e61b0a3bc21)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:34.908816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088bc17-c1ea-4f4a-a67a-38ac6b1232a3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:34.946341 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1654/3320] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:01:34 2022] GET /identity/v3/projects/413dde3664954c269ae17e61b0a3bc21 => generated 371 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:35.002681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cc26a-7cea-43da-bad1-8e0a52078435 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:35.032106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cc26a-7cea-43da-bad1-8e0a52078435 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:35.046952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4cf07-57c8-42ba-ae7a-23e93f81cfda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:35.048409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4cf07-57c8-42ba-ae7a-23e93f81cfda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:35.049117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4cf07-57c8-42ba-ae7a-23e93f81cfda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:35.049802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4cf07-57c8-42ba-ae7a-23e93f81cfda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/users/ea881a68c09543d984115a312d8c4078` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:35.099287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:35.109221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4cf07-57c8-42ba-ae7a-23e93f81cfda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ea881a68c09543d984115a312d8c4078)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:35.111305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4cf07-57c8-42ba-ae7a-23e93f81cfda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:35.210547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-87e4cf07-57c8-42ba-ae7a-23e93f81cfda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea881a68c09543d984115a312d8c4078'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:35.241932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-87e4cf07-57c8-42ba-ae7a-23e93f81cfda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea881a68c09543d984115a312d8c4078'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:35.274135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-87e4cf07-57c8-42ba-ae7a-23e93f81cfda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea881a68c09543d984115a312d8c4078'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:35.312995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-87e4cf07-57c8-42ba-ae7a-23e93f81cfda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea881a68c09543d984115a312d8c4078'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:35.314257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-87e4cf07-57c8-42ba-ae7a-23e93f81cfda tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea881a68c09543d984115a312d8c4078'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:35.378115 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1667/3321] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:01:35 2022] DELETE /identity/v3/users/ea881a68c09543d984115a312d8c4078 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:35.383017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088bc17-c1ea-4f4a-a67a-38ac6b1232a3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:35.388336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9088bc17-c1ea-4f4a-a67a-38ac6b1232a3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:35.418160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088bc17-c1ea-4f4a-a67a-38ac6b1232a3 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:35.555103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:35.555755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:35.556246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:35.556514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects/413dde3664954c269ae17e61b0a3bc21` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:35.559766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:delete_project(project_id=413dde3664954c269ae17e61b0a3bc21)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:35.561798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:35.664865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413dde3664954c269ae17e61b0a3bc21', 'request_id': 'req-6c28fc58-121e-4014-b781-0767bbeb35ab'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:35.684139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413dde3664954c269ae17e61b0a3bc21', 'request_id': 'req-6c28fc58-121e-4014-b781-0767bbeb35ab'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:35.693311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413dde3664954c269ae17e61b0a3bc21', 'request_id': 'req-6c28fc58-121e-4014-b781-0767bbeb35ab'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:35.740052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] The token cache is being invalidate because project 413dde3664954c269ae17e61b0a3bc21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:35.740349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:35.741080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:35.742850 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1655/3322] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:35 2022] DELETE /identity/v3/projects/413dde3664954c269ae17e61b0a3bc21 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:35.957424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c884f53-12d3-478d-b79a-aa7bb5c291e0 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:35.958027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c884f53-12d3-478d-b79a-aa7bb5c291e0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:35.958469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c884f53-12d3-478d-b79a-aa7bb5c291e0 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:35.960064 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1668/3323] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:01:35.968300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:01:35.969784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:36.008345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f9825-646c-4505-906f-254b0252437f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:36.008811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f9825-646c-4505-906f-254b0252437f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:36.009594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f9825-646c-4505-906f-254b0252437f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:36.077987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a26f9825-646c-4505-906f-254b0252437f None None] MFA Rules not processed for user `8dbb8a95851248bfabd9a1afe40fc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:36.079328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a26f9825-646c-4505-906f-254b0252437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:36.173781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:36.177074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:36.182963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:36.304073 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1669/3324] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:36.334690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28fc58-121e-4014-b781-0767bbeb35ab tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:36.348796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66f7ee-f548-4ffe-be41-854038172b99 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:36.349481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66f7ee-f548-4ffe-be41-854038172b99 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:36.349765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66f7ee-f548-4ffe-be41-854038172b99 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:36.350339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66f7ee-f548-4ffe-be41-854038172b99 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects/6aac4f0f62414384a38fdf86e99ad9a1` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:36.352833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66f7ee-f548-4ffe-be41-854038172b99 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:get_project(project_id=6aac4f0f62414384a38fdf86e99ad9a1)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:36.355618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66f7ee-f548-4ffe-be41-854038172b99 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:36.358702 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1656/3325] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:01:35 2022] GET /identity/v3/projects/6aac4f0f62414384a38fdf86e99ad9a1 => generated 373 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:36.540595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0b08d-a56b-408c-a8cd-e8a4eb5e6ebe None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:36.540957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0b08d-a56b-408c-a8cd-e8a4eb5e6ebe None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:36.541170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0b08d-a56b-408c-a8cd-e8a4eb5e6ebe None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:36.542727 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1670/3326] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:01:36.549540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66f7ee-f548-4ffe-be41-854038172b99 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:01:36.551536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7a66f7ee-f548-4ffe-be41-854038172b99 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:36.587040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66f7ee-f548-4ffe-be41-854038172b99 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:36.598003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66f7ee-f548-4ffe-be41-854038172b99 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:36.604734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58501dc-1a1f-47e7-83de-cf50c1c365e1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:36.605833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58501dc-1a1f-47e7-83de-cf50c1c365e1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:36.605833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58501dc-1a1f-47e7-83de-cf50c1c365e1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:36.606198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58501dc-1a1f-47e7-83de-cf50c1c365e1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects/6aac4f0f62414384a38fdf86e99ad9a1` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:36.607373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58501dc-1a1f-47e7-83de-cf50c1c365e1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:get_project(project_id=6aac4f0f62414384a38fdf86e99ad9a1)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:36.610132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58501dc-1a1f-47e7-83de-cf50c1c365e1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:36.612873 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1657/3327] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:01:36 2022] GET /identity/v3/projects/6aac4f0f62414384a38fdf86e99ad9a1 => generated 373 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:38.345689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1905d89-e743-449a-ac38-9afbe47e5dd4 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:38.346234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1905d89-e743-449a-ac38-9afbe47e5dd4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:38.346234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1905d89-e743-449a-ac38-9afbe47e5dd4 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:38.347948 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1671/3328] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:01:38.377774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58501dc-1a1f-47e7-83de-cf50c1c365e1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:01:38.411984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58501dc-1a1f-47e7-83de-cf50c1c365e1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:38.443833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58501dc-1a1f-47e7-83de-cf50c1c365e1 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:38.455715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418d90d-6b9d-4735-833b-f7db17090869 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03c75fa5391445bcb94b24bafdc0828a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:38.457359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418d90d-6b9d-4735-833b-f7db17090869 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:38.471570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418d90d-6b9d-4735-833b-f7db17090869 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:38.473375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418d90d-6b9d-4735-833b-f7db17090869 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] PATH_INFO: `/v3/projects/6aac4f0f62414384a38fdf86e99ad9a1` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:38.478802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418d90d-6b9d-4735-833b-f7db17090869 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorizing `identity:get_project(project_id=6aac4f0f62414384a38fdf86e99ad9a1)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:38.500563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418d90d-6b9d-4735-833b-f7db17090869 tempest-QuotasAdminTestJSON-1591622006 tempest-QuotasAdminTestJSON-1591622006-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:38.521319 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1658/3329] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:01:38 2022] GET /identity/v3/projects/6aac4f0f62414384a38fdf86e99ad9a1 => generated 373 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:39.522673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1905d89-e743-449a-ac38-9afbe47e5dd4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:39.524692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f1905d89-e743-449a-ac38-9afbe47e5dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:39.679132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1905d89-e743-449a-ac38-9afbe47e5dd4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:39.686685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:39.687658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:39.688299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:39.688739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] PATH_INFO: `/v3/users/16adde7bae3b45ec978d488f3813888b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:39.690971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16adde7bae3b45ec978d488f3813888b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:39.693977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:39.737051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:39.829859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16adde7bae3b45ec978d488f3813888b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:39.852055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16adde7bae3b45ec978d488f3813888b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:39.852973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16adde7bae3b45ec978d488f3813888b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:39.866975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16adde7bae3b45ec978d488f3813888b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:39.868089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16adde7bae3b45ec978d488f3813888b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:39.913792 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1672/3330] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:01:39 2022] DELETE /identity/v3/users/16adde7bae3b45ec978d488f3813888b => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:39.917987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2d2d5-6cd7-4ebe-a9a6-f808a0fcef87 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:39.918486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2d2d5-6cd7-4ebe-a9a6-f808a0fcef87 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:39.918569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2d2d5-6cd7-4ebe-a9a6-f808a0fcef87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:39.957558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d6a2d2d5-6cd7-4ebe-a9a6-f808a0fcef87 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:39.958949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d6a2d2d5-6cd7-4ebe-a9a6-f808a0fcef87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:40.047364 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1659/3331] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:40.072157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:40.076414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:40.301973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d018d5-385c-406b-b766-0e04410f95e3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:40.324063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c4e12-eb0f-43da-b581-59ea6d90c4c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:40.326057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c4e12-eb0f-43da-b581-59ea6d90c4c8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:40.328896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c4e12-eb0f-43da-b581-59ea6d90c4c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:40.329412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c4e12-eb0f-43da-b581-59ea6d90c4c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:40.361755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c4e12-eb0f-43da-b581-59ea6d90c4c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:40.363259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c4e12-eb0f-43da-b581-59ea6d90c4c8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:40.382959 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1673/3332] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:01:41.514147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2d2d5-6cd7-4ebe-a9a6-f808a0fcef87 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:41.517798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d6a2d2d5-6cd7-4ebe-a9a6-f808a0fcef87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:41.549974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2d2d5-6cd7-4ebe-a9a6-f808a0fcef87 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:41.556396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:41.557417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:41.571725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:41.572142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] PATH_INFO: `/v3/projects/6aac4f0f62414384a38fdf86e99ad9a1` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:41.573752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aac4f0f62414384a38fdf86e99ad9a1)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:41.589435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:41.676932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aac4f0f62414384a38fdf86e99ad9a1', 'request_id': 'req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:41.699122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aac4f0f62414384a38fdf86e99ad9a1', 'request_id': 'req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:41.709346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aac4f0f62414384a38fdf86e99ad9a1', 'request_id': 'req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:41.734393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] The token cache is being invalidate because project 6aac4f0f62414384a38fdf86e99ad9a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:41.735012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:41.749155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:41.754610 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1660/3333] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:41 2022] DELETE /identity/v3/projects/6aac4f0f62414384a38fdf86e99ad9a1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:41.759274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c4e12-eb0f-43da-b581-59ea6d90c4c8 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:41.777882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c4e12-eb0f-43da-b581-59ea6d90c4c8 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:41.874627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:41.875361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:41.875802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:41.876434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] PATH_INFO: `/v3/users/03c75fa5391445bcb94b24bafdc0828a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:41.881172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c75fa5391445bcb94b24bafdc0828a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:41.883082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:41.964299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:41.968555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c75fa5391445bcb94b24bafdc0828a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:41.988769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c75fa5391445bcb94b24bafdc0828a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:41.990858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c75fa5391445bcb94b24bafdc0828a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:42.006490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c75fa5391445bcb94b24bafdc0828a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:42.007516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c75fa5391445bcb94b24bafdc0828a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:42.050175 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1674/3334] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:01:41 2022] DELETE /identity/v3/users/03c75fa5391445bcb94b24bafdc0828a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:42.490450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:42.492552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:42.519742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2193f-8f4b-4d3a-a74d-a7229a3e3178 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:42.565435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:42.665231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874e060-48c8-4c65-a7de-039596533091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:42.666349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874e060-48c8-4c65-a7de-039596533091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:42.666640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874e060-48c8-4c65-a7de-039596533091 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:42.666944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874e060-48c8-4c65-a7de-039596533091 admin admin] PATH_INFO: `/v3/projects/cc3b4d697ead402dbb4b7a66fe7d18e8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:42.668486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874e060-48c8-4c65-a7de-039596533091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3b4d697ead402dbb4b7a66fe7d18e8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:42.672207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874e060-48c8-4c65-a7de-039596533091 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:42.743375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e874e060-48c8-4c65-a7de-039596533091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'request_id': 'req-e874e060-48c8-4c65-a7de-039596533091'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:42.756315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e874e060-48c8-4c65-a7de-039596533091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'request_id': 'req-e874e060-48c8-4c65-a7de-039596533091'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:42.766537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e874e060-48c8-4c65-a7de-039596533091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3b4d697ead402dbb4b7a66fe7d18e8', 'request_id': 'req-e874e060-48c8-4c65-a7de-039596533091'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:42.822044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:42.826133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:42.858473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e874e060-48c8-4c65-a7de-039596533091 admin admin] The token cache is being invalidate because project cc3b4d697ead402dbb4b7a66fe7d18e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:42.864536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e874e060-48c8-4c65-a7de-039596533091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:42.867382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e874e060-48c8-4c65-a7de-039596533091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:42.881135 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1661/3335] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:42 2022] DELETE /identity/v3/projects/cc3b4d697ead402dbb4b7a66fe7d18e8 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:42.891815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07dd77-afdb-4f5e-9529-a563f005a624 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:42.892155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07dd77-afdb-4f5e-9529-a563f005a624 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:42.892444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07dd77-afdb-4f5e-9529-a563f005a624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:43.019529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7a07dd77-afdb-4f5e-9529-a563f005a624 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:43.023943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7a07dd77-afdb-4f5e-9529-a563f005a624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:43.097206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c5bad-4ec6-45c4-9809-2237f2181051 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:43.174164 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1662/3336] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:43.181337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c1c3c-658f-4f11-b254-e5c6d72402b0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:43.182246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c1c3c-658f-4f11-b254-e5c6d72402b0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:43.182659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c1c3c-658f-4f11-b254-e5c6d72402b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:43.212537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a33c0-df5c-466a-95a1-cde82de1f9e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:43.213177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a33c0-df5c-466a-95a1-cde82de1f9e2 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:43.213462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a33c0-df5c-466a-95a1-cde82de1f9e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:43.213737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a33c0-df5c-466a-95a1-cde82de1f9e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:43.221283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-304a33c0-df5c-466a-95a1-cde82de1f9e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:43.221735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6a4c1c3c-658f-4f11-b254-e5c6d72402b0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:43.223557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6a4c1c3c-658f-4f11-b254-e5c6d72402b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:43.240992 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1663/3337] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:43.244220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c1c3c-658f-4f11-b254-e5c6d72402b0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:43.287668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c1c3c-658f-4f11-b254-e5c6d72402b0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:43.311554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a33c0-df5c-466a-95a1-cde82de1f9e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:43.313280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e505a65-9331-4ee1-802a-a2c22567f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:43.313448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a33c0-df5c-466a-95a1-cde82de1f9e2 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:43.315846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e505a65-9331-4ee1-802a-a2c22567f856 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:43.317028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e505a65-9331-4ee1-802a-a2c22567f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:43.319827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e505a65-9331-4ee1-802a-a2c22567f856 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:43.321630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e505a65-9331-4ee1-802a-a2c22567f856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:43.321950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e505a65-9331-4ee1-802a-a2c22567f856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:43.323634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e505a65-9331-4ee1-802a-a2c22567f856 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:43.324299 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1675/3338] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:01:43.353815 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1664/3339] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:43.358572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a33c0-df5c-466a-95a1-cde82de1f9e2 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:43.383175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a33c0-df5c-466a-95a1-cde82de1f9e2 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:43.391601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515d697-801e-4915-9252-4c30860403d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:43.393544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515d697-801e-4915-9252-4c30860403d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:43.394045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515d697-801e-4915-9252-4c30860403d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:43.394535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515d697-801e-4915-9252-4c30860403d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:43.395337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515d697-801e-4915-9252-4c30860403d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:43.398249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515d697-801e-4915-9252-4c30860403d0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:43.438367 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1676/3340] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:01:43 2022] POST /identity/v3/projects => generated 395 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:43.443803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e505a65-9331-4ee1-802a-a2c22567f856 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:43.462017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e505a65-9331-4ee1-802a-a2c22567f856 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:43.507575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:43.574418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7d464-a935-4048-8c13-aec54e2ba7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:43.577497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7d464-a935-4048-8c13-aec54e2ba7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:43.577988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7d464-a935-4048-8c13-aec54e2ba7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:43.578429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7d464-a935-4048-8c13-aec54e2ba7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:43.579292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7d464-a935-4048-8c13-aec54e2ba7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:43.582268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7d464-a935-4048-8c13-aec54e2ba7f7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:43.628512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515d697-801e-4915-9252-4c30860403d0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:43.640643 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1665/3341] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:01:43 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:43.650554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515d697-801e-4915-9252-4c30860403d0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:43.660766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af993ceb-d4b7-4c40-91a8-43828441a250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:43.661303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af993ceb-d4b7-4c40-91a8-43828441a250 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:43.661878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af993ceb-d4b7-4c40-91a8-43828441a250 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:43.662435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af993ceb-d4b7-4c40-91a8-43828441a250 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:43.665129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af993ceb-d4b7-4c40-91a8-43828441a250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:43.667136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af993ceb-d4b7-4c40-91a8-43828441a250 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:43.672396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:43.694482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7d464-a935-4048-8c13-aec54e2ba7f7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:43.705805 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1677/3342] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:43.712861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7d464-a935-4048-8c13-aec54e2ba7f7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:43.725520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db3314-05d6-4bf8-9e67-8378f5752b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:43.726284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db3314-05d6-4bf8-9e67-8378f5752b3c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:43.727615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db3314-05d6-4bf8-9e67-8378f5752b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:43.728026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db3314-05d6-4bf8-9e67-8378f5752b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:43.729321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db3314-05d6-4bf8-9e67-8378f5752b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:43.733151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db3314-05d6-4bf8-9e67-8378f5752b3c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:43.756873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af993ceb-d4b7-4c40-91a8-43828441a250 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:43.768120 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1666/3343] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:43.775106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af993ceb-d4b7-4c40-91a8-43828441a250 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:43.791227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c187df8-58d1-429f-b22c-4739e5d42927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:43.792143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c187df8-58d1-429f-b22c-4739e5d42927 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:43.793192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c187df8-58d1-429f-b22c-4739e5d42927 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:43.795995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c187df8-58d1-429f-b22c-4739e5d42927 admin admin] PATH_INFO: `/v3/projects/869f98d4de46470ab21dbf9e95401c4a/users/0e76e957d64f48cba3d8ac6f78a10296/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:43.823944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c187df8-58d1-429f-b22c-4739e5d42927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869f98d4de46470ab21dbf9e95401c4a, user_id=0e76e957d64f48cba3d8ac6f78a10296, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:43.827409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c187df8-58d1-429f-b22c-4739e5d42927 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:43.866606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0eb88-42d1-4b9a-92c5-674dc60bee8d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:43.867067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0eb88-42d1-4b9a-92c5-674dc60bee8d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:43.867460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0eb88-42d1-4b9a-92c5-674dc60bee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:43.873121 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1678/3344] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:43 2022] PUT /identity/v3/projects/869f98d4de46470ab21dbf9e95401c4a/users/0e76e957d64f48cba3d8ac6f78a10296/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:43.908336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0ee0eb88-42d1-4b9a-92c5-674dc60bee8d None None] MFA Rules not processed for user `0e76e957d64f48cba3d8ac6f78a10296`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:43.909768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0ee0eb88-42d1-4b9a-92c5-674dc60bee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:44.004319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c187df8-58d1-429f-b22c-4739e5d42927 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:44.007197 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1667/3345] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:44.097368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c187df8-58d1-429f-b22c-4739e5d42927 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:44.103215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983c78b-74da-48c6-98c6-f6502199e88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:44.103991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c78b-74da-48c6-98c6-f6502199e88f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:44.104390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c78b-74da-48c6-98c6-f6502199e88f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:44.104778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983c78b-74da-48c6-98c6-f6502199e88f admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:44.105575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983c78b-74da-48c6-98c6-f6502199e88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:44.107752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983c78b-74da-48c6-98c6-f6502199e88f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:44.149036 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1679/3346] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:01:44 2022] POST /identity/v3/projects => generated 393 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:44.153363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0eb88-42d1-4b9a-92c5-674dc60bee8d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:44.167044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0eb88-42d1-4b9a-92c5-674dc60bee8d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:44.259185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892292e-4ee6-4276-938d-d9d505d2973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:44.259827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892292e-4ee6-4276-938d-d9d505d2973d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:44.260115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892292e-4ee6-4276-938d-d9d505d2973d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:44.260485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892292e-4ee6-4276-938d-d9d505d2973d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:44.261654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892292e-4ee6-4276-938d-d9d505d2973d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:44.264692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892292e-4ee6-4276-938d-d9d505d2973d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:44.301892 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1668/3347] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:01:44 2022] POST /identity/v3/users => generated 303 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:44.307543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983c78b-74da-48c6-98c6-f6502199e88f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:44.329561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983c78b-74da-48c6-98c6-f6502199e88f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:44.341290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da6785-2580-4745-9a20-bf44f3b00ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:44.342151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da6785-2580-4745-9a20-bf44f3b00ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:44.342534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da6785-2580-4745-9a20-bf44f3b00ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:44.342980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da6785-2580-4745-9a20-bf44f3b00ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:44.344338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da6785-2580-4745-9a20-bf44f3b00ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:44.346108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da6785-2580-4745-9a20-bf44f3b00ce9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:44.367032 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1680/3348] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:01:44.370652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892292e-4ee6-4276-938d-d9d505d2973d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:44.393770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892292e-4ee6-4276-938d-d9d505d2973d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:44.402469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620aba5-6cce-4b23-ad21-4726296a5d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:44.403476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620aba5-6cce-4b23-ad21-4726296a5d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:44.403878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620aba5-6cce-4b23-ad21-4726296a5d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:44.404232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620aba5-6cce-4b23-ad21-4726296a5d86 admin admin] PATH_INFO: `/v3/projects/c2738cadf29940c5bad339227b37da93/users/106534688ecf462cb77a80c8a193856e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:44.455827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620aba5-6cce-4b23-ad21-4726296a5d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2738cadf29940c5bad339227b37da93, user_id=106534688ecf462cb77a80c8a193856e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:44.462422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620aba5-6cce-4b23-ad21-4726296a5d86 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:44.500552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:44.508802 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1669/3349] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:44 2022] PUT /identity/v3/projects/c2738cadf29940c5bad339227b37da93/users/106534688ecf462cb77a80c8a193856e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:01:44.512498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da6785-2580-4745-9a20-bf44f3b00ce9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:44.535613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da6785-2580-4745-9a20-bf44f3b00ce9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:44.652337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620aba5-6cce-4b23-ad21-4726296a5d86 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:44.655256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e620aba5-6cce-4b23-ad21-4726296a5d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:44.736376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69721bf6-3279-4952-bab2-e34aad52f922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:44.737474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69721bf6-3279-4952-bab2-e34aad52f922 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:44.737933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69721bf6-3279-4952-bab2-e34aad52f922 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:44.738375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69721bf6-3279-4952-bab2-e34aad52f922 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:44.739526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69721bf6-3279-4952-bab2-e34aad52f922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:44.743384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69721bf6-3279-4952-bab2-e34aad52f922 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:44.767478 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1681/3350] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:44.772786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69721bf6-3279-4952-bab2-e34aad52f922 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:44.810815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69721bf6-3279-4952-bab2-e34aad52f922 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:44.820535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54980af7-06ec-4f59-ac35-4134458e8e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:44.821498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54980af7-06ec-4f59-ac35-4134458e8e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:44.822024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54980af7-06ec-4f59-ac35-4134458e8e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:44.822648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54980af7-06ec-4f59-ac35-4134458e8e43 admin admin] PATH_INFO: `/v3/projects/c2738cadf29940c5bad339227b37da93/users/106534688ecf462cb77a80c8a193856e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:44.825088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54980af7-06ec-4f59-ac35-4134458e8e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2738cadf29940c5bad339227b37da93, user_id=106534688ecf462cb77a80c8a193856e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:44.830720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54980af7-06ec-4f59-ac35-4134458e8e43 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:44.850616 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1682/3351] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:44 2022] PUT /identity/v3/projects/c2738cadf29940c5bad339227b37da93/users/106534688ecf462cb77a80c8a193856e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:44.852690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54980af7-06ec-4f59-ac35-4134458e8e43 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:44.864322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-54980af7-06ec-4f59-ac35-4134458e8e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:44.901732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620aba5-6cce-4b23-ad21-4726296a5d86 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:45.015764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:45.038984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:45.039249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:45.039899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:45.040484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] PATH_INFO: `/v3/users/26726afc7c1746949ff868d5046efcdf` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:45.044898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26726afc7c1746949ff868d5046efcdf)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:45.047185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:45.080839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54980af7-06ec-4f59-ac35-4134458e8e43 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:45.092558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e183ee9-385c-4bff-89d7-ff8ca8ba286a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:45.093267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e183ee9-385c-4bff-89d7-ff8ca8ba286a service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:45.093621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e183ee9-385c-4bff-89d7-ff8ca8ba286a service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:45.096276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e183ee9-385c-4bff-89d7-ff8ca8ba286a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:45.099559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5e183ee9-385c-4bff-89d7-ff8ca8ba286a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:45.129646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e183ee9-385c-4bff-89d7-ff8ca8ba286a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:45.132032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e183ee9-385c-4bff-89d7-ff8ca8ba286a service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:45.150894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26726afc7c1746949ff868d5046efcdf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:45.164211 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1683/3352] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:45.167540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a3cf8-8d94-4eeb-9658-2fbee7e60532 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:45.167858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a3cf8-8d94-4eeb-9658-2fbee7e60532 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:45.169599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a3cf8-8d94-4eeb-9658-2fbee7e60532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:45.170647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26726afc7c1746949ff868d5046efcdf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:45.176185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26726afc7c1746949ff868d5046efcdf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:45.223496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26726afc7c1746949ff868d5046efcdf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:45.224303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26726afc7c1746949ff868d5046efcdf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:45.249148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-914a3cf8-8d94-4eeb-9658-2fbee7e60532 None None] MFA Rules not processed for user `106534688ecf462cb77a80c8a193856e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:45.271441 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1670/3353] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:01:44 2022] DELETE /identity/v3/users/26726afc7c1746949ff868d5046efcdf => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:01:45.273463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-914a3cf8-8d94-4eeb-9658-2fbee7e60532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:45.579927 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1684/3354] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:46.089468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:46.094797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:46.175009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:46.269161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7803e9-7874-4c43-a90d-fa57c0297d41 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:46.280358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d811075-a5b6-47ec-9f2f-50fc66cff01b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:46.281155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d811075-a5b6-47ec-9f2f-50fc66cff01b service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:46.281890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d811075-a5b6-47ec-9f2f-50fc66cff01b service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:46.282286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d811075-a5b6-47ec-9f2f-50fc66cff01b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:46.296392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d811075-a5b6-47ec-9f2f-50fc66cff01b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:46.299255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d811075-a5b6-47ec-9f2f-50fc66cff01b service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:46.323459 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1671/3355] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:46 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:46.337132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a3cf8-8d94-4eeb-9658-2fbee7e60532 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:46.338641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-914a3cf8-8d94-4eeb-9658-2fbee7e60532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:46.495355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a3cf8-8d94-4eeb-9658-2fbee7e60532 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:46.503640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345b13a-bbd5-47bc-b45b-9b6e46190605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:46.505525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345b13a-bbd5-47bc-b45b-9b6e46190605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:46.507506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345b13a-bbd5-47bc-b45b-9b6e46190605 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:46.509397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345b13a-bbd5-47bc-b45b-9b6e46190605 admin admin] PATH_INFO: `/v3/projects/da7078e87a8a4ccbae0dfbfc71d448e5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:46.511320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345b13a-bbd5-47bc-b45b-9b6e46190605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da7078e87a8a4ccbae0dfbfc71d448e5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:46.514634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345b13a-bbd5-47bc-b45b-9b6e46190605 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:46.596319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0345b13a-bbd5-47bc-b45b-9b6e46190605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da7078e87a8a4ccbae0dfbfc71d448e5', 'request_id': 'req-0345b13a-bbd5-47bc-b45b-9b6e46190605'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:46.606963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0345b13a-bbd5-47bc-b45b-9b6e46190605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da7078e87a8a4ccbae0dfbfc71d448e5', 'request_id': 'req-0345b13a-bbd5-47bc-b45b-9b6e46190605'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:46.609744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:46.621381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0345b13a-bbd5-47bc-b45b-9b6e46190605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da7078e87a8a4ccbae0dfbfc71d448e5', 'request_id': 'req-0345b13a-bbd5-47bc-b45b-9b6e46190605'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:46.675655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0345b13a-bbd5-47bc-b45b-9b6e46190605 admin admin] The token cache is being invalidate because project da7078e87a8a4ccbae0dfbfc71d448e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:46.676991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0345b13a-bbd5-47bc-b45b-9b6e46190605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:46.679978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0345b13a-bbd5-47bc-b45b-9b6e46190605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:46.689040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a5630-81fe-4a3d-afb3-014183555341 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:46.689405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a5630-81fe-4a3d-afb3-014183555341 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:46.689647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a5630-81fe-4a3d-afb3-014183555341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:46.692159 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1685/3356] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:46 2022] DELETE /identity/v3/projects/da7078e87a8a4ccbae0dfbfc71d448e5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:46.730262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e60a5630-81fe-4a3d-afb3-014183555341 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:46.732510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e60a5630-81fe-4a3d-afb3-014183555341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:46.900513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8eca0-3d10-423e-ab0b-0aa477c8ef01 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:46.900513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8eca0-3d10-423e-ab0b-0aa477c8ef01 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:46.900513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8eca0-3d10-423e-ab0b-0aa477c8ef01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:46.912956 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1672/3357] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:01:46.941178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3ef8eca0-3d10-423e-ab0b-0aa477c8ef01 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:46.943629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ef8eca0-3d10-423e-ab0b-0aa477c8ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:46.972802 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1686/3358] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:46.973320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a5630-81fe-4a3d-afb3-014183555341 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:46.990427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a5630-81fe-4a3d-afb3-014183555341 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:47.008586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1363d31-79db-4f8f-9377-0f576ecbcf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:47.009337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1363d31-79db-4f8f-9377-0f576ecbcf71 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:47.009725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1363d31-79db-4f8f-9377-0f576ecbcf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:47.010108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1363d31-79db-4f8f-9377-0f576ecbcf71 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:47.011046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1363d31-79db-4f8f-9377-0f576ecbcf71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:47.011468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1363d31-79db-4f8f-9377-0f576ecbcf71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:47.014226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1363d31-79db-4f8f-9377-0f576ecbcf71 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:47.045272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8eca0-3d10-423e-ab0b-0aa477c8ef01 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:47.046757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ef8eca0-3d10-423e-ab0b-0aa477c8ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:47.050422 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1673/3359] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:47.051697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1363d31-79db-4f8f-9377-0f576ecbcf71 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:47.078506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1363d31-79db-4f8f-9377-0f576ecbcf71 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:47.089710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f87203-e17b-4670-8a28-13486a5eaf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:47.090688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f87203-e17b-4670-8a28-13486a5eaf22 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:47.091069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f87203-e17b-4670-8a28-13486a5eaf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:47.091459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f87203-e17b-4670-8a28-13486a5eaf22 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:47.092214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f87203-e17b-4670-8a28-13486a5eaf22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:47.094297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f87203-e17b-4670-8a28-13486a5eaf22 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:47.144696 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1674/3360] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:01:47 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:47.149920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f87203-e17b-4670-8a28-13486a5eaf22 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:47.178606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8eca0-3d10-423e-ab0b-0aa477c8ef01 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:47.308958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ea3cd-dd1d-4ff1-a6c1-9b72771caee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:47.310154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ea3cd-dd1d-4ff1-a6c1-9b72771caee1 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:47.310440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ea3cd-dd1d-4ff1-a6c1-9b72771caee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:47.310784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ea3cd-dd1d-4ff1-a6c1-9b72771caee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:47.318620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7c7ea3cd-dd1d-4ff1-a6c1-9b72771caee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:47.359336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f87203-e17b-4670-8a28-13486a5eaf22 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:47.381362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf6881-2f3c-4a0a-b2a9-ff52869494b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:47.382679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf6881-2f3c-4a0a-b2a9-ff52869494b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:47.385426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf6881-2f3c-4a0a-b2a9-ff52869494b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:47.385834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf6881-2f3c-4a0a-b2a9-ff52869494b0 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:47.387733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf6881-2f3c-4a0a-b2a9-ff52869494b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:47.391011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf6881-2f3c-4a0a-b2a9-ff52869494b0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:47.449613 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1675/3361] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:01:47 2022] POST /identity/v3/users => generated 294 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:47.458606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf6881-2f3c-4a0a-b2a9-ff52869494b0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:47.462301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ea3cd-dd1d-4ff1-a6c1-9b72771caee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:47.463804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ea3cd-dd1d-4ff1-a6c1-9b72771caee1 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:47.469603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:47.478448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf6881-2f3c-4a0a-b2a9-ff52869494b0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:47.489625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63fd9f-25b2-4a89-8dbd-5a6ba52a186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:47.490425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63fd9f-25b2-4a89-8dbd-5a6ba52a186a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:47.490942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63fd9f-25b2-4a89-8dbd-5a6ba52a186a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:47.492397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63fd9f-25b2-4a89-8dbd-5a6ba52a186a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:47.493184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63fd9f-25b2-4a89-8dbd-5a6ba52a186a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:47.494950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63fd9f-25b2-4a89-8dbd-5a6ba52a186a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:47.498334 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1687/3362] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:47.521491 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1676/3363] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:47.526357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ea3cd-dd1d-4ff1-a6c1-9b72771caee1 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:47.542880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ea3cd-dd1d-4ff1-a6c1-9b72771caee1 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:47.552964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef6abf-0ffa-4129-aacd-d01156e9a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:47.554014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef6abf-0ffa-4129-aacd-d01156e9a66b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:47.554550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef6abf-0ffa-4129-aacd-d01156e9a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:47.556655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef6abf-0ffa-4129-aacd-d01156e9a66b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:47.557606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef6abf-0ffa-4129-aacd-d01156e9a66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:47.561814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef6abf-0ffa-4129-aacd-d01156e9a66b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:47.592737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63fd9f-25b2-4a89-8dbd-5a6ba52a186a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:47.600086 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1688/3364] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:47.604356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63fd9f-25b2-4a89-8dbd-5a6ba52a186a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:47.612287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704882b1-b8f1-4fad-98a6-a10400faa542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:47.613349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704882b1-b8f1-4fad-98a6-a10400faa542 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:47.613686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704882b1-b8f1-4fad-98a6-a10400faa542 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:47.614031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704882b1-b8f1-4fad-98a6-a10400faa542 admin admin] PATH_INFO: `/v3/projects/05e9358455a84783aaee73d111ae80dc/users/e53686d22edb4f4ebca9f6799eb23f7f/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:47.632794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704882b1-b8f1-4fad-98a6-a10400faa542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e9358455a84783aaee73d111ae80dc, user_id=e53686d22edb4f4ebca9f6799eb23f7f, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:47.635666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704882b1-b8f1-4fad-98a6-a10400faa542 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:47.672806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d354fcd-72d1-4e74-9a2e-7e53c95534ba None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:47.673088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d354fcd-72d1-4e74-9a2e-7e53c95534ba None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:47.673366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d354fcd-72d1-4e74-9a2e-7e53c95534ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:47.676700 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1677/3365] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:47 2022] PUT /identity/v3/projects/05e9358455a84783aaee73d111ae80dc/users/e53686d22edb4f4ebca9f6799eb23f7f/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:47.704221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3d354fcd-72d1-4e74-9a2e-7e53c95534ba None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:47.705590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3d354fcd-72d1-4e74-9a2e-7e53c95534ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:47.740562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:47.827210 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1689/3366] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:47.970534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704882b1-b8f1-4fad-98a6-a10400faa542 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:48.088199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119501d5-6e40-4210-910b-639717e6a41d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:48.088490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119501d5-6e40-4210-910b-639717e6a41d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:48.088770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119501d5-6e40-4210-910b-639717e6a41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:48.110881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-119501d5-6e40-4210-910b-639717e6a41d None None] MFA Rules not processed for user `3afd4b10403a452e81f60f30ed5690f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:48.112153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-119501d5-6e40-4210-910b-639717e6a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:48.134689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704882b1-b8f1-4fad-98a6-a10400faa542 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:48.145534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149cee6-4a5d-43be-9d6a-0ef65767e2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:48.146174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149cee6-4a5d-43be-9d6a-0ef65767e2ef service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:48.146458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149cee6-4a5d-43be-9d6a-0ef65767e2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:48.146959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149cee6-4a5d-43be-9d6a-0ef65767e2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:48.171123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149cee6-4a5d-43be-9d6a-0ef65767e2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:48.175321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149cee6-4a5d-43be-9d6a-0ef65767e2ef service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:48.203146 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1678/3367] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:48.272972 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1690/3368] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:49.931312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149cee6-4a5d-43be-9d6a-0ef65767e2ef service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:49.936388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4149cee6-4a5d-43be-9d6a-0ef65767e2ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:50.209510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149cee6-4a5d-43be-9d6a-0ef65767e2ef service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:50.241349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a315cd-2804-4be9-9b61-48ece545849f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:50.246026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a315cd-2804-4be9-9b61-48ece545849f service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:50.248009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a315cd-2804-4be9-9b61-48ece545849f service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:50.251165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a315cd-2804-4be9-9b61-48ece545849f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:50.256695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f8a315cd-2804-4be9-9b61-48ece545849f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:50.430890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a315cd-2804-4be9-9b61-48ece545849f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:50.433217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a315cd-2804-4be9-9b61-48ece545849f service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:50.463274 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1679/3369] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:49 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:01:50.489727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119501d5-6e40-4210-910b-639717e6a41d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:50.491749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-119501d5-6e40-4210-910b-639717e6a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:50.519381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119501d5-6e40-4210-910b-639717e6a41d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:50.532103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:50.532938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:50.533328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:50.533711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] PATH_INFO: `/v3/users/0e76e957d64f48cba3d8ac6f78a10296` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:50.536892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e76e957d64f48cba3d8ac6f78a10296)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:50.541400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:50.692581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e76e957d64f48cba3d8ac6f78a10296'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:50.717259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e76e957d64f48cba3d8ac6f78a10296'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:50.723647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e76e957d64f48cba3d8ac6f78a10296'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:50.757510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e76e957d64f48cba3d8ac6f78a10296'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:50.758346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e76e957d64f48cba3d8ac6f78a10296'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:50.806685 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1691/3370] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:01:50 2022] DELETE /identity/v3/users/0e76e957d64f48cba3d8ac6f78a10296 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:50.811908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12c296-c82b-49ca-8614-60db208cbf33 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:50.812476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12c296-c82b-49ca-8614-60db208cbf33 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:50.812956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12c296-c82b-49ca-8614-60db208cbf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:50.874485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ba12c296-c82b-49ca-8614-60db208cbf33 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:50.879196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ba12c296-c82b-49ca-8614-60db208cbf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:50.898229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:50.943746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:50.945884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:51.074009 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1680/3371] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:51.131529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:51.140866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc025a9c-0b01-47de-99be-39e43d8df0f5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:51.162992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12c296-c82b-49ca-8614-60db208cbf33 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:51.164739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ba12c296-c82b-49ca-8614-60db208cbf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:51.185982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ba15c-e7ae-4871-a624-9d336cbafbea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:51.186852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ba15c-e7ae-4871-a624-9d336cbafbea service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:51.187145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ba15c-e7ae-4871-a624-9d336cbafbea service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:51.188583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ba15c-e7ae-4871-a624-9d336cbafbea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:51.192951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-676ba15c-e7ae-4871-a624-9d336cbafbea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:51.233581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12c296-c82b-49ca-8614-60db208cbf33 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:51.253779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27a675-4a64-4bcd-a2bf-57689dcd68ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:51.258819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27a675-4a64-4bcd-a2bf-57689dcd68ea service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:51.259624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27a675-4a64-4bcd-a2bf-57689dcd68ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:51.261193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27a675-4a64-4bcd-a2bf-57689dcd68ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:51.301685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27a675-4a64-4bcd-a2bf-57689dcd68ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:51.305135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27a675-4a64-4bcd-a2bf-57689dcd68ea service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:51.349701 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1681/3372] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:01:51.499717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ba15c-e7ae-4871-a624-9d336cbafbea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:51.528150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ba15c-e7ae-4871-a624-9d336cbafbea service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:51.569884 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1692/3373] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:01:52.042482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27a675-4a64-4bcd-a2bf-57689dcd68ea service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:52.044461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ce27a675-4a64-4bcd-a2bf-57689dcd68ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:52.066922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27a675-4a64-4bcd-a2bf-57689dcd68ea service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:52.073102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:52.074012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:52.074529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:52.076090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] PATH_INFO: `/v3/projects/869f98d4de46470ab21dbf9e95401c4a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:52.078216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=869f98d4de46470ab21dbf9e95401c4a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:52.081005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:52.157464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869f98d4de46470ab21dbf9e95401c4a', 'request_id': 'req-8c656365-9f16-4dfc-a85f-12a46c380fce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.170237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ba15c-e7ae-4871-a624-9d336cbafbea service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:52.172290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-676ba15c-e7ae-4871-a624-9d336cbafbea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:52.198344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ba15c-e7ae-4871-a624-9d336cbafbea service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:52.198562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869f98d4de46470ab21dbf9e95401c4a', 'request_id': 'req-8c656365-9f16-4dfc-a85f-12a46c380fce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.221846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869f98d4de46470ab21dbf9e95401c4a', 'request_id': 'req-8c656365-9f16-4dfc-a85f-12a46c380fce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.246506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] The token cache is being invalidate because project 869f98d4de46470ab21dbf9e95401c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:52.247756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.249247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.257836 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1682/3374] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:52 2022] DELETE /identity/v3/projects/869f98d4de46470ab21dbf9e95401c4a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:52.260040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:52.261837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:52.328071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:52.332456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:52.334060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:52.334978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] PATH_INFO: `/v3/users/d049efd2598f4a528d68972936643fd5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:52.339159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d049efd2598f4a528d68972936643fd5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:52.342810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:52.386726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c656365-9f16-4dfc-a85f-12a46c380fce admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:52.408334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:52.409715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:52.410311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:52.410847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] PATH_INFO: `/v3/users/106534688ecf462cb77a80c8a193856e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:52.413252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=106534688ecf462cb77a80c8a193856e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:52.416944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:52.455174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:52.457965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd049efd2598f4a528d68972936643fd5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.492801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd049efd2598f4a528d68972936643fd5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.493858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd049efd2598f4a528d68972936643fd5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.514874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106534688ecf462cb77a80c8a193856e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.517210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd049efd2598f4a528d68972936643fd5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.517982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd049efd2598f4a528d68972936643fd5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.550856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106534688ecf462cb77a80c8a193856e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.554049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106534688ecf462cb77a80c8a193856e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.568234 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1693/3375] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:01:52 2022] DELETE /identity/v3/users/d049efd2598f4a528d68972936643fd5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:01:52.596771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106534688ecf462cb77a80c8a193856e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.598636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106534688ecf462cb77a80c8a193856e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:52.637238 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1683/3376] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:01:52 2022] DELETE /identity/v3/users/106534688ecf462cb77a80c8a193856e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:53.102338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:53.104236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:53.122145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:53.164421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:53.166864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:53.205064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d2ad2-c804-4c13-9aed-0a3977a254fd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:53.295697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e3176-6355-49af-8ff4-37d3e98adb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:53.296489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e3176-6355-49af-8ff4-37d3e98adb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:53.296839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e3176-6355-49af-8ff4-37d3e98adb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:53.297181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e3176-6355-49af-8ff4-37d3e98adb9a admin admin] PATH_INFO: `/v3/projects/a71cd8d737d7477f8c4536defbf8f39d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:53.298910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e3176-6355-49af-8ff4-37d3e98adb9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a71cd8d737d7477f8c4536defbf8f39d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:53.300984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e3176-6355-49af-8ff4-37d3e98adb9a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:53.374084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c210265-1c18-4ce6-8e7d-e42d71c6e2a4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:53.398570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-850e3176-6355-49af-8ff4-37d3e98adb9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a71cd8d737d7477f8c4536defbf8f39d', 'request_id': 'req-850e3176-6355-49af-8ff4-37d3e98adb9a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:53.424205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-850e3176-6355-49af-8ff4-37d3e98adb9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a71cd8d737d7477f8c4536defbf8f39d', 'request_id': 'req-850e3176-6355-49af-8ff4-37d3e98adb9a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:53.436046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-850e3176-6355-49af-8ff4-37d3e98adb9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a71cd8d737d7477f8c4536defbf8f39d', 'request_id': 'req-850e3176-6355-49af-8ff4-37d3e98adb9a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:53.488684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-850e3176-6355-49af-8ff4-37d3e98adb9a admin admin] The token cache is being invalidate because project a71cd8d737d7477f8c4536defbf8f39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:53.489060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-850e3176-6355-49af-8ff4-37d3e98adb9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:53.492364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-850e3176-6355-49af-8ff4-37d3e98adb9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:53.498480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384788fd-d105-45ec-8972-f15a5789ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:53.499359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384788fd-d105-45ec-8972-f15a5789ab92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:53.499842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384788fd-d105-45ec-8972-f15a5789ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:53.500296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384788fd-d105-45ec-8972-f15a5789ab92 admin admin] PATH_INFO: `/v3/projects/c2738cadf29940c5bad339227b37da93` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:53.501849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384788fd-d105-45ec-8972-f15a5789ab92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2738cadf29940c5bad339227b37da93)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:53.503443 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1694/3377] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:53 2022] DELETE /identity/v3/projects/a71cd8d737d7477f8c4536defbf8f39d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:53.505763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218edaa-e0eb-4c92-931b-8ed407eb62b4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:53.507537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218edaa-e0eb-4c92-931b-8ed407eb62b4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:53.511071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218edaa-e0eb-4c92-931b-8ed407eb62b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:53.516054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384788fd-d105-45ec-8972-f15a5789ab92 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:53.572623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d218edaa-e0eb-4c92-931b-8ed407eb62b4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:53.575000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d218edaa-e0eb-4c92-931b-8ed407eb62b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:53.620727 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1695/3378] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:53.624134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8fac0-24a9-42b1-afce-e96bf4722de6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:53.624872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8fac0-24a9-42b1-afce-e96bf4722de6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:53.626645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8fac0-24a9-42b1-afce-e96bf4722de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:53.632747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:53.642858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-384788fd-d105-45ec-8972-f15a5789ab92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2738cadf29940c5bad339227b37da93', 'request_id': 'req-384788fd-d105-45ec-8972-f15a5789ab92'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:53.673791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-384788fd-d105-45ec-8972-f15a5789ab92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2738cadf29940c5bad339227b37da93', 'request_id': 'req-384788fd-d105-45ec-8972-f15a5789ab92'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:53.685338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-41c8fac0-24a9-42b1-afce-e96bf4722de6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:53.686694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-384788fd-d105-45ec-8972-f15a5789ab92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2738cadf29940c5bad339227b37da93', 'request_id': 'req-384788fd-d105-45ec-8972-f15a5789ab92'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:53.686848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-41c8fac0-24a9-42b1-afce-e96bf4722de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:53.710825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-384788fd-d105-45ec-8972-f15a5789ab92 admin admin] The token cache is being invalidate because project c2738cadf29940c5bad339227b37da93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:01:53.711359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-384788fd-d105-45ec-8972-f15a5789ab92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:53.712402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-384788fd-d105-45ec-8972-f15a5789ab92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:01:53.715003 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1684/3379] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:01:53 2022] DELETE /identity/v3/projects/c2738cadf29940c5bad339227b37da93 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:01:53.721636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f41b3-27cd-47b3-badc-866f6607a8d0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:53.722178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f41b3-27cd-47b3-badc-866f6607a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:53.722717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f41b3-27cd-47b3-badc-866f6607a8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:53.752176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-488f41b3-27cd-47b3-badc-866f6607a8d0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:53.753849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-488f41b3-27cd-47b3-badc-866f6607a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:53.759368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:53.863198 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1696/3380] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:53.870504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8fac0-24a9-42b1-afce-e96bf4722de6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:53.885347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8fac0-24a9-42b1-afce-e96bf4722de6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:53.915753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04dd5-2a55-400d-b82e-2cb90124894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:53.917334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04dd5-2a55-400d-b82e-2cb90124894e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:53.917845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04dd5-2a55-400d-b82e-2cb90124894e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:53.918410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04dd5-2a55-400d-b82e-2cb90124894e admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:53.920007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f04dd5-2a55-400d-b82e-2cb90124894e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:53.920510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f04dd5-2a55-400d-b82e-2cb90124894e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:53.922342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f04dd5-2a55-400d-b82e-2cb90124894e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:53.941075 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1685/3381] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:01:53.948733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd0be-5534-4b04-bccf-2749996b8a75 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:53.949025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd0be-5534-4b04-bccf-2749996b8a75 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:53.949304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fd0be-5534-4b04-bccf-2749996b8a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:53.953467 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1697/3382] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:53.954459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04dd5-2a55-400d-b82e-2cb90124894e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:53.967171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04dd5-2a55-400d-b82e-2cb90124894e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:53.975526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffdbd4-f22a-4090-a94b-777192d4e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:53.976297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffdbd4-f22a-4090-a94b-777192d4e178 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:53.976587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffdbd4-f22a-4090-a94b-777192d4e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:53.976859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffdbd4-f22a-4090-a94b-777192d4e178 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:53.977507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffdbd4-f22a-4090-a94b-777192d4e178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:53.977893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-333fd0be-5534-4b04-bccf-2749996b8a75 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:53.979360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-333fd0be-5534-4b04-bccf-2749996b8a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:53.980504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffdbd4-f22a-4090-a94b-777192d4e178 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:53.990350 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1686/3383] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:53.996253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd0be-5534-4b04-bccf-2749996b8a75 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:54.017580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fd0be-5534-4b04-bccf-2749996b8a75 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:54.021795 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1698/3384] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:01:53 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:01:54.025875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffdbd4-f22a-4090-a94b-777192d4e178 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:54.028565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13121dd2-032f-46cb-a337-1d5b824811d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:54.029560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13121dd2-032f-46cb-a337-1d5b824811d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.030302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13121dd2-032f-46cb-a337-1d5b824811d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.031048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13121dd2-032f-46cb-a337-1d5b824811d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.031978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13121dd2-032f-46cb-a337-1d5b824811d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:01:54.032756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13121dd2-032f-46cb-a337-1d5b824811d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:54.037255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13121dd2-032f-46cb-a337-1d5b824811d2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:54.054221 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1687/3385] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:01:54.058192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13121dd2-032f-46cb-a337-1d5b824811d2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:54.070062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13121dd2-032f-46cb-a337-1d5b824811d2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:54.117824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffdbd4-f22a-4090-a94b-777192d4e178 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:54.123963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1183764-c694-4924-9bf7-69dd7e824eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:54.124594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1183764-c694-4924-9bf7-69dd7e824eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.124874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1183764-c694-4924-9bf7-69dd7e824eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.125243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1183764-c694-4924-9bf7-69dd7e824eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.125806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1183764-c694-4924-9bf7-69dd7e824eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:54.127857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1183764-c694-4924-9bf7-69dd7e824eb9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:54.153822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b99ff4-ec4b-457a-86be-a22c2c820b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:54.154951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99ff4-ec4b-457a-86be-a22c2c820b9b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.158701 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1699/3386] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:01:54 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:01:54.158920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99ff4-ec4b-457a-86be-a22c2c820b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.158920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99ff4-ec4b-457a-86be-a22c2c820b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.158920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b99ff4-ec4b-457a-86be-a22c2c820b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:54.158920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b99ff4-ec4b-457a-86be-a22c2c820b9b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:54.160751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1183764-c694-4924-9bf7-69dd7e824eb9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:54.173894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1183764-c694-4924-9bf7-69dd7e824eb9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:54.180469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f178d2-4de6-408d-9321-45b02f87643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:54.181223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f178d2-4de6-408d-9321-45b02f87643d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.181546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f178d2-4de6-408d-9321-45b02f87643d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.181847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f178d2-4de6-408d-9321-45b02f87643d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.182466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f178d2-4de6-408d-9321-45b02f87643d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:54.184230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f178d2-4de6-408d-9321-45b02f87643d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:54.193631 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1688/3387] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:01:54 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:01:54.200663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b99ff4-ec4b-457a-86be-a22c2c820b9b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:54.201769 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1700/3388] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:01:54.202782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f178d2-4de6-408d-9321-45b02f87643d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:54.213277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f178d2-4de6-408d-9321-45b02f87643d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:54.253498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:54.278677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b99ff4-ec4b-457a-86be-a22c2c820b9b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:54.284089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96b06e-dabf-4362-a23e-6d379e72304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:54.284717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96b06e-dabf-4362-a23e-6d379e72304d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.284996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96b06e-dabf-4362-a23e-6d379e72304d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.285388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96b06e-dabf-4362-a23e-6d379e72304d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.286017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96b06e-dabf-4362-a23e-6d379e72304d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:54.288434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96b06e-dabf-4362-a23e-6d379e72304d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:54.295213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945fd79-227b-4d9a-a0d2-29b6f5e787a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:54.296601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945fd79-227b-4d9a-a0d2-29b6f5e787a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.296601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945fd79-227b-4d9a-a0d2-29b6f5e787a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.296839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945fd79-227b-4d9a-a0d2-29b6f5e787a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.297786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945fd79-227b-4d9a-a0d2-29b6f5e787a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:54.299611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945fd79-227b-4d9a-a0d2-29b6f5e787a9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:54.320148 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1701/3389] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:54.321131 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1689/3390] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:01:54 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:01:54.322474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945fd79-227b-4d9a-a0d2-29b6f5e787a9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:54.324587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96b06e-dabf-4362-a23e-6d379e72304d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:54.335004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945fd79-227b-4d9a-a0d2-29b6f5e787a9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:54.336751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96b06e-dabf-4362-a23e-6d379e72304d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:54.340109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4529dc-66b4-421b-be63-2eb5970c0679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:54.341087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4529dc-66b4-421b-be63-2eb5970c0679 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.341494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4529dc-66b4-421b-be63-2eb5970c0679 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.341831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4529dc-66b4-421b-be63-2eb5970c0679 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.342020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ada40-ccc0-43e3-adf6-d5c17dbac21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:54.342702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ada40-ccc0-43e3-adf6-d5c17dbac21d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.343036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4529dc-66b4-421b-be63-2eb5970c0679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:54.343503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ada40-ccc0-43e3-adf6-d5c17dbac21d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.343782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ada40-ccc0-43e3-adf6-d5c17dbac21d admin admin] PATH_INFO: `/v3/projects/8681d6e7b81f4ff3b89e30ac0ae06dce/users/6b4aa532a1844e298d1acc95944e68a0/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.344653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4529dc-66b4-421b-be63-2eb5970c0679 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:54.361736 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1702/3391] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:54.363904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ada40-ccc0-43e3-adf6-d5c17dbac21d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8681d6e7b81f4ff3b89e30ac0ae06dce, user_id=6b4aa532a1844e298d1acc95944e68a0, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:54.365752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4529dc-66b4-421b-be63-2eb5970c0679 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:54.368623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ada40-ccc0-43e3-adf6-d5c17dbac21d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:54.393421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4529dc-66b4-421b-be63-2eb5970c0679 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:54.408659 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1690/3392] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:54 2022] PUT /identity/v3/projects/8681d6e7b81f4ff3b89e30ac0ae06dce/users/6b4aa532a1844e298d1acc95944e68a0/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:54.409616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:54.412504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c4163-6c47-4a33-97c0-b3a209fea666 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.412962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c4163-6c47-4a33-97c0-b3a209fea666 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.413227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c4163-6c47-4a33-97c0-b3a209fea666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.462224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-207c4163-6c47-4a33-97c0-b3a209fea666 None None] MFA Rules not processed for user `6b4aa532a1844e298d1acc95944e68a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:54.465265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-207c4163-6c47-4a33-97c0-b3a209fea666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:54.497054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247e102-b26f-4be0-b06d-27c3d8d8c326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:54.497544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247e102-b26f-4be0-b06d-27c3d8d8c326 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.498051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247e102-b26f-4be0-b06d-27c3d8d8c326 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.498388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247e102-b26f-4be0-b06d-27c3d8d8c326 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.499287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247e102-b26f-4be0-b06d-27c3d8d8c326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:54.502733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247e102-b26f-4be0-b06d-27c3d8d8c326 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:54.527062 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1703/3393] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:01:54.529235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247e102-b26f-4be0-b06d-27c3d8d8c326 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:54.544856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247e102-b26f-4be0-b06d-27c3d8d8c326 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:54.551759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725032f-fe9e-4dd8-a71b-f6ecd0734713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:54.552526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725032f-fe9e-4dd8-a71b-f6ecd0734713 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.552970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725032f-fe9e-4dd8-a71b-f6ecd0734713 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.553323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725032f-fe9e-4dd8-a71b-f6ecd0734713 admin admin] PATH_INFO: `/v3/projects/55ce8d87470a49268ce76dd08c5be965/users/ea4e121ce0184fb98e373da8fd5eb42a/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.576785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725032f-fe9e-4dd8-a71b-f6ecd0734713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ce8d87470a49268ce76dd08c5be965, user_id=ea4e121ce0184fb98e373da8fd5eb42a, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:54.580201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725032f-fe9e-4dd8-a71b-f6ecd0734713 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:54.601108 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1704/3394] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:01:54 2022] PUT /identity/v3/projects/55ce8d87470a49268ce76dd08c5be965/users/ea4e121ce0184fb98e373da8fd5eb42a/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:01:54.606222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42f80b-1670-47e4-bf3a-ff33f6c6e7d0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.606779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42f80b-1670-47e4-bf3a-ff33f6c6e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.607945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42f80b-1670-47e4-bf3a-ff33f6c6e7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.618126 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1691/3395] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:01:54.619331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1cb76-f253-4996-96de-114b0c46b810 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.619624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1cb76-f253-4996-96de-114b0c46b810 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.619902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1cb76-f253-4996-96de-114b0c46b810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.647888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-dec1cb76-f253-4996-96de-114b0c46b810 None None] MFA Rules not processed for user `8c74321e1a114e3094d2f69930037505`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:54.649200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dec1cb76-f253-4996-96de-114b0c46b810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:54.661803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1b42f80b-1670-47e4-bf3a-ff33f6c6e7d0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:54.663363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1b42f80b-1670-47e4-bf3a-ff33f6c6e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:54.741648 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1692/3396] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:54.743253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a2100-5cd9-4003-89e1-cfba922bad20 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.743592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a2100-5cd9-4003-89e1-cfba922bad20 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.743874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a2100-5cd9-4003-89e1-cfba922bad20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.765048 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1705/3397] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:54.774758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42f80b-1670-47e4-bf3a-ff33f6c6e7d0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:54.777696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1b42f80b-1670-47e4-bf3a-ff33f6c6e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:54.782032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-567a2100-5cd9-4003-89e1-cfba922bad20 None None] MFA Rules not processed for user `6b4aa532a1844e298d1acc95944e68a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:01:54.783570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-567a2100-5cd9-4003-89e1-cfba922bad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:54.850843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:01:54.870375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42f80b-1670-47e4-bf3a-ff33f6c6e7d0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:54.880205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d3c6e-a501-4664-b83c-000bc4f5c31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:54.882296 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1693/3398] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:01:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:01:54.882486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d3c6e-a501-4664-b83c-000bc4f5c31e service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:54.884255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d3c6e-a501-4664-b83c-000bc4f5c31e service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:54.884255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d3c6e-a501-4664-b83c-000bc4f5c31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:54.896206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d3c6e-a501-4664-b83c-000bc4f5c31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:54.897706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d3c6e-a501-4664-b83c-000bc4f5c31e service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:54.921617 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1706/3399] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:01:56.462511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a2100-5cd9-4003-89e1-cfba922bad20 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:56.465113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-567a2100-5cd9-4003-89e1-cfba922bad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:56.616311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a2100-5cd9-4003-89e1-cfba922bad20 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:56.629302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe70fb-c2ec-45d2-8da3-80898c9d8f24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:56.630764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe70fb-c2ec-45d2-8da3-80898c9d8f24 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:56.630764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe70fb-c2ec-45d2-8da3-80898c9d8f24 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:56.630948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe70fb-c2ec-45d2-8da3-80898c9d8f24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:56.647384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe70fb-c2ec-45d2-8da3-80898c9d8f24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:56.649294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe70fb-c2ec-45d2-8da3-80898c9d8f24 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:56.664109 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1694/3400] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:01:57.706331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d3c6e-a501-4664-b83c-000bc4f5c31e service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:01:57.708928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-343d3c6e-a501-4664-b83c-000bc4f5c31e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:57.730055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d3c6e-a501-4664-b83c-000bc4f5c31e service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:01:57.741853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a9491-b1de-4542-9a1c-5642f39a7c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:01:57.742797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9491-b1de-4542-9a1c-5642f39a7c5d service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:01:57.743741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9491-b1de-4542-9a1c-5642f39a7c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:01:57.744185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9491-b1de-4542-9a1c-5642f39a7c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:01:57.749637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d72a9491-b1de-4542-9a1c-5642f39a7c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:01:57.775247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a9491-b1de-4542-9a1c-5642f39a7c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:01:57.776711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a9491-b1de-4542-9a1c-5642f39a7c5d service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:01:57.794443 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1707/3401] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:01:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:06.659121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=40 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:07.790489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:08.599573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb4c0f-f9c1-4447-ab52-075a4267ed43 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:08.600582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb4c0f-f9c1-4447-ab52-075a4267ed43 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:08.600874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb4c0f-f9c1-4447-ab52-075a4267ed43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:08.690484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-aefb4c0f-f9c1-4447-ab52-075a4267ed43 None None] MFA Rules not processed for user `ea4e121ce0184fb98e373da8fd5eb42a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:08.691928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aefb4c0f-f9c1-4447-ab52-075a4267ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:08.901549 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1695/3402] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:08.915244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e69da-be14-450c-b3f8-c9bd80611a90 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:08.916174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e69da-be14-450c-b3f8-c9bd80611a90 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:08.916605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e69da-be14-450c-b3f8-c9bd80611a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:08.989051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c21e69da-be14-450c-b3f8-c9bd80611a90 None None] MFA Rules not processed for user `ea4e121ce0184fb98e373da8fd5eb42a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:08.991363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c21e69da-be14-450c-b3f8-c9bd80611a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:09.013930 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1708/3403] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:09.569497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309755-def2-42dd-8f97-ef20400d1768 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:09.569798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309755-def2-42dd-8f97-ef20400d1768 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:09.570075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86309755-def2-42dd-8f97-ef20400d1768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:09.662883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-86309755-def2-42dd-8f97-ef20400d1768 None None] MFA Rules not processed for user `e53686d22edb4f4ebca9f6799eb23f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:09.664124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-86309755-def2-42dd-8f97-ef20400d1768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:09.842167 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1696/3404] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:09.846088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e69da-be14-450c-b3f8-c9bd80611a90 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:09.847857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c21e69da-be14-450c-b3f8-c9bd80611a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:09.874939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e69da-be14-450c-b3f8-c9bd80611a90 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:09.881394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055b268-79a1-4469-9bf0-642170e3536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:09.882411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055b268-79a1-4469-9bf0-642170e3536a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:09.882994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055b268-79a1-4469-9bf0-642170e3536a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:09.883459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055b268-79a1-4469-9bf0-642170e3536a admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:09.884457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055b268-79a1-4469-9bf0-642170e3536a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:09.886720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055b268-79a1-4469-9bf0-642170e3536a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:09.964304 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1709/3405] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:02:09 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:09.967984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86309755-def2-42dd-8f97-ef20400d1768 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:10.000807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86309755-def2-42dd-8f97-ef20400d1768 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:10.148915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da7ab7-27ea-42cd-b3d6-4348113401c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:10.150166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da7ab7-27ea-42cd-b3d6-4348113401c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:10.150668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da7ab7-27ea-42cd-b3d6-4348113401c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:10.151247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da7ab7-27ea-42cd-b3d6-4348113401c9 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:10.152102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da7ab7-27ea-42cd-b3d6-4348113401c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:10.155295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da7ab7-27ea-42cd-b3d6-4348113401c9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:10.214286 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1697/3406] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:02:09 2022] POST /identity/v3/users => generated 301 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:10.219541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055b268-79a1-4469-9bf0-642170e3536a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:10.243279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055b268-79a1-4469-9bf0-642170e3536a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:10.268201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c85054-59cc-451c-983a-657d34be36a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:10.269120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85054-59cc-451c-983a-657d34be36a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:10.271515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85054-59cc-451c-983a-657d34be36a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:10.271946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c85054-59cc-451c-983a-657d34be36a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:10.278509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c85054-59cc-451c-983a-657d34be36a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:10.287209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c85054-59cc-451c-983a-657d34be36a1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:10.324139 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1710/3407] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:10.329235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da7ab7-27ea-42cd-b3d6-4348113401c9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:10.345750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da7ab7-27ea-42cd-b3d6-4348113401c9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:10.360413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dc0f9-a2e8-48c1-ae35-07d1d74cd646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:10.361296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dc0f9-a2e8-48c1-ae35-07d1d74cd646 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:10.362183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dc0f9-a2e8-48c1-ae35-07d1d74cd646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:10.362183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dc0f9-a2e8-48c1-ae35-07d1d74cd646 admin admin] PATH_INFO: `/v3/projects/3a4eebcc69ea4495bfdb9503d799a682/users/8de209e1f73e45d2a82d7d3fc9f0aca9/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:10.369795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:10.400417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dc0f9-a2e8-48c1-ae35-07d1d74cd646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4eebcc69ea4495bfdb9503d799a682, user_id=8de209e1f73e45d2a82d7d3fc9f0aca9, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:10.403606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dc0f9-a2e8-48c1-ae35-07d1d74cd646 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:10.430055 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1698/3408] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:02:10 2022] PUT /identity/v3/projects/3a4eebcc69ea4495bfdb9503d799a682/users/8de209e1f73e45d2a82d7d3fc9f0aca9/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:02:10.435945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c85054-59cc-451c-983a-657d34be36a1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:10.452055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c85054-59cc-451c-983a-657d34be36a1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:10.635931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d612e-4c3e-4818-b47f-9ad0ea182b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:10.637784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d612e-4c3e-4818-b47f-9ad0ea182b3f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:10.637784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d612e-4c3e-4818-b47f-9ad0ea182b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:10.638356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d612e-4c3e-4818-b47f-9ad0ea182b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:10.639135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d612e-4c3e-4818-b47f-9ad0ea182b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:10.641221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d612e-4c3e-4818-b47f-9ad0ea182b3f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:10.672059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dc0f9-a2e8-48c1-ae35-07d1d74cd646 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:10.682670 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1711/3409] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:10.689187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dc0f9-a2e8-48c1-ae35-07d1d74cd646 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:10.712687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21367f1-a5fd-4db0-80d7-94ea54b80108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:10.714812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21367f1-a5fd-4db0-80d7-94ea54b80108 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:10.715921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21367f1-a5fd-4db0-80d7-94ea54b80108 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:10.716420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21367f1-a5fd-4db0-80d7-94ea54b80108 admin admin] PATH_INFO: `/v3/projects/3a4eebcc69ea4495bfdb9503d799a682/users/8de209e1f73e45d2a82d7d3fc9f0aca9/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:10.719597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21367f1-a5fd-4db0-80d7-94ea54b80108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4eebcc69ea4495bfdb9503d799a682, user_id=8de209e1f73e45d2a82d7d3fc9f0aca9, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:10.723119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21367f1-a5fd-4db0-80d7-94ea54b80108 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:10.748936 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1699/3410] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:02:10 2022] PUT /identity/v3/projects/3a4eebcc69ea4495bfdb9503d799a682/users/8de209e1f73e45d2a82d7d3fc9f0aca9/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:02:10.847420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d612e-4c3e-4818-b47f-9ad0ea182b3f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:10.849402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c16d612e-4c3e-4818-b47f-9ad0ea182b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:11.071279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d612e-4c3e-4818-b47f-9ad0ea182b3f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:11.212828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:11.234910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d2cfc-431a-43fc-b37d-adbe10ce7895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:11.236495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d2cfc-431a-43fc-b37d-adbe10ce7895 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:11.236984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d2cfc-431a-43fc-b37d-adbe10ce7895 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:11.237508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d2cfc-431a-43fc-b37d-adbe10ce7895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:11.328254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d2cfc-431a-43fc-b37d-adbe10ce7895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:11.330384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d2cfc-431a-43fc-b37d-adbe10ce7895 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:11.343253 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1712/3411] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:13.869989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21367f1-a5fd-4db0-80d7-94ea54b80108 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:13.874688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b21367f1-a5fd-4db0-80d7-94ea54b80108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:14.129028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21367f1-a5fd-4db0-80d7-94ea54b80108 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:14.138496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a028a-3f9d-4e9d-97d8-f031b8fec6f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:14.139272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a028a-3f9d-4e9d-97d8-f031b8fec6f3 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:14.139557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a028a-3f9d-4e9d-97d8-f031b8fec6f3 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:14.139834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a028a-3f9d-4e9d-97d8-f031b8fec6f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:14.142422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e88a028a-3f9d-4e9d-97d8-f031b8fec6f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:14.172030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a028a-3f9d-4e9d-97d8-f031b8fec6f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:14.182195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a028a-3f9d-4e9d-97d8-f031b8fec6f3 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:14.202606 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1700/3412] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:20.501706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe25b5-0125-4e8c-8e18-f974e6766ee9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:20.502590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe25b5-0125-4e8c-8e18-f974e6766ee9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:20.503199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe25b5-0125-4e8c-8e18-f974e6766ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:20.539893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-31fe25b5-0125-4e8c-8e18-f974e6766ee9 None None] MFA Rules not processed for user `3afd4b10403a452e81f60f30ed5690f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:20.542953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-31fe25b5-0125-4e8c-8e18-f974e6766ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:20.630703 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1713/3413] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:23.162623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a028a-3f9d-4e9d-97d8-f031b8fec6f3 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:23.172196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e88a028a-3f9d-4e9d-97d8-f031b8fec6f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:23.324945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a028a-3f9d-4e9d-97d8-f031b8fec6f3 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:23.334168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e0618-f4bd-45af-8667-9361c22372ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:23.335786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e0618-f4bd-45af-8667-9361c22372ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:23.336514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e0618-f4bd-45af-8667-9361c22372ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:23.337050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e0618-f4bd-45af-8667-9361c22372ff admin admin] PATH_INFO: `/v3/users/a23efd87fea548e7a3a48d08d23812c7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:23.340586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e0618-f4bd-45af-8667-9361c22372ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23efd87fea548e7a3a48d08d23812c7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:23.350609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e0618-f4bd-45af-8667-9361c22372ff admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:23.462852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5d6e0618-f4bd-45af-8667-9361c22372ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23efd87fea548e7a3a48d08d23812c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:23.488602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5d6e0618-f4bd-45af-8667-9361c22372ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23efd87fea548e7a3a48d08d23812c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:23.489389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5d6e0618-f4bd-45af-8667-9361c22372ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23efd87fea548e7a3a48d08d23812c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:23.509257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:23.547555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5d6e0618-f4bd-45af-8667-9361c22372ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23efd87fea548e7a3a48d08d23812c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:23.571814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5d6e0618-f4bd-45af-8667-9361c22372ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23efd87fea548e7a3a48d08d23812c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:23.617310 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1701/3414] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:02:23 2022] DELETE /identity/v3/users/a23efd87fea548e7a3a48d08d23812c7 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:24.371748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe25b5-0125-4e8c-8e18-f974e6766ee9 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:24.400946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe25b5-0125-4e8c-8e18-f974e6766ee9 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:24.523779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06641e3-bcdb-43dc-8499-08267eec94c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:24.525037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06641e3-bcdb-43dc-8499-08267eec94c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:24.525684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06641e3-bcdb-43dc-8499-08267eec94c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:24.526303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06641e3-bcdb-43dc-8499-08267eec94c1 admin admin] PATH_INFO: `/v3/projects/ec82aa58d032474e8d3257b4652b1dd0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:24.530787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06641e3-bcdb-43dc-8499-08267eec94c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec82aa58d032474e8d3257b4652b1dd0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:24.537188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06641e3-bcdb-43dc-8499-08267eec94c1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:24.659021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:24.668840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f06641e3-bcdb-43dc-8499-08267eec94c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec82aa58d032474e8d3257b4652b1dd0', 'request_id': 'req-f06641e3-bcdb-43dc-8499-08267eec94c1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:24.677726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f06641e3-bcdb-43dc-8499-08267eec94c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec82aa58d032474e8d3257b4652b1dd0', 'request_id': 'req-f06641e3-bcdb-43dc-8499-08267eec94c1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:24.692533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f06641e3-bcdb-43dc-8499-08267eec94c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec82aa58d032474e8d3257b4652b1dd0', 'request_id': 'req-f06641e3-bcdb-43dc-8499-08267eec94c1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:24.710590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f06641e3-bcdb-43dc-8499-08267eec94c1 admin admin] The token cache is being invalidate because project ec82aa58d032474e8d3257b4652b1dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:02:24.711229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f06641e3-bcdb-43dc-8499-08267eec94c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:24.711978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f06641e3-bcdb-43dc-8499-08267eec94c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:24.714149 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1714/3415] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:02:24 2022] DELETE /identity/v3/projects/ec82aa58d032474e8d3257b4652b1dd0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:24.720367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea54d-9771-44e8-8f66-b6b8120e04c2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:24.720871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea54d-9771-44e8-8f66-b6b8120e04c2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:24.723265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ea54d-9771-44e8-8f66-b6b8120e04c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:24.805295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f97ea54d-9771-44e8-8f66-b6b8120e04c2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:24.806915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f97ea54d-9771-44e8-8f66-b6b8120e04c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:24.941401 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1702/3416] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:24.949562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb9cf6-4fab-444a-87af-fbf7eb912e2f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:24.949872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb9cf6-4fab-444a-87af-fbf7eb912e2f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:24.950279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb9cf6-4fab-444a-87af-fbf7eb912e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:24.972215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-65eb9cf6-4fab-444a-87af-fbf7eb912e2f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:24.973481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-65eb9cf6-4fab-444a-87af-fbf7eb912e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:24.983572 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1715/3417] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:24.989315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ea54d-9771-44e8-8f66-b6b8120e04c2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:25.003035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ea54d-9771-44e8-8f66-b6b8120e04c2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:25.007605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834bfec-7071-4a7d-adc5-cf9f32a7a1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:25.008387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834bfec-7071-4a7d-adc5-cf9f32a7a1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:25.009371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834bfec-7071-4a7d-adc5-cf9f32a7a1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:25.009724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834bfec-7071-4a7d-adc5-cf9f32a7a1c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:25.010461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834bfec-7071-4a7d-adc5-cf9f32a7a1c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:02:25.010880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834bfec-7071-4a7d-adc5-cf9f32a7a1c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:25.013199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834bfec-7071-4a7d-adc5-cf9f32a7a1c0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:25.030828 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1703/3418] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:02:25.033280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb9cf6-4fab-444a-87af-fbf7eb912e2f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:25.058123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb9cf6-4fab-444a-87af-fbf7eb912e2f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:25.067347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce73946-c2fa-4458-a0ad-fbcd15e6e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:25.067987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73946-c2fa-4458-a0ad-fbcd15e6e768 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:25.068263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73946-c2fa-4458-a0ad-fbcd15e6e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:25.068924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73946-c2fa-4458-a0ad-fbcd15e6e768 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:25.069197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce73946-c2fa-4458-a0ad-fbcd15e6e768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:25.071176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce73946-c2fa-4458-a0ad-fbcd15e6e768 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:25.112441 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1716/3419] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:02:25 2022] POST /identity/v3/projects => generated 381 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:02:25.115193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834bfec-7071-4a7d-adc5-cf9f32a7a1c0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:25.149439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834bfec-7071-4a7d-adc5-cf9f32a7a1c0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:25.235914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179759d-aefa-4828-9fcd-9f5d2b0be1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:25.238229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179759d-aefa-4828-9fcd-9f5d2b0be1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:25.238613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179759d-aefa-4828-9fcd-9f5d2b0be1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:25.239866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179759d-aefa-4828-9fcd-9f5d2b0be1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:25.242037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179759d-aefa-4828-9fcd-9f5d2b0be1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:25.244321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179759d-aefa-4828-9fcd-9f5d2b0be1b3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:25.260945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce73946-c2fa-4458-a0ad-fbcd15e6e768 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:25.264272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ce73946-c2fa-4458-a0ad-fbcd15e6e768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:25.293146 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1704/3420] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:02:25 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:25.295446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179759d-aefa-4828-9fcd-9f5d2b0be1b3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:25.320245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179759d-aefa-4828-9fcd-9f5d2b0be1b3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:25.338579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861de7b-17ec-4345-9ea2-a0e147c05348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:25.339419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861de7b-17ec-4345-9ea2-a0e147c05348 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:25.340621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861de7b-17ec-4345-9ea2-a0e147c05348 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:25.342379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861de7b-17ec-4345-9ea2-a0e147c05348 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:25.343335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861de7b-17ec-4345-9ea2-a0e147c05348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:25.348807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861de7b-17ec-4345-9ea2-a0e147c05348 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:25.383784 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1705/3421] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:25.384812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861de7b-17ec-4345-9ea2-a0e147c05348 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:25.423591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861de7b-17ec-4345-9ea2-a0e147c05348 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:25.429172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce73946-c2fa-4458-a0ad-fbcd15e6e768 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:25.441061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aadde-fdd4-452b-b006-bb94e1c91181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:25.442422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aadde-fdd4-452b-b006-bb94e1c91181 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:25.444186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aadde-fdd4-452b-b006-bb94e1c91181 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:25.445066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d745b5a-1c6d-4dc0-aa45-9a80929f3286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:25.445500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263aadde-fdd4-452b-b006-bb94e1c91181 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:25.446253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263aadde-fdd4-452b-b006-bb94e1c91181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:25.448354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d745b5a-1c6d-4dc0-aa45-9a80929f3286 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:25.449161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d745b5a-1c6d-4dc0-aa45-9a80929f3286 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:25.451261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263aadde-fdd4-452b-b006-bb94e1c91181 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:25.451804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d745b5a-1c6d-4dc0-aa45-9a80929f3286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:25.459159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5d745b5a-1c6d-4dc0-aa45-9a80929f3286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:25.480536 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1706/3422] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:25.481850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aadde-fdd4-452b-b006-bb94e1c91181 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:25.483351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d745b5a-1c6d-4dc0-aa45-9a80929f3286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:25.484833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d745b5a-1c6d-4dc0-aa45-9a80929f3286 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:25.504617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263aadde-fdd4-452b-b006-bb94e1c91181 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:25.521579 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1717/3423] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:25.544218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733a6e4-783a-4d84-8114-79df0f44d996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:25.545235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733a6e4-783a-4d84-8114-79df0f44d996 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:25.545696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733a6e4-783a-4d84-8114-79df0f44d996 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:25.546175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733a6e4-783a-4d84-8114-79df0f44d996 admin admin] PATH_INFO: `/v3/projects/3605de1becdf4bc6a03c330a11ac352e/users/8fcb9c34c18349e8a193f1309f56c3fa/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:25.568634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733a6e4-783a-4d84-8114-79df0f44d996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3605de1becdf4bc6a03c330a11ac352e, user_id=8fcb9c34c18349e8a193f1309f56c3fa, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:25.573027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733a6e4-783a-4d84-8114-79df0f44d996 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:25.607183 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1707/3424] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:02:25 2022] PUT /identity/v3/projects/3605de1becdf4bc6a03c330a11ac352e/users/8fcb9c34c18349e8a193f1309f56c3fa/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:25.612126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749efdcd-6609-43a3-b096-398b9c8dc069 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:25.612412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749efdcd-6609-43a3-b096-398b9c8dc069 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:25.612693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749efdcd-6609-43a3-b096-398b9c8dc069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:25.641127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-749efdcd-6609-43a3-b096-398b9c8dc069 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:25.643471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-749efdcd-6609-43a3-b096-398b9c8dc069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:25.735273 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1718/3425] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:25.748054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733a6e4-783a-4d84-8114-79df0f44d996 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:25.750477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3733a6e4-783a-4d84-8114-79df0f44d996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:25.781970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:25.887672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733a6e4-783a-4d84-8114-79df0f44d996 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:25.892991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef13c9d-3eb9-45be-b6ce-754351e9e913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:25.893931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef13c9d-3eb9-45be-b6ce-754351e9e913 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:25.894396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef13c9d-3eb9-45be-b6ce-754351e9e913 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:25.894982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef13c9d-3eb9-45be-b6ce-754351e9e913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:25.950702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef13c9d-3eb9-45be-b6ce-754351e9e913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:25.964510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef13c9d-3eb9-45be-b6ce-754351e9e913 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:26.018506 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1708/3426] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:02:26.455220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f3318-3059-4a80-9fb7-3f5902a9888f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:26.458380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f3318-3059-4a80-9fb7-3f5902a9888f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:26.459318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f3318-3059-4a80-9fb7-3f5902a9888f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:26.539340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-dc5f3318-3059-4a80-9fb7-3f5902a9888f None None] MFA Rules not processed for user `8de209e1f73e45d2a82d7d3fc9f0aca9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:26.540796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dc5f3318-3059-4a80-9fb7-3f5902a9888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:26.646287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:26.747510 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1719/3427] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:26 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:26.766682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef13c9d-3eb9-45be-b6ce-754351e9e913 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:26.768515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6ef13c9d-3eb9-45be-b6ce-754351e9e913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:26.961374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef13c9d-3eb9-45be-b6ce-754351e9e913 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:26.986193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d542c6-c40e-4174-8070-dfb23ec84372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:26.986970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d542c6-c40e-4174-8070-dfb23ec84372 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:26.987500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d542c6-c40e-4174-8070-dfb23ec84372 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:26.987921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d542c6-c40e-4174-8070-dfb23ec84372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:26.992372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-96d542c6-c40e-4174-8070-dfb23ec84372 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:27.182288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d542c6-c40e-4174-8070-dfb23ec84372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:27.188777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d542c6-c40e-4174-8070-dfb23ec84372 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:27.210666 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1709/3428] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:29.924202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f3318-3059-4a80-9fb7-3f5902a9888f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:29.926200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dc5f3318-3059-4a80-9fb7-3f5902a9888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:30.183209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f3318-3059-4a80-9fb7-3f5902a9888f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:30.205356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c961c-2f67-4d50-8d95-794b398c00e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:30.205842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c961c-2f67-4d50-8d95-794b398c00e2 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:30.206131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c961c-2f67-4d50-8d95-794b398c00e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:30.206411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c961c-2f67-4d50-8d95-794b398c00e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:30.212475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c40c961c-2f67-4d50-8d95-794b398c00e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:30.244389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c961c-2f67-4d50-8d95-794b398c00e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:30.251784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c961c-2f67-4d50-8d95-794b398c00e2 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:30.301220 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1720/3429] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:31.320646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d542c6-c40e-4174-8070-dfb23ec84372 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:31.322136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-96d542c6-c40e-4174-8070-dfb23ec84372 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:31.356261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d542c6-c40e-4174-8070-dfb23ec84372 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:31.372612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11000880-f5a1-4a48-8358-75fd9b2b3379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:31.373802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11000880-f5a1-4a48-8358-75fd9b2b3379 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:31.374239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11000880-f5a1-4a48-8358-75fd9b2b3379 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:31.375366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11000880-f5a1-4a48-8358-75fd9b2b3379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:31.384348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-11000880-f5a1-4a48-8358-75fd9b2b3379 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:31.553502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11000880-f5a1-4a48-8358-75fd9b2b3379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:31.560314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11000880-f5a1-4a48-8358-75fd9b2b3379 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:31.590315 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1710/3430] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:33.381262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c961c-2f67-4d50-8d95-794b398c00e2 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:33.404160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c961c-2f67-4d50-8d95-794b398c00e2 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:33.421875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9406e-2ab0-4814-8f44-9c061a50a24b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:33.422511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9406e-2ab0-4814-8f44-9c061a50a24b service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:33.422829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9406e-2ab0-4814-8f44-9c061a50a24b service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:33.423108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9406e-2ab0-4814-8f44-9c061a50a24b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:33.429337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-faf9406e-2ab0-4814-8f44-9c061a50a24b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:33.479340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9406e-2ab0-4814-8f44-9c061a50a24b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:33.486386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9406e-2ab0-4814-8f44-9c061a50a24b service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:33.514343 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1721/3431] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:35.448299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da94f-75af-48f9-b051-9261afcb841a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:35.448895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da94f-75af-48f9-b051-9261afcb841a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:35.449042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253da94f-75af-48f9-b051-9261afcb841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:35.465909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:35.571963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-253da94f-75af-48f9-b051-9261afcb841a None None] MFA Rules not processed for user `8fcb9c34c18349e8a193f1309f56c3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:35.578426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-253da94f-75af-48f9-b051-9261afcb841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:35.757925 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1711/3432] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:35.768711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048a40d-a98d-4e67-b26e-d7a420d8b4d0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:35.769265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048a40d-a98d-4e67-b26e-d7a420d8b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:35.769265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048a40d-a98d-4e67-b26e-d7a420d8b4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:35.837934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a048a40d-a98d-4e67-b26e-d7a420d8b4d0 None None] MFA Rules not processed for user `8fcb9c34c18349e8a193f1309f56c3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:35.844804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a048a40d-a98d-4e67-b26e-d7a420d8b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:35.884036 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1722/3433] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:36.075115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253da94f-75af-48f9-b051-9261afcb841a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:36.100631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253da94f-75af-48f9-b051-9261afcb841a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:36.115058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbaa6e-6e4c-4102-838c-894859e58bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:36.115705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbaa6e-6e4c-4102-838c-894859e58bc1 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:36.116759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbaa6e-6e4c-4102-838c-894859e58bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:36.117047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbaa6e-6e4c-4102-838c-894859e58bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:36.136862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbaa6e-6e4c-4102-838c-894859e58bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:36.142047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbaa6e-6e4c-4102-838c-894859e58bc1 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:36.180640 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1712/3434] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:44.459423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6b0da-81dd-4ef7-ba14-cf580042ee8b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:44.460433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6b0da-81dd-4ef7-ba14-cf580042ee8b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:44.460988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6b0da-81dd-4ef7-ba14-cf580042ee8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:44.488300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2ff6b0da-81dd-4ef7-ba14-cf580042ee8b None None] MFA Rules not processed for user `3afd4b10403a452e81f60f30ed5690f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:44.491586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2ff6b0da-81dd-4ef7-ba14-cf580042ee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:44.618051 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1723/3435] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:02:44.821635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fee7c1-3caa-4069-8f90-7a1688513fea None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:44.822179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fee7c1-3caa-4069-8f90-7a1688513fea None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:44.822179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fee7c1-3caa-4069-8f90-7a1688513fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:44.863489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-46fee7c1-3caa-4069-8f90-7a1688513fea None None] MFA Rules not processed for user `8dbb8a95851248bfabd9a1afe40fc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:44.865504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-46fee7c1-3caa-4069-8f90-7a1688513fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:45.036880 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1713/3436] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:47.066397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6b0da-81dd-4ef7-ba14-cf580042ee8b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:47.068439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2ff6b0da-81dd-4ef7-ba14-cf580042ee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:47.095507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6b0da-81dd-4ef7-ba14-cf580042ee8b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:47.107034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:47.108676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:47.109746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:47.110797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] PATH_INFO: `/v3/users/6b4aa532a1844e298d1acc95944e68a0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:47.113290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4aa532a1844e298d1acc95944e68a0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:47.119515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:47.222469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:47.273513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4aa532a1844e298d1acc95944e68a0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:47.298494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4aa532a1844e298d1acc95944e68a0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:47.300985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4aa532a1844e298d1acc95944e68a0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:47.321987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4aa532a1844e298d1acc95944e68a0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:47.326151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4aa532a1844e298d1acc95944e68a0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:47.380216 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1724/3437] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:02:47 2022] DELETE /identity/v3/users/6b4aa532a1844e298d1acc95944e68a0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:47.381437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236a1ac-7d3c-40e3-b2b1-ee76d8435db5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:47.382078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236a1ac-7d3c-40e3-b2b1-ee76d8435db5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:47.382452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236a1ac-7d3c-40e3-b2b1-ee76d8435db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:47.426315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0236a1ac-7d3c-40e3-b2b1-ee76d8435db5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:47.428928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0236a1ac-7d3c-40e3-b2b1-ee76d8435db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:47.569983 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1714/3438] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:02:47.654242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:47.656099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:47.833534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc5426-e123-4001-ba78-326bb56c2ed0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:47.838105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa95a2b-a006-41ff-9d3e-a9cc93789335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:47.838719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa95a2b-a006-41ff-9d3e-a9cc93789335 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:47.839041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa95a2b-a006-41ff-9d3e-a9cc93789335 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:47.839429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa95a2b-a006-41ff-9d3e-a9cc93789335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:47.849971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa95a2b-a006-41ff-9d3e-a9cc93789335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:47.851444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa95a2b-a006-41ff-9d3e-a9cc93789335 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:47.866598 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1725/3439] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:48.457572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236a1ac-7d3c-40e3-b2b1-ee76d8435db5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:48.459280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0236a1ac-7d3c-40e3-b2b1-ee76d8435db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:48.550709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:48.671911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236a1ac-7d3c-40e3-b2b1-ee76d8435db5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:48.687333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa19d2-4c58-46fd-9b55-ab7a1dea5d7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:48.689456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa19d2-4c58-46fd-9b55-ab7a1dea5d7a service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:48.689739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa19d2-4c58-46fd-9b55-ab7a1dea5d7a service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:48.694060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa19d2-4c58-46fd-9b55-ab7a1dea5d7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:48.695842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-02fa19d2-4c58-46fd-9b55-ab7a1dea5d7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:48.729591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa19d2-4c58-46fd-9b55-ab7a1dea5d7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:48.734394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa19d2-4c58-46fd-9b55-ab7a1dea5d7a service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:48.762228 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1715/3440] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:48.849741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451d0fc-e4e0-4af0-a480-f18d9c41557a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:48.849741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451d0fc-e4e0-4af0-a480-f18d9c41557a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:48.849741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451d0fc-e4e0-4af0-a480-f18d9c41557a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:48.902088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4451d0fc-e4e0-4af0-a480-f18d9c41557a None None] MFA Rules not processed for user `8dbb8a95851248bfabd9a1afe40fc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:48.908101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4451d0fc-e4e0-4af0-a480-f18d9c41557a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:48.986212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa19d2-4c58-46fd-9b55-ab7a1dea5d7a service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:48.987871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-02fa19d2-4c58-46fd-9b55-ab7a1dea5d7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:49.037050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa19d2-4c58-46fd-9b55-ab7a1dea5d7a service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:49.056520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:49.059456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:49.059912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:49.062571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1 admin admin] PATH_INFO: `/v3/projects/8681d6e7b81f4ff3b89e30ac0ae06dce` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:49.084348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8681d6e7b81f4ff3b89e30ac0ae06dce)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:49.093723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:49.107015 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1726/3441] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:49.216803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8681d6e7b81f4ff3b89e30ac0ae06dce', 'request_id': 'req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:49.248301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8681d6e7b81f4ff3b89e30ac0ae06dce', 'request_id': 'req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:49.264384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8681d6e7b81f4ff3b89e30ac0ae06dce', 'request_id': 'req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:49.291632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1 admin admin] The token cache is being invalidate because project 8681d6e7b81f4ff3b89e30ac0ae06dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:02:49.292675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:49.293787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-940e23d2-692a-4b9e-b9c4-f113d32cc6c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:49.296384 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1716/3442] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:02:48 2022] DELETE /identity/v3/projects/8681d6e7b81f4ff3b89e30ac0ae06dce => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:02:49.303052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ce5d1-5333-408d-89f2-040efdf1a824 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:49.304757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ce5d1-5333-408d-89f2-040efdf1a824 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:49.305474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ce5d1-5333-408d-89f2-040efdf1a824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:49.338008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c15ce5d1-5333-408d-89f2-040efdf1a824 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:49.343942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c15ce5d1-5333-408d-89f2-040efdf1a824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:49.489747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:49.550998 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1727/3443] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:49.556342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c37268-5c25-45be-9db4-1be5dc0335a9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:49.557155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c37268-5c25-45be-9db4-1be5dc0335a9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:49.557588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c37268-5c25-45be-9db4-1be5dc0335a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:49.616571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-60c37268-5c25-45be-9db4-1be5dc0335a9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:49.617817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-60c37268-5c25-45be-9db4-1be5dc0335a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:49.629745 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1717/3444] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:49.634417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ce5d1-5333-408d-89f2-040efdf1a824 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:49.652373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ce5d1-5333-408d-89f2-040efdf1a824 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:49.658646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ace8d3-e090-408c-82ce-acc4c33ea53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:49.660797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ace8d3-e090-408c-82ce-acc4c33ea53a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:49.661179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ace8d3-e090-408c-82ce-acc4c33ea53a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:49.661698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ace8d3-e090-408c-82ce-acc4c33ea53a admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:49.663049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ace8d3-e090-408c-82ce-acc4c33ea53a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:02:49.663621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ace8d3-e090-408c-82ce-acc4c33ea53a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:49.671463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ace8d3-e090-408c-82ce-acc4c33ea53a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:49.689751 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1728/3445] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:02:49.691809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c37268-5c25-45be-9db4-1be5dc0335a9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:49.723668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c37268-5c25-45be-9db4-1be5dc0335a9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:49.747945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0235000-c4f3-423d-9abf-ce29e822ef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:49.748677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0235000-c4f3-423d-9abf-ce29e822ef60 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:49.749112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0235000-c4f3-423d-9abf-ce29e822ef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:49.749477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0235000-c4f3-423d-9abf-ce29e822ef60 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:49.750135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0235000-c4f3-423d-9abf-ce29e822ef60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:49.754736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0235000-c4f3-423d-9abf-ce29e822ef60 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:49.805291 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1718/3446] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:02:49 2022] POST /identity/v3/projects => generated 403 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:49.809580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ace8d3-e090-408c-82ce-acc4c33ea53a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:49.821744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ace8d3-e090-408c-82ce-acc4c33ea53a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:50.047627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938595a-6b17-4852-8504-8a292d5dd49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:50.048284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938595a-6b17-4852-8504-8a292d5dd49b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:50.048526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938595a-6b17-4852-8504-8a292d5dd49b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:50.048804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938595a-6b17-4852-8504-8a292d5dd49b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:50.049460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938595a-6b17-4852-8504-8a292d5dd49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:50.051464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938595a-6b17-4852-8504-8a292d5dd49b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:50.122347 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1729/3447] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:02:49 2022] POST /identity/v3/users => generated 302 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:50.123824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0235000-c4f3-423d-9abf-ce29e822ef60 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:50.137450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0235000-c4f3-423d-9abf-ce29e822ef60 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:50.147715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938595a-6b17-4852-8504-8a292d5dd49b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:50.149480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8938595a-6b17-4852-8504-8a292d5dd49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:50.155807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009ac86-89fa-4910-9800-54610017ed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:50.155807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009ac86-89fa-4910-9800-54610017ed74 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:50.158528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009ac86-89fa-4910-9800-54610017ed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:50.159781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009ac86-89fa-4910-9800-54610017ed74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:50.160573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009ac86-89fa-4910-9800-54610017ed74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:50.164603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009ac86-89fa-4910-9800-54610017ed74 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:50.191274 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1719/3448] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:50.192730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009ac86-89fa-4910-9800-54610017ed74 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:50.242894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009ac86-89fa-4910-9800-54610017ed74 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:50.260933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474238f-9f06-48eb-9e40-8abe77590fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:50.263435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474238f-9f06-48eb-9e40-8abe77590fbc admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:50.263728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474238f-9f06-48eb-9e40-8abe77590fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:50.264005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474238f-9f06-48eb-9e40-8abe77590fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:50.264807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474238f-9f06-48eb-9e40-8abe77590fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:50.266439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474238f-9f06-48eb-9e40-8abe77590fbc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:50.283719 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1720/3449] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:50.285747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474238f-9f06-48eb-9e40-8abe77590fbc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:50.287527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9474238f-9f06-48eb-9e40-8abe77590fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:50.309580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474238f-9f06-48eb-9e40-8abe77590fbc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:50.314644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd06f47-f191-489c-ab47-a6cef534f14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:50.314922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938595a-6b17-4852-8504-8a292d5dd49b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:50.315242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd06f47-f191-489c-ab47-a6cef534f14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:50.315524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd06f47-f191-489c-ab47-a6cef534f14d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:50.315786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd06f47-f191-489c-ab47-a6cef534f14d admin admin] PATH_INFO: `/v3/users/ea4e121ce0184fb98e373da8fd5eb42a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:50.317256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd06f47-f191-489c-ab47-a6cef534f14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea4e121ce0184fb98e373da8fd5eb42a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:50.319212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd06f47-f191-489c-ab47-a6cef534f14d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:50.332651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7af81-7d4b-4195-bec0-d66c4b33d00d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:50.333287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7af81-7d4b-4195-bec0-d66c4b33d00d service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:50.333582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7af81-7d4b-4195-bec0-d66c4b33d00d service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:50.333931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7af81-7d4b-4195-bec0-d66c4b33d00d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:50.335790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e9d7af81-7d4b-4195-bec0-d66c4b33d00d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:50.368364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7af81-7d4b-4195-bec0-d66c4b33d00d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:50.374584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7af81-7d4b-4195-bec0-d66c4b33d00d service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:50.400071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:50.410868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5fd06f47-f191-489c-ab47-a6cef534f14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea4e121ce0184fb98e373da8fd5eb42a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:50.422065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5fd06f47-f191-489c-ab47-a6cef534f14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea4e121ce0184fb98e373da8fd5eb42a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:50.423366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5fd06f47-f191-489c-ab47-a6cef534f14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea4e121ce0184fb98e373da8fd5eb42a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:50.425373 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1730/3450] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:50.427528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7af81-7d4b-4195-bec0-d66c4b33d00d service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:50.460107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7af81-7d4b-4195-bec0-d66c4b33d00d service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:50.468134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5fd06f47-f191-489c-ab47-a6cef534f14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea4e121ce0184fb98e373da8fd5eb42a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:50.469139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5fd06f47-f191-489c-ab47-a6cef534f14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea4e121ce0184fb98e373da8fd5eb42a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:50.472721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14a7ce-4745-4ac3-bc63-ff33753c9bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:50.476023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14a7ce-4745-4ac3-bc63-ff33753c9bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:50.477024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14a7ce-4745-4ac3-bc63-ff33753c9bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:50.478091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14a7ce-4745-4ac3-bc63-ff33753c9bf8 admin admin] PATH_INFO: `/v3/projects/0cda00e3c37c4fafb3c63a4c7c6ca20c/users/cf21e0da4c9045cf8eb49fdff6f0aba7/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:50.497195 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1721/3451] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:02:50 2022] DELETE /identity/v3/users/ea4e121ce0184fb98e373da8fd5eb42a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:50.532083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14a7ce-4745-4ac3-bc63-ff33753c9bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cda00e3c37c4fafb3c63a4c7c6ca20c, user_id=cf21e0da4c9045cf8eb49fdff6f0aba7, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:50.534512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14a7ce-4745-4ac3-bc63-ff33753c9bf8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:50.559594 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1731/3452] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:02:50 2022] PUT /identity/v3/projects/0cda00e3c37c4fafb3c63a4c7c6ca20c/users/cf21e0da4c9045cf8eb49fdff6f0aba7/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:50.571676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0cf5c-9171-4bc1-8a9a-78076abdd507 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:50.574371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0cf5c-9171-4bc1-8a9a-78076abdd507 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:50.574949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0cf5c-9171-4bc1-8a9a-78076abdd507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:50.618043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-90d0cf5c-9171-4bc1-8a9a-78076abdd507 None None] MFA Rules not processed for user `cf21e0da4c9045cf8eb49fdff6f0aba7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:50.621587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-90d0cf5c-9171-4bc1-8a9a-78076abdd507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:50.867569 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1722/3453] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:50.986465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14a7ce-4745-4ac3-bc63-ff33753c9bf8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:50.988483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ff14a7ce-4745-4ac3-bc63-ff33753c9bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:51.106869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:51.165457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14a7ce-4745-4ac3-bc63-ff33753c9bf8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:51.180274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:51.180935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:51.181231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:51.181505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] PATH_INFO: `/v3/projects/55ce8d87470a49268ce76dd08c5be965` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:51.188099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ce8d87470a49268ce76dd08c5be965)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:51.206464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:51.310100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ce8d87470a49268ce76dd08c5be965', 'request_id': 'req-cb24b49a-4057-4a02-a36f-5cc0b9228672'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:51.322463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ce8d87470a49268ce76dd08c5be965', 'request_id': 'req-cb24b49a-4057-4a02-a36f-5cc0b9228672'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:51.343248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ce8d87470a49268ce76dd08c5be965', 'request_id': 'req-cb24b49a-4057-4a02-a36f-5cc0b9228672'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:51.370029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] The token cache is being invalidate because project 55ce8d87470a49268ce76dd08c5be965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:02:51.375183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:51.379474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:51.381190 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1732/3454] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:02:50 2022] DELETE /identity/v3/projects/55ce8d87470a49268ce76dd08c5be965 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:51.390039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eaf81-d337-42ce-9507-de6fbfca7129 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:51.390433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eaf81-d337-42ce-9507-de6fbfca7129 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:51.390948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eaf81-d337-42ce-9507-de6fbfca7129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:51.441310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-061eaf81-d337-42ce-9507-de6fbfca7129 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:51.444277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-061eaf81-d337-42ce-9507-de6fbfca7129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:51.449743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:51.451502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:51.608437 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1723/3455] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:51.615734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb5fca-62a7-4846-8acc-6e16c6ac5737 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:51.616028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb5fca-62a7-4846-8acc-6e16c6ac5737 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:51.616310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb5fca-62a7-4846-8acc-6e16c6ac5737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:51.643650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24b49a-4057-4a02-a36f-5cc0b9228672 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:51.657179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94701998-4994-4cf4-8cf1-4ee3fc29044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:51.657962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94701998-4994-4cf4-8cf1-4ee3fc29044f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:51.658339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94701998-4994-4cf4-8cf1-4ee3fc29044f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:51.660251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94701998-4994-4cf4-8cf1-4ee3fc29044f admin admin] PATH_INFO: `/v3/users/cf21e0da4c9045cf8eb49fdff6f0aba7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:51.661543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94701998-4994-4cf4-8cf1-4ee3fc29044f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf21e0da4c9045cf8eb49fdff6f0aba7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:51.661780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b1fb5fca-62a7-4846-8acc-6e16c6ac5737 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:51.663200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b1fb5fca-62a7-4846-8acc-6e16c6ac5737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:51.663842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94701998-4994-4cf4-8cf1-4ee3fc29044f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:51.681179 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1724/3456] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:02:51.686394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb5fca-62a7-4846-8acc-6e16c6ac5737 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:51.721905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb5fca-62a7-4846-8acc-6e16c6ac5737 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:51.733677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-94701998-4994-4cf4-8cf1-4ee3fc29044f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf21e0da4c9045cf8eb49fdff6f0aba7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:51.736609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac58d3b-691b-488d-9b7e-8866b627ae8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:51.739066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac58d3b-691b-488d-9b7e-8866b627ae8f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:51.739356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac58d3b-691b-488d-9b7e-8866b627ae8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:51.739641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac58d3b-691b-488d-9b7e-8866b627ae8f admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:51.740398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac58d3b-691b-488d-9b7e-8866b627ae8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:02:51.740707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac58d3b-691b-488d-9b7e-8866b627ae8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:51.742354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac58d3b-691b-488d-9b7e-8866b627ae8f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:51.766908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-94701998-4994-4cf4-8cf1-4ee3fc29044f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf21e0da4c9045cf8eb49fdff6f0aba7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:51.768176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-94701998-4994-4cf4-8cf1-4ee3fc29044f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf21e0da4c9045cf8eb49fdff6f0aba7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:51.795810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-94701998-4994-4cf4-8cf1-4ee3fc29044f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf21e0da4c9045cf8eb49fdff6f0aba7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:51.796593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-94701998-4994-4cf4-8cf1-4ee3fc29044f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf21e0da4c9045cf8eb49fdff6f0aba7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:51.810165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:51.812337 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1725/3457] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:02:51.816331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac58d3b-691b-488d-9b7e-8866b627ae8f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:51.818355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bac58d3b-691b-488d-9b7e-8866b627ae8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:51.837124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac58d3b-691b-488d-9b7e-8866b627ae8f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:51.843341 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1733/3458] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:02:51 2022] DELETE /identity/v3/users/cf21e0da4c9045cf8eb49fdff6f0aba7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:51.844821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355223f-0564-4faf-84fd-385dc0b46fc4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:51.845103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355223f-0564-4faf-84fd-385dc0b46fc4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:51.847067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355223f-0564-4faf-84fd-385dc0b46fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:51.930225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0355223f-0564-4faf-84fd-385dc0b46fc4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:51.935530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0355223f-0564-4faf-84fd-385dc0b46fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:51.955163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:52.041187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e6a5a-f558-4f22-8b98-a8c9d5a227e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:52.041829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e6a5a-f558-4f22-8b98-a8c9d5a227e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:52.042118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e6a5a-f558-4f22-8b98-a8c9d5a227e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:52.043677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e6a5a-f558-4f22-8b98-a8c9d5a227e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:52.048875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e6a5a-f558-4f22-8b98-a8c9d5a227e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:52.054808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e6a5a-f558-4f22-8b98-a8c9d5a227e7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:52.129864 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1734/3459] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:52.136855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355223f-0564-4faf-84fd-385dc0b46fc4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:52.139337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0355223f-0564-4faf-84fd-385dc0b46fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:52.152907 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1726/3460] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:02:51 2022] POST /identity/v3/projects => generated 387 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:52.153895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e6a5a-f558-4f22-8b98-a8c9d5a227e7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:52.344092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355223f-0564-4faf-84fd-385dc0b46fc4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:52.359052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e6a5a-f558-4f22-8b98-a8c9d5a227e7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:52.373064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c88a89-8043-40bc-abcf-5f11dacda60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:52.374240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c88a89-8043-40bc-abcf-5f11dacda60d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:52.374526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c88a89-8043-40bc-abcf-5f11dacda60d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:52.374827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c88a89-8043-40bc-abcf-5f11dacda60d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:52.375471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c88a89-8043-40bc-abcf-5f11dacda60d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:52.382921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c88a89-8043-40bc-abcf-5f11dacda60d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:52.435276 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1727/3461] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:02:52 2022] POST /identity/v3/users => generated 294 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:52.437092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c88a89-8043-40bc-abcf-5f11dacda60d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:52.458471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290bdf0-4a4c-4849-8a44-36f5a7c43477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:52.459152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290bdf0-4a4c-4849-8a44-36f5a7c43477 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:52.459510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290bdf0-4a4c-4849-8a44-36f5a7c43477 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:52.459852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290bdf0-4a4c-4849-8a44-36f5a7c43477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:52.468076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c88a89-8043-40bc-abcf-5f11dacda60d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:52.471778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290bdf0-4a4c-4849-8a44-36f5a7c43477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:52.482774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290bdf0-4a4c-4849-8a44-36f5a7c43477 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:52.489585 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1735/3462] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:02:52.501966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6859c-7c02-41ef-8003-321dc96a3f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:52.503107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6859c-7c02-41ef-8003-321dc96a3f91 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:52.504163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6859c-7c02-41ef-8003-321dc96a3f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:52.504437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6859c-7c02-41ef-8003-321dc96a3f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:52.505492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6859c-7c02-41ef-8003-321dc96a3f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:52.515196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6859c-7c02-41ef-8003-321dc96a3f91 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:52.547633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290bdf0-4a4c-4849-8a44-36f5a7c43477 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:52.547968 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1728/3463] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:52.580410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290bdf0-4a4c-4849-8a44-36f5a7c43477 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:52.587829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d849bf8-d88f-4fd9-8220-38df7a16f528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:52.590619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d849bf8-d88f-4fd9-8220-38df7a16f528 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:52.591440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d849bf8-d88f-4fd9-8220-38df7a16f528 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:52.591804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d849bf8-d88f-4fd9-8220-38df7a16f528 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:52.592617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d849bf8-d88f-4fd9-8220-38df7a16f528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:52.596185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d849bf8-d88f-4fd9-8220-38df7a16f528 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:52.655332 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1736/3464] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:52.658878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6859c-7c02-41ef-8003-321dc96a3f91 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:52.677595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6859c-7c02-41ef-8003-321dc96a3f91 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:52.700799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd4c95-280c-43cd-aa25-5e08205fbad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:52.701750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd4c95-280c-43cd-aa25-5e08205fbad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:52.702343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd4c95-280c-43cd-aa25-5e08205fbad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:52.705349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd4c95-280c-43cd-aa25-5e08205fbad3 admin admin] PATH_INFO: `/v3/projects/8954f67edddb46d2b47556b3dd04091e/users/34e0fcf65bd04c148f884037e16b3c09/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:52.757809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd4c95-280c-43cd-aa25-5e08205fbad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8954f67edddb46d2b47556b3dd04091e, user_id=34e0fcf65bd04c148f884037e16b3c09, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:52.760637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd4c95-280c-43cd-aa25-5e08205fbad3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:52.806970 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1729/3465] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:02:52 2022] PUT /identity/v3/projects/8954f67edddb46d2b47556b3dd04091e/users/34e0fcf65bd04c148f884037e16b3c09/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:52.809968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae379d-2013-48b1-8d22-c8f58c4e7bbe None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:52.810458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae379d-2013-48b1-8d22-c8f58c4e7bbe None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:52.810933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae379d-2013-48b1-8d22-c8f58c4e7bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:52.856925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-84ae379d-2013-48b1-8d22-c8f58c4e7bbe None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:52.858294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-84ae379d-2013-48b1-8d22-c8f58c4e7bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:52.960078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:53.038537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd4c95-280c-43cd-aa25-5e08205fbad3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:53.044002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3bfd4c95-280c-43cd-aa25-5e08205fbad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:53.098370 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1737/3466] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:53.111360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae379d-2013-48b1-8d22-c8f58c4e7bbe None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:53.221000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd4c95-280c-43cd-aa25-5e08205fbad3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:53.229053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:53.229781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:53.230615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:53.231158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0 admin admin] PATH_INFO: `/v3/projects/0cda00e3c37c4fafb3c63a4c7c6ca20c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:53.233698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cda00e3c37c4fafb3c63a4c7c6ca20c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:53.235849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:53.254965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae379d-2013-48b1-8d22-c8f58c4e7bbe None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:53.260386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e16d1f-e8fb-403c-b91a-59958516eeca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:53.262321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e16d1f-e8fb-403c-b91a-59958516eeca service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:53.262712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e16d1f-e8fb-403c-b91a-59958516eeca service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:53.263411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e16d1f-e8fb-403c-b91a-59958516eeca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:53.276163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:53.276754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e16d1f-e8fb-403c-b91a-59958516eeca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:53.279021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e16d1f-e8fb-403c-b91a-59958516eeca service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:53.300994 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1738/3467] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:02:53.403730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cda00e3c37c4fafb3c63a4c7c6ca20c', 'request_id': 'req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:53.431674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cda00e3c37c4fafb3c63a4c7c6ca20c', 'request_id': 'req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:53.455572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cda00e3c37c4fafb3c63a4c7c6ca20c', 'request_id': 'req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:53.497421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0 admin admin] The token cache is being invalidate because project 0cda00e3c37c4fafb3c63a4c7c6ca20c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:02:53.497936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:53.500814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3dcdd91b-14fa-4b9e-957d-47bcc817b1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:53.503601 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1730/3468] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:02:53 2022] DELETE /identity/v3/projects/0cda00e3c37c4fafb3c63a4c7c6ca20c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:53.517564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092d9f7-d113-4638-b3f8-1a1c9afb4007 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:53.517922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092d9f7-d113-4638-b3f8-1a1c9afb4007 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:53.518121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092d9f7-d113-4638-b3f8-1a1c9afb4007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:53.576459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d092d9f7-d113-4638-b3f8-1a1c9afb4007 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:53.578592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d092d9f7-d113-4638-b3f8-1a1c9afb4007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:53.801387 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1739/3469] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:53.813310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cd19b-bd93-48c7-a4bc-89bc273a4954 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:53.813875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cd19b-bd93-48c7-a4bc-89bc273a4954 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:53.813954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cd19b-bd93-48c7-a4bc-89bc273a4954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:53.880408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9e2cd19b-bd93-48c7-a4bc-89bc273a4954 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:53.881567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9e2cd19b-bd93-48c7-a4bc-89bc273a4954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:53.915747 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1731/3470] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:53.922242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092d9f7-d113-4638-b3f8-1a1c9afb4007 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:53.953588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092d9f7-d113-4638-b3f8-1a1c9afb4007 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:53.962305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc4075-c2b2-4290-a490-3cb088ad27fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:53.963403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4075-c2b2-4290-a490-3cb088ad27fb admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:53.964014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4075-c2b2-4290-a490-3cb088ad27fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:53.964403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4075-c2b2-4290-a490-3cb088ad27fb admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:53.965370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc4075-c2b2-4290-a490-3cb088ad27fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:02:53.965684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc4075-c2b2-4290-a490-3cb088ad27fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:53.967317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc4075-c2b2-4290-a490-3cb088ad27fb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:53.998220 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1740/3471] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:02:54.002456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cd19b-bd93-48c7-a4bc-89bc273a4954 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:54.024696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cd19b-bd93-48c7-a4bc-89bc273a4954 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:54.031540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e8f7e-75df-4a20-a471-6f50b06f1420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:54.032300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e8f7e-75df-4a20-a471-6f50b06f1420 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:54.032500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e8f7e-75df-4a20-a471-6f50b06f1420 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:54.032754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e8f7e-75df-4a20-a471-6f50b06f1420 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:54.034142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e8f7e-75df-4a20-a471-6f50b06f1420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:54.037585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e8f7e-75df-4a20-a471-6f50b06f1420 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:54.140935 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1732/3472] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:02:54 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:54.144799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc4075-c2b2-4290-a490-3cb088ad27fb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:54.162820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc4075-c2b2-4290-a490-3cb088ad27fb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:54.356628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96362bda-f9b4-41c1-8528-24eae38265b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:54.358102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96362bda-f9b4-41c1-8528-24eae38265b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:54.358603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96362bda-f9b4-41c1-8528-24eae38265b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:54.359106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96362bda-f9b4-41c1-8528-24eae38265b4 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:54.360038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96362bda-f9b4-41c1-8528-24eae38265b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:54.365600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96362bda-f9b4-41c1-8528-24eae38265b4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:54.403873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:54.415323 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1741/3473] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:02:54 2022] POST /identity/v3/users => generated 284 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:54.416824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e8f7e-75df-4a20-a471-6f50b06f1420 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:54.430592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e8f7e-75df-4a20-a471-6f50b06f1420 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:54.447762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87192f30-d5d2-4ad8-82ba-d0ac79f58ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:54.448473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87192f30-d5d2-4ad8-82ba-d0ac79f58ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:54.448886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87192f30-d5d2-4ad8-82ba-d0ac79f58ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:54.449169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87192f30-d5d2-4ad8-82ba-d0ac79f58ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:54.449842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87192f30-d5d2-4ad8-82ba-d0ac79f58ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:54.451675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87192f30-d5d2-4ad8-82ba-d0ac79f58ef8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:54.482579 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1733/3474] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:54.487403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96362bda-f9b4-41c1-8528-24eae38265b4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:54.503341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96362bda-f9b4-41c1-8528-24eae38265b4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:54.519560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fde748-c195-4780-97aa-d935b8ca5e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:54.520206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde748-c195-4780-97aa-d935b8ca5e04 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:54.520493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde748-c195-4780-97aa-d935b8ca5e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:54.520820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde748-c195-4780-97aa-d935b8ca5e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:54.522197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fde748-c195-4780-97aa-d935b8ca5e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:54.523341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fde748-c195-4780-97aa-d935b8ca5e04 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:54.561861 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1742/3475] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:54.566194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87192f30-d5d2-4ad8-82ba-d0ac79f58ef8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:54.587553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87192f30-d5d2-4ad8-82ba-d0ac79f58ef8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:54.605765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa8ce2-05e9-4a9e-8a39-63430b1e5be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:54.606841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa8ce2-05e9-4a9e-8a39-63430b1e5be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:54.607460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa8ce2-05e9-4a9e-8a39-63430b1e5be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:54.611564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa8ce2-05e9-4a9e-8a39-63430b1e5be6 admin admin] PATH_INFO: `/v3/projects/f87f1da439934832bd564cbd08346256/users/f218a836c7bf44e78fc59a6c32e8369b/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:54.671000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa8ce2-05e9-4a9e-8a39-63430b1e5be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87f1da439934832bd564cbd08346256, user_id=f218a836c7bf44e78fc59a6c32e8369b, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:54.681257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa8ce2-05e9-4a9e-8a39-63430b1e5be6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:54.722010 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1734/3476] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:02:54 2022] PUT /identity/v3/projects/f87f1da439934832bd564cbd08346256/users/f218a836c7bf44e78fc59a6c32e8369b/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:02:54.732989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf451-e053-4503-85d3-301cc1e71299 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:54.733320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf451-e053-4503-85d3-301cc1e71299 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:54.733552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf451-e053-4503-85d3-301cc1e71299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:54.795777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3ffbf451-e053-4503-85d3-301cc1e71299 None None] MFA Rules not processed for user `f218a836c7bf44e78fc59a6c32e8369b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:54.797117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ffbf451-e053-4503-85d3-301cc1e71299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:54.950584 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1743/3477] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:54.954807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa8ce2-05e9-4a9e-8a39-63430b1e5be6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:55.170419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa8ce2-05e9-4a9e-8a39-63430b1e5be6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:55.197861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a146318-2bb5-4eaa-93e1-570e160b1198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:55.199236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a146318-2bb5-4eaa-93e1-570e160b1198 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:55.199839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a146318-2bb5-4eaa-93e1-570e160b1198 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:55.200297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a146318-2bb5-4eaa-93e1-570e160b1198 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:55.201128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a146318-2bb5-4eaa-93e1-570e160b1198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:55.206884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a146318-2bb5-4eaa-93e1-570e160b1198 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:55.272277 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1735/3478] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:02:54 2022] POST /identity/v3/projects => generated 365 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:55.276291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbf451-e053-4503-85d3-301cc1e71299 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:55.295190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbf451-e053-4503-85d3-301cc1e71299 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:55.556081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56c010-8e7a-411b-8780-390eca8b7f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:55.557291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c010-8e7a-411b-8780-390eca8b7f1c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:55.559696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c010-8e7a-411b-8780-390eca8b7f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:55.562702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c010-8e7a-411b-8780-390eca8b7f1c admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:55.564108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56c010-8e7a-411b-8780-390eca8b7f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:55.577081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56c010-8e7a-411b-8780-390eca8b7f1c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:55.640587 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1744/3479] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:02:55 2022] POST /identity/v3/users => generated 289 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:55.646211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a146318-2bb5-4eaa-93e1-570e160b1198 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:55.664321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a146318-2bb5-4eaa-93e1-570e160b1198 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:55.678528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10fedb-6fb2-43dd-8150-94ec077cad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:55.679203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10fedb-6fb2-43dd-8150-94ec077cad85 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:55.679691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10fedb-6fb2-43dd-8150-94ec077cad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:55.680179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10fedb-6fb2-43dd-8150-94ec077cad85 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:55.680998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10fedb-6fb2-43dd-8150-94ec077cad85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:55.685482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10fedb-6fb2-43dd-8150-94ec077cad85 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:55.717923 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1736/3480] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:55.723153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56c010-8e7a-411b-8780-390eca8b7f1c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:55.748243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56c010-8e7a-411b-8780-390eca8b7f1c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:55.763665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bff12-3586-4c84-9459-dc2d6306ae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:55.764737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bff12-3586-4c84-9459-dc2d6306ae0c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:55.765130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bff12-3586-4c84-9459-dc2d6306ae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:55.765503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bff12-3586-4c84-9459-dc2d6306ae0c admin admin] PATH_INFO: `/v3/projects/3c449c5429aa469fa2cbe1680b5dd172/users/105874e6ce5746498d0500f2ebdbc3ea/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:55.802983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bff12-3586-4c84-9459-dc2d6306ae0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c449c5429aa469fa2cbe1680b5dd172, user_id=105874e6ce5746498d0500f2ebdbc3ea, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:55.808214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8bff12-3586-4c84-9459-dc2d6306ae0c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:55.853216 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1745/3481] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:02:55 2022] PUT /identity/v3/projects/3c449c5429aa469fa2cbe1680b5dd172/users/105874e6ce5746498d0500f2ebdbc3ea/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:55.857753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10fedb-6fb2-43dd-8150-94ec077cad85 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:55.870466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10fedb-6fb2-43dd-8150-94ec077cad85 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:55.888650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:55.976638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742aca00-2240-45d3-b411-30acd47999be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:55.977324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aca00-2240-45d3-b411-30acd47999be admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:55.977556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aca00-2240-45d3-b411-30acd47999be admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:55.977836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aca00-2240-45d3-b411-30acd47999be admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:55.978686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742aca00-2240-45d3-b411-30acd47999be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:55.981425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742aca00-2240-45d3-b411-30acd47999be admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:55.997860 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1737/3482] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:02:56.002381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bff12-3586-4c84-9459-dc2d6306ae0c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:56.018094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8bff12-3586-4c84-9459-dc2d6306ae0c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:56.032913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745de4d-0f8b-40fe-9178-8868a0a89665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:56.033795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745de4d-0f8b-40fe-9178-8868a0a89665 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:56.034182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745de4d-0f8b-40fe-9178-8868a0a89665 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:56.034576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745de4d-0f8b-40fe-9178-8868a0a89665 admin admin] PATH_INFO: `/v3/projects/3c449c5429aa469fa2cbe1680b5dd172/users/105874e6ce5746498d0500f2ebdbc3ea/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:56.045549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745de4d-0f8b-40fe-9178-8868a0a89665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c449c5429aa469fa2cbe1680b5dd172, user_id=105874e6ce5746498d0500f2ebdbc3ea, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:56.048503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745de4d-0f8b-40fe-9178-8868a0a89665 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:56.085682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e619b38-caa6-476b-a93f-777d8c77384d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:56.086108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e619b38-caa6-476b-a93f-777d8c77384d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:56.086578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e619b38-caa6-476b-a93f-777d8c77384d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:56.090088 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1746/3483] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:02:56 2022] PUT /identity/v3/projects/3c449c5429aa469fa2cbe1680b5dd172/users/105874e6ce5746498d0500f2ebdbc3ea/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:56.145256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4e619b38-caa6-476b-a93f-777d8c77384d None None] MFA Rules not processed for user `105874e6ce5746498d0500f2ebdbc3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:02:56.146766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4e619b38-caa6-476b-a93f-777d8c77384d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:56.324634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745de4d-0f8b-40fe-9178-8868a0a89665 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:56.325595 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1738/3484] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:02:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:02:56.357597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745de4d-0f8b-40fe-9178-8868a0a89665 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:56.371078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4b1bf-705b-4539-8651-5ebb26f94b82 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:56.372211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4b1bf-705b-4539-8651-5ebb26f94b82 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:56.372746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4b1bf-705b-4539-8651-5ebb26f94b82 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:56.373417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4b1bf-705b-4539-8651-5ebb26f94b82 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:56.374820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4b1bf-705b-4539-8651-5ebb26f94b82 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:56.382912 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-b9b4b1bf-705b-4539-8651-5ebb26f94b82 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:02:56.382912 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:02:56.382912 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:02:56.388241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4b1bf-705b-4539-8651-5ebb26f94b82 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:56.424619 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1747/3485] 10.222.0.70 () {60 vars in 1150 bytes} [Sun Aug 28 19:02:56 2022] POST /identity/v3/domains => generated 275 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:56.427841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e619b38-caa6-476b-a93f-777d8c77384d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:56.458396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e619b38-caa6-476b-a93f-777d8c77384d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:56.621710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e39866-958b-49a8-93ae-e154ae3ab9d7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:56.622474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e39866-958b-49a8-93ae-e154ae3ab9d7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:56.623047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e39866-958b-49a8-93ae-e154ae3ab9d7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:56.623396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e39866-958b-49a8-93ae-e154ae3ab9d7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:56.624203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e39866-958b-49a8-93ae-e154ae3ab9d7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:56.625365 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-b3e39866-958b-49a8-93ae-e154ae3ab9d7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:02:56.625365 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:02:56.625365 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:02:56.626289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e39866-958b-49a8-93ae-e154ae3ab9d7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:56.665538 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1739/3486] 10.222.0.70 () {60 vars in 1150 bytes} [Sun Aug 28 19:02:56 2022] POST /identity/v3/domains => generated 277 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:56.670829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4b1bf-705b-4539-8651-5ebb26f94b82 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:56.696178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4b1bf-705b-4539-8651-5ebb26f94b82 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:56.743219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:56.896011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b71c8-d5f9-4b64-a377-a8c8f9c2765c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:56.898484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b71c8-d5f9-4b64-a377-a8c8f9c2765c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:56.901274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b71c8-d5f9-4b64-a377-a8c8f9c2765c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:56.902502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b71c8-d5f9-4b64-a377-a8c8f9c2765c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:56.906169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b71c8-d5f9-4b64-a377-a8c8f9c2765c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:56.909419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b71c8-d5f9-4b64-a377-a8c8f9c2765c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:56.996079 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1748/3487] 10.222.0.70 () {60 vars in 1150 bytes} [Sun Aug 28 19:02:56 2022] POST /identity/v3/domains => generated 277 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:02:56.997737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e39866-958b-49a8-93ae-e154ae3ab9d7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:57.019071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e39866-958b-49a8-93ae-e154ae3ab9d7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:57.067455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:57.182933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd6c6b-716c-4709-b950-483ce0a7718c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:57.184932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd6c6b-716c-4709-b950-483ce0a7718c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:57.185316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd6c6b-716c-4709-b950-483ce0a7718c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:57.185949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd6c6b-716c-4709-b950-483ce0a7718c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:57.186723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd6c6b-716c-4709-b950-483ce0a7718c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:57.188782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd6c6b-716c-4709-b950-483ce0a7718c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:57.250201 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1740/3488] 10.222.0.70 () {60 vars in 1150 bytes} [Sun Aug 28 19:02:56 2022] POST /identity/v3/domains => generated 279 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:57.256390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b71c8-d5f9-4b64-a377-a8c8f9c2765c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:57.272439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b71c8-d5f9-4b64-a377-a8c8f9c2765c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:57.379881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:57.380685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:57.381038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:57.381387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/4ddfc46ea6ae42c2b155f17b39924040` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:57.418546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4ddfc46ea6ae42c2b155f17b39924040)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:57.419417 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:02:57.419417 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:02:57.419417 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:02:57.420950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:57.473523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4ddfc46ea6ae42c2b155f17b39924040'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:57.482436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4ddfc46ea6ae42c2b155f17b39924040'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:57.585876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ddfc46ea6ae42c2b155f17b39924040', 'request_id': 'req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:57.602234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ddfc46ea6ae42c2b155f17b39924040', 'request_id': 'req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:57.611618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ddfc46ea6ae42c2b155f17b39924040', 'request_id': 'req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:57.631536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] The token cache is being invalidate because project 4ddfc46ea6ae42c2b155f17b39924040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:02:57.632043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:57.632945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:57.644116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:57.655572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4ddfc46ea6ae42c2b155f17b39924040', 'request_id': 'req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:57.657208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4ddfc46ea6ae42c2b155f17b39924040', 'request_id': 'req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:57.665468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4ddfc46ea6ae42c2b155f17b39924040', 'request_id': 'req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:57.672643 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1749/3489] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:02:57 2022] DELETE /identity/v3/domains/4ddfc46ea6ae42c2b155f17b39924040 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:57.679701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd6c6b-716c-4709-b950-483ce0a7718c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:57.682273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-10fd6c6b-716c-4709-b950-483ce0a7718c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:57.711180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd6c6b-716c-4709-b950-483ce0a7718c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:57.833055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddb1df-8600-4997-9ca8-ab97efa9e80c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:57.833830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddb1df-8600-4997-9ca8-ab97efa9e80c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:57.834189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddb1df-8600-4997-9ca8-ab97efa9e80c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:57.834506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddb1df-8600-4997-9ca8-ab97efa9e80c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:57.835367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddb1df-8600-4997-9ca8-ab97efa9e80c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:57.837353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddb1df-8600-4997-9ca8-ab97efa9e80c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:57.877092 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1741/3490] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:02:57 2022] POST /identity/v3/domains => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:57.879477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:57.905227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165c6a5-d632-42e1-9d77-ea1fdbb6b688 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:58.015998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b57bc1-6803-49f1-aa21-f14d741e482e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:58.017195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b57bc1-6803-49f1-aa21-f14d741e482e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:58.017195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b57bc1-6803-49f1-aa21-f14d741e482e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:58.017493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b57bc1-6803-49f1-aa21-f14d741e482e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/0fe49686a1594bef8257952411268dd1` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:58.054471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b57bc1-6803-49f1-aa21-f14d741e482e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0fe49686a1594bef8257952411268dd1)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:58.055572 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-58b57bc1-6803-49f1-aa21-f14d741e482e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:02:58.055572 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:02:58.055572 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:02:58.056692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b57bc1-6803-49f1-aa21-f14d741e482e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:58.140021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-58b57bc1-6803-49f1-aa21-f14d741e482e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0fe49686a1594bef8257952411268dd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.143274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-58b57bc1-6803-49f1-aa21-f14d741e482e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0fe49686a1594bef8257952411268dd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.227730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-58b57bc1-6803-49f1-aa21-f14d741e482e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0fe49686a1594bef8257952411268dd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.229265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-58b57bc1-6803-49f1-aa21-f14d741e482e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0fe49686a1594bef8257952411268dd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.237535 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1750/3491] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:02:57 2022] PATCH /identity/v3/domains/0fe49686a1594bef8257952411268dd1 => generated 249 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:02:58.239769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddb1df-8600-4997-9ca8-ab97efa9e80c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:58.241713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-deddb1df-8600-4997-9ca8-ab97efa9e80c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:58.280749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddb1df-8600-4997-9ca8-ab97efa9e80c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:58.424466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:58.425544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:58.428097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:58.428471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/0fe49686a1594bef8257952411268dd1` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:58.469963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0fe49686a1594bef8257952411268dd1)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:58.471095 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:02:58.471095 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:02:58.471095 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:02:58.472391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:58.536709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0fe49686a1594bef8257952411268dd1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.544572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0fe49686a1594bef8257952411268dd1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.603248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:58.645855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe49686a1594bef8257952411268dd1', 'request_id': 'req-815d366e-79db-4baf-82a1-4217c1bfaeaf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.662413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe49686a1594bef8257952411268dd1', 'request_id': 'req-815d366e-79db-4baf-82a1-4217c1bfaeaf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.685497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe49686a1594bef8257952411268dd1', 'request_id': 'req-815d366e-79db-4baf-82a1-4217c1bfaeaf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.707050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] The token cache is being invalidate because project 0fe49686a1594bef8257952411268dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:02:58.707404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.708172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.722263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0fe49686a1594bef8257952411268dd1', 'request_id': 'req-815d366e-79db-4baf-82a1-4217c1bfaeaf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.727527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0fe49686a1594bef8257952411268dd1', 'request_id': 'req-815d366e-79db-4baf-82a1-4217c1bfaeaf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.728389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0fe49686a1594bef8257952411268dd1', 'request_id': 'req-815d366e-79db-4baf-82a1-4217c1bfaeaf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:58.752098 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1742/3492] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:02:58 2022] DELETE /identity/v3/domains/0fe49686a1594bef8257952411268dd1 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:02:58.757550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b57bc1-6803-49f1-aa21-f14d741e482e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:58.777894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b57bc1-6803-49f1-aa21-f14d741e482e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:58.959300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6af41-f945-4896-96c4-f13e2b015670 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:58.960211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6af41-f945-4896-96c4-f13e2b015670 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:58.961550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6af41-f945-4896-96c4-f13e2b015670 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:58.961550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6af41-f945-4896-96c4-f13e2b015670 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:58.962347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6af41-f945-4896-96c4-f13e2b015670 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:58.965089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a6af41-f945-4896-96c4-f13e2b015670 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:59.008071 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1751/3493] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:02:58 2022] POST /identity/v3/domains => generated 277 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:02:59.012541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:59.014274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:59.044032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d366e-79db-4baf-82a1-4217c1bfaeaf tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:59.233670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35675de3-b03d-49d0-964b-93a5771f4fe9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:59.234325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35675de3-b03d-49d0-964b-93a5771f4fe9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:59.234611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35675de3-b03d-49d0-964b-93a5771f4fe9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:59.234943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35675de3-b03d-49d0-964b-93a5771f4fe9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/b67a1e40b3fb46cead56b9539907e16b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:59.248781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35675de3-b03d-49d0-964b-93a5771f4fe9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b67a1e40b3fb46cead56b9539907e16b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:59.249900 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-35675de3-b03d-49d0-964b-93a5771f4fe9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:02:59.249900 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:02:59.249900 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:02:59.250883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35675de3-b03d-49d0-964b-93a5771f4fe9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:59.287246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-35675de3-b03d-49d0-964b-93a5771f4fe9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b67a1e40b3fb46cead56b9539907e16b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:59.288484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-35675de3-b03d-49d0-964b-93a5771f4fe9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b67a1e40b3fb46cead56b9539907e16b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:59.334715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-35675de3-b03d-49d0-964b-93a5771f4fe9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b67a1e40b3fb46cead56b9539907e16b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:59.335935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-35675de3-b03d-49d0-964b-93a5771f4fe9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b67a1e40b3fb46cead56b9539907e16b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:59.341605 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1743/3494] 10.222.0.70 () {60 vars in 1250 bytes} [Sun Aug 28 19:02:59 2022] PATCH /identity/v3/domains/b67a1e40b3fb46cead56b9539907e16b => generated 278 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:02:59.345618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6af41-f945-4896-96c4-f13e2b015670 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:59.349564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d9a6af41-f945-4896-96c4-f13e2b015670 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:02:59.372684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6af41-f945-4896-96c4-f13e2b015670 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:59.465583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:59.542640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a1f76-9ef6-46bc-bc89-6040ffacd3b1 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:59.546690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1f76-9ef6-46bc-bc89-6040ffacd3b1 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:59.546993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1f76-9ef6-46bc-bc89-6040ffacd3b1 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:59.548172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1f76-9ef6-46bc-bc89-6040ffacd3b1 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/b67a1e40b3fb46cead56b9539907e16b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:59.582313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a1f76-9ef6-46bc-bc89-6040ffacd3b1 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=b67a1e40b3fb46cead56b9539907e16b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:59.601245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a1f76-9ef6-46bc-bc89-6040ffacd3b1 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:59.610704 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1752/3495] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:02:59 2022] GET /identity/v3/domains/b67a1e40b3fb46cead56b9539907e16b => generated 278 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:02:59.614065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35675de3-b03d-49d0-964b-93a5771f4fe9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:02:59.636956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35675de3-b03d-49d0-964b-93a5771f4fe9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:02:59.654228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:02:59.655594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:02:59.655883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:02:59.656255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/b67a1e40b3fb46cead56b9539907e16b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:02:59.660712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b67a1e40b3fb46cead56b9539907e16b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:02:59.664453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:02:59.734983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b67a1e40b3fb46cead56b9539907e16b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:59.743295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b67a1e40b3fb46cead56b9539907e16b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:59.805195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:02:59.892859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b67a1e40b3fb46cead56b9539907e16b', 'request_id': 'req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:59.913206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b67a1e40b3fb46cead56b9539907e16b', 'request_id': 'req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:59.932047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b67a1e40b3fb46cead56b9539907e16b', 'request_id': 'req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:59.966170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] The token cache is being invalidate because project b67a1e40b3fb46cead56b9539907e16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:02:59.966494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:59.967391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:02:59.997428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b67a1e40b3fb46cead56b9539907e16b', 'request_id': 'req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:00.007828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b67a1e40b3fb46cead56b9539907e16b', 'request_id': 'req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:00.008651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b67a1e40b3fb46cead56b9539907e16b', 'request_id': 'req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:00.022866 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1744/3496] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:02:59 2022] DELETE /identity/v3/domains/b67a1e40b3fb46cead56b9539907e16b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:00.030085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a1f76-9ef6-46bc-bc89-6040ffacd3b1 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:00.034138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dd8a1f76-9ef6-46bc-bc89-6040ffacd3b1 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:00.065029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a1f76-9ef6-46bc-bc89-6040ffacd3b1 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:00.275756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa971a1-418b-45e1-a3a4-819523769c3b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:00.276482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa971a1-418b-45e1-a3a4-819523769c3b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:00.276949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa971a1-418b-45e1-a3a4-819523769c3b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:00.277749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa971a1-418b-45e1-a3a4-819523769c3b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:00.283011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa971a1-418b-45e1-a3a4-819523769c3b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:00.284759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa971a1-418b-45e1-a3a4-819523769c3b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:00.339043 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1753/3497] 10.222.0.70 () {58 vars in 1128 bytes} [Sun Aug 28 19:03:00 2022] GET /identity/v3/domains => generated 1347 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:00.341078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:00.360577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1ce36-2c07-48b6-b8d6-7f2d04b90e07 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:00.368335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd4db9-2992-46e7-af1d-de2718a62cd7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:00.369026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4db9-2992-46e7-af1d-de2718a62cd7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:00.369319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4db9-2992-46e7-af1d-de2718a62cd7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:00.369597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4db9-2992-46e7-af1d-de2718a62cd7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/b67a1e40b3fb46cead56b9539907e16b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:00.393649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd4db9-2992-46e7-af1d-de2718a62cd7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-27dd4db9-2992-46e7-af1d-de2718a62cd7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Could not find domain: b67a1e40b3fb46cead56b9539907e16b.: keystone.exception.DomainNotFound: Could not find domain: b67a1e40b3fb46cead56b9539907e16b. Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b67a1e40b3fb46cead56b9539907e16b. Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:00.410674 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:00.412521 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b67a1e40b3fb46cead56b9539907e16b. Aug 28 19:03:00.413490 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:00.414427 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1745/3498] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:03:00 2022] PATCH /identity/v3/domains/b67a1e40b3fb46cead56b9539907e16b => generated 112 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 19:03:00.417856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa971a1-418b-45e1-a3a4-819523769c3b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:00.436461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa971a1-418b-45e1-a3a4-819523769c3b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:00.443181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac50030-4953-4021-89b5-a4dd594c5442 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:00.444276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac50030-4953-4021-89b5-a4dd594c5442 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:00.444276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac50030-4953-4021-89b5-a4dd594c5442 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:00.444608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac50030-4953-4021-89b5-a4dd594c5442 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:00.446591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac50030-4953-4021-89b5-a4dd594c5442 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:00.451827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac50030-4953-4021-89b5-a4dd594c5442 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:00.518932 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1754/3499] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:03:00 2022] POST /identity/v3/domains => generated 276 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:00.523414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd4db9-2992-46e7-af1d-de2718a62cd7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:00.558435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd4db9-2992-46e7-af1d-de2718a62cd7 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:00.703251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfb0d2-7f18-462f-854b-d62cc94ab35a tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:00.703902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfb0d2-7f18-462f-854b-d62cc94ab35a tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:00.704191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfb0d2-7f18-462f-854b-d62cc94ab35a tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:00.704474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfb0d2-7f18-462f-854b-d62cc94ab35a tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:00.705274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfb0d2-7f18-462f-854b-d62cc94ab35a tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:00.707388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfb0d2-7f18-462f-854b-d62cc94ab35a tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:00.784005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac50030-4953-4021-89b5-a4dd594c5442 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:00.784256 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1746/3500] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:03:00 2022] POST /identity/v3/users => generated 346 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:03:00.801616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac50030-4953-4021-89b5-a4dd594c5442 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:00.813024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c77e3c-0c8a-4fde-b5f8-5756e3983657 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:00.813749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c77e3c-0c8a-4fde-b5f8-5756e3983657 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:00.814058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c77e3c-0c8a-4fde-b5f8-5756e3983657 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:00.814340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c77e3c-0c8a-4fde-b5f8-5756e3983657 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:00.815013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c77e3c-0c8a-4fde-b5f8-5756e3983657 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:00.816172 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-10c77e3c-0c8a-4fde-b5f8-5756e3983657 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:00.816172 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:03:00.816172 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:03:00.817366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c77e3c-0c8a-4fde-b5f8-5756e3983657 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:00.869473 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1755/3501] 10.222.0.70 () {60 vars in 1147 bytes} [Sun Aug 28 19:03:00 2022] POST /identity/v3/groups => generated 325 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:00.871360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfb0d2-7f18-462f-854b-d62cc94ab35a tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:00.902381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfb0d2-7f18-462f-854b-d62cc94ab35a tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:00.942655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ccf54-8de8-4142-a15d-5a5034e8109b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:00.943448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ccf54-8de8-4142-a15d-5a5034e8109b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:00.945437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ccf54-8de8-4142-a15d-5a5034e8109b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:00.945830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ccf54-8de8-4142-a15d-5a5034e8109b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/6069565428514cac92a2d19f284f645c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:00.953094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ccf54-8de8-4142-a15d-5a5034e8109b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6069565428514cac92a2d19f284f645c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:00.965705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ccf54-8de8-4142-a15d-5a5034e8109b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:01.047819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3d7ccf54-8de8-4142-a15d-5a5034e8109b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6069565428514cac92a2d19f284f645c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:01.048824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3d7ccf54-8de8-4142-a15d-5a5034e8109b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6069565428514cac92a2d19f284f645c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:01.125829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3d7ccf54-8de8-4142-a15d-5a5034e8109b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6069565428514cac92a2d19f284f645c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:01.127329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3d7ccf54-8de8-4142-a15d-5a5034e8109b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6069565428514cac92a2d19f284f645c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:01.136437 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1747/3502] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:03:00 2022] PATCH /identity/v3/domains/6069565428514cac92a2d19f284f645c => generated 277 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:01.138514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c77e3c-0c8a-4fde-b5f8-5756e3983657 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:01.143519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-10c77e3c-0c8a-4fde-b5f8-5756e3983657 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:01.168229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c77e3c-0c8a-4fde-b5f8-5756e3983657 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:01.358963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:01.359643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:01.359934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:01.360263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/6069565428514cac92a2d19f284f645c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:01.395798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6069565428514cac92a2d19f284f645c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:01.397577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:01.454921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6069565428514cac92a2d19f284f645c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:01.461841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6069565428514cac92a2d19f284f645c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:01.475477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:01.776294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b6fdc2409e474eb4786a3823758d27'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:01.787907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b6fdc2409e474eb4786a3823758d27'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:01.789093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b6fdc2409e474eb4786a3823758d27'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:01.802109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b6fdc2409e474eb4786a3823758d27'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:01.803053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b6fdc2409e474eb4786a3823758d27'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:01.976968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6069565428514cac92a2d19f284f645c', 'request_id': 'req-805e5be1-882d-436b-8a95-d982c486b98f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:01.993812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6069565428514cac92a2d19f284f645c', 'request_id': 'req-805e5be1-882d-436b-8a95-d982c486b98f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:02.013801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6069565428514cac92a2d19f284f645c', 'request_id': 'req-805e5be1-882d-436b-8a95-d982c486b98f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:02.048657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] The token cache is being invalidate because project 6069565428514cac92a2d19f284f645c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:02.049583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:02.050682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:02.077270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6069565428514cac92a2d19f284f645c', 'request_id': 'req-805e5be1-882d-436b-8a95-d982c486b98f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:02.080537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6069565428514cac92a2d19f284f645c', 'request_id': 'req-805e5be1-882d-436b-8a95-d982c486b98f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:02.085901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=73,keystone:DELETE=25,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:02.088384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6069565428514cac92a2d19f284f645c', 'request_id': 'req-805e5be1-882d-436b-8a95-d982c486b98f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:02.106996 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1756/3503] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:03:01 2022] DELETE /identity/v3/domains/6069565428514cac92a2d19f284f645c => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:02.111632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ccf54-8de8-4142-a15d-5a5034e8109b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:02.139878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ccf54-8de8-4142-a15d-5a5034e8109b tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:02.177458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:02.306997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44423321-ec54-43e6-b0de-7c41975fe6f5 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:02.308347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44423321-ec54-43e6-b0de-7c41975fe6f5 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:02.309166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44423321-ec54-43e6-b0de-7c41975fe6f5 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:02.309541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44423321-ec54-43e6-b0de-7c41975fe6f5 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/6069565428514cac92a2d19f284f645c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:02.337795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44423321-ec54-43e6-b0de-7c41975fe6f5 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=6069565428514cac92a2d19f284f645c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:02.341211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44423321-ec54-43e6-b0de-7c41975fe6f5 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-44423321-ec54-43e6-b0de-7c41975fe6f5 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Could not find domain: 6069565428514cac92a2d19f284f645c.: keystone.exception.DomainNotFound: Could not find domain: 6069565428514cac92a2d19f284f645c. Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6069565428514cac92a2d19f284f645c. Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:02.367006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:03:02.368762 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6069565428514cac92a2d19f284f645c. Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:02.370026 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1748/3504] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:03:02 2022] GET /identity/v3/domains/6069565428514cac92a2d19f284f645c => generated 112 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:03:02.374406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:02.379761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:02.397861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e5be1-882d-436b-8a95-d982c486b98f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:02.407204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a46547-86e6-41be-956d-a31e05a64c52 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:02.408189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a46547-86e6-41be-956d-a31e05a64c52 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:02.408553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a46547-86e6-41be-956d-a31e05a64c52 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:02.411150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a46547-86e6-41be-956d-a31e05a64c52 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/users/c9b6fdc2409e474eb4786a3823758d27` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:02.427052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a46547-86e6-41be-956d-a31e05a64c52 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:get_user(user_id=c9b6fdc2409e474eb4786a3823758d27)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:02.430763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a46547-86e6-41be-956d-a31e05a64c52 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-e3a46547-86e6-41be-956d-a31e05a64c52 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Could not find user: c9b6fdc2409e474eb4786a3823758d27.: keystone.exception.UserNotFound: Could not find user: c9b6fdc2409e474eb4786a3823758d27. Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 19:03:02.456836 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:03:02.457986 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:03:02.459017 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:03:02.459017 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:03:02.459017 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:03:02.459017 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:03:02.459017 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:03:02.459017 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:03:02.459017 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:03:02.459017 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:03:02.459017 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:03:02.459017 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:03:02.459017 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c9b6fdc2409e474eb4786a3823758d27. Aug 28 19:03:02.459017 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:03:02.460680 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1757/3505] 10.222.0.70 () {58 vars in 1221 bytes} [Sun Aug 28 19:03:02 2022] GET /identity/v3/users/c9b6fdc2409e474eb4786a3823758d27 => generated 110 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:03:02.467654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44423321-ec54-43e6-b0de-7c41975fe6f5 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:02.500075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44423321-ec54-43e6-b0de-7c41975fe6f5 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:02.519881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f2b48-3e54-435d-b0e4-7c35eeb22d6c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:02.521128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f2b48-3e54-435d-b0e4-7c35eeb22d6c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:02.522784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f2b48-3e54-435d-b0e4-7c35eeb22d6c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:02.523097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f2b48-3e54-435d-b0e4-7c35eeb22d6c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/groups/fa9f0bf861674ef3b5d14d25dffb3e7e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:02.569997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f2b48-3e54-435d-b0e4-7c35eeb22d6c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:get_group(group_id=fa9f0bf861674ef3b5d14d25dffb3e7e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:02.577059 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-6e1f2b48-3e54-435d-b0e4-7c35eeb22d6c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:02.577059 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:03:02.577059 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:03:02.583978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f2b48-3e54-435d-b0e4-7c35eeb22d6c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-6e1f2b48-3e54-435d-b0e4-7c35eeb22d6c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Could not find group: fa9f0bf861674ef3b5d14d25dffb3e7e.: keystone.exception.GroupNotFound: Could not find group: fa9f0bf861674ef3b5d14d25dffb3e7e. Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_group(group_id) Aug 28 19:03:02.619429 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:03:02.620395 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:03:02.621456 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:03:02.621456 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:03:02.621456 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:03:02.621456 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:03:02.621456 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 28 19:03:02.621456 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 28 19:03:02.621456 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 28 19:03:02.621456 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 28 19:03:02.621456 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 28 19:03:02.621456 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 28 19:03:02.621456 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: fa9f0bf861674ef3b5d14d25dffb3e7e. Aug 28 19:03:02.621456 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:02.625667 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1749/3506] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:02 2022] GET /identity/v3/groups/fa9f0bf861674ef3b5d14d25dffb3e7e => generated 111 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:03:02.630457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a46547-86e6-41be-956d-a31e05a64c52 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:02.655990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a46547-86e6-41be-956d-a31e05a64c52 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:02.671585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3338e68-785c-4779-af65-fe1f0aa35d05 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:02.672313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3338e68-785c-4779-af65-fe1f0aa35d05 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:02.672593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3338e68-785c-4779-af65-fe1f0aa35d05 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:02.672872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3338e68-785c-4779-af65-fe1f0aa35d05 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/groups/fa9f0bf861674ef3b5d14d25dffb3e7e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:02.685342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3338e68-785c-4779-af65-fe1f0aa35d05 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-e3338e68-785c-4779-af65-fe1f0aa35d05 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Could not find group: fa9f0bf861674ef3b5d14d25dffb3e7e.: keystone.exception.GroupNotFound: Could not find group: fa9f0bf861674ef3b5d14d25dffb3e7e. Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Aug 28 19:03:02.701311 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 19:03:02.702466 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: fa9f0bf861674ef3b5d14d25dffb3e7e. Aug 28 19:03:02.703713 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:03:02.708504 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1758/3507] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:03:02 2022] DELETE /identity/v3/groups/fa9f0bf861674ef3b5d14d25dffb3e7e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:03:02.710011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f2b48-3e54-435d-b0e4-7c35eeb22d6c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:02.733715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f2b48-3e54-435d-b0e4-7c35eeb22d6c tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:02.763924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edaac4-2727-41b0-9526-4648bebd4770 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:02.764589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edaac4-2727-41b0-9526-4648bebd4770 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:02.764851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edaac4-2727-41b0-9526-4648bebd4770 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:02.765135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edaac4-2727-41b0-9526-4648bebd4770 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/users/c9b6fdc2409e474eb4786a3823758d27` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:02.783662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edaac4-2727-41b0-9526-4648bebd4770 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c9b6fdc2409e474eb4786a3823758d27)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:02.785585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edaac4-2727-41b0-9526-4648bebd4770 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-35edaac4-2727-41b0-9526-4648bebd4770 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Could not find user: c9b6fdc2409e474eb4786a3823758d27.: keystone.exception.UserNotFound: Could not find user: c9b6fdc2409e474eb4786a3823758d27. Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Aug 28 19:03:02.835962 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:03:02.836811 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: c9b6fdc2409e474eb4786a3823758d27. Aug 28 19:03:02.838163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:02.840470 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1750/3508] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:02 2022] DELETE /identity/v3/users/c9b6fdc2409e474eb4786a3823758d27 => generated 110 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:03:02.842122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3338e68-785c-4779-af65-fe1f0aa35d05 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:02.864355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3338e68-785c-4779-af65-fe1f0aa35d05 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:02.897295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747911c-50af-4bf1-9945-8873b465611e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:02.897295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747911c-50af-4bf1-9945-8873b465611e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:02.897295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747911c-50af-4bf1-9945-8873b465611e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:02.897784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747911c-50af-4bf1-9945-8873b465611e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/6069565428514cac92a2d19f284f645c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:02.924018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747911c-50af-4bf1-9945-8873b465611e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-e747911c-50af-4bf1-9945-8873b465611e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Could not find domain: 6069565428514cac92a2d19f284f645c.: keystone.exception.DomainNotFound: Could not find domain: 6069565428514cac92a2d19f284f645c. Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6069565428514cac92a2d19f284f645c. Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:02.946486 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:02.947827 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6069565428514cac92a2d19f284f645c. Aug 28 19:03:02.949071 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:03:02.950128 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1759/3509] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:03:02 2022] PATCH /identity/v3/domains/6069565428514cac92a2d19f284f645c => generated 112 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:03:02.955516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edaac4-2727-41b0-9526-4648bebd4770 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:02.981721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edaac4-2727-41b0-9526-4648bebd4770 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:03.009142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b339657-afaa-4f01-b859-608da816ce72 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:03.010083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b339657-afaa-4f01-b859-608da816ce72 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:03.010433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b339657-afaa-4f01-b859-608da816ce72 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:03.010811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b339657-afaa-4f01-b859-608da816ce72 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:03.011847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b339657-afaa-4f01-b859-608da816ce72 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:03.013671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b339657-afaa-4f01-b859-608da816ce72 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:03.068775 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1751/3510] 10.222.0.70 () {58 vars in 1128 bytes} [Sun Aug 28 19:03:02 2022] GET /identity/v3/domains => generated 1347 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:03:03.074207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747911c-50af-4bf1-9945-8873b465611e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:03.090457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747911c-50af-4bf1-9945-8873b465611e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:03.105633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06134b37-2b78-498f-86cc-a07419d65303 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:03.106380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06134b37-2b78-498f-86cc-a07419d65303 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:03.106667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06134b37-2b78-498f-86cc-a07419d65303 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:03.106968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06134b37-2b78-498f-86cc-a07419d65303 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:03.107634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06134b37-2b78-498f-86cc-a07419d65303 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:03:03.108686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06134b37-2b78-498f-86cc-a07419d65303 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:03.114323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06134b37-2b78-498f-86cc-a07419d65303 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:03.149417 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1760/3511] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:03:03 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:03.155911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b339657-afaa-4f01-b859-608da816ce72 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:03.170456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b339657-afaa-4f01-b859-608da816ce72 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:03.185551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6bade-8b1f-417c-b4e8-2862f2a25701 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:03.186385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6bade-8b1f-417c-b4e8-2862f2a25701 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:03.186498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6bade-8b1f-417c-b4e8-2862f2a25701 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:03.186846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6bade-8b1f-417c-b4e8-2862f2a25701 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:03.187613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6bade-8b1f-417c-b4e8-2862f2a25701 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-234863187) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:03:03.187921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6bade-8b1f-417c-b4e8-2862f2a25701 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:03.189619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6bade-8b1f-417c-b4e8-2862f2a25701 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:03.230552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28a935-500d-4cd5-90f7-80910bbef5e1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:03.231136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28a935-500d-4cd5-90f7-80910bbef5e1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:03.231476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28a935-500d-4cd5-90f7-80910bbef5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:03.261385 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1752/3512] 10.222.0.70 () {58 vars in 1197 bytes} [Sun Aug 28 19:03:03 2022] GET /identity/v3/domains?name=tempest-test_domain-234863187 => generated 406 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:03.262913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6bade-8b1f-417c-b4e8-2862f2a25701 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:03.307271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6e28a935-500d-4cd5-90f7-80910bbef5e1 None None] MFA Rules not processed for user `34e0fcf65bd04c148f884037e16b3c09`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:03.309666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6e28a935-500d-4cd5-90f7-80910bbef5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:03.315130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6bade-8b1f-417c-b4e8-2862f2a25701 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:03.332201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb308cc-45f0-4a14-988f-8024535da26e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:03.332911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb308cc-45f0-4a14-988f-8024535da26e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:03.337705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb308cc-45f0-4a14-988f-8024535da26e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:03.337705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb308cc-45f0-4a14-988f-8024535da26e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/6069565428514cac92a2d19f284f645c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:03.371990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb308cc-45f0-4a14-988f-8024535da26e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-5fb308cc-45f0-4a14-988f-8024535da26e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Could not find domain: 6069565428514cac92a2d19f284f645c.: keystone.exception.DomainNotFound: Could not find domain: 6069565428514cac92a2d19f284f645c. Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6069565428514cac92a2d19f284f645c. Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:03.397934 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:03.399035 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6069565428514cac92a2d19f284f645c. Aug 28 19:03:03.399911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:03.404938 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1753/3513] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:03:03 2022] PATCH /identity/v3/domains/6069565428514cac92a2d19f284f645c => generated 112 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:03:03.405900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb308cc-45f0-4a14-988f-8024535da26e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:03.444818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb308cc-45f0-4a14-988f-8024535da26e tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:03.464894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec356a-32e6-4a0d-bdf8-cbe13004ba93 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:03.469345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec356a-32e6-4a0d-bdf8-cbe13004ba93 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:03.469620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec356a-32e6-4a0d-bdf8-cbe13004ba93 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:03.469923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec356a-32e6-4a0d-bdf8-cbe13004ba93 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/39d723c46d424021b2d6805585e61cc3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:03.513090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec356a-32e6-4a0d-bdf8-cbe13004ba93 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=39d723c46d424021b2d6805585e61cc3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:03.514944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec356a-32e6-4a0d-bdf8-cbe13004ba93 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:03.593272 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1761/3514] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:03:03.636912 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1754/3515] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:03:03 2022] PATCH /identity/v3/domains/39d723c46d424021b2d6805585e61cc3 => generated 277 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:03.641484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28a935-500d-4cd5-90f7-80910bbef5e1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:03.661906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28a935-500d-4cd5-90f7-80910bbef5e1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:03.669622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:03.671363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:03.671917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:03.672418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/39d723c46d424021b2d6805585e61cc3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:03.697456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=39d723c46d424021b2d6805585e61cc3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:03.699569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:03.748539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '39d723c46d424021b2d6805585e61cc3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:03.753175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '39d723c46d424021b2d6805585e61cc3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:03.844147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d723c46d424021b2d6805585e61cc3', 'request_id': 'req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:03.855377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d723c46d424021b2d6805585e61cc3', 'request_id': 'req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:03.868209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d723c46d424021b2d6805585e61cc3', 'request_id': 'req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:03.872469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:03.896881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] The token cache is being invalidate because project 39d723c46d424021b2d6805585e61cc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:03.897147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:03.909313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:03.930036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '39d723c46d424021b2d6805585e61cc3', 'request_id': 'req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:03.931954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '39d723c46d424021b2d6805585e61cc3', 'request_id': 'req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:03.943375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '39d723c46d424021b2d6805585e61cc3', 'request_id': 'req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:03.960268 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1762/3516] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:03:03 2022] DELETE /identity/v3/domains/39d723c46d424021b2d6805585e61cc3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:03:03.967113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec356a-32e6-4a0d-bdf8-cbe13004ba93 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:03.974019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-64ec356a-32e6-4a0d-bdf8-cbe13004ba93 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:04.020629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec356a-32e6-4a0d-bdf8-cbe13004ba93 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:04.155259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42089849-32e8-4aaf-9c9a-e757f8eed36f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:04.156117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42089849-32e8-4aaf-9c9a-e757f8eed36f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:04.157007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42089849-32e8-4aaf-9c9a-e757f8eed36f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:04.157007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42089849-32e8-4aaf-9c9a-e757f8eed36f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/8bc5d28b1e1f4cd2bcfa3cb76e3125cd` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:04.159796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:04.174811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42089849-32e8-4aaf-9c9a-e757f8eed36f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8bc5d28b1e1f4cd2bcfa3cb76e3125cd)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:04.176953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42089849-32e8-4aaf-9c9a-e757f8eed36f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:04.212207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-42089849-32e8-4aaf-9c9a-e757f8eed36f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8bc5d28b1e1f4cd2bcfa3cb76e3125cd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:04.213307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-42089849-32e8-4aaf-9c9a-e757f8eed36f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8bc5d28b1e1f4cd2bcfa3cb76e3125cd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:04.271784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-42089849-32e8-4aaf-9c9a-e757f8eed36f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8bc5d28b1e1f4cd2bcfa3cb76e3125cd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:04.272938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-42089849-32e8-4aaf-9c9a-e757f8eed36f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8bc5d28b1e1f4cd2bcfa3cb76e3125cd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:04.284372 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1755/3517] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:03:03 2022] PATCH /identity/v3/domains/8bc5d28b1e1f4cd2bcfa3cb76e3125cd => generated 278 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:04.286323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:04.315812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c6cd8-f9f0-48e7-a1bd-b157c7ae9a21 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:04.398070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42089849-32e8-4aaf-9c9a-e757f8eed36f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:04.400655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-42089849-32e8-4aaf-9c9a-e757f8eed36f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:04.550659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:04.551818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:04.552336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:04.552860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/8bc5d28b1e1f4cd2bcfa3cb76e3125cd` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:04.575136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8bc5d28b1e1f4cd2bcfa3cb76e3125cd)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:04.577705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:04.632468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8bc5d28b1e1f4cd2bcfa3cb76e3125cd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:04.646111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8bc5d28b1e1f4cd2bcfa3cb76e3125cd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:04.699777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42089849-32e8-4aaf-9c9a-e757f8eed36f tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:04.732142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6dc0d-d14b-48b8-89a6-1fbb79e52e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:04.733255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6dc0d-d14b-48b8-89a6-1fbb79e52e2a service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:04.733758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6dc0d-d14b-48b8-89a6-1fbb79e52e2a service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:04.734250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6dc0d-d14b-48b8-89a6-1fbb79e52e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:04.742667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b7c6dc0d-d14b-48b8-89a6-1fbb79e52e2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:04.783864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc5d28b1e1f4cd2bcfa3cb76e3125cd', 'request_id': 'req-8385b5c7-2d50-49df-8989-96df06e0dcf0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:04.812937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc5d28b1e1f4cd2bcfa3cb76e3125cd', 'request_id': 'req-8385b5c7-2d50-49df-8989-96df06e0dcf0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:04.863761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc5d28b1e1f4cd2bcfa3cb76e3125cd', 'request_id': 'req-8385b5c7-2d50-49df-8989-96df06e0dcf0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:04.923038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] The token cache is being invalidate because project 8bc5d28b1e1f4cd2bcfa3cb76e3125cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:04.924102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:04.927738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:04.944586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6dc0d-d14b-48b8-89a6-1fbb79e52e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:04.948544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6dc0d-d14b-48b8-89a6-1fbb79e52e2a service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:04.968639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8bc5d28b1e1f4cd2bcfa3cb76e3125cd', 'request_id': 'req-8385b5c7-2d50-49df-8989-96df06e0dcf0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:04.970921 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1756/3518] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:04.972346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6dc0d-d14b-48b8-89a6-1fbb79e52e2a service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:04.975289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b7c6dc0d-d14b-48b8-89a6-1fbb79e52e2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:04.983698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8bc5d28b1e1f4cd2bcfa3cb76e3125cd', 'request_id': 'req-8385b5c7-2d50-49df-8989-96df06e0dcf0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:05.001458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8bc5d28b1e1f4cd2bcfa3cb76e3125cd', 'request_id': 'req-8385b5c7-2d50-49df-8989-96df06e0dcf0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:05.005173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6dc0d-d14b-48b8-89a6-1fbb79e52e2a service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:05.021151 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1763/3519] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:03:04 2022] DELETE /identity/v3/domains/8bc5d28b1e1f4cd2bcfa3cb76e3125cd => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:05.025564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:05.034594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:05.079338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=2,keystone:DELETE=16,keystone:SELECT=82 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:05.234611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:05.272379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385b5c7-2d50-49df-8989-96df06e0dcf0 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:05.292761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c43a6-63db-4de4-aa80-be8674dd2dea tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:05.296829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c43a6-63db-4de4-aa80-be8674dd2dea tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:05.297368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c43a6-63db-4de4-aa80-be8674dd2dea tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:05.298961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c43a6-63db-4de4-aa80-be8674dd2dea tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/9add0c341a9c46bebd273c6f403016b4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:05.299290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7f1a-4871-4b96-a8ec-800263a6d909 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:05.301276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7f1a-4871-4b96-a8ec-800263a6d909 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:05.304358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7f1a-4871-4b96-a8ec-800263a6d909 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:05.306372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7f1a-4871-4b96-a8ec-800263a6d909 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:05.316883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-382c7f1a-4871-4b96-a8ec-800263a6d909 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:05.346515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c43a6-63db-4de4-aa80-be8674dd2dea tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9add0c341a9c46bebd273c6f403016b4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:05.354212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c43a6-63db-4de4-aa80-be8674dd2dea tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:05.375742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7f1a-4871-4b96-a8ec-800263a6d909 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:05.380319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7f1a-4871-4b96-a8ec-800263a6d909 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:05.453561 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1757/3520] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:05.469714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b74c43a6-63db-4de4-aa80-be8674dd2dea tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9add0c341a9c46bebd273c6f403016b4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:05.472693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b74c43a6-63db-4de4-aa80-be8674dd2dea tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9add0c341a9c46bebd273c6f403016b4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:05.610244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b74c43a6-63db-4de4-aa80-be8674dd2dea tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9add0c341a9c46bebd273c6f403016b4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:05.612905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b74c43a6-63db-4de4-aa80-be8674dd2dea tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9add0c341a9c46bebd273c6f403016b4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:05.619654 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1764/3521] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:03:05 2022] PATCH /identity/v3/domains/9add0c341a9c46bebd273c6f403016b4 => generated 276 bytes in 595 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:05.625130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7f1a-4871-4b96-a8ec-800263a6d909 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:05.670438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7f1a-4871-4b96-a8ec-800263a6d909 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:05.929502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105874e6ce5746498d0500f2ebdbc3ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c449c5429aa469fa2cbe1680b5dd172', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:05.930318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:05.930655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:05.931284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] PATH_INFO: `/v3/domains/9add0c341a9c46bebd273c6f403016b4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:06.001199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9add0c341a9c46bebd273c6f403016b4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:06.003260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:06.047072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9add0c341a9c46bebd273c6f403016b4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.052145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9add0c341a9c46bebd273c6f403016b4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.141034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9add0c341a9c46bebd273c6f403016b4', 'request_id': 'req-69a3b504-6685-42b0-a37f-e225c79316c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.156181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9add0c341a9c46bebd273c6f403016b4', 'request_id': 'req-69a3b504-6685-42b0-a37f-e225c79316c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.173281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9add0c341a9c46bebd273c6f403016b4', 'request_id': 'req-69a3b504-6685-42b0-a37f-e225c79316c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.204504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] The token cache is being invalidate because project 9add0c341a9c46bebd273c6f403016b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:06.205485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.207128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.218612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9add0c341a9c46bebd273c6f403016b4', 'request_id': 'req-69a3b504-6685-42b0-a37f-e225c79316c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.222370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9add0c341a9c46bebd273c6f403016b4', 'request_id': 'req-69a3b504-6685-42b0-a37f-e225c79316c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.223034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69a3b504-6685-42b0-a37f-e225c79316c9 tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9add0c341a9c46bebd273c6f403016b4', 'request_id': 'req-69a3b504-6685-42b0-a37f-e225c79316c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.231582 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1758/3522] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:03:05 2022] DELETE /identity/v3/domains/9add0c341a9c46bebd273c6f403016b4 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:06.234555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c43a6-63db-4de4-aa80-be8674dd2dea tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:06.236176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b74c43a6-63db-4de4-aa80-be8674dd2dea tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:06.329901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c43a6-63db-4de4-aa80-be8674dd2dea tempest-DomainsTestJSON-681983083 tempest-DomainsTestJSON-681983083-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:06.410491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:06.411538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:06.411838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:06.412185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] PATH_INFO: `/v3/users/f218a836c7bf44e78fc59a6c32e8369b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:06.415262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f218a836c7bf44e78fc59a6c32e8369b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:06.418302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:06.436694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:06.485369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f218a836c7bf44e78fc59a6c32e8369b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.499731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f218a836c7bf44e78fc59a6c32e8369b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.501462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f218a836c7bf44e78fc59a6c32e8369b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.514506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f218a836c7bf44e78fc59a6c32e8369b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.515443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f218a836c7bf44e78fc59a6c32e8369b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:06.547637 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1765/3523] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:06 2022] DELETE /identity/v3/users/f218a836c7bf44e78fc59a6c32e8369b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:06.553574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cdd08-8458-4fb8-8fd1-85d1bb8f6955 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:06.554294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cdd08-8458-4fb8-8fd1-85d1bb8f6955 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:06.554294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cdd08-8458-4fb8-8fd1-85d1bb8f6955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:06.604484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7f3cdd08-8458-4fb8-8fd1-85d1bb8f6955 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:06.607291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7f3cdd08-8458-4fb8-8fd1-85d1bb8f6955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:06.622147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:06.706441 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1759/3524] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:06.748053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:06.750306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:06.873572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e65a9-ea15-460f-b4d0-d00ffdd39043 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:06.878340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c4c9a-adba-4442-be75-5fc62a160a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:06.879053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c4c9a-adba-4442-be75-5fc62a160a4f service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:06.879528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c4c9a-adba-4442-be75-5fc62a160a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:06.879930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c4c9a-adba-4442-be75-5fc62a160a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:06.918571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c4c9a-adba-4442-be75-5fc62a160a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:06.923630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c4c9a-adba-4442-be75-5fc62a160a4f service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:06.943697 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1766/3525] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:07.891787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cdd08-8458-4fb8-8fd1-85d1bb8f6955 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:07.893376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7f3cdd08-8458-4fb8-8fd1-85d1bb8f6955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:07.911495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cdd08-8458-4fb8-8fd1-85d1bb8f6955 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:07.931015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:07.931679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:07.931960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:07.932237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] PATH_INFO: `/v3/projects/f87f1da439934832bd564cbd08346256` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:07.934845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87f1da439934832bd564cbd08346256)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:07.941206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:08.078349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87f1da439934832bd564cbd08346256', 'request_id': 'req-2c8067b4-b047-4c2e-9768-a648a9987667'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:08.100070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87f1da439934832bd564cbd08346256', 'request_id': 'req-2c8067b4-b047-4c2e-9768-a648a9987667'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:08.108347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87f1da439934832bd564cbd08346256', 'request_id': 'req-2c8067b4-b047-4c2e-9768-a648a9987667'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:08.125252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] The token cache is being invalidate because project f87f1da439934832bd564cbd08346256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:08.125555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:08.126578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:08.128538 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1760/3526] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:07 2022] DELETE /identity/v3/projects/f87f1da439934832bd564cbd08346256 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:08.137038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c4c9a-adba-4442-be75-5fc62a160a4f service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:08.166597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c4c9a-adba-4442-be75-5fc62a160a4f service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:08.293223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf987080-c962-47c5-b245-e154daa398b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:08.295402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf987080-c962-47c5-b245-e154daa398b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:08.295695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf987080-c962-47c5-b245-e154daa398b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:08.295968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf987080-c962-47c5-b245-e154daa398b6 admin admin] PATH_INFO: `/v3/users/105874e6ce5746498d0500f2ebdbc3ea` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:08.297254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf987080-c962-47c5-b245-e154daa398b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=105874e6ce5746498d0500f2ebdbc3ea)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:08.299259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf987080-c962-47c5-b245-e154daa398b6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:08.365163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:08.380588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cf987080-c962-47c5-b245-e154daa398b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105874e6ce5746498d0500f2ebdbc3ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:08.399647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cf987080-c962-47c5-b245-e154daa398b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105874e6ce5746498d0500f2ebdbc3ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:08.400941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cf987080-c962-47c5-b245-e154daa398b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105874e6ce5746498d0500f2ebdbc3ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:08.418458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cf987080-c962-47c5-b245-e154daa398b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105874e6ce5746498d0500f2ebdbc3ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:08.419816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cf987080-c962-47c5-b245-e154daa398b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105874e6ce5746498d0500f2ebdbc3ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:08.449001 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1767/3527] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:08 2022] DELETE /identity/v3/users/105874e6ce5746498d0500f2ebdbc3ea => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:09.236838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:09.238846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:09.271088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8067b4-b047-4c2e-9768-a648a9987667 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:09.393396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a182f5c-741e-48c5-a28a-772f8b02d4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:09.394171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182f5c-741e-48c5-a28a-772f8b02d4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:09.394609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182f5c-741e-48c5-a28a-772f8b02d4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:09.395007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182f5c-741e-48c5-a28a-772f8b02d4e3 admin admin] PATH_INFO: `/v3/projects/3c449c5429aa469fa2cbe1680b5dd172` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:09.401635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a182f5c-741e-48c5-a28a-772f8b02d4e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c449c5429aa469fa2cbe1680b5dd172)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:09.404201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a182f5c-741e-48c5-a28a-772f8b02d4e3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:09.496011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:09.508156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3a182f5c-741e-48c5-a28a-772f8b02d4e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c449c5429aa469fa2cbe1680b5dd172', 'request_id': 'req-3a182f5c-741e-48c5-a28a-772f8b02d4e3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:09.521508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3a182f5c-741e-48c5-a28a-772f8b02d4e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c449c5429aa469fa2cbe1680b5dd172', 'request_id': 'req-3a182f5c-741e-48c5-a28a-772f8b02d4e3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:09.536821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3a182f5c-741e-48c5-a28a-772f8b02d4e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c449c5429aa469fa2cbe1680b5dd172', 'request_id': 'req-3a182f5c-741e-48c5-a28a-772f8b02d4e3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:09.554907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3a182f5c-741e-48c5-a28a-772f8b02d4e3 admin admin] The token cache is being invalidate because project 3c449c5429aa469fa2cbe1680b5dd172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:09.555207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3a182f5c-741e-48c5-a28a-772f8b02d4e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:09.555890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3a182f5c-741e-48c5-a28a-772f8b02d4e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:09.558716 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1761/3528] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:09 2022] DELETE /identity/v3/projects/3c449c5429aa469fa2cbe1680b5dd172 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:09.564066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe2011-a197-4aaf-a89d-cbcb83b64d24 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:09.564690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe2011-a197-4aaf-a89d-cbcb83b64d24 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:09.564690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe2011-a197-4aaf-a89d-cbcb83b64d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:09.604055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-edbe2011-a197-4aaf-a89d-cbcb83b64d24 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:09.605810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-edbe2011-a197-4aaf-a89d-cbcb83b64d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:09.749097 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1768/3529] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:09.757170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bef20-556d-4931-9abd-94d168ca60ed None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:09.757505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bef20-556d-4931-9abd-94d168ca60ed None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:09.757960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bef20-556d-4931-9abd-94d168ca60ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:09.783055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-849bef20-556d-4931-9abd-94d168ca60ed None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:09.784875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-849bef20-556d-4931-9abd-94d168ca60ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:09.802829 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1762/3530] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:09.803999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe2011-a197-4aaf-a89d-cbcb83b64d24 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:09.818118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe2011-a197-4aaf-a89d-cbcb83b64d24 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:09.824179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fff1f0-3b71-47a9-8df8-e97edfed4c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:09.825097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fff1f0-3b71-47a9-8df8-e97edfed4c32 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:09.825482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fff1f0-3b71-47a9-8df8-e97edfed4c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:09.825855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fff1f0-3b71-47a9-8df8-e97edfed4c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:09.826625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fff1f0-3b71-47a9-8df8-e97edfed4c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:03:09.827086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fff1f0-3b71-47a9-8df8-e97edfed4c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:09.829093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fff1f0-3b71-47a9-8df8-e97edfed4c32 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:09.848524 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1769/3531] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:09.849831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bef20-556d-4931-9abd-94d168ca60ed None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:09.862299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bef20-556d-4931-9abd-94d168ca60ed None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:09.875358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80308e-4efd-4f20-9444-aad4a0a10cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:09.880620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80308e-4efd-4f20-9444-aad4a0a10cfe admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:09.881355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80308e-4efd-4f20-9444-aad4a0a10cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:09.881694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80308e-4efd-4f20-9444-aad4a0a10cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:09.882728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80308e-4efd-4f20-9444-aad4a0a10cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:09.888411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80308e-4efd-4f20-9444-aad4a0a10cfe admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:09.959601 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1763/3532] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:09 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:09.959807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fff1f0-3b71-47a9-8df8-e97edfed4c32 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:09.975414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fff1f0-3b71-47a9-8df8-e97edfed4c32 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:10.124259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c43b2-ad8e-4bd1-bec4-7cca0089014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:10.125167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c43b2-ad8e-4bd1-bec4-7cca0089014b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:10.125311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c43b2-ad8e-4bd1-bec4-7cca0089014b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:10.125590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c43b2-ad8e-4bd1-bec4-7cca0089014b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:10.126243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c43b2-ad8e-4bd1-bec4-7cca0089014b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:10.128243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c43b2-ad8e-4bd1-bec4-7cca0089014b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:10.164211 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1770/3533] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:03:09 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:03:10.170649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80308e-4efd-4f20-9444-aad4a0a10cfe admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:10.189511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80308e-4efd-4f20-9444-aad4a0a10cfe admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:10.196659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e24f4-a047-4a11-81ed-d9cca4e8177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:10.197220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e24f4-a047-4a11-81ed-d9cca4e8177a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:10.197495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e24f4-a047-4a11-81ed-d9cca4e8177a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:10.198500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e24f4-a047-4a11-81ed-d9cca4e8177a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:10.199224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e24f4-a047-4a11-81ed-d9cca4e8177a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:10.201313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e24f4-a047-4a11-81ed-d9cca4e8177a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:10.222543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c43b2-ad8e-4bd1-bec4-7cca0089014b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:10.232279 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1764/3534] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:10.235211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c43b2-ad8e-4bd1-bec4-7cca0089014b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:10.244106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75908df4-1504-4877-a62b-99abb9872f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:10.244650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75908df4-1504-4877-a62b-99abb9872f99 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:10.244990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75908df4-1504-4877-a62b-99abb9872f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:10.245386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75908df4-1504-4877-a62b-99abb9872f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:10.246420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75908df4-1504-4877-a62b-99abb9872f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:10.250905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75908df4-1504-4877-a62b-99abb9872f99 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:10.270052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e24f4-a047-4a11-81ed-d9cca4e8177a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:10.270671 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1771/3535] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:03:10.294413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e24f4-a047-4a11-81ed-d9cca4e8177a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:10.321506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d4e6f-a8e6-4f8a-852f-8f1c2e4b32b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:10.322205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4e6f-a8e6-4f8a-852f-8f1c2e4b32b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:10.322494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4e6f-a8e6-4f8a-852f-8f1c2e4b32b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:10.322791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4e6f-a8e6-4f8a-852f-8f1c2e4b32b5 admin admin] PATH_INFO: `/v3/projects/5db38d9ee74f4c97ab7b7c0b30322554/users/96520ddb23f74c9bbb10aa8e012a3b84/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:10.353303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d4e6f-a8e6-4f8a-852f-8f1c2e4b32b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db38d9ee74f4c97ab7b7c0b30322554, user_id=96520ddb23f74c9bbb10aa8e012a3b84, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:10.356426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d4e6f-a8e6-4f8a-852f-8f1c2e4b32b5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:10.397989 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1765/3536] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:10 2022] PUT /identity/v3/projects/5db38d9ee74f4c97ab7b7c0b30322554/users/96520ddb23f74c9bbb10aa8e012a3b84/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:10.401061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798c356-ac99-40c5-8021-eb1b9fce670a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:10.402665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798c356-ac99-40c5-8021-eb1b9fce670a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:10.404719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798c356-ac99-40c5-8021-eb1b9fce670a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:10.465585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8798c356-ac99-40c5-8021-eb1b9fce670a None None] MFA Rules not processed for user `96520ddb23f74c9bbb10aa8e012a3b84`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:10.468022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8798c356-ac99-40c5-8021-eb1b9fce670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:10.484195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:10.622686 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1772/3537] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:03:10.628662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d4e6f-a8e6-4f8a-852f-8f1c2e4b32b5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:10.756981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d4e6f-a8e6-4f8a-852f-8f1c2e4b32b5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:10.769348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65dfe0-cac1-46e5-aafc-8b7061ac18bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:10.771225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65dfe0-cac1-46e5-aafc-8b7061ac18bc admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:10.771634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65dfe0-cac1-46e5-aafc-8b7061ac18bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:10.772144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65dfe0-cac1-46e5-aafc-8b7061ac18bc admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:10.772928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65dfe0-cac1-46e5-aafc-8b7061ac18bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:10.781618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65dfe0-cac1-46e5-aafc-8b7061ac18bc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:10.880241 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1766/3538] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:10 2022] POST /identity/v3/projects => generated 381 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:10.884096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798c356-ac99-40c5-8021-eb1b9fce670a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:10.905216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798c356-ac99-40c5-8021-eb1b9fce670a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:11.067903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be265898-6275-4aca-8093-a830736baebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:11.068686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be265898-6275-4aca-8093-a830736baebf admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:11.069016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be265898-6275-4aca-8093-a830736baebf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:11.069269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be265898-6275-4aca-8093-a830736baebf admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:11.069941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be265898-6275-4aca-8093-a830736baebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:11.074648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be265898-6275-4aca-8093-a830736baebf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:11.132948 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1773/3539] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:03:10 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:03:11.139524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65dfe0-cac1-46e5-aafc-8b7061ac18bc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:11.157526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65dfe0-cac1-46e5-aafc-8b7061ac18bc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:11.168671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34e341-f274-46a6-aa44-fb45eaf96e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:11.169934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34e341-f274-46a6-aa44-fb45eaf96e9c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:11.170515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34e341-f274-46a6-aa44-fb45eaf96e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:11.171034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34e341-f274-46a6-aa44-fb45eaf96e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:11.171970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34e341-f274-46a6-aa44-fb45eaf96e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:11.178719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34e341-f274-46a6-aa44-fb45eaf96e9c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:11.201531 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1767/3540] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:11.205904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be265898-6275-4aca-8093-a830736baebf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:11.226933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be265898-6275-4aca-8093-a830736baebf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:11.239865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33d329-b160-4053-8574-5cf8decae79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:11.240919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33d329-b160-4053-8574-5cf8decae79c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:11.241414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33d329-b160-4053-8574-5cf8decae79c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:11.241905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33d329-b160-4053-8574-5cf8decae79c admin admin] PATH_INFO: `/v3/projects/ae58894eb30b4892aed1ec10c3ce0282/users/eb5c16dc9b9a47aa9a7452a00c548adc/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:11.284218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33d329-b160-4053-8574-5cf8decae79c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae58894eb30b4892aed1ec10c3ce0282, user_id=eb5c16dc9b9a47aa9a7452a00c548adc, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:11.287297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33d329-b160-4053-8574-5cf8decae79c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:11.316580 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1774/3541] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:11 2022] PUT /identity/v3/projects/ae58894eb30b4892aed1ec10c3ce0282/users/eb5c16dc9b9a47aa9a7452a00c548adc/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:11.320510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34e341-f274-46a6-aa44-fb45eaf96e9c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:11.342042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34e341-f274-46a6-aa44-fb45eaf96e9c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:11.500271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:11.582669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714d90d-0eca-432a-b8ac-458a13ea0391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:11.582934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714d90d-0eca-432a-b8ac-458a13ea0391 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:11.583219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714d90d-0eca-432a-b8ac-458a13ea0391 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:11.583493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714d90d-0eca-432a-b8ac-458a13ea0391 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:11.586995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714d90d-0eca-432a-b8ac-458a13ea0391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:11.589527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714d90d-0eca-432a-b8ac-458a13ea0391 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:11.641056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33d329-b160-4053-8574-5cf8decae79c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:11.642776 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1768/3542] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:11.663114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33d329-b160-4053-8574-5cf8decae79c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:11.688751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3557e-1582-485b-a626-e8abb7f4f253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:11.689771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3557e-1582-485b-a626-e8abb7f4f253 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:11.690253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3557e-1582-485b-a626-e8abb7f4f253 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:11.690783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3557e-1582-485b-a626-e8abb7f4f253 admin admin] PATH_INFO: `/v3/projects/ae58894eb30b4892aed1ec10c3ce0282/users/eb5c16dc9b9a47aa9a7452a00c548adc/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:11.699734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3557e-1582-485b-a626-e8abb7f4f253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae58894eb30b4892aed1ec10c3ce0282, user_id=eb5c16dc9b9a47aa9a7452a00c548adc, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:11.702732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3557e-1582-485b-a626-e8abb7f4f253 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:11.741624 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1775/3543] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:11 2022] PUT /identity/v3/projects/ae58894eb30b4892aed1ec10c3ce0282/users/eb5c16dc9b9a47aa9a7452a00c548adc/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:03:11.755298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139024-a112-4e17-9a7c-2184b1ba19cf None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:11.755671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139024-a112-4e17-9a7c-2184b1ba19cf None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:11.755993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f139024-a112-4e17-9a7c-2184b1ba19cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:11.863569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6f139024-a112-4e17-9a7c-2184b1ba19cf None None] MFA Rules not processed for user `eb5c16dc9b9a47aa9a7452a00c548adc`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:11.865317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6f139024-a112-4e17-9a7c-2184b1ba19cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:12.138369 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1769/3544] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:12.142351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3557e-1582-485b-a626-e8abb7f4f253 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:12.183935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3557e-1582-485b-a626-e8abb7f4f253 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:12.195924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf917f-d37b-46ce-b100-bb41083f041a tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5c16dc9b9a47aa9a7452a00c548adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae58894eb30b4892aed1ec10c3ce0282', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:12.196822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf917f-d37b-46ce-b100-bb41083f041a tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:12.197351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf917f-d37b-46ce-b100-bb41083f041a tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:12.197869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf917f-d37b-46ce-b100-bb41083f041a tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:12.199422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf917f-d37b-46ce-b100-bb41083f041a tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:12.201748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf917f-d37b-46ce-b100-bb41083f041a tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-d4bf917f-d37b-46ce-b100-bb41083f041a tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invalid input for field 'name': '' is too short Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: On instance['name']: Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: On instance['name']: Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: '' Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise error Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application On instance['name']: Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application '' Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:03:12.237429 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 19:03:12.239209 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 19:03:12.240543 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 19:03:12.240543 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 19:03:12.240543 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:03:12.240543 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 19:03:12.240543 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:03:12.240543 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:03:12.240543 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application On instance['name']: Aug 28 19:03:12.240543 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application '' Aug 28 19:03:12.240543 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:03:12.243660 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1776/3545] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:03:12 2022] POST /identity/v3/domains => generated 283 bytes in 102 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 19:03:12.252893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139024-a112-4e17-9a7c-2184b1ba19cf None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:12.291681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f139024-a112-4e17-9a7c-2184b1ba19cf None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:12.310584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e557f5a-d7b2-4e4f-8e0d-b122704e3306 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5c16dc9b9a47aa9a7452a00c548adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae58894eb30b4892aed1ec10c3ce0282', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:12.312553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e557f5a-d7b2-4e4f-8e0d-b122704e3306 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:12.313319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e557f5a-d7b2-4e4f-8e0d-b122704e3306 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:12.313764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e557f5a-d7b2-4e4f-8e0d-b122704e3306 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:12.314802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e557f5a-d7b2-4e4f-8e0d-b122704e3306 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:12.316695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e557f5a-d7b2-4e4f-8e0d-b122704e3306 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-9e557f5a-d7b2-4e4f-8e0d-b122704e3306 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: On instance['name']: Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: On instance['name']: Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise error Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:03:12.355535 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application On instance['name']: Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 28 19:03:12.357382 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 28 19:03:12.358368 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 19:03:12.358368 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 19:03:12.358368 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 19:03:12.358368 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 19:03:12.358368 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 19:03:12.358368 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:12.358368 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 19:03:12.358368 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:03:12.358368 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:12.358368 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application On instance['name']: Aug 28 19:03:12.358368 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 19:03:12.358368 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:12.360387 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1770/3546] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:03:12 2022] POST /identity/v3/domains => generated 412 bytes in 106 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 19:03:12.365208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf917f-d37b-46ce-b100-bb41083f041a tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:12.379927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf917f-d37b-46ce-b100-bb41083f041a tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:12.392178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf1596-f222-4f6d-81d1-848dc68c0d67 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5c16dc9b9a47aa9a7452a00c548adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae58894eb30b4892aed1ec10c3ce0282', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:12.392793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf1596-f222-4f6d-81d1-848dc68c0d67 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:12.393077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf1596-f222-4f6d-81d1-848dc68c0d67 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:12.393353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf1596-f222-4f6d-81d1-848dc68c0d67 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:12.394084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf1596-f222-4f6d-81d1-848dc68c0d67 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:12.395649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf1596-f222-4f6d-81d1-848dc68c0d67 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:12.441818 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1777/3547] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:03:12 2022] POST /identity/v3/domains => generated 276 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:12.444105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e557f5a-d7b2-4e4f-8e0d-b122704e3306 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:12.465216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e557f5a-d7b2-4e4f-8e0d-b122704e3306 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:12.587232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48bd28-7700-4145-9bc4-c2196532f2e0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:12.587566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48bd28-7700-4145-9bc4-c2196532f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:12.588027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48bd28-7700-4145-9bc4-c2196532f2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:12.637547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ce48bd28-7700-4145-9bc4-c2196532f2e0 None None] MFA Rules not processed for user `8c74321e1a114e3094d2f69930037505`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:12.639106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ce48bd28-7700-4145-9bc4-c2196532f2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:12.641091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e889d60-dcec-4769-ac7a-0aa7100b6318 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5c16dc9b9a47aa9a7452a00c548adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae58894eb30b4892aed1ec10c3ce0282', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:12.642134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e889d60-dcec-4769-ac7a-0aa7100b6318 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:12.642441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e889d60-dcec-4769-ac7a-0aa7100b6318 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:12.642855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e889d60-dcec-4769-ac7a-0aa7100b6318 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] PATH_INFO: `/v3/domains/f1ca4449da2a4862809e78c170feb8e6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:12.663938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e889d60-dcec-4769-ac7a-0aa7100b6318 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f1ca4449da2a4862809e78c170feb8e6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:12.670505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e889d60-dcec-4769-ac7a-0aa7100b6318 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-3e889d60-dcec-4769-ac7a-0aa7100b6318 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Aug 28 19:03:12.719553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Aug 28 19:03:12.720548 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:12.720548 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:12.720548 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Aug 28 19:03:12.720548 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Aug 28 19:03:12.720548 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Aug 28 19:03:12.720548 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 28 19:03:12.720548 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 28 19:03:12.720548 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:12.721016 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1771/3548] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:03:12 2022] DELETE /identity/v3/domains/f1ca4449da2a4862809e78c170feb8e6 => generated 120 bytes in 277 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:03:12.729376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e889d60-dcec-4769-ac7a-0aa7100b6318 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:12.763968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e889d60-dcec-4769-ac7a-0aa7100b6318 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:12.776673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feb7a9-3458-4e1f-bc20-240e7e16d202 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5c16dc9b9a47aa9a7452a00c548adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae58894eb30b4892aed1ec10c3ce0282', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:12.777344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feb7a9-3458-4e1f-bc20-240e7e16d202 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:12.781574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feb7a9-3458-4e1f-bc20-240e7e16d202 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:12.782007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feb7a9-3458-4e1f-bc20-240e7e16d202 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] PATH_INFO: `/v3/domains/f1ca4449da2a4862809e78c170feb8e6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:12.787582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47feb7a9-3458-4e1f-bc20-240e7e16d202 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f1ca4449da2a4862809e78c170feb8e6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:12.792140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47feb7a9-3458-4e1f-bc20-240e7e16d202 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:12.806272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:12.828582 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1778/3549] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:12.876013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47feb7a9-3458-4e1f-bc20-240e7e16d202 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f1ca4449da2a4862809e78c170feb8e6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:12.876789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47feb7a9-3458-4e1f-bc20-240e7e16d202 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f1ca4449da2a4862809e78c170feb8e6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:12.910708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:12.915638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47feb7a9-3458-4e1f-bc20-240e7e16d202 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f1ca4449da2a4862809e78c170feb8e6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:12.917351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47feb7a9-3458-4e1f-bc20-240e7e16d202 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f1ca4449da2a4862809e78c170feb8e6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:12.926246 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1772/3550] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:03:12 2022] PATCH /identity/v3/domains/f1ca4449da2a4862809e78c170feb8e6 => generated 277 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:12.927628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48bd28-7700-4145-9bc4-c2196532f2e0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:12.947545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48bd28-7700-4145-9bc4-c2196532f2e0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:13.079260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5c16dc9b9a47aa9a7452a00c548adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae58894eb30b4892aed1ec10c3ce0282', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:13.080103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:13.080406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:13.080691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] PATH_INFO: `/v3/domains/f1ca4449da2a4862809e78c170feb8e6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:13.108063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f1ca4449da2a4862809e78c170feb8e6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:13.109869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:13.137132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f1ca4449da2a4862809e78c170feb8e6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:13.142317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f1ca4449da2a4862809e78c170feb8e6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:13.166735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402b698-f3fa-4f34-8ac4-33c6cc720b44 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:13.167654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402b698-f3fa-4f34-8ac4-33c6cc720b44 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:13.167890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402b698-f3fa-4f34-8ac4-33c6cc720b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:13.202523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8402b698-f3fa-4f34-8ac4-33c6cc720b44 None None] MFA Rules not processed for user `34e0fcf65bd04c148f884037e16b3c09`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:13.204277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8402b698-f3fa-4f34-8ac4-33c6cc720b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:13.254779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ca4449da2a4862809e78c170feb8e6', 'request_id': 'req-7331728c-9af8-411c-a151-10f236617a2e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:13.266991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ca4449da2a4862809e78c170feb8e6', 'request_id': 'req-7331728c-9af8-411c-a151-10f236617a2e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:13.281693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ca4449da2a4862809e78c170feb8e6', 'request_id': 'req-7331728c-9af8-411c-a151-10f236617a2e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:13.322724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] The token cache is being invalidate because project f1ca4449da2a4862809e78c170feb8e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:13.326161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:13.327232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:13.347313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f1ca4449da2a4862809e78c170feb8e6', 'request_id': 'req-7331728c-9af8-411c-a151-10f236617a2e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:13.348425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f1ca4449da2a4862809e78c170feb8e6', 'request_id': 'req-7331728c-9af8-411c-a151-10f236617a2e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:13.356821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f1ca4449da2a4862809e78c170feb8e6', 'request_id': 'req-7331728c-9af8-411c-a151-10f236617a2e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:13.361639 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1773/3551] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:03:13.380342 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1779/3552] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:03:12 2022] DELETE /identity/v3/domains/f1ca4449da2a4862809e78c170feb8e6 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:13.387688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402b698-f3fa-4f34-8ac4-33c6cc720b44 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:13.389158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8402b698-f3fa-4f34-8ac4-33c6cc720b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:13.419522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402b698-f3fa-4f34-8ac4-33c6cc720b44 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:13.567282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df433749-f980-4299-a4f7-d401375fced4 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5c16dc9b9a47aa9a7452a00c548adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae58894eb30b4892aed1ec10c3ce0282', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:13.568351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df433749-f980-4299-a4f7-d401375fced4 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:13.568886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df433749-f980-4299-a4f7-d401375fced4 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:13.569845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df433749-f980-4299-a4f7-d401375fced4 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] PATH_INFO: `/v3/domains/2cb6c38b2feb41bda328b166ccb6c90c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:13.592960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df433749-f980-4299-a4f7-d401375fced4 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-df433749-f980-4299-a4f7-d401375fced4 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Could not find domain: 2cb6c38b2feb41bda328b166ccb6c90c.: keystone.exception.DomainNotFound: Could not find domain: 2cb6c38b2feb41bda328b166ccb6c90c. Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2cb6c38b2feb41bda328b166ccb6c90c. Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:13.601148 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:13.602147 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:03:13.603179 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2cb6c38b2feb41bda328b166ccb6c90c. Aug 28 19:03:13.604168 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:13.611140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:13.611601 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1774/3553] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:03:13 2022] DELETE /identity/v3/domains/2cb6c38b2feb41bda328b166ccb6c90c => generated 112 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 19:03:13.613322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:13.641735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331728c-9af8-411c-a151-10f236617a2e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:13.657666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e312203-63ca-4ff6-b9a6-a3f0bda2ecb7 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5c16dc9b9a47aa9a7452a00c548adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae58894eb30b4892aed1ec10c3ce0282', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:13.658339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e312203-63ca-4ff6-b9a6-a3f0bda2ecb7 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:13.658630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e312203-63ca-4ff6-b9a6-a3f0bda2ecb7 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:13.659013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e312203-63ca-4ff6-b9a6-a3f0bda2ecb7 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:13.659695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e312203-63ca-4ff6-b9a6-a3f0bda2ecb7 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:13.661407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e312203-63ca-4ff6-b9a6-a3f0bda2ecb7 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:13.708081 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1780/3554] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:03:13 2022] POST /identity/v3/domains => generated 253 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:03:13.712446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df433749-f980-4299-a4f7-d401375fced4 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:13.730611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df433749-f980-4299-a4f7-d401375fced4 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:13.836621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e312203-63ca-4ff6-b9a6-a3f0bda2ecb7 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:13.839597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5e312203-63ca-4ff6-b9a6-a3f0bda2ecb7 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:13.880800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:13.936968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c81d1b-8ea2-4be1-a65a-b188a1e5a06e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5c16dc9b9a47aa9a7452a00c548adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae58894eb30b4892aed1ec10c3ce0282', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:13.939140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c81d1b-8ea2-4be1-a65a-b188a1e5a06e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:13.941133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c81d1b-8ea2-4be1-a65a-b188a1e5a06e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:13.942232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c81d1b-8ea2-4be1-a65a-b188a1e5a06e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:13.943459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c81d1b-8ea2-4be1-a65a-b188a1e5a06e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:13.950948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c81d1b-8ea2-4be1-a65a-b188a1e5a06e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:13.982375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.sql.core [None req-38c81d1b-8ea2-4be1-a65a-b188a1e5a06e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-2001835309' for key 'project.ixu_project_name_domain_id'") Aug 28 19:03:13.982375 n-d-854118-7 devstack@keystone.service[88374]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 19:03:13.982375 n-d-854118-7 devstack@keystone.service[88374]: [parameters: {'id': '16611b7c899f43979d27c79758591286', 'name': 'tempest-domain-dup-2001835309', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 28 19:03:13.982375 n-d-854118-7 devstack@keystone.service[88374]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88374) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 19:03:13.987496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e312203-63ca-4ff6-b9a6-a3f0bda2ecb7 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:13.997749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec0c77-053e-452e-9b98-e465fbdabbb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:13.998382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec0c77-053e-452e-9b98-e465fbdabbb3 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:13.998667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec0c77-053e-452e-9b98-e465fbdabbb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:13.999143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec0c77-053e-452e-9b98-e465fbdabbb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:14.000032 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-38c81d1b-8ea2-4be1-a65a-b188a1e5a06e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-2001835309.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-2001835309. Aug 28 19:03:14.000032 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:14.000032 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 19:03:14.000032 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 19:03:14.000032 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 19:03:14.000032 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 19:03:14.000032 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 19:03:14.000032 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 19:03:14.000032 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 19:03:14.000032 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application conn.query(q) Aug 28 19:03:14.000032 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 19:03:14.000032 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 19:03:14.000032 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application result.read() Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-2001835309' for key 'project.ixu_project_name_domain_id'") Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 19:03:14.001131 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application next(self.gen) Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application yield resource Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application next(self.gen) Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise self.value Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application session.commit() Aug 28 19:03:14.002356 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.session.flush() Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application compat.raise_( Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 19:03:14.003605 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 19:03:14.004781 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application conn.query(q) Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application result.read() Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 19:03:14.005859 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-2001835309' for key 'project.ixu_project_name_domain_id'") Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [parameters: {'id': '16611b7c899f43979d27c79758591286', 'name': 'tempest-domain-dup-2001835309', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:14.006991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-2001835309. Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:14.007959 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-2001835309. Aug 28 19:03:14.009132 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:14.015120 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1775/3555] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:03:13 2022] POST /identity/v3/domains => generated 212 bytes in 303 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:03:14.015414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d5ec0c77-053e-452e-9b98-e465fbdabbb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:14.017843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c81d1b-8ea2-4be1-a65a-b188a1e5a06e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:14.032475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec0c77-053e-452e-9b98-e465fbdabbb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:14.047151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec0c77-053e-452e-9b98-e465fbdabbb3 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:14.059990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c81d1b-8ea2-4be1-a65a-b188a1e5a06e tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:14.072438 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1781/3556] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:14.096316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804a5d3-0a11-44ed-be73-dd323492bac1 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5c16dc9b9a47aa9a7452a00c548adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae58894eb30b4892aed1ec10c3ce0282', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:14.096612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a5d3-0a11-44ed-be73-dd323492bac1 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:14.096895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a5d3-0a11-44ed-be73-dd323492bac1 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:14.097182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804a5d3-0a11-44ed-be73-dd323492bac1 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] PATH_INFO: `/v3/domains/4f7cc9e825b0467f87213a0823694edc` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:14.138007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804a5d3-0a11-44ed-be73-dd323492bac1 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4f7cc9e825b0467f87213a0823694edc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:14.140022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804a5d3-0a11-44ed-be73-dd323492bac1 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:14.213230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2804a5d3-0a11-44ed-be73-dd323492bac1 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4f7cc9e825b0467f87213a0823694edc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:14.226961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2804a5d3-0a11-44ed-be73-dd323492bac1 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4f7cc9e825b0467f87213a0823694edc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:14.255537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:14.298018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2804a5d3-0a11-44ed-be73-dd323492bac1 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4f7cc9e825b0467f87213a0823694edc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:14.299642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2804a5d3-0a11-44ed-be73-dd323492bac1 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4f7cc9e825b0467f87213a0823694edc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:14.317741 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1776/3557] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:03:14 2022] PATCH /identity/v3/domains/4f7cc9e825b0467f87213a0823694edc => generated 254 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:14.323889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec0c77-053e-452e-9b98-e465fbdabbb3 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:14.375421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec0c77-053e-452e-9b98-e465fbdabbb3 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:14.580899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5c16dc9b9a47aa9a7452a00c548adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae58894eb30b4892aed1ec10c3ce0282', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:14.582482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:14.590112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:14.591034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] PATH_INFO: `/v3/domains/4f7cc9e825b0467f87213a0823694edc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:14.622523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4f7cc9e825b0467f87213a0823694edc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:14.624517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:14.667923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4f7cc9e825b0467f87213a0823694edc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:14.680067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4f7cc9e825b0467f87213a0823694edc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:14.815055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7cc9e825b0467f87213a0823694edc', 'request_id': 'req-63b8c23e-effe-4b8a-a573-ffba9af7ac63'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:14.840953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7cc9e825b0467f87213a0823694edc', 'request_id': 'req-63b8c23e-effe-4b8a-a573-ffba9af7ac63'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:14.862590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7cc9e825b0467f87213a0823694edc', 'request_id': 'req-63b8c23e-effe-4b8a-a573-ffba9af7ac63'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:14.894073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] The token cache is being invalidate because project 4f7cc9e825b0467f87213a0823694edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:14.915491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:14.925416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:14.956234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4f7cc9e825b0467f87213a0823694edc', 'request_id': 'req-63b8c23e-effe-4b8a-a573-ffba9af7ac63'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:14.957535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4f7cc9e825b0467f87213a0823694edc', 'request_id': 'req-63b8c23e-effe-4b8a-a573-ffba9af7ac63'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:14.961675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:14.967486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4f7cc9e825b0467f87213a0823694edc', 'request_id': 'req-63b8c23e-effe-4b8a-a573-ffba9af7ac63'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:15.031950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804a5d3-0a11-44ed-be73-dd323492bac1 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:15.032606 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1782/3558] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:03:14 2022] DELETE /identity/v3/domains/4f7cc9e825b0467f87213a0823694edc => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:15.033924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2804a5d3-0a11-44ed-be73-dd323492bac1 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:15.061184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804a5d3-0a11-44ed-be73-dd323492bac1 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:15.308302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70bfd9-97ac-4023-ad3a-0dd75bfe128b tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5c16dc9b9a47aa9a7452a00c548adc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae58894eb30b4892aed1ec10c3ce0282', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:15.308989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70bfd9-97ac-4023-ad3a-0dd75bfe128b tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:15.309278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70bfd9-97ac-4023-ad3a-0dd75bfe128b tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:15.309556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70bfd9-97ac-4023-ad3a-0dd75bfe128b tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] PATH_INFO: `/v3/domains/f1ca4449da2a4862809e78c170feb8e6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:15.345325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70bfd9-97ac-4023-ad3a-0dd75bfe128b tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-fb70bfd9-97ac-4023-ad3a-0dd75bfe128b tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Could not find domain: f1ca4449da2a4862809e78c170feb8e6.: keystone.exception.DomainNotFound: Could not find domain: f1ca4449da2a4862809e78c170feb8e6. Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f1ca4449da2a4862809e78c170feb8e6. Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:15.362758 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:03:15.363848 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:03:15.365269 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f1ca4449da2a4862809e78c170feb8e6. Aug 28 19:03:15.366257 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:03:15.368094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:15.369628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:15.376406 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1777/3559] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:03:15 2022] PATCH /identity/v3/domains/f1ca4449da2a4862809e78c170feb8e6 => generated 112 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:03:15.594262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8c23e-effe-4b8a-a573-ffba9af7ac63 tempest-DomainsNegativeTestJSON-749390480 tempest-DomainsNegativeTestJSON-749390480-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:15.601249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:15.602295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:15.603007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:15.603836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] PATH_INFO: `/v3/users/96520ddb23f74c9bbb10aa8e012a3b84` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:15.605605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96520ddb23f74c9bbb10aa8e012a3b84)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:15.607754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:15.726542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96520ddb23f74c9bbb10aa8e012a3b84'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:15.749271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96520ddb23f74c9bbb10aa8e012a3b84'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:15.752430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96520ddb23f74c9bbb10aa8e012a3b84'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:15.781675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96520ddb23f74c9bbb10aa8e012a3b84'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:15.783546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96520ddb23f74c9bbb10aa8e012a3b84'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:15.827136 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1783/3560] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:15 2022] DELETE /identity/v3/users/96520ddb23f74c9bbb10aa8e012a3b84 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:03:15.833150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a6a6-6f1c-4b9a-95a2-092ed4765f01 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:15.833150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a6a6-6f1c-4b9a-95a2-092ed4765f01 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:15.833482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a6a6-6f1c-4b9a-95a2-092ed4765f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:15.911209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3e58a6a6-6f1c-4b9a-95a2-092ed4765f01 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:15.912466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3e58a6a6-6f1c-4b9a-95a2-092ed4765f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:16.046797 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1778/3561] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:03:16.245802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:16.247860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:16.331111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03092dd3-33db-420d-8225-fe325ac07b57 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:16.342615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcf8d1-588e-4c0c-8a5b-abbfbe07acf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:16.343417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcf8d1-588e-4c0c-8a5b-abbfbe07acf6 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:16.343878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcf8d1-588e-4c0c-8a5b-abbfbe07acf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:16.344179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcf8d1-588e-4c0c-8a5b-abbfbe07acf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:16.356830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcf8d1-588e-4c0c-8a5b-abbfbe07acf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:16.358567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcf8d1-588e-4c0c-8a5b-abbfbe07acf6 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:16.373072 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1784/3562] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:18.720598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58a6a6-6f1c-4b9a-95a2-092ed4765f01 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:18.722443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3e58a6a6-6f1c-4b9a-95a2-092ed4765f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:18.762643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58a6a6-6f1c-4b9a-95a2-092ed4765f01 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:18.784604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:18.785318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:18.785577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:18.785853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] PATH_INFO: `/v3/projects/5db38d9ee74f4c97ab7b7c0b30322554` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:18.793688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db38d9ee74f4c97ab7b7c0b30322554)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:18.805971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:19.017153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db38d9ee74f4c97ab7b7c0b30322554', 'request_id': 'req-46e9aa21-9e59-4416-b7a2-c7195d41efab'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:19.036148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db38d9ee74f4c97ab7b7c0b30322554', 'request_id': 'req-46e9aa21-9e59-4416-b7a2-c7195d41efab'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:19.053764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db38d9ee74f4c97ab7b7c0b30322554', 'request_id': 'req-46e9aa21-9e59-4416-b7a2-c7195d41efab'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:19.116786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] The token cache is being invalidate because project 5db38d9ee74f4c97ab7b7c0b30322554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:19.123511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:19.126505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:19.130659 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1779/3563] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:18 2022] DELETE /identity/v3/projects/5db38d9ee74f4c97ab7b7c0b30322554 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:19.135726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcf8d1-588e-4c0c-8a5b-abbfbe07acf6 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:19.158858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcf8d1-588e-4c0c-8a5b-abbfbe07acf6 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:19.195849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:19.301886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3c0e6-ea28-4b0c-b812-9a4fb9bc2e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:19.302619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c0e6-ea28-4b0c-b812-9a4fb9bc2e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:19.304399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c0e6-ea28-4b0c-b812-9a4fb9bc2e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:19.304660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c0e6-ea28-4b0c-b812-9a4fb9bc2e85 admin admin] PATH_INFO: `/v3/users/eb5c16dc9b9a47aa9a7452a00c548adc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:19.308097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3c0e6-ea28-4b0c-b812-9a4fb9bc2e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb5c16dc9b9a47aa9a7452a00c548adc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:19.312115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3c0e6-ea28-4b0c-b812-9a4fb9bc2e85 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:19.447263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36a3c0e6-ea28-4b0c-b812-9a4fb9bc2e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb5c16dc9b9a47aa9a7452a00c548adc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:19.480796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36a3c0e6-ea28-4b0c-b812-9a4fb9bc2e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb5c16dc9b9a47aa9a7452a00c548adc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:19.483437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36a3c0e6-ea28-4b0c-b812-9a4fb9bc2e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb5c16dc9b9a47aa9a7452a00c548adc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:19.508771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36a3c0e6-ea28-4b0c-b812-9a4fb9bc2e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb5c16dc9b9a47aa9a7452a00c548adc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:19.511621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36a3c0e6-ea28-4b0c-b812-9a4fb9bc2e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb5c16dc9b9a47aa9a7452a00c548adc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:19.555165 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1785/3564] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:19 2022] DELETE /identity/v3/users/eb5c16dc9b9a47aa9a7452a00c548adc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:21.959850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:21.963051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:22.006592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9aa21-9e59-4416-b7a2-c7195d41efab admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:22.036918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:22.189541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:22.190579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:22.191124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:22.191840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79 admin admin] PATH_INFO: `/v3/projects/ae58894eb30b4892aed1ec10c3ce0282` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:22.193478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae58894eb30b4892aed1ec10c3ce0282)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:22.195647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:22.343482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae58894eb30b4892aed1ec10c3ce0282', 'request_id': 'req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:22.363077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae58894eb30b4892aed1ec10c3ce0282', 'request_id': 'req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:22.379753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae58894eb30b4892aed1ec10c3ce0282', 'request_id': 'req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:22.419987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79 admin admin] The token cache is being invalidate because project ae58894eb30b4892aed1ec10c3ce0282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:22.420288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:22.424489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bedaf8e1-d264-4c83-830f-fb0ec61dcf79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:22.436489 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1780/3565] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:21 2022] DELETE /identity/v3/projects/ae58894eb30b4892aed1ec10c3ce0282 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:22.439277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05571c5-9977-4e17-ad01-2685df3114d3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:22.439277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05571c5-9977-4e17-ad01-2685df3114d3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:22.439277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05571c5-9977-4e17-ad01-2685df3114d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:22.484049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c05571c5-9977-4e17-ad01-2685df3114d3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:22.489192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c05571c5-9977-4e17-ad01-2685df3114d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:22.608771 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1786/3566] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:22.616504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecab94-87d3-4514-b254-fcf1d85d31cb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:22.616796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecab94-87d3-4514-b254-fcf1d85d31cb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:22.617075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecab94-87d3-4514-b254-fcf1d85d31cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:22.648778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f1ecab94-87d3-4514-b254-fcf1d85d31cb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:22.650367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f1ecab94-87d3-4514-b254-fcf1d85d31cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:22.676118 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1781/3567] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:22.677379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05571c5-9977-4e17-ad01-2685df3114d3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:22.693877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05571c5-9977-4e17-ad01-2685df3114d3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:22.704765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd955d-51af-4e07-b3f3-689d717039b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:22.706804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd955d-51af-4e07-b3f3-689d717039b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:22.707346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd955d-51af-4e07-b3f3-689d717039b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:22.708970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd955d-51af-4e07-b3f3-689d717039b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:22.715404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd955d-51af-4e07-b3f3-689d717039b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:03:22.716528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd955d-51af-4e07-b3f3-689d717039b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:22.727574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd955d-51af-4e07-b3f3-689d717039b3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:22.780812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecab94-87d3-4514-b254-fcf1d85d31cb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:22.781052 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1787/3568] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:22.796723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecab94-87d3-4514-b254-fcf1d85d31cb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:22.808434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed03685-5616-4ead-bb64-8fabca8f489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:22.809292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed03685-5616-4ead-bb64-8fabca8f489d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:22.809641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed03685-5616-4ead-bb64-8fabca8f489d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:22.811013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed03685-5616-4ead-bb64-8fabca8f489d admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:22.812860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed03685-5616-4ead-bb64-8fabca8f489d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:22.818793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed03685-5616-4ead-bb64-8fabca8f489d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:22.882809 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1782/3569] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:22 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:22.887996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd955d-51af-4e07-b3f3-689d717039b3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:22.917746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd955d-51af-4e07-b3f3-689d717039b3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:22.994307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:23.129503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e2942-b4a1-4066-b0a7-9687d02f5dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:23.130675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e2942-b4a1-4066-b0a7-9687d02f5dfe admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:23.131335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e2942-b4a1-4066-b0a7-9687d02f5dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:23.132671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e2942-b4a1-4066-b0a7-9687d02f5dfe admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:23.133915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e2942-b4a1-4066-b0a7-9687d02f5dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:23.138407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e2942-b4a1-4066-b0a7-9687d02f5dfe admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:23.195070 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1788/3570] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:03:22 2022] POST /identity/v3/users => generated 286 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:23.195555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed03685-5616-4ead-bb64-8fabca8f489d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:23.211211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed03685-5616-4ead-bb64-8fabca8f489d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:23.238163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10035423-619e-4a9a-bc80-bbd2a1d69344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:23.238163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10035423-619e-4a9a-bc80-bbd2a1d69344 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:23.238163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10035423-619e-4a9a-bc80-bbd2a1d69344 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:23.238163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10035423-619e-4a9a-bc80-bbd2a1d69344 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:23.238777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10035423-619e-4a9a-bc80-bbd2a1d69344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:23.239704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10035423-619e-4a9a-bc80-bbd2a1d69344 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:23.277895 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1783/3571] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:03:23.282529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e2942-b4a1-4066-b0a7-9687d02f5dfe admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:23.308644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e2942-b4a1-4066-b0a7-9687d02f5dfe admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:23.319636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0701b-1f7f-4323-aa60-a98451d21039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:23.321123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0701b-1f7f-4323-aa60-a98451d21039 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:23.321736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0701b-1f7f-4323-aa60-a98451d21039 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:23.322477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0701b-1f7f-4323-aa60-a98451d21039 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:23.327375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0701b-1f7f-4323-aa60-a98451d21039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:23.330883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0701b-1f7f-4323-aa60-a98451d21039 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:23.361617 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1789/3572] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:23.367838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10035423-619e-4a9a-bc80-bbd2a1d69344 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:23.421061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10035423-619e-4a9a-bc80-bbd2a1d69344 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:23.431771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaa16f-2695-43b5-b095-ecba954e842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:23.434194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaa16f-2695-43b5-b095-ecba954e842e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:23.434618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaa16f-2695-43b5-b095-ecba954e842e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:23.435059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaa16f-2695-43b5-b095-ecba954e842e admin admin] PATH_INFO: `/v3/projects/6e048cdbdc9946859c4389356aa271a6/users/0007c1c7c4e845d8bbb6e3f9f676eee6/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:23.483390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdaa16f-2695-43b5-b095-ecba954e842e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e048cdbdc9946859c4389356aa271a6, user_id=0007c1c7c4e845d8bbb6e3f9f676eee6, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:23.487519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdaa16f-2695-43b5-b095-ecba954e842e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:23.541496 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1784/3573] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:23 2022] PUT /identity/v3/projects/6e048cdbdc9946859c4389356aa271a6/users/0007c1c7c4e845d8bbb6e3f9f676eee6/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:23.552610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea67a1-1928-4880-8142-f44588d92cbd None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:23.553802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea67a1-1928-4880-8142-f44588d92cbd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:23.554428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea67a1-1928-4880-8142-f44588d92cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:23.624853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-34ea67a1-1928-4880-8142-f44588d92cbd None None] MFA Rules not processed for user `0007c1c7c4e845d8bbb6e3f9f676eee6`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:23.626586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-34ea67a1-1928-4880-8142-f44588d92cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:23.692779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4c8cc-0b6f-4d09-84f9-b8bf45f478e7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:23.693031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4c8cc-0b6f-4d09-84f9-b8bf45f478e7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:23.693309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4c8cc-0b6f-4d09-84f9-b8bf45f478e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:23.733423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ddb4c8cc-0b6f-4d09-84f9-b8bf45f478e7 None None] MFA Rules not processed for user `e53686d22edb4f4ebca9f6799eb23f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:23.735574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ddb4c8cc-0b6f-4d09-84f9-b8bf45f478e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:23.806104 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1790/3574] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:23.806349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:23.811470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea67a1-1928-4880-8142-f44588d92cbd None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:23.849511 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1785/3575] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:03:23.859848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea11c-c403-4d05-9b98-3bb20c13f0c3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:23.860136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea11c-c403-4d05-9b98-3bb20c13f0c3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:23.860567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcea11c-c403-4d05-9b98-3bb20c13f0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:23.882592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4dcea11c-c403-4d05-9b98-3bb20c13f0c3 None None] MFA Rules not processed for user `e53686d22edb4f4ebca9f6799eb23f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:23.884039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4dcea11c-c403-4d05-9b98-3bb20c13f0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:23.892453 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1786/3576] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:23.954684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea67a1-1928-4880-8142-f44588d92cbd None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:23.972310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedea39-7c5b-4356-b789-594e19264560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:23.974088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedea39-7c5b-4356-b789-594e19264560 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:23.975511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedea39-7c5b-4356-b789-594e19264560 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:23.975511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dedea39-7c5b-4356-b789-594e19264560 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:23.978468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedea39-7c5b-4356-b789-594e19264560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:23.982123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dedea39-7c5b-4356-b789-594e19264560 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:24.072112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcea11c-c403-4d05-9b98-3bb20c13f0c3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:24.073556 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1791/3577] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:23 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:24.093150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcea11c-c403-4d05-9b98-3bb20c13f0c3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:24.235598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa102a-d6ff-4e4f-bb6c-13d217df7a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:24.237845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa102a-d6ff-4e4f-bb6c-13d217df7a9d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:24.238911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa102a-d6ff-4e4f-bb6c-13d217df7a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:24.239624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa102a-d6ff-4e4f-bb6c-13d217df7a9d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:24.240531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa102a-d6ff-4e4f-bb6c-13d217df7a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:24.243329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa102a-d6ff-4e4f-bb6c-13d217df7a9d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:24.314581 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1787/3578] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:03:24 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:03:24.315109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedea39-7c5b-4356-b789-594e19264560 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:24.329807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dedea39-7c5b-4356-b789-594e19264560 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:24.342065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228621f-bc65-45c0-acc6-8e315afd8336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:24.343172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228621f-bc65-45c0-acc6-8e315afd8336 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:24.343728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228621f-bc65-45c0-acc6-8e315afd8336 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:24.344185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228621f-bc65-45c0-acc6-8e315afd8336 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:24.345571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228621f-bc65-45c0-acc6-8e315afd8336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:24.348774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228621f-bc65-45c0-acc6-8e315afd8336 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:24.378579 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1792/3579] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:24.381486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa102a-d6ff-4e4f-bb6c-13d217df7a9d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:24.403396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa102a-d6ff-4e4f-bb6c-13d217df7a9d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:24.414878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e205f97-ba48-4dfb-a73d-f68db784e81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:24.416034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205f97-ba48-4dfb-a73d-f68db784e81e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:24.416751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205f97-ba48-4dfb-a73d-f68db784e81e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:24.417454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205f97-ba48-4dfb-a73d-f68db784e81e admin admin] PATH_INFO: `/v3/projects/6bf8e79a8dab4b378dbb169a2ab2ba59/users/32e8fac975c54482a8dda6bc23459585/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:24.444778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e205f97-ba48-4dfb-a73d-f68db784e81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf8e79a8dab4b378dbb169a2ab2ba59, user_id=32e8fac975c54482a8dda6bc23459585, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:24.452243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e205f97-ba48-4dfb-a73d-f68db784e81e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:24.478818 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1788/3580] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:24 2022] PUT /identity/v3/projects/6bf8e79a8dab4b378dbb169a2ab2ba59/users/32e8fac975c54482a8dda6bc23459585/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:03:24.482934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228621f-bc65-45c0-acc6-8e315afd8336 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:24.491368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:24.496830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228621f-bc65-45c0-acc6-8e315afd8336 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:24.634482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1beeb7-e7ed-43e4-885c-025ef9761611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:24.636248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1beeb7-e7ed-43e4-885c-025ef9761611 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:24.636248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1beeb7-e7ed-43e4-885c-025ef9761611 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:24.636552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1beeb7-e7ed-43e4-885c-025ef9761611 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:24.637414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1beeb7-e7ed-43e4-885c-025ef9761611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:24.639108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1beeb7-e7ed-43e4-885c-025ef9761611 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:24.662201 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1793/3581] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:03:24.667295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e205f97-ba48-4dfb-a73d-f68db784e81e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:24.681242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e205f97-ba48-4dfb-a73d-f68db784e81e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:24.690991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40411cd0-8b96-4b11-a5d2-da166daa390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:24.692496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411cd0-8b96-4b11-a5d2-da166daa390b admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:24.692496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411cd0-8b96-4b11-a5d2-da166daa390b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:24.692496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411cd0-8b96-4b11-a5d2-da166daa390b admin admin] PATH_INFO: `/v3/projects/6bf8e79a8dab4b378dbb169a2ab2ba59/users/32e8fac975c54482a8dda6bc23459585/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:24.694430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40411cd0-8b96-4b11-a5d2-da166daa390b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf8e79a8dab4b378dbb169a2ab2ba59, user_id=32e8fac975c54482a8dda6bc23459585, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:24.699474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40411cd0-8b96-4b11-a5d2-da166daa390b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:24.717202 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1789/3582] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:24 2022] PUT /identity/v3/projects/6bf8e79a8dab4b378dbb169a2ab2ba59/users/32e8fac975c54482a8dda6bc23459585/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:24.812411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d3e2e-2fed-4170-b597-8fea53689485 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:24.813009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d3e2e-2fed-4170-b597-8fea53689485 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:24.814052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d3e2e-2fed-4170-b597-8fea53689485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:24.874443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cc0d3e2e-2fed-4170-b597-8fea53689485 None None] MFA Rules not processed for user `32e8fac975c54482a8dda6bc23459585`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:24.875860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cc0d3e2e-2fed-4170-b597-8fea53689485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:24.991047 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1794/3583] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:24.996291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40411cd0-8b96-4b11-a5d2-da166daa390b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.012064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40411cd0-8b96-4b11-a5d2-da166daa390b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:25.023486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc831f09-66e6-472b-8d74-b822b38384fa tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:25.024562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc831f09-66e6-472b-8d74-b822b38384fa tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:25.025043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc831f09-66e6-472b-8d74-b822b38384fa tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:25.025638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc831f09-66e6-472b-8d74-b822b38384fa tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:25.027882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc831f09-66e6-472b-8d74-b822b38384fa tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:25.029703 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-bc831f09-66e6-472b-8d74-b822b38384fa tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:25.029703 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:03:25.029703 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:03:25.031210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc831f09-66e6-472b-8d74-b822b38384fa tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:25.075041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d3e2e-2fed-4170-b597-8fea53689485 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.076420 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1790/3584] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:24 2022] POST /identity/v3/services => generated 290 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:25.094931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d3e2e-2fed-4170-b597-8fea53689485 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:25.124792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f59e14-6a98-4f50-9547-6ae058da4420 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:25.125423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f59e14-6a98-4f50-9547-6ae058da4420 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:25.125707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f59e14-6a98-4f50-9547-6ae058da4420 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:25.125983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f59e14-6a98-4f50-9547-6ae058da4420 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:25.126665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f59e14-6a98-4f50-9547-6ae058da4420 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:25.127816 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-66f59e14-6a98-4f50-9547-6ae058da4420 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:25.127816 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:03:25.127816 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:03:25.128961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f59e14-6a98-4f50-9547-6ae058da4420 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:25.158014 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1795/3585] 10.222.0.70 () {60 vars in 1213 bytes} [Sun Aug 28 19:03:25 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:03:25.162855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc831f09-66e6-472b-8d74-b822b38384fa tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.191886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc831f09-66e6-472b-8d74-b822b38384fa tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:25.211013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d78ddb-b41b-4ead-b499-8160b3ce9543 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:25.211707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d78ddb-b41b-4ead-b499-8160b3ce9543 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:25.211995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d78ddb-b41b-4ead-b499-8160b3ce9543 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:25.212279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d78ddb-b41b-4ead-b499-8160b3ce9543 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:25.212948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d78ddb-b41b-4ead-b499-8160b3ce9543 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:25.214980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d78ddb-b41b-4ead-b499-8160b3ce9543 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:25.255145 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1791/3586] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:25 2022] POST /identity/v3/services => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:25.258905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f59e14-6a98-4f50-9547-6ae058da4420 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.273958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f59e14-6a98-4f50-9547-6ae058da4420 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:25.320944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6435f8-8ca9-4bb4-94c4-98640ad71a4c tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:25.321757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6435f8-8ca9-4bb4-94c4-98640ad71a4c tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:25.321902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6435f8-8ca9-4bb4-94c4-98640ad71a4c tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:25.322144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6435f8-8ca9-4bb4-94c4-98640ad71a4c tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:25.322879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6435f8-8ca9-4bb4-94c4-98640ad71a4c tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:25.327130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6435f8-8ca9-4bb4-94c4-98640ad71a4c tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:25.350388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d78ddb-b41b-4ead-b499-8160b3ce9543 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.361823 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1796/3587] 10.222.0.70 () {60 vars in 1213 bytes} [Sun Aug 28 19:03:25 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:25.382942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d78ddb-b41b-4ead-b499-8160b3ce9543 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:25.395395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdc24d-8c16-4560-8194-d38d85224c30 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:25.396122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdc24d-8c16-4560-8194-d38d85224c30 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:25.396505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdc24d-8c16-4560-8194-d38d85224c30 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:25.396779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdc24d-8c16-4560-8194-d38d85224c30 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:25.397411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdc24d-8c16-4560-8194-d38d85224c30 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:25.398433 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-22cdc24d-8c16-4560-8194-d38d85224c30 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:25.398433 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:03:25.398433 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:03:25.399375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdc24d-8c16-4560-8194-d38d85224c30 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:25.433535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6435f8-8ca9-4bb4-94c4-98640ad71a4c tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.436822 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1792/3588] 10.222.0.70 () {58 vars in 1191 bytes} [Sun Aug 28 19:03:25 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:03:25.447544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6435f8-8ca9-4bb4-94c4-98640ad71a4c tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:25.468033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bcf5f-a214-42cc-b2c1-7f3795443b94 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:25.468889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bcf5f-a214-42cc-b2c1-7f3795443b94 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:25.469182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bcf5f-a214-42cc-b2c1-7f3795443b94 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:25.469515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bcf5f-a214-42cc-b2c1-7f3795443b94 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/dd9eed9f57bf4c7eb852b5d8d8ed87e6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:25.470183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bcf5f-a214-42cc-b2c1-7f3795443b94 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=dd9eed9f57bf4c7eb852b5d8d8ed87e6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:25.472692 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-c85bcf5f-a214-42cc-b2c1-7f3795443b94 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:25.472692 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:03:25.472692 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:03:25.473602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bcf5f-a214-42cc-b2c1-7f3795443b94 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:25.505753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdc24d-8c16-4560-8194-d38d85224c30 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.516741 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1797/3589] 10.222.0.70 () {58 vars in 1290 bytes} [Sun Aug 28 19:03:25 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/dd9eed9f57bf4c7eb852b5d8d8ed87e6 => generated 334 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:25.519424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdc24d-8c16-4560-8194-d38d85224c30 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:25.532770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6c5d6-9290-403c-9d23-cdec2b2dd296 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:25.533446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6c5d6-9290-403c-9d23-cdec2b2dd296 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:25.533736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6c5d6-9290-403c-9d23-cdec2b2dd296 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:25.534021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6c5d6-9290-403c-9d23-cdec2b2dd296 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/dd9eed9f57bf4c7eb852b5d8d8ed87e6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:25.534721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6c5d6-9290-403c-9d23-cdec2b2dd296 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=dd9eed9f57bf4c7eb852b5d8d8ed87e6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:25.536514 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-fda6c5d6-9290-403c-9d23-cdec2b2dd296 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:25.536514 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:03:25.536514 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:03:25.537439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6c5d6-9290-403c-9d23-cdec2b2dd296 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:25.552552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bcf5f-a214-42cc-b2c1-7f3795443b94 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.553778 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1793/3590] 10.222.0.70 () {58 vars in 1291 bytes} [Sun Aug 28 19:03:25 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/dd9eed9f57bf4c7eb852b5d8d8ed87e6 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 28 19:03:25.565127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bcf5f-a214-42cc-b2c1-7f3795443b94 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:25.578701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781a34e-da83-4733-a52a-214bf7bb60d1 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:25.578701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781a34e-da83-4733-a52a-214bf7bb60d1 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:25.578701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781a34e-da83-4733-a52a-214bf7bb60d1 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:25.579116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781a34e-da83-4733-a52a-214bf7bb60d1 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/dd9eed9f57bf4c7eb852b5d8d8ed87e6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:25.579116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781a34e-da83-4733-a52a-214bf7bb60d1 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=dd9eed9f57bf4c7eb852b5d8d8ed87e6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:25.580614 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-3781a34e-da83-4733-a52a-214bf7bb60d1 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:25.580614 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:03:25.580614 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:03:25.582197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781a34e-da83-4733-a52a-214bf7bb60d1 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:25.599075 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1798/3591] 10.222.0.70 () {58 vars in 1293 bytes} [Sun Aug 28 19:03:25 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/dd9eed9f57bf4c7eb852b5d8d8ed87e6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:03:25.603298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6c5d6-9290-403c-9d23-cdec2b2dd296 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.617738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6c5d6-9290-403c-9d23-cdec2b2dd296 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:25.625503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e8ce4-ad07-4acb-a1fb-1cfc0874b98a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:25.626714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e8ce4-ad07-4acb-a1fb-1cfc0874b98a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:25.627191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e8ce4-ad07-4acb-a1fb-1cfc0874b98a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:25.627760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e8ce4-ad07-4acb-a1fb-1cfc0874b98a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:25.629867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e8ce4-ad07-4acb-a1fb-1cfc0874b98a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:25.632484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e8ce4-ad07-4acb-a1fb-1cfc0874b98a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:25.640527 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1794/3592] 10.222.0.70 () {58 vars in 1191 bytes} [Sun Aug 28 19:03:25 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:25.645061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781a34e-da83-4733-a52a-214bf7bb60d1 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.661169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781a34e-da83-4733-a52a-214bf7bb60d1 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:25.667469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83ccb5-6f90-46c5-9cce-b4672e477eb2 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:25.669258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83ccb5-6f90-46c5-9cce-b4672e477eb2 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:25.669575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83ccb5-6f90-46c5-9cce-b4672e477eb2 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:25.670123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83ccb5-6f90-46c5-9cce-b4672e477eb2 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/dd9eed9f57bf4c7eb852b5d8d8ed87e6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:25.670772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83ccb5-6f90-46c5-9cce-b4672e477eb2 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=dd9eed9f57bf4c7eb852b5d8d8ed87e6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:25.674707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83ccb5-6f90-46c5-9cce-b4672e477eb2 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-9c83ccb5-6f90-46c5-9cce-b4672e477eb2 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Could not find Endpoint Group: dd9eed9f57bf4c7eb852b5d8d8ed87e6.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: dd9eed9f57bf4c7eb852b5d8d8ed87e6. Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Aug 28 19:03:25.688789 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Aug 28 19:03:25.690239 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Aug 28 19:03:25.690239 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Aug 28 19:03:25.690239 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Aug 28 19:03:25.690239 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Aug 28 19:03:25.690239 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: dd9eed9f57bf4c7eb852b5d8d8ed87e6. Aug 28 19:03:25.690239 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:03:25.690996 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1799/3593] 10.222.0.70 () {58 vars in 1293 bytes} [Sun Aug 28 19:03:25 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/dd9eed9f57bf4c7eb852b5d8d8ed87e6 => generated 120 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:03:25.694660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e8ce4-ad07-4acb-a1fb-1cfc0874b98a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.712105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e8ce4-ad07-4acb-a1fb-1cfc0874b98a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:25.728833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea84a0-ee54-4d34-a67d-ceb76478bfe3 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:25.730869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea84a0-ee54-4d34-a67d-ceb76478bfe3 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:25.731713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea84a0-ee54-4d34-a67d-ceb76478bfe3 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:25.732219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea84a0-ee54-4d34-a67d-ceb76478bfe3 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/services/edaf9cf7073a43a285c82ec34eabfc69` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:25.733620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea84a0-ee54-4d34-a67d-ceb76478bfe3 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:delete_service(service_id=edaf9cf7073a43a285c82ec34eabfc69)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:25.735660 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-99ea84a0-ee54-4d34-a67d-ceb76478bfe3 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:25.735660 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:03:25.735660 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:03:25.736914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea84a0-ee54-4d34-a67d-ceb76478bfe3 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:25.784143 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1795/3594] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:25 2022] DELETE /identity/v3/services/edaf9cf7073a43a285c82ec34eabfc69 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:25.789935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83ccb5-6f90-46c5-9cce-b4672e477eb2 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.810800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83ccb5-6f90-46c5-9cce-b4672e477eb2 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:25.843557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9b5aa-b4f5-4258-a64e-62ee846be70a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:25.844652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b5aa-b4f5-4258-a64e-62ee846be70a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:25.845112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b5aa-b4f5-4258-a64e-62ee846be70a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:25.845540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b5aa-b4f5-4258-a64e-62ee846be70a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:25.846366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9b5aa-b4f5-4258-a64e-62ee846be70a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:25.847591 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-9fc9b5aa-b4f5-4258-a64e-62ee846be70a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:25.847591 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:03:25.847591 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:03:25.849029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9b5aa-b4f5-4258-a64e-62ee846be70a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:25.864933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:25.893138 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1800/3595] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:25 2022] POST /identity/v3/services => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:03:25.894324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea84a0-ee54-4d34-a67d-ceb76478bfe3 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.912504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea84a0-ee54-4d34-a67d-ceb76478bfe3 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:25.930071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:25.935835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a853523-5a72-4092-a77b-56b4d2126719 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:25.936631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a853523-5a72-4092-a77b-56b4d2126719 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:25.937176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a853523-5a72-4092-a77b-56b4d2126719 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:25.937517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a853523-5a72-4092-a77b-56b4d2126719 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:25.938513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a853523-5a72-4092-a77b-56b4d2126719 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:25.939789 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-1a853523-5a72-4092-a77b-56b4d2126719 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:25.939789 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:03:25.939789 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:03:25.941850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a853523-5a72-4092-a77b-56b4d2126719 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:25.962473 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1796/3596] 10.222.0.70 () {60 vars in 1213 bytes} [Sun Aug 28 19:03:25 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:25.964784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9b5aa-b4f5-4258-a64e-62ee846be70a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:25.985316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9b5aa-b4f5-4258-a64e-62ee846be70a tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:26.001671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4981b8a-faa5-45e4-9170-14bfc78a5f80 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:26.003115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4981b8a-faa5-45e4-9170-14bfc78a5f80 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:26.004311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4981b8a-faa5-45e4-9170-14bfc78a5f80 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:26.005825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4981b8a-faa5-45e4-9170-14bfc78a5f80 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:26.006592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4981b8a-faa5-45e4-9170-14bfc78a5f80 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:26.009205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4981b8a-faa5-45e4-9170-14bfc78a5f80 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:26.040645 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1801/3597] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:25 2022] POST /identity/v3/services => generated 288 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:26.044865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a853523-5a72-4092-a77b-56b4d2126719 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:26.060194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a853523-5a72-4092-a77b-56b4d2126719 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:26.083459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d10e0-745a-49fe-810f-951f9ca4c22e tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:26.084517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d10e0-745a-49fe-810f-951f9ca4c22e tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:26.085051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d10e0-745a-49fe-810f-951f9ca4c22e tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:26.085534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d10e0-745a-49fe-810f-951f9ca4c22e tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/90f6d39d014f4254a84a689ca568508c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:26.086573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d10e0-745a-49fe-810f-951f9ca4c22e tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=90f6d39d014f4254a84a689ca568508c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:26.088108 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-4d1d10e0-745a-49fe-810f-951f9ca4c22e tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:26.088108 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:03:26.088108 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:03:26.090696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d10e0-745a-49fe-810f-951f9ca4c22e tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:26.113994 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1797/3598] 10.222.0.70 () {60 vars in 1313 bytes} [Sun Aug 28 19:03:26 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/90f6d39d014f4254a84a689ca568508c => generated 334 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:26.114184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4981b8a-faa5-45e4-9170-14bfc78a5f80 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:26.132093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4981b8a-faa5-45e4-9170-14bfc78a5f80 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:26.143635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae307e8-0e07-4dcd-8df7-5561e57d8412 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:26.144286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae307e8-0e07-4dcd-8df7-5561e57d8412 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:26.144574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae307e8-0e07-4dcd-8df7-5561e57d8412 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:26.144854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae307e8-0e07-4dcd-8df7-5561e57d8412 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/services/33418034385e4404a73807b0c68de942` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:26.145513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae307e8-0e07-4dcd-8df7-5561e57d8412 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:delete_service(service_id=33418034385e4404a73807b0c68de942)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:26.146568 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-5ae307e8-0e07-4dcd-8df7-5561e57d8412 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:26.146568 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:03:26.146568 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:03:26.147468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae307e8-0e07-4dcd-8df7-5561e57d8412 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:26.210367 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1802/3599] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:26 2022] DELETE /identity/v3/services/33418034385e4404a73807b0c68de942 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:26.218671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d10e0-745a-49fe-810f-951f9ca4c22e tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:26.251282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d10e0-745a-49fe-810f-951f9ca4c22e tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:26.280167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e5618-20ec-475b-a149-8d5486e776d8 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:26.281077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e5618-20ec-475b-a149-8d5486e776d8 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:26.281551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e5618-20ec-475b-a149-8d5486e776d8 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:26.281928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e5618-20ec-475b-a149-8d5486e776d8 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/90f6d39d014f4254a84a689ca568508c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:26.282815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e5618-20ec-475b-a149-8d5486e776d8 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=90f6d39d014f4254a84a689ca568508c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:26.286191 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-8c7e5618-20ec-475b-a149-8d5486e776d8 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:03:26.286191 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:03:26.286191 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:03:26.287382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e5618-20ec-475b-a149-8d5486e776d8 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:26.323711 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1798/3600] 10.222.0.70 () {58 vars in 1293 bytes} [Sun Aug 28 19:03:26 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/90f6d39d014f4254a84a689ca568508c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:26.328789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae307e8-0e07-4dcd-8df7-5561e57d8412 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:26.348584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae307e8-0e07-4dcd-8df7-5561e57d8412 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:26.362335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a5ee8-c494-4b70-ac0b-febdf96402bd tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:26.364035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a5ee8-c494-4b70-ac0b-febdf96402bd tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:26.364508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a5ee8-c494-4b70-ac0b-febdf96402bd tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:26.365272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a5ee8-c494-4b70-ac0b-febdf96402bd tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/services/887fb90aec6e4a50a1f16e8063f3f437` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:26.366455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a5ee8-c494-4b70-ac0b-febdf96402bd tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:delete_service(service_id=887fb90aec6e4a50a1f16e8063f3f437)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:26.368610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a5ee8-c494-4b70-ac0b-febdf96402bd tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:26.402988 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1803/3601] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:26 2022] DELETE /identity/v3/services/887fb90aec6e4a50a1f16e8063f3f437 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:26.408687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e5618-20ec-475b-a149-8d5486e776d8 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:26.423758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e5618-20ec-475b-a149-8d5486e776d8 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:26.442969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbabdce-564c-473b-b67a-6eb682737740 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:26.443701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbabdce-564c-473b-b67a-6eb682737740 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:26.444248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbabdce-564c-473b-b67a-6eb682737740 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:26.444530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbabdce-564c-473b-b67a-6eb682737740 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/6c75bc826e444066a03b9859b7c457bf` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:26.445133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbabdce-564c-473b-b67a-6eb682737740 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=6c75bc826e444066a03b9859b7c457bf)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:26.446773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbabdce-564c-473b-b67a-6eb682737740 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:26.466146 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1799/3602] 10.222.0.70 () {58 vars in 1293 bytes} [Sun Aug 28 19:03:26 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/6c75bc826e444066a03b9859b7c457bf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:26.470727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a5ee8-c494-4b70-ac0b-febdf96402bd tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:26.482926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a5ee8-c494-4b70-ac0b-febdf96402bd tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:26.488353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b057ed1-f288-4d9f-bb13-56013267ef31 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e8fac975c54482a8dda6bc23459585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:26.489161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b057ed1-f288-4d9f-bb13-56013267ef31 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:26.489523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b057ed1-f288-4d9f-bb13-56013267ef31 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:26.489881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b057ed1-f288-4d9f-bb13-56013267ef31 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] PATH_INFO: `/v3/services/b043c9bbc3124cf4ad93cb5c35b00b65` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:26.490653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b057ed1-f288-4d9f-bb13-56013267ef31 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b043c9bbc3124cf4ad93cb5c35b00b65)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:26.492520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b057ed1-f288-4d9f-bb13-56013267ef31 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:26.527265 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1804/3603] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:26 2022] DELETE /identity/v3/services/b043c9bbc3124cf4ad93cb5c35b00b65 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:26.531699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbabdce-564c-473b-b67a-6eb682737740 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:26.680378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbabdce-564c-473b-b67a-6eb682737740 tempest-EndPointGroupsTest-1665279799 tempest-EndPointGroupsTest-1665279799-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:26.704054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:26.705867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:26.705867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:26.705867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] PATH_INFO: `/v3/users/0007c1c7c4e845d8bbb6e3f9f676eee6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:26.706827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0007c1c7c4e845d8bbb6e3f9f676eee6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:26.708906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:26.850301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0007c1c7c4e845d8bbb6e3f9f676eee6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:26.898967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0007c1c7c4e845d8bbb6e3f9f676eee6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:26.898967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0007c1c7c4e845d8bbb6e3f9f676eee6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:26.933867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0007c1c7c4e845d8bbb6e3f9f676eee6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:26.934643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0007c1c7c4e845d8bbb6e3f9f676eee6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:26.944111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=13 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:26.976982 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1800/3604] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:26 2022] DELETE /identity/v3/users/0007c1c7c4e845d8bbb6e3f9f676eee6 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:26.982125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f217c8-5e91-4b00-86ee-1866610d93fb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:26.982641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f217c8-5e91-4b00-86ee-1866610d93fb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:26.982765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f217c8-5e91-4b00-86ee-1866610d93fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:27.042021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c3f217c8-5e91-4b00-86ee-1866610d93fb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:27.043327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c3f217c8-5e91-4b00-86ee-1866610d93fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:27.185448 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1805/3605] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:27.294865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:27.296544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:27.447756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357169cb-4489-4c94-b0fa-5ddd19599815 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:27.456815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d826a2c-ecac-4e0e-937d-126f6027bc2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:27.457461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d826a2c-ecac-4e0e-937d-126f6027bc2f service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:27.457757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d826a2c-ecac-4e0e-937d-126f6027bc2f service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:27.458033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d826a2c-ecac-4e0e-937d-126f6027bc2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:27.480545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d826a2c-ecac-4e0e-937d-126f6027bc2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:27.483346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d826a2c-ecac-4e0e-937d-126f6027bc2f service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:27.516851 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1801/3606] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:27.969118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f217c8-5e91-4b00-86ee-1866610d93fb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:27.971518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c3f217c8-5e91-4b00-86ee-1866610d93fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:27.999906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f217c8-5e91-4b00-86ee-1866610d93fb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:28.018646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96991f0-f6bc-4553-b2b4-23fc10f0f8f3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:28.018950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96991f0-f6bc-4553-b2b4-23fc10f0f8f3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:28.019240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96991f0-f6bc-4553-b2b4-23fc10f0f8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:28.035544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:28.036414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:28.037159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:28.037159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] PATH_INFO: `/v3/users/8fcb9c34c18349e8a193f1309f56c3fa` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:28.038301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fcb9c34c18349e8a193f1309f56c3fa)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:28.040445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:28.077011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f96991f0-f6bc-4553-b2b4-23fc10f0f8f3 None None] MFA Rules not processed for user `8dbb8a95851248bfabd9a1afe40fc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:28.080091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f96991f0-f6bc-4553-b2b4-23fc10f0f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:28.167398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fcb9c34c18349e8a193f1309f56c3fa'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:28.190971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fcb9c34c18349e8a193f1309f56c3fa'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:28.191985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fcb9c34c18349e8a193f1309f56c3fa'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:28.223235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fcb9c34c18349e8a193f1309f56c3fa'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:28.226569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fcb9c34c18349e8a193f1309f56c3fa'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:28.238812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:28.298981 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1806/3607] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:27 2022] DELETE /identity/v3/users/8fcb9c34c18349e8a193f1309f56c3fa => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:28.390892 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1802/3608] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:03:28.735436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:28.737256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:28.897783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f259846-0506-4e29-be39-9f4d14518d18 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:28.908463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:28.909518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:28.910013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:28.910495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] PATH_INFO: `/v3/projects/3605de1becdf4bc6a03c330a11ac352e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:28.912212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3605de1becdf4bc6a03c330a11ac352e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:28.914358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:29.036843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3605de1becdf4bc6a03c330a11ac352e', 'request_id': 'req-729b2445-8a38-4d29-adb5-1e446d5ebb9c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.049892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3605de1becdf4bc6a03c330a11ac352e', 'request_id': 'req-729b2445-8a38-4d29-adb5-1e446d5ebb9c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.065903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3605de1becdf4bc6a03c330a11ac352e', 'request_id': 'req-729b2445-8a38-4d29-adb5-1e446d5ebb9c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.097183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] The token cache is being invalidate because project 3605de1becdf4bc6a03c330a11ac352e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:29.098814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.100926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.105900 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1807/3609] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:28 2022] DELETE /identity/v3/projects/3605de1becdf4bc6a03c330a11ac352e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:29.110733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0592d9-3e31-4904-8132-ff0054b46d59 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:29.111130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0592d9-3e31-4904-8132-ff0054b46d59 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:29.111584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0592d9-3e31-4904-8132-ff0054b46d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:29.153357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2e0592d9-3e31-4904-8132-ff0054b46d59 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:29.154886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2e0592d9-3e31-4904-8132-ff0054b46d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:29.250018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:29.251707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:29.319994 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1803/3610] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:29.329124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3551d-bcc1-40df-82c4-097edfc9929f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:29.329759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3551d-bcc1-40df-82c4-097edfc9929f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:29.330238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3551d-bcc1-40df-82c4-097edfc9929f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:29.378643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3fa3551d-bcc1-40df-82c4-097edfc9929f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:29.380712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3fa3551d-bcc1-40df-82c4-097edfc9929f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:29.404431 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1804/3611] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:29.409324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3551d-bcc1-40df-82c4-097edfc9929f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:29.421203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b2445-8a38-4d29-adb5-1e446d5ebb9c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:29.425703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3551d-bcc1-40df-82c4-097edfc9929f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:29.433162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:29.434191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:29.435135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:29.436171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] PATH_INFO: `/v3/projects/6e048cdbdc9946859c4389356aa271a6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:29.439136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e048cdbdc9946859c4389356aa271a6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:29.441535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:29.444242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070488d-e1f5-4fa7-b689-731b750d7f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:29.444884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070488d-e1f5-4fa7-b689-731b750d7f70 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:29.448785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070488d-e1f5-4fa7-b689-731b750d7f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:29.449170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070488d-e1f5-4fa7-b689-731b750d7f70 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:29.449862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070488d-e1f5-4fa7-b689-731b750d7f70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:03:29.450173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070488d-e1f5-4fa7-b689-731b750d7f70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:29.454361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070488d-e1f5-4fa7-b689-731b750d7f70 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:29.473247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:29.487509 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1805/3612] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:29.493665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070488d-e1f5-4fa7-b689-731b750d7f70 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:29.513149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:29.520764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070488d-e1f5-4fa7-b689-731b750d7f70 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:29.525572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e048cdbdc9946859c4389356aa271a6', 'request_id': 'req-5a677336-b5ae-4c67-9315-844df3132dc7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.537518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e048cdbdc9946859c4389356aa271a6', 'request_id': 'req-5a677336-b5ae-4c67-9315-844df3132dc7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.547447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e048cdbdc9946859c4389356aa271a6', 'request_id': 'req-5a677336-b5ae-4c67-9315-844df3132dc7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.571978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] The token cache is being invalidate because project 6e048cdbdc9946859c4389356aa271a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:29.572282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.574265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.579261 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1808/3613] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:29 2022] DELETE /identity/v3/projects/6e048cdbdc9946859c4389356aa271a6 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:03:29.582360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:29.586992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:29.689890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677336-b5ae-4c67-9315-844df3132dc7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:29.695737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:29.696806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:29.697345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:29.697847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] PATH_INFO: `/v3/users/32e8fac975c54482a8dda6bc23459585` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:29.699495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e8fac975c54482a8dda6bc23459585)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:29.701648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:29.705837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892e9db-7240-4f66-82e5-a7429e1deea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:29.707212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892e9db-7240-4f66-82e5-a7429e1deea8 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:29.707512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892e9db-7240-4f66-82e5-a7429e1deea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:29.707790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892e9db-7240-4f66-82e5-a7429e1deea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:29.708429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892e9db-7240-4f66-82e5-a7429e1deea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:29.710348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892e9db-7240-4f66-82e5-a7429e1deea8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:29.763979 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1806/3614] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:29 2022] POST /identity/v3/projects => generated 379 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:29.765467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892e9db-7240-4f66-82e5-a7429e1deea8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:29.769254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c892e9db-7240-4f66-82e5-a7429e1deea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:29.785295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e8fac975c54482a8dda6bc23459585'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.800832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e8fac975c54482a8dda6bc23459585'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.803543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e8fac975c54482a8dda6bc23459585'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.824826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e8fac975c54482a8dda6bc23459585'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.826042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e8fac975c54482a8dda6bc23459585'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:29.859363 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1809/3615] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:29 2022] DELETE /identity/v3/users/32e8fac975c54482a8dda6bc23459585 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:29.886296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892e9db-7240-4f66-82e5-a7429e1deea8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:29.987604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c5e51-438c-48a7-9ca6-cc9374bca221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:29.988606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c5e51-438c-48a7-9ca6-cc9374bca221 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:29.989054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c5e51-438c-48a7-9ca6-cc9374bca221 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:29.989539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c5e51-438c-48a7-9ca6-cc9374bca221 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:29.990504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c5e51-438c-48a7-9ca6-cc9374bca221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:29.994042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c5e51-438c-48a7-9ca6-cc9374bca221 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:30.040562 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1807/3616] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:03:29 2022] POST /identity/v3/users => generated 290 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:30.040795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:30.043104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:30.065608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86154f-234d-422e-a767-535139278bcd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:30.084822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09ab40-b690-4726-ac73-53703ba3d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:30.085555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09ab40-b690-4726-ac73-53703ba3d449 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:30.086204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09ab40-b690-4726-ac73-53703ba3d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:30.086692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09ab40-b690-4726-ac73-53703ba3d449 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:30.087748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09ab40-b690-4726-ac73-53703ba3d449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:30.090070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09ab40-b690-4726-ac73-53703ba3d449 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:30.118497 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1810/3617] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:03:30.123346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c5e51-438c-48a7-9ca6-cc9374bca221 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:30.137294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c5e51-438c-48a7-9ca6-cc9374bca221 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:30.175779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f7c69-f60b-4624-b605-274e7fc12833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:30.176181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7c69-f60b-4624-b605-274e7fc12833 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:30.176468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7c69-f60b-4624-b605-274e7fc12833 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:30.176746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7c69-f60b-4624-b605-274e7fc12833 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:30.177401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f7c69-f60b-4624-b605-274e7fc12833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:30.179054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f7c69-f60b-4624-b605-274e7fc12833 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:30.210666 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1808/3618] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:30.215525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09ab40-b690-4726-ac73-53703ba3d449 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:30.232382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09ab40-b690-4726-ac73-53703ba3d449 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:30.267086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3193d-e514-4b46-a605-55423357a540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:30.267770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3193d-e514-4b46-a605-55423357a540 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:30.268060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3193d-e514-4b46-a605-55423357a540 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:30.268345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3193d-e514-4b46-a605-55423357a540 admin admin] PATH_INFO: `/v3/projects/fbd4a07daa3441088652a61666026a0a/users/d600dc31506e42849d5e83d70a61b097/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:30.316630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:30.332799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3193d-e514-4b46-a605-55423357a540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd4a07daa3441088652a61666026a0a, user_id=d600dc31506e42849d5e83d70a61b097, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:30.335550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3193d-e514-4b46-a605-55423357a540 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:30.382043 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1811/3619] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:30 2022] PUT /identity/v3/projects/fbd4a07daa3441088652a61666026a0a/users/d600dc31506e42849d5e83d70a61b097/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:30.388202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeac23d-20a3-42e6-b450-094139105aed None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:30.388520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeac23d-20a3-42e6-b450-094139105aed None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:30.389235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeac23d-20a3-42e6-b450-094139105aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:30.432705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3193d-e514-4b46-a605-55423357a540 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:30.435938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1bc3193d-e514-4b46-a605-55423357a540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:30.438309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6eeac23d-20a3-42e6-b450-094139105aed None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:30.439626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6eeac23d-20a3-42e6-b450-094139105aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:30.462234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:30.625996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3193d-e514-4b46-a605-55423357a540 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:30.628979 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1809/3620] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:30.637806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:30.639129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:30.639437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:30.639778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec admin admin] PATH_INFO: `/v3/projects/6bf8e79a8dab4b378dbb169a2ab2ba59` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:30.641026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeac23d-20a3-42e6-b450-094139105aed None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:30.642540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf8e79a8dab4b378dbb169a2ab2ba59)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:30.642812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6eeac23d-20a3-42e6-b450-094139105aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:30.644523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:30.752060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'request_id': 'req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:30.759304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'request_id': 'req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:30.771294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf8e79a8dab4b378dbb169a2ab2ba59', 'request_id': 'req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:30.787314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeac23d-20a3-42e6-b450-094139105aed None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:30.816113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec admin admin] The token cache is being invalidate because project 6bf8e79a8dab4b378dbb169a2ab2ba59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:30.816418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:30.821530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-caaaa9a2-a3c7-4874-9575-dd6de8b446ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:30.824690 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1812/3621] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:30 2022] DELETE /identity/v3/projects/6bf8e79a8dab4b378dbb169a2ab2ba59 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:30.829103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51027a-1842-4943-8742-f3ca3934cbe7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:30.829398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51027a-1842-4943-8742-f3ca3934cbe7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:30.829686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51027a-1842-4943-8742-f3ca3934cbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:30.883718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-af51027a-1842-4943-8742-f3ca3934cbe7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:30.886228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753d510-ed1e-43ee-afa5-c8f439e47a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:30.887016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753d510-ed1e-43ee-afa5-c8f439e47a4f service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:30.887326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753d510-ed1e-43ee-afa5-c8f439e47a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:30.887823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753d510-ed1e-43ee-afa5-c8f439e47a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:30.889484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-af51027a-1842-4943-8742-f3ca3934cbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:30.891484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b753d510-ed1e-43ee-afa5-c8f439e47a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:31.063656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753d510-ed1e-43ee-afa5-c8f439e47a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:31.068661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753d510-ed1e-43ee-afa5-c8f439e47a4f service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:31.094929 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1813/3622] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:31.096330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8eae6-cae5-4c5b-b5e5-b4013d85c703 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:31.096621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8eae6-cae5-4c5b-b5e5-b4013d85c703 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:31.096897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8eae6-cae5-4c5b-b5e5-b4013d85c703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:31.105850 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1810/3623] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:31.131252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-82f8eae6-cae5-4c5b-b5e5-b4013d85c703 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:31.133309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-82f8eae6-cae5-4c5b-b5e5-b4013d85c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:31.150372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753d510-ed1e-43ee-afa5-c8f439e47a4f service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:31.161886 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1814/3624] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:31.162383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753d510-ed1e-43ee-afa5-c8f439e47a4f service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:31.168566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77a32e-8c8c-4bc2-bb46-e44c566e94de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:31.169193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77a32e-8c8c-4bc2-bb46-e44c566e94de admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:31.169476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77a32e-8c8c-4bc2-bb46-e44c566e94de admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:31.169753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77a32e-8c8c-4bc2-bb46-e44c566e94de admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:31.170409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77a32e-8c8c-4bc2-bb46-e44c566e94de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:03:31.170718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77a32e-8c8c-4bc2-bb46-e44c566e94de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:31.172732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77a32e-8c8c-4bc2-bb46-e44c566e94de admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:31.192783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8eae6-cae5-4c5b-b5e5-b4013d85c703 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:31.206183 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1811/3625] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:31.208315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8eae6-cae5-4c5b-b5e5-b4013d85c703 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:31.214642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df8496-958b-4fbe-a0fd-9aa0712e6483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:31.215318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df8496-958b-4fbe-a0fd-9aa0712e6483 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:31.215638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df8496-958b-4fbe-a0fd-9aa0712e6483 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:31.215967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df8496-958b-4fbe-a0fd-9aa0712e6483 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:31.217374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df8496-958b-4fbe-a0fd-9aa0712e6483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:31.219711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df8496-958b-4fbe-a0fd-9aa0712e6483 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:31.236802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:31.605956 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1815/3626] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:31 2022] POST /identity/v3/projects => generated 379 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:31.610901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77a32e-8c8c-4bc2-bb46-e44c566e94de admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:31.624252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77a32e-8c8c-4bc2-bb46-e44c566e94de admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:31.669086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:31.891797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa602e-5c2d-44a8-a297-46a33d9e4f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:31.892361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa602e-5c2d-44a8-a297-46a33d9e4f26 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:31.892651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa602e-5c2d-44a8-a297-46a33d9e4f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:31.892925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa602e-5c2d-44a8-a297-46a33d9e4f26 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:31.899750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa602e-5c2d-44a8-a297-46a33d9e4f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:31.906115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa602e-5c2d-44a8-a297-46a33d9e4f26 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:32.002872 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1812/3627] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:03:31 2022] POST /identity/v3/users => generated 290 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:32.006421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df8496-958b-4fbe-a0fd-9aa0712e6483 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:32.101885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df8496-958b-4fbe-a0fd-9aa0712e6483 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:32.127188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b48e60-1af5-4a69-87d2-08cf7b5e4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:32.128561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b48e60-1af5-4a69-87d2-08cf7b5e4d03 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:32.128770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b48e60-1af5-4a69-87d2-08cf7b5e4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:32.129125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b48e60-1af5-4a69-87d2-08cf7b5e4d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:32.130218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b48e60-1af5-4a69-87d2-08cf7b5e4d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:32.145117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b48e60-1af5-4a69-87d2-08cf7b5e4d03 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:32.175315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa602e-5c2d-44a8-a297-46a33d9e4f26 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:32.188131 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1816/3628] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:32.199870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa602e-5c2d-44a8-a297-46a33d9e4f26 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:32.209067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc328ba2-23d5-4874-a2e3-ed326b7f9932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:32.210075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc328ba2-23d5-4874-a2e3-ed326b7f9932 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:32.210463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc328ba2-23d5-4874-a2e3-ed326b7f9932 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:32.210896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc328ba2-23d5-4874-a2e3-ed326b7f9932 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:32.211672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc328ba2-23d5-4874-a2e3-ed326b7f9932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:32.215578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc328ba2-23d5-4874-a2e3-ed326b7f9932 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:32.253835 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1813/3629] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:32.258125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b48e60-1af5-4a69-87d2-08cf7b5e4d03 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:32.280231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b48e60-1af5-4a69-87d2-08cf7b5e4d03 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:32.293860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468179d-e653-477f-9318-a4d38d016b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:32.297265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468179d-e653-477f-9318-a4d38d016b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:32.297659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468179d-e653-477f-9318-a4d38d016b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:32.298051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468179d-e653-477f-9318-a4d38d016b67 admin admin] PATH_INFO: `/v3/projects/a667554a235e4a5287bc5b70b22ebd0d/users/35e369bcd10d4163b6915f2a07ee9eb1/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:32.339880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468179d-e653-477f-9318-a4d38d016b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a667554a235e4a5287bc5b70b22ebd0d, user_id=35e369bcd10d4163b6915f2a07ee9eb1, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:32.349256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468179d-e653-477f-9318-a4d38d016b67 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:32.375823 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1817/3630] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:32 2022] PUT /identity/v3/projects/a667554a235e4a5287bc5b70b22ebd0d/users/35e369bcd10d4163b6915f2a07ee9eb1/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:32.386918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b280ba-3c1c-4caf-86d7-77d283e61d27 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:32.387521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b280ba-3c1c-4caf-86d7-77d283e61d27 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:32.387898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b280ba-3c1c-4caf-86d7-77d283e61d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:32.450762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-97b280ba-3c1c-4caf-86d7-77d283e61d27 None None] MFA Rules not processed for user `35e369bcd10d4163b6915f2a07ee9eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:32.455265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-97b280ba-3c1c-4caf-86d7-77d283e61d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:32.621223 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1814/3631] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:32.626083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468179d-e653-477f-9318-a4d38d016b67 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:32.639603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468179d-e653-477f-9318-a4d38d016b67 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:32.649569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef96b1-0e7e-4459-9cc3-8f7183a5021d tempest-DefaultDomainTestJSON-1095826615 tempest-DefaultDomainTestJSON-1095826615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35e369bcd10d4163b6915f2a07ee9eb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a667554a235e4a5287bc5b70b22ebd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:32.650654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef96b1-0e7e-4459-9cc3-8f7183a5021d tempest-DefaultDomainTestJSON-1095826615 tempest-DefaultDomainTestJSON-1095826615-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:32.652401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef96b1-0e7e-4459-9cc3-8f7183a5021d tempest-DefaultDomainTestJSON-1095826615 tempest-DefaultDomainTestJSON-1095826615-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:32.652691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef96b1-0e7e-4459-9cc3-8f7183a5021d tempest-DefaultDomainTestJSON-1095826615 tempest-DefaultDomainTestJSON-1095826615-project] PATH_INFO: `/v3/domains/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:32.654867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef96b1-0e7e-4459-9cc3-8f7183a5021d tempest-DefaultDomainTestJSON-1095826615 tempest-DefaultDomainTestJSON-1095826615-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:32.656564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef96b1-0e7e-4459-9cc3-8f7183a5021d tempest-DefaultDomainTestJSON-1095826615 tempest-DefaultDomainTestJSON-1095826615-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:32.658632 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1818/3632] 10.222.0.70 () {58 vars in 1152 bytes} [Sun Aug 28 19:03:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:32.663483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b280ba-3c1c-4caf-86d7-77d283e61d27 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:32.752089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b280ba-3c1c-4caf-86d7-77d283e61d27 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:32.758076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:32.758868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:32.759318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:32.759853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] PATH_INFO: `/v3/users/35e369bcd10d4163b6915f2a07ee9eb1` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:32.761999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e369bcd10d4163b6915f2a07ee9eb1)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:32.764302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:32.803550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:32.868384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e369bcd10d4163b6915f2a07ee9eb1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:32.893405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e369bcd10d4163b6915f2a07ee9eb1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:32.895905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e369bcd10d4163b6915f2a07ee9eb1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:32.924906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e369bcd10d4163b6915f2a07ee9eb1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:32.927640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e369bcd10d4163b6915f2a07ee9eb1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:32.953998 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1815/3633] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:32 2022] DELETE /identity/v3/users/35e369bcd10d4163b6915f2a07ee9eb1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:32.959790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cc33e-7b11-4854-a48b-c078186bcd8a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:32.960261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cc33e-7b11-4854-a48b-c078186bcd8a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:32.960652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cc33e-7b11-4854-a48b-c078186bcd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:33.012543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c03cc33e-7b11-4854-a48b-c078186bcd8a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:33.018358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c03cc33e-7b11-4854-a48b-c078186bcd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:33.159298 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1819/3634] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:33.166410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:33.169411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:33.306839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cc088-a3b0-4ef7-8804-ef3350294e30 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:33.312598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127a3df-3be3-4b9e-9e49-af0f6171c84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:33.313792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127a3df-3be3-4b9e-9e49-af0f6171c84f service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:33.314309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127a3df-3be3-4b9e-9e49-af0f6171c84f service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:33.315217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127a3df-3be3-4b9e-9e49-af0f6171c84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:33.330235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127a3df-3be3-4b9e-9e49-af0f6171c84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:33.332126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127a3df-3be3-4b9e-9e49-af0f6171c84f service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:33.364436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1816/3635] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:33.852298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cc33e-7b11-4854-a48b-c078186bcd8a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:33.856757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c03cc33e-7b11-4854-a48b-c078186bcd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:33.893301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cc33e-7b11-4854-a48b-c078186bcd8a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:33.903393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:33.904324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:33.905213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:33.905505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b admin admin] PATH_INFO: `/v3/projects/a667554a235e4a5287bc5b70b22ebd0d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:33.906718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a667554a235e4a5287bc5b70b22ebd0d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:33.908961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:34.029440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a667554a235e4a5287bc5b70b22ebd0d', 'request_id': 'req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.051362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a667554a235e4a5287bc5b70b22ebd0d', 'request_id': 'req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.069455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a667554a235e4a5287bc5b70b22ebd0d', 'request_id': 'req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.107981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b admin admin] The token cache is being invalidate because project a667554a235e4a5287bc5b70b22ebd0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:34.108741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.109989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bff3dd9e-322a-4e81-a0ca-205aa8248a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:34.117325 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1820/3636] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:33 2022] DELETE /identity/v3/projects/a667554a235e4a5287bc5b70b22ebd0d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:34.117855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624e9e0-7d19-4bee-89cf-b9cc7259ffcb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:34.118334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624e9e0-7d19-4bee-89cf-b9cc7259ffcb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:34.118422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624e9e0-7d19-4bee-89cf-b9cc7259ffcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:34.161265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4624e9e0-7d19-4bee-89cf-b9cc7259ffcb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:34.162730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4624e9e0-7d19-4bee-89cf-b9cc7259ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:34.371035 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1817/3637] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:34.372999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b6828-a8fa-43e3-8791-0797a4af131f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:34.373463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b6828-a8fa-43e3-8791-0797a4af131f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:34.373551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b6828-a8fa-43e3-8791-0797a4af131f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:34.425904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0f7b6828-a8fa-43e3-8791-0797a4af131f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:34.433026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0f7b6828-a8fa-43e3-8791-0797a4af131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:34.458921 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1821/3638] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:34.461419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624e9e0-7d19-4bee-89cf-b9cc7259ffcb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:34.507146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624e9e0-7d19-4bee-89cf-b9cc7259ffcb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:34.523743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea30ca9-193f-49f7-9dc1-9380e20770f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:34.525041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea30ca9-193f-49f7-9dc1-9380e20770f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:34.525563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea30ca9-193f-49f7-9dc1-9380e20770f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:34.526104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea30ca9-193f-49f7-9dc1-9380e20770f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:34.527267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea30ca9-193f-49f7-9dc1-9380e20770f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:03:34.527822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea30ca9-193f-49f7-9dc1-9380e20770f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:34.529963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea30ca9-193f-49f7-9dc1-9380e20770f0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:34.556131 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1818/3639] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:34.558399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b6828-a8fa-43e3-8791-0797a4af131f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:34.577695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b6828-a8fa-43e3-8791-0797a4af131f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:34.604008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550dd610-d09d-4844-a229-4fb088af461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:34.604889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550dd610-d09d-4844-a229-4fb088af461e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:34.605361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550dd610-d09d-4844-a229-4fb088af461e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:34.605726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550dd610-d09d-4844-a229-4fb088af461e admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:34.608205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550dd610-d09d-4844-a229-4fb088af461e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:34.611059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550dd610-d09d-4844-a229-4fb088af461e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:34.678651 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1822/3640] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:34 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:34.681167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea30ca9-193f-49f7-9dc1-9380e20770f0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:34.701130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea30ca9-193f-49f7-9dc1-9380e20770f0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:34.789002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:34.886396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0698ed1-9eaf-4514-bcf4-7398c491dca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:34.887556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0698ed1-9eaf-4514-bcf4-7398c491dca9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:34.889128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0698ed1-9eaf-4514-bcf4-7398c491dca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:34.889614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0698ed1-9eaf-4514-bcf4-7398c491dca9 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:34.891201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0698ed1-9eaf-4514-bcf4-7398c491dca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:34.897229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0698ed1-9eaf-4514-bcf4-7398c491dca9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:34.950404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550dd610-d09d-4844-a229-4fb088af461e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:34.950715 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1819/3641] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:03:34 2022] POST /identity/v3/users => generated 286 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:34.964371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550dd610-d09d-4844-a229-4fb088af461e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:34.976701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccaa8a4-b311-4c3f-937d-c7c5564b6488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:34.977337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccaa8a4-b311-4c3f-937d-c7c5564b6488 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:34.978479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccaa8a4-b311-4c3f-937d-c7c5564b6488 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:34.979480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccaa8a4-b311-4c3f-937d-c7c5564b6488 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:34.980543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccaa8a4-b311-4c3f-937d-c7c5564b6488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:34.982216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccaa8a4-b311-4c3f-937d-c7c5564b6488 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:34.984753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:35.003668 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1823/3642] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:35.007441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0698ed1-9eaf-4514-bcf4-7398c491dca9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:35.039468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0698ed1-9eaf-4514-bcf4-7398c491dca9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:35.064995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227217a-792e-4fbb-97b5-ec4cf6c7fc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:35.065749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227217a-792e-4fbb-97b5-ec4cf6c7fc04 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.067049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227217a-792e-4fbb-97b5-ec4cf6c7fc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.067049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227217a-792e-4fbb-97b5-ec4cf6c7fc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.069493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227217a-792e-4fbb-97b5-ec4cf6c7fc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:35.071275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227217a-792e-4fbb-97b5-ec4cf6c7fc04 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:35.110308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccaa8a4-b311-4c3f-937d-c7c5564b6488 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:35.110988 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1820/3643] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:35.126423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccaa8a4-b311-4c3f-937d-c7c5564b6488 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:35.141658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cfc06-501b-4f78-bede-aafe81cbba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:35.147299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cfc06-501b-4f78-bede-aafe81cbba65 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.148627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cfc06-501b-4f78-bede-aafe81cbba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.149079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cfc06-501b-4f78-bede-aafe81cbba65 admin admin] PATH_INFO: `/v3/projects/5c90474c52dd4a6cacb0165fd08c1b06/users/78137a8105a145b38c918a945ea2844d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.169744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8cfc06-501b-4f78-bede-aafe81cbba65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c90474c52dd4a6cacb0165fd08c1b06, user_id=78137a8105a145b38c918a945ea2844d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:35.175516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8cfc06-501b-4f78-bede-aafe81cbba65 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:35.200457 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1824/3644] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:35 2022] PUT /identity/v3/projects/5c90474c52dd4a6cacb0165fd08c1b06/users/78137a8105a145b38c918a945ea2844d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:03:35.211708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62580a1a-b0e0-4943-9a07-558e24927374 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.212280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62580a1a-b0e0-4943-9a07-558e24927374 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.212395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62580a1a-b0e0-4943-9a07-558e24927374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.284452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-62580a1a-b0e0-4943-9a07-558e24927374 None None] MFA Rules not processed for user `78137a8105a145b38c918a945ea2844d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:35.285966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-62580a1a-b0e0-4943-9a07-558e24927374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:35.406893 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1821/3645] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:35.420081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cfc06-501b-4f78-bede-aafe81cbba65 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:35.422862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5c8cfc06-501b-4f78-bede-aafe81cbba65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:35.531532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cfc06-501b-4f78-bede-aafe81cbba65 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:35.535755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d905d1-4e8c-4a32-a8c8-341546b72950 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:35.536317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d905d1-4e8c-4a32-a8c8-341546b72950 service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.536601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d905d1-4e8c-4a32-a8c8-341546b72950 service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.536937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d905d1-4e8c-4a32-a8c8-341546b72950 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:35.549385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d905d1-4e8c-4a32-a8c8-341546b72950 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:35.550942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d905d1-4e8c-4a32-a8c8-341546b72950 service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:35.569656 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1825/3646] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:35.955555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab8520-a943-4f89-85fe-2cf64371faa8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:35.955901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab8520-a943-4f89-85fe-2cf64371faa8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:35.956125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab8520-a943-4f89-85fe-2cf64371faa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:36.161599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e6ab8520-a943-4f89-85fe-2cf64371faa8 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:36.163030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e6ab8520-a943-4f89-85fe-2cf64371faa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:36.335536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:36.349370 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1822/3647] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:03:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:36.420658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d905d1-4e8c-4a32-a8c8-341546b72950 service glance] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:36.422377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-87d905d1-4e8c-4a32-a8c8-341546b72950 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:36.663630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d905d1-4e8c-4a32-a8c8-341546b72950 service glance] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:36.679715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9882a-0e4f-4d9a-af0d-1bd430b6baba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:36.683729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9882a-0e4f-4d9a-af0d-1bd430b6baba service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:36.684237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9882a-0e4f-4d9a-af0d-1bd430b6baba service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:36.684810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9882a-0e4f-4d9a-af0d-1bd430b6baba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:36.708126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9882a-0e4f-4d9a-af0d-1bd430b6baba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:36.712915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9882a-0e4f-4d9a-af0d-1bd430b6baba service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:36.739806 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1826/3648] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:03:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:03:37.250612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefec95-05a8-43f7-acb2-6442654f3eaf None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:37.250935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefec95-05a8-43f7-acb2-6442654f3eaf None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:37.251223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefec95-05a8-43f7-acb2-6442654f3eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:37.303338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-deefec95-05a8-43f7-acb2-6442654f3eaf None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:37.304593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-deefec95-05a8-43f7-acb2-6442654f3eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:37.334696 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1823/3649] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:03:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:37.365308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9882a-0e4f-4d9a-af0d-1bd430b6baba service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:37.387875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9882a-0e4f-4d9a-af0d-1bd430b6baba service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:37.412882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d46fa-dbab-40f5-b06d-216987f3bc72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:37.413517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d46fa-dbab-40f5-b06d-216987f3bc72 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:37.413959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d46fa-dbab-40f5-b06d-216987f3bc72 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:37.414423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d46fa-dbab-40f5-b06d-216987f3bc72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:37.436608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d46fa-dbab-40f5-b06d-216987f3bc72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:37.438383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d46fa-dbab-40f5-b06d-216987f3bc72 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:37.467175 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1827/3650] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:03:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:03:38.127493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46cd21-696b-4950-8661-780c64edf12f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:38.128027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46cd21-696b-4950-8661-780c64edf12f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:38.128027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46cd21-696b-4950-8661-780c64edf12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:38.165024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1b46cd21-696b-4950-8661-780c64edf12f None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:38.166395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1b46cd21-696b-4950-8661-780c64edf12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:38.185715 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1824/3651] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:03:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:38.201803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d46fa-dbab-40f5-b06d-216987f3bc72 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:38.213870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d46fa-dbab-40f5-b06d-216987f3bc72 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:38.236073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32719f13-359e-468e-abd1-55099d965d76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:38.236913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32719f13-359e-468e-abd1-55099d965d76 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:38.237351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32719f13-359e-468e-abd1-55099d965d76 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:38.237786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32719f13-359e-468e-abd1-55099d965d76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:38.268930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32719f13-359e-468e-abd1-55099d965d76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:38.273298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32719f13-359e-468e-abd1-55099d965d76 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:38.285944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:38.300051 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1828/3652] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:03:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:03:39.067519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed7c61-b42b-443a-acba-3cca718295af None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:39.068173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed7c61-b42b-443a-acba-3cca718295af None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:39.068726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed7c61-b42b-443a-acba-3cca718295af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:39.129148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-aeed7c61-b42b-443a-acba-3cca718295af None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:39.131308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aeed7c61-b42b-443a-acba-3cca718295af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:39.146211 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1825/3653] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:03:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:03:39.155161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32719f13-359e-468e-abd1-55099d965d76 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:39.182266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32719f13-359e-468e-abd1-55099d965d76 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:39.193322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd213e34-3fd6-49fe-8a1f-14eae34ff833 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:39.194299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd213e34-3fd6-49fe-8a1f-14eae34ff833 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:39.197532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd213e34-3fd6-49fe-8a1f-14eae34ff833 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:39.197532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd213e34-3fd6-49fe-8a1f-14eae34ff833 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:39.225606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd213e34-3fd6-49fe-8a1f-14eae34ff833 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:39.227589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd213e34-3fd6-49fe-8a1f-14eae34ff833 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:39.256010 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1829/3654] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:03:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:03:39.770134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed7c61-b42b-443a-acba-3cca718295af None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:39.771641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aeed7c61-b42b-443a-acba-3cca718295af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:39.804518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d85d6a-9db8-4e6c-8cb5-8459023f49fd None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:39.804799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d85d6a-9db8-4e6c-8cb5-8459023f49fd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:39.805077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d85d6a-9db8-4e6c-8cb5-8459023f49fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:39.851948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-66d85d6a-9db8-4e6c-8cb5-8459023f49fd None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:39.853229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-66d85d6a-9db8-4e6c-8cb5-8459023f49fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:39.877830 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1830/3655] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:03:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:03:39.890166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d85d6a-9db8-4e6c-8cb5-8459023f49fd None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:39.915244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d85d6a-9db8-4e6c-8cb5-8459023f49fd None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:39.925496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5086a6-a27e-4acf-ab13-d3d27e8a9120 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:39.926552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5086a6-a27e-4acf-ab13-d3d27e8a9120 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:39.927083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5086a6-a27e-4acf-ab13-d3d27e8a9120 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:39.927510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5086a6-a27e-4acf-ab13-d3d27e8a9120 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:39.949190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5086a6-a27e-4acf-ab13-d3d27e8a9120 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:39.953722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5086a6-a27e-4acf-ab13-d3d27e8a9120 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:39.957665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed7c61-b42b-443a-acba-3cca718295af None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:39.967378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30291000-fe70-443e-8ce6-b6fec113d1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:39.976956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30291000-fe70-443e-8ce6-b6fec113d1da service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:39.977901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30291000-fe70-443e-8ce6-b6fec113d1da service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:39.978400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30291000-fe70-443e-8ce6-b6fec113d1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:39.980686 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1831/3656] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:03:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:03:40.011765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-30291000-fe70-443e-8ce6-b6fec113d1da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:40.374809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30291000-fe70-443e-8ce6-b6fec113d1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:40.377036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30291000-fe70-443e-8ce6-b6fec113d1da service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:40.435268 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1826/3657] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:40.648989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d00330-3ddd-4c7c-91ed-a8d62982ac1d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:40.650062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d00330-3ddd-4c7c-91ed-a8d62982ac1d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:40.651190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d00330-3ddd-4c7c-91ed-a8d62982ac1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:40.698168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-06d00330-3ddd-4c7c-91ed-a8d62982ac1d None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:40.699747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-06d00330-3ddd-4c7c-91ed-a8d62982ac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:40.731911 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1832/3658] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:03:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:40.738391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30291000-fe70-443e-8ce6-b6fec113d1da service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:40.752794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30291000-fe70-443e-8ce6-b6fec113d1da service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:40.759277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535852a-6f43-4fcb-a66d-5d8dbeebe2b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:40.760238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535852a-6f43-4fcb-a66d-5d8dbeebe2b0 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:40.760707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535852a-6f43-4fcb-a66d-5d8dbeebe2b0 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:40.761700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535852a-6f43-4fcb-a66d-5d8dbeebe2b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:40.771706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535852a-6f43-4fcb-a66d-5d8dbeebe2b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:40.773696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535852a-6f43-4fcb-a66d-5d8dbeebe2b0 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:40.784834 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1827/3659] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:03:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:03:43.658626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33c1b6-a2ad-4359-8b59-ded7d482db9c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:43.659633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33c1b6-a2ad-4359-8b59-ded7d482db9c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:43.660184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33c1b6-a2ad-4359-8b59-ded7d482db9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:43.703668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-aa33c1b6-a2ad-4359-8b59-ded7d482db9c None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:43.707936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aa33c1b6-a2ad-4359-8b59-ded7d482db9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:43.747629 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1833/3660] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:03:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:43.756251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535852a-6f43-4fcb-a66d-5d8dbeebe2b0 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:43.774940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535852a-6f43-4fcb-a66d-5d8dbeebe2b0 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:43.790765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1fe96-0c53-44d5-8760-cfec6faff758 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:43.792235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1fe96-0c53-44d5-8760-cfec6faff758 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:43.792713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1fe96-0c53-44d5-8760-cfec6faff758 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:43.793012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1fe96-0c53-44d5-8760-cfec6faff758 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:43.814532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1fe96-0c53-44d5-8760-cfec6faff758 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:43.818214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1fe96-0c53-44d5-8760-cfec6faff758 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:43.848150 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1828/3661] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:03:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:03:44.237427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5c386-7c0b-450f-be55-db5623fee1b7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:44.237991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5c386-7c0b-450f-be55-db5623fee1b7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:44.238608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5c386-7c0b-450f-be55-db5623fee1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:44.295422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-36c5c386-7c0b-450f-be55-db5623fee1b7 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:44.301376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-36c5c386-7c0b-450f-be55-db5623fee1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:44.319554 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1834/3662] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:03:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:44.335335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1fe96-0c53-44d5-8760-cfec6faff758 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:44.350267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1fe96-0c53-44d5-8760-cfec6faff758 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:44.366246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d93282-6e6a-477c-8233-a92181d11b8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:44.367042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d93282-6e6a-477c-8233-a92181d11b8a service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:44.367331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d93282-6e6a-477c-8233-a92181d11b8a service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:44.367611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d93282-6e6a-477c-8233-a92181d11b8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:44.386513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d93282-6e6a-477c-8233-a92181d11b8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:44.392976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d93282-6e6a-477c-8233-a92181d11b8a service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:44.410283 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1829/3663] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:03:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:03:44.747365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eebf1-91d0-467f-a26d-75958ec4a006 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:44.747891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eebf1-91d0-467f-a26d-75958ec4a006 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:44.748160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eebf1-91d0-467f-a26d-75958ec4a006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:44.851449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-220eebf1-91d0-467f-a26d-75958ec4a006 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:44.859544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-220eebf1-91d0-467f-a26d-75958ec4a006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:44.923997 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1835/3664] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:03:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:44.938303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d93282-6e6a-477c-8233-a92181d11b8a service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:44.969093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d93282-6e6a-477c-8233-a92181d11b8a service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:44.990017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dfab5-cbd0-4926-884a-cb8f193d559f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:44.991060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dfab5-cbd0-4926-884a-cb8f193d559f service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:44.991351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dfab5-cbd0-4926-884a-cb8f193d559f service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:44.991631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dfab5-cbd0-4926-884a-cb8f193d559f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:45.007131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dfab5-cbd0-4926-884a-cb8f193d559f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:45.009056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dfab5-cbd0-4926-884a-cb8f193d559f service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:45.038668 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1830/3665] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:03:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:03:45.351842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507480a9-1392-4f61-a199-67d36e3d3300 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:45.352040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507480a9-1392-4f61-a199-67d36e3d3300 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:45.352328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507480a9-1392-4f61-a199-67d36e3d3300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:45.436475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-507480a9-1392-4f61-a199-67d36e3d3300 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:45.441049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-507480a9-1392-4f61-a199-67d36e3d3300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:45.479634 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1836/3666] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:03:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:45.496500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dfab5-cbd0-4926-884a-cb8f193d559f service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:45.526861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dfab5-cbd0-4926-884a-cb8f193d559f service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:45.551541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e9cde-9777-4178-9b86-43230b118cd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:45.553016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e9cde-9777-4178-9b86-43230b118cd4 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:45.553380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e9cde-9777-4178-9b86-43230b118cd4 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:45.553811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e9cde-9777-4178-9b86-43230b118cd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:45.598428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e9cde-9777-4178-9b86-43230b118cd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:45.600009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e9cde-9777-4178-9b86-43230b118cd4 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:45.629024 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1831/3667] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:03:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:03:46.052370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781412e-fd4a-4d5a-b5f4-3d4849c926c4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:46.052935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781412e-fd4a-4d5a-b5f4-3d4849c926c4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:46.052935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781412e-fd4a-4d5a-b5f4-3d4849c926c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:46.107986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c781412e-fd4a-4d5a-b5f4-3d4849c926c4 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:46.111921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c781412e-fd4a-4d5a-b5f4-3d4849c926c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:46.128608 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1837/3668] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:03:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:03:46.144662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e9cde-9777-4178-9b86-43230b118cd4 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:46.153760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:46.169162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e9cde-9777-4178-9b86-43230b118cd4 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:46.187664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39908d99-4be8-4284-9156-0255fb7e710a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:46.189703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39908d99-4be8-4284-9156-0255fb7e710a service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:46.192979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39908d99-4be8-4284-9156-0255fb7e710a service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:46.194557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39908d99-4be8-4284-9156-0255fb7e710a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:46.217258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39908d99-4be8-4284-9156-0255fb7e710a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:46.226044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39908d99-4be8-4284-9156-0255fb7e710a service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:46.272406 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1832/3669] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:03:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:03:46.429908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dbf8b-9470-4904-9c1f-9cf752931f63 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:46.430669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dbf8b-9470-4904-9c1f-9cf752931f63 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:46.431248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26dbf8b-9470-4904-9c1f-9cf752931f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:46.505464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a26dbf8b-9470-4904-9c1f-9cf752931f63 None None] MFA Rules not processed for user `d600dc31506e42849d5e83d70a61b097`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:46.509056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a26dbf8b-9470-4904-9c1f-9cf752931f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:46.611261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdce4de-6eb4-4384-9590-840dc13e4cf2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:46.611557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdce4de-6eb4-4384-9590-840dc13e4cf2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:46.612139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdce4de-6eb4-4384-9590-840dc13e4cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:46.673056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cbdce4de-6eb4-4384-9590-840dc13e4cf2 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:46.674467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cbdce4de-6eb4-4384-9590-840dc13e4cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:46.706963 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1833/3670] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:03:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:46.726852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdce4de-6eb4-4384-9590-840dc13e4cf2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:46.755439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdce4de-6eb4-4384-9590-840dc13e4cf2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:46.781954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21741c-9740-4d15-8721-fa5be276500c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:46.782616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21741c-9740-4d15-8721-fa5be276500c service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:46.785573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21741c-9740-4d15-8721-fa5be276500c service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:46.785904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21741c-9740-4d15-8721-fa5be276500c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:46.797725 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1838/3671] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:46.799008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7a505-4f1c-4d5d-bddc-9b442afdc928 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:46.799481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7a505-4f1c-4d5d-bddc-9b442afdc928 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:46.800074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7a505-4f1c-4d5d-bddc-9b442afdc928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:46.809082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21741c-9740-4d15-8721-fa5be276500c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:46.813181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21741c-9740-4d15-8721-fa5be276500c service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:46.850210 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1834/3672] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:03:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:03:46.857778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-88a7a505-4f1c-4d5d-bddc-9b442afdc928 None None] MFA Rules not processed for user `d600dc31506e42849d5e83d70a61b097`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:46.865958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-88a7a505-4f1c-4d5d-bddc-9b442afdc928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:46.879909 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1839/3673] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:03:47.105682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21741c-9740-4d15-8721-fa5be276500c service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:47.272324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21741c-9740-4d15-8721-fa5be276500c service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:47.279392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:47.280055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:47.280339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:47.280611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] PATH_INFO: `/v3/users/78137a8105a145b38c918a945ea2844d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:47.283158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78137a8105a145b38c918a945ea2844d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:47.286261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:47.323892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7a505-4f1c-4d5d-bddc-9b442afdc928 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:47.326103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-88a7a505-4f1c-4d5d-bddc-9b442afdc928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:47.375796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7a505-4f1c-4d5d-bddc-9b442afdc928 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:47.393708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5d6c2-4fc9-401e-a937-a3e9fe275b28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:47.394999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5d6c2-4fc9-401e-a937-a3e9fe275b28 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:47.395549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5d6c2-4fc9-401e-a937-a3e9fe275b28 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:47.396200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5d6c2-4fc9-401e-a937-a3e9fe275b28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:47.407744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5d6c2-4fc9-401e-a937-a3e9fe275b28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:47.409711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5d6c2-4fc9-401e-a937-a3e9fe275b28 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:47.418176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78137a8105a145b38c918a945ea2844d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:47.435296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78137a8105a145b38c918a945ea2844d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:47.436201 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1840/3674] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:47.436758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78137a8105a145b38c918a945ea2844d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:47.453910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78137a8105a145b38c918a945ea2844d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:47.454991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78137a8105a145b38c918a945ea2844d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:47.477258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752746c8-21fe-4d82-adac-e852db33ceff None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:47.477598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752746c8-21fe-4d82-adac-e852db33ceff None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:47.478048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752746c8-21fe-4d82-adac-e852db33ceff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:47.481333 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1835/3675] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:47 2022] DELETE /identity/v3/users/78137a8105a145b38c918a945ea2844d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:47.502918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-752746c8-21fe-4d82-adac-e852db33ceff None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:47.504761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-752746c8-21fe-4d82-adac-e852db33ceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:47.624848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:47.640451 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1841/3676] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:47.652337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:47.653949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:47.793641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86245813-bec9-4079-9bd5-3f589c25afc4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:47.808002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821eb29-e4dd-4c2e-91b8-48ca666b1cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:47.808002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821eb29-e4dd-4c2e-91b8-48ca666b1cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:47.808558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821eb29-e4dd-4c2e-91b8-48ca666b1cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:47.808956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821eb29-e4dd-4c2e-91b8-48ca666b1cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:47.823525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:47.833484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821eb29-e4dd-4c2e-91b8-48ca666b1cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:47.835229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821eb29-e4dd-4c2e-91b8-48ca666b1cf0 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:47.870311 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1836/3677] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:48.674555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752746c8-21fe-4d82-adac-e852db33ceff None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:48.676302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-752746c8-21fe-4d82-adac-e852db33ceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:48.728114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752746c8-21fe-4d82-adac-e852db33ceff None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:48.742533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb68bde-e798-466a-b40d-18026f92c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:48.743551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb68bde-e798-466a-b40d-18026f92c955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:48.744089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb68bde-e798-466a-b40d-18026f92c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:48.745053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb68bde-e798-466a-b40d-18026f92c955 admin admin] PATH_INFO: `/v3/projects/5c90474c52dd4a6cacb0165fd08c1b06` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:48.752478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb68bde-e798-466a-b40d-18026f92c955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c90474c52dd4a6cacb0165fd08c1b06)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:48.760674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb68bde-e798-466a-b40d-18026f92c955 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:48.862147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6bb68bde-e798-466a-b40d-18026f92c955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c90474c52dd4a6cacb0165fd08c1b06', 'request_id': 'req-6bb68bde-e798-466a-b40d-18026f92c955'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:48.871862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6bb68bde-e798-466a-b40d-18026f92c955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c90474c52dd4a6cacb0165fd08c1b06', 'request_id': 'req-6bb68bde-e798-466a-b40d-18026f92c955'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:48.885167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6bb68bde-e798-466a-b40d-18026f92c955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c90474c52dd4a6cacb0165fd08c1b06', 'request_id': 'req-6bb68bde-e798-466a-b40d-18026f92c955'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:48.949986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6bb68bde-e798-466a-b40d-18026f92c955 admin admin] The token cache is being invalidate because project 5c90474c52dd4a6cacb0165fd08c1b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:03:48.950267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6bb68bde-e798-466a-b40d-18026f92c955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:48.951984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6bb68bde-e798-466a-b40d-18026f92c955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:03:48.959062 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1842/3678] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:03:48 2022] DELETE /identity/v3/projects/5c90474c52dd4a6cacb0165fd08c1b06 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:48.960500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd19b42-e6c7-4a2a-b54b-0ee8e3f742b1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:48.960951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd19b42-e6c7-4a2a-b54b-0ee8e3f742b1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:48.961058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd19b42-e6c7-4a2a-b54b-0ee8e3f742b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:49.010692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cbd19b42-e6c7-4a2a-b54b-0ee8e3f742b1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:49.012151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cbd19b42-e6c7-4a2a-b54b-0ee8e3f742b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:49.190085 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1837/3679] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:49.204157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831c3db-a999-4f33-ba80-271d9560477b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:49.204427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831c3db-a999-4f33-ba80-271d9560477b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:49.204711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831c3db-a999-4f33-ba80-271d9560477b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:49.249379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0831c3db-a999-4f33-ba80-271d9560477b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:49.250620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0831c3db-a999-4f33-ba80-271d9560477b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:49.276937 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1843/3680] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:49.278224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd19b42-e6c7-4a2a-b54b-0ee8e3f742b1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:49.299303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd19b42-e6c7-4a2a-b54b-0ee8e3f742b1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:49.312052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ef01b-00f1-49e7-ad58-092398756f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:49.313050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ef01b-00f1-49e7-ad58-092398756f72 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:49.313527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ef01b-00f1-49e7-ad58-092398756f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:49.313992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ef01b-00f1-49e7-ad58-092398756f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:49.314870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ef01b-00f1-49e7-ad58-092398756f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:03:49.315371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ef01b-00f1-49e7-ad58-092398756f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:49.317245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ef01b-00f1-49e7-ad58-092398756f72 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:49.350662 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1838/3681] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:03:49.357746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831c3db-a999-4f33-ba80-271d9560477b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:49.375210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831c3db-a999-4f33-ba80-271d9560477b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:49.396654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf86cf7-3f59-43c5-b38c-90a80e0cd309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:49.397639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf86cf7-3f59-43c5-b38c-90a80e0cd309 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:49.398118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf86cf7-3f59-43c5-b38c-90a80e0cd309 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:49.398585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf86cf7-3f59-43c5-b38c-90a80e0cd309 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:49.399567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf86cf7-3f59-43c5-b38c-90a80e0cd309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:49.403217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf86cf7-3f59-43c5-b38c-90a80e0cd309 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:49.474461 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1844/3682] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:49 2022] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:49.481333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ef01b-00f1-49e7-ad58-092398756f72 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:49.497168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ef01b-00f1-49e7-ad58-092398756f72 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:49.710241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e708da-46ac-4c8b-a30a-da7526c81a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:49.711356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e708da-46ac-4c8b-a30a-da7526c81a7c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:49.711623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e708da-46ac-4c8b-a30a-da7526c81a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:49.712391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e708da-46ac-4c8b-a30a-da7526c81a7c admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:49.713617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e708da-46ac-4c8b-a30a-da7526c81a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:49.723405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e708da-46ac-4c8b-a30a-da7526c81a7c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:49.853235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf86cf7-3f59-43c5-b38c-90a80e0cd309 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:49.857942 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1839/3683] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:03:49 2022] POST /identity/v3/users => generated 296 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:03:49.882687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf86cf7-3f59-43c5-b38c-90a80e0cd309 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:49.911048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaf95e-2d28-4090-8fd6-87a5af6aa86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:49.912067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaf95e-2d28-4090-8fd6-87a5af6aa86a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:49.912586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaf95e-2d28-4090-8fd6-87a5af6aa86a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:49.913071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaf95e-2d28-4090-8fd6-87a5af6aa86a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:49.914183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaf95e-2d28-4090-8fd6-87a5af6aa86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:49.918838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaf95e-2d28-4090-8fd6-87a5af6aa86a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:49.938554 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1845/3684] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:03:49.945160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e708da-46ac-4c8b-a30a-da7526c81a7c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:49.977475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e708da-46ac-4c8b-a30a-da7526c81a7c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:49.991425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bed2a3-22c8-4e56-9001-901b848e0eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:49.994220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bed2a3-22c8-4e56-9001-901b848e0eee admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:49.995657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bed2a3-22c8-4e56-9001-901b848e0eee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:49.997834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bed2a3-22c8-4e56-9001-901b848e0eee admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:50.000058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bed2a3-22c8-4e56-9001-901b848e0eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:50.004070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bed2a3-22c8-4e56-9001-901b848e0eee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:50.079919 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1840/3685] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:50.085854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaf95e-2d28-4090-8fd6-87a5af6aa86a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:50.112345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaf95e-2d28-4090-8fd6-87a5af6aa86a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:50.120950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00991c76-70c7-44cc-8729-6d26b28dddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:50.122359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00991c76-70c7-44cc-8729-6d26b28dddd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:50.123207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00991c76-70c7-44cc-8729-6d26b28dddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:50.123900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00991c76-70c7-44cc-8729-6d26b28dddd0 admin admin] PATH_INFO: `/v3/projects/de7fcc560fe046018129496480957e26/users/9d6046033b7a47a588ee14bac245b70d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:50.159024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00991c76-70c7-44cc-8729-6d26b28dddd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7fcc560fe046018129496480957e26, user_id=9d6046033b7a47a588ee14bac245b70d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:50.162768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00991c76-70c7-44cc-8729-6d26b28dddd0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:50.193537 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1846/3686] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:50 2022] PUT /identity/v3/projects/de7fcc560fe046018129496480957e26/users/9d6046033b7a47a588ee14bac245b70d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:03:50.213929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd393fb-67b0-4676-8232-30389b844763 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:50.214350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd393fb-67b0-4676-8232-30389b844763 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:50.214711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd393fb-67b0-4676-8232-30389b844763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:50.273459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9bd393fb-67b0-4676-8232-30389b844763 None None] MFA Rules not processed for user `9d6046033b7a47a588ee14bac245b70d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:50.275974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9bd393fb-67b0-4676-8232-30389b844763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:50.435795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:50.496531 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1841/3687] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:50.500946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00991c76-70c7-44cc-8729-6d26b28dddd0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:50.764902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00991c76-70c7-44cc-8729-6d26b28dddd0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:50.794446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d41c0-1d6b-4dc3-b22b-564bac082f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:50.795214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d41c0-1d6b-4dc3-b22b-564bac082f00 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:50.795501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d41c0-1d6b-4dc3-b22b-564bac082f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:50.795997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d41c0-1d6b-4dc3-b22b-564bac082f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:50.796728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d41c0-1d6b-4dc3-b22b-564bac082f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:50.800282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d41c0-1d6b-4dc3-b22b-564bac082f00 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:50.832819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:50.846005 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1847/3688] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:03:50 2022] POST /identity/v3/projects => generated 389 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:03:50.847424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd393fb-67b0-4676-8232-30389b844763 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:50.877395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd393fb-67b0-4676-8232-30389b844763 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:51.122100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3c31b-e629-480b-a45d-7277922e11cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:51.124124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3c31b-e629-480b-a45d-7277922e11cf admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:51.124414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3c31b-e629-480b-a45d-7277922e11cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:51.124692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3c31b-e629-480b-a45d-7277922e11cf admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:51.125343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3c31b-e629-480b-a45d-7277922e11cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:51.127358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3c31b-e629-480b-a45d-7277922e11cf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:51.196427 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1842/3689] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:03:50 2022] POST /identity/v3/users => generated 301 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:03:51.200661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d41c0-1d6b-4dc3-b22b-564bac082f00 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:51.221066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d41c0-1d6b-4dc3-b22b-564bac082f00 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:51.234725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d637b80-74ec-4de9-a72d-06bdef9577d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:51.235431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637b80-74ec-4de9-a72d-06bdef9577d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:51.235698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637b80-74ec-4de9-a72d-06bdef9577d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:51.235976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d637b80-74ec-4de9-a72d-06bdef9577d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:51.236653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d637b80-74ec-4de9-a72d-06bdef9577d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:51.239557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d637b80-74ec-4de9-a72d-06bdef9577d3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:51.263672 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1848/3690] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:51.268117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3c31b-e629-480b-a45d-7277922e11cf admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:51.283027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3c31b-e629-480b-a45d-7277922e11cf admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:51.296951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38a641-c1e5-47e5-8c66-5a66a8f5a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:51.298097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38a641-c1e5-47e5-8c66-5a66a8f5a217 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:51.298384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38a641-c1e5-47e5-8c66-5a66a8f5a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:51.298659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38a641-c1e5-47e5-8c66-5a66a8f5a217 admin admin] PATH_INFO: `/v3/projects/5fa279bff87742648cf687d4c8dc3068/users/ea64d0e068114f0181c13b8528067a35/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:51.344066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38a641-c1e5-47e5-8c66-5a66a8f5a217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa279bff87742648cf687d4c8dc3068, user_id=ea64d0e068114f0181c13b8528067a35, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:51.350387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38a641-c1e5-47e5-8c66-5a66a8f5a217 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:51.399004 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1843/3691] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:51 2022] PUT /identity/v3/projects/5fa279bff87742648cf687d4c8dc3068/users/ea64d0e068114f0181c13b8528067a35/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:51.400060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d637b80-74ec-4de9-a72d-06bdef9577d3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:51.427685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d637b80-74ec-4de9-a72d-06bdef9577d3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:51.551778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a009d1-f853-4005-a96b-efa890d9da7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:51.553613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a009d1-f853-4005-a96b-efa890d9da7b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:51.554438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a009d1-f853-4005-a96b-efa890d9da7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:51.555450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a009d1-f853-4005-a96b-efa890d9da7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:51.557927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a009d1-f853-4005-a96b-efa890d9da7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:51.562068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a009d1-f853-4005-a96b-efa890d9da7b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:51.590842 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1849/3692] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:03:51.595412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38a641-c1e5-47e5-8c66-5a66a8f5a217 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:51.616981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38a641-c1e5-47e5-8c66-5a66a8f5a217 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:51.641430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b02f7-354b-4b04-b23f-8e0b543c18fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:51.642123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b02f7-354b-4b04-b23f-8e0b543c18fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:51.643551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b02f7-354b-4b04-b23f-8e0b543c18fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:51.643551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b02f7-354b-4b04-b23f-8e0b543c18fc admin admin] PATH_INFO: `/v3/projects/5fa279bff87742648cf687d4c8dc3068/users/ea64d0e068114f0181c13b8528067a35/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:51.645955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b02f7-354b-4b04-b23f-8e0b543c18fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa279bff87742648cf687d4c8dc3068, user_id=ea64d0e068114f0181c13b8528067a35, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:51.653145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b02f7-354b-4b04-b23f-8e0b543c18fc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:51.684620 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1844/3693] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:03:51 2022] PUT /identity/v3/projects/5fa279bff87742648cf687d4c8dc3068/users/ea64d0e068114f0181c13b8528067a35/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:03:51.695342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3d461-9b5d-4ed5-a78a-f4f01b7d50d7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:51.695668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3d461-9b5d-4ed5-a78a-f4f01b7d50d7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:51.695904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3d461-9b5d-4ed5-a78a-f4f01b7d50d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:51.755386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-65b3d461-9b5d-4ed5-a78a-f4f01b7d50d7 None None] MFA Rules not processed for user `ea64d0e068114f0181c13b8528067a35`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:03:51.756251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-65b3d461-9b5d-4ed5-a78a-f4f01b7d50d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:51.958816 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1850/3694] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:03:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:03:51.967712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b02f7-354b-4b04-b23f-8e0b543c18fc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:51.969819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-683b02f7-354b-4b04-b23f-8e0b543c18fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:03:52.127120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b02f7-354b-4b04-b23f-8e0b543c18fc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:52.139256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faed46-7a32-4e36-90d8-6dc5e981300d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:52.140319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faed46-7a32-4e36-90d8-6dc5e981300d service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:52.141009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faed46-7a32-4e36-90d8-6dc5e981300d service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:52.141561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faed46-7a32-4e36-90d8-6dc5e981300d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:52.280886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:03:52.289530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46faed46-7a32-4e36-90d8-6dc5e981300d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:52.296969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46faed46-7a32-4e36-90d8-6dc5e981300d service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:52.326150 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1845/3695] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:55.941974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3d461-9b5d-4ed5-a78a-f4f01b7d50d7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:03:55.953938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3d461-9b5d-4ed5-a78a-f4f01b7d50d7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:03:55.969920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c067d-f210-46a2-a3b9-4a5e94c08212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:03:55.971044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c067d-f210-46a2-a3b9-4a5e94c08212 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:03:55.971508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c067d-f210-46a2-a3b9-4a5e94c08212 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:03:55.971974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c067d-f210-46a2-a3b9-4a5e94c08212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:03:55.994403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c067d-f210-46a2-a3b9-4a5e94c08212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:03:55.996144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c067d-f210-46a2-a3b9-4a5e94c08212 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:03:56.015995 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1851/3696] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:03:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:03:59.824661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faed46-7a32-4e36-90d8-6dc5e981300d service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:00.032440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faed46-7a32-4e36-90d8-6dc5e981300d service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:00.051715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:00.052648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:00.052943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:00.053317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] PATH_INFO: `/v3/users/9d6046033b7a47a588ee14bac245b70d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:00.055166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6046033b7a47a588ee14bac245b70d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:00.068848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:00.232026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6046033b7a47a588ee14bac245b70d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:00.246630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6046033b7a47a588ee14bac245b70d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:00.247461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6046033b7a47a588ee14bac245b70d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:00.273196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6046033b7a47a588ee14bac245b70d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:00.274512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6046033b7a47a588ee14bac245b70d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:00.298012 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1846/3697] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:03:59 2022] DELETE /identity/v3/users/9d6046033b7a47a588ee14bac245b70d => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:00.302480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e366dd2-b611-4b8b-9e9d-735f4fa85893 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:00.303061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e366dd2-b611-4b8b-9e9d-735f4fa85893 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:00.303186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e366dd2-b611-4b8b-9e9d-735f4fa85893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:00.350161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3e366dd2-b611-4b8b-9e9d-735f4fa85893 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:00.352527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3e366dd2-b611-4b8b-9e9d-735f4fa85893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:00.622667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:00.639685 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1852/3698] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:00.644854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:00.646521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:00.753084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b90416-591d-4e50-906b-aef22fb5a4dd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:00.758241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ea766-fe81-4e3d-b737-f4b0e2e1038f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:00.758936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea766-fe81-4e3d-b737-f4b0e2e1038f service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:00.759223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea766-fe81-4e3d-b737-f4b0e2e1038f service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:00.759540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea766-fe81-4e3d-b737-f4b0e2e1038f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:00.770637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ea766-fe81-4e3d-b737-f4b0e2e1038f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:00.772433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ea766-fe81-4e3d-b737-f4b0e2e1038f service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:00.796638 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1847/3699] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:01.318549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e366dd2-b611-4b8b-9e9d-735f4fa85893 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:01.321050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3e366dd2-b611-4b8b-9e9d-735f4fa85893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:01.351470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e366dd2-b611-4b8b-9e9d-735f4fa85893 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:01.359524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:01.360485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:01.360973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:01.361461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] PATH_INFO: `/v3/projects/de7fcc560fe046018129496480957e26` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:01.362929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=de7fcc560fe046018129496480957e26)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:01.367248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:01.444777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7fcc560fe046018129496480957e26', 'request_id': 'req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:01.453945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7fcc560fe046018129496480957e26', 'request_id': 'req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:01.463782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7fcc560fe046018129496480957e26', 'request_id': 'req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:01.485579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] The token cache is being invalidate because project de7fcc560fe046018129496480957e26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:01.489885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:01.490657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:01.492864 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1853/3700] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:01 2022] DELETE /identity/v3/projects/de7fcc560fe046018129496480957e26 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:01.497710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ea766-fe81-4e3d-b737-f4b0e2e1038f service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:01.510757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ea766-fe81-4e3d-b737-f4b0e2e1038f service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:01.539580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:01.612870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81ae0c-ded2-41ba-906c-894beb9738ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:01.613653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81ae0c-ded2-41ba-906c-894beb9738ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:01.614034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81ae0c-ded2-41ba-906c-894beb9738ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:01.614408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81ae0c-ded2-41ba-906c-894beb9738ab admin admin] PATH_INFO: `/v3/users/ea64d0e068114f0181c13b8528067a35` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:01.616423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81ae0c-ded2-41ba-906c-894beb9738ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea64d0e068114f0181c13b8528067a35)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:01.618595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81ae0c-ded2-41ba-906c-894beb9738ab admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:01.690498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7c81ae0c-ded2-41ba-906c-894beb9738ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea64d0e068114f0181c13b8528067a35'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:01.705515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7c81ae0c-ded2-41ba-906c-894beb9738ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea64d0e068114f0181c13b8528067a35'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:01.706633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7c81ae0c-ded2-41ba-906c-894beb9738ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea64d0e068114f0181c13b8528067a35'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:01.723427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7c81ae0c-ded2-41ba-906c-894beb9738ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea64d0e068114f0181c13b8528067a35'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:01.724449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7c81ae0c-ded2-41ba-906c-894beb9738ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea64d0e068114f0181c13b8528067a35'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:01.746868 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1848/3701] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:01 2022] DELETE /identity/v3/users/ea64d0e068114f0181c13b8528067a35 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:02.271044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:02.274429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:02.304865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fc658-7ed9-4ca6-8f35-e440d7a99dac admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:02.481314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320e014-bb58-4b89-95e6-4c8e85cf9d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:02.482122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320e014-bb58-4b89-95e6-4c8e85cf9d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:02.482278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320e014-bb58-4b89-95e6-4c8e85cf9d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:02.482770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320e014-bb58-4b89-95e6-4c8e85cf9d13 admin admin] PATH_INFO: `/v3/projects/5fa279bff87742648cf687d4c8dc3068` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:02.484284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320e014-bb58-4b89-95e6-4c8e85cf9d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa279bff87742648cf687d4c8dc3068)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:02.486584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320e014-bb58-4b89-95e6-4c8e85cf9d13 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:02.601598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b320e014-bb58-4b89-95e6-4c8e85cf9d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa279bff87742648cf687d4c8dc3068', 'request_id': 'req-b320e014-bb58-4b89-95e6-4c8e85cf9d13'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:02.609076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b320e014-bb58-4b89-95e6-4c8e85cf9d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa279bff87742648cf687d4c8dc3068', 'request_id': 'req-b320e014-bb58-4b89-95e6-4c8e85cf9d13'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:02.616367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b320e014-bb58-4b89-95e6-4c8e85cf9d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa279bff87742648cf687d4c8dc3068', 'request_id': 'req-b320e014-bb58-4b89-95e6-4c8e85cf9d13'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:02.652601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b320e014-bb58-4b89-95e6-4c8e85cf9d13 admin admin] The token cache is being invalidate because project 5fa279bff87742648cf687d4c8dc3068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:02.654621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b320e014-bb58-4b89-95e6-4c8e85cf9d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:02.658877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b320e014-bb58-4b89-95e6-4c8e85cf9d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:02.662333 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1854/3702] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:02 2022] DELETE /identity/v3/projects/5fa279bff87742648cf687d4c8dc3068 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:02.667724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83412e9-b952-4482-a42e-91b88618ab77 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:02.668236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83412e9-b952-4482-a42e-91b88618ab77 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:02.668236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83412e9-b952-4482-a42e-91b88618ab77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:02.701575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a83412e9-b952-4482-a42e-91b88618ab77 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:02.704838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a83412e9-b952-4482-a42e-91b88618ab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:02.803842 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1849/3703] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:02.812062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b050ece-1034-4da8-bffd-aeaeb348d69f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:02.812837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b050ece-1034-4da8-bffd-aeaeb348d69f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:02.813332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b050ece-1034-4da8-bffd-aeaeb348d69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:02.855586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1b050ece-1034-4da8-bffd-aeaeb348d69f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:02.859925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1b050ece-1034-4da8-bffd-aeaeb348d69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:02.884189 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1855/3704] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:04:02.889286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83412e9-b952-4482-a42e-91b88618ab77 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:02.899458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83412e9-b952-4482-a42e-91b88618ab77 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:02.911049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20976e-2307-4f84-acb1-300689020a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:02.911683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20976e-2307-4f84-acb1-300689020a5f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:02.911968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20976e-2307-4f84-acb1-300689020a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:02.912249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20976e-2307-4f84-acb1-300689020a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:02.912910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20976e-2307-4f84-acb1-300689020a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:04:02.913216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20976e-2307-4f84-acb1-300689020a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:02.914870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20976e-2307-4f84-acb1-300689020a5f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:02.955859 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1850/3705] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:04:02.957513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b050ece-1034-4da8-bffd-aeaeb348d69f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:02.963571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:02.973406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b050ece-1034-4da8-bffd-aeaeb348d69f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:02.983437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdf3fd-6a07-46a0-97c3-5b9852ef922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:02.984231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf3fd-6a07-46a0-97c3-5b9852ef922d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:02.985176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf3fd-6a07-46a0-97c3-5b9852ef922d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:02.985558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf3fd-6a07-46a0-97c3-5b9852ef922d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:02.987455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdf3fd-6a07-46a0-97c3-5b9852ef922d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:02.989797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdf3fd-6a07-46a0-97c3-5b9852ef922d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:03.070216 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1856/3706] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:04:02 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:03.074803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20976e-2307-4f84-acb1-300689020a5f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:03.086524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20976e-2307-4f84-acb1-300689020a5f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:03.127263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:03.201052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03b482-3385-423f-9ddd-40c54bf9f245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:03.201666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03b482-3385-423f-9ddd-40c54bf9f245 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:03.201956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03b482-3385-423f-9ddd-40c54bf9f245 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:03.202242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03b482-3385-423f-9ddd-40c54bf9f245 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:03.203097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03b482-3385-423f-9ddd-40c54bf9f245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:03.205205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03b482-3385-423f-9ddd-40c54bf9f245 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:03.246362 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1851/3707] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:04:03 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:03.248190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdf3fd-6a07-46a0-97c3-5b9852ef922d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:03.264394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdf3fd-6a07-46a0-97c3-5b9852ef922d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:03.270522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64868e6a-8398-4331-b6dd-32c64d8df22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:03.271268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64868e6a-8398-4331-b6dd-32c64d8df22c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:03.271622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64868e6a-8398-4331-b6dd-32c64d8df22c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:03.272011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64868e6a-8398-4331-b6dd-32c64d8df22c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:03.273107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64868e6a-8398-4331-b6dd-32c64d8df22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:03.284928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64868e6a-8398-4331-b6dd-32c64d8df22c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:03.316709 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1857/3708] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:03.318685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03b482-3385-423f-9ddd-40c54bf9f245 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:03.333758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03b482-3385-423f-9ddd-40c54bf9f245 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:03.360223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5ec7b-d88c-4f03-9ef1-c99eb0d81d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:03.364068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5ec7b-d88c-4f03-9ef1-c99eb0d81d26 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:03.364367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5ec7b-d88c-4f03-9ef1-c99eb0d81d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:03.366218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5ec7b-d88c-4f03-9ef1-c99eb0d81d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:03.368230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5ec7b-d88c-4f03-9ef1-c99eb0d81d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:03.390072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5ec7b-d88c-4f03-9ef1-c99eb0d81d26 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:03.434084 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1852/3709] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:03.438474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64868e6a-8398-4331-b6dd-32c64d8df22c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:03.453361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64868e6a-8398-4331-b6dd-32c64d8df22c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:03.461526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd260c6-5cf8-4f35-a0b6-7b2548218c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:03.463510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd260c6-5cf8-4f35-a0b6-7b2548218c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:03.464051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd260c6-5cf8-4f35-a0b6-7b2548218c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:03.464560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd260c6-5cf8-4f35-a0b6-7b2548218c1a admin admin] PATH_INFO: `/v3/projects/f59a15523edc4b949e8e7cc27ebc6d1f/users/4e865448d7e143a19b566c0882667aa5/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:03.491764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd260c6-5cf8-4f35-a0b6-7b2548218c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59a15523edc4b949e8e7cc27ebc6d1f, user_id=4e865448d7e143a19b566c0882667aa5, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:03.501154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd260c6-5cf8-4f35-a0b6-7b2548218c1a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:03.536646 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1858/3710] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:03 2022] PUT /identity/v3/projects/f59a15523edc4b949e8e7cc27ebc6d1f/users/4e865448d7e143a19b566c0882667aa5/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:04:03.552163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e719fc-7040-4967-a956-9af81ac7684e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:03.552489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e719fc-7040-4967-a956-9af81ac7684e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:03.552756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e719fc-7040-4967-a956-9af81ac7684e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:03.622300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e2e719fc-7040-4967-a956-9af81ac7684e None None] MFA Rules not processed for user `4e865448d7e143a19b566c0882667aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:03.623590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e2e719fc-7040-4967-a956-9af81ac7684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:03.773644 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1853/3711] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:03.778791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd260c6-5cf8-4f35-a0b6-7b2548218c1a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:03.902196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd260c6-5cf8-4f35-a0b6-7b2548218c1a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:03.911573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67d339-31ca-46f7-8f22-4496045ce507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:03.912460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67d339-31ca-46f7-8f22-4496045ce507 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:03.912902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67d339-31ca-46f7-8f22-4496045ce507 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:03.913327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67d339-31ca-46f7-8f22-4496045ce507 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:03.914124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67d339-31ca-46f7-8f22-4496045ce507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:03.918978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67d339-31ca-46f7-8f22-4496045ce507 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:03.957206 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1859/3712] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:04:03 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:03.961592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e719fc-7040-4967-a956-9af81ac7684e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:03.985122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e719fc-7040-4967-a956-9af81ac7684e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:04.077918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4feec-81dd-4cb1-96ab-2972e2b9e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:04.079230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4feec-81dd-4cb1-96ab-2972e2b9e6bc admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:04.081206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4feec-81dd-4cb1-96ab-2972e2b9e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:04.081655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4feec-81dd-4cb1-96ab-2972e2b9e6bc admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:04.082682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4feec-81dd-4cb1-96ab-2972e2b9e6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:04.101593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4feec-81dd-4cb1-96ab-2972e2b9e6bc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:04.129415 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1854/3713] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:04:03 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:04.133046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67d339-31ca-46f7-8f22-4496045ce507 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:04.149690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67d339-31ca-46f7-8f22-4496045ce507 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:04.162955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76472ac7-c1a5-4279-b1c7-1deb69be9363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:04.163927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472ac7-c1a5-4279-b1c7-1deb69be9363 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:04.164404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472ac7-c1a5-4279-b1c7-1deb69be9363 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:04.165006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472ac7-c1a5-4279-b1c7-1deb69be9363 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:04.166518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76472ac7-c1a5-4279-b1c7-1deb69be9363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:04.168931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76472ac7-c1a5-4279-b1c7-1deb69be9363 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:04.183163 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1860/3714] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:04.187141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4feec-81dd-4cb1-96ab-2972e2b9e6bc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:04.200932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4feec-81dd-4cb1-96ab-2972e2b9e6bc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:04.208357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ac23-1747-4c77-9e0e-d8183259802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:04.210171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ac23-1747-4c77-9e0e-d8183259802d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:04.210785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ac23-1747-4c77-9e0e-d8183259802d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:04.211298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8ac23-1747-4c77-9e0e-d8183259802d admin admin] PATH_INFO: `/v3/projects/f8f3ff4ae5df49c3b14af0e978d277a3/users/90cd8fe9a72b416e81c7c5696be95511/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:04.234061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8ac23-1747-4c77-9e0e-d8183259802d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f3ff4ae5df49c3b14af0e978d277a3, user_id=90cd8fe9a72b416e81c7c5696be95511, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:04.238190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8ac23-1747-4c77-9e0e-d8183259802d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:04.253113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:04.263901 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1855/3715] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:04 2022] PUT /identity/v3/projects/f8f3ff4ae5df49c3b14af0e978d277a3/users/90cd8fe9a72b416e81c7c5696be95511/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:04.267491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76472ac7-c1a5-4279-b1c7-1deb69be9363 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:04.289886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76472ac7-c1a5-4279-b1c7-1deb69be9363 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:04.415545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3bfc3-1ff2-4a41-85f4-0c8de67ed45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:04.417889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3bfc3-1ff2-4a41-85f4-0c8de67ed45c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:04.418526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3bfc3-1ff2-4a41-85f4-0c8de67ed45c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:04.419005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3bfc3-1ff2-4a41-85f4-0c8de67ed45c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:04.419884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3bfc3-1ff2-4a41-85f4-0c8de67ed45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:04.421854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3bfc3-1ff2-4a41-85f4-0c8de67ed45c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:04.437768 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1861/3716] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:04.441724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ac23-1747-4c77-9e0e-d8183259802d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:04.456144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8ac23-1747-4c77-9e0e-d8183259802d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:04.462402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac0fbf-1884-4107-bdfe-6ca98bfb309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:04.463934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac0fbf-1884-4107-bdfe-6ca98bfb309b admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:04.464654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac0fbf-1884-4107-bdfe-6ca98bfb309b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:04.465108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac0fbf-1884-4107-bdfe-6ca98bfb309b admin admin] PATH_INFO: `/v3/projects/f8f3ff4ae5df49c3b14af0e978d277a3/users/90cd8fe9a72b416e81c7c5696be95511/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:04.467579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac0fbf-1884-4107-bdfe-6ca98bfb309b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f3ff4ae5df49c3b14af0e978d277a3, user_id=90cd8fe9a72b416e81c7c5696be95511, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:04.471489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac0fbf-1884-4107-bdfe-6ca98bfb309b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:04.486815 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1856/3717] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:04 2022] PUT /identity/v3/projects/f8f3ff4ae5df49c3b14af0e978d277a3/users/90cd8fe9a72b416e81c7c5696be95511/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:04.497688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455b706-4a86-40ae-a4a3-d63427a8942d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:04.498261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455b706-4a86-40ae-a4a3-d63427a8942d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:04.498261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455b706-4a86-40ae-a4a3-d63427a8942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:04.538273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5455b706-4a86-40ae-a4a3-d63427a8942d None None] MFA Rules not processed for user `90cd8fe9a72b416e81c7c5696be95511`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:04.539874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5455b706-4a86-40ae-a4a3-d63427a8942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:04.557184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:04.675760 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1862/3718] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:04.720925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac0fbf-1884-4107-bdfe-6ca98bfb309b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:04.723554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f2ac0fbf-1884-4107-bdfe-6ca98bfb309b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:04.831786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac0fbf-1884-4107-bdfe-6ca98bfb309b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:04.841048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886b3bc-7068-44b0-acb8-8c1cc5d2983b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:04.841684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886b3bc-7068-44b0-acb8-8c1cc5d2983b service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:04.841973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886b3bc-7068-44b0-acb8-8c1cc5d2983b service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:04.843014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886b3bc-7068-44b0-acb8-8c1cc5d2983b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:04.864419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886b3bc-7068-44b0-acb8-8c1cc5d2983b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:04.865944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886b3bc-7068-44b0-acb8-8c1cc5d2983b service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:04.896947 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1857/3719] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:07.565201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455b706-4a86-40ae-a4a3-d63427a8942d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:07.670231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455b706-4a86-40ae-a4a3-d63427a8942d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:07.677108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:07.677847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:07.678188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:07.680090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] PATH_INFO: `/v3/users/4e865448d7e143a19b566c0882667aa5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:07.681220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e865448d7e143a19b566c0882667aa5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:07.684044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:07.740488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e865448d7e143a19b566c0882667aa5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:07.749114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e865448d7e143a19b566c0882667aa5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:07.749888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e865448d7e143a19b566c0882667aa5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:07.760723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e865448d7e143a19b566c0882667aa5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:07.761764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e865448d7e143a19b566c0882667aa5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:07.783682 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1863/3720] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:07 2022] DELETE /identity/v3/users/4e865448d7e143a19b566c0882667aa5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:07.788077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd1df4-7695-43c2-8ce7-d110f5e9033f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:07.788618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd1df4-7695-43c2-8ce7-d110f5e9033f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:07.788618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd1df4-7695-43c2-8ce7-d110f5e9033f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:07.814502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7edd1df4-7695-43c2-8ce7-d110f5e9033f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:07.815830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7edd1df4-7695-43c2-8ce7-d110f5e9033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:07.902710 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1858/3721] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:07.913376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:07.915571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:07.957893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:08.008948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae52e40-1369-418d-89fe-080afc2712a6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:08.012659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db396d-a395-4779-a957-8567395aeaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:08.013413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db396d-a395-4779-a957-8567395aeaaa service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:08.014160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db396d-a395-4779-a957-8567395aeaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:08.014442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db396d-a395-4779-a957-8567395aeaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:08.028366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db396d-a395-4779-a957-8567395aeaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:08.033770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db396d-a395-4779-a957-8567395aeaaa service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:08.055551 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1864/3722] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:08.369959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd1df4-7695-43c2-8ce7-d110f5e9033f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:08.371817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7edd1df4-7695-43c2-8ce7-d110f5e9033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:08.388511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd1df4-7695-43c2-8ce7-d110f5e9033f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:08.395249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:08.396149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:08.397072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:08.397593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] PATH_INFO: `/v3/projects/f59a15523edc4b949e8e7cc27ebc6d1f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:08.399286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59a15523edc4b949e8e7cc27ebc6d1f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:08.402311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:08.470043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59a15523edc4b949e8e7cc27ebc6d1f', 'request_id': 'req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:08.480269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59a15523edc4b949e8e7cc27ebc6d1f', 'request_id': 'req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:08.491522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59a15523edc4b949e8e7cc27ebc6d1f', 'request_id': 'req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:08.507340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] The token cache is being invalidate because project f59a15523edc4b949e8e7cc27ebc6d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:08.508014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:08.508942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:08.513554 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1859/3723] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:08 2022] DELETE /identity/v3/projects/f59a15523edc4b949e8e7cc27ebc6d1f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:04:08.517542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db396d-a395-4779-a957-8567395aeaaa service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:08.528468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db396d-a395-4779-a957-8567395aeaaa service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:08.605264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0edf6-6925-417b-9b88-9b8071013aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:08.605959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0edf6-6925-417b-9b88-9b8071013aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:08.606246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0edf6-6925-417b-9b88-9b8071013aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:08.606527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0edf6-6925-417b-9b88-9b8071013aa0 admin admin] PATH_INFO: `/v3/users/90cd8fe9a72b416e81c7c5696be95511` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:08.607800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0edf6-6925-417b-9b88-9b8071013aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90cd8fe9a72b416e81c7c5696be95511)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:08.610032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0edf6-6925-417b-9b88-9b8071013aa0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:08.673410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-22d0edf6-6925-417b-9b88-9b8071013aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90cd8fe9a72b416e81c7c5696be95511'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:08.682204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-22d0edf6-6925-417b-9b88-9b8071013aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90cd8fe9a72b416e81c7c5696be95511'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:08.682988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-22d0edf6-6925-417b-9b88-9b8071013aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90cd8fe9a72b416e81c7c5696be95511'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:08.692204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-22d0edf6-6925-417b-9b88-9b8071013aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90cd8fe9a72b416e81c7c5696be95511'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:08.693066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-22d0edf6-6925-417b-9b88-9b8071013aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90cd8fe9a72b416e81c7c5696be95511'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:08.714803 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1865/3724] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:08 2022] DELETE /identity/v3/users/90cd8fe9a72b416e81c7c5696be95511 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:09.103326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:09.106566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:09.146809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca0239-fec8-47b7-9a5c-eec6842a0a2e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:09.180903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:09.313473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b2897-3a6e-441a-8f05-311927ea7180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:09.315529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b2897-3a6e-441a-8f05-311927ea7180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:09.317746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b2897-3a6e-441a-8f05-311927ea7180 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:09.318068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b2897-3a6e-441a-8f05-311927ea7180 admin admin] PATH_INFO: `/v3/projects/f8f3ff4ae5df49c3b14af0e978d277a3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:09.321586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b2897-3a6e-441a-8f05-311927ea7180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f3ff4ae5df49c3b14af0e978d277a3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:09.328548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b2897-3a6e-441a-8f05-311927ea7180 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:09.435673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-771b2897-3a6e-441a-8f05-311927ea7180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f3ff4ae5df49c3b14af0e978d277a3', 'request_id': 'req-771b2897-3a6e-441a-8f05-311927ea7180'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:09.448405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-771b2897-3a6e-441a-8f05-311927ea7180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f3ff4ae5df49c3b14af0e978d277a3', 'request_id': 'req-771b2897-3a6e-441a-8f05-311927ea7180'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:09.456646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-771b2897-3a6e-441a-8f05-311927ea7180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f3ff4ae5df49c3b14af0e978d277a3', 'request_id': 'req-771b2897-3a6e-441a-8f05-311927ea7180'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:09.474691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-771b2897-3a6e-441a-8f05-311927ea7180 admin admin] The token cache is being invalidate because project f8f3ff4ae5df49c3b14af0e978d277a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:09.475394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-771b2897-3a6e-441a-8f05-311927ea7180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:09.476933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-771b2897-3a6e-441a-8f05-311927ea7180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:09.480317 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1860/3725] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:09 2022] DELETE /identity/v3/projects/f8f3ff4ae5df49c3b14af0e978d277a3 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:09.485354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd4fa8-f5a2-4f13-b913-f540382030dc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:09.485567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd4fa8-f5a2-4f13-b913-f540382030dc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:09.485838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd4fa8-f5a2-4f13-b913-f540382030dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:09.539847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-28dd4fa8-f5a2-4f13-b913-f540382030dc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:09.544633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-28dd4fa8-f5a2-4f13-b913-f540382030dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:09.613200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:09.678558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2b12-21ae-4b74-8dbd-35f8efc0b2ec None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:09.678872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2b12-21ae-4b74-8dbd-35f8efc0b2ec None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:09.679152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf2b12-21ae-4b74-8dbd-35f8efc0b2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:09.694868 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1866/3726] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:09.733613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4fdf2b12-21ae-4b74-8dbd-35f8efc0b2ec None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:09.735342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4fdf2b12-21ae-4b74-8dbd-35f8efc0b2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:09.748039 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1861/3727] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:04:09.752287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd4fa8-f5a2-4f13-b913-f540382030dc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:09.766022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd4fa8-f5a2-4f13-b913-f540382030dc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:09.781359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1baa6-93d7-45b2-aadb-cb07a5b20622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:09.782235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1baa6-93d7-45b2-aadb-cb07a5b20622 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:09.782611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1baa6-93d7-45b2-aadb-cb07a5b20622 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:09.782984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1baa6-93d7-45b2-aadb-cb07a5b20622 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:09.783714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1baa6-93d7-45b2-aadb-cb07a5b20622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:04:09.784095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1baa6-93d7-45b2-aadb-cb07a5b20622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:09.786600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1baa6-93d7-45b2-aadb-cb07a5b20622 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:09.803289 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1867/3728] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:04:09.808764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf2b12-21ae-4b74-8dbd-35f8efc0b2ec None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:09.825262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf2b12-21ae-4b74-8dbd-35f8efc0b2ec None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:09.831096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245febf3-75cb-4c00-bcf1-cc8ca5600f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:09.833362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245febf3-75cb-4c00-bcf1-cc8ca5600f3c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:09.833732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245febf3-75cb-4c00-bcf1-cc8ca5600f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:09.834091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245febf3-75cb-4c00-bcf1-cc8ca5600f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:09.834872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245febf3-75cb-4c00-bcf1-cc8ca5600f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:09.838336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245febf3-75cb-4c00-bcf1-cc8ca5600f3c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:09.892189 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1862/3729] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:04:09 2022] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:09.897451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1baa6-93d7-45b2-aadb-cb07a5b20622 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:09.919997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1baa6-93d7-45b2-aadb-cb07a5b20622 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:10.040503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a603b-4b2f-4abb-99ce-ea58252e9b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:10.045010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a603b-4b2f-4abb-99ce-ea58252e9b3e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:10.045657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a603b-4b2f-4abb-99ce-ea58252e9b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:10.046938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a603b-4b2f-4abb-99ce-ea58252e9b3e admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:10.048572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a603b-4b2f-4abb-99ce-ea58252e9b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:10.062643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a603b-4b2f-4abb-99ce-ea58252e9b3e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:10.136900 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1868/3730] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:04:09 2022] POST /identity/v3/users => generated 284 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:10.140945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245febf3-75cb-4c00-bcf1-cc8ca5600f3c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:10.161388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245febf3-75cb-4c00-bcf1-cc8ca5600f3c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:10.184400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6f6dd-59b8-4878-833c-7448d9e71738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:10.185034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6f6dd-59b8-4878-833c-7448d9e71738 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:10.185323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6f6dd-59b8-4878-833c-7448d9e71738 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:10.185598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6f6dd-59b8-4878-833c-7448d9e71738 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:10.186255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6f6dd-59b8-4878-833c-7448d9e71738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:10.187920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6f6dd-59b8-4878-833c-7448d9e71738 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:10.230034 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1863/3731] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:10.230282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a603b-4b2f-4abb-99ce-ea58252e9b3e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:10.245779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a603b-4b2f-4abb-99ce-ea58252e9b3e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:10.257377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d893d4e-b567-4fe7-83fe-7a5d254bc10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:10.258309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d893d4e-b567-4fe7-83fe-7a5d254bc10a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:10.263391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d893d4e-b567-4fe7-83fe-7a5d254bc10a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:10.263830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d893d4e-b567-4fe7-83fe-7a5d254bc10a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:10.264761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d893d4e-b567-4fe7-83fe-7a5d254bc10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:10.272893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d893d4e-b567-4fe7-83fe-7a5d254bc10a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:10.311905 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1869/3732] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:04:10.316721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6f6dd-59b8-4878-833c-7448d9e71738 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:10.333465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6f6dd-59b8-4878-833c-7448d9e71738 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:10.350531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361616-2885-4f4e-b231-cfadf5406dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:10.351416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361616-2885-4f4e-b231-cfadf5406dea admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:10.351650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361616-2885-4f4e-b231-cfadf5406dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:10.354115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361616-2885-4f4e-b231-cfadf5406dea admin admin] PATH_INFO: `/v3/projects/9efa0b7bf74b48e2bd5562320a0a05b5/users/7eee5475b4084bc1b5046b30ae3683e3/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:10.390025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361616-2885-4f4e-b231-cfadf5406dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efa0b7bf74b48e2bd5562320a0a05b5, user_id=7eee5475b4084bc1b5046b30ae3683e3, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:10.394252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361616-2885-4f4e-b231-cfadf5406dea admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:10.440051 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1864/3733] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:10 2022] PUT /identity/v3/projects/9efa0b7bf74b48e2bd5562320a0a05b5/users/7eee5475b4084bc1b5046b30ae3683e3/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:10.443043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1851c2-d684-4051-b734-dd0a6d1539fe None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:10.443499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1851c2-d684-4051-b734-dd0a6d1539fe None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:10.443950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1851c2-d684-4051-b734-dd0a6d1539fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:10.557790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9b1851c2-d684-4051-b734-dd0a6d1539fe None None] MFA Rules not processed for user `7eee5475b4084bc1b5046b30ae3683e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:10.560003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9b1851c2-d684-4051-b734-dd0a6d1539fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:10.652641 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1870/3734] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:10.657947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361616-2885-4f4e-b231-cfadf5406dea admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:10.755816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:10.856319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361616-2885-4f4e-b231-cfadf5406dea admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:10.881295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12603f8-82e6-48de-bcdf-bab3e0e040ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:10.882046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12603f8-82e6-48de-bcdf-bab3e0e040ee admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:10.882330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12603f8-82e6-48de-bcdf-bab3e0e040ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:10.882606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12603f8-82e6-48de-bcdf-bab3e0e040ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:10.883322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12603f8-82e6-48de-bcdf-bab3e0e040ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:10.888828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12603f8-82e6-48de-bcdf-bab3e0e040ee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:11.002965 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1865/3735] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:04:10 2022] POST /identity/v3/projects => generated 369 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:11.003179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1851c2-d684-4051-b734-dd0a6d1539fe None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:11.025815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1851c2-d684-4051-b734-dd0a6d1539fe None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:11.135837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:11.188852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee36b81-531e-46ac-9056-79c6cff4d6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:11.190029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee36b81-531e-46ac-9056-79c6cff4d6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:11.190545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee36b81-531e-46ac-9056-79c6cff4d6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:11.191115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee36b81-531e-46ac-9056-79c6cff4d6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:11.191972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee36b81-531e-46ac-9056-79c6cff4d6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:11.194621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee36b81-531e-46ac-9056-79c6cff4d6b0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:11.245197 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1871/3736] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:04:11 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:04:11.249903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12603f8-82e6-48de-bcdf-bab3e0e040ee admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:11.267005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12603f8-82e6-48de-bcdf-bab3e0e040ee admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:11.281712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a970540-1ef5-45fa-9e0b-4135f90a8f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:11.284196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a970540-1ef5-45fa-9e0b-4135f90a8f3b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:11.284510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a970540-1ef5-45fa-9e0b-4135f90a8f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:11.284797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a970540-1ef5-45fa-9e0b-4135f90a8f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:11.285464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a970540-1ef5-45fa-9e0b-4135f90a8f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:11.293811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a970540-1ef5-45fa-9e0b-4135f90a8f3b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:11.334118 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1866/3737] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:11.339041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee36b81-531e-46ac-9056-79c6cff4d6b0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:11.357734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee36b81-531e-46ac-9056-79c6cff4d6b0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:11.388799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b0f7c-aceb-4bd2-8bc4-441452fef18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:11.389587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b0f7c-aceb-4bd2-8bc4-441452fef18b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:11.390053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b0f7c-aceb-4bd2-8bc4-441452fef18b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:11.390430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b0f7c-aceb-4bd2-8bc4-441452fef18b admin admin] PATH_INFO: `/v3/projects/e36e50b51ba5408ab8655dc3685ffffa/users/8110a8743bca4e01ad178958b4c58eaf/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:11.428624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b0f7c-aceb-4bd2-8bc4-441452fef18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36e50b51ba5408ab8655dc3685ffffa, user_id=8110a8743bca4e01ad178958b4c58eaf, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:11.432491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b0f7c-aceb-4bd2-8bc4-441452fef18b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:11.461657 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1872/3738] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:11 2022] PUT /identity/v3/projects/e36e50b51ba5408ab8655dc3685ffffa/users/8110a8743bca4e01ad178958b4c58eaf/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:11.466520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a970540-1ef5-45fa-9e0b-4135f90a8f3b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:11.483373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a970540-1ef5-45fa-9e0b-4135f90a8f3b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:11.573955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d183f6c-0cd9-4218-a432-d1987dd6e51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:11.574630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183f6c-0cd9-4218-a432-d1987dd6e51f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:11.575032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183f6c-0cd9-4218-a432-d1987dd6e51f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:11.575313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183f6c-0cd9-4218-a432-d1987dd6e51f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:11.576192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d183f6c-0cd9-4218-a432-d1987dd6e51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:11.577895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d183f6c-0cd9-4218-a432-d1987dd6e51f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:11.595923 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1867/3739] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:11.600358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b0f7c-aceb-4bd2-8bc4-441452fef18b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:11.623288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b0f7c-aceb-4bd2-8bc4-441452fef18b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:11.639608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53894d5-3060-4bef-9b24-176a1df6de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:11.640384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53894d5-3060-4bef-9b24-176a1df6de14 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:11.640678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53894d5-3060-4bef-9b24-176a1df6de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:11.640959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53894d5-3060-4bef-9b24-176a1df6de14 admin admin] PATH_INFO: `/v3/projects/e36e50b51ba5408ab8655dc3685ffffa/users/8110a8743bca4e01ad178958b4c58eaf/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:11.648454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53894d5-3060-4bef-9b24-176a1df6de14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36e50b51ba5408ab8655dc3685ffffa, user_id=8110a8743bca4e01ad178958b4c58eaf, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:11.651678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53894d5-3060-4bef-9b24-176a1df6de14 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:11.693130 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1873/3740] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:11 2022] PUT /identity/v3/projects/e36e50b51ba5408ab8655dc3685ffffa/users/8110a8743bca4e01ad178958b4c58eaf/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:11.707637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f1b6c-5659-4361-9ed6-cb67beb31f55 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:11.708196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f1b6c-5659-4361-9ed6-cb67beb31f55 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:11.708661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f1b6c-5659-4361-9ed6-cb67beb31f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:11.857519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fc2f1b6c-5659-4361-9ed6-cb67beb31f55 None None] MFA Rules not processed for user `8110a8743bca4e01ad178958b4c58eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:11.860169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fc2f1b6c-5659-4361-9ed6-cb67beb31f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:12.031864 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1868/3741] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:12.044182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53894d5-3060-4bef-9b24-176a1df6de14 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:12.046046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c53894d5-3060-4bef-9b24-176a1df6de14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:12.185639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53894d5-3060-4bef-9b24-176a1df6de14 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:12.194686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc3e34-746e-4afb-8f95-bf888777854e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:12.195794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3e34-746e-4afb-8f95-bf888777854e service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:12.196494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3e34-746e-4afb-8f95-bf888777854e service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:12.197835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc3e34-746e-4afb-8f95-bf888777854e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:12.220374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc3e34-746e-4afb-8f95-bf888777854e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:12.223270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc3e34-746e-4afb-8f95-bf888777854e service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:12.248283 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1874/3742] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:04:15.881508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f1b6c-5659-4361-9ed6-cb67beb31f55 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:15.970265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:16.028585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f1b6c-5659-4361-9ed6-cb67beb31f55 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:16.038174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:16.038985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:16.039324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:16.039727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] PATH_INFO: `/v3/users/7eee5475b4084bc1b5046b30ae3683e3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:16.041611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eee5475b4084bc1b5046b30ae3683e3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:16.044241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:16.120382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eee5475b4084bc1b5046b30ae3683e3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:16.129363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eee5475b4084bc1b5046b30ae3683e3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:16.130489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eee5475b4084bc1b5046b30ae3683e3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:16.146166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eee5475b4084bc1b5046b30ae3683e3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:16.147761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eee5475b4084bc1b5046b30ae3683e3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:16.174281 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1869/3743] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:15 2022] DELETE /identity/v3/users/7eee5475b4084bc1b5046b30ae3683e3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:16.179568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c3a03-d42b-4f61-a9c2-c242d3add65c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:16.180096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c3a03-d42b-4f61-a9c2-c242d3add65c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:16.180096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c3a03-d42b-4f61-a9c2-c242d3add65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:16.220463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-443c3a03-d42b-4f61-a9c2-c242d3add65c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:16.221679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-443c3a03-d42b-4f61-a9c2-c242d3add65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:16.379192 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1875/3744] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:16.451937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:16.454344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:16.623592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06908c-ee96-4365-8066-729f94b5baf9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:16.628135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cf0fe-d64f-45a3-863a-f0678d839548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:16.631971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cf0fe-d64f-45a3-863a-f0678d839548 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:16.632536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cf0fe-d64f-45a3-863a-f0678d839548 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:16.633521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cf0fe-d64f-45a3-863a-f0678d839548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:16.652221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cf0fe-d64f-45a3-863a-f0678d839548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:16.654031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cf0fe-d64f-45a3-863a-f0678d839548 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:16.667127 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1870/3745] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:18.343573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c3a03-d42b-4f61-a9c2-c242d3add65c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:18.345477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-443c3a03-d42b-4f61-a9c2-c242d3add65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:18.361809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c3a03-d42b-4f61-a9c2-c242d3add65c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:18.369672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:18.370489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:18.370880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:18.371166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] PATH_INFO: `/v3/users/8c74321e1a114e3094d2f69930037505` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:18.372525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c74321e1a114e3094d2f69930037505)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:18.374723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:18.429556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:18.449793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c74321e1a114e3094d2f69930037505'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:18.487630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c74321e1a114e3094d2f69930037505'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:18.488645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c74321e1a114e3094d2f69930037505'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:18.516241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c74321e1a114e3094d2f69930037505'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:18.531702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c74321e1a114e3094d2f69930037505'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:18.615523 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1876/3746] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:18 2022] DELETE /identity/v3/users/8c74321e1a114e3094d2f69930037505 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:04:18.661833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cf0fe-d64f-45a3-863a-f0678d839548 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:18.666188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cf0cf0fe-d64f-45a3-863a-f0678d839548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:18.694308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cf0fe-d64f-45a3-863a-f0678d839548 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:18.874370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:18.894943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:18.895609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:18.895888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:18.896163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] PATH_INFO: `/v3/projects/9efa0b7bf74b48e2bd5562320a0a05b5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:18.908768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9efa0b7bf74b48e2bd5562320a0a05b5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:18.912626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:19.027080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9efa0b7bf74b48e2bd5562320a0a05b5', 'request_id': 'req-69f6487f-8514-4d29-a5cc-08747e7a39cb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.043245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9efa0b7bf74b48e2bd5562320a0a05b5', 'request_id': 'req-69f6487f-8514-4d29-a5cc-08747e7a39cb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.053899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9efa0b7bf74b48e2bd5562320a0a05b5', 'request_id': 'req-69f6487f-8514-4d29-a5cc-08747e7a39cb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.065899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:19.068100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:19.084108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] The token cache is being invalidate because project 9efa0b7bf74b48e2bd5562320a0a05b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:19.084652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.085735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.090804 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1871/3747] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:18 2022] DELETE /identity/v3/projects/9efa0b7bf74b48e2bd5562320a0a05b5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:19.092082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:19.095114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:19.098547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d14b43-641d-4203-8343-45188892d9ad admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:19.189779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dac31-b0ca-485b-bf39-74aeb0386449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:19.190846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dac31-b0ca-485b-bf39-74aeb0386449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:19.191136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dac31-b0ca-485b-bf39-74aeb0386449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:19.191417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dac31-b0ca-485b-bf39-74aeb0386449 admin admin] PATH_INFO: `/v3/projects/8ca5a9d29cc64f20a63465f335012cd6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:19.192608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497dac31-b0ca-485b-bf39-74aeb0386449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca5a9d29cc64f20a63465f335012cd6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:19.194523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497dac31-b0ca-485b-bf39-74aeb0386449 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:19.203111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6487f-8514-4d29-a5cc-08747e7a39cb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:19.208517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe35950-589a-4709-a93c-86407ef22ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:19.209263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe35950-589a-4709-a93c-86407ef22ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:19.209644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe35950-589a-4709-a93c-86407ef22ede admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:19.210019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe35950-589a-4709-a93c-86407ef22ede admin admin] PATH_INFO: `/v3/users/8110a8743bca4e01ad178958b4c58eaf` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:19.211744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe35950-589a-4709-a93c-86407ef22ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=8110a8743bca4e01ad178958b4c58eaf)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:19.214157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe35950-589a-4709-a93c-86407ef22ede admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:19.293015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-497dac31-b0ca-485b-bf39-74aeb0386449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca5a9d29cc64f20a63465f335012cd6', 'request_id': 'req-497dac31-b0ca-485b-bf39-74aeb0386449'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.313303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-497dac31-b0ca-485b-bf39-74aeb0386449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca5a9d29cc64f20a63465f335012cd6', 'request_id': 'req-497dac31-b0ca-485b-bf39-74aeb0386449'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.325601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cfe35950-589a-4709-a93c-86407ef22ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8110a8743bca4e01ad178958b4c58eaf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.328281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-497dac31-b0ca-485b-bf39-74aeb0386449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca5a9d29cc64f20a63465f335012cd6', 'request_id': 'req-497dac31-b0ca-485b-bf39-74aeb0386449'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.339979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cfe35950-589a-4709-a93c-86407ef22ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8110a8743bca4e01ad178958b4c58eaf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.344421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cfe35950-589a-4709-a93c-86407ef22ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8110a8743bca4e01ad178958b4c58eaf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.349673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-497dac31-b0ca-485b-bf39-74aeb0386449 admin admin] The token cache is being invalidate because project 8ca5a9d29cc64f20a63465f335012cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:19.350989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-497dac31-b0ca-485b-bf39-74aeb0386449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.351866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-497dac31-b0ca-485b-bf39-74aeb0386449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.355644 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1877/3748] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:19 2022] DELETE /identity/v3/projects/8ca5a9d29cc64f20a63465f335012cd6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:19.359875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da4a9b-1cd6-4df1-b8f5-8f1040f91f8a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:19.360448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da4a9b-1cd6-4df1-b8f5-8f1040f91f8a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:19.360892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da4a9b-1cd6-4df1-b8f5-8f1040f91f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:19.366538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cfe35950-589a-4709-a93c-86407ef22ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8110a8743bca4e01ad178958b4c58eaf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.367309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cfe35950-589a-4709-a93c-86407ef22ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8110a8743bca4e01ad178958b4c58eaf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:19.384365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-31da4a9b-1cd6-4df1-b8f5-8f1040f91f8a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:19.385206 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1872/3749] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:19 2022] DELETE /identity/v3/users/8110a8743bca4e01ad178958b4c58eaf => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:04:19.385671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-31da4a9b-1cd6-4df1-b8f5-8f1040f91f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:19.435190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:19.474677 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1878/3750] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:04:19.484255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1abb41-c788-499b-a68f-6766474692bf None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:19.484560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1abb41-c788-499b-a68f-6766474692bf None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:19.484843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1abb41-c788-499b-a68f-6766474692bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:19.496396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:19.508791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ec1abb41-c788-499b-a68f-6766474692bf None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:19.510596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ec1abb41-c788-499b-a68f-6766474692bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:19.527960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da4a9b-1cd6-4df1-b8f5-8f1040f91f8a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:19.533867 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1873/3751] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:19.541350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da4a9b-1cd6-4df1-b8f5-8f1040f91f8a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:19.574363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba587b-9ccb-4934-b360-e83c46ea5d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:19.583824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba587b-9ccb-4934-b360-e83c46ea5d94 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:19.584126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba587b-9ccb-4934-b360-e83c46ea5d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:19.584416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba587b-9ccb-4934-b360-e83c46ea5d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:19.587055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba587b-9ccb-4934-b360-e83c46ea5d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:04:19.588007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba587b-9ccb-4934-b360-e83c46ea5d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:19.593059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba587b-9ccb-4934-b360-e83c46ea5d94 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:19.638415 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1879/3752] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:04:19.642637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1abb41-c788-499b-a68f-6766474692bf None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:19.656995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1abb41-c788-499b-a68f-6766474692bf None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:19.662365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7611d-67f8-4174-8fcd-8c35ec2e0c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:19.663148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7611d-67f8-4174-8fcd-8c35ec2e0c94 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:19.663311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7611d-67f8-4174-8fcd-8c35ec2e0c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:19.663543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7611d-67f8-4174-8fcd-8c35ec2e0c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:19.664176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7611d-67f8-4174-8fcd-8c35ec2e0c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:19.667584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7611d-67f8-4174-8fcd-8c35ec2e0c94 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:19.709969 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1874/3753] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:04:19 2022] POST /identity/v3/projects => generated 397 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:19.715347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba587b-9ccb-4934-b360-e83c46ea5d94 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:19.732474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba587b-9ccb-4934-b360-e83c46ea5d94 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:19.845619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37487d0-533a-4741-a50b-5d5f1627e80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:19.846587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37487d0-533a-4741-a50b-5d5f1627e80d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:19.846713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7611d-67f8-4174-8fcd-8c35ec2e0c94 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:19.847482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37487d0-533a-4741-a50b-5d5f1627e80d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:19.847950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37487d0-533a-4741-a50b-5d5f1627e80d admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:19.849581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c3b7611d-67f8-4174-8fcd-8c35ec2e0c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:19.849823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37487d0-533a-4741-a50b-5d5f1627e80d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:19.853638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37487d0-533a-4741-a50b-5d5f1627e80d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:19.899083 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1880/3754] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:04:19 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:19.900463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37487d0-533a-4741-a50b-5d5f1627e80d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:19.908244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7611d-67f8-4174-8fcd-8c35ec2e0c94 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:19.912925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37487d0-533a-4741-a50b-5d5f1627e80d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:19.918315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bbe63-a904-433a-a461-f35bcfdc75e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:19.919109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bbe63-a904-433a-a461-f35bcfdc75e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:19.919594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bbe63-a904-433a-a461-f35bcfdc75e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:19.919987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bbe63-a904-433a-a461-f35bcfdc75e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:19.920852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bbe63-a904-433a-a461-f35bcfdc75e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:19.923012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bbe63-a904-433a-a461-f35bcfdc75e7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:19.928397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46009abc-763a-4fd8-8b99-d9acbed92f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:19.929741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46009abc-763a-4fd8-8b99-d9acbed92f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:19.931941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46009abc-763a-4fd8-8b99-d9acbed92f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:19.932214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46009abc-763a-4fd8-8b99-d9acbed92f55 admin admin] PATH_INFO: `/v3/projects/e36e50b51ba5408ab8655dc3685ffffa` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:19.935200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46009abc-763a-4fd8-8b99-d9acbed92f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36e50b51ba5408ab8655dc3685ffffa)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:19.937334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46009abc-763a-4fd8-8b99-d9acbed92f55 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:19.938426 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1881/3755] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:19.942023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bbe63-a904-433a-a461-f35bcfdc75e7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:19.954254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bbe63-a904-433a-a461-f35bcfdc75e7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:19.960102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3ca75-bdce-4975-b01c-ce90d9d623ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:19.961517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3ca75-bdce-4975-b01c-ce90d9d623ff admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:19.962919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3ca75-bdce-4975-b01c-ce90d9d623ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:19.963713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3ca75-bdce-4975-b01c-ce90d9d623ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:19.965874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3ca75-bdce-4975-b01c-ce90d9d623ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:19.968240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3ca75-bdce-4975-b01c-ce90d9d623ff admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:19.982495 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1882/3756] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:19.986612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3ca75-bdce-4975-b01c-ce90d9d623ff admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:20.000101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3ca75-bdce-4975-b01c-ce90d9d623ff admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:20.005940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993587b7-0948-420e-861d-1dc62c5a2cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:20.007362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993587b7-0948-420e-861d-1dc62c5a2cff admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.007362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993587b7-0948-420e-861d-1dc62c5a2cff admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.008677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993587b7-0948-420e-861d-1dc62c5a2cff admin admin] PATH_INFO: `/v3/projects/f35e8df1e136421fa837ec71dff1b46c/users/ab997147a6aa4430ab0410e7eb876d62/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.034335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993587b7-0948-420e-861d-1dc62c5a2cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35e8df1e136421fa837ec71dff1b46c, user_id=ab997147a6aa4430ab0410e7eb876d62, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:20.038674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993587b7-0948-420e-861d-1dc62c5a2cff admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:20.067351 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1883/3757] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:19 2022] PUT /identity/v3/projects/f35e8df1e136421fa837ec71dff1b46c/users/ab997147a6aa4430ab0410e7eb876d62/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:20.070558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46009abc-763a-4fd8-8b99-d9acbed92f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36e50b51ba5408ab8655dc3685ffffa', 'request_id': 'req-46009abc-763a-4fd8-8b99-d9acbed92f55'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:20.074519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688c0c2-53dd-4db1-9fe5-9af4f6b93a33 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.078326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688c0c2-53dd-4db1-9fe5-9af4f6b93a33 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.078757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688c0c2-53dd-4db1-9fe5-9af4f6b93a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.084196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46009abc-763a-4fd8-8b99-d9acbed92f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36e50b51ba5408ab8655dc3685ffffa', 'request_id': 'req-46009abc-763a-4fd8-8b99-d9acbed92f55'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:20.093202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46009abc-763a-4fd8-8b99-d9acbed92f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36e50b51ba5408ab8655dc3685ffffa', 'request_id': 'req-46009abc-763a-4fd8-8b99-d9acbed92f55'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:20.114168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a688c0c2-53dd-4db1-9fe5-9af4f6b93a33 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:20.116516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a688c0c2-53dd-4db1-9fe5-9af4f6b93a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:20.120021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46009abc-763a-4fd8-8b99-d9acbed92f55 admin admin] The token cache is being invalidate because project e36e50b51ba5408ab8655dc3685ffffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:20.120400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46009abc-763a-4fd8-8b99-d9acbed92f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:20.121119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46009abc-763a-4fd8-8b99-d9acbed92f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:20.123039 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1875/3758] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:19 2022] DELETE /identity/v3/projects/e36e50b51ba5408ab8655dc3685ffffa => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:20.128684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f8e9-9ed1-410e-a8b7-92a109f1b205 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.129145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f8e9-9ed1-410e-a8b7-92a109f1b205 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.129523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f8e9-9ed1-410e-a8b7-92a109f1b205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.156069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8ec3f8e9-9ed1-410e-a8b7-92a109f1b205 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:20.157408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8ec3f8e9-9ed1-410e-a8b7-92a109f1b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:20.199547 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1884/3759] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:20.209791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688c0c2-53dd-4db1-9fe5-9af4f6b93a33 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:20.211363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a688c0c2-53dd-4db1-9fe5-9af4f6b93a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:20.230134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:20.253212 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1876/3760] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:20.263142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f3753-0ab5-47c9-93a5-8583794e0aa0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.263450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f3753-0ab5-47c9-93a5-8583794e0aa0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.263785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f3753-0ab5-47c9-93a5-8583794e0aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.286553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688c0c2-53dd-4db1-9fe5-9af4f6b93a33 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:20.288070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ce7f3753-0ab5-47c9-93a5-8583794e0aa0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:20.289337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ce7f3753-0ab5-47c9-93a5-8583794e0aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:20.291122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86ee31-f6bd-4bfb-8c6a-fb89ae20914a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:20.291705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86ee31-f6bd-4bfb-8c6a-fb89ae20914a service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.291983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86ee31-f6bd-4bfb-8c6a-fb89ae20914a service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.292252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86ee31-f6bd-4bfb-8c6a-fb89ae20914a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.304768 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1877/3761] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:20.305486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86ee31-f6bd-4bfb-8c6a-fb89ae20914a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:20.309282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f3753-0ab5-47c9-93a5-8583794e0aa0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:20.309452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86ee31-f6bd-4bfb-8c6a-fb89ae20914a service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:20.322080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f3753-0ab5-47c9-93a5-8583794e0aa0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:20.323691 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1885/3762] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:04:20.328070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a98d08-7b2f-4157-bd1f-56968360be59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:20.328694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98d08-7b2f-4157-bd1f-56968360be59 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.328981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98d08-7b2f-4157-bd1f-56968360be59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.329257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98d08-7b2f-4157-bd1f-56968360be59 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.329910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a98d08-7b2f-4157-bd1f-56968360be59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:04:20.330312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a98d08-7b2f-4157-bd1f-56968360be59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:20.331871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a98d08-7b2f-4157-bd1f-56968360be59 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:20.348695 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1878/3763] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:04:20.349993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86ee31-f6bd-4bfb-8c6a-fb89ae20914a service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:20.362158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86ee31-f6bd-4bfb-8c6a-fb89ae20914a service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:20.367667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af6ab9-fc21-4ede-8724-2bcdcf709320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:20.369237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af6ab9-fc21-4ede-8724-2bcdcf709320 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.369554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af6ab9-fc21-4ede-8724-2bcdcf709320 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.369891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af6ab9-fc21-4ede-8724-2bcdcf709320 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.370836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af6ab9-fc21-4ede-8724-2bcdcf709320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:20.373016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af6ab9-fc21-4ede-8724-2bcdcf709320 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:20.407045 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1886/3764] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:04:20 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:20.412380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a98d08-7b2f-4157-bd1f-56968360be59 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:20.432026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a98d08-7b2f-4157-bd1f-56968360be59 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:20.487884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:20.512684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8addd3b-05c1-475e-b09c-71facfb5af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:20.513489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8addd3b-05c1-475e-b09c-71facfb5af7d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.513712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8addd3b-05c1-475e-b09c-71facfb5af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.514081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8addd3b-05c1-475e-b09c-71facfb5af7d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.514834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8addd3b-05c1-475e-b09c-71facfb5af7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:20.516944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8addd3b-05c1-475e-b09c-71facfb5af7d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:20.546638 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1879/3765] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:04:20 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:20.548204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af6ab9-fc21-4ede-8724-2bcdcf709320 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:20.561680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af6ab9-fc21-4ede-8724-2bcdcf709320 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:20.569690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59997573-e3e9-4f60-9f96-8114ddcaecae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:20.570319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59997573-e3e9-4f60-9f96-8114ddcaecae admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.570602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59997573-e3e9-4f60-9f96-8114ddcaecae admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.570920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59997573-e3e9-4f60-9f96-8114ddcaecae admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.572172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59997573-e3e9-4f60-9f96-8114ddcaecae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:20.574460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59997573-e3e9-4f60-9f96-8114ddcaecae admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:20.593827 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1887/3766] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:20.597703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8addd3b-05c1-475e-b09c-71facfb5af7d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:20.608713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8addd3b-05c1-475e-b09c-71facfb5af7d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:20.614165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03705f-070f-44c2-addf-331c285b9a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:20.615293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03705f-070f-44c2-addf-331c285b9a44 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.615293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03705f-070f-44c2-addf-331c285b9a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.615496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03705f-070f-44c2-addf-331c285b9a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.616822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03705f-070f-44c2-addf-331c285b9a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:20.617883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03705f-070f-44c2-addf-331c285b9a44 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:20.640060 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1880/3767] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:04:20.644461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59997573-e3e9-4f60-9f96-8114ddcaecae admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:20.660381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59997573-e3e9-4f60-9f96-8114ddcaecae admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:20.685056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b727510-25e3-407f-8c20-bca12c59a361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:20.685749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b727510-25e3-407f-8c20-bca12c59a361 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.686034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b727510-25e3-407f-8c20-bca12c59a361 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.686314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b727510-25e3-407f-8c20-bca12c59a361 admin admin] PATH_INFO: `/v3/projects/1d1f3a3c1d414ebdba090103a45b0bd3/users/2c2c05546cfa49dea359dc6eaf4101c4/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.741378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b727510-25e3-407f-8c20-bca12c59a361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1f3a3c1d414ebdba090103a45b0bd3, user_id=2c2c05546cfa49dea359dc6eaf4101c4, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:20.747773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b727510-25e3-407f-8c20-bca12c59a361 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:20.765831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03705f-070f-44c2-addf-331c285b9a44 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:20.772350 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1888/3768] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:20 2022] PUT /identity/v3/projects/1d1f3a3c1d414ebdba090103a45b0bd3/users/2c2c05546cfa49dea359dc6eaf4101c4/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:20.785993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567417c9-2ad7-4c89-886c-0a05366ee2bd None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.786805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567417c9-2ad7-4c89-886c-0a05366ee2bd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.787295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567417c9-2ad7-4c89-886c-0a05366ee2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.850928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-567417c9-2ad7-4c89-886c-0a05366ee2bd None None] MFA Rules not processed for user `2c2c05546cfa49dea359dc6eaf4101c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:20.852296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-567417c9-2ad7-4c89-886c-0a05366ee2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:20.867311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03705f-070f-44c2-addf-331c285b9a44 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:20.950881 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1889/3769] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:20.961918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567417c9-2ad7-4c89-886c-0a05366ee2bd None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:20.963239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7bb11-b44d-4b7d-a873-d17bb3b488e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:20.963856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7bb11-b44d-4b7d-a873-d17bb3b488e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.964138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7bb11-b44d-4b7d-a873-d17bb3b488e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.964467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7bb11-b44d-4b7d-a873-d17bb3b488e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.966233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b4b7bb11-b44d-4b7d-a873-d17bb3b488e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:20.973649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567417c9-2ad7-4c89-886c-0a05366ee2bd None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:20.978894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27869ba6-b00e-4c4e-b31c-b52fc0599bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:20.979532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869ba6-b00e-4c4e-b31c-b52fc0599bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:20.979882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869ba6-b00e-4c4e-b31c-b52fc0599bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:20.980161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869ba6-b00e-4c4e-b31c-b52fc0599bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:20.990303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27869ba6-b00e-4c4e-b31c-b52fc0599bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:20.991932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27869ba6-b00e-4c4e-b31c-b52fc0599bf8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:21.004095 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1890/3770] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:04:21.042025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27869ba6-b00e-4c4e-b31c-b52fc0599bf8 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:21.046575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7bb11-b44d-4b7d-a873-d17bb3b488e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:21.048185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7bb11-b44d-4b7d-a873-d17bb3b488e6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:21.061930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27869ba6-b00e-4c4e-b31c-b52fc0599bf8 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:21.063215 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1881/3771] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:21.068299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:21.069215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:21.069813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:21.070275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] PATH_INFO: `/v3/users/2c2c05546cfa49dea359dc6eaf4101c4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:21.072461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2c05546cfa49dea359dc6eaf4101c4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:21.075033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:21.114424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:21.148113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2c05546cfa49dea359dc6eaf4101c4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:21.159552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2c05546cfa49dea359dc6eaf4101c4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:21.161762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2c05546cfa49dea359dc6eaf4101c4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:21.170517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2c05546cfa49dea359dc6eaf4101c4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:21.171979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2c05546cfa49dea359dc6eaf4101c4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:21.226564 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1891/3772] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:21 2022] DELETE /identity/v3/users/2c2c05546cfa49dea359dc6eaf4101c4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:04:21.229036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5e92-61d6-4ee5-93cc-3f89e7cdd556 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:21.229429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5e92-61d6-4ee5-93cc-3f89e7cdd556 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:21.231563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5e92-61d6-4ee5-93cc-3f89e7cdd556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:21.279811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:21.282358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:21.288456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-385c5e92-61d6-4ee5-93cc-3f89e7cdd556 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:21.289601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-385c5e92-61d6-4ee5-93cc-3f89e7cdd556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:21.320367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:21.381244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1de29-100f-4988-99c7-e6993d7a46e0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:21.388213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad311e6d-7b1a-4ad0-beed-d9cd2ed04be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:21.389211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad311e6d-7b1a-4ad0-beed-d9cd2ed04be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:21.389864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad311e6d-7b1a-4ad0-beed-d9cd2ed04be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:21.390048 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1882/3773] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:04:21.390634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad311e6d-7b1a-4ad0-beed-d9cd2ed04be4 admin admin] PATH_INFO: `/v3/users/3afd4b10403a452e81f60f30ed5690f0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:21.392490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad311e6d-7b1a-4ad0-beed-d9cd2ed04be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3afd4b10403a452e81f60f30ed5690f0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:21.394710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad311e6d-7b1a-4ad0-beed-d9cd2ed04be4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:21.399047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5e92-61d6-4ee5-93cc-3f89e7cdd556 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:21.401285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-385c5e92-61d6-4ee5-93cc-3f89e7cdd556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:21.479335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad311e6d-7b1a-4ad0-beed-d9cd2ed04be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3afd4b10403a452e81f60f30ed5690f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:21.491535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad311e6d-7b1a-4ad0-beed-d9cd2ed04be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3afd4b10403a452e81f60f30ed5690f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:21.492381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad311e6d-7b1a-4ad0-beed-d9cd2ed04be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3afd4b10403a452e81f60f30ed5690f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:21.504855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad311e6d-7b1a-4ad0-beed-d9cd2ed04be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3afd4b10403a452e81f60f30ed5690f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:21.505589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad311e6d-7b1a-4ad0-beed-d9cd2ed04be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3afd4b10403a452e81f60f30ed5690f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:21.507611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5e92-61d6-4ee5-93cc-3f89e7cdd556 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:21.513769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff016b46-0169-4b24-8bbd-83b0785b0373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:21.514591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff016b46-0169-4b24-8bbd-83b0785b0373 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:21.514985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff016b46-0169-4b24-8bbd-83b0785b0373 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:21.515341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff016b46-0169-4b24-8bbd-83b0785b0373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:21.517676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ff016b46-0169-4b24-8bbd-83b0785b0373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:21.530483 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1892/3774] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:21 2022] DELETE /identity/v3/users/3afd4b10403a452e81f60f30ed5690f0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:04:21.536507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7aa565-4cc0-44d8-af80-328ab0bfe791 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:21.536798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7aa565-4cc0-44d8-af80-328ab0bfe791 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:21.537076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7aa565-4cc0-44d8-af80-328ab0bfe791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:21.542954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff016b46-0169-4b24-8bbd-83b0785b0373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:21.544427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff016b46-0169-4b24-8bbd-83b0785b0373 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:21.555923 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1883/3775] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:21.578336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cf7aa565-4cc0-44d8-af80-328ab0bfe791 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:21.579623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cf7aa565-4cc0-44d8-af80-328ab0bfe791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:21.605051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:21.680545 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1893/3776] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:21.708427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff016b46-0169-4b24-8bbd-83b0785b0373 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:21.710022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ff016b46-0169-4b24-8bbd-83b0785b0373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:21.726234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff016b46-0169-4b24-8bbd-83b0785b0373 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:21.811036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3eccf-28ad-41ff-a4ac-aa75426cb21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:21.811790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3eccf-28ad-41ff-a4ac-aa75426cb21b service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:21.812059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3eccf-28ad-41ff-a4ac-aa75426cb21b service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:21.812615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3eccf-28ad-41ff-a4ac-aa75426cb21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:21.824009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3eccf-28ad-41ff-a4ac-aa75426cb21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:21.825521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3eccf-28ad-41ff-a4ac-aa75426cb21b service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:21.836776 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1884/3777] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:22.612437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7aa565-4cc0-44d8-af80-328ab0bfe791 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:22.615465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cf7aa565-4cc0-44d8-af80-328ab0bfe791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:22.654221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7aa565-4cc0-44d8-af80-328ab0bfe791 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:22.669701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:22.671136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:22.671651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:22.672476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f admin admin] PATH_INFO: `/v3/projects/1d1f3a3c1d414ebdba090103a45b0bd3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:22.683047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1f3a3c1d414ebdba090103a45b0bd3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:22.689268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:22.839756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1f3a3c1d414ebdba090103a45b0bd3', 'request_id': 'req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:22.847652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1f3a3c1d414ebdba090103a45b0bd3', 'request_id': 'req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:22.856932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1f3a3c1d414ebdba090103a45b0bd3', 'request_id': 'req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:22.874372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f admin admin] The token cache is being invalidate because project 1d1f3a3c1d414ebdba090103a45b0bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:22.874590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:22.875289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b93db557-a2f1-4ccd-a459-a1e7dc671c9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:22.880275 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1894/3778] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:22 2022] DELETE /identity/v3/projects/1d1f3a3c1d414ebdba090103a45b0bd3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:22.888075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239658a2-3a98-405a-97cb-12a66e7d0ef4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:22.889085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239658a2-3a98-405a-97cb-12a66e7d0ef4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:22.889607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239658a2-3a98-405a-97cb-12a66e7d0ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:22.918915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-239658a2-3a98-405a-97cb-12a66e7d0ef4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:22.921333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-239658a2-3a98-405a-97cb-12a66e7d0ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:23.127892 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1885/3779] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:23.132311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368f19b-89c7-4bca-8aac-03b87fcd3598 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:23.132915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368f19b-89c7-4bca-8aac-03b87fcd3598 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:23.133573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368f19b-89c7-4bca-8aac-03b87fcd3598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:23.183874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a368f19b-89c7-4bca-8aac-03b87fcd3598 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:23.186606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a368f19b-89c7-4bca-8aac-03b87fcd3598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:23.215065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239658a2-3a98-405a-97cb-12a66e7d0ef4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:23.224026 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1895/3780] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:23.245049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239658a2-3a98-405a-97cb-12a66e7d0ef4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:23.282139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ca511-9fce-4e91-82d9-e847d0f70d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:23.283300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ca511-9fce-4e91-82d9-e847d0f70d7c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:23.283753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ca511-9fce-4e91-82d9-e847d0f70d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:23.284207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ca511-9fce-4e91-82d9-e847d0f70d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:23.285287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ca511-9fce-4e91-82d9-e847d0f70d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:04:23.285782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ca511-9fce-4e91-82d9-e847d0f70d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:23.288799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ca511-9fce-4e91-82d9-e847d0f70d7c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:23.301555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:23.319832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368f19b-89c7-4bca-8aac-03b87fcd3598 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:23.327193 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1886/3781] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:04:23.340115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368f19b-89c7-4bca-8aac-03b87fcd3598 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:23.353222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3559b49-b881-40dc-a82b-a1737f8ed69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:23.355509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3559b49-b881-40dc-a82b-a1737f8ed69d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:23.356141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3559b49-b881-40dc-a82b-a1737f8ed69d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:23.357602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3559b49-b881-40dc-a82b-a1737f8ed69d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:23.360085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3559b49-b881-40dc-a82b-a1737f8ed69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:23.363756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3559b49-b881-40dc-a82b-a1737f8ed69d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:23.435616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ca511-9fce-4e91-82d9-e847d0f70d7c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:23.436904 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1896/3782] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:04:23 2022] POST /identity/v3/projects => generated 391 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:04:23.465764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ca511-9fce-4e91-82d9-e847d0f70d7c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:23.535592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3559b49-b881-40dc-a82b-a1737f8ed69d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:23.538549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c3559b49-b881-40dc-a82b-a1737f8ed69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:23.580594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398353a-b75c-4335-8569-2afe300895be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:23.581249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398353a-b75c-4335-8569-2afe300895be admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:23.581540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398353a-b75c-4335-8569-2afe300895be admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:23.581826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398353a-b75c-4335-8569-2afe300895be admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:23.582481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398353a-b75c-4335-8569-2afe300895be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:23.589869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398353a-b75c-4335-8569-2afe300895be admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:23.641034 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1887/3783] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:04:23 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:04:23.647463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398353a-b75c-4335-8569-2afe300895be admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:23.670679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398353a-b75c-4335-8569-2afe300895be admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:23.685649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858442e-5473-4b93-ae6b-7549e7b183e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:23.686283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858442e-5473-4b93-ae6b-7549e7b183e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:23.686568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858442e-5473-4b93-ae6b-7549e7b183e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:23.686877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858442e-5473-4b93-ae6b-7549e7b183e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:23.687537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858442e-5473-4b93-ae6b-7549e7b183e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:23.690793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858442e-5473-4b93-ae6b-7549e7b183e7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:23.715867 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1888/3784] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:23.721588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858442e-5473-4b93-ae6b-7549e7b183e7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:23.731780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3559b49-b881-40dc-a82b-a1737f8ed69d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:23.741286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:23.742259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:23.742780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:23.743331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] PATH_INFO: `/v3/projects/97973e718908435199990fb614f1ee39` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:23.745605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97973e718908435199990fb614f1ee39)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:23.748415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:23.749862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858442e-5473-4b93-ae6b-7549e7b183e7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:23.756378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe9594-df72-4927-917b-5d954c922fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:23.757071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe9594-df72-4927-917b-5d954c922fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:23.757364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe9594-df72-4927-917b-5d954c922fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:23.757645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe9594-df72-4927-917b-5d954c922fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:23.758300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe9594-df72-4927-917b-5d954c922fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:23.761011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe9594-df72-4927-917b-5d954c922fd6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:23.775364 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1889/3785] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:23.779797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe9594-df72-4927-917b-5d954c922fd6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:23.784435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:23.801889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe9594-df72-4927-917b-5d954c922fd6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:23.807188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760b4dd-5e44-401d-892e-980a4717e1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:23.807874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760b4dd-5e44-401d-892e-980a4717e1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:23.808195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760b4dd-5e44-401d-892e-980a4717e1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:23.808478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760b4dd-5e44-401d-892e-980a4717e1aa admin admin] PATH_INFO: `/v3/projects/94faad231f70415bb839f5f21bfa0fb1/users/eb1bd37825b4450e90c73f326d89311d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:23.843398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97973e718908435199990fb614f1ee39', 'request_id': 'req-53a17bf0-f5b9-4244-8a83-946c56248fd7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:23.850495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97973e718908435199990fb614f1ee39', 'request_id': 'req-53a17bf0-f5b9-4244-8a83-946c56248fd7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:23.884576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760b4dd-5e44-401d-892e-980a4717e1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=94faad231f70415bb839f5f21bfa0fb1, user_id=eb1bd37825b4450e90c73f326d89311d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:23.896966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760b4dd-5e44-401d-892e-980a4717e1aa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:23.900659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97973e718908435199990fb614f1ee39', 'request_id': 'req-53a17bf0-f5b9-4244-8a83-946c56248fd7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:23.958129 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1890/3786] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:23 2022] PUT /identity/v3/projects/94faad231f70415bb839f5f21bfa0fb1/users/eb1bd37825b4450e90c73f326d89311d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:04:23.970936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] The token cache is being invalidate because project 97973e718908435199990fb614f1ee39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:23.972206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:23.972206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:23.973133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c0c21-5b64-40cb-a05a-e9249035aee6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:23.973894 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1897/3787] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:23 2022] DELETE /identity/v3/projects/97973e718908435199990fb614f1ee39 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:23.977501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c0c21-5b64-40cb-a05a-e9249035aee6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:23.978480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c0c21-5b64-40cb-a05a-e9249035aee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:23.979308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:23.984274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:24.047765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b76c0c21-5b64-40cb-a05a-e9249035aee6 None None] MFA Rules not processed for user `eb1bd37825b4450e90c73f326d89311d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:24.049621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b76c0c21-5b64-40cb-a05a-e9249035aee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:24.172879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a17bf0-f5b9-4244-8a83-946c56248fd7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:24.242545 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1891/3788] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:24.276354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c0c21-5b64-40cb-a05a-e9249035aee6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:24.280402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b76c0c21-5b64-40cb-a05a-e9249035aee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:24.315673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54b9f7-91af-4b04-81f8-1327862e8f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:24.316366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54b9f7-91af-4b04-81f8-1327862e8f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:24.316623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54b9f7-91af-4b04-81f8-1327862e8f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:24.316919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54b9f7-91af-4b04-81f8-1327862e8f16 admin admin] PATH_INFO: `/v3/users/3d2b6ed161814d26a139d219533bf8b3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:24.318184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54b9f7-91af-4b04-81f8-1327862e8f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2b6ed161814d26a139d219533bf8b3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:24.320197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54b9f7-91af-4b04-81f8-1327862e8f16 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:24.358937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:24.412181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c0c21-5b64-40cb-a05a-e9249035aee6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:24.415759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a54b9f7-91af-4b04-81f8-1327862e8f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2b6ed161814d26a139d219533bf8b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:24.418357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe574e-95a7-44aa-8381-7d4d8411ce4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:24.419189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe574e-95a7-44aa-8381-7d4d8411ce4d service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:24.419594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe574e-95a7-44aa-8381-7d4d8411ce4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:24.420569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe574e-95a7-44aa-8381-7d4d8411ce4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:24.433379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe574e-95a7-44aa-8381-7d4d8411ce4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:24.435373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe574e-95a7-44aa-8381-7d4d8411ce4d service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:24.452580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a54b9f7-91af-4b04-81f8-1327862e8f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2b6ed161814d26a139d219533bf8b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:24.453377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a54b9f7-91af-4b04-81f8-1327862e8f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2b6ed161814d26a139d219533bf8b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:24.455607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:24.477491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a54b9f7-91af-4b04-81f8-1327862e8f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2b6ed161814d26a139d219533bf8b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:24.478591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a54b9f7-91af-4b04-81f8-1327862e8f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2b6ed161814d26a139d219533bf8b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:24.486161 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1892/3789] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:24.559337 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1898/3790] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:23 2022] DELETE /identity/v3/users/3d2b6ed161814d26a139d219533bf8b3 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:04:26.341332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe574e-95a7-44aa-8381-7d4d8411ce4d service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:26.379499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe574e-95a7-44aa-8381-7d4d8411ce4d service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:26.555588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab186d-dc30-4824-ac34-856dc939ddcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:26.556700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab186d-dc30-4824-ac34-856dc939ddcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:26.557332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab186d-dc30-4824-ac34-856dc939ddcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:26.557815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab186d-dc30-4824-ac34-856dc939ddcd admin admin] PATH_INFO: `/v3/projects/928860326a0943b8abc556bb25895bff` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:26.566434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab186d-dc30-4824-ac34-856dc939ddcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=928860326a0943b8abc556bb25895bff)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:26.569234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab186d-dc30-4824-ac34-856dc939ddcd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:26.680919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d8ab186d-dc30-4824-ac34-856dc939ddcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928860326a0943b8abc556bb25895bff', 'request_id': 'req-d8ab186d-dc30-4824-ac34-856dc939ddcd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:26.694448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d8ab186d-dc30-4824-ac34-856dc939ddcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928860326a0943b8abc556bb25895bff', 'request_id': 'req-d8ab186d-dc30-4824-ac34-856dc939ddcd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:26.701999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d8ab186d-dc30-4824-ac34-856dc939ddcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928860326a0943b8abc556bb25895bff', 'request_id': 'req-d8ab186d-dc30-4824-ac34-856dc939ddcd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:26.717465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d8ab186d-dc30-4824-ac34-856dc939ddcd admin admin] The token cache is being invalidate because project 928860326a0943b8abc556bb25895bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:26.718014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d8ab186d-dc30-4824-ac34-856dc939ddcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:26.719022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d8ab186d-dc30-4824-ac34-856dc939ddcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:26.722824 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1893/3791] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:26 2022] DELETE /identity/v3/projects/928860326a0943b8abc556bb25895bff => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:26.726678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2508cd-f855-476e-8855-517e3d77e3e9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:26.727616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2508cd-f855-476e-8855-517e3d77e3e9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:26.728911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2508cd-f855-476e-8855-517e3d77e3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:26.760456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0e2508cd-f855-476e-8855-517e3d77e3e9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:26.761761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0e2508cd-f855-476e-8855-517e3d77e3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:26.898449 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1899/3792] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:26.907559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1a092-294e-4aa9-913b-99de678878f2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:26.907848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1a092-294e-4aa9-913b-99de678878f2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:26.908126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1a092-294e-4aa9-913b-99de678878f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:26.963722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f5f1a092-294e-4aa9-913b-99de678878f2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:26.965244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f5f1a092-294e-4aa9-913b-99de678878f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:26.992349 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1894/3793] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:04:26.999892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2508cd-f855-476e-8855-517e3d77e3e9 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:27.022635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2508cd-f855-476e-8855-517e3d77e3e9 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:27.029459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423dbac-0361-419e-9f8f-5071beb2ec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:27.030317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423dbac-0361-419e-9f8f-5071beb2ec6c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:27.031478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423dbac-0361-419e-9f8f-5071beb2ec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:27.031890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423dbac-0361-419e-9f8f-5071beb2ec6c admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:27.032716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423dbac-0361-419e-9f8f-5071beb2ec6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:04:27.033129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423dbac-0361-419e-9f8f-5071beb2ec6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:27.035110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423dbac-0361-419e-9f8f-5071beb2ec6c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:27.071115 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1900/3794] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:04:27.076735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1a092-294e-4aa9-913b-99de678878f2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:27.115143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1a092-294e-4aa9-913b-99de678878f2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:27.128221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ad3f5-20db-4c8b-9c77-b17dfece7de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:27.129112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ad3f5-20db-4c8b-9c77-b17dfece7de5 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:27.129503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ad3f5-20db-4c8b-9c77-b17dfece7de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:27.129894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ad3f5-20db-4c8b-9c77-b17dfece7de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:27.131224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ad3f5-20db-4c8b-9c77-b17dfece7de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:27.134049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ad3f5-20db-4c8b-9c77-b17dfece7de5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:27.199820 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1895/3795] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:04:27 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:27.203913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423dbac-0361-419e-9f8f-5071beb2ec6c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:27.220868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423dbac-0361-419e-9f8f-5071beb2ec6c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:27.338171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e4da3-59c4-41c9-8f04-3a0f91a5b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:27.339410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e4da3-59c4-41c9-8f04-3a0f91a5b079 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:27.339959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e4da3-59c4-41c9-8f04-3a0f91a5b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:27.340845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e4da3-59c4-41c9-8f04-3a0f91a5b079 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:27.342017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e4da3-59c4-41c9-8f04-3a0f91a5b079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:27.345633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e4da3-59c4-41c9-8f04-3a0f91a5b079 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:27.403660 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1901/3796] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:04:27 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:27.406201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ad3f5-20db-4c8b-9c77-b17dfece7de5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:27.428988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ad3f5-20db-4c8b-9c77-b17dfece7de5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:27.435506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49e33a-829f-4cbb-ac33-17949fd590cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:27.436188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49e33a-829f-4cbb-ac33-17949fd590cb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:27.436590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49e33a-829f-4cbb-ac33-17949fd590cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:27.436918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49e33a-829f-4cbb-ac33-17949fd590cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:27.437630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49e33a-829f-4cbb-ac33-17949fd590cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:27.440191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49e33a-829f-4cbb-ac33-17949fd590cb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:27.463037 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1896/3797] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:27.465026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e4da3-59c4-41c9-8f04-3a0f91a5b079 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:27.481711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e4da3-59c4-41c9-8f04-3a0f91a5b079 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:27.499751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf4f7c-e343-4aa7-87a1-23f108e7d52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:27.500513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf4f7c-e343-4aa7-87a1-23f108e7d52e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:27.501452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf4f7c-e343-4aa7-87a1-23f108e7d52e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:27.501452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf4f7c-e343-4aa7-87a1-23f108e7d52e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:27.502007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf4f7c-e343-4aa7-87a1-23f108e7d52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:27.504165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf4f7c-e343-4aa7-87a1-23f108e7d52e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:27.530579 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1902/3798] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:27.532321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49e33a-829f-4cbb-ac33-17949fd590cb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:27.543593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49e33a-829f-4cbb-ac33-17949fd590cb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:27.549661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694390ac-a343-4721-a1ab-56ae357e2c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:27.550285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694390ac-a343-4721-a1ab-56ae357e2c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:27.550593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694390ac-a343-4721-a1ab-56ae357e2c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:27.550898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694390ac-a343-4721-a1ab-56ae357e2c4f admin admin] PATH_INFO: `/v3/projects/ea72dbd0993744c5a1af47926bb0877e/users/600512845bb7444b82f9fe99f1e51327/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:27.570453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694390ac-a343-4721-a1ab-56ae357e2c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea72dbd0993744c5a1af47926bb0877e, user_id=600512845bb7444b82f9fe99f1e51327, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:27.573991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694390ac-a343-4721-a1ab-56ae357e2c4f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:27.592544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:27.609450 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1897/3799] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:27 2022] PUT /identity/v3/projects/ea72dbd0993744c5a1af47926bb0877e/users/600512845bb7444b82f9fe99f1e51327/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:27.611831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4bc09-c166-4d58-9ce3-2c2b6d654ff9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:27.612303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4bc09-c166-4d58-9ce3-2c2b6d654ff9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:27.612610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4bc09-c166-4d58-9ce3-2c2b6d654ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:27.642976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f0f4bc09-c166-4d58-9ce3-2c2b6d654ff9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:27.644623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f0f4bc09-c166-4d58-9ce3-2c2b6d654ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:27.709133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:27.766204 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1903/3800] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:27.782318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694390ac-a343-4721-a1ab-56ae357e2c4f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:27.784440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-694390ac-a343-4721-a1ab-56ae357e2c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:27.908938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694390ac-a343-4721-a1ab-56ae357e2c4f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:27.914015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57d2f5-fc44-45f0-865b-e1a39593aee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:27.917305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57d2f5-fc44-45f0-865b-e1a39593aee5 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:27.918364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57d2f5-fc44-45f0-865b-e1a39593aee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:27.918880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57d2f5-fc44-45f0-865b-e1a39593aee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:27.950789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57d2f5-fc44-45f0-865b-e1a39593aee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:27.950789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57d2f5-fc44-45f0-865b-e1a39593aee5 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:27.968988 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1898/3801] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:29.543895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4bc09-c166-4d58-9ce3-2c2b6d654ff9 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:29.546949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f0f4bc09-c166-4d58-9ce3-2c2b6d654ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:29.742174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4bc09-c166-4d58-9ce3-2c2b6d654ff9 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:29.750807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ddfcd-25b6-471b-b3ed-549d1005ab50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:29.751448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ddfcd-25b6-471b-b3ed-549d1005ab50 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:29.751734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ddfcd-25b6-471b-b3ed-549d1005ab50 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:29.752067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ddfcd-25b6-471b-b3ed-549d1005ab50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:29.754274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f31ddfcd-25b6-471b-b3ed-549d1005ab50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:29.770506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ddfcd-25b6-471b-b3ed-549d1005ab50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:29.772656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ddfcd-25b6-471b-b3ed-549d1005ab50 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:29.796776 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1904/3802] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:29.985226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57d2f5-fc44-45f0-865b-e1a39593aee5 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:29.986818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8b57d2f5-fc44-45f0-865b-e1a39593aee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:30.012766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57d2f5-fc44-45f0-865b-e1a39593aee5 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:30.041352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656567e1-2a7d-4ab5-bb17-0205a056fda6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:30.042332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656567e1-2a7d-4ab5-bb17-0205a056fda6 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:30.043164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656567e1-2a7d-4ab5-bb17-0205a056fda6 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:30.044343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656567e1-2a7d-4ab5-bb17-0205a056fda6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:30.050426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-656567e1-2a7d-4ab5-bb17-0205a056fda6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:30.119053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656567e1-2a7d-4ab5-bb17-0205a056fda6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:30.123896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656567e1-2a7d-4ab5-bb17-0205a056fda6 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:30.156015 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1899/3803] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:38.419925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ddfcd-25b6-471b-b3ed-549d1005ab50 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:38.424436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f31ddfcd-25b6-471b-b3ed-549d1005ab50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:38.471453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ddfcd-25b6-471b-b3ed-549d1005ab50 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:38.486646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:38.489038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:38.494007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:38.494779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] PATH_INFO: `/v3/users/eb1bd37825b4450e90c73f326d89311d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:38.498091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1bd37825b4450e90c73f326d89311d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:38.508460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:38.641631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1bd37825b4450e90c73f326d89311d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:38.677497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1bd37825b4450e90c73f326d89311d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:38.678324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1bd37825b4450e90c73f326d89311d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:38.690341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1bd37825b4450e90c73f326d89311d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:38.691170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1bd37825b4450e90c73f326d89311d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:38.731956 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1905/3804] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:38 2022] DELETE /identity/v3/users/eb1bd37825b4450e90c73f326d89311d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:38.737149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed204f8b-b9c8-47d8-bf16-8212258a877b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:38.738777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed204f8b-b9c8-47d8-bf16-8212258a877b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:38.739926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed204f8b-b9c8-47d8-bf16-8212258a877b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:38.774050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ed204f8b-b9c8-47d8-bf16-8212258a877b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:38.784377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ed204f8b-b9c8-47d8-bf16-8212258a877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:38.956119 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1900/3805] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:38.988487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:38.989966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:39.152534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:39.241327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908fb92-5c66-4a09-87b5-400f7d4d1ea1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:39.250416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94679cc4-f11e-4770-b37a-42a0b6b82249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:39.255390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94679cc4-f11e-4770-b37a-42a0b6b82249 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:39.256970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94679cc4-f11e-4770-b37a-42a0b6b82249 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:39.257276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94679cc4-f11e-4770-b37a-42a0b6b82249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:39.285704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94679cc4-f11e-4770-b37a-42a0b6b82249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:39.289098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94679cc4-f11e-4770-b37a-42a0b6b82249 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:39.329274 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1906/3806] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:40.646543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed204f8b-b9c8-47d8-bf16-8212258a877b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:40.648814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ed204f8b-b9c8-47d8-bf16-8212258a877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:40.725466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed204f8b-b9c8-47d8-bf16-8212258a877b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:40.761505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d29008-7c3a-4b1f-873b-74abbe3055c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:40.762865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d29008-7c3a-4b1f-873b-74abbe3055c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:40.763598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d29008-7c3a-4b1f-873b-74abbe3055c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:40.764240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d29008-7c3a-4b1f-873b-74abbe3055c0 admin admin] PATH_INFO: `/v3/projects/94faad231f70415bb839f5f21bfa0fb1` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:40.766485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d29008-7c3a-4b1f-873b-74abbe3055c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94faad231f70415bb839f5f21bfa0fb1)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:40.788312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d29008-7c3a-4b1f-873b-74abbe3055c0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:40.894694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b2d29008-7c3a-4b1f-873b-74abbe3055c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94faad231f70415bb839f5f21bfa0fb1', 'request_id': 'req-b2d29008-7c3a-4b1f-873b-74abbe3055c0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:40.911026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b2d29008-7c3a-4b1f-873b-74abbe3055c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94faad231f70415bb839f5f21bfa0fb1', 'request_id': 'req-b2d29008-7c3a-4b1f-873b-74abbe3055c0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:40.921400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b2d29008-7c3a-4b1f-873b-74abbe3055c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94faad231f70415bb839f5f21bfa0fb1', 'request_id': 'req-b2d29008-7c3a-4b1f-873b-74abbe3055c0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:40.942876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b2d29008-7c3a-4b1f-873b-74abbe3055c0 admin admin] The token cache is being invalidate because project 94faad231f70415bb839f5f21bfa0fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:40.943629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b2d29008-7c3a-4b1f-873b-74abbe3055c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:40.944675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b2d29008-7c3a-4b1f-873b-74abbe3055c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:40.955033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c6a23-df8e-42da-b8af-81b18540c5dc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:40.955673 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1901/3807] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:40 2022] DELETE /identity/v3/projects/94faad231f70415bb839f5f21bfa0fb1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:40.955907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c6a23-df8e-42da-b8af-81b18540c5dc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:40.956403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c6a23-df8e-42da-b8af-81b18540c5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:40.984413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-402c6a23-df8e-42da-b8af-81b18540c5dc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:40.986079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-402c6a23-df8e-42da-b8af-81b18540c5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:41.153511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605c64-9b37-4563-bb2b-8417461fe4a9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:41.154512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605c64-9b37-4563-bb2b-8417461fe4a9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:41.156035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605c64-9b37-4563-bb2b-8417461fe4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:41.176010 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1907/3808] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:41.202035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-63605c64-9b37-4563-bb2b-8417461fe4a9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:41.204530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bef2d-22b3-459a-9f49-81a6c91bd141 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:41.206409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bef2d-22b3-459a-9f49-81a6c91bd141 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:41.207006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07bef2d-22b3-459a-9f49-81a6c91bd141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:41.226502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-63605c64-9b37-4563-bb2b-8417461fe4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:41.264092 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1902/3809] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:41.267117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63605c64-9b37-4563-bb2b-8417461fe4a9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:41.294289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63605c64-9b37-4563-bb2b-8417461fe4a9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:41.300181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b07bef2d-22b3-459a-9f49-81a6c91bd141 None None] MFA Rules not processed for user `600512845bb7444b82f9fe99f1e51327`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:41.302236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b07bef2d-22b3-459a-9f49-81a6c91bd141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:41.309307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ede228-5c92-4cf8-8d76-749182bc3002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:41.311409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ede228-5c92-4cf8-8d76-749182bc3002 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:41.313716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ede228-5c92-4cf8-8d76-749182bc3002 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:41.314164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ede228-5c92-4cf8-8d76-749182bc3002 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:41.315843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ede228-5c92-4cf8-8d76-749182bc3002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:04:41.316322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ede228-5c92-4cf8-8d76-749182bc3002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:41.318950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ede228-5c92-4cf8-8d76-749182bc3002 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:41.321398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:41.364348 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1903/3810] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:04:41.365599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ede228-5c92-4cf8-8d76-749182bc3002 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:41.392499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ede228-5c92-4cf8-8d76-749182bc3002 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:41.406202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a32c7-0ecb-4a3c-b40a-9782d49361eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:41.408475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a32c7-0ecb-4a3c-b40a-9782d49361eb admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:41.412084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a32c7-0ecb-4a3c-b40a-9782d49361eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:41.412480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a32c7-0ecb-4a3c-b40a-9782d49361eb admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:41.413173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a32c7-0ecb-4a3c-b40a-9782d49361eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:41.416969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a32c7-0ecb-4a3c-b40a-9782d49361eb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:41.505631 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1904/3811] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:04:41 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:41.509826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a32c7-0ecb-4a3c-b40a-9782d49361eb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:41.511811 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1908/3812] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:04:41.526833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a346fb7-c713-4912-be9f-fa8ba4c687df None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:41.527151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a346fb7-c713-4912-be9f-fa8ba4c687df None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:41.527361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a346fb7-c713-4912-be9f-fa8ba4c687df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:41.614121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5a346fb7-c713-4912-be9f-fa8ba4c687df None None] MFA Rules not processed for user `600512845bb7444b82f9fe99f1e51327`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:41.620276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5a346fb7-c713-4912-be9f-fa8ba4c687df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:41.797427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a32c7-0ecb-4a3c-b40a-9782d49361eb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:41.810359 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1909/3813] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:04:41.818393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df473ef-172e-425f-ac6a-e889137be4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:41.819999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df473ef-172e-425f-ac6a-e889137be4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:41.821474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df473ef-172e-425f-ac6a-e889137be4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:41.822258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df473ef-172e-425f-ac6a-e889137be4a2 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:41.825186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df473ef-172e-425f-ac6a-e889137be4a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:41.828604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df473ef-172e-425f-ac6a-e889137be4a2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:41.877314 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1905/3814] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:04:41 2022] POST /identity/v3/users => generated 289 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:41.881491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a346fb7-c713-4912-be9f-fa8ba4c687df None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:41.904329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a346fb7-c713-4912-be9f-fa8ba4c687df None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:41.912385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf9980-8b63-46c7-9a41-77ce0c66a2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:41.913743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9980-8b63-46c7-9a41-77ce0c66a2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:41.914187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9980-8b63-46c7-9a41-77ce0c66a2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:41.915705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9980-8b63-46c7-9a41-77ce0c66a2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:41.917741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf9980-8b63-46c7-9a41-77ce0c66a2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:41.920363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf9980-8b63-46c7-9a41-77ce0c66a2d4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:41.937758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:41.954962 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1910/3815] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:41.956200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df473ef-172e-425f-ac6a-e889137be4a2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:41.975598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df473ef-172e-425f-ac6a-e889137be4a2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:41.987128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af481b01-0439-4366-8f9f-b7fbb7549617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:41.989088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af481b01-0439-4366-8f9f-b7fbb7549617 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:41.989805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af481b01-0439-4366-8f9f-b7fbb7549617 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:41.990564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af481b01-0439-4366-8f9f-b7fbb7549617 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:41.992516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af481b01-0439-4366-8f9f-b7fbb7549617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:41.996443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af481b01-0439-4366-8f9f-b7fbb7549617 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:42.026600 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1906/3816] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:04:42.031484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf9980-8b63-46c7-9a41-77ce0c66a2d4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:42.050104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf9980-8b63-46c7-9a41-77ce0c66a2d4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:42.068240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fc6ed-fd68-46b5-9a30-ba11e7d61815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:42.071629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc6ed-fd68-46b5-9a30-ba11e7d61815 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:42.072391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc6ed-fd68-46b5-9a30-ba11e7d61815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:42.075217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc6ed-fd68-46b5-9a30-ba11e7d61815 admin admin] PATH_INFO: `/v3/projects/6b1beb38510147cea51f4ff8456d0aaf/users/fce4ac8cbf114bd69219ce54f85b5809/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:42.134817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fc6ed-fd68-46b5-9a30-ba11e7d61815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1beb38510147cea51f4ff8456d0aaf, user_id=fce4ac8cbf114bd69219ce54f85b5809, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:42.137611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fc6ed-fd68-46b5-9a30-ba11e7d61815 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:42.187688 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1911/3817] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:42 2022] PUT /identity/v3/projects/6b1beb38510147cea51f4ff8456d0aaf/users/fce4ac8cbf114bd69219ce54f85b5809/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:42.190181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85501911-8fd9-4ccf-b05b-015b54d6d1f3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:42.190471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85501911-8fd9-4ccf-b05b-015b54d6d1f3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:42.190772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85501911-8fd9-4ccf-b05b-015b54d6d1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:42.277989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-85501911-8fd9-4ccf-b05b-015b54d6d1f3 None None] MFA Rules not processed for user `fce4ac8cbf114bd69219ce54f85b5809`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:42.281914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-85501911-8fd9-4ccf-b05b-015b54d6d1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:42.416146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02475e40-6061-4104-a3a8-0b73ca6b10ad None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:42.416510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02475e40-6061-4104-a3a8-0b73ca6b10ad None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:42.416796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02475e40-6061-4104-a3a8-0b73ca6b10ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:42.502000 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1907/3818] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:42.507900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-02475e40-6061-4104-a3a8-0b73ca6b10ad None None] MFA Rules not processed for user `ab997147a6aa4430ab0410e7eb876d62`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:42.510028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-02475e40-6061-4104-a3a8-0b73ca6b10ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:42.597269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85501911-8fd9-4ccf-b05b-015b54d6d1f3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:42.598923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-85501911-8fd9-4ccf-b05b-015b54d6d1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:42.802155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:42.802995 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1912/3819] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:04:42.822398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af765708-6523-4bce-aed6-15a2c76031d3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:42.823024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af765708-6523-4bce-aed6-15a2c76031d3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:42.823351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af765708-6523-4bce-aed6-15a2c76031d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:42.879602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85501911-8fd9-4ccf-b05b-015b54d6d1f3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:42.885920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-af765708-6523-4bce-aed6-15a2c76031d3 None None] MFA Rules not processed for user `ab997147a6aa4430ab0410e7eb876d62`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:42.887725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-af765708-6523-4bce-aed6-15a2c76031d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:42.905873 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1913/3820] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:42.916512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e0b38-ab4c-4457-be47-1e1cd9fdf2b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:42.920798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e0b38-ab4c-4457-be47-1e1cd9fdf2b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:42.924615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e0b38-ab4c-4457-be47-1e1cd9fdf2b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:42.925245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e0b38-ab4c-4457-be47-1e1cd9fdf2b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:42.996485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e0b38-ab4c-4457-be47-1e1cd9fdf2b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:43.000527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e0b38-ab4c-4457-be47-1e1cd9fdf2b6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:43.035590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af765708-6523-4bce-aed6-15a2c76031d3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:43.039405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-af765708-6523-4bce-aed6-15a2c76031d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:43.056315 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1908/3821] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:04:43.239540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fc30-6c09-4bb7-bcf7-8baf5e48f89c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:43.240587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fc30-6c09-4bb7-bcf7-8baf5e48f89c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:43.241372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fc30-6c09-4bb7-bcf7-8baf5e48f89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:43.316372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-32a1fc30-6c09-4bb7-bcf7-8baf5e48f89c None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:43.324220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-32a1fc30-6c09-4bb7-bcf7-8baf5e48f89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:43.330051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af765708-6523-4bce-aed6-15a2c76031d3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:43.357297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d37f0-e305-492b-a7cf-69ad9152108a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:43.361973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d37f0-e305-492b-a7cf-69ad9152108a service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:43.363431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d37f0-e305-492b-a7cf-69ad9152108a service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:43.363714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d37f0-e305-492b-a7cf-69ad9152108a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:43.549160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:43.556691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d37f0-e305-492b-a7cf-69ad9152108a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:43.558924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d37f0-e305-492b-a7cf-69ad9152108a service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:43.589163 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1914/3822] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:43.589976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d37f0-e305-492b-a7cf-69ad9152108a service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:43.594870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2a4d37f0-e305-492b-a7cf-69ad9152108a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:43.629776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d37f0-e305-492b-a7cf-69ad9152108a service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:43.648789 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1909/3823] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:04:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:43.650159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc8851-ad98-4763-af0c-d9be1f8dfa0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:43.650943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc8851-ad98-4763-af0c-d9be1f8dfa0d service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:43.651255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc8851-ad98-4763-af0c-d9be1f8dfa0d service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:43.651529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc8851-ad98-4763-af0c-d9be1f8dfa0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:43.671097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc8851-ad98-4763-af0c-d9be1f8dfa0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:43.672726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc8851-ad98-4763-af0c-d9be1f8dfa0d service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:43.700556 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1915/3824] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:43.729309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fc30-6c09-4bb7-bcf7-8baf5e48f89c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:43.743781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-32a1fc30-6c09-4bb7-bcf7-8baf5e48f89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:44.001207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fc30-6c09-4bb7-bcf7-8baf5e48f89c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:44.012190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d68d8-a983-48f3-8e7b-134d71c60b12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:44.012828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d68d8-a983-48f3-8e7b-134d71c60b12 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:44.013107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d68d8-a983-48f3-8e7b-134d71c60b12 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:44.013376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d68d8-a983-48f3-8e7b-134d71c60b12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:44.031072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d68d8-a983-48f3-8e7b-134d71c60b12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:44.032698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d68d8-a983-48f3-8e7b-134d71c60b12 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:44.054836 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1910/3825] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:04:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:04:44.923408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc8851-ad98-4763-af0c-d9be1f8dfa0d service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:44.933312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cdbc8851-ad98-4763-af0c-d9be1f8dfa0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:44.949363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc8851-ad98-4763-af0c-d9be1f8dfa0d service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:44.953296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f23fd-e38f-4987-94d6-78ca5dc5f06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:44.954936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f23fd-e38f-4987-94d6-78ca5dc5f06a service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:44.954936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f23fd-e38f-4987-94d6-78ca5dc5f06a service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:44.954936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f23fd-e38f-4987-94d6-78ca5dc5f06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:44.956888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3d4f23fd-e38f-4987-94d6-78ca5dc5f06a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:44.990459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f23fd-e38f-4987-94d6-78ca5dc5f06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:44.991588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f23fd-e38f-4987-94d6-78ca5dc5f06a service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:45.035109 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1916/3826] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:46.598566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d68d8-a983-48f3-8e7b-134d71c60b12 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:46.600840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1c4d68d8-a983-48f3-8e7b-134d71c60b12 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:47.058090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d68d8-a983-48f3-8e7b-134d71c60b12 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:47.065303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:47.066318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:47.067011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:47.067829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] PATH_INFO: `/v3/users/ab694f38b57c4283be1582ce02008978` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:47.069664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab694f38b57c4283be1582ce02008978)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:47.072177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:47.204905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:47.286030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab694f38b57c4283be1582ce02008978'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:47.344009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab694f38b57c4283be1582ce02008978'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:47.347345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab694f38b57c4283be1582ce02008978'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:47.411763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab694f38b57c4283be1582ce02008978'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:47.415664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab694f38b57c4283be1582ce02008978'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:47.498316 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1911/3827] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:46 2022] DELETE /identity/v3/users/ab694f38b57c4283be1582ce02008978 => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:48.027758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f23fd-e38f-4987-94d6-78ca5dc5f06a service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:48.030757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3d4f23fd-e38f-4987-94d6-78ca5dc5f06a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:48.105717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f23fd-e38f-4987-94d6-78ca5dc5f06a service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:48.427315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:48.429986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:48.432870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:48.434031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] PATH_INFO: `/v3/users/d600dc31506e42849d5e83d70a61b097` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:48.438300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d600dc31506e42849d5e83d70a61b097)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:48.445230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:48.688807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd600dc31506e42849d5e83d70a61b097'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:48.732925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd600dc31506e42849d5e83d70a61b097'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:48.736727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd600dc31506e42849d5e83d70a61b097'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:48.792332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd600dc31506e42849d5e83d70a61b097'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:48.793204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd600dc31506e42849d5e83d70a61b097'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:48.859306 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1917/3828] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:48 2022] DELETE /identity/v3/users/d600dc31506e42849d5e83d70a61b097 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:48.876360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:48.882441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:48.949073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba31e9-94c5-4402-b8bc-b4948f2b59c4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:49.135306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:49.136258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:49.136549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:49.136823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] PATH_INFO: `/v3/projects/e7bcb4bc729448d0a6e6913d89f76e78` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:49.138388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7bcb4bc729448d0a6e6913d89f76e78)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:49.140853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:49.264727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7bcb4bc729448d0a6e6913d89f76e78', 'request_id': 'req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:49.286693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7bcb4bc729448d0a6e6913d89f76e78', 'request_id': 'req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:49.316270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7bcb4bc729448d0a6e6913d89f76e78', 'request_id': 'req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:49.372767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] The token cache is being invalidate because project e7bcb4bc729448d0a6e6913d89f76e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:49.373389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:49.377171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:49.387128 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1912/3829] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:48 2022] DELETE /identity/v3/projects/e7bcb4bc729448d0a6e6913d89f76e78 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:49.388450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:49.389893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:49.427536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6baa2-9685-4986-b643-c60a0a981b66 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:49.622047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:49.666918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf82b6-c80e-4e41-8505-a8d931c8f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:49.668579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf82b6-c80e-4e41-8505-a8d931c8f93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:49.669715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf82b6-c80e-4e41-8505-a8d931c8f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:49.671083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf82b6-c80e-4e41-8505-a8d931c8f93c admin admin] PATH_INFO: `/v3/users/b55fc4046f834aa0b2e34c08d5e1b096` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:49.672875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf82b6-c80e-4e41-8505-a8d931c8f93c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b55fc4046f834aa0b2e34c08d5e1b096)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:49.675710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf82b6-c80e-4e41-8505-a8d931c8f93c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:49.786712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bdbf82b6-c80e-4e41-8505-a8d931c8f93c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b55fc4046f834aa0b2e34c08d5e1b096'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:49.821147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bdbf82b6-c80e-4e41-8505-a8d931c8f93c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b55fc4046f834aa0b2e34c08d5e1b096'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:49.822116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bdbf82b6-c80e-4e41-8505-a8d931c8f93c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b55fc4046f834aa0b2e34c08d5e1b096'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:49.838157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bdbf82b6-c80e-4e41-8505-a8d931c8f93c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b55fc4046f834aa0b2e34c08d5e1b096'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:49.839742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bdbf82b6-c80e-4e41-8505-a8d931c8f93c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b55fc4046f834aa0b2e34c08d5e1b096'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:49.906315 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1918/3830] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:49 2022] DELETE /identity/v3/users/b55fc4046f834aa0b2e34c08d5e1b096 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:50.743580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:50.746987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:50.781681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e8c9d-b8ae-4d7e-9556-b0a7e93add8f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:50.896187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:50.950349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97936410-0f7b-4b43-a0ca-7de14ecc52c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:50.954579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97936410-0f7b-4b43-a0ca-7de14ecc52c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:50.955163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97936410-0f7b-4b43-a0ca-7de14ecc52c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:50.955601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97936410-0f7b-4b43-a0ca-7de14ecc52c1 admin admin] PATH_INFO: `/v3/projects/fbd4a07daa3441088652a61666026a0a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:50.957157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97936410-0f7b-4b43-a0ca-7de14ecc52c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd4a07daa3441088652a61666026a0a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:50.959667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97936410-0f7b-4b43-a0ca-7de14ecc52c1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:51.045426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-97936410-0f7b-4b43-a0ca-7de14ecc52c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd4a07daa3441088652a61666026a0a', 'request_id': 'req-97936410-0f7b-4b43-a0ca-7de14ecc52c1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:51.058834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-97936410-0f7b-4b43-a0ca-7de14ecc52c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd4a07daa3441088652a61666026a0a', 'request_id': 'req-97936410-0f7b-4b43-a0ca-7de14ecc52c1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:51.084503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-97936410-0f7b-4b43-a0ca-7de14ecc52c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd4a07daa3441088652a61666026a0a', 'request_id': 'req-97936410-0f7b-4b43-a0ca-7de14ecc52c1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:51.119762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-97936410-0f7b-4b43-a0ca-7de14ecc52c1 admin admin] The token cache is being invalidate because project fbd4a07daa3441088652a61666026a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:51.122522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-97936410-0f7b-4b43-a0ca-7de14ecc52c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:51.124481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-97936410-0f7b-4b43-a0ca-7de14ecc52c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:51.132335 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1913/3831] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:50 2022] DELETE /identity/v3/projects/fbd4a07daa3441088652a61666026a0a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:51.139634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0013de-fdda-48f7-a8b3-1bd685898bcd None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:51.140981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0013de-fdda-48f7-a8b3-1bd685898bcd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:51.142236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0013de-fdda-48f7-a8b3-1bd685898bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:51.188899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fa0013de-fdda-48f7-a8b3-1bd685898bcd None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:51.192085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fa0013de-fdda-48f7-a8b3-1bd685898bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:51.420478 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1919/3832] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:51.428408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd740-4510-4bf6-8654-b06d3de601fc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:51.431374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd740-4510-4bf6-8654-b06d3de601fc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:51.432193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd740-4510-4bf6-8654-b06d3de601fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:51.475810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-581dd740-4510-4bf6-8654-b06d3de601fc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:51.479352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-581dd740-4510-4bf6-8654-b06d3de601fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:51.513165 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1914/3833] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:51.517803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0013de-fdda-48f7-a8b3-1bd685898bcd None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:51.530354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0013de-fdda-48f7-a8b3-1bd685898bcd None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:51.545918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc0ff0-3a7e-4c08-b505-e4b0e38aab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:51.546666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc0ff0-3a7e-4c08-b505-e4b0e38aab7c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:51.547083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc0ff0-3a7e-4c08-b505-e4b0e38aab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:51.548714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc0ff0-3a7e-4c08-b505-e4b0e38aab7c admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:51.549538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc0ff0-3a7e-4c08-b505-e4b0e38aab7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:04:51.551213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc0ff0-3a7e-4c08-b505-e4b0e38aab7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:51.557423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc0ff0-3a7e-4c08-b505-e4b0e38aab7c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:51.615543 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1920/3834] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:04:51.618481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dd740-4510-4bf6-8654-b06d3de601fc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:51.632710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dd740-4510-4bf6-8654-b06d3de601fc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:51.635489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c1c3e-e393-4e03-8822-a760714bfa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:51.636133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c1c3e-e393-4e03-8822-a760714bfa0b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:51.636427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c1c3e-e393-4e03-8822-a760714bfa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:51.636673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c1c3e-e393-4e03-8822-a760714bfa0b admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:51.637328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c1c3e-e393-4e03-8822-a760714bfa0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:51.639570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c1c3e-e393-4e03-8822-a760714bfa0b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:51.687418 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1915/3835] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:04:51 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:04:51.689088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc0ff0-3a7e-4c08-b505-e4b0e38aab7c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:51.701965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc0ff0-3a7e-4c08-b505-e4b0e38aab7c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:51.818840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c1c3e-e393-4e03-8822-a760714bfa0b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:51.823547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5e8c1c3e-e393-4e03-8822-a760714bfa0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:51.929655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:51.960421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd76e0-5947-4bc3-af10-676ca7fef5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:51.962613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd76e0-5947-4bc3-af10-676ca7fef5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:51.967101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd76e0-5947-4bc3-af10-676ca7fef5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:51.969586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd76e0-5947-4bc3-af10-676ca7fef5e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:51.971970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd76e0-5947-4bc3-af10-676ca7fef5e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:51.978407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd76e0-5947-4bc3-af10-676ca7fef5e3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:52.050288 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1921/3836] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:04:51 2022] POST /identity/v3/users => generated 285 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:52.051191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c1c3e-e393-4e03-8822-a760714bfa0b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:52.053501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd76e0-5947-4bc3-af10-676ca7fef5e3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:52.070612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9f843-38c7-4b68-8c31-b83a634ff40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:52.075303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9f843-38c7-4b68-8c31-b83a634ff40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:52.077344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9f843-38c7-4b68-8c31-b83a634ff40b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:52.077830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9f843-38c7-4b68-8c31-b83a634ff40b admin admin] PATH_INFO: `/v3/projects/c7a7280abc094c989fb691fdbc1fa57e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:52.081760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9f843-38c7-4b68-8c31-b83a634ff40b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a7280abc094c989fb691fdbc1fa57e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:52.087220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9f843-38c7-4b68-8c31-b83a634ff40b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:52.088591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd76e0-5947-4bc3-af10-676ca7fef5e3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:52.106295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f5e67-b801-453d-b6d5-fab91b41dd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:52.108620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f5e67-b801-453d-b6d5-fab91b41dd00 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:52.110449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f5e67-b801-453d-b6d5-fab91b41dd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:52.110968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f5e67-b801-453d-b6d5-fab91b41dd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:52.111816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f5e67-b801-453d-b6d5-fab91b41dd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:52.135599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f5e67-b801-453d-b6d5-fab91b41dd00 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:52.167462 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1922/3837] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:52.172361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f5e67-b801-453d-b6d5-fab91b41dd00 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:52.196774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f5e67-b801-453d-b6d5-fab91b41dd00 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:52.215921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:52.220631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917612fa-0c51-4396-afbb-33e674a3de35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:52.222327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917612fa-0c51-4396-afbb-33e674a3de35 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:52.224132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917612fa-0c51-4396-afbb-33e674a3de35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:52.224443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917612fa-0c51-4396-afbb-33e674a3de35 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:52.225126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917612fa-0c51-4396-afbb-33e674a3de35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:52.229455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917612fa-0c51-4396-afbb-33e674a3de35 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:52.256230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-75a9f843-38c7-4b68-8c31-b83a634ff40b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a7280abc094c989fb691fdbc1fa57e', 'request_id': 'req-75a9f843-38c7-4b68-8c31-b83a634ff40b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:52.262805 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1923/3838] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:52.268225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917612fa-0c51-4396-afbb-33e674a3de35 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:52.278180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-75a9f843-38c7-4b68-8c31-b83a634ff40b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a7280abc094c989fb691fdbc1fa57e', 'request_id': 'req-75a9f843-38c7-4b68-8c31-b83a634ff40b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:52.291793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-75a9f843-38c7-4b68-8c31-b83a634ff40b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a7280abc094c989fb691fdbc1fa57e', 'request_id': 'req-75a9f843-38c7-4b68-8c31-b83a634ff40b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:52.299604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917612fa-0c51-4396-afbb-33e674a3de35 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:52.321679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-75a9f843-38c7-4b68-8c31-b83a634ff40b admin admin] The token cache is being invalidate because project c7a7280abc094c989fb691fdbc1fa57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:04:52.322008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-75a9f843-38c7-4b68-8c31-b83a634ff40b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:52.324334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-75a9f843-38c7-4b68-8c31-b83a634ff40b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:52.328013 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1916/3839] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:51 2022] DELETE /identity/v3/projects/c7a7280abc094c989fb691fdbc1fa57e => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:04:52.335256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff45e-5f9f-43bb-b329-a9cf60faa05a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:52.335539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff45e-5f9f-43bb-b329-a9cf60faa05a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:52.335823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ff45e-5f9f-43bb-b329-a9cf60faa05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:52.400081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-915ff45e-5f9f-43bb-b329-a9cf60faa05a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:52.401986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-915ff45e-5f9f-43bb-b329-a9cf60faa05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:52.485423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ee2ad-1c0f-4f22-9c87-17cb2e74b014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:52.487120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ee2ad-1c0f-4f22-9c87-17cb2e74b014 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:52.494322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ee2ad-1c0f-4f22-9c87-17cb2e74b014 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:52.496039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ee2ad-1c0f-4f22-9c87-17cb2e74b014 admin admin] PATH_INFO: `/v3/projects/3af547c7281649ed97925a94808bebfc/users/b522965c08064a3bb9ac0f3afd8e5eff/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:52.499044 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1917/3840] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:04:52.509850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b7a54-73d8-4a24-8371-0d6641233a0f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:52.510303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b7a54-73d8-4a24-8371-0d6641233a0f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:52.515802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b7a54-73d8-4a24-8371-0d6641233a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:52.544944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-795b7a54-73d8-4a24-8371-0d6641233a0f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:52.546498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-795b7a54-73d8-4a24-8371-0d6641233a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:52.554179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ee2ad-1c0f-4f22-9c87-17cb2e74b014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af547c7281649ed97925a94808bebfc, user_id=b522965c08064a3bb9ac0f3afd8e5eff, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:52.557801 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1918/3841] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:52.563294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ee2ad-1c0f-4f22-9c87-17cb2e74b014 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:52.564854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b7a54-73d8-4a24-8371-0d6641233a0f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:52.595544 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1924/3842] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:52 2022] PUT /identity/v3/projects/3af547c7281649ed97925a94808bebfc/users/b522965c08064a3bb9ac0f3afd8e5eff/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:04:52.619909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb49c8-a4ed-41ae-8edd-de6cbea098cc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:52.620838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb49c8-a4ed-41ae-8edd-de6cbea098cc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:52.621460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb49c8-a4ed-41ae-8edd-de6cbea098cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:52.622367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b7a54-73d8-4a24-8371-0d6641233a0f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:52.690755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-04bb49c8-a4ed-41ae-8edd-de6cbea098cc None None] MFA Rules not processed for user `b522965c08064a3bb9ac0f3afd8e5eff`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:52.693062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-04bb49c8-a4ed-41ae-8edd-de6cbea098cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:52.922017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eced3ab-12b2-4116-b51d-b984b69040af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:52.923102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eced3ab-12b2-4116-b51d-b984b69040af admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:52.923607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eced3ab-12b2-4116-b51d-b984b69040af admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:52.924072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eced3ab-12b2-4116-b51d-b984b69040af admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:52.925220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eced3ab-12b2-4116-b51d-b984b69040af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:04:52.925740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eced3ab-12b2-4116-b51d-b984b69040af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:52.933123 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1925/3843] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:52.952032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eced3ab-12b2-4116-b51d-b984b69040af admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:52.959800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5971d-440a-419d-92df-5e58915cd6ae None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:52.960471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5971d-440a-419d-92df-5e58915cd6ae None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:52.960916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5971d-440a-419d-92df-5e58915cd6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:52.990074 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1919/3844] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:04:52.996768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eced3ab-12b2-4116-b51d-b984b69040af admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:53.005958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-25b5971d-440a-419d-92df-5e58915cd6ae None None] MFA Rules not processed for user `b522965c08064a3bb9ac0f3afd8e5eff`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:53.009807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-25b5971d-440a-419d-92df-5e58915cd6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:53.025873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eced3ab-12b2-4116-b51d-b984b69040af admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:53.041880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03da9-c1cd-4765-803d-2c323e8ad1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:53.042956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03da9-c1cd-4765-803d-2c323e8ad1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:53.043147 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1926/3845] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:04:53.044071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03da9-c1cd-4765-803d-2c323e8ad1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:53.044582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03da9-c1cd-4765-803d-2c323e8ad1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:53.047641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b03da9-c1cd-4765-803d-2c323e8ad1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:53.061036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b03da9-c1cd-4765-803d-2c323e8ad1c2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:53.133134 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1920/3846] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:04:52 2022] POST /identity/v3/projects => generated 409 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:53.139674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5971d-440a-419d-92df-5e58915cd6ae None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:53.205474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5971d-440a-419d-92df-5e58915cd6ae None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:53.311237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:53.426987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3801e62-9e5d-4edf-93be-241de97d0377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:53.427996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3801e62-9e5d-4edf-93be-241de97d0377 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:53.428347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3801e62-9e5d-4edf-93be-241de97d0377 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:53.430716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3801e62-9e5d-4edf-93be-241de97d0377 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:53.433119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3801e62-9e5d-4edf-93be-241de97d0377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:53.435241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3801e62-9e5d-4edf-93be-241de97d0377 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:53.501300 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1927/3847] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:04:53 2022] POST /identity/v3/users => generated 305 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:53.502575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03da9-c1cd-4765-803d-2c323e8ad1c2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:53.546688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03da9-c1cd-4765-803d-2c323e8ad1c2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:53.597926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492b3ee-1c1d-4b4d-958e-462e2d21cb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:53.598704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492b3ee-1c1d-4b4d-958e-462e2d21cb86 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:53.599022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492b3ee-1c1d-4b4d-958e-462e2d21cb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:53.604380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492b3ee-1c1d-4b4d-958e-462e2d21cb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:53.604380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492b3ee-1c1d-4b4d-958e-462e2d21cb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:53.605566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492b3ee-1c1d-4b4d-958e-462e2d21cb86 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:53.651255 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1921/3848] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:53.656197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3801e62-9e5d-4edf-93be-241de97d0377 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:53.674822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3801e62-9e5d-4edf-93be-241de97d0377 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:53.691085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f837691-a254-475b-8de2-18f15e606486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:53.691780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f837691-a254-475b-8de2-18f15e606486 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:53.692071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f837691-a254-475b-8de2-18f15e606486 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:53.692349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f837691-a254-475b-8de2-18f15e606486 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:53.694715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f837691-a254-475b-8de2-18f15e606486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:53.702254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f837691-a254-475b-8de2-18f15e606486 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:53.748817 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1928/3849] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:53.752341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492b3ee-1c1d-4b4d-958e-462e2d21cb86 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:53.769608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492b3ee-1c1d-4b4d-958e-462e2d21cb86 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:53.783083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b729e52-8de2-4e17-9db5-e4672e0d0b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:53.785210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b729e52-8de2-4e17-9db5-e4672e0d0b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:53.785487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b729e52-8de2-4e17-9db5-e4672e0d0b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:53.785774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b729e52-8de2-4e17-9db5-e4672e0d0b98 admin admin] PATH_INFO: `/v3/projects/14d520e8b8c943feb800923d157ca511/users/a4fe1c48dacd4f03ad0129c0ff0e919f/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:53.826494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:53.842497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b729e52-8de2-4e17-9db5-e4672e0d0b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d520e8b8c943feb800923d157ca511, user_id=a4fe1c48dacd4f03ad0129c0ff0e919f, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:53.865149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b729e52-8de2-4e17-9db5-e4672e0d0b98 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:53.944033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f837691-a254-475b-8de2-18f15e606486 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:53.947092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7f837691-a254-475b-8de2-18f15e606486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:53.969106 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1922/3850] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:53 2022] PUT /identity/v3/projects/14d520e8b8c943feb800923d157ca511/users/a4fe1c48dacd4f03ad0129c0ff0e919f/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:54.071454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fd489-5893-41d7-b017-d6c8f9fff174 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:54.071898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fd489-5893-41d7-b017-d6c8f9fff174 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:54.072300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fd489-5893-41d7-b017-d6c8f9fff174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:54.097575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f837691-a254-475b-8de2-18f15e606486 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:54.123873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-015fd489-5893-41d7-b017-d6c8f9fff174 None None] MFA Rules not processed for user `a4fe1c48dacd4f03ad0129c0ff0e919f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:54.126560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-015fd489-5893-41d7-b017-d6c8f9fff174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:54.210720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca4506-671f-47d1-8dc7-8230aa5b5cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:54.212783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca4506-671f-47d1-8dc7-8230aa5b5cf5 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:54.212783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca4506-671f-47d1-8dc7-8230aa5b5cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:54.214387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca4506-671f-47d1-8dc7-8230aa5b5cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:54.274498 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1923/3851] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:54 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:04:54.275932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fd489-5893-41d7-b017-d6c8f9fff174 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:54.402546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:54.472034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca4506-671f-47d1-8dc7-8230aa5b5cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:54.479954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca4506-671f-47d1-8dc7-8230aa5b5cf5 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:54.544880 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1929/3852] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:54.579333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fd489-5893-41d7-b017-d6c8f9fff174 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:54.591511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6167c2-2d64-480f-a8a8-ef97e44f73df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:54.592469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6167c2-2d64-480f-a8a8-ef97e44f73df admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:54.592924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6167c2-2d64-480f-a8a8-ef97e44f73df admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:54.593362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6167c2-2d64-480f-a8a8-ef97e44f73df admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:54.594232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6167c2-2d64-480f-a8a8-ef97e44f73df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:54.597295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6167c2-2d64-480f-a8a8-ef97e44f73df admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:54.681116 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1924/3853] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:04:54 2022] POST /identity/v3/projects => generated 407 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:04:54.687521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca4506-671f-47d1-8dc7-8230aa5b5cf5 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:54.713515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca4506-671f-47d1-8dc7-8230aa5b5cf5 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:54.957687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214f4e1-76d8-4180-aac5-1d74e78cb383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:54.960920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214f4e1-76d8-4180-aac5-1d74e78cb383 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:54.962217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214f4e1-76d8-4180-aac5-1d74e78cb383 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:54.962569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214f4e1-76d8-4180-aac5-1d74e78cb383 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:54.978502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214f4e1-76d8-4180-aac5-1d74e78cb383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:54.980673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214f4e1-76d8-4180-aac5-1d74e78cb383 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:55.060501 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1930/3854] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:04:54 2022] POST /identity/v3/users => generated 310 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:04:55.066388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6167c2-2d64-480f-a8a8-ef97e44f73df admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:55.150129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6167c2-2d64-480f-a8a8-ef97e44f73df admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:55.184756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74693f-25b7-41d6-968c-46df1004da85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:55.189795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74693f-25b7-41d6-968c-46df1004da85 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:55.192001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74693f-25b7-41d6-968c-46df1004da85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:55.193940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74693f-25b7-41d6-968c-46df1004da85 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:55.195302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74693f-25b7-41d6-968c-46df1004da85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:55.198541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74693f-25b7-41d6-968c-46df1004da85 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:55.217362 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1925/3855] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:55.222713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214f4e1-76d8-4180-aac5-1d74e78cb383 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:55.245598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214f4e1-76d8-4180-aac5-1d74e78cb383 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:55.272074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224954f-f7e0-4bee-9af8-d7daf5f17c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:55.278419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224954f-f7e0-4bee-9af8-d7daf5f17c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:55.279274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224954f-f7e0-4bee-9af8-d7daf5f17c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:55.280875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224954f-f7e0-4bee-9af8-d7daf5f17c15 admin admin] PATH_INFO: `/v3/projects/12798be8dadf49de9e5df405ca5bfa9b/users/e2c5f11e1f524082993fef75b6c0c1a5/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:55.349795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224954f-f7e0-4bee-9af8-d7daf5f17c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12798be8dadf49de9e5df405ca5bfa9b, user_id=e2c5f11e1f524082993fef75b6c0c1a5, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:55.369779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224954f-f7e0-4bee-9af8-d7daf5f17c15 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:55.430943 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1931/3856] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:55 2022] PUT /identity/v3/projects/12798be8dadf49de9e5df405ca5bfa9b/users/e2c5f11e1f524082993fef75b6c0c1a5/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:55.434671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74693f-25b7-41d6-968c-46df1004da85 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:55.467915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74693f-25b7-41d6-968c-46df1004da85 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:55.669630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:55.697643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c51b45-2e83-42f4-937d-3a4361eb8ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:55.698422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c51b45-2e83-42f4-937d-3a4361eb8ede admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:55.698697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c51b45-2e83-42f4-937d-3a4361eb8ede admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:55.699112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c51b45-2e83-42f4-937d-3a4361eb8ede admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:55.699781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c51b45-2e83-42f4-937d-3a4361eb8ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:55.702297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c51b45-2e83-42f4-937d-3a4361eb8ede admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:55.741991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224954f-f7e0-4bee-9af8-d7daf5f17c15 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:55.746356 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1926/3857] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:04:55.757983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224954f-f7e0-4bee-9af8-d7daf5f17c15 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:55.790915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fdac0-d76b-4ff2-8269-ddffca0ed0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:55.793859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fdac0-d76b-4ff2-8269-ddffca0ed0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:55.796361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fdac0-d76b-4ff2-8269-ddffca0ed0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:55.799173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fdac0-d76b-4ff2-8269-ddffca0ed0ef admin admin] PATH_INFO: `/v3/projects/12798be8dadf49de9e5df405ca5bfa9b/users/e2c5f11e1f524082993fef75b6c0c1a5/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:55.812330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fdac0-d76b-4ff2-8269-ddffca0ed0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=12798be8dadf49de9e5df405ca5bfa9b, user_id=e2c5f11e1f524082993fef75b6c0c1a5, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:55.827235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fdac0-d76b-4ff2-8269-ddffca0ed0ef admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:55.846125 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1932/3858] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:04:55 2022] PUT /identity/v3/projects/12798be8dadf49de9e5df405ca5bfa9b/users/e2c5f11e1f524082993fef75b6c0c1a5/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:55.857796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d40e9f-ea02-46a2-be7c-b3edd05b35ea None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:55.858181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d40e9f-ea02-46a2-be7c-b3edd05b35ea None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:55.858602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d40e9f-ea02-46a2-be7c-b3edd05b35ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:56.045163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-83d40e9f-ea02-46a2-be7c-b3edd05b35ea None None] MFA Rules not processed for user `e2c5f11e1f524082993fef75b6c0c1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:56.047208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-83d40e9f-ea02-46a2-be7c-b3edd05b35ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:56.458407 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1927/3859] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:55 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 602 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:56.470929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fdac0-d76b-4ff2-8269-ddffca0ed0ef admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:56.642115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fdac0-d76b-4ff2-8269-ddffca0ed0ef admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:56.659082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:56.660247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:56.660639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:56.661074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] PATH_INFO: `/v3/users/a4fe1c48dacd4f03ad0129c0ff0e919f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:56.666907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4fe1c48dacd4f03ad0129c0ff0e919f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:56.675243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:56.838648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:04:56.890485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4fe1c48dacd4f03ad0129c0ff0e919f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:56.937844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4fe1c48dacd4f03ad0129c0ff0e919f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:56.940019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4fe1c48dacd4f03ad0129c0ff0e919f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:56.991520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4fe1c48dacd4f03ad0129c0ff0e919f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:56.992244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4fe1c48dacd4f03ad0129c0ff0e919f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:04:57.071120 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1933/3860] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:04:56 2022] DELETE /identity/v3/users/a4fe1c48dacd4f03ad0129c0ff0e919f => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:04:57.077593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213d222-5b8f-4255-9d56-395b5e234c38 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:57.078020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213d222-5b8f-4255-9d56-395b5e234c38 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:57.078471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213d222-5b8f-4255-9d56-395b5e234c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:57.205221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c213d222-5b8f-4255-9d56-395b5e234c38 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:04:57.209976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c213d222-5b8f-4255-9d56-395b5e234c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:57.524870 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1928/3861] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:04:57.585783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:57.588516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:57.739098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d864db1-b3e4-489a-b6b1-d9c8736922a8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:57.749558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d3f0d-377f-4bc2-8a11-de8bcc8baded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:57.750265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d3f0d-377f-4bc2-8a11-de8bcc8baded service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:57.753546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d3f0d-377f-4bc2-8a11-de8bcc8baded service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:57.753949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d3f0d-377f-4bc2-8a11-de8bcc8baded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:57.788638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d3f0d-377f-4bc2-8a11-de8bcc8baded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:57.809307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d3f0d-377f-4bc2-8a11-de8bcc8baded service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:04:57.833847 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1934/3862] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:04:59.808136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213d222-5b8f-4255-9d56-395b5e234c38 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:04:59.811189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c213d222-5b8f-4255-9d56-395b5e234c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:04:59.835907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213d222-5b8f-4255-9d56-395b5e234c38 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:04:59.853091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:04:59.854059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:04:59.854803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:04:59.857095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] PATH_INFO: `/v3/projects/14d520e8b8c943feb800923d157ca511` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:04:59.862065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d520e8b8c943feb800923d157ca511)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:04:59.865469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:00.015347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d520e8b8c943feb800923d157ca511', 'request_id': 'req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:00.051499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d520e8b8c943feb800923d157ca511', 'request_id': 'req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:00.061829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d520e8b8c943feb800923d157ca511', 'request_id': 'req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:00.098280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:00.112532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] The token cache is being invalidate because project 14d520e8b8c943feb800923d157ca511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:05:00.114752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:00.118591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:00.125040 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1929/3863] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:04:59 2022] DELETE /identity/v3/projects/14d520e8b8c943feb800923d157ca511 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:00.129207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d3f0d-377f-4bc2-8a11-de8bcc8baded service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:00.155910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d3f0d-377f-4bc2-8a11-de8bcc8baded service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:00.368586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a221a-42f0-4b10-98d5-47b7de344b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:00.369877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a221a-42f0-4b10-98d5-47b7de344b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:00.370377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a221a-42f0-4b10-98d5-47b7de344b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:00.370885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a221a-42f0-4b10-98d5-47b7de344b18 admin admin] PATH_INFO: `/v3/users/e2c5f11e1f524082993fef75b6c0c1a5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:00.372577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a221a-42f0-4b10-98d5-47b7de344b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c5f11e1f524082993fef75b6c0c1a5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:00.374895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a221a-42f0-4b10-98d5-47b7de344b18 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:00.517334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f82a221a-42f0-4b10-98d5-47b7de344b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c5f11e1f524082993fef75b6c0c1a5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:00.536998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f82a221a-42f0-4b10-98d5-47b7de344b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c5f11e1f524082993fef75b6c0c1a5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:00.538543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f82a221a-42f0-4b10-98d5-47b7de344b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c5f11e1f524082993fef75b6c0c1a5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:00.549280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:00.584841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f82a221a-42f0-4b10-98d5-47b7de344b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c5f11e1f524082993fef75b6c0c1a5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:00.585711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f82a221a-42f0-4b10-98d5-47b7de344b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c5f11e1f524082993fef75b6c0c1a5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:00.643165 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1935/3864] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:05:00 2022] DELETE /identity/v3/users/e2c5f11e1f524082993fef75b6c0c1a5 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:02.305874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:02.309542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:02.375568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e32cf7-3fb5-40ec-8b96-070c07eee4a2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:02.701283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865890e7-10f8-4399-bea9-2738285029dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:02.705227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865890e7-10f8-4399-bea9-2738285029dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:02.706776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865890e7-10f8-4399-bea9-2738285029dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:02.708610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865890e7-10f8-4399-bea9-2738285029dc admin admin] PATH_INFO: `/v3/projects/12798be8dadf49de9e5df405ca5bfa9b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:02.720241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865890e7-10f8-4399-bea9-2738285029dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=12798be8dadf49de9e5df405ca5bfa9b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:02.736710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865890e7-10f8-4399-bea9-2738285029dc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:02.998011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-865890e7-10f8-4399-bea9-2738285029dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12798be8dadf49de9e5df405ca5bfa9b', 'request_id': 'req-865890e7-10f8-4399-bea9-2738285029dc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:03.043141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-865890e7-10f8-4399-bea9-2738285029dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12798be8dadf49de9e5df405ca5bfa9b', 'request_id': 'req-865890e7-10f8-4399-bea9-2738285029dc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:03.065613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-865890e7-10f8-4399-bea9-2738285029dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12798be8dadf49de9e5df405ca5bfa9b', 'request_id': 'req-865890e7-10f8-4399-bea9-2738285029dc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:03.148248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-865890e7-10f8-4399-bea9-2738285029dc admin admin] The token cache is being invalidate because project 12798be8dadf49de9e5df405ca5bfa9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:05:03.152381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-865890e7-10f8-4399-bea9-2738285029dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:03.157841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-865890e7-10f8-4399-bea9-2738285029dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:03.161348 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1930/3865] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:05:02 2022] DELETE /identity/v3/projects/12798be8dadf49de9e5df405ca5bfa9b => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:03.171750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2d77-249e-47db-8b97-09b64bfa164e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:03.172363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2d77-249e-47db-8b97-09b64bfa164e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:03.172710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab2d77-249e-47db-8b97-09b64bfa164e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:03.324456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4eab2d77-249e-47db-8b97-09b64bfa164e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:03.330057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4eab2d77-249e-47db-8b97-09b64bfa164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:03.572454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02849d-c5d3-4ec2-8aff-15c6f2cc60d9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:03.574098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02849d-c5d3-4ec2-8aff-15c6f2cc60d9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:03.576031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02849d-c5d3-4ec2-8aff-15c6f2cc60d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:03.579424 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1936/3866] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:03.658989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fa02849d-c5d3-4ec2-8aff-15c6f2cc60d9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:03.658989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fa02849d-c5d3-4ec2-8aff-15c6f2cc60d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:03.667882 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1931/3867] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:03.699247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab2d77-249e-47db-8b97-09b64bfa164e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:03.699247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab2d77-249e-47db-8b97-09b64bfa164e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:03.702784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9289e-72b5-4000-9358-0d0e3d9068ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:03.704720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9289e-72b5-4000-9358-0d0e3d9068ba admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:03.705400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9289e-72b5-4000-9358-0d0e3d9068ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:03.706029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9289e-72b5-4000-9358-0d0e3d9068ba admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:03.707203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9289e-72b5-4000-9358-0d0e3d9068ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:05:03.707803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9289e-72b5-4000-9358-0d0e3d9068ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:03.709877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9289e-72b5-4000-9358-0d0e3d9068ba admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:03.732001 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1937/3868] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:05:03.734240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02849d-c5d3-4ec2-8aff-15c6f2cc60d9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:03.752997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02849d-c5d3-4ec2-8aff-15c6f2cc60d9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:03.762299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3543cba-8cf5-4acf-bf07-c5583fb11531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:03.763425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543cba-8cf5-4acf-bf07-c5583fb11531 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:03.763924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543cba-8cf5-4acf-bf07-c5583fb11531 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:03.764421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543cba-8cf5-4acf-bf07-c5583fb11531 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:03.765550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3543cba-8cf5-4acf-bf07-c5583fb11531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:03.769592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3543cba-8cf5-4acf-bf07-c5583fb11531 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:03.866616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9289e-72b5-4000-9358-0d0e3d9068ba admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:03.884141 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1932/3869] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:05:03 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:05:03.884514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9289e-72b5-4000-9358-0d0e3d9068ba admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:03.976718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88160bc6-738b-4618-91f8-860e8153e049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:03.978159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88160bc6-738b-4618-91f8-860e8153e049 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:03.979142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88160bc6-738b-4618-91f8-860e8153e049 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:03.979311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88160bc6-738b-4618-91f8-860e8153e049 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:03.981144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88160bc6-738b-4618-91f8-860e8153e049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:03.989586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88160bc6-738b-4618-91f8-860e8153e049 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:04.059945 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1938/3870] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:05:03 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:05:04.062316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3543cba-8cf5-4acf-bf07-c5583fb11531 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:04.115505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3543cba-8cf5-4acf-bf07-c5583fb11531 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:04.126972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfb44a-78df-4fd0-bcc7-ec5278ef8b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:04.127619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfb44a-78df-4fd0-bcc7-ec5278ef8b0d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:04.127904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfb44a-78df-4fd0-bcc7-ec5278ef8b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:04.128179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfb44a-78df-4fd0-bcc7-ec5278ef8b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:04.131618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfb44a-78df-4fd0-bcc7-ec5278ef8b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:04.138927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfb44a-78df-4fd0-bcc7-ec5278ef8b0d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:04.166892 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1933/3871] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:05:04.171252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88160bc6-738b-4618-91f8-860e8153e049 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:04.188689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88160bc6-738b-4618-91f8-860e8153e049 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:04.202198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81521ee5-ab41-4a33-ad37-fe5855cf6534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:04.202998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81521ee5-ab41-4a33-ad37-fe5855cf6534 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:04.203341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81521ee5-ab41-4a33-ad37-fe5855cf6534 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:04.203621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81521ee5-ab41-4a33-ad37-fe5855cf6534 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:04.204322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81521ee5-ab41-4a33-ad37-fe5855cf6534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:04.207246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81521ee5-ab41-4a33-ad37-fe5855cf6534 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:04.245129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfb44a-78df-4fd0-bcc7-ec5278ef8b0d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:04.246140 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1939/3872] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:05:04.267052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfb44a-78df-4fd0-bcc7-ec5278ef8b0d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:04.276095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe49e7-2362-40ee-9e94-219906044197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:04.277104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe49e7-2362-40ee-9e94-219906044197 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:04.277529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe49e7-2362-40ee-9e94-219906044197 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:04.278008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe49e7-2362-40ee-9e94-219906044197 admin admin] PATH_INFO: `/v3/projects/f129e49f2b7b48979951f7f736f8acca/users/550d16e73d594f708b4639e2cd54a3db/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:04.348882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe49e7-2362-40ee-9e94-219906044197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f129e49f2b7b48979951f7f736f8acca, user_id=550d16e73d594f708b4639e2cd54a3db, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:04.355241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe49e7-2362-40ee-9e94-219906044197 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:04.402372 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1934/3873] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:05:04 2022] PUT /identity/v3/projects/f129e49f2b7b48979951f7f736f8acca/users/550d16e73d594f708b4639e2cd54a3db/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:04.418020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a771-d7a1-44c3-89a3-412dad438b2d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:04.418211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a771-d7a1-44c3-89a3-412dad438b2d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:04.419056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19a771-d7a1-44c3-89a3-412dad438b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:04.503111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7c19a771-d7a1-44c3-89a3-412dad438b2d None None] MFA Rules not processed for user `550d16e73d594f708b4639e2cd54a3db`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:04.506273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7c19a771-d7a1-44c3-89a3-412dad438b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:04.690409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:04.874209 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1940/3874] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:04.880202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe49e7-2362-40ee-9e94-219906044197 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:04.943550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:05.069357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe49e7-2362-40ee-9e94-219906044197 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:05.095191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98163e7-8ae1-4ee9-a856-26253b26f687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:05.098843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98163e7-8ae1-4ee9-a856-26253b26f687 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:05.099376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98163e7-8ae1-4ee9-a856-26253b26f687 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:05.101216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98163e7-8ae1-4ee9-a856-26253b26f687 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:05.103843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98163e7-8ae1-4ee9-a856-26253b26f687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:05.117280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98163e7-8ae1-4ee9-a856-26253b26f687 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:05.256010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19a771-d7a1-44c3-89a3-412dad438b2d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:05.257608 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1935/3875] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:05:04 2022] POST /identity/v3/projects => generated 375 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:05:05.312572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19a771-d7a1-44c3-89a3-412dad438b2d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:05.649321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315f865-f054-4c82-9f8e-831ad7e4294b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:05.651655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315f865-f054-4c82-9f8e-831ad7e4294b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:05.651971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315f865-f054-4c82-9f8e-831ad7e4294b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:05.652885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315f865-f054-4c82-9f8e-831ad7e4294b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:05.653865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315f865-f054-4c82-9f8e-831ad7e4294b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:05.659998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315f865-f054-4c82-9f8e-831ad7e4294b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:05.714801 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1941/3876] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:05:05 2022] POST /identity/v3/users => generated 294 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:05:05.722525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98163e7-8ae1-4ee9-a856-26253b26f687 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:05.762458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98163e7-8ae1-4ee9-a856-26253b26f687 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:05.783754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c81841-5b48-4212-a7f8-fdb89bf3fc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:05.784858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c81841-5b48-4212-a7f8-fdb89bf3fc7d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:05.785378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c81841-5b48-4212-a7f8-fdb89bf3fc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:05.788255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c81841-5b48-4212-a7f8-fdb89bf3fc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:05.792722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c81841-5b48-4212-a7f8-fdb89bf3fc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:05.803952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c81841-5b48-4212-a7f8-fdb89bf3fc7d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:05.864798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315f865-f054-4c82-9f8e-831ad7e4294b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:05.866490 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1936/3877] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:05:05.908536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315f865-f054-4c82-9f8e-831ad7e4294b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:05.921311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b5a72-5e31-41f8-b1c6-099546552bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:05.922587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b5a72-5e31-41f8-b1c6-099546552bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:05.923205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b5a72-5e31-41f8-b1c6-099546552bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:05.923695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b5a72-5e31-41f8-b1c6-099546552bf6 admin admin] PATH_INFO: `/v3/projects/b4b62c2da443498f9a4fe4de0244130c/users/6f4301aca77d407094a3d1af8e9ea45f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:05.963886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b5a72-5e31-41f8-b1c6-099546552bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b62c2da443498f9a4fe4de0244130c, user_id=6f4301aca77d407094a3d1af8e9ea45f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:05.970126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b5a72-5e31-41f8-b1c6-099546552bf6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:06.005295 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1942/3878] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:05:05 2022] PUT /identity/v3/projects/b4b62c2da443498f9a4fe4de0244130c/users/6f4301aca77d407094a3d1af8e9ea45f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:05:06.013726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c81841-5b48-4212-a7f8-fdb89bf3fc7d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:06.058545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c81841-5b48-4212-a7f8-fdb89bf3fc7d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:06.325622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2adc0e-f6ac-445c-89bb-af930bf45ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:06.326267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2adc0e-f6ac-445c-89bb-af930bf45ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:06.326565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2adc0e-f6ac-445c-89bb-af930bf45ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:06.326871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2adc0e-f6ac-445c-89bb-af930bf45ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:06.327524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2adc0e-f6ac-445c-89bb-af930bf45ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:06.329150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2adc0e-f6ac-445c-89bb-af930bf45ba7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:06.353788 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1937/3879] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:05:06.360612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b5a72-5e31-41f8-b1c6-099546552bf6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:06.381121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b5a72-5e31-41f8-b1c6-099546552bf6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:06.399232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbeb2e2-2dc4-4840-8ae3-cc8aede73e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:06.400590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbeb2e2-2dc4-4840-8ae3-cc8aede73e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:06.401099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbeb2e2-2dc4-4840-8ae3-cc8aede73e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:06.402165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbeb2e2-2dc4-4840-8ae3-cc8aede73e59 admin admin] PATH_INFO: `/v3/projects/b4b62c2da443498f9a4fe4de0244130c/users/6f4301aca77d407094a3d1af8e9ea45f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:06.410369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbeb2e2-2dc4-4840-8ae3-cc8aede73e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b62c2da443498f9a4fe4de0244130c, user_id=6f4301aca77d407094a3d1af8e9ea45f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:06.414063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbeb2e2-2dc4-4840-8ae3-cc8aede73e59 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:06.444465 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1943/3880] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:05:06 2022] PUT /identity/v3/projects/b4b62c2da443498f9a4fe4de0244130c/users/6f4301aca77d407094a3d1af8e9ea45f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:06.469218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092fe81-d014-43c5-996e-f856b3178523 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:06.470305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092fe81-d014-43c5-996e-f856b3178523 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:06.471128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092fe81-d014-43c5-996e-f856b3178523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:06.571787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6092fe81-d014-43c5-996e-f856b3178523 None None] MFA Rules not processed for user `6f4301aca77d407094a3d1af8e9ea45f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:06.574395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6092fe81-d014-43c5-996e-f856b3178523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:06.823313 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1938/3881] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:06.839183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff82380-dbfc-40c6-86ac-19d8eb2bd2f8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:06.839875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff82380-dbfc-40c6-86ac-19d8eb2bd2f8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:06.840430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff82380-dbfc-40c6-86ac-19d8eb2bd2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:06.907478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4ff82380-dbfc-40c6-86ac-19d8eb2bd2f8 None None] MFA Rules not processed for user `550d16e73d594f708b4639e2cd54a3db`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:06.909594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4ff82380-dbfc-40c6-86ac-19d8eb2bd2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:07.101333 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1944/3882] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:07.322359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092fe81-d014-43c5-996e-f856b3178523 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:07.324771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6092fe81-d014-43c5-996e-f856b3178523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:07.395957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:07.510507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092fe81-d014-43c5-996e-f856b3178523 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:07.532077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9abd1-2082-4eae-80f7-cabc5be5445f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:07.533156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9abd1-2082-4eae-80f7-cabc5be5445f service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:07.533542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9abd1-2082-4eae-80f7-cabc5be5445f service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:07.534045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9abd1-2082-4eae-80f7-cabc5be5445f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:07.553399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9abd1-2082-4eae-80f7-cabc5be5445f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:07.569058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9abd1-2082-4eae-80f7-cabc5be5445f service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:07.597023 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1939/3883] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:05:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:05:09.354590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669f5c1-1f11-484d-aabd-efa4fbb30329 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:09.356187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669f5c1-1f11-484d-aabd-efa4fbb30329 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:09.356659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669f5c1-1f11-484d-aabd-efa4fbb30329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:09.538202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9669f5c1-1f11-484d-aabd-efa4fbb30329 None None] MFA Rules not processed for user `550d16e73d594f708b4639e2cd54a3db`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:09.542981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9669f5c1-1f11-484d-aabd-efa4fbb30329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:09.571241 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1945/3884] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:13.760516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17be9e0-36ce-4f05-b175-df618406b1fc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:13.761636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17be9e0-36ce-4f05-b175-df618406b1fc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:13.762217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17be9e0-36ce-4f05-b175-df618406b1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:13.814475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d17be9e0-36ce-4f05-b175-df618406b1fc None None] MFA Rules not processed for user `ab997147a6aa4430ab0410e7eb876d62`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:13.816540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d17be9e0-36ce-4f05-b175-df618406b1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:13.911532 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1940/3885] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:14.283132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ba203-e31f-4e94-98a5-53c7e91fdad6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:14.284004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ba203-e31f-4e94-98a5-53c7e91fdad6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:14.284004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ba203-e31f-4e94-98a5-53c7e91fdad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:14.322246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f06ba203-e31f-4e94-98a5-53c7e91fdad6 None None] MFA Rules not processed for user `ab997147a6aa4430ab0410e7eb876d62`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:14.323925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f06ba203-e31f-4e94-98a5-53c7e91fdad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:14.350374 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1946/3886] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:14.876318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b528f2-015a-4f32-b416-ca23a3c80a64 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:14.877244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b528f2-015a-4f32-b416-ca23a3c80a64 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:14.877523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b528f2-015a-4f32-b416-ca23a3c80a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:14.919149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-70b528f2-015a-4f32-b416-ca23a3c80a64 None None] MFA Rules not processed for user `ab997147a6aa4430ab0410e7eb876d62`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:14.920384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-70b528f2-015a-4f32-b416-ca23a3c80a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:14.948485 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1941/3887] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:15.594878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f3b99-6890-445e-89d3-d2eb6ce62aa5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:15.595744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f3b99-6890-445e-89d3-d2eb6ce62aa5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:15.596254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f3b99-6890-445e-89d3-d2eb6ce62aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:15.623127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-730f3b99-6890-445e-89d3-d2eb6ce62aa5 None None] MFA Rules not processed for user `ab997147a6aa4430ab0410e7eb876d62`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:15.625575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-730f3b99-6890-445e-89d3-d2eb6ce62aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:15.643068 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1947/3888] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:16.118422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38ef6c-f467-4a4b-a3db-a82046939bdd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:16.119019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38ef6c-f467-4a4b-a3db-a82046939bdd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:16.119312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38ef6c-f467-4a4b-a3db-a82046939bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:16.155216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cf38ef6c-f467-4a4b-a3db-a82046939bdd None None] MFA Rules not processed for user `ab997147a6aa4430ab0410e7eb876d62`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:16.156505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cf38ef6c-f467-4a4b-a3db-a82046939bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:16.165171 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1942/3889] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:21.402209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd1689-921e-4801-888b-cc1a1cb65609 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:21.402778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd1689-921e-4801-888b-cc1a1cb65609 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:21.403010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd1689-921e-4801-888b-cc1a1cb65609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:21.450395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a3cd1689-921e-4801-888b-cc1a1cb65609 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:21.451693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a3cd1689-921e-4801-888b-cc1a1cb65609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:21.465251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:21.592525 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1948/3890] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:05:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:21.612915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38ef6c-f467-4a4b-a3db-a82046939bdd None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:21.615506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cf38ef6c-f467-4a4b-a3db-a82046939bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:21.760554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38ef6c-f467-4a4b-a3db-a82046939bdd None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:21.768045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db9964-80c2-4002-981f-203caa5a6f6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:21.769362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db9964-80c2-4002-981f-203caa5a6f6b service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:21.770027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db9964-80c2-4002-981f-203caa5a6f6b service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:21.770525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db9964-80c2-4002-981f-203caa5a6f6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:21.786559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db9964-80c2-4002-981f-203caa5a6f6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:21.789070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db9964-80c2-4002-981f-203caa5a6f6b service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:21.810280 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1943/3891] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:05:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:05:24.705588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be86e-9bde-4c8c-b093-f6672777d1ad None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:24.706091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be86e-9bde-4c8c-b093-f6672777d1ad None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:24.706091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2be86e-9bde-4c8c-b093-f6672777d1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:24.727269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6b2be86e-9bde-4c8c-b093-f6672777d1ad None None] MFA Rules not processed for user `8dbb8a95851248bfabd9a1afe40fc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:24.728943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6b2be86e-9bde-4c8c-b093-f6672777d1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:24.810934 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1949/3892] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:27.555954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9547-ec32-4cee-a5cf-0210c8c0958e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:27.556518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9547-ec32-4cee-a5cf-0210c8c0958e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:27.557187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd9547-ec32-4cee-a5cf-0210c8c0958e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:27.628909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bbfd9547-ec32-4cee-a5cf-0210c8c0958e None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:27.631184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bbfd9547-ec32-4cee-a5cf-0210c8c0958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:27.659292 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1944/3893] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:05:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:27.676076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2be86e-9bde-4c8c-b093-f6672777d1ad None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:27.700476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2be86e-9bde-4c8c-b093-f6672777d1ad None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:27.711322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912b596-4c3e-4abf-804a-5f7867aa3753 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:27.712796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912b596-4c3e-4abf-804a-5f7867aa3753 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:27.713711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912b596-4c3e-4abf-804a-5f7867aa3753 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:27.714342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912b596-4c3e-4abf-804a-5f7867aa3753 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:27.732950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912b596-4c3e-4abf-804a-5f7867aa3753 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:27.735708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912b596-4c3e-4abf-804a-5f7867aa3753 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:27.751417 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1950/3894] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:05:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:05:28.952855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd9547-ec32-4cee-a5cf-0210c8c0958e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:28.958006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bbfd9547-ec32-4cee-a5cf-0210c8c0958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:28.990588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:29.195908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd9547-ec32-4cee-a5cf-0210c8c0958e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:29.219129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:29.222947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:29.223551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:29.224162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] PATH_INFO: `/v3/users/fce4ac8cbf114bd69219ce54f85b5809` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:29.227994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce4ac8cbf114bd69219ce54f85b5809)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:29.233621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:29.384110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce4ac8cbf114bd69219ce54f85b5809'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:29.416952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce4ac8cbf114bd69219ce54f85b5809'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:29.419322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce4ac8cbf114bd69219ce54f85b5809'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:29.501463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce4ac8cbf114bd69219ce54f85b5809'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:29.504567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce4ac8cbf114bd69219ce54f85b5809'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:29.545705 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1945/3895] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:05:28 2022] DELETE /identity/v3/users/fce4ac8cbf114bd69219ce54f85b5809 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:29.550334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53133d7-a6dd-4a91-989d-c2f0e31abd10 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:29.551270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53133d7-a6dd-4a91-989d-c2f0e31abd10 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:29.551563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53133d7-a6dd-4a91-989d-c2f0e31abd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:29.604358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c53133d7-a6dd-4a91-989d-c2f0e31abd10 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:29.605644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c53133d7-a6dd-4a91-989d-c2f0e31abd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:29.907621 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1951/3896] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:30.218639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:30.221637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:30.358851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e11f3-3288-4c63-b9f6-bbc7705ffc27 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:30.369158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9a9b0-290f-4939-bb2d-f5cc18f9fa5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:30.370547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9a9b0-290f-4939-bb2d-f5cc18f9fa5c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:30.371067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9a9b0-290f-4939-bb2d-f5cc18f9fa5c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:30.371546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9a9b0-290f-4939-bb2d-f5cc18f9fa5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:30.383663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9a9b0-290f-4939-bb2d-f5cc18f9fa5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:30.385406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9a9b0-290f-4939-bb2d-f5cc18f9fa5c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:30.401920 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1946/3897] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:05:31.494171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53133d7-a6dd-4a91-989d-c2f0e31abd10 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:31.495684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c53133d7-a6dd-4a91-989d-c2f0e31abd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:31.520990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53133d7-a6dd-4a91-989d-c2f0e31abd10 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:31.530049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc9984-7bed-416d-82ca-990322d9f85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:31.530937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc9984-7bed-416d-82ca-990322d9f85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:31.531671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc9984-7bed-416d-82ca-990322d9f85e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:31.532134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc9984-7bed-416d-82ca-990322d9f85e admin admin] PATH_INFO: `/v3/projects/6b1beb38510147cea51f4ff8456d0aaf` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:31.533528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc9984-7bed-416d-82ca-990322d9f85e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1beb38510147cea51f4ff8456d0aaf)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:31.536081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc9984-7bed-416d-82ca-990322d9f85e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:31.635234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:31.655434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-02cc9984-7bed-416d-82ca-990322d9f85e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1beb38510147cea51f4ff8456d0aaf', 'request_id': 'req-02cc9984-7bed-416d-82ca-990322d9f85e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:31.669408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-02cc9984-7bed-416d-82ca-990322d9f85e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1beb38510147cea51f4ff8456d0aaf', 'request_id': 'req-02cc9984-7bed-416d-82ca-990322d9f85e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:31.687417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-02cc9984-7bed-416d-82ca-990322d9f85e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1beb38510147cea51f4ff8456d0aaf', 'request_id': 'req-02cc9984-7bed-416d-82ca-990322d9f85e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:31.740516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-02cc9984-7bed-416d-82ca-990322d9f85e admin admin] The token cache is being invalidate because project 6b1beb38510147cea51f4ff8456d0aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:05:31.741040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-02cc9984-7bed-416d-82ca-990322d9f85e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:31.743587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-02cc9984-7bed-416d-82ca-990322d9f85e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:31.752678 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1952/3898] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:05:31 2022] DELETE /identity/v3/projects/6b1beb38510147cea51f4ff8456d0aaf => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:31.758344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f282770-3152-4d15-8b56-7bffc77b625e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:31.759248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f282770-3152-4d15-8b56-7bffc77b625e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:31.759714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f282770-3152-4d15-8b56-7bffc77b625e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:31.810302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2f282770-3152-4d15-8b56-7bffc77b625e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:31.814643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2f282770-3152-4d15-8b56-7bffc77b625e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:31.927410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:31.992737 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1947/3899] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:32.000559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a14f-cbf2-49bd-89d6-3e3d416ece45 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:32.000839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a14f-cbf2-49bd-89d6-3e3d416ece45 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:32.001140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a14f-cbf2-49bd-89d6-3e3d416ece45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:32.055585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b7b7a14f-cbf2-49bd-89d6-3e3d416ece45 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:32.056843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b7b7a14f-cbf2-49bd-89d6-3e3d416ece45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:32.081836 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1953/3900] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:32.086505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f282770-3152-4d15-8b56-7bffc77b625e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:32.097425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f282770-3152-4d15-8b56-7bffc77b625e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:32.117372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc943d1-1852-45f0-bdb6-856cb7832779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:32.118591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc943d1-1852-45f0-bdb6-856cb7832779 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:32.118905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc943d1-1852-45f0-bdb6-856cb7832779 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:32.119177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc943d1-1852-45f0-bdb6-856cb7832779 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:32.119830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc943d1-1852-45f0-bdb6-856cb7832779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:05:32.120135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc943d1-1852-45f0-bdb6-856cb7832779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:32.121989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc943d1-1852-45f0-bdb6-856cb7832779 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:32.160407 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1948/3901] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:05:32.165293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a14f-cbf2-49bd-89d6-3e3d416ece45 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:32.183489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a14f-cbf2-49bd-89d6-3e3d416ece45 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:32.197592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac770220-9fb4-4f2b-88ea-e047ada45658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:32.198443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac770220-9fb4-4f2b-88ea-e047ada45658 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:32.198979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac770220-9fb4-4f2b-88ea-e047ada45658 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:32.199445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac770220-9fb4-4f2b-88ea-e047ada45658 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:32.200273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac770220-9fb4-4f2b-88ea-e047ada45658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:32.204862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac770220-9fb4-4f2b-88ea-e047ada45658 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:32.281607 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1954/3902] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:05:32 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:05:32.285528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc943d1-1852-45f0-bdb6-856cb7832779 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:32.298534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc943d1-1852-45f0-bdb6-856cb7832779 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:32.434645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06d189-1936-40fd-ae69-e886443414b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:32.436008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06d189-1936-40fd-ae69-e886443414b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:32.436469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06d189-1936-40fd-ae69-e886443414b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:32.437620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06d189-1936-40fd-ae69-e886443414b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:32.438830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06d189-1936-40fd-ae69-e886443414b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:32.445096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06d189-1936-40fd-ae69-e886443414b3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:32.499473 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1949/3903] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:05:32 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:05:32.500432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac770220-9fb4-4f2b-88ea-e047ada45658 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:32.516459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac770220-9fb4-4f2b-88ea-e047ada45658 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:32.537718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3153864-0497-41f5-b99b-5a67e7a90498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:32.538368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3153864-0497-41f5-b99b-5a67e7a90498 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:32.539292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3153864-0497-41f5-b99b-5a67e7a90498 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:32.539607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3153864-0497-41f5-b99b-5a67e7a90498 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:32.540288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3153864-0497-41f5-b99b-5a67e7a90498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:32.541951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3153864-0497-41f5-b99b-5a67e7a90498 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:32.575981 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1955/3904] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:05:32.578039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06d189-1936-40fd-ae69-e886443414b3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:32.601796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06d189-1936-40fd-ae69-e886443414b3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:32.609770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced63906-7782-4c7a-a432-ce18f6157d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:32.610422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63906-7782-4c7a-a432-ce18f6157d22 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:32.610706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63906-7782-4c7a-a432-ce18f6157d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:32.611010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63906-7782-4c7a-a432-ce18f6157d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:32.611668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced63906-7782-4c7a-a432-ce18f6157d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:32.613632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced63906-7782-4c7a-a432-ce18f6157d22 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:32.649846 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1950/3905] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:05:32.650633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3153864-0497-41f5-b99b-5a67e7a90498 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:32.669031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3153864-0497-41f5-b99b-5a67e7a90498 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:32.684784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d93b7-973c-4838-aaf2-03487c3e51a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:32.685947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d93b7-973c-4838-aaf2-03487c3e51a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:32.686549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d93b7-973c-4838-aaf2-03487c3e51a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:32.687090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d93b7-973c-4838-aaf2-03487c3e51a2 admin admin] PATH_INFO: `/v3/projects/15543c90b4bc4850bcc83124d8cd832a/users/c4935f1dcb9949b390e162b865d85bfb/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:32.724278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d93b7-973c-4838-aaf2-03487c3e51a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15543c90b4bc4850bcc83124d8cd832a, user_id=c4935f1dcb9949b390e162b865d85bfb, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:32.731236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d93b7-973c-4838-aaf2-03487c3e51a2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:32.767388 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1956/3906] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:05:32 2022] PUT /identity/v3/projects/15543c90b4bc4850bcc83124d8cd832a/users/c4935f1dcb9949b390e162b865d85bfb/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:05:32.778031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e606c4-6844-4772-bd0a-35712695f07d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:32.778874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e606c4-6844-4772-bd0a-35712695f07d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:32.778987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e606c4-6844-4772-bd0a-35712695f07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:32.840382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-62e606c4-6844-4772-bd0a-35712695f07d None None] MFA Rules not processed for user `c4935f1dcb9949b390e162b865d85bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:32.842081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-62e606c4-6844-4772-bd0a-35712695f07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:32.946992 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1951/3907] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:33.081377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d93b7-973c-4838-aaf2-03487c3e51a2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:33.083782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8e4d93b7-973c-4838-aaf2-03487c3e51a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:33.371289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d93b7-973c-4838-aaf2-03487c3e51a2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:33.381058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54563c-6570-4942-b36a-bc73c9a46104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:33.381704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54563c-6570-4942-b36a-bc73c9a46104 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:33.382001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54563c-6570-4942-b36a-bc73c9a46104 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:33.384323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54563c-6570-4942-b36a-bc73c9a46104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:33.424800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54563c-6570-4942-b36a-bc73c9a46104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:33.426394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54563c-6570-4942-b36a-bc73c9a46104 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:33.465214 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1957/3908] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:05:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:05:33.797540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e606c4-6844-4772-bd0a-35712695f07d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:33.799682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-62e606c4-6844-4772-bd0a-35712695f07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:33.934078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:33.990774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e606c4-6844-4772-bd0a-35712695f07d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:34.006404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631ad51-3de0-41bc-86ba-a3493f6227df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:34.009075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631ad51-3de0-41bc-86ba-a3493f6227df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:34.009697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631ad51-3de0-41bc-86ba-a3493f6227df admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:34.011829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631ad51-3de0-41bc-86ba-a3493f6227df admin admin] PATH_INFO: `/v3/users/ab997147a6aa4430ab0410e7eb876d62` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:34.015667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631ad51-3de0-41bc-86ba-a3493f6227df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab997147a6aa4430ab0410e7eb876d62)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:34.019301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631ad51-3de0-41bc-86ba-a3493f6227df admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:34.174243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7631ad51-3de0-41bc-86ba-a3493f6227df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab997147a6aa4430ab0410e7eb876d62'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:34.197319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7631ad51-3de0-41bc-86ba-a3493f6227df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab997147a6aa4430ab0410e7eb876d62'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:34.198365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7631ad51-3de0-41bc-86ba-a3493f6227df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab997147a6aa4430ab0410e7eb876d62'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:34.232934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7631ad51-3de0-41bc-86ba-a3493f6227df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab997147a6aa4430ab0410e7eb876d62'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:34.234219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7631ad51-3de0-41bc-86ba-a3493f6227df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab997147a6aa4430ab0410e7eb876d62'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:34.264087 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1952/3909] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:05:33 2022] DELETE /identity/v3/users/ab997147a6aa4430ab0410e7eb876d62 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:35.198891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54563c-6570-4942-b36a-bc73c9a46104 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:35.216858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54563c-6570-4942-b36a-bc73c9a46104 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:35.351434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:35.352786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:35.353069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:35.353361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8 admin admin] PATH_INFO: `/v3/projects/f35e8df1e136421fa837ec71dff1b46c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:35.355112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35e8df1e136421fa837ec71dff1b46c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:35.357605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:35.393223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:35.467534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35e8df1e136421fa837ec71dff1b46c', 'request_id': 'req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:35.481497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35e8df1e136421fa837ec71dff1b46c', 'request_id': 'req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:35.494917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35e8df1e136421fa837ec71dff1b46c', 'request_id': 'req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:35.518901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8 admin admin] The token cache is being invalidate because project f35e8df1e136421fa837ec71dff1b46c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:05:35.519813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:35.522060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19f34c92-9440-4cb2-90ac-3e6d2ff693d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:35.531011 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1958/3910] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:05:35 2022] DELETE /identity/v3/projects/f35e8df1e136421fa837ec71dff1b46c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:35.532902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29708-471c-42ad-84c0-73b1fd343576 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:35.533742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29708-471c-42ad-84c0-73b1fd343576 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:35.534297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29708-471c-42ad-84c0-73b1fd343576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:35.574058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3de29708-471c-42ad-84c0-73b1fd343576 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:35.575490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3de29708-471c-42ad-84c0-73b1fd343576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:35.692994 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1953/3911] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:35.702007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643bd42-9cc5-4e7a-98c4-c41a41ac7b37 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:35.702238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643bd42-9cc5-4e7a-98c4-c41a41ac7b37 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:35.702514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643bd42-9cc5-4e7a-98c4-c41a41ac7b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:35.742147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0643bd42-9cc5-4e7a-98c4-c41a41ac7b37 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:35.744025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0643bd42-9cc5-4e7a-98c4-c41a41ac7b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:35.761525 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1959/3912] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:35.763083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de29708-471c-42ad-84c0-73b1fd343576 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:35.776998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de29708-471c-42ad-84c0-73b1fd343576 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:35.783615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadfa52-db9f-4533-aea9-c2cbaa0704a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:35.784252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadfa52-db9f-4533-aea9-c2cbaa0704a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:35.784542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadfa52-db9f-4533-aea9-c2cbaa0704a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:35.784822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadfa52-db9f-4533-aea9-c2cbaa0704a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:35.785859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eadfa52-db9f-4533-aea9-c2cbaa0704a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:05:35.786171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eadfa52-db9f-4533-aea9-c2cbaa0704a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:35.789988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eadfa52-db9f-4533-aea9-c2cbaa0704a5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:35.812056 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1954/3913] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:05:35.825349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643bd42-9cc5-4e7a-98c4-c41a41ac7b37 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:35.856897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643bd42-9cc5-4e7a-98c4-c41a41ac7b37 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:35.891403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9ad96-8d05-4f43-84e9-0f4b20767f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:35.897403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ad96-8d05-4f43-84e9-0f4b20767f7d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:35.898112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ad96-8d05-4f43-84e9-0f4b20767f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:35.898721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9ad96-8d05-4f43-84e9-0f4b20767f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:35.899621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9ad96-8d05-4f43-84e9-0f4b20767f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:35.908281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9ad96-8d05-4f43-84e9-0f4b20767f7d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:35.999316 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1960/3914] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:05:35 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:05:36.004619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadfa52-db9f-4533-aea9-c2cbaa0704a5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:36.024458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadfa52-db9f-4533-aea9-c2cbaa0704a5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:36.126905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:36.166620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a40cb3-4d9c-4eb7-bc5a-cc09dc17e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:36.167653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40cb3-4d9c-4eb7-bc5a-cc09dc17e312 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:36.168117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40cb3-4d9c-4eb7-bc5a-cc09dc17e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:36.168629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40cb3-4d9c-4eb7-bc5a-cc09dc17e312 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:36.171098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a40cb3-4d9c-4eb7-bc5a-cc09dc17e312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:36.174355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a40cb3-4d9c-4eb7-bc5a-cc09dc17e312 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:36.229374 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1955/3915] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:05:36 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:05:36.234206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9ad96-8d05-4f43-84e9-0f4b20767f7d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:36.262958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9ad96-8d05-4f43-84e9-0f4b20767f7d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:36.289660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4ff1a-c485-4af0-8093-d77c0f03aa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:36.291622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4ff1a-c485-4af0-8093-d77c0f03aa78 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:36.291919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4ff1a-c485-4af0-8093-d77c0f03aa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:36.292427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4ff1a-c485-4af0-8093-d77c0f03aa78 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:36.293368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4ff1a-c485-4af0-8093-d77c0f03aa78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:36.295205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4ff1a-c485-4af0-8093-d77c0f03aa78 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:36.325697 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1961/3916] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:05:36.328143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a40cb3-4d9c-4eb7-bc5a-cc09dc17e312 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:36.394126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a40cb3-4d9c-4eb7-bc5a-cc09dc17e312 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:36.409133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9e162-fe43-45a7-bfae-45e4c539a440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:36.409798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9e162-fe43-45a7-bfae-45e4c539a440 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:36.410087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9e162-fe43-45a7-bfae-45e4c539a440 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:36.410364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9e162-fe43-45a7-bfae-45e4c539a440 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:36.414323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9e162-fe43-45a7-bfae-45e4c539a440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:36.416092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9e162-fe43-45a7-bfae-45e4c539a440 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:36.464043 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1956/3917] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:05:36.466107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4ff1a-c485-4af0-8093-d77c0f03aa78 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:36.501928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4ff1a-c485-4af0-8093-d77c0f03aa78 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:36.515076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a878a-11f5-4594-9224-80b128c06b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:36.515760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a878a-11f5-4594-9224-80b128c06b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:36.516042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a878a-11f5-4594-9224-80b128c06b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:36.516324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a878a-11f5-4594-9224-80b128c06b20 admin admin] PATH_INFO: `/v3/projects/82f40afe83bb4020b126bd056752d1d0/users/9fa50f553f1d42f39bd6e0f788459685/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:36.566622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a878a-11f5-4594-9224-80b128c06b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f40afe83bb4020b126bd056752d1d0, user_id=9fa50f553f1d42f39bd6e0f788459685, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:36.584312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a878a-11f5-4594-9224-80b128c06b20 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:36.622049 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1962/3918] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:05:36 2022] PUT /identity/v3/projects/82f40afe83bb4020b126bd056752d1d0/users/9fa50f553f1d42f39bd6e0f788459685/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:36.623928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879951d7-8c44-480d-8b98-ab4bcdd8f5de None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:36.624499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879951d7-8c44-480d-8b98-ab4bcdd8f5de None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:36.624499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879951d7-8c44-480d-8b98-ab4bcdd8f5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:36.691346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-879951d7-8c44-480d-8b98-ab4bcdd8f5de None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:36.692627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-879951d7-8c44-480d-8b98-ab4bcdd8f5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:36.928112 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1957/3919] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:36.979898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a878a-11f5-4594-9224-80b128c06b20 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:36.982023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d49a878a-11f5-4594-9224-80b128c06b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:37.148844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a878a-11f5-4594-9224-80b128c06b20 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:37.153158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea1bb7-3450-45a2-a86f-b15174b37fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:37.154238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea1bb7-3450-45a2-a86f-b15174b37fad service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:37.154700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea1bb7-3450-45a2-a86f-b15174b37fad service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:37.155155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea1bb7-3450-45a2-a86f-b15174b37fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:37.181936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea1bb7-3450-45a2-a86f-b15174b37fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:37.183781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea1bb7-3450-45a2-a86f-b15174b37fad service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:37.207664 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1963/3920] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:05:41.703852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879951d7-8c44-480d-8b98-ab4bcdd8f5de None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:41.705309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-879951d7-8c44-480d-8b98-ab4bcdd8f5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:41.722721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879951d7-8c44-480d-8b98-ab4bcdd8f5de None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:41.732344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:41.733633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:41.734287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:41.735009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] PATH_INFO: `/v3/users/b522965c08064a3bb9ac0f3afd8e5eff` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:41.737182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b522965c08064a3bb9ac0f3afd8e5eff)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:41.740640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:41.823556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b522965c08064a3bb9ac0f3afd8e5eff'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:41.836762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b522965c08064a3bb9ac0f3afd8e5eff'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:41.838136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b522965c08064a3bb9ac0f3afd8e5eff'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:41.858728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b522965c08064a3bb9ac0f3afd8e5eff'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:41.859576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b522965c08064a3bb9ac0f3afd8e5eff'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:41.884978 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1958/3921] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:05:41 2022] DELETE /identity/v3/users/b522965c08064a3bb9ac0f3afd8e5eff => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:41.885694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf679da-d0ef-4246-9bf8-43bb3c0362aa None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:41.886562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf679da-d0ef-4246-9bf8-43bb3c0362aa None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:41.887063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf679da-d0ef-4246-9bf8-43bb3c0362aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:41.932883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1cf679da-d0ef-4246-9bf8-43bb3c0362aa None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:41.935525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1cf679da-d0ef-4246-9bf8-43bb3c0362aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:42.020118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:42.123956 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1964/3922] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:42.185458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:42.187197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:42.328404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:42.368874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe202f3-dd22-4e55-802d-51bcdbf9b6aa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:42.373948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8119cdd-3507-4ec9-85ea-b47a5dd52e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:42.374581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8119cdd-3507-4ec9-85ea-b47a5dd52e63 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:42.374926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8119cdd-3507-4ec9-85ea-b47a5dd52e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:42.375253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8119cdd-3507-4ec9-85ea-b47a5dd52e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:42.393037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8119cdd-3507-4ec9-85ea-b47a5dd52e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:42.394522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8119cdd-3507-4ec9-85ea-b47a5dd52e63 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:42.408289 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1959/3923] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:05:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:05:44.290253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf679da-d0ef-4246-9bf8-43bb3c0362aa None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:44.295708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1cf679da-d0ef-4246-9bf8-43bb3c0362aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:44.326919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf679da-d0ef-4246-9bf8-43bb3c0362aa None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:44.337245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10041137-954a-44e8-8b41-29dcafa0e288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:44.338909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10041137-954a-44e8-8b41-29dcafa0e288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:44.339359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10041137-954a-44e8-8b41-29dcafa0e288 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:44.339793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10041137-954a-44e8-8b41-29dcafa0e288 admin admin] PATH_INFO: `/v3/projects/3af547c7281649ed97925a94808bebfc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:44.342706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10041137-954a-44e8-8b41-29dcafa0e288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af547c7281649ed97925a94808bebfc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:44.345092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10041137-954a-44e8-8b41-29dcafa0e288 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:44.528070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10041137-954a-44e8-8b41-29dcafa0e288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af547c7281649ed97925a94808bebfc', 'request_id': 'req-10041137-954a-44e8-8b41-29dcafa0e288'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:44.564061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10041137-954a-44e8-8b41-29dcafa0e288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af547c7281649ed97925a94808bebfc', 'request_id': 'req-10041137-954a-44e8-8b41-29dcafa0e288'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:44.588747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10041137-954a-44e8-8b41-29dcafa0e288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af547c7281649ed97925a94808bebfc', 'request_id': 'req-10041137-954a-44e8-8b41-29dcafa0e288'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:44.630459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10041137-954a-44e8-8b41-29dcafa0e288 admin admin] The token cache is being invalidate because project 3af547c7281649ed97925a94808bebfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:05:44.630826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10041137-954a-44e8-8b41-29dcafa0e288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:44.631820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-10041137-954a-44e8-8b41-29dcafa0e288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:44.635729 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1965/3924] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:05:44 2022] DELETE /identity/v3/projects/3af547c7281649ed97925a94808bebfc => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:44.645363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8bcae-f6b1-4eb8-9ec7-e4e04000dd16 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:44.645913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8bcae-f6b1-4eb8-9ec7-e4e04000dd16 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:44.646065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8bcae-f6b1-4eb8-9ec7-e4e04000dd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:44.712028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-00e8bcae-f6b1-4eb8-9ec7-e4e04000dd16 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:44.715661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-00e8bcae-f6b1-4eb8-9ec7-e4e04000dd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:44.944314 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1960/3925] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:44.946976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a09552-e4ad-41a7-a0d7-905d1bed55d6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:44.947393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a09552-e4ad-41a7-a0d7-905d1bed55d6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:44.947780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a09552-e4ad-41a7-a0d7-905d1bed55d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:45.005874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a9a09552-e4ad-41a7-a0d7-905d1bed55d6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:45.008831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a9a09552-e4ad-41a7-a0d7-905d1bed55d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:45.047852 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1966/3926] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:45.048846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8bcae-f6b1-4eb8-9ec7-e4e04000dd16 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:45.062725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8bcae-f6b1-4eb8-9ec7-e4e04000dd16 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:45.097221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e68552-eb8c-477b-aed7-49bb14dd0bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:45.098221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e68552-eb8c-477b-aed7-49bb14dd0bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:45.099392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e68552-eb8c-477b-aed7-49bb14dd0bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:45.099860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e68552-eb8c-477b-aed7-49bb14dd0bc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:45.102487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e68552-eb8c-477b-aed7-49bb14dd0bc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:05:45.105259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e68552-eb8c-477b-aed7-49bb14dd0bc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:45.110290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e68552-eb8c-477b-aed7-49bb14dd0bc2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:45.138336 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1961/3927] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:05:45.143071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a09552-e4ad-41a7-a0d7-905d1bed55d6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:45.169131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a09552-e4ad-41a7-a0d7-905d1bed55d6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:45.198003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884f6f1-5446-434a-a252-857ea678c8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:45.198716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884f6f1-5446-434a-a252-857ea678c8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:45.199724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884f6f1-5446-434a-a252-857ea678c8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:45.201157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884f6f1-5446-434a-a252-857ea678c8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:45.201932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884f6f1-5446-434a-a252-857ea678c8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:45.212052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884f6f1-5446-434a-a252-857ea678c8d2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:45.323092 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1967/3928] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:05:45 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:05:45.327781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e68552-eb8c-477b-aed7-49bb14dd0bc2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:45.349081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e68552-eb8c-477b-aed7-49bb14dd0bc2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:45.630435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc7ff7-e020-480b-954c-b7839c1976a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:45.631113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc7ff7-e020-480b-954c-b7839c1976a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:45.631401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc7ff7-e020-480b-954c-b7839c1976a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:45.631682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc7ff7-e020-480b-954c-b7839c1976a1 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:45.632906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc7ff7-e020-480b-954c-b7839c1976a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:45.634951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc7ff7-e020-480b-954c-b7839c1976a1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:45.695014 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1962/3929] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:05:45 2022] POST /identity/v3/users => generated 300 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:05:45.699649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884f6f1-5446-434a-a252-857ea678c8d2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:45.718236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884f6f1-5446-434a-a252-857ea678c8d2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:45.732133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050d747-cbd1-4bf2-a288-722b2f6938fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:45.733058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050d747-cbd1-4bf2-a288-722b2f6938fe admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:45.733506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050d747-cbd1-4bf2-a288-722b2f6938fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:45.734071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050d747-cbd1-4bf2-a288-722b2f6938fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:45.734970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050d747-cbd1-4bf2-a288-722b2f6938fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:45.736804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050d747-cbd1-4bf2-a288-722b2f6938fe admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:45.780825 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1968/3930] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:05:45.784841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc7ff7-e020-480b-954c-b7839c1976a1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:45.807470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc7ff7-e020-480b-954c-b7839c1976a1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:45.823708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888a8b-2e9a-4215-a78b-1824037631dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:45.824844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888a8b-2e9a-4215-a78b-1824037631dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:45.825295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888a8b-2e9a-4215-a78b-1824037631dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:45.825773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888a8b-2e9a-4215-a78b-1824037631dc admin admin] PATH_INFO: `/v3/projects/b5d2594357804db5bf5f849a8424ac75/users/1293f3720ab94579b53bfb531025a545/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:45.848440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66888a8b-2e9a-4215-a78b-1824037631dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d2594357804db5bf5f849a8424ac75, user_id=1293f3720ab94579b53bfb531025a545, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:45.852683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66888a8b-2e9a-4215-a78b-1824037631dc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:45.878552 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1963/3931] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:05:45 2022] PUT /identity/v3/projects/b5d2594357804db5bf5f849a8424ac75/users/1293f3720ab94579b53bfb531025a545/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:45.885503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050d747-cbd1-4bf2-a288-722b2f6938fe admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:45.901188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050d747-cbd1-4bf2-a288-722b2f6938fe admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:46.091739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e1576-8d26-4fac-9bbb-be3c51b3a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:46.100504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e1576-8d26-4fac-9bbb-be3c51b3a711 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:46.102107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e1576-8d26-4fac-9bbb-be3c51b3a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:46.102580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e1576-8d26-4fac-9bbb-be3c51b3a711 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:46.103452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e1576-8d26-4fac-9bbb-be3c51b3a711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:46.105286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e1576-8d26-4fac-9bbb-be3c51b3a711 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:46.134968 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1969/3932] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:05:46.139525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888a8b-2e9a-4215-a78b-1824037631dc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:46.154360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888a8b-2e9a-4215-a78b-1824037631dc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:46.176127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7304abd-c732-4029-8029-3c586d8955d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:46.177081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7304abd-c732-4029-8029-3c586d8955d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:46.177538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7304abd-c732-4029-8029-3c586d8955d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:46.178095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7304abd-c732-4029-8029-3c586d8955d8 admin admin] PATH_INFO: `/v3/projects/b5d2594357804db5bf5f849a8424ac75/users/1293f3720ab94579b53bfb531025a545/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:46.186730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7304abd-c732-4029-8029-3c586d8955d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d2594357804db5bf5f849a8424ac75, user_id=1293f3720ab94579b53bfb531025a545, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:46.190292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7304abd-c732-4029-8029-3c586d8955d8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:46.215957 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1964/3933] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:05:46 2022] PUT /identity/v3/projects/b5d2594357804db5bf5f849a8424ac75/users/1293f3720ab94579b53bfb531025a545/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:46.227716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6d8e3-d353-485c-9c0d-dfe3cdb411c5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:46.228056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6d8e3-d353-485c-9c0d-dfe3cdb411c5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:46.228295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6d8e3-d353-485c-9c0d-dfe3cdb411c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:46.335812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-95e6d8e3-d353-485c-9c0d-dfe3cdb411c5 None None] MFA Rules not processed for user `1293f3720ab94579b53bfb531025a545`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:46.352681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-95e6d8e3-d353-485c-9c0d-dfe3cdb411c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:46.376783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:46.629166 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1970/3934] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:46.634417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7304abd-c732-4029-8029-3c586d8955d8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:46.761482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:46.905980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7304abd-c732-4029-8029-3c586d8955d8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:46.914924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fad5d-3034-4aca-a845-d7e5080f01a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:46.915613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fad5d-3034-4aca-a845-d7e5080f01a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:46.915901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fad5d-3034-4aca-a845-d7e5080f01a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:46.916183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fad5d-3034-4aca-a845-d7e5080f01a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:46.916837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fad5d-3034-4aca-a845-d7e5080f01a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:46.924493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fad5d-3034-4aca-a845-d7e5080f01a3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:46.991958 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1965/3935] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:05:46 2022] POST /identity/v3/projects => generated 383 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:05:46.993546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6d8e3-d353-485c-9c0d-dfe3cdb411c5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:47.012060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6d8e3-d353-485c-9c0d-dfe3cdb411c5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:47.242107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715ff13-8f5f-45b7-a4de-b6d44082b726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:47.243106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715ff13-8f5f-45b7-a4de-b6d44082b726 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:47.243621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715ff13-8f5f-45b7-a4de-b6d44082b726 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:47.244053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715ff13-8f5f-45b7-a4de-b6d44082b726 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:47.244849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715ff13-8f5f-45b7-a4de-b6d44082b726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:47.249398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715ff13-8f5f-45b7-a4de-b6d44082b726 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:47.308088 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1971/3936] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:05:46 2022] POST /identity/v3/users => generated 292 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:05:47.313908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fad5d-3034-4aca-a845-d7e5080f01a3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:47.337750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fad5d-3034-4aca-a845-d7e5080f01a3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:47.363839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af15eb-b7b3-41fd-b26a-d888d3bcfbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:47.364720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af15eb-b7b3-41fd-b26a-d888d3bcfbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:47.365011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af15eb-b7b3-41fd-b26a-d888d3bcfbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:47.365292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af15eb-b7b3-41fd-b26a-d888d3bcfbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:47.365994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af15eb-b7b3-41fd-b26a-d888d3bcfbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:47.387253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af15eb-b7b3-41fd-b26a-d888d3bcfbb7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:47.457404 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1966/3937] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:05:47.458833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715ff13-8f5f-45b7-a4de-b6d44082b726 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:47.476920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715ff13-8f5f-45b7-a4de-b6d44082b726 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:47.509628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fea41-bd1a-4683-b586-c009a9faa8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:47.510361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fea41-bd1a-4683-b586-c009a9faa8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:47.510653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fea41-bd1a-4683-b586-c009a9faa8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:47.511017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fea41-bd1a-4683-b586-c009a9faa8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:47.511678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fea41-bd1a-4683-b586-c009a9faa8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:47.513394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fea41-bd1a-4683-b586-c009a9faa8b2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:47.542005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af15eb-b7b3-41fd-b26a-d888d3bcfbb7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:47.542876 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1972/3938] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:05:47.557278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af15eb-b7b3-41fd-b26a-d888d3bcfbb7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:47.571005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d54c4f-f164-4e7d-8788-5c86eab8980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:47.573004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d54c4f-f164-4e7d-8788-5c86eab8980b admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:47.573458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d54c4f-f164-4e7d-8788-5c86eab8980b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:47.574971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d54c4f-f164-4e7d-8788-5c86eab8980b admin admin] PATH_INFO: `/v3/projects/076a0b57a0f84db98782a030cbdde227/users/bf60fbaf8d184daa9edd59f2c9b59bd1/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:47.628485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d54c4f-f164-4e7d-8788-5c86eab8980b admin admin] RBAC: Authorizing `identity:create_grant(project_id=076a0b57a0f84db98782a030cbdde227, user_id=bf60fbaf8d184daa9edd59f2c9b59bd1, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:47.638308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d54c4f-f164-4e7d-8788-5c86eab8980b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:47.692875 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1967/3939] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:05:47 2022] PUT /identity/v3/projects/076a0b57a0f84db98782a030cbdde227/users/bf60fbaf8d184daa9edd59f2c9b59bd1/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:47.705331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea40650-f30a-4197-a24e-97ffa535bdc7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:47.705622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea40650-f30a-4197-a24e-97ffa535bdc7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:47.705905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea40650-f30a-4197-a24e-97ffa535bdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:47.794826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4ea40650-f30a-4197-a24e-97ffa535bdc7 None None] MFA Rules not processed for user `bf60fbaf8d184daa9edd59f2c9b59bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:47.796198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4ea40650-f30a-4197-a24e-97ffa535bdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:48.008910 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1973/3940] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:48.019040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d54c4f-f164-4e7d-8788-5c86eab8980b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:48.020855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a1d54c4f-f164-4e7d-8788-5c86eab8980b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:48.264474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d54c4f-f164-4e7d-8788-5c86eab8980b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:48.293321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc219cd4-b060-4e9f-9964-88f58944ee49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:48.294551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc219cd4-b060-4e9f-9964-88f58944ee49 service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:48.295225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc219cd4-b060-4e9f-9964-88f58944ee49 service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:48.295863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc219cd4-b060-4e9f-9964-88f58944ee49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:48.508058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc219cd4-b060-4e9f-9964-88f58944ee49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:48.510362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc219cd4-b060-4e9f-9964-88f58944ee49 service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:48.550017 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1968/3941] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:05:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:05:50.361877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea40650-f30a-4197-a24e-97ffa535bdc7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:50.385300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:50.521347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea40650-f30a-4197-a24e-97ffa535bdc7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:50.529176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:50.529864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:50.530152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:50.530609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] PATH_INFO: `/v3/users/1293f3720ab94579b53bfb531025a545` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:50.532262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1293f3720ab94579b53bfb531025a545)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:50.534453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:50.643890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1293f3720ab94579b53bfb531025a545'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:50.666343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1293f3720ab94579b53bfb531025a545'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:50.667309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1293f3720ab94579b53bfb531025a545'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:50.685189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1293f3720ab94579b53bfb531025a545'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:50.685983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1293f3720ab94579b53bfb531025a545'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:50.730918 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1974/3942] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:05:50 2022] DELETE /identity/v3/users/1293f3720ab94579b53bfb531025a545 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:50.736894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551bed-a30d-42c4-af87-a3029c969c2c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:50.737446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551bed-a30d-42c4-af87-a3029c969c2c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:50.737576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf551bed-a30d-42c4-af87-a3029c969c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:50.782842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bf551bed-a30d-42c4-af87-a3029c969c2c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:50.789226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bf551bed-a30d-42c4-af87-a3029c969c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:50.832684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:50.973683 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1969/3943] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:51.135871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:51.139026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:51.364836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfe4c0-3e47-4d6e-a4ba-3769c6a46ae9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:51.387656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db2e24-40a2-4ada-ba6f-eff90bbff6e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:51.389114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db2e24-40a2-4ada-ba6f-eff90bbff6e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:51.389508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db2e24-40a2-4ada-ba6f-eff90bbff6e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:51.389891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db2e24-40a2-4ada-ba6f-eff90bbff6e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:51.464027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db2e24-40a2-4ada-ba6f-eff90bbff6e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:51.465915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db2e24-40a2-4ada-ba6f-eff90bbff6e2 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:51.515942 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1975/3944] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:05:52.115024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf551bed-a30d-42c4-af87-a3029c969c2c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:52.118139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bf551bed-a30d-42c4-af87-a3029c969c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:52.141453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf551bed-a30d-42c4-af87-a3029c969c2c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:52.160188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:52.160845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:52.161319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:52.161597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] PATH_INFO: `/v3/projects/b5d2594357804db5bf5f849a8424ac75` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:52.165098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d2594357804db5bf5f849a8424ac75)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:52.167083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:52.311377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d2594357804db5bf5f849a8424ac75', 'request_id': 'req-aa0b429b-700a-4b39-950c-98a28b97831d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:52.344335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d2594357804db5bf5f849a8424ac75', 'request_id': 'req-aa0b429b-700a-4b39-950c-98a28b97831d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:52.358815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d2594357804db5bf5f849a8424ac75', 'request_id': 'req-aa0b429b-700a-4b39-950c-98a28b97831d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:52.401207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] The token cache is being invalidate because project b5d2594357804db5bf5f849a8424ac75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:05:52.401589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:52.402674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:52.404997 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1970/3945] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:05:52 2022] DELETE /identity/v3/projects/b5d2594357804db5bf5f849a8424ac75 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:52.408697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db2e24-40a2-4ada-ba6f-eff90bbff6e2 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:52.433583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db2e24-40a2-4ada-ba6f-eff90bbff6e2 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:52.543994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:52.651944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48182413-f247-40d9-bf0d-56209726533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:52.655661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48182413-f247-40d9-bf0d-56209726533b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:52.656280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48182413-f247-40d9-bf0d-56209726533b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:52.657181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48182413-f247-40d9-bf0d-56209726533b admin admin] PATH_INFO: `/v3/users/bf60fbaf8d184daa9edd59f2c9b59bd1` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:52.661914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48182413-f247-40d9-bf0d-56209726533b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf60fbaf8d184daa9edd59f2c9b59bd1)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:52.673976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48182413-f247-40d9-bf0d-56209726533b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:52.802878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-48182413-f247-40d9-bf0d-56209726533b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf60fbaf8d184daa9edd59f2c9b59bd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:52.847839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-48182413-f247-40d9-bf0d-56209726533b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf60fbaf8d184daa9edd59f2c9b59bd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:52.852657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-48182413-f247-40d9-bf0d-56209726533b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf60fbaf8d184daa9edd59f2c9b59bd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:52.880498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-48182413-f247-40d9-bf0d-56209726533b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf60fbaf8d184daa9edd59f2c9b59bd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:52.881347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-48182413-f247-40d9-bf0d-56209726533b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf60fbaf8d184daa9edd59f2c9b59bd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:52.975497 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1976/3946] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:05:52 2022] DELETE /identity/v3/users/bf60fbaf8d184daa9edd59f2c9b59bd1 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:54.720435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:54.722185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:54.758197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b429b-700a-4b39-950c-98a28b97831d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:54.902875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a2ed2-b24a-483d-975b-07efbed974d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:54.903898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a2ed2-b24a-483d-975b-07efbed974d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:54.904287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a2ed2-b24a-483d-975b-07efbed974d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:54.904857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a2ed2-b24a-483d-975b-07efbed974d4 admin admin] PATH_INFO: `/v3/projects/076a0b57a0f84db98782a030cbdde227` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:54.906359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a2ed2-b24a-483d-975b-07efbed974d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=076a0b57a0f84db98782a030cbdde227)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:54.908445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a2ed2-b24a-483d-975b-07efbed974d4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:55.015174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:55.028433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-341a2ed2-b24a-483d-975b-07efbed974d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076a0b57a0f84db98782a030cbdde227', 'request_id': 'req-341a2ed2-b24a-483d-975b-07efbed974d4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:55.055756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-341a2ed2-b24a-483d-975b-07efbed974d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076a0b57a0f84db98782a030cbdde227', 'request_id': 'req-341a2ed2-b24a-483d-975b-07efbed974d4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:55.063166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-341a2ed2-b24a-483d-975b-07efbed974d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076a0b57a0f84db98782a030cbdde227', 'request_id': 'req-341a2ed2-b24a-483d-975b-07efbed974d4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:55.086218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-341a2ed2-b24a-483d-975b-07efbed974d4 admin admin] The token cache is being invalidate because project 076a0b57a0f84db98782a030cbdde227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:05:55.086218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-341a2ed2-b24a-483d-975b-07efbed974d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:55.099284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-341a2ed2-b24a-483d-975b-07efbed974d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:05:55.102562 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1971/3947] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:05:54 2022] DELETE /identity/v3/projects/076a0b57a0f84db98782a030cbdde227 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:55.107358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8e54a-89e6-4e89-8f00-6985a87c7915 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:55.108334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8e54a-89e6-4e89-8f00-6985a87c7915 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:55.108824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8e54a-89e6-4e89-8f00-6985a87c7915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:55.147878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-19a8e54a-89e6-4e89-8f00-6985a87c7915 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:55.149400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-19a8e54a-89e6-4e89-8f00-6985a87c7915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:55.291711 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1977/3948] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:55.299241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11586e1-c0bb-40c2-8598-a3f434b572a3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:55.299903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11586e1-c0bb-40c2-8598-a3f434b572a3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:55.300413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11586e1-c0bb-40c2-8598-a3f434b572a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:55.353570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a11586e1-c0bb-40c2-8598-a3f434b572a3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:55.363873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a11586e1-c0bb-40c2-8598-a3f434b572a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:55.397293 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1972/3949] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:55.401186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8e54a-89e6-4e89-8f00-6985a87c7915 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:55.416455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8e54a-89e6-4e89-8f00-6985a87c7915 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:55.436401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d2fc5-1fa5-4f28-82aa-109e6a7a1df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:55.437326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d2fc5-1fa5-4f28-82aa-109e6a7a1df9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:55.438505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d2fc5-1fa5-4f28-82aa-109e6a7a1df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:55.439030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d2fc5-1fa5-4f28-82aa-109e6a7a1df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:55.439929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d2fc5-1fa5-4f28-82aa-109e6a7a1df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:05:55.440468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d2fc5-1fa5-4f28-82aa-109e6a7a1df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:55.442320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d2fc5-1fa5-4f28-82aa-109e6a7a1df9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:55.484891 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1978/3950] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:05:55.489663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcc663-cd8d-449a-810f-ab8a9d45f7b9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:55.490302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcc663-cd8d-449a-810f-ab8a9d45f7b9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:55.491153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcc663-cd8d-449a-810f-ab8a9d45f7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:55.496396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d2fc5-1fa5-4f28-82aa-109e6a7a1df9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:55.517052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9afcc663-cd8d-449a-810f-ab8a9d45f7b9 None None] MFA Rules not processed for user `550d16e73d594f708b4639e2cd54a3db`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:55.518700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9afcc663-cd8d-449a-810f-ab8a9d45f7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:55.542582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d2fc5-1fa5-4f28-82aa-109e6a7a1df9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:55.567160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967fa55-907f-4a83-b8cc-25314bf2c592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:55.568190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967fa55-907f-4a83-b8cc-25314bf2c592 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:55.568704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967fa55-907f-4a83-b8cc-25314bf2c592 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:55.569751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967fa55-907f-4a83-b8cc-25314bf2c592 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:55.570685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967fa55-907f-4a83-b8cc-25314bf2c592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:55.572883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967fa55-907f-4a83-b8cc-25314bf2c592 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:55.630457 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1973/3951] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 28 19:05:55.681883 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1979/3952] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:05:55 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:05:55.686848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcc663-cd8d-449a-810f-ab8a9d45f7b9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:55.709363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcc663-cd8d-449a-810f-ab8a9d45f7b9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:55.863720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf55fc-0c1a-4c61-a978-c7ba2cecdb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:55.865267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf55fc-0c1a-4c61-a978-c7ba2cecdb1e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:55.867245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf55fc-0c1a-4c61-a978-c7ba2cecdb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:55.867738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf55fc-0c1a-4c61-a978-c7ba2cecdb1e admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:55.868572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf55fc-0c1a-4c61-a978-c7ba2cecdb1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:55.875878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf55fc-0c1a-4c61-a978-c7ba2cecdb1e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:55.953241 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1974/3953] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:05:55 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:05:55.954489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967fa55-907f-4a83-b8cc-25314bf2c592 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:55.966679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967fa55-907f-4a83-b8cc-25314bf2c592 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:56.016305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af27a8-3d94-47a5-a307-56fab27ef906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:56.016951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af27a8-3d94-47a5-a307-56fab27ef906 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:56.017222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af27a8-3d94-47a5-a307-56fab27ef906 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:56.017502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af27a8-3d94-47a5-a307-56fab27ef906 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:56.018177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af27a8-3d94-47a5-a307-56fab27ef906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:56.033972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af27a8-3d94-47a5-a307-56fab27ef906 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:56.086774 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1980/3954] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:05:56.087568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf55fc-0c1a-4c61-a978-c7ba2cecdb1e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:56.122863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf55fc-0c1a-4c61-a978-c7ba2cecdb1e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:56.139999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962b270-01e5-4060-956d-b536b33d8e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:56.140689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962b270-01e5-4060-956d-b536b33d8e9b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:56.143117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962b270-01e5-4060-956d-b536b33d8e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:56.143452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962b270-01e5-4060-956d-b536b33d8e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:56.147223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962b270-01e5-4060-956d-b536b33d8e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:56.151099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962b270-01e5-4060-956d-b536b33d8e9b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:56.176724 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1975/3955] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:05:56.181622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af27a8-3d94-47a5-a307-56fab27ef906 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:56.197769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af27a8-3d94-47a5-a307-56fab27ef906 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:56.219757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd1618-1353-4ff9-804a-7032dfea4df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:56.221505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd1618-1353-4ff9-804a-7032dfea4df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:56.221795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd1618-1353-4ff9-804a-7032dfea4df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:56.222076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd1618-1353-4ff9-804a-7032dfea4df6 admin admin] PATH_INFO: `/v3/projects/e93392efb81a4069a164a8f4c4a6d6b6/users/1cafd7a9957f43a1abdfd397b62adbb5/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:56.233753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:56.262833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd1618-1353-4ff9-804a-7032dfea4df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93392efb81a4069a164a8f4c4a6d6b6, user_id=1cafd7a9957f43a1abdfd397b62adbb5, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:56.266124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd1618-1353-4ff9-804a-7032dfea4df6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:56.313676 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1981/3956] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:05:56 2022] PUT /identity/v3/projects/e93392efb81a4069a164a8f4c4a6d6b6/users/1cafd7a9957f43a1abdfd397b62adbb5/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:56.318639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd21ce9-05b3-48a2-9514-cf217adbed58 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:56.318971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd21ce9-05b3-48a2-9514-cf217adbed58 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:56.320157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd21ce9-05b3-48a2-9514-cf217adbed58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:56.425450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-abd21ce9-05b3-48a2-9514-cf217adbed58 None None] MFA Rules not processed for user `1cafd7a9957f43a1abdfd397b62adbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:56.426717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-abd21ce9-05b3-48a2-9514-cf217adbed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:56.567245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:56.664206 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1976/3957] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:56.668100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd1618-1353-4ff9-804a-7032dfea4df6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:56.915526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd1618-1353-4ff9-804a-7032dfea4df6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:56.982927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e23354-a968-4afa-9e62-b0c51cecb218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:56.983605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e23354-a968-4afa-9e62-b0c51cecb218 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:56.984178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e23354-a968-4afa-9e62-b0c51cecb218 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:56.984178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e23354-a968-4afa-9e62-b0c51cecb218 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:56.984729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e23354-a968-4afa-9e62-b0c51cecb218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:56.989305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e23354-a968-4afa-9e62-b0c51cecb218 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:57.113852 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1982/3958] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:05:56 2022] POST /identity/v3/projects => generated 377 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:05:57.118705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd21ce9-05b3-48a2-9514-cf217adbed58 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:57.136995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd21ce9-05b3-48a2-9514-cf217adbed58 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:57.383524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb00e45-05c9-463c-996f-8119ca0a72c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:57.384197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb00e45-05c9-463c-996f-8119ca0a72c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:57.384475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb00e45-05c9-463c-996f-8119ca0a72c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:57.384753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb00e45-05c9-463c-996f-8119ca0a72c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:57.385421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb00e45-05c9-463c-996f-8119ca0a72c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:57.387603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb00e45-05c9-463c-996f-8119ca0a72c1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:57.480794 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1977/3959] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:05:57 2022] POST /identity/v3/users => generated 289 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:05:57.481648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e23354-a968-4afa-9e62-b0c51cecb218 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:57.495586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e23354-a968-4afa-9e62-b0c51cecb218 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:57.520490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37814f-9353-476b-8bc0-fbfa4303a3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:57.521120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37814f-9353-476b-8bc0-fbfa4303a3cb admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:57.521578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37814f-9353-476b-8bc0-fbfa4303a3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:57.522008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37814f-9353-476b-8bc0-fbfa4303a3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:57.523247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37814f-9353-476b-8bc0-fbfa4303a3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:57.524934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37814f-9353-476b-8bc0-fbfa4303a3cb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:57.582625 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1983/3960] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:05:57.583813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb00e45-05c9-463c-996f-8119ca0a72c1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:57.602106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb00e45-05c9-463c-996f-8119ca0a72c1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:57.635332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d597e-bc8a-4a7a-9c59-3ecf2258d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:57.635332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d597e-bc8a-4a7a-9c59-3ecf2258d2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:57.642997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d597e-bc8a-4a7a-9c59-3ecf2258d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:57.649258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d597e-bc8a-4a7a-9c59-3ecf2258d2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:57.655289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d597e-bc8a-4a7a-9c59-3ecf2258d2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:57.662070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d597e-bc8a-4a7a-9c59-3ecf2258d2e4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:57.721416 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1978/3961] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:05:57.725918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37814f-9353-476b-8bc0-fbfa4303a3cb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:57.742153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37814f-9353-476b-8bc0-fbfa4303a3cb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:57.784666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f6f67-5c57-44bf-af16-0e9e4758776b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:57.785465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6f67-5c57-44bf-af16-0e9e4758776b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:57.785646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6f67-5c57-44bf-af16-0e9e4758776b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:57.786103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6f67-5c57-44bf-af16-0e9e4758776b admin admin] PATH_INFO: `/v3/projects/2987210cfc4e4b4186c63d87f4f55499/users/e5be13121018433ca5f32bd3390ad1f0/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:57.833894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f6f67-5c57-44bf-af16-0e9e4758776b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2987210cfc4e4b4186c63d87f4f55499, user_id=e5be13121018433ca5f32bd3390ad1f0, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:57.843517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f6f67-5c57-44bf-af16-0e9e4758776b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:57.876850 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1984/3962] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:05:57 2022] PUT /identity/v3/projects/2987210cfc4e4b4186c63d87f4f55499/users/e5be13121018433ca5f32bd3390ad1f0/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:05:57.988572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0f958-6e52-4133-ba80-01cd80998911 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:57.988808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0f958-6e52-4133-ba80-01cd80998911 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:57.989095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0f958-6e52-4133-ba80-01cd80998911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:58.045693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e7c0f958-6e52-4133-ba80-01cd80998911 None None] MFA Rules not processed for user `e5be13121018433ca5f32bd3390ad1f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:58.049617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e7c0f958-6e52-4133-ba80-01cd80998911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:58.254520 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1979/3963] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:05:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:58.271303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f6f67-5c57-44bf-af16-0e9e4758776b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:58.273842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-171f6f67-5c57-44bf-af16-0e9e4758776b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:58.503466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f6f67-5c57-44bf-af16-0e9e4758776b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:58.515614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5372a-55b4-4c85-850b-1e3ae6ab1ef8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:58.516782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5372a-55b4-4c85-850b-1e3ae6ab1ef8 service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:58.517228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5372a-55b4-4c85-850b-1e3ae6ab1ef8 service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:58.517671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5372a-55b4-4c85-850b-1e3ae6ab1ef8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:58.659532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:58.737725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5372a-55b4-4c85-850b-1e3ae6ab1ef8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:58.742993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5372a-55b4-4c85-850b-1e3ae6ab1ef8 service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:58.778713 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1985/3964] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:05:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:05:59.203482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d7859-9dbf-4e0f-ac0f-b60b64859fd0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:59.204715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d7859-9dbf-4e0f-ac0f-b60b64859fd0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:59.206862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d7859-9dbf-4e0f-ac0f-b60b64859fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:59.263313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d02d7859-9dbf-4e0f-ac0f-b60b64859fd0 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:05:59.266710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d02d7859-9dbf-4e0f-ac0f-b60b64859fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:59.383140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:05:59.410627 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1980/3965] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:05:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:05:59.426085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5372a-55b4-4c85-850b-1e3ae6ab1ef8 service glance] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:05:59.428374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-87d5372a-55b4-4c85-850b-1e3ae6ab1ef8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:05:59.734071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5372a-55b4-4c85-850b-1e3ae6ab1ef8 service glance] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:05:59.751009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9891207-3a19-4309-bb88-1d33e9200dee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:05:59.754246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891207-3a19-4309-bb88-1d33e9200dee service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:05:59.754874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891207-3a19-4309-bb88-1d33e9200dee service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:05:59.756104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9891207-3a19-4309-bb88-1d33e9200dee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:05:59.782323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9891207-3a19-4309-bb88-1d33e9200dee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:05:59.787359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9891207-3a19-4309-bb88-1d33e9200dee service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:05:59.811474 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1986/3966] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:05:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:06:00.301184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d7859-9dbf-4e0f-ac0f-b60b64859fd0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:00.302875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d02d7859-9dbf-4e0f-ac0f-b60b64859fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:00.339100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d7859-9dbf-4e0f-ac0f-b60b64859fd0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:00.353603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f21f31-511a-4970-9148-c6164d02e913 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:00.354314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f21f31-511a-4970-9148-c6164d02e913 service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:00.354670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f21f31-511a-4970-9148-c6164d02e913 service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:00.355068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f21f31-511a-4970-9148-c6164d02e913 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:00.369079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f21f31-511a-4970-9148-c6164d02e913 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:00.375040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f21f31-511a-4970-9148-c6164d02e913 service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:00.395696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354db55-3118-4b51-999f-0b683160a1e7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:00.395981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354db55-3118-4b51-999f-0b683160a1e7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:00.396480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354db55-3118-4b51-999f-0b683160a1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:00.402654 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1981/3967] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:00.471358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2354db55-3118-4b51-999f-0b683160a1e7 None None] MFA Rules not processed for user `9fa50f553f1d42f39bd6e0f788459685`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:00.473269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2354db55-3118-4b51-999f-0b683160a1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:00.531630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a140d-f4ab-4c6f-ac77-4a56adb962c7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:00.532223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a140d-f4ab-4c6f-ac77-4a56adb962c7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:00.533693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a140d-f4ab-4c6f-ac77-4a56adb962c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:00.585959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4f8a140d-f4ab-4c6f-ac77-4a56adb962c7 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:00.586763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4f8a140d-f4ab-4c6f-ac77-4a56adb962c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:00.640022 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1982/3968] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:06:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:00.641455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9862401-e857-4200-a679-eb8bf6c24fb2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:00.641741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9862401-e857-4200-a679-eb8bf6c24fb2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:00.642013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9862401-e857-4200-a679-eb8bf6c24fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:00.702538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d9862401-e857-4200-a679-eb8bf6c24fb2 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:00.703813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d9862401-e857-4200-a679-eb8bf6c24fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:00.703991 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1987/3969] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:00.704956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354db55-3118-4b51-999f-0b683160a1e7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:00.735446 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1983/3970] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:06:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:00.737011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa91fa-eafa-41e3-9979-9e05bedd42f5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:00.737452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa91fa-eafa-41e3-9979-9e05bedd42f5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:00.738126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa91fa-eafa-41e3-9979-9e05bedd42f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:00.740458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354db55-3118-4b51-999f-0b683160a1e7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:00.759031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9b954-3d55-4997-ae52-f1834cfe64c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:00.759662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9b954-3d55-4997-ae52-f1834cfe64c8 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:00.760114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9b954-3d55-4997-ae52-f1834cfe64c8 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:00.762316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9b954-3d55-4997-ae52-f1834cfe64c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:00.774551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9b954-3d55-4997-ae52-f1834cfe64c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:00.776087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-54fa91fa-eafa-41e3-9979-9e05bedd42f5 None None] MFA Rules not processed for user `9fa50f553f1d42f39bd6e0f788459685`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:00.776392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9b954-3d55-4997-ae52-f1834cfe64c8 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:00.779178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-54fa91fa-eafa-41e3-9979-9e05bedd42f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:00.790320 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1984/3971] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:00.791794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa91fa-eafa-41e3-9979-9e05bedd42f5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:00.796174 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1988/3972] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:06:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:06:00.838918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa91fa-eafa-41e3-9979-9e05bedd42f5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:00.846318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f11ef-9f68-44ab-833f-3e4224cc926d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:00.847700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f11ef-9f68-44ab-833f-3e4224cc926d service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:00.848264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f11ef-9f68-44ab-833f-3e4224cc926d service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:00.848872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f11ef-9f68-44ab-833f-3e4224cc926d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:00.887219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f11ef-9f68-44ab-833f-3e4224cc926d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:00.892607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f11ef-9f68-44ab-833f-3e4224cc926d service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:00.958000 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1985/3973] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:06:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:06:01.118661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9b954-3d55-4997-ae52-f1834cfe64c8 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:01.276676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:01.323256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9b954-3d55-4997-ae52-f1834cfe64c8 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:01.337418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab684e96-35c5-4bc7-86a3-26b31b62ddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:01.338357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab684e96-35c5-4bc7-86a3-26b31b62ddd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:01.338951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab684e96-35c5-4bc7-86a3-26b31b62ddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:01.339909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab684e96-35c5-4bc7-86a3-26b31b62ddd8 admin admin] PATH_INFO: `/v3/users/1cafd7a9957f43a1abdfd397b62adbb5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:01.361582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab684e96-35c5-4bc7-86a3-26b31b62ddd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cafd7a9957f43a1abdfd397b62adbb5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:01.367616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab684e96-35c5-4bc7-86a3-26b31b62ddd8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:01.478665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f11ef-9f68-44ab-833f-3e4224cc926d service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:01.480890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3e2f11ef-9f68-44ab-833f-3e4224cc926d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:01.525089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab684e96-35c5-4bc7-86a3-26b31b62ddd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cafd7a9957f43a1abdfd397b62adbb5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:01.555628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab684e96-35c5-4bc7-86a3-26b31b62ddd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cafd7a9957f43a1abdfd397b62adbb5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:01.559075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab684e96-35c5-4bc7-86a3-26b31b62ddd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cafd7a9957f43a1abdfd397b62adbb5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:01.588673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab684e96-35c5-4bc7-86a3-26b31b62ddd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cafd7a9957f43a1abdfd397b62adbb5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:01.590274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab684e96-35c5-4bc7-86a3-26b31b62ddd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cafd7a9957f43a1abdfd397b62adbb5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:01.642180 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1989/3974] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:01 2022] DELETE /identity/v3/users/1cafd7a9957f43a1abdfd397b62adbb5 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:01.647028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f26aa1-ba63-4187-8e1b-931f20a11b55 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:01.647890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f26aa1-ba63-4187-8e1b-931f20a11b55 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:01.648530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f26aa1-ba63-4187-8e1b-931f20a11b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:01.692125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c9f26aa1-ba63-4187-8e1b-931f20a11b55 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:01.695988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c9f26aa1-ba63-4187-8e1b-931f20a11b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:01.833894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f11ef-9f68-44ab-833f-3e4224cc926d service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:01.853948 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1990/3975] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:01.874928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f26aa1-ba63-4187-8e1b-931f20a11b55 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:01.878103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c9f26aa1-ba63-4187-8e1b-931f20a11b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:02.014466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952df68-aa5d-45dc-ab62-6b97a3d7251f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:02.015301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952df68-aa5d-45dc-ab62-6b97a3d7251f service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:02.015655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952df68-aa5d-45dc-ab62-6b97a3d7251f service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:02.016341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f26aa1-ba63-4187-8e1b-931f20a11b55 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:02.016824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952df68-aa5d-45dc-ab62-6b97a3d7251f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:02.027204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b952df68-aa5d-45dc-ab62-6b97a3d7251f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:02.027533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc455b-c097-40aa-899e-0b984815f120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:02.028424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc455b-c097-40aa-899e-0b984815f120 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:02.028764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc455b-c097-40aa-899e-0b984815f120 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:02.029036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc455b-c097-40aa-899e-0b984815f120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:02.048986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc455b-c097-40aa-899e-0b984815f120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:02.050561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc455b-c097-40aa-899e-0b984815f120 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:02.070891 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1991/3976] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:02.130129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:02.176164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952df68-aa5d-45dc-ab62-6b97a3d7251f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:02.177940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952df68-aa5d-45dc-ab62-6b97a3d7251f service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:02.199988 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1986/3977] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:03.276230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc455b-c097-40aa-899e-0b984815f120 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:03.278518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0ecc455b-c097-40aa-899e-0b984815f120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:03.300074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc455b-c097-40aa-899e-0b984815f120 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:03.325677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:03.326542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:03.327013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:03.327440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] PATH_INFO: `/v3/projects/e93392efb81a4069a164a8f4c4a6d6b6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:03.330245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93392efb81a4069a164a8f4c4a6d6b6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:03.332403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:03.358962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:03.455723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93392efb81a4069a164a8f4c4a6d6b6', 'request_id': 'req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:03.482258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93392efb81a4069a164a8f4c4a6d6b6', 'request_id': 'req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:03.499490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93392efb81a4069a164a8f4c4a6d6b6', 'request_id': 'req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:03.528793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] The token cache is being invalidate because project e93392efb81a4069a164a8f4c4a6d6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:03.530348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:03.531665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:03.534672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6d9e-40d3-4eae-8114-411558f6a346 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:03.535998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6d9e-40d3-4eae-8114-411558f6a346 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:03.536489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6d9e-40d3-4eae-8114-411558f6a346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:03.536622 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1992/3978] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:03 2022] DELETE /identity/v3/projects/e93392efb81a4069a164a8f4c4a6d6b6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:03.541147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:03.544004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:03.587272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ac4b6d9e-40d3-4eae-8114-411558f6a346 None None] MFA Rules not processed for user `600512845bb7444b82f9fe99f1e51327`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:03.597139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ac4b6d9e-40d3-4eae-8114-411558f6a346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:03.697475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196645fc-d3f8-4490-8c9a-6e2c8e3bf707 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:03.728832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:03.731495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:03.732967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:03.734612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] PATH_INFO: `/v3/users/e5be13121018433ca5f32bd3390ad1f0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:03.739412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5be13121018433ca5f32bd3390ad1f0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:03.744704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:03.787180 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1987/3979] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:06:03.898094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5be13121018433ca5f32bd3390ad1f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:03.910576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5be13121018433ca5f32bd3390ad1f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:03.911794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5be13121018433ca5f32bd3390ad1f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:03.933363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5be13121018433ca5f32bd3390ad1f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:03.935290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5be13121018433ca5f32bd3390ad1f0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:03.986565 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1993/3980] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:03 2022] DELETE /identity/v3/users/e5be13121018433ca5f32bd3390ad1f0 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:05.896356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6d9e-40d3-4eae-8114-411558f6a346 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:05.898650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ac4b6d9e-40d3-4eae-8114-411558f6a346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:05.918521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:05.920181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:05.945200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6d9e-40d3-4eae-8114-411558f6a346 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:05.952948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:06.073649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e595a-5691-48ed-bf2e-052f7282f825 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:06.093676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c355dcd-8c25-4802-8efd-8369a7dc427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:06.094482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c355dcd-8c25-4802-8efd-8369a7dc427e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.094864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c355dcd-8c25-4802-8efd-8369a7dc427e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.095254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c355dcd-8c25-4802-8efd-8369a7dc427e admin admin] PATH_INFO: `/v3/users/34e0fcf65bd04c148f884037e16b3c09` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.097752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c355dcd-8c25-4802-8efd-8369a7dc427e admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e0fcf65bd04c148f884037e16b3c09)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:06.098307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:06.099032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.099663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c355dcd-8c25-4802-8efd-8369a7dc427e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:06.101275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.101719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104 admin admin] PATH_INFO: `/v3/projects/2987210cfc4e4b4186c63d87f4f55499` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.103200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2987210cfc4e4b4186c63d87f4f55499)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:06.121006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:06.216271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3c355dcd-8c25-4802-8efd-8369a7dc427e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e0fcf65bd04c148f884037e16b3c09'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.232155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3c355dcd-8c25-4802-8efd-8369a7dc427e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e0fcf65bd04c148f884037e16b3c09'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.233531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3c355dcd-8c25-4802-8efd-8369a7dc427e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e0fcf65bd04c148f884037e16b3c09'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.271925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3c355dcd-8c25-4802-8efd-8369a7dc427e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e0fcf65bd04c148f884037e16b3c09'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.273512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3c355dcd-8c25-4802-8efd-8369a7dc427e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e0fcf65bd04c148f884037e16b3c09'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.274610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2987210cfc4e4b4186c63d87f4f55499', 'request_id': 'req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.288919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2987210cfc4e4b4186c63d87f4f55499', 'request_id': 'req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.300051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2987210cfc4e4b4186c63d87f4f55499', 'request_id': 'req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.312694 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1988/3981] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:05 2022] DELETE /identity/v3/users/34e0fcf65bd04c148f884037e16b3c09 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:06.341987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104 admin admin] The token cache is being invalidate because project 2987210cfc4e4b4186c63d87f4f55499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:06.344110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.346061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4e257fe-08e6-44e7-9fe8-ce8ff7d68104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.350484 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1994/3982] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:05 2022] DELETE /identity/v3/projects/2987210cfc4e4b4186c63d87f4f55499 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:06.356969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d48b0-d97b-4faa-a9db-d5cc5e82093b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.357575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d48b0-d97b-4faa-a9db-d5cc5e82093b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.358043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d48b0-d97b-4faa-a9db-d5cc5e82093b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.375015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:06.400388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-da8d48b0-d97b-4faa-a9db-d5cc5e82093b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:06.401661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-da8d48b0-d97b-4faa-a9db-d5cc5e82093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:06.521600 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1989/3983] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:06.531835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d8a5d-cf4f-4db1-89ab-a003c441b3a8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.532875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d8a5d-cf4f-4db1-89ab-a003c441b3a8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.532875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d8a5d-cf4f-4db1-89ab-a003c441b3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.567602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-325d8a5d-cf4f-4db1-89ab-a003c441b3a8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:06.569465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-325d8a5d-cf4f-4db1-89ab-a003c441b3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:06.593374 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1995/3984] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:06.594084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d48b0-d97b-4faa-a9db-d5cc5e82093b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:06.622065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d48b0-d97b-4faa-a9db-d5cc5e82093b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:06.630482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d8a5d-cf4f-4db1-89ab-a003c441b3a8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:06.632824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-325d8a5d-cf4f-4db1-89ab-a003c441b3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:06.637125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4c7ef-c0a2-4630-9440-31837e0df03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:06.644521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4c7ef-c0a2-4630-9440-31837e0df03c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.644868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4c7ef-c0a2-4630-9440-31837e0df03c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.645438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4c7ef-c0a2-4630-9440-31837e0df03c admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.647030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4c7ef-c0a2-4630-9440-31837e0df03c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:06.650796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4c7ef-c0a2-4630-9440-31837e0df03c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:06.652503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4c7ef-c0a2-4630-9440-31837e0df03c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:06.655991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d8a5d-cf4f-4db1-89ab-a003c441b3a8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:06.668617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253c5df-3b67-4502-9157-79d4f4a3c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:06.669484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253c5df-3b67-4502-9157-79d4f4a3c318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.669776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253c5df-3b67-4502-9157-79d4f4a3c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.670091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253c5df-3b67-4502-9157-79d4f4a3c318 admin admin] PATH_INFO: `/v3/projects/8954f67edddb46d2b47556b3dd04091e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.671476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253c5df-3b67-4502-9157-79d4f4a3c318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8954f67edddb46d2b47556b3dd04091e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:06.675204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253c5df-3b67-4502-9157-79d4f4a3c318 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:06.682014 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1990/3985] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:06:06.683214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4c7ef-c0a2-4630-9440-31837e0df03c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:06.694886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4c7ef-c0a2-4630-9440-31837e0df03c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:06.703503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff167c-7c60-4bc6-a4ca-241b60237bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:06.704512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff167c-7c60-4bc6-a4ca-241b60237bfe admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.705097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff167c-7c60-4bc6-a4ca-241b60237bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.705874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff167c-7c60-4bc6-a4ca-241b60237bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.706865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff167c-7c60-4bc6-a4ca-241b60237bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:06.709314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff167c-7c60-4bc6-a4ca-241b60237bfe admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:06.751279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c253c5df-3b67-4502-9157-79d4f4a3c318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8954f67edddb46d2b47556b3dd04091e', 'request_id': 'req-c253c5df-3b67-4502-9157-79d4f4a3c318'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.751500 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1991/3986] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:06 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:06.753205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff167c-7c60-4bc6-a4ca-241b60237bfe admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:06.757385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c253c5df-3b67-4502-9157-79d4f4a3c318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8954f67edddb46d2b47556b3dd04091e', 'request_id': 'req-c253c5df-3b67-4502-9157-79d4f4a3c318'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.766249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c253c5df-3b67-4502-9157-79d4f4a3c318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8954f67edddb46d2b47556b3dd04091e', 'request_id': 'req-c253c5df-3b67-4502-9157-79d4f4a3c318'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.783935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c253c5df-3b67-4502-9157-79d4f4a3c318 admin admin] The token cache is being invalidate because project 8954f67edddb46d2b47556b3dd04091e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:06.784680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c253c5df-3b67-4502-9157-79d4f4a3c318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.784988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c253c5df-3b67-4502-9157-79d4f4a3c318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:06.788508 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1996/3987] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:06 2022] DELETE /identity/v3/projects/8954f67edddb46d2b47556b3dd04091e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:06:06.793557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e33a42-34bd-47cc-aad4-81dbb927e266 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.793843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e33a42-34bd-47cc-aad4-81dbb927e266 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.794120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e33a42-34bd-47cc-aad4-81dbb927e266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.820721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-93e33a42-34bd-47cc-aad4-81dbb927e266 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:06.822029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-93e33a42-34bd-47cc-aad4-81dbb927e266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:06.836855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff167c-7c60-4bc6-a4ca-241b60237bfe admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:06.841610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f87e6-669f-4900-9576-29929059fa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:06.842231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f87e6-669f-4900-9576-29929059fa0d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.842514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f87e6-669f-4900-9576-29929059fa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.842882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f87e6-669f-4900-9576-29929059fa0d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.843692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f87e6-669f-4900-9576-29929059fa0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:06.844208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:06.845847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f87e6-669f-4900-9576-29929059fa0d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:06.873908 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1992/3988] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:06 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:06.878264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f87e6-669f-4900-9576-29929059fa0d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:06.880050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bf3f87e6-669f-4900-9576-29929059fa0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:06.892566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f87e6-669f-4900-9576-29929059fa0d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:06.898016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751791f-32f9-4c84-92fa-b237033fdc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:06.899006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751791f-32f9-4c84-92fa-b237033fdc86 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.899006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751791f-32f9-4c84-92fa-b237033fdc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.899392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751791f-32f9-4c84-92fa-b237033fdc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.899852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751791f-32f9-4c84-92fa-b237033fdc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:06.901734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751791f-32f9-4c84-92fa-b237033fdc86 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:06.909860 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1997/3989] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:06:06.912255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d11edb-577e-483c-82f7-14b76aa36f41 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.913613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d11edb-577e-483c-82f7-14b76aa36f41 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.914355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d11edb-577e-483c-82f7-14b76aa36f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.915398 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1993/3990] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:06.919430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751791f-32f9-4c84-92fa-b237033fdc86 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:06.929805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751791f-32f9-4c84-92fa-b237033fdc86 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:06.935001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04575c9-7cd3-4317-a7ec-3c5055b52cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:06.935619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04575c9-7cd3-4317-a7ec-3c5055b52cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.935904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04575c9-7cd3-4317-a7ec-3c5055b52cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.936183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04575c9-7cd3-4317-a7ec-3c5055b52cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.936822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04575c9-7cd3-4317-a7ec-3c5055b52cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:06.938461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04575c9-7cd3-4317-a7ec-3c5055b52cc0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:06.941812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-24d11edb-577e-483c-82f7-14b76aa36f41 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:06.943232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-24d11edb-577e-483c-82f7-14b76aa36f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:06.950780 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1994/3991] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:06.953379 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1998/3992] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:06.954414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04575c9-7cd3-4317-a7ec-3c5055b52cc0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:06.961312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d11edb-577e-483c-82f7-14b76aa36f41 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:06.965913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04575c9-7cd3-4317-a7ec-3c5055b52cc0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:06.970771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fe472-09af-4e30-bedb-bff227a31513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:06.971892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe472-09af-4e30-bedb-bff227a31513 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.972023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe472-09af-4e30-bedb-bff227a31513 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.972210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe472-09af-4e30-bedb-bff227a31513 admin admin] PATH_INFO: `/v3/projects/7eb1c58cf49c474cb40de6258ae1d2ab/users/1ba411595e244977b9e567c6fddb67a7/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.976072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d11edb-577e-483c-82f7-14b76aa36f41 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:06.979918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5594dc3-e313-43ba-b298-17b32d9d0d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:06.980624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5594dc3-e313-43ba-b298-17b32d9d0d70 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:06.980981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5594dc3-e313-43ba-b298-17b32d9d0d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:06.981449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5594dc3-e313-43ba-b298-17b32d9d0d70 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:06.982192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5594dc3-e313-43ba-b298-17b32d9d0d70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:06.983008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5594dc3-e313-43ba-b298-17b32d9d0d70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:06.984557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5594dc3-e313-43ba-b298-17b32d9d0d70 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:06.992780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fe472-09af-4e30-bedb-bff227a31513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb1c58cf49c474cb40de6258ae1d2ab, user_id=1ba411595e244977b9e567c6fddb67a7, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:06.996040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fe472-09af-4e30-bedb-bff227a31513 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:06.999171 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 1999/3993] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:06:07.003203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5594dc3-e313-43ba-b298-17b32d9d0d70 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:07.017428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5594dc3-e313-43ba-b298-17b32d9d0d70 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:07.025557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760613bd-99d8-43ae-8884-928f77125ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:07.026275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760613bd-99d8-43ae-8884-928f77125ecb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:07.026682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760613bd-99d8-43ae-8884-928f77125ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:07.027057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760613bd-99d8-43ae-8884-928f77125ecb admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:07.027786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760613bd-99d8-43ae-8884-928f77125ecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:07.030450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760613bd-99d8-43ae-8884-928f77125ecb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:07.030952 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1995/3994] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:06 2022] PUT /identity/v3/projects/7eb1c58cf49c474cb40de6258ae1d2ab/users/1ba411595e244977b9e567c6fddb67a7/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:07.031882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fe472-09af-4e30-bedb-bff227a31513 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:07.033518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2f7fe472-09af-4e30-bedb-bff227a31513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:07.050168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:07.087271 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2000/3995] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:07 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:06:07.088311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057a6d2-8b54-4bbe-b002-fb08660cd219 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:07.088604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057a6d2-8b54-4bbe-b002-fb08660cd219 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:07.088879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057a6d2-8b54-4bbe-b002-fb08660cd219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:07.123060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b057a6d2-8b54-4bbe-b002-fb08660cd219 None None] MFA Rules not processed for user `1ba411595e244977b9e567c6fddb67a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:07.124569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b057a6d2-8b54-4bbe-b002-fb08660cd219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:07.129256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fe472-09af-4e30-bedb-bff227a31513 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:07.203226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e038a-4669-4737-9c8d-376dc64ee644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:07.203974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e038a-4669-4737-9c8d-376dc64ee644 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:07.204536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e038a-4669-4737-9c8d-376dc64ee644 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:07.204778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e038a-4669-4737-9c8d-376dc64ee644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:07.206443 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2001/3996] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:07.207484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057a6d2-8b54-4bbe-b002-fb08660cd219 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:07.212761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f06e038a-4669-4737-9c8d-376dc64ee644 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:07.288728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e038a-4669-4737-9c8d-376dc64ee644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:07.290525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e038a-4669-4737-9c8d-376dc64ee644 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:07.293072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057a6d2-8b54-4bbe-b002-fb08660cd219 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:07.298322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd514a-26e2-4304-9cbc-2f2e298f8656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:07.298961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd514a-26e2-4304-9cbc-2f2e298f8656 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:07.299243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd514a-26e2-4304-9cbc-2f2e298f8656 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:07.299515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd514a-26e2-4304-9cbc-2f2e298f8656 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:07.300151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd514a-26e2-4304-9cbc-2f2e298f8656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:07.300896 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1996/3997] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:07.302344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd514a-26e2-4304-9cbc-2f2e298f8656 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:07.307762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e038a-4669-4737-9c8d-376dc64ee644 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:07.328296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f06e038a-4669-4737-9c8d-376dc64ee644 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:07.336241 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2002/3998] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:07 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:07.341177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd514a-26e2-4304-9cbc-2f2e298f8656 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:07.353107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:07.363806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd514a-26e2-4304-9cbc-2f2e298f8656 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:07.373557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107b715-7314-40bf-8375-48d44b20d994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:07.374435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107b715-7314-40bf-8375-48d44b20d994 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:07.374958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107b715-7314-40bf-8375-48d44b20d994 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:07.375297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107b715-7314-40bf-8375-48d44b20d994 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:07.376185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107b715-7314-40bf-8375-48d44b20d994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:07.378775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107b715-7314-40bf-8375-48d44b20d994 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:07.396650 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2003/3999] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:07.397866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107b715-7314-40bf-8375-48d44b20d994 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:07.410803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107b715-7314-40bf-8375-48d44b20d994 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:07.418683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48b9c1-e8e1-4d38-9699-623152ff11ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:07.419471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b9c1-e8e1-4d38-9699-623152ff11ca admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:07.419753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b9c1-e8e1-4d38-9699-623152ff11ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:07.420123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b9c1-e8e1-4d38-9699-623152ff11ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:07.420883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48b9c1-e8e1-4d38-9699-623152ff11ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:07.422780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48b9c1-e8e1-4d38-9699-623152ff11ca admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:07.430995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:07.436402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e038a-4669-4737-9c8d-376dc64ee644 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:07.440439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2df8f5-1656-4314-bb87-416b71f76841 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:07.441068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2df8f5-1656-4314-bb87-416b71f76841 service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:07.441355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2df8f5-1656-4314-bb87-416b71f76841 service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:07.441633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2df8f5-1656-4314-bb87-416b71f76841 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:07.443138 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2004/4000] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:07.444549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48b9c1-e8e1-4d38-9699-623152ff11ca admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:07.453466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2df8f5-1656-4314-bb87-416b71f76841 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:07.455263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2df8f5-1656-4314-bb87-416b71f76841 service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:07.455914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48b9c1-e8e1-4d38-9699-623152ff11ca admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:07.461475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3cb9b-c74c-4267-90fd-e4811ed8b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:07.462526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3cb9b-c74c-4267-90fd-e4811ed8b080 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:07.463012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3cb9b-c74c-4267-90fd-e4811ed8b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:07.463356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3cb9b-c74c-4267-90fd-e4811ed8b080 admin admin] PATH_INFO: `/v3/projects/d81d1eeb030c4c1a9ecc48ef98104c82/users/dfb0da7739064336a7b00f30bca3f28c/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:07.478009 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1997/4001] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:07.484162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3cb9b-c74c-4267-90fd-e4811ed8b080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81d1eeb030c4c1a9ecc48ef98104c82, user_id=dfb0da7739064336a7b00f30bca3f28c, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:07.487304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3cb9b-c74c-4267-90fd-e4811ed8b080 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:07.509508 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2005/4002] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:07 2022] PUT /identity/v3/projects/d81d1eeb030c4c1a9ecc48ef98104c82/users/dfb0da7739064336a7b00f30bca3f28c/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:07.510838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76deb1-cf13-4f16-a0b9-8ca1ab6edd50 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:07.511141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76deb1-cf13-4f16-a0b9-8ca1ab6edd50 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:07.511425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76deb1-cf13-4f16-a0b9-8ca1ab6edd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:07.549601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ec76deb1-cf13-4f16-a0b9-8ca1ab6edd50 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:07.550877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ec76deb1-cf13-4f16-a0b9-8ca1ab6edd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:07.649778 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1998/4003] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:06:07.660177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3cb9b-c74c-4267-90fd-e4811ed8b080 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:07.662115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-efa3cb9b-c74c-4267-90fd-e4811ed8b080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:07.760254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3cb9b-c74c-4267-90fd-e4811ed8b080 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:07.765328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2359e2-33e4-48c3-9582-6e6a76cfb978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:07.765994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2359e2-33e4-48c3-9582-6e6a76cfb978 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:07.766618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2359e2-33e4-48c3-9582-6e6a76cfb978 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:07.769475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2359e2-33e4-48c3-9582-6e6a76cfb978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:07.786395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2359e2-33e4-48c3-9582-6e6a76cfb978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:07.789062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2359e2-33e4-48c3-9582-6e6a76cfb978 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:07.813037 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2006/4004] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:08.700895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76deb1-cf13-4f16-a0b9-8ca1ab6edd50 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:08.713066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76deb1-cf13-4f16-a0b9-8ca1ab6edd50 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:08.719098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:08.719956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:08.720486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:08.720842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] PATH_INFO: `/v3/users/1ba411595e244977b9e567c6fddb67a7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:08.722184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba411595e244977b9e567c6fddb67a7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:08.724357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:08.845009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba411595e244977b9e567c6fddb67a7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:08.863396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba411595e244977b9e567c6fddb67a7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:08.866605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba411595e244977b9e567c6fddb67a7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:08.906038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba411595e244977b9e567c6fddb67a7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:08.906886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba411595e244977b9e567c6fddb67a7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:08.941887 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 1999/4005] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:08 2022] DELETE /identity/v3/users/1ba411595e244977b9e567c6fddb67a7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:08.944199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba7537-8b1b-4e27-ac0e-280868396bfc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:08.944199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba7537-8b1b-4e27-ac0e-280868396bfc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:08.944896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba7537-8b1b-4e27-ac0e-280868396bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:08.983315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-49ba7537-8b1b-4e27-ac0e-280868396bfc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:08.984969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-49ba7537-8b1b-4e27-ac0e-280868396bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:09.113009 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2007/4006] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:09.127270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:09.129457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:09.255314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dfe07-8cb1-487c-b3d1-8aad0f82cbee admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:09.263272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2048fd2-7546-4d0f-86c9-1151dc91b17c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:09.266658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2048fd2-7546-4d0f-86c9-1151dc91b17c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:09.267437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2048fd2-7546-4d0f-86c9-1151dc91b17c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:09.268449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2048fd2-7546-4d0f-86c9-1151dc91b17c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:09.299598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2048fd2-7546-4d0f-86c9-1151dc91b17c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:09.301283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2048fd2-7546-4d0f-86c9-1151dc91b17c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:09.326077 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2000/4007] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:10.402518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba7537-8b1b-4e27-ac0e-280868396bfc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:10.407868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-49ba7537-8b1b-4e27-ac0e-280868396bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:10.428552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba7537-8b1b-4e27-ac0e-280868396bfc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:10.441802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb74af-7a97-4c4a-abc8-c25e18860f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:10.444821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb74af-7a97-4c4a-abc8-c25e18860f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:10.448000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb74af-7a97-4c4a-abc8-c25e18860f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:10.448466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb74af-7a97-4c4a-abc8-c25e18860f9c admin admin] PATH_INFO: `/v3/projects/7eb1c58cf49c474cb40de6258ae1d2ab` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:10.453812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb74af-7a97-4c4a-abc8-c25e18860f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb1c58cf49c474cb40de6258ae1d2ab)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:10.457106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb74af-7a97-4c4a-abc8-c25e18860f9c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:10.550988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46cb74af-7a97-4c4a-abc8-c25e18860f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb1c58cf49c474cb40de6258ae1d2ab', 'request_id': 'req-46cb74af-7a97-4c4a-abc8-c25e18860f9c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:10.556601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:10.559307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46cb74af-7a97-4c4a-abc8-c25e18860f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb1c58cf49c474cb40de6258ae1d2ab', 'request_id': 'req-46cb74af-7a97-4c4a-abc8-c25e18860f9c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:10.582706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46cb74af-7a97-4c4a-abc8-c25e18860f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb1c58cf49c474cb40de6258ae1d2ab', 'request_id': 'req-46cb74af-7a97-4c4a-abc8-c25e18860f9c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:10.610196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46cb74af-7a97-4c4a-abc8-c25e18860f9c admin admin] The token cache is being invalidate because project 7eb1c58cf49c474cb40de6258ae1d2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:10.610503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46cb74af-7a97-4c4a-abc8-c25e18860f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:10.612160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46cb74af-7a97-4c4a-abc8-c25e18860f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:10.619564 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2008/4008] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:10 2022] DELETE /identity/v3/projects/7eb1c58cf49c474cb40de6258ae1d2ab => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:10.620955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aa6d9-86a5-4dc2-b574-45e4d98b4c24 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:10.621408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aa6d9-86a5-4dc2-b574-45e4d98b4c24 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:10.622719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aa6d9-86a5-4dc2-b574-45e4d98b4c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:10.649315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:10.659501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-be6aa6d9-86a5-4dc2-b574-45e4d98b4c24 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:10.661987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-be6aa6d9-86a5-4dc2-b574-45e4d98b4c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:10.823255 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2001/4009] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:10.831137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5611b-dded-4e1d-a542-63696af15522 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:10.831370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5611b-dded-4e1d-a542-63696af15522 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:10.831627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5611b-dded-4e1d-a542-63696af15522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:10.854307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f1c5611b-dded-4e1d-a542-63696af15522 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:10.855852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f1c5611b-dded-4e1d-a542-63696af15522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:10.869997 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2009/4010] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:10.874457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aa6d9-86a5-4dc2-b574-45e4d98b4c24 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:10.885280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aa6d9-86a5-4dc2-b574-45e4d98b4c24 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:10.895367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f9b3d-a1c9-4da4-b449-86408dd0ad04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:10.898271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f9b3d-a1c9-4da4-b449-86408dd0ad04 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:10.898588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f9b3d-a1c9-4da4-b449-86408dd0ad04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:10.898908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f9b3d-a1c9-4da4-b449-86408dd0ad04 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:10.899773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f9b3d-a1c9-4da4-b449-86408dd0ad04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:10.900088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f9b3d-a1c9-4da4-b449-86408dd0ad04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:10.901897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f9b3d-a1c9-4da4-b449-86408dd0ad04 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:10.918668 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2002/4011] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:06:10.921420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5611b-dded-4e1d-a542-63696af15522 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:10.932913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5611b-dded-4e1d-a542-63696af15522 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:10.948755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b9a15-e64a-4be1-804d-1d8dcb5b5aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:10.949687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b9a15-e64a-4be1-804d-1d8dcb5b5aaf admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:10.950177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b9a15-e64a-4be1-804d-1d8dcb5b5aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:10.950696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b9a15-e64a-4be1-804d-1d8dcb5b5aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:10.951610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b9a15-e64a-4be1-804d-1d8dcb5b5aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:10.954873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b9a15-e64a-4be1-804d-1d8dcb5b5aaf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:11.002454 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2010/4012] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:10 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:06:11.003045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f9b3d-a1c9-4da4-b449-86408dd0ad04 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:11.025421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f9b3d-a1c9-4da4-b449-86408dd0ad04 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:11.153818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97272d08-9c8c-4c22-8a84-d365fc0b4fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:11.154540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97272d08-9c8c-4c22-8a84-d365fc0b4fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:11.155062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97272d08-9c8c-4c22-8a84-d365fc0b4fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:11.155420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97272d08-9c8c-4c22-8a84-d365fc0b4fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:11.156153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97272d08-9c8c-4c22-8a84-d365fc0b4fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:11.158475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97272d08-9c8c-4c22-8a84-d365fc0b4fd5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:11.203761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b9a15-e64a-4be1-804d-1d8dcb5b5aaf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:11.204997 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2003/4013] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:11 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:06:11.220354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b9a15-e64a-4be1-804d-1d8dcb5b5aaf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:11.240358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51731d-f655-4588-849a-3d7da0545d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:11.242547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51731d-f655-4588-849a-3d7da0545d05 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:11.243167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51731d-f655-4588-849a-3d7da0545d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:11.243527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51731d-f655-4588-849a-3d7da0545d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:11.245223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51731d-f655-4588-849a-3d7da0545d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:11.247435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51731d-f655-4588-849a-3d7da0545d05 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:11.274467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97272d08-9c8c-4c22-8a84-d365fc0b4fd5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:11.294982 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2011/4014] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:11.298492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97272d08-9c8c-4c22-8a84-d365fc0b4fd5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:11.310769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1dc58-20b0-4f75-9586-378ece12191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:11.312887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1dc58-20b0-4f75-9586-378ece12191c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:11.313357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1dc58-20b0-4f75-9586-378ece12191c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:11.314522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1dc58-20b0-4f75-9586-378ece12191c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:11.315738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1dc58-20b0-4f75-9586-378ece12191c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:11.321062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1dc58-20b0-4f75-9586-378ece12191c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:11.391403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51731d-f655-4588-849a-3d7da0545d05 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:11.415076 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2004/4015] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:11.416626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51731d-f655-4588-849a-3d7da0545d05 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:11.435391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550d987-2aed-4661-9927-4980de2e94ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:11.436092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550d987-2aed-4661-9927-4980de2e94ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:11.436361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550d987-2aed-4661-9927-4980de2e94ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:11.436850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550d987-2aed-4661-9927-4980de2e94ac admin admin] PATH_INFO: `/v3/projects/5b796a342deb4d9b9bb7f71975673772/users/69d8377796f143a8b85266c30ff863ce/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:11.470515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550d987-2aed-4661-9927-4980de2e94ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b796a342deb4d9b9bb7f71975673772, user_id=69d8377796f143a8b85266c30ff863ce, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:11.479088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550d987-2aed-4661-9927-4980de2e94ac admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:11.524609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c686325-018b-4282-84aa-bfc22eecc5ea None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:11.525054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c686325-018b-4282-84aa-bfc22eecc5ea None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:11.525217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c686325-018b-4282-84aa-bfc22eecc5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:11.531646 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2012/4016] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:11 2022] PUT /identity/v3/projects/5b796a342deb4d9b9bb7f71975673772/users/69d8377796f143a8b85266c30ff863ce/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:11.609582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3c686325-018b-4282-84aa-bfc22eecc5ea None None] MFA Rules not processed for user `69d8377796f143a8b85266c30ff863ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:11.610066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3c686325-018b-4282-84aa-bfc22eecc5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:11.722655 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2005/4017] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:11.732590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550d987-2aed-4661-9927-4980de2e94ac admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:11.735134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5550d987-2aed-4661-9927-4980de2e94ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:11.844024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550d987-2aed-4661-9927-4980de2e94ac admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:11.851397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e368c3-96ac-4a8d-863b-e13d474e828a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:11.852203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e368c3-96ac-4a8d-863b-e13d474e828a service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:11.852591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e368c3-96ac-4a8d-863b-e13d474e828a service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:11.853115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e368c3-96ac-4a8d-863b-e13d474e828a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:11.891666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e368c3-96ac-4a8d-863b-e13d474e828a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:11.897105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e368c3-96ac-4a8d-863b-e13d474e828a service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:11.929557 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2013/4018] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:12.360397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c686325-018b-4282-84aa-bfc22eecc5ea None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:12.365054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:12.479624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c686325-018b-4282-84aa-bfc22eecc5ea None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:12.486495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:12.487363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:12.487599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:12.487883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] PATH_INFO: `/v3/users/69d8377796f143a8b85266c30ff863ce` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:12.489059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d8377796f143a8b85266c30ff863ce)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:12.493558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:12.582122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d8377796f143a8b85266c30ff863ce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:12.623311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d8377796f143a8b85266c30ff863ce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:12.624144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d8377796f143a8b85266c30ff863ce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:12.646692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d8377796f143a8b85266c30ff863ce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:12.647741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d8377796f143a8b85266c30ff863ce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:12.670819 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2006/4019] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:12 2022] DELETE /identity/v3/users/69d8377796f143a8b85266c30ff863ce => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:12.673380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3598ae-f4a7-4d99-a319-b0a273554944 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:12.673859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3598ae-f4a7-4d99-a319-b0a273554944 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:12.676091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3598ae-f4a7-4d99-a319-b0a273554944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:12.743046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fd3598ae-f4a7-4d99-a319-b0a273554944 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:12.749532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fd3598ae-f4a7-4d99-a319-b0a273554944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:12.942970 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2014/4020] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:12.972518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:12.974582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:13.113568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f947662-4153-48ca-8d33-a8ad92e3be1e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:13.125376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72710f-8ea9-4a85-bdb0-d001323d11de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:13.126021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72710f-8ea9-4a85-bdb0-d001323d11de service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:13.126293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72710f-8ea9-4a85-bdb0-d001323d11de service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:13.126729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72710f-8ea9-4a85-bdb0-d001323d11de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:13.183622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72710f-8ea9-4a85-bdb0-d001323d11de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:13.188141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72710f-8ea9-4a85-bdb0-d001323d11de service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:13.213968 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2007/4021] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:14.261311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3598ae-f4a7-4d99-a319-b0a273554944 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:14.263459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fd3598ae-f4a7-4d99-a319-b0a273554944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:14.285238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3598ae-f4a7-4d99-a319-b0a273554944 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:14.301067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a184234-2336-49d0-9e7e-943e3b936590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:14.304201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a184234-2336-49d0-9e7e-943e3b936590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:14.306822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a184234-2336-49d0-9e7e-943e3b936590 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:14.307284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a184234-2336-49d0-9e7e-943e3b936590 admin admin] PATH_INFO: `/v3/projects/5b796a342deb4d9b9bb7f71975673772` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:14.311638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a184234-2336-49d0-9e7e-943e3b936590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b796a342deb4d9b9bb7f71975673772)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:14.319427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a184234-2336-49d0-9e7e-943e3b936590 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:14.368651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:14.464735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9a184234-2336-49d0-9e7e-943e3b936590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b796a342deb4d9b9bb7f71975673772', 'request_id': 'req-9a184234-2336-49d0-9e7e-943e3b936590'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:14.478671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9a184234-2336-49d0-9e7e-943e3b936590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b796a342deb4d9b9bb7f71975673772', 'request_id': 'req-9a184234-2336-49d0-9e7e-943e3b936590'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:14.498306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9a184234-2336-49d0-9e7e-943e3b936590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b796a342deb4d9b9bb7f71975673772', 'request_id': 'req-9a184234-2336-49d0-9e7e-943e3b936590'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:14.535314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9a184234-2336-49d0-9e7e-943e3b936590 admin admin] The token cache is being invalidate because project 5b796a342deb4d9b9bb7f71975673772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:14.535632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9a184234-2336-49d0-9e7e-943e3b936590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:14.537909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9a184234-2336-49d0-9e7e-943e3b936590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:14.541375 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2015/4022] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:14 2022] DELETE /identity/v3/projects/5b796a342deb4d9b9bb7f71975673772 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:14.548724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6557bf2-719d-48e9-ab3b-ee9e9dcebb4f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:14.549878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6557bf2-719d-48e9-ab3b-ee9e9dcebb4f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:14.550514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6557bf2-719d-48e9-ab3b-ee9e9dcebb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:14.577900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a6557bf2-719d-48e9-ab3b-ee9e9dcebb4f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:14.580542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a6557bf2-719d-48e9-ab3b-ee9e9dcebb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:14.620506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:14.702442 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2008/4023] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:14.714560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945e77b-d75d-4cf5-bbf6-8acddf3042c5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:14.715579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945e77b-d75d-4cf5-bbf6-8acddf3042c5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:14.716267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945e77b-d75d-4cf5-bbf6-8acddf3042c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:14.759734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a945e77b-d75d-4cf5-bbf6-8acddf3042c5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:14.761188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a945e77b-d75d-4cf5-bbf6-8acddf3042c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:14.783711 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2016/4024] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:14.785894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6557bf2-719d-48e9-ab3b-ee9e9dcebb4f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:14.821929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6557bf2-719d-48e9-ab3b-ee9e9dcebb4f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:14.840428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9372b-656c-4c4d-a415-84a176638606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:14.841394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9372b-656c-4c4d-a415-84a176638606 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:14.841836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9372b-656c-4c4d-a415-84a176638606 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:14.842272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9372b-656c-4c4d-a415-84a176638606 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:14.843435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9372b-656c-4c4d-a415-84a176638606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:14.843918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9372b-656c-4c4d-a415-84a176638606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:14.846882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9372b-656c-4c4d-a415-84a176638606 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:14.884668 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2009/4025] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:06:14.885870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945e77b-d75d-4cf5-bbf6-8acddf3042c5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:14.903225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945e77b-d75d-4cf5-bbf6-8acddf3042c5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:14.913142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1629451-259b-4cd9-8577-bb12e52acf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:14.916137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1629451-259b-4cd9-8577-bb12e52acf48 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:14.916592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1629451-259b-4cd9-8577-bb12e52acf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:14.927415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1629451-259b-4cd9-8577-bb12e52acf48 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:14.928172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1629451-259b-4cd9-8577-bb12e52acf48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:14.942851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1629451-259b-4cd9-8577-bb12e52acf48 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:15.049717 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2017/4026] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:14 2022] POST /identity/v3/projects => generated 357 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:15.054587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9372b-656c-4c4d-a415-84a176638606 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:15.080650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9372b-656c-4c4d-a415-84a176638606 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:15.221859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ac828-b52b-41ff-9d9f-d98fc9b3577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:15.222495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ac828-b52b-41ff-9d9f-d98fc9b3577c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:15.222874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ac828-b52b-41ff-9d9f-d98fc9b3577c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:15.223598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ac828-b52b-41ff-9d9f-d98fc9b3577c admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:15.223696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ac828-b52b-41ff-9d9f-d98fc9b3577c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:15.229411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ac828-b52b-41ff-9d9f-d98fc9b3577c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:15.299724 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2010/4027] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:15 2022] POST /identity/v3/users => generated 279 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:15.302067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1629451-259b-4cd9-8577-bb12e52acf48 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:15.318297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1629451-259b-4cd9-8577-bb12e52acf48 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:15.329686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64808ac5-0a32-4c92-96a3-95b36da54a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:15.331385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808ac5-0a32-4c92-96a3-95b36da54a7e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:15.332971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808ac5-0a32-4c92-96a3-95b36da54a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:15.333683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808ac5-0a32-4c92-96a3-95b36da54a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:15.337047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64808ac5-0a32-4c92-96a3-95b36da54a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:15.341213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64808ac5-0a32-4c92-96a3-95b36da54a7e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:15.371073 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2018/4028] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:15.376983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ac828-b52b-41ff-9d9f-d98fc9b3577c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:15.406592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ac828-b52b-41ff-9d9f-d98fc9b3577c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:15.418622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3225b58-6ee2-4bb1-a7b5-0b25b3fafd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:15.420041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225b58-6ee2-4bb1-a7b5-0b25b3fafd42 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:15.420619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225b58-6ee2-4bb1-a7b5-0b25b3fafd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:15.421411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225b58-6ee2-4bb1-a7b5-0b25b3fafd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:15.422724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3225b58-6ee2-4bb1-a7b5-0b25b3fafd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:15.431235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3225b58-6ee2-4bb1-a7b5-0b25b3fafd42 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:15.449407 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2011/4029] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:15.453412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64808ac5-0a32-4c92-96a3-95b36da54a7e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:15.468265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64808ac5-0a32-4c92-96a3-95b36da54a7e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:15.483548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af66674-5c18-4ac9-bc14-e2e0e2e63bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:15.484224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af66674-5c18-4ac9-bc14-e2e0e2e63bab admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:15.484512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af66674-5c18-4ac9-bc14-e2e0e2e63bab admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:15.484794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af66674-5c18-4ac9-bc14-e2e0e2e63bab admin admin] PATH_INFO: `/v3/projects/1ef7a70d206748beb8d2091d29aa18d8/users/38e89fc107a340619d75de9a651fd6c2/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:15.572849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af66674-5c18-4ac9-bc14-e2e0e2e63bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef7a70d206748beb8d2091d29aa18d8, user_id=38e89fc107a340619d75de9a651fd6c2, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:15.577718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af66674-5c18-4ac9-bc14-e2e0e2e63bab admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:15.613274 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2019/4030] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:15 2022] PUT /identity/v3/projects/1ef7a70d206748beb8d2091d29aa18d8/users/38e89fc107a340619d75de9a651fd6c2/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:06:15.638329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ca4fb-5ef9-4436-ac53-9ae078310eea None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:15.638841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ca4fb-5ef9-4436-ac53-9ae078310eea None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:15.638968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ca4fb-5ef9-4436-ac53-9ae078310eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:15.696223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ac5ca4fb-5ef9-4436-ac53-9ae078310eea None None] MFA Rules not processed for user `38e89fc107a340619d75de9a651fd6c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:15.698090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ac5ca4fb-5ef9-4436-ac53-9ae078310eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:15.841808 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2012/4031] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:15.843230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af66674-5c18-4ac9-bc14-e2e0e2e63bab admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:15.947465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af66674-5c18-4ac9-bc14-e2e0e2e63bab admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:15.953684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c58d3-4467-4702-a83c-e5d4fcc3025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:15.954705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c58d3-4467-4702-a83c-e5d4fcc3025f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:15.955247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c58d3-4467-4702-a83c-e5d4fcc3025f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:15.955536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c58d3-4467-4702-a83c-e5d4fcc3025f admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:15.956235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c58d3-4467-4702-a83c-e5d4fcc3025f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:15.958612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c58d3-4467-4702-a83c-e5d4fcc3025f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:16.002432 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2020/4032] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:15 2022] POST /identity/v3/projects => generated 357 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:16.010614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ca4fb-5ef9-4436-ac53-9ae078310eea None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:16.033374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ca4fb-5ef9-4436-ac53-9ae078310eea None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:16.060217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:16.155803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69282991-6ee3-4491-b482-933def02d5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:16.156667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69282991-6ee3-4491-b482-933def02d5fd admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:16.157489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69282991-6ee3-4491-b482-933def02d5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:16.157938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69282991-6ee3-4491-b482-933def02d5fd admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:16.158757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69282991-6ee3-4491-b482-933def02d5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:16.163172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69282991-6ee3-4491-b482-933def02d5fd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:16.248326 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2013/4033] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:16 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:16.250020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c58d3-4467-4702-a83c-e5d4fcc3025f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:16.270393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c58d3-4467-4702-a83c-e5d4fcc3025f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:16.285032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9184047-9f9d-4e2b-aa52-a7e17283e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:16.285839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9184047-9f9d-4e2b-aa52-a7e17283e2be admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:16.286623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9184047-9f9d-4e2b-aa52-a7e17283e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:16.286623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9184047-9f9d-4e2b-aa52-a7e17283e2be admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:16.288001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9184047-9f9d-4e2b-aa52-a7e17283e2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:16.292015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9184047-9f9d-4e2b-aa52-a7e17283e2be admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:16.319898 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2021/4034] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:16.324705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69282991-6ee3-4491-b482-933def02d5fd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:16.338927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69282991-6ee3-4491-b482-933def02d5fd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:16.357186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c4559-6125-4b73-9f62-1d5ec4314c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:16.358101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4559-6125-4b73-9f62-1d5ec4314c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:16.358526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4559-6125-4b73-9f62-1d5ec4314c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:16.359202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c4559-6125-4b73-9f62-1d5ec4314c96 admin admin] PATH_INFO: `/v3/projects/b714569e16a34182bc4dd14f94980110/users/0aac9f1edf6e4dc3bbe6b296de9e1102/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:16.407896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c4559-6125-4b73-9f62-1d5ec4314c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b714569e16a34182bc4dd14f94980110, user_id=0aac9f1edf6e4dc3bbe6b296de9e1102, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:16.410726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c4559-6125-4b73-9f62-1d5ec4314c96 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:16.439290 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2014/4035] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:16 2022] PUT /identity/v3/projects/b714569e16a34182bc4dd14f94980110/users/0aac9f1edf6e4dc3bbe6b296de9e1102/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:16.440665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9184047-9f9d-4e2b-aa52-a7e17283e2be admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:16.462587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9184047-9f9d-4e2b-aa52-a7e17283e2be admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:16.492142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:16.587751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93a6e6-70b6-47fc-b56d-23b3fcc84b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:16.589755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93a6e6-70b6-47fc-b56d-23b3fcc84b79 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:16.590440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93a6e6-70b6-47fc-b56d-23b3fcc84b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:16.593103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93a6e6-70b6-47fc-b56d-23b3fcc84b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:16.594083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93a6e6-70b6-47fc-b56d-23b3fcc84b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:16.605775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93a6e6-70b6-47fc-b56d-23b3fcc84b79 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:16.633009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c4559-6125-4b73-9f62-1d5ec4314c96 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:16.641300 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2022/4036] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:06:16.666941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c4559-6125-4b73-9f62-1d5ec4314c96 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:16.682965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae6ad8-b79c-4d9e-81e4-dbb05be3fd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:16.683824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae6ad8-b79c-4d9e-81e4-dbb05be3fd12 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:16.685704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae6ad8-b79c-4d9e-81e4-dbb05be3fd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:16.686133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae6ad8-b79c-4d9e-81e4-dbb05be3fd12 admin admin] PATH_INFO: `/v3/projects/b714569e16a34182bc4dd14f94980110/users/0aac9f1edf6e4dc3bbe6b296de9e1102/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:16.689722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae6ad8-b79c-4d9e-81e4-dbb05be3fd12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b714569e16a34182bc4dd14f94980110, user_id=0aac9f1edf6e4dc3bbe6b296de9e1102, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:16.692676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae6ad8-b79c-4d9e-81e4-dbb05be3fd12 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:16.732460 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2015/4037] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:16 2022] PUT /identity/v3/projects/b714569e16a34182bc4dd14f94980110/users/0aac9f1edf6e4dc3bbe6b296de9e1102/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:16.735466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a5d47-7244-4bb2-b1b6-a10c372b9bb2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:16.735756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a5d47-7244-4bb2-b1b6-a10c372b9bb2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:16.736038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a5d47-7244-4bb2-b1b6-a10c372b9bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:16.780281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d77a5d47-7244-4bb2-b1b6-a10c372b9bb2 None None] MFA Rules not processed for user `0aac9f1edf6e4dc3bbe6b296de9e1102`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:16.781870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d77a5d47-7244-4bb2-b1b6-a10c372b9bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:16.951310 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2023/4038] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:16.953112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae6ad8-b79c-4d9e-81e4-dbb05be3fd12 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:16.967984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae6ad8-b79c-4d9e-81e4-dbb05be3fd12 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:16.981592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d60565-393f-49b1-bae9-0eee9af7ec26 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aac9f1edf6e4dc3bbe6b296de9e1102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b714569e16a34182bc4dd14f94980110', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:16.982436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d60565-393f-49b1-bae9-0eee9af7ec26 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:16.982868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d60565-393f-49b1-bae9-0eee9af7ec26 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:16.983277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d60565-393f-49b1-bae9-0eee9af7ec26 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:16.984054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d60565-393f-49b1-bae9-0eee9af7ec26 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:16.984468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d60565-393f-49b1-bae9-0eee9af7ec26 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:16.988808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d60565-393f-49b1-bae9-0eee9af7ec26 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:17.013196 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2016/4039] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:06:17.017252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a5d47-7244-4bb2-b1b6-a10c372b9bb2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:17.032544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a5d47-7244-4bb2-b1b6-a10c372b9bb2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:17.039196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaaef6-0af3-4fbe-bcfe-a7b35bb8e20f tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aac9f1edf6e4dc3bbe6b296de9e1102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b714569e16a34182bc4dd14f94980110', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:17.039898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaaef6-0af3-4fbe-bcfe-a7b35bb8e20f tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:17.040180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaaef6-0af3-4fbe-bcfe-a7b35bb8e20f tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:17.040456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaaef6-0af3-4fbe-bcfe-a7b35bb8e20f tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:17.041223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaaef6-0af3-4fbe-bcfe-a7b35bb8e20f tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:17.044103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaaef6-0af3-4fbe-bcfe-a7b35bb8e20f tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:17.089347 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2024/4040] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:17 2022] POST /identity/v3/projects => generated 348 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:17.093622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d60565-393f-49b1-bae9-0eee9af7ec26 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:17.109860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d60565-393f-49b1-bae9-0eee9af7ec26 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:17.248530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33aa0b-1515-4dee-9b9b-b446dd12ca68 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aac9f1edf6e4dc3bbe6b296de9e1102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b714569e16a34182bc4dd14f94980110', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:17.249174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33aa0b-1515-4dee-9b9b-b446dd12ca68 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:17.249458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33aa0b-1515-4dee-9b9b-b446dd12ca68 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:17.249736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33aa0b-1515-4dee-9b9b-b446dd12ca68 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:17.250387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33aa0b-1515-4dee-9b9b-b446dd12ca68 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:17.250690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33aa0b-1515-4dee-9b9b-b446dd12ca68 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:17.253169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33aa0b-1515-4dee-9b9b-b446dd12ca68 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:17.274815 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2017/4041] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:06:17.286764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaaef6-0af3-4fbe-bcfe-a7b35bb8e20f tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:17.291659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b6eaaef6-0af3-4fbe-bcfe-a7b35bb8e20f tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:17.369403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaaef6-0af3-4fbe-bcfe-a7b35bb8e20f tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:17.373654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef00a50-c7f5-4e3d-8483-339153cec6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:17.374281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef00a50-c7f5-4e3d-8483-339153cec6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:17.374624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef00a50-c7f5-4e3d-8483-339153cec6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:17.375090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef00a50-c7f5-4e3d-8483-339153cec6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:17.389771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef00a50-c7f5-4e3d-8483-339153cec6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:17.391432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef00a50-c7f5-4e3d-8483-339153cec6a8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:17.425207 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2025/4042] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:06:18.101585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33aa0b-1515-4dee-9b9b-b446dd12ca68 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:18.119342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33aa0b-1515-4dee-9b9b-b446dd12ca68 tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:18.130649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aac9f1edf6e4dc3bbe6b296de9e1102', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b714569e16a34182bc4dd14f94980110', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:18.131886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:18.132452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:18.132897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] PATH_INFO: `/v3/projects/56b0a02356f747aba9863448ceb4ddbb` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:18.136654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: Authorizing `identity:delete_project(project_id=56b0a02356f747aba9863448ceb4ddbb)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:18.145203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:18.243883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:18.249937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b0a02356f747aba9863448ceb4ddbb', 'request_id': 'req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:18.265171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b0a02356f747aba9863448ceb4ddbb', 'request_id': 'req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:18.274600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b0a02356f747aba9863448ceb4ddbb', 'request_id': 'req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:18.299590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] The token cache is being invalidate because project 56b0a02356f747aba9863448ceb4ddbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:18.299981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:18.300754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-95a0010e-b86d-4ff8-97a1-1926dd11bb1b tempest-QuotasTest-1133882374 tempest-QuotasTest-1133882374-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:18.302655 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2018/4043] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:18 2022] DELETE /identity/v3/projects/56b0a02356f747aba9863448ceb4ddbb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:18.707739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef00a50-c7f5-4e3d-8483-339153cec6a8 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:18.744162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:18.848175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef00a50-c7f5-4e3d-8483-339153cec6a8 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:18.926320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:18.927208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:18.927950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:18.928056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] PATH_INFO: `/v3/users/38e89fc107a340619d75de9a651fd6c2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:18.929787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e89fc107a340619d75de9a651fd6c2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:18.932045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:19.002311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e89fc107a340619d75de9a651fd6c2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:19.013521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e89fc107a340619d75de9a651fd6c2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:19.014512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e89fc107a340619d75de9a651fd6c2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:19.027083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e89fc107a340619d75de9a651fd6c2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:19.028712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e89fc107a340619d75de9a651fd6c2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:19.057995 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2026/4044] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:18 2022] DELETE /identity/v3/users/38e89fc107a340619d75de9a651fd6c2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:19.062525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237f3b1-f80b-406b-8689-48200d091210 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:19.062846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237f3b1-f80b-406b-8689-48200d091210 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:19.063219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237f3b1-f80b-406b-8689-48200d091210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:19.111014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2237f3b1-f80b-406b-8689-48200d091210 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:19.114183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2237f3b1-f80b-406b-8689-48200d091210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:19.285239 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2019/4045] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:19.306912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:19.308627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:19.409219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:19.427689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79657a-0df0-4db7-8ead-a3ac63e4076f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:19.433967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad11d5-877c-4ceb-900e-89bbadfa9eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:19.434598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad11d5-877c-4ceb-900e-89bbadfa9eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:19.435098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad11d5-877c-4ceb-900e-89bbadfa9eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:19.435370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad11d5-877c-4ceb-900e-89bbadfa9eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:19.447716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad11d5-877c-4ceb-900e-89bbadfa9eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:19.454509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad11d5-877c-4ceb-900e-89bbadfa9eb3 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:19.467815 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2027/4046] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:06:20.204014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237f3b1-f80b-406b-8689-48200d091210 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:20.205819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2237f3b1-f80b-406b-8689-48200d091210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:20.261370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237f3b1-f80b-406b-8689-48200d091210 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:20.277139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:20.281291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:20.281535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:20.281829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] PATH_INFO: `/v3/projects/1ef7a70d206748beb8d2091d29aa18d8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:20.288388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef7a70d206748beb8d2091d29aa18d8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:20.290367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:20.391992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef7a70d206748beb8d2091d29aa18d8', 'request_id': 'req-e914a89a-ce48-4faa-90f5-e9f10b505e98'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.402331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef7a70d206748beb8d2091d29aa18d8', 'request_id': 'req-e914a89a-ce48-4faa-90f5-e9f10b505e98'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.414577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef7a70d206748beb8d2091d29aa18d8', 'request_id': 'req-e914a89a-ce48-4faa-90f5-e9f10b505e98'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.426763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] The token cache is being invalidate because project 1ef7a70d206748beb8d2091d29aa18d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:20.427049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.428375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.430305 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2020/4047] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:20 2022] DELETE /identity/v3/projects/1ef7a70d206748beb8d2091d29aa18d8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:20.434291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad11d5-877c-4ceb-900e-89bbadfa9eb3 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:20.446206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad11d5-877c-4ceb-900e-89bbadfa9eb3 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:20.522784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b15cae-a668-4324-83af-7e5280a45f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:20.523791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b15cae-a668-4324-83af-7e5280a45f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:20.524262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b15cae-a668-4324-83af-7e5280a45f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:20.524541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b15cae-a668-4324-83af-7e5280a45f09 admin admin] PATH_INFO: `/v3/users/0aac9f1edf6e4dc3bbe6b296de9e1102` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:20.525901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b15cae-a668-4324-83af-7e5280a45f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aac9f1edf6e4dc3bbe6b296de9e1102)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:20.528258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b15cae-a668-4324-83af-7e5280a45f09 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:20.598910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2b15cae-a668-4324-83af-7e5280a45f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aac9f1edf6e4dc3bbe6b296de9e1102'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.614006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2b15cae-a668-4324-83af-7e5280a45f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aac9f1edf6e4dc3bbe6b296de9e1102'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.614826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2b15cae-a668-4324-83af-7e5280a45f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aac9f1edf6e4dc3bbe6b296de9e1102'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.633029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2b15cae-a668-4324-83af-7e5280a45f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aac9f1edf6e4dc3bbe6b296de9e1102'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.634005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2b15cae-a668-4324-83af-7e5280a45f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aac9f1edf6e4dc3bbe6b296de9e1102'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.663835 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2028/4048] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:20 2022] DELETE /identity/v3/users/0aac9f1edf6e4dc3bbe6b296de9e1102 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:20.747604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:20.751041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:20.769339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914a89a-ce48-4faa-90f5-e9f10b505e98 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:20.835143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:20.836457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:20.836741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:20.837011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] PATH_INFO: `/v3/users/c4935f1dcb9949b390e162b865d85bfb` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:20.838264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4935f1dcb9949b390e162b865d85bfb)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:20.840223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:20.842031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:20.896209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4935f1dcb9949b390e162b865d85bfb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.907887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4935f1dcb9949b390e162b865d85bfb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.908653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4935f1dcb9949b390e162b865d85bfb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.923365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4935f1dcb9949b390e162b865d85bfb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.924103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4935f1dcb9949b390e162b865d85bfb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:20.941089 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2021/4049] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:20 2022] DELETE /identity/v3/users/c4935f1dcb9949b390e162b865d85bfb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:20.945801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd50c3d-1350-42bc-a8ff-78629ff93039 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:20.946089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd50c3d-1350-42bc-a8ff-78629ff93039 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:20.946370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd50c3d-1350-42bc-a8ff-78629ff93039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:20.974122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7bd50c3d-1350-42bc-a8ff-78629ff93039 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:20.976172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7bd50c3d-1350-42bc-a8ff-78629ff93039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:21.056821 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2029/4050] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:06:21.070128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:21.072192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:21.160275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed53ab-a0c3-47ef-9c7e-aed41cc9cda7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:21.186380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ccba5-7968-470b-9e4b-7b48925ee1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:21.187348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ccba5-7968-470b-9e4b-7b48925ee1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:21.188248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ccba5-7968-470b-9e4b-7b48925ee1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:21.188855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ccba5-7968-470b-9e4b-7b48925ee1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:21.218065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ccba5-7968-470b-9e4b-7b48925ee1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:21.220233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ccba5-7968-470b-9e4b-7b48925ee1b9 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:21.254111 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2022/4051] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:06:21.392015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd50c3d-1350-42bc-a8ff-78629ff93039 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:21.393748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7bd50c3d-1350-42bc-a8ff-78629ff93039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:21.412726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd50c3d-1350-42bc-a8ff-78629ff93039 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:21.420092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0b56a-b299-414f-bba6-984c6d9b77bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:21.420747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b56a-b299-414f-bba6-984c6d9b77bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:21.421028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b56a-b299-414f-bba6-984c6d9b77bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:21.421317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0b56a-b299-414f-bba6-984c6d9b77bc admin admin] PATH_INFO: `/v3/projects/b714569e16a34182bc4dd14f94980110` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:21.422497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0b56a-b299-414f-bba6-984c6d9b77bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b714569e16a34182bc4dd14f94980110)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:21.426010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0b56a-b299-414f-bba6-984c6d9b77bc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:21.429996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:21.501626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3f0b56a-b299-414f-bba6-984c6d9b77bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b714569e16a34182bc4dd14f94980110', 'request_id': 'req-d3f0b56a-b299-414f-bba6-984c6d9b77bc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:21.510173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3f0b56a-b299-414f-bba6-984c6d9b77bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b714569e16a34182bc4dd14f94980110', 'request_id': 'req-d3f0b56a-b299-414f-bba6-984c6d9b77bc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:21.518246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3f0b56a-b299-414f-bba6-984c6d9b77bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b714569e16a34182bc4dd14f94980110', 'request_id': 'req-d3f0b56a-b299-414f-bba6-984c6d9b77bc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:21.532049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ccba5-7968-470b-9e4b-7b48925ee1b9 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:21.534548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-775ccba5-7968-470b-9e4b-7b48925ee1b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:21.549266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3f0b56a-b299-414f-bba6-984c6d9b77bc admin admin] The token cache is being invalidate because project b714569e16a34182bc4dd14f94980110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:21.551765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ccba5-7968-470b-9e4b-7b48925ee1b9 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:21.552257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3f0b56a-b299-414f-bba6-984c6d9b77bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:21.554441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3f0b56a-b299-414f-bba6-984c6d9b77bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:21.557032 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2030/4052] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:21 2022] DELETE /identity/v3/projects/b714569e16a34182bc4dd14f94980110 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:21.570698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2a27e-02eb-4cf4-8ec5-319beb97e59b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:21.583580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2a27e-02eb-4cf4-8ec5-319beb97e59b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:21.583580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2a27e-02eb-4cf4-8ec5-319beb97e59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:21.609972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-35b2a27e-02eb-4cf4-8ec5-319beb97e59b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:21.611345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-35b2a27e-02eb-4cf4-8ec5-319beb97e59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:21.657051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937e566-d94b-4c21-8752-28a4696782d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:21.657790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937e566-d94b-4c21-8752-28a4696782d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:21.658315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937e566-d94b-4c21-8752-28a4696782d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:21.658874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937e566-d94b-4c21-8752-28a4696782d5 admin admin] PATH_INFO: `/v3/projects/15543c90b4bc4850bcc83124d8cd832a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:21.660258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937e566-d94b-4c21-8752-28a4696782d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15543c90b4bc4850bcc83124d8cd832a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:21.662233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937e566-d94b-4c21-8752-28a4696782d5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:21.682870 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2031/4053] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:06:21.693069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e5415-0c5d-4c6a-b197-a2ba5025fee1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:21.693282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:21.693537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e5415-0c5d-4c6a-b197-a2ba5025fee1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:21.693985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e5415-0c5d-4c6a-b197-a2ba5025fee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:21.751203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e54e5415-0c5d-4c6a-b197-a2ba5025fee1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:21.754534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e54e5415-0c5d-4c6a-b197-a2ba5025fee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:21.766917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e937e566-d94b-4c21-8752-28a4696782d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15543c90b4bc4850bcc83124d8cd832a', 'request_id': 'req-e937e566-d94b-4c21-8752-28a4696782d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:21.780131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e937e566-d94b-4c21-8752-28a4696782d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15543c90b4bc4850bcc83124d8cd832a', 'request_id': 'req-e937e566-d94b-4c21-8752-28a4696782d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:21.791995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e937e566-d94b-4c21-8752-28a4696782d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15543c90b4bc4850bcc83124d8cd832a', 'request_id': 'req-e937e566-d94b-4c21-8752-28a4696782d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:21.806636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e937e566-d94b-4c21-8752-28a4696782d5 admin admin] The token cache is being invalidate because project 15543c90b4bc4850bcc83124d8cd832a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:21.808304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e937e566-d94b-4c21-8752-28a4696782d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:21.809257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e937e566-d94b-4c21-8752-28a4696782d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:21.815184 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2023/4054] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:21 2022] DELETE /identity/v3/projects/15543c90b4bc4850bcc83124d8cd832a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:06:21.816321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaa985-5d88-43e3-9185-6d5903181ca7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:21.816627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaa985-5d88-43e3-9185-6d5903181ca7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:21.816896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaa985-5d88-43e3-9185-6d5903181ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:21.852909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b3aaa985-5d88-43e3-9185-6d5903181ca7 None None] MFA Rules not processed for user `dfb0da7739064336a7b00f30bca3f28c`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:21.853151 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2032/4055] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:21.854554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b3aaa985-5d88-43e3-9185-6d5903181ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:21.854999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b34b-4d0c-41f3-b2e4-bae0e9ad45b6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:21.855301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b34b-4d0c-41f3-b2e4-bae0e9ad45b6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:21.855585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5b34b-4d0c-41f3-b2e4-bae0e9ad45b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:21.880875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8bb5b34b-4d0c-41f3-b2e4-bae0e9ad45b6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:21.882405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8bb5b34b-4d0c-41f3-b2e4-bae0e9ad45b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:21.902074 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2033/4056] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:21.902074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5b34b-4d0c-41f3-b2e4-bae0e9ad45b6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:21.914339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5b34b-4d0c-41f3-b2e4-bae0e9ad45b6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:21.921585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b2f59-36ad-4fb5-8a5b-506c99a86864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:21.922448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b2f59-36ad-4fb5-8a5b-506c99a86864 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:21.922448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b2f59-36ad-4fb5-8a5b-506c99a86864 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:21.922765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b2f59-36ad-4fb5-8a5b-506c99a86864 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:21.923519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b2f59-36ad-4fb5-8a5b-506c99a86864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:21.923900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b2f59-36ad-4fb5-8a5b-506c99a86864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:21.925863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b2f59-36ad-4fb5-8a5b-506c99a86864 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:21.947499 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2034/4057] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:06:21.949365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4fe8c-8aae-4e1c-9974-d6e6755cacfe None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:21.949608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4fe8c-8aae-4e1c-9974-d6e6755cacfe None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:21.949828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4fe8c-8aae-4e1c-9974-d6e6755cacfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:21.983221 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2024/4058] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:21.984745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaa985-5d88-43e3-9185-6d5903181ca7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.003993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5cd4fe8c-8aae-4e1c-9974-d6e6755cacfe None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:22.005246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5cd4fe8c-8aae-4e1c-9974-d6e6755cacfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:22.005506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaa985-5d88-43e3-9185-6d5903181ca7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.015880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b14ce1-2cb0-49b9-b583-498f775e827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.016902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b14ce1-2cb0-49b9-b583-498f775e827f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.017661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b14ce1-2cb0-49b9-b583-498f775e827f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.018095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b14ce1-2cb0-49b9-b583-498f775e827f admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.018948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b14ce1-2cb0-49b9-b583-498f775e827f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:22.022993 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2035/4059] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:22.022993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4fe8c-8aae-4e1c-9974-d6e6755cacfe None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.023564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5cd4fe8c-8aae-4e1c-9974-d6e6755cacfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:22.025519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b14ce1-2cb0-49b9-b583-498f775e827f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:22.031802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:22.065219 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2025/4060] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:21 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:22.066420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b14ce1-2cb0-49b9-b583-498f775e827f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.133617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4fe8c-8aae-4e1c-9974-d6e6755cacfe None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.171997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b14ce1-2cb0-49b9-b583-498f775e827f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.177757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3d3eb-452b-4d62-9821-59d59c37dc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.179220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3d3eb-452b-4d62-9821-59d59c37dc63 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.179823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3d3eb-452b-4d62-9821-59d59c37dc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.180260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3d3eb-452b-4d62-9821-59d59c37dc63 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.181080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3d3eb-452b-4d62-9821-59d59c37dc63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:22.181543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3d3eb-452b-4d62-9821-59d59c37dc63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:22.183526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3d3eb-452b-4d62-9821-59d59c37dc63 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:22.215024 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2026/4061] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:06:22.215872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3d3eb-452b-4d62-9821-59d59c37dc63 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.233794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e929c4-64bb-4547-b90e-604bcc601afc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.234428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e929c4-64bb-4547-b90e-604bcc601afc service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.234931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e929c4-64bb-4547-b90e-604bcc601afc service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.235288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e929c4-64bb-4547-b90e-604bcc601afc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.238458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3d3eb-452b-4d62-9821-59d59c37dc63 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.252227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8a262-cbea-4cef-ac53-fa092dacb0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.255116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8a262-cbea-4cef-ac53-fa092dacb0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.255376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8a262-cbea-4cef-ac53-fa092dacb0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.255666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8a262-cbea-4cef-ac53-fa092dacb0c8 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.257844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8a262-cbea-4cef-ac53-fa092dacb0c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:22.260260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8a262-cbea-4cef-ac53-fa092dacb0c8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:22.287162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:22.308957 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2027/4062] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:22 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:22.309940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8a262-cbea-4cef-ac53-fa092dacb0c8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.317991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e929c4-64bb-4547-b90e-604bcc601afc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:22.321015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e929c4-64bb-4547-b90e-604bcc601afc service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:22.323749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8a262-cbea-4cef-ac53-fa092dacb0c8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.338597 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2036/4063] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:22.351594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1801a93-70cd-4ef1-afa3-a29b33f18285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.352344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1801a93-70cd-4ef1-afa3-a29b33f18285 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.352642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1801a93-70cd-4ef1-afa3-a29b33f18285 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.353092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1801a93-70cd-4ef1-afa3-a29b33f18285 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.353825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1801a93-70cd-4ef1-afa3-a29b33f18285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:22.356445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1801a93-70cd-4ef1-afa3-a29b33f18285 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:22.358581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e929c4-64bb-4547-b90e-604bcc601afc service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.373795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e929c4-64bb-4547-b90e-604bcc601afc service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.379864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221518b2-0267-49a8-9112-495c1851260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.380586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221518b2-0267-49a8-9112-495c1851260e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.380727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221518b2-0267-49a8-9112-495c1851260e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.381558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221518b2-0267-49a8-9112-495c1851260e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.382332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221518b2-0267-49a8-9112-495c1851260e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:22.384167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221518b2-0267-49a8-9112-495c1851260e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:22.404211 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2037/4064] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:22.406649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221518b2-0267-49a8-9112-495c1851260e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.426316 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2028/4065] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:22 2022] POST /identity/v3/projects => generated 357 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:22.427416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221518b2-0267-49a8-9112-495c1851260e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.431991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1801a93-70cd-4ef1-afa3-a29b33f18285 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.479185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:22.533032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15234f29-622f-466e-9968-330f42136b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.533862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15234f29-622f-466e-9968-330f42136b21 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.534209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15234f29-622f-466e-9968-330f42136b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.534579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15234f29-622f-466e-9968-330f42136b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.536556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15234f29-622f-466e-9968-330f42136b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:22.539639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15234f29-622f-466e-9968-330f42136b21 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:22.552973 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2038/4066] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:22.557891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15234f29-622f-466e-9968-330f42136b21 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.578173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15234f29-622f-466e-9968-330f42136b21 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.582621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1801a93-70cd-4ef1-afa3-a29b33f18285 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.584126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b38dc-a327-4d38-95f4-e0955a5d78bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.591652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31651928-0d0e-4a88-802c-c372e0f4aeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.592572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31651928-0d0e-4a88-802c-c372e0f4aeed admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.593161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31651928-0d0e-4a88-802c-c372e0f4aeed admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.593509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31651928-0d0e-4a88-802c-c372e0f4aeed admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.594346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31651928-0d0e-4a88-802c-c372e0f4aeed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:22.596904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31651928-0d0e-4a88-802c-c372e0f4aeed admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:22.603801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b38dc-a327-4d38-95f4-e0955a5d78bc admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.604554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b38dc-a327-4d38-95f4-e0955a5d78bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.604874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b38dc-a327-4d38-95f4-e0955a5d78bc admin admin] PATH_INFO: `/v3/projects/5b07ce9dc6724276bd4a549882ed2f77/users/6e094f952a244065b0685e6136b441bd/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.634201 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2029/4067] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:22 2022] POST /identity/v3/users => generated 279 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:22.637749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31651928-0d0e-4a88-802c-c372e0f4aeed admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.649507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b38dc-a327-4d38-95f4-e0955a5d78bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b07ce9dc6724276bd4a549882ed2f77, user_id=6e094f952a244065b0685e6136b441bd, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:22.652186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b38dc-a327-4d38-95f4-e0955a5d78bc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:22.668265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31651928-0d0e-4a88-802c-c372e0f4aeed admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.675561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af4802-e827-4fc9-aa81-d4fb58871448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.676180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af4802-e827-4fc9-aa81-d4fb58871448 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.676514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af4802-e827-4fc9-aa81-d4fb58871448 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.676793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af4802-e827-4fc9-aa81-d4fb58871448 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.677597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af4802-e827-4fc9-aa81-d4fb58871448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:22.679236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af4802-e827-4fc9-aa81-d4fb58871448 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:22.681969 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2039/4068] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:22 2022] PUT /identity/v3/projects/5b07ce9dc6724276bd4a549882ed2f77/users/6e094f952a244065b0685e6136b441bd/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:22.695229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f4f82-ec68-41a7-a470-e33e9f9ad9bd None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.695530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f4f82-ec68-41a7-a470-e33e9f9ad9bd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.695797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f4f82-ec68-41a7-a470-e33e9f9ad9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.704270 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2030/4069] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:22.708506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af4802-e827-4fc9-aa81-d4fb58871448 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.729776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af4802-e827-4fc9-aa81-d4fb58871448 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.759885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d74f4f82-ec68-41a7-a470-e33e9f9ad9bd None None] MFA Rules not processed for user `6e094f952a244065b0685e6136b441bd`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:22.761147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d74f4f82-ec68-41a7-a470-e33e9f9ad9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:22.883397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d844e-6390-46d4-a765-0271ba819388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.884773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d844e-6390-46d4-a765-0271ba819388 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.885082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d844e-6390-46d4-a765-0271ba819388 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.885507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d844e-6390-46d4-a765-0271ba819388 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:22.886769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d844e-6390-46d4-a765-0271ba819388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:22.890518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d844e-6390-46d4-a765-0271ba819388 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:22.935498 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2031/4070] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:06:22.939483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d844e-6390-46d4-a765-0271ba819388 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.945428 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2040/4071] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:22.951913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f4f82-ec68-41a7-a470-e33e9f9ad9bd None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:22.966464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d844e-6390-46d4-a765-0271ba819388 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:22.986828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426dd75-3496-4a7f-8954-a97f47f346df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:22.987563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426dd75-3496-4a7f-8954-a97f47f346df admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:22.987849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426dd75-3496-4a7f-8954-a97f47f346df admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:22.988200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426dd75-3496-4a7f-8954-a97f47f346df admin admin] PATH_INFO: `/v3/projects/84ad58e39e744a94941432fa8f1b44d9/users/59e4cac05cac4dabb137d980e7a39bbf/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.004619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f4f82-ec68-41a7-a470-e33e9f9ad9bd None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:23.016703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d26519-1625-44ae-9bb2-ddbddaba434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:23.019394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d26519-1625-44ae-9bb2-ddbddaba434e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:23.019683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d26519-1625-44ae-9bb2-ddbddaba434e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:23.021046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d26519-1625-44ae-9bb2-ddbddaba434e admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.022874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426dd75-3496-4a7f-8954-a97f47f346df admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ad58e39e744a94941432fa8f1b44d9, user_id=59e4cac05cac4dabb137d980e7a39bbf, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:23.023760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d26519-1625-44ae-9bb2-ddbddaba434e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:23.025991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426dd75-3496-4a7f-8954-a97f47f346df admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:23.027216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d26519-1625-44ae-9bb2-ddbddaba434e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:23.061217 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2032/4072] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:22 2022] PUT /identity/v3/projects/84ad58e39e744a94941432fa8f1b44d9/users/59e4cac05cac4dabb137d980e7a39bbf/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:06:23.076428 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2041/4073] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:22 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:23.076608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c5bd6-df13-47c8-ba30-9b013eef08ac None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:23.076608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c5bd6-df13-47c8-ba30-9b013eef08ac None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:23.076608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c5bd6-df13-47c8-ba30-9b013eef08ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.079083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d26519-1625-44ae-9bb2-ddbddaba434e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:23.151595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a55c5bd6-df13-47c8-ba30-9b013eef08ac None None] MFA Rules not processed for user `59e4cac05cac4dabb137d980e7a39bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:23.153094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a55c5bd6-df13-47c8-ba30-9b013eef08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:23.189084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:23.206380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d26519-1625-44ae-9bb2-ddbddaba434e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:23.217221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e2455-2ec1-41b8-8778-3e9196a415ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:23.218054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2455-2ec1-41b8-8778-3e9196a415ce admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:23.218450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2455-2ec1-41b8-8778-3e9196a415ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:23.218889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2455-2ec1-41b8-8778-3e9196a415ce admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.219714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e2455-2ec1-41b8-8778-3e9196a415ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:23.222564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e2455-2ec1-41b8-8778-3e9196a415ce admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:23.247364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:23.260199 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2042/4074] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:23 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:23.265398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e2455-2ec1-41b8-8778-3e9196a415ce admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:23.280074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e2455-2ec1-41b8-8778-3e9196a415ce admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:23.286435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f938f4b-f170-4f5e-a9f1-a4559ba960da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:23.287156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f938f4b-f170-4f5e-a9f1-a4559ba960da admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:23.288429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f938f4b-f170-4f5e-a9f1-a4559ba960da admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:23.288715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f938f4b-f170-4f5e-a9f1-a4559ba960da admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.289472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f938f4b-f170-4f5e-a9f1-a4559ba960da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:23.291183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f938f4b-f170-4f5e-a9f1-a4559ba960da admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:23.291315 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2033/4075] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:06:23.304955 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2043/4076] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:23.310240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c5bd6-df13-47c8-ba30-9b013eef08ac None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:23.317386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f938f4b-f170-4f5e-a9f1-a4559ba960da admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:23.320040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2f938f4b-f170-4f5e-a9f1-a4559ba960da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:23.325596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c5bd6-df13-47c8-ba30-9b013eef08ac None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:23.331690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84163c32-3120-4727-8fc1-4560f71c4e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:23.332589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84163c32-3120-4727-8fc1-4560f71c4e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:23.333881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84163c32-3120-4727-8fc1-4560f71c4e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:23.335034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84163c32-3120-4727-8fc1-4560f71c4e0f admin admin] PATH_INFO: `/v3/projects/e70adc8d7c0f4332b1e730498f34c72e/users/d0ae70df540349d3b414bf85e8a238f2/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.353950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84163c32-3120-4727-8fc1-4560f71c4e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70adc8d7c0f4332b1e730498f34c72e, user_id=d0ae70df540349d3b414bf85e8a238f2, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:23.357157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84163c32-3120-4727-8fc1-4560f71c4e0f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:23.381578 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2034/4077] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:23 2022] PUT /identity/v3/projects/e70adc8d7c0f4332b1e730498f34c72e/users/d0ae70df540349d3b414bf85e8a238f2/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:23.385324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84163c32-3120-4727-8fc1-4560f71c4e0f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:23.447683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f938f4b-f170-4f5e-a9f1-a4559ba960da admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:23.487636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84163c32-3120-4727-8fc1-4560f71c4e0f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:23.496050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b0b1c-a84e-469e-933e-c3b6d4c48ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:23.497047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b0b1c-a84e-469e-933e-c3b6d4c48ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:23.497564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b0b1c-a84e-469e-933e-c3b6d4c48ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:23.498155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b0b1c-a84e-469e-933e-c3b6d4c48ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.499088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b0b1c-a84e-469e-933e-c3b6d4c48ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:23.501090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b0b1c-a84e-469e-933e-c3b6d4c48ce7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:23.531527 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2035/4078] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:23.541924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b0b1c-a84e-469e-933e-c3b6d4c48ce7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:23.569800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b0b1c-a84e-469e-933e-c3b6d4c48ce7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:23.588487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d7640-e544-4164-9431-e5d6fff9787d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:23.589991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d7640-e544-4164-9431-e5d6fff9787d service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:23.591051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d7640-e544-4164-9431-e5d6fff9787d service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:23.591405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d7640-e544-4164-9431-e5d6fff9787d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.592172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f7f05-a2af-49ca-94ff-a9a82d0e7eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:23.594952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f7f05-a2af-49ca-94ff-a9a82d0e7eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:23.596110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f7f05-a2af-49ca-94ff-a9a82d0e7eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:23.596728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f7f05-a2af-49ca-94ff-a9a82d0e7eb4 admin admin] PATH_INFO: `/v3/projects/e70adc8d7c0f4332b1e730498f34c72e/users/d0ae70df540349d3b414bf85e8a238f2/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.603240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f7f05-a2af-49ca-94ff-a9a82d0e7eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70adc8d7c0f4332b1e730498f34c72e, user_id=d0ae70df540349d3b414bf85e8a238f2, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:23.612972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f7f05-a2af-49ca-94ff-a9a82d0e7eb4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:23.656784 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2036/4079] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:23 2022] PUT /identity/v3/projects/e70adc8d7c0f4332b1e730498f34c72e/users/d0ae70df540349d3b414bf85e8a238f2/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:23.659167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d043a-5754-48d9-b2e4-7ce19b931467 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:23.662402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d043a-5754-48d9-b2e4-7ce19b931467 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:23.663713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d043a-5754-48d9-b2e4-7ce19b931467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:23.762800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d7640-e544-4164-9431-e5d6fff9787d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:23.765525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d7640-e544-4164-9431-e5d6fff9787d service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:23.767581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d82d043a-5754-48d9-b2e4-7ce19b931467 None None] MFA Rules not processed for user `d0ae70df540349d3b414bf85e8a238f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:23.769088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d82d043a-5754-48d9-b2e4-7ce19b931467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:23.792031 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2044/4080] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:06:23.923389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:23.945105 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2037/4081] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:23.987238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d7640-e544-4164-9431-e5d6fff9787d service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:24.018587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d7640-e544-4164-9431-e5d6fff9787d service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:24.176034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae3fd3-2a88-4cf2-8752-800bf54e000f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:24.176907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3fd3-2a88-4cf2-8752-800bf54e000f service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:24.177089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3fd3-2a88-4cf2-8752-800bf54e000f service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:24.177353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3fd3-2a88-4cf2-8752-800bf54e000f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:24.204552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae3fd3-2a88-4cf2-8752-800bf54e000f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:24.206279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae3fd3-2a88-4cf2-8752-800bf54e000f service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:24.213391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:24.219945 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2045/4082] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:25.242789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0741c-f1f7-4577-b694-096c0ea997f2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:25.243954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0741c-f1f7-4577-b694-096c0ea997f2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:25.244698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0741c-f1f7-4577-b694-096c0ea997f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:25.275113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8ce0741c-f1f7-4577-b694-096c0ea997f2 None None] MFA Rules not processed for user `dfb0da7739064336a7b00f30bca3f28c`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:25.275113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8ce0741c-f1f7-4577-b694-096c0ea997f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:25.404436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2038/4083] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:26.344672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae3fd3-2a88-4cf2-8752-800bf54e000f service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:26.468828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae3fd3-2a88-4cf2-8752-800bf54e000f service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:26.483874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0aac5-3493-4eb3-a967-0fde2d5d46c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:26.484336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0aac5-3493-4eb3-a967-0fde2d5d46c9 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:26.484699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0aac5-3493-4eb3-a967-0fde2d5d46c9 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:26.485788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0aac5-3493-4eb3-a967-0fde2d5d46c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:26.490068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0aa0aac5-3493-4eb3-a967-0fde2d5d46c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:26.611661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0aac5-3493-4eb3-a967-0fde2d5d46c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:26.613671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0aac5-3493-4eb3-a967-0fde2d5d46c9 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:26.644300 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2046/4084] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:34.495773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0741c-f1f7-4577-b694-096c0ea997f2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:34.514261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0741c-f1f7-4577-b694-096c0ea997f2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:34.531048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7119af2-49ca-44c9-9a2f-59785ea9a646 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0ae70df540349d3b414bf85e8a238f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e70adc8d7c0f4332b1e730498f34c72e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:34.531841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7119af2-49ca-44c9-9a2f-59785ea9a646 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:34.538193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7119af2-49ca-44c9-9a2f-59785ea9a646 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:34.540050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7119af2-49ca-44c9-9a2f-59785ea9a646 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:34.541467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7119af2-49ca-44c9-9a2f-59785ea9a646 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:34.541964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7119af2-49ca-44c9-9a2f-59785ea9a646 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:34.546715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7119af2-49ca-44c9-9a2f-59785ea9a646 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:34.572047 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2039/4085] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:06:34.576780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0aac5-3493-4eb3-a967-0fde2d5d46c9 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:34.593504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0aac5-3493-4eb3-a967-0fde2d5d46c9 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:34.619573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67d8f-dbf7-4fd2-a114-08a7c339189c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0ae70df540349d3b414bf85e8a238f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e70adc8d7c0f4332b1e730498f34c72e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:34.620548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67d8f-dbf7-4fd2-a114-08a7c339189c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:34.622778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67d8f-dbf7-4fd2-a114-08a7c339189c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:34.623299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c67d8f-dbf7-4fd2-a114-08a7c339189c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:34.624394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c67d8f-dbf7-4fd2-a114-08a7c339189c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:34.627889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c67d8f-dbf7-4fd2-a114-08a7c339189c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:34.702780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7119af2-49ca-44c9-9a2f-59785ea9a646 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:34.704032 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2047/4086] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:34 2022] POST /identity/v3/projects => generated 347 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:34.720747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7119af2-49ca-44c9-9a2f-59785ea9a646 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:34.881127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d6657-ed40-49c0-8301-2e8228f57c42 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0ae70df540349d3b414bf85e8a238f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e70adc8d7c0f4332b1e730498f34c72e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:34.883765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d6657-ed40-49c0-8301-2e8228f57c42 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:34.885335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d6657-ed40-49c0-8301-2e8228f57c42 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:34.886092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d6657-ed40-49c0-8301-2e8228f57c42 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:34.888244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d6657-ed40-49c0-8301-2e8228f57c42 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:34.888653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d6657-ed40-49c0-8301-2e8228f57c42 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:34.897881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d6657-ed40-49c0-8301-2e8228f57c42 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:34.929614 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2040/4087] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:06:36.219934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67d8f-dbf7-4fd2-a114-08a7c339189c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:36.248707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c67d8f-dbf7-4fd2-a114-08a7c339189c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:36.258662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0ae70df540349d3b414bf85e8a238f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e70adc8d7c0f4332b1e730498f34c72e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:36.259640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:36.259925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:36.260205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] PATH_INFO: `/v3/projects/5ea5d1e0bc5d4ea5a4225e3d3849674f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:36.261434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5ea5d1e0bc5d4ea5a4225e3d3849674f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:36.263426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:36.335701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea5d1e0bc5d4ea5a4225e3d3849674f', 'request_id': 'req-d35fb8f8-9521-4867-9128-cd30abafc47c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:36.358220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea5d1e0bc5d4ea5a4225e3d3849674f', 'request_id': 'req-d35fb8f8-9521-4867-9128-cd30abafc47c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:36.369545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea5d1e0bc5d4ea5a4225e3d3849674f', 'request_id': 'req-d35fb8f8-9521-4867-9128-cd30abafc47c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:36.373022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:36.388289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] The token cache is being invalidate because project 5ea5d1e0bc5d4ea5a4225e3d3849674f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:36.388573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:36.389482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:36.391267 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2048/4088] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:36 2022] DELETE /identity/v3/projects/5ea5d1e0bc5d4ea5a4225e3d3849674f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:36.405979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d6657-ed40-49c0-8301-2e8228f57c42 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:36.408050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3f5d6657-ed40-49c0-8301-2e8228f57c42 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:36.478724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d6657-ed40-49c0-8301-2e8228f57c42 tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:36.523475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:36.536441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2d659-99f7-4b72-a9e4-82b0e8d07149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:36.537643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d659-99f7-4b72-a9e4-82b0e8d07149 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:36.537926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d659-99f7-4b72-a9e4-82b0e8d07149 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:36.538190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d659-99f7-4b72-a9e4-82b0e8d07149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:36.539984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fed2d659-99f7-4b72-a9e4-82b0e8d07149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:36.613848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2d659-99f7-4b72-a9e4-82b0e8d07149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:36.616015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2d659-99f7-4b72-a9e4-82b0e8d07149 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:36.629287 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2041/4089] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:38.542890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:38.544545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:38.668756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fb8f8-9521-4867-9128-cd30abafc47c tempest-RoutersAdminTest-955530833 tempest-RoutersAdminTest-955530833-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:38.673741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:38.675026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:38.675708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:38.676193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] PATH_INFO: `/v3/users/59e4cac05cac4dabb137d980e7a39bbf` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:38.678106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e4cac05cac4dabb137d980e7a39bbf)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:38.681080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:38.765069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e4cac05cac4dabb137d980e7a39bbf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:38.776709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e4cac05cac4dabb137d980e7a39bbf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:38.778974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e4cac05cac4dabb137d980e7a39bbf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:38.788734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e4cac05cac4dabb137d980e7a39bbf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:38.790072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e4cac05cac4dabb137d980e7a39bbf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:38.821241 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2049/4090] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:38 2022] DELETE /identity/v3/users/59e4cac05cac4dabb137d980e7a39bbf => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:38.825960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577e3fc-a488-4392-a5c8-c5d536fb69fc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:38.826922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577e3fc-a488-4392-a5c8-c5d536fb69fc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:38.826922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577e3fc-a488-4392-a5c8-c5d536fb69fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:38.858527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5577e3fc-a488-4392-a5c8-c5d536fb69fc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:38.860449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5577e3fc-a488-4392-a5c8-c5d536fb69fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:38.951723 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2042/4091] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:38.960600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:38.963706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:39.041325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a98ae8-9a41-47c0-820f-88e8d7b02f76 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:39.046090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f0521-d3bb-4f07-ad1e-745c48b26f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:39.046801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f0521-d3bb-4f07-ad1e-745c48b26f40 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:39.047061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f0521-d3bb-4f07-ad1e-745c48b26f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:39.047328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f0521-d3bb-4f07-ad1e-745c48b26f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:39.059210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f0521-d3bb-4f07-ad1e-745c48b26f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:39.060661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f0521-d3bb-4f07-ad1e-745c48b26f40 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:39.074702 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2050/4092] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:06:39.272110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577e3fc-a488-4392-a5c8-c5d536fb69fc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:39.273916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5577e3fc-a488-4392-a5c8-c5d536fb69fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:39.295877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577e3fc-a488-4392-a5c8-c5d536fb69fc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:39.303432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:39.304182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:39.304531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:39.304831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f admin admin] PATH_INFO: `/v3/projects/84ad58e39e744a94941432fa8f1b44d9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:39.306333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ad58e39e744a94941432fa8f1b44d9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:39.308481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:39.363405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ad58e39e744a94941432fa8f1b44d9', 'request_id': 'req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:39.373240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ad58e39e744a94941432fa8f1b44d9', 'request_id': 'req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:39.379938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ad58e39e744a94941432fa8f1b44d9', 'request_id': 'req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:39.393583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f admin admin] The token cache is being invalidate because project 84ad58e39e744a94941432fa8f1b44d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:39.394009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:39.395187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-35a20731-77a0-4bda-a7f1-0ee3cbb2125f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:39.398420 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2043/4093] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:39 2022] DELETE /identity/v3/projects/84ad58e39e744a94941432fa8f1b44d9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:39.403539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c214a-2c7a-4c11-9112-6ea19b5f6f46 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:39.403902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c214a-2c7a-4c11-9112-6ea19b5f6f46 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:39.404386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c214a-2c7a-4c11-9112-6ea19b5f6f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:39.427234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-844c214a-2c7a-4c11-9112-6ea19b5f6f46 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:39.428791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-844c214a-2c7a-4c11-9112-6ea19b5f6f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:39.445885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:39.511794 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2051/4094] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:39.520100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3510e1b-2b86-486e-a218-e19cdbec2f7c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:39.520431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3510e1b-2b86-486e-a218-e19cdbec2f7c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:39.520686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3510e1b-2b86-486e-a218-e19cdbec2f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:39.545998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a3510e1b-2b86-486e-a218-e19cdbec2f7c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:39.547246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a3510e1b-2b86-486e-a218-e19cdbec2f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:39.555513 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2044/4095] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:39.559746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c214a-2c7a-4c11-9112-6ea19b5f6f46 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:39.570720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c214a-2c7a-4c11-9112-6ea19b5f6f46 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:39.575493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdbcae-dc8a-4db0-8610-9fe344a6b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:39.576111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdbcae-dc8a-4db0-8610-9fe344a6b206 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:39.576396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdbcae-dc8a-4db0-8610-9fe344a6b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:39.576733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdbcae-dc8a-4db0-8610-9fe344a6b206 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:39.577393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdbcae-dc8a-4db0-8610-9fe344a6b206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:39.577697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdbcae-dc8a-4db0-8610-9fe344a6b206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:39.579341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdbcae-dc8a-4db0-8610-9fe344a6b206 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:39.595246 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2052/4096] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:06:39.600559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3510e1b-2b86-486e-a218-e19cdbec2f7c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:39.609923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3510e1b-2b86-486e-a218-e19cdbec2f7c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:39.615774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19478cd-3d64-4943-bd9f-41d3c7d1a998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:39.616563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19478cd-3d64-4943-bd9f-41d3c7d1a998 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:39.616848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19478cd-3d64-4943-bd9f-41d3c7d1a998 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:39.617122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19478cd-3d64-4943-bd9f-41d3c7d1a998 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:39.617776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19478cd-3d64-4943-bd9f-41d3c7d1a998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:39.619764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19478cd-3d64-4943-bd9f-41d3c7d1a998 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:39.630161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:39.656669 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2045/4097] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:39 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:39.660887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdbcae-dc8a-4db0-8610-9fe344a6b206 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:39.672803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdbcae-dc8a-4db0-8610-9fe344a6b206 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:39.742566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eb807-fd88-4986-b8e1-5462b545cb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:39.743076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eb807-fd88-4986-b8e1-5462b545cb8f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:39.752828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eb807-fd88-4986-b8e1-5462b545cb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:39.753368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eb807-fd88-4986-b8e1-5462b545cb8f admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:39.754069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284eb807-fd88-4986-b8e1-5462b545cb8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:39.756322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284eb807-fd88-4986-b8e1-5462b545cb8f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:39.789876 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2053/4098] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:39 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:39.794467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19478cd-3d64-4943-bd9f-41d3c7d1a998 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:39.807029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19478cd-3d64-4943-bd9f-41d3c7d1a998 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:39.812138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30c2f-3755-4e41-8ba8-dff3e98d0a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:39.812834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30c2f-3755-4e41-8ba8-dff3e98d0a91 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:39.813126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30c2f-3755-4e41-8ba8-dff3e98d0a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:39.813555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30c2f-3755-4e41-8ba8-dff3e98d0a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:39.814195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb30c2f-3755-4e41-8ba8-dff3e98d0a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:39.815845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb30c2f-3755-4e41-8ba8-dff3e98d0a91 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:39.829095 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2046/4099] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:06:39.832965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eb807-fd88-4986-b8e1-5462b545cb8f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:39.845449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eb807-fd88-4986-b8e1-5462b545cb8f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:39.851185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9f84c-c838-490c-99cb-9fe82b387e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:39.851968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9f84c-c838-490c-99cb-9fe82b387e3b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:39.852242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9f84c-c838-490c-99cb-9fe82b387e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:39.852434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9f84c-c838-490c-99cb-9fe82b387e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:39.853061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9f84c-c838-490c-99cb-9fe82b387e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:39.854865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9f84c-c838-490c-99cb-9fe82b387e3b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:39.871445 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2054/4100] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:39.872873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30c2f-3755-4e41-8ba8-dff3e98d0a91 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:39.891850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30c2f-3755-4e41-8ba8-dff3e98d0a91 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:39.915267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f3424-f4bb-440b-a795-ab5999cea7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:39.916383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f3424-f4bb-440b-a795-ab5999cea7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:39.917479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f3424-f4bb-440b-a795-ab5999cea7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:39.917761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f3424-f4bb-440b-a795-ab5999cea7ea admin admin] PATH_INFO: `/v3/projects/9d3573c315ea431a86b3d86626dfde93/users/6a9e7ada3dd14fb3a29e9a039b708979/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:39.936786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f3424-f4bb-440b-a795-ab5999cea7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d3573c315ea431a86b3d86626dfde93, user_id=6a9e7ada3dd14fb3a29e9a039b708979, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:39.940754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f3424-f4bb-440b-a795-ab5999cea7ea admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:39.964685 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2047/4101] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:39 2022] PUT /identity/v3/projects/9d3573c315ea431a86b3d86626dfde93/users/6a9e7ada3dd14fb3a29e9a039b708979/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:39.978088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dceb7c-8cc0-47ec-ab77-1b68a2bcae81 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:39.978811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dceb7c-8cc0-47ec-ab77-1b68a2bcae81 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:39.979310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dceb7c-8cc0-47ec-ab77-1b68a2bcae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:40.016426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f9dceb7c-8cc0-47ec-ab77-1b68a2bcae81 None None] MFA Rules not processed for user `6a9e7ada3dd14fb3a29e9a039b708979`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:40.017659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f9dceb7c-8cc0-47ec-ab77-1b68a2bcae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:40.104734 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2055/4102] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:40.128586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f3424-f4bb-440b-a795-ab5999cea7ea admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:40.131478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f02f3424-f4bb-440b-a795-ab5999cea7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:40.207529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f3424-f4bb-440b-a795-ab5999cea7ea admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:40.212489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28efa53-a8ad-4ebd-98cb-2c912840a082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:40.213304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28efa53-a8ad-4ebd-98cb-2c912840a082 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:40.214894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28efa53-a8ad-4ebd-98cb-2c912840a082 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:40.215052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28efa53-a8ad-4ebd-98cb-2c912840a082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:40.226229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28efa53-a8ad-4ebd-98cb-2c912840a082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:40.227745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28efa53-a8ad-4ebd-98cb-2c912840a082 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:40.242130 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2048/4103] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:40.271394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dceb7c-8cc0-47ec-ab77-1b68a2bcae81 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:40.299820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:40.382563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dceb7c-8cc0-47ec-ab77-1b68a2bcae81 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:40.395787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:40.396149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:40.396980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:40.397331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] PATH_INFO: `/v3/users/6a9e7ada3dd14fb3a29e9a039b708979` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:40.401840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a9e7ada3dd14fb3a29e9a039b708979)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:40.403999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:40.497967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a9e7ada3dd14fb3a29e9a039b708979'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:40.510528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a9e7ada3dd14fb3a29e9a039b708979'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:40.511425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a9e7ada3dd14fb3a29e9a039b708979'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:40.523887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a9e7ada3dd14fb3a29e9a039b708979'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:40.524586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a9e7ada3dd14fb3a29e9a039b708979'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:40.605603 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2056/4104] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:40 2022] DELETE /identity/v3/users/6a9e7ada3dd14fb3a29e9a039b708979 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:40.610060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8057-1baf-4007-ba39-bf487530581c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:40.610286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8057-1baf-4007-ba39-bf487530581c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:40.610634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b8057-1baf-4007-ba39-bf487530581c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:40.641054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2f5b8057-1baf-4007-ba39-bf487530581c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:40.643193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2f5b8057-1baf-4007-ba39-bf487530581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:40.743153 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2049/4105] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:40.762056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:40.763580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:40.889988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ff64a-8228-4f4b-a03e-d15e3db4a57d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:40.898124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970bb85b-0f90-46bd-9bea-f69c028c60a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:40.900046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb85b-0f90-46bd-9bea-f69c028c60a2 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:40.900787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb85b-0f90-46bd-9bea-f69c028c60a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:40.901443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb85b-0f90-46bd-9bea-f69c028c60a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:40.932877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bb85b-0f90-46bd-9bea-f69c028c60a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:40.937103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970bb85b-0f90-46bd-9bea-f69c028c60a2 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:40.961073 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2057/4106] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:41.471553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b8057-1baf-4007-ba39-bf487530581c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:41.473637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2f5b8057-1baf-4007-ba39-bf487530581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:41.503851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b8057-1baf-4007-ba39-bf487530581c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:41.515492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:41.515492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:41.515779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:41.516362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3 admin admin] PATH_INFO: `/v3/projects/9d3573c315ea431a86b3d86626dfde93` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:41.517985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d3573c315ea431a86b3d86626dfde93)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:41.520856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:41.663739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d3573c315ea431a86b3d86626dfde93', 'request_id': 'req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:41.667369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:41.685669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d3573c315ea431a86b3d86626dfde93', 'request_id': 'req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:41.700670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d3573c315ea431a86b3d86626dfde93', 'request_id': 'req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:41.747843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3 admin admin] The token cache is being invalidate because project 9d3573c315ea431a86b3d86626dfde93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:41.748351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:41.749326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4b8fa0f5-0e23-4040-9db0-17984e3d39d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:41.752213 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2050/4107] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:41 2022] DELETE /identity/v3/projects/9d3573c315ea431a86b3d86626dfde93 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:41.757801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6178-5b47-41c4-adb8-e902e62be36b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:41.758339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6178-5b47-41c4-adb8-e902e62be36b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:41.758558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6178-5b47-41c4-adb8-e902e62be36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:41.792549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-580a6178-5b47-41c4-adb8-e902e62be36b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:41.795229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-580a6178-5b47-41c4-adb8-e902e62be36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:41.841290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:41.886910 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2058/4108] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:41.888655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7116dd4-40e7-42c2-94ef-767d64c9d08a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:41.888949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7116dd4-40e7-42c2-94ef-767d64c9d08a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:41.889226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7116dd4-40e7-42c2-94ef-767d64c9d08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:41.910954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b7116dd4-40e7-42c2-94ef-767d64c9d08a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:41.913089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b7116dd4-40e7-42c2-94ef-767d64c9d08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:41.922763 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2051/4109] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:06:41.926649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a6178-5b47-41c4-adb8-e902e62be36b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:41.941770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a6178-5b47-41c4-adb8-e902e62be36b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:41.950442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47eb813-84c9-4e6c-aed3-4eb69f7a0fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:41.951483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47eb813-84c9-4e6c-aed3-4eb69f7a0fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:41.951932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47eb813-84c9-4e6c-aed3-4eb69f7a0fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:41.952371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47eb813-84c9-4e6c-aed3-4eb69f7a0fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:41.953191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47eb813-84c9-4e6c-aed3-4eb69f7a0fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:41.953676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47eb813-84c9-4e6c-aed3-4eb69f7a0fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:41.955472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47eb813-84c9-4e6c-aed3-4eb69f7a0fc8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:41.972653 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2059/4110] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:06:41.973998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7116dd4-40e7-42c2-94ef-767d64c9d08a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:41.984509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7116dd4-40e7-42c2-94ef-767d64c9d08a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:41.989894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68993ce7-639b-42a0-abef-05ac614044cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:41.991157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68993ce7-639b-42a0-abef-05ac614044cd admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:41.991157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68993ce7-639b-42a0-abef-05ac614044cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:41.991157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68993ce7-639b-42a0-abef-05ac614044cd admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:41.991777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68993ce7-639b-42a0-abef-05ac614044cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:41.994102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68993ce7-639b-42a0-abef-05ac614044cd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:42.032993 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2052/4111] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:41 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:42.035333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47eb813-84c9-4e6c-aed3-4eb69f7a0fc8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:42.047375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47eb813-84c9-4e6c-aed3-4eb69f7a0fc8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:42.131588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27efaa-6f24-4afa-812e-7931dcf60dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:42.132368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27efaa-6f24-4afa-812e-7931dcf60dfb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:42.132660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27efaa-6f24-4afa-812e-7931dcf60dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:42.134408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27efaa-6f24-4afa-812e-7931dcf60dfb admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:42.134408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27efaa-6f24-4afa-812e-7931dcf60dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:42.135592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27efaa-6f24-4afa-812e-7931dcf60dfb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:42.165053 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2060/4112] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:42 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:42.170461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68993ce7-639b-42a0-abef-05ac614044cd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:42.182566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68993ce7-639b-42a0-abef-05ac614044cd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:42.189131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e85c24-73f2-4325-95ed-653107f84bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:42.189687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e85c24-73f2-4325-95ed-653107f84bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:42.189970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e85c24-73f2-4325-95ed-653107f84bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:42.190391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e85c24-73f2-4325-95ed-653107f84bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:42.191075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e85c24-73f2-4325-95ed-653107f84bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:42.192766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e85c24-73f2-4325-95ed-653107f84bc7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:42.205650 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2053/4113] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:42.210278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27efaa-6f24-4afa-812e-7931dcf60dfb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:42.221433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27efaa-6f24-4afa-812e-7931dcf60dfb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:42.227342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c11b90-bc4d-47da-b804-c67040df4a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:42.228262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c11b90-bc4d-47da-b804-c67040df4a70 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:42.228262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c11b90-bc4d-47da-b804-c67040df4a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:42.228508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c11b90-bc4d-47da-b804-c67040df4a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:42.229320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c11b90-bc4d-47da-b804-c67040df4a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:42.231143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c11b90-bc4d-47da-b804-c67040df4a70 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:42.248234 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2061/4114] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:42.249287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e85c24-73f2-4325-95ed-653107f84bc7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:42.278722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e85c24-73f2-4325-95ed-653107f84bc7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:42.311987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554b232-1893-4e85-ac80-32480171e1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:42.312683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554b232-1893-4e85-ac80-32480171e1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:42.312974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554b232-1893-4e85-ac80-32480171e1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:42.313247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554b232-1893-4e85-ac80-32480171e1ee admin admin] PATH_INFO: `/v3/projects/82df5e3cf91e4f75a02d0ee01ef5e577/users/e17a61c4304c430ba2fc4d3f7455f9e4/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:42.349663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554b232-1893-4e85-ac80-32480171e1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=82df5e3cf91e4f75a02d0ee01ef5e577, user_id=e17a61c4304c430ba2fc4d3f7455f9e4, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:42.353227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554b232-1893-4e85-ac80-32480171e1ee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:42.382270 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2054/4115] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:42 2022] PUT /identity/v3/projects/82df5e3cf91e4f75a02d0ee01ef5e577/users/e17a61c4304c430ba2fc4d3f7455f9e4/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:42.392624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca82e7-2004-41f0-bc28-a6a655757f80 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:42.392914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca82e7-2004-41f0-bc28-a6a655757f80 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:42.393186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca82e7-2004-41f0-bc28-a6a655757f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:42.428963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-49ca82e7-2004-41f0-bc28-a6a655757f80 None None] MFA Rules not processed for user `e17a61c4304c430ba2fc4d3f7455f9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:42.430213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-49ca82e7-2004-41f0-bc28-a6a655757f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:42.541507 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2062/4116] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:42.546111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554b232-1893-4e85-ac80-32480171e1ee admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:42.666305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554b232-1893-4e85-ac80-32480171e1ee admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:42.671423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be16b94-59a8-42da-a385-4844e85af022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:42.672306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be16b94-59a8-42da-a385-4844e85af022 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:42.672699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be16b94-59a8-42da-a385-4844e85af022 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:42.673082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be16b94-59a8-42da-a385-4844e85af022 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:42.673838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be16b94-59a8-42da-a385-4844e85af022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:42.676009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be16b94-59a8-42da-a385-4844e85af022 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:42.718863 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2055/4117] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:42 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:42.720002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca82e7-2004-41f0-bc28-a6a655757f80 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:42.733768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca82e7-2004-41f0-bc28-a6a655757f80 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:42.799297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:42.852201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543039aa-b175-48b1-81ad-9ac7f3e1de05 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:42.852919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543039aa-b175-48b1-81ad-9ac7f3e1de05 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:42.853362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543039aa-b175-48b1-81ad-9ac7f3e1de05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:42.872857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2feaab-0a80-49cc-8822-fe645f6a8936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:42.873669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2feaab-0a80-49cc-8822-fe645f6a8936 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:42.874211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2feaab-0a80-49cc-8822-fe645f6a8936 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:42.874628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2feaab-0a80-49cc-8822-fe645f6a8936 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:42.875712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2feaab-0a80-49cc-8822-fe645f6a8936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:42.881350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-543039aa-b175-48b1-81ad-9ac7f3e1de05 None None] MFA Rules not processed for user `8dbb8a95851248bfabd9a1afe40fc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:42.883790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-543039aa-b175-48b1-81ad-9ac7f3e1de05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:42.892439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2feaab-0a80-49cc-8822-fe645f6a8936 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:42.928966 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2063/4118] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:42 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:42.932673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2feaab-0a80-49cc-8822-fe645f6a8936 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:42.950230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2feaab-0a80-49cc-8822-fe645f6a8936 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:42.957749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e17204-83d3-4e05-8bcc-cc9079b03ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:42.958454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e17204-83d3-4e05-8bcc-cc9079b03ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:42.961668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e17204-83d3-4e05-8bcc-cc9079b03ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:42.962036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e17204-83d3-4e05-8bcc-cc9079b03ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:42.962709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e17204-83d3-4e05-8bcc-cc9079b03ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:42.964686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e17204-83d3-4e05-8bcc-cc9079b03ba0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:42.980353 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2064/4119] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:42.984491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e17204-83d3-4e05-8bcc-cc9079b03ba0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:43.002001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e17204-83d3-4e05-8bcc-cc9079b03ba0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:43.007911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26be7df-52a6-4bda-a831-1c589435ad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:43.008595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26be7df-52a6-4bda-a831-1c589435ad56 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:43.008950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26be7df-52a6-4bda-a831-1c589435ad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:43.009236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26be7df-52a6-4bda-a831-1c589435ad56 admin admin] PATH_INFO: `/v3/projects/1653d6bf6f1e4911839f31fb7e9c9428/users/16468ff188cd406684a20ee2e20cdf8f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:43.014058 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2056/4120] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:43.098916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26be7df-52a6-4bda-a831-1c589435ad56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1653d6bf6f1e4911839f31fb7e9c9428, user_id=16468ff188cd406684a20ee2e20cdf8f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:43.103044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26be7df-52a6-4bda-a831-1c589435ad56 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:43.127302 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2065/4121] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:42 2022] PUT /identity/v3/projects/1653d6bf6f1e4911839f31fb7e9c9428/users/16468ff188cd406684a20ee2e20cdf8f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:43.127869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543039aa-b175-48b1-81ad-9ac7f3e1de05 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:43.141424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543039aa-b175-48b1-81ad-9ac7f3e1de05 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:43.147614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:43.226624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68654c-303e-4b3a-975b-51212de4592f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:43.228130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68654c-303e-4b3a-975b-51212de4592f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:43.228289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68654c-303e-4b3a-975b-51212de4592f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:43.229474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68654c-303e-4b3a-975b-51212de4592f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:43.230490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68654c-303e-4b3a-975b-51212de4592f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:43.232698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68654c-303e-4b3a-975b-51212de4592f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:43.248421 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2057/4122] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:06:43.254606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26be7df-52a6-4bda-a831-1c589435ad56 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:43.266056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26be7df-52a6-4bda-a831-1c589435ad56 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:43.273912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4c3d4-5a25-4666-a01f-171db9df2d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:43.274590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4c3d4-5a25-4666-a01f-171db9df2d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:43.274925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4c3d4-5a25-4666-a01f-171db9df2d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:43.275206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4c3d4-5a25-4666-a01f-171db9df2d83 admin admin] PATH_INFO: `/v3/projects/1653d6bf6f1e4911839f31fb7e9c9428/users/16468ff188cd406684a20ee2e20cdf8f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:43.277997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4c3d4-5a25-4666-a01f-171db9df2d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1653d6bf6f1e4911839f31fb7e9c9428, user_id=16468ff188cd406684a20ee2e20cdf8f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:43.280731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4c3d4-5a25-4666-a01f-171db9df2d83 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:43.310693 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2066/4123] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:43 2022] PUT /identity/v3/projects/1653d6bf6f1e4911839f31fb7e9c9428/users/16468ff188cd406684a20ee2e20cdf8f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:43.323117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d517a6-9e95-4c4d-95bc-1951093a5cce None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:43.323117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d517a6-9e95-4c4d-95bc-1951093a5cce None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:43.323480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d517a6-9e95-4c4d-95bc-1951093a5cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:43.361647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-34d517a6-9e95-4c4d-95bc-1951093a5cce None None] MFA Rules not processed for user `16468ff188cd406684a20ee2e20cdf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:43.363196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-34d517a6-9e95-4c4d-95bc-1951093a5cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:43.469325 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2058/4124] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:43.478019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4c3d4-5a25-4666-a01f-171db9df2d83 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:43.480893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1db4c3d4-5a25-4666-a01f-171db9df2d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:43.603117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4c3d4-5a25-4666-a01f-171db9df2d83 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:43.611442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a680f-6b33-4097-8530-8aae447bf1c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:43.612088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a680f-6b33-4097-8530-8aae447bf1c0 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:43.612372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a680f-6b33-4097-8530-8aae447bf1c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:43.612647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a680f-6b33-4097-8530-8aae447bf1c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:43.626542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a680f-6b33-4097-8530-8aae447bf1c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:43.628509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a680f-6b33-4097-8530-8aae447bf1c0 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:43.645504 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2067/4125] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:43.773253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d517a6-9e95-4c4d-95bc-1951093a5cce None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:43.785892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d517a6-9e95-4c4d-95bc-1951093a5cce None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:43.790686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54191c81-ca69-4548-8240-4558fee3f099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:43.791555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54191c81-ca69-4548-8240-4558fee3f099 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:43.792056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54191c81-ca69-4548-8240-4558fee3f099 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:43.792483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54191c81-ca69-4548-8240-4558fee3f099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:43.866626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54191c81-ca69-4548-8240-4558fee3f099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:43.868285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54191c81-ca69-4548-8240-4558fee3f099 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:43.877864 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2059/4126] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:47.296444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a680f-6b33-4097-8530-8aae447bf1c0 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:47.301467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3e2a680f-6b33-4097-8530-8aae447bf1c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:47.462438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a680f-6b33-4097-8530-8aae447bf1c0 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:47.471884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426fd89-afe2-4fda-a804-ecb4b95f92a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:47.473060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426fd89-afe2-4fda-a804-ecb4b95f92a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:47.473829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426fd89-afe2-4fda-a804-ecb4b95f92a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:47.476025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426fd89-afe2-4fda-a804-ecb4b95f92a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:47.480034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6426fd89-afe2-4fda-a804-ecb4b95f92a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:47.514357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:47.594336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426fd89-afe2-4fda-a804-ecb4b95f92a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:47.599794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426fd89-afe2-4fda-a804-ecb4b95f92a6 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:47.616784 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2068/4127] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:49.355153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54191c81-ca69-4548-8240-4558fee3f099 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:49.357491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-54191c81-ca69-4548-8240-4558fee3f099 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:49.476684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:49.608576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54191c81-ca69-4548-8240-4558fee3f099 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:49.615739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c971c-2e09-4f7c-b987-fad82388eafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:49.617017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c971c-2e09-4f7c-b987-fad82388eafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:49.617468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c971c-2e09-4f7c-b987-fad82388eafe admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:49.617911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c971c-2e09-4f7c-b987-fad82388eafe admin admin] PATH_INFO: `/v3/users/9fa50f553f1d42f39bd6e0f788459685` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:49.619436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c971c-2e09-4f7c-b987-fad82388eafe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa50f553f1d42f39bd6e0f788459685)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:49.621706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c971c-2e09-4f7c-b987-fad82388eafe admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:49.699123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f94c971c-2e09-4f7c-b987-fad82388eafe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa50f553f1d42f39bd6e0f788459685'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:49.732729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f94c971c-2e09-4f7c-b987-fad82388eafe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa50f553f1d42f39bd6e0f788459685'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:49.735504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f94c971c-2e09-4f7c-b987-fad82388eafe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa50f553f1d42f39bd6e0f788459685'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:49.768264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f94c971c-2e09-4f7c-b987-fad82388eafe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa50f553f1d42f39bd6e0f788459685'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:49.769251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f94c971c-2e09-4f7c-b987-fad82388eafe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa50f553f1d42f39bd6e0f788459685'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:49.806378 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2060/4128] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:49 2022] DELETE /identity/v3/users/9fa50f553f1d42f39bd6e0f788459685 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:50.040748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426fd89-afe2-4fda-a804-ecb4b95f92a6 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:50.056406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426fd89-afe2-4fda-a804-ecb4b95f92a6 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:50.211448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3ef4c-ab8b-47c7-b699-085fe509a920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:50.212110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3ef4c-ab8b-47c7-b699-085fe509a920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:50.212393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3ef4c-ab8b-47c7-b699-085fe509a920 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:50.212663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3ef4c-ab8b-47c7-b699-085fe509a920 admin admin] PATH_INFO: `/v3/projects/82f40afe83bb4020b126bd056752d1d0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:50.213816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3ef4c-ab8b-47c7-b699-085fe509a920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82f40afe83bb4020b126bd056752d1d0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:50.219204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3ef4c-ab8b-47c7-b699-085fe509a920 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:50.338171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fca3ef4c-ab8b-47c7-b699-085fe509a920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f40afe83bb4020b126bd056752d1d0', 'request_id': 'req-fca3ef4c-ab8b-47c7-b699-085fe509a920'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:50.348438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fca3ef4c-ab8b-47c7-b699-085fe509a920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f40afe83bb4020b126bd056752d1d0', 'request_id': 'req-fca3ef4c-ab8b-47c7-b699-085fe509a920'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:50.358784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fca3ef4c-ab8b-47c7-b699-085fe509a920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f40afe83bb4020b126bd056752d1d0', 'request_id': 'req-fca3ef4c-ab8b-47c7-b699-085fe509a920'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:50.382335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fca3ef4c-ab8b-47c7-b699-085fe509a920 admin admin] The token cache is being invalidate because project 82f40afe83bb4020b126bd056752d1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:50.387680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fca3ef4c-ab8b-47c7-b699-085fe509a920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:50.389520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fca3ef4c-ab8b-47c7-b699-085fe509a920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:50.397117 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2069/4129] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:50 2022] DELETE /identity/v3/projects/82f40afe83bb4020b126bd056752d1d0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:50.399048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd66c1-2b96-42cc-9070-5b1bfcfac918 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:50.399502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd66c1-2b96-42cc-9070-5b1bfcfac918 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:50.399621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd66c1-2b96-42cc-9070-5b1bfcfac918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:50.435587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-77dd66c1-2b96-42cc-9070-5b1bfcfac918 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:50.439320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-77dd66c1-2b96-42cc-9070-5b1bfcfac918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:50.590785 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2061/4130] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:50.597703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b65e3-8fe8-4344-b63f-d37b9ab9cad2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:50.598004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b65e3-8fe8-4344-b63f-d37b9ab9cad2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:50.598134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b65e3-8fe8-4344-b63f-d37b9ab9cad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:50.622365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e08b65e3-8fe8-4344-b63f-d37b9ab9cad2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:50.623753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e08b65e3-8fe8-4344-b63f-d37b9ab9cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:50.634272 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2070/4131] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:50.638777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd66c1-2b96-42cc-9070-5b1bfcfac918 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:50.651450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd66c1-2b96-42cc-9070-5b1bfcfac918 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:50.657691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df79f1-54e7-427f-95a0-99aa324fa834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:50.658573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df79f1-54e7-427f-95a0-99aa324fa834 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:50.658934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df79f1-54e7-427f-95a0-99aa324fa834 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:50.659398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df79f1-54e7-427f-95a0-99aa324fa834 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:50.660139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df79f1-54e7-427f-95a0-99aa324fa834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:50.661273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df79f1-54e7-427f-95a0-99aa324fa834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:50.665620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df79f1-54e7-427f-95a0-99aa324fa834 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:50.689021 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2062/4132] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:06:50.692345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b65e3-8fe8-4344-b63f-d37b9ab9cad2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:50.706909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b65e3-8fe8-4344-b63f-d37b9ab9cad2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:50.718605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67479680-3cb3-4652-87a8-3dcacdaffd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:50.719543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67479680-3cb3-4652-87a8-3dcacdaffd44 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:50.720031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67479680-3cb3-4652-87a8-3dcacdaffd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:50.720973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67479680-3cb3-4652-87a8-3dcacdaffd44 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:50.721833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67479680-3cb3-4652-87a8-3dcacdaffd44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:50.725212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67479680-3cb3-4652-87a8-3dcacdaffd44 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:50.825060 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2071/4133] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:50 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:06:50.826326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df79f1-54e7-427f-95a0-99aa324fa834 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:50.844108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df79f1-54e7-427f-95a0-99aa324fa834 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:50.909934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:50.957551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4318b91-ec9a-485e-adcc-16155bce6efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:50.958193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4318b91-ec9a-485e-adcc-16155bce6efb admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:50.958723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4318b91-ec9a-485e-adcc-16155bce6efb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:50.959449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4318b91-ec9a-485e-adcc-16155bce6efb admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:50.960058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4318b91-ec9a-485e-adcc-16155bce6efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:50.963054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4318b91-ec9a-485e-adcc-16155bce6efb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:51.017874 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2063/4134] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:50 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:06:51.019331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67479680-3cb3-4652-87a8-3dcacdaffd44 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:51.031232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67479680-3cb3-4652-87a8-3dcacdaffd44 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:51.038302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a474ba-b9ee-4d32-973e-7120e3f57f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:51.038964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a474ba-b9ee-4d32-973e-7120e3f57f4f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:51.039258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a474ba-b9ee-4d32-973e-7120e3f57f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:51.039731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a474ba-b9ee-4d32-973e-7120e3f57f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:51.040394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a474ba-b9ee-4d32-973e-7120e3f57f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:51.042041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a474ba-b9ee-4d32-973e-7120e3f57f4f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:51.043772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:51.078439 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2072/4135] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:06:51.085057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4318b91-ec9a-485e-adcc-16155bce6efb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:51.098129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4318b91-ec9a-485e-adcc-16155bce6efb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:51.114455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44483be-fd62-481a-a4d1-06586f70ed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:51.116638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44483be-fd62-481a-a4d1-06586f70ed45 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:51.118599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44483be-fd62-481a-a4d1-06586f70ed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:51.119304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44483be-fd62-481a-a4d1-06586f70ed45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:51.120231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44483be-fd62-481a-a4d1-06586f70ed45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:51.124025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44483be-fd62-481a-a4d1-06586f70ed45 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:51.157462 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2064/4136] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:51.161749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a474ba-b9ee-4d32-973e-7120e3f57f4f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:51.198773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a474ba-b9ee-4d32-973e-7120e3f57f4f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:51.203674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b4079-0cf5-4014-b60b-fbdd57057b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:51.204258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b4079-0cf5-4014-b60b-fbdd57057b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:51.204619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b4079-0cf5-4014-b60b-fbdd57057b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:51.204971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b4079-0cf5-4014-b60b-fbdd57057b8b admin admin] PATH_INFO: `/v3/projects/ad83d69a46e14942bfe2d5457e2a3258/users/06c1d130679c4313acb3f62fc124f76e/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:51.225837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b4079-0cf5-4014-b60b-fbdd57057b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad83d69a46e14942bfe2d5457e2a3258, user_id=06c1d130679c4313acb3f62fc124f76e, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:51.228723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b4079-0cf5-4014-b60b-fbdd57057b8b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:51.259278 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2073/4137] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:51 2022] PUT /identity/v3/projects/ad83d69a46e14942bfe2d5457e2a3258/users/06c1d130679c4313acb3f62fc124f76e/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:51.264454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74661-a5a7-435a-bd49-694a081ef927 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:51.264797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74661-a5a7-435a-bd49-694a081ef927 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:51.265074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74661-a5a7-435a-bd49-694a081ef927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:51.308633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-86a74661-a5a7-435a-bd49-694a081ef927 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:51.309851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-86a74661-a5a7-435a-bd49-694a081ef927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:51.500096 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2065/4138] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:06:51.512128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b4079-0cf5-4014-b60b-fbdd57057b8b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:51.513810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-431b4079-0cf5-4014-b60b-fbdd57057b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:51.627312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b4079-0cf5-4014-b60b-fbdd57057b8b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:51.631707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d09b29-128f-4cac-a407-eabef1c73d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:51.632491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d09b29-128f-4cac-a407-eabef1c73d4e service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:51.632884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d09b29-128f-4cac-a407-eabef1c73d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:51.633231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d09b29-128f-4cac-a407-eabef1c73d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:51.645100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d09b29-128f-4cac-a407-eabef1c73d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:51.646836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d09b29-128f-4cac-a407-eabef1c73d4e service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:51.658295 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2074/4139] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:51.851638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a74661-a5a7-435a-bd49-694a081ef927 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:51.878619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a74661-a5a7-435a-bd49-694a081ef927 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:51.906050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9474370-8baa-4edb-bd38-9256d12aadf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:51.906815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474370-8baa-4edb-bd38-9256d12aadf1 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:51.907167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474370-8baa-4edb-bd38-9256d12aadf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:51.907508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474370-8baa-4edb-bd38-9256d12aadf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:51.916454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a9474370-8baa-4edb-bd38-9256d12aadf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:52.096670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9474370-8baa-4edb-bd38-9256d12aadf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:52.101765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9474370-8baa-4edb-bd38-9256d12aadf1 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:52.135812 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2066/4140] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:06:52.462529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e39622-dc34-4b5d-aa8a-3a43ea91e017 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:52.464036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e39622-dc34-4b5d-aa8a-3a43ea91e017 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:52.464537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e39622-dc34-4b5d-aa8a-3a43ea91e017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:52.602260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-27e39622-dc34-4b5d-aa8a-3a43ea91e017 None None] MFA Rules not processed for user `06c1d130679c4313acb3f62fc124f76e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:52.603832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-27e39622-dc34-4b5d-aa8a-3a43ea91e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:52.712828 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2075/4141] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:52.726701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed0211-a72b-4873-8af8-f5d2abb524b5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:52.727901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed0211-a72b-4873-8af8-f5d2abb524b5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:52.728436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed0211-a72b-4873-8af8-f5d2abb524b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:52.777820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2aed0211-a72b-4873-8af8-f5d2abb524b5 None None] MFA Rules not processed for user `06c1d130679c4313acb3f62fc124f76e`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:52.780764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2aed0211-a72b-4873-8af8-f5d2abb524b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:52.797622 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2067/4142] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:52.817407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e39622-dc34-4b5d-aa8a-3a43ea91e017 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:52.819728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-27e39622-dc34-4b5d-aa8a-3a43ea91e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:52.849546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e39622-dc34-4b5d-aa8a-3a43ea91e017 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:52.862991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1733d-7f34-4dbd-9fcc-0e47c4c212c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:52.863642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1733d-7f34-4dbd-9fcc-0e47c4c212c5 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:52.863930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1733d-7f34-4dbd-9fcc-0e47c4c212c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:52.864410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1733d-7f34-4dbd-9fcc-0e47c4c212c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:52.881994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1733d-7f34-4dbd-9fcc-0e47c4c212c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:52.886118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1733d-7f34-4dbd-9fcc-0e47c4c212c5 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:52.906448 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2076/4143] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:54.230303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed0211-a72b-4873-8af8-f5d2abb524b5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:54.231953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2aed0211-a72b-4873-8af8-f5d2abb524b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:54.349926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:54.438032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed0211-a72b-4873-8af8-f5d2abb524b5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:54.451532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f81e2-e1a3-4fd6-ad33-b8a03d50839a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:54.452181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f81e2-e1a3-4fd6-ad33-b8a03d50839a service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:54.452659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f81e2-e1a3-4fd6-ad33-b8a03d50839a service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:54.453106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f81e2-e1a3-4fd6-ad33-b8a03d50839a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:54.460187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-699f81e2-e1a3-4fd6-ad33-b8a03d50839a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:54.488539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f81e2-e1a3-4fd6-ad33-b8a03d50839a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:54.490421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f81e2-e1a3-4fd6-ad33-b8a03d50839a service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:54.501236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1733d-7f34-4dbd-9fcc-0e47c4c212c5 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:54.515994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1733d-7f34-4dbd-9fcc-0e47c4c212c5 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:54.517458 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2068/4144] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:06:54.534075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aec08f-c601-4ac7-831b-724a8241836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:54.534826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aec08f-c601-4ac7-831b-724a8241836c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:54.535183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aec08f-c601-4ac7-831b-724a8241836c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:54.535536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aec08f-c601-4ac7-831b-724a8241836c admin admin] PATH_INFO: `/v3/users/06c1d130679c4313acb3f62fc124f76e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:54.537092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aec08f-c601-4ac7-831b-724a8241836c admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c1d130679c4313acb3f62fc124f76e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:54.539184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aec08f-c601-4ac7-831b-724a8241836c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:54.639519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:54.643572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e9aec08f-c601-4ac7-831b-724a8241836c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c1d130679c4313acb3f62fc124f76e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:54.671116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e9aec08f-c601-4ac7-831b-724a8241836c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c1d130679c4313acb3f62fc124f76e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:54.672469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e9aec08f-c601-4ac7-831b-724a8241836c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c1d130679c4313acb3f62fc124f76e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:54.685761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e9aec08f-c601-4ac7-831b-724a8241836c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c1d130679c4313acb3f62fc124f76e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:54.686590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e9aec08f-c601-4ac7-831b-724a8241836c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c1d130679c4313acb3f62fc124f76e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:54.708696 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2077/4145] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:06:54 2022] DELETE /identity/v3/users/06c1d130679c4313acb3f62fc124f76e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:55.161313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f81e2-e1a3-4fd6-ad33-b8a03d50839a service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:55.187688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f81e2-e1a3-4fd6-ad33-b8a03d50839a service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:55.369180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332cf16-8af0-45af-9498-712a59493819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:55.369847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332cf16-8af0-45af-9498-712a59493819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:55.370141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332cf16-8af0-45af-9498-712a59493819 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:55.370425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332cf16-8af0-45af-9498-712a59493819 admin admin] PATH_INFO: `/v3/projects/ad83d69a46e14942bfe2d5457e2a3258` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:55.372006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332cf16-8af0-45af-9498-712a59493819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad83d69a46e14942bfe2d5457e2a3258)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:55.373972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332cf16-8af0-45af-9498-712a59493819 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:55.546344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3332cf16-8af0-45af-9498-712a59493819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad83d69a46e14942bfe2d5457e2a3258', 'request_id': 'req-3332cf16-8af0-45af-9498-712a59493819'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:55.589618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3332cf16-8af0-45af-9498-712a59493819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad83d69a46e14942bfe2d5457e2a3258', 'request_id': 'req-3332cf16-8af0-45af-9498-712a59493819'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:55.598683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3332cf16-8af0-45af-9498-712a59493819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad83d69a46e14942bfe2d5457e2a3258', 'request_id': 'req-3332cf16-8af0-45af-9498-712a59493819'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:55.664757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3332cf16-8af0-45af-9498-712a59493819 admin admin] The token cache is being invalidate because project ad83d69a46e14942bfe2d5457e2a3258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:06:55.665432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3332cf16-8af0-45af-9498-712a59493819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:55.666668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3332cf16-8af0-45af-9498-712a59493819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:06:55.669474 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2069/4146] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:06:55 2022] DELETE /identity/v3/projects/ad83d69a46e14942bfe2d5457e2a3258 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:55.679207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a344-f12c-4c6f-9951-6d9cbafcdad0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:55.680752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a344-f12c-4c6f-9951-6d9cbafcdad0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:55.681555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a344-f12c-4c6f-9951-6d9cbafcdad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:55.723129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8127a344-f12c-4c6f-9951-6d9cbafcdad0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:55.726735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8127a344-f12c-4c6f-9951-6d9cbafcdad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:55.931617 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2078/4147] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:55.935429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9c919-796a-4a5c-ba7a-51b226ac1b8b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:55.936241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9c919-796a-4a5c-ba7a-51b226ac1b8b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:55.937000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9c919-796a-4a5c-ba7a-51b226ac1b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:55.974633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-baf9c919-796a-4a5c-ba7a-51b226ac1b8b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:55.977409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-baf9c919-796a-4a5c-ba7a-51b226ac1b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:55.999903 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2070/4148] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:56.001012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127a344-f12c-4c6f-9951-6d9cbafcdad0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:56.016912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127a344-f12c-4c6f-9951-6d9cbafcdad0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:56.026136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca70b50-5b3d-4db3-abd8-7e8890962f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:56.026942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca70b50-5b3d-4db3-abd8-7e8890962f43 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:56.028092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca70b50-5b3d-4db3-abd8-7e8890962f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:56.028375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca70b50-5b3d-4db3-abd8-7e8890962f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:56.029032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca70b50-5b3d-4db3-abd8-7e8890962f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:06:56.029337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca70b50-5b3d-4db3-abd8-7e8890962f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:56.031155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca70b50-5b3d-4db3-abd8-7e8890962f43 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:56.062798 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2079/4149] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:06:56.066884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9c919-796a-4a5c-ba7a-51b226ac1b8b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:56.085134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9c919-796a-4a5c-ba7a-51b226ac1b8b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:56.095136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1af0f7-7e01-4ce9-b5f4-a35732dc3ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:56.096525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af0f7-7e01-4ce9-b5f4-a35732dc3ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:56.097066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af0f7-7e01-4ce9-b5f4-a35732dc3ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:56.097769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af0f7-7e01-4ce9-b5f4-a35732dc3ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:56.099584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1af0f7-7e01-4ce9-b5f4-a35732dc3ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:56.103506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1af0f7-7e01-4ce9-b5f4-a35732dc3ae1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:56.182853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca70b50-5b3d-4db3-abd8-7e8890962f43 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:56.192319 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2071/4150] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:06:56 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:56.203586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca70b50-5b3d-4db3-abd8-7e8890962f43 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:56.371764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4185a-7b44-4bf3-8a0b-472a1fe807ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:56.376049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4185a-7b44-4bf3-8a0b-472a1fe807ca admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:56.376571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4185a-7b44-4bf3-8a0b-472a1fe807ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:56.378007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4185a-7b44-4bf3-8a0b-472a1fe807ca admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:56.379920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4185a-7b44-4bf3-8a0b-472a1fe807ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:56.403221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4185a-7b44-4bf3-8a0b-472a1fe807ca admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:56.487171 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2080/4151] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:06:56 2022] POST /identity/v3/users => generated 286 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:06:56.492778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1af0f7-7e01-4ce9-b5f4-a35732dc3ae1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:56.517605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1af0f7-7e01-4ce9-b5f4-a35732dc3ae1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:56.537688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238b00d-445d-46ac-96f7-41a83a2b5ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:56.538962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238b00d-445d-46ac-96f7-41a83a2b5ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:56.539397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238b00d-445d-46ac-96f7-41a83a2b5ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:56.539838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238b00d-445d-46ac-96f7-41a83a2b5ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:56.540905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238b00d-445d-46ac-96f7-41a83a2b5ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:56.543595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238b00d-445d-46ac-96f7-41a83a2b5ac2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:56.609897 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2072/4152] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:56.610619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4185a-7b44-4bf3-8a0b-472a1fe807ca admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:56.624944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4185a-7b44-4bf3-8a0b-472a1fe807ca admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:56.631843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650cf8b-8277-4e70-9988-add6a06467e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:56.632832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650cf8b-8277-4e70-9988-add6a06467e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:56.633255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650cf8b-8277-4e70-9988-add6a06467e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:56.633762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650cf8b-8277-4e70-9988-add6a06467e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:56.634969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650cf8b-8277-4e70-9988-add6a06467e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:56.639156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650cf8b-8277-4e70-9988-add6a06467e8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:56.689676 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2081/4153] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:06:56.699086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238b00d-445d-46ac-96f7-41a83a2b5ac2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:56.726626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238b00d-445d-46ac-96f7-41a83a2b5ac2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:56.732264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c210aea-662a-4dfa-a14f-a3892529bf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:56.733398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c210aea-662a-4dfa-a14f-a3892529bf92 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:56.733867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c210aea-662a-4dfa-a14f-a3892529bf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:56.734462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c210aea-662a-4dfa-a14f-a3892529bf92 admin admin] PATH_INFO: `/v3/projects/732cb1bf67764eeba464f8e208afe85a/users/cdaff6e87e3a4a4b9497947b7b1a6142/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:56.746645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:56.757963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c210aea-662a-4dfa-a14f-a3892529bf92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732cb1bf67764eeba464f8e208afe85a, user_id=cdaff6e87e3a4a4b9497947b7b1a6142, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:56.762019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c210aea-662a-4dfa-a14f-a3892529bf92 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:56.790087 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2073/4154] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:06:56 2022] PUT /identity/v3/projects/732cb1bf67764eeba464f8e208afe85a/users/cdaff6e87e3a4a4b9497947b7b1a6142/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:06:56.800828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9573d2-c0f6-434a-b6ac-1f9de3a7774e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:56.802069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9573d2-c0f6-434a-b6ac-1f9de3a7774e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:56.802069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9573d2-c0f6-434a-b6ac-1f9de3a7774e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:56.900761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5d9573d2-c0f6-434a-b6ac-1f9de3a7774e None None] MFA Rules not processed for user `cdaff6e87e3a4a4b9497947b7b1a6142`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:06:56.905993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5d9573d2-c0f6-434a-b6ac-1f9de3a7774e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:56.969140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:06:57.084710 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2082/4155] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:06:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:06:57.297779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c210aea-662a-4dfa-a14f-a3892529bf92 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:06:57.301368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2c210aea-662a-4dfa-a14f-a3892529bf92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:06:57.593290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c210aea-662a-4dfa-a14f-a3892529bf92 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:06:57.622713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcbbb1-a710-45fd-aeed-c12eaabd84d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:06:57.628744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcbbb1-a710-45fd-aeed-c12eaabd84d4 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:06:57.629311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcbbb1-a710-45fd-aeed-c12eaabd84d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:06:57.629842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcbbb1-a710-45fd-aeed-c12eaabd84d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:06:57.654391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcbbb1-a710-45fd-aeed-c12eaabd84d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:06:57.659158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcbbb1-a710-45fd-aeed-c12eaabd84d4 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:06:57.718365 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2074/4156] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:06:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:00.122627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9573d2-c0f6-434a-b6ac-1f9de3a7774e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:00.127774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5d9573d2-c0f6-434a-b6ac-1f9de3a7774e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:00.272774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9573d2-c0f6-434a-b6ac-1f9de3a7774e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:00.292248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd36b5e-70ef-46f4-820a-428cf90c25d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:00.294648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36b5e-70ef-46f4-820a-428cf90c25d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:00.295225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36b5e-70ef-46f4-820a-428cf90c25d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:00.295726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd36b5e-70ef-46f4-820a-428cf90c25d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:00.301284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2fd36b5e-70ef-46f4-820a-428cf90c25d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:00.337739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd36b5e-70ef-46f4-820a-428cf90c25d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:00.345274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd36b5e-70ef-46f4-820a-428cf90c25d8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:00.370454 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2083/4157] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:00.590062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ca2db-c103-4e8d-b09a-252cc6c5a816 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:00.590813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ca2db-c103-4e8d-b09a-252cc6c5a816 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:00.590813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ca2db-c103-4e8d-b09a-252cc6c5a816 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:00.594935 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2075/4158] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:07:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:07:00.613612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c199d-06b1-4dd3-a737-ead545579c19 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:00.614542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c199d-06b1-4dd3-a737-ead545579c19 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:00.614781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c199d-06b1-4dd3-a737-ead545579c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:00.734683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4f3c199d-06b1-4dd3-a737-ead545579c19 None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:00.736202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4f3c199d-06b1-4dd3-a737-ead545579c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:00.745388 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2084/4159] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:07:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:00.798515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ca2db-c103-4e8d-b09a-252cc6c5a816 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:00.801602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bf8ca2db-c103-4e8d-b09a-252cc6c5a816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:00.857460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ca2db-c103-4e8d-b09a-252cc6c5a816 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:00.867561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b0b45-e4ea-42e2-921a-4c33d1be36f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:00.869111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b0b45-e4ea-42e2-921a-4c33d1be36f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:00.869798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b0b45-e4ea-42e2-921a-4c33d1be36f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:00.871840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b0b45-e4ea-42e2-921a-4c33d1be36f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:00.887568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b0b45-e4ea-42e2-921a-4c33d1be36f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:00.892315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b0b45-e4ea-42e2-921a-4c33d1be36f8 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:00.917150 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2076/4160] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:04.541622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c199d-06b1-4dd3-a737-ead545579c19 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:04.672123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c199d-06b1-4dd3-a737-ead545579c19 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:04.679583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:04.680242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:04.680511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:04.680788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] PATH_INFO: `/v3/users/cdaff6e87e3a4a4b9497947b7b1a6142` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:04.681989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdaff6e87e3a4a4b9497947b7b1a6142)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:04.684554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:04.814163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:04.819472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdaff6e87e3a4a4b9497947b7b1a6142'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:04.836496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdaff6e87e3a4a4b9497947b7b1a6142'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:04.837641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdaff6e87e3a4a4b9497947b7b1a6142'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:04.856059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdaff6e87e3a4a4b9497947b7b1a6142'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:04.857054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdaff6e87e3a4a4b9497947b7b1a6142'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:04.890421 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2085/4161] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:04 2022] DELETE /identity/v3/users/cdaff6e87e3a4a4b9497947b7b1a6142 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:04.896445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051ae3-2597-49f2-a620-592f0e18cc21 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:04.897211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051ae3-2597-49f2-a620-592f0e18cc21 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:04.897211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051ae3-2597-49f2-a620-592f0e18cc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:04.931538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-81051ae3-2597-49f2-a620-592f0e18cc21 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:04.933007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-81051ae3-2597-49f2-a620-592f0e18cc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:05.025228 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2077/4162] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:05.043172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:05.044686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:05.159791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740083b-5bf6-421e-b557-837819b4ccf9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:05.166918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895be6d-e4ff-4a3b-93c7-ff903bbe27ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:05.167847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895be6d-e4ff-4a3b-93c7-ff903bbe27ff service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:05.168291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895be6d-e4ff-4a3b-93c7-ff903bbe27ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:05.168724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895be6d-e4ff-4a3b-93c7-ff903bbe27ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:05.185329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895be6d-e4ff-4a3b-93c7-ff903bbe27ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:05.187862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895be6d-e4ff-4a3b-93c7-ff903bbe27ff service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:05.210863 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2086/4163] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:06.073334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81051ae3-2597-49f2-a620-592f0e18cc21 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:06.075494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-81051ae3-2597-49f2-a620-592f0e18cc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:06.113565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81051ae3-2597-49f2-a620-592f0e18cc21 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:06.149187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf4218-b57d-44d8-b701-e1e389deb77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:06.153754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf4218-b57d-44d8-b701-e1e389deb77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:06.154059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf4218-b57d-44d8-b701-e1e389deb77d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:06.154345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf4218-b57d-44d8-b701-e1e389deb77d admin admin] PATH_INFO: `/v3/projects/732cb1bf67764eeba464f8e208afe85a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:06.161142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf4218-b57d-44d8-b701-e1e389deb77d admin admin] RBAC: Authorizing `identity:delete_project(project_id=732cb1bf67764eeba464f8e208afe85a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:06.164006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf4218-b57d-44d8-b701-e1e389deb77d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:06.237501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f8bf4218-b57d-44d8-b701-e1e389deb77d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732cb1bf67764eeba464f8e208afe85a', 'request_id': 'req-f8bf4218-b57d-44d8-b701-e1e389deb77d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:06.245096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:06.251844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f8bf4218-b57d-44d8-b701-e1e389deb77d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732cb1bf67764eeba464f8e208afe85a', 'request_id': 'req-f8bf4218-b57d-44d8-b701-e1e389deb77d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:06.265821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f8bf4218-b57d-44d8-b701-e1e389deb77d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732cb1bf67764eeba464f8e208afe85a', 'request_id': 'req-f8bf4218-b57d-44d8-b701-e1e389deb77d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:06.282412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f8bf4218-b57d-44d8-b701-e1e389deb77d admin admin] The token cache is being invalidate because project 732cb1bf67764eeba464f8e208afe85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:06.282711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f8bf4218-b57d-44d8-b701-e1e389deb77d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:06.283793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f8bf4218-b57d-44d8-b701-e1e389deb77d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:06.285976 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2078/4164] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:06 2022] DELETE /identity/v3/projects/732cb1bf67764eeba464f8e208afe85a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:06.290687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af52db-9f42-47d9-823c-24ccb75ac572 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:06.291332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af52db-9f42-47d9-823c-24ccb75ac572 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:06.291332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af52db-9f42-47d9-823c-24ccb75ac572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:06.332093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-30af52db-9f42-47d9-823c-24ccb75ac572 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:06.336831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-30af52db-9f42-47d9-823c-24ccb75ac572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:06.470930 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2087/4165] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:06.473367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b5b4f-db9c-4906-964c-b0e2dd2fba1a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:06.474491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b5b4f-db9c-4906-964c-b0e2dd2fba1a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:06.474800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b5b4f-db9c-4906-964c-b0e2dd2fba1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:06.508258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-827b5b4f-db9c-4906-964c-b0e2dd2fba1a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:06.510101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-827b5b4f-db9c-4906-964c-b0e2dd2fba1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:06.535713 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2079/4166] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:06.541052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af52db-9f42-47d9-823c-24ccb75ac572 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:06.560305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af52db-9f42-47d9-823c-24ccb75ac572 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:06.566560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77ccfe-561a-4b6f-b200-42ac269e4770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:06.568249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77ccfe-561a-4b6f-b200-42ac269e4770 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:06.568802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77ccfe-561a-4b6f-b200-42ac269e4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:06.569170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77ccfe-561a-4b6f-b200-42ac269e4770 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:06.569933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77ccfe-561a-4b6f-b200-42ac269e4770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:06.570451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77ccfe-561a-4b6f-b200-42ac269e4770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:06.572257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77ccfe-561a-4b6f-b200-42ac269e4770 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:06.616593 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2088/4167] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:06.622115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b5b4f-db9c-4906-964c-b0e2dd2fba1a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:06.634594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b5b4f-db9c-4906-964c-b0e2dd2fba1a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:06.649042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03bbe8-4b69-4fb0-9717-15c9bb847928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:06.649851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03bbe8-4b69-4fb0-9717-15c9bb847928 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:06.650230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03bbe8-4b69-4fb0-9717-15c9bb847928 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:06.650616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03bbe8-4b69-4fb0-9717-15c9bb847928 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:06.651363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03bbe8-4b69-4fb0-9717-15c9bb847928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:06.653818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03bbe8-4b69-4fb0-9717-15c9bb847928 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:06.718271 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2080/4168] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:06 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:06.719159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77ccfe-561a-4b6f-b200-42ac269e4770 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:06.746381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77ccfe-561a-4b6f-b200-42ac269e4770 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:06.855084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:06.862223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba050c8-0169-4216-ac7e-6531259ca5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:06.862223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba050c8-0169-4216-ac7e-6531259ca5ad admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:06.862223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba050c8-0169-4216-ac7e-6531259ca5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:06.862223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba050c8-0169-4216-ac7e-6531259ca5ad admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:06.862939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba050c8-0169-4216-ac7e-6531259ca5ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:06.865635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba050c8-0169-4216-ac7e-6531259ca5ad admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:06.901230 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2089/4169] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:06 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:07:06.905456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03bbe8-4b69-4fb0-9717-15c9bb847928 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:06.927397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03bbe8-4b69-4fb0-9717-15c9bb847928 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:06.941906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0066aa0-10d8-45f7-991c-f26e62712ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:06.944084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0066aa0-10d8-45f7-991c-f26e62712ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:06.944657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0066aa0-10d8-45f7-991c-f26e62712ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:06.945174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0066aa0-10d8-45f7-991c-f26e62712ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:06.946920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0066aa0-10d8-45f7-991c-f26e62712ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:06.950636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0066aa0-10d8-45f7-991c-f26e62712ef8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:06.977510 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2081/4170] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:06.987959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba050c8-0169-4216-ac7e-6531259ca5ad admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:07.002269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba050c8-0169-4216-ac7e-6531259ca5ad admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:07.009450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3f655-60f5-4393-ada3-9ec6e3cbe17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:07.009987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3f655-60f5-4393-ada3-9ec6e3cbe17f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:07.010274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3f655-60f5-4393-ada3-9ec6e3cbe17f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:07.010574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3f655-60f5-4393-ada3-9ec6e3cbe17f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:07.011726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3f655-60f5-4393-ada3-9ec6e3cbe17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:07.013340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3f655-60f5-4393-ada3-9ec6e3cbe17f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:07.026543 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2090/4171] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:07.032745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0066aa0-10d8-45f7-991c-f26e62712ef8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:07.055112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0066aa0-10d8-45f7-991c-f26e62712ef8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:07.062029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e4abf-6c24-4e7d-b46e-3530ca75cf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:07.063061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e4abf-6c24-4e7d-b46e-3530ca75cf12 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:07.063491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e4abf-6c24-4e7d-b46e-3530ca75cf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:07.063976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e4abf-6c24-4e7d-b46e-3530ca75cf12 admin admin] PATH_INFO: `/v3/projects/828114ad963e40cca65e557054cffb8c/users/7a46c5d0d2d441c384246fb7867a565b/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:07.089962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e4abf-6c24-4e7d-b46e-3530ca75cf12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=828114ad963e40cca65e557054cffb8c, user_id=7a46c5d0d2d441c384246fb7867a565b, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:07.094668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e4abf-6c24-4e7d-b46e-3530ca75cf12 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:07.118777 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2082/4172] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:07 2022] PUT /identity/v3/projects/828114ad963e40cca65e557054cffb8c/users/7a46c5d0d2d441c384246fb7867a565b/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:07.131879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e9124-c7c9-4543-95ca-a835fc55dafe None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:07.132382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e9124-c7c9-4543-95ca-a835fc55dafe None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:07.132881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e9124-c7c9-4543-95ca-a835fc55dafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:07.184743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6c7e9124-c7c9-4543-95ca-a835fc55dafe None None] MFA Rules not processed for user `7a46c5d0d2d441c384246fb7867a565b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:07.186880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6c7e9124-c7c9-4543-95ca-a835fc55dafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:07.300818 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2091/4173] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:07:07.303269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e4abf-6c24-4e7d-b46e-3530ca75cf12 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:07.428904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e4abf-6c24-4e7d-b46e-3530ca75cf12 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:07.435358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45600308-f34b-46c5-8128-51d2d6aef28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:07.436119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45600308-f34b-46c5-8128-51d2d6aef28e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:07.436392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45600308-f34b-46c5-8128-51d2d6aef28e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:07.436673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45600308-f34b-46c5-8128-51d2d6aef28e admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:07.437333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45600308-f34b-46c5-8128-51d2d6aef28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:07.439527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45600308-f34b-46c5-8128-51d2d6aef28e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:07.475414 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2083/4174] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:07 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:07:07.479343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e9124-c7c9-4543-95ca-a835fc55dafe None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:07.493534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e9124-c7c9-4543-95ca-a835fc55dafe None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:07.569459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43880401-d025-402c-a68a-2b3514d8af07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:07.570030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43880401-d025-402c-a68a-2b3514d8af07 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:07.570316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43880401-d025-402c-a68a-2b3514d8af07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:07.570594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43880401-d025-402c-a68a-2b3514d8af07 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:07.571407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43880401-d025-402c-a68a-2b3514d8af07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:07.573382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43880401-d025-402c-a68a-2b3514d8af07 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:07.609084 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2092/4175] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:07 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:07.612904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45600308-f34b-46c5-8128-51d2d6aef28e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:07.625490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45600308-f34b-46c5-8128-51d2d6aef28e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:07.631634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff486e9-5327-47f8-9385-990ef21cc9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:07.632389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff486e9-5327-47f8-9385-990ef21cc9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:07.632670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff486e9-5327-47f8-9385-990ef21cc9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:07.632997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff486e9-5327-47f8-9385-990ef21cc9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:07.633640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff486e9-5327-47f8-9385-990ef21cc9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:07.635812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff486e9-5327-47f8-9385-990ef21cc9e9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:07.655063 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2084/4176] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:07:07.656513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43880401-d025-402c-a68a-2b3514d8af07 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:07.678873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43880401-d025-402c-a68a-2b3514d8af07 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:07.687415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acada173-46d0-4a9d-b974-86865b1d1ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:07.688771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acada173-46d0-4a9d-b974-86865b1d1ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:07.689357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acada173-46d0-4a9d-b974-86865b1d1ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:07.690033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acada173-46d0-4a9d-b974-86865b1d1ae4 admin admin] PATH_INFO: `/v3/projects/93d2c393bc1c4671868f415f1f855e56/users/63bf634cc72e44b6a028904953af3cf0/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:07.736302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acada173-46d0-4a9d-b974-86865b1d1ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d2c393bc1c4671868f415f1f855e56, user_id=63bf634cc72e44b6a028904953af3cf0, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:07.753279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acada173-46d0-4a9d-b974-86865b1d1ae4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:07.780357 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2093/4177] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:07 2022] PUT /identity/v3/projects/93d2c393bc1c4671868f415f1f855e56/users/63bf634cc72e44b6a028904953af3cf0/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:07.784540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff486e9-5327-47f8-9385-990ef21cc9e9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:07.799055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff486e9-5327-47f8-9385-990ef21cc9e9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:07.904299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:07.940521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58d90d-f3a9-4cb3-bf7a-c47a96beb26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:07.941681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58d90d-f3a9-4cb3-bf7a-c47a96beb26b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:07.942120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58d90d-f3a9-4cb3-bf7a-c47a96beb26b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:07.942633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58d90d-f3a9-4cb3-bf7a-c47a96beb26b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:07.944347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58d90d-f3a9-4cb3-bf7a-c47a96beb26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:07.947209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58d90d-f3a9-4cb3-bf7a-c47a96beb26b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:07.979318 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2085/4178] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:07:07.984246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acada173-46d0-4a9d-b974-86865b1d1ae4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:08.002566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acada173-46d0-4a9d-b974-86865b1d1ae4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:08.018852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddc384-5555-4cee-a624-31c05ce98694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:08.019622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddc384-5555-4cee-a624-31c05ce98694 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:08.019969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddc384-5555-4cee-a624-31c05ce98694 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:08.022796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddc384-5555-4cee-a624-31c05ce98694 admin admin] PATH_INFO: `/v3/projects/93d2c393bc1c4671868f415f1f855e56/users/63bf634cc72e44b6a028904953af3cf0/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:08.025108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddc384-5555-4cee-a624-31c05ce98694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d2c393bc1c4671868f415f1f855e56, user_id=63bf634cc72e44b6a028904953af3cf0, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:08.028457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddc384-5555-4cee-a624-31c05ce98694 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:08.047019 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2094/4179] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:07 2022] PUT /identity/v3/projects/93d2c393bc1c4671868f415f1f855e56/users/63bf634cc72e44b6a028904953af3cf0/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:08.055058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4fd87-1796-4d2e-8740-e982550d4560 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:08.055982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4fd87-1796-4d2e-8740-e982550d4560 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:08.056815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4fd87-1796-4d2e-8740-e982550d4560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:08.108204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ece4fd87-1796-4d2e-8740-e982550d4560 None None] MFA Rules not processed for user `63bf634cc72e44b6a028904953af3cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:08.110914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ece4fd87-1796-4d2e-8740-e982550d4560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:08.242440 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2086/4180] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:08.248958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddc384-5555-4cee-a624-31c05ce98694 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:08.264632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddc384-5555-4cee-a624-31c05ce98694 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:08.270673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139dc35-5874-471f-a901-fc25ae897ec9 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:08.272053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139dc35-5874-471f-a901-fc25ae897ec9 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:08.272780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139dc35-5874-471f-a901-fc25ae897ec9 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:08.273160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139dc35-5874-471f-a901-fc25ae897ec9 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:08.274093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139dc35-5874-471f-a901-fc25ae897ec9 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:08.276200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139dc35-5874-471f-a901-fc25ae897ec9 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:08.291991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:08.322187 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2095/4181] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:08 2022] POST /identity/v3/projects => generated 350 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:08.326644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4fd87-1796-4d2e-8740-e982550d4560 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:08.385296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4fd87-1796-4d2e-8740-e982550d4560 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:08.473386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734c4b7-2a89-4178-a107-4acfb3b928b4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:08.474649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734c4b7-2a89-4178-a107-4acfb3b928b4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:08.475160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734c4b7-2a89-4178-a107-4acfb3b928b4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:08.475503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734c4b7-2a89-4178-a107-4acfb3b928b4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:08.476617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734c4b7-2a89-4178-a107-4acfb3b928b4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:08.479041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734c4b7-2a89-4178-a107-4acfb3b928b4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:08.482239 n-d-854118-7 devstack@keystone.service[88374]: WARNING keystone.server.flask.common [None req-3734c4b7-2a89-4178-a107-4acfb3b928b4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 19:07:08.538823 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2087/4182] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:08 2022] POST /identity/v3/projects => generated 351 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:08.542000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139dc35-5874-471f-a901-fc25ae897ec9 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:08.557894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139dc35-5874-471f-a901-fc25ae897ec9 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:08.676192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afbd31-d124-4d5f-8901-014c5558ce49 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:08.677480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afbd31-d124-4d5f-8901-014c5558ce49 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:08.678003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afbd31-d124-4d5f-8901-014c5558ce49 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:08.678727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afbd31-d124-4d5f-8901-014c5558ce49 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/users/7a46c5d0d2d441c384246fb7867a565b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:08.680211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afbd31-d124-4d5f-8901-014c5558ce49 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:get_user(user_id=7a46c5d0d2d441c384246fb7867a565b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:08.683185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afbd31-d124-4d5f-8901-014c5558ce49 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:08.685413 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2096/4183] 10.222.0.70 () {58 vars in 1221 bytes} [Sun Aug 28 19:07:08 2022] GET /identity/v3/users/7a46c5d0d2d441c384246fb7867a565b => generated 288 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:08.692191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734c4b7-2a89-4178-a107-4acfb3b928b4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:08.709423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734c4b7-2a89-4178-a107-4acfb3b928b4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:08.716084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a78c5a-48a5-48f0-bc2a-4fd08d63e57d tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:08.716728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78c5a-48a5-48f0-bc2a-4fd08d63e57d tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:08.717016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78c5a-48a5-48f0-bc2a-4fd08d63e57d tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:08.717321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78c5a-48a5-48f0-bc2a-4fd08d63e57d tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/credentials` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:08.718132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a78c5a-48a5-48f0-bc2a-4fd08d63e57d tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:08.720460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a78c5a-48a5-48f0-bc2a-4fd08d63e57d tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:08.753878 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2088/4184] 10.222.0.70 () {60 vars in 1162 bytes} [Sun Aug 28 19:07:08 2022] POST /identity/v3/credentials => generated 431 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:08.758074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afbd31-d124-4d5f-8901-014c5558ce49 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:08.773349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afbd31-d124-4d5f-8901-014c5558ce49 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:08.788201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70458a44-96f3-4c6a-8c15-6afd0942d5c3 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:08.788855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70458a44-96f3-4c6a-8c15-6afd0942d5c3 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:08.789219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70458a44-96f3-4c6a-8c15-6afd0942d5c3 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:08.789494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70458a44-96f3-4c6a-8c15-6afd0942d5c3 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/credentials/4e50864dbb003071e03156dd4aa7b9889187d797520a7870d189c478dd45c7d6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:08.795224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70458a44-96f3-4c6a-8c15-6afd0942d5c3 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=4e50864dbb003071e03156dd4aa7b9889187d797520a7870d189c478dd45c7d6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:08.798049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70458a44-96f3-4c6a-8c15-6afd0942d5c3 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:08.801276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70458a44-96f3-4c6a-8c15-6afd0942d5c3 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=4e50864dbb003071e03156dd4aa7b9889187d797520a7870d189c478dd45c7d6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:08.815592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70458a44-96f3-4c6a-8c15-6afd0942d5c3 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:08.858467 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2097/4185] 10.222.0.70 () {60 vars in 1358 bytes} [Sun Aug 28 19:07:08 2022] PATCH /identity/v3/credentials/4e50864dbb003071e03156dd4aa7b9889187d797520a7870d189c478dd45c7d6 => generated 435 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:08.863664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a78c5a-48a5-48f0-bc2a-4fd08d63e57d tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:08.881361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a78c5a-48a5-48f0-bc2a-4fd08d63e57d tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:08.892927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde64d28-4bf0-4715-8773-171c4db57bbd tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:08.898079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde64d28-4bf0-4715-8773-171c4db57bbd tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:08.900231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde64d28-4bf0-4715-8773-171c4db57bbd tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:08.900946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde64d28-4bf0-4715-8773-171c4db57bbd tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/credentials/4e50864dbb003071e03156dd4aa7b9889187d797520a7870d189c478dd45c7d6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:08.936348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde64d28-4bf0-4715-8773-171c4db57bbd tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=4e50864dbb003071e03156dd4aa7b9889187d797520a7870d189c478dd45c7d6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:08.945831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde64d28-4bf0-4715-8773-171c4db57bbd tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:08.952513 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2089/4186] 10.222.0.70 () {58 vars in 1335 bytes} [Sun Aug 28 19:07:08 2022] GET /identity/v3/credentials/4e50864dbb003071e03156dd4aa7b9889187d797520a7870d189c478dd45c7d6 => generated 435 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:08.957098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70458a44-96f3-4c6a-8c15-6afd0942d5c3 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:08.974904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70458a44-96f3-4c6a-8c15-6afd0942d5c3 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:08.993272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ce359-4c80-41c4-b78a-105a085229a6 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:08.994973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ce359-4c80-41c4-b78a-105a085229a6 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:08.996639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ce359-4c80-41c4-b78a-105a085229a6 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:08.997389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ce359-4c80-41c4-b78a-105a085229a6 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/credentials/4e50864dbb003071e03156dd4aa7b9889187d797520a7870d189c478dd45c7d6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:09.001022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ce359-4c80-41c4-b78a-105a085229a6 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=4e50864dbb003071e03156dd4aa7b9889187d797520a7870d189c478dd45c7d6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:09.009119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ce359-4c80-41c4-b78a-105a085229a6 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:09.077472 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2098/4187] 10.222.0.70 () {58 vars in 1338 bytes} [Sun Aug 28 19:07:08 2022] DELETE /identity/v3/credentials/4e50864dbb003071e03156dd4aa7b9889187d797520a7870d189c478dd45c7d6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:09.085966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde64d28-4bf0-4715-8773-171c4db57bbd tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:09.150108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde64d28-4bf0-4715-8773-171c4db57bbd tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:09.163101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84b966-e852-4c4c-b603-1eb6409be392 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:09.164940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84b966-e852-4c4c-b603-1eb6409be392 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:09.165843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84b966-e852-4c4c-b603-1eb6409be392 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:09.166889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84b966-e852-4c4c-b603-1eb6409be392 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/credentials` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:09.168272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84b966-e852-4c4c-b603-1eb6409be392 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:09.172253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84b966-e852-4c4c-b603-1eb6409be392 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:09.224927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ce359-4c80-41c4-b78a-105a085229a6 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:09.232175 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2090/4188] 10.222.0.70 () {60 vars in 1162 bytes} [Sun Aug 28 19:07:09 2022] POST /identity/v3/credentials => generated 431 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:09.244359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ce359-4c80-41c4-b78a-105a085229a6 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:09.265540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c0d37-32a9-4b7a-ab5d-4ed00c717d17 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:09.266680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c0d37-32a9-4b7a-ab5d-4ed00c717d17 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:09.266680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c0d37-32a9-4b7a-ab5d-4ed00c717d17 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:09.267252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c0d37-32a9-4b7a-ab5d-4ed00c717d17 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/credentials` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:09.267772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c0d37-32a9-4b7a-ab5d-4ed00c717d17 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:09.271749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c0d37-32a9-4b7a-ab5d-4ed00c717d17 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:09.324448 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2099/4189] 10.222.0.70 () {60 vars in 1162 bytes} [Sun Aug 28 19:07:09 2022] POST /identity/v3/credentials => generated 430 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:09.327515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84b966-e852-4c4c-b603-1eb6409be392 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:09.356680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84b966-e852-4c4c-b603-1eb6409be392 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:09.378728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41802f7-f76f-42b5-8307-be363e739d6c tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:09.381670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41802f7-f76f-42b5-8307-be363e739d6c tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:09.382652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41802f7-f76f-42b5-8307-be363e739d6c tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:09.385299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41802f7-f76f-42b5-8307-be363e739d6c tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/credentials` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:09.391857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41802f7-f76f-42b5-8307-be363e739d6c tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:09.401128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41802f7-f76f-42b5-8307-be363e739d6c tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:09.431687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41802f7-f76f-42b5-8307-be363e739d6c tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:09.438505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41802f7-f76f-42b5-8307-be363e739d6c tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:09.443990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41802f7-f76f-42b5-8307-be363e739d6c tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:09.447540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41802f7-f76f-42b5-8307-be363e739d6c tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:09.451991 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2091/4190] 10.222.0.70 () {58 vars in 1140 bytes} [Sun Aug 28 19:07:09 2022] GET /identity/v3/credentials => generated 946 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:09.456365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c0d37-32a9-4b7a-ab5d-4ed00c717d17 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:09.504017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c0d37-32a9-4b7a-ab5d-4ed00c717d17 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:09.523987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4789f-3eb3-4f52-b1fa-50983b91495f tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:09.524908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4789f-3eb3-4f52-b1fa-50983b91495f tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:09.525204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4789f-3eb3-4f52-b1fa-50983b91495f tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:09.525489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4789f-3eb3-4f52-b1fa-50983b91495f tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/credentials/2467ccbd1ccc2d1d3d345945b8f43d285295ec2ccb097d5c46bd2848a5bda69e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:09.532207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4789f-3eb3-4f52-b1fa-50983b91495f tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=2467ccbd1ccc2d1d3d345945b8f43d285295ec2ccb097d5c46bd2848a5bda69e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:09.538474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4789f-3eb3-4f52-b1fa-50983b91495f tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:09.578030 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2100/4191] 10.222.0.70 () {58 vars in 1338 bytes} [Sun Aug 28 19:07:09 2022] DELETE /identity/v3/credentials/2467ccbd1ccc2d1d3d345945b8f43d285295ec2ccb097d5c46bd2848a5bda69e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:09.584479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41802f7-f76f-42b5-8307-be363e739d6c tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:09.617640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41802f7-f76f-42b5-8307-be363e739d6c tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:09.637046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23a907-40d7-4863-b369-0d05b84444e4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:09.638175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23a907-40d7-4863-b369-0d05b84444e4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:09.638770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23a907-40d7-4863-b369-0d05b84444e4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:09.639331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23a907-40d7-4863-b369-0d05b84444e4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/credentials/71acffa8403b49cb98137547659fbb5d14d7c8aa54955ca0fdadac76f6d2f462` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:09.643633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23a907-40d7-4863-b369-0d05b84444e4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=71acffa8403b49cb98137547659fbb5d14d7c8aa54955ca0fdadac76f6d2f462)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:09.653395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23a907-40d7-4863-b369-0d05b84444e4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:09.733076 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2092/4192] 10.222.0.70 () {58 vars in 1338 bytes} [Sun Aug 28 19:07:09 2022] DELETE /identity/v3/credentials/71acffa8403b49cb98137547659fbb5d14d7c8aa54955ca0fdadac76f6d2f462 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:09.738136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4789f-3eb3-4f52-b1fa-50983b91495f tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:09.771866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4789f-3eb3-4f52-b1fa-50983b91495f tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:09.806551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:09.807758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:09.808244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:09.808783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/projects/9d9600d3b76b47fbbacc56cf5a8d3acd` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:09.810803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d9600d3b76b47fbbacc56cf5a8d3acd)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:09.819007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:09.959222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9600d3b76b47fbbacc56cf5a8d3acd', 'request_id': 'req-2e62de2f-c186-462a-b701-2fb74a68ffd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:09.969948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9600d3b76b47fbbacc56cf5a8d3acd', 'request_id': 'req-2e62de2f-c186-462a-b701-2fb74a68ffd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:09.983902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9600d3b76b47fbbacc56cf5a8d3acd', 'request_id': 'req-2e62de2f-c186-462a-b701-2fb74a68ffd1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:10.018167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] The token cache is being invalidate because project 9d9600d3b76b47fbbacc56cf5a8d3acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:10.018613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:10.020116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:10.024600 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2101/4193] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:09 2022] DELETE /identity/v3/projects/9d9600d3b76b47fbbacc56cf5a8d3acd => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:10.030588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23a907-40d7-4863-b369-0d05b84444e4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:10.033401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-db23a907-40d7-4863-b369-0d05b84444e4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:10.058719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:10.076168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23a907-40d7-4863-b369-0d05b84444e4 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:10.201260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63bf634cc72e44b6a028904953af3cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93d2c393bc1c4671868f415f1f855e56', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:10.202702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:10.203494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:10.204200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] PATH_INFO: `/v3/projects/b8c638c373f941bbb56e499d39381362` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:10.205833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b8c638c373f941bbb56e499d39381362)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:10.209089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:10.270637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8c638c373f941bbb56e499d39381362', 'request_id': 'req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:10.295123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8c638c373f941bbb56e499d39381362', 'request_id': 'req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:10.314417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8c638c373f941bbb56e499d39381362', 'request_id': 'req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:10.342537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] The token cache is being invalidate because project b8c638c373f941bbb56e499d39381362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:10.343108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:10.344906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c6c93b2d-54ce-4b25-ad7d-bcec58aa3135 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:10.350091 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2093/4194] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:10 2022] DELETE /identity/v3/projects/b8c638c373f941bbb56e499d39381362 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:10.354439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:10.356739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:10.431773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:10.558425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62de2f-c186-462a-b701-2fb74a68ffd1 tempest-CredentialsTestJSON-679586072 tempest-CredentialsTestJSON-679586072-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:10.667750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:10.668590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:10.668981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:10.669369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] PATH_INFO: `/v3/users/7a46c5d0d2d441c384246fb7867a565b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:10.670722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a46c5d0d2d441c384246fb7867a565b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:10.672987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:10.762138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a46c5d0d2d441c384246fb7867a565b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:10.774560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a46c5d0d2d441c384246fb7867a565b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:10.775556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a46c5d0d2d441c384246fb7867a565b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:10.796002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a46c5d0d2d441c384246fb7867a565b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:10.796473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a46c5d0d2d441c384246fb7867a565b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:10.833187 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2102/4195] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:10 2022] DELETE /identity/v3/users/7a46c5d0d2d441c384246fb7867a565b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:10.839737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a099-e2d3-42d0-830a-13ee6e7b7f86 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:10.839737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a099-e2d3-42d0-830a-13ee6e7b7f86 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:10.839907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9a099-e2d3-42d0-830a-13ee6e7b7f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:10.878051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fdb9a099-e2d3-42d0-830a-13ee6e7b7f86 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:10.879341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fdb9a099-e2d3-42d0-830a-13ee6e7b7f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:10.998011 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2094/4196] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:11.010417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:11.011689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:11.183921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:11.198079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9547e-b6c0-40bf-9991-df54ab787afe admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:11.204097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fced9-8f76-4a8d-9fe1-4e84444a5dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:11.204097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fced9-8f76-4a8d-9fe1-4e84444a5dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:11.204575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fced9-8f76-4a8d-9fe1-4e84444a5dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:11.205042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fced9-8f76-4a8d-9fe1-4e84444a5dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:11.217470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fced9-8f76-4a8d-9fe1-4e84444a5dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:11.219310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fced9-8f76-4a8d-9fe1-4e84444a5dc6 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:11.238236 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2103/4197] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:11.771943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a099-e2d3-42d0-830a-13ee6e7b7f86 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:11.775685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fdb9a099-e2d3-42d0-830a-13ee6e7b7f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:11.801774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9a099-e2d3-42d0-830a-13ee6e7b7f86 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:11.823844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:11.824721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:11.825194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:11.826414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] PATH_INFO: `/v3/projects/828114ad963e40cca65e557054cffb8c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:11.835762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=828114ad963e40cca65e557054cffb8c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:11.838161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:11.921056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:11.952797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828114ad963e40cca65e557054cffb8c', 'request_id': 'req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:11.972120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828114ad963e40cca65e557054cffb8c', 'request_id': 'req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:11.983207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828114ad963e40cca65e557054cffb8c', 'request_id': 'req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:12.005112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] The token cache is being invalidate because project 828114ad963e40cca65e557054cffb8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:12.005448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:12.006438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:12.008280 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2095/4198] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:11 2022] DELETE /identity/v3/projects/828114ad963e40cca65e557054cffb8c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:12.012452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fced9-8f76-4a8d-9fe1-4e84444a5dc6 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:12.026644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fced9-8f76-4a8d-9fe1-4e84444a5dc6 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:12.119857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d383d-ac1f-44e5-ac76-3ef85e1209a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:12.121052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d383d-ac1f-44e5-ac76-3ef85e1209a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:12.121288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d383d-ac1f-44e5-ac76-3ef85e1209a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:12.121777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d383d-ac1f-44e5-ac76-3ef85e1209a2 admin admin] PATH_INFO: `/v3/users/63bf634cc72e44b6a028904953af3cf0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:12.123860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d383d-ac1f-44e5-ac76-3ef85e1209a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63bf634cc72e44b6a028904953af3cf0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:12.125670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d383d-ac1f-44e5-ac76-3ef85e1209a2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:12.205882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c92d383d-ac1f-44e5-ac76-3ef85e1209a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63bf634cc72e44b6a028904953af3cf0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:12.230973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c92d383d-ac1f-44e5-ac76-3ef85e1209a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63bf634cc72e44b6a028904953af3cf0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:12.232864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c92d383d-ac1f-44e5-ac76-3ef85e1209a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63bf634cc72e44b6a028904953af3cf0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:12.248984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c92d383d-ac1f-44e5-ac76-3ef85e1209a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63bf634cc72e44b6a028904953af3cf0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:12.250108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c92d383d-ac1f-44e5-ac76-3ef85e1209a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63bf634cc72e44b6a028904953af3cf0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:12.290044 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2104/4199] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:12 2022] DELETE /identity/v3/users/63bf634cc72e44b6a028904953af3cf0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:12.890500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:12.892608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:12.916211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab87fb-0e40-4491-be4d-7ce9b589c8b9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:13.065621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:13.066273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:13.066561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:13.066868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1 admin admin] PATH_INFO: `/v3/projects/93d2c393bc1c4671868f415f1f855e56` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:13.071973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d2c393bc1c4671868f415f1f855e56)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:13.074143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:13.203090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d2c393bc1c4671868f415f1f855e56', 'request_id': 'req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:13.235012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d2c393bc1c4671868f415f1f855e56', 'request_id': 'req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:13.244323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d2c393bc1c4671868f415f1f855e56', 'request_id': 'req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:13.266876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1 admin admin] The token cache is being invalidate because project 93d2c393bc1c4671868f415f1f855e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:13.267176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:13.271278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ddb5134-4e3e-44b2-bace-23924ea0d6b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:13.275162 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2096/4200] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:12 2022] DELETE /identity/v3/projects/93d2c393bc1c4671868f415f1f855e56 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:13.280323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeb3b3-3928-45c3-ae8a-89e0b3a2f73f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:13.280858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeb3b3-3928-45c3-ae8a-89e0b3a2f73f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:13.281219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeb3b3-3928-45c3-ae8a-89e0b3a2f73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:13.325768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-39aeb3b3-3928-45c3-ae8a-89e0b3a2f73f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:13.334549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-39aeb3b3-3928-45c3-ae8a-89e0b3a2f73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:13.448741 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2105/4201] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:13.456940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bc4b-54af-4ff6-a9a7-2a5794a797de None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:13.457291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bc4b-54af-4ff6-a9a7-2a5794a797de None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:13.457518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bc4b-54af-4ff6-a9a7-2a5794a797de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:13.501035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ab91bc4b-54af-4ff6-a9a7-2a5794a797de None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:13.503229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ab91bc4b-54af-4ff6-a9a7-2a5794a797de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:13.521825 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2097/4202] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:13.526222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeb3b3-3928-45c3-ae8a-89e0b3a2f73f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:13.544640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeb3b3-3928-45c3-ae8a-89e0b3a2f73f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:13.554071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb92b67-60b3-41f3-be8a-1119d6d3dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:13.555291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb92b67-60b3-41f3-be8a-1119d6d3dbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:13.555875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb92b67-60b3-41f3-be8a-1119d6d3dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:13.556369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb92b67-60b3-41f3-be8a-1119d6d3dbf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:13.557546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb92b67-60b3-41f3-be8a-1119d6d3dbf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:13.558175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb92b67-60b3-41f3-be8a-1119d6d3dbf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:13.561599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb92b67-60b3-41f3-be8a-1119d6d3dbf7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:13.574392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:13.590100 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2106/4203] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:13.592182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91bc4b-54af-4ff6-a9a7-2a5794a797de None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:13.612148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91bc4b-54af-4ff6-a9a7-2a5794a797de None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:13.618344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea881b73-bf2a-4c70-b4ea-0440fe8331ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:13.619078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea881b73-bf2a-4c70-b4ea-0440fe8331ec admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:13.619413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea881b73-bf2a-4c70-b4ea-0440fe8331ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:13.619698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea881b73-bf2a-4c70-b4ea-0440fe8331ec admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:13.620654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea881b73-bf2a-4c70-b4ea-0440fe8331ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:13.622771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea881b73-bf2a-4c70-b4ea-0440fe8331ec admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:13.666438 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2098/4204] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:13 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:13.668073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb92b67-60b3-41f3-be8a-1119d6d3dbf7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:13.680064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb92b67-60b3-41f3-be8a-1119d6d3dbf7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:13.760552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf7273-f91f-40d9-a672-a151d00e4314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:13.762242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf7273-f91f-40d9-a672-a151d00e4314 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:13.764588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf7273-f91f-40d9-a672-a151d00e4314 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:13.764974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf7273-f91f-40d9-a672-a151d00e4314 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:13.766117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf7273-f91f-40d9-a672-a151d00e4314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:13.769024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf7273-f91f-40d9-a672-a151d00e4314 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:13.825572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea881b73-bf2a-4c70-b4ea-0440fe8331ec admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:13.825729 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2107/4205] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:13 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:13.839007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea881b73-bf2a-4c70-b4ea-0440fe8331ec admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:13.845109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326af60d-dc15-4b74-ae97-34af9e00a6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:13.845857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326af60d-dc15-4b74-ae97-34af9e00a6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:13.846254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326af60d-dc15-4b74-ae97-34af9e00a6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:13.846606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326af60d-dc15-4b74-ae97-34af9e00a6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:13.847536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326af60d-dc15-4b74-ae97-34af9e00a6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:13.850033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326af60d-dc15-4b74-ae97-34af9e00a6e1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:13.867882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf7273-f91f-40d9-a672-a151d00e4314 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:13.887713 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2099/4206] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:13.894066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf7273-f91f-40d9-a672-a151d00e4314 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:13.901023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff776d-fa10-40e9-8bf5-97d0f05d0cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:13.901758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff776d-fa10-40e9-8bf5-97d0f05d0cdd admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:13.902119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff776d-fa10-40e9-8bf5-97d0f05d0cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:13.902814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff776d-fa10-40e9-8bf5-97d0f05d0cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:13.903562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff776d-fa10-40e9-8bf5-97d0f05d0cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:13.905337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff776d-fa10-40e9-8bf5-97d0f05d0cdd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:13.920803 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2108/4207] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:13.925589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326af60d-dc15-4b74-ae97-34af9e00a6e1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:13.951752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326af60d-dc15-4b74-ae97-34af9e00a6e1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:13.963311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35658295-7fed-488d-989a-9083960b68a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:13.964277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35658295-7fed-488d-989a-9083960b68a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:13.964728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35658295-7fed-488d-989a-9083960b68a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:13.965173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35658295-7fed-488d-989a-9083960b68a0 admin admin] PATH_INFO: `/v3/projects/cdfe31e39722402bafadc426d73e0284/users/e989d086a55b4a2abe7329a2ef99db58/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:13.970347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:13.988424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35658295-7fed-488d-989a-9083960b68a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfe31e39722402bafadc426d73e0284, user_id=e989d086a55b4a2abe7329a2ef99db58, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:13.992307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35658295-7fed-488d-989a-9083960b68a0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:14.026432 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2100/4208] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:13 2022] PUT /identity/v3/projects/cdfe31e39722402bafadc426d73e0284/users/e989d086a55b4a2abe7329a2ef99db58/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:14.029100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b55cc-b0ea-4639-ba27-e69f2d17f4ee None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:14.029602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b55cc-b0ea-4639-ba27-e69f2d17f4ee None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:14.029887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b55cc-b0ea-4639-ba27-e69f2d17f4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:14.063289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-618b55cc-b0ea-4639-ba27-e69f2d17f4ee None None] MFA Rules not processed for user `e989d086a55b4a2abe7329a2ef99db58`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:14.064508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-618b55cc-b0ea-4639-ba27-e69f2d17f4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:14.180134 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2109/4209] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:14.181248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35658295-7fed-488d-989a-9083960b68a0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:14.267816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35658295-7fed-488d-989a-9083960b68a0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:14.274334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfbd83-3921-4aa5-b928-f3ffbfff4fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:14.275017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfbd83-3921-4aa5-b928-f3ffbfff4fcb admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:14.275461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfbd83-3921-4aa5-b928-f3ffbfff4fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:14.275891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfbd83-3921-4aa5-b928-f3ffbfff4fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:14.276649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfbd83-3921-4aa5-b928-f3ffbfff4fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:14.278807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfbd83-3921-4aa5-b928-f3ffbfff4fcb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:14.318361 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2101/4210] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:14 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:07:14.323173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b55cc-b0ea-4639-ba27-e69f2d17f4ee None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:14.337820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b55cc-b0ea-4639-ba27-e69f2d17f4ee None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:14.430316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad792e9-13ad-40ff-8234-e715c52ef823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:14.431117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad792e9-13ad-40ff-8234-e715c52ef823 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:14.431434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad792e9-13ad-40ff-8234-e715c52ef823 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:14.431761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad792e9-13ad-40ff-8234-e715c52ef823 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:14.432500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad792e9-13ad-40ff-8234-e715c52ef823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:14.434446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad792e9-13ad-40ff-8234-e715c52ef823 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:14.446528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:14.476577 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2110/4211] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:14 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:14.477547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfbd83-3921-4aa5-b928-f3ffbfff4fcb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:14.490729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfbd83-3921-4aa5-b928-f3ffbfff4fcb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:14.499296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8011f-2233-4b09-a087-40feb8d0745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:14.500270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8011f-2233-4b09-a087-40feb8d0745d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:14.500740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8011f-2233-4b09-a087-40feb8d0745d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:14.501566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8011f-2233-4b09-a087-40feb8d0745d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:14.502474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8011f-2233-4b09-a087-40feb8d0745d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:14.504316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8011f-2233-4b09-a087-40feb8d0745d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:14.519400 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2102/4212] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:14.525884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad792e9-13ad-40ff-8234-e715c52ef823 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:14.541354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad792e9-13ad-40ff-8234-e715c52ef823 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:14.546409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07e3cf-17a2-4fcd-bb9a-fd835f58fd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:14.547128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07e3cf-17a2-4fcd-bb9a-fd835f58fd13 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:14.547416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07e3cf-17a2-4fcd-bb9a-fd835f58fd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:14.547697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07e3cf-17a2-4fcd-bb9a-fd835f58fd13 admin admin] PATH_INFO: `/v3/projects/e29e98202fde42d4bef3ede5cad5a4e6/users/9441d9c9fe3a436abf60d0806437b6d0/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:14.567947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07e3cf-17a2-4fcd-bb9a-fd835f58fd13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29e98202fde42d4bef3ede5cad5a4e6, user_id=9441d9c9fe3a436abf60d0806437b6d0, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:14.572388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07e3cf-17a2-4fcd-bb9a-fd835f58fd13 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:14.597585 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2111/4213] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:14 2022] PUT /identity/v3/projects/e29e98202fde42d4bef3ede5cad5a4e6/users/9441d9c9fe3a436abf60d0806437b6d0/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:14.599643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8011f-2233-4b09-a087-40feb8d0745d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:14.620613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8011f-2233-4b09-a087-40feb8d0745d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:14.781645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af625da8-8084-43f2-8da8-00fa6583aa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:14.782289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af625da8-8084-43f2-8da8-00fa6583aa43 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:14.782848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af625da8-8084-43f2-8da8-00fa6583aa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:14.782982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af625da8-8084-43f2-8da8-00fa6583aa43 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:14.783539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af625da8-8084-43f2-8da8-00fa6583aa43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:14.785435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af625da8-8084-43f2-8da8-00fa6583aa43 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:14.805670 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2103/4214] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:07:14.810289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07e3cf-17a2-4fcd-bb9a-fd835f58fd13 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:14.823059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07e3cf-17a2-4fcd-bb9a-fd835f58fd13 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:14.828760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e89440-b304-4d64-ac0a-08a296fba919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:14.829573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e89440-b304-4d64-ac0a-08a296fba919 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:14.829867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e89440-b304-4d64-ac0a-08a296fba919 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:14.830151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e89440-b304-4d64-ac0a-08a296fba919 admin admin] PATH_INFO: `/v3/projects/e29e98202fde42d4bef3ede5cad5a4e6/users/9441d9c9fe3a436abf60d0806437b6d0/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:14.833325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e89440-b304-4d64-ac0a-08a296fba919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29e98202fde42d4bef3ede5cad5a4e6, user_id=9441d9c9fe3a436abf60d0806437b6d0, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:14.836325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e89440-b304-4d64-ac0a-08a296fba919 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:14.869558 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2112/4215] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:14 2022] PUT /identity/v3/projects/e29e98202fde42d4bef3ede5cad5a4e6/users/9441d9c9fe3a436abf60d0806437b6d0/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:14.871055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855c34c-3fdb-42fb-a106-087337e6eeff None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:14.871366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855c34c-3fdb-42fb-a106-087337e6eeff None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:14.871653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855c34c-3fdb-42fb-a106-087337e6eeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:14.935375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e855c34c-3fdb-42fb-a106-087337e6eeff None None] MFA Rules not processed for user `9441d9c9fe3a436abf60d0806437b6d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:14.936704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e855c34c-3fdb-42fb-a106-087337e6eeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:15.018169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:15.086143 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2104/4216] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:15.097431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e89440-b304-4d64-ac0a-08a296fba919 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:15.131228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e89440-b304-4d64-ac0a-08a296fba919 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:15.137915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315658db-3360-4b4f-a9d6-7140f5eb9a89 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:15.139537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315658db-3360-4b4f-a9d6-7140f5eb9a89 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:15.140041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315658db-3360-4b4f-a9d6-7140f5eb9a89 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:15.141096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315658db-3360-4b4f-a9d6-7140f5eb9a89 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:15.141997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315658db-3360-4b4f-a9d6-7140f5eb9a89 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:15.144495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315658db-3360-4b4f-a9d6-7140f5eb9a89 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:15.172618 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2113/4217] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:15 2022] POST /identity/v3/services => generated 289 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:15.176811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855c34c-3fdb-42fb-a106-087337e6eeff None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:15.188368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855c34c-3fdb-42fb-a106-087337e6eeff None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:15.213398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35d79-222c-4a7e-8a0b-a69a92f23b90 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:15.214415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35d79-222c-4a7e-8a0b-a69a92f23b90 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:15.214978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35d79-222c-4a7e-8a0b-a69a92f23b90 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:15.215611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35d79-222c-4a7e-8a0b-a69a92f23b90 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:15.216514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35d79-222c-4a7e-8a0b-a69a92f23b90 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:15.219135 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-64a35d79-222c-4a7e-8a0b-a69a92f23b90 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:15.219135 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:15.219135 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:15.221046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35d79-222c-4a7e-8a0b-a69a92f23b90 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:15.255570 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-64a35d79-222c-4a7e-8a0b-a69a92f23b90 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-630957408. To ensure interoperability, identifiers should be a valid uuid. Aug 28 19:07:15.255570 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 19:07:15.255570 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:15.300925 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2105/4218] 10.222.0.70 () {60 vars in 1156 bytes} [Sun Aug 28 19:07:15 2022] POST /identity/v3/endpoints => generated 359 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:07:15.305915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315658db-3360-4b4f-a9d6-7140f5eb9a89 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:15.331307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315658db-3360-4b4f-a9d6-7140f5eb9a89 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:15.351488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fa4d5-2ae2-4ef4-bf9b-b3c30dd90e02 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:15.352990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fa4d5-2ae2-4ef4-bf9b-b3c30dd90e02 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:15.353478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fa4d5-2ae2-4ef4-bf9b-b3c30dd90e02 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:15.353858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fa4d5-2ae2-4ef4-bf9b-b3c30dd90e02 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/regions/tempest-region-630957408` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:15.355094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40fa4d5-2ae2-4ef4-bf9b-b3c30dd90e02 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-630957408)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:15.356569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40fa4d5-2ae2-4ef4-bf9b-b3c30dd90e02 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:15.363706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35d79-222c-4a7e-8a0b-a69a92f23b90 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:15.375888 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2114/4219] 10.222.0.70 () {58 vars in 1203 bytes} [Sun Aug 28 19:07:15 2022] GET /identity/v3/regions/tempest-region-630957408 => generated 178 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:07:15.382403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35d79-222c-4a7e-8a0b-a69a92f23b90 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:15.389698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161443a-aa89-4876-824b-78fd72ecf953 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:15.390957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161443a-aa89-4876-824b-78fd72ecf953 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:15.391468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161443a-aa89-4876-824b-78fd72ecf953 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:15.391805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161443a-aa89-4876-824b-78fd72ecf953 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:15.392744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161443a-aa89-4876-824b-78fd72ecf953 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:15.395557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161443a-aa89-4876-824b-78fd72ecf953 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:15.413532 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2106/4220] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:15 2022] POST /identity/v3/services => generated 288 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:15.417793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fa4d5-2ae2-4ef4-bf9b-b3c30dd90e02 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:15.433874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fa4d5-2ae2-4ef4-bf9b-b3c30dd90e02 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:15.464051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f43b1-ea2e-4b55-b061-78b810a4df95 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:15.464928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f43b1-ea2e-4b55-b061-78b810a4df95 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:15.465399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f43b1-ea2e-4b55-b061-78b810a4df95 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:15.465814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f43b1-ea2e-4b55-b061-78b810a4df95 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:15.466874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f43b1-ea2e-4b55-b061-78b810a4df95 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:15.467982 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-a55f43b1-ea2e-4b55-b061-78b810a4df95 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:15.467982 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:15.467982 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:15.468895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f43b1-ea2e-4b55-b061-78b810a4df95 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:15.501820 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-a55f43b1-ea2e-4b55-b061-78b810a4df95 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-372633288. To ensure interoperability, identifiers should be a valid uuid. Aug 28 19:07:15.501820 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 19:07:15.501820 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:15.560124 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2115/4221] 10.222.0.70 () {60 vars in 1156 bytes} [Sun Aug 28 19:07:15 2022] POST /identity/v3/endpoints => generated 361 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:15.565160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161443a-aa89-4876-824b-78fd72ecf953 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:15.603485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161443a-aa89-4876-824b-78fd72ecf953 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:15.668494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d87b5-5c38-47da-87a4-58d7d3ee76ff tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:15.669159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d87b5-5c38-47da-87a4-58d7d3ee76ff tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:15.669442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d87b5-5c38-47da-87a4-58d7d3ee76ff tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:15.669713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d87b5-5c38-47da-87a4-58d7d3ee76ff tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/regions/tempest-region-372633288` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:15.670303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d87b5-5c38-47da-87a4-58d7d3ee76ff tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-372633288)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:15.671445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d87b5-5c38-47da-87a4-58d7d3ee76ff tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:15.677535 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2107/4222] 10.222.0.70 () {58 vars in 1203 bytes} [Sun Aug 28 19:07:15 2022] GET /identity/v3/regions/tempest-region-372633288 => generated 178 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:15.678993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f43b1-ea2e-4b55-b061-78b810a4df95 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:15.691330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f43b1-ea2e-4b55-b061-78b810a4df95 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:15.698757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e491cf-1c65-4704-8117-9445268059c4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:15.699662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e491cf-1c65-4704-8117-9445268059c4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:15.699988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e491cf-1c65-4704-8117-9445268059c4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:15.700499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e491cf-1c65-4704-8117-9445268059c4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:15.701326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e491cf-1c65-4704-8117-9445268059c4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:15.703965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e491cf-1c65-4704-8117-9445268059c4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:15.742837 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-d1e491cf-1c65-4704-8117-9445268059c4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-398803781. To ensure interoperability, identifiers should be a valid uuid. Aug 28 19:07:15.742837 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 19:07:15.742837 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:15.784897 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2116/4223] 10.222.0.70 () {60 vars in 1156 bytes} [Sun Aug 28 19:07:15 2022] POST /identity/v3/endpoints => generated 358 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:15.785606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d87b5-5c38-47da-87a4-58d7d3ee76ff tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:15.803098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d87b5-5c38-47da-87a4-58d7d3ee76ff tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:15.823891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997ae0f-0c69-4fc1-8f97-9b1bf141607f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:15.824904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997ae0f-0c69-4fc1-8f97-9b1bf141607f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:15.825578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997ae0f-0c69-4fc1-8f97-9b1bf141607f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:15.826399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997ae0f-0c69-4fc1-8f97-9b1bf141607f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/regions/tempest-region-398803781` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:15.827607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997ae0f-0c69-4fc1-8f97-9b1bf141607f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-398803781)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:15.831769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997ae0f-0c69-4fc1-8f97-9b1bf141607f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:15.838953 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2108/4224] 10.222.0.70 () {58 vars in 1203 bytes} [Sun Aug 28 19:07:15 2022] GET /identity/v3/regions/tempest-region-398803781 => generated 178 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:07:15.844244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e491cf-1c65-4704-8117-9445268059c4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:15.856558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e491cf-1c65-4704-8117-9445268059c4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:15.862199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2aaf2-2a59-436b-a1e2-91b7962cc570 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:15.862884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2aaf2-2a59-436b-a1e2-91b7962cc570 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:15.863171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2aaf2-2a59-436b-a1e2-91b7962cc570 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:15.863516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2aaf2-2a59-436b-a1e2-91b7962cc570 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:15.864825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2aaf2-2a59-436b-a1e2-91b7962cc570 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:15.865861 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-3db2aaf2-2a59-436b-a1e2-91b7962cc570 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:15.865861 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:15.865861 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:15.866831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2aaf2-2a59-436b-a1e2-91b7962cc570 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:15.882783 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2117/4225] 10.222.0.70 () {58 vars in 1134 bytes} [Sun Aug 28 19:07:15 2022] GET /identity/v3/endpoints => generated 4392 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:15.886193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997ae0f-0c69-4fc1-8f97-9b1bf141607f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:15.899140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997ae0f-0c69-4fc1-8f97-9b1bf141607f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:15.904727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ce180-43b9-44a1-bf62-450d4200b23d tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:15.905454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ce180-43b9-44a1-bf62-450d4200b23d tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:15.905808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ce180-43b9-44a1-bf62-450d4200b23d tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:15.906154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ce180-43b9-44a1-bf62-450d4200b23d tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints/18e3394baf9248f3a04e4b82172f6768` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:15.914542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ce180-43b9-44a1-bf62-450d4200b23d tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=18e3394baf9248f3a04e4b82172f6768)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:15.915840 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-243ce180-43b9-44a1-bf62-450d4200b23d tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:15.915840 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:15.915840 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:15.916862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ce180-43b9-44a1-bf62-450d4200b23d tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:15.921544 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2109/4226] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:15 2022] GET /identity/v3/endpoints/18e3394baf9248f3a04e4b82172f6768 => generated 358 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:15.923118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2aaf2-2a59-436b-a1e2-91b7962cc570 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:15.937754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2aaf2-2a59-436b-a1e2-91b7962cc570 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:15.958165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a4782-1a86-484c-a26e-b7e35bceaac8 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:15.959089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a4782-1a86-484c-a26e-b7e35bceaac8 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:15.959371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a4782-1a86-484c-a26e-b7e35bceaac8 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:15.959646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a4782-1a86-484c-a26e-b7e35bceaac8 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints/18e3394baf9248f3a04e4b82172f6768` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:15.961329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a4782-1a86-484c-a26e-b7e35bceaac8 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=18e3394baf9248f3a04e4b82172f6768)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:15.962548 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-563a4782-1a86-484c-a26e-b7e35bceaac8 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:15.962548 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:15.962548 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:15.963955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a4782-1a86-484c-a26e-b7e35bceaac8 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:15.994914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-563a4782-1a86-484c-a26e-b7e35bceaac8 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '18e3394baf9248f3a04e4b82172f6768', 'request_id': 'req-563a4782-1a86-484c-a26e-b7e35bceaac8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:16.040034 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2118/4227] 10.222.0.70 () {58 vars in 1236 bytes} [Sun Aug 28 19:07:15 2022] DELETE /identity/v3/endpoints/18e3394baf9248f3a04e4b82172f6768 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:16.044080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ce180-43b9-44a1-bf62-450d4200b23d tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:16.058437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ce180-43b9-44a1-bf62-450d4200b23d tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:16.129355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1f5a5-cd31-4ef6-a588-79b233fd439e tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:16.131065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1f5a5-cd31-4ef6-a588-79b233fd439e tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:16.131781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1f5a5-cd31-4ef6-a588-79b233fd439e tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:16.132117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1f5a5-cd31-4ef6-a588-79b233fd439e tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:16.132896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1f5a5-cd31-4ef6-a588-79b233fd439e tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:16.145873 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-a4b1f5a5-cd31-4ef6-a588-79b233fd439e tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:16.145873 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:16.145873 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:16.145873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1f5a5-cd31-4ef6-a588-79b233fd439e tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:16.171214 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2110/4228] 10.222.0.70 () {58 vars in 1134 bytes} [Sun Aug 28 19:07:16 2022] GET /identity/v3/endpoints => generated 4047 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:16.179465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a4782-1a86-484c-a26e-b7e35bceaac8 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:16.199579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a4782-1a86-484c-a26e-b7e35bceaac8 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:16.211375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa49d0-193b-4192-a1f8-546fc03c40a6 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:16.211936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa49d0-193b-4192-a1f8-546fc03c40a6 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:16.212225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa49d0-193b-4192-a1f8-546fc03c40a6 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:16.212502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa49d0-193b-4192-a1f8-546fc03c40a6 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints/18e3394baf9248f3a04e4b82172f6768` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:16.228528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa49d0-193b-4192-a1f8-546fc03c40a6 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-0efa49d0-193b-4192-a1f8-546fc03c40a6 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Could not find endpoint: 18e3394baf9248f3a04e4b82172f6768.: keystone.exception.EndpointNotFound: Could not find endpoint: 18e3394baf9248f3a04e4b82172f6768. Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:07:16.246136 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 18e3394baf9248f3a04e4b82172f6768. Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:07:16.248003 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:07:16.249787 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 18e3394baf9248f3a04e4b82172f6768. Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:07:16.251371 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2119/4229] 10.222.0.70 () {58 vars in 1236 bytes} [Sun Aug 28 19:07:16 2022] DELETE /identity/v3/endpoints/18e3394baf9248f3a04e4b82172f6768 => generated 114 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:07:16.252735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1f5a5-cd31-4ef6-a588-79b233fd439e tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:16.267962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1f5a5-cd31-4ef6-a588-79b233fd439e tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:16.278993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a686d75-435e-460f-a624-e2ba30345d33 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:16.279926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a686d75-435e-460f-a624-e2ba30345d33 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:16.280432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a686d75-435e-460f-a624-e2ba30345d33 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:16.280884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a686d75-435e-460f-a624-e2ba30345d33 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/regions/tempest-region-398803781` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:16.281826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a686d75-435e-460f-a624-e2ba30345d33 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-398803781)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:16.283212 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-7a686d75-435e-460f-a624-e2ba30345d33 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:16.283212 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:16.283212 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:16.284566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a686d75-435e-460f-a624-e2ba30345d33 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:16.306539 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-7a686d75-435e-460f-a624-e2ba30345d33 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-398803781. To ensure interoperability, identifiers should be a valid uuid. Aug 28 19:07:16.306539 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 19:07:16.306539 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:16.320351 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2111/4230] 10.222.0.70 () {58 vars in 1206 bytes} [Sun Aug 28 19:07:16 2022] DELETE /identity/v3/regions/tempest-region-398803781 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:16.325563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa49d0-193b-4192-a1f8-546fc03c40a6 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:16.346682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa49d0-193b-4192-a1f8-546fc03c40a6 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:16.381428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103a374-2260-447e-9146-4c59ec7a5d2f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:16.382054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103a374-2260-447e-9146-4c59ec7a5d2f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:16.382341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103a374-2260-447e-9146-4c59ec7a5d2f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:16.382704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103a374-2260-447e-9146-4c59ec7a5d2f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:16.383441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103a374-2260-447e-9146-4c59ec7a5d2f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:16.385054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103a374-2260-447e-9146-4c59ec7a5d2f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:16.414125 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2120/4231] 10.222.0.70 () {58 vars in 1134 bytes} [Sun Aug 28 19:07:16 2022] GET /identity/v3/endpoints => generated 4047 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:16.415432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a686d75-435e-460f-a624-e2ba30345d33 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:16.418446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103a374-2260-447e-9146-4c59ec7a5d2f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:16.423675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5103a374-2260-447e-9146-4c59ec7a5d2f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:16.433539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a686d75-435e-460f-a624-e2ba30345d33 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:16.440679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2ee52-180f-4fe6-a9b8-c9ae2959c3fa tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:16.441609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ee52-180f-4fe6-a9b8-c9ae2959c3fa tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:16.442871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ee52-180f-4fe6-a9b8-c9ae2959c3fa tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:16.443353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ee52-180f-4fe6-a9b8-c9ae2959c3fa tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:16.444205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2ee52-180f-4fe6-a9b8-c9ae2959c3fa tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Adding query filter params (service_id=19c1759b65d045e5913cc482d161b0b7) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:16.444698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2ee52-180f-4fe6-a9b8-c9ae2959c3fa tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:16.447132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2ee52-180f-4fe6-a9b8-c9ae2959c3fa tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:16.458895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=8,keystone:SELECT=90,keystone:DELETE=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:16.462408 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2112/4232] 10.222.0.70 () {58 vars in 1221 bytes} [Sun Aug 28 19:07:16 2022] GET /identity/v3/endpoints?service_id=19c1759b65d045e5913cc482d161b0b7 => generated 501 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:16.466448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2ee52-180f-4fe6-a9b8-c9ae2959c3fa tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:16.487308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2ee52-180f-4fe6-a9b8-c9ae2959c3fa tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:16.494775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cfaee-55ef-4295-9a36-36981c9e21f9 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:16.495730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cfaee-55ef-4295-9a36-36981c9e21f9 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:16.496280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cfaee-55ef-4295-9a36-36981c9e21f9 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:16.496846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cfaee-55ef-4295-9a36-36981c9e21f9 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:16.497727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cfaee-55ef-4295-9a36-36981c9e21f9 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Adding query filter params (service_id=beb7d99641e145a5a2626a9e89b08000) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:16.498259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cfaee-55ef-4295-9a36-36981c9e21f9 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:16.500293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cfaee-55ef-4295-9a36-36981c9e21f9 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:16.508323 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2113/4233] 10.222.0.70 () {58 vars in 1221 bytes} [Sun Aug 28 19:07:16 2022] GET /identity/v3/endpoints?service_id=beb7d99641e145a5a2626a9e89b08000 => generated 503 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:16.512211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cfaee-55ef-4295-9a36-36981c9e21f9 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:16.529131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cfaee-55ef-4295-9a36-36981c9e21f9 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:16.540771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a2c73-0d4e-4768-ab9a-e5acbf4b0fae tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:16.541903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a2c73-0d4e-4768-ab9a-e5acbf4b0fae tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:16.543390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a2c73-0d4e-4768-ab9a-e5acbf4b0fae tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:16.543763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a2c73-0d4e-4768-ab9a-e5acbf4b0fae tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:16.544710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a2c73-0d4e-4768-ab9a-e5acbf4b0fae tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:16.545260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a2c73-0d4e-4768-ab9a-e5acbf4b0fae tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:16.550361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a2c73-0d4e-4768-ab9a-e5acbf4b0fae tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:16.579062 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2114/4234] 10.222.0.70 () {58 vars in 1167 bytes} [Sun Aug 28 19:07:16 2022] GET /identity/v3/endpoints?interface=public => generated 3404 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:16.580195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a2c73-0d4e-4768-ab9a-e5acbf4b0fae tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:16.596246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a2c73-0d4e-4768-ab9a-e5acbf4b0fae tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:16.603730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2876469-fc5a-4596-8d74-5551e18b01d4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:16.604122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2876469-fc5a-4596-8d74-5551e18b01d4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:16.604485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2876469-fc5a-4596-8d74-5551e18b01d4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:16.604834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2876469-fc5a-4596-8d74-5551e18b01d4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:16.605605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2876469-fc5a-4596-8d74-5551e18b01d4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:16.605985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2876469-fc5a-4596-8d74-5551e18b01d4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:16.607781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2876469-fc5a-4596-8d74-5551e18b01d4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:16.636396 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2115/4235] 10.222.0.70 () {58 vars in 1171 bytes} [Sun Aug 28 19:07:16 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:16.642201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2876469-fc5a-4596-8d74-5551e18b01d4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:16.643284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103a374-2260-447e-9146-4c59ec7a5d2f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:16.651490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a112707-4043-4347-a136-f6ec5529a0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:16.652120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a112707-4043-4347-a136-f6ec5529a0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:16.652653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a112707-4043-4347-a136-f6ec5529a0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:16.652927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a112707-4043-4347-a136-f6ec5529a0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:16.662426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5a112707-4043-4347-a136-f6ec5529a0d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:16.670252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2876469-fc5a-4596-8d74-5551e18b01d4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:16.686303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9c004-a428-47de-99d7-3d055990cebe tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:16.687414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9c004-a428-47de-99d7-3d055990cebe tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:16.687816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9c004-a428-47de-99d7-3d055990cebe tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:16.688194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9c004-a428-47de-99d7-3d055990cebe tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:16.689119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9c004-a428-47de-99d7-3d055990cebe tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:16.702940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9c004-a428-47de-99d7-3d055990cebe tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:16.724862 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2116/4236] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:16 2022] POST /identity/v3/services => generated 289 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:16.729722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9c004-a428-47de-99d7-3d055990cebe tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:16.787790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9c004-a428-47de-99d7-3d055990cebe tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:16.795766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a112707-4043-4347-a136-f6ec5529a0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:16.796630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042bc31-983c-458f-acda-73657a7bb73b tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:16.797238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a112707-4043-4347-a136-f6ec5529a0d7 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:16.797383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042bc31-983c-458f-acda-73657a7bb73b tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:16.797673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042bc31-983c-458f-acda-73657a7bb73b tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:16.797955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042bc31-983c-458f-acda-73657a7bb73b tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:16.798630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042bc31-983c-458f-acda-73657a7bb73b tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:16.800263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042bc31-983c-458f-acda-73657a7bb73b tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:16.805816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:16.832031 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-6042bc31-983c-458f-acda-73657a7bb73b tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-131334132. To ensure interoperability, identifiers should be a valid uuid. Aug 28 19:07:16.832031 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 19:07:16.832031 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:16.853871 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2121/4237] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:16 2022] GET /identity/v3/auth/tokens => generated 4003 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:07:16.912219 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2117/4238] 10.222.0.70 () {60 vars in 1156 bytes} [Sun Aug 28 19:07:16 2022] POST /identity/v3/endpoints => generated 359 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:07:16.916585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a112707-4043-4347-a136-f6ec5529a0d7 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:16.931180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a112707-4043-4347-a136-f6ec5529a0d7 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:16.969685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2303e09-9cc0-412b-8962-66945f128be7 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:16.970393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2303e09-9cc0-412b-8962-66945f128be7 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:16.971315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2303e09-9cc0-412b-8962-66945f128be7 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:16.971315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2303e09-9cc0-412b-8962-66945f128be7 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/regions/tempest-region-131334132` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:16.971599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2303e09-9cc0-412b-8962-66945f128be7 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-131334132)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:16.972629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2303e09-9cc0-412b-8962-66945f128be7 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:16.978159 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2122/4239] 10.222.0.70 () {58 vars in 1203 bytes} [Sun Aug 28 19:07:16 2022] GET /identity/v3/regions/tempest-region-131334132 => generated 178 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:16.982759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042bc31-983c-458f-acda-73657a7bb73b tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:17.000543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042bc31-983c-458f-acda-73657a7bb73b tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:17.021438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3007-fbfd-4c16-8213-3f89ea701239 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:17.022081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3007-fbfd-4c16-8213-3f89ea701239 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:17.024241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3007-fbfd-4c16-8213-3f89ea701239 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:17.024241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3007-fbfd-4c16-8213-3f89ea701239 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints/a3a6d1d0eaac4bfc95ea1292109c9b8a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:17.044103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f3007-fbfd-4c16-8213-3f89ea701239 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=a3a6d1d0eaac4bfc95ea1292109c9b8a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:17.045144 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-9b1f3007-fbfd-4c16-8213-3f89ea701239 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:17.045144 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:17.045144 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:17.046055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f3007-fbfd-4c16-8213-3f89ea701239 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:17.100848 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-9b1f3007-fbfd-4c16-8213-3f89ea701239 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1545625001. To ensure interoperability, identifiers should be a valid uuid. Aug 28 19:07:17.100848 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 19:07:17.100848 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:17.183275 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2118/4240] 10.222.0.70 () {60 vars in 1256 bytes} [Sun Aug 28 19:07:16 2022] PATCH /identity/v3/endpoints/a3a6d1d0eaac4bfc95ea1292109c9b8a => generated 362 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:17.186984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2303e09-9cc0-412b-8962-66945f128be7 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:17.201297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2303e09-9cc0-412b-8962-66945f128be7 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:17.237608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60685d1-e628-45c3-b0b7-fe0c80d293e5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:17.238518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60685d1-e628-45c3-b0b7-fe0c80d293e5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:17.239571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60685d1-e628-45c3-b0b7-fe0c80d293e5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:17.240259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60685d1-e628-45c3-b0b7-fe0c80d293e5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/regions/tempest-region-1545625001` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:17.241280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60685d1-e628-45c3-b0b7-fe0c80d293e5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1545625001)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:17.252110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60685d1-e628-45c3-b0b7-fe0c80d293e5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:17.258704 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2123/4241] 10.222.0.70 () {58 vars in 1206 bytes} [Sun Aug 28 19:07:17 2022] GET /identity/v3/regions/tempest-region-1545625001 => generated 180 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:17.259927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3007-fbfd-4c16-8213-3f89ea701239 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:17.282848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3007-fbfd-4c16-8213-3f89ea701239 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:17.303767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313af86-3f66-48d1-9fea-d9249bf405e0 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:17.304876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313af86-3f66-48d1-9fea-d9249bf405e0 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:17.305425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313af86-3f66-48d1-9fea-d9249bf405e0 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:17.305749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313af86-3f66-48d1-9fea-d9249bf405e0 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints/a3a6d1d0eaac4bfc95ea1292109c9b8a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:17.320718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313af86-3f66-48d1-9fea-d9249bf405e0 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=a3a6d1d0eaac4bfc95ea1292109c9b8a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:17.321784 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-c313af86-3f66-48d1-9fea-d9249bf405e0 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:17.321784 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:17.321784 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:17.323443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313af86-3f66-48d1-9fea-d9249bf405e0 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:17.354764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fc4de-0732-44a7-893f-75c177731a33 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:17.356668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c313af86-3f66-48d1-9fea-d9249bf405e0 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'a3a6d1d0eaac4bfc95ea1292109c9b8a', 'request_id': 'req-c313af86-3f66-48d1-9fea-d9249bf405e0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:17.357010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fc4de-0732-44a7-893f-75c177731a33 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:17.357489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fc4de-0732-44a7-893f-75c177731a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:17.385482 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2119/4242] 10.222.0.70 () {58 vars in 1236 bytes} [Sun Aug 28 19:07:17 2022] DELETE /identity/v3/endpoints/a3a6d1d0eaac4bfc95ea1292109c9b8a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:17.389582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313af86-3f66-48d1-9fea-d9249bf405e0 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:17.391106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-db2fc4de-0732-44a7-893f-75c177731a33 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:17.392884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-db2fc4de-0732-44a7-893f-75c177731a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:17.450725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313af86-3f66-48d1-9fea-d9249bf405e0 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:17.457048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dc317-a5e0-40b5-99be-8ac9651eb4b5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:17.457283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dc317-a5e0-40b5-99be-8ac9651eb4b5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:17.457990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dc317-a5e0-40b5-99be-8ac9651eb4b5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:17.458146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dc317-a5e0-40b5-99be-8ac9651eb4b5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/regions/tempest-region-1545625001` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:17.458719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dc317-a5e0-40b5-99be-8ac9651eb4b5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1545625001)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:17.461765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dc317-a5e0-40b5-99be-8ac9651eb4b5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:17.507766 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2120/4243] 10.222.0.70 () {58 vars in 1209 bytes} [Sun Aug 28 19:07:17 2022] DELETE /identity/v3/regions/tempest-region-1545625001 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:17.511591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dc317-a5e0-40b5-99be-8ac9651eb4b5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:17.559095 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2124/4244] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:07:17 2022] POST /identity/v3/auth/tokens => generated 3959 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:17.568120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dc317-a5e0-40b5-99be-8ac9651eb4b5 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:17.580753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5629b-f948-41a2-972d-3834169321cd tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:17.580979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5629b-f948-41a2-972d-3834169321cd tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:17.581174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5629b-f948-41a2-972d-3834169321cd tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:17.581452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5629b-f948-41a2-972d-3834169321cd tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/regions/tempest-region-131334132` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:17.582042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5629b-f948-41a2-972d-3834169321cd tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-131334132)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:17.584709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5629b-f948-41a2-972d-3834169321cd tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:17.621494 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2121/4245] 10.222.0.70 () {58 vars in 1206 bytes} [Sun Aug 28 19:07:17 2022] DELETE /identity/v3/regions/tempest-region-131334132 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:17.625608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fc4de-0732-44a7-893f-75c177731a33 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:17.640670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fc4de-0732-44a7-893f-75c177731a33 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:17.663793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:17.668100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5629b-f948-41a2-972d-3834169321cd tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:17.673969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-62f5629b-f948-41a2-972d-3834169321cd tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:17.681237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee634d-a48e-4bc6-afde-370c18cfbc3f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:17.682017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee634d-a48e-4bc6-afde-370c18cfbc3f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:17.682373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee634d-a48e-4bc6-afde-370c18cfbc3f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:17.682796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee634d-a48e-4bc6-afde-370c18cfbc3f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/services/64ad78519b98442e91c305bd1b496cd7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:17.683468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee634d-a48e-4bc6-afde-370c18cfbc3f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:delete_service(service_id=64ad78519b98442e91c305bd1b496cd7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:17.685223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee634d-a48e-4bc6-afde-370c18cfbc3f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:17.737906 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2125/4246] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:17 2022] DELETE /identity/v3/services/64ad78519b98442e91c305bd1b496cd7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:17.739383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee634d-a48e-4bc6-afde-370c18cfbc3f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:17.781124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee634d-a48e-4bc6-afde-370c18cfbc3f tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:17.796492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c08a6-a4ff-4c85-98f2-75404141115a tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:17.800472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c08a6-a4ff-4c85-98f2-75404141115a tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:17.800802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c08a6-a4ff-4c85-98f2-75404141115a tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:17.801058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c08a6-a4ff-4c85-98f2-75404141115a tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints/e2dc5009d1ed406a9ebf1f39838ec705` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:17.822202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c08a6-a4ff-4c85-98f2-75404141115a tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e2dc5009d1ed406a9ebf1f39838ec705)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:17.823549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c08a6-a4ff-4c85-98f2-75404141115a tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:17.835638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-837c08a6-a4ff-4c85-98f2-75404141115a tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e2dc5009d1ed406a9ebf1f39838ec705', 'request_id': 'req-837c08a6-a4ff-4c85-98f2-75404141115a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:17.857697 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2126/4247] 10.222.0.70 () {58 vars in 1236 bytes} [Sun Aug 28 19:07:17 2022] DELETE /identity/v3/endpoints/e2dc5009d1ed406a9ebf1f39838ec705 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:17.864506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c08a6-a4ff-4c85-98f2-75404141115a tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:17.866947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:17.910418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5629b-f948-41a2-972d-3834169321cd tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:17.921154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c08a6-a4ff-4c85-98f2-75404141115a tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:17.929591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e99af8-5c61-49c3-b8ea-5cf1632343b3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:17.930264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e99af8-5c61-49c3-b8ea-5cf1632343b3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:17.930828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e99af8-5c61-49c3-b8ea-5cf1632343b3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:17.931040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e99af8-5c61-49c3-b8ea-5cf1632343b3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/regions/tempest-region-372633288` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:17.932553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e99af8-5c61-49c3-b8ea-5cf1632343b3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-372633288)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:17.945824 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-22e99af8-5c61-49c3-b8ea-5cf1632343b3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:17.945824 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:17.945824 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:17.948328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e99af8-5c61-49c3-b8ea-5cf1632343b3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:17.955051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7689ba1-55ea-460e-b575-811d4636abd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:17.956564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7689ba1-55ea-460e-b575-811d4636abd3 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:17.960602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7689ba1-55ea-460e-b575-811d4636abd3 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:17.961061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7689ba1-55ea-460e-b575-811d4636abd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:17.979734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7689ba1-55ea-460e-b575-811d4636abd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:17.981386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7689ba1-55ea-460e-b575-811d4636abd3 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:17.991336 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2127/4248] 10.222.0.70 () {58 vars in 1206 bytes} [Sun Aug 28 19:07:17 2022] DELETE /identity/v3/regions/tempest-region-372633288 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:17.997433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e99af8-5c61-49c3-b8ea-5cf1632343b3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:18.006304 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2122/4249] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:07:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:07:18.075888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e99af8-5c61-49c3-b8ea-5cf1632343b3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:18.087213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60912e14-910b-420d-b18e-4fb1fa478da3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:18.088102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60912e14-910b-420d-b18e-4fb1fa478da3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:18.088646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60912e14-910b-420d-b18e-4fb1fa478da3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:18.089808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60912e14-910b-420d-b18e-4fb1fa478da3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/services/beb7d99641e145a5a2626a9e89b08000` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:18.091354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60912e14-910b-420d-b18e-4fb1fa478da3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:delete_service(service_id=beb7d99641e145a5a2626a9e89b08000)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:18.093724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60912e14-910b-420d-b18e-4fb1fa478da3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:18.135373 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2128/4250] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:17 2022] DELETE /identity/v3/services/beb7d99641e145a5a2626a9e89b08000 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:18.140265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7689ba1-55ea-460e-b575-811d4636abd3 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:18.156874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7689ba1-55ea-460e-b575-811d4636abd3 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:18.181159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa41a9-b07f-4208-9f75-1923e9742da4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:18.182084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa41a9-b07f-4208-9f75-1923e9742da4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:18.182537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa41a9-b07f-4208-9f75-1923e9742da4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:18.183012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa41a9-b07f-4208-9f75-1923e9742da4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/endpoints/f6d485b1debc4d07bd3754036255b80e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:18.189329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa41a9-b07f-4208-9f75-1923e9742da4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=f6d485b1debc4d07bd3754036255b80e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:18.191319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa41a9-b07f-4208-9f75-1923e9742da4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:18.214617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1daa41a9-b07f-4208-9f75-1923e9742da4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'f6d485b1debc4d07bd3754036255b80e', 'request_id': 'req-1daa41a9-b07f-4208-9f75-1923e9742da4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:18.234946 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2123/4251] 10.222.0.70 () {58 vars in 1236 bytes} [Sun Aug 28 19:07:18 2022] DELETE /identity/v3/endpoints/f6d485b1debc4d07bd3754036255b80e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:18.235897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60912e14-910b-420d-b18e-4fb1fa478da3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:18.257089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60912e14-910b-420d-b18e-4fb1fa478da3 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:18.284979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e1e85-29a5-4421-8953-5e24c6853212 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:18.285659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e1e85-29a5-4421-8953-5e24c6853212 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:18.289644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e1e85-29a5-4421-8953-5e24c6853212 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:18.289941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e1e85-29a5-4421-8953-5e24c6853212 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/regions/tempest-region-630957408` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:18.295542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e1e85-29a5-4421-8953-5e24c6853212 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-630957408)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:18.298879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e1e85-29a5-4421-8953-5e24c6853212 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:18.341675 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-8c1e1e85-29a5-4421-8953-5e24c6853212 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-630957408. To ensure interoperability, identifiers should be a valid uuid. Aug 28 19:07:18.341675 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 19:07:18.341675 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:18.352086 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2129/4252] 10.222.0.70 () {58 vars in 1206 bytes} [Sun Aug 28 19:07:18 2022] DELETE /identity/v3/regions/tempest-region-630957408 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:18.356544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa41a9-b07f-4208-9f75-1923e9742da4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:18.397609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa41a9-b07f-4208-9f75-1923e9742da4 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:18.453451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da64f17-b1cc-48d1-bbb8-0744b6609756 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9441d9c9fe3a436abf60d0806437b6d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e29e98202fde42d4bef3ede5cad5a4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:18.454659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da64f17-b1cc-48d1-bbb8-0744b6609756 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:18.456722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da64f17-b1cc-48d1-bbb8-0744b6609756 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:18.457087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da64f17-b1cc-48d1-bbb8-0744b6609756 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] PATH_INFO: `/v3/services/19c1759b65d045e5913cc482d161b0b7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:18.457790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da64f17-b1cc-48d1-bbb8-0744b6609756 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorizing `identity:delete_service(service_id=19c1759b65d045e5913cc482d161b0b7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:18.464577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da64f17-b1cc-48d1-bbb8-0744b6609756 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:18.523754 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2124/4253] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:18 2022] DELETE /identity/v3/services/19c1759b65d045e5913cc482d161b0b7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:18.528970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e1e85-29a5-4421-8953-5e24c6853212 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:18.589718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e1e85-29a5-4421-8953-5e24c6853212 tempest-EndPointsTestJSON-1230569407 tempest-EndPointsTestJSON-1230569407-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:18.616698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:18.617778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:18.618372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:18.620549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] PATH_INFO: `/v3/users/e989d086a55b4a2abe7329a2ef99db58` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:18.622255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e989d086a55b4a2abe7329a2ef99db58)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:18.628468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:18.731697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e989d086a55b4a2abe7329a2ef99db58'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:18.736503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:DELETE=15 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:18.749923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e989d086a55b4a2abe7329a2ef99db58'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:18.750689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e989d086a55b4a2abe7329a2ef99db58'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:18.773522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e989d086a55b4a2abe7329a2ef99db58'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:18.774881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e989d086a55b4a2abe7329a2ef99db58'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:18.809207 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2130/4254] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:18 2022] DELETE /identity/v3/users/e989d086a55b4a2abe7329a2ef99db58 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:18.811024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e032-9e66-426c-91cd-7367f1941fca None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:18.811389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e032-9e66-426c-91cd-7367f1941fca None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:18.811748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e032-9e66-426c-91cd-7367f1941fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:18.900373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cbe6e032-9e66-426c-91cd-7367f1941fca None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:18.909154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cbe6e032-9e66-426c-91cd-7367f1941fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:19.081290 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2125/4255] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:07:19.191569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:19.193381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:19.354995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808b9c1-b7da-47e8-928f-3438c2c82f02 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:19.366303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54797ca5-e418-4322-a058-b72d36d40b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:19.367280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54797ca5-e418-4322-a058-b72d36d40b19 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:19.367821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54797ca5-e418-4322-a058-b72d36d40b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:19.368209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54797ca5-e418-4322-a058-b72d36d40b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:19.396193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54797ca5-e418-4322-a058-b72d36d40b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:19.401067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54797ca5-e418-4322-a058-b72d36d40b19 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:19.428133 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2131/4256] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:20.416502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6e032-9e66-426c-91cd-7367f1941fca None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:20.419087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cbe6e032-9e66-426c-91cd-7367f1941fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:20.462917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6e032-9e66-426c-91cd-7367f1941fca None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:20.485639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:20.486862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:20.490707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:20.491085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] PATH_INFO: `/v3/projects/cdfe31e39722402bafadc426d73e0284` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:20.495087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfe31e39722402bafadc426d73e0284)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:20.497963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:20.577901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfe31e39722402bafadc426d73e0284', 'request_id': 'req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:20.588583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfe31e39722402bafadc426d73e0284', 'request_id': 'req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:20.594701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:20.598997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfe31e39722402bafadc426d73e0284', 'request_id': 'req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:20.619313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] The token cache is being invalidate because project cdfe31e39722402bafadc426d73e0284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:20.619928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:20.623012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:20.626445 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2126/4257] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:20 2022] DELETE /identity/v3/projects/cdfe31e39722402bafadc426d73e0284 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:20.631684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54797ca5-e418-4322-a058-b72d36d40b19 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:20.647825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54797ca5-e418-4322-a058-b72d36d40b19 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:20.827770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14b26-44a6-490b-aa6c-387754822de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:20.830150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14b26-44a6-490b-aa6c-387754822de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:20.831473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14b26-44a6-490b-aa6c-387754822de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:20.831473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14b26-44a6-490b-aa6c-387754822de1 admin admin] PATH_INFO: `/v3/users/9441d9c9fe3a436abf60d0806437b6d0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:20.834415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd14b26-44a6-490b-aa6c-387754822de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9441d9c9fe3a436abf60d0806437b6d0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:20.838984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd14b26-44a6-490b-aa6c-387754822de1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:20.961202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7fd14b26-44a6-490b-aa6c-387754822de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9441d9c9fe3a436abf60d0806437b6d0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:20.986970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7fd14b26-44a6-490b-aa6c-387754822de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9441d9c9fe3a436abf60d0806437b6d0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:20.991437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7fd14b26-44a6-490b-aa6c-387754822de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9441d9c9fe3a436abf60d0806437b6d0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:21.009425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7fd14b26-44a6-490b-aa6c-387754822de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9441d9c9fe3a436abf60d0806437b6d0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:21.010764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7fd14b26-44a6-490b-aa6c-387754822de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9441d9c9fe3a436abf60d0806437b6d0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:21.012401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:21.084337 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2132/4258] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:20 2022] DELETE /identity/v3/users/9441d9c9fe3a436abf60d0806437b6d0 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:22.790956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:22.809722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:22.847498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea855b-adc9-4b3b-a42e-2a699ce8401d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:22.999409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa3c96-9673-436a-a808-434f9af64a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:23.000414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa3c96-9673-436a-a808-434f9af64a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:23.000861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa3c96-9673-436a-a808-434f9af64a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:23.001294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa3c96-9673-436a-a808-434f9af64a71 admin admin] PATH_INFO: `/v3/projects/e29e98202fde42d4bef3ede5cad5a4e6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:23.003445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa3c96-9673-436a-a808-434f9af64a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29e98202fde42d4bef3ede5cad5a4e6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:23.007350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa3c96-9673-436a-a808-434f9af64a71 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:23.089742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-daaa3c96-9673-436a-a808-434f9af64a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29e98202fde42d4bef3ede5cad5a4e6', 'request_id': 'req-daaa3c96-9673-436a-a808-434f9af64a71'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:23.101325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-daaa3c96-9673-436a-a808-434f9af64a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29e98202fde42d4bef3ede5cad5a4e6', 'request_id': 'req-daaa3c96-9673-436a-a808-434f9af64a71'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:23.111828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-daaa3c96-9673-436a-a808-434f9af64a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29e98202fde42d4bef3ede5cad5a4e6', 'request_id': 'req-daaa3c96-9673-436a-a808-434f9af64a71'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:23.136082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-daaa3c96-9673-436a-a808-434f9af64a71 admin admin] The token cache is being invalidate because project e29e98202fde42d4bef3ede5cad5a4e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:23.136541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-daaa3c96-9673-436a-a808-434f9af64a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:23.137480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-daaa3c96-9673-436a-a808-434f9af64a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:23.139628 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2127/4259] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:22 2022] DELETE /identity/v3/projects/e29e98202fde42d4bef3ede5cad5a4e6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:23.144978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6b3b1-767c-4919-babf-fd244d344e55 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:23.145815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6b3b1-767c-4919-babf-fd244d344e55 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:23.145815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6b3b1-767c-4919-babf-fd244d344e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:23.187236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-70e6b3b1-767c-4919-babf-fd244d344e55 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:23.188828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-70e6b3b1-767c-4919-babf-fd244d344e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:23.317684 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2133/4260] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:07:23.328880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e294a-e212-40ed-ac99-4f4222709dc2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:23.328880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e294a-e212-40ed-ac99-4f4222709dc2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:23.328880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e294a-e212-40ed-ac99-4f4222709dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:23.370765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-401e294a-e212-40ed-ac99-4f4222709dc2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:23.372083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-401e294a-e212-40ed-ac99-4f4222709dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:23.399331 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2128/4261] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:23.400482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6b3b1-767c-4919-babf-fd244d344e55 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:23.421501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6b3b1-767c-4919-babf-fd244d344e55 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:23.430314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b37a8-1db6-4227-8424-123164b0cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:23.431135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b37a8-1db6-4227-8424-123164b0cf2b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:23.431498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b37a8-1db6-4227-8424-123164b0cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:23.431838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b37a8-1db6-4227-8424-123164b0cf2b admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:23.432589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b37a8-1db6-4227-8424-123164b0cf2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:23.432969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b37a8-1db6-4227-8424-123164b0cf2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:23.434663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b37a8-1db6-4227-8424-123164b0cf2b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:23.469809 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2134/4262] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:07:23.474582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e294a-e212-40ed-ac99-4f4222709dc2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:23.488928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e294a-e212-40ed-ac99-4f4222709dc2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:23.502666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77311b-2ae0-4324-9393-7a65eaeb304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:23.503348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77311b-2ae0-4324-9393-7a65eaeb304f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:23.503702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77311b-2ae0-4324-9393-7a65eaeb304f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:23.504047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77311b-2ae0-4324-9393-7a65eaeb304f admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:23.504910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77311b-2ae0-4324-9393-7a65eaeb304f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:23.507135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77311b-2ae0-4324-9393-7a65eaeb304f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:23.576582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b37a8-1db6-4227-8424-123164b0cf2b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:23.582333 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2129/4263] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:23 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:23.593151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b37a8-1db6-4227-8424-123164b0cf2b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:23.689207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc56f2-2eef-4026-942e-480bffe7ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:23.689942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc56f2-2eef-4026-942e-480bffe7ee9a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:23.690238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc56f2-2eef-4026-942e-480bffe7ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:23.690816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc56f2-2eef-4026-942e-480bffe7ee9a admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:23.691469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc56f2-2eef-4026-942e-480bffe7ee9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:23.696864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc56f2-2eef-4026-942e-480bffe7ee9a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:23.697806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77311b-2ae0-4324-9393-7a65eaeb304f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:23.700030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3b77311b-2ae0-4324-9393-7a65eaeb304f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:23.721440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77311b-2ae0-4324-9393-7a65eaeb304f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:23.736954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:23.738820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:23.739739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:23.740273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] PATH_INFO: `/v3/users/8dbb8a95851248bfabd9a1afe40fc11b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:23.742210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbb8a95851248bfabd9a1afe40fc11b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:23.744949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:23.767264 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2135/4264] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:23 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:23.769406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc56f2-2eef-4026-942e-480bffe7ee9a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:23.803030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc56f2-2eef-4026-942e-480bffe7ee9a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:23.814735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f68846-1de2-4ba4-844b-816da56cde30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:23.815841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f68846-1de2-4ba4-844b-816da56cde30 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:23.819466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f68846-1de2-4ba4-844b-816da56cde30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:23.820032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f68846-1de2-4ba4-844b-816da56cde30 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:23.821012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f68846-1de2-4ba4-844b-816da56cde30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:23.824070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f68846-1de2-4ba4-844b-816da56cde30 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:23.840087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:23.842322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbb8a95851248bfabd9a1afe40fc11b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:23.858038 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2136/4265] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:23.871032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbb8a95851248bfabd9a1afe40fc11b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:23.871032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbb8a95851248bfabd9a1afe40fc11b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:23.875873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f68846-1de2-4ba4-844b-816da56cde30 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:23.881195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbb8a95851248bfabd9a1afe40fc11b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:23.882252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbb8a95851248bfabd9a1afe40fc11b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:23.910116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f68846-1de2-4ba4-844b-816da56cde30 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:23.919203 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2130/4266] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:23 2022] DELETE /identity/v3/users/8dbb8a95851248bfabd9a1afe40fc11b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:23.932812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfbe3-7f0f-4964-a1d7-d272d9d044b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:23.934027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfbe3-7f0f-4964-a1d7-d272d9d044b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:23.934656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfbe3-7f0f-4964-a1d7-d272d9d044b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:23.935180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfbe3-7f0f-4964-a1d7-d272d9d044b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:23.936095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecfbe3-7f0f-4964-a1d7-d272d9d044b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:23.938073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecfbe3-7f0f-4964-a1d7-d272d9d044b2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:23.972778 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2137/4267] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:23.979331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:23.981415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:24.215952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98a720-7eba-4347-b4aa-53f327003698 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:24.244400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cad693-1dde-4da6-95bd-8829da3a3824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:24.245321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad693-1dde-4da6-95bd-8829da3a3824 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:24.246265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad693-1dde-4da6-95bd-8829da3a3824 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:24.246562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad693-1dde-4da6-95bd-8829da3a3824 admin admin] PATH_INFO: `/v3/projects/983eee4b2c2c4419a8e69f2ab0703faa/users/f6d84a465718464ca872cdc192e278ec/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:24.273368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cad693-1dde-4da6-95bd-8829da3a3824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983eee4b2c2c4419a8e69f2ab0703faa, user_id=f6d84a465718464ca872cdc192e278ec, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:24.283831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cad693-1dde-4da6-95bd-8829da3a3824 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:24.321389 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2131/4268] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:23 2022] PUT /identity/v3/projects/983eee4b2c2c4419a8e69f2ab0703faa/users/f6d84a465718464ca872cdc192e278ec/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:24.331935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9e5a9-6d24-460a-ad70-06aae871acbd None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:24.333668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9e5a9-6d24-460a-ad70-06aae871acbd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:24.333668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9e5a9-6d24-460a-ad70-06aae871acbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:24.416134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-51d9e5a9-6d24-460a-ad70-06aae871acbd None None] MFA Rules not processed for user `f6d84a465718464ca872cdc192e278ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:24.417381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-51d9e5a9-6d24-460a-ad70-06aae871acbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:24.474206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:24.570036 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2138/4269] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:24.574279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cad693-1dde-4da6-95bd-8829da3a3824 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:24.674512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cad693-1dde-4da6-95bd-8829da3a3824 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:24.681570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506fea4-0b18-4b42-beb2-e0e446e53c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:24.682457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506fea4-0b18-4b42-beb2-e0e446e53c8c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:24.682955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506fea4-0b18-4b42-beb2-e0e446e53c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:24.683413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506fea4-0b18-4b42-beb2-e0e446e53c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:24.684360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506fea4-0b18-4b42-beb2-e0e446e53c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:24.694214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506fea4-0b18-4b42-beb2-e0e446e53c8c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:24.759588 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2132/4270] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:24 2022] POST /identity/v3/projects => generated 365 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:24.764177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9e5a9-6d24-460a-ad70-06aae871acbd None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:24.811188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9e5a9-6d24-460a-ad70-06aae871acbd None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:24.821772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506fea4-0b18-4b42-beb2-e0e446e53c8c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:24.823826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e506fea4-0b18-4b42-beb2-e0e446e53c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:24.903688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:24.925783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef037b5b-86b8-4e59-ad2b-e7e89f09509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:24.929584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef037b5b-86b8-4e59-ad2b-e7e89f09509a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:24.929893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef037b5b-86b8-4e59-ad2b-e7e89f09509a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:24.930177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef037b5b-86b8-4e59-ad2b-e7e89f09509a admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:24.930889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef037b5b-86b8-4e59-ad2b-e7e89f09509a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:24.934084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef037b5b-86b8-4e59-ad2b-e7e89f09509a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:24.972308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506fea4-0b18-4b42-beb2-e0e446e53c8c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:24.983778 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2139/4271] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:24 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:24.987645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef037b5b-86b8-4e59-ad2b-e7e89f09509a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:24.995968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:24.996653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:24.996940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:24.997475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f admin admin] PATH_INFO: `/v3/projects/016ddf77ac91421a883bbc8787204d42` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:25.002042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=016ddf77ac91421a883bbc8787204d42)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:25.008312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:25.009072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef037b5b-86b8-4e59-ad2b-e7e89f09509a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:25.021659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc819e-1a42-48e0-98ad-d612a9649be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:25.022292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc819e-1a42-48e0-98ad-d612a9649be4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:25.022579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc819e-1a42-48e0-98ad-d612a9649be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:25.022892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc819e-1a42-48e0-98ad-d612a9649be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:25.023560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc819e-1a42-48e0-98ad-d612a9649be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:25.026441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc819e-1a42-48e0-98ad-d612a9649be4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:25.050049 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2140/4272] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:07:25.056395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc819e-1a42-48e0-98ad-d612a9649be4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:25.087444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc819e-1a42-48e0-98ad-d612a9649be4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:25.100704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da693e-dad6-4da6-9d6f-9a62e9cfbd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:25.101743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da693e-dad6-4da6-9d6f-9a62e9cfbd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:25.102132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da693e-dad6-4da6-9d6f-9a62e9cfbd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:25.102906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da693e-dad6-4da6-9d6f-9a62e9cfbd3f admin admin] PATH_INFO: `/v3/projects/2754831d2f6049b6a4f746f27d944a23/users/6523df4825524dc2bce0a62da2733616/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:25.109757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016ddf77ac91421a883bbc8787204d42', 'request_id': 'req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:25.126213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016ddf77ac91421a883bbc8787204d42', 'request_id': 'req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:25.129169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da693e-dad6-4da6-9d6f-9a62e9cfbd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2754831d2f6049b6a4f746f27d944a23, user_id=6523df4825524dc2bce0a62da2733616, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:25.133352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da693e-dad6-4da6-9d6f-9a62e9cfbd3f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:25.136092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016ddf77ac91421a883bbc8787204d42', 'request_id': 'req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:25.156822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f admin admin] The token cache is being invalidate because project 016ddf77ac91421a883bbc8787204d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:25.157198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:25.159877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-923dad76-70c3-4e39-aff7-0f68ce4ddd3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:25.167480 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2133/4273] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:24 2022] DELETE /identity/v3/projects/016ddf77ac91421a883bbc8787204d42 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:25.169666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972f1d3-2501-4bda-9bb4-7435b85d6a5d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:25.169977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972f1d3-2501-4bda-9bb4-7435b85d6a5d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:25.170262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972f1d3-2501-4bda-9bb4-7435b85d6a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:25.201608 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2141/4274] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:25 2022] PUT /identity/v3/projects/2754831d2f6049b6a4f746f27d944a23/users/6523df4825524dc2bce0a62da2733616/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:25.205737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da693e-dad6-4da6-9d6f-9a62e9cfbd3f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:25.211609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-20da693e-dad6-4da6-9d6f-9a62e9cfbd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:25.216750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1972f1d3-2501-4bda-9bb4-7435b85d6a5d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:25.219116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1972f1d3-2501-4bda-9bb4-7435b85d6a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:25.388964 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2134/4275] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:25.392927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da693e-dad6-4da6-9d6f-9a62e9cfbd3f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:25.397740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80117-3c66-4f39-8afd-76d8902542db None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:25.398145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80117-3c66-4f39-8afd-76d8902542db None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:25.398551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80117-3c66-4f39-8afd-76d8902542db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:25.428037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa421558-248e-4e61-8e54-3a44bfc42fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:25.428673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421558-248e-4e61-8e54-3a44bfc42fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:25.428960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421558-248e-4e61-8e54-3a44bfc42fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:25.429237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421558-248e-4e61-8e54-3a44bfc42fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:25.434168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-77d80117-3c66-4f39-8afd-76d8902542db None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:25.435160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-77d80117-3c66-4f39-8afd-76d8902542db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:25.443384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa421558-248e-4e61-8e54-3a44bfc42fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:25.448368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa421558-248e-4e61-8e54-3a44bfc42fc6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:25.448548 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2135/4276] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:07:25.451671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d80117-3c66-4f39-8afd-76d8902542db None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:25.465716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d80117-3c66-4f39-8afd-76d8902542db None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:25.472748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe2963-12f2-40c9-9842-da9bc8ecbfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:25.474379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe2963-12f2-40c9-9842-da9bc8ecbfcc admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:25.474926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe2963-12f2-40c9-9842-da9bc8ecbfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:25.475309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe2963-12f2-40c9-9842-da9bc8ecbfcc admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:25.476119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe2963-12f2-40c9-9842-da9bc8ecbfcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:25.478365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe2963-12f2-40c9-9842-da9bc8ecbfcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:25.478709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe2963-12f2-40c9-9842-da9bc8ecbfcc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:25.495782 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2142/4277] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:25.497223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa421558-248e-4e61-8e54-3a44bfc42fc6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:25.502795 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2136/4278] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:25.503529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe2963-12f2-40c9-9842-da9bc8ecbfcc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:25.516679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe2963-12f2-40c9-9842-da9bc8ecbfcc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:25.522690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c74c5-b829-4513-b6ea-9e275ff593f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:25.523365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c74c5-b829-4513-b6ea-9e275ff593f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:25.523804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c74c5-b829-4513-b6ea-9e275ff593f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:25.524079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c74c5-b829-4513-b6ea-9e275ff593f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:25.524199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa421558-248e-4e61-8e54-3a44bfc42fc6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:25.524951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c74c5-b829-4513-b6ea-9e275ff593f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:25.528152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c74c5-b829-4513-b6ea-9e275ff593f8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:25.545818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437a36c-749f-457b-af59-f9c2a23f7d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:25.546638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437a36c-749f-457b-af59-f9c2a23f7d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:25.552595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437a36c-749f-457b-af59-f9c2a23f7d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:25.553013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437a36c-749f-457b-af59-f9c2a23f7d14 admin admin] PATH_INFO: `/v3/projects/2754831d2f6049b6a4f746f27d944a23/users/6523df4825524dc2bce0a62da2733616/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:25.560866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437a36c-749f-457b-af59-f9c2a23f7d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2754831d2f6049b6a4f746f27d944a23, user_id=6523df4825524dc2bce0a62da2733616, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:25.572154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437a36c-749f-457b-af59-f9c2a23f7d14 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:25.574497 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2137/4279] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:25 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:25.576381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c74c5-b829-4513-b6ea-9e275ff593f8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:25.637479 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2143/4280] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:25 2022] PUT /identity/v3/projects/2754831d2f6049b6a4f746f27d944a23/users/6523df4825524dc2bce0a62da2733616/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:25.641741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345ac1c-c03d-4ef7-9d73-fe1291b0aa20 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:25.642108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345ac1c-c03d-4ef7-9d73-fe1291b0aa20 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:25.642381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345ac1c-c03d-4ef7-9d73-fe1291b0aa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:25.659496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:25.662415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:25.733747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c345ac1c-c03d-4ef7-9d73-fe1291b0aa20 None None] MFA Rules not processed for user `6523df4825524dc2bce0a62da2733616`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:25.747718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c345ac1c-c03d-4ef7-9d73-fe1291b0aa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:25.794468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c74c5-b829-4513-b6ea-9e275ff593f8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:25.951117 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2144/4281] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:25.955143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345ac1c-c03d-4ef7-9d73-fe1291b0aa20 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:25.978819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90f770-4966-4004-9138-445ca0ea839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:25.979987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90f770-4966-4004-9138-445ca0ea839c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:25.980461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90f770-4966-4004-9138-445ca0ea839c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:25.980893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90f770-4966-4004-9138-445ca0ea839c admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:25.981755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90f770-4966-4004-9138-445ca0ea839c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:25.983917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90f770-4966-4004-9138-445ca0ea839c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:25.993968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345ac1c-c03d-4ef7-9d73-fe1291b0aa20 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:26.012470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea887a-1ef0-4512-98ca-38366e0c1bd7 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6523df4825524dc2bce0a62da2733616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2754831d2f6049b6a4f746f27d944a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:26.013127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea887a-1ef0-4512-98ca-38366e0c1bd7 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:26.013590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea887a-1ef0-4512-98ca-38366e0c1bd7 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:26.013882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea887a-1ef0-4512-98ca-38366e0c1bd7 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:26.014567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea887a-1ef0-4512-98ca-38366e0c1bd7 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:26.016328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea887a-1ef0-4512-98ca-38366e0c1bd7 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:26.036385 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2138/4282] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:25 2022] POST /identity/v3/users => generated 290 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:26.041273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90f770-4966-4004-9138-445ca0ea839c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:26.062705 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2145/4283] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:07:25 2022] POST /identity/v3/domains => generated 276 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:26.067092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90f770-4966-4004-9138-445ca0ea839c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:26.068262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea887a-1ef0-4512-98ca-38366e0c1bd7 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:26.153264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab375b49-a630-4493-a068-f6e63732c3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:26.153893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab375b49-a630-4493-a068-f6e63732c3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:26.154173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab375b49-a630-4493-a068-f6e63732c3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:26.154445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab375b49-a630-4493-a068-f6e63732c3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:26.155146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab375b49-a630-4493-a068-f6e63732c3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:26.157603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab375b49-a630-4493-a068-f6e63732c3a7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:26.176222 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2139/4284] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:26.178148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab375b49-a630-4493-a068-f6e63732c3a7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:26.189568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab375b49-a630-4493-a068-f6e63732c3a7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:26.195665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9b7dd-ceb3-4714-8865-c62a35050854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:26.196291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9b7dd-ceb3-4714-8865-c62a35050854 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:26.196575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9b7dd-ceb3-4714-8865-c62a35050854 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:26.196851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9b7dd-ceb3-4714-8865-c62a35050854 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:26.197497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9b7dd-ceb3-4714-8865-c62a35050854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:26.199274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9b7dd-ceb3-4714-8865-c62a35050854 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:26.219514 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2140/4285] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:26.226731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9b7dd-ceb3-4714-8865-c62a35050854 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:26.242321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9b7dd-ceb3-4714-8865-c62a35050854 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:26.249448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a1004-49bf-488c-9e99-09011b043fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:26.249828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a1004-49bf-488c-9e99-09011b043fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:26.250962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a1004-49bf-488c-9e99-09011b043fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:26.250962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a1004-49bf-488c-9e99-09011b043fc4 admin admin] PATH_INFO: `/v3/projects/bcb5e029af8e4fb1b314576e73d75410/users/e8ac4ee4e0c047b9b415607fcf64ae74/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:26.273128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a1004-49bf-488c-9e99-09011b043fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb5e029af8e4fb1b314576e73d75410, user_id=e8ac4ee4e0c047b9b415607fcf64ae74, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:26.276387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a1004-49bf-488c-9e99-09011b043fc4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:26.276700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea887a-1ef0-4512-98ca-38366e0c1bd7 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:26.282326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689102-8810-4d66-a56a-0d9ea5eb5f5f tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6523df4825524dc2bce0a62da2733616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2754831d2f6049b6a4f746f27d944a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:26.283077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689102-8810-4d66-a56a-0d9ea5eb5f5f tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:26.283364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689102-8810-4d66-a56a-0d9ea5eb5f5f tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:26.283650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689102-8810-4d66-a56a-0d9ea5eb5f5f tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:26.284298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c689102-8810-4d66-a56a-0d9ea5eb5f5f tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:26.287676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c689102-8810-4d66-a56a-0d9ea5eb5f5f tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:26.303154 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2141/4286] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:26 2022] PUT /identity/v3/projects/bcb5e029af8e4fb1b314576e73d75410/users/e8ac4ee4e0c047b9b415607fcf64ae74/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:26.312087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f7d99-4ed1-4b40-b65a-dd3a36d16f09 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:26.315717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f7d99-4ed1-4b40-b65a-dd3a36d16f09 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:26.316392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f7d99-4ed1-4b40-b65a-dd3a36d16f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:26.365271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1a5f7d99-4ed1-4b40-b65a-dd3a36d16f09 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:26.367866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1a5f7d99-4ed1-4b40-b65a-dd3a36d16f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:26.389312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:26.393260 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2146/4287] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:26 2022] POST /identity/v3/users => generated 347 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:26.397735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689102-8810-4d66-a56a-0d9ea5eb5f5f tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:26.422572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689102-8810-4d66-a56a-0d9ea5eb5f5f tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:26.565797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:26.577146 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2142/4288] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:26.586729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f7d99-4ed1-4b40-b65a-dd3a36d16f09 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:26.588216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1a5f7d99-4ed1-4b40-b65a-dd3a36d16f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:26.589965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048917c-fd48-4579-a46f-1e2a80064362 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6523df4825524dc2bce0a62da2733616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2754831d2f6049b6a4f746f27d944a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:26.591433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048917c-fd48-4579-a46f-1e2a80064362 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:26.621705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048917c-fd48-4579-a46f-1e2a80064362 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:26.625342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048917c-fd48-4579-a46f-1e2a80064362 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:26.630857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048917c-fd48-4579-a46f-1e2a80064362 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:26.639565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048917c-fd48-4579-a46f-1e2a80064362 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:26.696561 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2147/4289] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:26 2022] POST /identity/v3/users => generated 321 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:26.728107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048917c-fd48-4579-a46f-1e2a80064362 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:26.788388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048917c-fd48-4579-a46f-1e2a80064362 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:26.800052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcd9e2-9f82-4c44-954d-dfe61b9ac9da tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6523df4825524dc2bce0a62da2733616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2754831d2f6049b6a4f746f27d944a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:26.803547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcd9e2-9f82-4c44-954d-dfe61b9ac9da tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:26.803859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcd9e2-9f82-4c44-954d-dfe61b9ac9da tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:26.804185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcd9e2-9f82-4c44-954d-dfe61b9ac9da tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] PATH_INFO: `/v3/users/bbcafe27fddf4c21be9b16a6a78df3a5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:26.822476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f7d99-4ed1-4b40-b65a-dd3a36d16f09 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:26.829732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6c812-41e2-4813-864a-b49f1f42da77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:26.830953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6c812-41e2-4813-864a-b49f1f42da77 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:26.832000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6c812-41e2-4813-864a-b49f1f42da77 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:26.832203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6c812-41e2-4813-864a-b49f1f42da77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:26.856044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcd9e2-9f82-4c44-954d-dfe61b9ac9da tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorizing `identity:get_user(user_id=bbcafe27fddf4c21be9b16a6a78df3a5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:26.856632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6c812-41e2-4813-864a-b49f1f42da77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:26.859039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6c812-41e2-4813-864a-b49f1f42da77 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:26.861644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcd9e2-9f82-4c44-954d-dfe61b9ac9da tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:26.869647 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2148/4290] 10.222.0.70 () {58 vars in 1221 bytes} [Sun Aug 28 19:07:26 2022] GET /identity/v3/users/bbcafe27fddf4c21be9b16a6a78df3a5 => generated 347 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:26.871130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcd9e2-9f82-4c44-954d-dfe61b9ac9da tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:26.874882 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2143/4291] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:26.900524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcd9e2-9f82-4c44-954d-dfe61b9ac9da tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:26.919270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2318f0-607d-4962-a720-cf819704ada4 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6523df4825524dc2bce0a62da2733616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2754831d2f6049b6a4f746f27d944a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:26.919943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2318f0-607d-4962-a720-cf819704ada4 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:26.920232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2318f0-607d-4962-a720-cf819704ada4 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:26.920680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2318f0-607d-4962-a720-cf819704ada4 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:26.921402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2318f0-607d-4962-a720-cf819704ada4 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Adding query filter params (domain_id=7b7010576bf3432380635b080cfaf639) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:26.921724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2318f0-607d-4962-a720-cf819704ada4 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:26.928364 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-6d2318f0-607d-4962-a720-cf819704ada4 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:26.928364 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:26.928364 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:26.931207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2318f0-607d-4962-a720-cf819704ada4 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:26.964152 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2149/4292] 10.222.0.70 () {58 vars in 1207 bytes} [Sun Aug 28 19:07:26 2022] GET /identity/v3/users?domain_id=7b7010576bf3432380635b080cfaf639 => generated 484 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:26.969631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6c812-41e2-4813-864a-b49f1f42da77 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:26.999141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6c812-41e2-4813-864a-b49f1f42da77 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:27.023235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582f673-aabe-4da5-83d7-c921e26780f8 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6523df4825524dc2bce0a62da2733616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2754831d2f6049b6a4f746f27d944a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:27.023866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582f673-aabe-4da5-83d7-c921e26780f8 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:27.024165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582f673-aabe-4da5-83d7-c921e26780f8 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:27.024442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582f673-aabe-4da5-83d7-c921e26780f8 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:27.027657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582f673-aabe-4da5-83d7-c921e26780f8 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:27.032481 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-4582f673-aabe-4da5-83d7-c921e26780f8 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:27.032481 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:27.032481 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:27.033830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582f673-aabe-4da5-83d7-c921e26780f8 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:27.265113 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2144/4293] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:26 2022] GET /identity/v3/users => generated 9420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:27.271329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2318f0-607d-4962-a720-cf819704ada4 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:27.310865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2318f0-607d-4962-a720-cf819704ada4 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:27.345887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01974a84-2e41-4673-9610-297300092021 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6523df4825524dc2bce0a62da2733616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2754831d2f6049b6a4f746f27d944a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:27.347039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01974a84-2e41-4673-9610-297300092021 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:27.347602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01974a84-2e41-4673-9610-297300092021 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:27.349628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01974a84-2e41-4673-9610-297300092021 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:27.350955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01974a84-2e41-4673-9610-297300092021 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1958329682) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:27.359987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01974a84-2e41-4673-9610-297300092021 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:27.363225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01974a84-2e41-4673-9610-297300092021 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:27.493347 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2150/4294] 10.222.0.70 () {58 vars in 1189 bytes} [Sun Aug 28 19:07:27 2022] GET /identity/v3/users?name=tempest-test_user-1958329682 => generated 475 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:27.499018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582f673-aabe-4da5-83d7-c921e26780f8 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:27.534122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582f673-aabe-4da5-83d7-c921e26780f8 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:27.548269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc21b1-44b4-4948-b7af-5799e8b47509 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6523df4825524dc2bce0a62da2733616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2754831d2f6049b6a4f746f27d944a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:27.548972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc21b1-44b4-4948-b7af-5799e8b47509 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:27.549522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc21b1-44b4-4948-b7af-5799e8b47509 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:27.550024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc21b1-44b4-4948-b7af-5799e8b47509 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:27.573457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc21b1-44b4-4948-b7af-5799e8b47509 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:27.585876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc21b1-44b4-4948-b7af-5799e8b47509 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:27.592822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc21b1-44b4-4948-b7af-5799e8b47509 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:27.682592 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2145/4295] 10.222.0.70 () {58 vars in 1149 bytes} [Sun Aug 28 19:07:27 2022] GET /identity/v3/users?enabled=False => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:27.688206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01974a84-2e41-4673-9610-297300092021 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:27.718997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01974a84-2e41-4673-9610-297300092021 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:27.725737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb22db1-0f03-4e6c-8ce1-b49523494429 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6523df4825524dc2bce0a62da2733616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2754831d2f6049b6a4f746f27d944a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:27.727913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb22db1-0f03-4e6c-8ce1-b49523494429 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:27.728498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb22db1-0f03-4e6c-8ce1-b49523494429 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:27.729002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb22db1-0f03-4e6c-8ce1-b49523494429 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] PATH_INFO: `/v3/users/8c8b9a04cb88441abee278b8778dac37` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:27.795567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb22db1-0f03-4e6c-8ce1-b49523494429 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8c8b9a04cb88441abee278b8778dac37)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:27.798417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb22db1-0f03-4e6c-8ce1-b49523494429 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:27.926942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fcb22db1-0f03-4e6c-8ce1-b49523494429 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8b9a04cb88441abee278b8778dac37'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:27.962021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fcb22db1-0f03-4e6c-8ce1-b49523494429 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8b9a04cb88441abee278b8778dac37'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:27.968539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fcb22db1-0f03-4e6c-8ce1-b49523494429 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8b9a04cb88441abee278b8778dac37'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:27.984789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fcb22db1-0f03-4e6c-8ce1-b49523494429 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8b9a04cb88441abee278b8778dac37'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:27.985681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fcb22db1-0f03-4e6c-8ce1-b49523494429 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8b9a04cb88441abee278b8778dac37'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:28.056059 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2151/4296] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:27 2022] DELETE /identity/v3/users/8c8b9a04cb88441abee278b8778dac37 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:28.060945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc21b1-44b4-4948-b7af-5799e8b47509 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:28.063117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-61fc21b1-44b4-4948-b7af-5799e8b47509 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:28.097540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc21b1-44b4-4948-b7af-5799e8b47509 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:28.245221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6523df4825524dc2bce0a62da2733616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2754831d2f6049b6a4f746f27d944a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:28.245978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:28.246365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:28.246776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] PATH_INFO: `/v3/users/bbcafe27fddf4c21be9b16a6a78df3a5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:28.248084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bbcafe27fddf4c21be9b16a6a78df3a5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:28.253510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:28.361421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:28.373459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbcafe27fddf4c21be9b16a6a78df3a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:28.391814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbcafe27fddf4c21be9b16a6a78df3a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:28.397967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbcafe27fddf4c21be9b16a6a78df3a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:28.437240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbcafe27fddf4c21be9b16a6a78df3a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:28.438726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbcafe27fddf4c21be9b16a6a78df3a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:28.480809 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2146/4297] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:28 2022] DELETE /identity/v3/users/bbcafe27fddf4c21be9b16a6a78df3a5 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:28.481350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb22db1-0f03-4e6c-8ce1-b49523494429 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:28.500206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb22db1-0f03-4e6c-8ce1-b49523494429 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:28.662204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad20b53-32df-4487-ad58-17c378bb2082 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6523df4825524dc2bce0a62da2733616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2754831d2f6049b6a4f746f27d944a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:28.666857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad20b53-32df-4487-ad58-17c378bb2082 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:28.667389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad20b53-32df-4487-ad58-17c378bb2082 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:28.667858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad20b53-32df-4487-ad58-17c378bb2082 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] PATH_INFO: `/v3/domains/7b7010576bf3432380635b080cfaf639` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:28.677179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad20b53-32df-4487-ad58-17c378bb2082 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7b7010576bf3432380635b080cfaf639)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:28.678896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad20b53-32df-4487-ad58-17c378bb2082 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:28.703787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:28.735544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aad20b53-32df-4487-ad58-17c378bb2082 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7b7010576bf3432380635b080cfaf639'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:28.736546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aad20b53-32df-4487-ad58-17c378bb2082 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7b7010576bf3432380635b080cfaf639'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:28.790143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aad20b53-32df-4487-ad58-17c378bb2082 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7b7010576bf3432380635b080cfaf639'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:28.791960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aad20b53-32df-4487-ad58-17c378bb2082 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7b7010576bf3432380635b080cfaf639'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:28.793339 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2152/4298] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:07:28 2022] PATCH /identity/v3/domains/7b7010576bf3432380635b080cfaf639 => generated 277 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:07:28.798149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:28.799926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:28.832555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1455-d17a-4a1e-9103-bcb725116d59 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:28.924348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6523df4825524dc2bce0a62da2733616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2754831d2f6049b6a4f746f27d944a23', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:28.925067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:28.925355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:28.925773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] PATH_INFO: `/v3/domains/7b7010576bf3432380635b080cfaf639` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:28.941541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7b7010576bf3432380635b080cfaf639)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:28.943823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:28.979788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7b7010576bf3432380635b080cfaf639'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:28.985142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7b7010576bf3432380635b080cfaf639'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.069681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7010576bf3432380635b080cfaf639', 'request_id': 'req-69067d85-e56d-4712-bb86-94c37a864606'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.081723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7010576bf3432380635b080cfaf639', 'request_id': 'req-69067d85-e56d-4712-bb86-94c37a864606'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.104043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7010576bf3432380635b080cfaf639', 'request_id': 'req-69067d85-e56d-4712-bb86-94c37a864606'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.120730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] The token cache is being invalidate because project 7b7010576bf3432380635b080cfaf639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:29.121014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.121852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.134822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7b7010576bf3432380635b080cfaf639', 'request_id': 'req-69067d85-e56d-4712-bb86-94c37a864606'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.139279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:29.147670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7b7010576bf3432380635b080cfaf639', 'request_id': 'req-69067d85-e56d-4712-bb86-94c37a864606'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.148498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69067d85-e56d-4712-bb86-94c37a864606 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7b7010576bf3432380635b080cfaf639', 'request_id': 'req-69067d85-e56d-4712-bb86-94c37a864606'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.157863 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2147/4299] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:07:28 2022] DELETE /identity/v3/domains/7b7010576bf3432380635b080cfaf639 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:29.162487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad20b53-32df-4487-ad58-17c378bb2082 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:29.164501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aad20b53-32df-4487-ad58-17c378bb2082 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:29.384108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad20b53-32df-4487-ad58-17c378bb2082 tempest-UsersV3TestJSON-996844835 tempest-UsersV3TestJSON-996844835-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:29.623050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:29.624022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:29.624434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:29.624818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] PATH_INFO: `/v3/users/f6d84a465718464ca872cdc192e278ec` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:29.629354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d84a465718464ca872cdc192e278ec)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:29.634889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:29.745223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d84a465718464ca872cdc192e278ec'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.764087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d84a465718464ca872cdc192e278ec'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.771829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d84a465718464ca872cdc192e278ec'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.789134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d84a465718464ca872cdc192e278ec'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.790592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d84a465718464ca872cdc192e278ec'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:29.821269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:29.840358 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2153/4300] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:29 2022] DELETE /identity/v3/users/f6d84a465718464ca872cdc192e278ec => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:29.844878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cf175-ae21-45db-89af-f425a612ae08 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:29.845475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cf175-ae21-45db-89af-f425a612ae08 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:29.846039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cf175-ae21-45db-89af-f425a612ae08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:29.899828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5b0cf175-ae21-45db-89af-f425a612ae08 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:29.906515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5b0cf175-ae21-45db-89af-f425a612ae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:30.080069 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2148/4301] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:30.117934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:30.120174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:30.327787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12169932-6287-41f4-be9e-5c30a700031c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:30.342545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ebcbb-0616-4b62-8eb4-da50f1f7b6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:30.343953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ebcbb-0616-4b62-8eb4-da50f1f7b6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:30.344349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ebcbb-0616-4b62-8eb4-da50f1f7b6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:30.345202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ebcbb-0616-4b62-8eb4-da50f1f7b6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:30.377852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ebcbb-0616-4b62-8eb4-da50f1f7b6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:30.380168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ebcbb-0616-4b62-8eb4-da50f1f7b6c4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:30.408169 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2154/4302] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:32.743783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cf175-ae21-45db-89af-f425a612ae08 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:32.748080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ebcbb-0616-4b62-8eb4-da50f1f7b6c4 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:32.749984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-855ebcbb-0616-4b62-8eb4-da50f1f7b6c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:32.750922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5b0cf175-ae21-45db-89af-f425a612ae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:32.805532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ebcbb-0616-4b62-8eb4-da50f1f7b6c4 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:32.808934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cf175-ae21-45db-89af-f425a612ae08 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:32.827185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802142f-f8a1-4e37-8efe-e0e1883e8bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:32.829823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802142f-f8a1-4e37-8efe-e0e1883e8bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:32.833613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802142f-f8a1-4e37-8efe-e0e1883e8bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:32.844675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802142f-f8a1-4e37-8efe-e0e1883e8bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:32.848392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:32.849943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:32.851809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2802142f-f8a1-4e37-8efe-e0e1883e8bb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:32.853336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:32.854646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] PATH_INFO: `/v3/projects/983eee4b2c2c4419a8e69f2ab0703faa` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:32.861927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=983eee4b2c2c4419a8e69f2ab0703faa)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:32.871897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:32.906362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802142f-f8a1-4e37-8efe-e0e1883e8bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:32.909958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802142f-f8a1-4e37-8efe-e0e1883e8bb2 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:32.956244 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2155/4303] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:33.293753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983eee4b2c2c4419a8e69f2ab0703faa', 'request_id': 'req-1fee769c-20e9-4405-b117-b1f811076e0a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:33.320989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983eee4b2c2c4419a8e69f2ab0703faa', 'request_id': 'req-1fee769c-20e9-4405-b117-b1f811076e0a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:33.331098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983eee4b2c2c4419a8e69f2ab0703faa', 'request_id': 'req-1fee769c-20e9-4405-b117-b1f811076e0a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:33.356104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] The token cache is being invalidate because project 983eee4b2c2c4419a8e69f2ab0703faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:33.356475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:33.357407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:33.365993 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2149/4304] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:32 2022] DELETE /identity/v3/projects/983eee4b2c2c4419a8e69f2ab0703faa => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:33.370129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802142f-f8a1-4e37-8efe-e0e1883e8bb2 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:33.392233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802142f-f8a1-4e37-8efe-e0e1883e8bb2 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:33.700057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:33.702078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:33.702597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:33.703595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] PATH_INFO: `/v3/users/6523df4825524dc2bce0a62da2733616` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:33.706052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6523df4825524dc2bce0a62da2733616)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:33.723202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:33.782034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:33.784315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:33.869743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6523df4825524dc2bce0a62da2733616'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:33.899593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6523df4825524dc2bce0a62da2733616'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:33.900554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6523df4825524dc2bce0a62da2733616'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:33.931774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6523df4825524dc2bce0a62da2733616'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:33.932652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6523df4825524dc2bce0a62da2733616'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:33.981628 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2156/4305] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:33 2022] DELETE /identity/v3/users/6523df4825524dc2bce0a62da2733616 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:34.014219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee769c-20e9-4405-b117-b1f811076e0a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:34.028932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:34.199419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90c652-451d-45a9-a5a8-e98dff58080d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:34.200185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c652-451d-45a9-a5a8-e98dff58080d service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:34.200585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c652-451d-45a9-a5a8-e98dff58080d service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:34.200998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c652-451d-45a9-a5a8-e98dff58080d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:34.204206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3c90c652-451d-45a9-a5a8-e98dff58080d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:34.224414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90c652-451d-45a9-a5a8-e98dff58080d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:34.227400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90c652-451d-45a9-a5a8-e98dff58080d service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:34.246569 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2150/4306] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:07:36.456679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:36.459270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:36.470581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:36.798897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad10656-489a-48c5-9cad-06f2d2f85acf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:36.814110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202e26-9112-4a4f-a847-8e9720167257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:36.814858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202e26-9112-4a4f-a847-8e9720167257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:36.815196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202e26-9112-4a4f-a847-8e9720167257 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:36.815549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202e26-9112-4a4f-a847-8e9720167257 admin admin] PATH_INFO: `/v3/projects/2754831d2f6049b6a4f746f27d944a23` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:36.824326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e202e26-9112-4a4f-a847-8e9720167257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2754831d2f6049b6a4f746f27d944a23)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:36.826338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e202e26-9112-4a4f-a847-8e9720167257 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:36.969279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e202e26-9112-4a4f-a847-8e9720167257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2754831d2f6049b6a4f746f27d944a23', 'request_id': 'req-9e202e26-9112-4a4f-a847-8e9720167257'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:36.982652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e202e26-9112-4a4f-a847-8e9720167257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2754831d2f6049b6a4f746f27d944a23', 'request_id': 'req-9e202e26-9112-4a4f-a847-8e9720167257'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:36.995886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e202e26-9112-4a4f-a847-8e9720167257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2754831d2f6049b6a4f746f27d944a23', 'request_id': 'req-9e202e26-9112-4a4f-a847-8e9720167257'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:37.026446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e202e26-9112-4a4f-a847-8e9720167257 admin admin] The token cache is being invalidate because project 2754831d2f6049b6a4f746f27d944a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:37.026844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e202e26-9112-4a4f-a847-8e9720167257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:37.027853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e202e26-9112-4a4f-a847-8e9720167257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:37.033620 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2157/4307] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:36 2022] DELETE /identity/v3/projects/2754831d2f6049b6a4f746f27d944a23 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:37.036115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0e6dd-dd3d-4296-9a98-83ecf1f75536 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:37.036115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0e6dd-dd3d-4296-9a98-83ecf1f75536 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:37.036744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0e6dd-dd3d-4296-9a98-83ecf1f75536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:37.089254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fde0e6dd-dd3d-4296-9a98-83ecf1f75536 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:37.090718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fde0e6dd-dd3d-4296-9a98-83ecf1f75536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:37.344523 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2151/4308] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:37.361353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b8d41-6cab-4cb7-8f2c-05eeff678c28 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:37.361671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b8d41-6cab-4cb7-8f2c-05eeff678c28 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:37.361967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b8d41-6cab-4cb7-8f2c-05eeff678c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:37.400617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-149b8d41-6cab-4cb7-8f2c-05eeff678c28 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:37.407020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-149b8d41-6cab-4cb7-8f2c-05eeff678c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:37.442424 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2158/4309] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:37.449074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0e6dd-dd3d-4296-9a98-83ecf1f75536 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:37.461965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0e6dd-dd3d-4296-9a98-83ecf1f75536 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:37.479093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200f680-46b9-43bf-9a89-ee4d6115d7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:37.479820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f680-46b9-43bf-9a89-ee4d6115d7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:37.480107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f680-46b9-43bf-9a89-ee4d6115d7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:37.480385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f680-46b9-43bf-9a89-ee4d6115d7e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:37.481052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200f680-46b9-43bf-9a89-ee4d6115d7e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:37.481372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200f680-46b9-43bf-9a89-ee4d6115d7e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:37.484121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200f680-46b9-43bf-9a89-ee4d6115d7e8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:37.501151 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2152/4310] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:37.509206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b8d41-6cab-4cb7-8f2c-05eeff678c28 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:37.525709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b8d41-6cab-4cb7-8f2c-05eeff678c28 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:37.535061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f452bf-998b-48e7-8743-1ff92693118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:37.536445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f452bf-998b-48e7-8743-1ff92693118f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:37.536948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f452bf-998b-48e7-8743-1ff92693118f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:37.537450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f452bf-998b-48e7-8743-1ff92693118f admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:37.538368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f452bf-998b-48e7-8743-1ff92693118f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:37.541171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f452bf-998b-48e7-8743-1ff92693118f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:37.597678 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2159/4311] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:37 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:07:37.605231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200f680-46b9-43bf-9a89-ee4d6115d7e8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:37.625254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200f680-46b9-43bf-9a89-ee4d6115d7e8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:37.726979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abfd83-49b5-4221-ab51-0265253e75a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:37.727893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abfd83-49b5-4221-ab51-0265253e75a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:37.728252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abfd83-49b5-4221-ab51-0265253e75a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:37.728650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abfd83-49b5-4221-ab51-0265253e75a6 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:37.729486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abfd83-49b5-4221-ab51-0265253e75a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:37.733690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abfd83-49b5-4221-ab51-0265253e75a6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:37.782315 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2153/4312] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:37 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:37.788589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f452bf-998b-48e7-8743-1ff92693118f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:37.802500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f452bf-998b-48e7-8743-1ff92693118f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:37.808657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1a85f-e3c1-4185-a13b-4ee02ed19f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:37.809427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1a85f-e3c1-4185-a13b-4ee02ed19f72 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:37.809821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1a85f-e3c1-4185-a13b-4ee02ed19f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:37.810242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1a85f-e3c1-4185-a13b-4ee02ed19f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:37.811068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1a85f-e3c1-4185-a13b-4ee02ed19f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:37.813083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1a85f-e3c1-4185-a13b-4ee02ed19f72 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:37.828067 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2160/4313] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:37.831314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abfd83-49b5-4221-ab51-0265253e75a6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:37.847470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abfd83-49b5-4221-ab51-0265253e75a6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:37.855072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cc888-7ef8-445d-b787-cf8843a1b2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:37.856008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc888-7ef8-445d-b787-cf8843a1b2ff admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:37.856446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc888-7ef8-445d-b787-cf8843a1b2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:37.856839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc888-7ef8-445d-b787-cf8843a1b2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:37.857645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cc888-7ef8-445d-b787-cf8843a1b2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:37.867486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cc888-7ef8-445d-b787-cf8843a1b2ff admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:37.880920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:37.896297 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2154/4314] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:07:37.901549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1a85f-e3c1-4185-a13b-4ee02ed19f72 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:37.916306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1a85f-e3c1-4185-a13b-4ee02ed19f72 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:37.923559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115d806-5746-42aa-a237-2cffe93ab304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:37.924952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d806-5746-42aa-a237-2cffe93ab304 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:37.925254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d806-5746-42aa-a237-2cffe93ab304 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:37.925538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d806-5746-42aa-a237-2cffe93ab304 admin admin] PATH_INFO: `/v3/projects/5df14ed7cd6f4539b7b4807a8fe1628f/users/dd825b8da7bf4d8daf0d6df94807f87d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:37.948660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115d806-5746-42aa-a237-2cffe93ab304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df14ed7cd6f4539b7b4807a8fe1628f, user_id=dd825b8da7bf4d8daf0d6df94807f87d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:37.951507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115d806-5746-42aa-a237-2cffe93ab304 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:37.993329 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2161/4315] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:37 2022] PUT /identity/v3/projects/5df14ed7cd6f4539b7b4807a8fe1628f/users/dd825b8da7bf4d8daf0d6df94807f87d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:38.003769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb190b6f-02fb-4f5b-9b99-16c932e520f1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:38.004612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb190b6f-02fb-4f5b-9b99-16c932e520f1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:38.005054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb190b6f-02fb-4f5b-9b99-16c932e520f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:38.064268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-eb190b6f-02fb-4f5b-9b99-16c932e520f1 None None] MFA Rules not processed for user `dd825b8da7bf4d8daf0d6df94807f87d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:38.065668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eb190b6f-02fb-4f5b-9b99-16c932e520f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:38.210914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115d806-5746-42aa-a237-2cffe93ab304 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:38.211213 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2155/4316] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:38.319149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:38.372077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115d806-5746-42aa-a237-2cffe93ab304 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:38.387923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb65963-0809-4703-be7d-2679d95c95d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:38.388491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb65963-0809-4703-be7d-2679d95c95d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:38.391140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb65963-0809-4703-be7d-2679d95c95d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:38.391469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb65963-0809-4703-be7d-2679d95c95d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:38.396280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb65963-0809-4703-be7d-2679d95c95d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:38.399755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb65963-0809-4703-be7d-2679d95c95d5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:38.481076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb190b6f-02fb-4f5b-9b99-16c932e520f1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:38.492644 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2162/4317] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:38 2022] POST /identity/v3/projects => generated 367 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:38.506768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb190b6f-02fb-4f5b-9b99-16c932e520f1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:38.640918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7666551-93b4-4431-9336-348eccae6c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:38.641621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7666551-93b4-4431-9336-348eccae6c4e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:38.642699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7666551-93b4-4431-9336-348eccae6c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:38.643065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7666551-93b4-4431-9336-348eccae6c4e admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:38.643675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7666551-93b4-4431-9336-348eccae6c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:38.651879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7666551-93b4-4431-9336-348eccae6c4e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:38.744786 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2156/4318] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:38 2022] POST /identity/v3/users => generated 290 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:38.746100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb65963-0809-4703-be7d-2679d95c95d5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:38.769327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb65963-0809-4703-be7d-2679d95c95d5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:38.792409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1f72d-f43c-452c-9842-464138149b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:38.795539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1f72d-f43c-452c-9842-464138149b63 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:38.795872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1f72d-f43c-452c-9842-464138149b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:38.798466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1f72d-f43c-452c-9842-464138149b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:38.802444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1f72d-f43c-452c-9842-464138149b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:38.808018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1f72d-f43c-452c-9842-464138149b63 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:38.846961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7666551-93b4-4431-9336-348eccae6c4e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:38.847322 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2163/4319] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:38.880048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7666551-93b4-4431-9336-348eccae6c4e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:38.896723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57d20-6e2d-467b-ac5d-fb00e8532c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:38.897843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57d20-6e2d-467b-ac5d-fb00e8532c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:38.898343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57d20-6e2d-467b-ac5d-fb00e8532c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:38.902950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b57d20-6e2d-467b-ac5d-fb00e8532c07 admin admin] PATH_INFO: `/v3/projects/72098cd5952c4f4a8901e3e054bea789/users/4672e86e05e64af6b2d1ae5871a04aa3/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:38.975913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b57d20-6e2d-467b-ac5d-fb00e8532c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72098cd5952c4f4a8901e3e054bea789, user_id=4672e86e05e64af6b2d1ae5871a04aa3, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:38.995045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b57d20-6e2d-467b-ac5d-fb00e8532c07 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:39.040184 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2157/4320] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:38 2022] PUT /identity/v3/projects/72098cd5952c4f4a8901e3e054bea789/users/4672e86e05e64af6b2d1ae5871a04aa3/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:39.045761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1f72d-f43c-452c-9842-464138149b63 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:39.061911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1f72d-f43c-452c-9842-464138149b63 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:39.174704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f8445-ec27-4c33-b553-4744befc9af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:39.175688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8445-ec27-4c33-b553-4744befc9af4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:39.176478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8445-ec27-4c33-b553-4744befc9af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:39.176986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8445-ec27-4c33-b553-4744befc9af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:39.177950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f8445-ec27-4c33-b553-4744befc9af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:39.179915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f8445-ec27-4c33-b553-4744befc9af4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:39.200445 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2164/4321] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:39.202013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57d20-6e2d-467b-ac5d-fb00e8532c07 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:39.254921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b57d20-6e2d-467b-ac5d-fb00e8532c07 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:39.292166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d429c66-dfca-40da-9077-fb912f26be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:39.293591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429c66-dfca-40da-9077-fb912f26be38 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:39.294328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429c66-dfca-40da-9077-fb912f26be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:39.295159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429c66-dfca-40da-9077-fb912f26be38 admin admin] PATH_INFO: `/v3/projects/72098cd5952c4f4a8901e3e054bea789/users/4672e86e05e64af6b2d1ae5871a04aa3/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:39.302734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d429c66-dfca-40da-9077-fb912f26be38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72098cd5952c4f4a8901e3e054bea789, user_id=4672e86e05e64af6b2d1ae5871a04aa3, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:39.323411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d429c66-dfca-40da-9077-fb912f26be38 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:39.396309 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2158/4322] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:39 2022] PUT /identity/v3/projects/72098cd5952c4f4a8901e3e054bea789/users/4672e86e05e64af6b2d1ae5871a04aa3/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:39.411776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be555-4f84-488b-a8ff-a23b0127b6eb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:39.412225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be555-4f84-488b-a8ff-a23b0127b6eb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:39.412668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be555-4f84-488b-a8ff-a23b0127b6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:39.556055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-959be555-4f84-488b-a8ff-a23b0127b6eb None None] MFA Rules not processed for user `4672e86e05e64af6b2d1ae5871a04aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:39.561532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-959be555-4f84-488b-a8ff-a23b0127b6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:39.568855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d429c66-dfca-40da-9077-fb912f26be38 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:39.572899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8d429c66-dfca-40da-9077-fb912f26be38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:39.789983 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2165/4323] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:39.793317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959be555-4f84-488b-a8ff-a23b0127b6eb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:39.822850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959be555-4f84-488b-a8ff-a23b0127b6eb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:39.835522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16849bbb-dba3-484a-8b19-520bc0be72b5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:39.836326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849bbb-dba3-484a-8b19-520bc0be72b5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:39.836626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849bbb-dba3-484a-8b19-520bc0be72b5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:39.842270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849bbb-dba3-484a-8b19-520bc0be72b5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:39.843625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:39.844350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16849bbb-dba3-484a-8b19-520bc0be72b5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:39.847404 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-16849bbb-dba3-484a-8b19-520bc0be72b5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:39.847404 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:39.847404 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:39.857266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16849bbb-dba3-484a-8b19-520bc0be72b5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:39.900557 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2166/4324] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:07:39 2022] POST /identity/v3/roles => generated 235 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:39.908226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d429c66-dfca-40da-9077-fb912f26be38 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:39.915312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16849bbb-dba3-484a-8b19-520bc0be72b5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:39.935715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a0d62-5eb0-4037-9579-eaa660442ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:39.937491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a0d62-5eb0-4037-9579-eaa660442ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:39.937879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a0d62-5eb0-4037-9579-eaa660442ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:39.938240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a0d62-5eb0-4037-9579-eaa660442ce4 admin admin] PATH_INFO: `/v3/users/6e094f952a244065b0685e6136b441bd` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:39.944286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a0d62-5eb0-4037-9579-eaa660442ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e094f952a244065b0685e6136b441bd)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:39.955668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a0d62-5eb0-4037-9579-eaa660442ce4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:39.988017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16849bbb-dba3-484a-8b19-520bc0be72b5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:40.007022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f46c91-5ab7-48cf-9e6b-072a14b5c0f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:40.008125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f46c91-5ab7-48cf-9e6b-072a14b5c0f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:40.008804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f46c91-5ab7-48cf-9e6b-072a14b5c0f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:40.009311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f46c91-5ab7-48cf-9e6b-072a14b5c0f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:40.010232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f46c91-5ab7-48cf-9e6b-072a14b5c0f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:40.012264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f46c91-5ab7-48cf-9e6b-072a14b5c0f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:40.035926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:40.059375 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2167/4325] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:07:39 2022] POST /identity/v3/roles => generated 233 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:40.064854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f46c91-5ab7-48cf-9e6b-072a14b5c0f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:40.093472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f46c91-5ab7-48cf-9e6b-072a14b5c0f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:40.102108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d76e8-5778-4494-8719-a4110d96aa4d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:40.102984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d76e8-5778-4494-8719-a4110d96aa4d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:40.103561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d76e8-5778-4494-8719-a4110d96aa4d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:40.104327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d76e8-5778-4494-8719-a4110d96aa4d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:40.105251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d76e8-5778-4494-8719-a4110d96aa4d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:40.107516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d76e8-5778-4494-8719-a4110d96aa4d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:40.144383 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2168/4326] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:07:40 2022] POST /identity/v3/roles => generated 235 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:40.145484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d76e8-5778-4494-8719-a4110d96aa4d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:40.145946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d45a0d62-5eb0-4037-9579-eaa660442ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e094f952a244065b0685e6136b441bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:40.157352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d76e8-5778-4494-8719-a4110d96aa4d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:40.163128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d3231-96a0-4f51-b779-1df2dceb6424 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:40.163845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d3231-96a0-4f51-b779-1df2dceb6424 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:40.164311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d3231-96a0-4f51-b779-1df2dceb6424 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:40.164665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d3231-96a0-4f51-b779-1df2dceb6424 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:40.165420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d3231-96a0-4f51-b779-1df2dceb6424 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:40.167360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d3231-96a0-4f51-b779-1df2dceb6424 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:40.176751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d45a0d62-5eb0-4037-9579-eaa660442ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e094f952a244065b0685e6136b441bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:40.177982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d45a0d62-5eb0-4037-9579-eaa660442ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e094f952a244065b0685e6136b441bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:40.204763 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2169/4327] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:07:40 2022] POST /identity/v3/domains => generated 276 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:40.206893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d3231-96a0-4f51-b779-1df2dceb6424 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:40.215931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d45a0d62-5eb0-4037-9579-eaa660442ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e094f952a244065b0685e6136b441bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:40.217948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d45a0d62-5eb0-4037-9579-eaa660442ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e094f952a244065b0685e6136b441bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:40.249444 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2159/4328] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:39 2022] DELETE /identity/v3/users/6e094f952a244065b0685e6136b441bd => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:40.251198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2275b-ce8e-4ddd-8a07-4f3376b75b6d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:40.251494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2275b-ce8e-4ddd-8a07-4f3376b75b6d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:40.251823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2275b-ce8e-4ddd-8a07-4f3376b75b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:40.300243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9be2275b-ce8e-4ddd-8a07-4f3376b75b6d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:40.306400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9be2275b-ce8e-4ddd-8a07-4f3376b75b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:40.404583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d3231-96a0-4f51-b779-1df2dceb6424 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:40.480452 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2160/4329] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:40.499756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2275b-ce8e-4ddd-8a07-4f3376b75b6d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:40.501186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9be2275b-ce8e-4ddd-8a07-4f3376b75b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:40.585263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528d2ac-e120-4194-a892-84c31bc38da2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:40.585753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d2ac-e120-4194-a892-84c31bc38da2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:40.586046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d2ac-e120-4194-a892-84c31bc38da2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:40.586354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d2ac-e120-4194-a892-84c31bc38da2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:40.586976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528d2ac-e120-4194-a892-84c31bc38da2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:40.588922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528d2ac-e120-4194-a892-84c31bc38da2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:40.684388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2275b-ce8e-4ddd-8a07-4f3376b75b6d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:40.693549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e0df7-530f-4879-9c34-7b343b6c5121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:40.695859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e0df7-530f-4879-9c34-7b343b6c5121 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:40.698231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e0df7-530f-4879-9c34-7b343b6c5121 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:40.698533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e0df7-530f-4879-9c34-7b343b6c5121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:40.720357 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2170/4330] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:40 2022] POST /identity/v3/projects => generated 400 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:40.721463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528d2ac-e120-4194-a892-84c31bc38da2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:40.725256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c528d2ac-e120-4194-a892-84c31bc38da2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:40.763021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e0df7-530f-4879-9c34-7b343b6c5121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:40.766920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e0df7-530f-4879-9c34-7b343b6c5121 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:40.807516 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2161/4331] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:07:40.905084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:40.921575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528d2ac-e120-4194-a892-84c31bc38da2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:40.934061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba38e8-e464-4374-bace-0b6ca771f8c8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:40.934905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba38e8-e464-4374-bace-0b6ca771f8c8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:40.935308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba38e8-e464-4374-bace-0b6ca771f8c8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:40.935588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba38e8-e464-4374-bace-0b6ca771f8c8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:40.937235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba38e8-e464-4374-bace-0b6ca771f8c8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:40.940901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba38e8-e464-4374-bace-0b6ca771f8c8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:41.015608 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2171/4332] 10.222.0.70 () {60 vars in 1147 bytes} [Sun Aug 28 19:07:40 2022] POST /identity/v3/groups => generated 301 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:41.017056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e0df7-530f-4879-9c34-7b343b6c5121 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:41.026715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:41.037149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e0df7-530f-4879-9c34-7b343b6c5121 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:41.051624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d5280-f155-47fe-82e1-5b30ecb848f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:41.052461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5280-f155-47fe-82e1-5b30ecb848f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:41.052752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5280-f155-47fe-82e1-5b30ecb848f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:41.053120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d5280-f155-47fe-82e1-5b30ecb848f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:41.053815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d5280-f155-47fe-82e1-5b30ecb848f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:41.057125 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-5d2d5280-f155-47fe-82e1-5b30ecb848f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:41.057125 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:41.057125 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:41.060618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d5280-f155-47fe-82e1-5b30ecb848f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:41.095157 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2162/4333] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:07:41 2022] POST /identity/v3/roles => generated 234 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:41.104714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba38e8-e464-4374-bace-0b6ca771f8c8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:41.158896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba38e8-e464-4374-bace-0b6ca771f8c8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:41.168108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f328e6a-4a58-4074-8548-3744fd6bc288 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:41.168913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328e6a-4a58-4074-8548-3744fd6bc288 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:41.169202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328e6a-4a58-4074-8548-3744fd6bc288 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:41.169476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f328e6a-4a58-4074-8548-3744fd6bc288 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:41.170136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f328e6a-4a58-4074-8548-3744fd6bc288 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:41.172223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f328e6a-4a58-4074-8548-3744fd6bc288 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:41.238029 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2172/4334] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:41 2022] POST /identity/v3/users => generated 439 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:41.239584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d5280-f155-47fe-82e1-5b30ecb848f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:41.261487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d5280-f155-47fe-82e1-5b30ecb848f5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:41.306210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb96a-e19b-4951-9378-fde733ec15ac tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:41.306866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb96a-e19b-4951-9378-fde733ec15ac tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:41.312715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb96a-e19b-4951-9378-fde733ec15ac tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:41.313061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb96a-e19b-4951-9378-fde733ec15ac tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:41.313988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fb96a-e19b-4951-9378-fde733ec15ac tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:41.314882 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-3d0fb96a-e19b-4951-9378-fde733ec15ac tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:41.314882 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:41.314882 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:41.315803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fb96a-e19b-4951-9378-fde733ec15ac tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:41.410701 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2163/4335] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:07:41 2022] POST /identity/v3/roles => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:41.416518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f328e6a-4a58-4074-8548-3744fd6bc288 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:41.448531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f328e6a-4a58-4074-8548-3744fd6bc288 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:41.476130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1427273-21e9-432b-9c2e-cc56e80fc219 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:41.477260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1427273-21e9-432b-9c2e-cc56e80fc219 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:41.477751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1427273-21e9-432b-9c2e-cc56e80fc219 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:41.478376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1427273-21e9-432b-9c2e-cc56e80fc219 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/31bbaf75fea14d92b1c900a585300287` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:41.558494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1427273-21e9-432b-9c2e-cc56e80fc219 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd39a0d41cb24cb0ac980bb9d4d23435, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3, role_id=31bbaf75fea14d92b1c900a585300287)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:41.573131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1427273-21e9-432b-9c2e-cc56e80fc219 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:41.669793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb96a-e19b-4951-9378-fde733ec15ac tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:41.682680 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2173/4336] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:41 2022] PUT /identity/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/31bbaf75fea14d92b1c900a585300287 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:41.685635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb96a-e19b-4951-9378-fde733ec15ac tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:41.810690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc98f52-40af-4103-ad32-b9f7e29ee8a3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:41.811356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc98f52-40af-4103-ad32-b9f7e29ee8a3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:41.814392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc98f52-40af-4103-ad32-b9f7e29ee8a3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:41.814392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc98f52-40af-4103-ad32-b9f7e29ee8a3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:41.814959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc98f52-40af-4103-ad32-b9f7e29ee8a3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Adding query filter params (scope.project.id=cd39a0d41cb24cb0ac980bb9d4d23435, user.id=1611c2c3d5284ffe8f3f5d9ae507e0e3) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:41.815903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1427273-21e9-432b-9c2e-cc56e80fc219 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:41.818317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f1427273-21e9-432b-9c2e-cc56e80fc219 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:41.825482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc98f52-40af-4103-ad32-b9f7e29ee8a3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:41.826585 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-0fc98f52-40af-4103-ad32-b9f7e29ee8a3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:41.826585 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:41.826585 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:41.836156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc98f52-40af-4103-ad32-b9f7e29ee8a3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:42.037757 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2164/4337] 10.222.0.70 () {58 vars in 1356 bytes} [Sun Aug 28 19:07:41 2022] GET /identity/v3/role_assignments?scope.project.id=cd39a0d41cb24cb0ac980bb9d4d23435&user.id=1611c2c3d5284ffe8f3f5d9ae507e0e3&effective => generated 228 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:07:42.045173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc98f52-40af-4103-ad32-b9f7e29ee8a3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:42.060668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1427273-21e9-432b-9c2e-cc56e80fc219 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:42.068175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc98f52-40af-4103-ad32-b9f7e29ee8a3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:42.073936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:42.074598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:42.075223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:42.075636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] PATH_INFO: `/v3/projects/5b07ce9dc6724276bd4a549882ed2f77` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:42.076893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b07ce9dc6724276bd4a549882ed2f77)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:42.078830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:42.083226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f32277-04a6-43aa-8b12-74343612e171 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:42.084498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f32277-04a6-43aa-8b12-74343612e171 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:42.085336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f32277-04a6-43aa-8b12-74343612e171 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:42.086964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f32277-04a6-43aa-8b12-74343612e171 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/31bbaf75fea14d92b1c900a585300287` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:42.092096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f32277-04a6-43aa-8b12-74343612e171 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd39a0d41cb24cb0ac980bb9d4d23435, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3, role_id=31bbaf75fea14d92b1c900a585300287)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:42.093047 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-e3f32277-04a6-43aa-8b12-74343612e171 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:42.093047 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:42.093047 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:42.097398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f32277-04a6-43aa-8b12-74343612e171 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:42.123534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3f32277-04a6-43aa-8b12-74343612e171 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role 31bbaf75fea14d92b1c900a585300287 was removed from user 1611c2c3d5284ffe8f3f5d9ae507e0e3 on project cd39a0d41cb24cb0ac980bb9d4d23435. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:42.123895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3f32277-04a6-43aa-8b12-74343612e171 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.125981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e3f32277-04a6-43aa-8b12-74343612e171 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.178892 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2165/4338] 10.222.0.70 () {58 vars in 1467 bytes} [Sun Aug 28 19:07:42 2022] DELETE /identity/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/31bbaf75fea14d92b1c900a585300287 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:42.180528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f32277-04a6-43aa-8b12-74343612e171 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:42.182339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e3f32277-04a6-43aa-8b12-74343612e171 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:42.303347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b07ce9dc6724276bd4a549882ed2f77', 'request_id': 'req-52307833-a42f-416c-a843-c0b702995226'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.329679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b07ce9dc6724276bd4a549882ed2f77', 'request_id': 'req-52307833-a42f-416c-a843-c0b702995226'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.358691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b07ce9dc6724276bd4a549882ed2f77', 'request_id': 'req-52307833-a42f-416c-a843-c0b702995226'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.418228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] The token cache is being invalidate because project 5b07ce9dc6724276bd4a549882ed2f77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:42.423275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.427342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.433772 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2174/4339] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:41 2022] DELETE /identity/v3/projects/5b07ce9dc6724276bd4a549882ed2f77 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:42.434673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:42.436157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:42.500399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f32277-04a6-43aa-8b12-74343612e171 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:42.577363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:42.591057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:42.630088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307833-a42f-416c-a843-c0b702995226 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:42.652823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:42.653605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:42.658118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:42.658532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] PATH_INFO: `/v3/users/d0ae70df540349d3b414bf85e8a238f2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:42.660158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ae70df540349d3b414bf85e8a238f2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:42.664826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:42.681442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d95ed-0df5-44e5-abff-f6fd00895550 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:42.682195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d95ed-0df5-44e5-abff-f6fd00895550 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:42.682869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d95ed-0df5-44e5-abff-f6fd00895550 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:42.682869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d95ed-0df5-44e5-abff-f6fd00895550 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/31bbaf75fea14d92b1c900a585300287` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:42.687851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d95ed-0df5-44e5-abff-f6fd00895550 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=31bbaf75fea14d92b1c900a585300287)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:42.689141 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-ab3d95ed-0df5-44e5-abff-f6fd00895550 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:42.689141 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:42.689141 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:42.690105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d95ed-0df5-44e5-abff-f6fd00895550 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:42.788110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ab3d95ed-0df5-44e5-abff-f6fd00895550 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role 31bbaf75fea14d92b1c900a585300287 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:42.796861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ab3d95ed-0df5-44e5-abff-f6fd00895550 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.799314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ab3d95ed-0df5-44e5-abff-f6fd00895550 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.806817 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2166/4340] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:42 2022] DELETE /identity/v3/roles/31bbaf75fea14d92b1c900a585300287 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:42.811776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d95ed-0df5-44e5-abff-f6fd00895550 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:42.814298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ab3d95ed-0df5-44e5-abff-f6fd00895550 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:42.834959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ae70df540349d3b414bf85e8a238f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.868568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ae70df540349d3b414bf85e8a238f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.876203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ae70df540349d3b414bf85e8a238f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.901073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ae70df540349d3b414bf85e8a238f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.901851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ae70df540349d3b414bf85e8a238f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:42.964391 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2175/4341] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:42 2022] DELETE /identity/v3/users/d0ae70df540349d3b414bf85e8a238f2 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:43.022500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d95ed-0df5-44e5-abff-f6fd00895550 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:43.210243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40d0a2-6a82-4706-856c-3bb353499a63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:43.211258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40d0a2-6a82-4706-856c-3bb353499a63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:43.211728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40d0a2-6a82-4706-856c-3bb353499a63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:43.212188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40d0a2-6a82-4706-856c-3bb353499a63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/c58ed1495e164205a2b6ae44571721e4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:43.214876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40d0a2-6a82-4706-856c-3bb353499a63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd39a0d41cb24cb0ac980bb9d4d23435, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3, role_id=c58ed1495e164205a2b6ae44571721e4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:43.217840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40d0a2-6a82-4706-856c-3bb353499a63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:43.263270 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2167/4342] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:42 2022] PUT /identity/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/c58ed1495e164205a2b6ae44571721e4 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:43.267719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:43.269515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:43.298827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb7b6a-425f-40e4-9551-119fcf6755e5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:43.474135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74805c-57df-474e-841d-bfd6bf5bf4e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:43.478185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74805c-57df-474e-841d-bfd6bf5bf4e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:43.481408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74805c-57df-474e-841d-bfd6bf5bf4e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:43.481871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74805c-57df-474e-841d-bfd6bf5bf4e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:43.485290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74805c-57df-474e-841d-bfd6bf5bf4e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:43.486460 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-9a74805c-57df-474e-841d-bfd6bf5bf4e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:43.486460 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:43.486460 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:43.495793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74805c-57df-474e-841d-bfd6bf5bf4e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:43.565315 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2176/4343] 10.222.0.70 () {60 vars in 1363 bytes} [Sun Aug 28 19:07:43 2022] PUT /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e => generated 519 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:43.570445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40d0a2-6a82-4706-856c-3bb353499a63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:43.588641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40d0a2-6a82-4706-856c-3bb353499a63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:43.718432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:43.823291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a276b7-22ba-4873-adac-6f37a457e859 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:43.826544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a276b7-22ba-4873-adac-6f37a457e859 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:43.839768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a276b7-22ba-4873-adac-6f37a457e859 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:43.841620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a276b7-22ba-4873-adac-6f37a457e859 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:43.871257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a276b7-22ba-4873-adac-6f37a457e859 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Adding query filter params (scope.project.id=cd39a0d41cb24cb0ac980bb9d4d23435, user.id=1611c2c3d5284ffe8f3f5d9ae507e0e3) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:43.874851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a276b7-22ba-4873-adac-6f37a457e859 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:43.878908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74805c-57df-474e-841d-bfd6bf5bf4e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:43.882568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a276b7-22ba-4873-adac-6f37a457e859 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:43.882980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9a74805c-57df-474e-841d-bfd6bf5bf4e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:44.031444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:44.076908 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2168/4344] 10.222.0.70 () {58 vars in 1356 bytes} [Sun Aug 28 19:07:43 2022] GET /identity/v3/role_assignments?scope.project.id=cd39a0d41cb24cb0ac980bb9d4d23435&user.id=1611c2c3d5284ffe8f3f5d9ae507e0e3&effective => generated 1061 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:44.088295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a276b7-22ba-4873-adac-6f37a457e859 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:44.098986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b2a276b7-22ba-4873-adac-6f37a457e859 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:44.212038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74805c-57df-474e-841d-bfd6bf5bf4e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:44.284975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cedfd-85dc-4a14-884b-ca017001d6ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:44.290593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cedfd-85dc-4a14-884b-ca017001d6ac service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:44.291643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cedfd-85dc-4a14-884b-ca017001d6ac service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:44.292182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cedfd-85dc-4a14-884b-ca017001d6ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:44.299334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c23cedfd-85dc-4a14-884b-ca017001d6ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:44.371899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cedfd-85dc-4a14-884b-ca017001d6ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:44.377655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cedfd-85dc-4a14-884b-ca017001d6ac service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:44.421301 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2177/4345] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:44.423154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cedfd-85dc-4a14-884b-ca017001d6ac service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:44.456708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cedfd-85dc-4a14-884b-ca017001d6ac service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:44.458286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a276b7-22ba-4873-adac-6f37a457e859 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:44.470321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:44.471200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:44.471486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:44.471763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d admin admin] PATH_INFO: `/v3/projects/e70adc8d7c0f4332b1e730498f34c72e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:44.480707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166948b-7250-4c95-bfce-3ce88d12c1c0 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:44.481010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70adc8d7c0f4332b1e730498f34c72e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:44.481757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166948b-7250-4c95-bfce-3ce88d12c1c0 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:44.483202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:44.483367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166948b-7250-4c95-bfce-3ce88d12c1c0 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:44.484897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166948b-7250-4c95-bfce-3ce88d12c1c0 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:44.493096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166948b-7250-4c95-bfce-3ce88d12c1c0 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:44.494774 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-3166948b-7250-4c95-bfce-3ce88d12c1c0 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:44.494774 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:44.494774 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:44.509226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166948b-7250-4c95-bfce-3ce88d12c1c0 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:44.543086 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2178/4346] 10.222.0.70 () {58 vars in 1347 bytes} [Sun Aug 28 19:07:44 2022] DELETE /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:44.545095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166948b-7250-4c95-bfce-3ce88d12c1c0 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:44.592745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70adc8d7c0f4332b1e730498f34c72e', 'request_id': 'req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:44.619476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70adc8d7c0f4332b1e730498f34c72e', 'request_id': 'req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:44.627930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70adc8d7c0f4332b1e730498f34c72e', 'request_id': 'req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:44.661093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d admin admin] The token cache is being invalidate because project e70adc8d7c0f4332b1e730498f34c72e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:44.661394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:44.664583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5f55b6a5-e8ea-48ba-b5f9-bb049a35af2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:44.672232 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2169/4347] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:44 2022] DELETE /identity/v3/projects/e70adc8d7c0f4332b1e730498f34c72e => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:44.674168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d08a6-522c-4c19-b28a-1dc277b4bd3d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:44.674624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d08a6-522c-4c19-b28a-1dc277b4bd3d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:44.675114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d08a6-522c-4c19-b28a-1dc277b4bd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:44.675471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166948b-7250-4c95-bfce-3ce88d12c1c0 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:44.759939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-315d08a6-522c-4c19-b28a-1dc277b4bd3d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:44.770263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-315d08a6-522c-4c19-b28a-1dc277b4bd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:44.841060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9c9b0-91ce-4fe8-a29a-fb6e9d62c517 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:44.841700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9c9b0-91ce-4fe8-a29a-fb6e9d62c517 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:44.842002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9c9b0-91ce-4fe8-a29a-fb6e9d62c517 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:44.842372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9c9b0-91ce-4fe8-a29a-fb6e9d62c517 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:44.843029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9c9b0-91ce-4fe8-a29a-fb6e9d62c517 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Adding query filter params (scope.project.id=cd39a0d41cb24cb0ac980bb9d4d23435, user.id=1611c2c3d5284ffe8f3f5d9ae507e0e3) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:44.843353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9c9b0-91ce-4fe8-a29a-fb6e9d62c517 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:44.845236 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-a7c9c9b0-91ce-4fe8-a29a-fb6e9d62c517 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:44.845236 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:44.845236 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:44.846799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:44.849258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9c9b0-91ce-4fe8-a29a-fb6e9d62c517 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:44.985736 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2179/4348] 10.222.0.70 () {58 vars in 1356 bytes} [Sun Aug 28 19:07:44 2022] GET /identity/v3/role_assignments?scope.project.id=cd39a0d41cb24cb0ac980bb9d4d23435&user.id=1611c2c3d5284ffe8f3f5d9ae507e0e3&effective => generated 577 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:44.991263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9c9b0-91ce-4fe8-a29a-fb6e9d62c517 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:44.995970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a7c9c9b0-91ce-4fe8-a29a-fb6e9d62c517 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:45.040174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9c9b0-91ce-4fe8-a29a-fb6e9d62c517 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:45.057357 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2170/4349] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:45.065363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b598b-c040-491c-9f5d-85ee7b3308f1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:45.065655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b598b-c040-491c-9f5d-85ee7b3308f1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:45.065938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b598b-c040-491c-9f5d-85ee7b3308f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:45.069773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dede70-5836-4d99-9d73-7a0d96fcae05 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:45.070458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dede70-5836-4d99-9d73-7a0d96fcae05 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:45.071806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dede70-5836-4d99-9d73-7a0d96fcae05 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:45.072106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dede70-5836-4d99-9d73-7a0d96fcae05 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:45.076318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dede70-5836-4d99-9d73-7a0d96fcae05 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:45.089581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dede70-5836-4d99-9d73-7a0d96fcae05 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-66dede70-5836-4d99-9d73-7a0d96fcae05 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] c58ed1495e164205a2b6ae44571721e4 does not imply 1b6f6c72f9914b42a9b5c8dc9177235e.: keystone.exception.ImpliedRoleNotFound: c58ed1495e164205a2b6ae44571721e4 does not imply 1b6f6c72f9914b42a9b5c8dc9177235e. Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = query.one() Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:07:45.127105 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 28 19:07:45.129593 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 28 19:07:45.131211 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 28 19:07:45.131211 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 28 19:07:45.131211 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 28 19:07:45.131211 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c58ed1495e164205a2b6ae44571721e4 does not imply 1b6f6c72f9914b42a9b5c8dc9177235e. Aug 28 19:07:45.131211 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:07:45.135287 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2180/4350] 10.222.0.70 () {58 vars in 1347 bytes} [Sun Aug 28 19:07:44 2022] DELETE /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e => generated 137 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:07:45.135398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-379b598b-c040-491c-9f5d-85ee7b3308f1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:45.135398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-379b598b-c040-491c-9f5d-85ee7b3308f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:45.136172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dede70-5836-4d99-9d73-7a0d96fcae05 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:45.157329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dede70-5836-4d99-9d73-7a0d96fcae05 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:45.162017 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2171/4351] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:45.166152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95a77-6f1c-47ba-9c82-eff6c594e75a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:45.167147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95a77-6f1c-47ba-9c82-eff6c594e75a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:45.167603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95a77-6f1c-47ba-9c82-eff6c594e75a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:45.168078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95a77-6f1c-47ba-9c82-eff6c594e75a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/c58ed1495e164205a2b6ae44571721e4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:45.169283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b598b-c040-491c-9f5d-85ee7b3308f1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:45.171219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f95a77-6f1c-47ba-9c82-eff6c594e75a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd39a0d41cb24cb0ac980bb9d4d23435, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3, role_id=c58ed1495e164205a2b6ae44571721e4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:45.172276 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-78f95a77-6f1c-47ba-9c82-eff6c594e75a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:45.172276 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:45.172276 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:45.175346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f95a77-6f1c-47ba-9c82-eff6c594e75a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:45.193197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-78f95a77-6f1c-47ba-9c82-eff6c594e75a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role c58ed1495e164205a2b6ae44571721e4 was removed from user 1611c2c3d5284ffe8f3f5d9ae507e0e3 on project cd39a0d41cb24cb0ac980bb9d4d23435. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:45.193572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-78f95a77-6f1c-47ba-9c82-eff6c594e75a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:45.194108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b598b-c040-491c-9f5d-85ee7b3308f1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:45.194361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-78f95a77-6f1c-47ba-9c82-eff6c594e75a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:45.205619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423478b7-7537-44b9-974e-00e96b31b955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:45.205977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423478b7-7537-44b9-974e-00e96b31b955 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:45.206221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423478b7-7537-44b9-974e-00e96b31b955 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:45.206527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423478b7-7537-44b9-974e-00e96b31b955 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:45.210387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423478b7-7537-44b9-974e-00e96b31b955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:45.210623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423478b7-7537-44b9-974e-00e96b31b955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:45.211261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:45.212894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423478b7-7537-44b9-974e-00e96b31b955 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:45.252340 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2181/4352] 10.222.0.70 () {58 vars in 1467 bytes} [Sun Aug 28 19:07:45 2022] DELETE /identity/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/c58ed1495e164205a2b6ae44571721e4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:45.253436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2172/4353] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:45.258006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95a77-6f1c-47ba-9c82-eff6c594e75a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:45.260800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423478b7-7537-44b9-974e-00e96b31b955 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:45.261141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-78f95a77-6f1c-47ba-9c82-eff6c594e75a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:45.263361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-423478b7-7537-44b9-974e-00e96b31b955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:45.284386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423478b7-7537-44b9-974e-00e96b31b955 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:45.414204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cca24d-6335-42e9-a3ce-3fc289345047 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:45.416910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cca24d-6335-42e9-a3ce-3fc289345047 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:45.416910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cca24d-6335-42e9-a3ce-3fc289345047 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:45.416910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cca24d-6335-42e9-a3ce-3fc289345047 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:45.417542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cca24d-6335-42e9-a3ce-3fc289345047 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:45.429617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cca24d-6335-42e9-a3ce-3fc289345047 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:45.452786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95a77-6f1c-47ba-9c82-eff6c594e75a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:45.499426 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2173/4354] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:45 2022] POST /identity/v3/roles => generated 272 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:45.500065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50becfb-c0ca-43d0-b275-9c9a38229d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:45.500065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50becfb-c0ca-43d0-b275-9c9a38229d60 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:45.500065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50becfb-c0ca-43d0-b275-9c9a38229d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:45.500065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50becfb-c0ca-43d0-b275-9c9a38229d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:45.500506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50becfb-c0ca-43d0-b275-9c9a38229d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:45.500506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50becfb-c0ca-43d0-b275-9c9a38229d60 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:45.502839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cca24d-6335-42e9-a3ce-3fc289345047 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:45.526254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cca24d-6335-42e9-a3ce-3fc289345047 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:45.537965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542b06-d5d4-4f18-afe7-3c98f835d39e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:45.538245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542b06-d5d4-4f18-afe7-3c98f835d39e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:45.539831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542b06-d5d4-4f18-afe7-3c98f835d39e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:45.539831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542b06-d5d4-4f18-afe7-3c98f835d39e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:45.539831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef542b06-d5d4-4f18-afe7-3c98f835d39e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Adding query filter params (domain_id=30b84ff0d5de4968b8e775b86eca5371) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:45.540185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef542b06-d5d4-4f18-afe7-3c98f835d39e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:45.541733 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2182/4355] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:45 2022] POST /identity/v3/projects => generated 391 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:45.543768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50becfb-c0ca-43d0-b275-9c9a38229d60 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:45.544214 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-ef542b06-d5d4-4f18-afe7-3c98f835d39e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:45.544214 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:45.544214 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:45.545984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef542b06-d5d4-4f18-afe7-3c98f835d39e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:45.628301 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2174/4356] 10.222.0.70 () {58 vars in 1207 bytes} [Sun Aug 28 19:07:45 2022] GET /identity/v3/roles?domain_id=30b84ff0d5de4968b8e775b86eca5371 => generated 409 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:45.666637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542b06-d5d4-4f18-afe7-3c98f835d39e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:45.689326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542b06-d5d4-4f18-afe7-3c98f835d39e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:45.718442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50becfb-c0ca-43d0-b275-9c9a38229d60 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:45.726043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f25888-f788-4060-8346-fb2cf9c1fba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:45.728064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f25888-f788-4060-8346-fb2cf9c1fba5 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:45.728528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f25888-f788-4060-8346-fb2cf9c1fba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:45.728968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f25888-f788-4060-8346-fb2cf9c1fba5 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:45.729790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f25888-f788-4060-8346-fb2cf9c1fba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:45.732073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f25888-f788-4060-8346-fb2cf9c1fba5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:45.773456 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2183/4357] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:45 2022] POST /identity/v3/users => generated 296 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:45.777823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f25888-f788-4060-8346-fb2cf9c1fba5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:45.805430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f25888-f788-4060-8346-fb2cf9c1fba5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:45.814731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b12a-8776-483e-8d53-bef0c44afd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:45.815583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b12a-8776-483e-8d53-bef0c44afd08 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:45.815988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b12a-8776-483e-8d53-bef0c44afd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:45.816462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b12a-8776-483e-8d53-bef0c44afd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:45.819021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07b12a-8776-483e-8d53-bef0c44afd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:45.821130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07b12a-8776-483e-8d53-bef0c44afd08 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:45.846351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ca966-c20f-4235-986c-d08a1536f8ee tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:45.847041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ca966-c20f-4235-986c-d08a1536f8ee tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:45.847412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ca966-c20f-4235-986c-d08a1536f8ee tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:45.849201 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2184/4358] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:45 2022] GET /identity/v3/roles => generated 2321 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:07:45.855051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ca966-c20f-4235-986c-d08a1536f8ee tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/cf245bd9f3964e9d9b0602538385f67e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:45.857957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ca966-c20f-4235-986c-d08a1536f8ee tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=cf245bd9f3964e9d9b0602538385f67e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:45.862324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b12a-8776-483e-8d53-bef0c44afd08 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:45.878674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ca966-c20f-4235-986c-d08a1536f8ee tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:45.879060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b12a-8776-483e-8d53-bef0c44afd08 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:45.886595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe24c3-bb69-4a3f-95cd-b793100e751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:45.887591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe24c3-bb69-4a3f-95cd-b793100e751a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:45.888059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe24c3-bb69-4a3f-95cd-b793100e751a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:45.888509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe24c3-bb69-4a3f-95cd-b793100e751a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:45.889526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe24c3-bb69-4a3f-95cd-b793100e751a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:45.892968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe24c3-bb69-4a3f-95cd-b793100e751a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:45.940406 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2185/4359] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:45 2022] GET /identity/v3/roles => generated 2321 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:45.944768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe24c3-bb69-4a3f-95cd-b793100e751a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:45.970287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe24c3-bb69-4a3f-95cd-b793100e751a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:45.970528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:45.978603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da22f8-0eeb-4ce2-a8a1-a93adc86cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:45.981238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da22f8-0eeb-4ce2-a8a1-a93adc86cb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:45.982985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da22f8-0eeb-4ce2-a8a1-a93adc86cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:45.983660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da22f8-0eeb-4ce2-a8a1-a93adc86cb1d admin admin] PATH_INFO: `/v3/projects/11fb80f2cd9640df94e83cc13edb4dae/users/6eccffc3a62940eba3bc0510fa7f862a/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:46.014573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da22f8-0eeb-4ce2-a8a1-a93adc86cb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11fb80f2cd9640df94e83cc13edb4dae, user_id=6eccffc3a62940eba3bc0510fa7f862a, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:46.022590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da22f8-0eeb-4ce2-a8a1-a93adc86cb1d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:46.051813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-436ca966-c20f-4235-986c-d08a1536f8ee tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role cf245bd9f3964e9d9b0602538385f67e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:46.052677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-436ca966-c20f-4235-986c-d08a1536f8ee tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:46.055431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-436ca966-c20f-4235-986c-d08a1536f8ee tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:46.056480 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2186/4360] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:45 2022] PUT /identity/v3/projects/11fb80f2cd9640df94e83cc13edb4dae/users/6eccffc3a62940eba3bc0510fa7f862a/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:46.068075 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2175/4361] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:45 2022] DELETE /identity/v3/roles/cf245bd9f3964e9d9b0602538385f67e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:46.072296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8441887-a848-4da2-84d8-9100dc70ca24 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:46.073104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8441887-a848-4da2-84d8-9100dc70ca24 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:46.073502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8441887-a848-4da2-84d8-9100dc70ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:46.077387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ca966-c20f-4235-986c-d08a1536f8ee tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:46.101153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-436ca966-c20f-4235-986c-d08a1536f8ee tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:46.196929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e8441887-a848-4da2-84d8-9100dc70ca24 None None] MFA Rules not processed for user `6eccffc3a62940eba3bc0510fa7f862a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:46.202567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e8441887-a848-4da2-84d8-9100dc70ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:46.232273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:46.302461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ca966-c20f-4235-986c-d08a1536f8ee tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:46.314257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0af84d-3a0e-4a48-bb51-2706b52a04b2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:46.315001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0af84d-3a0e-4a48-bb51-2706b52a04b2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:46.315535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0af84d-3a0e-4a48-bb51-2706b52a04b2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:46.316033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0af84d-3a0e-4a48-bb51-2706b52a04b2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:46.317133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0af84d-3a0e-4a48-bb51-2706b52a04b2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Adding query filter params (domain_id=30b84ff0d5de4968b8e775b86eca5371) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:46.317754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0af84d-3a0e-4a48-bb51-2706b52a04b2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:46.319633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0af84d-3a0e-4a48-bb51-2706b52a04b2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:46.340388 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2176/4362] 10.222.0.70 () {58 vars in 1207 bytes} [Sun Aug 28 19:07:46 2022] GET /identity/v3/roles?domain_id=30b84ff0d5de4968b8e775b86eca5371 => generated 148 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:46.344157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0af84d-3a0e-4a48-bb51-2706b52a04b2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:46.366201 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2187/4363] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:46.371630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0af84d-3a0e-4a48-bb51-2706b52a04b2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:46.372662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8441887-a848-4da2-84d8-9100dc70ca24 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:46.379613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e8441887-a848-4da2-84d8-9100dc70ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:46.404991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932ebb6-4d6b-4840-a82e-aff738d7683b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:46.405763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932ebb6-4d6b-4840-a82e-aff738d7683b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:46.405963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932ebb6-4d6b-4840-a82e-aff738d7683b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:46.406209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932ebb6-4d6b-4840-a82e-aff738d7683b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/cf245bd9f3964e9d9b0602538385f67e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:46.435471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932ebb6-4d6b-4840-a82e-aff738d7683b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-b932ebb6-4d6b-4840-a82e-aff738d7683b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Could not find role: cf245bd9f3964e9d9b0602538385f67e.: keystone.exception.RoleNotFound: Could not find role: cf245bd9f3964e9d9b0602538385f67e. Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Aug 28 19:07:46.448313 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:07:46.449425 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:07:46.451095 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:07:46.451095 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:07:46.451095 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:07:46.451095 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:07:46.451095 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 19:07:46.451095 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 19:07:46.451095 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 19:07:46.451095 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 19:07:46.451095 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 19:07:46.451095 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:07:46.451095 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: cf245bd9f3964e9d9b0602538385f67e. Aug 28 19:07:46.451095 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:07:46.459145 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2177/4364] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:46 2022] DELETE /identity/v3/roles/cf245bd9f3964e9d9b0602538385f67e => generated 110 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 19:07:46.460101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932ebb6-4d6b-4840-a82e-aff738d7683b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:46.481377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932ebb6-4d6b-4840-a82e-aff738d7683b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:46.500481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f5537-493e-490e-bb20-be028b2e100f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:46.501661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5537-493e-490e-bb20-be028b2e100f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:46.501960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5537-493e-490e-bb20-be028b2e100f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:46.502252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5537-493e-490e-bb20-be028b2e100f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains/30b84ff0d5de4968b8e775b86eca5371/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:46.523648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f5537-493e-490e-bb20-be028b2e100f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=30b84ff0d5de4968b8e775b86eca5371, group_id=350916fed7344dfd80a84ee2d5d730a0, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:46.526342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f5537-493e-490e-bb20-be028b2e100f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:46.581595 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2178/4365] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:46 2022] PUT /identity/v3/domains/30b84ff0d5de4968b8e775b86eca5371/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:46.587852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f5537-493e-490e-bb20-be028b2e100f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:46.602189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8441887-a848-4da2-84d8-9100dc70ca24 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:46.749541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16df23d-18f9-4b52-abda-190338fc742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:46.750189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16df23d-18f9-4b52-abda-190338fc742b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:46.750475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16df23d-18f9-4b52-abda-190338fc742b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:46.750774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16df23d-18f9-4b52-abda-190338fc742b admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:46.756860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16df23d-18f9-4b52-abda-190338fc742b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:46.769182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16df23d-18f9-4b52-abda-190338fc742b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:46.809435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f5537-493e-490e-bb20-be028b2e100f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:46.818614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9b994-957e-4ed9-8411-4c47d86f9bc7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:46.820235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9b994-957e-4ed9-8411-4c47d86f9bc7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:46.820599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9b994-957e-4ed9-8411-4c47d86f9bc7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:46.821411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9b994-957e-4ed9-8411-4c47d86f9bc7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains/30b84ff0d5de4968b8e775b86eca5371/groups/350916fed7344dfd80a84ee2d5d730a0/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:46.822955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9b994-957e-4ed9-8411-4c47d86f9bc7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=30b84ff0d5de4968b8e775b86eca5371, group_id=350916fed7344dfd80a84ee2d5d730a0)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:46.824200 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-6eb9b994-957e-4ed9-8411-4c47d86f9bc7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:46.824200 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:46.824200 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:46.826912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9b994-957e-4ed9-8411-4c47d86f9bc7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:46.852172 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2188/4366] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:46 2022] POST /identity/v3/projects => generated 391 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:46.856768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16df23d-18f9-4b52-abda-190338fc742b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:46.875168 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2179/4367] 10.222.0.70 () {58 vars in 1365 bytes} [Sun Aug 28 19:07:46 2022] GET /identity/v3/domains/30b84ff0d5de4968b8e775b86eca5371/groups/350916fed7344dfd80a84ee2d5d730a0/roles => generated 409 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:46.876307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9b994-957e-4ed9-8411-4c47d86f9bc7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:46.913706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9b994-957e-4ed9-8411-4c47d86f9bc7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:46.974516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:47.007171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16df23d-18f9-4b52-abda-190338fc742b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:47.023459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a60fa6-9054-4fdf-aaa0-c40a71bb9e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:47.024392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a60fa6-9054-4fdf-aaa0-c40a71bb9e93 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:47.025011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a60fa6-9054-4fdf-aaa0-c40a71bb9e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:47.025482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a60fa6-9054-4fdf-aaa0-c40a71bb9e93 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:47.026652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a60fa6-9054-4fdf-aaa0-c40a71bb9e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:47.029067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a60fa6-9054-4fdf-aaa0-c40a71bb9e93 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:47.077243 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2189/4368] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:46 2022] POST /identity/v3/users => generated 302 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:07:47.082505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a60fa6-9054-4fdf-aaa0-c40a71bb9e93 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:47.105312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a60fa6-9054-4fdf-aaa0-c40a71bb9e93 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:47.109176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:47.118604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359760f9-699e-463a-b46d-67304c7bce34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:47.120567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359760f9-699e-463a-b46d-67304c7bce34 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:47.120855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359760f9-699e-463a-b46d-67304c7bce34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:47.121181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359760f9-699e-463a-b46d-67304c7bce34 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:47.121944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359760f9-699e-463a-b46d-67304c7bce34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:47.131481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359760f9-699e-463a-b46d-67304c7bce34 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:47.145917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5233c8-834b-45ff-8ab0-57f7faf5970b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:47.148275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5233c8-834b-45ff-8ab0-57f7faf5970b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:47.148574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5233c8-834b-45ff-8ab0-57f7faf5970b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:47.148861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5233c8-834b-45ff-8ab0-57f7faf5970b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains/30b84ff0d5de4968b8e775b86eca5371/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:47.156417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5233c8-834b-45ff-8ab0-57f7faf5970b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=30b84ff0d5de4968b8e775b86eca5371, group_id=350916fed7344dfd80a84ee2d5d730a0, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:47.157129 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-ea5233c8-834b-45ff-8ab0-57f7faf5970b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:47.157129 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:47.157129 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:47.166882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5233c8-834b-45ff-8ab0-57f7faf5970b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:47.189543 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2190/4369] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:47 2022] GET /identity/v3/roles => generated 2321 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:07:47.189543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359760f9-699e-463a-b46d-67304c7bce34 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:47.190272 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2180/4370] 10.222.0.70 () {58 vars in 1465 bytes} [Sun Aug 28 19:07:46 2022] HEAD /identity/v3/domains/30b84ff0d5de4968b8e775b86eca5371/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:47.190272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5233c8-834b-45ff-8ab0-57f7faf5970b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:47.241478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359760f9-699e-463a-b46d-67304c7bce34 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:47.245299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5233c8-834b-45ff-8ab0-57f7faf5970b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:47.249692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653b6e4-566b-484c-b114-dc7770463f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:47.251183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a6936-fb04-445c-b99c-e2e65afbd625 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:47.251905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a6936-fb04-445c-b99c-e2e65afbd625 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:47.252173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a6936-fb04-445c-b99c-e2e65afbd625 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:47.252398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653b6e4-566b-484c-b114-dc7770463f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:47.252520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a6936-fb04-445c-b99c-e2e65afbd625 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains/30b84ff0d5de4968b8e775b86eca5371/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:47.252722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653b6e4-566b-484c-b114-dc7770463f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:47.252919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653b6e4-566b-484c-b114-dc7770463f7d admin admin] PATH_INFO: `/v3/projects/e870d49108cb488ca5cbe29d14b575cb/users/93193236cc864a70ac3fcb08104b824f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:47.255153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a6936-fb04-445c-b99c-e2e65afbd625 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=30b84ff0d5de4968b8e775b86eca5371, group_id=350916fed7344dfd80a84ee2d5d730a0, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:47.259435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a6936-fb04-445c-b99c-e2e65afbd625 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:47.267517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dc6a6936-fb04-445c-b99c-e2e65afbd625 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role 4acd0b736620450492196e7a6b0ec112 was removed from group 350916fed7344dfd80a84ee2d5d730a0 on domain 30b84ff0d5de4968b8e775b86eca5371. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:47.267876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dc6a6936-fb04-445c-b99c-e2e65afbd625 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:47.268830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dc6a6936-fb04-445c-b99c-e2e65afbd625 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:47.317952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653b6e4-566b-484c-b114-dc7770463f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e870d49108cb488ca5cbe29d14b575cb, user_id=93193236cc864a70ac3fcb08104b824f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:47.317952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653b6e4-566b-484c-b114-dc7770463f7d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:47.318981 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2181/4371] 10.222.0.70 () {58 vars in 1467 bytes} [Sun Aug 28 19:07:47 2022] DELETE /identity/v3/domains/30b84ff0d5de4968b8e775b86eca5371/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:47.321329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a6936-fb04-445c-b99c-e2e65afbd625 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:47.326393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dc6a6936-fb04-445c-b99c-e2e65afbd625 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:47.354348 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2191/4372] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:47 2022] PUT /identity/v3/projects/e870d49108cb488ca5cbe29d14b575cb/users/93193236cc864a70ac3fcb08104b824f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:47.358643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653b6e4-566b-484c-b114-dc7770463f7d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:47.361396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4653b6e4-566b-484c-b114-dc7770463f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:47.442979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a6936-fb04-445c-b99c-e2e65afbd625 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:47.520281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9095e2-bdc5-4c44-b5d9-028ba47c075c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:47.521059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9095e2-bdc5-4c44-b5d9-028ba47c075c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:47.521354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9095e2-bdc5-4c44-b5d9-028ba47c075c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:47.521756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9095e2-bdc5-4c44-b5d9-028ba47c075c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:47.524150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9095e2-bdc5-4c44-b5d9-028ba47c075c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd39a0d41cb24cb0ac980bb9d4d23435, group_id=350916fed7344dfd80a84ee2d5d730a0, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:47.528325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9095e2-bdc5-4c44-b5d9-028ba47c075c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:47.565998 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2182/4373] 10.222.0.70 () {60 vars in 1486 bytes} [Sun Aug 28 19:07:47 2022] PUT /identity/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:47.568224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccce30c-b376-4d3a-96ae-fb8271230ad1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:47.568515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccce30c-b376-4d3a-96ae-fb8271230ad1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:47.568898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccce30c-b376-4d3a-96ae-fb8271230ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:47.610860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4ccce30c-b376-4d3a-96ae-fb8271230ad1 None None] MFA Rules not processed for user `e8ac4ee4e0c047b9b415607fcf64ae74`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:47.613984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4ccce30c-b376-4d3a-96ae-fb8271230ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:47.628127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653b6e4-566b-484c-b114-dc7770463f7d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:47.740532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:47.746248 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2183/4374] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:47.750010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccce30c-b376-4d3a-96ae-fb8271230ad1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:47.752340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4ccce30c-b376-4d3a-96ae-fb8271230ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:47.756232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe78be4-5e7d-4bd8-b3c4-8f1913c7ab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:47.756867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78be4-5e7d-4bd8-b3c4-8f1913c7ab15 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:47.757154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78be4-5e7d-4bd8-b3c4-8f1913c7ab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:47.757495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78be4-5e7d-4bd8-b3c4-8f1913c7ab15 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:47.758156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe78be4-5e7d-4bd8-b3c4-8f1913c7ab15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:47.759887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe78be4-5e7d-4bd8-b3c4-8f1913c7ab15 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:47.773918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccce30c-b376-4d3a-96ae-fb8271230ad1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:47.774668 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2192/4375] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:47 2022] GET /identity/v3/roles => generated 2321 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:47.775803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe78be4-5e7d-4bd8-b3c4-8f1913c7ab15 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:47.783702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:47.784367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:47.784657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:47.784995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] PATH_INFO: `/v3/users/dfb0da7739064336a7b00f30bca3f28c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:47.790227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb0da7739064336a7b00f30bca3f28c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:47.795919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:47.846354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:47.881760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe78be4-5e7d-4bd8-b3c4-8f1913c7ab15 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:47.888146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb0da7739064336a7b00f30bca3f28c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:47.894028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc5f83-7603-4d1b-88de-73287bf3d0e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:47.895601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc5f83-7603-4d1b-88de-73287bf3d0e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:47.896108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc5f83-7603-4d1b-88de-73287bf3d0e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:47.896402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc5f83-7603-4d1b-88de-73287bf3d0e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/groups/350916fed7344dfd80a84ee2d5d730a0/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:47.901025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc5f83-7603-4d1b-88de-73287bf3d0e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_grants(project_id=cd39a0d41cb24cb0ac980bb9d4d23435, group_id=350916fed7344dfd80a84ee2d5d730a0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:47.901953 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-e2dc5f83-7603-4d1b-88de-73287bf3d0e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:47.901953 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:47.901953 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:47.904083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc5f83-7603-4d1b-88de-73287bf3d0e4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:47.907771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb0da7739064336a7b00f30bca3f28c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:47.908631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb0da7739064336a7b00f30bca3f28c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:47.924339 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2193/4376] 10.222.0.70 () {58 vars in 1368 bytes} [Sun Aug 28 19:07:47 2022] GET /identity/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/groups/350916fed7344dfd80a84ee2d5d730a0/roles => generated 410 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:47.926375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717e461-b03f-4a32-a1ca-cc7f0174a81e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:47.926720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717e461-b03f-4a32-a1ca-cc7f0174a81e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:47.927080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717e461-b03f-4a32-a1ca-cc7f0174a81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:47.930124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb0da7739064336a7b00f30bca3f28c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:47.930908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb0da7739064336a7b00f30bca3f28c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:47.959058 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2184/4377] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:47 2022] DELETE /identity/v3/users/dfb0da7739064336a7b00f30bca3f28c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:47.959058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:47.959387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:47.997178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e717e461-b03f-4a32-a1ca-cc7f0174a81e None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:48.001170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e717e461-b03f-4a32-a1ca-cc7f0174a81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:48.181137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ed521-fc7b-4158-810d-76f2aeb3bc2c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:48.193976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118e4d4-db57-4afb-8309-a8a30fe1b6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:48.194213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118e4d4-db57-4afb-8309-a8a30fe1b6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:48.194454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118e4d4-db57-4afb-8309-a8a30fe1b6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:48.194607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118e4d4-db57-4afb-8309-a8a30fe1b6b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:48.195288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118e4d4-db57-4afb-8309-a8a30fe1b6b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:48.197204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118e4d4-db57-4afb-8309-a8a30fe1b6b7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:48.200457 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2194/4378] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:07:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:48.201309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717e461-b03f-4a32-a1ca-cc7f0174a81e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:48.202855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e717e461-b03f-4a32-a1ca-cc7f0174a81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:48.237001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717e461-b03f-4a32-a1ca-cc7f0174a81e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:48.245373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d12b1e-211c-49ee-82b1-989c9c99c6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:48.246131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d12b1e-211c-49ee-82b1-989c9c99c6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:48.246539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d12b1e-211c-49ee-82b1-989c9c99c6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:48.246955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d12b1e-211c-49ee-82b1-989c9c99c6ed admin admin] PATH_INFO: `/v3/projects/e870d49108cb488ca5cbe29d14b575cb/users/93193236cc864a70ac3fcb08104b824f/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:48.248988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d12b1e-211c-49ee-82b1-989c9c99c6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e870d49108cb488ca5cbe29d14b575cb, user_id=93193236cc864a70ac3fcb08104b824f, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:48.253329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d12b1e-211c-49ee-82b1-989c9c99c6ed admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:48.268644 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2185/4379] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:47 2022] POST /identity/v3/projects => generated 379 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:48.268644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118e4d4-db57-4afb-8309-a8a30fe1b6b7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:48.271269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6118e4d4-db57-4afb-8309-a8a30fe1b6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:48.290721 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2195/4380] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:48 2022] PUT /identity/v3/projects/e870d49108cb488ca5cbe29d14b575cb/users/93193236cc864a70ac3fcb08104b824f/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:48.291925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d12b1e-211c-49ee-82b1-989c9c99c6ed admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:48.296689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-46d12b1e-211c-49ee-82b1-989c9c99c6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:48.452973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:48.501255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118e4d4-db57-4afb-8309-a8a30fe1b6b7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:48.548393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d12b1e-211c-49ee-82b1-989c9c99c6ed admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:48.572384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346dadc-1953-495b-92f5-121f9315b946 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:48.572836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346dadc-1953-495b-92f5-121f9315b946 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:48.572976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346dadc-1953-495b-92f5-121f9315b946 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:48.573254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346dadc-1953-495b-92f5-121f9315b946 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:48.697840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:48.698430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6ffe2-5fbb-4b01-8d11-878e707497de tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:48.698694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6ffe2-5fbb-4b01-8d11-878e707497de tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:48.699249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6ffe2-5fbb-4b01-8d11-878e707497de tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:48.699707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6ffe2-5fbb-4b01-8d11-878e707497de tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/groups/350916fed7344dfd80a84ee2d5d730a0/users/1611c2c3d5284ffe8f3f5d9ae507e0e3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:48.709777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6ffe2-5fbb-4b01-8d11-878e707497de tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=350916fed7344dfd80a84ee2d5d730a0, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:48.713517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346dadc-1953-495b-92f5-121f9315b946 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:48.713742 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-26a6ffe2-5fbb-4b01-8d11-878e707497de tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:48.713742 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:48.713742 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:48.715239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346dadc-1953-495b-92f5-121f9315b946 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:48.716023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6ffe2-5fbb-4b01-8d11-878e707497de tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:48.745194 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2196/4381] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:07:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:07:48.746342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346dadc-1953-495b-92f5-121f9315b946 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:48.783695 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2186/4382] 10.222.0.70 () {60 vars in 1360 bytes} [Sun Aug 28 19:07:48 2022] PUT /identity/v3/groups/350916fed7344dfd80a84ee2d5d730a0/users/1611c2c3d5284ffe8f3f5d9ae507e0e3 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:48.788636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eef173-f8c6-4848-b459-ba15fcc1cffe None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:48.791116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eef173-f8c6-4848-b459-ba15fcc1cffe None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:48.791410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eef173-f8c6-4848-b459-ba15fcc1cffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:48.887641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-24eef173-f8c6-4848-b459-ba15fcc1cffe None None] MFA Rules not processed for user `93193236cc864a70ac3fcb08104b824f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:48.891022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-24eef173-f8c6-4848-b459-ba15fcc1cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:48.982362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346dadc-1953-495b-92f5-121f9315b946 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:49.039521 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2187/4383] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:49.040521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eef173-f8c6-4848-b459-ba15fcc1cffe None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:49.042534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-24eef173-f8c6-4848-b459-ba15fcc1cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:49.142563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eef173-f8c6-4848-b459-ba15fcc1cffe None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:49.165150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:49.167653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:49.168643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:49.169849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] PATH_INFO: `/v3/projects/d81d1eeb030c4c1a9ecc48ef98104c82` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:49.172984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81d1eeb030c4c1a9ecc48ef98104c82)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:49.177942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:49.189940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9ca16-9cae-4e7b-8758-a02603509126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:49.192222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9ca16-9cae-4e7b-8758-a02603509126 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:49.192523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9ca16-9cae-4e7b-8758-a02603509126 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:49.192800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9ca16-9cae-4e7b-8758-a02603509126 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:49.193476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9ca16-9cae-4e7b-8758-a02603509126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:49.199004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc9ca16-9cae-4e7b-8758-a02603509126 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:49.255805 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2197/4384] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:48 2022] POST /identity/v3/users => generated 296 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:49.255805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d8c45-28e0-4ff4-85c6-1ea1082aaaef None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:49.255805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d8c45-28e0-4ff4-85c6-1ea1082aaaef None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:49.255805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d8c45-28e0-4ff4-85c6-1ea1082aaaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:49.289348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:49.323985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0f5d8c45-28e0-4ff4-85c6-1ea1082aaaef None None] MFA Rules not processed for user `1611c2c3d5284ffe8f3f5d9ae507e0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:49.325442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0f5d8c45-28e0-4ff4-85c6-1ea1082aaaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:49.366522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81d1eeb030c4c1a9ecc48ef98104c82', 'request_id': 'req-4bebba31-60cf-4689-b416-b6ebf787b82c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:49.381331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81d1eeb030c4c1a9ecc48ef98104c82', 'request_id': 'req-4bebba31-60cf-4689-b416-b6ebf787b82c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:49.390060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81d1eeb030c4c1a9ecc48ef98104c82', 'request_id': 'req-4bebba31-60cf-4689-b416-b6ebf787b82c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:49.407694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] The token cache is being invalidate because project d81d1eeb030c4c1a9ecc48ef98104c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:49.407694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:49.407694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:49.409371 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2188/4385] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:07:49 2022] DELETE /identity/v3/projects/d81d1eeb030c4c1a9ecc48ef98104c82 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:49.414013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:49.414013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:49.470867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:49.510044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebba31-60cf-4689-b416-b6ebf787b82c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:49.516905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471f2f1-fff9-49d0-9b6b-7f48efb33244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:49.517897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471f2f1-fff9-49d0-9b6b-7f48efb33244 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:49.518186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471f2f1-fff9-49d0-9b6b-7f48efb33244 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:49.518518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471f2f1-fff9-49d0-9b6b-7f48efb33244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:49.521076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7471f2f1-fff9-49d0-9b6b-7f48efb33244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:49.540343 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2198/4386] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:49 2022] POST /identity/v3/auth/tokens => generated 3265 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:49.543364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d8c45-28e0-4ff4-85c6-1ea1082aaaef None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:49.545784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0f5d8c45-28e0-4ff4-85c6-1ea1082aaaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:49.578228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d8c45-28e0-4ff4-85c6-1ea1082aaaef None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:49.675241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471f2f1-fff9-49d0-9b6b-7f48efb33244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:49.678843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471f2f1-fff9-49d0-9b6b-7f48efb33244 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:49.694087 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2189/4387] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:49 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:49.716580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab045779-f0ee-4558-b1f2-0f33c9891090 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:49.716580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab045779-f0ee-4558-b1f2-0f33c9891090 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:49.716580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab045779-f0ee-4558-b1f2-0f33c9891090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:49.735390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025270a-5b2d-4922-a939-8a72b141f252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:49.737189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025270a-5b2d-4922-a939-8a72b141f252 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:49.738806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025270a-5b2d-4922-a939-8a72b141f252 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:49.739358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025270a-5b2d-4922-a939-8a72b141f252 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:49.740352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025270a-5b2d-4922-a939-8a72b141f252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:49.742247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025270a-5b2d-4922-a939-8a72b141f252 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:49.756565 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2199/4388] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:49 2022] GET /identity/v3/roles => generated 2321 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:49.757841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025270a-5b2d-4922-a939-8a72b141f252 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:49.759956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0025270a-5b2d-4922-a939-8a72b141f252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:49.776249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ab045779-f0ee-4558-b1f2-0f33c9891090 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:49.776758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ab045779-f0ee-4558-b1f2-0f33c9891090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:49.789754 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2190/4389] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:49.791481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e53cf1-fc9a-403e-8e20-44980b5da074 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:49.791922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e53cf1-fc9a-403e-8e20-44980b5da074 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:49.792209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e53cf1-fc9a-403e-8e20-44980b5da074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:49.821712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d6e53cf1-fc9a-403e-8e20-44980b5da074 None None] MFA Rules not processed for user `600512845bb7444b82f9fe99f1e51327`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:49.823417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d6e53cf1-fc9a-403e-8e20-44980b5da074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:49.884983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:49.916397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025270a-5b2d-4922-a939-8a72b141f252 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:49.930773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829abb-95e1-4479-8174-0c49e2026a32 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:49.931027 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2191/4390] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:49.931994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e53cf1-fc9a-403e-8e20-44980b5da074 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:49.945816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829abb-95e1-4479-8174-0c49e2026a32 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:49.947062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829abb-95e1-4479-8174-0c49e2026a32 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:49.947062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829abb-95e1-4479-8174-0c49e2026a32 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:49.954521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54829abb-95e1-4479-8174-0c49e2026a32 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:check_grant(project_id=cd39a0d41cb24cb0ac980bb9d4d23435, group_id=350916fed7344dfd80a84ee2d5d730a0, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:49.955672 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-54829abb-95e1-4479-8174-0c49e2026a32 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:49.955672 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:49.955672 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:49.957864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e53cf1-fc9a-403e-8e20-44980b5da074 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:49.958325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54829abb-95e1-4479-8174-0c49e2026a32 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:49.975025 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2200/4391] 10.222.0.70 () {58 vars in 1468 bytes} [Sun Aug 28 19:07:49 2022] HEAD /identity/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:49.981883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b61eed-4231-409f-a8bc-8910a5c3c441 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:49.981883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b61eed-4231-409f-a8bc-8910a5c3c441 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:49.984920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa1d93-6817-4564-b5c0-7c2abfd0861b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:49.985609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa1d93-6817-4564-b5c0-7c2abfd0861b admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:49.985912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b61eed-4231-409f-a8bc-8910a5c3c441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:49.988560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa1d93-6817-4564-b5c0-7c2abfd0861b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:49.989012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa1d93-6817-4564-b5c0-7c2abfd0861b admin admin] PATH_INFO: `/v3/projects/71c6a02231f84b38ba6e2eb4ab578707/users/b78fc23d55064b56873795fe500e822e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:50.029941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa1d93-6817-4564-b5c0-7c2abfd0861b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c6a02231f84b38ba6e2eb4ab578707, user_id=b78fc23d55064b56873795fe500e822e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:50.033362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa1d93-6817-4564-b5c0-7c2abfd0861b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:50.033557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-43b61eed-4231-409f-a8bc-8910a5c3c441 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:50.035317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-43b61eed-4231-409f-a8bc-8910a5c3c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:50.045461 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2201/4392] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:50.046438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b61eed-4231-409f-a8bc-8910a5c3c441 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:50.072703 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2192/4393] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:49 2022] PUT /identity/v3/projects/71c6a02231f84b38ba6e2eb4ab578707/users/b78fc23d55064b56873795fe500e822e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:50.073669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa1d93-6817-4564-b5c0-7c2abfd0861b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:50.079266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b61eed-4231-409f-a8bc-8910a5c3c441 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:50.192221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6ea63-923a-4901-ba27-5afb90c434bd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:50.193327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6ea63-923a-4901-ba27-5afb90c434bd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:50.193924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6ea63-923a-4901-ba27-5afb90c434bd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:50.194574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6ea63-923a-4901-ba27-5afb90c434bd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:50.197741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6ea63-923a-4901-ba27-5afb90c434bd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd39a0d41cb24cb0ac980bb9d4d23435, group_id=350916fed7344dfd80a84ee2d5d730a0, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:50.200635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6ea63-923a-4901-ba27-5afb90c434bd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:50.204577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa1d93-6817-4564-b5c0-7c2abfd0861b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:50.211774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-78b6ea63-923a-4901-ba27-5afb90c434bd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role 4acd0b736620450492196e7a6b0ec112 was removed from group 350916fed7344dfd80a84ee2d5d730a0 on project cd39a0d41cb24cb0ac980bb9d4d23435. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:50.212082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-78b6ea63-923a-4901-ba27-5afb90c434bd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:50.213077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-78b6ea63-923a-4901-ba27-5afb90c434bd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:50.214506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dc696-8e71-4f21-a4cf-6ade2ed6605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:50.215775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dc696-8e71-4f21-a4cf-6ade2ed6605b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:50.216304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dc696-8e71-4f21-a4cf-6ade2ed6605b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:50.216745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dc696-8e71-4f21-a4cf-6ade2ed6605b admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:50.217594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dc696-8e71-4f21-a4cf-6ade2ed6605b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:07:50.218827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dc696-8e71-4f21-a4cf-6ade2ed6605b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:50.221113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dc696-8e71-4f21-a4cf-6ade2ed6605b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:50.234656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:50.248927 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2193/4395] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:50.249088 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2202/4395] 10.222.0.70 () {58 vars in 1470 bytes} [Sun Aug 28 19:07:50 2022] DELETE /identity/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:50.249947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dc696-8e71-4f21-a4cf-6ade2ed6605b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:50.251754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-367dc696-8e71-4f21-a4cf-6ade2ed6605b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:50.252070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6ea63-923a-4901-ba27-5afb90c434bd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:50.255450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-78b6ea63-923a-4901-ba27-5afb90c434bd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:50.266330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dc696-8e71-4f21-a4cf-6ade2ed6605b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:50.380873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6ea63-923a-4901-ba27-5afb90c434bd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:50.386719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf591b-f3e9-4eea-91aa-3220f5a15e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:50.387453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf591b-f3e9-4eea-91aa-3220f5a15e28 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:50.387700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf591b-f3e9-4eea-91aa-3220f5a15e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:50.387897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf591b-f3e9-4eea-91aa-3220f5a15e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:50.388629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf591b-f3e9-4eea-91aa-3220f5a15e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:50.390503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf591b-f3e9-4eea-91aa-3220f5a15e28 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:50.422486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bed518-ddcc-40e1-9a36-f3d9d14b3278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:50.423291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bed518-ddcc-40e1-9a36-f3d9d14b3278 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:50.423606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bed518-ddcc-40e1-9a36-f3d9d14b3278 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:50.424973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bed518-ddcc-40e1-9a36-f3d9d14b3278 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:50.427608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bed518-ddcc-40e1-9a36-f3d9d14b3278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:50.431346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bed518-ddcc-40e1-9a36-f3d9d14b3278 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:50.434091 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2203/4396] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:07:50 2022] POST /identity/v3/projects => generated 391 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:50.435085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf591b-f3e9-4eea-91aa-3220f5a15e28 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:50.437512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d4cf591b-f3e9-4eea-91aa-3220f5a15e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:50.452491 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2194/4397] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:50 2022] GET /identity/v3/roles => generated 2321 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:50.453481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bed518-ddcc-40e1-9a36-f3d9d14b3278 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:50.470353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bed518-ddcc-40e1-9a36-f3d9d14b3278 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:50.532336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf591b-f3e9-4eea-91aa-3220f5a15e28 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:50.548424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062150e0-64f2-4413-b77b-cac88d3e4bcb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:50.550163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062150e0-64f2-4413-b77b-cac88d3e4bcb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:50.551614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062150e0-64f2-4413-b77b-cac88d3e4bcb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:50.553020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062150e0-64f2-4413-b77b-cac88d3e4bcb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/groups/350916fed7344dfd80a84ee2d5d730a0/users/1611c2c3d5284ffe8f3f5d9ae507e0e3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:50.555392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062150e0-64f2-4413-b77b-cac88d3e4bcb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=350916fed7344dfd80a84ee2d5d730a0, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:50.557553 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-062150e0-64f2-4413-b77b-cac88d3e4bcb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:50.557553 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:50.557553 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:50.560252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062150e0-64f2-4413-b77b-cac88d3e4bcb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:50.573698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:50.591334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-062150e0-64f2-4413-b77b-cac88d3e4bcb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1611c2c3d5284ffe8f3f5d9ae507e0e3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:50.600719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dc506-ed69-4f4b-bc1e-95997db8a039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:50.601575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dc506-ed69-4f4b-bc1e-95997db8a039 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:50.601974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dc506-ed69-4f4b-bc1e-95997db8a039 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:50.602374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dc506-ed69-4f4b-bc1e-95997db8a039 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:50.603498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dc506-ed69-4f4b-bc1e-95997db8a039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:50.605776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dc506-ed69-4f4b-bc1e-95997db8a039 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:50.623631 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2204/4398] 10.222.0.70 () {58 vars in 1344 bytes} [Sun Aug 28 19:07:50 2022] DELETE /identity/v3/groups/350916fed7344dfd80a84ee2d5d730a0/users/1611c2c3d5284ffe8f3f5d9ae507e0e3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:50.623631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062150e0-64f2-4413-b77b-cac88d3e4bcb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:50.650537 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2195/4399] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:07:50 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:50.651847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dc506-ed69-4f4b-bc1e-95997db8a039 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:50.671258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dc506-ed69-4f4b-bc1e-95997db8a039 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:50.753337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062150e0-64f2-4413-b77b-cac88d3e4bcb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:50.759363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e6718-19c1-4b8d-80ad-e098b87fa5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:50.760065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e6718-19c1-4b8d-80ad-e098b87fa5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:50.760363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e6718-19c1-4b8d-80ad-e098b87fa5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:50.760656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e6718-19c1-4b8d-80ad-e098b87fa5f9 admin admin] PATH_INFO: `/v3/projects/71c6a02231f84b38ba6e2eb4ab578707/users/b78fc23d55064b56873795fe500e822e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:50.763173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e6718-19c1-4b8d-80ad-e098b87fa5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c6a02231f84b38ba6e2eb4ab578707, user_id=b78fc23d55064b56873795fe500e822e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:50.767028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e6718-19c1-4b8d-80ad-e098b87fa5f9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:50.782291 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2205/4400] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:50 2022] PUT /identity/v3/projects/71c6a02231f84b38ba6e2eb4ab578707/users/b78fc23d55064b56873795fe500e822e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:50.783812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e6718-19c1-4b8d-80ad-e098b87fa5f9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:50.793227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee0c73-e8fb-4d22-b14b-93bbc6d063dc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:50.794522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee0c73-e8fb-4d22-b14b-93bbc6d063dc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:50.794844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee0c73-e8fb-4d22-b14b-93bbc6d063dc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:50.795139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee0c73-e8fb-4d22-b14b-93bbc6d063dc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/system/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:50.800499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee0c73-e8fb-4d22-b14b-93bbc6d063dc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=350916fed7344dfd80a84ee2d5d730a0, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:50.815224 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-0aee0c73-e8fb-4d22-b14b-93bbc6d063dc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:50.815224 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:50.815224 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:50.815224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee0c73-e8fb-4d22-b14b-93bbc6d063dc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:50.815754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:50.839582 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2196/4401] 10.222.0.70 () {60 vars in 1381 bytes} [Sun Aug 28 19:07:50 2022] PUT /identity/v3/system/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:50.849063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee0c73-e8fb-4d22-b14b-93bbc6d063dc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:50.867692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee0c73-e8fb-4d22-b14b-93bbc6d063dc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:50.949086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e6718-19c1-4b8d-80ad-e098b87fa5f9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:50.955147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cc501-b7f8-45dd-810e-324d95e4dbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:50.955959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cc501-b7f8-45dd-810e-324d95e4dbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:50.956099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cc501-b7f8-45dd-810e-324d95e4dbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:50.956309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cc501-b7f8-45dd-810e-324d95e4dbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:50.957661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cc501-b7f8-45dd-810e-324d95e4dbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:50.960088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cc501-b7f8-45dd-810e-324d95e4dbe1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:50.977246 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2206/4402] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:50 2022] GET /identity/v3/roles => generated 2321 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:50.979375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cc501-b7f8-45dd-810e-324d95e4dbe1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:50.996446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cc501-b7f8-45dd-810e-324d95e4dbe1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:51.002420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de21431-4a07-4d56-bc75-97f1445d8c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:51.003221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de21431-4a07-4d56-bc75-97f1445d8c1a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:51.003767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de21431-4a07-4d56-bc75-97f1445d8c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:51.003899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de21431-4a07-4d56-bc75-97f1445d8c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:51.005107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de21431-4a07-4d56-bc75-97f1445d8c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:51.007235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de21431-4a07-4d56-bc75-97f1445d8c1a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:51.027315 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2207/4403] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:50 2022] GET /identity/v3/roles => generated 2321 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:51.027573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe55c7b-0f6e-4aa5-b75e-cacc7e3e9233 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:51.027573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe55c7b-0f6e-4aa5-b75e-cacc7e3e9233 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:51.027573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe55c7b-0f6e-4aa5-b75e-cacc7e3e9233 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:51.028242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe55c7b-0f6e-4aa5-b75e-cacc7e3e9233 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/system/groups/350916fed7344dfd80a84ee2d5d730a0/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:51.028858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe55c7b-0f6e-4aa5-b75e-cacc7e3e9233 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=350916fed7344dfd80a84ee2d5d730a0)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:51.030295 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-ebe55c7b-0f6e-4aa5-b75e-cacc7e3e9233 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:51.030295 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:51.030295 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:51.031483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de21431-4a07-4d56-bc75-97f1445d8c1a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:51.031726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe55c7b-0f6e-4aa5-b75e-cacc7e3e9233 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:51.046679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de21431-4a07-4d56-bc75-97f1445d8c1a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:51.054129 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2197/4404] 10.222.0.70 () {58 vars in 1263 bytes} [Sun Aug 28 19:07:50 2022] GET /identity/v3/system/groups/350916fed7344dfd80a84ee2d5d730a0/roles => generated 375 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:07:51.054988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524917b-f6b0-4e1d-ab70-c76798ada124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:51.055837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524917b-f6b0-4e1d-ab70-c76798ada124 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:51.056251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524917b-f6b0-4e1d-ab70-c76798ada124 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:51.056628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524917b-f6b0-4e1d-ab70-c76798ada124 admin admin] PATH_INFO: `/v3/projects/b5c9c5750e2441de8ccdff6c714c08ba/users/9155e762ab8748539524b919f5ae6173/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:51.058590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe55c7b-0f6e-4aa5-b75e-cacc7e3e9233 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:51.073892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe55c7b-0f6e-4aa5-b75e-cacc7e3e9233 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:51.083548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524917b-f6b0-4e1d-ab70-c76798ada124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c9c5750e2441de8ccdff6c714c08ba, user_id=9155e762ab8748539524b919f5ae6173, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:51.087300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524917b-f6b0-4e1d-ab70-c76798ada124 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:51.088381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0592a93-2367-4bdd-ac19-1345923e459f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:51.088843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0592a93-2367-4bdd-ac19-1345923e459f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:51.089143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0592a93-2367-4bdd-ac19-1345923e459f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:51.089426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0592a93-2367-4bdd-ac19-1345923e459f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/system/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:51.093542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0592a93-2367-4bdd-ac19-1345923e459f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=350916fed7344dfd80a84ee2d5d730a0, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:51.094635 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-c0592a93-2367-4bdd-ac19-1345923e459f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:51.094635 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:51.094635 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:51.097240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0592a93-2367-4bdd-ac19-1345923e459f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:51.120523 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2198/4406] 10.222.0.70 () {58 vars in 1363 bytes} [Sun Aug 28 19:07:51 2022] HEAD /identity/v3/system/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:51.124552 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2208/4406] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:51 2022] PUT /identity/v3/projects/b5c9c5750e2441de8ccdff6c714c08ba/users/9155e762ab8748539524b919f5ae6173/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:51.125866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0592a93-2367-4bdd-ac19-1345923e459f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:51.130220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2bef-2212-49f5-a7dc-b318588188c8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:51.130648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2bef-2212-49f5-a7dc-b318588188c8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:51.131269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2bef-2212-49f5-a7dc-b318588188c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:51.148977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0592a93-2367-4bdd-ac19-1345923e459f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:51.186636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e88d2bef-2212-49f5-a7dc-b318588188c8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:51.188007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e88d2bef-2212-49f5-a7dc-b318588188c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:51.284202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3fcd4-98ce-4d47-925f-0c1b0648a27c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:51.285157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3fcd4-98ce-4d47-925f-0c1b0648a27c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:51.285668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3fcd4-98ce-4d47-925f-0c1b0648a27c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:51.286055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3fcd4-98ce-4d47-925f-0c1b0648a27c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/system/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:51.288365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3fcd4-98ce-4d47-925f-0c1b0648a27c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=350916fed7344dfd80a84ee2d5d730a0, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:51.289686 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-faf3fcd4-98ce-4d47-925f-0c1b0648a27c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:51.289686 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:51.289686 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:51.290908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3fcd4-98ce-4d47-925f-0c1b0648a27c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:51.293633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:51.320748 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2199/4407] 10.222.0.70 () {58 vars in 1365 bytes} [Sun Aug 28 19:07:51 2022] DELETE /identity/v3/system/groups/350916fed7344dfd80a84ee2d5d730a0/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:51.326512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3fcd4-98ce-4d47-925f-0c1b0648a27c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:51.339067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3fcd4-98ce-4d47-925f-0c1b0648a27c tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:51.345082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70aca-46e1-42a7-931f-70867c11db1a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:51.345789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70aca-46e1-42a7-931f-70867c11db1a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:51.346077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70aca-46e1-42a7-931f-70867c11db1a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:51.346359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70aca-46e1-42a7-931f-70867c11db1a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains/30b84ff0d5de4968b8e775b86eca5371/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:51.349423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b70aca-46e1-42a7-931f-70867c11db1a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=30b84ff0d5de4968b8e775b86eca5371, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:51.352419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b70aca-46e1-42a7-931f-70867c11db1a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:51.362701 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2209/4408] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:51.404211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2bef-2212-49f5-a7dc-b318588188c8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:51.404780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e88d2bef-2212-49f5-a7dc-b318588188c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:51.411525 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2200/4409] 10.222.0.70 () {60 vars in 1480 bytes} [Sun Aug 28 19:07:51 2022] PUT /identity/v3/domains/30b84ff0d5de4968b8e775b86eca5371/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:51.414302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70aca-46e1-42a7-931f-70867c11db1a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:51.538661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70aca-46e1-42a7-931f-70867c11db1a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:51.555693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d81a0-3321-4c38-a729-4b659fbaa3ed tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:51.556521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d81a0-3321-4c38-a729-4b659fbaa3ed tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:51.557093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d81a0-3321-4c38-a729-4b659fbaa3ed tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:51.557293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d81a0-3321-4c38-a729-4b659fbaa3ed tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains/30b84ff0d5de4968b8e775b86eca5371/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:51.559154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d81a0-3321-4c38-a729-4b659fbaa3ed tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=30b84ff0d5de4968b8e775b86eca5371, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:51.561722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d81a0-3321-4c38-a729-4b659fbaa3ed tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:51.595884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2bef-2212-49f5-a7dc-b318588188c8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:51.600626 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2201/4410] 10.222.0.70 () {58 vars in 1362 bytes} [Sun Aug 28 19:07:51 2022] GET /identity/v3/domains/30b84ff0d5de4968b8e775b86eca5371/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles => generated 408 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:51.606581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d81a0-3321-4c38-a729-4b659fbaa3ed tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:51.637321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d81a0-3321-4c38-a729-4b659fbaa3ed tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:51.641035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:51.653857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8bf4e-e76b-479e-87c7-d3c432f69e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:51.656555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8bf4e-e76b-479e-87c7-d3c432f69e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:51.658482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8bf4e-e76b-479e-87c7-d3c432f69e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:51.659185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8bf4e-e76b-479e-87c7-d3c432f69e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains/30b84ff0d5de4968b8e775b86eca5371/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:51.669641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8bf4e-e76b-479e-87c7-d3c432f69e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=30b84ff0d5de4968b8e775b86eca5371, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:51.674297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8bf4e-e76b-479e-87c7-d3c432f69e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:51.699321 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2202/4411] 10.222.0.70 () {58 vars in 1462 bytes} [Sun Aug 28 19:07:51 2022] HEAD /identity/v3/domains/30b84ff0d5de4968b8e775b86eca5371/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:51.700895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8bf4e-e76b-479e-87c7-d3c432f69e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:51.725278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8bf4e-e76b-479e-87c7-d3c432f69e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:51.738134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66be37-abc8-427c-8ae9-0351bf5f6a53 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:51.740045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66be37-abc8-427c-8ae9-0351bf5f6a53 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:51.740617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66be37-abc8-427c-8ae9-0351bf5f6a53 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:51.744058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66be37-abc8-427c-8ae9-0351bf5f6a53 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains/30b84ff0d5de4968b8e775b86eca5371/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:51.750107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66be37-abc8-427c-8ae9-0351bf5f6a53 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=30b84ff0d5de4968b8e775b86eca5371, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:51.750604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939532fb-5b21-49f8-bda6-759af3f2fe3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:51.751393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939532fb-5b21-49f8-bda6-759af3f2fe3d service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:51.751742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939532fb-5b21-49f8-bda6-759af3f2fe3d service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:51.752475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939532fb-5b21-49f8-bda6-759af3f2fe3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:51.759082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66be37-abc8-427c-8ae9-0351bf5f6a53 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:51.774857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8c66be37-abc8-427c-8ae9-0351bf5f6a53 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role 4acd0b736620450492196e7a6b0ec112 was removed from user 1611c2c3d5284ffe8f3f5d9ae507e0e3 on domain 30b84ff0d5de4968b8e775b86eca5371. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:51.775135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8c66be37-abc8-427c-8ae9-0351bf5f6a53 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:51.777537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8c66be37-abc8-427c-8ae9-0351bf5f6a53 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:51.809767 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2203/4412] 10.222.0.70 () {58 vars in 1464 bytes} [Sun Aug 28 19:07:51 2022] DELETE /identity/v3/domains/30b84ff0d5de4968b8e775b86eca5371/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:51.811391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66be37-abc8-427c-8ae9-0351bf5f6a53 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:51.814918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8c66be37-abc8-427c-8ae9-0351bf5f6a53 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:51.859204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939532fb-5b21-49f8-bda6-759af3f2fe3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:51.860782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939532fb-5b21-49f8-bda6-759af3f2fe3d service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:51.888228 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2210/4413] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:07:51.981039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66be37-abc8-427c-8ae9-0351bf5f6a53 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:52.003147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89141b-e84c-4cb1-b29a-b727a91ca90e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:52.007409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89141b-e84c-4cb1-b29a-b727a91ca90e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:52.007698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89141b-e84c-4cb1-b29a-b727a91ca90e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:52.008767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89141b-e84c-4cb1-b29a-b727a91ca90e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:52.022232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89141b-e84c-4cb1-b29a-b727a91ca90e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd39a0d41cb24cb0ac980bb9d4d23435, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:52.039639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89141b-e84c-4cb1-b29a-b727a91ca90e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:52.077818 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2204/4414] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:07:51 2022] PUT /identity/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:52.082754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939532fb-5b21-49f8-bda6-759af3f2fe3d service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:52.125135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939532fb-5b21-49f8-bda6-759af3f2fe3d service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:52.291548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c46258-3065-43b4-8324-22e1dd6ff716 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:52.292245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c46258-3065-43b4-8324-22e1dd6ff716 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:52.292560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c46258-3065-43b4-8324-22e1dd6ff716 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:52.292843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c46258-3065-43b4-8324-22e1dd6ff716 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:52.294732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c46258-3065-43b4-8324-22e1dd6ff716 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_grants(project_id=cd39a0d41cb24cb0ac980bb9d4d23435, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:52.297326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c46258-3065-43b4-8324-22e1dd6ff716 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:52.297518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89141b-e84c-4cb1-b29a-b727a91ca90e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:52.300316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6f89141b-e84c-4cb1-b29a-b727a91ca90e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:52.326087 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2211/4415] 10.222.0.70 () {58 vars in 1365 bytes} [Sun Aug 28 19:07:52 2022] GET /identity/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles => generated 409 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:52.327363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c46258-3065-43b4-8324-22e1dd6ff716 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:52.349888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c46258-3065-43b4-8324-22e1dd6ff716 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:52.362785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb916e49-b1b8-4426-a66d-7dc9e35533a7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:52.363511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb916e49-b1b8-4426-a66d-7dc9e35533a7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:52.363814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb916e49-b1b8-4426-a66d-7dc9e35533a7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:52.364083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb916e49-b1b8-4426-a66d-7dc9e35533a7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:52.370887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb916e49-b1b8-4426-a66d-7dc9e35533a7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:check_grant(project_id=cd39a0d41cb24cb0ac980bb9d4d23435, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:52.374390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb916e49-b1b8-4426-a66d-7dc9e35533a7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:52.396276 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2212/4416] 10.222.0.70 () {58 vars in 1465 bytes} [Sun Aug 28 19:07:52 2022] HEAD /identity/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:52.397687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb916e49-b1b8-4426-a66d-7dc9e35533a7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:52.410719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:52.420580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb916e49-b1b8-4426-a66d-7dc9e35533a7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:52.437061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d6d8b-8fe4-4b9a-8375-cf0ab54f976a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:52.437747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d6d8b-8fe4-4b9a-8375-cf0ab54f976a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:52.438036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d6d8b-8fe4-4b9a-8375-cf0ab54f976a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:52.438319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d6d8b-8fe4-4b9a-8375-cf0ab54f976a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:52.444344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d6d8b-8fe4-4b9a-8375-cf0ab54f976a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd39a0d41cb24cb0ac980bb9d4d23435, user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:52.447047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d6d8b-8fe4-4b9a-8375-cf0ab54f976a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:52.461062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-526d6d8b-8fe4-4b9a-8375-cf0ab54f976a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role 4acd0b736620450492196e7a6b0ec112 was removed from user 1611c2c3d5284ffe8f3f5d9ae507e0e3 on project cd39a0d41cb24cb0ac980bb9d4d23435. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:52.461377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-526d6d8b-8fe4-4b9a-8375-cf0ab54f976a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:52.463347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-526d6d8b-8fe4-4b9a-8375-cf0ab54f976a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:52.483882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89141b-e84c-4cb1-b29a-b727a91ca90e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:52.495200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed6a0a-b8c8-4c7a-9d18-5c3d0f0bbdb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:52.496187 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2213/4417] 10.222.0.70 () {58 vars in 1467 bytes} [Sun Aug 28 19:07:52 2022] DELETE /identity/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:52.496395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed6a0a-b8c8-4c7a-9d18-5c3d0f0bbdb7 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:52.496395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed6a0a-b8c8-4c7a-9d18-5c3d0f0bbdb7 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:52.497160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed6a0a-b8c8-4c7a-9d18-5c3d0f0bbdb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:52.500998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d6d8b-8fe4-4b9a-8375-cf0ab54f976a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:52.504598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-526d6d8b-8fe4-4b9a-8375-cf0ab54f976a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:52.504793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-70ed6a0a-b8c8-4c7a-9d18-5c3d0f0bbdb7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:52.531217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed6a0a-b8c8-4c7a-9d18-5c3d0f0bbdb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:52.534215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed6a0a-b8c8-4c7a-9d18-5c3d0f0bbdb7 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:52.562505 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2205/4418] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:52.674048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:52.721002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d6d8b-8fe4-4b9a-8375-cf0ab54f976a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:52.737694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2a217-05a7-4eb6-a13c-a65655a6ddc2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:52.740260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2a217-05a7-4eb6-a13c-a65655a6ddc2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:52.742898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2a217-05a7-4eb6-a13c-a65655a6ddc2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:52.743231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2a217-05a7-4eb6-a13c-a65655a6ddc2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/system/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:52.747696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2a217-05a7-4eb6-a13c-a65655a6ddc2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:52.750232 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-85c2a217-05a7-4eb6-a13c-a65655a6ddc2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:52.750232 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:52.750232 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:52.752929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2a217-05a7-4eb6-a13c-a65655a6ddc2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:52.773290 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2214/4419] 10.222.0.70 () {60 vars in 1378 bytes} [Sun Aug 28 19:07:52 2022] PUT /identity/v3/system/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:52.777615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed6a0a-b8c8-4c7a-9d18-5c3d0f0bbdb7 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:52.794868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed6a0a-b8c8-4c7a-9d18-5c3d0f0bbdb7 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:52.821225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8725ac-8083-4af3-a318-4f62a6a2c2d7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:52.821225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8725ac-8083-4af3-a318-4f62a6a2c2d7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:52.821547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8725ac-8083-4af3-a318-4f62a6a2c2d7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:52.821677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8725ac-8083-4af3-a318-4f62a6a2c2d7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/system/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:52.827650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8725ac-8083-4af3-a318-4f62a6a2c2d7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:52.831154 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-ed8725ac-8083-4af3-a318-4f62a6a2c2d7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:52.831154 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:52.831154 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:52.832624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8725ac-8083-4af3-a318-4f62a6a2c2d7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:52.887661 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2206/4420] 10.222.0.70 () {58 vars in 1260 bytes} [Sun Aug 28 19:07:52 2022] GET /identity/v3/system/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles => generated 374 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:52.888944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2a217-05a7-4eb6-a13c-a65655a6ddc2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:52.918158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2a217-05a7-4eb6-a13c-a65655a6ddc2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:52.928298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ad5fb-4637-4bfb-b045-e2baf3616d83 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:52.928997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ad5fb-4637-4bfb-b045-e2baf3616d83 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:52.929315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ad5fb-4637-4bfb-b045-e2baf3616d83 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:52.929643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ad5fb-4637-4bfb-b045-e2baf3616d83 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/system/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:52.935638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ad5fb-4637-4bfb-b045-e2baf3616d83 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:52.940638 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-ea0ad5fb-4637-4bfb-b045-e2baf3616d83 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:52.940638 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:52.940638 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:52.943510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ad5fb-4637-4bfb-b045-e2baf3616d83 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:52.955096 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2215/4421] 10.222.0.70 () {58 vars in 1360 bytes} [Sun Aug 28 19:07:52 2022] HEAD /identity/v3/system/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:52.959885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8725ac-8083-4af3-a318-4f62a6a2c2d7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:52.976210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8725ac-8083-4af3-a318-4f62a6a2c2d7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:52.996485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e224aed-7429-4bf9-9be3-ddebe6e92230 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:52.998484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e224aed-7429-4bf9-9be3-ddebe6e92230 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:52.999013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e224aed-7429-4bf9-9be3-ddebe6e92230 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:52.999209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e224aed-7429-4bf9-9be3-ddebe6e92230 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/system/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:53.002490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e224aed-7429-4bf9-9be3-ddebe6e92230 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3, role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:53.004022 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-6e224aed-7429-4bf9-9be3-ddebe6e92230 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:53.004022 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:53.004022 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:53.005168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e224aed-7429-4bf9-9be3-ddebe6e92230 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:53.028846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ad5fb-4637-4bfb-b045-e2baf3616d83 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:53.031623 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2207/4422] 10.222.0.70 () {58 vars in 1362 bytes} [Sun Aug 28 19:07:52 2022] DELETE /identity/v3/system/users/1611c2c3d5284ffe8f3f5d9ae507e0e3/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:53.046526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ad5fb-4637-4bfb-b045-e2baf3616d83 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:53.056358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb65a0-fb28-42a2-92e9-194af2da91fb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:53.058164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb65a0-fb28-42a2-92e9-194af2da91fb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:53.059200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb65a0-fb28-42a2-92e9-194af2da91fb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:53.059495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb65a0-fb28-42a2-92e9-194af2da91fb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:53.060282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb65a0-fb28-42a2-92e9-194af2da91fb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:53.064289 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-29bb65a0-fb28-42a2-92e9-194af2da91fb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:53.064289 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:53.064289 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:53.065158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb65a0-fb28-42a2-92e9-194af2da91fb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:53.104888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e224aed-7429-4bf9-9be3-ddebe6e92230 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:53.121007 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2216/4423] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:07:53 2022] POST /identity/v3/roles => generated 269 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:53.131024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e224aed-7429-4bf9-9be3-ddebe6e92230 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:53.145102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7965ca4-e703-4896-9fc0-42a6bc5665b6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:53.145779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7965ca4-e703-4896-9fc0-42a6bc5665b6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:53.146081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7965ca4-e703-4896-9fc0-42a6bc5665b6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:53.146368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7965ca4-e703-4896-9fc0-42a6bc5665b6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:53.149802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7965ca4-e703-4896-9fc0-42a6bc5665b6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:53.151737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7965ca4-e703-4896-9fc0-42a6bc5665b6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:53.229658 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2208/4424] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:07:53 2022] POST /identity/v3/roles => generated 270 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:53.233884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb65a0-fb28-42a2-92e9-194af2da91fb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:53.250670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb65a0-fb28-42a2-92e9-194af2da91fb tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:53.271857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d6ebd-168c-4369-a55d-6274fbec03ca tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:53.272536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d6ebd-168c-4369-a55d-6274fbec03ca tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:53.272821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d6ebd-168c-4369-a55d-6274fbec03ca tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:53.273101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d6ebd-168c-4369-a55d-6274fbec03ca tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e/implies/5060102db7ea4dfd90fd0facdbe25db7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:53.280443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d6ebd-168c-4369-a55d-6274fbec03ca tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7f27b6d4b6b8460aaecba6ada7ea4b7e, implied_role_id=5060102db7ea4dfd90fd0facdbe25db7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:53.282087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d6ebd-168c-4369-a55d-6274fbec03ca tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:53.338416 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2217/4425] 10.222.0.70 () {60 vars in 1363 bytes} [Sun Aug 28 19:07:53 2022] PUT /identity/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e/implies/5060102db7ea4dfd90fd0facdbe25db7 => generated 530 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:07:53.342413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7965ca4-e703-4896-9fc0-42a6bc5665b6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:53.360021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7965ca4-e703-4896-9fc0-42a6bc5665b6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:53.513018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f696-57e3-4745-8ea2-3564056b9c63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:53.513663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f696-57e3-4745-8ea2-3564056b9c63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:53.513954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f696-57e3-4745-8ea2-3564056b9c63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:53.516104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f696-57e3-4745-8ea2-3564056b9c63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:53.516813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99f696-57e3-4745-8ea2-3564056b9c63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:53.522870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99f696-57e3-4745-8ea2-3564056b9c63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:53.586488 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2209/4426] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:07:53 2022] POST /identity/v3/domains => generated 275 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:53.589536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d6ebd-168c-4369-a55d-6274fbec03ca tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:53.606312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d6ebd-168c-4369-a55d-6274fbec03ca tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:53.734100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05cdd9-a498-42ee-bbd8-2e2558f5b96d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:53.736736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05cdd9-a498-42ee-bbd8-2e2558f5b96d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:53.737789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05cdd9-a498-42ee-bbd8-2e2558f5b96d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:53.738303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05cdd9-a498-42ee-bbd8-2e2558f5b96d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:53.740609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05cdd9-a498-42ee-bbd8-2e2558f5b96d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:53.742672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05cdd9-a498-42ee-bbd8-2e2558f5b96d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:53.799700 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2218/4427] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:07:53 2022] POST /identity/v3/roles => generated 269 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:53.804829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f696-57e3-4745-8ea2-3564056b9c63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:53.830989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f696-57e3-4745-8ea2-3564056b9c63 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:53.843036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680cdc-37b9-49d7-be0b-c97ca88f4e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:53.844883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680cdc-37b9-49d7-be0b-c97ca88f4e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:53.846053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680cdc-37b9-49d7-be0b-c97ca88f4e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:53.847044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680cdc-37b9-49d7-be0b-c97ca88f4e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e/implies/2255145549714b578f6dcb7bb4afa894` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:53.854538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0680cdc-37b9-49d7-be0b-c97ca88f4e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7f27b6d4b6b8460aaecba6ada7ea4b7e, implied_role_id=2255145549714b578f6dcb7bb4afa894)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:53.855956 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-d0680cdc-37b9-49d7-be0b-c97ca88f4e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:53.855956 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:53.855956 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:53.859357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0680cdc-37b9-49d7-be0b-c97ca88f4e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:53.936121 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2210/4428] 10.222.0.70 () {60 vars in 1363 bytes} [Sun Aug 28 19:07:53 2022] PUT /identity/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e/implies/2255145549714b578f6dcb7bb4afa894 => generated 529 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:53.937225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05cdd9-a498-42ee-bbd8-2e2558f5b96d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:53.961518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05cdd9-a498-42ee-bbd8-2e2558f5b96d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:54.138226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01164f-118d-4163-bf6c-440ff3e3ef43 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:54.141254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01164f-118d-4163-bf6c-440ff3e3ef43 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:54.143190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01164f-118d-4163-bf6c-440ff3e3ef43 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:54.143509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01164f-118d-4163-bf6c-440ff3e3ef43 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e/implies/4acd0b736620450492196e7a6b0ec112` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:54.147060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01164f-118d-4163-bf6c-440ff3e3ef43 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=7f27b6d4b6b8460aaecba6ada7ea4b7e, implied_role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:54.149441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01164f-118d-4163-bf6c-440ff3e3ef43 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:54.210155 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2219/4429] 10.222.0.70 () {60 vars in 1363 bytes} [Sun Aug 28 19:07:53 2022] PUT /identity/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e/implies/4acd0b736620450492196e7a6b0ec112 => generated 524 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:54.214179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680cdc-37b9-49d7-be0b-c97ca88f4e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:54.234349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680cdc-37b9-49d7-be0b-c97ca88f4e54 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:54.347619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:54.357914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634d0c1-d563-4a5c-91b0-0b4e63451e73 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:54.359087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d0c1-d563-4a5c-91b0-0b4e63451e73 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:54.359733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d0c1-d563-4a5c-91b0-0b4e63451e73 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:54.360182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d0c1-d563-4a5c-91b0-0b4e63451e73 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/4acd0b736620450492196e7a6b0ec112/implies/7f27b6d4b6b8460aaecba6ada7ea4b7e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:54.362716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634d0c1-d563-4a5c-91b0-0b4e63451e73 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4acd0b736620450492196e7a6b0ec112, implied_role_id=7f27b6d4b6b8460aaecba6ada7ea4b7e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:54.366951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634d0c1-d563-4a5c-91b0-0b4e63451e73 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-e634d0c1-d563-4a5c-91b0-0b4e63451e73 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] 7f27b6d4b6b8460aaecba6ada7ea4b7e cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 7f27b6d4b6b8460aaecba6ada7ea4b7e cannot be an implied roles. Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Aug 28 19:07:54.403768 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Aug 28 19:07:54.405143 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:07:54.405143 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:07:54.405143 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Aug 28 19:07:54.405143 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Aug 28 19:07:54.405143 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 7f27b6d4b6b8460aaecba6ada7ea4b7e cannot be an implied roles. Aug 28 19:07:54.405143 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:07:54.407475 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2211/4430] 10.222.0.70 () {60 vars in 1363 bytes} [Sun Aug 28 19:07:54 2022] PUT /identity/v3/roles/4acd0b736620450492196e7a6b0ec112/implies/7f27b6d4b6b8460aaecba6ada7ea4b7e => generated 116 bytes in 194 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:07:54.412449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01164f-118d-4163-bf6c-440ff3e3ef43 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:54.420652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:54.429596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01164f-118d-4163-bf6c-440ff3e3ef43 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:54.437643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535edd54-1f69-4904-af45-19051b0dce16 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:54.438637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535edd54-1f69-4904-af45-19051b0dce16 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:54.439233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535edd54-1f69-4904-af45-19051b0dce16 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:54.439724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535edd54-1f69-4904-af45-19051b0dce16 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e/implies/4acd0b736620450492196e7a6b0ec112` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:54.443184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535edd54-1f69-4904-af45-19051b0dce16 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7f27b6d4b6b8460aaecba6ada7ea4b7e, implied_role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:54.445836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535edd54-1f69-4904-af45-19051b0dce16 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:54.471258 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2220/4431] 10.222.0.70 () {58 vars in 1347 bytes} [Sun Aug 28 19:07:54 2022] DELETE /identity/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e/implies/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:54.476144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634d0c1-d563-4a5c-91b0-0b4e63451e73 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:54.494203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634d0c1-d563-4a5c-91b0-0b4e63451e73 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:54.662473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342afc9d-2bb9-4479-881b-c8825953e56b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:54.663424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342afc9d-2bb9-4479-881b-c8825953e56b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:54.663914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342afc9d-2bb9-4479-881b-c8825953e56b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:54.664368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342afc9d-2bb9-4479-881b-c8825953e56b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e/implies/2255145549714b578f6dcb7bb4afa894` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:54.668587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342afc9d-2bb9-4479-881b-c8825953e56b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7f27b6d4b6b8460aaecba6ada7ea4b7e, implied_role_id=2255145549714b578f6dcb7bb4afa894)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:54.672959 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-342afc9d-2bb9-4479-881b-c8825953e56b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:54.672959 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:54.672959 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:54.675449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342afc9d-2bb9-4479-881b-c8825953e56b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:54.706535 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2212/4432] 10.222.0.70 () {58 vars in 1347 bytes} [Sun Aug 28 19:07:54 2022] DELETE /identity/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e/implies/2255145549714b578f6dcb7bb4afa894 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:54.710931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535edd54-1f69-4904-af45-19051b0dce16 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:54.729662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535edd54-1f69-4904-af45-19051b0dce16 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:54.880766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f5c6e-36c1-4ed2-bdc2-849c26da01e2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:54.882217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f5c6e-36c1-4ed2-bdc2-849c26da01e2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:54.882615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f5c6e-36c1-4ed2-bdc2-849c26da01e2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:54.883041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f5c6e-36c1-4ed2-bdc2-849c26da01e2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/2255145549714b578f6dcb7bb4afa894` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:54.884657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f5c6e-36c1-4ed2-bdc2-849c26da01e2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=2255145549714b578f6dcb7bb4afa894)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:54.886227 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-fb4f5c6e-36c1-4ed2-bdc2-849c26da01e2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:54.886227 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:54.886227 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:54.887545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f5c6e-36c1-4ed2-bdc2-849c26da01e2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:54.986327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb4f5c6e-36c1-4ed2-bdc2-849c26da01e2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role 2255145549714b578f6dcb7bb4afa894 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:54.987025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb4f5c6e-36c1-4ed2-bdc2-849c26da01e2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:54.987507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb4f5c6e-36c1-4ed2-bdc2-849c26da01e2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:54.997733 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2221/4433] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:54 2022] DELETE /identity/v3/roles/2255145549714b578f6dcb7bb4afa894 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:54.999079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342afc9d-2bb9-4479-881b-c8825953e56b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:55.001608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-342afc9d-2bb9-4479-881b-c8825953e56b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:55.036700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342afc9d-2bb9-4479-881b-c8825953e56b tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:55.166780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91017b5e-1ebe-45d2-9aec-7dc73fc69dfc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:55.167615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91017b5e-1ebe-45d2-9aec-7dc73fc69dfc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:55.168094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91017b5e-1ebe-45d2-9aec-7dc73fc69dfc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:55.170369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91017b5e-1ebe-45d2-9aec-7dc73fc69dfc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains/8d07ec0532394c4e84bac391f101df44` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:55.186711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91017b5e-1ebe-45d2-9aec-7dc73fc69dfc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8d07ec0532394c4e84bac391f101df44)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:55.190563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91017b5e-1ebe-45d2-9aec-7dc73fc69dfc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:55.225352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91017b5e-1ebe-45d2-9aec-7dc73fc69dfc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8d07ec0532394c4e84bac391f101df44'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.226485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91017b5e-1ebe-45d2-9aec-7dc73fc69dfc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8d07ec0532394c4e84bac391f101df44'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.285550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91017b5e-1ebe-45d2-9aec-7dc73fc69dfc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8d07ec0532394c4e84bac391f101df44'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.286703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91017b5e-1ebe-45d2-9aec-7dc73fc69dfc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8d07ec0532394c4e84bac391f101df44'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.294565 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2213/4434] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:07:54 2022] PATCH /identity/v3/domains/8d07ec0532394c4e84bac391f101df44 => generated 276 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:55.296798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f5c6e-36c1-4ed2-bdc2-849c26da01e2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:55.318160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f5c6e-36c1-4ed2-bdc2-849c26da01e2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:55.455397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:55.456395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:55.457556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:55.458335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains/8d07ec0532394c4e84bac391f101df44` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:55.474021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8d07ec0532394c4e84bac391f101df44)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:55.475945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:55.507743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8d07ec0532394c4e84bac391f101df44'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.512388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8d07ec0532394c4e84bac391f101df44'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.601986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:55.639493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d07ec0532394c4e84bac391f101df44', 'request_id': 'req-8827bdef-69b4-4946-8985-8309af6ad20d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.656870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d07ec0532394c4e84bac391f101df44', 'request_id': 'req-8827bdef-69b4-4946-8985-8309af6ad20d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.676993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d07ec0532394c4e84bac391f101df44', 'request_id': 'req-8827bdef-69b4-4946-8985-8309af6ad20d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.706073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] The token cache is being invalidate because project 8d07ec0532394c4e84bac391f101df44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:55.706416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.708365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.747814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8d07ec0532394c4e84bac391f101df44', 'request_id': 'req-8827bdef-69b4-4946-8985-8309af6ad20d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.749456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8d07ec0532394c4e84bac391f101df44', 'request_id': 'req-8827bdef-69b4-4946-8985-8309af6ad20d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.764408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8d07ec0532394c4e84bac391f101df44', 'request_id': 'req-8827bdef-69b4-4946-8985-8309af6ad20d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:55.780642 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2222/4435] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:07:55 2022] DELETE /identity/v3/domains/8d07ec0532394c4e84bac391f101df44 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:55.784926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91017b5e-1ebe-45d2-9aec-7dc73fc69dfc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:55.786875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-91017b5e-1ebe-45d2-9aec-7dc73fc69dfc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:55.833382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91017b5e-1ebe-45d2-9aec-7dc73fc69dfc tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:55.924683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:56.058761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bebf2c-832d-4aec-a848-6190d34cb733 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:56.060686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bebf2c-832d-4aec-a848-6190d34cb733 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:56.073979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bebf2c-832d-4aec-a848-6190d34cb733 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:56.074770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bebf2c-832d-4aec-a848-6190d34cb733 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e/implies/5060102db7ea4dfd90fd0facdbe25db7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:56.085070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bebf2c-832d-4aec-a848-6190d34cb733 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=7f27b6d4b6b8460aaecba6ada7ea4b7e, implied_role_id=5060102db7ea4dfd90fd0facdbe25db7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:56.093644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bebf2c-832d-4aec-a848-6190d34cb733 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:56.152459 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2214/4436] 10.222.0.70 () {58 vars in 1347 bytes} [Sun Aug 28 19:07:55 2022] DELETE /identity/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e/implies/5060102db7ea4dfd90fd0facdbe25db7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:56.153820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:56.156804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:56.221156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827bdef-69b4-4946-8985-8309af6ad20d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:56.482482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2fa34-ffe4-4c5d-ac28-50523f8e0aa3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:56.486420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2fa34-ffe4-4c5d-ac28-50523f8e0aa3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:56.486937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2fa34-ffe4-4c5d-ac28-50523f8e0aa3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:56.489768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2fa34-ffe4-4c5d-ac28-50523f8e0aa3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/5060102db7ea4dfd90fd0facdbe25db7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:56.502935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2fa34-ffe4-4c5d-ac28-50523f8e0aa3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=5060102db7ea4dfd90fd0facdbe25db7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:56.513968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2fa34-ffe4-4c5d-ac28-50523f8e0aa3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:56.713380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-52a2fa34-ffe4-4c5d-ac28-50523f8e0aa3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role 5060102db7ea4dfd90fd0facdbe25db7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:56.713830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-52a2fa34-ffe4-4c5d-ac28-50523f8e0aa3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:56.720295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-52a2fa34-ffe4-4c5d-ac28-50523f8e0aa3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:56.727868 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2223/4437] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:56 2022] DELETE /identity/v3/roles/5060102db7ea4dfd90fd0facdbe25db7 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:56.729720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bebf2c-832d-4aec-a848-6190d34cb733 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:56.732441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d1bebf2c-832d-4aec-a848-6190d34cb733 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:56.787089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bebf2c-832d-4aec-a848-6190d34cb733 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:57.010472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92116887-d4e0-4d91-93d1-d02792124748 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:57.011710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116887-d4e0-4d91-93d1-d02792124748 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:57.012073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116887-d4e0-4d91-93d1-d02792124748 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:57.012425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116887-d4e0-4d91-93d1-d02792124748 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:57.014211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92116887-d4e0-4d91-93d1-d02792124748 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=7f27b6d4b6b8460aaecba6ada7ea4b7e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:57.016491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92116887-d4e0-4d91-93d1-d02792124748 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:57.145465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-92116887-d4e0-4d91-93d1-d02792124748 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role 7f27b6d4b6b8460aaecba6ada7ea4b7e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:07:57.146173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-92116887-d4e0-4d91-93d1-d02792124748 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:57.148865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-92116887-d4e0-4d91-93d1-d02792124748 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:57.153708 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2215/4438] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:56 2022] DELETE /identity/v3/roles/7f27b6d4b6b8460aaecba6ada7ea4b7e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:07:57.159976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2fa34-ffe4-4c5d-ac28-50523f8e0aa3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:57.174187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2fa34-ffe4-4c5d-ac28-50523f8e0aa3 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:57.343040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a82f7c-6e2e-412e-a4e8-9f07cd8050b1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:57.343726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a82f7c-6e2e-412e-a4e8-9f07cd8050b1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:57.344015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a82f7c-6e2e-412e-a4e8-9f07cd8050b1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:57.346659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a82f7c-6e2e-412e-a4e8-9f07cd8050b1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:57.350502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a82f7c-6e2e-412e-a4e8-9f07cd8050b1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:57.354492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a82f7c-6e2e-412e-a4e8-9f07cd8050b1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:57.357830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:57.434273 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2224/4439] 10.222.0.70 () {60 vars in 1363 bytes} [Sun Aug 28 19:07:57 2022] PUT /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e => generated 519 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:57.437709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92116887-d4e0-4d91-93d1-d02792124748 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:57.439453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-92116887-d4e0-4d91-93d1-d02792124748 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:57.481353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92116887-d4e0-4d91-93d1-d02792124748 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:57.718330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5deec7d-1752-4641-9480-9da763b4ef45 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:57.718836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deec7d-1752-4641-9480-9da763b4ef45 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:57.719172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deec7d-1752-4641-9480-9da763b4ef45 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:57.719400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deec7d-1752-4641-9480-9da763b4ef45 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:57.721299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5deec7d-1752-4641-9480-9da763b4ef45 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:57.723950 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-c5deec7d-1752-4641-9480-9da763b4ef45 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:57.723950 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:57.723950 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:57.725037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5deec7d-1752-4641-9480-9da763b4ef45 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:57.725941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5deec7d-1752-4641-9480-9da763b4ef45 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:57.727084 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-c5deec7d-1752-4641-9480-9da763b4ef45 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:57.727084 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:57.727084 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:57.728277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5deec7d-1752-4641-9480-9da763b4ef45 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:57.735665 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2216/4440] 10.222.0.70 () {58 vars in 1345 bytes} [Sun Aug 28 19:07:57 2022] HEAD /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:57.739894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a82f7c-6e2e-412e-a4e8-9f07cd8050b1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:57.757776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a82f7c-6e2e-412e-a4e8-9f07cd8050b1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:57.774609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454dc48-7266-4dae-a8b4-6edee392f0a1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:57.776567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454dc48-7266-4dae-a8b4-6edee392f0a1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:57.777397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454dc48-7266-4dae-a8b4-6edee392f0a1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:57.778665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454dc48-7266-4dae-a8b4-6edee392f0a1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:57.784018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454dc48-7266-4dae-a8b4-6edee392f0a1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:57.785434 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-f454dc48-7266-4dae-a8b4-6edee392f0a1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:57.785434 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:07:57.785434 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:07:57.786357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454dc48-7266-4dae-a8b4-6edee392f0a1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:57.803951 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2225/4441] 10.222.0.70 () {58 vars in 1344 bytes} [Sun Aug 28 19:07:57 2022] GET /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e => generated 519 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:07:57.807951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5deec7d-1752-4641-9480-9da763b4ef45 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:57.824446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5deec7d-1752-4641-9480-9da763b4ef45 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:57.838309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930f63b-dec6-4618-be69-5e4cfb39f0ec tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:57.839465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930f63b-dec6-4618-be69-5e4cfb39f0ec tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:57.840040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930f63b-dec6-4618-be69-5e4cfb39f0ec tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:57.840535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930f63b-dec6-4618-be69-5e4cfb39f0ec tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:57.844356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930f63b-dec6-4618-be69-5e4cfb39f0ec tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:57.846906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930f63b-dec6-4618-be69-5e4cfb39f0ec tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:57.864774 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2217/4442] 10.222.0.70 () {58 vars in 1347 bytes} [Sun Aug 28 19:07:57 2022] DELETE /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:57.871350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454dc48-7266-4dae-a8b4-6edee392f0a1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:57.892318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454dc48-7266-4dae-a8b4-6edee392f0a1 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:58.106106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9efd4-f963-44d4-81d3-f313c5b76792 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:58.107516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9efd4-f963-44d4-81d3-f313c5b76792 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:58.108032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9efd4-f963-44d4-81d3-f313c5b76792 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:58.108441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9efd4-f963-44d4-81d3-f313c5b76792 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:58.111741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9efd4-f963-44d4-81d3-f313c5b76792 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:58.113520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9efd4-f963-44d4-81d3-f313c5b76792 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-53d9efd4-f963-44d4-81d3-f313c5b76792 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] c58ed1495e164205a2b6ae44571721e4 does not imply 1b6f6c72f9914b42a9b5c8dc9177235e.: keystone.exception.ImpliedRoleNotFound: c58ed1495e164205a2b6ae44571721e4 does not imply 1b6f6c72f9914b42a9b5c8dc9177235e. Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = query.one() Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:07:58.123852 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 28 19:07:58.125229 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 28 19:07:58.126459 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 28 19:07:58.126459 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c58ed1495e164205a2b6ae44571721e4 does not imply 1b6f6c72f9914b42a9b5c8dc9177235e. Aug 28 19:07:58.126459 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:07:58.130250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930f63b-dec6-4618-be69-5e4cfb39f0ec tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:58.141250 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2226/4443] 10.222.0.70 () {58 vars in 1344 bytes} [Sun Aug 28 19:07:57 2022] GET /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e => generated 137 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:07:58.143930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930f63b-dec6-4618-be69-5e4cfb39f0ec tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:58.150675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4a92d-93b9-4d11-b29b-6788182159a8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:58.151520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4a92d-93b9-4d11-b29b-6788182159a8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:58.151871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4a92d-93b9-4d11-b29b-6788182159a8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:58.152584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4a92d-93b9-4d11-b29b-6788182159a8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:58.155530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4a92d-93b9-4d11-b29b-6788182159a8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:58.157479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4a92d-93b9-4d11-b29b-6788182159a8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-4bd4a92d-93b9-4d11-b29b-6788182159a8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] c58ed1495e164205a2b6ae44571721e4 does not imply 1b6f6c72f9914b42a9b5c8dc9177235e.: keystone.exception.ImpliedRoleNotFound: c58ed1495e164205a2b6ae44571721e4 does not imply 1b6f6c72f9914b42a9b5c8dc9177235e. Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = query.one() Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._iter().one() Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._only_one_row( Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:07:58.177301 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 28 19:07:58.178574 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 28 19:07:58.179789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 28 19:07:58.179789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 28 19:07:58.179789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 28 19:07:58.179789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c58ed1495e164205a2b6ae44571721e4 does not imply 1b6f6c72f9914b42a9b5c8dc9177235e. Aug 28 19:07:58.179789 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:07:58.190469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9efd4-f963-44d4-81d3-f313c5b76792 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:58.200343 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2218/4444] 10.222.0.70 () {58 vars in 1347 bytes} [Sun Aug 28 19:07:58 2022] DELETE /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e => generated 137 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:07:58.209471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9efd4-f963-44d4-81d3-f313c5b76792 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:58.217656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae658a2-a8b7-4b16-9581-cd486df4d399 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:58.221786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae658a2-a8b7-4b16-9581-cd486df4d399 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:58.222543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae658a2-a8b7-4b16-9581-cd486df4d399 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:58.223400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae658a2-a8b7-4b16-9581-cd486df4d399 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:58.230178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae658a2-a8b7-4b16-9581-cd486df4d399 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:58.232506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae658a2-a8b7-4b16-9581-cd486df4d399 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:58.297050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4a92d-93b9-4d11-b29b-6788182159a8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:58.297792 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2227/4445] 10.222.0.70 () {60 vars in 1363 bytes} [Sun Aug 28 19:07:58 2022] PUT /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e => generated 519 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:58.316801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4a92d-93b9-4d11-b29b-6788182159a8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:58.364940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:58.369150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae658a2-a8b7-4b16-9581-cd486df4d399 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:58.372697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ae658a2-a8b7-4b16-9581-cd486df4d399 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:58.491836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf50e4-8f58-4922-bfa8-3c6efdaccc74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:58.493616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf50e4-8f58-4922-bfa8-3c6efdaccc74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:58.493989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf50e4-8f58-4922-bfa8-3c6efdaccc74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:58.494322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf50e4-8f58-4922-bfa8-3c6efdaccc74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/dec4b1283deb49bda3639dd1704890a9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:58.499659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf50e4-8f58-4922-bfa8-3c6efdaccc74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=dec4b1283deb49bda3639dd1704890a9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:58.501507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf50e4-8f58-4922-bfa8-3c6efdaccc74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:58.537798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae658a2-a8b7-4b16-9581-cd486df4d399 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:58.547889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2c5d7-10cd-4cce-9591-8ec191e0817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:58.549045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2c5d7-10cd-4cce-9591-8ec191e0817f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:58.549338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2c5d7-10cd-4cce-9591-8ec191e0817f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:58.549639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2c5d7-10cd-4cce-9591-8ec191e0817f admin admin] PATH_INFO: `/v3/users/550d16e73d594f708b4639e2cd54a3db` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:58.552266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2c5d7-10cd-4cce-9591-8ec191e0817f admin admin] RBAC: Authorizing `identity:delete_user(user_id=550d16e73d594f708b4639e2cd54a3db)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:58.554292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2c5d7-10cd-4cce-9591-8ec191e0817f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:58.570244 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2219/4446] 10.222.0.70 () {60 vars in 1363 bytes} [Sun Aug 28 19:07:58 2022] PUT /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/dec4b1283deb49bda3639dd1704890a9 => generated 521 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:58.571521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf50e4-8f58-4922-bfa8-3c6efdaccc74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:58.685893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:58.688896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-51d2c5d7-10cd-4cce-9591-8ec191e0817f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '550d16e73d594f708b4639e2cd54a3db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:58.722397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-51d2c5d7-10cd-4cce-9591-8ec191e0817f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '550d16e73d594f708b4639e2cd54a3db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:58.726445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-51d2c5d7-10cd-4cce-9591-8ec191e0817f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '550d16e73d594f708b4639e2cd54a3db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:58.759026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-51d2c5d7-10cd-4cce-9591-8ec191e0817f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '550d16e73d594f708b4639e2cd54a3db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:58.760326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-51d2c5d7-10cd-4cce-9591-8ec191e0817f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '550d16e73d594f708b4639e2cd54a3db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:58.764260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf50e4-8f58-4922-bfa8-3c6efdaccc74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:58.779043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff717b-2127-4501-a251-b462fb2e4712 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:58.779832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff717b-2127-4501-a251-b462fb2e4712 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:58.780122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff717b-2127-4501-a251-b462fb2e4712 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:58.780410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff717b-2127-4501-a251-b462fb2e4712 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/dec4b1283deb49bda3639dd1704890a9/implies/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:58.784427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff717b-2127-4501-a251-b462fb2e4712 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=dec4b1283deb49bda3639dd1704890a9, implied_role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:58.786483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff717b-2127-4501-a251-b462fb2e4712 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:58.830235 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2228/4447] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:58 2022] DELETE /identity/v3/users/550d16e73d594f708b4639e2cd54a3db => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:58.830235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb962d2-a9e2-4c8e-8254-675dd43939ee None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:58.830235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb962d2-a9e2-4c8e-8254-675dd43939ee None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:58.830672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb962d2-a9e2-4c8e-8254-675dd43939ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:58.858031 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2220/4448] 10.222.0.70 () {60 vars in 1363 bytes} [Sun Aug 28 19:07:58 2022] PUT /identity/v3/roles/dec4b1283deb49bda3639dd1704890a9/implies/4acd0b736620450492196e7a6b0ec112 => generated 520 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:07:58.860043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff717b-2127-4501-a251-b462fb2e4712 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:58.880759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-75ff717b-2127-4501-a251-b462fb2e4712 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:58.898682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6cb962d2-a9e2-4c8e-8254-675dd43939ee None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:58.900022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6cb962d2-a9e2-4c8e-8254-675dd43939ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:59.102553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff717b-2127-4501-a251-b462fb2e4712 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:59.119684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a03416-028f-415a-836c-578ca0058678 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:59.120334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a03416-028f-415a-836c-578ca0058678 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:59.120621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a03416-028f-415a-836c-578ca0058678 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:59.120899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a03416-028f-415a-836c-578ca0058678 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:59.121495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a03416-028f-415a-836c-578ca0058678 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:59.122769 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-78a03416-028f-415a-836c-578ca0058678 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:07:59.122769 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:07:59.122769 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:07:59.128978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a03416-028f-415a-836c-578ca0058678 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:59.136963 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2229/4449] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:07:59.182608 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2221/4450] 10.222.0.70 () {58 vars in 1152 bytes} [Sun Aug 28 19:07:58 2022] GET /identity/v3/role_inferences => generated 1605 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:07:59.187090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb962d2-a9e2-4c8e-8254-675dd43939ee None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:59.208892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb962d2-a9e2-4c8e-8254-675dd43939ee None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:59.220789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad2152-5f4e-4b0d-b39c-b5b6e5f5cb5a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:59.221827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad2152-5f4e-4b0d-b39c-b5b6e5f5cb5a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:59.222796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad2152-5f4e-4b0d-b39c-b5b6e5f5cb5a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:59.225359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad2152-5f4e-4b0d-b39c-b5b6e5f5cb5a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/dec4b1283deb49bda3639dd1704890a9/implies/4acd0b736620450492196e7a6b0ec112` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:59.228518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad2152-5f4e-4b0d-b39c-b5b6e5f5cb5a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dec4b1283deb49bda3639dd1704890a9, implied_role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:59.232482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad2152-5f4e-4b0d-b39c-b5b6e5f5cb5a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:59.260462 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2230/4451] 10.222.0.70 () {58 vars in 1347 bytes} [Sun Aug 28 19:07:59 2022] DELETE /identity/v3/roles/dec4b1283deb49bda3639dd1704890a9/implies/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:59.264564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a03416-028f-415a-836c-578ca0058678 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:59.284078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a03416-028f-415a-836c-578ca0058678 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:59.304930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad2152-5f4e-4b0d-b39c-b5b6e5f5cb5a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:59.306935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5dad2152-5f4e-4b0d-b39c-b5b6e5f5cb5a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:59.315301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:59.462373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad2152-5f4e-4b0d-b39c-b5b6e5f5cb5a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:59.470779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba658b2f-47a8-4e7c-b7a6-107f8572f1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:59.471428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba658b2f-47a8-4e7c-b7a6-107f8572f1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:59.471716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba658b2f-47a8-4e7c-b7a6-107f8572f1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:59.471998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba658b2f-47a8-4e7c-b7a6-107f8572f1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:59.479547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffe958-1309-4e93-8582-0a486d319887 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:59.480735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffe958-1309-4e93-8582-0a486d319887 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:59.481283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffe958-1309-4e93-8582-0a486d319887 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:59.481928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffe958-1309-4e93-8582-0a486d319887 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/dec4b1283deb49bda3639dd1704890a9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:59.485965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffe958-1309-4e93-8582-0a486d319887 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=dec4b1283deb49bda3639dd1704890a9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:59.489297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffe958-1309-4e93-8582-0a486d319887 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:59.517927 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2222/4452] 10.222.0.70 () {58 vars in 1347 bytes} [Sun Aug 28 19:07:59 2022] DELETE /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/dec4b1283deb49bda3639dd1704890a9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:59.519884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffe958-1309-4e93-8582-0a486d319887 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:59.523753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b5ffe958-1309-4e93-8582-0a486d319887 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:59.640551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffe958-1309-4e93-8582-0a486d319887 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:59.647540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b380581-ddac-4f19-84db-c030840dced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:59.648336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b380581-ddac-4f19-84db-c030840dced0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:59.649223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b380581-ddac-4f19-84db-c030840dced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:59.649599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b380581-ddac-4f19-84db-c030840dced0 admin admin] PATH_INFO: `/v3/users/6eccffc3a62940eba3bc0510fa7f862a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:59.650952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b380581-ddac-4f19-84db-c030840dced0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eccffc3a62940eba3bc0510fa7f862a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:59.661194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b380581-ddac-4f19-84db-c030840dced0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:59.695324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba658b2f-47a8-4e7c-b7a6-107f8572f1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:59.697145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba658b2f-47a8-4e7c-b7a6-107f8572f1e8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:59.713052 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2231/4453] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:07:59.714317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba658b2f-47a8-4e7c-b7a6-107f8572f1e8 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:59.723418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:07:59.730826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba658b2f-47a8-4e7c-b7a6-107f8572f1e8 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:07:59.787739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b380581-ddac-4f19-84db-c030840dced0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eccffc3a62940eba3bc0510fa7f862a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:59.805675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b380581-ddac-4f19-84db-c030840dced0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eccffc3a62940eba3bc0510fa7f862a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:59.806493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b380581-ddac-4f19-84db-c030840dced0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eccffc3a62940eba3bc0510fa7f862a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:59.840690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b380581-ddac-4f19-84db-c030840dced0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eccffc3a62940eba3bc0510fa7f862a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:59.841725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b380581-ddac-4f19-84db-c030840dced0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eccffc3a62940eba3bc0510fa7f862a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:07:59.866382 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2223/4454] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:07:59 2022] DELETE /identity/v3/users/6eccffc3a62940eba3bc0510fa7f862a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:59.870923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849439c-ba3e-4630-86d9-01722248fd95 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:59.871504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849439c-ba3e-4630-86d9-01722248fd95 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:59.871955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849439c-ba3e-4630-86d9-01722248fd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:59.885874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425d1a0-41ed-432b-8329-ba7fecce5a91 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:07:59.887349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425d1a0-41ed-432b-8329-ba7fecce5a91 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:07:59.888628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425d1a0-41ed-432b-8329-ba7fecce5a91 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:07:59.889352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425d1a0-41ed-432b-8329-ba7fecce5a91 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:07:59.895848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425d1a0-41ed-432b-8329-ba7fecce5a91 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:07:59.901508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425d1a0-41ed-432b-8329-ba7fecce5a91 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:07:59.920831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7849439c-ba3e-4630-86d9-01722248fd95 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:07:59.923217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7849439c-ba3e-4630-86d9-01722248fd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:59.928115 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2232/4455] 10.222.0.70 () {58 vars in 1347 bytes} [Sun Aug 28 19:07:59 2022] DELETE /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:07:59.935998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425d1a0-41ed-432b-8329-ba7fecce5a91 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:07:59.938156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c425d1a0-41ed-432b-8329-ba7fecce5a91 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:07:59.975441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:00.112942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425d1a0-41ed-432b-8329-ba7fecce5a91 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:00.126264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acdcc4-e1b3-48ce-ab02-9a2f0832c443 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:00.126884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acdcc4-e1b3-48ce-ab02-9a2f0832c443 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:00.127992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acdcc4-e1b3-48ce-ab02-9a2f0832c443 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:00.129348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acdcc4-e1b3-48ce-ab02-9a2f0832c443 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:00.131978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acdcc4-e1b3-48ce-ab02-9a2f0832c443 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:00.135987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acdcc4-e1b3-48ce-ab02-9a2f0832c443 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:00.154642 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2224/4456] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:08:00.167250 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2233/4457] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:07:59 2022] GET /identity/v3/roles => generated 2321 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:00.176185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849439c-ba3e-4630-86d9-01722248fd95 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:00.192441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acdcc4-e1b3-48ce-ab02-9a2f0832c443 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:00.194621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-99acdcc4-e1b3-48ce-ab02-9a2f0832c443 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:00.197022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849439c-ba3e-4630-86d9-01722248fd95 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:00.224868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe39d9-fa19-42c2-a705-1262981631d9 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:00.229083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe39d9-fa19-42c2-a705-1262981631d9 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:00.229520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe39d9-fa19-42c2-a705-1262981631d9 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:00.229905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe39d9-fa19-42c2-a705-1262981631d9 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:00.230971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe39d9-fa19-42c2-a705-1262981631d9 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:00.235573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe39d9-fa19-42c2-a705-1262981631d9 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:00.277847 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2225/4458] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:08:00 2022] POST /identity/v3/roles => generated 235 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:08:00.282426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe39d9-fa19-42c2-a705-1262981631d9 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:00.295917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe39d9-fa19-42c2-a705-1262981631d9 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:00.303712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aecaa8-bd44-40aa-b3ff-0de76f47584a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:00.304468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aecaa8-bd44-40aa-b3ff-0de76f47584a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:00.304818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aecaa8-bd44-40aa-b3ff-0de76f47584a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:00.305167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aecaa8-bd44-40aa-b3ff-0de76f47584a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/9d5ce489d67044acb0dac06683010764` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:00.307205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aecaa8-bd44-40aa-b3ff-0de76f47584a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:update_role(role_id=9d5ce489d67044acb0dac06683010764)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:00.308351 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-c4aecaa8-bd44-40aa-b3ff-0de76f47584a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:08:00.308351 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:08:00.308351 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:08:00.309819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aecaa8-bd44-40aa-b3ff-0de76f47584a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:00.349086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acdcc4-e1b3-48ce-ab02-9a2f0832c443 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:00.357094 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2226/4459] 10.222.0.70 () {60 vars in 1243 bytes} [Sun Aug 28 19:08:00 2022] PATCH /identity/v3/roles/9d5ce489d67044acb0dac06683010764 => generated 238 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:08:00.359211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928f9fc-572b-48b3-94bf-372e872c41c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:00.359930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928f9fc-572b-48b3-94bf-372e872c41c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:00.361259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aecaa8-bd44-40aa-b3ff-0de76f47584a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:00.362211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928f9fc-572b-48b3-94bf-372e872c41c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:00.365005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928f9fc-572b-48b3-94bf-372e872c41c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:00.389087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aecaa8-bd44-40aa-b3ff-0de76f47584a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:00.392762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928f9fc-572b-48b3-94bf-372e872c41c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:00.396215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928f9fc-572b-48b3-94bf-372e872c41c1 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:00.401698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7479db-5b9d-4876-89f5-a81e9718593a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:00.403772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7479db-5b9d-4876-89f5-a81e9718593a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:00.404862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7479db-5b9d-4876-89f5-a81e9718593a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:00.405219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7479db-5b9d-4876-89f5-a81e9718593a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/9d5ce489d67044acb0dac06683010764` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:00.431941 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2234/4460] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:08:00.436517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7479db-5b9d-4876-89f5-a81e9718593a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:get_role(role_id=9d5ce489d67044acb0dac06683010764)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:00.441885 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-fd7479db-5b9d-4876-89f5-a81e9718593a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:08:00.441885 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:08:00.441885 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:08:00.443044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7479db-5b9d-4876-89f5-a81e9718593a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:00.444913 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2227/4461] 10.222.0.70 () {58 vars in 1221 bytes} [Sun Aug 28 19:08:00 2022] GET /identity/v3/roles/9d5ce489d67044acb0dac06683010764 => generated 238 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:00.448863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928f9fc-572b-48b3-94bf-372e872c41c1 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:00.461716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928f9fc-572b-48b3-94bf-372e872c41c1 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:00.468541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b4e84-31d6-44c8-b14f-5e53b813ad0d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:00.469162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b4e84-31d6-44c8-b14f-5e53b813ad0d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:00.469445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b4e84-31d6-44c8-b14f-5e53b813ad0d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:00.469724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b4e84-31d6-44c8-b14f-5e53b813ad0d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:00.470424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b4e84-31d6-44c8-b14f-5e53b813ad0d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:00.473338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b4e84-31d6-44c8-b14f-5e53b813ad0d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:00.487398 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2235/4462] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:00 2022] GET /identity/v3/roles => generated 2550 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:00.492530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7479db-5b9d-4876-89f5-a81e9718593a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:00.506155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7479db-5b9d-4876-89f5-a81e9718593a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:00.512976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca6772-a3e6-4dd5-bb68-f1a03b07c1f6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:00.514143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca6772-a3e6-4dd5-bb68-f1a03b07c1f6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:00.514438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca6772-a3e6-4dd5-bb68-f1a03b07c1f6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:00.514729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca6772-a3e6-4dd5-bb68-f1a03b07c1f6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/9d5ce489d67044acb0dac06683010764` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:00.516469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca6772-a3e6-4dd5-bb68-f1a03b07c1f6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9d5ce489d67044acb0dac06683010764)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:00.517572 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-48ca6772-a3e6-4dd5-bb68-f1a03b07c1f6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:08:00.517572 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:08:00.517572 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:08:00.520413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca6772-a3e6-4dd5-bb68-f1a03b07c1f6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:00.593275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-48ca6772-a3e6-4dd5-bb68-f1a03b07c1f6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role 9d5ce489d67044acb0dac06683010764 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:00.593606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-48ca6772-a3e6-4dd5-bb68-f1a03b07c1f6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:00.597705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-48ca6772-a3e6-4dd5-bb68-f1a03b07c1f6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:00.603951 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2228/4463] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:00 2022] DELETE /identity/v3/roles/9d5ce489d67044acb0dac06683010764 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:00.612379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b4e84-31d6-44c8-b14f-5e53b813ad0d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:00.615094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-811b4e84-31d6-44c8-b14f-5e53b813ad0d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:00.635603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b4e84-31d6-44c8-b14f-5e53b813ad0d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:00.695874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:00.747730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19435fe3-d598-48ce-b05c-8cbc738f2341 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:00.748778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19435fe3-d598-48ce-b05c-8cbc738f2341 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:00.749120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19435fe3-d598-48ce-b05c-8cbc738f2341 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:00.749579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19435fe3-d598-48ce-b05c-8cbc738f2341 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:00.752294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19435fe3-d598-48ce-b05c-8cbc738f2341 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:00.755766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19435fe3-d598-48ce-b05c-8cbc738f2341 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:00.796527 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2236/4464] 10.222.0.70 () {60 vars in 1363 bytes} [Sun Aug 28 19:08:00 2022] PUT /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e => generated 519 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:00.801604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca6772-a3e6-4dd5-bb68-f1a03b07c1f6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:00.823455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca6772-a3e6-4dd5-bb68-f1a03b07c1f6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:00.992761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fe433-899e-4222-b5e9-4418c74d1de8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:00.998099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fe433-899e-4222-b5e9-4418c74d1de8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:00.998617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fe433-899e-4222-b5e9-4418c74d1de8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:00.998999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fe433-899e-4222-b5e9-4418c74d1de8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/dec4b1283deb49bda3639dd1704890a9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:01.008057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fe433-899e-4222-b5e9-4418c74d1de8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=dec4b1283deb49bda3639dd1704890a9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:01.025578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fe433-899e-4222-b5e9-4418c74d1de8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:01.073559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19435fe3-d598-48ce-b05c-8cbc738f2341 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:01.077553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-19435fe3-d598-48ce-b05c-8cbc738f2341 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:01.199955 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2229/4465] 10.222.0.70 () {60 vars in 1363 bytes} [Sun Aug 28 19:08:00 2022] PUT /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/dec4b1283deb49bda3639dd1704890a9 => generated 521 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:01.206387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fe433-899e-4222-b5e9-4418c74d1de8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:01.293045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:01.368108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19435fe3-d598-48ce-b05c-8cbc738f2341 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:01.419101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fe433-899e-4222-b5e9-4418c74d1de8 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:01.425816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5bba8-602f-4b88-871d-1738b5110aa2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:01.426915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5bba8-602f-4b88-871d-1738b5110aa2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:01.427255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5bba8-602f-4b88-871d-1738b5110aa2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:01.427649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5bba8-602f-4b88-871d-1738b5110aa2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/dec4b1283deb49bda3639dd1704890a9/implies/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:01.429987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5bba8-602f-4b88-871d-1738b5110aa2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=dec4b1283deb49bda3639dd1704890a9, implied_role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:01.434322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5bba8-602f-4b88-871d-1738b5110aa2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:01.491141 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2230/4466] 10.222.0.70 () {60 vars in 1363 bytes} [Sun Aug 28 19:08:01 2022] PUT /identity/v3/roles/dec4b1283deb49bda3639dd1704890a9/implies/4acd0b736620450492196e7a6b0ec112 => generated 520 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:08:01.492003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5bba8-602f-4b88-871d-1738b5110aa2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:01.522218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:01.522910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:01.523198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:01.523475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] PATH_INFO: `/v3/projects/f129e49f2b7b48979951f7f736f8acca` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:01.527367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f129e49f2b7b48979951f7f736f8acca)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:01.529321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:01.628256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f129e49f2b7b48979951f7f736f8acca', 'request_id': 'req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:01.635788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:01.636078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5bba8-602f-4b88-871d-1738b5110aa2 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:01.637585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f129e49f2b7b48979951f7f736f8acca', 'request_id': 'req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:01.648839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f129e49f2b7b48979951f7f736f8acca', 'request_id': 'req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:01.674671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] The token cache is being invalidate because project f129e49f2b7b48979951f7f736f8acca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:01.677420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:01.679479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:01.689464 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2237/4467] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:01 2022] DELETE /identity/v3/projects/f129e49f2b7b48979951f7f736f8acca => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:01.690619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:01.696115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:01.823130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93cdf7-371e-4040-bf3c-817ecd66c38f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:01.823835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93cdf7-371e-4040-bf3c-817ecd66c38f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:01.829050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93cdf7-371e-4040-bf3c-817ecd66c38f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:01.829050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93cdf7-371e-4040-bf3c-817ecd66c38f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/dec4b1283deb49bda3639dd1704890a9/implies` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:01.830087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93cdf7-371e-4040-bf3c-817ecd66c38f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=dec4b1283deb49bda3639dd1704890a9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:01.831187 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-9b93cdf7-371e-4040-bf3c-817ecd66c38f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:08:01.831187 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:08:01.831187 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:08:01.834882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93cdf7-371e-4040-bf3c-817ecd66c38f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:01.837770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e50650-cbb7-49ce-a93d-f0fd56e8ea13 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:01.843670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:01.845458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:01.845771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:01.846169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] PATH_INFO: `/v3/users/6f4301aca77d407094a3d1af8e9ea45f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:01.848765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f4301aca77d407094a3d1af8e9ea45f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:01.851028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:01.855152 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2231/4468] 10.222.0.70 () {58 vars in 1245 bytes} [Sun Aug 28 19:08:01 2022] GET /identity/v3/roles/dec4b1283deb49bda3639dd1704890a9/implies => generated 489 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:01.861076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93cdf7-371e-4040-bf3c-817ecd66c38f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:01.867603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9b93cdf7-371e-4040-bf3c-817ecd66c38f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:01.919429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93cdf7-371e-4040-bf3c-817ecd66c38f tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:01.945001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46e388-fac4-466a-a382-fad275465380 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:01.947219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46e388-fac4-466a-a382-fad275465380 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:01.947219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46e388-fac4-466a-a382-fad275465380 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:01.947219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46e388-fac4-466a-a382-fad275465380 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:01.948482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46e388-fac4-466a-a382-fad275465380 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=c58ed1495e164205a2b6ae44571721e4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:01.950568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46e388-fac4-466a-a382-fad275465380 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:01.959663 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2232/4469] 10.222.0.70 () {58 vars in 1245 bytes} [Sun Aug 28 19:08:01 2022] GET /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies => generated 659 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:01.962888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f4301aca77d407094a3d1af8e9ea45f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:01.965177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46e388-fac4-466a-a382-fad275465380 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:01.976869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46e388-fac4-466a-a382-fad275465380 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:01.987499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7313-d9b4-429a-b4ab-f8a877605fe7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:01.988763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7313-d9b4-429a-b4ab-f8a877605fe7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:01.989293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7313-d9b4-429a-b4ab-f8a877605fe7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:01.989831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7313-d9b4-429a-b4ab-f8a877605fe7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/dec4b1283deb49bda3639dd1704890a9/implies/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:01.989983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f4301aca77d407094a3d1af8e9ea45f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:01.991832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f4301aca77d407094a3d1af8e9ea45f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:01.992733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c7313-d9b4-429a-b4ab-f8a877605fe7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=dec4b1283deb49bda3639dd1704890a9, implied_role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:01.995735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c7313-d9b4-429a-b4ab-f8a877605fe7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:02.008159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f4301aca77d407094a3d1af8e9ea45f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:02.008822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f4301aca77d407094a3d1af8e9ea45f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:02.025445 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2233/4470] 10.222.0.70 () {58 vars in 1347 bytes} [Sun Aug 28 19:08:01 2022] DELETE /identity/v3/roles/dec4b1283deb49bda3639dd1704890a9/implies/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:02.030632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7313-d9b4-429a-b4ab-f8a877605fe7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:02.032652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-876c7313-d9b4-429a-b4ab-f8a877605fe7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:02.081008 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2238/4471] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:01 2022] DELETE /identity/v3/users/6f4301aca77d407094a3d1af8e9ea45f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:02.123889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:02.222864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7313-d9b4-429a-b4ab-f8a877605fe7 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:02.254554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:02.258479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:02.382772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eace2b-1a4b-4f7d-95a5-586e0b92219e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:02.384692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eace2b-1a4b-4f7d-95a5-586e0b92219e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:02.384986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eace2b-1a4b-4f7d-95a5-586e0b92219e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:02.385282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eace2b-1a4b-4f7d-95a5-586e0b92219e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/dec4b1283deb49bda3639dd1704890a9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:02.392216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eace2b-1a4b-4f7d-95a5-586e0b92219e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=dec4b1283deb49bda3639dd1704890a9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:02.398097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eace2b-1a4b-4f7d-95a5-586e0b92219e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:02.419127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c155e48-34b7-4cfd-85da-2c25c70329ef admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:02.425277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:02.425277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:02.425277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:02.425277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] PATH_INFO: `/v3/projects/11fb80f2cd9640df94e83cc13edb4dae` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:02.431388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=11fb80f2cd9640df94e83cc13edb4dae)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:02.435674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:02.436048 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2234/4472] 10.222.0.70 () {58 vars in 1347 bytes} [Sun Aug 28 19:08:02 2022] DELETE /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/dec4b1283deb49bda3639dd1704890a9 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:08:02.437310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eace2b-1a4b-4f7d-95a5-586e0b92219e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:02.444852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:02.535907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11fb80f2cd9640df94e83cc13edb4dae', 'request_id': 'req-cddf28fa-6f29-47dd-a627-8d610889bf0e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:02.553472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11fb80f2cd9640df94e83cc13edb4dae', 'request_id': 'req-cddf28fa-6f29-47dd-a627-8d610889bf0e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:02.567019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11fb80f2cd9640df94e83cc13edb4dae', 'request_id': 'req-cddf28fa-6f29-47dd-a627-8d610889bf0e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:02.591619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] The token cache is being invalidate because project 11fb80f2cd9640df94e83cc13edb4dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:02.592064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:02.592859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:02.595758 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2239/4473] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:02 2022] DELETE /identity/v3/projects/11fb80f2cd9640df94e83cc13edb4dae => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:02.602600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:02.606295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:02.638492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eace2b-1a4b-4f7d-95a5-586e0b92219e tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:02.761442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf28fa-6f29-47dd-a627-8d610889bf0e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:02.770885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:02.772110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:02.773265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:02.774018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] PATH_INFO: `/v3/users/93193236cc864a70ac3fcb08104b824f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:02.776603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=93193236cc864a70ac3fcb08104b824f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:02.779496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:02.834691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6d031-8d0f-47ff-815b-4f6a4d104a74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:02.835600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6d031-8d0f-47ff-815b-4f6a4d104a74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:02.835761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6d031-8d0f-47ff-815b-4f6a4d104a74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:02.836085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6d031-8d0f-47ff-815b-4f6a4d104a74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:02.838018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6d031-8d0f-47ff-815b-4f6a4d104a74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c58ed1495e164205a2b6ae44571721e4, implied_role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:02.839996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6d031-8d0f-47ff-815b-4f6a4d104a74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:02.861040 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2235/4474] 10.222.0.70 () {58 vars in 1347 bytes} [Sun Aug 28 19:08:02 2022] DELETE /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4/implies/1b6f6c72f9914b42a9b5c8dc9177235e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:02.868013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6d031-8d0f-47ff-815b-4f6a4d104a74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:02.877754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-61f6d031-8d0f-47ff-815b-4f6a4d104a74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:02.916529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:02.929423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93193236cc864a70ac3fcb08104b824f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:02.950672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93193236cc864a70ac3fcb08104b824f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:02.953132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93193236cc864a70ac3fcb08104b824f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:02.975683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93193236cc864a70ac3fcb08104b824f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:02.976492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93193236cc864a70ac3fcb08104b824f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:03.030442 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2240/4475] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:02 2022] DELETE /identity/v3/users/93193236cc864a70ac3fcb08104b824f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:03.042828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6d031-8d0f-47ff-815b-4f6a4d104a74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:03.112468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799f5a4-3961-48ae-9ba8-a2a7b15b659a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:03.113852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799f5a4-3961-48ae-9ba8-a2a7b15b659a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:03.114281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799f5a4-3961-48ae-9ba8-a2a7b15b659a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:03.114731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799f5a4-3961-48ae-9ba8-a2a7b15b659a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains/8d07ec0532394c4e84bac391f101df44` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:03.123400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799f5a4-3961-48ae-9ba8-a2a7b15b659a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-b799f5a4-3961-48ae-9ba8-a2a7b15b659a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Could not find domain: 8d07ec0532394c4e84bac391f101df44.: keystone.exception.DomainNotFound: Could not find domain: 8d07ec0532394c4e84bac391f101df44. Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8d07ec0532394c4e84bac391f101df44. Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:08:03.129158 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:08:03.133796 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8d07ec0532394c4e84bac391f101df44. Aug 28 19:08:03.135193 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:08:03.136726 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2236/4476] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:08:02 2022] PATCH /identity/v3/domains/8d07ec0532394c4e84bac391f101df44 => generated 112 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:08:03.136843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:03.138455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:03.155231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b4a43-52e9-438d-917e-b8ea0912ce0c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:03.161984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9912054-229e-4317-8c2f-83b6a351bb78 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:03.162766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9912054-229e-4317-8c2f-83b6a351bb78 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:03.163225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9912054-229e-4317-8c2f-83b6a351bb78 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:03.163735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9912054-229e-4317-8c2f-83b6a351bb78 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/users/1611c2c3d5284ffe8f3f5d9ae507e0e3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:03.165332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9912054-229e-4317-8c2f-83b6a351bb78 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1611c2c3d5284ffe8f3f5d9ae507e0e3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:03.167586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9912054-229e-4317-8c2f-83b6a351bb78 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:03.174621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:03.249323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b9912054-229e-4317-8c2f-83b6a351bb78 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1611c2c3d5284ffe8f3f5d9ae507e0e3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:03.260089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b9912054-229e-4317-8c2f-83b6a351bb78 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1611c2c3d5284ffe8f3f5d9ae507e0e3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:03.262244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b9912054-229e-4317-8c2f-83b6a351bb78 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1611c2c3d5284ffe8f3f5d9ae507e0e3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:03.272779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b9912054-229e-4317-8c2f-83b6a351bb78 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1611c2c3d5284ffe8f3f5d9ae507e0e3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:03.273801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b9912054-229e-4317-8c2f-83b6a351bb78 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1611c2c3d5284ffe8f3f5d9ae507e0e3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:03.330279 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2241/4477] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:03 2022] DELETE /identity/v3/users/1611c2c3d5284ffe8f3f5d9ae507e0e3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:03.331631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799f5a4-3961-48ae-9ba8-a2a7b15b659a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:03.333522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b799f5a4-3961-48ae-9ba8-a2a7b15b659a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:03.360186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799f5a4-3961-48ae-9ba8-a2a7b15b659a tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:03.556204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3341c-c8cc-45b4-b7d2-df896a890ea4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:03.583674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3341c-c8cc-45b4-b7d2-df896a890ea4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:03.583674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3341c-c8cc-45b4-b7d2-df896a890ea4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:03.583674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3341c-c8cc-45b4-b7d2-df896a890ea4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/4acd0b736620450492196e7a6b0ec112` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:03.583674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3341c-c8cc-45b4-b7d2-df896a890ea4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4acd0b736620450492196e7a6b0ec112)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:03.583674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3341c-c8cc-45b4-b7d2-df896a890ea4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:03.712130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-eca3341c-c8cc-45b4-b7d2-df896a890ea4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role 4acd0b736620450492196e7a6b0ec112 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:03.715171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-eca3341c-c8cc-45b4-b7d2-df896a890ea4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:03.717553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-eca3341c-c8cc-45b4-b7d2-df896a890ea4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:03.726393 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2237/4478] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:03 2022] DELETE /identity/v3/roles/4acd0b736620450492196e7a6b0ec112 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:03.727747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9912054-229e-4317-8c2f-83b6a351bb78 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:03.741107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9912054-229e-4317-8c2f-83b6a351bb78 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:03.893359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd8031-f58e-455b-86c0-0941cff32bf6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:03.894902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd8031-f58e-455b-86c0-0941cff32bf6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:03.895360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd8031-f58e-455b-86c0-0941cff32bf6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:03.895811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd8031-f58e-455b-86c0-0941cff32bf6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/groups/350916fed7344dfd80a84ee2d5d730a0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:03.902626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd8031-f58e-455b-86c0-0941cff32bf6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_group(group_id=350916fed7344dfd80a84ee2d5d730a0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:03.904224 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-f9cd8031-f58e-455b-86c0-0941cff32bf6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:08:03.904224 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:08:03.904224 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:08:03.906009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd8031-f58e-455b-86c0-0941cff32bf6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:04.059562 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2242/4479] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:08:03 2022] DELETE /identity/v3/groups/350916fed7344dfd80a84ee2d5d730a0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:08:04.064902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3341c-c8cc-45b4-b7d2-df896a890ea4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:04.067142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eca3341c-c8cc-45b4-b7d2-df896a890ea4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:04.101321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3341c-c8cc-45b4-b7d2-df896a890ea4 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:04.209966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:04.240559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd8031-f58e-455b-86c0-0941cff32bf6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:04.243715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f9cd8031-f58e-455b-86c0-0941cff32bf6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:04.305493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:04.308405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:04.308405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:04.308405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:04.310857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cd39a0d41cb24cb0ac980bb9d4d23435)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:04.317481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:04.376590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:04.431221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd8031-f58e-455b-86c0-0941cff32bf6 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:04.467872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd39a0d41cb24cb0ac980bb9d4d23435', 'request_id': 'req-3458b005-e877-4600-b95b-739d404733d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:04.488956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd39a0d41cb24cb0ac980bb9d4d23435', 'request_id': 'req-3458b005-e877-4600-b95b-739d404733d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:04.499351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd39a0d41cb24cb0ac980bb9d4d23435', 'request_id': 'req-3458b005-e877-4600-b95b-739d404733d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:04.518473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] The token cache is being invalidate because project cd39a0d41cb24cb0ac980bb9d4d23435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:04.519408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:04.520578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:04.524396 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2238/4480] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:04 2022] DELETE /identity/v3/projects/cd39a0d41cb24cb0ac980bb9d4d23435 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:04.526773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:04.538558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:04.653064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:04.654719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:04.655910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:04.656283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] PATH_INFO: `/v3/projects/e870d49108cb488ca5cbe29d14b575cb` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:04.668713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e870d49108cb488ca5cbe29d14b575cb)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:04.683742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:04.775434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458b005-e877-4600-b95b-739d404733d5 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:04.788846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:04.789629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:04.789915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:04.792652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7 admin admin] PATH_INFO: `/v3/projects/b4b62c2da443498f9a4fe4de0244130c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:04.796167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b62c2da443498f9a4fe4de0244130c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:04.799828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:04.815430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e870d49108cb488ca5cbe29d14b575cb', 'request_id': 'req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:04.824926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e870d49108cb488ca5cbe29d14b575cb', 'request_id': 'req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:04.834040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e870d49108cb488ca5cbe29d14b575cb', 'request_id': 'req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:04.870480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] The token cache is being invalidate because project e870d49108cb488ca5cbe29d14b575cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:04.870819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:04.874406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:04.883823 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2243/4481] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:04 2022] DELETE /identity/v3/projects/e870d49108cb488ca5cbe29d14b575cb => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:04.883823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:04.885720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:04.942727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b62c2da443498f9a4fe4de0244130c', 'request_id': 'req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:04.957361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:04.968371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b62c2da443498f9a4fe4de0244130c', 'request_id': 'req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:04.977684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b62c2da443498f9a4fe4de0244130c', 'request_id': 'req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:05.006273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7 admin admin] The token cache is being invalidate because project b4b62c2da443498f9a4fe4de0244130c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:05.006662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:05.009245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fea7e615-70f6-4ce5-a8ad-8452477d4eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:05.013657 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2239/4482] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:04 2022] DELETE /identity/v3/projects/b4b62c2da443498f9a4fe4de0244130c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:05.015064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b8381-26bc-4d8a-809d-5a722491b9e6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:05.015353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b8381-26bc-4d8a-809d-5a722491b9e6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:05.015624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b8381-26bc-4d8a-809d-5a722491b9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:05.077556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ad575-a8c6-41de-9bdc-98ee5a1fb10b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:05.099235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-211b8381-26bc-4d8a-809d-5a722491b9e6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:05.101534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-211b8381-26bc-4d8a-809d-5a722491b9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:05.159124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:05.245965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8249c-bbda-4ef8-8524-c1891fdc52fd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:05.247584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8249c-bbda-4ef8-8524-c1891fdc52fd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:05.248000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8249c-bbda-4ef8-8524-c1891fdc52fd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:05.248388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8249c-bbda-4ef8-8524-c1891fdc52fd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains/30b84ff0d5de4968b8e775b86eca5371` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:05.249973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8249c-bbda-4ef8-8524-c1891fdc52fd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=30b84ff0d5de4968b8e775b86eca5371)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:05.253476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8249c-bbda-4ef8-8524-c1891fdc52fd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:05.298416 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2240/4483] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:05.299945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a554b7-1d3e-42c9-b483-c8e8d4c10232 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:05.300944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a554b7-1d3e-42c9-b483-c8e8d4c10232 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:05.305427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a554b7-1d3e-42c9-b483-c8e8d4c10232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:05.312999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c6a8249c-bbda-4ef8-8524-c1891fdc52fd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '30b84ff0d5de4968b8e775b86eca5371'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:05.315437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c6a8249c-bbda-4ef8-8524-c1891fdc52fd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '30b84ff0d5de4968b8e775b86eca5371'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:05.386603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a1a554b7-1d3e-42c9-b483-c8e8d4c10232 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:05.388193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a1a554b7-1d3e-42c9-b483-c8e8d4c10232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:05.412835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c6a8249c-bbda-4ef8-8524-c1891fdc52fd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '30b84ff0d5de4968b8e775b86eca5371'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:05.414450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c6a8249c-bbda-4ef8-8524-c1891fdc52fd tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '30b84ff0d5de4968b8e775b86eca5371'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:05.426526 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2244/4484] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:08:04 2022] PATCH /identity/v3/domains/30b84ff0d5de4968b8e775b86eca5371 => generated 277 bytes in 546 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:05.428539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ece6d3-d039-4ec7-b1ed-dd956d8d48cc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:05.429105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ece6d3-d039-4ec7-b1ed-dd956d8d48cc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:05.429620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ece6d3-d039-4ec7-b1ed-dd956d8d48cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:05.479957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d8ece6d3-d039-4ec7-b1ed-dd956d8d48cc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:05.481903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d8ece6d3-d039-4ec7-b1ed-dd956d8d48cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:05.731473 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2241/4485] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:05.736186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a554b7-1d3e-42c9-b483-c8e8d4c10232 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:05.741307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a1a554b7-1d3e-42c9-b483-c8e8d4c10232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:05.811104 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2245/4486] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:05.812953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c56b9-d5c4-4629-a83f-f73fe121ea5d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:05.813491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c56b9-d5c4-4629-a83f-f73fe121ea5d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:05.814082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c56b9-d5c4-4629-a83f-f73fe121ea5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:05.843835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-921c56b9-d5c4-4629-a83f-f73fe121ea5d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:05.845208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-921c56b9-d5c4-4629-a83f-f73fe121ea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:05.860001 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2246/4487] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:05.860797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c56b9-d5c4-4629-a83f-f73fe121ea5d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:05.875232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c56b9-d5c4-4629-a83f-f73fe121ea5d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:05.882125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541d2b9-051b-4346-8cb9-a44627bf0993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:05.882678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541d2b9-051b-4346-8cb9-a44627bf0993 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:05.883112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541d2b9-051b-4346-8cb9-a44627bf0993 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:05.883785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541d2b9-051b-4346-8cb9-a44627bf0993 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:05.884138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541d2b9-051b-4346-8cb9-a44627bf0993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:08:05.884442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541d2b9-051b-4346-8cb9-a44627bf0993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:05.886313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541d2b9-051b-4346-8cb9-a44627bf0993 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:05.904970 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2247/4488] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:05.906201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541d2b9-051b-4346-8cb9-a44627bf0993 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:05.932869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541d2b9-051b-4346-8cb9-a44627bf0993 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:05.945274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db2e2d-64ae-4e83-aba5-d44c4d1e3675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:05.945908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db2e2d-64ae-4e83-aba5-d44c4d1e3675 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:05.946194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db2e2d-64ae-4e83-aba5-d44c4d1e3675 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:05.946471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db2e2d-64ae-4e83-aba5-d44c4d1e3675 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:05.953174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db2e2d-64ae-4e83-aba5-d44c4d1e3675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:08:05.953406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db2e2d-64ae-4e83-aba5-d44c4d1e3675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:05.956217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db2e2d-64ae-4e83-aba5-d44c4d1e3675 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:05.993783 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2248/4489] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:05.996168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db2e2d-64ae-4e83-aba5-d44c4d1e3675 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:06.003919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a554b7-1d3e-42c9-b483-c8e8d4c10232 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:06.016783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:06.017606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:06.018659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:06.019216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/domains/30b84ff0d5de4968b8e775b86eca5371` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:06.031767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db2e2d-64ae-4e83-aba5-d44c4d1e3675 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:06.039039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=30b84ff0d5de4968b8e775b86eca5371)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:06.041017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:06.050209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654bf12-baf5-4eda-ae10-e55fd185cc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:06.051941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654bf12-baf5-4eda-ae10-e55fd185cc08 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:06.052523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654bf12-baf5-4eda-ae10-e55fd185cc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:06.053429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654bf12-baf5-4eda-ae10-e55fd185cc08 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:06.054550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654bf12-baf5-4eda-ae10-e55fd185cc08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:06.057682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654bf12-baf5-4eda-ae10-e55fd185cc08 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:06.084831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:06.100843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '30b84ff0d5de4968b8e775b86eca5371'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:06.117698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '30b84ff0d5de4968b8e775b86eca5371'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:06.140201 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2249/4490] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:05 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:06.140201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654bf12-baf5-4eda-ae10-e55fd185cc08 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:06.237475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b84ff0d5de4968b8e775b86eca5371', 'request_id': 'req-d3599464-72ad-44e7-975f-033b8b632c31'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:06.244540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:06.254484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b84ff0d5de4968b8e775b86eca5371', 'request_id': 'req-d3599464-72ad-44e7-975f-033b8b632c31'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:06.265723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b84ff0d5de4968b8e775b86eca5371', 'request_id': 'req-d3599464-72ad-44e7-975f-033b8b632c31'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:06.311061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654bf12-baf5-4eda-ae10-e55fd185cc08 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:06.327220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] The token cache is being invalidate because project 30b84ff0d5de4968b8e775b86eca5371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:06.327753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:06.330506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:06.366682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '30b84ff0d5de4968b8e775b86eca5371', 'request_id': 'req-d3599464-72ad-44e7-975f-033b8b632c31'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:06.374936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '30b84ff0d5de4968b8e775b86eca5371', 'request_id': 'req-d3599464-72ad-44e7-975f-033b8b632c31'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:06.376470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '30b84ff0d5de4968b8e775b86eca5371', 'request_id': 'req-d3599464-72ad-44e7-975f-033b8b632c31'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:06.387904 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2242/4491] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:08:05 2022] DELETE /identity/v3/domains/30b84ff0d5de4968b8e775b86eca5371 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:06.390888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:06.395914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:06.438690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf89b0-b621-445a-8298-375bb899f04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:06.439369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf89b0-b621-445a-8298-375bb899f04d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:06.440439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf89b0-b621-445a-8298-375bb899f04d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:06.440765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf89b0-b621-445a-8298-375bb899f04d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:06.441924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf89b0-b621-445a-8298-375bb899f04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:06.444062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf89b0-b621-445a-8298-375bb899f04d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:06.546921 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2250/4492] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:06 2022] POST /identity/v3/projects => generated 379 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:06.553915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d295cd6-b74a-43cc-95a0-1528da022a94 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:06.554214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d295cd6-b74a-43cc-95a0-1528da022a94 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:06.561180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d295cd6-b74a-43cc-95a0-1528da022a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:06.569628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3599464-72ad-44e7-975f-033b8b632c31 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:06.668486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3d295cd6-b74a-43cc-95a0-1528da022a94 None None] MFA Rules not processed for user `b78fc23d55064b56873795fe500e822e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:06.671418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3d295cd6-b74a-43cc-95a0-1528da022a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:06.743624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89de86e-db47-4a98-868b-7917ca1be224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:06.746395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de86e-db47-4a98-868b-7917ca1be224 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:06.748521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de86e-db47-4a98-868b-7917ca1be224 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:06.748953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89de86e-db47-4a98-868b-7917ca1be224 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:06.749751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89de86e-db47-4a98-868b-7917ca1be224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:06.756393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89de86e-db47-4a98-868b-7917ca1be224 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:06.812187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:06.830797 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2243/4493] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:06 2022] POST /identity/v3/users => generated 292 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:06.833929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89de86e-db47-4a98-868b-7917ca1be224 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:06.838660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b89de86e-db47-4a98-868b-7917ca1be224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:06.897562 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2251/4494] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:06.899703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d295cd6-b74a-43cc-95a0-1528da022a94 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:06.903849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3d295cd6-b74a-43cc-95a0-1528da022a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:06.948574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d295cd6-b74a-43cc-95a0-1528da022a94 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:06.963004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf2842-1b00-4276-83c1-a79e7ffeae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:06.963746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf2842-1b00-4276-83c1-a79e7ffeae6f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:06.964648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf2842-1b00-4276-83c1-a79e7ffeae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:06.965718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf2842-1b00-4276-83c1-a79e7ffeae6f admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:06.967158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf2842-1b00-4276-83c1-a79e7ffeae6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:06.976485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf2842-1b00-4276-83c1-a79e7ffeae6f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:07.032603 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2252/4495] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:06 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:07.032603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf2842-1b00-4276-83c1-a79e7ffeae6f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:07.070548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89de86e-db47-4a98-868b-7917ca1be224 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:07.073065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf2842-1b00-4276-83c1-a79e7ffeae6f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:07.084955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef579d-f5bd-4cf7-8e4f-7531cea0542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:07.085411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60751-6835-4626-a170-af9d57355d74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:07.086233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60751-6835-4626-a170-af9d57355d74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:07.095720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef579d-f5bd-4cf7-8e4f-7531cea0542b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:07.096604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60751-6835-4626-a170-af9d57355d74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:07.096604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60751-6835-4626-a170-af9d57355d74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/dec4b1283deb49bda3639dd1704890a9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:07.097643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef579d-f5bd-4cf7-8e4f-7531cea0542b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:07.098650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef579d-f5bd-4cf7-8e4f-7531cea0542b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:07.099833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b60751-6835-4626-a170-af9d57355d74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dec4b1283deb49bda3639dd1704890a9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:07.100625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef579d-f5bd-4cf7-8e4f-7531cea0542b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:07.102502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef579d-f5bd-4cf7-8e4f-7531cea0542b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:07.104974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b60751-6835-4626-a170-af9d57355d74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:07.142330 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2253/4496] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:07 2022] GET /identity/v3/roles => generated 2096 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:07.151668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef579d-f5bd-4cf7-8e4f-7531cea0542b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:07.156266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-59ef579d-f5bd-4cf7-8e4f-7531cea0542b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:07.207813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10b60751-6835-4626-a170-af9d57355d74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role dec4b1283deb49bda3639dd1704890a9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:07.208581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10b60751-6835-4626-a170-af9d57355d74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:07.211113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10b60751-6835-4626-a170-af9d57355d74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:07.216102 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2244/4497] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:06 2022] DELETE /identity/v3/roles/dec4b1283deb49bda3639dd1704890a9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:07.217724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60751-6835-4626-a170-af9d57355d74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:07.222960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-10b60751-6835-4626-a170-af9d57355d74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:07.250018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:07.385574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef579d-f5bd-4cf7-8e4f-7531cea0542b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:07.429661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60751-6835-4626-a170-af9d57355d74 tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:07.444127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173150c-7bc9-4b9b-9679-de3f7eabc255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:07.444887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173150c-7bc9-4b9b-9679-de3f7eabc255 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:07.445940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173150c-7bc9-4b9b-9679-de3f7eabc255 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:07.445940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173150c-7bc9-4b9b-9679-de3f7eabc255 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:07.446991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173150c-7bc9-4b9b-9679-de3f7eabc255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:07.450781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173150c-7bc9-4b9b-9679-de3f7eabc255 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:07.470074 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2245/4498] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:07 2022] GET /identity/v3/roles => generated 1870 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:07.470074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173150c-7bc9-4b9b-9679-de3f7eabc255 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:07.473429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b173150c-7bc9-4b9b-9679-de3f7eabc255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:07.488588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173150c-7bc9-4b9b-9679-de3f7eabc255 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:07.495752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f123bdc-670b-414b-869d-7ba5c348d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:07.496684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f123bdc-670b-414b-869d-7ba5c348d908 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:07.497125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f123bdc-670b-414b-869d-7ba5c348d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:07.497721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f123bdc-670b-414b-869d-7ba5c348d908 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:07.498624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f123bdc-670b-414b-869d-7ba5c348d908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:07.501358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f123bdc-670b-414b-869d-7ba5c348d908 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:07.504670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebbfc6-4ae8-45ad-8a47-3c7d3a09d150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:07.505991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebbfc6-4ae8-45ad-8a47-3c7d3a09d150 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:07.506497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebbfc6-4ae8-45ad-8a47-3c7d3a09d150 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:07.506982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebbfc6-4ae8-45ad-8a47-3c7d3a09d150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:07.510063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e8ebbfc6-4ae8-45ad-8a47-3c7d3a09d150 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:07.519966 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2246/4499] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:07 2022] GET /identity/v3/roles => generated 1870 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:07.521900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f123bdc-670b-414b-869d-7ba5c348d908 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:07.530245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2f123bdc-670b-414b-869d-7ba5c348d908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:07.684519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:07.693753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebbfc6-4ae8-45ad-8a47-3c7d3a09d150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:07.695476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebbfc6-4ae8-45ad-8a47-3c7d3a09d150 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:07.724626 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2254/4500] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:07.735078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f123bdc-670b-414b-869d-7ba5c348d908 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:07.738412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebbfc6-4ae8-45ad-8a47-3c7d3a09d150 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:07.746501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c67513-9641-4063-9c5f-9299d516fdaf tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:07.748133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c67513-9641-4063-9c5f-9299d516fdaf tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:07.748658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c67513-9641-4063-9c5f-9299d516fdaf tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:07.749171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c67513-9641-4063-9c5f-9299d516fdaf tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/1b6f6c72f9914b42a9b5c8dc9177235e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:07.751276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c67513-9641-4063-9c5f-9299d516fdaf tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1b6f6c72f9914b42a9b5c8dc9177235e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:07.753145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c67513-9641-4063-9c5f-9299d516fdaf tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:07.763274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebbfc6-4ae8-45ad-8a47-3c7d3a09d150 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:07.770448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887dcf-8220-4b9c-93ad-9a0f5982e03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:07.771420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887dcf-8220-4b9c-93ad-9a0f5982e03c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:07.771756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887dcf-8220-4b9c-93ad-9a0f5982e03c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:07.772065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26887dcf-8220-4b9c-93ad-9a0f5982e03c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:07.773115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26887dcf-8220-4b9c-93ad-9a0f5982e03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:07.776139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26887dcf-8220-4b9c-93ad-9a0f5982e03c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:07.809942 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2255/4501] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:07 2022] GET /identity/v3/roles => generated 1870 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:07.811200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887dcf-8220-4b9c-93ad-9a0f5982e03c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:07.849476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26887dcf-8220-4b9c-93ad-9a0f5982e03c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:07.855385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b2c67513-9641-4063-9c5f-9299d516fdaf tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role 1b6f6c72f9914b42a9b5c8dc9177235e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:07.855890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b2c67513-9641-4063-9c5f-9299d516fdaf tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:07.860601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b2c67513-9641-4063-9c5f-9299d516fdaf tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:07.860857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88530-71a5-4af7-b45c-f9919c6d6473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:07.866070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88530-71a5-4af7-b45c-f9919c6d6473 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:07.866070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88530-71a5-4af7-b45c-f9919c6d6473 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:07.866455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae88530-71a5-4af7-b45c-f9919c6d6473 admin admin] PATH_INFO: `/v3/projects/77207cbf86b14b449ac261b98a9b0311/users/d4afb723d9a44a8284a518c8b2b2fec1/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:07.872763 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2247/4502] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:07 2022] DELETE /identity/v3/roles/1b6f6c72f9914b42a9b5c8dc9177235e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:07.873825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c67513-9641-4063-9c5f-9299d516fdaf tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:07.877452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b2c67513-9641-4063-9c5f-9299d516fdaf tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:07.978224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae88530-71a5-4af7-b45c-f9919c6d6473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77207cbf86b14b449ac261b98a9b0311, user_id=d4afb723d9a44a8284a518c8b2b2fec1, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:07.981499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae88530-71a5-4af7-b45c-f9919c6d6473 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:08.016480 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2256/4503] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:07 2022] PUT /identity/v3/projects/77207cbf86b14b449ac261b98a9b0311/users/d4afb723d9a44a8284a518c8b2b2fec1/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:08.027708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88530-71a5-4af7-b45c-f9919c6d6473 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:08.032019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2ae88530-71a5-4af7-b45c-f9919c6d6473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:08.048075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c67513-9641-4063-9c5f-9299d516fdaf tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:08.211805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:08.226502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de09970-c00e-45d1-8cda-faf8b4b6cc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:08.227385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de09970-c00e-45d1-8cda-faf8b4b6cc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:08.228602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de09970-c00e-45d1-8cda-faf8b4b6cc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:08.229748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae88530-71a5-4af7-b45c-f9919c6d6473 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:08.230151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de09970-c00e-45d1-8cda-faf8b4b6cc74 admin admin] PATH_INFO: `/v3/projects/264353fcec3e4b47821833779cf988d2/users/363b2cb0ef934d4cbfbc3d80e51e10ae/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:08.251975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e5449-218c-4c7d-a8c4-cab08fde8a1d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4672e86e05e64af6b2d1ae5871a04aa3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72098cd5952c4f4a8901e3e054bea789', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:08.252645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e5449-218c-4c7d-a8c4-cab08fde8a1d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:08.252935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e5449-218c-4c7d-a8c4-cab08fde8a1d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:08.253304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e5449-218c-4c7d-a8c4-cab08fde8a1d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] PATH_INFO: `/v3/roles/c58ed1495e164205a2b6ae44571721e4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:08.256265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e5449-218c-4c7d-a8c4-cab08fde8a1d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c58ed1495e164205a2b6ae44571721e4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:08.257320 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-8b5e5449-218c-4c7d-a8c4-cab08fde8a1d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:08:08.257320 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:08:08.257320 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:08:08.260303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e5449-218c-4c7d-a8c4-cab08fde8a1d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:08.275345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de09970-c00e-45d1-8cda-faf8b4b6cc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=264353fcec3e4b47821833779cf988d2, user_id=363b2cb0ef934d4cbfbc3d80e51e10ae, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:08.278495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de09970-c00e-45d1-8cda-faf8b4b6cc74 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:08.333497 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2248/4504] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:07 2022] PUT /identity/v3/projects/264353fcec3e4b47821833779cf988d2/users/363b2cb0ef934d4cbfbc3d80e51e10ae/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:08.338879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4bd5e-a8cb-494c-8621-8f26cc352511 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:08.339483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4bd5e-a8cb-494c-8621-8f26cc352511 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:08.342121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4bd5e-a8cb-494c-8621-8f26cc352511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:08.383002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8b5e5449-218c-4c7d-a8c4-cab08fde8a1d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invalidating the token cache because role c58ed1495e164205a2b6ae44571721e4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:08.383291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8b5e5449-218c-4c7d-a8c4-cab08fde8a1d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:08.384236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8b5e5449-218c-4c7d-a8c4-cab08fde8a1d tempest-RolesV3TestJSON-1439603048 tempest-RolesV3TestJSON-1439603048-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:08.388988 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2257/4505] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:08 2022] DELETE /identity/v3/roles/c58ed1495e164205a2b6ae44571721e4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:08.390476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0675-475c-45c2-8a6c-636b8b153c51 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:08.390767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0675-475c-45c2-8a6c-636b8b153c51 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:08.391813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb0675-475c-45c2-8a6c-636b8b153c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:08.399279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ecc4bd5e-a8cb-494c-8621-8f26cc352511 None None] MFA Rules not processed for user `d4afb723d9a44a8284a518c8b2b2fec1`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:08.403593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ecc4bd5e-a8cb-494c-8621-8f26cc352511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:08.487289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8dbb0675-475c-45c2-8a6c-636b8b153c51 None None] MFA Rules not processed for user `363b2cb0ef934d4cbfbc3d80e51e10ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:08.491709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8dbb0675-475c-45c2-8a6c-636b8b153c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:08.582348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:08.687238 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2258/4506] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:08.693471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0675-475c-45c2-8a6c-636b8b153c51 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:08.694057 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2249/4507] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:08.695999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8dbb0675-475c-45c2-8a6c-636b8b153c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:08.700498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4bd5e-a8cb-494c-8621-8f26cc352511 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:08.702691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ecc4bd5e-a8cb-494c-8621-8f26cc352511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:08.930389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb0675-475c-45c2-8a6c-636b8b153c51 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:08.958553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e35b3-7654-4e5c-a788-52a1ed4e044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:08.959315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e35b3-7654-4e5c-a788-52a1ed4e044a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:08.959540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e35b3-7654-4e5c-a788-52a1ed4e044a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:08.959818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e35b3-7654-4e5c-a788-52a1ed4e044a admin admin] PATH_INFO: `/v3/users/dd825b8da7bf4d8daf0d6df94807f87d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:08.966781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e35b3-7654-4e5c-a788-52a1ed4e044a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd825b8da7bf4d8daf0d6df94807f87d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:08.968063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4bd5e-a8cb-494c-8621-8f26cc352511 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:08.970652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e35b3-7654-4e5c-a788-52a1ed4e044a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:09.005160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb06a85-a5ea-408f-b199-a263dac7c598 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:09.005747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb06a85-a5ea-408f-b199-a263dac7c598 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:09.006039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb06a85-a5ea-408f-b199-a263dac7c598 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:09.006323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb06a85-a5ea-408f-b199-a263dac7c598 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:09.028983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb06a85-a5ea-408f-b199-a263dac7c598 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:09.036434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb06a85-a5ea-408f-b199-a263dac7c598 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:09.073677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-236e35b3-7654-4e5c-a788-52a1ed4e044a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd825b8da7bf4d8daf0d6df94807f87d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:09.084987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:09.093975 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2250/4508] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:08:09.095049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-236e35b3-7654-4e5c-a788-52a1ed4e044a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd825b8da7bf4d8daf0d6df94807f87d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:09.097712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-236e35b3-7654-4e5c-a788-52a1ed4e044a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd825b8da7bf4d8daf0d6df94807f87d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:09.097923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb06a85-a5ea-408f-b199-a263dac7c598 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:09.102885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ecb06a85-a5ea-408f-b199-a263dac7c598 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:09.138800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-236e35b3-7654-4e5c-a788-52a1ed4e044a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd825b8da7bf4d8daf0d6df94807f87d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:09.143442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-236e35b3-7654-4e5c-a788-52a1ed4e044a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd825b8da7bf4d8daf0d6df94807f87d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:09.210933 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2259/4509] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:08 2022] DELETE /identity/v3/users/dd825b8da7bf4d8daf0d6df94807f87d => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:09.216681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab1ae0-a48e-4f53-a9bd-cfe0e44797f8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:09.217264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab1ae0-a48e-4f53-a9bd-cfe0e44797f8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:09.218020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab1ae0-a48e-4f53-a9bd-cfe0e44797f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:09.255899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-90ab1ae0-a48e-4f53-a9bd-cfe0e44797f8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:09.257166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-90ab1ae0-a48e-4f53-a9bd-cfe0e44797f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:09.333944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb06a85-a5ea-408f-b199-a263dac7c598 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:09.392620 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2260/4510] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:08:09.405064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab1ae0-a48e-4f53-a9bd-cfe0e44797f8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:09.406682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-90ab1ae0-a48e-4f53-a9bd-cfe0e44797f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:09.472498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7698d41-7a03-40de-b198-ef5bbf9371d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:09.473286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7698d41-7a03-40de-b198-ef5bbf9371d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:09.473856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7698d41-7a03-40de-b198-ef5bbf9371d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:09.474237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7698d41-7a03-40de-b198-ef5bbf9371d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:09.489061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f7698d41-7a03-40de-b198-ef5bbf9371d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:09.604136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab1ae0-a48e-4f53-a9bd-cfe0e44797f8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:09.634208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3276d-8a37-479b-b3e5-06d4864f563c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:09.635234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3276d-8a37-479b-b3e5-06d4864f563c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:09.635766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3276d-8a37-479b-b3e5-06d4864f563c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:09.636264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3276d-8a37-479b-b3e5-06d4864f563c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:09.656527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3276d-8a37-479b-b3e5-06d4864f563c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:09.658311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3276d-8a37-479b-b3e5-06d4864f563c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:09.690342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:09.701123 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2261/4511] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:08:09.702132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008a61f-f3f0-46e3-979c-3bf12b220f4a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:09.705110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008a61f-f3f0-46e3-979c-3bf12b220f4a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:09.706272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008a61f-f3f0-46e3-979c-3bf12b220f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:09.773088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d008a61f-f3f0-46e3-979c-3bf12b220f4a None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:09.774726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d008a61f-f3f0-46e3-979c-3bf12b220f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:09.895498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7698d41-7a03-40de-b198-ef5bbf9371d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:09.899711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7698d41-7a03-40de-b198-ef5bbf9371d4 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:09.934933 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2251/4512] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 840 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:10.048122 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2262/4513] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:08:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:10.062446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7698d41-7a03-40de-b198-ef5bbf9371d4 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:10.064354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f7698d41-7a03-40de-b198-ef5bbf9371d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:10.277073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7698d41-7a03-40de-b198-ef5bbf9371d4 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:10.297034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2316b35-7c6a-4cb1-a989-a1a1aca0e0db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:10.297979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2316b35-7c6a-4cb1-a989-a1a1aca0e0db service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:10.298371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2316b35-7c6a-4cb1-a989-a1a1aca0e0db service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:10.299005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2316b35-7c6a-4cb1-a989-a1a1aca0e0db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:10.323520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2316b35-7c6a-4cb1-a989-a1a1aca0e0db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:10.325553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2316b35-7c6a-4cb1-a989-a1a1aca0e0db service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:10.355123 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2252/4514] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:08:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:08:10.588004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6558c41-caf8-4a34-8d77-ace8a44a4669 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:10.588410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6558c41-caf8-4a34-8d77-ace8a44a4669 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:10.588410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6558c41-caf8-4a34-8d77-ace8a44a4669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:10.626215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e6558c41-caf8-4a34-8d77-ace8a44a4669 None None] MFA Rules not processed for user `363b2cb0ef934d4cbfbc3d80e51e10ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:10.627514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e6558c41-caf8-4a34-8d77-ace8a44a4669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:10.649503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:10.753608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7394-bef5-4500-b728-46d4bacee28c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:10.754027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7394-bef5-4500-b728-46d4bacee28c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:10.754483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b7394-bef5-4500-b728-46d4bacee28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:10.769325 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2263/4515] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:10.870292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9d3b7394-bef5-4500-b728-46d4bacee28c None None] MFA Rules not processed for user `9155e762ab8748539524b919f5ae6173`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:10.879456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9d3b7394-bef5-4500-b728-46d4bacee28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:11.059950 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2253/4516] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:11.061886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a57dd-3a43-42e9-9244-5c972b94b321 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:11.062341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a57dd-3a43-42e9-9244-5c972b94b321 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:11.064651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a57dd-3a43-42e9-9244-5c972b94b321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:11.145796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-964a57dd-3a43-42e9-9244-5c972b94b321 None None] MFA Rules not processed for user `9155e762ab8748539524b919f5ae6173`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:11.148832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-964a57dd-3a43-42e9-9244-5c972b94b321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:11.179005 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2264/4517] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:11.190505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b7394-bef5-4500-b728-46d4bacee28c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:11.194071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9d3b7394-bef5-4500-b728-46d4bacee28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:11.465686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:11.515513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b7394-bef5-4500-b728-46d4bacee28c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:11.530495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b42f0-7b72-499e-a821-5320391efcfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:11.531635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b42f0-7b72-499e-a821-5320391efcfc service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:11.531635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b42f0-7b72-499e-a821-5320391efcfc service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:11.531955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b42f0-7b72-499e-a821-5320391efcfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:11.552801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b42f0-7b72-499e-a821-5320391efcfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:11.556248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b42f0-7b72-499e-a821-5320391efcfc service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:11.580008 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2254/4518] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:11.594070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a57dd-3a43-42e9-9244-5c972b94b321 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:11.596182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-964a57dd-3a43-42e9-9244-5c972b94b321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:11.639965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a57dd-3a43-42e9-9244-5c972b94b321 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:11.658200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:11.658891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:11.661287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:11.663367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] PATH_INFO: `/v3/projects/5df14ed7cd6f4539b7b4807a8fe1628f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:11.665285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df14ed7cd6f4539b7b4807a8fe1628f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:11.667480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:11.838459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df14ed7cd6f4539b7b4807a8fe1628f', 'request_id': 'req-17ade3c2-4058-4e17-9c63-fdd0c82ed522'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:11.864647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df14ed7cd6f4539b7b4807a8fe1628f', 'request_id': 'req-17ade3c2-4058-4e17-9c63-fdd0c82ed522'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:11.868880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df14ed7cd6f4539b7b4807a8fe1628f', 'request_id': 'req-17ade3c2-4058-4e17-9c63-fdd0c82ed522'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:11.919701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] The token cache is being invalidate because project 5df14ed7cd6f4539b7b4807a8fe1628f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:11.919918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:11.930553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:11.936188 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2265/4519] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:11 2022] DELETE /identity/v3/projects/5df14ed7cd6f4539b7b4807a8fe1628f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:11.938686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30889f3-cb5e-41d8-9cf3-9292954082a8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:11.939216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30889f3-cb5e-41d8-9cf3-9292954082a8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:11.939674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30889f3-cb5e-41d8-9cf3-9292954082a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:11.942150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:11.957260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:11.995994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c30889f3-cb5e-41d8-9cf3-9292954082a8 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:12.002139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c30889f3-cb5e-41d8-9cf3-9292954082a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:12.197062 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2255/4520] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:08:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:08:12.211324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30889f3-cb5e-41d8-9cf3-9292954082a8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:12.213202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c30889f3-cb5e-41d8-9cf3-9292954082a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:12.241225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ade3c2-4058-4e17-9c63-fdd0c82ed522 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:12.271046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea15143-9f29-49a8-bf93-ffc417faa051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:12.272078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea15143-9f29-49a8-bf93-ffc417faa051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:12.272512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea15143-9f29-49a8-bf93-ffc417faa051 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:12.273447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea15143-9f29-49a8-bf93-ffc417faa051 admin admin] PATH_INFO: `/v3/users/4672e86e05e64af6b2d1ae5871a04aa3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:12.286094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea15143-9f29-49a8-bf93-ffc417faa051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4672e86e05e64af6b2d1ae5871a04aa3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:12.288981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea15143-9f29-49a8-bf93-ffc417faa051 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:12.422717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:12.435877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30889f3-cb5e-41d8-9cf3-9292954082a8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:12.436394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3ea15143-9f29-49a8-bf93-ffc417faa051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4672e86e05e64af6b2d1ae5871a04aa3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:12.449588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb4a77-1cd7-4237-b1f2-048a2c80ad69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:12.450252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb4a77-1cd7-4237-b1f2-048a2c80ad69 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:12.450521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb4a77-1cd7-4237-b1f2-048a2c80ad69 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:12.453842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb4a77-1cd7-4237-b1f2-048a2c80ad69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:12.462926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3ea15143-9f29-49a8-bf93-ffc417faa051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4672e86e05e64af6b2d1ae5871a04aa3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:12.463840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3ea15143-9f29-49a8-bf93-ffc417faa051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4672e86e05e64af6b2d1ae5871a04aa3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:12.481246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb4a77-1cd7-4237-b1f2-048a2c80ad69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:12.484961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3ea15143-9f29-49a8-bf93-ffc417faa051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4672e86e05e64af6b2d1ae5871a04aa3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:12.485995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3ea15143-9f29-49a8-bf93-ffc417faa051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4672e86e05e64af6b2d1ae5871a04aa3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:12.488044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb4a77-1cd7-4237-b1f2-048a2c80ad69 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:12.514185 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2256/4521] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:08:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:08:12.638826 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2266/4522] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:11 2022] DELETE /identity/v3/users/4672e86e05e64af6b2d1ae5871a04aa3 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:12.754360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb4a77-1cd7-4237-b1f2-048a2c80ad69 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:12.756554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f5cb4a77-1cd7-4237-b1f2-048a2c80ad69 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:12.799730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb4a77-1cd7-4237-b1f2-048a2c80ad69 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:12.976989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:12.977663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:12.977950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:12.978231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] PATH_INFO: `/v3/users/363b2cb0ef934d4cbfbc3d80e51e10ae` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:12.985680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=363b2cb0ef934d4cbfbc3d80e51e10ae)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:12.988410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:13.034275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:13.117861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363b2cb0ef934d4cbfbc3d80e51e10ae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:13.151134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363b2cb0ef934d4cbfbc3d80e51e10ae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:13.152190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363b2cb0ef934d4cbfbc3d80e51e10ae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:13.212324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363b2cb0ef934d4cbfbc3d80e51e10ae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:13.214150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363b2cb0ef934d4cbfbc3d80e51e10ae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:13.273472 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2257/4523] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:12 2022] DELETE /identity/v3/users/363b2cb0ef934d4cbfbc3d80e51e10ae => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:13.280998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d5fd6-7ba0-4a4c-b1c3-9e4e51022f36 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:13.281398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d5fd6-7ba0-4a4c-b1c3-9e4e51022f36 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:13.281746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d5fd6-7ba0-4a4c-b1c3-9e4e51022f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:13.352108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-928d5fd6-7ba0-4a4c-b1c3-9e4e51022f36 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:13.362500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-928d5fd6-7ba0-4a4c-b1c3-9e4e51022f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:13.604454 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2267/4524] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:13.655883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:13.658094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:13.838053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80074646-6dae-4639-aa45-f4a8de3f05e1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:13.862664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f3f25-5312-45de-9c2e-739c1e69cea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:13.863501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f3f25-5312-45de-9c2e-739c1e69cea0 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:13.863798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f3f25-5312-45de-9c2e-739c1e69cea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:13.864081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f3f25-5312-45de-9c2e-739c1e69cea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:13.908182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f3f25-5312-45de-9c2e-739c1e69cea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:13.914246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f3f25-5312-45de-9c2e-739c1e69cea0 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:13.967531 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2258/4525] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:14.061567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d5fd6-7ba0-4a4c-b1c3-9e4e51022f36 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:14.063302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-928d5fd6-7ba0-4a4c-b1c3-9e4e51022f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:14.090562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d5fd6-7ba0-4a4c-b1c3-9e4e51022f36 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:14.104701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:14.106523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:14.108087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:14.108428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a admin admin] PATH_INFO: `/v3/projects/72098cd5952c4f4a8901e3e054bea789` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:14.113187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=72098cd5952c4f4a8901e3e054bea789)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:14.118659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:14.291521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72098cd5952c4f4a8901e3e054bea789', 'request_id': 'req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:14.327723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72098cd5952c4f4a8901e3e054bea789', 'request_id': 'req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:14.353992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72098cd5952c4f4a8901e3e054bea789', 'request_id': 'req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:14.393072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a admin admin] The token cache is being invalidate because project 72098cd5952c4f4a8901e3e054bea789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:14.393382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:14.395391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7534a8db-5a57-4800-b892-1ba3a5d7fd7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:14.400379 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2268/4526] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:14 2022] DELETE /identity/v3/projects/72098cd5952c4f4a8901e3e054bea789 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:08:14.406267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28420ed5-b253-4fe7-a627-f4d86cc553ad None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:14.407134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28420ed5-b253-4fe7-a627-f4d86cc553ad None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:14.408064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28420ed5-b253-4fe7-a627-f4d86cc553ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:14.457863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-28420ed5-b253-4fe7-a627-f4d86cc553ad None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:14.462794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28420ed5-b253-4fe7-a627-f4d86cc553ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:14.761251 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2259/4527] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:14.761927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336a8d3-6da3-4735-8eaa-3e9edff43dbf None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:14.761927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336a8d3-6da3-4735-8eaa-3e9edff43dbf None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:14.762212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336a8d3-6da3-4735-8eaa-3e9edff43dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:14.810097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e336a8d3-6da3-4735-8eaa-3e9edff43dbf None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:14.812744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e336a8d3-6da3-4735-8eaa-3e9edff43dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:14.853691 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2269/4528] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:14.855822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28420ed5-b253-4fe7-a627-f4d86cc553ad None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:14.884961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28420ed5-b253-4fe7-a627-f4d86cc553ad None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:14.903102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac151e3-bf20-40fe-a047-e5d79450f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:14.903663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac151e3-bf20-40fe-a047-e5d79450f3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:14.903944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac151e3-bf20-40fe-a047-e5d79450f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:14.904221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac151e3-bf20-40fe-a047-e5d79450f3a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:14.904892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac151e3-bf20-40fe-a047-e5d79450f3a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:08:14.905198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac151e3-bf20-40fe-a047-e5d79450f3a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:14.913708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac151e3-bf20-40fe-a047-e5d79450f3a1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:14.968095 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2260/4529] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:08:14.973777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336a8d3-6da3-4735-8eaa-3e9edff43dbf None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:14.996164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336a8d3-6da3-4735-8eaa-3e9edff43dbf None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:15.042795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115cb06-30b1-4fff-9f0a-5fa026c9735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:15.045643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115cb06-30b1-4fff-9f0a-5fa026c9735c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:15.047130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115cb06-30b1-4fff-9f0a-5fa026c9735c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:15.047448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115cb06-30b1-4fff-9f0a-5fa026c9735c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:15.049288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115cb06-30b1-4fff-9f0a-5fa026c9735c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:15.069340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115cb06-30b1-4fff-9f0a-5fa026c9735c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:15.187328 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2270/4530] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:14 2022] POST /identity/v3/projects => generated 371 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:15.191963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac151e3-bf20-40fe-a047-e5d79450f3a1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:15.209470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac151e3-bf20-40fe-a047-e5d79450f3a1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:15.244383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:15.415183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc6e2d-b5ca-4861-aa85-575be98aa5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:15.416594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6e2d-b5ca-4861-aa85-575be98aa5aa admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:15.418763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6e2d-b5ca-4861-aa85-575be98aa5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:15.419828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc6e2d-b5ca-4861-aa85-575be98aa5aa admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:15.423543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc6e2d-b5ca-4861-aa85-575be98aa5aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:15.429539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc6e2d-b5ca-4861-aa85-575be98aa5aa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:15.506495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115cb06-30b1-4fff-9f0a-5fa026c9735c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:15.508771 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2261/4531] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:15 2022] POST /identity/v3/users => generated 286 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:08:15.531635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115cb06-30b1-4fff-9f0a-5fa026c9735c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:15.547995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c9947-5020-476d-b225-14ea1f44a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:15.548631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c9947-5020-476d-b225-14ea1f44a89d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:15.548912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c9947-5020-476d-b225-14ea1f44a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:15.549186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c9947-5020-476d-b225-14ea1f44a89d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:15.549967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c9947-5020-476d-b225-14ea1f44a89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:15.556485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c9947-5020-476d-b225-14ea1f44a89d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:15.630314 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2271/4532] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:08:15.634879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc6e2d-b5ca-4861-aa85-575be98aa5aa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:15.670545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc6e2d-b5ca-4861-aa85-575be98aa5aa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:15.687309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48124d96-55ea-49af-a028-6d488629e940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:15.688229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124d96-55ea-49af-a028-6d488629e940 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:15.690494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124d96-55ea-49af-a028-6d488629e940 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:15.691164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48124d96-55ea-49af-a028-6d488629e940 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:15.692250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48124d96-55ea-49af-a028-6d488629e940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:15.696186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48124d96-55ea-49af-a028-6d488629e940 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:15.784750 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2262/4533] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:08:15.789212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c9947-5020-476d-b225-14ea1f44a89d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:15.796182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:15.806066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48124d96-55ea-49af-a028-6d488629e940 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:15.812726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-48124d96-55ea-49af-a028-6d488629e940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:15.819020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c9947-5020-476d-b225-14ea1f44a89d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:15.839495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7f305-48b6-41fe-9ffc-f94b55534a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:15.845783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f305-48b6-41fe-9ffc-f94b55534a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:15.846422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f305-48b6-41fe-9ffc-f94b55534a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:15.846976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f305-48b6-41fe-9ffc-f94b55534a2d admin admin] PATH_INFO: `/v3/projects/0509e5c37f17425d8a763cae56bea13e/users/f9a4260ba35a42c69d315e553ce38cc7/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:15.892366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48124d96-55ea-49af-a028-6d488629e940 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:15.918289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4df40-b673-4e63-9342-6ef67962cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:15.920588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4df40-b673-4e63-9342-6ef67962cf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:15.922713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4df40-b673-4e63-9342-6ef67962cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:15.923586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4df40-b673-4e63-9342-6ef67962cf3f admin admin] PATH_INFO: `/v3/projects/264353fcec3e4b47821833779cf988d2` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:15.928605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4df40-b673-4e63-9342-6ef67962cf3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=264353fcec3e4b47821833779cf988d2)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:15.938078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4df40-b673-4e63-9342-6ef67962cf3f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:15.942967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7f305-48b6-41fe-9ffc-f94b55534a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0509e5c37f17425d8a763cae56bea13e, user_id=f9a4260ba35a42c69d315e553ce38cc7, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:15.954906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7f305-48b6-41fe-9ffc-f94b55534a2d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:16.011041 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2272/4534] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:15 2022] PUT /identity/v3/projects/0509e5c37f17425d8a763cae56bea13e/users/f9a4260ba35a42c69d315e553ce38cc7/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:08:16.020854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc22b1-03e3-4277-b461-2e3c42f9ad7f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:16.022869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc22b1-03e3-4277-b461-2e3c42f9ad7f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:16.023318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc22b1-03e3-4277-b461-2e3c42f9ad7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:16.145535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b4fc22b1-03e3-4277-b461-2e3c42f9ad7f None None] MFA Rules not processed for user `f9a4260ba35a42c69d315e553ce38cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:16.146812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b4fc22b1-03e3-4277-b461-2e3c42f9ad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:16.178613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-89c4df40-b673-4e63-9342-6ef67962cf3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264353fcec3e4b47821833779cf988d2', 'request_id': 'req-89c4df40-b673-4e63-9342-6ef67962cf3f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:16.194805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-89c4df40-b673-4e63-9342-6ef67962cf3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264353fcec3e4b47821833779cf988d2', 'request_id': 'req-89c4df40-b673-4e63-9342-6ef67962cf3f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:16.213367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-89c4df40-b673-4e63-9342-6ef67962cf3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264353fcec3e4b47821833779cf988d2', 'request_id': 'req-89c4df40-b673-4e63-9342-6ef67962cf3f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:16.260042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-89c4df40-b673-4e63-9342-6ef67962cf3f admin admin] The token cache is being invalidate because project 264353fcec3e4b47821833779cf988d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:16.260391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-89c4df40-b673-4e63-9342-6ef67962cf3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:16.264484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-89c4df40-b673-4e63-9342-6ef67962cf3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:16.274231 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2263/4535] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:15 2022] DELETE /identity/v3/projects/264353fcec3e4b47821833779cf988d2 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:16.276073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06904c-a614-4fd4-bb93-f3e129767993 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:16.276401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06904c-a614-4fd4-bb93-f3e129767993 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:16.276673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06904c-a614-4fd4-bb93-f3e129767993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:16.352365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5b06904c-a614-4fd4-bb93-f3e129767993 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:16.355461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5b06904c-a614-4fd4-bb93-f3e129767993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:16.433533 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2273/4536] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:16.436858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc22b1-03e3-4277-b461-2e3c42f9ad7f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:16.440177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b4fc22b1-03e3-4277-b461-2e3c42f9ad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:16.653496 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2264/4537] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:16.657198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f042b38-4c78-4bd1-aea5-7a62203177b4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:16.659955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f042b38-4c78-4bd1-aea5-7a62203177b4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:16.660503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f042b38-4c78-4bd1-aea5-7a62203177b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:16.739468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8f042b38-4c78-4bd1-aea5-7a62203177b4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:16.741349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8f042b38-4c78-4bd1-aea5-7a62203177b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:16.744501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc22b1-03e3-4277-b461-2e3c42f9ad7f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:16.767925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d6ae7-7996-4386-9338-179731444004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:16.780958 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2265/4538] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:16.781125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d6ae7-7996-4386-9338-179731444004 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:16.781516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d6ae7-7996-4386-9338-179731444004 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:16.781657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d6ae7-7996-4386-9338-179731444004 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:16.786813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d6ae7-7996-4386-9338-179731444004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:16.789666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f042b38-4c78-4bd1-aea5-7a62203177b4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:16.794204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d6ae7-7996-4386-9338-179731444004 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:16.844626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f042b38-4c78-4bd1-aea5-7a62203177b4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:16.863241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9dba7b-a440-4f85-aacd-35083acb85ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:16.865709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dba7b-a440-4f85-aacd-35083acb85ed admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:16.866107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dba7b-a440-4f85-aacd-35083acb85ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:16.867083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dba7b-a440-4f85-aacd-35083acb85ed admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:16.870896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9dba7b-a440-4f85-aacd-35083acb85ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:08:16.871429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9dba7b-a440-4f85-aacd-35083acb85ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:16.873222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9dba7b-a440-4f85-aacd-35083acb85ed admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:16.898503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:16.914205 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2266/4539] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:16.915525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9dba7b-a440-4f85-aacd-35083acb85ed admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:16.921489 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2274/4540] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:16 2022] POST /identity/v3/projects => generated 369 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:16.930832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d6ae7-7996-4386-9338-179731444004 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:16.946004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9dba7b-a440-4f85-aacd-35083acb85ed admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:17.237188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba9450-8769-4e26-8477-fa731bb46953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:17.244192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba9450-8769-4e26-8477-fa731bb46953 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:17.244490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba9450-8769-4e26-8477-fa731bb46953 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:17.245072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba9450-8769-4e26-8477-fa731bb46953 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:17.245610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba9450-8769-4e26-8477-fa731bb46953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:17.257775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:17.263993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba9450-8769-4e26-8477-fa731bb46953 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:17.275452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d6ae7-7996-4386-9338-179731444004 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:17.281168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4815f-32df-4c9b-afad-70e6513ec5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:17.281906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4815f-32df-4c9b-afad-70e6513ec5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:17.282269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4815f-32df-4c9b-afad-70e6513ec5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:17.286675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4815f-32df-4c9b-afad-70e6513ec5a6 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:17.287905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4815f-32df-4c9b-afad-70e6513ec5a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:17.295850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4815f-32df-4c9b-afad-70e6513ec5a6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:17.360393 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2267/4541] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:16 2022] POST /identity/v3/projects => generated 381 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:17.361791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba9450-8769-4e26-8477-fa731bb46953 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:17.372160 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2275/4542] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:16 2022] POST /identity/v3/users => generated 291 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:17.373157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4815f-32df-4c9b-afad-70e6513ec5a6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:17.401553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4815f-32df-4c9b-afad-70e6513ec5a6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:17.575014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa973dbf-2653-425f-a8ee-4fb494b3f052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:17.575689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa973dbf-2653-425f-a8ee-4fb494b3f052 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:17.575980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa973dbf-2653-425f-a8ee-4fb494b3f052 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:17.577091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa973dbf-2653-425f-a8ee-4fb494b3f052 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:17.577788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa973dbf-2653-425f-a8ee-4fb494b3f052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:17.584391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa973dbf-2653-425f-a8ee-4fb494b3f052 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:17.591500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba9450-8769-4e26-8477-fa731bb46953 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:17.608369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db282e1-e228-499c-81f3-0264b497b09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:17.609011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db282e1-e228-499c-81f3-0264b497b09b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:17.609295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db282e1-e228-499c-81f3-0264b497b09b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:17.609572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db282e1-e228-499c-81f3-0264b497b09b admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:17.610484 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2276/4543] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:17.611235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db282e1-e228-499c-81f3-0264b497b09b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:17.613286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db282e1-e228-499c-81f3-0264b497b09b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:17.617273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa973dbf-2653-425f-a8ee-4fb494b3f052 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:17.661825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa973dbf-2653-425f-a8ee-4fb494b3f052 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:17.673443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834611c-ca9b-41db-895e-4803a62f4f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:17.676399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834611c-ca9b-41db-895e-4803a62f4f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:17.677704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834611c-ca9b-41db-895e-4803a62f4f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:17.677704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834611c-ca9b-41db-895e-4803a62f4f07 admin admin] PATH_INFO: `/v3/projects/5a62d3ea47e94676bee4434ea6baebb1/users/7a4abdd9df6446509c0f3c4808b9dca0/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:17.686033 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2268/4544] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:17 2022] POST /identity/v3/users => generated 291 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:17.701484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db282e1-e228-499c-81f3-0264b497b09b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:17.724814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834611c-ca9b-41db-895e-4803a62f4f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a62d3ea47e94676bee4434ea6baebb1, user_id=7a4abdd9df6446509c0f3c4808b9dca0, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:17.731913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834611c-ca9b-41db-895e-4803a62f4f07 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:17.750354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db282e1-e228-499c-81f3-0264b497b09b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:17.774298 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2277/4545] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:17 2022] PUT /identity/v3/projects/5a62d3ea47e94676bee4434ea6baebb1/users/7a4abdd9df6446509c0f3c4808b9dca0/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:17.775680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834611c-ca9b-41db-895e-4803a62f4f07 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:17.869116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834611c-ca9b-41db-895e-4803a62f4f07 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:17.876204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3d387-8851-412a-8724-a8d6213ac809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:17.876840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3d387-8851-412a-8724-a8d6213ac809 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:17.877122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3d387-8851-412a-8724-a8d6213ac809 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:17.877399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3d387-8851-412a-8724-a8d6213ac809 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:17.879594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3d387-8851-412a-8724-a8d6213ac809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:17.881538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3d387-8851-412a-8724-a8d6213ac809 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:17.902723 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2278/4546] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:17.904631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3d387-8851-412a-8724-a8d6213ac809 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:17.927038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3d387-8851-412a-8724-a8d6213ac809 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:17.943998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef0785-7bdb-4c2f-96ed-75cefc8d4bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:17.945059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef0785-7bdb-4c2f-96ed-75cefc8d4bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:17.945344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef0785-7bdb-4c2f-96ed-75cefc8d4bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:17.945621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef0785-7bdb-4c2f-96ed-75cefc8d4bb9 admin admin] PATH_INFO: `/v3/projects/5a62d3ea47e94676bee4434ea6baebb1/users/7a4abdd9df6446509c0f3c4808b9dca0/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:17.950971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef0785-7bdb-4c2f-96ed-75cefc8d4bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a62d3ea47e94676bee4434ea6baebb1, user_id=7a4abdd9df6446509c0f3c4808b9dca0, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:17.960771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef0785-7bdb-4c2f-96ed-75cefc8d4bb9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:17.992035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705f08f-4ab6-4ed8-a08d-d99933f30324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:17.992781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f08f-4ab6-4ed8-a08d-d99933f30324 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:17.992989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f08f-4ab6-4ed8-a08d-d99933f30324 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:17.993227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f08f-4ab6-4ed8-a08d-d99933f30324 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:17.996801 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2279/4547] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:17 2022] PUT /identity/v3/projects/5a62d3ea47e94676bee4434ea6baebb1/users/7a4abdd9df6446509c0f3c4808b9dca0/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:18.009228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a4c8c-24c9-4e47-88ef-7230abd2b54e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:18.009523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a4c8c-24c9-4e47-88ef-7230abd2b54e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:18.009806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a4c8c-24c9-4e47-88ef-7230abd2b54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:18.024204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705f08f-4ab6-4ed8-a08d-d99933f30324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:18.028567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705f08f-4ab6-4ed8-a08d-d99933f30324 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:18.081657 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2269/4548] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:18.084907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705f08f-4ab6-4ed8-a08d-d99933f30324 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:18.099459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-025a4c8c-24c9-4e47-88ef-7230abd2b54e None None] MFA Rules not processed for user `7a4abdd9df6446509c0f3c4808b9dca0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:18.108564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-025a4c8c-24c9-4e47-88ef-7230abd2b54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:18.117029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705f08f-4ab6-4ed8-a08d-d99933f30324 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:18.149458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:18.260279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:18.442476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631f15f-ec41-48ff-b998-5d821b737beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:18.447630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631f15f-ec41-48ff-b998-5d821b737beb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:18.447969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631f15f-ec41-48ff-b998-5d821b737beb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:18.448255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631f15f-ec41-48ff-b998-5d821b737beb admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:18.449005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631f15f-ec41-48ff-b998-5d821b737beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:18.458459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631f15f-ec41-48ff-b998-5d821b737beb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:18.506919 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2280/4549] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:08:18.508714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a4c8c-24c9-4e47-88ef-7230abd2b54e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:18.518292 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2270/4550] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:18.523305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631f15f-ec41-48ff-b998-5d821b737beb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:18.547041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a4c8c-24c9-4e47-88ef-7230abd2b54e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:18.568043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e1f79-7d97-4207-8ab3-74d80d4105d7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4abdd9df6446509c0f3c4808b9dca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a62d3ea47e94676bee4434ea6baebb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:18.568862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e1f79-7d97-4207-8ab3-74d80d4105d7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:18.569464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e1f79-7d97-4207-8ab3-74d80d4105d7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:18.569788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e1f79-7d97-4207-8ab3-74d80d4105d7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:18.571544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631f15f-ec41-48ff-b998-5d821b737beb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:18.573205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e1f79-7d97-4207-8ab3-74d80d4105d7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:18.578462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e1f79-7d97-4207-8ab3-74d80d4105d7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:18.592006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789425c-1b92-4927-b659-47181ade409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:18.593937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789425c-1b92-4927-b659-47181ade409d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:18.594226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789425c-1b92-4927-b659-47181ade409d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:18.596568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789425c-1b92-4927-b659-47181ade409d admin admin] PATH_INFO: `/v3/projects/f531b7ab75c44eedad1ed3049c3a6256/users/aea6cb1e544e4a1099be85a8f58e6b2d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:18.655806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789425c-1b92-4927-b659-47181ade409d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f531b7ab75c44eedad1ed3049c3a6256, user_id=aea6cb1e544e4a1099be85a8f58e6b2d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:18.701179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789425c-1b92-4927-b659-47181ade409d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:18.750968 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2281/4551] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:18 2022] POST /identity/v3/projects => generated 359 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:18.755861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e1f79-7d97-4207-8ab3-74d80d4105d7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:18.787735 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2271/4552] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:18 2022] PUT /identity/v3/projects/f531b7ab75c44eedad1ed3049c3a6256/users/aea6cb1e544e4a1099be85a8f58e6b2d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:08:18.798478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143effe-1335-462b-90b7-b15268f926ee None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:18.798913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143effe-1335-462b-90b7-b15268f926ee None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:18.799296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143effe-1335-462b-90b7-b15268f926ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:18.907735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c143effe-1335-462b-90b7-b15268f926ee None None] MFA Rules not processed for user `aea6cb1e544e4a1099be85a8f58e6b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:18.913649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c143effe-1335-462b-90b7-b15268f926ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:19.059455 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2272/4553] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:19.081274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143effe-1335-462b-90b7-b15268f926ee None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:19.084374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c143effe-1335-462b-90b7-b15268f926ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:19.084544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e1f79-7d97-4207-8ab3-74d80d4105d7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:19.278023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b05064-8687-407e-8311-9b6852d09ef9 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4abdd9df6446509c0f3c4808b9dca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a62d3ea47e94676bee4434ea6baebb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:19.278703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b05064-8687-407e-8311-9b6852d09ef9 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:19.280168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b05064-8687-407e-8311-9b6852d09ef9 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:19.280452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b05064-8687-407e-8311-9b6852d09ef9 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:19.281119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b05064-8687-407e-8311-9b6852d09ef9 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:19.289149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b05064-8687-407e-8311-9b6852d09ef9 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:19.340755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143effe-1335-462b-90b7-b15268f926ee None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:19.361754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865ae8f-cd51-4cfa-b07d-ae7067a26cd2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:19.376892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865ae8f-cd51-4cfa-b07d-ae7067a26cd2 service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:19.377269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865ae8f-cd51-4cfa-b07d-ae7067a26cd2 service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:19.377713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865ae8f-cd51-4cfa-b07d-ae7067a26cd2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:19.383132 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2282/4554] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:18 2022] POST /identity/v3/users => generated 371 bytes in 625 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:19.387482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b05064-8687-407e-8311-9b6852d09ef9 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:19.427640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865ae8f-cd51-4cfa-b07d-ae7067a26cd2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:19.429390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865ae8f-cd51-4cfa-b07d-ae7067a26cd2 service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:19.438137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b05064-8687-407e-8311-9b6852d09ef9 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:19.465791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583680a8-51f6-4d19-b259-d4f74e53d94f tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4abdd9df6446509c0f3c4808b9dca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a62d3ea47e94676bee4434ea6baebb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:19.466430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583680a8-51f6-4d19-b259-d4f74e53d94f tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:19.471022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583680a8-51f6-4d19-b259-d4f74e53d94f tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:19.471663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583680a8-51f6-4d19-b259-d4f74e53d94f tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:19.477603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583680a8-51f6-4d19-b259-d4f74e53d94f tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:08:19.477918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583680a8-51f6-4d19-b259-d4f74e53d94f tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:19.479766 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2273/4555] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:08:19.484750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583680a8-51f6-4d19-b259-d4f74e53d94f tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:19.553269 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2283/4556] 10.222.0.70 () {58 vars in 1157 bytes} [Sun Aug 28 19:08:19 2022] GET /identity/v3/users?domain_id=default => generated 8587 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:19.557892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865ae8f-cd51-4cfa-b07d-ae7067a26cd2 service glance] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:19.591915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583680a8-51f6-4d19-b259-d4f74e53d94f tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:19.594620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-583680a8-51f6-4d19-b259-d4f74e53d94f tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:19.604412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865ae8f-cd51-4cfa-b07d-ae7067a26cd2 service glance] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:19.630293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb5235-0829-4378-9691-b01c259c4bcf tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4abdd9df6446509c0f3c4808b9dca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a62d3ea47e94676bee4434ea6baebb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:19.630982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb5235-0829-4378-9691-b01c259c4bcf tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:19.631268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb5235-0829-4378-9691-b01c259c4bcf tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:19.631546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb5235-0829-4378-9691-b01c259c4bcf tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] PATH_INFO: `/v3/users/1af178956eaa4f948dc8995abaa90d2b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:19.655982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:19.683713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:19.770153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb5235-0829-4378-9691-b01c259c4bcf tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorizing `identity:update_user(user_id=1af178956eaa4f948dc8995abaa90d2b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:19.776298 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-63bb5235-0829-4378-9691-b01c259c4bcf tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:08:19.776298 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:08:19.776298 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:08:19.777833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb5235-0829-4378-9691-b01c259c4bcf tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:19.810900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583680a8-51f6-4d19-b259-d4f74e53d94f tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:19.823799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb2abb-6b81-4ec8-a5cd-0f7ee3ffb283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:19.824618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb2abb-6b81-4ec8-a5cd-0f7ee3ffb283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:19.825004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb2abb-6b81-4ec8-a5cd-0f7ee3ffb283 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:19.825381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb2abb-6b81-4ec8-a5cd-0f7ee3ffb283 admin admin] PATH_INFO: `/v3/users/e17a61c4304c430ba2fc4d3f7455f9e4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:19.828808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb2abb-6b81-4ec8-a5cd-0f7ee3ffb283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17a61c4304c430ba2fc4d3f7455f9e4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:19.845590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb2abb-6b81-4ec8-a5cd-0f7ee3ffb283 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:19.981528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-63bb5235-0829-4378-9691-b01c259c4bcf tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1af178956eaa4f948dc8995abaa90d2b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:20.002214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b1eb2abb-6b81-4ec8-a5cd-0f7ee3ffb283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17a61c4304c430ba2fc4d3f7455f9e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:20.012785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-63bb5235-0829-4378-9691-b01c259c4bcf tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invalidating the token cache because user 1af178956eaa4f948dc8995abaa90d2b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:20.013145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-63bb5235-0829-4378-9691-b01c259c4bcf tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:20.013773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-63bb5235-0829-4378-9691-b01c259c4bcf tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:20.021228 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2274/4557] 10.222.0.70 () {60 vars in 1244 bytes} [Sun Aug 28 19:08:19 2022] PATCH /identity/v3/users/1af178956eaa4f948dc8995abaa90d2b => generated 485 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:20.022722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b278bf1-932a-44e1-8439-775cf7e7ba0e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:20.023038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b278bf1-932a-44e1-8439-775cf7e7ba0e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:20.023321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b278bf1-932a-44e1-8439-775cf7e7ba0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:20.033048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b1eb2abb-6b81-4ec8-a5cd-0f7ee3ffb283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17a61c4304c430ba2fc4d3f7455f9e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:20.037637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b1eb2abb-6b81-4ec8-a5cd-0f7ee3ffb283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17a61c4304c430ba2fc4d3f7455f9e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:20.084437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b1eb2abb-6b81-4ec8-a5cd-0f7ee3ffb283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17a61c4304c430ba2fc4d3f7455f9e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:20.085195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b1eb2abb-6b81-4ec8-a5cd-0f7ee3ffb283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17a61c4304c430ba2fc4d3f7455f9e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:20.118867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6b278bf1-932a-44e1-8439-775cf7e7ba0e None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:20.125393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6b278bf1-932a-44e1-8439-775cf7e7ba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:20.150260 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2284/4558] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:19 2022] DELETE /identity/v3/users/e17a61c4304c430ba2fc4d3f7455f9e4 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:20.152120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f39037-974d-4d7c-b8f2-24f399e59ce7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:20.152833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f39037-974d-4d7c-b8f2-24f399e59ce7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:20.153466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f39037-974d-4d7c-b8f2-24f399e59ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:20.220255 n-d-854118-7 devstack@keystone.service[88375]: WARNING keystone.auth.plugins.core [None req-91f39037-974d-4d7c-b8f2-24f399e59ce7 None None] User is disabled: 1af178956eaa4f948dc8995abaa90d2b: AssertionError: User is disabled: 1af178956eaa4f948dc8995abaa90d2b Aug 28 19:08:20.238868 n-d-854118-7 devstack@keystone.service[88375]: WARNING keystone.server.flask.application [None req-91f39037-974d-4d7c-b8f2-24f399e59ce7 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.70: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 19:08:20.245962 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2285/4559] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:20 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 95 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 19:08:20.251015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3d2bc-d8bb-49c5-9742-ed8a362d80b7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:20.251633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3d2bc-d8bb-49c5-9742-ed8a362d80b7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:20.253757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3d2bc-d8bb-49c5-9742-ed8a362d80b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:20.326640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f8a3d2bc-d8bb-49c5-9742-ed8a362d80b7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:20.333342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f8a3d2bc-d8bb-49c5-9742-ed8a362d80b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:20.338765 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2275/4560] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:08:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:20.340036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b278bf1-932a-44e1-8439-775cf7e7ba0e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:20.350689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6b278bf1-932a-44e1-8439-775cf7e7ba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:20.417134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b278bf1-932a-44e1-8439-775cf7e7ba0e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:20.567109 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2286/4561] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:20.568133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3d2bc-d8bb-49c5-9742-ed8a362d80b7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:20.572850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f8a3d2bc-d8bb-49c5-9742-ed8a362d80b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:20.618567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4abdd9df6446509c0f3c4808b9dca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a62d3ea47e94676bee4434ea6baebb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:20.620787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:20.621458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:20.621995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] PATH_INFO: `/v3/users/1af178956eaa4f948dc8995abaa90d2b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:20.657330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1af178956eaa4f948dc8995abaa90d2b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:20.659844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:20.728728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:20.765217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af178956eaa4f948dc8995abaa90d2b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:20.780294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af178956eaa4f948dc8995abaa90d2b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:20.781351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af178956eaa4f948dc8995abaa90d2b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:20.784699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3d2bc-d8bb-49c5-9742-ed8a362d80b7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:20.791303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dda39-c9ac-471c-9609-66a57000c653 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:20.791942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dda39-c9ac-471c-9609-66a57000c653 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:20.792436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dda39-c9ac-471c-9609-66a57000c653 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:20.792722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dda39-c9ac-471c-9609-66a57000c653 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:20.795984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=9 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:20.810493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af178956eaa4f948dc8995abaa90d2b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:20.813224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af178956eaa4f948dc8995abaa90d2b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:20.859204 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2276/4562] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:20 2022] DELETE /identity/v3/users/1af178956eaa4f948dc8995abaa90d2b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:20.860025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:20.868245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:20.957978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dda39-c9ac-471c-9609-66a57000c653 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:20.960780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dda39-c9ac-471c-9609-66a57000c653 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:20.988504 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2287/4563] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:08:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:08:20.991620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dda39-c9ac-471c-9609-66a57000c653 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:21.021884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78104e4-1372-4ab4-9dbd-f0d46bee8026 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:21.027026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dda39-c9ac-471c-9609-66a57000c653 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:21.043368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984e6e-a63c-4899-a564-80677980c653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:21.045703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984e6e-a63c-4899-a564-80677980c653 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:21.050694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984e6e-a63c-4899-a564-80677980c653 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:21.051185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2984e6e-a63c-4899-a564-80677980c653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:21.058483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a2984e6e-a63c-4899-a564-80677980c653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:21.290599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4abdd9df6446509c0f3c4808b9dca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a62d3ea47e94676bee4434ea6baebb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:21.291561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:21.293406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:21.293823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] PATH_INFO: `/v3/projects/2fd403cb9f3d457e8a0c3e1a30613e75` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:21.298877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2fd403cb9f3d457e8a0c3e1a30613e75)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:21.304018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:21.332158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2984e6e-a63c-4899-a564-80677980c653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:21.334143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2984e6e-a63c-4899-a564-80677980c653 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:21.371212 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2277/4564] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:21.486004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd403cb9f3d457e8a0c3e1a30613e75', 'request_id': 'req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:21.505968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd403cb9f3d457e8a0c3e1a30613e75', 'request_id': 'req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:21.523705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd403cb9f3d457e8a0c3e1a30613e75', 'request_id': 'req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:21.588478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] The token cache is being invalidate because project 2fd403cb9f3d457e8a0c3e1a30613e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:21.588767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:21.601954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:21.611519 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2288/4565] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:20 2022] DELETE /identity/v3/projects/2fd403cb9f3d457e8a0c3e1a30613e75 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:21.619992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984e6e-a63c-4899-a564-80677980c653 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:21.622494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a2984e6e-a63c-4899-a564-80677980c653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:21.646769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2984e6e-a63c-4899-a564-80677980c653 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:21.862555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c74c1-ec6a-447d-87b0-79d54dffedd7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4abdd9df6446509c0f3c4808b9dca0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a62d3ea47e94676bee4434ea6baebb1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:21.863488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c74c1-ec6a-447d-87b0-79d54dffedd7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:21.863904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c74c1-ec6a-447d-87b0-79d54dffedd7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:21.864340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c74c1-ec6a-447d-87b0-79d54dffedd7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:21.865164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c74c1-ec6a-447d-87b0-79d54dffedd7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:21.868330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c74c1-ec6a-447d-87b0-79d54dffedd7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-8c5c74c1-ec6a-447d-87b0-79d54dffedd7 tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Could not find domain: 16537dd6ebfb4df58070e6ed47483d2e.: keystone.exception.DomainNotFound: Could not find domain: 16537dd6ebfb4df58070e6ed47483d2e. Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 16537dd6ebfb4df58070e6ed47483d2e. Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:08:21.889379 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Aug 28 19:08:21.890655 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:08:21.892006 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:08:21.893241 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:08:21.893241 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 16537dd6ebfb4df58070e6ed47483d2e. Aug 28 19:08:21.893241 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:08:21.898513 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2278/4566] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:21 2022] POST /identity/v3/users => generated 112 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:08:21.907737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:21.911898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:21.995356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:22.256731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf742e-0bf4-4f54-bdd9-0fc259d310bb tempest-UsersNegativeTest-947346186 tempest-UsersNegativeTest-947346186-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:22.270799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:22.271473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:22.271793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:22.272102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] PATH_INFO: `/v3/users/f9a4260ba35a42c69d315e553ce38cc7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:22.274632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a4260ba35a42c69d315e553ce38cc7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:22.276620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:22.412431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a4260ba35a42c69d315e553ce38cc7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:22.430692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a4260ba35a42c69d315e553ce38cc7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:22.432892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a4260ba35a42c69d315e553ce38cc7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:22.454111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a4260ba35a42c69d315e553ce38cc7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:22.455120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a4260ba35a42c69d315e553ce38cc7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:22.561170 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2289/4567] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:21 2022] DELETE /identity/v3/users/f9a4260ba35a42c69d315e553ce38cc7 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:22.572599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e1e1-d2f4-4a58-8144-1e593d82e3ca None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:22.573193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e1e1-d2f4-4a58-8144-1e593d82e3ca None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:22.575055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e1e1-d2f4-4a58-8144-1e593d82e3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:22.685043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9a76e1e1-d2f4-4a58-8144-1e593d82e3ca None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:22.686551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9a76e1e1-d2f4-4a58-8144-1e593d82e3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:22.889230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:22.892137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:22.908725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:23.040010 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2279/4568] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:23.094554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e1e1-d2f4-4a58-8144-1e593d82e3ca None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:23.097230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9a76e1e1-d2f4-4a58-8144-1e593d82e3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:23.245394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70795e-4e64-4d73-b9b1-460a8841e1e0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:23.283844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:23.285557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:23.286056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:23.286503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] PATH_INFO: `/v3/projects/82df5e3cf91e4f75a02d0ee01ef5e577` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:23.292047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] RBAC: Authorizing `identity:delete_project(project_id=82df5e3cf91e4f75a02d0ee01ef5e577)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:23.310645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e1e1-d2f4-4a58-8144-1e593d82e3ca None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:23.316419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ea971-c2a9-4c43-a0a1-dd31330a7f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:23.317141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ea971-c2a9-4c43-a0a1-dd31330a7f8f service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:23.317490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ea971-c2a9-4c43-a0a1-dd31330a7f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:23.318222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ea971-c2a9-4c43-a0a1-dd31330a7f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:23.319121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:23.363658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ea971-c2a9-4c43-a0a1-dd31330a7f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:23.365198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ea971-c2a9-4c43-a0a1-dd31330a7f8f service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:23.398562 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2280/4569] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:23.483628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:23.528731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82df5e3cf91e4f75a02d0ee01ef5e577', 'request_id': 'req-72225bc4-2b2a-4b58-a021-c8441763904d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:23.547223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82df5e3cf91e4f75a02d0ee01ef5e577', 'request_id': 'req-72225bc4-2b2a-4b58-a021-c8441763904d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:23.562272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82df5e3cf91e4f75a02d0ee01ef5e577', 'request_id': 'req-72225bc4-2b2a-4b58-a021-c8441763904d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:23.601138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] The token cache is being invalidate because project 82df5e3cf91e4f75a02d0ee01ef5e577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:23.601444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:23.603089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:23.610942 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2290/4570] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:22 2022] DELETE /identity/v3/projects/82df5e3cf91e4f75a02d0ee01ef5e577 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:23.612140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ea971-c2a9-4c43-a0a1-dd31330a7f8f service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:23.625825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ea971-c2a9-4c43-a0a1-dd31330a7f8f service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:23.829556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:23.830544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:23.831830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:23.832425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] PATH_INFO: `/v3/users/16468ff188cd406684a20ee2e20cdf8f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:23.835724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16468ff188cd406684a20ee2e20cdf8f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:23.839192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:23.969106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16468ff188cd406684a20ee2e20cdf8f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:23.980678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16468ff188cd406684a20ee2e20cdf8f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:23.982388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16468ff188cd406684a20ee2e20cdf8f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:24.002190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16468ff188cd406684a20ee2e20cdf8f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:24.002190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16468ff188cd406684a20ee2e20cdf8f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:24.004735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:24.040534 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2281/4571] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:23 2022] DELETE /identity/v3/users/16468ff188cd406684a20ee2e20cdf8f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:08:24.710444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:24.711952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:24.733137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72225bc4-2b2a-4b58-a021-c8441763904d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:24.868718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:24.869955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:24.870736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:24.871283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] PATH_INFO: `/v3/projects/0509e5c37f17425d8a763cae56bea13e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:24.873755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0509e5c37f17425d8a763cae56bea13e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:24.876760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:24.918279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:24.920865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:24.960444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844276f-f839-4185-a63f-3d415b369df5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:24.998194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0509e5c37f17425d8a763cae56bea13e', 'request_id': 'req-0659248b-e1a3-4d24-b603-b6cb60e4115c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.011721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0509e5c37f17425d8a763cae56bea13e', 'request_id': 'req-0659248b-e1a3-4d24-b603-b6cb60e4115c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.023295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0509e5c37f17425d8a763cae56bea13e', 'request_id': 'req-0659248b-e1a3-4d24-b603-b6cb60e4115c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.053444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] The token cache is being invalidate because project 0509e5c37f17425d8a763cae56bea13e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:25.053823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.054529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.062095 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2291/4572] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:24 2022] DELETE /identity/v3/projects/0509e5c37f17425d8a763cae56bea13e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:08:25.066023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:25.070444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:25.162012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea9296-2a62-464f-bb02-b4077b7d07a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:25.162669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9296-2a62-464f-bb02-b4077b7d07a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:25.163128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9296-2a62-464f-bb02-b4077b7d07a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:25.163425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9296-2a62-464f-bb02-b4077b7d07a9 admin admin] PATH_INFO: `/v3/projects/1653d6bf6f1e4911839f31fb7e9c9428` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:25.164635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea9296-2a62-464f-bb02-b4077b7d07a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1653d6bf6f1e4911839f31fb7e9c9428)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:25.166718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea9296-2a62-464f-bb02-b4077b7d07a9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:25.234957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:25.263042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7cea9296-2a62-464f-bb02-b4077b7d07a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1653d6bf6f1e4911839f31fb7e9c9428', 'request_id': 'req-7cea9296-2a62-464f-bb02-b4077b7d07a9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.276569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659248b-e1a3-4d24-b603-b6cb60e4115c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:25.287472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7cea9296-2a62-464f-bb02-b4077b7d07a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1653d6bf6f1e4911839f31fb7e9c9428', 'request_id': 'req-7cea9296-2a62-464f-bb02-b4077b7d07a9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.304370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7cea9296-2a62-464f-bb02-b4077b7d07a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1653d6bf6f1e4911839f31fb7e9c9428', 'request_id': 'req-7cea9296-2a62-464f-bb02-b4077b7d07a9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.334180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7cea9296-2a62-464f-bb02-b4077b7d07a9 admin admin] The token cache is being invalidate because project 1653d6bf6f1e4911839f31fb7e9c9428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:25.335585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7cea9296-2a62-464f-bb02-b4077b7d07a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.337345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7cea9296-2a62-464f-bb02-b4077b7d07a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.343408 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2282/4573] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:24 2022] DELETE /identity/v3/projects/1653d6bf6f1e4911839f31fb7e9c9428 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:25.351209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87affab-d3c5-4a9c-8310-70dd41df1d70 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:25.351597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87affab-d3c5-4a9c-8310-70dd41df1d70 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:25.354408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87affab-d3c5-4a9c-8310-70dd41df1d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:25.407194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df340f-1ba2-4cd8-958f-38a01ed09acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:25.407841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df340f-1ba2-4cd8-958f-38a01ed09acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:25.408120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df340f-1ba2-4cd8-958f-38a01ed09acc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:25.408394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df340f-1ba2-4cd8-958f-38a01ed09acc admin admin] PATH_INFO: `/v3/users/7a4abdd9df6446509c0f3c4808b9dca0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:25.410541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df340f-1ba2-4cd8-958f-38a01ed09acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a4abdd9df6446509c0f3c4808b9dca0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:25.413861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df340f-1ba2-4cd8-958f-38a01ed09acc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:25.433445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e87affab-d3c5-4a9c-8310-70dd41df1d70 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:25.434710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e87affab-d3c5-4a9c-8310-70dd41df1d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:25.470796 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2283/4574] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:25.481647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e355ceb-667d-423a-b0d9-df7d578386dc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:25.481938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e355ceb-667d-423a-b0d9-df7d578386dc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:25.482499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e355ceb-667d-423a-b0d9-df7d578386dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:25.509984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-03df340f-1ba2-4cd8-958f-38a01ed09acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4abdd9df6446509c0f3c4808b9dca0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.528310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-03df340f-1ba2-4cd8-958f-38a01ed09acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4abdd9df6446509c0f3c4808b9dca0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.529104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-03df340f-1ba2-4cd8-958f-38a01ed09acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4abdd9df6446509c0f3c4808b9dca0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.536071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4e355ceb-667d-423a-b0d9-df7d578386dc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:25.537406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4e355ceb-667d-423a-b0d9-df7d578386dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:25.543312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-03df340f-1ba2-4cd8-958f-38a01ed09acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4abdd9df6446509c0f3c4808b9dca0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.544295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-03df340f-1ba2-4cd8-958f-38a01ed09acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4abdd9df6446509c0f3c4808b9dca0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:25.559516 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2284/4575] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:25.562616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f81408-3440-4d60-a09f-870bae56413a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:25.564159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f81408-3440-4d60-a09f-870bae56413a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:25.564704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f81408-3440-4d60-a09f-870bae56413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:25.570820 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2292/4576] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:25 2022] DELETE /identity/v3/users/7a4abdd9df6446509c0f3c4808b9dca0 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:25.570820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df340f-1ba2-4cd8-958f-38a01ed09acc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:25.608911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-15f81408-3440-4d60-a09f-870bae56413a None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:25.610944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-15f81408-3440-4d60-a09f-870bae56413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:25.740106 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2285/4577] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:08:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:25.743987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df340f-1ba2-4cd8-958f-38a01ed09acc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:25.750695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59a6f1-253b-4caf-9eb3-78d8ade844ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:25.751355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59a6f1-253b-4caf-9eb3-78d8ade844ab admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:25.751639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59a6f1-253b-4caf-9eb3-78d8ade844ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:25.751919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59a6f1-253b-4caf-9eb3-78d8ade844ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:25.752583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59a6f1-253b-4caf-9eb3-78d8ade844ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:08:25.752958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59a6f1-253b-4caf-9eb3-78d8ade844ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:25.754657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59a6f1-253b-4caf-9eb3-78d8ade844ab admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:25.757963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f81408-3440-4d60-a09f-870bae56413a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:25.759972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-15f81408-3440-4d60-a09f-870bae56413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:25.788250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:25.797582 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2293/4578] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:25.801948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59a6f1-253b-4caf-9eb3-78d8ade844ab admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:25.825711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59a6f1-253b-4caf-9eb3-78d8ade844ab admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:25.843010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1d55-8f07-4c0b-8db6-dd863c21bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:25.845619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1d55-8f07-4c0b-8db6-dd863c21bc19 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:25.845945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1d55-8f07-4c0b-8db6-dd863c21bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:25.848135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c1d55-8f07-4c0b-8db6-dd863c21bc19 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:25.851155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c1d55-8f07-4c0b-8db6-dd863c21bc19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:25.853548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c1d55-8f07-4c0b-8db6-dd863c21bc19 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:25.889432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:25.922021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f81408-3440-4d60-a09f-870bae56413a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:25.933760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d770b-fad6-4d01-bc70-0d3e3f8f86aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:25.934410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d770b-fad6-4d01-bc70-0d3e3f8f86aa service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:25.934700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d770b-fad6-4d01-bc70-0d3e3f8f86aa service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:25.935288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d770b-fad6-4d01-bc70-0d3e3f8f86aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:25.943032 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2294/4579] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:25 2022] POST /identity/v3/projects => generated 357 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:25.946404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1d55-8f07-4c0b-8db6-dd863c21bc19 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:25.947225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d770b-fad6-4d01-bc70-0d3e3f8f86aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:25.951219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d770b-fad6-4d01-bc70-0d3e3f8f86aa service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:25.964569 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2286/4580] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:08:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:08:26.045104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c1d55-8f07-4c0b-8db6-dd863c21bc19 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:26.052852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a08c5-9249-4569-9f18-43e176d62852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:26.053543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a08c5-9249-4569-9f18-43e176d62852 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:26.053835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a08c5-9249-4569-9f18-43e176d62852 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:26.054115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a08c5-9249-4569-9f18-43e176d62852 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:26.054783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a08c5-9249-4569-9f18-43e176d62852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:26.057046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a08c5-9249-4569-9f18-43e176d62852 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:26.098618 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2295/4581] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:25 2022] POST /identity/v3/users => generated 279 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:26.101775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d770b-fad6-4d01-bc70-0d3e3f8f86aa service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:26.119986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d770b-fad6-4d01-bc70-0d3e3f8f86aa service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:26.134391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a6c1d-16c8-46cb-915c-01d36c96fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:26.135444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a6c1d-16c8-46cb-915c-01d36c96fab2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:26.136186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a6c1d-16c8-46cb-915c-01d36c96fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:26.136730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a6c1d-16c8-46cb-915c-01d36c96fab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:26.137663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a6c1d-16c8-46cb-915c-01d36c96fab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:26.140013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a6c1d-16c8-46cb-915c-01d36c96fab2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:26.152881 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2287/4582] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:26.160138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a08c5-9249-4569-9f18-43e176d62852 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:26.188728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a08c5-9249-4569-9f18-43e176d62852 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:26.209165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcdf994-f043-4d4e-8587-e3e5c1d6810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:26.211454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdf994-f043-4d4e-8587-e3e5c1d6810c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:26.212449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdf994-f043-4d4e-8587-e3e5c1d6810c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:26.219009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcdf994-f043-4d4e-8587-e3e5c1d6810c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:26.220432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdf994-f043-4d4e-8587-e3e5c1d6810c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:26.227560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcdf994-f043-4d4e-8587-e3e5c1d6810c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:26.263556 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2296/4583] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:26.269385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a6c1d-16c8-46cb-915c-01d36c96fab2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:26.306057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a6c1d-16c8-46cb-915c-01d36c96fab2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:26.318722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51176189-2aaa-4ddb-9ba4-7ffbdbb91a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:26.322237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51176189-2aaa-4ddb-9ba4-7ffbdbb91a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:26.323078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51176189-2aaa-4ddb-9ba4-7ffbdbb91a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:26.323791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51176189-2aaa-4ddb-9ba4-7ffbdbb91a5b admin admin] PATH_INFO: `/v3/projects/1964f6e32d95451fbbbf2c7a89ce4cb5/users/a8af1e7c54534ea0a87a9124cc9ffd37/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:26.366230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51176189-2aaa-4ddb-9ba4-7ffbdbb91a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1964f6e32d95451fbbbf2c7a89ce4cb5, user_id=a8af1e7c54534ea0a87a9124cc9ffd37, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:26.369173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51176189-2aaa-4ddb-9ba4-7ffbdbb91a5b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:26.398993 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2288/4584] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:26 2022] PUT /identity/v3/projects/1964f6e32d95451fbbbf2c7a89ce4cb5/users/a8af1e7c54534ea0a87a9124cc9ffd37/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:26.409826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ef6ad-01d3-4c88-a79a-caa380666415 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:26.410336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ef6ad-01d3-4c88-a79a-caa380666415 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:26.410765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ef6ad-01d3-4c88-a79a-caa380666415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:26.480524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-637ef6ad-01d3-4c88-a79a-caa380666415 None None] MFA Rules not processed for user `a8af1e7c54534ea0a87a9124cc9ffd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:26.481928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-637ef6ad-01d3-4c88-a79a-caa380666415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:26.573621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51176189-2aaa-4ddb-9ba4-7ffbdbb91a5b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:26.585735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-51176189-2aaa-4ddb-9ba4-7ffbdbb91a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:26.666381 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2297/4585] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:08:26.670567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ef6ad-01d3-4c88-a79a-caa380666415 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:26.773075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51176189-2aaa-4ddb-9ba4-7ffbdbb91a5b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:26.782637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93732e-a6c7-4137-bfa3-5ca1802deb54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:26.782637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93732e-a6c7-4137-bfa3-5ca1802deb54 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:26.782637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93732e-a6c7-4137-bfa3-5ca1802deb54 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:26.782637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93732e-a6c7-4137-bfa3-5ca1802deb54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:26.797569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2b93732e-a6c7-4137-bfa3-5ca1802deb54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:26.829126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93732e-a6c7-4137-bfa3-5ca1802deb54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:26.837453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93732e-a6c7-4137-bfa3-5ca1802deb54 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:26.852280 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2289/4586] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:08:26.853154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93732e-a6c7-4137-bfa3-5ca1802deb54 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:26.854703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2b93732e-a6c7-4137-bfa3-5ca1802deb54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:26.875531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:26.883880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ef6ad-01d3-4c88-a79a-caa380666415 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:26.888446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93732e-a6c7-4137-bfa3-5ca1802deb54 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:26.898689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35638f8f-df96-4916-94dd-f9ec428e5148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:26.899452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35638f8f-df96-4916-94dd-f9ec428e5148 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:26.900151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35638f8f-df96-4916-94dd-f9ec428e5148 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:26.900635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35638f8f-df96-4916-94dd-f9ec428e5148 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:26.901868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35638f8f-df96-4916-94dd-f9ec428e5148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:26.903793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:26.904837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:26.905119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:26.905367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35638f8f-df96-4916-94dd-f9ec428e5148 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:26.905492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] PATH_INFO: `/v3/users/d4afb723d9a44a8284a518c8b2b2fec1` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:26.912367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4afb723d9a44a8284a518c8b2b2fec1)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:26.914957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:26.980892 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2298/4587] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:26 2022] POST /identity/v3/projects => generated 355 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:26.984036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35638f8f-df96-4916-94dd-f9ec428e5148 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:26.986906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-35638f8f-df96-4916-94dd-f9ec428e5148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:27.038985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4afb723d9a44a8284a518c8b2b2fec1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:27.052639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:27.056610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4afb723d9a44a8284a518c8b2b2fec1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:27.061548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4afb723d9a44a8284a518c8b2b2fec1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:27.075469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35638f8f-df96-4916-94dd-f9ec428e5148 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:27.083438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967b688-1775-4096-95db-50a637ad3004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:27.084101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967b688-1775-4096-95db-50a637ad3004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:27.084383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967b688-1775-4096-95db-50a637ad3004 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:27.084728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967b688-1775-4096-95db-50a637ad3004 admin admin] PATH_INFO: `/v3/projects/5a62d3ea47e94676bee4434ea6baebb1` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:27.086098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967b688-1775-4096-95db-50a637ad3004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a62d3ea47e94676bee4434ea6baebb1)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:27.088169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967b688-1775-4096-95db-50a637ad3004 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:27.103319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4afb723d9a44a8284a518c8b2b2fec1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:27.105296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4afb723d9a44a8284a518c8b2b2fec1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:27.141996 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2290/4588] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:26 2022] DELETE /identity/v3/users/d4afb723d9a44a8284a518c8b2b2fec1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:27.145101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:27.146735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:27.173825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2967b688-1775-4096-95db-50a637ad3004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a62d3ea47e94676bee4434ea6baebb1', 'request_id': 'req-2967b688-1775-4096-95db-50a637ad3004'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:27.192622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2967b688-1775-4096-95db-50a637ad3004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a62d3ea47e94676bee4434ea6baebb1', 'request_id': 'req-2967b688-1775-4096-95db-50a637ad3004'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:27.204144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2967b688-1775-4096-95db-50a637ad3004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a62d3ea47e94676bee4434ea6baebb1', 'request_id': 'req-2967b688-1775-4096-95db-50a637ad3004'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:27.232435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2967b688-1775-4096-95db-50a637ad3004 admin admin] The token cache is being invalidate because project 5a62d3ea47e94676bee4434ea6baebb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:27.232807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2967b688-1775-4096-95db-50a637ad3004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:27.233850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2967b688-1775-4096-95db-50a637ad3004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:27.240101 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2299/4589] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:26 2022] DELETE /identity/v3/projects/5a62d3ea47e94676bee4434ea6baebb1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:27.240101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ccee1-383d-4109-8d2e-c5bc213aa522 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:27.240101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ccee1-383d-4109-8d2e-c5bc213aa522 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:27.240101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ccee1-383d-4109-8d2e-c5bc213aa522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:27.280462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-378ccee1-383d-4109-8d2e-c5bc213aa522 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:27.291946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-378ccee1-383d-4109-8d2e-c5bc213aa522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:27.310941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb13f8-7e16-4e74-962e-bbf5a7d3093e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:27.430832 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2300/4590] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:27.430832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b07b4e-22c5-475b-82dd-aa5acba3a998 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:27.430832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b07b4e-22c5-475b-82dd-aa5acba3a998 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:27.430832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b07b4e-22c5-475b-82dd-aa5acba3a998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:27.477912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0068180-e343-4d02-b275-0fceb53c7582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:27.477912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0068180-e343-4d02-b275-0fceb53c7582 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:27.477912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0068180-e343-4d02-b275-0fceb53c7582 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:27.477912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0068180-e343-4d02-b275-0fceb53c7582 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:27.478359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0068180-e343-4d02-b275-0fceb53c7582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:27.478359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0068180-e343-4d02-b275-0fceb53c7582 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:27.478541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f1b07b4e-22c5-475b-82dd-aa5acba3a998 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:27.478541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f1b07b4e-22c5-475b-82dd-aa5acba3a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:27.516282 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2301/4591] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:27.517302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b07b4e-22c5-475b-82dd-aa5acba3a998 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:27.520677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f1b07b4e-22c5-475b-82dd-aa5acba3a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:27.537076 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2291/4592] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:27 2022] POST /identity/v3/users => generated 284 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:27.544963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40972-1559-4443-a656-3fdd9082b54e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:27.547095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40972-1559-4443-a656-3fdd9082b54e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:27.547639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d40972-1559-4443-a656-3fdd9082b54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:27.567268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:27.601141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a4d40972-1559-4443-a656-3fdd9082b54e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:27.604035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a4d40972-1559-4443-a656-3fdd9082b54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:27.629831 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2292/4593] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:27.631410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d40972-1559-4443-a656-3fdd9082b54e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:27.653403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a4d40972-1559-4443-a656-3fdd9082b54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:27.685740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d40972-1559-4443-a656-3fdd9082b54e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:27.703414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4e1aa-697c-4c19-b248-4538708bd17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:27.704381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4e1aa-697c-4c19-b248-4538708bd17f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:27.704848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4e1aa-697c-4c19-b248-4538708bd17f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:27.705303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4e1aa-697c-4c19-b248-4538708bd17f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:27.708262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4e1aa-697c-4c19-b248-4538708bd17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:27.714472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4e1aa-697c-4c19-b248-4538708bd17f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:27.748933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b07b4e-22c5-475b-82dd-aa5acba3a998 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:27.757925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0c9a7-7a54-4e73-9fd4-d20fae55bb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:27.759692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0c9a7-7a54-4e73-9fd4-d20fae55bb42 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:27.759692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0c9a7-7a54-4e73-9fd4-d20fae55bb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:27.759692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0c9a7-7a54-4e73-9fd4-d20fae55bb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:27.767398 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2293/4594] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:27.769756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4e1aa-697c-4c19-b248-4538708bd17f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:27.792534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0c9a7-7a54-4e73-9fd4-d20fae55bb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:27.795933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0c9a7-7a54-4e73-9fd4-d20fae55bb42 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:27.799091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4e1aa-697c-4c19-b248-4538708bd17f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:27.819856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271776f-b6db-4abc-b0b8-a09ab0545f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:27.821038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271776f-b6db-4abc-b0b8-a09ab0545f47 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:27.821905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271776f-b6db-4abc-b0b8-a09ab0545f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:27.822390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271776f-b6db-4abc-b0b8-a09ab0545f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:27.823285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271776f-b6db-4abc-b0b8-a09ab0545f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:08:27.825493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271776f-b6db-4abc-b0b8-a09ab0545f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:27.830254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271776f-b6db-4abc-b0b8-a09ab0545f47 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:27.835957 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2302/4595] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:27.837186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0c9a7-7a54-4e73-9fd4-d20fae55bb42 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:27.861715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0c9a7-7a54-4e73-9fd4-d20fae55bb42 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:27.873172 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2294/4596] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:27.875873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271776f-b6db-4abc-b0b8-a09ab0545f47 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:27.876216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9098c25-d1d6-4c1c-8fda-f16280fff1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:27.876958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098c25-d1d6-4c1c-8fda-f16280fff1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:27.877270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098c25-d1d6-4c1c-8fda-f16280fff1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:27.877552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9098c25-d1d6-4c1c-8fda-f16280fff1fd admin admin] PATH_INFO: `/v3/projects/20db00b22cce43988cbfaebb3f5a3d9f/users/5c61a61c7ce74ec88ca7bf4663a18804/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:27.903700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271776f-b6db-4abc-b0b8-a09ab0545f47 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:27.919198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9098c25-d1d6-4c1c-8fda-f16280fff1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=20db00b22cce43988cbfaebb3f5a3d9f, user_id=5c61a61c7ce74ec88ca7bf4663a18804, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:27.921658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab37d9-9542-405b-a627-7f98f1184fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:27.922129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9098c25-d1d6-4c1c-8fda-f16280fff1fd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:27.922726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab37d9-9542-405b-a627-7f98f1184fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:27.923212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab37d9-9542-405b-a627-7f98f1184fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:27.923674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab37d9-9542-405b-a627-7f98f1184fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:27.924833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab37d9-9542-405b-a627-7f98f1184fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:27.927345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab37d9-9542-405b-a627-7f98f1184fa9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:27.957068 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2303/4597] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:27 2022] PUT /identity/v3/projects/20db00b22cce43988cbfaebb3f5a3d9f/users/5c61a61c7ce74ec88ca7bf4663a18804/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:27.958329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9098c25-d1d6-4c1c-8fda-f16280fff1fd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:28.007997 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2295/4598] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:27 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:28.009547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab37d9-9542-405b-a627-7f98f1184fa9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:28.047572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:28.119279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9098c25-d1d6-4c1c-8fda-f16280fff1fd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:28.183599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab37d9-9542-405b-a627-7f98f1184fa9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:28.196244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b7dfd-60b1-4842-acbe-c70752ab8816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:28.196887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b7dfd-60b1-4842-acbe-c70752ab8816 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:28.197178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b7dfd-60b1-4842-acbe-c70752ab8816 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:28.200875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b7dfd-60b1-4842-acbe-c70752ab8816 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:28.201985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b7dfd-60b1-4842-acbe-c70752ab8816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:28.203879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b7dfd-60b1-4842-acbe-c70752ab8816 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:28.247028 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2296/4599] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:28 2022] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:28.251587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b7dfd-60b1-4842-acbe-c70752ab8816 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:28.258472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3e56a-c1fc-443f-9230-47e522e0d5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:28.259378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3e56a-c1fc-443f-9230-47e522e0d5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:28.260056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3e56a-c1fc-443f-9230-47e522e0d5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:28.260796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3e56a-c1fc-443f-9230-47e522e0d5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:28.262836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3e56a-c1fc-443f-9230-47e522e0d5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:28.265499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3e56a-c1fc-443f-9230-47e522e0d5a3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:28.267384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b7dfd-60b1-4842-acbe-c70752ab8816 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:28.277690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec127ad-bcad-4a9c-a131-d3d8733d06c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:28.280104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec127ad-bcad-4a9c-a131-d3d8733d06c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:28.280402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec127ad-bcad-4a9c-a131-d3d8733d06c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:28.280762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec127ad-bcad-4a9c-a131-d3d8733d06c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:28.281359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec127ad-bcad-4a9c-a131-d3d8733d06c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:28.286047 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2304/4600] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:28.289288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3e56a-c1fc-443f-9230-47e522e0d5a3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:28.289592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec127ad-bcad-4a9c-a131-d3d8733d06c3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:28.307224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3e56a-c1fc-443f-9230-47e522e0d5a3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:28.313295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cddcf-3ede-40bf-8df9-f9ed636b3212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:28.313549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cddcf-3ede-40bf-8df9-f9ed636b3212 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:28.316173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cddcf-3ede-40bf-8df9-f9ed636b3212 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:28.316173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cddcf-3ede-40bf-8df9-f9ed636b3212 admin admin] PATH_INFO: `/v3/projects/20db00b22cce43988cbfaebb3f5a3d9f/users/5c61a61c7ce74ec88ca7bf4663a18804/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:28.319191 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2297/4601] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:28.320175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cddcf-3ede-40bf-8df9-f9ed636b3212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20db00b22cce43988cbfaebb3f5a3d9f, user_id=5c61a61c7ce74ec88ca7bf4663a18804, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:28.321038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec127ad-bcad-4a9c-a131-d3d8733d06c3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:28.323367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cddcf-3ede-40bf-8df9-f9ed636b3212 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:28.339782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec127ad-bcad-4a9c-a131-d3d8733d06c3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:28.347539 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2305/4602] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:28 2022] PUT /identity/v3/projects/20db00b22cce43988cbfaebb3f5a3d9f/users/5c61a61c7ce74ec88ca7bf4663a18804/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:28.359581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55766b91-b14d-453e-a6ee-bdf86e05fe22 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:28.360993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55766b91-b14d-453e-a6ee-bdf86e05fe22 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:28.361834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55766b91-b14d-453e-a6ee-bdf86e05fe22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:28.497772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-55766b91-b14d-453e-a6ee-bdf86e05fe22 None None] MFA Rules not processed for user `5c61a61c7ce74ec88ca7bf4663a18804`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:28.500233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-55766b91-b14d-453e-a6ee-bdf86e05fe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:28.506057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:28.603877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22c97c-8f51-4e49-b265-a1d4fd09c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:28.604896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22c97c-8f51-4e49-b265-a1d4fd09c41c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:28.605112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22c97c-8f51-4e49-b265-a1d4fd09c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:28.605469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22c97c-8f51-4e49-b265-a1d4fd09c41c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:28.606319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22c97c-8f51-4e49-b265-a1d4fd09c41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:28.610214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22c97c-8f51-4e49-b265-a1d4fd09c41c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:28.633478 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2298/4603] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:28.635020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22c97c-8f51-4e49-b265-a1d4fd09c41c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:28.637378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8e22c97c-8f51-4e49-b265-a1d4fd09c41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:28.658072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22c97c-8f51-4e49-b265-a1d4fd09c41c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:28.664854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e47bca-4f03-4b04-b0bc-9bea91a04db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:28.665590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e47bca-4f03-4b04-b0bc-9bea91a04db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:28.665956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e47bca-4f03-4b04-b0bc-9bea91a04db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:28.666541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e47bca-4f03-4b04-b0bc-9bea91a04db6 admin admin] PATH_INFO: `/v3/projects/77207cbf86b14b449ac261b98a9b0311` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:28.667902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e47bca-4f03-4b04-b0bc-9bea91a04db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77207cbf86b14b449ac261b98a9b0311)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:28.670685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e47bca-4f03-4b04-b0bc-9bea91a04db6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:28.692613 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2306/4604] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:28.694978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55766b91-b14d-453e-a6ee-bdf86e05fe22 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:28.716704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55766b91-b14d-453e-a6ee-bdf86e05fe22 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:28.729576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e777383-17e9-499c-8c0e-38481f4e05af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:28.731118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e777383-17e9-499c-8c0e-38481f4e05af admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:28.731540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e777383-17e9-499c-8c0e-38481f4e05af admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:28.731987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e777383-17e9-499c-8c0e-38481f4e05af admin admin] PATH_INFO: `/v3/projects/677a734585b4406d83f41b1117a081d7/users/526203b1c5c947ec9e37d7c66059dc45/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:28.758981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e777383-17e9-499c-8c0e-38481f4e05af admin admin] RBAC: Authorizing `identity:create_grant(project_id=677a734585b4406d83f41b1117a081d7, user_id=526203b1c5c947ec9e37d7c66059dc45, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:28.762667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e777383-17e9-499c-8c0e-38481f4e05af admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:28.792674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-39e47bca-4f03-4b04-b0bc-9bea91a04db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77207cbf86b14b449ac261b98a9b0311', 'request_id': 'req-39e47bca-4f03-4b04-b0bc-9bea91a04db6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:28.796167 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2307/4605] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:28 2022] PUT /identity/v3/projects/677a734585b4406d83f41b1117a081d7/users/526203b1c5c947ec9e37d7c66059dc45/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:28.796378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e777383-17e9-499c-8c0e-38481f4e05af admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:28.809855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2e777383-17e9-499c-8c0e-38481f4e05af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:28.820319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-39e47bca-4f03-4b04-b0bc-9bea91a04db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77207cbf86b14b449ac261b98a9b0311', 'request_id': 'req-39e47bca-4f03-4b04-b0bc-9bea91a04db6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:28.835790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-39e47bca-4f03-4b04-b0bc-9bea91a04db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77207cbf86b14b449ac261b98a9b0311', 'request_id': 'req-39e47bca-4f03-4b04-b0bc-9bea91a04db6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:28.878656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-39e47bca-4f03-4b04-b0bc-9bea91a04db6 admin admin] The token cache is being invalidate because project 77207cbf86b14b449ac261b98a9b0311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:28.879725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-39e47bca-4f03-4b04-b0bc-9bea91a04db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:28.887376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-39e47bca-4f03-4b04-b0bc-9bea91a04db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:28.890218 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2299/4606] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:28 2022] DELETE /identity/v3/projects/77207cbf86b14b449ac261b98a9b0311 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:28.892657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fd39e-a0d5-4a64-967a-d46e3f0e26a7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:28.893350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fd39e-a0d5-4a64-967a-d46e3f0e26a7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:28.893986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fd39e-a0d5-4a64-967a-d46e3f0e26a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:28.949666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:28.951083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e777383-17e9-499c-8c0e-38481f4e05af admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:28.967294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd43d0-f537-4282-ac06-010bd90b8368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:28.968078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd43d0-f537-4282-ac06-010bd90b8368 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:28.969150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd43d0-f537-4282-ac06-010bd90b8368 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:28.969538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd43d0-f537-4282-ac06-010bd90b8368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:28.970595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-449fd39e-a0d5-4a64-967a-d46e3f0e26a7 None None] MFA Rules not processed for user `526203b1c5c947ec9e37d7c66059dc45`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:28.973922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-449fd39e-a0d5-4a64-967a-d46e3f0e26a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:28.976532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a7dd43d0-f537-4282-ac06-010bd90b8368 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:29.110417 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2300/4607] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:29.114276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebea65-17bb-48a5-a9d5-62cdde163dd2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:29.114862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebea65-17bb-48a5-a9d5-62cdde163dd2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:29.115336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebea65-17bb-48a5-a9d5-62cdde163dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:29.139642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd43d0-f537-4282-ac06-010bd90b8368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:29.141116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd43d0-f537-4282-ac06-010bd90b8368 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:29.150296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bbebea65-17bb-48a5-a9d5-62cdde163dd2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:29.152850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bbebea65-17bb-48a5-a9d5-62cdde163dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:29.153767 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2308/4608] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:29.154615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd43d0-f537-4282-ac06-010bd90b8368 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:29.156274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a7dd43d0-f537-4282-ac06-010bd90b8368 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:29.237729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:29.298887 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2301/4609] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:29.305144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596f933-3c6d-44a0-9c50-570e712a4bb8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:29.306120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596f933-3c6d-44a0-9c50-570e712a4bb8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:29.306486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596f933-3c6d-44a0-9c50-570e712a4bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:29.345752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd43d0-f537-4282-ac06-010bd90b8368 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:29.351710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86516a7-b555-4b53-9aaf-be45b16e1ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:29.359163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86516a7-b555-4b53-9aaf-be45b16e1ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:29.359504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86516a7-b555-4b53-9aaf-be45b16e1ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:29.359804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86516a7-b555-4b53-9aaf-be45b16e1ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:29.360651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86516a7-b555-4b53-9aaf-be45b16e1ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:29.365678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86516a7-b555-4b53-9aaf-be45b16e1ed1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:29.381104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7596f933-3c6d-44a0-9c50-570e712a4bb8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:29.387056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7596f933-3c6d-44a0-9c50-570e712a4bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:29.418631 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2302/4610] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:29.419847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596f933-3c6d-44a0-9c50-570e712a4bb8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:29.421358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7596f933-3c6d-44a0-9c50-570e712a4bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:29.442725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596f933-3c6d-44a0-9c50-570e712a4bb8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:29.450656 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2309/4611] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:29 2022] POST /identity/v3/projects => generated 379 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:29.451544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86516a7-b555-4b53-9aaf-be45b16e1ed1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:29.455245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d8dc1-c092-48ef-9252-726127adfd7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:29.456475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d8dc1-c092-48ef-9252-726127adfd7f service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:29.457037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d8dc1-c092-48ef-9252-726127adfd7f service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:29.457439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d8dc1-c092-48ef-9252-726127adfd7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:29.461230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-409d8dc1-c092-48ef-9252-726127adfd7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:29.598121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86516a7-b555-4b53-9aaf-be45b16e1ed1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:29.598407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d8dc1-c092-48ef-9252-726127adfd7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:29.600958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d8dc1-c092-48ef-9252-726127adfd7f service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:29.608931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab12fed-603f-4f90-9b1b-84a75ac87bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:29.610391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab12fed-603f-4f90-9b1b-84a75ac87bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:29.610391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab12fed-603f-4f90-9b1b-84a75ac87bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:29.610391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab12fed-603f-4f90-9b1b-84a75ac87bd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:29.611827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab12fed-603f-4f90-9b1b-84a75ac87bd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:08:29.613199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab12fed-603f-4f90-9b1b-84a75ac87bd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:29.615177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab12fed-603f-4f90-9b1b-84a75ac87bd4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:29.622572 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2303/4612] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:29.624068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d8dc1-c092-48ef-9252-726127adfd7f service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:29.646480 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2310/4613] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:29.650705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab12fed-603f-4f90-9b1b-84a75ac87bd4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:29.657763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d8dc1-c092-48ef-9252-726127adfd7f service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:29.668732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab12fed-603f-4f90-9b1b-84a75ac87bd4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:29.676057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a396-905c-4a40-9df7-e94164695a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:29.676873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a396-905c-4a40-9df7-e94164695a0d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:29.679940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a396-905c-4a40-9df7-e94164695a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:29.679940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a396-905c-4a40-9df7-e94164695a0d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:29.679940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37a396-905c-4a40-9df7-e94164695a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:29.681899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37a396-905c-4a40-9df7-e94164695a0d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:29.701800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be36b1f-078d-461f-a988-54877d01c92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:29.702451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be36b1f-078d-461f-a988-54877d01c92c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:29.704449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be36b1f-078d-461f-a988-54877d01c92c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:29.706310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be36b1f-078d-461f-a988-54877d01c92c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:29.707287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be36b1f-078d-461f-a988-54877d01c92c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:29.712442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be36b1f-078d-461f-a988-54877d01c92c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:29.740598 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2304/4614] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:29 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:29.741675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a396-905c-4a40-9df7-e94164695a0d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:29.762428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a396-905c-4a40-9df7-e94164695a0d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:29.769990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95374650-5ae7-42b6-ab7e-5afda9ef43e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:29.771225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95374650-5ae7-42b6-ab7e-5afda9ef43e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:29.771627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95374650-5ae7-42b6-ab7e-5afda9ef43e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:29.772554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95374650-5ae7-42b6-ab7e-5afda9ef43e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:29.773551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95374650-5ae7-42b6-ab7e-5afda9ef43e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:29.776856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95374650-5ae7-42b6-ab7e-5afda9ef43e3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:29.800902 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2305/4615] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:29.802294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95374650-5ae7-42b6-ab7e-5afda9ef43e3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:29.810802 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2311/4616] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:29 2022] POST /identity/v3/projects => generated 389 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:08:29.814553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be36b1f-078d-461f-a988-54877d01c92c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:29.831330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:29.839012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95374650-5ae7-42b6-ab7e-5afda9ef43e3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:29.995374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b794af-c476-4e1a-bca5-0016dac34823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:30.001476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b794af-c476-4e1a-bca5-0016dac34823 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:30.004121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b794af-c476-4e1a-bca5-0016dac34823 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:30.008162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b794af-c476-4e1a-bca5-0016dac34823 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:30.019029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b794af-c476-4e1a-bca5-0016dac34823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:30.019029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b794af-c476-4e1a-bca5-0016dac34823 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:30.084026 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2306/4617] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:30.091669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b794af-c476-4e1a-bca5-0016dac34823 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:30.114229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b794af-c476-4e1a-bca5-0016dac34823 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:30.119199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be36b1f-078d-461f-a988-54877d01c92c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:30.131710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db82c1-28dd-4b5e-9ed3-7319ee10d33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:30.132425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db82c1-28dd-4b5e-9ed3-7319ee10d33f admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:30.133331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa25e09-3c18-4842-8bff-80c4e5b3f8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:30.133715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db82c1-28dd-4b5e-9ed3-7319ee10d33f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:30.134151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa25e09-3c18-4842-8bff-80c4e5b3f8cc admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:30.134533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa25e09-3c18-4842-8bff-80c4e5b3f8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:30.134969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa25e09-3c18-4842-8bff-80c4e5b3f8cc admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:30.135714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa25e09-3c18-4842-8bff-80c4e5b3f8cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:30.136789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db82c1-28dd-4b5e-9ed3-7319ee10d33f admin admin] PATH_INFO: `/v3/projects/15336e7f00174658b3dcf1b4ed3121a5/users/d3b930a4d1084fc9b2e351a9bbef1be6/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:30.137861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa25e09-3c18-4842-8bff-80c4e5b3f8cc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:30.169649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db82c1-28dd-4b5e-9ed3-7319ee10d33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=15336e7f00174658b3dcf1b4ed3121a5, user_id=d3b930a4d1084fc9b2e351a9bbef1be6, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:30.172949 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2312/4618] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:29 2022] POST /identity/v3/users => generated 295 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:30.173114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db82c1-28dd-4b5e-9ed3-7319ee10d33f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:30.175601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa25e09-3c18-4842-8bff-80c4e5b3f8cc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:30.196326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa25e09-3c18-4842-8bff-80c4e5b3f8cc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:30.206613 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2307/4619] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:30 2022] PUT /identity/v3/projects/15336e7f00174658b3dcf1b4ed3121a5/users/d3b930a4d1084fc9b2e351a9bbef1be6/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:30.209136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d6b1-e133-4126-b9ef-e9d9a5aac8ca None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:30.209395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:30.209526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d6b1-e133-4126-b9ef-e9d9a5aac8ca None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:30.209699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d6b1-e133-4126-b9ef-e9d9a5aac8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:30.260056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2801d6b1-e133-4126-b9ef-e9d9a5aac8ca None None] MFA Rules not processed for user `d3b930a4d1084fc9b2e351a9bbef1be6`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:30.261580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2801d6b1-e133-4126-b9ef-e9d9a5aac8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:30.301921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6a9d2-2464-4839-8b27-b8a3ff6314e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:30.302820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a9d2-2464-4839-8b27-b8a3ff6314e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:30.304269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a9d2-2464-4839-8b27-b8a3ff6314e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:30.306215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6a9d2-2464-4839-8b27-b8a3ff6314e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:30.308322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6a9d2-2464-4839-8b27-b8a3ff6314e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:30.312522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6a9d2-2464-4839-8b27-b8a3ff6314e1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:30.340409 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2313/4620] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:30.341590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6a9d2-2464-4839-8b27-b8a3ff6314e1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:30.354922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6a9d2-2464-4839-8b27-b8a3ff6314e1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:30.361166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a88bf-d815-4dcc-b4f3-9b2d7bcfd37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:30.361778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a88bf-d815-4dcc-b4f3-9b2d7bcfd37c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:30.362131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a88bf-d815-4dcc-b4f3-9b2d7bcfd37c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:30.362457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a88bf-d815-4dcc-b4f3-9b2d7bcfd37c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:30.363278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a88bf-d815-4dcc-b4f3-9b2d7bcfd37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:30.365113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a88bf-d815-4dcc-b4f3-9b2d7bcfd37c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:30.384177 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2314/4621] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:30.386287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a88bf-d815-4dcc-b4f3-9b2d7bcfd37c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:30.403406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a88bf-d815-4dcc-b4f3-9b2d7bcfd37c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:30.419258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b52b-191b-43f2-9f32-f539b98578cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:30.422549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b52b-191b-43f2-9f32-f539b98578cc admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:30.423692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b52b-191b-43f2-9f32-f539b98578cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:30.424817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b52b-191b-43f2-9f32-f539b98578cc admin admin] PATH_INFO: `/v3/projects/aac3d9c160b2456cb0567da0d966c774/users/7e6e66252f6b4ea7b1993923dc1447fc/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:30.438930 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2308/4622] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:08:30.441272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801d6b1-e133-4126-b9ef-e9d9a5aac8ca None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:30.477942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84b52b-191b-43f2-9f32-f539b98578cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac3d9c160b2456cb0567da0d966c774, user_id=7e6e66252f6b4ea7b1993923dc1447fc, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:30.481508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84b52b-191b-43f2-9f32-f539b98578cc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:30.509126 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2315/4623] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:30 2022] PUT /identity/v3/projects/aac3d9c160b2456cb0567da0d966c774/users/7e6e66252f6b4ea7b1993923dc1447fc/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:30.520910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e507-bc7c-41a9-ba9b-8769ca56d988 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:30.521286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e507-bc7c-41a9-ba9b-8769ca56d988 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:30.522096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19e507-bc7c-41a9-ba9b-8769ca56d988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:30.540081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801d6b1-e133-4126-b9ef-e9d9a5aac8ca None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:30.573357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:30.587038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1b19e507-bc7c-41a9-ba9b-8769ca56d988 None None] MFA Rules not processed for user `7e6e66252f6b4ea7b1993923dc1447fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:30.588461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1b19e507-bc7c-41a9-ba9b-8769ca56d988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:30.661695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450fb8c-7a58-430d-a1ad-160bc0aa599a tempest-IdentityV3ProjectsTest-342312654 tempest-IdentityV3ProjectsTest-342312654-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '526203b1c5c947ec9e37d7c66059dc45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '677a734585b4406d83f41b1117a081d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:30.662377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450fb8c-7a58-430d-a1ad-160bc0aa599a tempest-IdentityV3ProjectsTest-342312654 tempest-IdentityV3ProjectsTest-342312654-project] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:30.662671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450fb8c-7a58-430d-a1ad-160bc0aa599a tempest-IdentityV3ProjectsTest-342312654 tempest-IdentityV3ProjectsTest-342312654-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:30.663061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450fb8c-7a58-430d-a1ad-160bc0aa599a tempest-IdentityV3ProjectsTest-342312654 tempest-IdentityV3ProjectsTest-342312654-project] PATH_INFO: `/v3/users/526203b1c5c947ec9e37d7c66059dc45/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:30.664360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450fb8c-7a58-430d-a1ad-160bc0aa599a tempest-IdentityV3ProjectsTest-342312654 tempest-IdentityV3ProjectsTest-342312654-project] RBAC: Authorizing `identity:list_user_projects(user_id=526203b1c5c947ec9e37d7c66059dc45)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:30.671110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450fb8c-7a58-430d-a1ad-160bc0aa599a tempest-IdentityV3ProjectsTest-342312654 tempest-IdentityV3ProjectsTest-342312654-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:30.726477 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2316/4624] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:30.735561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19e507-bc7c-41a9-ba9b-8769ca56d988 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:30.738218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1b19e507-bc7c-41a9-ba9b-8769ca56d988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:30.764279 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2309/4625] 10.222.0.70 () {58 vars in 1248 bytes} [Sun Aug 28 19:08:30 2022] GET /identity/v3/users/526203b1c5c947ec9e37d7c66059dc45/projects => generated 515 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:30.781607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8e0e4-8a14-4065-b7b3-eb2fbf8c9ccd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:30.786122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8e0e4-8a14-4065-b7b3-eb2fbf8c9ccd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:30.786677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8e0e4-8a14-4065-b7b3-eb2fbf8c9ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:30.863703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-56c8e0e4-8a14-4065-b7b3-eb2fbf8c9ccd None None] MFA Rules not processed for user `526203b1c5c947ec9e37d7c66059dc45`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:30.865139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-56c8e0e4-8a14-4065-b7b3-eb2fbf8c9ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:30.885848 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2310/4626] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:30.892462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7f346-83db-43ee-8453-930494210560 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:30.896479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7f346-83db-43ee-8453-930494210560 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:30.897180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7f346-83db-43ee-8453-930494210560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:30.913113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19e507-bc7c-41a9-ba9b-8769ca56d988 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:30.924250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36ef9c-047a-437a-9557-b53b7070c00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:30.929519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36ef9c-047a-437a-9557-b53b7070c00c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:30.930212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36ef9c-047a-437a-9557-b53b7070c00c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:30.930431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-eac7f346-83db-43ee-8453-930494210560 None None] MFA Rules not processed for user `526203b1c5c947ec9e37d7c66059dc45`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:30.930940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36ef9c-047a-437a-9557-b53b7070c00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:30.932296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eac7f346-83db-43ee-8453-930494210560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:30.953073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36ef9c-047a-437a-9557-b53b7070c00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:30.958671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36ef9c-047a-437a-9557-b53b7070c00c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:30.972932 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2317/4627] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:31.040225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.models.token_model [None req-eac7f346-83db-43ee-8453-930494210560 None None] User 526203b1c5c947ec9e37d7c66059dc45 has no access to project 15336e7f00174658b3dcf1b4ed3121a5 {{(pid=88374) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Aug 28 19:08:31.045726 n-d-854118-7 devstack@keystone.service[88374]: WARNING keystone.server.flask.application [None req-eac7f346-83db-43ee-8453-930494210560 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.70: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 19:08:31.058115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36ef9c-047a-437a-9557-b53b7070c00c service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:31.066314 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2311/4628] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:30 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 174 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 19:08:31.073443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:31.243728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36ef9c-047a-437a-9557-b53b7070c00c service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:31.266810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:31.267496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:31.267766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:31.268045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] PATH_INFO: `/v3/users/526203b1c5c947ec9e37d7c66059dc45` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:31.275389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=526203b1c5c947ec9e37d7c66059dc45)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:31.281934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:31.458815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526203b1c5c947ec9e37d7c66059dc45'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:31.475820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526203b1c5c947ec9e37d7c66059dc45'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:31.476679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526203b1c5c947ec9e37d7c66059dc45'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:31.488209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526203b1c5c947ec9e37d7c66059dc45'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:31.489091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526203b1c5c947ec9e37d7c66059dc45'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:31.524402 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2318/4629] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:31 2022] DELETE /identity/v3/users/526203b1c5c947ec9e37d7c66059dc45 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:31.529273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1b73f-fad1-4a69-b910-daaa8605dd13 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:31.530085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1b73f-fad1-4a69-b910-daaa8605dd13 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:31.530085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1b73f-fad1-4a69-b910-daaa8605dd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:31.573962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3fb1b73f-fad1-4a69-b910-daaa8605dd13 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:31.582809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3fb1b73f-fad1-4a69-b910-daaa8605dd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:31.756865 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2312/4630] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:31.763841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:31.765526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:31.934326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dab201-e25e-4534-b5f3-81395f439f18 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:31.944610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146d49a-3c35-4a6b-9882-f12868de52e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:31.946135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146d49a-3c35-4a6b-9882-f12868de52e0 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:31.946424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146d49a-3c35-4a6b-9882-f12868de52e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:31.946702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146d49a-3c35-4a6b-9882-f12868de52e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:31.977518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146d49a-3c35-4a6b-9882-f12868de52e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:31.982229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146d49a-3c35-4a6b-9882-f12868de52e0 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:32.036610 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2319/4631] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:32.521512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1b73f-fad1-4a69-b910-daaa8605dd13 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:32.525860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3fb1b73f-fad1-4a69-b910-daaa8605dd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:32.605992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1b73f-fad1-4a69-b910-daaa8605dd13 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:32.620608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:32.622345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:32.622954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:32.624267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] PATH_INFO: `/v3/projects/677a734585b4406d83f41b1117a081d7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:32.630150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=677a734585b4406d83f41b1117a081d7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:32.636081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:32.766898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:32.876942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '677a734585b4406d83f41b1117a081d7', 'request_id': 'req-ee73bd3f-2712-40df-9451-b6bea8aa81ce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:32.913222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '677a734585b4406d83f41b1117a081d7', 'request_id': 'req-ee73bd3f-2712-40df-9451-b6bea8aa81ce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:32.945685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '677a734585b4406d83f41b1117a081d7', 'request_id': 'req-ee73bd3f-2712-40df-9451-b6bea8aa81ce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:32.989534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] The token cache is being invalidate because project 677a734585b4406d83f41b1117a081d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:32.989912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:32.997580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:33.007974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146d49a-3c35-4a6b-9882-f12868de52e0 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:33.008601 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2313/4632] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:32 2022] DELETE /identity/v3/projects/677a734585b4406d83f41b1117a081d7 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:33.025196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146d49a-3c35-4a6b-9882-f12868de52e0 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:33.151507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:33.279352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dac7a7-c92a-4ecf-ac86-6b58cf9abb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:33.280174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dac7a7-c92a-4ecf-ac86-6b58cf9abb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:33.280518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dac7a7-c92a-4ecf-ac86-6b58cf9abb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:33.281020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dac7a7-c92a-4ecf-ac86-6b58cf9abb07 admin admin] PATH_INFO: `/v3/users/d3b930a4d1084fc9b2e351a9bbef1be6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:33.285338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dac7a7-c92a-4ecf-ac86-6b58cf9abb07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b930a4d1084fc9b2e351a9bbef1be6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:33.292289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dac7a7-c92a-4ecf-ac86-6b58cf9abb07 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:33.416674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-66dac7a7-c92a-4ecf-ac86-6b58cf9abb07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b930a4d1084fc9b2e351a9bbef1be6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:33.435171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-66dac7a7-c92a-4ecf-ac86-6b58cf9abb07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b930a4d1084fc9b2e351a9bbef1be6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:33.436430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-66dac7a7-c92a-4ecf-ac86-6b58cf9abb07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b930a4d1084fc9b2e351a9bbef1be6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:33.451838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-66dac7a7-c92a-4ecf-ac86-6b58cf9abb07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b930a4d1084fc9b2e351a9bbef1be6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:33.452874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-66dac7a7-c92a-4ecf-ac86-6b58cf9abb07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b930a4d1084fc9b2e351a9bbef1be6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:33.555637 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2320/4633] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:33 2022] DELETE /identity/v3/users/d3b930a4d1084fc9b2e351a9bbef1be6 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:34.151417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:34.153320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:34.180400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73bd3f-2712-40df-9451-b6bea8aa81ce admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:34.367239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:34.367898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:34.368161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:34.368438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827 admin admin] PATH_INFO: `/v3/projects/15336e7f00174658b3dcf1b4ed3121a5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:34.370277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15336e7f00174658b3dcf1b4ed3121a5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:34.372233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:34.491738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15336e7f00174658b3dcf1b4ed3121a5', 'request_id': 'req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:34.521299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15336e7f00174658b3dcf1b4ed3121a5', 'request_id': 'req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:34.541578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15336e7f00174658b3dcf1b4ed3121a5', 'request_id': 'req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:34.591009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827 admin admin] The token cache is being invalidate because project 15336e7f00174658b3dcf1b4ed3121a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:34.594260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:34.597385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f4f551a8-40bb-4eaa-9e2e-27f5299ca827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:34.605288 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2314/4634] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:34 2022] DELETE /identity/v3/projects/15336e7f00174658b3dcf1b4ed3121a5 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:34.611408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e19ef2-9885-4ab1-a25d-3a861eac633e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:34.612997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e19ef2-9885-4ab1-a25d-3a861eac633e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:34.612997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e19ef2-9885-4ab1-a25d-3a861eac633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:34.647989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-66e19ef2-9885-4ab1-a25d-3a861eac633e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:34.649239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-66e19ef2-9885-4ab1-a25d-3a861eac633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:34.791157 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2321/4635] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:34.792985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b8a45-0401-4576-b8bf-cb01a34baad2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:34.793560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b8a45-0401-4576-b8bf-cb01a34baad2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:34.793872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b8a45-0401-4576-b8bf-cb01a34baad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:34.868209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-018b8a45-0401-4576-b8bf-cb01a34baad2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:34.869912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-018b8a45-0401-4576-b8bf-cb01a34baad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:34.903081 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2315/4636] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:34.908339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e19ef2-9885-4ab1-a25d-3a861eac633e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:34.965292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e19ef2-9885-4ab1-a25d-3a861eac633e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:35.010265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e03a28-5255-429a-b854-79b07d69abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:35.010940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e03a28-5255-429a-b854-79b07d69abb9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:35.011224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e03a28-5255-429a-b854-79b07d69abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:35.011530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e03a28-5255-429a-b854-79b07d69abb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:35.014860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e03a28-5255-429a-b854-79b07d69abb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:08:35.015209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e03a28-5255-429a-b854-79b07d69abb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:35.021703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e03a28-5255-429a-b854-79b07d69abb9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:35.086938 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2322/4637] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:35.090700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b8a45-0401-4576-b8bf-cb01a34baad2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:35.114812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b8a45-0401-4576-b8bf-cb01a34baad2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:35.164201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2ad90-c099-4c66-b045-dc6dd8769007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:35.169368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2ad90-c099-4c66-b045-dc6dd8769007 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:35.175429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2ad90-c099-4c66-b045-dc6dd8769007 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:35.176249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2ad90-c099-4c66-b045-dc6dd8769007 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:35.177272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2ad90-c099-4c66-b045-dc6dd8769007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:35.179842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2ad90-c099-4c66-b045-dc6dd8769007 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:35.286113 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2316/4638] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:35 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:35.288453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e03a28-5255-429a-b854-79b07d69abb9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:35.308248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e03a28-5255-429a-b854-79b07d69abb9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:35.432684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:35.541681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bc391-12b1-448e-9ef1-ea521c3f0b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:35.543834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bc391-12b1-448e-9ef1-ea521c3f0b18 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:35.544871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bc391-12b1-448e-9ef1-ea521c3f0b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:35.546018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bc391-12b1-448e-9ef1-ea521c3f0b18 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:35.549012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bc391-12b1-448e-9ef1-ea521c3f0b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:35.552775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bc391-12b1-448e-9ef1-ea521c3f0b18 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:35.635576 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2323/4639] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:35 2022] POST /identity/v3/users => generated 296 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:35.639924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2ad90-c099-4c66-b045-dc6dd8769007 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:35.669890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2ad90-c099-4c66-b045-dc6dd8769007 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:35.686783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d3b7e-b65e-46e2-a271-123f0b53d821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:35.687817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3b7e-b65e-46e2-a271-123f0b53d821 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:35.688368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3b7e-b65e-46e2-a271-123f0b53d821 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:35.691332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3b7e-b65e-46e2-a271-123f0b53d821 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:35.692723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d3b7e-b65e-46e2-a271-123f0b53d821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:35.695943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d3b7e-b65e-46e2-a271-123f0b53d821 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:35.727462 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2317/4640] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:35.733676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bc391-12b1-448e-9ef1-ea521c3f0b18 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:35.754557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bc391-12b1-448e-9ef1-ea521c3f0b18 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:35.771147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0180f-0710-4be9-bed6-317fa224572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:35.772136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0180f-0710-4be9-bed6-317fa224572c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:35.774395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0180f-0710-4be9-bed6-317fa224572c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:35.775089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0180f-0710-4be9-bed6-317fa224572c admin admin] PATH_INFO: `/v3/projects/555f8dbc7a0a4ef1ae0c83c806600906/users/14e6f20147864636ad8af74ac4b89634/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:35.896222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0180f-0710-4be9-bed6-317fa224572c admin admin] RBAC: Authorizing `identity:create_grant(project_id=555f8dbc7a0a4ef1ae0c83c806600906, user_id=14e6f20147864636ad8af74ac4b89634, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:35.900388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0180f-0710-4be9-bed6-317fa224572c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:35.948672 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2324/4641] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:35 2022] PUT /identity/v3/projects/555f8dbc7a0a4ef1ae0c83c806600906/users/14e6f20147864636ad8af74ac4b89634/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:35.952341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d3b7e-b65e-46e2-a271-123f0b53d821 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:35.965775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:35.973784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d3b7e-b65e-46e2-a271-123f0b53d821 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:36.186824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054be6b-39dd-44f2-befb-10d8909052c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:36.187641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054be6b-39dd-44f2-befb-10d8909052c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:36.187928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054be6b-39dd-44f2-befb-10d8909052c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:36.188212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054be6b-39dd-44f2-befb-10d8909052c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:36.189119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054be6b-39dd-44f2-befb-10d8909052c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:36.196926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054be6b-39dd-44f2-befb-10d8909052c7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:36.243713 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2318/4642] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:36.248013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0180f-0710-4be9-bed6-317fa224572c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:36.262514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0180f-0710-4be9-bed6-317fa224572c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:36.289156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634f712-a771-4ee9-9ae5-3fde239192d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:36.289819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634f712-a771-4ee9-9ae5-3fde239192d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:36.290110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634f712-a771-4ee9-9ae5-3fde239192d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:36.290394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634f712-a771-4ee9-9ae5-3fde239192d0 admin admin] PATH_INFO: `/v3/projects/555f8dbc7a0a4ef1ae0c83c806600906/users/14e6f20147864636ad8af74ac4b89634/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:36.319663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634f712-a771-4ee9-9ae5-3fde239192d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555f8dbc7a0a4ef1ae0c83c806600906, user_id=14e6f20147864636ad8af74ac4b89634, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:36.322362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634f712-a771-4ee9-9ae5-3fde239192d0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:36.345170 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2325/4643] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:36 2022] PUT /identity/v3/projects/555f8dbc7a0a4ef1ae0c83c806600906/users/14e6f20147864636ad8af74ac4b89634/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:36.357044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3046aa0-1a54-4062-baa0-f76a0cd20a42 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:36.357370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3046aa0-1a54-4062-baa0-f76a0cd20a42 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:36.357652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3046aa0-1a54-4062-baa0-f76a0cd20a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:36.472266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e3046aa0-1a54-4062-baa0-f76a0cd20a42 None None] MFA Rules not processed for user `14e6f20147864636ad8af74ac4b89634`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:36.474318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e3046aa0-1a54-4062-baa0-f76a0cd20a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:36.726108 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2319/4644] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:36.727798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634f712-a771-4ee9-9ae5-3fde239192d0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:36.935997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634f712-a771-4ee9-9ae5-3fde239192d0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:36.955547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe5c3b-32e0-40ad-b356-5dfd6af18423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:36.956823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe5c3b-32e0-40ad-b356-5dfd6af18423 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:36.957222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe5c3b-32e0-40ad-b356-5dfd6af18423 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:36.957504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe5c3b-32e0-40ad-b356-5dfd6af18423 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:36.958151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe5c3b-32e0-40ad-b356-5dfd6af18423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:36.964009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe5c3b-32e0-40ad-b356-5dfd6af18423 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:37.037152 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2326/4645] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:36 2022] POST /identity/v3/projects => generated 379 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:37.040997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3046aa0-1a54-4062-baa0-f76a0cd20a42 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:37.057791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3046aa0-1a54-4062-baa0-f76a0cd20a42 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:37.216771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34d57f-5a35-4768-ad87-2cbf291a3996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:37.217474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34d57f-5a35-4768-ad87-2cbf291a3996 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:37.217697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34d57f-5a35-4768-ad87-2cbf291a3996 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:37.218112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34d57f-5a35-4768-ad87-2cbf291a3996 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:37.218828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34d57f-5a35-4768-ad87-2cbf291a3996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:37.221072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34d57f-5a35-4768-ad87-2cbf291a3996 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:37.269871 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2320/4646] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:37 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:37.273932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe5c3b-32e0-40ad-b356-5dfd6af18423 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:37.288023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe5c3b-32e0-40ad-b356-5dfd6af18423 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:37.298297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a5218-51d4-4897-945b-a996e23703f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:37.298977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a5218-51d4-4897-945b-a996e23703f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:37.299265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a5218-51d4-4897-945b-a996e23703f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:37.300164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a5218-51d4-4897-945b-a996e23703f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:37.300816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a5218-51d4-4897-945b-a996e23703f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:37.310929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a5218-51d4-4897-945b-a996e23703f5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:37.336755 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2327/4647] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:37.340688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34d57f-5a35-4768-ad87-2cbf291a3996 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:37.353076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34d57f-5a35-4768-ad87-2cbf291a3996 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:37.376283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd5d8d-f5d2-4ef8-bd7d-a0fd8078951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:37.376283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd5d8d-f5d2-4ef8-bd7d-a0fd8078951a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:37.376283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd5d8d-f5d2-4ef8-bd7d-a0fd8078951a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:37.376283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd5d8d-f5d2-4ef8-bd7d-a0fd8078951a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:37.376739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd5d8d-f5d2-4ef8-bd7d-a0fd8078951a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:37.376739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd5d8d-f5d2-4ef8-bd7d-a0fd8078951a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:37.402402 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2321/4648] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:37.405458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a5218-51d4-4897-945b-a996e23703f5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:37.422077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a5218-51d4-4897-945b-a996e23703f5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:37.448351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844265d-7afc-441b-8334-98735c655170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:37.449620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844265d-7afc-441b-8334-98735c655170 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:37.449907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844265d-7afc-441b-8334-98735c655170 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:37.450187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844265d-7afc-441b-8334-98735c655170 admin admin] PATH_INFO: `/v3/projects/d4db313b09964f718e1a83ab8053855e/users/e2e4d82f812c4a2aa9935706275b74fc/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:37.489361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844265d-7afc-441b-8334-98735c655170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4db313b09964f718e1a83ab8053855e, user_id=e2e4d82f812c4a2aa9935706275b74fc, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:37.496443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844265d-7afc-441b-8334-98735c655170 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:37.554777 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2328/4649] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:37 2022] PUT /identity/v3/projects/d4db313b09964f718e1a83ab8053855e/users/e2e4d82f812c4a2aa9935706275b74fc/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:37.666217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc17b6-c0b3-47c9-82cd-47b1300032e6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:37.666524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc17b6-c0b3-47c9-82cd-47b1300032e6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:37.666854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc17b6-c0b3-47c9-82cd-47b1300032e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:37.703347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:37.750021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-68dc17b6-c0b3-47c9-82cd-47b1300032e6 None None] MFA Rules not processed for user `e2e4d82f812c4a2aa9935706275b74fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:37.751793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-68dc17b6-c0b3-47c9-82cd-47b1300032e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:37.871904 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2322/4650] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:37.928237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844265d-7afc-441b-8334-98735c655170 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:37.931703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9844265d-7afc-441b-8334-98735c655170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:38.070924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:38.119572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844265d-7afc-441b-8334-98735c655170 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:38.129470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247bac7-82c3-4494-8673-3e425ac13344 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:38.130245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247bac7-82c3-4494-8673-3e425ac13344 service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:38.130640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247bac7-82c3-4494-8673-3e425ac13344 service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:38.131060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247bac7-82c3-4494-8673-3e425ac13344 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:38.332971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247bac7-82c3-4494-8673-3e425ac13344 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:38.334654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247bac7-82c3-4494-8673-3e425ac13344 service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:38.373344 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2329/4651] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:40.792885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc17b6-c0b3-47c9-82cd-47b1300032e6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:41.017120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc17b6-c0b3-47c9-82cd-47b1300032e6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:41.034867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:41.035542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:41.035823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:41.036101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] PATH_INFO: `/v3/users/14e6f20147864636ad8af74ac4b89634` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:41.042114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e6f20147864636ad8af74ac4b89634)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:41.050010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:41.198066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e6f20147864636ad8af74ac4b89634'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:41.229300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e6f20147864636ad8af74ac4b89634'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:41.231195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e6f20147864636ad8af74ac4b89634'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:41.280063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e6f20147864636ad8af74ac4b89634'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:41.281587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e6f20147864636ad8af74ac4b89634'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:41.359401 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2323/4652] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:40 2022] DELETE /identity/v3/users/14e6f20147864636ad8af74ac4b89634 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:41.363933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943c982-e7c4-4a28-b0fe-42dd836bc4e6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:41.364700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943c982-e7c4-4a28-b0fe-42dd836bc4e6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:41.364700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943c982-e7c4-4a28-b0fe-42dd836bc4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:41.431896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9943c982-e7c4-4a28-b0fe-42dd836bc4e6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:41.447339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9943c982-e7c4-4a28-b0fe-42dd836bc4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:41.696505 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2330/4653] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:41.727466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:41.729024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:41.755376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:41.869342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e649a07-8ca0-4695-b608-f62ab8388c2f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:41.881965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff48da9-74d1-499d-a417-4fd1769e74fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:41.885210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff48da9-74d1-499d-a417-4fd1769e74fc service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:41.885781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff48da9-74d1-499d-a417-4fd1769e74fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:41.886281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff48da9-74d1-499d-a417-4fd1769e74fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:41.928447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff48da9-74d1-499d-a417-4fd1769e74fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:41.931620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff48da9-74d1-499d-a417-4fd1769e74fc service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:41.966672 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2324/4654] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:42.958648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943c982-e7c4-4a28-b0fe-42dd836bc4e6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:42.960791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9943c982-e7c4-4a28-b0fe-42dd836bc4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:42.998505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943c982-e7c4-4a28-b0fe-42dd836bc4e6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:43.007293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02eba9c-c816-41b8-bcb2-86f5367a172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:43.008332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eba9c-c816-41b8-bcb2-86f5367a172a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:43.008792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eba9c-c816-41b8-bcb2-86f5367a172a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:43.009243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eba9c-c816-41b8-bcb2-86f5367a172a admin admin] PATH_INFO: `/v3/projects/555f8dbc7a0a4ef1ae0c83c806600906` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:43.010675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02eba9c-c816-41b8-bcb2-86f5367a172a admin admin] RBAC: Authorizing `identity:delete_project(project_id=555f8dbc7a0a4ef1ae0c83c806600906)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:43.012872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02eba9c-c816-41b8-bcb2-86f5367a172a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:43.193607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b02eba9c-c816-41b8-bcb2-86f5367a172a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555f8dbc7a0a4ef1ae0c83c806600906', 'request_id': 'req-b02eba9c-c816-41b8-bcb2-86f5367a172a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:43.202393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b02eba9c-c816-41b8-bcb2-86f5367a172a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555f8dbc7a0a4ef1ae0c83c806600906', 'request_id': 'req-b02eba9c-c816-41b8-bcb2-86f5367a172a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:43.216177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b02eba9c-c816-41b8-bcb2-86f5367a172a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555f8dbc7a0a4ef1ae0c83c806600906', 'request_id': 'req-b02eba9c-c816-41b8-bcb2-86f5367a172a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:43.241434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b02eba9c-c816-41b8-bcb2-86f5367a172a admin admin] The token cache is being invalidate because project 555f8dbc7a0a4ef1ae0c83c806600906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:43.242244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b02eba9c-c816-41b8-bcb2-86f5367a172a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:43.244449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b02eba9c-c816-41b8-bcb2-86f5367a172a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:43.253080 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2331/4655] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:42 2022] DELETE /identity/v3/projects/555f8dbc7a0a4ef1ae0c83c806600906 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:43.256973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff48da9-74d1-499d-a417-4fd1769e74fc service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:43.280184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff48da9-74d1-499d-a417-4fd1769e74fc service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:43.325830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41449516-79dd-4554-926d-8782b43376b7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:43.326401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41449516-79dd-4554-926d-8782b43376b7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:43.326914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41449516-79dd-4554-926d-8782b43376b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:43.372366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-41449516-79dd-4554-926d-8782b43376b7 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:43.373648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-41449516-79dd-4554-926d-8782b43376b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:43.393492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:43.496672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:43.497580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:43.498040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:43.498492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] PATH_INFO: `/v3/users/e2e4d82f812c4a2aa9935706275b74fc` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:43.500026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e4d82f812c4a2aa9935706275b74fc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:43.502160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:43.641887 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2332/4656] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:08:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:43.661805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e4d82f812c4a2aa9935706275b74fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:43.662666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41449516-79dd-4554-926d-8782b43376b7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:43.664569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-41449516-79dd-4554-926d-8782b43376b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:43.693846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e4d82f812c4a2aa9935706275b74fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:43.694854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e4d82f812c4a2aa9935706275b74fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:43.735738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e4d82f812c4a2aa9935706275b74fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:43.740966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e4d82f812c4a2aa9935706275b74fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:43.788027 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2325/4657] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:43 2022] DELETE /identity/v3/users/e2e4d82f812c4a2aa9935706275b74fc => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:43.942440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41449516-79dd-4554-926d-8782b43376b7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:44.129210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4027f7-4a1b-49bc-b042-2221fa7ce73a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:44.129956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4027f7-4a1b-49bc-b042-2221fa7ce73a service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:44.130129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4027f7-4a1b-49bc-b042-2221fa7ce73a service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:44.130715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4027f7-4a1b-49bc-b042-2221fa7ce73a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:44.145987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8b4027f7-4a1b-49bc-b042-2221fa7ce73a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:44.464351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4027f7-4a1b-49bc-b042-2221fa7ce73a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:44.491367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4027f7-4a1b-49bc-b042-2221fa7ce73a service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:44.522554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:44.547224 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2333/4658] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:08:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 885 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:08:44.986133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:44.989240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:45.176125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:45.289054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969f4ec-b23a-499c-becd-75872833b8ba admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:45.320804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:45.321220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:45.321737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:45.322112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] PATH_INFO: `/v3/users/aea6cb1e544e4a1099be85a8f58e6b2d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:45.325807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea6cb1e544e4a1099be85a8f58e6b2d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:45.328032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:45.458023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea6cb1e544e4a1099be85a8f58e6b2d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:45.476567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea6cb1e544e4a1099be85a8f58e6b2d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:45.484580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea6cb1e544e4a1099be85a8f58e6b2d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:45.515427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea6cb1e544e4a1099be85a8f58e6b2d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:45.523301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea6cb1e544e4a1099be85a8f58e6b2d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:45.544987 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2326/4659] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:44 2022] DELETE /identity/v3/users/aea6cb1e544e4a1099be85a8f58e6b2d => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:45.550562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904caee1-6e8f-4dc3-abbe-80f9ff2531d8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:45.551163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904caee1-6e8f-4dc3-abbe-80f9ff2531d8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:45.551163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904caee1-6e8f-4dc3-abbe-80f9ff2531d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:45.660010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-904caee1-6e8f-4dc3-abbe-80f9ff2531d8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:45.661767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-904caee1-6e8f-4dc3-abbe-80f9ff2531d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:45.784201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:45.788232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:45.999115 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2334/4660] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:46.006696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904caee1-6e8f-4dc3-abbe-80f9ff2531d8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:46.007130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfd093-34d6-455a-b7fb-65a6a7e9e3b6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:46.008827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-904caee1-6e8f-4dc3-abbe-80f9ff2531d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:46.025737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6d3e7-88a6-4077-95f5-54850c4af6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:46.026966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6d3e7-88a6-4077-95f5-54850c4af6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:46.027443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6d3e7-88a6-4077-95f5-54850c4af6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:46.028674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6d3e7-88a6-4077-95f5-54850c4af6d0 admin admin] PATH_INFO: `/v3/projects/d4db313b09964f718e1a83ab8053855e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:46.029350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6d3e7-88a6-4077-95f5-54850c4af6d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4db313b09964f718e1a83ab8053855e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:46.032521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6d3e7-88a6-4077-95f5-54850c4af6d0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:46.195932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aea6d3e7-88a6-4077-95f5-54850c4af6d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4db313b09964f718e1a83ab8053855e', 'request_id': 'req-aea6d3e7-88a6-4077-95f5-54850c4af6d0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:46.232445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:46.251194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aea6d3e7-88a6-4077-95f5-54850c4af6d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4db313b09964f718e1a83ab8053855e', 'request_id': 'req-aea6d3e7-88a6-4077-95f5-54850c4af6d0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:46.280868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aea6d3e7-88a6-4077-95f5-54850c4af6d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4db313b09964f718e1a83ab8053855e', 'request_id': 'req-aea6d3e7-88a6-4077-95f5-54850c4af6d0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:46.287232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904caee1-6e8f-4dc3-abbe-80f9ff2531d8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:46.334603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aea6d3e7-88a6-4077-95f5-54850c4af6d0 admin admin] The token cache is being invalidate because project d4db313b09964f718e1a83ab8053855e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:46.337866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aea6d3e7-88a6-4077-95f5-54850c4af6d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:46.340241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aea6d3e7-88a6-4077-95f5-54850c4af6d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:46.357954 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2327/4661] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:45 2022] DELETE /identity/v3/projects/d4db313b09964f718e1a83ab8053855e => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:46.366516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36bae9-60fb-4aef-9755-2053f1bf041b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:46.367077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36bae9-60fb-4aef-9755-2053f1bf041b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:46.367565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36bae9-60fb-4aef-9755-2053f1bf041b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:46.444144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4a36bae9-60fb-4aef-9755-2053f1bf041b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:46.446891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4a36bae9-60fb-4aef-9755-2053f1bf041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:46.550252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7faf8-288a-470a-93f8-62f571540efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:46.550949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7faf8-288a-470a-93f8-62f571540efc service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:46.551839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7faf8-288a-470a-93f8-62f571540efc service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:46.551839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7faf8-288a-470a-93f8-62f571540efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:46.560529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4bc7faf8-288a-470a-93f8-62f571540efc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:46.690323 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2328/4662] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:08:46.704300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d445864-2cee-486f-9326-118a650643e6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:46.706299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d445864-2cee-486f-9326-118a650643e6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:46.708647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d445864-2cee-486f-9326-118a650643e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:46.804517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7faf8-288a-470a-93f8-62f571540efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:46.805374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7faf8-288a-470a-93f8-62f571540efc service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:46.831373 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2335/4663] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 825 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:46.860052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2d445864-2cee-486f-9326-118a650643e6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:46.861304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2d445864-2cee-486f-9326-118a650643e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:46.885779 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2329/4664] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:08:46.891625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7faf8-288a-470a-93f8-62f571540efc service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:46.929279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7faf8-288a-470a-93f8-62f571540efc service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:46.936413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b8349-d735-4948-aede-0a7cf693a86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:46.937053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b8349-d735-4948-aede-0a7cf693a86b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:46.937338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b8349-d735-4948-aede-0a7cf693a86b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:46.937614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b8349-d735-4948-aede-0a7cf693a86b admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:46.938283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b8349-d735-4948-aede-0a7cf693a86b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:08:46.938588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b8349-d735-4948-aede-0a7cf693a86b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:46.941046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b8349-d735-4948-aede-0a7cf693a86b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:46.942996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:46.988654 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2336/4665] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:46.992908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d445864-2cee-486f-9326-118a650643e6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:47.007605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d445864-2cee-486f-9326-118a650643e6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:47.033801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b099e0c-c325-4627-adb4-b52a2e234043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:47.034904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b099e0c-c325-4627-adb4-b52a2e234043 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:47.035273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b099e0c-c325-4627-adb4-b52a2e234043 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:47.035547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b099e0c-c325-4627-adb4-b52a2e234043 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:47.036462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b099e0c-c325-4627-adb4-b52a2e234043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:47.038435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b099e0c-c325-4627-adb4-b52a2e234043 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:47.111356 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2330/4666] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:46 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:47.116518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b8349-d735-4948-aede-0a7cf693a86b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:47.137080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b8349-d735-4948-aede-0a7cf693a86b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:47.331782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb870129-10a2-4ea3-9cb9-6c564a5c6f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:47.332750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870129-10a2-4ea3-9cb9-6c564a5c6f87 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:47.333267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870129-10a2-4ea3-9cb9-6c564a5c6f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:47.333712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870129-10a2-4ea3-9cb9-6c564a5c6f87 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:47.334534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb870129-10a2-4ea3-9cb9-6c564a5c6f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:47.336681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb870129-10a2-4ea3-9cb9-6c564a5c6f87 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:47.398098 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2337/4667] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:47 2022] POST /identity/v3/users => generated 283 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:08:47.402278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b099e0c-c325-4627-adb4-b52a2e234043 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:47.425910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b099e0c-c325-4627-adb4-b52a2e234043 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:47.440226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d447161-6d10-46d3-bb69-2cabe3da1ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:47.441247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d447161-6d10-46d3-bb69-2cabe3da1ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:47.441719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d447161-6d10-46d3-bb69-2cabe3da1ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:47.442158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d447161-6d10-46d3-bb69-2cabe3da1ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:47.443772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d447161-6d10-46d3-bb69-2cabe3da1ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:47.445825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d447161-6d10-46d3-bb69-2cabe3da1ee6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:47.486579 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2331/4668] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:47.491291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb870129-10a2-4ea3-9cb9-6c564a5c6f87 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:47.504937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb870129-10a2-4ea3-9cb9-6c564a5c6f87 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:47.515292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af680d-b92b-45b1-a56c-95aa767f9f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:47.516502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af680d-b92b-45b1-a56c-95aa767f9f5b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:47.517002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af680d-b92b-45b1-a56c-95aa767f9f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:47.517454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af680d-b92b-45b1-a56c-95aa767f9f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:47.518467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af680d-b92b-45b1-a56c-95aa767f9f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:47.520392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af680d-b92b-45b1-a56c-95aa767f9f5b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:47.567760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d447161-6d10-46d3-bb69-2cabe3da1ee6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:47.573883 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2338/4669] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:47.607502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d447161-6d10-46d3-bb69-2cabe3da1ee6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:47.621146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c5a68-ccc8-4385-9edd-c799a1febfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:47.622166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c5a68-ccc8-4385-9edd-c799a1febfe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:47.622629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c5a68-ccc8-4385-9edd-c799a1febfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:47.623098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c5a68-ccc8-4385-9edd-c799a1febfe8 admin admin] PATH_INFO: `/v3/projects/7492cf892e9c41e1a06f7262a2d0a740/users/82950b334644415fb9fcb51b45b3fa2d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:47.676997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c5a68-ccc8-4385-9edd-c799a1febfe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7492cf892e9c41e1a06f7262a2d0a740, user_id=82950b334644415fb9fcb51b45b3fa2d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:47.680697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c5a68-ccc8-4385-9edd-c799a1febfe8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:47.726468 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2332/4670] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:47 2022] PUT /identity/v3/projects/7492cf892e9c41e1a06f7262a2d0a740/users/82950b334644415fb9fcb51b45b3fa2d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:47.727691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29ffc2-3d7d-47fc-b1b4-683f97ba99ab None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:47.728232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29ffc2-3d7d-47fc-b1b4-683f97ba99ab None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:47.729435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29ffc2-3d7d-47fc-b1b4-683f97ba99ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:47.856489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0a29ffc2-3d7d-47fc-b1b4-683f97ba99ab None None] MFA Rules not processed for user `82950b334644415fb9fcb51b45b3fa2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:47.857755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0a29ffc2-3d7d-47fc-b1b4-683f97ba99ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:48.132505 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2339/4671] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:08:48.138128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c5a68-ccc8-4385-9edd-c799a1febfe8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:48.322706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c5a68-ccc8-4385-9edd-c799a1febfe8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:48.335413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbf15c-1196-413a-9db6-f63fe3181dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:48.336058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbf15c-1196-413a-9db6-f63fe3181dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:48.336344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbf15c-1196-413a-9db6-f63fe3181dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:48.336623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbf15c-1196-413a-9db6-f63fe3181dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:48.337274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbf15c-1196-413a-9db6-f63fe3181dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:48.339258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbf15c-1196-413a-9db6-f63fe3181dc0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:48.416871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29ffc2-3d7d-47fc-b1b4-683f97ba99ab None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:48.418942 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2333/4672] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:48 2022] POST /identity/v3/projects => generated 369 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:48.457531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29ffc2-3d7d-47fc-b1b4-683f97ba99ab None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:48.602048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295d41b-9bdd-442e-926d-8ddf9427320f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:48.603367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295d41b-9bdd-442e-926d-8ddf9427320f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:48.603822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295d41b-9bdd-442e-926d-8ddf9427320f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:48.604263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295d41b-9bdd-442e-926d-8ddf9427320f admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:48.605116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295d41b-9bdd-442e-926d-8ddf9427320f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:48.607695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295d41b-9bdd-442e-926d-8ddf9427320f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:48.620809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:48.663596 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2340/4673] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:48 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:48.665124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbf15c-1196-413a-9db6-f63fe3181dc0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:48.675967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:48.683533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbf15c-1196-413a-9db6-f63fe3181dc0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:48.710457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84b9cc-6fa9-4a20-9e42-182dcea363d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:48.713487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84b9cc-6fa9-4a20-9e42-182dcea363d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:48.714188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84b9cc-6fa9-4a20-9e42-182dcea363d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:48.714882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84b9cc-6fa9-4a20-9e42-182dcea363d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:48.715886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84b9cc-6fa9-4a20-9e42-182dcea363d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:48.718115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84b9cc-6fa9-4a20-9e42-182dcea363d6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:48.792844 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2334/4674] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:08:48.802681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295d41b-9bdd-442e-926d-8ddf9427320f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:48.822379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295d41b-9bdd-442e-926d-8ddf9427320f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:48.866645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44b3ab-97bc-443c-a781-2da5653efc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:48.867921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44b3ab-97bc-443c-a781-2da5653efc8a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:48.868456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44b3ab-97bc-443c-a781-2da5653efc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:48.868980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44b3ab-97bc-443c-a781-2da5653efc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:48.870661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44b3ab-97bc-443c-a781-2da5653efc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:48.875356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44b3ab-97bc-443c-a781-2da5653efc8a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:48.922401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84b9cc-6fa9-4a20-9e42-182dcea363d6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:48.936603 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2341/4675] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:48.942311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84b9cc-6fa9-4a20-9e42-182dcea363d6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:48.958307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efba213-89e9-4e4c-a2f5-6b52eb637fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:48.959606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efba213-89e9-4e4c-a2f5-6b52eb637fad admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:48.960196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efba213-89e9-4e4c-a2f5-6b52eb637fad admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:48.961374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efba213-89e9-4e4c-a2f5-6b52eb637fad admin admin] PATH_INFO: `/v3/projects/4fa83bfb5bd0427d9b2fc8473398ea61/users/744a7afe965e454c909ee236d8f65e03/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:49.003706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efba213-89e9-4e4c-a2f5-6b52eb637fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa83bfb5bd0427d9b2fc8473398ea61, user_id=744a7afe965e454c909ee236d8f65e03, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:49.013809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efba213-89e9-4e4c-a2f5-6b52eb637fad admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:49.040900 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2335/4676] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:48 2022] PUT /identity/v3/projects/4fa83bfb5bd0427d9b2fc8473398ea61/users/744a7afe965e454c909ee236d8f65e03/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:08:49.051727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ba526-006d-4aac-9394-174d9644a4a8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:49.052430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ba526-006d-4aac-9394-174d9644a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:49.052946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ba526-006d-4aac-9394-174d9644a4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:49.113446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-842ba526-006d-4aac-9394-174d9644a4a8 None None] MFA Rules not processed for user `744a7afe965e454c909ee236d8f65e03`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:49.115188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-842ba526-006d-4aac-9394-174d9644a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:49.323024 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2342/4677] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:08:49.332357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efba213-89e9-4e4c-a2f5-6b52eb637fad admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:49.334272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4efba213-89e9-4e4c-a2f5-6b52eb637fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:49.468594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efba213-89e9-4e4c-a2f5-6b52eb637fad admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:49.473824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3ecf1-9e80-42a7-9784-d3c54f81f0d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:49.474571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3ecf1-9e80-42a7-9784-d3c54f81f0d9 service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:49.474967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3ecf1-9e80-42a7-9784-d3c54f81f0d9 service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:49.475325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3ecf1-9e80-42a7-9784-d3c54f81f0d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:49.567368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3ecf1-9e80-42a7-9784-d3c54f81f0d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:49.568939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3ecf1-9e80-42a7-9784-d3c54f81f0d9 service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:49.601084 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2336/4678] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:49.778881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ba526-006d-4aac-9394-174d9644a4a8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:49.780976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-842ba526-006d-4aac-9394-174d9644a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:49.994924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ba526-006d-4aac-9394-174d9644a4a8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:50.012147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb466350-fd71-4fcd-8fda-86c78ae35541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:50.012724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb466350-fd71-4fcd-8fda-86c78ae35541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:50.013014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb466350-fd71-4fcd-8fda-86c78ae35541 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:50.013292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb466350-fd71-4fcd-8fda-86c78ae35541 admin admin] PATH_INFO: `/v3/projects/f531b7ab75c44eedad1ed3049c3a6256` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:50.023612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb466350-fd71-4fcd-8fda-86c78ae35541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f531b7ab75c44eedad1ed3049c3a6256)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:50.025722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb466350-fd71-4fcd-8fda-86c78ae35541 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:50.079249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3ecf1-9e80-42a7-9784-d3c54f81f0d9 service glance] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:50.090729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3ecf1-9e80-42a7-9784-d3c54f81f0d9 service glance] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:50.097855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7d687-61fe-46f6-81ac-d0750b62c3a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:50.097855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7d687-61fe-46f6-81ac-d0750b62c3a1 service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:50.097855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7d687-61fe-46f6-81ac-d0750b62c3a1 service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:50.097855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7d687-61fe-46f6-81ac-d0750b62c3a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:50.119979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7d687-61fe-46f6-81ac-d0750b62c3a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:50.126950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7d687-61fe-46f6-81ac-d0750b62c3a1 service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:50.159415 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2337/4679] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:08:50.192232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb466350-fd71-4fcd-8fda-86c78ae35541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f531b7ab75c44eedad1ed3049c3a6256', 'request_id': 'req-fb466350-fd71-4fcd-8fda-86c78ae35541'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:50.201990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb466350-fd71-4fcd-8fda-86c78ae35541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f531b7ab75c44eedad1ed3049c3a6256', 'request_id': 'req-fb466350-fd71-4fcd-8fda-86c78ae35541'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:50.210989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb466350-fd71-4fcd-8fda-86c78ae35541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f531b7ab75c44eedad1ed3049c3a6256', 'request_id': 'req-fb466350-fd71-4fcd-8fda-86c78ae35541'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:50.231485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:50.243399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb466350-fd71-4fcd-8fda-86c78ae35541 admin admin] The token cache is being invalidate because project f531b7ab75c44eedad1ed3049c3a6256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:50.244873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb466350-fd71-4fcd-8fda-86c78ae35541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:50.247302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb466350-fd71-4fcd-8fda-86c78ae35541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:50.254673 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2343/4680] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:49 2022] DELETE /identity/v3/projects/f531b7ab75c44eedad1ed3049c3a6256 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:08:50.263136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7c5e8-af2c-47a8-89b2-b3b138c7c032 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:50.263136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7c5e8-af2c-47a8-89b2-b3b138c7c032 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:50.263136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7c5e8-af2c-47a8-89b2-b3b138c7c032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:50.309978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-34a7c5e8-af2c-47a8-89b2-b3b138c7c032 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:50.311237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-34a7c5e8-af2c-47a8-89b2-b3b138c7c032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:50.511752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ef233-59da-4744-bb60-f9aefc90bfeb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:50.512632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ef233-59da-4744-bb60-f9aefc90bfeb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:50.512632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ef233-59da-4744-bb60-f9aefc90bfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:50.519697 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2338/4681] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:50.554305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-545ef233-59da-4744-bb60-f9aefc90bfeb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:50.594497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-545ef233-59da-4744-bb60-f9aefc90bfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:50.630735 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2344/4682] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:50.632343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7c5e8-af2c-47a8-89b2-b3b138c7c032 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:50.652975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7c5e8-af2c-47a8-89b2-b3b138c7c032 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:50.667814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bce60b-c3cf-400f-b38d-09a94bf5b0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:50.669709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bce60b-c3cf-400f-b38d-09a94bf5b0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:50.670089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bce60b-c3cf-400f-b38d-09a94bf5b0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:50.671031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bce60b-c3cf-400f-b38d-09a94bf5b0d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:50.673083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bce60b-c3cf-400f-b38d-09a94bf5b0d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:08:50.673657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bce60b-c3cf-400f-b38d-09a94bf5b0d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:50.679724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bce60b-c3cf-400f-b38d-09a94bf5b0d9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:50.701552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:50.714554 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2339/4683] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:08:50.718121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ef233-59da-4744-bb60-f9aefc90bfeb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:50.730612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ef233-59da-4744-bb60-f9aefc90bfeb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:50.747172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf28001-ed68-403d-8c68-55b6d8dfe165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:50.747824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf28001-ed68-403d-8c68-55b6d8dfe165 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:50.748326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf28001-ed68-403d-8c68-55b6d8dfe165 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:50.748658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf28001-ed68-403d-8c68-55b6d8dfe165 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:50.751292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf28001-ed68-403d-8c68-55b6d8dfe165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:50.758607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf28001-ed68-403d-8c68-55b6d8dfe165 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:50.839658 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2345/4684] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:50 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:50.844014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bce60b-c3cf-400f-b38d-09a94bf5b0d9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:50.863958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bce60b-c3cf-400f-b38d-09a94bf5b0d9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:51.051556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5ced1-6f0c-440f-b78a-50c19ed16eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:51.052208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5ced1-6f0c-440f-b78a-50c19ed16eeb admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:51.052503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5ced1-6f0c-440f-b78a-50c19ed16eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:51.052784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5ced1-6f0c-440f-b78a-50c19ed16eeb admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:51.053452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5ced1-6f0c-440f-b78a-50c19ed16eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:51.055457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5ced1-6f0c-440f-b78a-50c19ed16eeb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:51.137006 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2340/4685] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:50 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:51.139738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf28001-ed68-403d-8c68-55b6d8dfe165 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:51.157467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf28001-ed68-403d-8c68-55b6d8dfe165 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:51.178662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dff02-63de-4913-887d-3325cd6f8bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:51.183309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dff02-63de-4913-887d-3325cd6f8bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:51.183598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dff02-63de-4913-887d-3325cd6f8bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:51.188119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dff02-63de-4913-887d-3325cd6f8bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:51.188915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dff02-63de-4913-887d-3325cd6f8bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:51.198479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dff02-63de-4913-887d-3325cd6f8bf6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:51.240068 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2346/4686] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:51.242506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5ced1-6f0c-440f-b78a-50c19ed16eeb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:51.254933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5ced1-6f0c-440f-b78a-50c19ed16eeb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:51.270665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71230b-a143-4628-ace3-860cf1a8c336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:51.271339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71230b-a143-4628-ace3-860cf1a8c336 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:51.271640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71230b-a143-4628-ace3-860cf1a8c336 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:51.271907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71230b-a143-4628-ace3-860cf1a8c336 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:51.272570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71230b-a143-4628-ace3-860cf1a8c336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:51.274204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71230b-a143-4628-ace3-860cf1a8c336 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:51.316250 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2341/4687] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:51.318020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dff02-63de-4913-887d-3325cd6f8bf6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:51.343589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dff02-63de-4913-887d-3325cd6f8bf6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:51.357018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bf644-392e-46c6-bf89-5f8e328beb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:51.359295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bf644-392e-46c6-bf89-5f8e328beb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:51.364269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bf644-392e-46c6-bf89-5f8e328beb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:51.365326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bf644-392e-46c6-bf89-5f8e328beb8c admin admin] PATH_INFO: `/v3/projects/1976921c67ab40e7a3b9ba6ddbeb8abf/users/5d5833af8c0a4ca9a844905b5ea94665/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:51.388802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bf644-392e-46c6-bf89-5f8e328beb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1976921c67ab40e7a3b9ba6ddbeb8abf, user_id=5d5833af8c0a4ca9a844905b5ea94665, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:51.392230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bf644-392e-46c6-bf89-5f8e328beb8c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:51.426449 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2347/4688] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:51 2022] PUT /identity/v3/projects/1976921c67ab40e7a3b9ba6ddbeb8abf/users/5d5833af8c0a4ca9a844905b5ea94665/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:51.431780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5375c-6e84-46fd-90ec-37a6818cee9c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:51.432361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5375c-6e84-46fd-90ec-37a6818cee9c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:51.432805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5375c-6e84-46fd-90ec-37a6818cee9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:51.474027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1ed5375c-6e84-46fd-90ec-37a6818cee9c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:51.476016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1ed5375c-6e84-46fd-90ec-37a6818cee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:51.666364 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2342/4689] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:51.707005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bf644-392e-46c6-bf89-5f8e328beb8c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:51.707005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-665bf644-392e-46c6-bf89-5f8e328beb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:51.911576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bf644-392e-46c6-bf89-5f8e328beb8c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:51.929779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32583205-92a4-4197-911a-3607b5a806f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:51.930828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583205-92a4-4197-911a-3607b5a806f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:51.931284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583205-92a4-4197-911a-3607b5a806f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:51.931950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32583205-92a4-4197-911a-3607b5a806f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:51.945657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32583205-92a4-4197-911a-3607b5a806f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:51.947553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32583205-92a4-4197-911a-3607b5a806f2 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:51.977076 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2348/4690] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:53.170866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5375c-6e84-46fd-90ec-37a6818cee9c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:53.175126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1ed5375c-6e84-46fd-90ec-37a6818cee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:53.206782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f3aae-a3e4-4464-b400-a51bc2135857 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:53.207368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f3aae-a3e4-4464-b400-a51bc2135857 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:53.207611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f3aae-a3e4-4464-b400-a51bc2135857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:53.237445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5375c-6e84-46fd-90ec-37a6818cee9c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:53.250341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cc3f3aae-a3e4-4464-b400-a51bc2135857 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:53.253684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cc3f3aae-a3e4-4464-b400-a51bc2135857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:53.273285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4eaab-30c1-4d18-a9b8-bc09140e3c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:53.277044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4eaab-30c1-4d18-a9b8-bc09140e3c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:53.279092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4eaab-30c1-4d18-a9b8-bc09140e3c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:53.281038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4eaab-30c1-4d18-a9b8-bc09140e3c48 admin admin] PATH_INFO: `/v3/users/82950b334644415fb9fcb51b45b3fa2d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:53.290243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4eaab-30c1-4d18-a9b8-bc09140e3c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82950b334644415fb9fcb51b45b3fa2d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:53.294928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4eaab-30c1-4d18-a9b8-bc09140e3c48 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:53.520972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-02f4eaab-30c1-4d18-a9b8-bc09140e3c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82950b334644415fb9fcb51b45b3fa2d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:53.532120 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2349/4691] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:08:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:08:53.545908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-02f4eaab-30c1-4d18-a9b8-bc09140e3c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82950b334644415fb9fcb51b45b3fa2d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:53.546939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-02f4eaab-30c1-4d18-a9b8-bc09140e3c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82950b334644415fb9fcb51b45b3fa2d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:53.549137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f3aae-a3e4-4464-b400-a51bc2135857 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:53.551304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cc3f3aae-a3e4-4464-b400-a51bc2135857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:53.573925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:53.581726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-02f4eaab-30c1-4d18-a9b8-bc09140e3c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82950b334644415fb9fcb51b45b3fa2d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:53.583017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-02f4eaab-30c1-4d18-a9b8-bc09140e3c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82950b334644415fb9fcb51b45b3fa2d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:53.617266 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2343/4692] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:53 2022] DELETE /identity/v3/users/82950b334644415fb9fcb51b45b3fa2d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:53.623372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1bb6e-6c1c-4334-b35f-daacedcc5f1b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:53.623861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1bb6e-6c1c-4334-b35f-daacedcc5f1b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:53.624347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1bb6e-6c1c-4334-b35f-daacedcc5f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:53.670415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e2c1bb6e-6c1c-4334-b35f-daacedcc5f1b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:53.671790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e2c1bb6e-6c1c-4334-b35f-daacedcc5f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:53.690972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:53.733398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f3aae-a3e4-4464-b400-a51bc2135857 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:53.820656 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2344/4693] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:08:53.876536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1bb6e-6c1c-4334-b35f-daacedcc5f1b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:53.878339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e2c1bb6e-6c1c-4334-b35f-daacedcc5f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:53.935109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94590d27-47bc-4233-a0f1-6e46194d654f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:53.936954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94590d27-47bc-4233-a0f1-6e46194d654f service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:53.937374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94590d27-47bc-4233-a0f1-6e46194d654f service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:53.938538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94590d27-47bc-4233-a0f1-6e46194d654f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:53.947143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-94590d27-47bc-4233-a0f1-6e46194d654f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:54.017597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1bb6e-6c1c-4334-b35f-daacedcc5f1b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:54.030496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5a08b-3b73-43dc-8f6e-8d919789aa40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:54.031157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5a08b-3b73-43dc-8f6e-8d919789aa40 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:54.031443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5a08b-3b73-43dc-8f6e-8d919789aa40 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:54.031720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5a08b-3b73-43dc-8f6e-8d919789aa40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:54.058658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5a08b-3b73-43dc-8f6e-8d919789aa40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:54.064283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5a08b-3b73-43dc-8f6e-8d919789aa40 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:54.119470 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2345/4694] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:54.143990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94590d27-47bc-4233-a0f1-6e46194d654f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:54.146456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94590d27-47bc-4233-a0f1-6e46194d654f service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:54.183888 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2350/4695] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:08:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:08:55.098165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab9eb3-c66d-4c41-ba17-ff7819229bae None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:55.098717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab9eb3-c66d-4c41-ba17-ff7819229bae None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:55.098717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab9eb3-c66d-4c41-ba17-ff7819229bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:55.142435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5bab9eb3-c66d-4c41-ba17-ff7819229bae None None] MFA Rules not processed for user `600512845bb7444b82f9fe99f1e51327`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:55.147631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5bab9eb3-c66d-4c41-ba17-ff7819229bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:55.226418 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2346/4696] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:55.375802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94590d27-47bc-4233-a0f1-6e46194d654f service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:55.377776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-94590d27-47bc-4233-a0f1-6e46194d654f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:55.395092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94590d27-47bc-4233-a0f1-6e46194d654f service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:55.400779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:55.401852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:55.402244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:55.402629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] PATH_INFO: `/v3/projects/7492cf892e9c41e1a06f7262a2d0a740` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:55.404050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7492cf892e9c41e1a06f7262a2d0a740)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:55.406161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:55.526145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7492cf892e9c41e1a06f7262a2d0a740', 'request_id': 'req-d8eb9748-7293-4732-80dd-02efa821763a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:55.543397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7492cf892e9c41e1a06f7262a2d0a740', 'request_id': 'req-d8eb9748-7293-4732-80dd-02efa821763a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:55.557855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7492cf892e9c41e1a06f7262a2d0a740', 'request_id': 'req-d8eb9748-7293-4732-80dd-02efa821763a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:55.593389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] The token cache is being invalidate because project 7492cf892e9c41e1a06f7262a2d0a740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:55.593699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:55.601997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:55.609735 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2351/4697] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:55 2022] DELETE /identity/v3/projects/7492cf892e9c41e1a06f7262a2d0a740 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:55.612000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab9eb3-c66d-4c41-ba17-ff7819229bae None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:55.634433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab9eb3-c66d-4c41-ba17-ff7819229bae None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:55.756201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:55.831859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:55.832705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:55.833116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:55.833745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] PATH_INFO: `/v3/users/744a7afe965e454c909ee236d8f65e03` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:55.836502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=744a7afe965e454c909ee236d8f65e03)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:55.844034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:55.989554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744a7afe965e454c909ee236d8f65e03'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:56.008644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744a7afe965e454c909ee236d8f65e03'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:56.010311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744a7afe965e454c909ee236d8f65e03'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:56.055830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744a7afe965e454c909ee236d8f65e03'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:56.069191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744a7afe965e454c909ee236d8f65e03'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:56.103922 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2347/4698] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:55 2022] DELETE /identity/v3/users/744a7afe965e454c909ee236d8f65e03 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:56.370041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:56.372561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:56.416191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:56.520260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb9748-7293-4732-80dd-02efa821763a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:56.650980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531dfde-3392-419d-a20b-b79f4e193f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:56.652268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531dfde-3392-419d-a20b-b79f4e193f2a service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:56.652847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531dfde-3392-419d-a20b-b79f4e193f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:56.653376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531dfde-3392-419d-a20b-b79f4e193f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:56.655512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5531dfde-3392-419d-a20b-b79f4e193f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:56.691184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531dfde-3392-419d-a20b-b79f4e193f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:56.693145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531dfde-3392-419d-a20b-b79f4e193f2a service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:56.702170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:56.704506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:56.735014 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2352/4699] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:56.803502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf4753-186d-4727-b593-9e4e8cfc8a1b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:56.810355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81266c3-18c1-4fed-94d6-6266209c859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:56.813909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81266c3-18c1-4fed-94d6-6266209c859c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:56.815234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81266c3-18c1-4fed-94d6-6266209c859c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:56.815510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81266c3-18c1-4fed-94d6-6266209c859c admin admin] PATH_INFO: `/v3/projects/4fa83bfb5bd0427d9b2fc8473398ea61` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:56.822357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81266c3-18c1-4fed-94d6-6266209c859c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa83bfb5bd0427d9b2fc8473398ea61)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:56.827871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81266c3-18c1-4fed-94d6-6266209c859c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:56.919773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b81266c3-18c1-4fed-94d6-6266209c859c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa83bfb5bd0427d9b2fc8473398ea61', 'request_id': 'req-b81266c3-18c1-4fed-94d6-6266209c859c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:56.946930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b81266c3-18c1-4fed-94d6-6266209c859c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa83bfb5bd0427d9b2fc8473398ea61', 'request_id': 'req-b81266c3-18c1-4fed-94d6-6266209c859c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:56.952151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:56.984734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b81266c3-18c1-4fed-94d6-6266209c859c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa83bfb5bd0427d9b2fc8473398ea61', 'request_id': 'req-b81266c3-18c1-4fed-94d6-6266209c859c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:57.011655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b81266c3-18c1-4fed-94d6-6266209c859c admin admin] The token cache is being invalidate because project 4fa83bfb5bd0427d9b2fc8473398ea61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:08:57.012043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b81266c3-18c1-4fed-94d6-6266209c859c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:57.012661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b81266c3-18c1-4fed-94d6-6266209c859c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:57.014394 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2348/4700] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:08:56 2022] DELETE /identity/v3/projects/4fa83bfb5bd0427d9b2fc8473398ea61 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:57.024613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c878333-5876-45ba-b0a0-f6bb19d0aef0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:57.026895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c878333-5876-45ba-b0a0-f6bb19d0aef0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:57.027591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c878333-5876-45ba-b0a0-f6bb19d0aef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:57.076863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6c878333-5876-45ba-b0a0-f6bb19d0aef0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:57.078095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6c878333-5876-45ba-b0a0-f6bb19d0aef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:57.193562 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2353/4701] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:57.201650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd063b-8d79-406d-ab16-03cc2e10a9ae None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:57.203008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd063b-8d79-406d-ab16-03cc2e10a9ae None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:57.203643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd063b-8d79-406d-ab16-03cc2e10a9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:57.231927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bcbd063b-8d79-406d-ab16-03cc2e10a9ae None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:57.234574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bcbd063b-8d79-406d-ab16-03cc2e10a9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:57.249258 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2349/4702] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:57.249763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c878333-5876-45ba-b0a0-f6bb19d0aef0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:57.265010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c878333-5876-45ba-b0a0-f6bb19d0aef0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:57.272571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff493570-57a7-4a0b-89d3-ca0a8570bf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:57.273673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493570-57a7-4a0b-89d3-ca0a8570bf69 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:57.274867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493570-57a7-4a0b-89d3-ca0a8570bf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:57.275385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493570-57a7-4a0b-89d3-ca0a8570bf69 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:57.276963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff493570-57a7-4a0b-89d3-ca0a8570bf69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:08:57.277506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff493570-57a7-4a0b-89d3-ca0a8570bf69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:57.279723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff493570-57a7-4a0b-89d3-ca0a8570bf69 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:57.319018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd063b-8d79-406d-ab16-03cc2e10a9ae None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:57.334013 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2354/4703] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:08:57.342622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd063b-8d79-406d-ab16-03cc2e10a9ae None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:57.357029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fb917-2d0f-417d-8b68-8840ad53b8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:57.373854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fb917-2d0f-417d-8b68-8840ad53b8db admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:57.377801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fb917-2d0f-417d-8b68-8840ad53b8db admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:57.379265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fb917-2d0f-417d-8b68-8840ad53b8db admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:57.382076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fb917-2d0f-417d-8b68-8840ad53b8db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:57.398062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fb917-2d0f-417d-8b68-8840ad53b8db admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:57.507027 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2350/4704] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:57 2022] POST /identity/v3/projects => generated 411 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:57.509004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff493570-57a7-4a0b-89d3-ca0a8570bf69 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:57.533576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff493570-57a7-4a0b-89d3-ca0a8570bf69 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:57.729667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:57.745167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c741423-3bfc-4b3a-aa7b-1651e7cca80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:57.745807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c741423-3bfc-4b3a-aa7b-1651e7cca80c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:57.759998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c741423-3bfc-4b3a-aa7b-1651e7cca80c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:57.762639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c741423-3bfc-4b3a-aa7b-1651e7cca80c admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:57.763556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c741423-3bfc-4b3a-aa7b-1651e7cca80c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:57.773495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c741423-3bfc-4b3a-aa7b-1651e7cca80c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:57.839953 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2355/4705] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:57 2022] POST /identity/v3/users => generated 306 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:57.843848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fb917-2d0f-417d-8b68-8840ad53b8db admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:57.859755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fb917-2d0f-417d-8b68-8840ad53b8db admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:57.875035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86258433-3534-4046-b7c4-d625a87ffd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:57.880835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86258433-3534-4046-b7c4-d625a87ffd11 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:57.882439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86258433-3534-4046-b7c4-d625a87ffd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:57.885976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86258433-3534-4046-b7c4-d625a87ffd11 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:57.887002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86258433-3534-4046-b7c4-d625a87ffd11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:57.888459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86258433-3534-4046-b7c4-d625a87ffd11 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:57.907777 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2351/4706] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:57.916647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c741423-3bfc-4b3a-aa7b-1651e7cca80c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:57.953198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c741423-3bfc-4b3a-aa7b-1651e7cca80c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:57.968836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45c161-0084-438e-ac91-5900b8d515ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:57.969208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c161-0084-438e-ac91-5900b8d515ca admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:57.969497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c161-0084-438e-ac91-5900b8d515ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:57.969773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c161-0084-438e-ac91-5900b8d515ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:57.970431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45c161-0084-438e-ac91-5900b8d515ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:57.972917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45c161-0084-438e-ac91-5900b8d515ca admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:58.000675 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2356/4707] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:08:58.005270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86258433-3534-4046-b7c4-d625a87ffd11 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:58.021428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86258433-3534-4046-b7c4-d625a87ffd11 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:58.035695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0298ab7-3a55-44a1-a7d3-113a043d5ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:58.036386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0298ab7-3a55-44a1-a7d3-113a043d5ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:58.036778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0298ab7-3a55-44a1-a7d3-113a043d5ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:58.037061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0298ab7-3a55-44a1-a7d3-113a043d5ce2 admin admin] PATH_INFO: `/v3/projects/4d2e7363ffe440549009955b6d5a8b81/users/2c2ceca4b03f4539baf7203333b46cfb/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:58.081709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0298ab7-3a55-44a1-a7d3-113a043d5ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d2e7363ffe440549009955b6d5a8b81, user_id=2c2ceca4b03f4539baf7203333b46cfb, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:58.089170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0298ab7-3a55-44a1-a7d3-113a043d5ce2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:58.140113 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2352/4708] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:58 2022] PUT /identity/v3/projects/4d2e7363ffe440549009955b6d5a8b81/users/2c2ceca4b03f4539baf7203333b46cfb/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:58.164538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0521d9-ddcb-4dde-ac32-bbeb03df5b18 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:58.164959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0521d9-ddcb-4dde-ac32-bbeb03df5b18 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:58.165481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0521d9-ddcb-4dde-ac32-bbeb03df5b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:58.205886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0298ab7-3a55-44a1-a7d3-113a043d5ce2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:58.211174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e0298ab7-3a55-44a1-a7d3-113a043d5ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:58.268255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4f0521d9-ddcb-4dde-ac32-bbeb03df5b18 None None] MFA Rules not processed for user `2c2ceca4b03f4539baf7203333b46cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:58.269576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4f0521d9-ddcb-4dde-ac32-bbeb03df5b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:58.339625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0298ab7-3a55-44a1-a7d3-113a043d5ce2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:58.347218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba8af7-9a9c-499d-91d9-886644caee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:58.348264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba8af7-9a9c-499d-91d9-886644caee81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:58.349221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba8af7-9a9c-499d-91d9-886644caee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:58.349703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba8af7-9a9c-499d-91d9-886644caee81 admin admin] PATH_INFO: `/v3/users/7e6e66252f6b4ea7b1993923dc1447fc` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:58.351885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba8af7-9a9c-499d-91d9-886644caee81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6e66252f6b4ea7b1993923dc1447fc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:58.354549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba8af7-9a9c-499d-91d9-886644caee81 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:58.464606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1dba8af7-9a9c-499d-91d9-886644caee81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6e66252f6b4ea7b1993923dc1447fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:58.489450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1dba8af7-9a9c-499d-91d9-886644caee81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6e66252f6b4ea7b1993923dc1447fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:58.506985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1dba8af7-9a9c-499d-91d9-886644caee81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6e66252f6b4ea7b1993923dc1447fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:58.570627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1dba8af7-9a9c-499d-91d9-886644caee81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6e66252f6b4ea7b1993923dc1447fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:58.573973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1dba8af7-9a9c-499d-91d9-886644caee81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6e66252f6b4ea7b1993923dc1447fc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:08:58.639519 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2353/4709] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:08:58 2022] DELETE /identity/v3/users/7e6e66252f6b4ea7b1993923dc1447fc => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:58.659033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b747941-04e4-4752-ad25-a3d8896227be None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:58.659312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b747941-04e4-4752-ad25-a3d8896227be None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:58.659558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b747941-04e4-4752-ad25-a3d8896227be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:58.693431 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2357/4710] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:58 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 531 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:58.701897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:58.702558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0521d9-ddcb-4dde-ac32-bbeb03df5b18 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:58.749601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3b747941-04e4-4752-ad25-a3d8896227be None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:58.753598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3b747941-04e4-4752-ad25-a3d8896227be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:58.754191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0521d9-ddcb-4dde-ac32-bbeb03df5b18 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:58.954982 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2354/4711] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:08:59.005662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4d645-d819-49e5-8cfc-602a7a3dcf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:59.006354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4d645-d819-49e5-8cfc-602a7a3dcf0d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:59.006646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4d645-d819-49e5-8cfc-602a7a3dcf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:59.006961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4d645-d819-49e5-8cfc-602a7a3dcf0d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:59.007653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4d645-d819-49e5-8cfc-602a7a3dcf0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:59.009922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4d645-d819-49e5-8cfc-602a7a3dcf0d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:59.052838 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2358/4712] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:08:58 2022] POST /identity/v3/projects => generated 411 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:08:59.056041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b747941-04e4-4752-ad25-a3d8896227be None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:59.057512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3b747941-04e4-4752-ad25-a3d8896227be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:59.076869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b747941-04e4-4752-ad25-a3d8896227be None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:59.355495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da6dad-84c6-420e-93ea-d3d918995fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:59.356232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da6dad-84c6-420e-93ea-d3d918995fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:59.356853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da6dad-84c6-420e-93ea-d3d918995fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:59.364995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da6dad-84c6-420e-93ea-d3d918995fb8 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:59.365816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da6dad-84c6-420e-93ea-d3d918995fb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:59.371652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da6dad-84c6-420e-93ea-d3d918995fb8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:59.413588 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2355/4713] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:08:59 2022] POST /identity/v3/users => generated 312 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:08:59.418725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4d645-d819-49e5-8cfc-602a7a3dcf0d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:59.450557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4d645-d819-49e5-8cfc-602a7a3dcf0d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:59.469103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff0a13-4d76-46c8-b916-4560046921c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:59.470020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff0a13-4d76-46c8-b916-4560046921c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:59.470565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff0a13-4d76-46c8-b916-4560046921c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:59.470941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff0a13-4d76-46c8-b916-4560046921c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:59.471534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff0a13-4d76-46c8-b916-4560046921c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:59.473376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff0a13-4d76-46c8-b916-4560046921c9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:59.492121 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2359/4714] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:08:59.496505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da6dad-84c6-420e-93ea-d3d918995fb8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:59.510519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da6dad-84c6-420e-93ea-d3d918995fb8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:59.521049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55f855-9dc3-4867-8954-88e000ff3764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:59.521884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55f855-9dc3-4867-8954-88e000ff3764 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:59.522242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55f855-9dc3-4867-8954-88e000ff3764 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:59.522591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55f855-9dc3-4867-8954-88e000ff3764 admin admin] PATH_INFO: `/v3/projects/1dc29fe6326a4d1db215e6db87204a22/users/9bd4890ca1ff4e1f82acd1e3bacbb441/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:59.543653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55f855-9dc3-4867-8954-88e000ff3764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc29fe6326a4d1db215e6db87204a22, user_id=9bd4890ca1ff4e1f82acd1e3bacbb441, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:59.546525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55f855-9dc3-4867-8954-88e000ff3764 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:59.577833 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2356/4715] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:59 2022] PUT /identity/v3/projects/1dc29fe6326a4d1db215e6db87204a22/users/9bd4890ca1ff4e1f82acd1e3bacbb441/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:08:59.578100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff0a13-4d76-46c8-b916-4560046921c9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:59.598032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff0a13-4d76-46c8-b916-4560046921c9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:59.658029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55f855-9dc3-4867-8954-88e000ff3764 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:59.661006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fe55f855-9dc3-4867-8954-88e000ff3764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:08:59.676150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:08:59.734999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf2f0e-7e6c-4f07-b50e-d3f29f8da0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:59.735629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf2f0e-7e6c-4f07-b50e-d3f29f8da0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:59.735912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf2f0e-7e6c-4f07-b50e-d3f29f8da0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:59.736570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf2f0e-7e6c-4f07-b50e-d3f29f8da0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:59.737398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf2f0e-7e6c-4f07-b50e-d3f29f8da0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:59.740490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf2f0e-7e6c-4f07-b50e-d3f29f8da0f0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:59.765526 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2360/4716] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:08:59.769792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf2f0e-7e6c-4f07-b50e-d3f29f8da0f0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:08:59.794783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf2f0e-7e6c-4f07-b50e-d3f29f8da0f0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:59.804798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55f855-9dc3-4867-8954-88e000ff3764 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:08:59.807971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe9300-4936-452a-ad65-817b34216393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:59.809618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe9300-4936-452a-ad65-817b34216393 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:59.809915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe9300-4936-452a-ad65-817b34216393 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:59.810202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe9300-4936-452a-ad65-817b34216393 admin admin] PATH_INFO: `/v3/projects/1dc29fe6326a4d1db215e6db87204a22/users/9bd4890ca1ff4e1f82acd1e3bacbb441/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:59.813491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec42b3-9b48-4b43-ab9c-d2eed2a9fff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:08:59.814137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec42b3-9b48-4b43-ab9c-d2eed2a9fff6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:59.814522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec42b3-9b48-4b43-ab9c-d2eed2a9fff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:59.814816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec42b3-9b48-4b43-ab9c-d2eed2a9fff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:59.816188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe9300-4936-452a-ad65-817b34216393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc29fe6326a4d1db215e6db87204a22, user_id=9bd4890ca1ff4e1f82acd1e3bacbb441, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:59.819563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe9300-4936-452a-ad65-817b34216393 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:59.841140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec42b3-9b48-4b43-ab9c-d2eed2a9fff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:08:59.845086 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2361/4717] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:08:59 2022] PUT /identity/v3/projects/1dc29fe6326a4d1db215e6db87204a22/users/9bd4890ca1ff4e1f82acd1e3bacbb441/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:08:59.854665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec42b3-9b48-4b43-ab9c-d2eed2a9fff6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:08:59.861848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770dd77-ec4f-4b43-bdb4-af795c0c5f86 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:08:59.862322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770dd77-ec4f-4b43-bdb4-af795c0c5f86 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:08:59.862526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770dd77-ec4f-4b43-bdb4-af795c0c5f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:08:59.877864 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2357/4718] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:08:59.928621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8770dd77-ec4f-4b43-bdb4-af795c0c5f86 None None] MFA Rules not processed for user `9bd4890ca1ff4e1f82acd1e3bacbb441`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:08:59.930202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8770dd77-ec4f-4b43-bdb4-af795c0c5f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:00.134700 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2362/4719] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:08:59 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:00.258770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec42b3-9b48-4b43-ab9c-d2eed2a9fff6 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:00.262645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5cec42b3-9b48-4b43-ab9c-d2eed2a9fff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:00.297224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec42b3-9b48-4b43-ab9c-d2eed2a9fff6 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:00.323598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:00.444251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b39a2f-ef56-4787-b8c8-4a39aa71955c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:00.456971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b39a2f-ef56-4787-b8c8-4a39aa71955c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:00.459122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b39a2f-ef56-4787-b8c8-4a39aa71955c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:00.462241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b39a2f-ef56-4787-b8c8-4a39aa71955c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:00.484860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b39a2f-ef56-4787-b8c8-4a39aa71955c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:00.491578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b39a2f-ef56-4787-b8c8-4a39aa71955c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:00.519756 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2358/4720] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:00 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:00.800383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770dd77-ec4f-4b43-bdb4-af795c0c5f86 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:00.802094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8770dd77-ec4f-4b43-bdb4-af795c0c5f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:00.929901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b39a2f-ef56-4787-b8c8-4a39aa71955c service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:00.931405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-43b39a2f-ef56-4787-b8c8-4a39aa71955c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:00.948219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770dd77-ec4f-4b43-bdb4-af795c0c5f86 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:00.966216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:00.967484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:00.968003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:00.968506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] PATH_INFO: `/v3/users/9155e762ab8748539524b919f5ae6173` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:00.968803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b39a2f-ef56-4787-b8c8-4a39aa71955c service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:00.970352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9155e762ab8748539524b919f5ae6173)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:00.975466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:00.982231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:00.982952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:00.983456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:00.983725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e admin admin] PATH_INFO: `/v3/projects/aac3d9c160b2456cb0567da0d966c774` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:00.985026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac3d9c160b2456cb0567da0d966c774)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:00.991082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:01.077317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9155e762ab8748539524b919f5ae6173'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:01.084011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:01.091939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9155e762ab8748539524b919f5ae6173'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:01.093171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9155e762ab8748539524b919f5ae6173'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:01.130795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9155e762ab8748539524b919f5ae6173'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:01.134089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9155e762ab8748539524b919f5ae6173'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:01.184604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac3d9c160b2456cb0567da0d966c774', 'request_id': 'req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:01.200938 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2363/4721] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:09:00 2022] DELETE /identity/v3/users/9155e762ab8748539524b919f5ae6173 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:01.202174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:01.203981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:01.211730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac3d9c160b2456cb0567da0d966c774', 'request_id': 'req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:01.238164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac3d9c160b2456cb0567da0d966c774', 'request_id': 'req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:01.278694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e admin admin] The token cache is being invalidate because project aac3d9c160b2456cb0567da0d966c774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:01.280720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:01.282044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4bff34c3-4b0f-4a61-b209-f81cb6e4ff5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:01.305084 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2359/4722] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:00 2022] DELETE /identity/v3/projects/aac3d9c160b2456cb0567da0d966c774 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:09:01.307758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a26a4-cb57-4f7f-971a-4697eb695bb1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:01.309221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a26a4-cb57-4f7f-971a-4697eb695bb1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:01.310238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a26a4-cb57-4f7f-971a-4697eb695bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:01.414427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-358a26a4-cb57-4f7f-971a-4697eb695bb1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:01.419599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-358a26a4-cb57-4f7f-971a-4697eb695bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:01.464403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690dd64-011c-4e29-b8d3-59a0636b3889 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:01.502499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf51dc5-c132-44e6-9f9a-3574bc7f263b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:01.504002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf51dc5-c132-44e6-9f9a-3574bc7f263b service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:01.505381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf51dc5-c132-44e6-9f9a-3574bc7f263b service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:01.505902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf51dc5-c132-44e6-9f9a-3574bc7f263b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:01.520395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2bf51dc5-c132-44e6-9f9a-3574bc7f263b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:01.546074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf51dc5-c132-44e6-9f9a-3574bc7f263b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:01.547658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf51dc5-c132-44e6-9f9a-3574bc7f263b service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:01.584803 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2364/4723] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:01.614051 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2360/4724] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:01.615299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95843586-8338-4e71-bfac-9512bde01a6f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:01.615772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95843586-8338-4e71-bfac-9512bde01a6f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:01.616245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95843586-8338-4e71-bfac-9512bde01a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:01.662345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-95843586-8338-4e71-bfac-9512bde01a6f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:01.664385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-95843586-8338-4e71-bfac-9512bde01a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:01.690936 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2365/4725] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:01.694694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a26a4-cb57-4f7f-971a-4697eb695bb1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:01.715034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a26a4-cb57-4f7f-971a-4697eb695bb1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:01.747287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d52aa-5442-4f11-869c-45b04d488822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:01.748651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d52aa-5442-4f11-869c-45b04d488822 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:01.750331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d52aa-5442-4f11-869c-45b04d488822 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:01.753336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d52aa-5442-4f11-869c-45b04d488822 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:01.755797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d52aa-5442-4f11-869c-45b04d488822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:09:01.756993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d52aa-5442-4f11-869c-45b04d488822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:01.763856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d52aa-5442-4f11-869c-45b04d488822 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:01.807789 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2361/4726] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:09:01.813402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95843586-8338-4e71-bfac-9512bde01a6f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:01.829910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95843586-8338-4e71-bfac-9512bde01a6f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:01.844865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd2c74-7d6c-41e0-9086-f76998ce44c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:01.845621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd2c74-7d6c-41e0-9086-f76998ce44c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:01.846123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd2c74-7d6c-41e0-9086-f76998ce44c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:01.846406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd2c74-7d6c-41e0-9086-f76998ce44c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:01.847111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd2c74-7d6c-41e0-9086-f76998ce44c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:01.849081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd2c74-7d6c-41e0-9086-f76998ce44c4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:01.924578 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2366/4727] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:01 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:01.929841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d52aa-5442-4f11-869c-45b04d488822 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:01.951858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d52aa-5442-4f11-869c-45b04d488822 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:01.998594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:02.055329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263629f0-3602-4ab4-93b5-d542aa377aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:02.055970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263629f0-3602-4ab4-93b5-d542aa377aee admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:02.056259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263629f0-3602-4ab4-93b5-d542aa377aee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:02.056538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263629f0-3602-4ab4-93b5-d542aa377aee admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:02.057474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263629f0-3602-4ab4-93b5-d542aa377aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:02.059247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263629f0-3602-4ab4-93b5-d542aa377aee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:02.099356 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2362/4728] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:01 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:02.100718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd2c74-7d6c-41e0-9086-f76998ce44c4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:02.118132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd2c74-7d6c-41e0-9086-f76998ce44c4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:02.139044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c1062-917c-4d01-a3da-b964f515bb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:02.140965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c1062-917c-4d01-a3da-b964f515bb6c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:02.141273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c1062-917c-4d01-a3da-b964f515bb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:02.141533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c1062-917c-4d01-a3da-b964f515bb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:02.146433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c1062-917c-4d01-a3da-b964f515bb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:02.148280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c1062-917c-4d01-a3da-b964f515bb6c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:02.169131 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2367/4729] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:02.173495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263629f0-3602-4ab4-93b5-d542aa377aee admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:02.191261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263629f0-3602-4ab4-93b5-d542aa377aee admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:02.200278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fae24-8e31-4800-8b52-b30405611d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:02.201019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fae24-8e31-4800-8b52-b30405611d84 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:02.201319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fae24-8e31-4800-8b52-b30405611d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:02.202395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fae24-8e31-4800-8b52-b30405611d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:02.203286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fae24-8e31-4800-8b52-b30405611d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:02.205363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5fae24-8e31-4800-8b52-b30405611d84 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:02.225129 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2363/4730] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:02.227417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c1062-917c-4d01-a3da-b964f515bb6c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:02.240274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c1062-917c-4d01-a3da-b964f515bb6c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:02.246718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867354c-d8f7-48a3-86f7-255d96623d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:02.247522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867354c-d8f7-48a3-86f7-255d96623d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:02.247725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867354c-d8f7-48a3-86f7-255d96623d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:02.248054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867354c-d8f7-48a3-86f7-255d96623d59 admin admin] PATH_INFO: `/v3/projects/b5ab10d45f774cab9bc406836254fc1a/users/c47852e33a9f4835bf8b5e3a2a760cdd/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:02.276783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867354c-d8f7-48a3-86f7-255d96623d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ab10d45f774cab9bc406836254fc1a, user_id=c47852e33a9f4835bf8b5e3a2a760cdd, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:02.279696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867354c-d8f7-48a3-86f7-255d96623d59 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:02.320098 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2368/4731] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:02 2022] PUT /identity/v3/projects/b5ab10d45f774cab9bc406836254fc1a/users/c47852e33a9f4835bf8b5e3a2a760cdd/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:09:02.322102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47748e-b73e-40ae-855f-30d85789111a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:02.322494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47748e-b73e-40ae-855f-30d85789111a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:02.322878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47748e-b73e-40ae-855f-30d85789111a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:02.361542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4f47748e-b73e-40ae-855f-30d85789111a None None] MFA Rules not processed for user `c47852e33a9f4835bf8b5e3a2a760cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:02.364164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4f47748e-b73e-40ae-855f-30d85789111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:02.471576 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2364/4732] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:02.524677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867354c-d8f7-48a3-86f7-255d96623d59 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:02.527721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f867354c-d8f7-48a3-86f7-255d96623d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:02.717421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:02.732230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867354c-d8f7-48a3-86f7-255d96623d59 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:02.747628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd0e82-1945-4034-9b7e-df1b838aa62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:02.748282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0e82-1945-4034-9b7e-df1b838aa62c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:02.748552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0e82-1945-4034-9b7e-df1b838aa62c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:02.749208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0e82-1945-4034-9b7e-df1b838aa62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:02.773802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd0e82-1945-4034-9b7e-df1b838aa62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:02.775330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd0e82-1945-4034-9b7e-df1b838aa62c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:02.788357 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2369/4733] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:02.873185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47748e-b73e-40ae-855f-30d85789111a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:02.874924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4f47748e-b73e-40ae-855f-30d85789111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:03.043076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47748e-b73e-40ae-855f-30d85789111a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:03.052790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0215333-a64b-4a42-9e62-4e86d7d7d22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:03.053677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0215333-a64b-4a42-9e62-4e86d7d7d22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:03.053967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0215333-a64b-4a42-9e62-4e86d7d7d22d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:03.054249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0215333-a64b-4a42-9e62-4e86d7d7d22d admin admin] PATH_INFO: `/v3/projects/b5c9c5750e2441de8ccdff6c714c08ba` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:03.055541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0215333-a64b-4a42-9e62-4e86d7d7d22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c9c5750e2441de8ccdff6c714c08ba)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:03.058829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0215333-a64b-4a42-9e62-4e86d7d7d22d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:03.109054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd0e82-1945-4034-9b7e-df1b838aa62c service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:03.111162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-09fd0e82-1945-4034-9b7e-df1b838aa62c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:03.139337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:03.168464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a0215333-a64b-4a42-9e62-4e86d7d7d22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c9c5750e2441de8ccdff6c714c08ba', 'request_id': 'req-a0215333-a64b-4a42-9e62-4e86d7d7d22d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:03.197825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a0215333-a64b-4a42-9e62-4e86d7d7d22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c9c5750e2441de8ccdff6c714c08ba', 'request_id': 'req-a0215333-a64b-4a42-9e62-4e86d7d7d22d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:03.207491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a0215333-a64b-4a42-9e62-4e86d7d7d22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c9c5750e2441de8ccdff6c714c08ba', 'request_id': 'req-a0215333-a64b-4a42-9e62-4e86d7d7d22d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:03.238125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a0215333-a64b-4a42-9e62-4e86d7d7d22d admin admin] The token cache is being invalidate because project b5c9c5750e2441de8ccdff6c714c08ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:03.238430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a0215333-a64b-4a42-9e62-4e86d7d7d22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:03.242468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a0215333-a64b-4a42-9e62-4e86d7d7d22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:03.251775 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2365/4734] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:02 2022] DELETE /identity/v3/projects/b5c9c5750e2441de8ccdff6c714c08ba => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:03.256568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f4ea7-e350-4ff4-a901-710bee4d2e2b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:03.259044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f4ea7-e350-4ff4-a901-710bee4d2e2b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:03.259359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f4ea7-e350-4ff4-a901-710bee4d2e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:03.330220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-388f4ea7-e350-4ff4-a901-710bee4d2e2b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:03.332804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-388f4ea7-e350-4ff4-a901-710bee4d2e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:03.341874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd0e82-1945-4034-9b7e-df1b838aa62c service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:03.464524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a6770-9eb1-4207-bc4e-f7158ea0ea25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:03.465281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a6770-9eb1-4207-bc4e-f7158ea0ea25 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:03.465634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a6770-9eb1-4207-bc4e-f7158ea0ea25 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:03.465979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a6770-9eb1-4207-bc4e-f7158ea0ea25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:03.470292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9b8a6770-9eb1-4207-bc4e-f7158ea0ea25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:03.553806 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2366/4735] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:03.567017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf06ab-4dfa-40b1-9992-b54546086ec6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:03.567017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf06ab-4dfa-40b1-9992-b54546086ec6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:03.567017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf06ab-4dfa-40b1-9992-b54546086ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:03.579448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a6770-9eb1-4207-bc4e-f7158ea0ea25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:03.583407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a6770-9eb1-4207-bc4e-f7158ea0ea25 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:03.609686 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2370/4736] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:03.619207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-26bf06ab-4dfa-40b1-9992-b54546086ec6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:03.620901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-26bf06ab-4dfa-40b1-9992-b54546086ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:03.646264 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2367/4737] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:09:03.650874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a6770-9eb1-4207-bc4e-f7158ea0ea25 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:03.676047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a6770-9eb1-4207-bc4e-f7158ea0ea25 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:03.693826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba39e4e-663c-4c82-8ae5-9be2d111a230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:03.694948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba39e4e-663c-4c82-8ae5-9be2d111a230 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:03.695458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba39e4e-663c-4c82-8ae5-9be2d111a230 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:03.695926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba39e4e-663c-4c82-8ae5-9be2d111a230 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:03.697006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba39e4e-663c-4c82-8ae5-9be2d111a230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:09:03.697581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba39e4e-663c-4c82-8ae5-9be2d111a230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:03.703301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba39e4e-663c-4c82-8ae5-9be2d111a230 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:03.740056 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2371/4738] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:09:03.744839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf06ab-4dfa-40b1-9992-b54546086ec6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:03.769407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf06ab-4dfa-40b1-9992-b54546086ec6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:03.786977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b3abe-fe84-4112-ba1e-193f06588a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:03.787906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b3abe-fe84-4112-ba1e-193f06588a67 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:03.788230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b3abe-fe84-4112-ba1e-193f06588a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:03.788478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b3abe-fe84-4112-ba1e-193f06588a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:03.789149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b3abe-fe84-4112-ba1e-193f06588a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:03.791673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b3abe-fe84-4112-ba1e-193f06588a67 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:03.855688 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2368/4739] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:03 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:03.858869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba39e4e-663c-4c82-8ae5-9be2d111a230 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:03.874730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:03.884296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba39e4e-663c-4c82-8ae5-9be2d111a230 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:04.037052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2822872-1240-4ace-bf6f-478aee6079ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:04.037860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2822872-1240-4ace-bf6f-478aee6079ea admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:04.038254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2822872-1240-4ace-bf6f-478aee6079ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:04.038636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2822872-1240-4ace-bf6f-478aee6079ea admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:04.039415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2822872-1240-4ace-bf6f-478aee6079ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:04.041817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2822872-1240-4ace-bf6f-478aee6079ea admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:04.122824 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2372/4740] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:03 2022] POST /identity/v3/users => generated 294 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:04.123979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b3abe-fe84-4112-ba1e-193f06588a67 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:04.160820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b3abe-fe84-4112-ba1e-193f06588a67 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:04.203532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00c3ff-95ad-45ce-9ce6-ccdbd297d932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:04.204319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c3ff-95ad-45ce-9ce6-ccdbd297d932 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:04.204604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c3ff-95ad-45ce-9ce6-ccdbd297d932 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:04.204909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c3ff-95ad-45ce-9ce6-ccdbd297d932 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:04.205578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00c3ff-95ad-45ce-9ce6-ccdbd297d932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:04.207316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00c3ff-95ad-45ce-9ce6-ccdbd297d932 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:04.251495 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2369/4741] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:04.255606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2822872-1240-4ace-bf6f-478aee6079ea admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:04.274507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2822872-1240-4ace-bf6f-478aee6079ea admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:04.297801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31069ec0-96f9-416e-a7c0-a91e023e298a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:04.299658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31069ec0-96f9-416e-a7c0-a91e023e298a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:04.301975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31069ec0-96f9-416e-a7c0-a91e023e298a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:04.301975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31069ec0-96f9-416e-a7c0-a91e023e298a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:04.301975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31069ec0-96f9-416e-a7c0-a91e023e298a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:04.303981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31069ec0-96f9-416e-a7c0-a91e023e298a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:04.349340 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2373/4742] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:04.353826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00c3ff-95ad-45ce-9ce6-ccdbd297d932 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:04.369550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00c3ff-95ad-45ce-9ce6-ccdbd297d932 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:04.382680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92b791-94a9-4b8f-90e3-a6e4f46755ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:04.384388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92b791-94a9-4b8f-90e3-a6e4f46755ad admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:04.385985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92b791-94a9-4b8f-90e3-a6e4f46755ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:04.387467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92b791-94a9-4b8f-90e3-a6e4f46755ad admin admin] PATH_INFO: `/v3/projects/c13ee2197d3e4c12a807dc3f70619db3/users/89900b5f2e7e45e6a1757b9e7b38add0/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:04.442346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92b791-94a9-4b8f-90e3-a6e4f46755ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13ee2197d3e4c12a807dc3f70619db3, user_id=89900b5f2e7e45e6a1757b9e7b38add0, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:04.445702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92b791-94a9-4b8f-90e3-a6e4f46755ad admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:04.489344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af5cc6-ccf3-4518-8cae-30e513ef056d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:04.489636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af5cc6-ccf3-4518-8cae-30e513ef056d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:04.489922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af5cc6-ccf3-4518-8cae-30e513ef056d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:04.493218 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2370/4743] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:04 2022] PUT /identity/v3/projects/c13ee2197d3e4c12a807dc3f70619db3/users/89900b5f2e7e45e6a1757b9e7b38add0/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:04.534487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e8af5cc6-ccf3-4518-8cae-30e513ef056d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:04.538624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e8af5cc6-ccf3-4518-8cae-30e513ef056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:04.757038 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2374/4744] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:04.779759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92b791-94a9-4b8f-90e3-a6e4f46755ad admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:04.782784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-af92b791-94a9-4b8f-90e3-a6e4f46755ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:04.943989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92b791-94a9-4b8f-90e3-a6e4f46755ad admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:04.951030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ffdfe-8f1c-4443-9b73-408d65d8261b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:04.952125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ffdfe-8f1c-4443-9b73-408d65d8261b service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:04.952383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ffdfe-8f1c-4443-9b73-408d65d8261b service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:04.952837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ffdfe-8f1c-4443-9b73-408d65d8261b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:04.979920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ffdfe-8f1c-4443-9b73-408d65d8261b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:04.983900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ffdfe-8f1c-4443-9b73-408d65d8261b service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:05.009909 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2371/4745] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:08.510258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af5cc6-ccf3-4518-8cae-30e513ef056d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:08.511823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e8af5cc6-ccf3-4518-8cae-30e513ef056d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:08.592730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af5cc6-ccf3-4518-8cae-30e513ef056d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:08.610846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:08.618428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:08.619964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:08.620820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] PATH_INFO: `/v3/users/a8af1e7c54534ea0a87a9124cc9ffd37` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:08.623209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8af1e7c54534ea0a87a9124cc9ffd37)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:08.628740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:08.769317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8af1e7c54534ea0a87a9124cc9ffd37'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:08.792410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8af1e7c54534ea0a87a9124cc9ffd37'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:08.793693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8af1e7c54534ea0a87a9124cc9ffd37'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:08.819312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8af1e7c54534ea0a87a9124cc9ffd37'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:08.821127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8af1e7c54534ea0a87a9124cc9ffd37'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:08.873497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:08.885471 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2375/4746] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:09:08 2022] DELETE /identity/v3/users/a8af1e7c54534ea0a87a9124cc9ffd37 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:08.890058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bcf33-6420-494a-8b11-86b62531ccd7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:08.890541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bcf33-6420-494a-8b11-86b62531ccd7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:08.890792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bcf33-6420-494a-8b11-86b62531ccd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:08.906885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:08.944133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-336bcf33-6420-494a-8b11-86b62531ccd7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:08.945325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-336bcf33-6420-494a-8b11-86b62531ccd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:09.073872 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2372/4747] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:09:09.125630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:09.128160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:09.261154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc21994-9a18-4e01-97fc-0e56a020eb6f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:09.276030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aebd7-2622-48cf-9f8f-86f1333e6360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:09.276965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aebd7-2622-48cf-9f8f-86f1333e6360 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:09.277417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aebd7-2622-48cf-9f8f-86f1333e6360 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:09.277533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aebd7-2622-48cf-9f8f-86f1333e6360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:09.302278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2aebd7-2622-48cf-9f8f-86f1333e6360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:09.304228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2aebd7-2622-48cf-9f8f-86f1333e6360 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:09.328752 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2376/4748] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:10.617564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594826b-0924-4322-b2e5-499e7cae45e0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:10.618425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594826b-0924-4322-b2e5-499e7cae45e0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:10.618948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594826b-0924-4322-b2e5-499e7cae45e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:10.715324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4594826b-0924-4322-b2e5-499e7cae45e0 None None] MFA Rules not processed for user `89900b5f2e7e45e6a1757b9e7b38add0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:10.716584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4594826b-0924-4322-b2e5-499e7cae45e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:10.764040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c6493-efdd-4e0b-b7ea-2adf8ae57478 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:10.764658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c6493-efdd-4e0b-b7ea-2adf8ae57478 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:10.764658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c6493-efdd-4e0b-b7ea-2adf8ae57478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:10.851379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f80c6493-efdd-4e0b-b7ea-2adf8ae57478 None None] MFA Rules not processed for user `5d5833af8c0a4ca9a844905b5ea94665`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:10.854775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f80c6493-efdd-4e0b-b7ea-2adf8ae57478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:10.987219 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2373/4749] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:11.018300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239b809-b618-4999-b795-0a28095352ed None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:11.018680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239b809-b618-4999-b795-0a28095352ed None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:11.019060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239b809-b618-4999-b795-0a28095352ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:11.060821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5239b809-b618-4999-b795-0a28095352ed None None] MFA Rules not processed for user `89900b5f2e7e45e6a1757b9e7b38add0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:11.062239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5239b809-b618-4999-b795-0a28095352ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:11.074416 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2377/4750] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:09:11.086351 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2374/4751] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:11.091169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac905889-d10b-4e8e-8e0e-12fbff81a950 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:11.092068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac905889-d10b-4e8e-8e0e-12fbff81a950 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:11.092756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac905889-d10b-4e8e-8e0e-12fbff81a950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:11.155520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ac905889-d10b-4e8e-8e0e-12fbff81a950 None None] MFA Rules not processed for user `89900b5f2e7e45e6a1757b9e7b38add0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:11.157260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ac905889-d10b-4e8e-8e0e-12fbff81a950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:11.181937 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2378/4752] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:11.532567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239b809-b618-4999-b795-0a28095352ed None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:11.535378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5239b809-b618-4999-b795-0a28095352ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:11.698331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239b809-b618-4999-b795-0a28095352ed None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:11.707158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c660b-740d-4abe-8478-85329177b709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:11.708240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c660b-740d-4abe-8478-85329177b709 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:11.708747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c660b-740d-4abe-8478-85329177b709 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:11.710887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c660b-740d-4abe-8478-85329177b709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:11.724949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c660b-740d-4abe-8478-85329177b709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:11.727163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c660b-740d-4abe-8478-85329177b709 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:11.757679 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2375/4753] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:11.802559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac905889-d10b-4e8e-8e0e-12fbff81a950 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:11.804262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ac905889-d10b-4e8e-8e0e-12fbff81a950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:11.836252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac905889-d10b-4e8e-8e0e-12fbff81a950 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:11.848155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e984f-ccf6-4ac0-bf00-e78d4b3b9937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:11.849271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e984f-ccf6-4ac0-bf00-e78d4b3b9937 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:11.849726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e984f-ccf6-4ac0-bf00-e78d4b3b9937 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:11.850167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e984f-ccf6-4ac0-bf00-e78d4b3b9937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:11.860995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c660b-740d-4abe-8478-85329177b709 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:11.863753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d58c660b-740d-4abe-8478-85329177b709 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:11.866665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e984f-ccf6-4ac0-bf00-e78d4b3b9937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:11.868507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e984f-ccf6-4ac0-bf00-e78d4b3b9937 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:11.891643 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2379/4754] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:11.971482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c660b-740d-4abe-8478-85329177b709 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:12.012770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:12.016449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:12.017750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:12.018354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0 admin admin] PATH_INFO: `/v3/projects/1964f6e32d95451fbbbf2c7a89ce4cb5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:12.021021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1964f6e32d95451fbbbf2c7a89ce4cb5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:12.027169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:12.042873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:12.137368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1964f6e32d95451fbbbf2c7a89ce4cb5', 'request_id': 'req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:12.153419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1964f6e32d95451fbbbf2c7a89ce4cb5', 'request_id': 'req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:12.162489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1964f6e32d95451fbbbf2c7a89ce4cb5', 'request_id': 'req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:12.179234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0 admin admin] The token cache is being invalidate because project 1964f6e32d95451fbbbf2c7a89ce4cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:12.179974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:12.181114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc9f44a0-08a3-4190-b98b-c8f0f5055ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:12.183191 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2376/4755] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:11 2022] DELETE /identity/v3/projects/1964f6e32d95451fbbbf2c7a89ce4cb5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:09:12.186988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e984f-ccf6-4ac0-bf00-e78d4b3b9937 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:12.206834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e984f-ccf6-4ac0-bf00-e78d4b3b9937 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:12.319296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:12.320259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:12.320609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:12.323313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] PATH_INFO: `/v3/users/5c61a61c7ce74ec88ca7bf4663a18804` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:12.326213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c61a61c7ce74ec88ca7bf4663a18804)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:12.331019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:12.356606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:12.447416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c61a61c7ce74ec88ca7bf4663a18804'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:12.477002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c61a61c7ce74ec88ca7bf4663a18804'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:12.478904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c61a61c7ce74ec88ca7bf4663a18804'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:12.506021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c61a61c7ce74ec88ca7bf4663a18804'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:12.509998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c61a61c7ce74ec88ca7bf4663a18804'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:12.557137 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2380/4756] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:09:12 2022] DELETE /identity/v3/users/5c61a61c7ce74ec88ca7bf4663a18804 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:13.755153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25483a-0df0-43ce-810f-93ecf46dbb95 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:13.756294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25483a-0df0-43ce-810f-93ecf46dbb95 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:13.757243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25483a-0df0-43ce-810f-93ecf46dbb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:13.809495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2b25483a-0df0-43ce-810f-93ecf46dbb95 None None] MFA Rules not processed for user `89900b5f2e7e45e6a1757b9e7b38add0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:13.818514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2b25483a-0df0-43ce-810f-93ecf46dbb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:13.910789 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2377/4757] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:14.580410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:14.582173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:14.775711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1762649-4f5d-463e-96dc-41f96a44da91 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:14.797498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f3a8d-e753-45fd-bb9d-26ae1c87734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:14.798264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f3a8d-e753-45fd-bb9d-26ae1c87734c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:14.799386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f3a8d-e753-45fd-bb9d-26ae1c87734c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:14.799669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f3a8d-e753-45fd-bb9d-26ae1c87734c admin admin] PATH_INFO: `/v3/users/2c2ceca4b03f4539baf7203333b46cfb` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:14.803794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f3a8d-e753-45fd-bb9d-26ae1c87734c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2ceca4b03f4539baf7203333b46cfb)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:14.810341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f3a8d-e753-45fd-bb9d-26ae1c87734c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:14.832647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25483a-0df0-43ce-810f-93ecf46dbb95 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:14.836090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2b25483a-0df0-43ce-810f-93ecf46dbb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:14.881552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25483a-0df0-43ce-810f-93ecf46dbb95 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:14.919537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699dd77-e031-49ab-930c-ad86399c9c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:14.920325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699dd77-e031-49ab-930c-ad86399c9c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:14.920595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699dd77-e031-49ab-930c-ad86399c9c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:14.920876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699dd77-e031-49ab-930c-ad86399c9c4f admin admin] PATH_INFO: `/v3/projects/20db00b22cce43988cbfaebb3f5a3d9f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:14.922453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699dd77-e031-49ab-930c-ad86399c9c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=20db00b22cce43988cbfaebb3f5a3d9f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:14.924545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699dd77-e031-49ab-930c-ad86399c9c4f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:14.957735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0b1f3a8d-e753-45fd-bb9d-26ae1c87734c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2ceca4b03f4539baf7203333b46cfb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:14.975594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0b1f3a8d-e753-45fd-bb9d-26ae1c87734c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2ceca4b03f4539baf7203333b46cfb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:14.979232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0b1f3a8d-e753-45fd-bb9d-26ae1c87734c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2ceca4b03f4539baf7203333b46cfb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:14.992506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0b1f3a8d-e753-45fd-bb9d-26ae1c87734c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2ceca4b03f4539baf7203333b46cfb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:14.993426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0b1f3a8d-e753-45fd-bb9d-26ae1c87734c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2ceca4b03f4539baf7203333b46cfb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:15.023844 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2381/4758] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:09:14 2022] DELETE /identity/v3/users/2c2ceca4b03f4539baf7203333b46cfb => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:15.025517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af717e37-25a4-4adc-b6b7-f9cb55adbf17 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:15.026034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af717e37-25a4-4adc-b6b7-f9cb55adbf17 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:15.026811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af717e37-25a4-4adc-b6b7-f9cb55adbf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:15.047012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:15.057162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-af717e37-25a4-4adc-b6b7-f9cb55adbf17 None None] MFA Rules not processed for user `5d5833af8c0a4ca9a844905b5ea94665`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:15.058587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-af717e37-25a4-4adc-b6b7-f9cb55adbf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:15.082113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1699dd77-e031-49ab-930c-ad86399c9c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20db00b22cce43988cbfaebb3f5a3d9f', 'request_id': 'req-1699dd77-e031-49ab-930c-ad86399c9c4f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:15.097980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1699dd77-e031-49ab-930c-ad86399c9c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20db00b22cce43988cbfaebb3f5a3d9f', 'request_id': 'req-1699dd77-e031-49ab-930c-ad86399c9c4f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:15.113118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1699dd77-e031-49ab-930c-ad86399c9c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20db00b22cce43988cbfaebb3f5a3d9f', 'request_id': 'req-1699dd77-e031-49ab-930c-ad86399c9c4f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:15.133422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1699dd77-e031-49ab-930c-ad86399c9c4f admin admin] The token cache is being invalidate because project 20db00b22cce43988cbfaebb3f5a3d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:15.133725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1699dd77-e031-49ab-930c-ad86399c9c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:15.134426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1699dd77-e031-49ab-930c-ad86399c9c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:15.141651 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2378/4759] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:14 2022] DELETE /identity/v3/projects/20db00b22cce43988cbfaebb3f5a3d9f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:15.141651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e04ed-48e6-4b9f-b9fe-d45396fffd59 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:15.141651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e04ed-48e6-4b9f-b9fe-d45396fffd59 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:15.141651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e04ed-48e6-4b9f-b9fe-d45396fffd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:15.176178 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2382/4760] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:15.180707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae8838-5470-459a-a69a-af5cab9f9372 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:15.181005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae8838-5470-459a-a69a-af5cab9f9372 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:15.181293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae8838-5470-459a-a69a-af5cab9f9372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:15.188276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-635e04ed-48e6-4b9f-b9fe-d45396fffd59 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:15.190432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-635e04ed-48e6-4b9f-b9fe-d45396fffd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:15.254103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-08ae8838-5470-459a-a69a-af5cab9f9372 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:15.255933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-08ae8838-5470-459a-a69a-af5cab9f9372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:15.260998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:15.406940 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2379/4761] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:15.429099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e04ed-48e6-4b9f-b9fe-d45396fffd59 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:15.430621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-635e04ed-48e6-4b9f-b9fe-d45396fffd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:15.470780 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2383/4762] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:15.488943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444fba3-f3ac-428f-8ee2-145385f5acdb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:15.490723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444fba3-f3ac-428f-8ee2-145385f5acdb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:15.491066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444fba3-f3ac-428f-8ee2-145385f5acdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:15.554165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1444fba3-f3ac-428f-8ee2-145385f5acdb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:15.556755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1444fba3-f3ac-428f-8ee2-145385f5acdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:15.587321 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2384/4763] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:15.588884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444fba3-f3ac-428f-8ee2-145385f5acdb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:15.635645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444fba3-f3ac-428f-8ee2-145385f5acdb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:15.652137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e04ed-48e6-4b9f-b9fe-d45396fffd59 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:15.655648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740ac49-4bfc-4f50-bf76-8a5f2b119bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:15.656712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740ac49-4bfc-4f50-bf76-8a5f2b119bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:15.659068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740ac49-4bfc-4f50-bf76-8a5f2b119bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:15.660532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740ac49-4bfc-4f50-bf76-8a5f2b119bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:15.663248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740ac49-4bfc-4f50-bf76-8a5f2b119bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:09:15.664596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740ac49-4bfc-4f50-bf76-8a5f2b119bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:15.669367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740ac49-4bfc-4f50-bf76-8a5f2b119bd9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:15.671076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f4502-791b-4ce7-b538-4f990a08920a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:15.672296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f4502-791b-4ce7-b538-4f990a08920a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:15.672746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f4502-791b-4ce7-b538-4f990a08920a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:15.673248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f4502-791b-4ce7-b538-4f990a08920a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:15.731980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f4502-791b-4ce7-b538-4f990a08920a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:15.734912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f4502-791b-4ce7-b538-4f990a08920a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:15.743843 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2385/4764] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:09:15.749909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740ac49-4bfc-4f50-bf76-8a5f2b119bd9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:15.790830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740ac49-4bfc-4f50-bf76-8a5f2b119bd9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:15.792532 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2380/4765] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:09:15.800444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b0541-759d-44d3-b63d-cbc22a6ccd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:15.801804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b0541-759d-44d3-b63d-cbc22a6ccd60 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:15.802318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b0541-759d-44d3-b63d-cbc22a6ccd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:15.802844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b0541-759d-44d3-b63d-cbc22a6ccd60 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:15.804317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b0541-759d-44d3-b63d-cbc22a6ccd60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:15.809195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b0541-759d-44d3-b63d-cbc22a6ccd60 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:15.869932 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2386/4766] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:15 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:09:15.872011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f4502-791b-4ce7-b538-4f990a08920a service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:15.899998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f4502-791b-4ce7-b538-4f990a08920a service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:16.103643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526f90a-ae07-4121-b240-b7b1b4964d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:16.104576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526f90a-ae07-4121-b240-b7b1b4964d15 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:16.105017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526f90a-ae07-4121-b240-b7b1b4964d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:16.106235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526f90a-ae07-4121-b240-b7b1b4964d15 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:16.107581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526f90a-ae07-4121-b240-b7b1b4964d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:16.110100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526f90a-ae07-4121-b240-b7b1b4964d15 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:16.157173 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2381/4767] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:15 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:16.159752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b0541-759d-44d3-b63d-cbc22a6ccd60 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:16.180598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b0541-759d-44d3-b63d-cbc22a6ccd60 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:16.210559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e073f-9612-4c5c-b35c-a344836654bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:16.211645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e073f-9612-4c5c-b35c-a344836654bf admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:16.212150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e073f-9612-4c5c-b35c-a344836654bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:16.213573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e073f-9612-4c5c-b35c-a344836654bf admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:16.214031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e073f-9612-4c5c-b35c-a344836654bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:16.219464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e073f-9612-4c5c-b35c-a344836654bf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:16.256288 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2387/4768] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:16.260042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526f90a-ae07-4121-b240-b7b1b4964d15 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:16.274966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526f90a-ae07-4121-b240-b7b1b4964d15 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:16.292467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32739349-5b9b-4c8b-9876-364e79bd3155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:16.293125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32739349-5b9b-4c8b-9876-364e79bd3155 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:16.293415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32739349-5b9b-4c8b-9876-364e79bd3155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:16.293689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32739349-5b9b-4c8b-9876-364e79bd3155 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:16.296603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32739349-5b9b-4c8b-9876-364e79bd3155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:16.300545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32739349-5b9b-4c8b-9876-364e79bd3155 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:16.328376 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2382/4769] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:16.333333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e073f-9612-4c5c-b35c-a344836654bf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:16.350960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e073f-9612-4c5c-b35c-a344836654bf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:16.360371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9052e-69dc-4503-8b66-72859045c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:16.362258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9052e-69dc-4503-8b66-72859045c802 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:16.362382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9052e-69dc-4503-8b66-72859045c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:16.362803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9052e-69dc-4503-8b66-72859045c802 admin admin] PATH_INFO: `/v3/projects/50dc010f145d43dda75a375341a78bc4/users/0849711750ab4fbc9d339e4ec273374d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:16.384596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9052e-69dc-4503-8b66-72859045c802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50dc010f145d43dda75a375341a78bc4, user_id=0849711750ab4fbc9d339e4ec273374d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:16.387473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9052e-69dc-4503-8b66-72859045c802 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:16.423177 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2388/4770] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:16 2022] PUT /identity/v3/projects/50dc010f145d43dda75a375341a78bc4/users/0849711750ab4fbc9d339e4ec273374d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:16.433344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800a122-5399-435f-a8bf-0344ab11d3f4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:16.433773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800a122-5399-435f-a8bf-0344ab11d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:16.434254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800a122-5399-435f-a8bf-0344ab11d3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:16.500879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5800a122-5399-435f-a8bf-0344ab11d3f4 None None] MFA Rules not processed for user `0849711750ab4fbc9d339e4ec273374d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:16.503060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5800a122-5399-435f-a8bf-0344ab11d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:16.573060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:16.658792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9052e-69dc-4503-8b66-72859045c802 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:16.659408 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2383/4771] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:16.783382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:16.857403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9052e-69dc-4503-8b66-72859045c802 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:16.874729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e276a6-46c9-4a66-aadb-61f728beab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:16.875749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e276a6-46c9-4a66-aadb-61f728beab8e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:16.876265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e276a6-46c9-4a66-aadb-61f728beab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:16.876815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e276a6-46c9-4a66-aadb-61f728beab8e admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:16.878706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e276a6-46c9-4a66-aadb-61f728beab8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:16.885738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e276a6-46c9-4a66-aadb-61f728beab8e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:16.954985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800a122-5399-435f-a8bf-0344ab11d3f4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:16.957566 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2389/4772] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:16 2022] POST /identity/v3/projects => generated 377 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:16.974127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800a122-5399-435f-a8bf-0344ab11d3f4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:17.126341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0167f-c235-45c6-a418-0dc591c84ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:17.126625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0167f-c235-45c6-a418-0dc591c84ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:17.127123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0167f-c235-45c6-a418-0dc591c84ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:17.127912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0167f-c235-45c6-a418-0dc591c84ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:17.129221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0167f-c235-45c6-a418-0dc591c84ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:17.138907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0167f-c235-45c6-a418-0dc591c84ae5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:17.183720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e276a6-46c9-4a66-aadb-61f728beab8e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:17.192338 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2384/4773] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:16 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:09:17.198030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e276a6-46c9-4a66-aadb-61f728beab8e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:17.206330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08827969-b158-4228-83cf-0b2f5d9001c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:17.207462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08827969-b158-4228-83cf-0b2f5d9001c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:17.207820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08827969-b158-4228-83cf-0b2f5d9001c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:17.208232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08827969-b158-4228-83cf-0b2f5d9001c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:17.209015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08827969-b158-4228-83cf-0b2f5d9001c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:17.211068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08827969-b158-4228-83cf-0b2f5d9001c7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:17.230647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0167f-c235-45c6-a418-0dc591c84ae5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:17.243403 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2390/4774] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:17.248059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0167f-c235-45c6-a418-0dc591c84ae5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:17.254645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313cbe7-fa89-461d-ac88-eeb78e7d5161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:17.255471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313cbe7-fa89-461d-ac88-eeb78e7d5161 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:17.255833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313cbe7-fa89-461d-ac88-eeb78e7d5161 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:17.256240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313cbe7-fa89-461d-ac88-eeb78e7d5161 admin admin] PATH_INFO: `/v3/projects/17226b6365fa465b9a75cc46a7412427/users/2929cf98d76a437ba4f1b3ea29894682/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:17.275507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313cbe7-fa89-461d-ac88-eeb78e7d5161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17226b6365fa465b9a75cc46a7412427, user_id=2929cf98d76a437ba4f1b3ea29894682, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:17.278697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313cbe7-fa89-461d-ac88-eeb78e7d5161 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:17.302951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08827969-b158-4228-83cf-0b2f5d9001c7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:17.303414 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2385/4775] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:17 2022] PUT /identity/v3/projects/17226b6365fa465b9a75cc46a7412427/users/2929cf98d76a437ba4f1b3ea29894682/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:17.316863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08827969-b158-4228-83cf-0b2f5d9001c7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:17.415884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24577a07-3896-402d-bbc8-11fb019badbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:17.416704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24577a07-3896-402d-bbc8-11fb019badbe admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:17.417030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24577a07-3896-402d-bbc8-11fb019badbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:17.417487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24577a07-3896-402d-bbc8-11fb019badbe admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:17.418087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24577a07-3896-402d-bbc8-11fb019badbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:17.424893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24577a07-3896-402d-bbc8-11fb019badbe admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:17.440487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313cbe7-fa89-461d-ac88-eeb78e7d5161 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:17.443248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0313cbe7-fa89-461d-ac88-eeb78e7d5161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:17.458450 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2391/4776] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:17.459065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24577a07-3896-402d-bbc8-11fb019badbe admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:17.479897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24577a07-3896-402d-bbc8-11fb019badbe admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:17.487596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313cbe7-fa89-461d-ac88-eeb78e7d5161 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:17.494803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc1ef6-436a-467d-8b28-8eadfbac7781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:17.495249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc1ef6-436a-467d-8b28-8eadfbac7781 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:17.495537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc1ef6-436a-467d-8b28-8eadfbac7781 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:17.495976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc1ef6-436a-467d-8b28-8eadfbac7781 admin admin] PATH_INFO: `/v3/projects/17226b6365fa465b9a75cc46a7412427/users/2929cf98d76a437ba4f1b3ea29894682/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:17.499625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc1ef6-436a-467d-8b28-8eadfbac7781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17226b6365fa465b9a75cc46a7412427, user_id=2929cf98d76a437ba4f1b3ea29894682, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:17.499865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:17.500367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:17.500927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:17.500927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] PATH_INFO: `/v3/projects/4d2e7363ffe440549009955b6d5a8b81` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:17.503725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d2e7363ffe440549009955b6d5a8b81)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:17.507258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc1ef6-436a-467d-8b28-8eadfbac7781 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:17.510127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:17.554381 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2392/4777] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:17 2022] PUT /identity/v3/projects/17226b6365fa465b9a75cc46a7412427/users/2929cf98d76a437ba4f1b3ea29894682/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:09:17.555003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b2cff-3ae8-4dfb-a2d3-fd8ab33d97e1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:17.555293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b2cff-3ae8-4dfb-a2d3-fd8ab33d97e1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:17.555572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b2cff-3ae8-4dfb-a2d3-fd8ab33d97e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:17.665635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b77b2cff-3ae8-4dfb-a2d3-fd8ab33d97e1 None None] MFA Rules not processed for user `2929cf98d76a437ba4f1b3ea29894682`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:17.667732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b77b2cff-3ae8-4dfb-a2d3-fd8ab33d97e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:17.700008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d2e7363ffe440549009955b6d5a8b81', 'request_id': 'req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:17.715205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d2e7363ffe440549009955b6d5a8b81', 'request_id': 'req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:17.725132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d2e7363ffe440549009955b6d5a8b81', 'request_id': 'req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:17.765268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] The token cache is being invalidate because project 4d2e7363ffe440549009955b6d5a8b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:17.765572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:17.779885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:17.801867 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2386/4778] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:17 2022] DELETE /identity/v3/projects/4d2e7363ffe440549009955b6d5a8b81 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:17.803936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:17.808134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:17.892621 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2393/4779] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:09:17.897075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b2cff-3ae8-4dfb-a2d3-fd8ab33d97e1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:17.899658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b77b2cff-3ae8-4dfb-a2d3-fd8ab33d97e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:17.928049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:17.938059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:18.016115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b2cff-3ae8-4dfb-a2d3-fd8ab33d97e1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:18.031837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca888e-3eda-46c4-92cc-321361ffd542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:18.033711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca888e-3eda-46c4-92cc-321361ffd542 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:18.034217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca888e-3eda-46c4-92cc-321361ffd542 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:18.034783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca888e-3eda-46c4-92cc-321361ffd542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:18.036913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d4ca888e-3eda-46c4-92cc-321361ffd542 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:18.052779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca02f3-4acd-4dcd-9a9b-4a7bffb0736d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:18.065307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:18.065887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:18.066173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:18.066895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] PATH_INFO: `/v3/users/9bd4890ca1ff4e1f82acd1e3bacbb441` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:18.069542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd4890ca1ff4e1f82acd1e3bacbb441)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:18.072689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:18.241908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd4890ca1ff4e1f82acd1e3bacbb441'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:18.263126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca888e-3eda-46c4-92cc-321361ffd542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:18.266005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca888e-3eda-46c4-92cc-321361ffd542 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:18.267923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd4890ca1ff4e1f82acd1e3bacbb441'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:18.269953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd4890ca1ff4e1f82acd1e3bacbb441'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:18.292426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd4890ca1ff4e1f82acd1e3bacbb441'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:18.293587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd4890ca1ff4e1f82acd1e3bacbb441'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:18.315412 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2394/4780] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:18.316748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160da05b-aeda-42d6-87fe-4e8b7d71cbe8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:18.317043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160da05b-aeda-42d6-87fe-4e8b7d71cbe8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:18.317374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160da05b-aeda-42d6-87fe-4e8b7d71cbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:18.328899 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2387/4781] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:09:17 2022] DELETE /identity/v3/users/9bd4890ca1ff4e1f82acd1e3bacbb441 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:18.373672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-160da05b-aeda-42d6-87fe-4e8b7d71cbe8 None None] MFA Rules not processed for user `89900b5f2e7e45e6a1757b9e7b38add0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:18.375175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-160da05b-aeda-42d6-87fe-4e8b7d71cbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:18.530521 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2395/4782] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:19.778796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:19.780990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:19.968706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60446fa1-e1ef-4e86-be9b-f93877ac5ee8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:19.976573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b472f07-57fb-41ce-b3a7-261d77da49b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:19.976573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b472f07-57fb-41ce-b3a7-261d77da49b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:19.977049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b472f07-57fb-41ce-b3a7-261d77da49b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:19.977731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b472f07-57fb-41ce-b3a7-261d77da49b6 admin admin] PATH_INFO: `/v3/projects/1dc29fe6326a4d1db215e6db87204a22` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:19.994572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b472f07-57fb-41ce-b3a7-261d77da49b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc29fe6326a4d1db215e6db87204a22)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:19.998899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b472f07-57fb-41ce-b3a7-261d77da49b6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:20.150966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:20.198193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4b472f07-57fb-41ce-b3a7-261d77da49b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc29fe6326a4d1db215e6db87204a22', 'request_id': 'req-4b472f07-57fb-41ce-b3a7-261d77da49b6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:20.210382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4b472f07-57fb-41ce-b3a7-261d77da49b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc29fe6326a4d1db215e6db87204a22', 'request_id': 'req-4b472f07-57fb-41ce-b3a7-261d77da49b6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:20.222628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4b472f07-57fb-41ce-b3a7-261d77da49b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc29fe6326a4d1db215e6db87204a22', 'request_id': 'req-4b472f07-57fb-41ce-b3a7-261d77da49b6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:20.250490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4b472f07-57fb-41ce-b3a7-261d77da49b6 admin admin] The token cache is being invalidate because project 1dc29fe6326a4d1db215e6db87204a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:20.252196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4b472f07-57fb-41ce-b3a7-261d77da49b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:20.253919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4b472f07-57fb-41ce-b3a7-261d77da49b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:20.258289 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2388/4783] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:19 2022] DELETE /identity/v3/projects/1dc29fe6326a4d1db215e6db87204a22 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:20.265582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64ef9b-0a0e-4f47-9794-7b6fbf6b33af None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:20.266151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64ef9b-0a0e-4f47-9794-7b6fbf6b33af None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:20.266691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64ef9b-0a0e-4f47-9794-7b6fbf6b33af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:20.316254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8d64ef9b-0a0e-4f47-9794-7b6fbf6b33af None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:20.317493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8d64ef9b-0a0e-4f47-9794-7b6fbf6b33af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:20.381035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:20.415568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e70eb-72dc-454e-8e35-de974b98c76c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:20.416196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e70eb-72dc-454e-8e35-de974b98c76c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:20.416657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e70eb-72dc-454e-8e35-de974b98c76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:20.420905 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2396/4784] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:20.441296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-323e70eb-72dc-454e-8e35-de974b98c76c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:20.445444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-323e70eb-72dc-454e-8e35-de974b98c76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:20.466859 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2389/4785] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:20.471973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64ef9b-0a0e-4f47-9794-7b6fbf6b33af None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:20.491685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64ef9b-0a0e-4f47-9794-7b6fbf6b33af None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:20.503059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e40f0-fe39-498f-997a-087f284fd18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:20.503894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e40f0-fe39-498f-997a-087f284fd18c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:20.504734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e40f0-fe39-498f-997a-087f284fd18c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:20.504734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e40f0-fe39-498f-997a-087f284fd18c admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:20.507600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e40f0-fe39-498f-997a-087f284fd18c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:09:20.508385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e40f0-fe39-498f-997a-087f284fd18c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:20.510539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e40f0-fe39-498f-997a-087f284fd18c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:20.527729 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2397/4786] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:09:20.531514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e70eb-72dc-454e-8e35-de974b98c76c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:20.544073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e70eb-72dc-454e-8e35-de974b98c76c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:20.550977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3df72-d4e3-4099-b536-8fd3abf1d17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:20.551734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3df72-d4e3-4099-b536-8fd3abf1d17a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:20.552220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3df72-d4e3-4099-b536-8fd3abf1d17a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:20.552562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3df72-d4e3-4099-b536-8fd3abf1d17a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:20.553299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3df72-d4e3-4099-b536-8fd3abf1d17a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:20.555548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3df72-d4e3-4099-b536-8fd3abf1d17a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:20.625207 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2390/4787] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:20 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:09:20.635582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e40f0-fe39-498f-997a-087f284fd18c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:20.670593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e40f0-fe39-498f-997a-087f284fd18c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:20.773869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298470f-5ca0-4503-82e3-716d24e4660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:20.774694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298470f-5ca0-4503-82e3-716d24e4660b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:20.775378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298470f-5ca0-4503-82e3-716d24e4660b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:20.776026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298470f-5ca0-4503-82e3-716d24e4660b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:20.777137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298470f-5ca0-4503-82e3-716d24e4660b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:20.779473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298470f-5ca0-4503-82e3-716d24e4660b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:20.822548 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2398/4788] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:20 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:20.826535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3df72-d4e3-4099-b536-8fd3abf1d17a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:20.847580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3df72-d4e3-4099-b536-8fd3abf1d17a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:20.857914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a8661-579f-4b7c-a860-215d9db0609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:20.858944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a8661-579f-4b7c-a860-215d9db0609e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:20.859429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a8661-579f-4b7c-a860-215d9db0609e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:20.859904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a8661-579f-4b7c-a860-215d9db0609e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:20.862516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a8661-579f-4b7c-a860-215d9db0609e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:20.864300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a8661-579f-4b7c-a860-215d9db0609e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:20.882407 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2391/4789] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:09:20.886904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298470f-5ca0-4503-82e3-716d24e4660b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:20.903225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298470f-5ca0-4503-82e3-716d24e4660b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:20.910820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f364b-6a84-4539-9cee-aa2d5f32629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:20.911602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f364b-6a84-4539-9cee-aa2d5f32629d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:20.913499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f364b-6a84-4539-9cee-aa2d5f32629d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:20.918849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f364b-6a84-4539-9cee-aa2d5f32629d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:20.921107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f364b-6a84-4539-9cee-aa2d5f32629d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:20.924364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f364b-6a84-4539-9cee-aa2d5f32629d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:20.943740 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2399/4790] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:20.945919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a8661-579f-4b7c-a860-215d9db0609e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:20.981925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a8661-579f-4b7c-a860-215d9db0609e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:20.989539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932d7d3-c4eb-42ca-9136-c6bc1e5567b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:20.990230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932d7d3-c4eb-42ca-9136-c6bc1e5567b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:20.990516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932d7d3-c4eb-42ca-9136-c6bc1e5567b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:20.990833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932d7d3-c4eb-42ca-9136-c6bc1e5567b5 admin admin] PATH_INFO: `/v3/projects/085636d86e0443c08ab077f2cb9bee02/users/1f26d07d53c4462aa2451518d8519cde/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:21.036920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932d7d3-c4eb-42ca-9136-c6bc1e5567b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085636d86e0443c08ab077f2cb9bee02, user_id=1f26d07d53c4462aa2451518d8519cde, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:21.039711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932d7d3-c4eb-42ca-9136-c6bc1e5567b5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:21.065733 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2392/4791] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:20 2022] PUT /identity/v3/projects/085636d86e0443c08ab077f2cb9bee02/users/1f26d07d53c4462aa2451518d8519cde/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:21.078596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bd26e-4b8e-4110-b8e1-4de6aafdc7b3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:21.079083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bd26e-4b8e-4110-b8e1-4de6aafdc7b3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:21.080401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bd26e-4b8e-4110-b8e1-4de6aafdc7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:21.193744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a00bd26e-4b8e-4110-b8e1-4de6aafdc7b3 None None] MFA Rules not processed for user `1f26d07d53c4462aa2451518d8519cde`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:21.198215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a00bd26e-4b8e-4110-b8e1-4de6aafdc7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:21.348966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932d7d3-c4eb-42ca-9136-c6bc1e5567b5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:21.352201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d932d7d3-c4eb-42ca-9136-c6bc1e5567b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:21.384907 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2400/4792] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:21.388396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bd26e-4b8e-4110-b8e1-4de6aafdc7b3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:21.478675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932d7d3-c4eb-42ca-9136-c6bc1e5567b5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:21.486321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcb3f1-8e88-4401-bc5d-87d8adffe66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:21.487377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcb3f1-8e88-4401-bc5d-87d8adffe66e service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:21.487944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcb3f1-8e88-4401-bc5d-87d8adffe66e service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:21.488976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcb3f1-8e88-4401-bc5d-87d8adffe66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:21.516193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-70fcb3f1-8e88-4401-bc5d-87d8adffe66e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:21.528702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:21.607753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bd26e-4b8e-4110-b8e1-4de6aafdc7b3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:21.621347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7723f-cade-4d95-9f15-ea1111e8507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:21.622450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7723f-cade-4d95-9f15-ea1111e8507c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:21.622952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7723f-cade-4d95-9f15-ea1111e8507c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:21.623988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7723f-cade-4d95-9f15-ea1111e8507c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:21.625005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7723f-cade-4d95-9f15-ea1111e8507c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:21.627753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7723f-cade-4d95-9f15-ea1111e8507c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:21.681977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:21.692804 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2401/4793] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:21 2022] POST /identity/v3/projects => generated 381 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:21.695788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7723f-cade-4d95-9f15-ea1111e8507c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:21.714165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcb3f1-8e88-4401-bc5d-87d8adffe66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:21.715939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcb3f1-8e88-4401-bc5d-87d8adffe66e service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:21.748982 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2393/4794] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:09:21.793366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7723f-cade-4d95-9f15-ea1111e8507c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:21.803871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e60aff-93d6-419d-ad98-4ce6e3c36f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:21.804683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e60aff-93d6-419d-ad98-4ce6e3c36f8e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:21.804973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e60aff-93d6-419d-ad98-4ce6e3c36f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:21.805258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e60aff-93d6-419d-ad98-4ce6e3c36f8e admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:21.805987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e60aff-93d6-419d-ad98-4ce6e3c36f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:21.808632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e60aff-93d6-419d-ad98-4ce6e3c36f8e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:21.856173 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2402/4795] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:21 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:21.861007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcb3f1-8e88-4401-bc5d-87d8adffe66e service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:21.917657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcb3f1-8e88-4401-bc5d-87d8adffe66e service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:21.940090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0086d-d4e3-45e3-8daf-0a32f1d46986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:21.941008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0086d-d4e3-45e3-8daf-0a32f1d46986 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:21.945039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0086d-d4e3-45e3-8daf-0a32f1d46986 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:21.947115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0086d-d4e3-45e3-8daf-0a32f1d46986 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:21.960853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0086d-d4e3-45e3-8daf-0a32f1d46986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:21.963672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0086d-d4e3-45e3-8daf-0a32f1d46986 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:21.998279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be870-a4d1-4bc0-a094-02d4c6aa4e48 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:21.998572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be870-a4d1-4bc0-a094-02d4c6aa4e48 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:21.999527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176be870-a4d1-4bc0-a094-02d4c6aa4e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:21.999729 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2394/4796] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:09:22.005440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0086d-d4e3-45e3-8daf-0a32f1d46986 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:22.028969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0086d-d4e3-45e3-8daf-0a32f1d46986 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:22.053155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe541b-eaf2-4fc7-8600-f7fa80cb2519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:22.055680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe541b-eaf2-4fc7-8600-f7fa80cb2519 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:22.056137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe541b-eaf2-4fc7-8600-f7fa80cb2519 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:22.056470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe541b-eaf2-4fc7-8600-f7fa80cb2519 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:22.057372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe541b-eaf2-4fc7-8600-f7fa80cb2519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:22.062140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe541b-eaf2-4fc7-8600-f7fa80cb2519 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:22.072321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-176be870-a4d1-4bc0-a094-02d4c6aa4e48 None None] MFA Rules not processed for user `e8ac4ee4e0c047b9b415607fcf64ae74`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:22.085507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-176be870-a4d1-4bc0-a094-02d4c6aa4e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:22.092950 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2395/4797] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:22.097248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe541b-eaf2-4fc7-8600-f7fa80cb2519 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:22.120573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe541b-eaf2-4fc7-8600-f7fa80cb2519 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:22.132043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca00a3-ba8c-47b1-9a79-2d7b92e8598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:22.133314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca00a3-ba8c-47b1-9a79-2d7b92e8598b admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:22.133829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca00a3-ba8c-47b1-9a79-2d7b92e8598b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:22.134917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca00a3-ba8c-47b1-9a79-2d7b92e8598b admin admin] PATH_INFO: `/v3/projects/6ab6b83d52564fd299385692540d2107/users/397f04cd73f54ca1a0add662f7e0927a/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:22.171249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca00a3-ba8c-47b1-9a79-2d7b92e8598b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab6b83d52564fd299385692540d2107, user_id=397f04cd73f54ca1a0add662f7e0927a, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:22.176535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca00a3-ba8c-47b1-9a79-2d7b92e8598b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:22.215436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2396/4798] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:22 2022] PUT /identity/v3/projects/6ab6b83d52564fd299385692540d2107/users/397f04cd73f54ca1a0add662f7e0927a/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:22.217621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f93c30-5507-466e-8cdb-6c8e4d9b1a80 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:22.218026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f93c30-5507-466e-8cdb-6c8e4d9b1a80 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:22.218407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f93c30-5507-466e-8cdb-6c8e4d9b1a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:22.268342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f3f93c30-5507-466e-8cdb-6c8e4d9b1a80 None None] MFA Rules not processed for user `397f04cd73f54ca1a0add662f7e0927a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:22.270883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f3f93c30-5507-466e-8cdb-6c8e4d9b1a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:22.388591 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2403/4799] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:22.390471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5a161-c612-48d0-b2c5-1b8e454c6307 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:22.392653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5a161-c612-48d0-b2c5-1b8e454c6307 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:22.393005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5a161-c612-48d0-b2c5-1b8e454c6307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:22.449657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cdc5a161-c612-48d0-b2c5-1b8e454c6307 None None] MFA Rules not processed for user `e8ac4ee4e0c047b9b415607fcf64ae74`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:22.452632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cdc5a161-c612-48d0-b2c5-1b8e454c6307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:22.528571 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2397/4800] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:22.534252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f93c30-5507-466e-8cdb-6c8e4d9b1a80 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:22.659729 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2404/4801] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:09:22.709338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f93c30-5507-466e-8cdb-6c8e4d9b1a80 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:22.721679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccf687-8a74-4474-a48c-ef28b2fbf2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:22.722329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccf687-8a74-4474-a48c-ef28b2fbf2ef admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:22.722615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccf687-8a74-4474-a48c-ef28b2fbf2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:22.722922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccf687-8a74-4474-a48c-ef28b2fbf2ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:22.723572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccf687-8a74-4474-a48c-ef28b2fbf2ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:22.725587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccf687-8a74-4474-a48c-ef28b2fbf2ef admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:22.800639 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2398/4802] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:22 2022] POST /identity/v3/projects => generated 381 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:22.806104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5a161-c612-48d0-b2c5-1b8e454c6307 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:22.817715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:22.824404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5a161-c612-48d0-b2c5-1b8e454c6307 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:22.972887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ec6fd-b673-42f5-89a8-fe34761291fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:22.974062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec6fd-b673-42f5-89a8-fe34761291fb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:22.974597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec6fd-b673-42f5-89a8-fe34761291fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:22.975137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec6fd-b673-42f5-89a8-fe34761291fb admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:22.976246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ec6fd-b673-42f5-89a8-fe34761291fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:22.978839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ec6fd-b673-42f5-89a8-fe34761291fb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:23.066624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccf687-8a74-4474-a48c-ef28b2fbf2ef admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:23.069846 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2405/4803] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:22 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:23.096442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccf687-8a74-4474-a48c-ef28b2fbf2ef admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:23.127562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd7673-f61e-40dd-88a6-dd6d0cd45610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:23.129083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd7673-f61e-40dd-88a6-dd6d0cd45610 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:23.131074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd7673-f61e-40dd-88a6-dd6d0cd45610 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:23.131520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd7673-f61e-40dd-88a6-dd6d0cd45610 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:23.132281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd7673-f61e-40dd-88a6-dd6d0cd45610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:23.134073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd7673-f61e-40dd-88a6-dd6d0cd45610 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:23.220605 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2399/4804] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:23.221718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ec6fd-b673-42f5-89a8-fe34761291fb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:23.252203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ec6fd-b673-42f5-89a8-fe34761291fb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:23.269316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6af68a-0513-49f2-b5e7-4d4258848589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:23.271063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af68a-0513-49f2-b5e7-4d4258848589 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:23.271588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af68a-0513-49f2-b5e7-4d4258848589 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:23.272160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af68a-0513-49f2-b5e7-4d4258848589 admin admin] PATH_INFO: `/v3/projects/48d4a6f648834d0f9c3176b4d04bc6e7/users/e7ea0371d85144ec801383eef2a0c933/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:23.312803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6af68a-0513-49f2-b5e7-4d4258848589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d4a6f648834d0f9c3176b4d04bc6e7, user_id=e7ea0371d85144ec801383eef2a0c933, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:23.322446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6af68a-0513-49f2-b5e7-4d4258848589 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:23.354008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd7673-f61e-40dd-88a6-dd6d0cd45610 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:23.354385 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2406/4805] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:23 2022] PUT /identity/v3/projects/48d4a6f648834d0f9c3176b4d04bc6e7/users/e7ea0371d85144ec801383eef2a0c933/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:23.362986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:23.378495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd7673-f61e-40dd-88a6-dd6d0cd45610 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:23.480066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92a655-a56b-4831-8d01-6b7d9754e3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:23.481754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92a655-a56b-4831-8d01-6b7d9754e3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:23.483655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92a655-a56b-4831-8d01-6b7d9754e3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:23.484238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92a655-a56b-4831-8d01-6b7d9754e3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:23.485243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92a655-a56b-4831-8d01-6b7d9754e3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:23.490257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92a655-a56b-4831-8d01-6b7d9754e3a5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:23.521504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6af68a-0513-49f2-b5e7-4d4258848589 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:23.523379 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2400/4806] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:23.535820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6af68a-0513-49f2-b5e7-4d4258848589 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:23.543653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470aeeb-4fbb-4709-aeeb-2d0673d04541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:23.544340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470aeeb-4fbb-4709-aeeb-2d0673d04541 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:23.544620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470aeeb-4fbb-4709-aeeb-2d0673d04541 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:23.544890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470aeeb-4fbb-4709-aeeb-2d0673d04541 admin admin] PATH_INFO: `/v3/projects/48d4a6f648834d0f9c3176b4d04bc6e7/users/e7ea0371d85144ec801383eef2a0c933/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:23.548969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470aeeb-4fbb-4709-aeeb-2d0673d04541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d4a6f648834d0f9c3176b4d04bc6e7, user_id=e7ea0371d85144ec801383eef2a0c933, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:23.555092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470aeeb-4fbb-4709-aeeb-2d0673d04541 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:23.589025 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2407/4807] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:23 2022] PUT /identity/v3/projects/48d4a6f648834d0f9c3176b4d04bc6e7/users/e7ea0371d85144ec801383eef2a0c933/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:23.602401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d03b3d-6c3e-4cd4-899e-7286b28a2e3a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:23.603117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d03b3d-6c3e-4cd4-899e-7286b28a2e3a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:23.603559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d03b3d-6c3e-4cd4-899e-7286b28a2e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:23.668212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-79d03b3d-6c3e-4cd4-899e-7286b28a2e3a None None] MFA Rules not processed for user `e7ea0371d85144ec801383eef2a0c933`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:23.670102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-79d03b3d-6c3e-4cd4-899e-7286b28a2e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:23.903399 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2401/4808] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:24.139814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470aeeb-4fbb-4709-aeeb-2d0673d04541 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:24.150469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4470aeeb-4fbb-4709-aeeb-2d0673d04541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:24.346971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470aeeb-4fbb-4709-aeeb-2d0673d04541 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:24.364927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57ac4d-bc42-4094-859d-6feced57c410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:24.365685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57ac4d-bc42-4094-859d-6feced57c410 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:24.366018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57ac4d-bc42-4094-859d-6feced57c410 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:24.366297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57ac4d-bc42-4094-859d-6feced57c410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:24.627871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57ac4d-bc42-4094-859d-6feced57c410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:24.635803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57ac4d-bc42-4094-859d-6feced57c410 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:24.659874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:24.686819 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2408/4809] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:33.888923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=62 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:34.218151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d03b3d-6c3e-4cd4-899e-7286b28a2e3a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:34.220656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-79d03b3d-6c3e-4cd4-899e-7286b28a2e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:34.463305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d03b3d-6c3e-4cd4-899e-7286b28a2e3a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:34.480001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ade368-b4f2-4c5f-b22c-8e16c14ef841 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:34.481474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ade368-b4f2-4c5f-b22c-8e16c14ef841 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:34.482230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ade368-b4f2-4c5f-b22c-8e16c14ef841 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:34.484020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ade368-b4f2-4c5f-b22c-8e16c14ef841 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:34.487326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b5ade368-b4f2-4c5f-b22c-8e16c14ef841 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:34.536483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ade368-b4f2-4c5f-b22c-8e16c14ef841 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:34.547597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ade368-b4f2-4c5f-b22c-8e16c14ef841 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:34.572035 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2402/4810] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:34.601215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57ac4d-bc42-4094-859d-6feced57c410 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:34.602641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fe57ac4d-bc42-4094-859d-6feced57c410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:34.634004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57ac4d-bc42-4094-859d-6feced57c410 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:34.656878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c616317-bae5-484a-bc4c-434863efe04e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:34.658650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616317-bae5-484a-bc4c-434863efe04e service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:34.659199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616317-bae5-484a-bc4c-434863efe04e service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:34.659638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616317-bae5-484a-bc4c-434863efe04e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:34.666569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8c616317-bae5-484a-bc4c-434863efe04e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:34.698957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c616317-bae5-484a-bc4c-434863efe04e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:34.701353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c616317-bae5-484a-bc4c-434863efe04e service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:34.762119 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2409/4811] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:35.853875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ade368-b4f2-4c5f-b22c-8e16c14ef841 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:35.855452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b5ade368-b4f2-4c5f-b22c-8e16c14ef841 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:36.024161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ade368-b4f2-4c5f-b22c-8e16c14ef841 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:36.029349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:36.029997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:36.030282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:36.030557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] PATH_INFO: `/v3/users/0849711750ab4fbc9d339e4ec273374d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:36.032784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0849711750ab4fbc9d339e4ec273374d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:36.035159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:36.194933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0849711750ab4fbc9d339e4ec273374d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:36.212279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0849711750ab4fbc9d339e4ec273374d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:36.213316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0849711750ab4fbc9d339e4ec273374d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:36.241284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0849711750ab4fbc9d339e4ec273374d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:36.242438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0849711750ab4fbc9d339e4ec273374d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:36.265648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:36.272796 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2403/4812] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:09:35 2022] DELETE /identity/v3/users/0849711750ab4fbc9d339e4ec273374d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:36.277507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7d929-1adf-4a04-b614-0f31b0c4dc8a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:36.277999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7d929-1adf-4a04-b614-0f31b0c4dc8a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:36.277999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7d929-1adf-4a04-b614-0f31b0c4dc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:36.314383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-acd7d929-1adf-4a04-b614-0f31b0c4dc8a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:36.317915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-acd7d929-1adf-4a04-b614-0f31b0c4dc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:36.443943 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2410/4813] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:36.481202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:36.483027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:36.614684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7d929-1adf-4a04-b614-0f31b0c4dc8a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:36.616495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-acd7d929-1adf-4a04-b614-0f31b0c4dc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:36.620669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6189335-3642-4be5-9f40-84b03d67f0cf admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:36.625260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed78d7-24bf-4ec3-8500-4cdde31e5f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:36.626556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed78d7-24bf-4ec3-8500-4cdde31e5f4f service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:36.627049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed78d7-24bf-4ec3-8500-4cdde31e5f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:36.627332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed78d7-24bf-4ec3-8500-4cdde31e5f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:36.638667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed78d7-24bf-4ec3-8500-4cdde31e5f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:36.640627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed78d7-24bf-4ec3-8500-4cdde31e5f4f service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:36.643905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7d929-1adf-4a04-b614-0f31b0c4dc8a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:36.656192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:36.657894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:36.658194 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2404/4814] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:09:36.658979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:36.659273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] PATH_INFO: `/v3/users/c47852e33a9f4835bf8b5e3a2a760cdd` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:36.667635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47852e33a9f4835bf8b5e3a2a760cdd)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:36.669623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:36.781939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47852e33a9f4835bf8b5e3a2a760cdd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:36.796408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47852e33a9f4835bf8b5e3a2a760cdd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:36.797054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47852e33a9f4835bf8b5e3a2a760cdd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:36.820806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47852e33a9f4835bf8b5e3a2a760cdd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:36.821451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47852e33a9f4835bf8b5e3a2a760cdd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:36.862575 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2411/4815] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:09:36 2022] DELETE /identity/v3/users/c47852e33a9f4835bf8b5e3a2a760cdd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:09:36.864280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2455b-3a88-4028-b757-fbe4f36a70f5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:36.864728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2455b-3a88-4028-b757-fbe4f36a70f5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:36.864837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2455b-3a88-4028-b757-fbe4f36a70f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:36.912455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a5e2455b-3a88-4028-b757-fbe4f36a70f5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:36.913871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a5e2455b-3a88-4028-b757-fbe4f36a70f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:37.019903 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2405/4816] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:37.054280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:37.056243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:37.240384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217536d1-bd41-494d-bf76-ee69fcd95a3d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:37.253172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84a5e5-6312-4d73-b7b1-5912a0090843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:37.253818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84a5e5-6312-4d73-b7b1-5912a0090843 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:37.254103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84a5e5-6312-4d73-b7b1-5912a0090843 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:37.254377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84a5e5-6312-4d73-b7b1-5912a0090843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:37.280049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84a5e5-6312-4d73-b7b1-5912a0090843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:37.281527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84a5e5-6312-4d73-b7b1-5912a0090843 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:37.304236 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2412/4817] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:37.976178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2455b-3a88-4028-b757-fbe4f36a70f5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:37.978582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a5e2455b-3a88-4028-b757-fbe4f36a70f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:38.007463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2455b-3a88-4028-b757-fbe4f36a70f5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:38.017440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4acc1-80eb-4793-8508-288d5bc219f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:38.018658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4acc1-80eb-4793-8508-288d5bc219f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:38.020989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4acc1-80eb-4793-8508-288d5bc219f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:38.021736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4acc1-80eb-4793-8508-288d5bc219f3 admin admin] PATH_INFO: `/v3/projects/b5ab10d45f774cab9bc406836254fc1a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:38.023956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4acc1-80eb-4793-8508-288d5bc219f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ab10d45f774cab9bc406836254fc1a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:38.026618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da4acc1-80eb-4793-8508-288d5bc219f3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:38.156892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1da4acc1-80eb-4793-8508-288d5bc219f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ab10d45f774cab9bc406836254fc1a', 'request_id': 'req-1da4acc1-80eb-4793-8508-288d5bc219f3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:38.189674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1da4acc1-80eb-4793-8508-288d5bc219f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ab10d45f774cab9bc406836254fc1a', 'request_id': 'req-1da4acc1-80eb-4793-8508-288d5bc219f3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:38.199049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1da4acc1-80eb-4793-8508-288d5bc219f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ab10d45f774cab9bc406836254fc1a', 'request_id': 'req-1da4acc1-80eb-4793-8508-288d5bc219f3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:38.231183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1da4acc1-80eb-4793-8508-288d5bc219f3 admin admin] The token cache is being invalidate because project b5ab10d45f774cab9bc406836254fc1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:38.231571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1da4acc1-80eb-4793-8508-288d5bc219f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:38.233452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1da4acc1-80eb-4793-8508-288d5bc219f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:38.243923 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2406/4818] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:37 2022] DELETE /identity/v3/projects/b5ab10d45f774cab9bc406836254fc1a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:38.245614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f921c3-4ce5-4607-81af-056cb7108976 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:38.245904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f921c3-4ce5-4607-81af-056cb7108976 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:38.246184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f921c3-4ce5-4607-81af-056cb7108976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:38.253594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:38.315888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-83f921c3-4ce5-4607-81af-056cb7108976 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:38.317237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-83f921c3-4ce5-4607-81af-056cb7108976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:38.443953 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2413/4819] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:38.452370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e9d6e-1aa2-4252-b5ca-5cc0bd0c4828 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:38.452979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e9d6e-1aa2-4252-b5ca-5cc0bd0c4828 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:38.453513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e9d6e-1aa2-4252-b5ca-5cc0bd0c4828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:38.475610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f921c3-4ce5-4607-81af-056cb7108976 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:38.477494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-83f921c3-4ce5-4607-81af-056cb7108976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:38.500313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-269e9d6e-1aa2-4252-b5ca-5cc0bd0c4828 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:38.504505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-269e9d6e-1aa2-4252-b5ca-5cc0bd0c4828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:38.505904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f921c3-4ce5-4607-81af-056cb7108976 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:38.520489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:38.521883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:38.523018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:38.525382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] PATH_INFO: `/v3/projects/50dc010f145d43dda75a375341a78bc4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:38.531096 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2407/4820] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:09:38.531536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50dc010f145d43dda75a375341a78bc4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:38.535298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e9d6e-1aa2-4252-b5ca-5cc0bd0c4828 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:38.537669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:38.554910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e9d6e-1aa2-4252-b5ca-5cc0bd0c4828 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:38.569553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a67cb4-022a-45fb-b183-0cc156c0cb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:38.570599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a67cb4-022a-45fb-b183-0cc156c0cb58 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:38.571160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a67cb4-022a-45fb-b183-0cc156c0cb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:38.571663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a67cb4-022a-45fb-b183-0cc156c0cb58 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:38.572563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a67cb4-022a-45fb-b183-0cc156c0cb58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:09:38.573117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a67cb4-022a-45fb-b183-0cc156c0cb58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:38.575062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a67cb4-022a-45fb-b183-0cc156c0cb58 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:38.638678 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2408/4821] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:09:38.640146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a67cb4-022a-45fb-b183-0cc156c0cb58 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:38.678063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:38.699331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50dc010f145d43dda75a375341a78bc4', 'request_id': 'req-2f4c9d12-db33-499c-bfa7-19cf3366f858'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:38.699599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a67cb4-022a-45fb-b183-0cc156c0cb58 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:38.713620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50dc010f145d43dda75a375341a78bc4', 'request_id': 'req-2f4c9d12-db33-499c-bfa7-19cf3366f858'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:38.728834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50dc010f145d43dda75a375341a78bc4', 'request_id': 'req-2f4c9d12-db33-499c-bfa7-19cf3366f858'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:38.761495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] The token cache is being invalidate because project 50dc010f145d43dda75a375341a78bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:38.762542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:38.763501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:38.765399 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2414/4822] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:38 2022] DELETE /identity/v3/projects/50dc010f145d43dda75a375341a78bc4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:38.770569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:38.773661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:38.905279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72407f-429f-403f-a794-a709b049d43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:38.906610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72407f-429f-403f-a794-a709b049d43a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:38.907832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72407f-429f-403f-a794-a709b049d43a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:38.908294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72407f-429f-403f-a794-a709b049d43a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:38.909447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72407f-429f-403f-a794-a709b049d43a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:38.927109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72407f-429f-403f-a794-a709b049d43a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:38.935541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c9d12-db33-499c-bfa7-19cf3366f858 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:38.951240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:38.952182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:38.953176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:38.953667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] PATH_INFO: `/v3/users/2929cf98d76a437ba4f1b3ea29894682` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:38.956374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2929cf98d76a437ba4f1b3ea29894682)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:38.962548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:39.028834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:39.030726 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2409/4823] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:38 2022] POST /identity/v3/projects => generated 377 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:39.034118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72407f-429f-403f-a794-a709b049d43a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:39.042058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fc72407f-429f-403f-a794-a709b049d43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:39.087267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2929cf98d76a437ba4f1b3ea29894682'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:39.114270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2929cf98d76a437ba4f1b3ea29894682'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:39.114633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2929cf98d76a437ba4f1b3ea29894682'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:39.138768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2929cf98d76a437ba4f1b3ea29894682'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:39.140125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2929cf98d76a437ba4f1b3ea29894682'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:39.176210 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2415/4824] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:09:38 2022] DELETE /identity/v3/users/2929cf98d76a437ba4f1b3ea29894682 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:39.253918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72407f-429f-403f-a794-a709b049d43a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:39.365623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116246d-6400-48f2-b09a-579d90484700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:39.366365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116246d-6400-48f2-b09a-579d90484700 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:39.366658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116246d-6400-48f2-b09a-579d90484700 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:39.367018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116246d-6400-48f2-b09a-579d90484700 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:39.368124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116246d-6400-48f2-b09a-579d90484700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:39.370149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116246d-6400-48f2-b09a-579d90484700 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:39.414501 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2410/4825] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:39 2022] POST /identity/v3/users => generated 289 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:39.415993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:39.420802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:39.449192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a0635-3123-4391-97cd-238f5f462966 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:39.461960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbc107-8764-4bc6-b86a-fb98673ae9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:39.463158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbc107-8764-4bc6-b86a-fb98673ae9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:39.463612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbc107-8764-4bc6-b86a-fb98673ae9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:39.464491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbc107-8764-4bc6-b86a-fb98673ae9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:39.465743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbc107-8764-4bc6-b86a-fb98673ae9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:39.470412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbc107-8764-4bc6-b86a-fb98673ae9b0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:39.503719 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2416/4826] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:39.507128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116246d-6400-48f2-b09a-579d90484700 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:39.544278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116246d-6400-48f2-b09a-579d90484700 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:39.569041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2956f-de93-4180-85df-4a625dadddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:39.569681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2956f-de93-4180-85df-4a625dadddf4 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:39.569969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2956f-de93-4180-85df-4a625dadddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:39.570252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2956f-de93-4180-85df-4a625dadddf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:39.570937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2956f-de93-4180-85df-4a625dadddf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:39.572571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2956f-de93-4180-85df-4a625dadddf4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:39.595926 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2411/4827] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:39.599931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbc107-8764-4bc6-b86a-fb98673ae9b0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:39.618629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbc107-8764-4bc6-b86a-fb98673ae9b0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:39.634730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc64214-47eb-4c65-849a-342aedce2cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:39.635929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc64214-47eb-4c65-849a-342aedce2cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:39.636636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc64214-47eb-4c65-849a-342aedce2cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:39.637260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc64214-47eb-4c65-849a-342aedce2cfe admin admin] PATH_INFO: `/v3/projects/a74f957e216142c9969d9b5c6d0de8e4/users/38b62750d1364679bd36474e3efaf2d4/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:39.711634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc64214-47eb-4c65-849a-342aedce2cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74f957e216142c9969d9b5c6d0de8e4, user_id=38b62750d1364679bd36474e3efaf2d4, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:39.715018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc64214-47eb-4c65-849a-342aedce2cfe admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:39.752441 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2417/4828] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:39 2022] PUT /identity/v3/projects/a74f957e216142c9969d9b5c6d0de8e4/users/38b62750d1364679bd36474e3efaf2d4/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:39.765739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bea9b-ee87-4da3-8190-d43f6a581cf5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:39.766126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bea9b-ee87-4da3-8190-d43f6a581cf5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:39.766449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bea9b-ee87-4da3-8190-d43f6a581cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:39.906813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-068bea9b-ee87-4da3-8190-d43f6a581cf5 None None] MFA Rules not processed for user `38b62750d1364679bd36474e3efaf2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:39.911547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-068bea9b-ee87-4da3-8190-d43f6a581cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:39.928946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:39.993958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc64214-47eb-4c65-849a-342aedce2cfe admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:39.996241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-abc64214-47eb-4c65-849a-342aedce2cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:40.182048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc64214-47eb-4c65-849a-342aedce2cfe admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:40.183865 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2412/4829] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:40.190520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06136169-b216-402f-9669-ac93b6efee18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:40.191218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06136169-b216-402f-9669-ac93b6efee18 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:40.191506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06136169-b216-402f-9669-ac93b6efee18 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:40.191783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06136169-b216-402f-9669-ac93b6efee18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:40.193697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-06136169-b216-402f-9669-ac93b6efee18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:40.211620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bea9b-ee87-4da3-8190-d43f6a581cf5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:40.237578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bea9b-ee87-4da3-8190-d43f6a581cf5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:40.252717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ba81a-2ba0-47b6-a39e-748b301b4ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:40.253428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ba81a-2ba0-47b6-a39e-748b301b4ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:40.253710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ba81a-2ba0-47b6-a39e-748b301b4ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:40.253986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ba81a-2ba0-47b6-a39e-748b301b4ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:40.275284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ba81a-2ba0-47b6-a39e-748b301b4ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:40.277540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ba81a-2ba0-47b6-a39e-748b301b4ff8 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:40.303815 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2413/4830] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:40.356073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06136169-b216-402f-9669-ac93b6efee18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:40.371495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06136169-b216-402f-9669-ac93b6efee18 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:40.386324 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2418/4831] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:09:40.663213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ba81a-2ba0-47b6-a39e-748b301b4ff8 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:40.665634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ea8ba81a-2ba0-47b6-a39e-748b301b4ff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:40.833674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ba81a-2ba0-47b6-a39e-748b301b4ff8 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:40.840234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440afdc-333f-46cf-97d5-af6c7e222135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:40.841315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440afdc-333f-46cf-97d5-af6c7e222135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:40.841771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440afdc-333f-46cf-97d5-af6c7e222135 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:40.842443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440afdc-333f-46cf-97d5-af6c7e222135 admin admin] PATH_INFO: `/v3/projects/17226b6365fa465b9a75cc46a7412427` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:40.843978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440afdc-333f-46cf-97d5-af6c7e222135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17226b6365fa465b9a75cc46a7412427)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:40.847329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440afdc-333f-46cf-97d5-af6c7e222135 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:40.934243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0440afdc-333f-46cf-97d5-af6c7e222135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17226b6365fa465b9a75cc46a7412427', 'request_id': 'req-0440afdc-333f-46cf-97d5-af6c7e222135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:40.951786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0440afdc-333f-46cf-97d5-af6c7e222135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17226b6365fa465b9a75cc46a7412427', 'request_id': 'req-0440afdc-333f-46cf-97d5-af6c7e222135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:40.966973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0440afdc-333f-46cf-97d5-af6c7e222135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17226b6365fa465b9a75cc46a7412427', 'request_id': 'req-0440afdc-333f-46cf-97d5-af6c7e222135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:40.999979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0440afdc-333f-46cf-97d5-af6c7e222135 admin admin] The token cache is being invalidate because project 17226b6365fa465b9a75cc46a7412427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:41.000275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0440afdc-333f-46cf-97d5-af6c7e222135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:41.003977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0440afdc-333f-46cf-97d5-af6c7e222135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:41.008847 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2414/4832] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:40 2022] DELETE /identity/v3/projects/17226b6365fa465b9a75cc46a7412427 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:41.013904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198572f-8f4d-4229-8130-be7c2f6c0e4a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:41.014385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198572f-8f4d-4229-8130-be7c2f6c0e4a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:41.014942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198572f-8f4d-4229-8130-be7c2f6c0e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:41.034695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:41.052099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0198572f-8f4d-4229-8130-be7c2f6c0e4a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:41.056234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0198572f-8f4d-4229-8130-be7c2f6c0e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:41.188973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afd079-869f-4461-9535-c916be4b65e4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:41.189647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afd079-869f-4461-9535-c916be4b65e4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:41.191840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afd079-869f-4461-9535-c916be4b65e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:41.199180 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2419/4833] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:41.236813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a5afd079-869f-4461-9535-c916be4b65e4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:41.241116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a5afd079-869f-4461-9535-c916be4b65e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:41.279977 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2415/4834] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:41.284799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198572f-8f4d-4229-8130-be7c2f6c0e4a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:41.300680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198572f-8f4d-4229-8130-be7c2f6c0e4a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:41.314207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc5140-cf29-49c5-8adf-ab0884423bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:41.326558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc5140-cf29-49c5-8adf-ab0884423bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:41.331334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc5140-cf29-49c5-8adf-ab0884423bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:41.331837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc5140-cf29-49c5-8adf-ab0884423bd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:41.333930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc5140-cf29-49c5-8adf-ab0884423bd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:09:41.340073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc5140-cf29-49c5-8adf-ab0884423bd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:41.343314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc5140-cf29-49c5-8adf-ab0884423bd3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:41.395800 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2420/4835] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:09:41.396327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afd079-869f-4461-9535-c916be4b65e4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:41.411800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afd079-869f-4461-9535-c916be4b65e4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:41.427197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe6803-766c-4647-8775-27bc8000ded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:41.427877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe6803-766c-4647-8775-27bc8000ded9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:41.428165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe6803-766c-4647-8775-27bc8000ded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:41.428457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe6803-766c-4647-8775-27bc8000ded9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:41.429092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe6803-766c-4647-8775-27bc8000ded9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:41.431231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe6803-766c-4647-8775-27bc8000ded9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:41.482430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:41.520190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc5140-cf29-49c5-8adf-ab0884423bd3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:41.528729 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2416/4836] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:41 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:41.535791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc5140-cf29-49c5-8adf-ab0884423bd3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:41.674259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f9366-9ce6-4a26-a2f5-53710b7abcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:41.675334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f9366-9ce6-4a26-a2f5-53710b7abcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:41.675942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f9366-9ce6-4a26-a2f5-53710b7abcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:41.676548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f9366-9ce6-4a26-a2f5-53710b7abcf8 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:41.677610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f9366-9ce6-4a26-a2f5-53710b7abcf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:41.679976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f9366-9ce6-4a26-a2f5-53710b7abcf8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:41.717675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe6803-766c-4647-8775-27bc8000ded9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:41.728188 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2421/4837] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:41 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:41.736548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe6803-766c-4647-8775-27bc8000ded9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:41.751388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af996262-23fe-471a-a8e6-00967063cbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:41.753488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af996262-23fe-471a-a8e6-00967063cbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:41.753488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af996262-23fe-471a-a8e6-00967063cbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:41.753488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af996262-23fe-471a-a8e6-00967063cbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:41.755384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af996262-23fe-471a-a8e6-00967063cbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:41.762340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af996262-23fe-471a-a8e6-00967063cbc6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:41.796849 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2417/4838] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:41.802210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f9366-9ce6-4a26-a2f5-53710b7abcf8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:41.820567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f9366-9ce6-4a26-a2f5-53710b7abcf8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:41.833810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adf856-1c60-4fae-9c68-2d384d494cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:41.834496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adf856-1c60-4fae-9c68-2d384d494cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:41.834804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adf856-1c60-4fae-9c68-2d384d494cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:41.835083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adf856-1c60-4fae-9c68-2d384d494cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:41.835779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8adf856-1c60-4fae-9c68-2d384d494cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:41.837628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8adf856-1c60-4fae-9c68-2d384d494cd2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:41.862134 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2422/4839] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:41.862698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af996262-23fe-471a-a8e6-00967063cbc6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:41.885122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af996262-23fe-471a-a8e6-00967063cbc6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:41.902424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14da9c-21a0-4b37-ac57-30fe985e42b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:41.903194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14da9c-21a0-4b37-ac57-30fe985e42b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:41.903486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14da9c-21a0-4b37-ac57-30fe985e42b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:41.903764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14da9c-21a0-4b37-ac57-30fe985e42b4 admin admin] PATH_INFO: `/v3/projects/943cf58e8ad04694bd3ed43273a548bc/users/47190518060a458eb3eac40c7736397a/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:41.939416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14da9c-21a0-4b37-ac57-30fe985e42b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=943cf58e8ad04694bd3ed43273a548bc, user_id=47190518060a458eb3eac40c7736397a, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:41.942210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14da9c-21a0-4b37-ac57-30fe985e42b4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:41.989502 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2418/4840] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:41 2022] PUT /identity/v3/projects/943cf58e8ad04694bd3ed43273a548bc/users/47190518060a458eb3eac40c7736397a/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:09:41.992545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b51c1a-dc5b-418d-b914-c9e4d2d0f067 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:41.993143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b51c1a-dc5b-418d-b914-c9e4d2d0f067 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:41.993760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b51c1a-dc5b-418d-b914-c9e4d2d0f067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:42.065408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-13b51c1a-dc5b-418d-b914-c9e4d2d0f067 None None] MFA Rules not processed for user `47190518060a458eb3eac40c7736397a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:42.068530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-13b51c1a-dc5b-418d-b914-c9e4d2d0f067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:42.239504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:42.249088 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2423/4841] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:42.263149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14da9c-21a0-4b37-ac57-30fe985e42b4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:42.265543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0f14da9c-21a0-4b37-ac57-30fe985e42b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:42.413844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14da9c-21a0-4b37-ac57-30fe985e42b4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:42.419536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3be4b8-dbde-452e-944f-e07771604cf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:42.420186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3be4b8-dbde-452e-944f-e07771604cf8 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:42.420477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3be4b8-dbde-452e-944f-e07771604cf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:42.420750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3be4b8-dbde-452e-944f-e07771604cf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:42.462881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3be4b8-dbde-452e-944f-e07771604cf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:42.464910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3be4b8-dbde-452e-944f-e07771604cf8 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:42.497776 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2419/4842] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:42.513336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b51c1a-dc5b-418d-b914-c9e4d2d0f067 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:42.687586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b51c1a-dc5b-418d-b914-c9e4d2d0f067 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:42.707044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:42.712471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:42.713028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:42.715186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] PATH_INFO: `/v3/users/47190518060a458eb3eac40c7736397a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:42.718604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=47190518060a458eb3eac40c7736397a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:42.724582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:42.855323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47190518060a458eb3eac40c7736397a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:42.873523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47190518060a458eb3eac40c7736397a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:42.876837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47190518060a458eb3eac40c7736397a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:42.896868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47190518060a458eb3eac40c7736397a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:42.899200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47190518060a458eb3eac40c7736397a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:42.960568 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2424/4843] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:09:42 2022] DELETE /identity/v3/users/47190518060a458eb3eac40c7736397a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:42.962305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d6ece-5427-464d-a273-3301b63f636b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:42.962593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d6ece-5427-464d-a273-3301b63f636b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:42.963161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d6ece-5427-464d-a273-3301b63f636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:43.027131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d65d6ece-5427-464d-a273-3301b63f636b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:43.028691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d65d6ece-5427-464d-a273-3301b63f636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:43.215938 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2420/4844] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:43.315823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:43.318333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:43.530087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb5a59-388a-4447-8d4a-9e5d7f049dae admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:43.542183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e43d8-48ef-470d-bb6c-7a8c089ad4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:43.543084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e43d8-48ef-470d-bb6c-7a8c089ad4ea service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:43.543455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e43d8-48ef-470d-bb6c-7a8c089ad4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:43.544238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e43d8-48ef-470d-bb6c-7a8c089ad4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:43.571094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e43d8-48ef-470d-bb6c-7a8c089ad4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:43.572874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e43d8-48ef-470d-bb6c-7a8c089ad4ea service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:43.598695 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2425/4845] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:44.246807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d6ece-5427-464d-a273-3301b63f636b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:44.248289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d65d6ece-5427-464d-a273-3301b63f636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:44.384019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:44.417458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d6ece-5427-464d-a273-3301b63f636b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:44.436931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb85fa-c5f4-451d-8da1-41ee644e08a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:44.437789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb85fa-c5f4-451d-8da1-41ee644e08a2 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:44.445379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb85fa-c5f4-451d-8da1-41ee644e08a2 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:44.447391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb85fa-c5f4-451d-8da1-41ee644e08a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:44.454978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1bdb85fa-c5f4-451d-8da1-41ee644e08a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:44.621913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb85fa-c5f4-451d-8da1-41ee644e08a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:44.624854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb85fa-c5f4-451d-8da1-41ee644e08a2 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:44.654135 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2421/4846] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:46.809442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e43d8-48ef-470d-bb6c-7a8c089ad4ea service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:46.811031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-595e43d8-48ef-470d-bb6c-7a8c089ad4ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:46.833162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e43d8-48ef-470d-bb6c-7a8c089ad4ea service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:46.845069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ef518-3d5f-4703-9ffb-db2dca07680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:46.846163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef518-3d5f-4703-9ffb-db2dca07680c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:46.846698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef518-3d5f-4703-9ffb-db2dca07680c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:46.847229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ef518-3d5f-4703-9ffb-db2dca07680c admin admin] PATH_INFO: `/v3/projects/943cf58e8ad04694bd3ed43273a548bc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:46.859743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ef518-3d5f-4703-9ffb-db2dca07680c admin admin] RBAC: Authorizing `identity:delete_project(project_id=943cf58e8ad04694bd3ed43273a548bc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:46.863017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ef518-3d5f-4703-9ffb-db2dca07680c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:46.894147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:46.986589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-428ef518-3d5f-4703-9ffb-db2dca07680c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943cf58e8ad04694bd3ed43273a548bc', 'request_id': 'req-428ef518-3d5f-4703-9ffb-db2dca07680c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:47.015421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-428ef518-3d5f-4703-9ffb-db2dca07680c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943cf58e8ad04694bd3ed43273a548bc', 'request_id': 'req-428ef518-3d5f-4703-9ffb-db2dca07680c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:47.028982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-428ef518-3d5f-4703-9ffb-db2dca07680c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943cf58e8ad04694bd3ed43273a548bc', 'request_id': 'req-428ef518-3d5f-4703-9ffb-db2dca07680c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:47.049703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-428ef518-3d5f-4703-9ffb-db2dca07680c admin admin] The token cache is being invalidate because project 943cf58e8ad04694bd3ed43273a548bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:47.050013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-428ef518-3d5f-4703-9ffb-db2dca07680c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:47.050862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-428ef518-3d5f-4703-9ffb-db2dca07680c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:47.058244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145dcce-5369-4326-9ef1-8e5ee6c2d287 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:47.058720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145dcce-5369-4326-9ef1-8e5ee6c2d287 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:47.058871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145dcce-5369-4326-9ef1-8e5ee6c2d287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:47.062513 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2426/4847] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:46 2022] DELETE /identity/v3/projects/943cf58e8ad04694bd3ed43273a548bc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:47.085792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4145dcce-5369-4326-9ef1-8e5ee6c2d287 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:47.087469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4145dcce-5369-4326-9ef1-8e5ee6c2d287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:47.214869 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2422/4848] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:47.233463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ee40-039a-4140-9807-bcf6284770d6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:47.233755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ee40-039a-4140-9807-bcf6284770d6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:47.234042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ee40-039a-4140-9807-bcf6284770d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:47.282060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1039ee40-039a-4140-9807-bcf6284770d6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:47.283048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1039ee40-039a-4140-9807-bcf6284770d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:47.309344 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2427/4849] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:47.311345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145dcce-5369-4326-9ef1-8e5ee6c2d287 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:47.331427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145dcce-5369-4326-9ef1-8e5ee6c2d287 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:47.350102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc5f30-b052-4448-aa68-916e96179e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:47.351006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5f30-b052-4448-aa68-916e96179e89 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:47.351456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5f30-b052-4448-aa68-916e96179e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:47.351900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5f30-b052-4448-aa68-916e96179e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:47.352725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc5f30-b052-4448-aa68-916e96179e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:09:47.353206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc5f30-b052-4448-aa68-916e96179e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:47.355470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc5f30-b052-4448-aa68-916e96179e89 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:47.396756 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2423/4850] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:09:47.400171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039ee40-039a-4140-9807-bcf6284770d6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:47.420996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039ee40-039a-4140-9807-bcf6284770d6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:47.447562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d36f7e-332e-4652-9079-3d0fa5f35cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:47.448261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36f7e-332e-4652-9079-3d0fa5f35cdf admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:47.448546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36f7e-332e-4652-9079-3d0fa5f35cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:47.448940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36f7e-332e-4652-9079-3d0fa5f35cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:47.449587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d36f7e-332e-4652-9079-3d0fa5f35cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:47.452257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d36f7e-332e-4652-9079-3d0fa5f35cdf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:47.506478 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2428/4851] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:47 2022] POST /identity/v3/projects => generated 361 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:47.507436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc5f30-b052-4448-aa68-916e96179e89 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:47.523802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc5f30-b052-4448-aa68-916e96179e89 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:47.684254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbd5f6-e776-430a-9a6f-71f108c21f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:47.685990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd5f6-e776-430a-9a6f-71f108c21f3f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:47.685990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd5f6-e776-430a-9a6f-71f108c21f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:47.685990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd5f6-e776-430a-9a6f-71f108c21f3f admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:47.686797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbd5f6-e776-430a-9a6f-71f108c21f3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:47.688720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbd5f6-e776-430a-9a6f-71f108c21f3f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:47.718010 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2424/4852] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:47 2022] POST /identity/v3/users => generated 281 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:09:47.727838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d36f7e-332e-4652-9079-3d0fa5f35cdf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:47.746912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d36f7e-332e-4652-9079-3d0fa5f35cdf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:47.766813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768024f-5199-47c6-8b4d-7b998909ee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:47.767463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768024f-5199-47c6-8b4d-7b998909ee77 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:47.769338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768024f-5199-47c6-8b4d-7b998909ee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:47.769875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768024f-5199-47c6-8b4d-7b998909ee77 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:47.770664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768024f-5199-47c6-8b4d-7b998909ee77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:47.776708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768024f-5199-47c6-8b4d-7b998909ee77 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:47.822039 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2429/4853] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:47.826893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbd5f6-e776-430a-9a6f-71f108c21f3f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:47.843073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbd5f6-e776-430a-9a6f-71f108c21f3f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:47.857208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774cc80-7f34-481f-a866-0e31e1aa5172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:47.857969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774cc80-7f34-481f-a866-0e31e1aa5172 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:47.858261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774cc80-7f34-481f-a866-0e31e1aa5172 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:47.858542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774cc80-7f34-481f-a866-0e31e1aa5172 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:47.859523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774cc80-7f34-481f-a866-0e31e1aa5172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:47.867063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774cc80-7f34-481f-a866-0e31e1aa5172 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:47.897458 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2425/4854] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:47.902360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768024f-5199-47c6-8b4d-7b998909ee77 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:47.921130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768024f-5199-47c6-8b4d-7b998909ee77 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:47.933582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebd40e-cfc9-49a7-b10a-db4a0e282c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:47.934581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebd40e-cfc9-49a7-b10a-db4a0e282c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:47.936908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebd40e-cfc9-49a7-b10a-db4a0e282c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:47.937338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebd40e-cfc9-49a7-b10a-db4a0e282c08 admin admin] PATH_INFO: `/v3/projects/0f87687e5a254e758fb649192c3beb4c/users/add5eace1aa144558997d2f873edebf8/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:47.988567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebd40e-cfc9-49a7-b10a-db4a0e282c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f87687e5a254e758fb649192c3beb4c, user_id=add5eace1aa144558997d2f873edebf8, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:47.992055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebd40e-cfc9-49a7-b10a-db4a0e282c08 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:48.018429 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2430/4855] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:47 2022] PUT /identity/v3/projects/0f87687e5a254e758fb649192c3beb4c/users/add5eace1aa144558997d2f873edebf8/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:09:48.030810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd9bb7-2299-406f-bd64-b05cc314c6d8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:48.031254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd9bb7-2299-406f-bd64-b05cc314c6d8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:48.031690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd9bb7-2299-406f-bd64-b05cc314c6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:48.042271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:48.100428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b6fd9bb7-2299-406f-bd64-b05cc314c6d8 None None] MFA Rules not processed for user `add5eace1aa144558997d2f873edebf8`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:48.102356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b6fd9bb7-2299-406f-bd64-b05cc314c6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:48.282582 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2426/4856] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:48.319086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebd40e-cfc9-49a7-b10a-db4a0e282c08 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:48.321390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-92ebd40e-cfc9-49a7-b10a-db4a0e282c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:48.456319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebd40e-cfc9-49a7-b10a-db4a0e282c08 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:48.467463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858c1a8-c3d9-415a-ab4c-05ba20b57bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:48.468331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858c1a8-c3d9-415a-ab4c-05ba20b57bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:48.468722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858c1a8-c3d9-415a-ab4c-05ba20b57bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:48.469086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858c1a8-c3d9-415a-ab4c-05ba20b57bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:48.490215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858c1a8-c3d9-415a-ab4c-05ba20b57bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:48.492057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858c1a8-c3d9-415a-ab4c-05ba20b57bd6 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:48.531391 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2431/4857] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:48.546847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd9bb7-2299-406f-bd64-b05cc314c6d8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:48.663356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd9bb7-2299-406f-bd64-b05cc314c6d8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:48.668840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:48.669377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:48.669665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:48.669946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] PATH_INFO: `/v3/users/add5eace1aa144558997d2f873edebf8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:48.671351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=add5eace1aa144558997d2f873edebf8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:48.673615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:48.743777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add5eace1aa144558997d2f873edebf8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:48.756818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add5eace1aa144558997d2f873edebf8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:48.757839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add5eace1aa144558997d2f873edebf8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:48.774358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add5eace1aa144558997d2f873edebf8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:48.779373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add5eace1aa144558997d2f873edebf8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:48.801125 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2427/4858] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:09:48 2022] DELETE /identity/v3/users/add5eace1aa144558997d2f873edebf8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:48.807057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256a6b-2647-4eb6-a47d-1af5e9627f75 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:48.807649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256a6b-2647-4eb6-a47d-1af5e9627f75 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:48.808117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48256a6b-2647-4eb6-a47d-1af5e9627f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:48.849106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-48256a6b-2647-4eb6-a47d-1af5e9627f75 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:48.854504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-48256a6b-2647-4eb6-a47d-1af5e9627f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:48.925421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:48.979300 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2432/4859] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:48.986908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:48.989985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:49.030235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:49.127220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cece428-868a-4b00-81d6-7181eeac75ce admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:49.132798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8631d31-a3d2-48c2-a098-6abddb51a68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:49.135099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8631d31-a3d2-48c2-a098-6abddb51a68e service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:49.135737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8631d31-a3d2-48c2-a098-6abddb51a68e service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:49.136221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8631d31-a3d2-48c2-a098-6abddb51a68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:49.148870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8631d31-a3d2-48c2-a098-6abddb51a68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:49.151191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8631d31-a3d2-48c2-a098-6abddb51a68e service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:49.164781 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2428/4860] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:49.571980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256a6b-2647-4eb6-a47d-1af5e9627f75 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:49.577548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-48256a6b-2647-4eb6-a47d-1af5e9627f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:49.605065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48256a6b-2647-4eb6-a47d-1af5e9627f75 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:49.624035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:49.626208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:49.626607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:49.627571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] PATH_INFO: `/v3/users/38b62750d1364679bd36474e3efaf2d4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:49.631697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b62750d1364679bd36474e3efaf2d4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:49.639291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:49.739135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b62750d1364679bd36474e3efaf2d4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:49.749427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b62750d1364679bd36474e3efaf2d4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:49.750868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b62750d1364679bd36474e3efaf2d4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:49.763792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b62750d1364679bd36474e3efaf2d4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:49.764675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b62750d1364679bd36474e3efaf2d4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:49.821374 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2433/4861] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:09:49 2022] DELETE /identity/v3/users/38b62750d1364679bd36474e3efaf2d4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:49.825708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0cad1-5923-4b1b-ab96-42e892bc9e8e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:49.826071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0cad1-5923-4b1b-ab96-42e892bc9e8e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:49.826549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0cad1-5923-4b1b-ab96-42e892bc9e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:49.882041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7da0cad1-5923-4b1b-ab96-42e892bc9e8e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:49.886846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:49.888331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:49.892151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7da0cad1-5923-4b1b-ab96-42e892bc9e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:50.024589 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2429/4862] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:50.042153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce423337-98f7-423f-8e26-0a766ab252df admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:50.047861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fa7c3-6492-403d-9549-9ba0d4347c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:50.049661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fa7c3-6492-403d-9549-9ba0d4347c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:50.050153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fa7c3-6492-403d-9549-9ba0d4347c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:50.051670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fa7c3-6492-403d-9549-9ba0d4347c68 admin admin] PATH_INFO: `/v3/projects/0f87687e5a254e758fb649192c3beb4c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:50.054033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fa7c3-6492-403d-9549-9ba0d4347c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f87687e5a254e758fb649192c3beb4c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:50.056884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fa7c3-6492-403d-9549-9ba0d4347c68 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:50.066212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0cad1-5923-4b1b-ab96-42e892bc9e8e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:50.067821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7da0cad1-5923-4b1b-ab96-42e892bc9e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:50.196459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-058fa7c3-6492-403d-9549-9ba0d4347c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f87687e5a254e758fb649192c3beb4c', 'request_id': 'req-058fa7c3-6492-403d-9549-9ba0d4347c68'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:50.233882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-058fa7c3-6492-403d-9549-9ba0d4347c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f87687e5a254e758fb649192c3beb4c', 'request_id': 'req-058fa7c3-6492-403d-9549-9ba0d4347c68'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:50.235681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:50.242299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0cad1-5923-4b1b-ab96-42e892bc9e8e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:50.252767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-058fa7c3-6492-403d-9549-9ba0d4347c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f87687e5a254e758fb649192c3beb4c', 'request_id': 'req-058fa7c3-6492-403d-9549-9ba0d4347c68'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:50.285931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-058fa7c3-6492-403d-9549-9ba0d4347c68 admin admin] The token cache is being invalidate because project 0f87687e5a254e758fb649192c3beb4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:50.286334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-058fa7c3-6492-403d-9549-9ba0d4347c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:50.288150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-058fa7c3-6492-403d-9549-9ba0d4347c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:50.293886 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2434/4863] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:49 2022] DELETE /identity/v3/projects/0f87687e5a254e758fb649192c3beb4c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:50.298946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0e83b-3aea-4a1d-8dec-0b890533fbbe None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:50.299729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0e83b-3aea-4a1d-8dec-0b890533fbbe None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:50.300296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0e83b-3aea-4a1d-8dec-0b890533fbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:50.341109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0244e0-b3f9-4734-9e10-27b6a2bcc51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:50.342462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0244e0-b3f9-4734-9e10-27b6a2bcc51a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:50.342818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0244e0-b3f9-4734-9e10-27b6a2bcc51a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:50.344940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-18c0e83b-3aea-4a1d-8dec-0b890533fbbe None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:50.348356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0244e0-b3f9-4734-9e10-27b6a2bcc51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:50.349345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-18c0e83b-3aea-4a1d-8dec-0b890533fbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:50.350480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-af0244e0-b3f9-4734-9e10-27b6a2bcc51a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:50.398203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:50.477971 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2435/4864] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:50.490885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e106b-e81a-4141-9ff7-6300bb4fd86c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:50.491304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e106b-e81a-4141-9ff7-6300bb4fd86c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:50.491665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e106b-e81a-4141-9ff7-6300bb4fd86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:50.493419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0244e0-b3f9-4734-9e10-27b6a2bcc51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:50.494486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0244e0-b3f9-4734-9e10-27b6a2bcc51a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:50.522128 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2430/4865] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:50.532286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1e3e106b-e81a-4141-9ff7-6300bb4fd86c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:50.533515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1e3e106b-e81a-4141-9ff7-6300bb4fd86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:50.542957 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2436/4866] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:50.547393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0244e0-b3f9-4734-9e10-27b6a2bcc51a service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:50.566617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0244e0-b3f9-4734-9e10-27b6a2bcc51a service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:50.575975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0cba5-a90f-46f1-96f8-45dbfe46523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:50.576587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0cba5-a90f-46f1-96f8-45dbfe46523d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:50.576876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0cba5-a90f-46f1-96f8-45dbfe46523d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:50.577151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0cba5-a90f-46f1-96f8-45dbfe46523d admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:50.577809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0cba5-a90f-46f1-96f8-45dbfe46523d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:09:50.578116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0cba5-a90f-46f1-96f8-45dbfe46523d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:50.585693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0cba5-a90f-46f1-96f8-45dbfe46523d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:50.607256 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2431/4867] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:09:50.612116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e106b-e81a-4141-9ff7-6300bb4fd86c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:50.625048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e106b-e81a-4141-9ff7-6300bb4fd86c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:50.637478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ac3b4-aac2-4acd-a2c8-9aa8017e6c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:50.638295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ac3b4-aac2-4acd-a2c8-9aa8017e6c94 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:50.640508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ac3b4-aac2-4acd-a2c8-9aa8017e6c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:50.640873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ac3b4-aac2-4acd-a2c8-9aa8017e6c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:50.642302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ac3b4-aac2-4acd-a2c8-9aa8017e6c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:50.649629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ac3b4-aac2-4acd-a2c8-9aa8017e6c94 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:50.686130 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2437/4868] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:50 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:50.699422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0cba5-a90f-46f1-96f8-45dbfe46523d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:50.712440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0cba5-a90f-46f1-96f8-45dbfe46523d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:50.831876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569354-3230-41d5-9f12-4b3aca60f701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:50.832868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569354-3230-41d5-9f12-4b3aca60f701 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:50.833282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569354-3230-41d5-9f12-4b3aca60f701 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:50.833655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569354-3230-41d5-9f12-4b3aca60f701 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:50.834610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee569354-3230-41d5-9f12-4b3aca60f701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:50.838302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee569354-3230-41d5-9f12-4b3aca60f701 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:50.867425 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2432/4869] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:50 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:50.871194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ac3b4-aac2-4acd-a2c8-9aa8017e6c94 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:50.887787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ac3b4-aac2-4acd-a2c8-9aa8017e6c94 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:50.899340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c780f9-afc7-4910-b6ee-55dc804255b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:50.899905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c780f9-afc7-4910-b6ee-55dc804255b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:50.900190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c780f9-afc7-4910-b6ee-55dc804255b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:50.900464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c780f9-afc7-4910-b6ee-55dc804255b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:50.901682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c780f9-afc7-4910-b6ee-55dc804255b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:50.903034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c780f9-afc7-4910-b6ee-55dc804255b6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:50.928347 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2438/4870] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:50.932745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569354-3230-41d5-9f12-4b3aca60f701 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:50.951258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569354-3230-41d5-9f12-4b3aca60f701 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:50.965954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f3be0-5477-4964-a5ae-a6cc6e2039bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:50.966802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f3be0-5477-4964-a5ae-a6cc6e2039bb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:50.967079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f3be0-5477-4964-a5ae-a6cc6e2039bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:50.967355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f3be0-5477-4964-a5ae-a6cc6e2039bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:50.968022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f3be0-5477-4964-a5ae-a6cc6e2039bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:50.971593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f3be0-5477-4964-a5ae-a6cc6e2039bb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:50.994267 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2433/4871] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:50.998412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c780f9-afc7-4910-b6ee-55dc804255b6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:51.020874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c780f9-afc7-4910-b6ee-55dc804255b6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:51.038193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716253f-a74f-42de-bcd5-6acef76c79c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:51.038953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716253f-a74f-42de-bcd5-6acef76c79c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:51.039214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716253f-a74f-42de-bcd5-6acef76c79c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:51.039735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716253f-a74f-42de-bcd5-6acef76c79c1 admin admin] PATH_INFO: `/v3/projects/8763193cebaf4b78acafca8436a5557c/users/439e7eefbeb547ee82f1011451137c8e/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:51.082099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716253f-a74f-42de-bcd5-6acef76c79c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8763193cebaf4b78acafca8436a5557c, user_id=439e7eefbeb547ee82f1011451137c8e, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:51.084876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716253f-a74f-42de-bcd5-6acef76c79c1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:51.108842 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2439/4872] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:50 2022] PUT /identity/v3/projects/8763193cebaf4b78acafca8436a5557c/users/439e7eefbeb547ee82f1011451137c8e/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:51.121568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1bda0-81a5-4793-8a79-c2c97751e2a4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:51.121568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1bda0-81a5-4793-8a79-c2c97751e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:51.121895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1bda0-81a5-4793-8a79-c2c97751e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:51.183104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-19a1bda0-81a5-4793-8a79-c2c97751e2a4 None None] MFA Rules not processed for user `439e7eefbeb547ee82f1011451137c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:51.184768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-19a1bda0-81a5-4793-8a79-c2c97751e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:51.201395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716253f-a74f-42de-bcd5-6acef76c79c1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:51.205522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c716253f-a74f-42de-bcd5-6acef76c79c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:51.337400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716253f-a74f-42de-bcd5-6acef76c79c1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:51.342559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293473a-cf44-4221-8c4e-e7a99c0e7703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:51.343244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293473a-cf44-4221-8c4e-e7a99c0e7703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:51.343526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293473a-cf44-4221-8c4e-e7a99c0e7703 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:51.343799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293473a-cf44-4221-8c4e-e7a99c0e7703 admin admin] PATH_INFO: `/v3/projects/a74f957e216142c9969d9b5c6d0de8e4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:51.346251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293473a-cf44-4221-8c4e-e7a99c0e7703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74f957e216142c9969d9b5c6d0de8e4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:51.349084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293473a-cf44-4221-8c4e-e7a99c0e7703 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:51.353615 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2434/4873] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:51.358672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1bda0-81a5-4793-8a79-c2c97751e2a4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:51.384332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:51.396050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1bda0-81a5-4793-8a79-c2c97751e2a4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:51.410650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71837082-9e45-4293-b54d-3053ed6faca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:51.411747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71837082-9e45-4293-b54d-3053ed6faca0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:51.412881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71837082-9e45-4293-b54d-3053ed6faca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:51.414887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71837082-9e45-4293-b54d-3053ed6faca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:51.415806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71837082-9e45-4293-b54d-3053ed6faca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:51.427234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71837082-9e45-4293-b54d-3053ed6faca0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:51.428347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a293473a-cf44-4221-8c4e-e7a99c0e7703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74f957e216142c9969d9b5c6d0de8e4', 'request_id': 'req-a293473a-cf44-4221-8c4e-e7a99c0e7703'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:51.445443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a293473a-cf44-4221-8c4e-e7a99c0e7703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74f957e216142c9969d9b5c6d0de8e4', 'request_id': 'req-a293473a-cf44-4221-8c4e-e7a99c0e7703'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:51.462078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:51.465856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a293473a-cf44-4221-8c4e-e7a99c0e7703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74f957e216142c9969d9b5c6d0de8e4', 'request_id': 'req-a293473a-cf44-4221-8c4e-e7a99c0e7703'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:51.512967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a293473a-cf44-4221-8c4e-e7a99c0e7703 admin admin] The token cache is being invalidate because project a74f957e216142c9969d9b5c6d0de8e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:09:51.518624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a293473a-cf44-4221-8c4e-e7a99c0e7703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:51.518624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a293473a-cf44-4221-8c4e-e7a99c0e7703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:09:51.521025 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2440/4874] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:09:51 2022] DELETE /identity/v3/projects/a74f957e216142c9969d9b5c6d0de8e4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:51.538876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6edf-6735-43ee-86c4-a6394199d74e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:51.539492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6edf-6735-43ee-86c4-a6394199d74e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:51.540427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6edf-6735-43ee-86c4-a6394199d74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:51.556219 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2435/4875] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:51 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:51.562168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71837082-9e45-4293-b54d-3053ed6faca0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:51.566218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-71837082-9e45-4293-b54d-3053ed6faca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:51.669276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-250d6edf-6735-43ee-86c4-a6394199d74e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:51.676350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-250d6edf-6735-43ee-86c4-a6394199d74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:51.737537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71837082-9e45-4293-b54d-3053ed6faca0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:51.758002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1ba07-8366-4a22-aa45-dcea9414bf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:51.759521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1ba07-8366-4a22-aa45-dcea9414bf03 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:51.759925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1ba07-8366-4a22-aa45-dcea9414bf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:51.761653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1ba07-8366-4a22-aa45-dcea9414bf03 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:51.762455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1ba07-8366-4a22-aa45-dcea9414bf03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:51.768789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1ba07-8366-4a22-aa45-dcea9414bf03 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:51.825282 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2436/4876] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:51 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:51.827313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1ba07-8366-4a22-aa45-dcea9414bf03 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:51.847003 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2441/4877] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:51.855530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7170e-99de-4019-ae95-8c89778f557c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:51.855994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7170e-99de-4019-ae95-8c89778f557c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:51.856442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7170e-99de-4019-ae95-8c89778f557c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:51.870159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1ba07-8366-4a22-aa45-dcea9414bf03 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:51.877729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66ac86-35d0-4e23-8a1b-b01e53053c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:51.878557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66ac86-35d0-4e23-8a1b-b01e53053c84 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:51.878982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66ac86-35d0-4e23-8a1b-b01e53053c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:51.880383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66ac86-35d0-4e23-8a1b-b01e53053c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:51.880383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66ac86-35d0-4e23-8a1b-b01e53053c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:51.881982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66ac86-35d0-4e23-8a1b-b01e53053c84 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:51.899060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fae7170e-99de-4019-ae95-8c89778f557c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:51.899614 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2437/4878] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:51.899745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fae7170e-99de-4019-ae95-8c89778f557c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:51.901069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66ac86-35d0-4e23-8a1b-b01e53053c84 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:51.910266 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2442/4879] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:51.914924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7170e-99de-4019-ae95-8c89778f557c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:51.923099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66ac86-35d0-4e23-8a1b-b01e53053c84 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:51.931472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750101b6-1d67-4cc8-b0c0-fed6dc6fde86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:51.931743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7170e-99de-4019-ae95-8c89778f557c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:51.933645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750101b6-1d67-4cc8-b0c0-fed6dc6fde86 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:51.934145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750101b6-1d67-4cc8-b0c0-fed6dc6fde86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:51.934608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750101b6-1d67-4cc8-b0c0-fed6dc6fde86 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:51.935536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750101b6-1d67-4cc8-b0c0-fed6dc6fde86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:51.937366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750101b6-1d67-4cc8-b0c0-fed6dc6fde86 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:51.938895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebbef0-43bc-4d96-8459-f72a30531229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:51.940226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebbef0-43bc-4d96-8459-f72a30531229 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:51.941372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebbef0-43bc-4d96-8459-f72a30531229 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:51.941816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebbef0-43bc-4d96-8459-f72a30531229 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:51.943405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebbef0-43bc-4d96-8459-f72a30531229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:09:51.944066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebbef0-43bc-4d96-8459-f72a30531229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:51.946396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebbef0-43bc-4d96-8459-f72a30531229 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:51.962549 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2438/4880] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:51.964169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750101b6-1d67-4cc8-b0c0-fed6dc6fde86 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:51.972071 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2443/4881] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:09:51.977706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebbef0-43bc-4d96-8459-f72a30531229 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:51.992904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750101b6-1d67-4cc8-b0c0-fed6dc6fde86 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:52.004467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebbef0-43bc-4d96-8459-f72a30531229 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:52.010497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c6ab7-19a4-45cd-a79e-c975bec55316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:52.011746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c6ab7-19a4-45cd-a79e-c975bec55316 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:52.012141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c6ab7-19a4-45cd-a79e-c975bec55316 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:52.013044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c6ab7-19a4-45cd-a79e-c975bec55316 admin admin] PATH_INFO: `/v3/projects/630311237e1c4562b04a6178baf0603c/users/d9a4b9c59cfa443bbc948e58fdf85665/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:52.021680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68304b65-5927-49b5-a8f3-7c5dbae471b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:52.021985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68304b65-5927-49b5-a8f3-7c5dbae471b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:52.024094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68304b65-5927-49b5-a8f3-7c5dbae471b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:52.024094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68304b65-5927-49b5-a8f3-7c5dbae471b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:52.025417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68304b65-5927-49b5-a8f3-7c5dbae471b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:52.046657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68304b65-5927-49b5-a8f3-7c5dbae471b4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:52.066258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c6ab7-19a4-45cd-a79e-c975bec55316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630311237e1c4562b04a6178baf0603c, user_id=d9a4b9c59cfa443bbc948e58fdf85665, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:52.074281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c6ab7-19a4-45cd-a79e-c975bec55316 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:52.115414 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2439/4882] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:51 2022] PUT /identity/v3/projects/630311237e1c4562b04a6178baf0603c/users/d9a4b9c59cfa443bbc948e58fdf85665/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:52.127514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce0d57-519b-4577-91d2-5e4a9456b3f4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:52.128180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce0d57-519b-4577-91d2-5e4a9456b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:52.128685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce0d57-519b-4577-91d2-5e4a9456b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:52.128835 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2444/4883] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:51 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:52.132813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68304b65-5927-49b5-a8f3-7c5dbae471b4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:52.174957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-08ce0d57-519b-4577-91d2-5e4a9456b3f4 None None] MFA Rules not processed for user `d9a4b9c59cfa443bbc948e58fdf85665`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:52.176807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-08ce0d57-519b-4577-91d2-5e4a9456b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:52.261442 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2440/4884] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:52.262901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce0d57-519b-4577-91d2-5e4a9456b3f4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:52.264823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68304b65-5927-49b5-a8f3-7c5dbae471b4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:52.274875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c1b03-0f9a-468b-b256-7ddfbfb40f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:52.275509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c1b03-0f9a-468b-b256-7ddfbfb40f0c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:52.276040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c1b03-0f9a-468b-b256-7ddfbfb40f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:52.276319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c1b03-0f9a-468b-b256-7ddfbfb40f0c admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:52.276964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c1b03-0f9a-468b-b256-7ddfbfb40f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:52.278188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce0d57-519b-4577-91d2-5e4a9456b3f4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:52.278941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c1b03-0f9a-468b-b256-7ddfbfb40f0c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:52.286587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a5d60-d109-45f6-b295-23275a4a28e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:52.287670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a5d60-d109-45f6-b295-23275a4a28e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:52.288337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a5d60-d109-45f6-b295-23275a4a28e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:52.290044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a5d60-d109-45f6-b295-23275a4a28e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:52.291938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a5d60-d109-45f6-b295-23275a4a28e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:52.294899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a5d60-d109-45f6-b295-23275a4a28e9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:52.328299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:52.336661 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2445/4885] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:52 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:09:52.338945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c1b03-0f9a-468b-b256-7ddfbfb40f0c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:52.362693 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2441/4886] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:52 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:52.367630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a5d60-d109-45f6-b295-23275a4a28e9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:52.368497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c1b03-0f9a-468b-b256-7ddfbfb40f0c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:52.395652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:52.537817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256a828-60d0-4920-af79-3bf021a0388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:52.539556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256a828-60d0-4920-af79-3bf021a0388f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:52.541488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256a828-60d0-4920-af79-3bf021a0388f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:52.541935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256a828-60d0-4920-af79-3bf021a0388f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:52.544090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256a828-60d0-4920-af79-3bf021a0388f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:52.549473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256a828-60d0-4920-af79-3bf021a0388f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:52.565458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a5d60-d109-45f6-b295-23275a4a28e9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:52.580619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b128a22-b6da-4f50-ad04-b657ec796b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:52.581132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128a22-b6da-4f50-ad04-b657ec796b2e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:52.581512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128a22-b6da-4f50-ad04-b657ec796b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:52.581688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b128a22-b6da-4f50-ad04-b657ec796b2e admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:52.582582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b128a22-b6da-4f50-ad04-b657ec796b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:52.584406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b128a22-b6da-4f50-ad04-b657ec796b2e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:52.585666 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2446/4887] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:52.587195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256a828-60d0-4920-af79-3bf021a0388f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:52.613699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256a828-60d0-4920-af79-3bf021a0388f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:52.629522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd017b99-165e-4191-85f6-9ebb3c73a6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:52.630865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd017b99-165e-4191-85f6-9ebb3c73a6bd admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:52.631347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd017b99-165e-4191-85f6-9ebb3c73a6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:52.631722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd017b99-165e-4191-85f6-9ebb3c73a6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:52.634973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd017b99-165e-4191-85f6-9ebb3c73a6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:52.635555 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2442/4888] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:52 2022] POST /identity/v3/users => generated 298 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:52.639726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b128a22-b6da-4f50-ad04-b657ec796b2e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:52.642216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd017b99-165e-4191-85f6-9ebb3c73a6bd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:52.662725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b128a22-b6da-4f50-ad04-b657ec796b2e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:52.679734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833a190-1f41-4f4d-9470-41db03c41e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:52.680378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833a190-1f41-4f4d-9470-41db03c41e03 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:52.680662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833a190-1f41-4f4d-9470-41db03c41e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:52.680938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833a190-1f41-4f4d-9470-41db03c41e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:52.681882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833a190-1f41-4f4d-9470-41db03c41e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:52.683020 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2447/4889] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:52.683761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833a190-1f41-4f4d-9470-41db03c41e03 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:52.687676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd017b99-165e-4191-85f6-9ebb3c73a6bd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:52.708546 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2443/4890] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:52.712317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833a190-1f41-4f4d-9470-41db03c41e03 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:52.713399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd017b99-165e-4191-85f6-9ebb3c73a6bd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:52.721944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba648a24-22f1-4e6d-b3e4-ea67c87d8f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:52.723869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648a24-22f1-4e6d-b3e4-ea67c87d8f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:52.724409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648a24-22f1-4e6d-b3e4-ea67c87d8f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:52.724918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba648a24-22f1-4e6d-b3e4-ea67c87d8f97 admin admin] PATH_INFO: `/v3/projects/59174bc5915b49e0869302ab08fe232e/users/81fd39cf24504ae6bb58db93231bce23/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:52.738604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833a190-1f41-4f4d-9470-41db03c41e03 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:52.744266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3dc37-366c-42d2-9fe8-685d85c1f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:52.745610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3dc37-366c-42d2-9fe8-685d85c1f59d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:52.746185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3dc37-366c-42d2-9fe8-685d85c1f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:52.747608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3dc37-366c-42d2-9fe8-685d85c1f59d admin admin] PATH_INFO: `/v3/projects/d48f6ee27239434787bf5890176f467c/users/aee241d38d8540a6b98e46ef60d76ee2/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:52.767373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba648a24-22f1-4e6d-b3e4-ea67c87d8f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59174bc5915b49e0869302ab08fe232e, user_id=81fd39cf24504ae6bb58db93231bce23, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:52.775563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3dc37-366c-42d2-9fe8-685d85c1f59d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48f6ee27239434787bf5890176f467c, user_id=aee241d38d8540a6b98e46ef60d76ee2, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:52.780117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3dc37-366c-42d2-9fe8-685d85c1f59d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:52.782676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba648a24-22f1-4e6d-b3e4-ea67c87d8f97 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:52.802892 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2444/4891] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:52 2022] PUT /identity/v3/projects/d48f6ee27239434787bf5890176f467c/users/aee241d38d8540a6b98e46ef60d76ee2/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:09:52.807659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3dc37-366c-42d2-9fe8-685d85c1f59d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:52.833271 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2448/4892] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:52 2022] PUT /identity/v3/projects/59174bc5915b49e0869302ab08fe232e/users/81fd39cf24504ae6bb58db93231bce23/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:52.837391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52deda7-c678-430a-aa2c-eea1a6b1c1e1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:52.837866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52deda7-c678-430a-aa2c-eea1a6b1c1e1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:52.838366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52deda7-c678-430a-aa2c-eea1a6b1c1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:52.935464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c52deda7-c678-430a-aa2c-eea1a6b1c1e1 None None] MFA Rules not processed for user `81fd39cf24504ae6bb58db93231bce23`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:52.938373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c52deda7-c678-430a-aa2c-eea1a6b1c1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:52.999342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3dc37-366c-42d2-9fe8-685d85c1f59d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:53.138575 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2449/4893] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:53.155113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52deda7-c678-430a-aa2c-eea1a6b1c1e1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:53.184042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e6b0f-fda1-4175-8c18-0dab0bf1045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:53.184592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e6b0f-fda1-4175-8c18-0dab0bf1045a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:53.185663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e6b0f-fda1-4175-8c18-0dab0bf1045a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:53.185663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e6b0f-fda1-4175-8c18-0dab0bf1045a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:53.185934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e6b0f-fda1-4175-8c18-0dab0bf1045a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:53.187436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e6b0f-fda1-4175-8c18-0dab0bf1045a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:53.224872 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2445/4894] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:53.234231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e6b0f-fda1-4175-8c18-0dab0bf1045a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:53.249676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:53.256035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e6b0f-fda1-4175-8c18-0dab0bf1045a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:53.288022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ae52-4e2b-4282-9f27-9e9c7566f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:53.288649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ae52-4e2b-4282-9f27-9e9c7566f327 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:53.288917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ae52-4e2b-4282-9f27-9e9c7566f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:53.289193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ae52-4e2b-4282-9f27-9e9c7566f327 admin admin] PATH_INFO: `/v3/projects/d48f6ee27239434787bf5890176f467c/users/aee241d38d8540a6b98e46ef60d76ee2/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:53.293450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2ae52-4e2b-4282-9f27-9e9c7566f327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48f6ee27239434787bf5890176f467c, user_id=aee241d38d8540a6b98e46ef60d76ee2, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:53.296275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2ae52-4e2b-4282-9f27-9e9c7566f327 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:53.316421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:53.327355 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2446/4895] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:53 2022] PUT /identity/v3/projects/d48f6ee27239434787bf5890176f467c/users/aee241d38d8540a6b98e46ef60d76ee2/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:53.336583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351d031-9663-4b73-adc0-5e5cc2581ca8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:53.336874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351d031-9663-4b73-adc0-5e5cc2581ca8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:53.337743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351d031-9663-4b73-adc0-5e5cc2581ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:53.355799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52deda7-c678-430a-aa2c-eea1a6b1c1e1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:53.416795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f351d031-9663-4b73-adc0-5e5cc2581ca8 None None] MFA Rules not processed for user `aee241d38d8540a6b98e46ef60d76ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:53.418071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f351d031-9663-4b73-adc0-5e5cc2581ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:53.540029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb83045-9cb0-4a67-809b-dc60021ebba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:53.541280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb83045-9cb0-4a67-809b-dc60021ebba3 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:53.541739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb83045-9cb0-4a67-809b-dc60021ebba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:53.542209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb83045-9cb0-4a67-809b-dc60021ebba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:53.544051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb83045-9cb0-4a67-809b-dc60021ebba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:53.551455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb83045-9cb0-4a67-809b-dc60021ebba3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:53.632285 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2447/4896] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:53.642623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351d031-9663-4b73-adc0-5e5cc2581ca8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:53.646884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f351d031-9663-4b73-adc0-5e5cc2581ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:53.680767 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2450/4897] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:09:53 2022] POST /identity/v3/projects => generated 381 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:53.682373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb83045-9cb0-4a67-809b-dc60021ebba3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:53.820717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351d031-9663-4b73-adc0-5e5cc2581ca8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:53.857181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb83045-9cb0-4a67-809b-dc60021ebba3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:53.875745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed32d5d-5d63-4494-9497-1d91468f7646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:53.878466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed32d5d-5d63-4494-9497-1d91468f7646 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:53.878794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed32d5d-5d63-4494-9497-1d91468f7646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:53.879065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed32d5d-5d63-4494-9497-1d91468f7646 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:53.879724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed32d5d-5d63-4494-9497-1d91468f7646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:53.888970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed32d5d-5d63-4494-9497-1d91468f7646 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:53.949801 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2451/4898] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:09:53 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:09:53.951731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed32d5d-5d63-4494-9497-1d91468f7646 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:53.992950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8378-2070-4a16-a4ac-1e92bdccfa35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:53.993904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8378-2070-4a16-a4ac-1e92bdccfa35 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:53.994374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8378-2070-4a16-a4ac-1e92bdccfa35 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:53.995388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed32d5d-5d63-4494-9497-1d91468f7646 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:53.996147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c8378-2070-4a16-a4ac-1e92bdccfa35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:54.004189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3f4c8378-2070-4a16-a4ac-1e92bdccfa35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:54.011342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115fdf9-925d-486c-bd59-5cabd2084b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:54.012402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115fdf9-925d-486c-bd59-5cabd2084b48 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:54.013647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115fdf9-925d-486c-bd59-5cabd2084b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:54.017256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115fdf9-925d-486c-bd59-5cabd2084b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:54.018246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115fdf9-925d-486c-bd59-5cabd2084b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:54.021337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115fdf9-925d-486c-bd59-5cabd2084b48 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:54.050495 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2452/4899] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:54.058542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115fdf9-925d-486c-bd59-5cabd2084b48 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:54.076317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115fdf9-925d-486c-bd59-5cabd2084b48 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:54.091332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6c31e-ac80-4157-8fda-7cee989bd452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:54.092105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6c31e-ac80-4157-8fda-7cee989bd452 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:54.092401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6c31e-ac80-4157-8fda-7cee989bd452 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:54.092677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6c31e-ac80-4157-8fda-7cee989bd452 admin admin] PATH_INFO: `/v3/projects/b2dc2855406f446da1e28b822189527b/users/c3c74bf8802e4f7c85bed08d80274e56/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:54.128874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:54.147561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6c31e-ac80-4157-8fda-7cee989bd452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2dc2855406f446da1e28b822189527b, user_id=c3c74bf8802e4f7c85bed08d80274e56, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:54.152582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6c31e-ac80-4157-8fda-7cee989bd452 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:54.207492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c8378-2070-4a16-a4ac-1e92bdccfa35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:54.210042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c8378-2070-4a16-a4ac-1e92bdccfa35 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:54.215094 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2453/4900] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:54 2022] PUT /identity/v3/projects/b2dc2855406f446da1e28b822189527b/users/c3c74bf8802e4f7c85bed08d80274e56/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:54.217622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6c31e-ac80-4157-8fda-7cee989bd452 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:54.228918 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2448/4901] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:54.325411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:54.372137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6c31e-ac80-4157-8fda-7cee989bd452 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:54.380838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538b6cb-f6a4-4bf2-8519-2622670e49cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:54.381610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538b6cb-f6a4-4bf2-8519-2622670e49cb admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:54.382016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538b6cb-f6a4-4bf2-8519-2622670e49cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:54.382697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538b6cb-f6a4-4bf2-8519-2622670e49cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:54.384527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538b6cb-f6a4-4bf2-8519-2622670e49cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:54.386788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538b6cb-f6a4-4bf2-8519-2622670e49cb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:54.407653 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2454/4902] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:09:54.411955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8378-2070-4a16-a4ac-1e92bdccfa35 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:54.433427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c8378-2070-4a16-a4ac-1e92bdccfa35 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:54.453994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27b92a-9b70-434f-bfd4-593a19529a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:54.456433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27b92a-9b70-434f-bfd4-593a19529a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:54.457566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27b92a-9b70-434f-bfd4-593a19529a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:54.459451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27b92a-9b70-434f-bfd4-593a19529a59 admin admin] PATH_INFO: `/v3/projects/b2dc2855406f446da1e28b822189527b/users/c3c74bf8802e4f7c85bed08d80274e56/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:54.465335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27b92a-9b70-434f-bfd4-593a19529a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2dc2855406f446da1e28b822189527b, user_id=c3c74bf8802e4f7c85bed08d80274e56, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:54.474217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27b92a-9b70-434f-bfd4-593a19529a59 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:54.516936 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2449/4903] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:09:54 2022] PUT /identity/v3/projects/b2dc2855406f446da1e28b822189527b/users/c3c74bf8802e4f7c85bed08d80274e56/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:09:54.522175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6481-a748-4e24-9eaf-ff98afcfa5dd None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:54.522572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6481-a748-4e24-9eaf-ff98afcfa5dd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:54.522890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6481-a748-4e24-9eaf-ff98afcfa5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:54.607889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-189e6481-a748-4e24-9eaf-ff98afcfa5dd None None] MFA Rules not processed for user `c3c74bf8802e4f7c85bed08d80274e56`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:09:54.609926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-189e6481-a748-4e24-9eaf-ff98afcfa5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:54.841416 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2455/4904] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:09:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:09:54.873786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27b92a-9b70-434f-bfd4-593a19529a59 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:55.025971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27b92a-9b70-434f-bfd4-593a19529a59 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:55.033229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edad7a-c32e-4bb6-8189-4ef611c31271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:55.034623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edad7a-c32e-4bb6-8189-4ef611c31271 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:55.035795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edad7a-c32e-4bb6-8189-4ef611c31271 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:55.035795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edad7a-c32e-4bb6-8189-4ef611c31271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:55.050523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edad7a-c32e-4bb6-8189-4ef611c31271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:55.056505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8edad7a-c32e-4bb6-8189-4ef611c31271 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:55.104484 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2450/4905] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:55.300544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e6481-a748-4e24-9eaf-ff98afcfa5dd None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:55.321811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e6481-a748-4e24-9eaf-ff98afcfa5dd None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:55.339640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46e3c-512e-4ad0-86fa-735ddc78a5a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:55.340430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46e3c-512e-4ad0-86fa-735ddc78a5a2 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:55.340739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46e3c-512e-4ad0-86fa-735ddc78a5a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:55.341003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46e3c-512e-4ad0-86fa-735ddc78a5a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:55.479570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea46e3c-512e-4ad0-86fa-735ddc78a5a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:55.481728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea46e3c-512e-4ad0-86fa-735ddc78a5a2 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:55.499786 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2456/4906] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:56.658593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edad7a-c32e-4bb6-8189-4ef611c31271 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:56.664907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c8edad7a-c32e-4bb6-8189-4ef611c31271 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:56.795799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edad7a-c32e-4bb6-8189-4ef611c31271 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:56.802500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07bcf3-ad29-4055-984e-a14764931daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:56.803754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07bcf3-ad29-4055-984e-a14764931daf service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:56.804400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07bcf3-ad29-4055-984e-a14764931daf service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:56.804922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07bcf3-ad29-4055-984e-a14764931daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:56.807502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3f07bcf3-ad29-4055-984e-a14764931daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:09:56.907500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07bcf3-ad29-4055-984e-a14764931daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:56.911053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07bcf3-ad29-4055-984e-a14764931daf service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:56.926831 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2451/4907] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:09:57.945707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46e3c-512e-4ad0-86fa-735ddc78a5a2 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:09:57.965757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46e3c-512e-4ad0-86fa-735ddc78a5a2 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:09:57.979517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b9755-6d91-477a-8638-adcd8928a673 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:09:57.980157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b9755-6d91-477a-8638-adcd8928a673 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:09:57.980501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b9755-6d91-477a-8638-adcd8928a673 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:09:57.980783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b9755-6d91-477a-8638-adcd8928a673 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:09:58.115796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:09:58.120694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b9755-6d91-477a-8638-adcd8928a673 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:09:58.123861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b9755-6d91-477a-8638-adcd8928a673 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:09:58.186920 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2457/4908] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:09:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:10:00.328003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07bcf3-ad29-4055-984e-a14764931daf service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:00.343908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07bcf3-ad29-4055-984e-a14764931daf service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:00.355738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012a046-1025-4d81-af12-8f77585b3f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:00.356757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012a046-1025-4d81-af12-8f77585b3f03 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:00.357304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012a046-1025-4d81-af12-8f77585b3f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:00.358370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012a046-1025-4d81-af12-8f77585b3f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:00.407714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:00.460070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012a046-1025-4d81-af12-8f77585b3f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:00.462641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012a046-1025-4d81-af12-8f77585b3f03 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:00.490637 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2452/4909] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:01.821634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b9755-6d91-477a-8638-adcd8928a673 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:01.834899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b9755-6d91-477a-8638-adcd8928a673 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:01.855378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1139e-9fc5-44a9-8561-33286836a516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:01.856059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1139e-9fc5-44a9-8561-33286836a516 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:01.856526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1139e-9fc5-44a9-8561-33286836a516 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:01.857232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1139e-9fc5-44a9-8561-33286836a516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:01.867476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0fe1139e-9fc5-44a9-8561-33286836a516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:02.069316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1139e-9fc5-44a9-8561-33286836a516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:02.071478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1139e-9fc5-44a9-8561-33286836a516 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:02.092813 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2458/4910] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:06.533766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012a046-1025-4d81-af12-8f77585b3f03 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:06.535886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2012a046-1025-4d81-af12-8f77585b3f03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:06.618593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012a046-1025-4d81-af12-8f77585b3f03 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:06.634699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deb863-80c1-46ae-ae7e-eae508b13321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:06.635705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deb863-80c1-46ae-ae7e-eae508b13321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:06.636498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deb863-80c1-46ae-ae7e-eae508b13321 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:06.637004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deb863-80c1-46ae-ae7e-eae508b13321 admin admin] PATH_INFO: `/v3/users/600512845bb7444b82f9fe99f1e51327` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:06.640573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9deb863-80c1-46ae-ae7e-eae508b13321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=600512845bb7444b82f9fe99f1e51327)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:06.646669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9deb863-80c1-46ae-ae7e-eae508b13321 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:06.786123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9deb863-80c1-46ae-ae7e-eae508b13321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600512845bb7444b82f9fe99f1e51327'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:06.817142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9deb863-80c1-46ae-ae7e-eae508b13321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600512845bb7444b82f9fe99f1e51327'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:06.818073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9deb863-80c1-46ae-ae7e-eae508b13321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600512845bb7444b82f9fe99f1e51327'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:06.867675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9deb863-80c1-46ae-ae7e-eae508b13321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600512845bb7444b82f9fe99f1e51327'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:06.872698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9deb863-80c1-46ae-ae7e-eae508b13321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600512845bb7444b82f9fe99f1e51327'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:06.912837 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2453/4911] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:06 2022] DELETE /identity/v3/users/600512845bb7444b82f9fe99f1e51327 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:08.209128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1139e-9fc5-44a9-8561-33286836a516 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:08.267941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1139e-9fc5-44a9-8561-33286836a516 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:08.464712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2938d-5b35-4cd2-a718-b031791c4659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:08.465271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2938d-5b35-4cd2-a718-b031791c4659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:08.465698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2938d-5b35-4cd2-a718-b031791c4659 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:08.466002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2938d-5b35-4cd2-a718-b031791c4659 admin admin] PATH_INFO: `/v3/projects/ea72dbd0993744c5a1af47926bb0877e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:08.467412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2938d-5b35-4cd2-a718-b031791c4659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea72dbd0993744c5a1af47926bb0877e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:08.499370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2938d-5b35-4cd2-a718-b031791c4659 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:08.629699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-21f2938d-5b35-4cd2-a718-b031791c4659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea72dbd0993744c5a1af47926bb0877e', 'request_id': 'req-21f2938d-5b35-4cd2-a718-b031791c4659'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:08.639847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-21f2938d-5b35-4cd2-a718-b031791c4659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea72dbd0993744c5a1af47926bb0877e', 'request_id': 'req-21f2938d-5b35-4cd2-a718-b031791c4659'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:08.651639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-21f2938d-5b35-4cd2-a718-b031791c4659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea72dbd0993744c5a1af47926bb0877e', 'request_id': 'req-21f2938d-5b35-4cd2-a718-b031791c4659'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:08.679241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-21f2938d-5b35-4cd2-a718-b031791c4659 admin admin] The token cache is being invalidate because project ea72dbd0993744c5a1af47926bb0877e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:08.679797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-21f2938d-5b35-4cd2-a718-b031791c4659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:08.682709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-21f2938d-5b35-4cd2-a718-b031791c4659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:08.689894 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2459/4912] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:08 2022] DELETE /identity/v3/projects/ea72dbd0993744c5a1af47926bb0877e => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:08.694927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debd1bb-7dee-4a64-96fe-075f25ab2f30 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:08.695445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debd1bb-7dee-4a64-96fe-075f25ab2f30 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:08.695545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debd1bb-7dee-4a64-96fe-075f25ab2f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:08.721209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4debd1bb-7dee-4a64-96fe-075f25ab2f30 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:08.722531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4debd1bb-7dee-4a64-96fe-075f25ab2f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:08.829505 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2454/4913] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:08.839542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea1bf7-9af8-4d63-b5fe-46ddda9a8df0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:08.840006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea1bf7-9af8-4d63-b5fe-46ddda9a8df0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:08.840452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea1bf7-9af8-4d63-b5fe-46ddda9a8df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:08.912417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fbea1bf7-9af8-4d63-b5fe-46ddda9a8df0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:08.916812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fbea1bf7-9af8-4d63-b5fe-46ddda9a8df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:08.944948 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2460/4914] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:08.949073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debd1bb-7dee-4a64-96fe-075f25ab2f30 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:08.990905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debd1bb-7dee-4a64-96fe-075f25ab2f30 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:09.007657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a70131-2513-4acf-b00f-0140e063d281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:09.008906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a70131-2513-4acf-b00f-0140e063d281 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:09.008906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a70131-2513-4acf-b00f-0140e063d281 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:09.008906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a70131-2513-4acf-b00f-0140e063d281 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:09.010945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a70131-2513-4acf-b00f-0140e063d281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:10:09.013511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a70131-2513-4acf-b00f-0140e063d281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:09.015376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a70131-2513-4acf-b00f-0140e063d281 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:09.029348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:09.036609 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2455/4915] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:10:09.051194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea1bf7-9af8-4d63-b5fe-46ddda9a8df0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:09.072120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea1bf7-9af8-4d63-b5fe-46ddda9a8df0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:09.087575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ff5c-9db1-4508-939b-beda3bb8599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:09.091294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ff5c-9db1-4508-939b-beda3bb8599a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:09.091976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ff5c-9db1-4508-939b-beda3bb8599a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:09.092677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ff5c-9db1-4508-939b-beda3bb8599a admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:09.102945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ff5c-9db1-4508-939b-beda3bb8599a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:09.105169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ff5c-9db1-4508-939b-beda3bb8599a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:09.149161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:09.187845 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2461/4916] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:10:09 2022] POST /identity/v3/projects => generated 399 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:09.193914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a70131-2513-4acf-b00f-0140e063d281 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:09.223570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a70131-2513-4acf-b00f-0140e063d281 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:09.360908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e7889-12cc-4d8c-939d-03a38fc749f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:09.361797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e7889-12cc-4d8c-939d-03a38fc749f0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:09.362299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e7889-12cc-4d8c-939d-03a38fc749f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:09.362454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e7889-12cc-4d8c-939d-03a38fc749f0 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:09.363001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e7889-12cc-4d8c-939d-03a38fc749f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:09.365122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e7889-12cc-4d8c-939d-03a38fc749f0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:09.422205 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2456/4917] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:10:09 2022] POST /identity/v3/users => generated 300 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:09.428480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ff5c-9db1-4508-939b-beda3bb8599a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:09.448472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ff5c-9db1-4508-939b-beda3bb8599a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:09.467635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b11b-d50b-4870-a67c-c701953d3cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:09.468273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b11b-d50b-4870-a67c-c701953d3cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:09.472086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b11b-d50b-4870-a67c-c701953d3cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:09.472543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b11b-d50b-4870-a67c-c701953d3cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:09.476269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951b11b-d50b-4870-a67c-c701953d3cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:09.488781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951b11b-d50b-4870-a67c-c701953d3cf2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:09.567097 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2462/4918] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:10:09.575270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e7889-12cc-4d8c-939d-03a38fc749f0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:09.592497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e7889-12cc-4d8c-939d-03a38fc749f0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:09.599309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9e510-6d77-4f52-beb1-88c3d5473f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:09.599781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9e510-6d77-4f52-beb1-88c3d5473f92 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:09.600137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9e510-6d77-4f52-beb1-88c3d5473f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:09.600500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9e510-6d77-4f52-beb1-88c3d5473f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:09.601325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9e510-6d77-4f52-beb1-88c3d5473f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:09.605197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9e510-6d77-4f52-beb1-88c3d5473f92 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:09.629047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b11b-d50b-4870-a67c-c701953d3cf2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:09.636009 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2457/4919] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:09.646452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b11b-d50b-4870-a67c-c701953d3cf2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:09.660665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5975eb3-d818-4413-8ed0-b19ed2c212bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:09.663501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5975eb3-d818-4413-8ed0-b19ed2c212bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:09.663902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5975eb3-d818-4413-8ed0-b19ed2c212bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:09.664332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5975eb3-d818-4413-8ed0-b19ed2c212bf admin admin] PATH_INFO: `/v3/projects/07866dd9afc4444887f34f4483858453/users/5c52e93e22e14a089145c179740c5c3a/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:09.752565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5975eb3-d818-4413-8ed0-b19ed2c212bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=07866dd9afc4444887f34f4483858453, user_id=5c52e93e22e14a089145c179740c5c3a, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:09.755656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5975eb3-d818-4413-8ed0-b19ed2c212bf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:09.836988 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2463/4920] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:10:09 2022] PUT /identity/v3/projects/07866dd9afc4444887f34f4483858453/users/5c52e93e22e14a089145c179740c5c3a/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:09.842276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6fef0-3840-475a-886e-16098a10d8df None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:09.842840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6fef0-3840-475a-886e-16098a10d8df None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:09.843183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6fef0-3840-475a-886e-16098a10d8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:09.905207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7fa6fef0-3840-475a-886e-16098a10d8df None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:09.912483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7fa6fef0-3840-475a-886e-16098a10d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:10.164402 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2458/4921] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:10.216290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5975eb3-d818-4413-8ed0-b19ed2c212bf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:10.218397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a5975eb3-d818-4413-8ed0-b19ed2c212bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:10.427511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5975eb3-d818-4413-8ed0-b19ed2c212bf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:10.437334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df97af-0eb5-4ceb-a953-524e2a0aa4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:10.439280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df97af-0eb5-4ceb-a953-524e2a0aa4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:10.439741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df97af-0eb5-4ceb-a953-524e2a0aa4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:10.440211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df97af-0eb5-4ceb-a953-524e2a0aa4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:10.470212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df97af-0eb5-4ceb-a953-524e2a0aa4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:10.472198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df97af-0eb5-4ceb-a953-524e2a0aa4f4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:10.495055 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2464/4922] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:13.289492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6fef0-3840-475a-886e-16098a10d8df None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:13.291947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7fa6fef0-3840-475a-886e-16098a10d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:13.345961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6fef0-3840-475a-886e-16098a10d8df None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:13.372342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b3718-c2a2-4e87-a609-30f180d6478a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:13.373568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b3718-c2a2-4e87-a609-30f180d6478a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:13.373568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b3718-c2a2-4e87-a609-30f180d6478a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:13.373772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b3718-c2a2-4e87-a609-30f180d6478a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:13.387696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c16b3718-c2a2-4e87-a609-30f180d6478a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:13.586760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b3718-c2a2-4e87-a609-30f180d6478a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:13.588246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b3718-c2a2-4e87-a609-30f180d6478a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:13.619242 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2459/4923] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:16.292549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea12883-a896-456d-ac01-5679f039745a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:16.293373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea12883-a896-456d-ac01-5679f039745a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:16.293985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea12883-a896-456d-ac01-5679f039745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:16.346676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5ea12883-a896-456d-ac01-5679f039745a None None] MFA Rules not processed for user `5d5833af8c0a4ca9a844905b5ea94665`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:16.349003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5ea12883-a896-456d-ac01-5679f039745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:16.559790 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2465/4924] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:17.540577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b3718-c2a2-4e87-a609-30f180d6478a service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:17.542068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c16b3718-c2a2-4e87-a609-30f180d6478a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:17.579022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b3718-c2a2-4e87-a609-30f180d6478a service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:17.586557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f6bd0-03cc-4a45-9a3f-8cce7b973cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:17.587902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f6bd0-03cc-4a45-9a3f-8cce7b973cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:17.588347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f6bd0-03cc-4a45-9a3f-8cce7b973cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:17.595438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f6bd0-03cc-4a45-9a3f-8cce7b973cb8 admin admin] PATH_INFO: `/v3/users/439e7eefbeb547ee82f1011451137c8e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:17.597740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f6bd0-03cc-4a45-9a3f-8cce7b973cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=439e7eefbeb547ee82f1011451137c8e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:17.600091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f6bd0-03cc-4a45-9a3f-8cce7b973cb8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:17.607427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea12883-a896-456d-ac01-5679f039745a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:17.610304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5ea12883-a896-456d-ac01-5679f039745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:17.648076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:17.649138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea12883-a896-456d-ac01-5679f039745a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:17.663459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd200a-18fa-40d6-9e40-ae0439eb4e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:17.665954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd200a-18fa-40d6-9e40-ae0439eb4e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:17.666254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd200a-18fa-40d6-9e40-ae0439eb4e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:17.666538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd200a-18fa-40d6-9e40-ae0439eb4e29 admin admin] PATH_INFO: `/v3/users/81fd39cf24504ae6bb58db93231bce23` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:17.670425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd200a-18fa-40d6-9e40-ae0439eb4e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81fd39cf24504ae6bb58db93231bce23)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:17.674843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd200a-18fa-40d6-9e40-ae0439eb4e29 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:17.814326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-18dd200a-18fa-40d6-9e40-ae0439eb4e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81fd39cf24504ae6bb58db93231bce23'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:17.826231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c85f6bd0-03cc-4a45-9a3f-8cce7b973cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439e7eefbeb547ee82f1011451137c8e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:17.840446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-18dd200a-18fa-40d6-9e40-ae0439eb4e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81fd39cf24504ae6bb58db93231bce23'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:17.841764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-18dd200a-18fa-40d6-9e40-ae0439eb4e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81fd39cf24504ae6bb58db93231bce23'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:17.862356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:17.878511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-18dd200a-18fa-40d6-9e40-ae0439eb4e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81fd39cf24504ae6bb58db93231bce23'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:17.880680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-18dd200a-18fa-40d6-9e40-ae0439eb4e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81fd39cf24504ae6bb58db93231bce23'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:17.888202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c85f6bd0-03cc-4a45-9a3f-8cce7b973cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439e7eefbeb547ee82f1011451137c8e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:17.892104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c85f6bd0-03cc-4a45-9a3f-8cce7b973cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439e7eefbeb547ee82f1011451137c8e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:17.912532 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2466/4925] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:17 2022] DELETE /identity/v3/users/81fd39cf24504ae6bb58db93231bce23 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:17.914408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf0ace-f4b2-4560-a190-c85c5bafb703 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:17.914704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf0ace-f4b2-4560-a190-c85c5bafb703 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:17.915740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf0ace-f4b2-4560-a190-c85c5bafb703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:17.952964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c85f6bd0-03cc-4a45-9a3f-8cce7b973cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439e7eefbeb547ee82f1011451137c8e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:17.956176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c85f6bd0-03cc-4a45-9a3f-8cce7b973cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439e7eefbeb547ee82f1011451137c8e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:17.958382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b0cf0ace-f4b2-4560-a190-c85c5bafb703 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:17.960291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b0cf0ace-f4b2-4560-a190-c85c5bafb703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:18.023078 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2460/4926] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:17 2022] DELETE /identity/v3/users/439e7eefbeb547ee82f1011451137c8e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:18.028612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691fa52-57dd-4e6e-a86d-153d3576d753 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:18.028914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691fa52-57dd-4e6e-a86d-153d3576d753 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:18.029200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691fa52-57dd-4e6e-a86d-153d3576d753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:18.066956 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2467/4927] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:18.101123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8691fa52-57dd-4e6e-a86d-153d3576d753 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:18.102393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8691fa52-57dd-4e6e-a86d-153d3576d753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:18.117426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf0ace-f4b2-4560-a190-c85c5bafb703 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:18.119312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b0cf0ace-f4b2-4560-a190-c85c5bafb703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:18.367643 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2461/4928] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:18.411958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf0ace-f4b2-4560-a190-c85c5bafb703 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:18.461547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691fa52-57dd-4e6e-a86d-153d3576d753 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:18.463100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8691fa52-57dd-4e6e-a86d-153d3576d753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:18.679917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7788d-5138-4757-a27b-0db7aadce3b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:18.681160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7788d-5138-4757-a27b-0db7aadce3b4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:18.681663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7788d-5138-4757-a27b-0db7aadce3b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:18.682137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7788d-5138-4757-a27b-0db7aadce3b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:18.747203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7788d-5138-4757-a27b-0db7aadce3b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:18.757460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7788d-5138-4757-a27b-0db7aadce3b4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:18.760355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691fa52-57dd-4e6e-a86d-153d3576d753 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:18.777175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d31ee-9858-4736-9c9b-92c24158d351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:18.777832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d31ee-9858-4736-9c9b-92c24158d351 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:18.778116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d31ee-9858-4736-9c9b-92c24158d351 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:18.778394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d31ee-9858-4736-9c9b-92c24158d351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:18.809208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d31ee-9858-4736-9c9b-92c24158d351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:18.814300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d31ee-9858-4736-9c9b-92c24158d351 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:18.814856 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2468/4929] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:10:18.866794 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2462/4930] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:10:20.044798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7788d-5138-4757-a27b-0db7aadce3b4 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:20.060471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7788d-5138-4757-a27b-0db7aadce3b4 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:20.068401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ae061-8c3c-4b2d-9ea4-b10b521b14ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:20.069038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ae061-8c3c-4b2d-9ea4-b10b521b14ed service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:20.069328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ae061-8c3c-4b2d-9ea4-b10b521b14ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:20.069609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ae061-8c3c-4b2d-9ea4-b10b521b14ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:20.075254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-093ae061-8c3c-4b2d-9ea4-b10b521b14ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:20.099723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ae061-8c3c-4b2d-9ea4-b10b521b14ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:20.104005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ae061-8c3c-4b2d-9ea4-b10b521b14ed service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:20.124667 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2469/4931] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:20.631688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d31ee-9858-4736-9c9b-92c24158d351 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:20.634874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-065d31ee-9858-4736-9c9b-92c24158d351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:20.664739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d31ee-9858-4736-9c9b-92c24158d351 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:20.684741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:20.685746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:20.686406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:20.687256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] PATH_INFO: `/v3/projects/59174bc5915b49e0869302ab08fe232e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:20.690371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59174bc5915b49e0869302ab08fe232e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:20.693934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:20.757472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:20.819819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59174bc5915b49e0869302ab08fe232e', 'request_id': 'req-01ab4b18-1f87-4b90-98c5-30cb23f10280'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:20.850293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59174bc5915b49e0869302ab08fe232e', 'request_id': 'req-01ab4b18-1f87-4b90-98c5-30cb23f10280'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:20.867078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59174bc5915b49e0869302ab08fe232e', 'request_id': 'req-01ab4b18-1f87-4b90-98c5-30cb23f10280'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:20.908034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] The token cache is being invalidate because project 59174bc5915b49e0869302ab08fe232e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:20.908387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:20.911705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:20.923600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ae061-8c3c-4b2d-9ea4-b10b521b14ed service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:20.924457 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2463/4932] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:20 2022] DELETE /identity/v3/projects/59174bc5915b49e0869302ab08fe232e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:20.941713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:20.961867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ae061-8c3c-4b2d-9ea4-b10b521b14ed service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:21.123513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:21.125573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:21.126057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:21.126557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] PATH_INFO: `/v3/users/c3c74bf8802e4f7c85bed08d80274e56` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:21.135790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c74bf8802e4f7c85bed08d80274e56)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:21.138470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:21.250360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c74bf8802e4f7c85bed08d80274e56'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:21.258155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c74bf8802e4f7c85bed08d80274e56'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:21.269483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c74bf8802e4f7c85bed08d80274e56'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:21.294260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c74bf8802e4f7c85bed08d80274e56'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:21.295063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c74bf8802e4f7c85bed08d80274e56'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:21.333399 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2470/4933] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:20 2022] DELETE /identity/v3/users/c3c74bf8802e4f7c85bed08d80274e56 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:10:21.773952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:21.775126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:21.801416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab4b18-1f87-4b90-98c5-30cb23f10280 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:22.088328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:22.089393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:22.091300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:22.093097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] PATH_INFO: `/v3/projects/8763193cebaf4b78acafca8436a5557c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:22.096018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] RBAC: Authorizing `identity:delete_project(project_id=8763193cebaf4b78acafca8436a5557c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:22.102412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:22.236898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8763193cebaf4b78acafca8436a5557c', 'request_id': 'req-dd0be156-ce61-4609-89fe-d2e55fa551be'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:22.270275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8763193cebaf4b78acafca8436a5557c', 'request_id': 'req-dd0be156-ce61-4609-89fe-d2e55fa551be'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:22.299617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8763193cebaf4b78acafca8436a5557c', 'request_id': 'req-dd0be156-ce61-4609-89fe-d2e55fa551be'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:22.334441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] The token cache is being invalidate because project 8763193cebaf4b78acafca8436a5557c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:22.334762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:22.341427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:22.344744 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2464/4934] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:21 2022] DELETE /identity/v3/projects/8763193cebaf4b78acafca8436a5557c => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:22.348893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:22.350690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:22.379482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40124f0-48d5-4f63-a266-67a174200648 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:22.487752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290e5f3-3355-4d56-9945-6d10f72de1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:22.490137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e5f3-3355-4d56-9945-6d10f72de1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:22.491763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e5f3-3355-4d56-9945-6d10f72de1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:22.492269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290e5f3-3355-4d56-9945-6d10f72de1e8 admin admin] PATH_INFO: `/v3/users/d9a4b9c59cfa443bbc948e58fdf85665` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:22.494661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290e5f3-3355-4d56-9945-6d10f72de1e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a4b9c59cfa443bbc948e58fdf85665)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:22.502722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290e5f3-3355-4d56-9945-6d10f72de1e8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:22.600072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:22.644448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4290e5f3-3355-4d56-9945-6d10f72de1e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a4b9c59cfa443bbc948e58fdf85665'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:22.666423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4290e5f3-3355-4d56-9945-6d10f72de1e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a4b9c59cfa443bbc948e58fdf85665'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:22.667366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4290e5f3-3355-4d56-9945-6d10f72de1e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a4b9c59cfa443bbc948e58fdf85665'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:22.691348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4290e5f3-3355-4d56-9945-6d10f72de1e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a4b9c59cfa443bbc948e58fdf85665'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:22.692246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4290e5f3-3355-4d56-9945-6d10f72de1e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a4b9c59cfa443bbc948e58fdf85665'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:22.735702 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2471/4935] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:22 2022] DELETE /identity/v3/users/d9a4b9c59cfa443bbc948e58fdf85665 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:23.728767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:23.730513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:23.759028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0be156-ce61-4609-89fe-d2e55fa551be admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:23.917952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:23.972535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db777079-24d9-48df-89ec-2e1b9dc833e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:23.974425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db777079-24d9-48df-89ec-2e1b9dc833e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:23.975477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db777079-24d9-48df-89ec-2e1b9dc833e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:23.975910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db777079-24d9-48df-89ec-2e1b9dc833e4 admin admin] PATH_INFO: `/v3/projects/b2dc2855406f446da1e28b822189527b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:23.980603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db777079-24d9-48df-89ec-2e1b9dc833e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2dc2855406f446da1e28b822189527b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:23.988365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db777079-24d9-48df-89ec-2e1b9dc833e4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:24.148924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db777079-24d9-48df-89ec-2e1b9dc833e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2dc2855406f446da1e28b822189527b', 'request_id': 'req-db777079-24d9-48df-89ec-2e1b9dc833e4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:24.169400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db777079-24d9-48df-89ec-2e1b9dc833e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2dc2855406f446da1e28b822189527b', 'request_id': 'req-db777079-24d9-48df-89ec-2e1b9dc833e4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:24.181636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db777079-24d9-48df-89ec-2e1b9dc833e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2dc2855406f446da1e28b822189527b', 'request_id': 'req-db777079-24d9-48df-89ec-2e1b9dc833e4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:24.226040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db777079-24d9-48df-89ec-2e1b9dc833e4 admin admin] The token cache is being invalidate because project b2dc2855406f446da1e28b822189527b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:24.227300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db777079-24d9-48df-89ec-2e1b9dc833e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:24.228937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db777079-24d9-48df-89ec-2e1b9dc833e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:24.234859 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2465/4936] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:23 2022] DELETE /identity/v3/projects/b2dc2855406f446da1e28b822189527b => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:24.240272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61131c9-35bf-49b2-a27f-b389a06fa9a2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:24.240796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61131c9-35bf-49b2-a27f-b389a06fa9a2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:24.241295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61131c9-35bf-49b2-a27f-b389a06fa9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:24.310085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c61131c9-35bf-49b2-a27f-b389a06fa9a2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:24.311861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c61131c9-35bf-49b2-a27f-b389a06fa9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:24.407644 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2472/4937] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:10:24.416701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aa4d3-b44f-41d9-9504-527d4c0a02e5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:24.417366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aa4d3-b44f-41d9-9504-527d4c0a02e5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:24.417840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722aa4d3-b44f-41d9-9504-527d4c0a02e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:24.495031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-722aa4d3-b44f-41d9-9504-527d4c0a02e5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:24.501125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-722aa4d3-b44f-41d9-9504-527d4c0a02e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:24.597079 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2466/4938] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:24.602396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61131c9-35bf-49b2-a27f-b389a06fa9a2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:24.626340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61131c9-35bf-49b2-a27f-b389a06fa9a2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:24.643424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cbfb6-3950-42f6-951f-f476ea469362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:24.644145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cbfb6-3950-42f6-951f-f476ea469362 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:24.644694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cbfb6-3950-42f6-951f-f476ea469362 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:24.644973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cbfb6-3950-42f6-951f-f476ea469362 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:24.648221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cbfb6-3950-42f6-951f-f476ea469362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:10:24.648383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cbfb6-3950-42f6-951f-f476ea469362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:24.669025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24cbfb6-3950-42f6-951f-f476ea469362 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:24.674027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aa4d3-b44f-41d9-9504-527d4c0a02e5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:24.676690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-722aa4d3-b44f-41d9-9504-527d4c0a02e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:24.751918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722aa4d3-b44f-41d9-9504-527d4c0a02e5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:24.768124 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2473/4939] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:10:24.769904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cbfb6-3950-42f6-951f-f476ea469362 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:24.771858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:24.772522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:24.772803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:24.773323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] PATH_INFO: `/v3/projects/630311237e1c4562b04a6178baf0603c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:24.774706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b24cbfb6-3950-42f6-951f-f476ea469362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:24.777387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630311237e1c4562b04a6178baf0603c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:24.783456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:24.900834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cbfb6-3950-42f6-951f-f476ea469362 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:24.963929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630311237e1c4562b04a6178baf0603c', 'request_id': 'req-e7492dc9-f201-45f6-8041-06c003fdb7c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:24.987822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630311237e1c4562b04a6178baf0603c', 'request_id': 'req-e7492dc9-f201-45f6-8041-06c003fdb7c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:24.996566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:24.998631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630311237e1c4562b04a6178baf0603c', 'request_id': 'req-e7492dc9-f201-45f6-8041-06c003fdb7c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:25.039657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] The token cache is being invalidate because project 630311237e1c4562b04a6178baf0603c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:25.043341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:25.043341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:25.056192 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2467/4940] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:24 2022] DELETE /identity/v3/projects/630311237e1c4562b04a6178baf0603c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:25.061199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:25.064996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:25.082373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da60690-a661-413a-b948-0c79a2fba12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:25.083817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60690-a661-413a-b948-0c79a2fba12b service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:25.084311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60690-a661-413a-b948-0c79a2fba12b service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:25.084833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60690-a661-413a-b948-0c79a2fba12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:25.091443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9da60690-a661-413a-b948-0c79a2fba12b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:25.267861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:25.330869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7492dc9-f201-45f6-8041-06c003fdb7c7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:25.353016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de166073-df7a-4051-acbc-6fd5b7edd58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:25.355389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de166073-df7a-4051-acbc-6fd5b7edd58d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:25.356977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de166073-df7a-4051-acbc-6fd5b7edd58d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:25.357503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de166073-df7a-4051-acbc-6fd5b7edd58d admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:25.364528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de166073-df7a-4051-acbc-6fd5b7edd58d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:25.373563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de166073-df7a-4051-acbc-6fd5b7edd58d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:25.414382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da60690-a661-413a-b948-0c79a2fba12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:25.423862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da60690-a661-413a-b948-0c79a2fba12b service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:25.471800 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2474/4941] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:25.475367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da60690-a661-413a-b948-0c79a2fba12b service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:25.482008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9da60690-a661-413a-b948-0c79a2fba12b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:25.486278 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2468/4942] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:10:25 2022] POST /identity/v3/projects => generated 383 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:25.492851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de166073-df7a-4051-acbc-6fd5b7edd58d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:25.539247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da60690-a661-413a-b948-0c79a2fba12b service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:25.658321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de166073-df7a-4051-acbc-6fd5b7edd58d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:25.664290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a832d42-5ca2-4b2a-bfb4-48052eae0316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:25.666888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a832d42-5ca2-4b2a-bfb4-48052eae0316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:25.667317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a832d42-5ca2-4b2a-bfb4-48052eae0316 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:25.668196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a832d42-5ca2-4b2a-bfb4-48052eae0316 admin admin] PATH_INFO: `/v3/users/aee241d38d8540a6b98e46ef60d76ee2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:25.669446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a832d42-5ca2-4b2a-bfb4-48052eae0316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee241d38d8540a6b98e46ef60d76ee2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:25.672641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a832d42-5ca2-4b2a-bfb4-48052eae0316 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:25.672778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850021e8-1748-4210-bd13-9e335027af05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:25.673455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850021e8-1748-4210-bd13-9e335027af05 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:25.673734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850021e8-1748-4210-bd13-9e335027af05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:25.674003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850021e8-1748-4210-bd13-9e335027af05 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:25.674645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850021e8-1748-4210-bd13-9e335027af05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:25.676629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850021e8-1748-4210-bd13-9e335027af05 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:25.765714 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2469/4943] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:10:25 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:25.768241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850021e8-1748-4210-bd13-9e335027af05 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:25.794418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a832d42-5ca2-4b2a-bfb4-48052eae0316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee241d38d8540a6b98e46ef60d76ee2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:25.802807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850021e8-1748-4210-bd13-9e335027af05 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:25.813361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a832d42-5ca2-4b2a-bfb4-48052eae0316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee241d38d8540a6b98e46ef60d76ee2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:25.815455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca439ac-2119-4a07-8b67-f7aa3b357774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:25.815918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a832d42-5ca2-4b2a-bfb4-48052eae0316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee241d38d8540a6b98e46ef60d76ee2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:25.818353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca439ac-2119-4a07-8b67-f7aa3b357774 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:25.818726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca439ac-2119-4a07-8b67-f7aa3b357774 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:25.819038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca439ac-2119-4a07-8b67-f7aa3b357774 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:25.819716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca439ac-2119-4a07-8b67-f7aa3b357774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:25.825480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca439ac-2119-4a07-8b67-f7aa3b357774 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:25.834532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a832d42-5ca2-4b2a-bfb4-48052eae0316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee241d38d8540a6b98e46ef60d76ee2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:25.835906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a832d42-5ca2-4b2a-bfb4-48052eae0316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee241d38d8540a6b98e46ef60d76ee2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:25.862436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2470/4944] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:25.863451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca439ac-2119-4a07-8b67-f7aa3b357774 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:25.868972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eca439ac-2119-4a07-8b67-f7aa3b357774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:25.884426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:25.892443 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2475/4945] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:25 2022] DELETE /identity/v3/users/aee241d38d8540a6b98e46ef60d76ee2 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:25.896027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca439ac-2119-4a07-8b67-f7aa3b357774 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:25.969320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfeb61-b8c3-426c-a21a-acbc0500d04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:25.969956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfeb61-b8c3-426c-a21a-acbc0500d04c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:25.970241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfeb61-b8c3-426c-a21a-acbc0500d04c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:25.970519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfeb61-b8c3-426c-a21a-acbc0500d04c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:25.971214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfeb61-b8c3-426c-a21a-acbc0500d04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:25.972873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfeb61-b8c3-426c-a21a-acbc0500d04c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:25.989589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a832d42-5ca2-4b2a-bfb4-48052eae0316 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:25.994997 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2471/4946] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:26.006701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a832d42-5ca2-4b2a-bfb4-48052eae0316 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:26.021311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7798cc8-1c60-4a24-9402-04a4d2c046a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:26.021974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7798cc8-1c60-4a24-9402-04a4d2c046a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:26.022329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7798cc8-1c60-4a24-9402-04a4d2c046a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:26.022659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7798cc8-1c60-4a24-9402-04a4d2c046a9 admin admin] PATH_INFO: `/v3/projects/d86c269921fd400da6f52ab43b9a80a9/users/21f979282d544fa9b98e18a8fa7043c6/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:26.085039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7798cc8-1c60-4a24-9402-04a4d2c046a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86c269921fd400da6f52ab43b9a80a9, user_id=21f979282d544fa9b98e18a8fa7043c6, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:26.092520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7798cc8-1c60-4a24-9402-04a4d2c046a9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:26.165564 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2476/4947] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:10:25 2022] PUT /identity/v3/projects/d86c269921fd400da6f52ab43b9a80a9/users/21f979282d544fa9b98e18a8fa7043c6/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:10:26.176767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1628d-c783-48e1-bd25-c1752e0bead9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:26.177544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1628d-c783-48e1-bd25-c1752e0bead9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:26.178420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1628d-c783-48e1-bd25-c1752e0bead9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:26.272334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b1c1628d-c783-48e1-bd25-c1752e0bead9 None None] MFA Rules not processed for user `21f979282d544fa9b98e18a8fa7043c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:26.273746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b1c1628d-c783-48e1-bd25-c1752e0bead9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:26.414625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:26.456809 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2472/4948] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:26.464113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7798cc8-1c60-4a24-9402-04a4d2c046a9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:26.617786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7798cc8-1c60-4a24-9402-04a4d2c046a9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:26.627929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313339a7-ef37-473c-96c7-7ebaf1183e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:26.628575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313339a7-ef37-473c-96c7-7ebaf1183e7d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:26.628867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313339a7-ef37-473c-96c7-7ebaf1183e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:26.629148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313339a7-ef37-473c-96c7-7ebaf1183e7d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:26.629804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313339a7-ef37-473c-96c7-7ebaf1183e7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:26.632106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313339a7-ef37-473c-96c7-7ebaf1183e7d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:26.690787 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2477/4949] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:10:26 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:26.694900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1628d-c783-48e1-bd25-c1752e0bead9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:26.717140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1628d-c783-48e1-bd25-c1752e0bead9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:26.955634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7838822-f64c-40c2-9d46-f1f0eeb3e480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:26.956693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7838822-f64c-40c2-9d46-f1f0eeb3e480 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:26.957181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7838822-f64c-40c2-9d46-f1f0eeb3e480 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:26.957701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7838822-f64c-40c2-9d46-f1f0eeb3e480 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:26.959410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7838822-f64c-40c2-9d46-f1f0eeb3e480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:26.962931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7838822-f64c-40c2-9d46-f1f0eeb3e480 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:27.025893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313339a7-ef37-473c-96c7-7ebaf1183e7d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:27.029314 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2473/4950] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:10:26 2022] POST /identity/v3/users => generated 299 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:27.050387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313339a7-ef37-473c-96c7-7ebaf1183e7d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:27.060566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecdffe-b6bb-432f-a0b9-cdd3a7ea2588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:27.061594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecdffe-b6bb-432f-a0b9-cdd3a7ea2588 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:27.062664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecdffe-b6bb-432f-a0b9-cdd3a7ea2588 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:27.063256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecdffe-b6bb-432f-a0b9-cdd3a7ea2588 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:27.064533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecdffe-b6bb-432f-a0b9-cdd3a7ea2588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:27.068638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecdffe-b6bb-432f-a0b9-cdd3a7ea2588 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:27.099594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7838822-f64c-40c2-9d46-f1f0eeb3e480 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:27.108078 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2478/4951] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:27.126499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7838822-f64c-40c2-9d46-f1f0eeb3e480 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:27.146211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9bbab-da88-43b0-a3db-65d42665efc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:27.147277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9bbab-da88-43b0-a3db-65d42665efc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:27.147691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9bbab-da88-43b0-a3db-65d42665efc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:27.148174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9bbab-da88-43b0-a3db-65d42665efc7 admin admin] PATH_INFO: `/v3/projects/d515007baf57453c8ae96104f50900a2/users/893dc43bdd3d4c23928e7f304a8fdd63/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:27.193815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9bbab-da88-43b0-a3db-65d42665efc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d515007baf57453c8ae96104f50900a2, user_id=893dc43bdd3d4c23928e7f304a8fdd63, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:27.197003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9bbab-da88-43b0-a3db-65d42665efc7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:27.228740 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2474/4952] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:10:27 2022] PUT /identity/v3/projects/d515007baf57453c8ae96104f50900a2/users/893dc43bdd3d4c23928e7f304a8fdd63/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:27.232996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecdffe-b6bb-432f-a0b9-cdd3a7ea2588 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:27.249544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecdffe-b6bb-432f-a0b9-cdd3a7ea2588 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:27.416623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e999ef-37ad-4fa5-9633-b1039de891bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:27.417202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e999ef-37ad-4fa5-9633-b1039de891bc admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:27.417644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e999ef-37ad-4fa5-9633-b1039de891bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:27.417927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e999ef-37ad-4fa5-9633-b1039de891bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:27.418601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e999ef-37ad-4fa5-9633-b1039de891bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:27.420329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e999ef-37ad-4fa5-9633-b1039de891bc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:27.441917 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2479/4953] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:27.446201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9bbab-da88-43b0-a3db-65d42665efc7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:27.470563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9bbab-da88-43b0-a3db-65d42665efc7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:27.486346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230606e5-874e-4fac-837c-9f826d74c990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:27.487184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230606e5-874e-4fac-837c-9f826d74c990 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:27.488225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230606e5-874e-4fac-837c-9f826d74c990 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:27.492260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230606e5-874e-4fac-837c-9f826d74c990 admin admin] PATH_INFO: `/v3/projects/d515007baf57453c8ae96104f50900a2/users/893dc43bdd3d4c23928e7f304a8fdd63/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:27.496696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230606e5-874e-4fac-837c-9f826d74c990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d515007baf57453c8ae96104f50900a2, user_id=893dc43bdd3d4c23928e7f304a8fdd63, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:27.503785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230606e5-874e-4fac-837c-9f826d74c990 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:27.518862 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2475/4954] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:10:27 2022] PUT /identity/v3/projects/d515007baf57453c8ae96104f50900a2/users/893dc43bdd3d4c23928e7f304a8fdd63/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:27.523661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d81c1-412b-41a6-8e63-d87d7687aa09 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:27.524635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d81c1-412b-41a6-8e63-d87d7687aa09 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:27.525062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d81c1-412b-41a6-8e63-d87d7687aa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:27.596089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cd6d81c1-412b-41a6-8e63-d87d7687aa09 None None] MFA Rules not processed for user `893dc43bdd3d4c23928e7f304a8fdd63`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:27.597386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cd6d81c1-412b-41a6-8e63-d87d7687aa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:27.666080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:27.750500 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2480/4955] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:10:27.758043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230606e5-874e-4fac-837c-9f826d74c990 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:27.759975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-230606e5-874e-4fac-837c-9f826d74c990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:27.837043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230606e5-874e-4fac-837c-9f826d74c990 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:27.842594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99680370-4539-48a5-9f01-f0ca37a67c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:27.843610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99680370-4539-48a5-9f01-f0ca37a67c25 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:27.844060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99680370-4539-48a5-9f01-f0ca37a67c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:27.844486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99680370-4539-48a5-9f01-f0ca37a67c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:27.856770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99680370-4539-48a5-9f01-f0ca37a67c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:27.858667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99680370-4539-48a5-9f01-f0ca37a67c25 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:27.873516 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2476/4956] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:28.056941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d81c1-412b-41a6-8e63-d87d7687aa09 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:28.172275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d81c1-412b-41a6-8e63-d87d7687aa09 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:28.181485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:28.182329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:28.184347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:28.184721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] PATH_INFO: `/v3/users/21f979282d544fa9b98e18a8fa7043c6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:28.187791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f979282d544fa9b98e18a8fa7043c6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:28.192975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:28.290842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f979282d544fa9b98e18a8fa7043c6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:28.301468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f979282d544fa9b98e18a8fa7043c6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:28.302109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f979282d544fa9b98e18a8fa7043c6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:28.327935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f979282d544fa9b98e18a8fa7043c6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:28.329152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f979282d544fa9b98e18a8fa7043c6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:28.377275 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2481/4957] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:28 2022] DELETE /identity/v3/users/21f979282d544fa9b98e18a8fa7043c6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:28.382917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eda55-5cea-46ce-99ea-54ebc5206aba None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:28.383345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eda55-5cea-46ce-99ea-54ebc5206aba None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:28.383415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eda55-5cea-46ce-99ea-54ebc5206aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:28.428374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ab2eda55-5cea-46ce-99ea-54ebc5206aba None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:28.429851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ab2eda55-5cea-46ce-99ea-54ebc5206aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:28.548697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:28.639399 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2477/4958] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:28.658716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:28.660612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:28.777434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68ba30-791a-4e52-bde3-9b30349edadb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:28.782413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ecc40-faf4-4083-9268-84a3f63fb936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:28.783414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ecc40-faf4-4083-9268-84a3f63fb936 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:28.783702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ecc40-faf4-4083-9268-84a3f63fb936 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:28.783981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ecc40-faf4-4083-9268-84a3f63fb936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:28.791085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:28.800858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ecc40-faf4-4083-9268-84a3f63fb936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:28.804942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ecc40-faf4-4083-9268-84a3f63fb936 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:28.824560 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2482/4959] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:29.621478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eda55-5cea-46ce-99ea-54ebc5206aba None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:29.623633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ab2eda55-5cea-46ce-99ea-54ebc5206aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:29.650159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eda55-5cea-46ce-99ea-54ebc5206aba None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:29.668772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:29.669542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:29.669831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:29.670107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] PATH_INFO: `/v3/projects/d86c269921fd400da6f52ab43b9a80a9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:29.671322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d86c269921fd400da6f52ab43b9a80a9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:29.673323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:29.759760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ecc40-faf4-4083-9268-84a3f63fb936 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:29.762463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-718ecc40-faf4-4083-9268-84a3f63fb936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:29.784806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ecc40-faf4-4083-9268-84a3f63fb936 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:29.793565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd86c269921fd400da6f52ab43b9a80a9', 'request_id': 'req-b634e863-0f0c-421e-b227-c296fb678b5c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:29.811585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd86c269921fd400da6f52ab43b9a80a9', 'request_id': 'req-b634e863-0f0c-421e-b227-c296fb678b5c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:29.832782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd86c269921fd400da6f52ab43b9a80a9', 'request_id': 'req-b634e863-0f0c-421e-b227-c296fb678b5c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:29.889725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] The token cache is being invalidate because project d86c269921fd400da6f52ab43b9a80a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:29.890684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:29.898939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:29.904725 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2478/4960] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:29 2022] DELETE /identity/v3/projects/d86c269921fd400da6f52ab43b9a80a9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:29.912499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:29.920267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:30.048336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cb9a8-8a5d-496c-9356-1194ce44669d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:30.049277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cb9a8-8a5d-496c-9356-1194ce44669d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:30.049700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cb9a8-8a5d-496c-9356-1194ce44669d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:30.050112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cb9a8-8a5d-496c-9356-1194ce44669d admin admin] PATH_INFO: `/v3/projects/d48f6ee27239434787bf5890176f467c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:30.052061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cb9a8-8a5d-496c-9356-1194ce44669d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d48f6ee27239434787bf5890176f467c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:30.060701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cb9a8-8a5d-496c-9356-1194ce44669d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:30.248737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e863-0f0c-421e-b227-c296fb678b5c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:30.262921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a12cb9a8-8a5d-496c-9356-1194ce44669d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd48f6ee27239434787bf5890176f467c', 'request_id': 'req-a12cb9a8-8a5d-496c-9356-1194ce44669d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:30.276506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a12cb9a8-8a5d-496c-9356-1194ce44669d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd48f6ee27239434787bf5890176f467c', 'request_id': 'req-a12cb9a8-8a5d-496c-9356-1194ce44669d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:30.296007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a12cb9a8-8a5d-496c-9356-1194ce44669d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd48f6ee27239434787bf5890176f467c', 'request_id': 'req-a12cb9a8-8a5d-496c-9356-1194ce44669d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:30.320146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a12cb9a8-8a5d-496c-9356-1194ce44669d admin admin] The token cache is being invalidate because project d48f6ee27239434787bf5890176f467c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:30.320461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a12cb9a8-8a5d-496c-9356-1194ce44669d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:30.321156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a12cb9a8-8a5d-496c-9356-1194ce44669d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:30.323102 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2483/4961] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:29 2022] DELETE /identity/v3/projects/d48f6ee27239434787bf5890176f467c => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:30.329059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e07fb-f8ff-4e4d-a01f-a27546220884 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:30.329268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e07fb-f8ff-4e4d-a01f-a27546220884 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:30.329516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e07fb-f8ff-4e4d-a01f-a27546220884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:30.373815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-661e07fb-f8ff-4e4d-a01f-a27546220884 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:30.375132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-661e07fb-f8ff-4e4d-a01f-a27546220884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:30.415519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:30.416184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:30.416931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:30.417220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] PATH_INFO: `/v3/users/893dc43bdd3d4c23928e7f304a8fdd63` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:30.419957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=893dc43bdd3d4c23928e7f304a8fdd63)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:30.426231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:30.474656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:30.520779 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2484/4962] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:30.528452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fffb51-0c0f-4f9f-8f6e-c34d9b97e09d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:30.528909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fffb51-0c0f-4f9f-8f6e-c34d9b97e09d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:30.529196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fffb51-0c0f-4f9f-8f6e-c34d9b97e09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:30.565728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-61fffb51-0c0f-4f9f-8f6e-c34d9b97e09d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:30.568996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-61fffb51-0c0f-4f9f-8f6e-c34d9b97e09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:30.593242 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2485/4963] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:10:30.597136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fffb51-0c0f-4f9f-8f6e-c34d9b97e09d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:30.628093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fffb51-0c0f-4f9f-8f6e-c34d9b97e09d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:30.644287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a1005-8582-4678-84e5-b91dffa93d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:30.645053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a1005-8582-4678-84e5-b91dffa93d36 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:30.649225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a1005-8582-4678-84e5-b91dffa93d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:30.649673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a1005-8582-4678-84e5-b91dffa93d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:30.650935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a1005-8582-4678-84e5-b91dffa93d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:10:30.651351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a1005-8582-4678-84e5-b91dffa93d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:30.654685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893dc43bdd3d4c23928e7f304a8fdd63'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:30.655379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a1005-8582-4678-84e5-b91dffa93d36 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:30.669988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893dc43bdd3d4c23928e7f304a8fdd63'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:30.671063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893dc43bdd3d4c23928e7f304a8fdd63'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:30.690545 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2486/4964] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:10:30.694717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a1005-8582-4678-84e5-b91dffa93d36 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:30.696087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893dc43bdd3d4c23928e7f304a8fdd63'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:30.697323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893dc43bdd3d4c23928e7f304a8fdd63'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:30.709971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:30.717757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a1005-8582-4678-84e5-b91dffa93d36 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:30.726446 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2479/4965] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:29 2022] DELETE /identity/v3/users/893dc43bdd3d4c23928e7f304a8fdd63 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:30.737974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e6bc9-e49e-47ea-acae-748abd7ff5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:30.738798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e6bc9-e49e-47ea-acae-748abd7ff5ec admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:30.739328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e6bc9-e49e-47ea-acae-748abd7ff5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:30.739632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e6bc9-e49e-47ea-acae-748abd7ff5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:30.742123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e6bc9-e49e-47ea-acae-748abd7ff5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:30.745067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e6bc9-e49e-47ea-acae-748abd7ff5ec admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:30.789691 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2487/4966] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:10:30 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:30.793680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:30.795319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:30.986846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04ce15-48fd-41cf-8461-c612a5507bf1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:31.118483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560ee78-fa51-442a-962d-ce45cf5432db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:31.119315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560ee78-fa51-442a-962d-ce45cf5432db admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:31.119598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560ee78-fa51-442a-962d-ce45cf5432db admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:31.119878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560ee78-fa51-442a-962d-ce45cf5432db admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:31.120654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560ee78-fa51-442a-962d-ce45cf5432db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:31.122661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560ee78-fa51-442a-962d-ce45cf5432db admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:31.169949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e6bc9-e49e-47ea-acae-748abd7ff5ec admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:31.180069 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2480/4967] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:10:30 2022] POST /identity/v3/users => generated 290 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:31.183788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e6bc9-e49e-47ea-acae-748abd7ff5ec admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:31.190692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0b39b-a378-41e2-9bba-247dfdbd4de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:31.191454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0b39b-a378-41e2-9bba-247dfdbd4de7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:31.191785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0b39b-a378-41e2-9bba-247dfdbd4de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:31.192246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0b39b-a378-41e2-9bba-247dfdbd4de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:31.193102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0b39b-a378-41e2-9bba-247dfdbd4de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:31.195311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0b39b-a378-41e2-9bba-247dfdbd4de7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:31.213710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560ee78-fa51-442a-962d-ce45cf5432db admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:31.224154 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2488/4968] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:31.227068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560ee78-fa51-442a-962d-ce45cf5432db admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:31.233334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34c680-2cbb-41f0-85de-80b2183907ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:31.234466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c680-2cbb-41f0-85de-80b2183907ee admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:31.235156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c680-2cbb-41f0-85de-80b2183907ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:31.235742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c680-2cbb-41f0-85de-80b2183907ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:31.236571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34c680-2cbb-41f0-85de-80b2183907ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:31.252233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34c680-2cbb-41f0-85de-80b2183907ee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:31.287895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0b39b-a378-41e2-9bba-247dfdbd4de7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:31.304149 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2481/4969] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:10:31.313743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0b39b-a378-41e2-9bba-247dfdbd4de7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:31.325565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4147bc-f97f-4fd2-af26-2dc1b0111b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:31.326230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4147bc-f97f-4fd2-af26-2dc1b0111b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:31.326518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4147bc-f97f-4fd2-af26-2dc1b0111b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:31.326831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4147bc-f97f-4fd2-af26-2dc1b0111b04 admin admin] PATH_INFO: `/v3/projects/12a12105dd6c4b28b7566c889b325605/users/940de3bdb29e498ba1d1d5185ecda577/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:31.351875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4147bc-f97f-4fd2-af26-2dc1b0111b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a12105dd6c4b28b7566c889b325605, user_id=940de3bdb29e498ba1d1d5185ecda577, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:31.355449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4147bc-f97f-4fd2-af26-2dc1b0111b04 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:31.398577 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2489/4970] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:10:31 2022] PUT /identity/v3/projects/12a12105dd6c4b28b7566c889b325605/users/940de3bdb29e498ba1d1d5185ecda577/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:10:31.527641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ee589-45f1-4a0b-b920-78158ba49bae None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:31.527641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ee589-45f1-4a0b-b920-78158ba49bae None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:31.527641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ee589-45f1-4a0b-b920-78158ba49bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:31.626671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:31.631972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-846ee589-45f1-4a0b-b920-78158ba49bae None None] MFA Rules not processed for user `940de3bdb29e498ba1d1d5185ecda577`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:31.633960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-846ee589-45f1-4a0b-b920-78158ba49bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:31.761347 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2482/4971] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:31.774466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4147bc-f97f-4fd2-af26-2dc1b0111b04 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:31.777017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ab4147bc-f97f-4fd2-af26-2dc1b0111b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:31.898574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4147bc-f97f-4fd2-af26-2dc1b0111b04 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:31.932900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08969d32-b9f4-4125-b8dc-6a259943d6f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:31.933752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08969d32-b9f4-4125-b8dc-6a259943d6f1 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:31.936210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08969d32-b9f4-4125-b8dc-6a259943d6f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:31.940393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08969d32-b9f4-4125-b8dc-6a259943d6f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:31.997463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08969d32-b9f4-4125-b8dc-6a259943d6f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:31.998987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08969d32-b9f4-4125-b8dc-6a259943d6f1 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:32.058390 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2490/4972] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:33.412871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ee589-45f1-4a0b-b920-78158ba49bae None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:33.414655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-846ee589-45f1-4a0b-b920-78158ba49bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:33.511224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ee589-45f1-4a0b-b920-78158ba49bae None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:33.518868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd772a8-eb53-4773-90ca-8763dd10cfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:33.519753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd772a8-eb53-4773-90ca-8763dd10cfe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:33.520168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd772a8-eb53-4773-90ca-8763dd10cfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:33.520454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd772a8-eb53-4773-90ca-8763dd10cfe0 admin admin] PATH_INFO: `/v3/projects/d515007baf57453c8ae96104f50900a2` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:33.522392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd772a8-eb53-4773-90ca-8763dd10cfe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d515007baf57453c8ae96104f50900a2)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:33.528270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd772a8-eb53-4773-90ca-8763dd10cfe0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:33.626415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8dd772a8-eb53-4773-90ca-8763dd10cfe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd515007baf57453c8ae96104f50900a2', 'request_id': 'req-8dd772a8-eb53-4773-90ca-8763dd10cfe0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:33.637885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8dd772a8-eb53-4773-90ca-8763dd10cfe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd515007baf57453c8ae96104f50900a2', 'request_id': 'req-8dd772a8-eb53-4773-90ca-8763dd10cfe0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:33.655442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8dd772a8-eb53-4773-90ca-8763dd10cfe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd515007baf57453c8ae96104f50900a2', 'request_id': 'req-8dd772a8-eb53-4773-90ca-8763dd10cfe0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:33.670489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8dd772a8-eb53-4773-90ca-8763dd10cfe0 admin admin] The token cache is being invalidate because project d515007baf57453c8ae96104f50900a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:33.670930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8dd772a8-eb53-4773-90ca-8763dd10cfe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:33.672116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8dd772a8-eb53-4773-90ca-8763dd10cfe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:33.674314 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2483/4973] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:33 2022] DELETE /identity/v3/projects/d515007baf57453c8ae96104f50900a2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:33.678982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc78235-51b9-4c32-bbfb-2ccf3de6ec34 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:33.679449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc78235-51b9-4c32-bbfb-2ccf3de6ec34 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:33.679525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc78235-51b9-4c32-bbfb-2ccf3de6ec34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:33.704135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7cc78235-51b9-4c32-bbfb-2ccf3de6ec34 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:33.705652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7cc78235-51b9-4c32-bbfb-2ccf3de6ec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:33.818512 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2491/4974] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:33.821293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8d7ab-76d6-4cf5-aab6-81309dba044f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:33.821769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8d7ab-76d6-4cf5-aab6-81309dba044f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:33.822229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8d7ab-76d6-4cf5-aab6-81309dba044f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:33.871582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b4b8d7ab-76d6-4cf5-aab6-81309dba044f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:33.872847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b4b8d7ab-76d6-4cf5-aab6-81309dba044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:33.897079 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2484/4975] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:33.897865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc78235-51b9-4c32-bbfb-2ccf3de6ec34 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:33.911571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc78235-51b9-4c32-bbfb-2ccf3de6ec34 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:33.917431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f28da-4747-4889-81d8-dab9c135fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:33.918154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f28da-4747-4889-81d8-dab9c135fbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:33.918454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f28da-4747-4889-81d8-dab9c135fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:33.918736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f28da-4747-4889-81d8-dab9c135fbc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:33.919590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f28da-4747-4889-81d8-dab9c135fbc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:10:33.919944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f28da-4747-4889-81d8-dab9c135fbc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:33.922299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f28da-4747-4889-81d8-dab9c135fbc6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:33.943392 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2492/4976] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:10:33.944791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8d7ab-76d6-4cf5-aab6-81309dba044f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:33.955766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8d7ab-76d6-4cf5-aab6-81309dba044f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:33.961588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054a65f-897b-4172-b442-521759b4f784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:33.962224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054a65f-897b-4172-b442-521759b4f784 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:33.962503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054a65f-897b-4172-b442-521759b4f784 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:33.962830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054a65f-897b-4172-b442-521759b4f784 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:33.963478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054a65f-897b-4172-b442-521759b4f784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:33.965432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054a65f-897b-4172-b442-521759b4f784 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:34.008958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f28da-4747-4889-81d8-dab9c135fbc6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:34.009182 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2485/4977] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:10:33 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:34.028150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f28da-4747-4889-81d8-dab9c135fbc6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:34.126436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:34.169056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce39688-1031-4f15-b4fc-4a0d44317219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:34.169649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce39688-1031-4f15-b4fc-4a0d44317219 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:34.169875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce39688-1031-4f15-b4fc-4a0d44317219 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:34.170199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce39688-1031-4f15-b4fc-4a0d44317219 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:34.172524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce39688-1031-4f15-b4fc-4a0d44317219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:34.182965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce39688-1031-4f15-b4fc-4a0d44317219 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:34.221220 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2493/4978] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:10:34 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:10:34.225293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054a65f-897b-4172-b442-521759b4f784 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:34.235481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:34.242712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054a65f-897b-4172-b442-521759b4f784 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:34.252561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f4b4a-f6d6-4134-a0c6-2091291768ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:34.253823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f4b4a-f6d6-4134-a0c6-2091291768ec admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:34.254198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f4b4a-f6d6-4134-a0c6-2091291768ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:34.254646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f4b4a-f6d6-4134-a0c6-2091291768ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:34.256628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f4b4a-f6d6-4134-a0c6-2091291768ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:34.259295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f4b4a-f6d6-4134-a0c6-2091291768ec admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:34.276662 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2486/4979] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:34.277900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce39688-1031-4f15-b4fc-4a0d44317219 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:34.289849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce39688-1031-4f15-b4fc-4a0d44317219 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:34.295742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53581b-764c-46d9-8b86-b1e03409169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:34.300381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53581b-764c-46d9-8b86-b1e03409169e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:34.300381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53581b-764c-46d9-8b86-b1e03409169e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:34.300381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53581b-764c-46d9-8b86-b1e03409169e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:34.300381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53581b-764c-46d9-8b86-b1e03409169e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:34.303929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53581b-764c-46d9-8b86-b1e03409169e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:34.323283 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2494/4980] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:34.324573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f4b4a-f6d6-4134-a0c6-2091291768ec admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:34.336569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f4b4a-f6d6-4134-a0c6-2091291768ec admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:34.342226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07be11-3446-4abb-bc10-94796ec9df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:34.343400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07be11-3446-4abb-bc10-94796ec9df87 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:34.343929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07be11-3446-4abb-bc10-94796ec9df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:34.344332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07be11-3446-4abb-bc10-94796ec9df87 admin admin] PATH_INFO: `/v3/projects/8c03078c9bb148d2a276bbf3f1af9d5e/users/efd44a2cd43c45d0a754f4825ed7f0e4/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:34.365049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07be11-3446-4abb-bc10-94796ec9df87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c03078c9bb148d2a276bbf3f1af9d5e, user_id=efd44a2cd43c45d0a754f4825ed7f0e4, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:34.369525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07be11-3446-4abb-bc10-94796ec9df87 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:34.386559 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2487/4981] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:10:34 2022] PUT /identity/v3/projects/8c03078c9bb148d2a276bbf3f1af9d5e/users/efd44a2cd43c45d0a754f4825ed7f0e4/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:34.490041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd6e93-397c-431d-9a96-e181f3be29ff None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:34.490431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd6e93-397c-431d-9a96-e181f3be29ff None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:34.490837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd6e93-397c-431d-9a96-e181f3be29ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:34.531538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e2bd6e93-397c-431d-9a96-e181f3be29ff None None] MFA Rules not processed for user `efd44a2cd43c45d0a754f4825ed7f0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:34.533033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e2bd6e93-397c-431d-9a96-e181f3be29ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:34.628931 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2495/4982] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:34.633263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07be11-3446-4abb-bc10-94796ec9df87 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:34.755828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07be11-3446-4abb-bc10-94796ec9df87 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:34.765136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94a28b-fae8-4c9c-b53d-ed45ef19fee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:34.767044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94a28b-fae8-4c9c-b53d-ed45ef19fee3 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:34.767504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94a28b-fae8-4c9c-b53d-ed45ef19fee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:34.767973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94a28b-fae8-4c9c-b53d-ed45ef19fee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:34.768743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94a28b-fae8-4c9c-b53d-ed45ef19fee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:34.771311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94a28b-fae8-4c9c-b53d-ed45ef19fee3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:34.839129 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2488/4983] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:10:34 2022] POST /identity/v3/projects => generated 391 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:34.840338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd6e93-397c-431d-9a96-e181f3be29ff None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:34.855110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd6e93-397c-431d-9a96-e181f3be29ff None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:34.970063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c3995-231d-4c4e-8dd8-98be47e0d71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:34.971680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3995-231d-4c4e-8dd8-98be47e0d71e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:34.972889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3995-231d-4c4e-8dd8-98be47e0d71e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:34.973247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c3995-231d-4c4e-8dd8-98be47e0d71e admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:34.974379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c3995-231d-4c4e-8dd8-98be47e0d71e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:34.976741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c3995-231d-4c4e-8dd8-98be47e0d71e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:35.011238 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2496/4984] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:10:34 2022] POST /identity/v3/users => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:35.016430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94a28b-fae8-4c9c-b53d-ed45ef19fee3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:35.030497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94a28b-fae8-4c9c-b53d-ed45ef19fee3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:35.037559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da809bef-a562-48cb-a294-2749cf9d700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:35.038773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da809bef-a562-48cb-a294-2749cf9d700d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:35.039286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da809bef-a562-48cb-a294-2749cf9d700d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:35.039763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da809bef-a562-48cb-a294-2749cf9d700d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:35.040614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da809bef-a562-48cb-a294-2749cf9d700d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:35.042615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da809bef-a562-48cb-a294-2749cf9d700d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:35.056670 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2489/4985] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:35.062440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c3995-231d-4c4e-8dd8-98be47e0d71e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:35.082168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c3995-231d-4c4e-8dd8-98be47e0d71e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:35.088410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b087f24-c998-4cb3-ad7a-0e86fc2fdb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:35.088980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b087f24-c998-4cb3-ad7a-0e86fc2fdb46 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:35.089263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b087f24-c998-4cb3-ad7a-0e86fc2fdb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:35.089531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b087f24-c998-4cb3-ad7a-0e86fc2fdb46 admin admin] PATH_INFO: `/v3/projects/c23a917c6cfe43c7af2402995bccb7ec/users/a14908e30ca94098a6d3897af310d265/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:35.115677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b087f24-c998-4cb3-ad7a-0e86fc2fdb46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23a917c6cfe43c7af2402995bccb7ec, user_id=a14908e30ca94098a6d3897af310d265, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:35.115677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b087f24-c998-4cb3-ad7a-0e86fc2fdb46 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:35.149208 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2497/4986] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:10:35 2022] PUT /identity/v3/projects/c23a917c6cfe43c7af2402995bccb7ec/users/a14908e30ca94098a6d3897af310d265/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:35.160954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da809bef-a562-48cb-a294-2749cf9d700d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:35.196177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da809bef-a562-48cb-a294-2749cf9d700d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:35.308690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2872a-5e38-449e-89cf-2f986b10334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:35.309593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2872a-5e38-449e-89cf-2f986b10334b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:35.310016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2872a-5e38-449e-89cf-2f986b10334b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:35.310427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2872a-5e38-449e-89cf-2f986b10334b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:35.311270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2872a-5e38-449e-89cf-2f986b10334b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:35.332439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2872a-5e38-449e-89cf-2f986b10334b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:35.352448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b087f24-c998-4cb3-ad7a-0e86fc2fdb46 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:35.354799 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2490/4987] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:35.369656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b087f24-c998-4cb3-ad7a-0e86fc2fdb46 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:35.385096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28571d-7cb9-45fc-9d3e-ce8f6a37581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:35.386305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28571d-7cb9-45fc-9d3e-ce8f6a37581e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:35.386927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28571d-7cb9-45fc-9d3e-ce8f6a37581e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:35.387405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28571d-7cb9-45fc-9d3e-ce8f6a37581e admin admin] PATH_INFO: `/v3/projects/c23a917c6cfe43c7af2402995bccb7ec/users/a14908e30ca94098a6d3897af310d265/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:35.391210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28571d-7cb9-45fc-9d3e-ce8f6a37581e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23a917c6cfe43c7af2402995bccb7ec, user_id=a14908e30ca94098a6d3897af310d265, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:35.395615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc28571d-7cb9-45fc-9d3e-ce8f6a37581e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:35.404782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:35.415192 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2498/4988] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:10:35 2022] PUT /identity/v3/projects/c23a917c6cfe43c7af2402995bccb7ec/users/a14908e30ca94098a6d3897af310d265/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:10:35.425112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3a4e6-9f1a-4023-a47c-3ee47af266c2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:35.426015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3a4e6-9f1a-4023-a47c-3ee47af266c2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:35.426494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3a4e6-9f1a-4023-a47c-3ee47af266c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:35.471106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-21d3a4e6-9f1a-4023-a47c-3ee47af266c2 None None] MFA Rules not processed for user `a14908e30ca94098a6d3897af310d265`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:35.472478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-21d3a4e6-9f1a-4023-a47c-3ee47af266c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:35.529474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:35.612346 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2491/4989] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:35 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:10:35.627515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28571d-7cb9-45fc-9d3e-ce8f6a37581e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:35.634323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fc28571d-7cb9-45fc-9d3e-ce8f6a37581e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:35.731764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28571d-7cb9-45fc-9d3e-ce8f6a37581e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:35.738467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976338e-ea13-45ec-bdd1-2a2acc116342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:35.739272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976338e-ea13-45ec-bdd1-2a2acc116342 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:35.739623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976338e-ea13-45ec-bdd1-2a2acc116342 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:35.740107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976338e-ea13-45ec-bdd1-2a2acc116342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:35.752462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976338e-ea13-45ec-bdd1-2a2acc116342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:35.754286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976338e-ea13-45ec-bdd1-2a2acc116342 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:35.768029 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2499/4990] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:10:35.871701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3a4e6-9f1a-4023-a47c-3ee47af266c2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:35.873372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-21d3a4e6-9f1a-4023-a47c-3ee47af266c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:35.894566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3a4e6-9f1a-4023-a47c-3ee47af266c2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:35.912684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daccbce-8cd8-4407-96ea-350f1c41a430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:35.914823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daccbce-8cd8-4407-96ea-350f1c41a430 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:35.915617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daccbce-8cd8-4407-96ea-350f1c41a430 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:35.916289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daccbce-8cd8-4407-96ea-350f1c41a430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:35.999999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daccbce-8cd8-4407-96ea-350f1c41a430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:36.002719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daccbce-8cd8-4407-96ea-350f1c41a430 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:36.034274 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2492/4991] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:39.058002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42833c9a-0036-49a8-9123-82867126beee None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:39.058504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42833c9a-0036-49a8-9123-82867126beee None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:39.058575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42833c9a-0036-49a8-9123-82867126beee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:39.115060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-42833c9a-0036-49a8-9123-82867126beee None None] MFA Rules not processed for user `5c52e93e22e14a089145c179740c5c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:39.116786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-42833c9a-0036-49a8-9123-82867126beee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:39.273404 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2500/4992] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:39.274419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d585f-91f7-43bd-8266-b66a5ea3f946 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:39.274940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d585f-91f7-43bd-8266-b66a5ea3f946 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:39.275039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d585f-91f7-43bd-8266-b66a5ea3f946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:39.306547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b11d585f-91f7-43bd-8266-b66a5ea3f946 None None] MFA Rules not processed for user `5c52e93e22e14a089145c179740c5c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:39.307949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b11d585f-91f7-43bd-8266-b66a5ea3f946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:39.316321 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2493/4993] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:39.522444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42833c9a-0036-49a8-9123-82867126beee None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:39.524011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-42833c9a-0036-49a8-9123-82867126beee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:39.764583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42833c9a-0036-49a8-9123-82867126beee None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:39.790338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d6173-998f-4612-a887-ac4937b9ac26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:39.791087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d6173-998f-4612-a887-ac4937b9ac26 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:39.796132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d6173-998f-4612-a887-ac4937b9ac26 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:39.797796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d6173-998f-4612-a887-ac4937b9ac26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:39.837861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d6173-998f-4612-a887-ac4937b9ac26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:39.839857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d6173-998f-4612-a887-ac4937b9ac26 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:39.848863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:39.869396 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2501/4994] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:39 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:40.797966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d585f-91f7-43bd-8266-b66a5ea3f946 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:40.800109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b11d585f-91f7-43bd-8266-b66a5ea3f946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:40.926374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d585f-91f7-43bd-8266-b66a5ea3f946 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:40.931813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:40.932478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:40.932767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:40.933046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] PATH_INFO: `/v3/users/1f26d07d53c4462aa2451518d8519cde` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:40.934428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f26d07d53c4462aa2451518d8519cde)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:40.937833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:41.053226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f26d07d53c4462aa2451518d8519cde'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:41.069578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f26d07d53c4462aa2451518d8519cde'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:41.070627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f26d07d53c4462aa2451518d8519cde'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:41.079055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:41.104443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f26d07d53c4462aa2451518d8519cde'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:41.105687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f26d07d53c4462aa2451518d8519cde'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:41.140563 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2494/4995] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:40 2022] DELETE /identity/v3/users/1f26d07d53c4462aa2451518d8519cde => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:10:41.146224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f488f58-69de-4b2c-923b-1db6b1eef8fc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:41.146224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f488f58-69de-4b2c-923b-1db6b1eef8fc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:41.146963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f488f58-69de-4b2c-923b-1db6b1eef8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:41.188917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1f488f58-69de-4b2c-923b-1db6b1eef8fc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:41.196327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1f488f58-69de-4b2c-923b-1db6b1eef8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:41.381224 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2502/4996] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:41.394355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:41.396020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:41.542324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff88cc-e600-4b75-ab79-389fc9885b72 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:41.552269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c7db5-021e-4d1b-984d-8271becbd136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:41.552923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c7db5-021e-4d1b-984d-8271becbd136 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:41.553208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c7db5-021e-4d1b-984d-8271becbd136 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:41.553482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c7db5-021e-4d1b-984d-8271becbd136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:41.591361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c7db5-021e-4d1b-984d-8271becbd136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:41.594829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c7db5-021e-4d1b-984d-8271becbd136 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:41.621344 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2495/4997] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:41.911038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f488f58-69de-4b2c-923b-1db6b1eef8fc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:41.916507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1f488f58-69de-4b2c-923b-1db6b1eef8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:41.942170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f488f58-69de-4b2c-923b-1db6b1eef8fc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:41.966852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:41.967551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:41.968491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:41.968990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] PATH_INFO: `/v3/projects/085636d86e0443c08ab077f2cb9bee02` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:41.970659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] RBAC: Authorizing `identity:delete_project(project_id=085636d86e0443c08ab077f2cb9bee02)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:41.972774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:42.103149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085636d86e0443c08ab077f2cb9bee02', 'request_id': 'req-4e0b22ba-dd65-487a-acc2-75607d0d664f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:42.134403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085636d86e0443c08ab077f2cb9bee02', 'request_id': 'req-4e0b22ba-dd65-487a-acc2-75607d0d664f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:42.143804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085636d86e0443c08ab077f2cb9bee02', 'request_id': 'req-4e0b22ba-dd65-487a-acc2-75607d0d664f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:42.164181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] The token cache is being invalidate because project 085636d86e0443c08ab077f2cb9bee02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:42.164793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:42.166408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:42.173659 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2503/4998] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:41 2022] DELETE /identity/v3/projects/085636d86e0443c08ab077f2cb9bee02 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:42.176428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c7db5-021e-4d1b-984d-8271becbd136 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:42.210618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c7db5-021e-4d1b-984d-8271becbd136 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:42.325844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:42.326608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:42.335151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:42.335532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] PATH_INFO: `/v3/users/397f04cd73f54ca1a0add662f7e0927a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:42.337248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=397f04cd73f54ca1a0add662f7e0927a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:42.340987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:42.448234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397f04cd73f54ca1a0add662f7e0927a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:42.466392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397f04cd73f54ca1a0add662f7e0927a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:42.467327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397f04cd73f54ca1a0add662f7e0927a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:42.512343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397f04cd73f54ca1a0add662f7e0927a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:42.513119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397f04cd73f54ca1a0add662f7e0927a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:42.543487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:42.553827 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2496/4999] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:42 2022] DELETE /identity/v3/users/397f04cd73f54ca1a0add662f7e0927a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:43.270725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:43.273090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:43.305750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b22ba-dd65-487a-acc2-75607d0d664f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:43.435335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:43.436139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:43.436581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:43.437072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] PATH_INFO: `/v3/projects/6ab6b83d52564fd299385692540d2107` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:43.439484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ab6b83d52564fd299385692540d2107)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:43.441614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:43.497950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:43.572899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ab6b83d52564fd299385692540d2107', 'request_id': 'req-5a82ecc7-2b27-4984-9ccd-c67de84a61af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:43.601764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ab6b83d52564fd299385692540d2107', 'request_id': 'req-5a82ecc7-2b27-4984-9ccd-c67de84a61af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:43.618532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ab6b83d52564fd299385692540d2107', 'request_id': 'req-5a82ecc7-2b27-4984-9ccd-c67de84a61af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:43.669006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] The token cache is being invalidate because project 6ab6b83d52564fd299385692540d2107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:43.669443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:43.672249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:43.675425 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2504/5000] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:43 2022] DELETE /identity/v3/projects/6ab6b83d52564fd299385692540d2107 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:43.679388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:43.685715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:43.707216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b6efc-44c1-4f9d-9e1f-c659e416fb19 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:43.916125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41dedc-0407-400c-b37e-c3e1775ded44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:43.916799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41dedc-0407-400c-b37e-c3e1775ded44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:43.917082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41dedc-0407-400c-b37e-c3e1775ded44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:43.917357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41dedc-0407-400c-b37e-c3e1775ded44 admin admin] PATH_INFO: `/v3/users/e7ea0371d85144ec801383eef2a0c933` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:43.919101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41dedc-0407-400c-b37e-c3e1775ded44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ea0371d85144ec801383eef2a0c933)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:43.921902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41dedc-0407-400c-b37e-c3e1775ded44 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:44.044918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6d41dedc-0407-400c-b37e-c3e1775ded44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ea0371d85144ec801383eef2a0c933'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:44.066111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6d41dedc-0407-400c-b37e-c3e1775ded44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ea0371d85144ec801383eef2a0c933'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:44.066940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6d41dedc-0407-400c-b37e-c3e1775ded44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ea0371d85144ec801383eef2a0c933'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:44.097354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6d41dedc-0407-400c-b37e-c3e1775ded44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ea0371d85144ec801383eef2a0c933'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:44.098379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6d41dedc-0407-400c-b37e-c3e1775ded44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ea0371d85144ec801383eef2a0c933'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:44.139284 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2497/5001] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:43 2022] DELETE /identity/v3/users/e7ea0371d85144ec801383eef2a0c933 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:45.049876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:45.052256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:45.082580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82ecc7-2b27-4984-9ccd-c67de84a61af admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:45.256383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:45.258383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:45.259303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:45.260145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] PATH_INFO: `/v3/users/efd44a2cd43c45d0a754f4825ed7f0e4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:45.268024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd44a2cd43c45d0a754f4825ed7f0e4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:45.270771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:45.400032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd44a2cd43c45d0a754f4825ed7f0e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:45.425838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd44a2cd43c45d0a754f4825ed7f0e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:45.431295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd44a2cd43c45d0a754f4825ed7f0e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:45.470352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd44a2cd43c45d0a754f4825ed7f0e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:45.471672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd44a2cd43c45d0a754f4825ed7f0e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:45.536745 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2505/5002] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:45 2022] DELETE /identity/v3/users/efd44a2cd43c45d0a754f4825ed7f0e4 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:45.537692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eec97b-f3d5-46f5-8e6f-01a71a250880 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:45.538202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eec97b-f3d5-46f5-8e6f-01a71a250880 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:45.538450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eec97b-f3d5-46f5-8e6f-01a71a250880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:45.578470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-88eec97b-f3d5-46f5-8e6f-01a71a250880 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:45.580295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-88eec97b-f3d5-46f5-8e6f-01a71a250880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:45.687859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:45.689970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:45.749975 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2498/5003] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:45.797902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:45.827873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eec97b-f3d5-46f5-8e6f-01a71a250880 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:45.830685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-88eec97b-f3d5-46f5-8e6f-01a71a250880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:45.872995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e4f41-b977-46d1-819d-bd6c7980cfeb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:45.896524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9347deb-ffab-4785-9f4d-6199947a67c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:45.897186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:45.897307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9347deb-ffab-4785-9f4d-6199947a67c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:45.897480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9347deb-ffab-4785-9f4d-6199947a67c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:45.898207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9347deb-ffab-4785-9f4d-6199947a67c0 admin admin] PATH_INFO: `/v3/projects/48d4a6f648834d0f9c3176b4d04bc6e7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:45.904931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9347deb-ffab-4785-9f4d-6199947a67c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d4a6f648834d0f9c3176b4d04bc6e7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:45.907073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9347deb-ffab-4785-9f4d-6199947a67c0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:46.004639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eec97b-f3d5-46f5-8e6f-01a71a250880 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:46.011241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9593f-641a-4f3b-a477-ba01e793c23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:46.012272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9593f-641a-4f3b-a477-ba01e793c23a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:46.012714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9593f-641a-4f3b-a477-ba01e793c23a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:46.013495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9593f-641a-4f3b-a477-ba01e793c23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:46.044178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9593f-641a-4f3b-a477-ba01e793c23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:46.048637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9593f-641a-4f3b-a477-ba01e793c23a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:46.067835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a9347deb-ffab-4785-9f4d-6199947a67c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d4a6f648834d0f9c3176b4d04bc6e7', 'request_id': 'req-a9347deb-ffab-4785-9f4d-6199947a67c0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:46.068384 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2499/5004] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:10:46.080325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a9347deb-ffab-4785-9f4d-6199947a67c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d4a6f648834d0f9c3176b4d04bc6e7', 'request_id': 'req-a9347deb-ffab-4785-9f4d-6199947a67c0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:46.094652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a9347deb-ffab-4785-9f4d-6199947a67c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d4a6f648834d0f9c3176b4d04bc6e7', 'request_id': 'req-a9347deb-ffab-4785-9f4d-6199947a67c0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:46.118158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a9347deb-ffab-4785-9f4d-6199947a67c0 admin admin] The token cache is being invalidate because project 48d4a6f648834d0f9c3176b4d04bc6e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:46.118557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a9347deb-ffab-4785-9f4d-6199947a67c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:46.119670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a9347deb-ffab-4785-9f4d-6199947a67c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:46.127929 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2506/5005] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:45 2022] DELETE /identity/v3/projects/48d4a6f648834d0f9c3176b4d04bc6e7 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:10:46.134108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a74ff-5657-46ac-b8d5-ec1e077c5a30 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:46.134627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a74ff-5657-46ac-b8d5-ec1e077c5a30 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:46.135064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a74ff-5657-46ac-b8d5-ec1e077c5a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:46.169183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-709a74ff-5657-46ac-b8d5-ec1e077c5a30 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:46.177007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-709a74ff-5657-46ac-b8d5-ec1e077c5a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:46.324939 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2500/5006] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:10:46.334681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db1aeb-669f-4bca-9cb5-9833074f23f3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:46.335193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db1aeb-669f-4bca-9cb5-9833074f23f3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:46.335640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db1aeb-669f-4bca-9cb5-9833074f23f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:46.384973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d5db1aeb-669f-4bca-9cb5-9833074f23f3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:46.387281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d5db1aeb-669f-4bca-9cb5-9833074f23f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:46.415021 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2507/5007] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:46.420757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a74ff-5657-46ac-b8d5-ec1e077c5a30 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:46.438564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a74ff-5657-46ac-b8d5-ec1e077c5a30 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:46.458302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748fa7a-2c4c-457a-8c38-d9f472fc8c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:46.459103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748fa7a-2c4c-457a-8c38-d9f472fc8c78 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:46.459401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748fa7a-2c4c-457a-8c38-d9f472fc8c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:46.459745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748fa7a-2c4c-457a-8c38-d9f472fc8c78 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:46.460793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748fa7a-2c4c-457a-8c38-d9f472fc8c78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:10:46.461129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748fa7a-2c4c-457a-8c38-d9f472fc8c78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:46.463194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748fa7a-2c4c-457a-8c38-d9f472fc8c78 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:46.481527 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2501/5008] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:10:46.486812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db1aeb-669f-4bca-9cb5-9833074f23f3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:46.500118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db1aeb-669f-4bca-9cb5-9833074f23f3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:46.513254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8438400-4b94-4986-8c98-9260b2ee18b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:46.518035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8438400-4b94-4986-8c98-9260b2ee18b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:46.518782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8438400-4b94-4986-8c98-9260b2ee18b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:46.519234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8438400-4b94-4986-8c98-9260b2ee18b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:46.521661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8438400-4b94-4986-8c98-9260b2ee18b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:46.527719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8438400-4b94-4986-8c98-9260b2ee18b6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:46.641242 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2508/5009] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:10:46 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:10:46.645829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748fa7a-2c4c-457a-8c38-d9f472fc8c78 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:46.672513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748fa7a-2c4c-457a-8c38-d9f472fc8c78 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:46.877205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f6238-c883-4a46-8208-77878562bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:46.878121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6238-c883-4a46-8208-77878562bbc7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:46.878490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6238-c883-4a46-8208-77878562bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:46.878913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f6238-c883-4a46-8208-77878562bbc7 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:46.879675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f6238-c883-4a46-8208-77878562bbc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:46.881999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f6238-c883-4a46-8208-77878562bbc7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:46.922780 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2502/5010] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:10:46 2022] POST /identity/v3/users => generated 287 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:46.926402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8438400-4b94-4986-8c98-9260b2ee18b6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:46.949028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8438400-4b94-4986-8c98-9260b2ee18b6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:46.958300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd4c94-f151-44cc-b36f-c216c77cf7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:46.959492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd4c94-f151-44cc-b36f-c216c77cf7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:46.960596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd4c94-f151-44cc-b36f-c216c77cf7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:46.963604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd4c94-f151-44cc-b36f-c216c77cf7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:46.965840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd4c94-f151-44cc-b36f-c216c77cf7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:46.970119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd4c94-f151-44cc-b36f-c216c77cf7a6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:46.986666 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2509/5011] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:46.991530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f6238-c883-4a46-8208-77878562bbc7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:47.004839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f6238-c883-4a46-8208-77878562bbc7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:47.012404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02fa7a-2228-403a-96ff-b1a3fad2bc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:47.013191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02fa7a-2228-403a-96ff-b1a3fad2bc90 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:47.013628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02fa7a-2228-403a-96ff-b1a3fad2bc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:47.014107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02fa7a-2228-403a-96ff-b1a3fad2bc90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:47.015069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02fa7a-2228-403a-96ff-b1a3fad2bc90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:47.019267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02fa7a-2228-403a-96ff-b1a3fad2bc90 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:47.037203 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2503/5012] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:10:47.041015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd4c94-f151-44cc-b36f-c216c77cf7a6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:47.055615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd4c94-f151-44cc-b36f-c216c77cf7a6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:47.063370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d30b-3d1a-4770-ae36-054cc1856cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:47.064247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d30b-3d1a-4770-ae36-054cc1856cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:47.064540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d30b-3d1a-4770-ae36-054cc1856cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:47.064826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d30b-3d1a-4770-ae36-054cc1856cbd admin admin] PATH_INFO: `/v3/projects/c8c16b51899d43559a9d7a0cbb53f101/users/8236c1461345454bb377bfeef482aeb0/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:47.088776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d30b-3d1a-4770-ae36-054cc1856cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c16b51899d43559a9d7a0cbb53f101, user_id=8236c1461345454bb377bfeef482aeb0, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:47.094332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d30b-3d1a-4770-ae36-054cc1856cbd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:47.164679 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2510/5013] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:10:47 2022] PUT /identity/v3/projects/c8c16b51899d43559a9d7a0cbb53f101/users/8236c1461345454bb377bfeef482aeb0/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:10:47.170142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37438917-b057-4f7d-971d-3cee364bee1b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:47.170525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37438917-b057-4f7d-971d-3cee364bee1b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:47.171797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37438917-b057-4f7d-971d-3cee364bee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:47.178791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d30b-3d1a-4770-ae36-054cc1856cbd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:47.185225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7c79d30b-3d1a-4770-ae36-054cc1856cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:47.215752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-37438917-b057-4f7d-971d-3cee364bee1b None None] MFA Rules not processed for user `8236c1461345454bb377bfeef482aeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:47.217321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-37438917-b057-4f7d-971d-3cee364bee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:47.261943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:47.340769 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2504/5014] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:47.400646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:47.410785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d30b-3d1a-4770-ae36-054cc1856cbd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:47.425002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:47.427341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:47.427660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:47.427946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] PATH_INFO: `/v3/projects/8c03078c9bb148d2a276bbf3f1af9d5e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:47.429446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c03078c9bb148d2a276bbf3f1af9d5e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:47.439065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37438917-b057-4f7d-971d-3cee364bee1b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:47.441552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-37438917-b057-4f7d-971d-3cee364bee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:47.448339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:47.621004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37438917-b057-4f7d-971d-3cee364bee1b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:47.632375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c03078c9bb148d2a276bbf3f1af9d5e', 'request_id': 'req-9beec810-a598-4d71-85ae-2e943290b05a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:47.666707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c03078c9bb148d2a276bbf3f1af9d5e', 'request_id': 'req-9beec810-a598-4d71-85ae-2e943290b05a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:47.694624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c03078c9bb148d2a276bbf3f1af9d5e', 'request_id': 'req-9beec810-a598-4d71-85ae-2e943290b05a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:47.739199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] The token cache is being invalidate because project 8c03078c9bb148d2a276bbf3f1af9d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:47.739658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:47.741081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:47.746623 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2511/5015] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:47 2022] DELETE /identity/v3/projects/8c03078c9bb148d2a276bbf3f1af9d5e => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:47.746623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:47.753728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:47.831203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c026e-a281-428c-aa30-7ee9bb44ea72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:47.832007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c026e-a281-428c-aa30-7ee9bb44ea72 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:47.832397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c026e-a281-428c-aa30-7ee9bb44ea72 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:47.832775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c026e-a281-428c-aa30-7ee9bb44ea72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:47.840337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b44c026e-a281-428c-aa30-7ee9bb44ea72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:47.977994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beec810-a598-4d71-85ae-2e943290b05a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:47.979486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c026e-a281-428c-aa30-7ee9bb44ea72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:47.981248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c026e-a281-428c-aa30-7ee9bb44ea72 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:47.987594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9694c-f03d-4a8e-93f5-05fb89a1d440 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:47.989028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9694c-f03d-4a8e-93f5-05fb89a1d440 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:47.989446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9694c-f03d-4a8e-93f5-05fb89a1d440 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:47.989805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9694c-f03d-4a8e-93f5-05fb89a1d440 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:47.992543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ddb9694c-f03d-4a8e-93f5-05fb89a1d440 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:47.998627 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2505/5016] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:48.002693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c026e-a281-428c-aa30-7ee9bb44ea72 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:48.011498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b44c026e-a281-428c-aa30-7ee9bb44ea72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:48.117972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:48.182416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c026e-a281-428c-aa30-7ee9bb44ea72 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:48.199991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380481a-690b-437b-9215-20cc9c592533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:48.199991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380481a-690b-437b-9215-20cc9c592533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:48.199991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380481a-690b-437b-9215-20cc9c592533 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:48.200836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380481a-690b-437b-9215-20cc9c592533 admin admin] PATH_INFO: `/v3/users/a14908e30ca94098a6d3897af310d265` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:48.203743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380481a-690b-437b-9215-20cc9c592533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14908e30ca94098a6d3897af310d265)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:48.213571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380481a-690b-437b-9215-20cc9c592533 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:48.315811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e380481a-690b-437b-9215-20cc9c592533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14908e30ca94098a6d3897af310d265'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:48.328438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e380481a-690b-437b-9215-20cc9c592533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14908e30ca94098a6d3897af310d265'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:48.329570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e380481a-690b-437b-9215-20cc9c592533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14908e30ca94098a6d3897af310d265'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:48.335472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9694c-f03d-4a8e-93f5-05fb89a1d440 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:48.337829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9694c-f03d-4a8e-93f5-05fb89a1d440 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:48.349434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e380481a-690b-437b-9215-20cc9c592533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14908e30ca94098a6d3897af310d265'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:48.350540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e380481a-690b-437b-9215-20cc9c592533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14908e30ca94098a6d3897af310d265'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:48.357991 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2512/5017] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:10:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:10:48.371638 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2506/5018] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:47 2022] DELETE /identity/v3/users/a14908e30ca94098a6d3897af310d265 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:50.692882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9694c-f03d-4a8e-93f5-05fb89a1d440 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:50.721342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9694c-f03d-4a8e-93f5-05fb89a1d440 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:50.836408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:50.931703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5acbf-848b-4110-9b6d-36b30d4df297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:50.932577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5acbf-848b-4110-9b6d-36b30d4df297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:50.933048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5acbf-848b-4110-9b6d-36b30d4df297 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:50.933584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5acbf-848b-4110-9b6d-36b30d4df297 admin admin] PATH_INFO: `/v3/projects/c23a917c6cfe43c7af2402995bccb7ec` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:50.935963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5acbf-848b-4110-9b6d-36b30d4df297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23a917c6cfe43c7af2402995bccb7ec)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:50.941106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5acbf-848b-4110-9b6d-36b30d4df297 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:51.053012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23d5acbf-848b-4110-9b6d-36b30d4df297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23a917c6cfe43c7af2402995bccb7ec', 'request_id': 'req-23d5acbf-848b-4110-9b6d-36b30d4df297'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:51.079968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23d5acbf-848b-4110-9b6d-36b30d4df297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23a917c6cfe43c7af2402995bccb7ec', 'request_id': 'req-23d5acbf-848b-4110-9b6d-36b30d4df297'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:51.092826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23d5acbf-848b-4110-9b6d-36b30d4df297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23a917c6cfe43c7af2402995bccb7ec', 'request_id': 'req-23d5acbf-848b-4110-9b6d-36b30d4df297'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:51.140608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23d5acbf-848b-4110-9b6d-36b30d4df297 admin admin] The token cache is being invalidate because project c23a917c6cfe43c7af2402995bccb7ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:51.142029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23d5acbf-848b-4110-9b6d-36b30d4df297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:51.143455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23d5acbf-848b-4110-9b6d-36b30d4df297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:51.146157 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2513/5019] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:50 2022] DELETE /identity/v3/projects/c23a917c6cfe43c7af2402995bccb7ec => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:51.151378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c9650-213d-42e8-ab26-6c7e22837353 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:51.152116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c9650-213d-42e8-ab26-6c7e22837353 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:51.152116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c9650-213d-42e8-ab26-6c7e22837353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:51.196033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e15c9650-213d-42e8-ab26-6c7e22837353 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:51.198199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e15c9650-213d-42e8-ab26-6c7e22837353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:51.401496 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2507/5020] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:51.410334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee332fb-a79f-4dde-bdff-6e093b1278aa None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:51.410902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee332fb-a79f-4dde-bdff-6e093b1278aa None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:51.411321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee332fb-a79f-4dde-bdff-6e093b1278aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:51.450013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7ee332fb-a79f-4dde-bdff-6e093b1278aa None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:51.455972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7ee332fb-a79f-4dde-bdff-6e093b1278aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:51.476910 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2514/5021] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:51.481225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c9650-213d-42e8-ab26-6c7e22837353 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:51.504922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c9650-213d-42e8-ab26-6c7e22837353 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:51.514154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c7ce8-6bf1-496e-a4e0-2fc3f3f5dcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:51.515227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c7ce8-6bf1-496e-a4e0-2fc3f3f5dcfc admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:51.515690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c7ce8-6bf1-496e-a4e0-2fc3f3f5dcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:51.515977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c7ce8-6bf1-496e-a4e0-2fc3f3f5dcfc admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:51.516657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c7ce8-6bf1-496e-a4e0-2fc3f3f5dcfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:10:51.516968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c7ce8-6bf1-496e-a4e0-2fc3f3f5dcfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:51.518687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c7ce8-6bf1-496e-a4e0-2fc3f3f5dcfc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:51.536102 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2508/5022] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:10:51.540621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee332fb-a79f-4dde-bdff-6e093b1278aa None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:51.553224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee332fb-a79f-4dde-bdff-6e093b1278aa None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:51.583477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbe663-d1f4-4089-9b5c-7438083e3701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:51.584882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbe663-d1f4-4089-9b5c-7438083e3701 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:51.585170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbe663-d1f4-4089-9b5c-7438083e3701 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:51.585451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbe663-d1f4-4089-9b5c-7438083e3701 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:51.586677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbe663-d1f4-4089-9b5c-7438083e3701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:51.588258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbe663-d1f4-4089-9b5c-7438083e3701 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:51.696313 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2515/5023] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:10:51 2022] POST /identity/v3/projects => generated 409 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:51.696956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c7ce8-6bf1-496e-a4e0-2fc3f3f5dcfc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:51.711085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c7ce8-6bf1-496e-a4e0-2fc3f3f5dcfc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:51.775512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:51.812666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809e186-eb10-4a03-bd1d-c76f4ad66f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:51.813519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809e186-eb10-4a03-bd1d-c76f4ad66f65 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:51.814154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809e186-eb10-4a03-bd1d-c76f4ad66f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:51.814540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809e186-eb10-4a03-bd1d-c76f4ad66f65 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:51.816343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809e186-eb10-4a03-bd1d-c76f4ad66f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:51.818451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809e186-eb10-4a03-bd1d-c76f4ad66f65 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:51.844282 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2509/5024] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:10:51 2022] POST /identity/v3/users => generated 305 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:51.850213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbe663-d1f4-4089-9b5c-7438083e3701 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:51.908206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbe663-d1f4-4089-9b5c-7438083e3701 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:51.933177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b261e-3d0f-4d6b-8bb0-f523dc99b99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:51.934196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b261e-3d0f-4d6b-8bb0-f523dc99b99e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:51.934616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b261e-3d0f-4d6b-8bb0-f523dc99b99e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:51.935084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b261e-3d0f-4d6b-8bb0-f523dc99b99e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:51.935900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b261e-3d0f-4d6b-8bb0-f523dc99b99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:51.938542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b261e-3d0f-4d6b-8bb0-f523dc99b99e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:51.958711 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2516/5025] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:51.965929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809e186-eb10-4a03-bd1d-c76f4ad66f65 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:51.981553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809e186-eb10-4a03-bd1d-c76f4ad66f65 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:51.988218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeff16d-616e-4643-92c5-0fc64b18cb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:51.988708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeff16d-616e-4643-92c5-0fc64b18cb92 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:51.989104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeff16d-616e-4643-92c5-0fc64b18cb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:51.989481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeff16d-616e-4643-92c5-0fc64b18cb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:51.990301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeff16d-616e-4643-92c5-0fc64b18cb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:52.007348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeff16d-616e-4643-92c5-0fc64b18cb92 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:52.048235 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2510/5026] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:52.049745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b261e-3d0f-4d6b-8bb0-f523dc99b99e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:52.074181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b261e-3d0f-4d6b-8bb0-f523dc99b99e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:52.080480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf1d90-9bbe-4c32-a8c9-1763878cfa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:52.081663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf1d90-9bbe-4c32-a8c9-1763878cfa0d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:52.082212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf1d90-9bbe-4c32-a8c9-1763878cfa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:52.082572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf1d90-9bbe-4c32-a8c9-1763878cfa0d admin admin] PATH_INFO: `/v3/projects/ae256632df1e492eaa32713c5c104d14/users/c4dbd772454c48fe858f0fcba24c8f72/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:52.161907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf1d90-9bbe-4c32-a8c9-1763878cfa0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae256632df1e492eaa32713c5c104d14, user_id=c4dbd772454c48fe858f0fcba24c8f72, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:52.165324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf1d90-9bbe-4c32-a8c9-1763878cfa0d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:52.190297 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2517/5027] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:10:52 2022] PUT /identity/v3/projects/ae256632df1e492eaa32713c5c104d14/users/c4dbd772454c48fe858f0fcba24c8f72/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:52.202020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c57da-028b-49c7-828d-bd3e273916d0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:52.202677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c57da-028b-49c7-828d-bd3e273916d0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:52.203107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c57da-028b-49c7-828d-bd3e273916d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:52.239016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ae8c57da-028b-49c7-828d-bd3e273916d0 None None] MFA Rules not processed for user `c4dbd772454c48fe858f0fcba24c8f72`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:52.240428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ae8c57da-028b-49c7-828d-bd3e273916d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:52.351004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf1d90-9bbe-4c32-a8c9-1763878cfa0d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:52.354605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b3bf1d90-9bbe-4c32-a8c9-1763878cfa0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:52.357486 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2511/5028] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:52 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:52.371801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c57da-028b-49c7-828d-bd3e273916d0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:52.465851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:52.480214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf1d90-9bbe-4c32-a8c9-1763878cfa0d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:52.500161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:52.501013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:52.501544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:52.502065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] PATH_INFO: `/v3/users/e53686d22edb4f4ebca9f6799eb23f7f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:52.504030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c57da-028b-49c7-828d-bd3e273916d0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:52.504187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53686d22edb4f4ebca9f6799eb23f7f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:52.506665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:52.509940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4aba1c-9b40-4977-a444-f9795a2b4b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:52.510982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4aba1c-9b40-4977-a444-f9795a2b4b5a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:52.511353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4aba1c-9b40-4977-a444-f9795a2b4b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:52.511715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4aba1c-9b40-4977-a444-f9795a2b4b5a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:52.512493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4aba1c-9b40-4977-a444-f9795a2b4b5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:52.515302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4aba1c-9b40-4977-a444-f9795a2b4b5a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:52.576444 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2512/5029] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:10:52 2022] POST /identity/v3/projects => generated 409 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:52.581546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4aba1c-9b40-4977-a444-f9795a2b4b5a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:52.607432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53686d22edb4f4ebca9f6799eb23f7f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:52.618921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53686d22edb4f4ebca9f6799eb23f7f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:52.620159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53686d22edb4f4ebca9f6799eb23f7f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:52.632909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53686d22edb4f4ebca9f6799eb23f7f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:52.634057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53686d22edb4f4ebca9f6799eb23f7f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:52.656204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:52.677735 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2518/5030] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:52 2022] DELETE /identity/v3/users/e53686d22edb4f4ebca9f6799eb23f7f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:10:52.717109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4aba1c-9b40-4977-a444-f9795a2b4b5a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:52.862859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41851d-4639-4f99-991c-e216259bc5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:52.868009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41851d-4639-4f99-991c-e216259bc5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:52.868403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41851d-4639-4f99-991c-e216259bc5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:52.868892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41851d-4639-4f99-991c-e216259bc5f1 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:52.869734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41851d-4639-4f99-991c-e216259bc5f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:52.880304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41851d-4639-4f99-991c-e216259bc5f1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:52.944712 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2513/5031] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:10:52 2022] POST /identity/v3/users => generated 311 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:52.946208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:52.947755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:52.978401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216d12e-5cc8-4651-9aa8-e6df0529f9dd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:52.998980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f39e-653f-4adf-8f90-609f567af90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:52.998980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f39e-653f-4adf-8f90-609f567af90f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:52.998980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f39e-653f-4adf-8f90-609f567af90f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:52.998980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f39e-653f-4adf-8f90-609f567af90f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:53.000125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178f39e-653f-4adf-8f90-609f567af90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:53.001188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178f39e-653f-4adf-8f90-609f567af90f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:53.037495 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2519/5032] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:53.039318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41851d-4639-4f99-991c-e216259bc5f1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:53.053880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41851d-4639-4f99-991c-e216259bc5f1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:53.069693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03b318-3024-4d38-9020-6c7509195192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:53.070864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03b318-3024-4d38-9020-6c7509195192 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:53.071221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03b318-3024-4d38-9020-6c7509195192 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:53.071575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03b318-3024-4d38-9020-6c7509195192 admin admin] PATH_INFO: `/v3/projects/fa4311e452a84b07a4828a180554e69d/users/bd218b04bde74ae998db3a56e66d469a/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:53.117141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03b318-3024-4d38-9020-6c7509195192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4311e452a84b07a4828a180554e69d, user_id=bd218b04bde74ae998db3a56e66d469a, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:53.120046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03b318-3024-4d38-9020-6c7509195192 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:53.172109 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2514/5033] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:10:53 2022] PUT /identity/v3/projects/fa4311e452a84b07a4828a180554e69d/users/bd218b04bde74ae998db3a56e66d469a/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:10:53.177016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f39e-653f-4adf-8f90-609f567af90f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:53.193812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f39e-653f-4adf-8f90-609f567af90f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:53.395127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a70bff-03de-4926-b7dc-6400a9594fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:53.396495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a70bff-03de-4926-b7dc-6400a9594fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:53.397213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a70bff-03de-4926-b7dc-6400a9594fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:53.398019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a70bff-03de-4926-b7dc-6400a9594fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:53.399363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a70bff-03de-4926-b7dc-6400a9594fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:53.405016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a70bff-03de-4926-b7dc-6400a9594fb7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:53.448506 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2520/5034] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:53.449846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03b318-3024-4d38-9020-6c7509195192 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:53.464601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03b318-3024-4d38-9020-6c7509195192 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:53.476561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b143a-937f-4db5-bb57-aaf5251eabf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:53.478451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b143a-937f-4db5-bb57-aaf5251eabf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:53.479213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b143a-937f-4db5-bb57-aaf5251eabf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:53.480692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b143a-937f-4db5-bb57-aaf5251eabf2 admin admin] PATH_INFO: `/v3/projects/fa4311e452a84b07a4828a180554e69d/users/bd218b04bde74ae998db3a56e66d469a/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:53.485792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b143a-937f-4db5-bb57-aaf5251eabf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4311e452a84b07a4828a180554e69d, user_id=bd218b04bde74ae998db3a56e66d469a, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:53.493821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b143a-937f-4db5-bb57-aaf5251eabf2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:53.549119 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2515/5035] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:10:53 2022] PUT /identity/v3/projects/fa4311e452a84b07a4828a180554e69d/users/bd218b04bde74ae998db3a56e66d469a/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:53.556159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe6a50-0f4c-485f-b88d-288fe724d216 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:53.556438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe6a50-0f4c-485f-b88d-288fe724d216 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:53.556742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe6a50-0f4c-485f-b88d-288fe724d216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:53.666450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-bdbe6a50-0f4c-485f-b88d-288fe724d216 None None] MFA Rules not processed for user `bd218b04bde74ae998db3a56e66d469a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:53.668005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bdbe6a50-0f4c-485f-b88d-288fe724d216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:53.791702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:53.830684 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2521/5036] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:53 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:10:53.847704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b143a-937f-4db5-bb57-aaf5251eabf2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:53.849350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-765b143a-937f-4db5-bb57-aaf5251eabf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:54.000616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b143a-937f-4db5-bb57-aaf5251eabf2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:54.015511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892e1eb-0c3f-446e-ae3e-15eb3e8158d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:54.016150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892e1eb-0c3f-446e-ae3e-15eb3e8158d8 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:54.016437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892e1eb-0c3f-446e-ae3e-15eb3e8158d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:54.016717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892e1eb-0c3f-446e-ae3e-15eb3e8158d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:54.043823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892e1eb-0c3f-446e-ae3e-15eb3e8158d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:54.045716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892e1eb-0c3f-446e-ae3e-15eb3e8158d8 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:54.062301 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2516/5037] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:53 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:54.415944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe6a50-0f4c-485f-b88d-288fe724d216 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:54.422269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bdbe6a50-0f4c-485f-b88d-288fe724d216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:54.470858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892e1eb-0c3f-446e-ae3e-15eb3e8158d8 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:54.474021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7892e1eb-0c3f-446e-ae3e-15eb3e8158d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:54.499681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892e1eb-0c3f-446e-ae3e-15eb3e8158d8 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:54.514228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77766ed-bb79-4388-81b8-67ef2fadb41d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:54.516221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77766ed-bb79-4388-81b8-67ef2fadb41d service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:54.516726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77766ed-bb79-4388-81b8-67ef2fadb41d service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:54.517720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77766ed-bb79-4388-81b8-67ef2fadb41d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:54.520220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b77766ed-bb79-4388-81b8-67ef2fadb41d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:54.582029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:54.595617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe6a50-0f4c-485f-b88d-288fe724d216 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:54.616401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:54.617064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:54.617344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:54.617616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] PATH_INFO: `/v3/projects/05e9358455a84783aaee73d111ae80dc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:54.618819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e9358455a84783aaee73d111ae80dc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:54.620771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:54.673588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77766ed-bb79-4388-81b8-67ef2fadb41d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:54.676560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77766ed-bb79-4388-81b8-67ef2fadb41d service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:54.697813 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2517/5038] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:54 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:10:54.710520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e9358455a84783aaee73d111ae80dc', 'request_id': 'req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:54.720717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e9358455a84783aaee73d111ae80dc', 'request_id': 'req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:54.732101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e9358455a84783aaee73d111ae80dc', 'request_id': 'req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:54.767143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] The token cache is being invalidate because project 05e9358455a84783aaee73d111ae80dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:54.767459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:54.768136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:54.774158 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2522/5039] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:54 2022] DELETE /identity/v3/projects/05e9358455a84783aaee73d111ae80dc => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:54.775673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77766ed-bb79-4388-81b8-67ef2fadb41d service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:54.793307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77766ed-bb79-4388-81b8-67ef2fadb41d service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:54.917495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6511fdb-a137-46c6-882c-e94d8bd4f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:54.918446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511fdb-a137-46c6-882c-e94d8bd4f52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:54.918922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511fdb-a137-46c6-882c-e94d8bd4f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:54.919407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511fdb-a137-46c6-882c-e94d8bd4f52f admin admin] PATH_INFO: `/v3/users/8de209e1f73e45d2a82d7d3fc9f0aca9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:54.921667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6511fdb-a137-46c6-882c-e94d8bd4f52f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de209e1f73e45d2a82d7d3fc9f0aca9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:54.938838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6511fdb-a137-46c6-882c-e94d8bd4f52f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:55.060722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d6511fdb-a137-46c6-882c-e94d8bd4f52f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de209e1f73e45d2a82d7d3fc9f0aca9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:55.070904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d6511fdb-a137-46c6-882c-e94d8bd4f52f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de209e1f73e45d2a82d7d3fc9f0aca9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:55.071653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d6511fdb-a137-46c6-882c-e94d8bd4f52f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de209e1f73e45d2a82d7d3fc9f0aca9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:55.098128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d6511fdb-a137-46c6-882c-e94d8bd4f52f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de209e1f73e45d2a82d7d3fc9f0aca9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:55.098975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d6511fdb-a137-46c6-882c-e94d8bd4f52f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de209e1f73e45d2a82d7d3fc9f0aca9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:55.126567 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2518/5040] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:10:54 2022] DELETE /identity/v3/users/8de209e1f73e45d2a82d7d3fc9f0aca9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:56.417590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:56.419053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:56.442665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02f1bd-5b08-429e-ae3c-2d7f194b0ae0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:56.534314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf89c6-c313-44f9-bc58-38d3d022aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:56.535391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf89c6-c313-44f9-bc58-38d3d022aaf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:56.536285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf89c6-c313-44f9-bc58-38d3d022aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:56.536776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf89c6-c313-44f9-bc58-38d3d022aaf7 admin admin] PATH_INFO: `/v3/projects/3a4eebcc69ea4495bfdb9503d799a682` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:56.538781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf89c6-c313-44f9-bc58-38d3d022aaf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4eebcc69ea4495bfdb9503d799a682)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:56.542894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf89c6-c313-44f9-bc58-38d3d022aaf7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:56.659482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:56.739533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6caf89c6-c313-44f9-bc58-38d3d022aaf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4eebcc69ea4495bfdb9503d799a682', 'request_id': 'req-6caf89c6-c313-44f9-bc58-38d3d022aaf7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:56.749172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6caf89c6-c313-44f9-bc58-38d3d022aaf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4eebcc69ea4495bfdb9503d799a682', 'request_id': 'req-6caf89c6-c313-44f9-bc58-38d3d022aaf7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:56.762609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6caf89c6-c313-44f9-bc58-38d3d022aaf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4eebcc69ea4495bfdb9503d799a682', 'request_id': 'req-6caf89c6-c313-44f9-bc58-38d3d022aaf7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:56.803373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6caf89c6-c313-44f9-bc58-38d3d022aaf7 admin admin] The token cache is being invalidate because project 3a4eebcc69ea4495bfdb9503d799a682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:10:56.803839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6caf89c6-c313-44f9-bc58-38d3d022aaf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:56.805362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6caf89c6-c313-44f9-bc58-38d3d022aaf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:10:56.813229 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2523/5041] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:10:56 2022] DELETE /identity/v3/projects/3a4eebcc69ea4495bfdb9503d799a682 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:56.819398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeefe5-f36d-47eb-820f-5bf2475d7bf2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:56.820307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeefe5-f36d-47eb-820f-5bf2475d7bf2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:56.820778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeefe5-f36d-47eb-820f-5bf2475d7bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:56.879246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8aaeefe5-f36d-47eb-820f-5bf2475d7bf2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:56.881168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8aaeefe5-f36d-47eb-820f-5bf2475d7bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:57.011755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:10:57.058988 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2519/5042] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:57.070519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381130ff-1475-42eb-ac43-fb46f39177b2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:57.071015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381130ff-1475-42eb-ac43-fb46f39177b2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:57.071155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381130ff-1475-42eb-ac43-fb46f39177b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:57.102972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-381130ff-1475-42eb-ac43-fb46f39177b2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:57.104997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-381130ff-1475-42eb-ac43-fb46f39177b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:57.135349 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2524/5043] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:10:57.137145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeefe5-f36d-47eb-820f-5bf2475d7bf2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:57.157060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeefe5-f36d-47eb-820f-5bf2475d7bf2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:57.176788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc0d1d-193a-46ec-86f3-60802cb802c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:57.177571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc0d1d-193a-46ec-86f3-60802cb802c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:57.177939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc0d1d-193a-46ec-86f3-60802cb802c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:57.178276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc0d1d-193a-46ec-86f3-60802cb802c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:57.179414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc0d1d-193a-46ec-86f3-60802cb802c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:10:57.179414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc0d1d-193a-46ec-86f3-60802cb802c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:57.180822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc0d1d-193a-46ec-86f3-60802cb802c6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:57.216871 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2520/5044] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:10:57.222144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381130ff-1475-42eb-ac43-fb46f39177b2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:57.279902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381130ff-1475-42eb-ac43-fb46f39177b2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:57.321218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd797fbf-d8bc-4c88-a503-05684f26e8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:57.324596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797fbf-d8bc-4c88-a503-05684f26e8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:57.326414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797fbf-d8bc-4c88-a503-05684f26e8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:57.327126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797fbf-d8bc-4c88-a503-05684f26e8e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:57.328405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd797fbf-d8bc-4c88-a503-05684f26e8e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:57.332327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd797fbf-d8bc-4c88-a503-05684f26e8e2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:57.450070 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2525/5045] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:10:57 2022] POST /identity/v3/projects => generated 397 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:57.461268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc0d1d-193a-46ec-86f3-60802cb802c6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:57.480490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc0d1d-193a-46ec-86f3-60802cb802c6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:57.710679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b24e7-3ed9-4d58-b0c1-c9700a15454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:57.711561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b24e7-3ed9-4d58-b0c1-c9700a15454d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:57.711981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b24e7-3ed9-4d58-b0c1-c9700a15454d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:57.712363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b24e7-3ed9-4d58-b0c1-c9700a15454d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:57.715077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b24e7-3ed9-4d58-b0c1-c9700a15454d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:57.717939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b24e7-3ed9-4d58-b0c1-c9700a15454d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:57.792420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd797fbf-d8bc-4c88-a503-05684f26e8e2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:57.805674 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2521/5046] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:10:57 2022] POST /identity/v3/users => generated 299 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:10:57.812980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd797fbf-d8bc-4c88-a503-05684f26e8e2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:57.825080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df99a35-7fdf-42e4-9741-b239ca26e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:57.825884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df99a35-7fdf-42e4-9741-b239ca26e8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:57.826315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df99a35-7fdf-42e4-9741-b239ca26e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:57.826965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df99a35-7fdf-42e4-9741-b239ca26e8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:57.828413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df99a35-7fdf-42e4-9741-b239ca26e8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:57.834317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df99a35-7fdf-42e4-9741-b239ca26e8d5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:57.865554 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2526/5047] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:10:57.876995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b24e7-3ed9-4d58-b0c1-c9700a15454d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:57.909220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b24e7-3ed9-4d58-b0c1-c9700a15454d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:57.926964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75ea87-3b75-4126-bb8f-9589cb99422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:57.927842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75ea87-3b75-4126-bb8f-9589cb99422c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:57.928352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75ea87-3b75-4126-bb8f-9589cb99422c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:57.928773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75ea87-3b75-4126-bb8f-9589cb99422c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:57.929800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75ea87-3b75-4126-bb8f-9589cb99422c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:57.931829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75ea87-3b75-4126-bb8f-9589cb99422c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:57.967766 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2522/5048] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:10:57.974225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df99a35-7fdf-42e4-9741-b239ca26e8d5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:57.996150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df99a35-7fdf-42e4-9741-b239ca26e8d5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:58.008975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c5264-f645-498b-b06a-cc77fb64a058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:58.010690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c5264-f645-498b-b06a-cc77fb64a058 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:58.011955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c5264-f645-498b-b06a-cc77fb64a058 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:58.012415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c5264-f645-498b-b06a-cc77fb64a058 admin admin] PATH_INFO: `/v3/projects/7b0ab5cf56914726834f8a35321136e4/users/1ef6c81f1a244e8289a548e6be43de31/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:58.072046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c5264-f645-498b-b06a-cc77fb64a058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0ab5cf56914726834f8a35321136e4, user_id=1ef6c81f1a244e8289a548e6be43de31, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:58.072046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c5264-f645-498b-b06a-cc77fb64a058 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:58.118350 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2527/5049] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:10:57 2022] PUT /identity/v3/projects/7b0ab5cf56914726834f8a35321136e4/users/1ef6c81f1a244e8289a548e6be43de31/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:10:58.125249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c34b-d89d-42ee-86c6-58bb98c3e5ab None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:58.126364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c34b-d89d-42ee-86c6-58bb98c3e5ab None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:58.127099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c34b-d89d-42ee-86c6-58bb98c3e5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:58.162113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c636c34b-d89d-42ee-86c6-58bb98c3e5ab None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:10:58.163953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c636c34b-d89d-42ee-86c6-58bb98c3e5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:58.285719 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2523/5050] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:10:58.319393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c5264-f645-498b-b06a-cc77fb64a058 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:10:58.341281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3d7c5264-f645-498b-b06a-cc77fb64a058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:10:58.510898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c5264-f645-498b-b06a-cc77fb64a058 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:10:58.533550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868686a-d153-41f4-8941-2103894225c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:10:58.535532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868686a-d153-41f4-8941-2103894225c5 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:10:58.536624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868686a-d153-41f4-8941-2103894225c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:10:58.538671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868686a-d153-41f4-8941-2103894225c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:10:58.567369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868686a-d153-41f4-8941-2103894225c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:10:58.571949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868686a-d153-41f4-8941-2103894225c5 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:10:58.597114 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2528/5051] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:08.274326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:08.583602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:10.203756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c34b-d89d-42ee-86c6-58bb98c3e5ab None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:10.205211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c636c34b-d89d-42ee-86c6-58bb98c3e5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:10.224674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c34b-d89d-42ee-86c6-58bb98c3e5ab None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:10.230309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:10.231023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:10.231307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:10.231582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] PATH_INFO: `/v3/users/c4dbd772454c48fe858f0fcba24c8f72` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:10.233559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4dbd772454c48fe858f0fcba24c8f72)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:10.235919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:10.359148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4dbd772454c48fe858f0fcba24c8f72'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:10.369293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4dbd772454c48fe858f0fcba24c8f72'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:10.371219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4dbd772454c48fe858f0fcba24c8f72'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:10.388771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4dbd772454c48fe858f0fcba24c8f72'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:10.390854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4dbd772454c48fe858f0fcba24c8f72'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:10.423420 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2524/5052] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:11:10 2022] DELETE /identity/v3/users/c4dbd772454c48fe858f0fcba24c8f72 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:11:10.440664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b64867-37aa-4029-8dc0-52a2db863bf1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:10.441314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b64867-37aa-4029-8dc0-52a2db863bf1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:10.442078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b64867-37aa-4029-8dc0-52a2db863bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:10.485295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-94b64867-37aa-4029-8dc0-52a2db863bf1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:10.486876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-94b64867-37aa-4029-8dc0-52a2db863bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:10.603877 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2529/5053] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:10.626405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:10.628200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:10.798254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849adac6-f9e5-4b3e-80f6-8ca36e05695e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:10.802317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2521b6a-8bcb-48bd-948a-ce21524a9e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:10.803139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2521b6a-8bcb-48bd-948a-ce21524a9e94 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:10.803649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2521b6a-8bcb-48bd-948a-ce21524a9e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:10.804008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2521b6a-8bcb-48bd-948a-ce21524a9e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:10.818172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2521b6a-8bcb-48bd-948a-ce21524a9e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:10.820025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2521b6a-8bcb-48bd-948a-ce21524a9e94 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:10.836011 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2525/5054] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:12.455923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b64867-37aa-4029-8dc0-52a2db863bf1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:12.459925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-94b64867-37aa-4029-8dc0-52a2db863bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:12.485541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b64867-37aa-4029-8dc0-52a2db863bf1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:12.496402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:12.497220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:12.497400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:12.498603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] PATH_INFO: `/v3/projects/ae256632df1e492eaa32713c5c104d14` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:12.499693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae256632df1e492eaa32713c5c104d14)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:12.502054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:12.603775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae256632df1e492eaa32713c5c104d14', 'request_id': 'req-8105f340-84b9-4f87-a590-683fdf003272'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:12.617533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae256632df1e492eaa32713c5c104d14', 'request_id': 'req-8105f340-84b9-4f87-a590-683fdf003272'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:12.656386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae256632df1e492eaa32713c5c104d14', 'request_id': 'req-8105f340-84b9-4f87-a590-683fdf003272'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:12.688380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] The token cache is being invalidate because project ae256632df1e492eaa32713c5c104d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:11:12.688727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:12.699535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:12.706854 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2530/5055] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:11:12 2022] DELETE /identity/v3/projects/ae256632df1e492eaa32713c5c104d14 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:11:12.709709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2521b6a-8bcb-48bd-948a-ce21524a9e94 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:12.728776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2521b6a-8bcb-48bd-948a-ce21524a9e94 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:12.838242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488876d-8142-4f37-a79c-246c6fff0908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:12.839308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488876d-8142-4f37-a79c-246c6fff0908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:12.839710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488876d-8142-4f37-a79c-246c6fff0908 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:12.840093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488876d-8142-4f37-a79c-246c6fff0908 admin admin] PATH_INFO: `/v3/users/bd218b04bde74ae998db3a56e66d469a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:12.841559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488876d-8142-4f37-a79c-246c6fff0908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd218b04bde74ae998db3a56e66d469a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:12.844882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488876d-8142-4f37-a79c-246c6fff0908 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:12.868583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:12.927904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8488876d-8142-4f37-a79c-246c6fff0908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd218b04bde74ae998db3a56e66d469a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:12.937020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8488876d-8142-4f37-a79c-246c6fff0908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd218b04bde74ae998db3a56e66d469a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:12.942554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8488876d-8142-4f37-a79c-246c6fff0908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd218b04bde74ae998db3a56e66d469a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:12.958947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8488876d-8142-4f37-a79c-246c6fff0908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd218b04bde74ae998db3a56e66d469a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:12.959943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8488876d-8142-4f37-a79c-246c6fff0908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd218b04bde74ae998db3a56e66d469a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:12.985839 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2526/5056] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:11:12 2022] DELETE /identity/v3/users/bd218b04bde74ae998db3a56e66d469a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:11:14.574769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:14.577562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:14.601434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105f340-84b9-4f87-a590-683fdf003272 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:14.856178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ddf56-5d9e-4626-824a-f832d97aed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:14.857333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ddf56-5d9e-4626-824a-f832d97aed0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:14.858337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ddf56-5d9e-4626-824a-f832d97aed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:14.861012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ddf56-5d9e-4626-824a-f832d97aed0c admin admin] PATH_INFO: `/v3/projects/fa4311e452a84b07a4828a180554e69d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:14.865012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ddf56-5d9e-4626-824a-f832d97aed0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa4311e452a84b07a4828a180554e69d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:14.868098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ddf56-5d9e-4626-824a-f832d97aed0c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:14.922681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:14.961065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a62ddf56-5d9e-4626-824a-f832d97aed0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa4311e452a84b07a4828a180554e69d', 'request_id': 'req-a62ddf56-5d9e-4626-824a-f832d97aed0c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:14.970889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a62ddf56-5d9e-4626-824a-f832d97aed0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa4311e452a84b07a4828a180554e69d', 'request_id': 'req-a62ddf56-5d9e-4626-824a-f832d97aed0c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:14.981455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a62ddf56-5d9e-4626-824a-f832d97aed0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa4311e452a84b07a4828a180554e69d', 'request_id': 'req-a62ddf56-5d9e-4626-824a-f832d97aed0c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:15.004327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a62ddf56-5d9e-4626-824a-f832d97aed0c admin admin] The token cache is being invalidate because project fa4311e452a84b07a4828a180554e69d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:11:15.004970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a62ddf56-5d9e-4626-824a-f832d97aed0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:15.005795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a62ddf56-5d9e-4626-824a-f832d97aed0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:15.008388 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2531/5057] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:11:14 2022] DELETE /identity/v3/projects/fa4311e452a84b07a4828a180554e69d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:11:15.027900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9e727-6caa-4a9d-8033-e5b3d9f15586 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:15.027900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9e727-6caa-4a9d-8033-e5b3d9f15586 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:15.027900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9e727-6caa-4a9d-8033-e5b3d9f15586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:15.054853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-28f9e727-6caa-4a9d-8033-e5b3d9f15586 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:15.056271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28f9e727-6caa-4a9d-8033-e5b3d9f15586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:15.204904 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2527/5058] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:15.213998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0dc1-c772-4a0f-9d20-f82799a5890b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:15.214859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0dc1-c772-4a0f-9d20-f82799a5890b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:15.215416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0dc1-c772-4a0f-9d20-f82799a5890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:15.306523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a21e0dc1-c772-4a0f-9d20-f82799a5890b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:15.308036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a21e0dc1-c772-4a0f-9d20-f82799a5890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:15.343879 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2532/5059] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:15.348741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9e727-6caa-4a9d-8033-e5b3d9f15586 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:15.371529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9e727-6caa-4a9d-8033-e5b3d9f15586 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:15.378540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056544d-3319-4a23-b845-7d098256e0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:15.379365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056544d-3319-4a23-b845-7d098256e0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:15.379826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056544d-3319-4a23-b845-7d098256e0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:15.380175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056544d-3319-4a23-b845-7d098256e0a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:15.381311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056544d-3319-4a23-b845-7d098256e0a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:11:15.382388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056544d-3319-4a23-b845-7d098256e0a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:15.386098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056544d-3319-4a23-b845-7d098256e0a7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:15.422306 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2528/5060] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:11:15.428163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0dc1-c772-4a0f-9d20-f82799a5890b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:15.440342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0dc1-c772-4a0f-9d20-f82799a5890b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:15.453403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1d000-4b5c-4213-87cc-e96fc63675f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:15.454034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1d000-4b5c-4213-87cc-e96fc63675f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:15.454316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1d000-4b5c-4213-87cc-e96fc63675f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:15.454588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1d000-4b5c-4213-87cc-e96fc63675f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:15.455280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1d000-4b5c-4213-87cc-e96fc63675f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:15.460029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1d000-4b5c-4213-87cc-e96fc63675f7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:15.621986 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2533/5061] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:11:15 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:11:15.627112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056544d-3319-4a23-b845-7d098256e0a7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:15.676865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056544d-3319-4a23-b845-7d098256e0a7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:15.778848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892dbec-29a7-402e-9db3-f1e1c7d38785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:15.779915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892dbec-29a7-402e-9db3-f1e1c7d38785 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:15.780356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892dbec-29a7-402e-9db3-f1e1c7d38785 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:15.780902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892dbec-29a7-402e-9db3-f1e1c7d38785 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:15.782249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892dbec-29a7-402e-9db3-f1e1c7d38785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:15.786023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892dbec-29a7-402e-9db3-f1e1c7d38785 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:15.868792 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2529/5062] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:11:15 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:11:15.874443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1d000-4b5c-4213-87cc-e96fc63675f7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:15.885888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1d000-4b5c-4213-87cc-e96fc63675f7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:15.897171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4477f91-816e-4f9f-8285-2185db82c7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:15.898171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4477f91-816e-4f9f-8285-2185db82c7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:15.898658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4477f91-816e-4f9f-8285-2185db82c7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:15.900192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4477f91-816e-4f9f-8285-2185db82c7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:15.901092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4477f91-816e-4f9f-8285-2185db82c7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:15.903163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4477f91-816e-4f9f-8285-2185db82c7e1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:15.930649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892dbec-29a7-402e-9db3-f1e1c7d38785 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:15.939924 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2534/5063] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:11:15.947849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892dbec-29a7-402e-9db3-f1e1c7d38785 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:15.958157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a076e3a-3411-4cc1-acbd-de71441317c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:15.960123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a076e3a-3411-4cc1-acbd-de71441317c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:15.960748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a076e3a-3411-4cc1-acbd-de71441317c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:15.961277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a076e3a-3411-4cc1-acbd-de71441317c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:15.964571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a076e3a-3411-4cc1-acbd-de71441317c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:15.968374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a076e3a-3411-4cc1-acbd-de71441317c7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:15.980351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:16.002404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4477f91-816e-4f9f-8285-2185db82c7e1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:16.011621 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2530/5064] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:11:16.034652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4477f91-816e-4f9f-8285-2185db82c7e1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:16.044585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5329db-9f2b-4236-b783-9096b1e4a011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:16.056433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5329db-9f2b-4236-b783-9096b1e4a011 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:16.059684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5329db-9f2b-4236-b783-9096b1e4a011 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:16.060276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5329db-9f2b-4236-b783-9096b1e4a011 admin admin] PATH_INFO: `/v3/projects/884d5f23c85342399c9f692166119b2f/users/90a03535aa7940679e805674541147ec/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:16.088076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5329db-9f2b-4236-b783-9096b1e4a011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884d5f23c85342399c9f692166119b2f, user_id=90a03535aa7940679e805674541147ec, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:16.091314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5329db-9f2b-4236-b783-9096b1e4a011 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:16.177025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0cc18-25ff-403b-bf10-ded185fce7a4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:16.177607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0cc18-25ff-403b-bf10-ded185fce7a4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:16.177980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0cc18-25ff-403b-bf10-ded185fce7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:16.181554 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2535/5065] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:11:15 2022] PUT /identity/v3/projects/884d5f23c85342399c9f692166119b2f/users/90a03535aa7940679e805674541147ec/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:11:16.239783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6bb0cc18-25ff-403b-bf10-ded185fce7a4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:16.241176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6bb0cc18-25ff-403b-bf10-ded185fce7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:16.413331 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2531/5066] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:16.428573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5329db-9f2b-4236-b783-9096b1e4a011 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:16.430488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5d5329db-9f2b-4236-b783-9096b1e4a011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:16.600881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5329db-9f2b-4236-b783-9096b1e4a011 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:16.634687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6eb1b3-7ff6-4af8-ae2b-514e7cfe3753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:16.636117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eb1b3-7ff6-4af8-ae2b-514e7cfe3753 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:16.636593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eb1b3-7ff6-4af8-ae2b-514e7cfe3753 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:16.637037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eb1b3-7ff6-4af8-ae2b-514e7cfe3753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:16.675441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6eb1b3-7ff6-4af8-ae2b-514e7cfe3753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:16.678190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6eb1b3-7ff6-4af8-ae2b-514e7cfe3753 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:16.699785 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2536/5067] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:19.850980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0cc18-25ff-403b-bf10-ded185fce7a4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:19.852578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6bb0cc18-25ff-403b-bf10-ded185fce7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:19.893266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0cc18-25ff-403b-bf10-ded185fce7a4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:19.914999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a12e2d-73e6-400c-8217-57a36f37e611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:19.915984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12e2d-73e6-400c-8217-57a36f37e611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:19.916700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12e2d-73e6-400c-8217-57a36f37e611 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:19.917139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a12e2d-73e6-400c-8217-57a36f37e611 admin admin] PATH_INFO: `/v3/users/89900b5f2e7e45e6a1757b9e7b38add0` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:19.930843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a12e2d-73e6-400c-8217-57a36f37e611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89900b5f2e7e45e6a1757b9e7b38add0)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:19.933481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a12e2d-73e6-400c-8217-57a36f37e611 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:20.084984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f4a12e2d-73e6-400c-8217-57a36f37e611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89900b5f2e7e45e6a1757b9e7b38add0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:20.100236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f4a12e2d-73e6-400c-8217-57a36f37e611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89900b5f2e7e45e6a1757b9e7b38add0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:20.101319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f4a12e2d-73e6-400c-8217-57a36f37e611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89900b5f2e7e45e6a1757b9e7b38add0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:20.137815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f4a12e2d-73e6-400c-8217-57a36f37e611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89900b5f2e7e45e6a1757b9e7b38add0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:20.138642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f4a12e2d-73e6-400c-8217-57a36f37e611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89900b5f2e7e45e6a1757b9e7b38add0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:20.165625 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2532/5068] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:11:19 2022] DELETE /identity/v3/users/89900b5f2e7e45e6a1757b9e7b38add0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:11:20.193176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f531d-c0ab-4dc5-a48a-f51d2a927b3c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:20.193618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f531d-c0ab-4dc5-a48a-f51d2a927b3c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:20.194049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f531d-c0ab-4dc5-a48a-f51d2a927b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:20.257777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-301f531d-c0ab-4dc5-a48a-f51d2a927b3c None None] MFA Rules not processed for user `1ef6c81f1a244e8289a548e6be43de31`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:20.259924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-301f531d-c0ab-4dc5-a48a-f51d2a927b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:20.328223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:20.384610 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2537/5069] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:20.393617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470fc2-b0d8-4719-95dc-3d5411856e7c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:20.393906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470fc2-b0d8-4719-95dc-3d5411856e7c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:20.394384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470fc2-b0d8-4719-95dc-3d5411856e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:20.436587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c8470fc2-b0d8-4719-95dc-3d5411856e7c None None] MFA Rules not processed for user `1ef6c81f1a244e8289a548e6be43de31`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:20.438111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c8470fc2-b0d8-4719-95dc-3d5411856e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:20.459962 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2533/5070] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:20.539691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f531d-c0ab-4dc5-a48a-f51d2a927b3c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:20.541285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-301f531d-c0ab-4dc5-a48a-f51d2a927b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:20.549271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8470fc2-b0d8-4719-95dc-3d5411856e7c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:20.552929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c8470fc2-b0d8-4719-95dc-3d5411856e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:20.688291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8470fc2-b0d8-4719-95dc-3d5411856e7c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:20.694999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:20.695780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:20.696067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:20.696405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9 admin admin] PATH_INFO: `/v3/projects/c13ee2197d3e4c12a807dc3f70619db3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:20.697802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13ee2197d3e4c12a807dc3f70619db3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:20.700697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:20.705157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f531d-c0ab-4dc5-a48a-f51d2a927b3c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:20.712805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:20.716094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748fd10-99f2-4777-ac1f-86cbb1d8d593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:20.717213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748fd10-99f2-4777-ac1f-86cbb1d8d593 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:20.718086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748fd10-99f2-4777-ac1f-86cbb1d8d593 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:20.718806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748fd10-99f2-4777-ac1f-86cbb1d8d593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:20.734961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748fd10-99f2-4777-ac1f-86cbb1d8d593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:20.737149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748fd10-99f2-4777-ac1f-86cbb1d8d593 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:20.754000 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2538/5071] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:20 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:20.780380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13ee2197d3e4c12a807dc3f70619db3', 'request_id': 'req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:20.801064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13ee2197d3e4c12a807dc3f70619db3', 'request_id': 'req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:20.809435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13ee2197d3e4c12a807dc3f70619db3', 'request_id': 'req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:20.828053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9 admin admin] The token cache is being invalidate because project c13ee2197d3e4c12a807dc3f70619db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:11:20.828743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:20.830336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-98b1514c-e8db-4ed9-a65b-c8cc3b2cc4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:20.832558 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2534/5072] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:11:20 2022] DELETE /identity/v3/projects/c13ee2197d3e4c12a807dc3f70619db3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:11:20.840107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bacf1-56b0-4279-9db5-9a249bfb002f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:20.840616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bacf1-56b0-4279-9db5-9a249bfb002f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:20.841099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bacf1-56b0-4279-9db5-9a249bfb002f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:20.881012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9c4bacf1-56b0-4279-9db5-9a249bfb002f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:20.882272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9c4bacf1-56b0-4279-9db5-9a249bfb002f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:21.050353 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2539/5073] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:21.059231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b6c7f-ad87-41e4-a73b-4cbc3b8e3e74 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:21.059231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b6c7f-ad87-41e4-a73b-4cbc3b8e3e74 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:21.060035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b6c7f-ad87-41e4-a73b-4cbc3b8e3e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:21.096738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daabae-c409-41fe-a27b-79ff7df67e97 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:21.097007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daabae-c409-41fe-a27b-79ff7df67e97 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:21.097189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-990b6c7f-ad87-41e4-a73b-4cbc3b8e3e74 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:21.097327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daabae-c409-41fe-a27b-79ff7df67e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:21.101310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-990b6c7f-ad87-41e4-a73b-4cbc3b8e3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:21.138266 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2535/5074] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:21.144214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b6c7f-ad87-41e4-a73b-4cbc3b8e3e74 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:21.168465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b6c7f-ad87-41e4-a73b-4cbc3b8e3e74 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:21.187320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf67f6-0d54-4a7e-bd44-63c415452698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:21.188367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf67f6-0d54-4a7e-bd44-63c415452698 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:21.189277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf67f6-0d54-4a7e-bd44-63c415452698 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:21.190397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf67f6-0d54-4a7e-bd44-63c415452698 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:21.191794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf67f6-0d54-4a7e-bd44-63c415452698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:11:21.193318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf67f6-0d54-4a7e-bd44-63c415452698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:21.197565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf67f6-0d54-4a7e-bd44-63c415452698 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:21.233688 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2536/5075] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:11:21.234272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-99daabae-c409-41fe-a27b-79ff7df67e97 None None] MFA Rules not processed for user `90a03535aa7940679e805674541147ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:21.235562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-99daabae-c409-41fe-a27b-79ff7df67e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:21.237820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf67f6-0d54-4a7e-bd44-63c415452698 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:21.271277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf67f6-0d54-4a7e-bd44-63c415452698 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:21.286464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45867b8a-e6f4-468c-a73f-ea8f9033278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:21.289366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45867b8a-e6f4-468c-a73f-ea8f9033278d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:21.290143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45867b8a-e6f4-468c-a73f-ea8f9033278d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:21.290634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45867b8a-e6f4-468c-a73f-ea8f9033278d admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:21.291539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45867b8a-e6f4-468c-a73f-ea8f9033278d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:21.297641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45867b8a-e6f4-468c-a73f-ea8f9033278d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:21.427853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:21.447544 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2537/5076] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:11:21 2022] POST /identity/v3/projects => generated 393 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:11:21.449145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45867b8a-e6f4-468c-a73f-ea8f9033278d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:21.477731 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2540/5077] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:11:21.478820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99daabae-c409-41fe-a27b-79ff7df67e97 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:21.493983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-99daabae-c409-41fe-a27b-79ff7df67e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:21.508468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99daabae-c409-41fe-a27b-79ff7df67e97 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:21.629223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb7fa5-51b2-483b-ad68-9e116ff07cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:21.631450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb7fa5-51b2-483b-ad68-9e116ff07cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:21.631731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb7fa5-51b2-483b-ad68-9e116ff07cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:21.632002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb7fa5-51b2-483b-ad68-9e116ff07cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:21.632642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb7fa5-51b2-483b-ad68-9e116ff07cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:21.637911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb7fa5-51b2-483b-ad68-9e116ff07cb7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:21.708650 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2541/5078] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:11:21 2022] POST /identity/v3/projects => generated 373 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:11:21.709657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb7fa5-51b2-483b-ad68-9e116ff07cb7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:21.800762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45867b8a-e6f4-468c-a73f-ea8f9033278d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:21.897660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb7fa5-51b2-483b-ad68-9e116ff07cb7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:21.907415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f36a9a-123e-46b2-bb40-f5cbecd8a356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:21.909673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36a9a-123e-46b2-bb40-f5cbecd8a356 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:21.910524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36a9a-123e-46b2-bb40-f5cbecd8a356 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:21.911340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36a9a-123e-46b2-bb40-f5cbecd8a356 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:21.913009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36a9a-123e-46b2-bb40-f5cbecd8a356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:21.916915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36a9a-123e-46b2-bb40-f5cbecd8a356 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:21.959299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86c008-d10e-488a-90eb-924c79e25402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:21.960285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86c008-d10e-488a-90eb-924c79e25402 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:21.965875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86c008-d10e-488a-90eb-924c79e25402 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:21.966092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86c008-d10e-488a-90eb-924c79e25402 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:21.969598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86c008-d10e-488a-90eb-924c79e25402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:21.983643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86c008-d10e-488a-90eb-924c79e25402 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:21.998810 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2542/5079] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:11:21 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:11:22.002919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:22.005750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f36a9a-123e-46b2-bb40-f5cbecd8a356 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:22.033753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f36a9a-123e-46b2-bb40-f5cbecd8a356 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:22.039356 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2538/5080] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:11:21 2022] POST /identity/v3/users => generated 297 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:11:22.041073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86c008-d10e-488a-90eb-924c79e25402 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:22.047392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e052f-804d-41d8-a02b-291723c2c2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:22.049378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e052f-804d-41d8-a02b-291723c2c2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:22.050269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e052f-804d-41d8-a02b-291723c2c2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:22.051039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e052f-804d-41d8-a02b-291723c2c2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:22.053440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e052f-804d-41d8-a02b-291723c2c2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:22.056992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e052f-804d-41d8-a02b-291723c2c2f5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:22.068306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86c008-d10e-488a-90eb-924c79e25402 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:22.086391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2ef75-392b-47ec-8537-7ab55c17b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:22.090528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2ef75-392b-47ec-8537-7ab55c17b63f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:22.092375 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2543/5081] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:11:22.094245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2ef75-392b-47ec-8537-7ab55c17b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:22.094810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2ef75-392b-47ec-8537-7ab55c17b63f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:22.098501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2ef75-392b-47ec-8537-7ab55c17b63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:22.098710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e052f-804d-41d8-a02b-291723c2c2f5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:22.105847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2ef75-392b-47ec-8537-7ab55c17b63f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:22.120586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e052f-804d-41d8-a02b-291723c2c2f5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:22.131001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca071dc-7684-4614-b5ad-5f1c3fe799c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:22.132799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca071dc-7684-4614-b5ad-5f1c3fe799c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:22.133681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca071dc-7684-4614-b5ad-5f1c3fe799c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:22.134972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca071dc-7684-4614-b5ad-5f1c3fe799c2 admin admin] PATH_INFO: `/v3/projects/ebf59ff59bfd4145b85c4e61d6673b13/users/1801d710cd0f40f2a30cc26f2211ddb4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:22.155313 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2539/5082] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:11:22.160967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2ef75-392b-47ec-8537-7ab55c17b63f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:22.178887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2ef75-392b-47ec-8537-7ab55c17b63f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:22.186140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc228ad1-87a6-48ae-bae4-f067a484819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:22.187429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc228ad1-87a6-48ae-bae4-f067a484819c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:22.188239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc228ad1-87a6-48ae-bae4-f067a484819c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:22.188882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca071dc-7684-4614-b5ad-5f1c3fe799c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf59ff59bfd4145b85c4e61d6673b13, user_id=1801d710cd0f40f2a30cc26f2211ddb4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:22.189144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc228ad1-87a6-48ae-bae4-f067a484819c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:22.190075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc228ad1-87a6-48ae-bae4-f067a484819c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:22.191918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc228ad1-87a6-48ae-bae4-f067a484819c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:22.196535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca071dc-7684-4614-b5ad-5f1c3fe799c2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:22.222922 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2540/5083] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:11:22.225386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc228ad1-87a6-48ae-bae4-f067a484819c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:22.239114 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2544/5084] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:11:22 2022] PUT /identity/v3/projects/ebf59ff59bfd4145b85c4e61d6673b13/users/1801d710cd0f40f2a30cc26f2211ddb4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:11:22.247475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca071dc-7684-4614-b5ad-5f1c3fe799c2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:22.251238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc228ad1-87a6-48ae-bae4-f067a484819c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:22.405274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf48227-b922-4ede-a9ee-a86df3e2f7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:22.406601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf48227-b922-4ede-a9ee-a86df3e2f7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:22.406865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf48227-b922-4ede-a9ee-a86df3e2f7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:22.407154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf48227-b922-4ede-a9ee-a86df3e2f7cd admin admin] PATH_INFO: `/v3/projects/be9c6c59665546dd86cd8f85d5307ba2/users/f30fea146339456b8c8db0d702376af0/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:22.455506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf48227-b922-4ede-a9ee-a86df3e2f7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9c6c59665546dd86cd8f85d5307ba2, user_id=f30fea146339456b8c8db0d702376af0, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:22.458581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf48227-b922-4ede-a9ee-a86df3e2f7cd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:22.487172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:22.500846 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2541/5085] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:11:22 2022] PUT /identity/v3/projects/be9c6c59665546dd86cd8f85d5307ba2/users/f30fea146339456b8c8db0d702376af0/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:11:22.504918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c184e-b64a-461e-9a05-8b3c5e221572 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:22.505300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c184e-b64a-461e-9a05-8b3c5e221572 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:22.506134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c184e-b64a-461e-9a05-8b3c5e221572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:22.574296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c65c184e-b64a-461e-9a05-8b3c5e221572 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:22.581217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca071dc-7684-4614-b5ad-5f1c3fe799c2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:22.588048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c65c184e-b64a-461e-9a05-8b3c5e221572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:22.788960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb617dc4-b581-47c8-a21c-87fec9a8945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:22.789592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617dc4-b581-47c8-a21c-87fec9a8945d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:22.789880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617dc4-b581-47c8-a21c-87fec9a8945d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:22.790154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617dc4-b581-47c8-a21c-87fec9a8945d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:22.791351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb617dc4-b581-47c8-a21c-87fec9a8945d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:22.792985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb617dc4-b581-47c8-a21c-87fec9a8945d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:22.850020 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2542/5086] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:22.851526 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2545/5087] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 605 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:11:22.853169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c184e-b64a-461e-9a05-8b3c5e221572 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:22.887716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c184e-b64a-461e-9a05-8b3c5e221572 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:22.898144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785dcbd-3bbd-41cc-b4ab-2f2504d588f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:22.898870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785dcbd-3bbd-41cc-b4ab-2f2504d588f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:22.899158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785dcbd-3bbd-41cc-b4ab-2f2504d588f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:22.899438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785dcbd-3bbd-41cc-b4ab-2f2504d588f1 admin admin] PATH_INFO: `/v3/projects/ebf59ff59bfd4145b85c4e61d6673b13/users/1801d710cd0f40f2a30cc26f2211ddb4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:22.904924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb617dc4-b581-47c8-a21c-87fec9a8945d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:22.907153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fb617dc4-b581-47c8-a21c-87fec9a8945d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:22.915113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785dcbd-3bbd-41cc-b4ab-2f2504d588f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf59ff59bfd4145b85c4e61d6673b13, user_id=1801d710cd0f40f2a30cc26f2211ddb4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:22.925315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785dcbd-3bbd-41cc-b4ab-2f2504d588f1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:22.981265 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2543/5088] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:11:22 2022] PUT /identity/v3/projects/ebf59ff59bfd4145b85c4e61d6673b13/users/1801d710cd0f40f2a30cc26f2211ddb4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:11:23.056639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb617dc4-b581-47c8-a21c-87fec9a8945d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:23.124111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17dda0f-5492-4221-ab85-093ab8ef9305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:23.126705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dda0f-5492-4221-ab85-093ab8ef9305 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:23.127118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dda0f-5492-4221-ab85-093ab8ef9305 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:23.127857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dda0f-5492-4221-ab85-093ab8ef9305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:23.233919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:23.271346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dda0f-5492-4221-ab85-093ab8ef9305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:23.275771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17dda0f-5492-4221-ab85-093ab8ef9305 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:23.309457 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2546/5089] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:27.246309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda23219-5fd8-4794-967e-aa82d5ec0df1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:27.246909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda23219-5fd8-4794-967e-aa82d5ec0df1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:27.246909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda23219-5fd8-4794-967e-aa82d5ec0df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:27.311580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-dda23219-5fd8-4794-967e-aa82d5ec0df1 None None] MFA Rules not processed for user `1801d710cd0f40f2a30cc26f2211ddb4`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:27.313441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dda23219-5fd8-4794-967e-aa82d5ec0df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:27.407755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:27.541017 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2544/5090] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:27.555022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be4fc7-83f2-459f-8272-baa4b7c54506 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:27.555517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be4fc7-83f2-459f-8272-baa4b7c54506 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:27.555609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be4fc7-83f2-459f-8272-baa4b7c54506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:27.616737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-53be4fc7-83f2-459f-8272-baa4b7c54506 None None] MFA Rules not processed for user `90a03535aa7940679e805674541147ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:27.618046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-53be4fc7-83f2-459f-8272-baa4b7c54506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:27.729487 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2547/5091] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:27.738585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda23219-5fd8-4794-967e-aa82d5ec0df1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:27.740407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dda23219-5fd8-4794-967e-aa82d5ec0df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:27.912804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda23219-5fd8-4794-967e-aa82d5ec0df1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:27.930491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2183bb-47cb-4097-8195-7dc3a09bb084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:27.931794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2183bb-47cb-4097-8195-7dc3a09bb084 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:27.932348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2183bb-47cb-4097-8195-7dc3a09bb084 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:27.932897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2183bb-47cb-4097-8195-7dc3a09bb084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:27.963165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2183bb-47cb-4097-8195-7dc3a09bb084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:27.967821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2183bb-47cb-4097-8195-7dc3a09bb084 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:27.993476 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2545/5092] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:37.288926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475f1f-9987-4887-88a0-5dd8b39151f3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:37.289472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475f1f-9987-4887-88a0-5dd8b39151f3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:37.289856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475f1f-9987-4887-88a0-5dd8b39151f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:37.372061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-eb475f1f-9987-4887-88a0-5dd8b39151f3 None None] MFA Rules not processed for user `f30fea146339456b8c8db0d702376af0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:37.375752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-eb475f1f-9987-4887-88a0-5dd8b39151f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:37.556297 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2548/5093] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:37.569074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a4064-8e1e-444a-a178-d4a57f835fe3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:37.569661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a4064-8e1e-444a-a178-d4a57f835fe3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:37.569960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a4064-8e1e-444a-a178-d4a57f835fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:37.633260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-669a4064-8e1e-444a-a178-d4a57f835fe3 None None] MFA Rules not processed for user `f30fea146339456b8c8db0d702376af0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:37.635317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-669a4064-8e1e-444a-a178-d4a57f835fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:37.644599 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2546/5094] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:38.989621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb475f1f-9987-4887-88a0-5dd8b39151f3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:39.010323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb475f1f-9987-4887-88a0-5dd8b39151f3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:39.023788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbb9a0-b0de-432e-b63d-cbfac0bc0332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:39.025129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbb9a0-b0de-432e-b63d-cbfac0bc0332 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:39.025566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbb9a0-b0de-432e-b63d-cbfac0bc0332 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:39.025991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbb9a0-b0de-432e-b63d-cbfac0bc0332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:39.048333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbb9a0-b0de-432e-b63d-cbfac0bc0332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:39.050150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbb9a0-b0de-432e-b63d-cbfac0bc0332 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:39.070429 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2549/5095] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:45.790062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a4064-8e1e-444a-a178-d4a57f835fe3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:45.792432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-669a4064-8e1e-444a-a178-d4a57f835fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:45.808983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a4064-8e1e-444a-a178-d4a57f835fe3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:45.815581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82782ad5-eb58-4dab-a41f-c19977117ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:45.816490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82782ad5-eb58-4dab-a41f-c19977117ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:45.816997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82782ad5-eb58-4dab-a41f-c19977117ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:45.817496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82782ad5-eb58-4dab-a41f-c19977117ebc admin admin] PATH_INFO: `/v3/users/5d5833af8c0a4ca9a844905b5ea94665` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:45.819044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82782ad5-eb58-4dab-a41f-c19977117ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5833af8c0a4ca9a844905b5ea94665)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:45.821511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82782ad5-eb58-4dab-a41f-c19977117ebc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:45.965167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-82782ad5-eb58-4dab-a41f-c19977117ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5833af8c0a4ca9a844905b5ea94665'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:45.983127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-82782ad5-eb58-4dab-a41f-c19977117ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5833af8c0a4ca9a844905b5ea94665'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:45.984227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-82782ad5-eb58-4dab-a41f-c19977117ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5833af8c0a4ca9a844905b5ea94665'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:46.022380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-82782ad5-eb58-4dab-a41f-c19977117ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5833af8c0a4ca9a844905b5ea94665'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:46.023212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-82782ad5-eb58-4dab-a41f-c19977117ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5833af8c0a4ca9a844905b5ea94665'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:46.046208 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2547/5096] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:11:45 2022] DELETE /identity/v3/users/5d5833af8c0a4ca9a844905b5ea94665 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:11:46.337976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbb9a0-b0de-432e-b63d-cbfac0bc0332 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:46.364680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbb9a0-b0de-432e-b63d-cbfac0bc0332 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:46.460801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bd1cd-988a-4126-8253-3fbfd4f1186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:46.461463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bd1cd-988a-4126-8253-3fbfd4f1186b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:46.462327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bd1cd-988a-4126-8253-3fbfd4f1186b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:46.462856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bd1cd-988a-4126-8253-3fbfd4f1186b admin admin] PATH_INFO: `/v3/projects/1976921c67ab40e7a3b9ba6ddbeb8abf` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:46.465069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bd1cd-988a-4126-8253-3fbfd4f1186b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1976921c67ab40e7a3b9ba6ddbeb8abf)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:46.468630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bd1cd-988a-4126-8253-3fbfd4f1186b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:46.490524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:46.570230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-973bd1cd-988a-4126-8253-3fbfd4f1186b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1976921c67ab40e7a3b9ba6ddbeb8abf', 'request_id': 'req-973bd1cd-988a-4126-8253-3fbfd4f1186b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:46.580351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-973bd1cd-988a-4126-8253-3fbfd4f1186b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1976921c67ab40e7a3b9ba6ddbeb8abf', 'request_id': 'req-973bd1cd-988a-4126-8253-3fbfd4f1186b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:46.595968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-973bd1cd-988a-4126-8253-3fbfd4f1186b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1976921c67ab40e7a3b9ba6ddbeb8abf', 'request_id': 'req-973bd1cd-988a-4126-8253-3fbfd4f1186b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:46.648513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-973bd1cd-988a-4126-8253-3fbfd4f1186b admin admin] The token cache is being invalidate because project 1976921c67ab40e7a3b9ba6ddbeb8abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:11:46.648961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-973bd1cd-988a-4126-8253-3fbfd4f1186b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:46.649819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-973bd1cd-988a-4126-8253-3fbfd4f1186b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:11:46.652971 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2550/5097] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:11:46 2022] DELETE /identity/v3/projects/1976921c67ab40e7a3b9ba6ddbeb8abf => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:11:46.658527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08990b9-f16d-4dd8-80af-cd0c0c24c408 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:46.659450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08990b9-f16d-4dd8-80af-cd0c0c24c408 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:46.659744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08990b9-f16d-4dd8-80af-cd0c0c24c408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:46.682587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b08990b9-f16d-4dd8-80af-cd0c0c24c408 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:46.684365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b08990b9-f16d-4dd8-80af-cd0c0c24c408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:46.695984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:46.771976 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2548/5098] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:11:46.780339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b87b7-5b86-442d-9a6d-0a10b60ae9db None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:46.780651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b87b7-5b86-442d-9a6d-0a10b60ae9db None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:46.780933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b87b7-5b86-442d-9a6d-0a10b60ae9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:46.809283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d02b87b7-5b86-442d-9a6d-0a10b60ae9db None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:46.812044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d02b87b7-5b86-442d-9a6d-0a10b60ae9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:46.821713 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2551/5099] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:46.827073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08990b9-f16d-4dd8-80af-cd0c0c24c408 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:46.837660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08990b9-f16d-4dd8-80af-cd0c0c24c408 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:46.843599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d4f4b-0bc6-40bb-8c29-823d45d5f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:46.844237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d4f4b-0bc6-40bb-8c29-823d45d5f856 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:46.844526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d4f4b-0bc6-40bb-8c29-823d45d5f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:46.844804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d4f4b-0bc6-40bb-8c29-823d45d5f856 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:46.845469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d4f4b-0bc6-40bb-8c29-823d45d5f856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:11:46.845777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d4f4b-0bc6-40bb-8c29-823d45d5f856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:46.847454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d4f4b-0bc6-40bb-8c29-823d45d5f856 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:46.860593 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2549/5100] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:11:46.866824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b87b7-5b86-442d-9a6d-0a10b60ae9db None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:46.878640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b87b7-5b86-442d-9a6d-0a10b60ae9db None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:46.886091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd9195-8782-4d48-a226-d0c5513ddba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:46.886308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd9195-8782-4d48-a226-d0c5513ddba7 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:46.886617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd9195-8782-4d48-a226-d0c5513ddba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:46.887439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd9195-8782-4d48-a226-d0c5513ddba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:46.888316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd9195-8782-4d48-a226-d0c5513ddba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:46.890686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd9195-8782-4d48-a226-d0c5513ddba7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:46.938404 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2552/5101] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:11:46 2022] POST /identity/v3/projects => generated 395 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:11:46.942803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d4f4b-0bc6-40bb-8c29-823d45d5f856 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:46.956971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d4f4b-0bc6-40bb-8c29-823d45d5f856 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:47.045060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cdba3-a247-4b0e-aa98-60fefcdcb350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:47.045742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cdba3-a247-4b0e-aa98-60fefcdcb350 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:47.046109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cdba3-a247-4b0e-aa98-60fefcdcb350 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:47.046398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cdba3-a247-4b0e-aa98-60fefcdcb350 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:47.047109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cdba3-a247-4b0e-aa98-60fefcdcb350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:47.049466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cdba3-a247-4b0e-aa98-60fefcdcb350 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:47.079825 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2550/5102] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:11:46 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:11:47.081954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd9195-8782-4d48-a226-d0c5513ddba7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:47.105862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd9195-8782-4d48-a226-d0c5513ddba7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:47.105862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf18ced-f773-44e1-9920-c298cd450cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:47.105862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf18ced-f773-44e1-9920-c298cd450cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:47.105862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf18ced-f773-44e1-9920-c298cd450cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:47.106174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf18ced-f773-44e1-9920-c298cd450cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:47.107266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf18ced-f773-44e1-9920-c298cd450cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:47.109065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf18ced-f773-44e1-9920-c298cd450cb1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:47.130699 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2553/5103] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:11:47.135967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cdba3-a247-4b0e-aa98-60fefcdcb350 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:47.149773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cdba3-a247-4b0e-aa98-60fefcdcb350 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:47.158534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089a6a9-1138-49cd-8ab1-a08de16be736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:47.159289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089a6a9-1138-49cd-8ab1-a08de16be736 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:47.159819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089a6a9-1138-49cd-8ab1-a08de16be736 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:47.160009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089a6a9-1138-49cd-8ab1-a08de16be736 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:47.161074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089a6a9-1138-49cd-8ab1-a08de16be736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:47.163258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089a6a9-1138-49cd-8ab1-a08de16be736 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:47.177117 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2551/5104] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:11:47.186818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf18ced-f773-44e1-9920-c298cd450cb1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:47.193071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf18ced-f773-44e1-9920-c298cd450cb1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:47.198368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cb3ef-b310-4c0e-9116-e843fa62774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:47.199250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cb3ef-b310-4c0e-9116-e843fa62774c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:47.199669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cb3ef-b310-4c0e-9116-e843fa62774c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:47.200018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cb3ef-b310-4c0e-9116-e843fa62774c admin admin] PATH_INFO: `/v3/projects/9939cb9037cd4c0a805d2634f4a94db6/users/4abf9c0cb494437b9cd4415ff5545a0a/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:47.219444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cb3ef-b310-4c0e-9116-e843fa62774c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9939cb9037cd4c0a805d2634f4a94db6, user_id=4abf9c0cb494437b9cd4415ff5545a0a, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:47.222630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cb3ef-b310-4c0e-9116-e843fa62774c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:47.246970 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2554/5105] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:11:47 2022] PUT /identity/v3/projects/9939cb9037cd4c0a805d2634f4a94db6/users/4abf9c0cb494437b9cd4415ff5545a0a/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:11:47.248264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2564c-18c2-46df-b4bf-9209176f8009 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:47.248838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2564c-18c2-46df-b4bf-9209176f8009 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:47.249981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2564c-18c2-46df-b4bf-9209176f8009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:47.281970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e3f2564c-18c2-46df-b4bf-9209176f8009 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:47.281970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e3f2564c-18c2-46df-b4bf-9209176f8009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:47.282373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cb3ef-b310-4c0e-9116-e843fa62774c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:47.283471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-240cb3ef-b310-4c0e-9116-e843fa62774c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:47.370392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cb3ef-b310-4c0e-9116-e843fa62774c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:47.377741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d83e4-d64f-4b66-b179-c106e642a677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:47.379193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d83e4-d64f-4b66-b179-c106e642a677 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:47.380564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d83e4-d64f-4b66-b179-c106e642a677 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:47.381033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d83e4-d64f-4b66-b179-c106e642a677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:47.384935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b41d83e4-d64f-4b66-b179-c106e642a677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:47.428357 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2552/5106] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:47.435610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2564c-18c2-46df-b4bf-9209176f8009 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:47.437522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e3f2564c-18c2-46df-b4bf-9209176f8009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:47.481015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2564c-18c2-46df-b4bf-9209176f8009 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:47.488361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:47.489510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd48ac-7008-4de2-9195-e05e2f14efab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:47.490836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd48ac-7008-4de2-9195-e05e2f14efab service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:47.492301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd48ac-7008-4de2-9195-e05e2f14efab service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:47.492895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd48ac-7008-4de2-9195-e05e2f14efab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:47.514228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd48ac-7008-4de2-9195-e05e2f14efab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:47.516857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd48ac-7008-4de2-9195-e05e2f14efab service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:47.533316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d83e4-d64f-4b66-b179-c106e642a677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:47.535838 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2553/5107] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:47.536595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d83e4-d64f-4b66-b179-c106e642a677 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:47.567309 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2555/5108] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:50.811461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4aefd2-ba95-4e43-9849-70474efff1bc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:50.815840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4aefd2-ba95-4e43-9849-70474efff1bc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:50.816488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4aefd2-ba95-4e43-9849-70474efff1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:50.875237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4d4aefd2-ba95-4e43-9849-70474efff1bc None None] MFA Rules not processed for user `5c52e93e22e14a089145c179740c5c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:50.876723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4d4aefd2-ba95-4e43-9849-70474efff1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:50.881554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:11:50.991619 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2554/5109] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:52.301311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d83e4-d64f-4b66-b179-c106e642a677 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:52.311859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d83e4-d64f-4b66-b179-c106e642a677 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:52.323418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb0e4e-6c35-4b98-a7b4-7a060d85c459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:52.324057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb0e4e-6c35-4b98-a7b4-7a060d85c459 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:52.324345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb0e4e-6c35-4b98-a7b4-7a060d85c459 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:52.324632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb0e4e-6c35-4b98-a7b4-7a060d85c459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:52.332360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f8eb0e4e-6c35-4b98-a7b4-7a060d85c459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:52.386316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb0e4e-6c35-4b98-a7b4-7a060d85c459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:52.387934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb0e4e-6c35-4b98-a7b4-7a060d85c459 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:52.441026 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2556/5110] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:58.393206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4aefd2-ba95-4e43-9849-70474efff1bc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:58.396365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4d4aefd2-ba95-4e43-9849-70474efff1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:58.616430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4aefd2-ba95-4e43-9849-70474efff1bc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:58.626514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71401aa4-5f1f-408f-a723-967f52d1a470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:58.627197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71401aa4-5f1f-408f-a723-967f52d1a470 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:58.627539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71401aa4-5f1f-408f-a723-967f52d1a470 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:58.627828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71401aa4-5f1f-408f-a723-967f52d1a470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:58.639721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-71401aa4-5f1f-408f-a723-967f52d1a470 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:58.737124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5e102-c17c-47e9-a4e7-a2b4745c63f4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:58.738015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5e102-c17c-47e9-a4e7-a2b4745c63f4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:58.738519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5e102-c17c-47e9-a4e7-a2b4745c63f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:58.780451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-18c5e102-c17c-47e9-a4e7-a2b4745c63f4 None None] MFA Rules not processed for user `4abf9c0cb494437b9cd4415ff5545a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:11:58.782546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-18c5e102-c17c-47e9-a4e7-a2b4745c63f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:58.887357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71401aa4-5f1f-408f-a723-967f52d1a470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:58.895234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71401aa4-5f1f-408f-a723-967f52d1a470 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:58.925897 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2555/5111] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:11:58.928051 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2557/5112] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:11:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:11:58.945204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71401aa4-5f1f-408f-a723-967f52d1a470 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:11:58.947836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-71401aa4-5f1f-408f-a723-967f52d1a470 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:11:58.984430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71401aa4-5f1f-408f-a723-967f52d1a470 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:11:59.000324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecbd20-aed1-49ef-8b56-4e4904fa0ea5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:11:59.000988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecbd20-aed1-49ef-8b56-4e4904fa0ea5 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:11:59.001287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecbd20-aed1-49ef-8b56-4e4904fa0ea5 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:11:59.001621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecbd20-aed1-49ef-8b56-4e4904fa0ea5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:11:59.029018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecbd20-aed1-49ef-8b56-4e4904fa0ea5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:11:59.031813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecbd20-aed1-49ef-8b56-4e4904fa0ea5 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:11:59.056319 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2556/5113] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:11:58 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:00.666402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5e102-c17c-47e9-a4e7-a2b4745c63f4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:00.668009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-18c5e102-c17c-47e9-a4e7-a2b4745c63f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:00.695482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5e102-c17c-47e9-a4e7-a2b4745c63f4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:00.704957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:00.710010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:00.710768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:00.712188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] PATH_INFO: `/v3/users/940de3bdb29e498ba1d1d5185ecda577` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:00.714251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] RBAC: Authorizing `identity:delete_user(user_id=940de3bdb29e498ba1d1d5185ecda577)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:00.721765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:00.850880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940de3bdb29e498ba1d1d5185ecda577'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:00.875323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940de3bdb29e498ba1d1d5185ecda577'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:00.881747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940de3bdb29e498ba1d1d5185ecda577'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:00.917906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940de3bdb29e498ba1d1d5185ecda577'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:00.921585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940de3bdb29e498ba1d1d5185ecda577'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:01.013476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28782af4-0a99-435e-9a75-e10d74473c81 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:01.014394 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2558/5114] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:12:00 2022] DELETE /identity/v3/users/940de3bdb29e498ba1d1d5185ecda577 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:01.014610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28782af4-0a99-435e-9a75-e10d74473c81 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:01.015053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28782af4-0a99-435e-9a75-e10d74473c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:01.048943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-28782af4-0a99-435e-9a75-e10d74473c81 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:01.050582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28782af4-0a99-435e-9a75-e10d74473c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:01.173280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:01.199465 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2557/5115] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:12:01.280761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:01.283286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:01.329597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:01.455111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23496105-8ccf-43c4-877a-e7f286f1618b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:01.467902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e5194-47d7-494d-b86b-49c837e21be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:01.470799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e5194-47d7-494d-b86b-49c837e21be2 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:01.471173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e5194-47d7-494d-b86b-49c837e21be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:01.471457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e5194-47d7-494d-b86b-49c837e21be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:01.500493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e5194-47d7-494d-b86b-49c837e21be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:01.508986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e5194-47d7-494d-b86b-49c837e21be2 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:01.548724 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2559/5116] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:02.558021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28782af4-0a99-435e-9a75-e10d74473c81 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:02.576552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28782af4-0a99-435e-9a75-e10d74473c81 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:02.584150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19a3a5-0180-48c3-8ab5-391b35ea38e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:02.585966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19a3a5-0180-48c3-8ab5-391b35ea38e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:02.586471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19a3a5-0180-48c3-8ab5-391b35ea38e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:02.587184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19a3a5-0180-48c3-8ab5-391b35ea38e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:02.591192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fa19a3a5-0180-48c3-8ab5-391b35ea38e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:02.617740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19a3a5-0180-48c3-8ab5-391b35ea38e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:02.631003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19a3a5-0180-48c3-8ab5-391b35ea38e6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:02.644759 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2558/5117] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:03.907983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e5194-47d7-494d-b86b-49c837e21be2 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:03.910621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-967e5194-47d7-494d-b86b-49c837e21be2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:03.931397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e5194-47d7-494d-b86b-49c837e21be2 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:03.937053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:03.938199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:03.938624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:03.939331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b admin admin] PATH_INFO: `/v3/projects/12a12105dd6c4b28b7566c889b325605` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:03.942887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=12a12105dd6c4b28b7566c889b325605)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:03.945536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:04.046601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12a12105dd6c4b28b7566c889b325605', 'request_id': 'req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:04.057812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12a12105dd6c4b28b7566c889b325605', 'request_id': 'req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:04.083840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12a12105dd6c4b28b7566c889b325605', 'request_id': 'req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:04.114438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b admin admin] The token cache is being invalidate because project 12a12105dd6c4b28b7566c889b325605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:12:04.114730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:04.117946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-110fef7e-5e36-437d-9d93-0f9cccd8eb1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:04.129516 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2560/5118] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:12:03 2022] DELETE /identity/v3/projects/12a12105dd6c4b28b7566c889b325605 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:04.134354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868f0cd-f04c-45db-937c-743ad77c8770 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:04.135290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868f0cd-f04c-45db-937c-743ad77c8770 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:04.136101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868f0cd-f04c-45db-937c-743ad77c8770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:04.169465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2868f0cd-f04c-45db-937c-743ad77c8770 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:04.171053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2868f0cd-f04c-45db-937c-743ad77c8770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:04.300970 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2559/5119] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:04.311524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb572f6d-25ab-4a28-a02a-d487bf5178f8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:04.312330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb572f6d-25ab-4a28-a02a-d487bf5178f8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:04.312330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb572f6d-25ab-4a28-a02a-d487bf5178f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:04.350725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-bb572f6d-25ab-4a28-a02a-d487bf5178f8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:04.352994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bb572f6d-25ab-4a28-a02a-d487bf5178f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:04.375552 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2561/5120] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:04.380135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868f0cd-f04c-45db-937c-743ad77c8770 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:04.402032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868f0cd-f04c-45db-937c-743ad77c8770 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:04.416824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c47144-f09b-449d-8578-1d90ee457f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:04.417625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c47144-f09b-449d-8578-1d90ee457f90 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:04.417956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c47144-f09b-449d-8578-1d90ee457f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:04.418240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c47144-f09b-449d-8578-1d90ee457f90 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:04.419797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c47144-f09b-449d-8578-1d90ee457f90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:12:04.420360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c47144-f09b-449d-8578-1d90ee457f90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:04.422192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c47144-f09b-449d-8578-1d90ee457f90 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:04.458989 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2560/5121] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:12:04.463025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb572f6d-25ab-4a28-a02a-d487bf5178f8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:04.482259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb572f6d-25ab-4a28-a02a-d487bf5178f8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:04.488718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd23eac-dbdd-4791-aa61-6810b3fd3ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:04.492065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd23eac-dbdd-4791-aa61-6810b3fd3ded admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:04.492568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd23eac-dbdd-4791-aa61-6810b3fd3ded admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:04.492994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd23eac-dbdd-4791-aa61-6810b3fd3ded admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:04.495742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd23eac-dbdd-4791-aa61-6810b3fd3ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:04.500653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd23eac-dbdd-4791-aa61-6810b3fd3ded admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:04.577792 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2562/5122] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:12:04 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:12:04.582993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c47144-f09b-449d-8578-1d90ee457f90 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:04.602092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c47144-f09b-449d-8578-1d90ee457f90 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:04.742180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aea8f6-bea8-4638-9467-0c369b6014fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:04.743762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aea8f6-bea8-4638-9467-0c369b6014fa admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:04.744059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aea8f6-bea8-4638-9467-0c369b6014fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:04.744354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aea8f6-bea8-4638-9467-0c369b6014fa admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:04.746056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aea8f6-bea8-4638-9467-0c369b6014fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:04.751376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aea8f6-bea8-4638-9467-0c369b6014fa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:04.792964 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2561/5123] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:12:04 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:12:04.797445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd23eac-dbdd-4791-aa61-6810b3fd3ded admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:04.816929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd23eac-dbdd-4791-aa61-6810b3fd3ded admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:04.825490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eac489-6411-4e26-a919-2c9b69b0c879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:04.826201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eac489-6411-4e26-a919-2c9b69b0c879 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:04.826480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eac489-6411-4e26-a919-2c9b69b0c879 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:04.826817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eac489-6411-4e26-a919-2c9b69b0c879 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:04.828021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eac489-6411-4e26-a919-2c9b69b0c879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:04.829020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eac489-6411-4e26-a919-2c9b69b0c879 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:04.869554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aea8f6-bea8-4638-9467-0c369b6014fa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:04.869803 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2563/5124] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:12:04.882243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aea8f6-bea8-4638-9467-0c369b6014fa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:04.891536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0549273-5e35-48c2-b422-a5730a23903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:04.892056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0549273-5e35-48c2-b422-a5730a23903e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:04.892482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0549273-5e35-48c2-b422-a5730a23903e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:04.893180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0549273-5e35-48c2-b422-a5730a23903e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:04.893808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0549273-5e35-48c2-b422-a5730a23903e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:04.896874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0549273-5e35-48c2-b422-a5730a23903e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:04.916848 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2562/5125] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:12:04.918278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eac489-6411-4e26-a919-2c9b69b0c879 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:04.931450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eac489-6411-4e26-a919-2c9b69b0c879 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:04.938978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238aca5-39ef-478c-b931-18b31019a175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:04.940034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238aca5-39ef-478c-b931-18b31019a175 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:04.940472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238aca5-39ef-478c-b931-18b31019a175 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:04.940942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238aca5-39ef-478c-b931-18b31019a175 admin admin] PATH_INFO: `/v3/projects/2ab54437e9e546e58002ced96a27dc72/users/999a0519461e44439ecfb32d9f60de60/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:04.963700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238aca5-39ef-478c-b931-18b31019a175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab54437e9e546e58002ced96a27dc72, user_id=999a0519461e44439ecfb32d9f60de60, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:04.967555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238aca5-39ef-478c-b931-18b31019a175 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:04.998802 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2564/5126] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:12:04 2022] PUT /identity/v3/projects/2ab54437e9e546e58002ced96a27dc72/users/999a0519461e44439ecfb32d9f60de60/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:05.001476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183af8-23f0-4bc8-b59a-f4c1a1172b2e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:05.001608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183af8-23f0-4bc8-b59a-f4c1a1172b2e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:05.001791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183af8-23f0-4bc8-b59a-f4c1a1172b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:05.042217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b7183af8-23f0-4bc8-b59a-f4c1a1172b2e None None] MFA Rules not processed for user `999a0519461e44439ecfb32d9f60de60`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:05.052447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b7183af8-23f0-4bc8-b59a-f4c1a1172b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:05.109396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:05.195177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238aca5-39ef-478c-b931-18b31019a175 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:05.196875 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2563/5127] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:05.197356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d238aca5-39ef-478c-b931-18b31019a175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:05.336596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:05.463334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238aca5-39ef-478c-b931-18b31019a175 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:05.478414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f82595-3b19-452c-aa35-0d499d7e515e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:05.482633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f82595-3b19-452c-aa35-0d499d7e515e service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:05.483185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f82595-3b19-452c-aa35-0d499d7e515e service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:05.484024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f82595-3b19-452c-aa35-0d499d7e515e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:05.533543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f82595-3b19-452c-aa35-0d499d7e515e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:05.538188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f82595-3b19-452c-aa35-0d499d7e515e service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:05.578346 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2565/5128] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:12:09.910400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7183af8-23f0-4bc8-b59a-f4c1a1172b2e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:09.912321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b7183af8-23f0-4bc8-b59a-f4c1a1172b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:10.078878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7183af8-23f0-4bc8-b59a-f4c1a1172b2e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:10.089493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567ff7e-e3f3-4f97-a125-02c127e7d4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:10.091940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567ff7e-e3f3-4f97-a125-02c127e7d4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:10.092248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567ff7e-e3f3-4f97-a125-02c127e7d4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:10.096692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567ff7e-e3f3-4f97-a125-02c127e7d4a5 admin admin] PATH_INFO: `/v3/users/1ef6c81f1a244e8289a548e6be43de31` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:10.100011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567ff7e-e3f3-4f97-a125-02c127e7d4a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef6c81f1a244e8289a548e6be43de31)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:10.108412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567ff7e-e3f3-4f97-a125-02c127e7d4a5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:10.230237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7567ff7e-e3f3-4f97-a125-02c127e7d4a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef6c81f1a244e8289a548e6be43de31'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:10.242573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7567ff7e-e3f3-4f97-a125-02c127e7d4a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef6c81f1a244e8289a548e6be43de31'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:10.243447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7567ff7e-e3f3-4f97-a125-02c127e7d4a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef6c81f1a244e8289a548e6be43de31'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:10.261932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7567ff7e-e3f3-4f97-a125-02c127e7d4a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef6c81f1a244e8289a548e6be43de31'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:10.263205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7567ff7e-e3f3-4f97-a125-02c127e7d4a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef6c81f1a244e8289a548e6be43de31'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:10.318765 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2564/5129] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:12:09 2022] DELETE /identity/v3/users/1ef6c81f1a244e8289a548e6be43de31 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:11.014826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f82595-3b19-452c-aa35-0d499d7e515e service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:11.045109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f82595-3b19-452c-aa35-0d499d7e515e service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:11.204925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8f379-4235-4c93-8f43-72406b017bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:11.206023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f379-4235-4c93-8f43-72406b017bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:11.206023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f379-4235-4c93-8f43-72406b017bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:11.206265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f379-4235-4c93-8f43-72406b017bd4 admin admin] PATH_INFO: `/v3/projects/7b0ab5cf56914726834f8a35321136e4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:11.207391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8f379-4235-4c93-8f43-72406b017bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0ab5cf56914726834f8a35321136e4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:11.209331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8f379-4235-4c93-8f43-72406b017bd4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:11.341263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-28c8f379-4235-4c93-8f43-72406b017bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0ab5cf56914726834f8a35321136e4', 'request_id': 'req-28c8f379-4235-4c93-8f43-72406b017bd4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:11.350853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-28c8f379-4235-4c93-8f43-72406b017bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0ab5cf56914726834f8a35321136e4', 'request_id': 'req-28c8f379-4235-4c93-8f43-72406b017bd4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:11.359012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-28c8f379-4235-4c93-8f43-72406b017bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0ab5cf56914726834f8a35321136e4', 'request_id': 'req-28c8f379-4235-4c93-8f43-72406b017bd4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:11.379992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-28c8f379-4235-4c93-8f43-72406b017bd4 admin admin] The token cache is being invalidate because project 7b0ab5cf56914726834f8a35321136e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:12:11.380538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-28c8f379-4235-4c93-8f43-72406b017bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:11.381538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-28c8f379-4235-4c93-8f43-72406b017bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:11.384830 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2566/5130] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:12:11 2022] DELETE /identity/v3/projects/7b0ab5cf56914726834f8a35321136e4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:11.391288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf30ca-6af3-451b-8168-724f8a7c8e4a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:11.391743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf30ca-6af3-451b-8168-724f8a7c8e4a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:11.391856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf30ca-6af3-451b-8168-724f8a7c8e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:11.471035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3ecf30ca-6af3-451b-8168-724f8a7c8e4a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:11.473726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3ecf30ca-6af3-451b-8168-724f8a7c8e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:11.643624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:11.690843 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2565/5131] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:11.693807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e9739-1600-4e94-95f4-d1a6e86ad8f7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:11.694216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e9739-1600-4e94-95f4-d1a6e86ad8f7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:11.694601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e9739-1600-4e94-95f4-d1a6e86ad8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:11.756438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-993e9739-1600-4e94-95f4-d1a6e86ad8f7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:11.763159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-993e9739-1600-4e94-95f4-d1a6e86ad8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:11.789495 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2567/5132] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:11.796335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf30ca-6af3-451b-8168-724f8a7c8e4a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:11.815259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf30ca-6af3-451b-8168-724f8a7c8e4a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:11.826230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2cdc3-8820-47ae-9eb4-f67f084d64cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:11.826904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2cdc3-8820-47ae-9eb4-f67f084d64cc admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:11.827193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2cdc3-8820-47ae-9eb4-f67f084d64cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:11.827477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2cdc3-8820-47ae-9eb4-f67f084d64cc admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:11.828142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2cdc3-8820-47ae-9eb4-f67f084d64cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:12:11.828520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2cdc3-8820-47ae-9eb4-f67f084d64cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:11.830907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2cdc3-8820-47ae-9eb4-f67f084d64cc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:11.862875 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2566/5133] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:12:11.868758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e9739-1600-4e94-95f4-d1a6e86ad8f7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:11.897017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e9739-1600-4e94-95f4-d1a6e86ad8f7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:11.906721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09895a04-1b10-47a6-8e1f-65e42d184a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:11.907687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09895a04-1b10-47a6-8e1f-65e42d184a57 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:11.908210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09895a04-1b10-47a6-8e1f-65e42d184a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:11.908853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09895a04-1b10-47a6-8e1f-65e42d184a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:11.909729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09895a04-1b10-47a6-8e1f-65e42d184a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:11.912166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09895a04-1b10-47a6-8e1f-65e42d184a57 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:11.982832 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2568/5134] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:12:11 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:12:11.985548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2cdc3-8820-47ae-9eb4-f67f084d64cc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:12.005923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2cdc3-8820-47ae-9eb4-f67f084d64cc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:12.232298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c516343-2904-44ec-b885-806e5548b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:12.232947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c516343-2904-44ec-b885-806e5548b92f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:12.233231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c516343-2904-44ec-b885-806e5548b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:12.233513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c516343-2904-44ec-b885-806e5548b92f admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:12.235028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c516343-2904-44ec-b885-806e5548b92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:12.237401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c516343-2904-44ec-b885-806e5548b92f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:12.287579 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2567/5135] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:12:11 2022] POST /identity/v3/users => generated 290 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:12:12.289421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09895a04-1b10-47a6-8e1f-65e42d184a57 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:12.326786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09895a04-1b10-47a6-8e1f-65e42d184a57 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:12.346002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c3588-6802-417a-8f43-48650c3789dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:12.347330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c3588-6802-417a-8f43-48650c3789dc admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:12.348294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c3588-6802-417a-8f43-48650c3789dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:12.350701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c3588-6802-417a-8f43-48650c3789dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:12.352080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c3588-6802-417a-8f43-48650c3789dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:12.357898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c3588-6802-417a-8f43-48650c3789dc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:12.393642 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2569/5136] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:12:12.400582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c516343-2904-44ec-b885-806e5548b92f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:12.433418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c516343-2904-44ec-b885-806e5548b92f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:12.481513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d73e4-e483-49c3-b0f1-326fe577980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:12.482619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d73e4-e483-49c3-b0f1-326fe577980e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:12.491316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d73e4-e483-49c3-b0f1-326fe577980e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:12.491923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d73e4-e483-49c3-b0f1-326fe577980e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:12.497908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d73e4-e483-49c3-b0f1-326fe577980e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:12.508595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d73e4-e483-49c3-b0f1-326fe577980e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:12.544202 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2568/5137] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:12:12.548235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c3588-6802-417a-8f43-48650c3789dc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:12.570020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c3588-6802-417a-8f43-48650c3789dc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:12.624686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a314-2aa6-4df3-b1ac-d65e0c9919d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:12.626018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a314-2aa6-4df3-b1ac-d65e0c9919d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:12.626541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a314-2aa6-4df3-b1ac-d65e0c9919d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:12.627081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a314-2aa6-4df3-b1ac-d65e0c9919d2 admin admin] PATH_INFO: `/v3/projects/eaa59de15bec4f9fbeb72bf62b18e40b/users/c5265d83d5ae4494b59597802d052593/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:12.699527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0a314-2aa6-4df3-b1ac-d65e0c9919d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa59de15bec4f9fbeb72bf62b18e40b, user_id=c5265d83d5ae4494b59597802d052593, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:12.707528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0a314-2aa6-4df3-b1ac-d65e0c9919d2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:12.752793 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2570/5138] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:12:12 2022] PUT /identity/v3/projects/eaa59de15bec4f9fbeb72bf62b18e40b/users/c5265d83d5ae4494b59597802d052593/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:12.758578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a20e10-a208-4a0d-91b7-0b363297b3a7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:12.759336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a20e10-a208-4a0d-91b7-0b363297b3a7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:12.759648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a20e10-a208-4a0d-91b7-0b363297b3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:12.809031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-54a20e10-a208-4a0d-91b7-0b363297b3a7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:12.813772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-54a20e10-a208-4a0d-91b7-0b363297b3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:13.010441 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2569/5139] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:12:13.033257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a314-2aa6-4df3-b1ac-d65e0c9919d2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:13.035613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1be0a314-2aa6-4df3-b1ac-d65e0c9919d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:13.064896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:13.386732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a314-2aa6-4df3-b1ac-d65e0c9919d2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:13.407185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e2322-befb-4bec-b87b-5efd922e1ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:13.409897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e2322-befb-4bec-b87b-5efd922e1ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:13.411371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e2322-befb-4bec-b87b-5efd922e1ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:13.415668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e2322-befb-4bec-b87b-5efd922e1ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:13.456491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e2322-befb-4bec-b87b-5efd922e1ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:13.460810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e2322-befb-4bec-b87b-5efd922e1ab3 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:13.488212 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2571/5140] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:15.144791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a20e10-a208-4a0d-91b7-0b363297b3a7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:15.146677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-54a20e10-a208-4a0d-91b7-0b363297b3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:15.178434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a20e10-a208-4a0d-91b7-0b363297b3a7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:15.198164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2740ef-a841-42ba-beb9-f024f5eb2af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:15.198858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2740ef-a841-42ba-beb9-f024f5eb2af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:15.199146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2740ef-a841-42ba-beb9-f024f5eb2af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:15.199422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2740ef-a841-42ba-beb9-f024f5eb2af4 admin admin] PATH_INFO: `/v3/users/4abf9c0cb494437b9cd4415ff5545a0a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:15.208315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2740ef-a841-42ba-beb9-f024f5eb2af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abf9c0cb494437b9cd4415ff5545a0a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:15.216251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2740ef-a841-42ba-beb9-f024f5eb2af4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:15.389079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4f2740ef-a841-42ba-beb9-f024f5eb2af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abf9c0cb494437b9cd4415ff5545a0a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:15.415135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:15.419608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4f2740ef-a841-42ba-beb9-f024f5eb2af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abf9c0cb494437b9cd4415ff5545a0a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:15.421566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4f2740ef-a841-42ba-beb9-f024f5eb2af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abf9c0cb494437b9cd4415ff5545a0a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:15.470785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4f2740ef-a841-42ba-beb9-f024f5eb2af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abf9c0cb494437b9cd4415ff5545a0a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:15.472430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4f2740ef-a841-42ba-beb9-f024f5eb2af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abf9c0cb494437b9cd4415ff5545a0a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:15.507970 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2570/5141] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:12:15 2022] DELETE /identity/v3/users/4abf9c0cb494437b9cd4415ff5545a0a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:16.552640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e2322-befb-4bec-b87b-5efd922e1ab3 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:16.599677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e2322-befb-4bec-b87b-5efd922e1ab3 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:16.848833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a67d86-1736-4d88-b14e-b64056731fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:16.849736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a67d86-1736-4d88-b14e-b64056731fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:16.850182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a67d86-1736-4d88-b14e-b64056731fff admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:16.850623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a67d86-1736-4d88-b14e-b64056731fff admin admin] PATH_INFO: `/v3/projects/9939cb9037cd4c0a805d2634f4a94db6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:16.852142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a67d86-1736-4d88-b14e-b64056731fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9939cb9037cd4c0a805d2634f4a94db6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:16.854689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a67d86-1736-4d88-b14e-b64056731fff admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:16.972064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-76a67d86-1736-4d88-b14e-b64056731fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9939cb9037cd4c0a805d2634f4a94db6', 'request_id': 'req-76a67d86-1736-4d88-b14e-b64056731fff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:16.993683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-76a67d86-1736-4d88-b14e-b64056731fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9939cb9037cd4c0a805d2634f4a94db6', 'request_id': 'req-76a67d86-1736-4d88-b14e-b64056731fff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:17.006403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-76a67d86-1736-4d88-b14e-b64056731fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9939cb9037cd4c0a805d2634f4a94db6', 'request_id': 'req-76a67d86-1736-4d88-b14e-b64056731fff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:17.043316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-76a67d86-1736-4d88-b14e-b64056731fff admin admin] The token cache is being invalidate because project 9939cb9037cd4c0a805d2634f4a94db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:12:17.044212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-76a67d86-1736-4d88-b14e-b64056731fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:17.045720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-76a67d86-1736-4d88-b14e-b64056731fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:17.053806 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2572/5142] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:12:16 2022] DELETE /identity/v3/projects/9939cb9037cd4c0a805d2634f4a94db6 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:17.055668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85453bb2-fe6e-405f-9af6-ca22a887cb89 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:17.056122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85453bb2-fe6e-405f-9af6-ca22a887cb89 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:17.056525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85453bb2-fe6e-405f-9af6-ca22a887cb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:17.119477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-85453bb2-fe6e-405f-9af6-ca22a887cb89 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:17.122437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-85453bb2-fe6e-405f-9af6-ca22a887cb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:17.265659 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2571/5143] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:17.267787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa2621-9fe4-4c62-9565-87355fa1f50d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:17.268343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa2621-9fe4-4c62-9565-87355fa1f50d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:17.268866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa2621-9fe4-4c62-9565-87355fa1f50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:17.303918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8bfa2621-9fe4-4c62-9565-87355fa1f50d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:17.306856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8bfa2621-9fe4-4c62-9565-87355fa1f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:17.332671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85453bb2-fe6e-405f-9af6-ca22a887cb89 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:17.343787 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2573/5144] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:17.350112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85453bb2-fe6e-405f-9af6-ca22a887cb89 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:17.365866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba9d82-afcf-42ea-bf74-9707be5c5c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:17.366548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba9d82-afcf-42ea-bf74-9707be5c5c12 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:17.367063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba9d82-afcf-42ea-bf74-9707be5c5c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:17.367342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba9d82-afcf-42ea-bf74-9707be5c5c12 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:17.367932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba9d82-afcf-42ea-bf74-9707be5c5c12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:12:17.368389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba9d82-afcf-42ea-bf74-9707be5c5c12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:17.372254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba9d82-afcf-42ea-bf74-9707be5c5c12 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:17.399550 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2572/5145] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:12:17.404595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa2621-9fe4-4c62-9565-87355fa1f50d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:17.417731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa2621-9fe4-4c62-9565-87355fa1f50d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:17.436560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715a3aa-1b7b-496e-8902-f9727cc09210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:17.437184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715a3aa-1b7b-496e-8902-f9727cc09210 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:17.437458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715a3aa-1b7b-496e-8902-f9727cc09210 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:17.437740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715a3aa-1b7b-496e-8902-f9727cc09210 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:17.438577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715a3aa-1b7b-496e-8902-f9727cc09210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:17.441883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715a3aa-1b7b-496e-8902-f9727cc09210 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:17.508595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba9d82-afcf-42ea-bf74-9707be5c5c12 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:17.521916 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2574/5146] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:12:17 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:12:17.530290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba9d82-afcf-42ea-bf74-9707be5c5c12 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:17.655051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76f4d8-349d-4e52-b6db-fec6a6bc5e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:17.656603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f4d8-349d-4e52-b6db-fec6a6bc5e18 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:17.656894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f4d8-349d-4e52-b6db-fec6a6bc5e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:17.657174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76f4d8-349d-4e52-b6db-fec6a6bc5e18 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:17.657832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76f4d8-349d-4e52-b6db-fec6a6bc5e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:17.664723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76f4d8-349d-4e52-b6db-fec6a6bc5e18 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:17.711379 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2573/5147] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:12:17 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:12:17.723816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715a3aa-1b7b-496e-8902-f9727cc09210 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:17.739014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715a3aa-1b7b-496e-8902-f9727cc09210 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:17.748058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178eef3-91e4-46a0-986b-939d59589baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:17.748935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178eef3-91e4-46a0-986b-939d59589baa admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:17.749543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178eef3-91e4-46a0-986b-939d59589baa admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:17.749968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178eef3-91e4-46a0-986b-939d59589baa admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:17.751245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178eef3-91e4-46a0-986b-939d59589baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:17.753340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178eef3-91e4-46a0-986b-939d59589baa admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:17.761290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:17.771960 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2575/5148] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:12:17.776861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76f4d8-349d-4e52-b6db-fec6a6bc5e18 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:17.798754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76f4d8-349d-4e52-b6db-fec6a6bc5e18 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:17.816514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7830644-6647-435f-b8e6-47a84803abb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:17.818227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7830644-6647-435f-b8e6-47a84803abb0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:17.819645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7830644-6647-435f-b8e6-47a84803abb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:17.820032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7830644-6647-435f-b8e6-47a84803abb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:17.820796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7830644-6647-435f-b8e6-47a84803abb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:17.825477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7830644-6647-435f-b8e6-47a84803abb0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:17.873102 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2574/5149] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:12:17.875722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178eef3-91e4-46a0-986b-939d59589baa admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:17.895747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178eef3-91e4-46a0-986b-939d59589baa admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:17.920883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e214e10-7a75-425f-bbca-ab11b70a045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:17.921863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e214e10-7a75-425f-bbca-ab11b70a045a admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:17.922020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e214e10-7a75-425f-bbca-ab11b70a045a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:17.922302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e214e10-7a75-425f-bbca-ab11b70a045a admin admin] PATH_INFO: `/v3/projects/f7bc76e114594662bbc2f4c27c3bdb5a/users/6068e4a4e13549ab8deab4bbd4804f0d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:17.993980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e214e10-7a75-425f-bbca-ab11b70a045a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7bc76e114594662bbc2f4c27c3bdb5a, user_id=6068e4a4e13549ab8deab4bbd4804f0d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:18.001990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e214e10-7a75-425f-bbca-ab11b70a045a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:18.039878 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2576/5150] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:12:17 2022] PUT /identity/v3/projects/f7bc76e114594662bbc2f4c27c3bdb5a/users/6068e4a4e13549ab8deab4bbd4804f0d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:18.045662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588e472-17dd-4251-be54-44fd9c8cfe6e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:18.045832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588e472-17dd-4251-be54-44fd9c8cfe6e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:18.046025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588e472-17dd-4251-be54-44fd9c8cfe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:18.098819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b588e472-17dd-4251-be54-44fd9c8cfe6e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:18.100098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b588e472-17dd-4251-be54-44fd9c8cfe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:18.183272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:18.268176 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2575/5151] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:18.336309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e214e10-7a75-425f-bbca-ab11b70a045a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:18.339231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8e214e10-7a75-425f-bbca-ab11b70a045a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:18.506684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e214e10-7a75-425f-bbca-ab11b70a045a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:18.517363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e50f0-4bdc-4a07-9adc-0680a3119954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:18.518786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e50f0-4bdc-4a07-9adc-0680a3119954 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:18.520088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e50f0-4bdc-4a07-9adc-0680a3119954 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:18.520371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e50f0-4bdc-4a07-9adc-0680a3119954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:18.548597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e50f0-4bdc-4a07-9adc-0680a3119954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:18.551609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e50f0-4bdc-4a07-9adc-0680a3119954 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:18.589299 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2577/5152] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:27.999157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960e30d-1364-4162-959b-051ec2c472d9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:27.999871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960e30d-1364-4162-959b-051ec2c472d9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:28.000155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960e30d-1364-4162-959b-051ec2c472d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:28.093610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4960e30d-1364-4162-959b-051ec2c472d9 None None] MFA Rules not processed for user `c5265d83d5ae4494b59597802d052593`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:28.094873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4960e30d-1364-4162-959b-051ec2c472d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:28.298539 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2576/5153] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:28.315243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e50f0-4bdc-4a07-9adc-0680a3119954 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:28.318218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b24e50f0-4bdc-4a07-9adc-0680a3119954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:28.510385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e50f0-4bdc-4a07-9adc-0680a3119954 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:28.527510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079851c1-133e-4b44-9432-bcdd0b046e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:28.531240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079851c1-133e-4b44-9432-bcdd0b046e4f service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:28.531814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079851c1-133e-4b44-9432-bcdd0b046e4f service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:28.532234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079851c1-133e-4b44-9432-bcdd0b046e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:28.557296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079851c1-133e-4b44-9432-bcdd0b046e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:28.570876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079851c1-133e-4b44-9432-bcdd0b046e4f service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:28.604991 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2578/5154] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:30.582460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631791e8-cf70-4d7f-97aa-830827276e6d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:30.583067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631791e8-cf70-4d7f-97aa-830827276e6d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:30.583067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631791e8-cf70-4d7f-97aa-830827276e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:30.619624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-631791e8-cf70-4d7f-97aa-830827276e6d None None] MFA Rules not processed for user `5c52e93e22e14a089145c179740c5c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:30.623990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-631791e8-cf70-4d7f-97aa-830827276e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:30.795649 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2577/5155] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:12:37.193573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079851c1-133e-4b44-9432-bcdd0b046e4f service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:37.195397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-079851c1-133e-4b44-9432-bcdd0b046e4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:37.240193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079851c1-133e-4b44-9432-bcdd0b046e4f service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:37.257574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb845f-b8e5-406e-a223-c3d2c3a30a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:37.257574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb845f-b8e5-406e-a223-c3d2c3a30a19 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:37.257574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb845f-b8e5-406e-a223-c3d2c3a30a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:37.257574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb845f-b8e5-406e-a223-c3d2c3a30a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:37.258591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-20eb845f-b8e5-406e-a223-c3d2c3a30a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:37.272625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb845f-b8e5-406e-a223-c3d2c3a30a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:37.274536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb845f-b8e5-406e-a223-c3d2c3a30a19 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:37.287517 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2579/5156] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:37.768119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244b119-0161-4e59-853b-19ccd5ecea99 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:37.768722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244b119-0161-4e59-853b-19ccd5ecea99 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:37.768722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244b119-0161-4e59-853b-19ccd5ecea99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:37.813514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0244b119-0161-4e59-853b-19ccd5ecea99 None None] MFA Rules not processed for user `c5265d83d5ae4494b59597802d052593`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:37.820239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0244b119-0161-4e59-853b-19ccd5ecea99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:37.838024 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2578/5157] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:38.745376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb845f-b8e5-406e-a223-c3d2c3a30a19 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:38.747806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-20eb845f-b8e5-406e-a223-c3d2c3a30a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:38.776704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb845f-b8e5-406e-a223-c3d2c3a30a19 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:38.789768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:38.790761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:38.793971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:38.800118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] PATH_INFO: `/v3/users/999a0519461e44439ecfb32d9f60de60` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:38.801889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999a0519461e44439ecfb32d9f60de60)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:38.804180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:38.936312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:38.941769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999a0519461e44439ecfb32d9f60de60'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:38.966319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999a0519461e44439ecfb32d9f60de60'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:38.967139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999a0519461e44439ecfb32d9f60de60'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:38.996418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999a0519461e44439ecfb32d9f60de60'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:38.997482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999a0519461e44439ecfb32d9f60de60'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:39.061649 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2580/5158] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:12:38 2022] DELETE /identity/v3/users/999a0519461e44439ecfb32d9f60de60 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:39.066050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62540842-285d-4822-b75c-6b2e56d5db43 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:39.066596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62540842-285d-4822-b75c-6b2e56d5db43 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:39.066850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62540842-285d-4822-b75c-6b2e56d5db43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:39.174963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-62540842-285d-4822-b75c-6b2e56d5db43 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:39.185160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-62540842-285d-4822-b75c-6b2e56d5db43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:39.451613 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2579/5159] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:39.528414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:39.530127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:39.676951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccaa21-ff3c-4abc-9c79-7764d4f8d7f1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:39.677380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccaa21-ff3c-4abc-9c79-7764d4f8d7f1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:39.677748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccaa21-ff3c-4abc-9c79-7764d4f8d7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:39.697555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe8a0-052c-43fb-91d8-3b8dca8ba903 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:39.705291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fe320-b3ba-46fb-9909-fd0ca0bd7b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:39.705939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fe320-b3ba-46fb-9909-fd0ca0bd7b46 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:39.706222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fe320-b3ba-46fb-9909-fd0ca0bd7b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:39.706496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fe320-b3ba-46fb-9909-fd0ca0bd7b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:39.707570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:39.733010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fe320-b3ba-46fb-9909-fd0ca0bd7b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:39.734409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fe320-b3ba-46fb-9909-fd0ca0bd7b46 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:39.740450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-33ccaa21-ff3c-4abc-9c79-7764d4f8d7f1 None None] MFA Rules not processed for user `6068e4a4e13549ab8deab4bbd4804f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:39.742032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-33ccaa21-ff3c-4abc-9c79-7764d4f8d7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:39.759349 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2581/5160] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:39.890659 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2580/5161] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:12:39.905410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f84f7-b2a5-43d9-828b-1bad566be7d3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:39.908761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f84f7-b2a5-43d9-828b-1bad566be7d3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:39.909503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f84f7-b2a5-43d9-828b-1bad566be7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:39.969818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-142f84f7-b2a5-43d9-828b-1bad566be7d3 None None] MFA Rules not processed for user `6068e4a4e13549ab8deab4bbd4804f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:39.973195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-142f84f7-b2a5-43d9-828b-1bad566be7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:39.993286 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2582/5162] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:40.348188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccaa21-ff3c-4abc-9c79-7764d4f8d7f1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:40.352031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-33ccaa21-ff3c-4abc-9c79-7764d4f8d7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:40.685766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccaa21-ff3c-4abc-9c79-7764d4f8d7f1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:40.707341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb315e0-3bec-434f-bc4e-46b9c33fca29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:40.707926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb315e0-3bec-434f-bc4e-46b9c33fca29 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:40.708217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb315e0-3bec-434f-bc4e-46b9c33fca29 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:40.708499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb315e0-3bec-434f-bc4e-46b9c33fca29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:40.738433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb315e0-3bec-434f-bc4e-46b9c33fca29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:40.740113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb315e0-3bec-434f-bc4e-46b9c33fca29 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:40.777473 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2581/5163] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:41.637926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f84f7-b2a5-43d9-828b-1bad566be7d3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:41.640277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-142f84f7-b2a5-43d9-828b-1bad566be7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:41.671850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f84f7-b2a5-43d9-828b-1bad566be7d3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:41.695502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:41.696445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:41.696912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:41.697344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd admin admin] PATH_INFO: `/v3/projects/2ab54437e9e546e58002ced96a27dc72` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:41.700489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab54437e9e546e58002ced96a27dc72)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:41.702631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:41.903787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab54437e9e546e58002ced96a27dc72', 'request_id': 'req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:41.923702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab54437e9e546e58002ced96a27dc72', 'request_id': 'req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:41.935114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab54437e9e546e58002ced96a27dc72', 'request_id': 'req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:42.033594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd admin admin] The token cache is being invalidate because project 2ab54437e9e546e58002ced96a27dc72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:12:42.034097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:42.045545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee65acdf-911f-47d7-bdd7-7082f6ef3fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:42.046027 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2583/5164] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:12:41 2022] DELETE /identity/v3/projects/2ab54437e9e546e58002ced96a27dc72 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:46.718474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1a196-bcc8-44ce-806a-91bcbbad5df3 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:46.719099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1a196-bcc8-44ce-806a-91bcbbad5df3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:46.719099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1a196-bcc8-44ce-806a-91bcbbad5df3 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:46.720572 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2582/5165] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:12:46.730262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a1592-81cf-4c81-a7a3-f68ad4dd09bc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:46.733992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a1592-81cf-4c81-a7a3-f68ad4dd09bc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:46.734489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a1592-81cf-4c81-a7a3-f68ad4dd09bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:46.806517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-376a1592-81cf-4c81-a7a3-f68ad4dd09bc None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:46.808372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-376a1592-81cf-4c81-a7a3-f68ad4dd09bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:46.962860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:47.005825 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2584/5166] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:12:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:47.190333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1a196-bcc8-44ce-806a-91bcbbad5df3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:47.192197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-03b1a196-bcc8-44ce-806a-91bcbbad5df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:47.214976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1a196-bcc8-44ce-806a-91bcbbad5df3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:47.222082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa06f1-fa97-4065-aa57-54880cb03a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:47.222946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa06f1-fa97-4065-aa57-54880cb03a71 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:47.223389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa06f1-fa97-4065-aa57-54880cb03a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:47.223818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa06f1-fa97-4065-aa57-54880cb03a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:47.234578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa06f1-fa97-4065-aa57-54880cb03a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:47.237396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa06f1-fa97-4065-aa57-54880cb03a71 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:47.248053 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2583/5167] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:48.808926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a1592-81cf-4c81-a7a3-f68ad4dd09bc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:48.811150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-376a1592-81cf-4c81-a7a3-f68ad4dd09bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:48.998966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a1592-81cf-4c81-a7a3-f68ad4dd09bc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:49.006189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663ad5-97e9-498d-8a8f-2e9e0160b212 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:49.008792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663ad5-97e9-498d-8a8f-2e9e0160b212 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:49.008792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663ad5-97e9-498d-8a8f-2e9e0160b212 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:49.008792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b663ad5-97e9-498d-8a8f-2e9e0160b212 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:49.045827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5b663ad5-97e9-498d-8a8f-2e9e0160b212 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:49.082914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b663ad5-97e9-498d-8a8f-2e9e0160b212 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:49.087979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b663ad5-97e9-498d-8a8f-2e9e0160b212 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:49.119764 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2585/5168] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:12:56.284965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa06f1-fa97-4065-aa57-54880cb03a71 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:56.287142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-24aa06f1-fa97-4065-aa57-54880cb03a71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:56.392720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa06f1-fa97-4065-aa57-54880cb03a71 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:56.402329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:56.404780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:56.405455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:56.405902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] PATH_INFO: `/v3/users/90a03535aa7940679e805674541147ec` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:56.408023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a03535aa7940679e805674541147ec)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:56.410883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:56.426468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:56.503194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a03535aa7940679e805674541147ec'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:56.511885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a03535aa7940679e805674541147ec'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:56.512869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a03535aa7940679e805674541147ec'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:56.528361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a03535aa7940679e805674541147ec'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:56.529400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a03535aa7940679e805674541147ec'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:56.550971 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2584/5169] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:12:56 2022] DELETE /identity/v3/users/90a03535aa7940679e805674541147ec => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:56.946247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663ad5-97e9-498d-8a8f-2e9e0160b212 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:56.978669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b663ad5-97e9-498d-8a8f-2e9e0160b212 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:57.060221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:57.061217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:57.061335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:57.061586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] PATH_INFO: `/v3/projects/884d5f23c85342399c9f692166119b2f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:57.062970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=884d5f23c85342399c9f692166119b2f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:57.064941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:57.134394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884d5f23c85342399c9f692166119b2f', 'request_id': 'req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:57.142778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884d5f23c85342399c9f692166119b2f', 'request_id': 'req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:57.152018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884d5f23c85342399c9f692166119b2f', 'request_id': 'req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:57.170891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] The token cache is being invalidate because project 884d5f23c85342399c9f692166119b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:12:57.171361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:57.172324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:57.177590 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2586/5170] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:12:56 2022] DELETE /identity/v3/projects/884d5f23c85342399c9f692166119b2f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:57.179127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:57.181681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:57.202869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76b6c9-3909-46e7-bd09-02fb77f8d94c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:57.278914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:57.279852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:57.280233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:57.281127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] PATH_INFO: `/v3/users/1801d710cd0f40f2a30cc26f2211ddb4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:57.281903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1801d710cd0f40f2a30cc26f2211ddb4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:57.284035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:57.346523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1801d710cd0f40f2a30cc26f2211ddb4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:57.356552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1801d710cd0f40f2a30cc26f2211ddb4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:57.357960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1801d710cd0f40f2a30cc26f2211ddb4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:57.381004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1801d710cd0f40f2a30cc26f2211ddb4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:57.385799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1801d710cd0f40f2a30cc26f2211ddb4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:57.401558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:57.404687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:57.417500 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2585/5171] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:12:57 2022] DELETE /identity/v3/users/1801d710cd0f40f2a30cc26f2211ddb4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:12:57.424090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:57.510831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb5a32-1de4-42ad-a216-de33a4f6f8bf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:57.603448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0657703-cb77-48d7-bbdc-4033a419d1fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:57.604468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0657703-cb77-48d7-bbdc-4033a419d1fd service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:57.605727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0657703-cb77-48d7-bbdc-4033a419d1fd service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:57.606353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0657703-cb77-48d7-bbdc-4033a419d1fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:57.608619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b0657703-cb77-48d7-bbdc-4033a419d1fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:57.625749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0657703-cb77-48d7-bbdc-4033a419d1fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:57.627742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0657703-cb77-48d7-bbdc-4033a419d1fd service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:57.646071 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2587/5172] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:12:58.598697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:58.601742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:58.639161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0657703-cb77-48d7-bbdc-4033a419d1fd service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:58.641061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:58.645017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b0657703-cb77-48d7-bbdc-4033a419d1fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:58.776206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9b5c8-5cf1-47ad-a559-9f4f3dc9623f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:58.789043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dce661-2286-4311-8aea-a37e4e236456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:58.790866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dce661-2286-4311-8aea-a37e4e236456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:58.791444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dce661-2286-4311-8aea-a37e4e236456 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:58.792483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dce661-2286-4311-8aea-a37e4e236456 admin admin] PATH_INFO: `/v3/projects/ebf59ff59bfd4145b85c4e61d6673b13` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:58.796343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dce661-2286-4311-8aea-a37e4e236456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf59ff59bfd4145b85c4e61d6673b13)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:58.799749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dce661-2286-4311-8aea-a37e4e236456 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:58.800952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0657703-cb77-48d7-bbdc-4033a419d1fd service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:58.810093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b8a12-1011-4a68-b3c7-8c3056979e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:58.810093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b8a12-1011-4a68-b3c7-8c3056979e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:58.810093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b8a12-1011-4a68-b3c7-8c3056979e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:58.810093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b8a12-1011-4a68-b3c7-8c3056979e5f admin admin] PATH_INFO: `/v3/users/8236c1461345454bb377bfeef482aeb0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:58.811540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b8a12-1011-4a68-b3c7-8c3056979e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8236c1461345454bb377bfeef482aeb0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:58.813861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b8a12-1011-4a68-b3c7-8c3056979e5f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:58.870697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:58.904253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a8b8a12-1011-4a68-b3c7-8c3056979e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8236c1461345454bb377bfeef482aeb0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:58.917760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a9dce661-2286-4311-8aea-a37e4e236456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf59ff59bfd4145b85c4e61d6673b13', 'request_id': 'req-a9dce661-2286-4311-8aea-a37e4e236456'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:58.922857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a8b8a12-1011-4a68-b3c7-8c3056979e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8236c1461345454bb377bfeef482aeb0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:58.924004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a8b8a12-1011-4a68-b3c7-8c3056979e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8236c1461345454bb377bfeef482aeb0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:58.937890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a9dce661-2286-4311-8aea-a37e4e236456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf59ff59bfd4145b85c4e61d6673b13', 'request_id': 'req-a9dce661-2286-4311-8aea-a37e4e236456'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:58.950863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a8b8a12-1011-4a68-b3c7-8c3056979e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8236c1461345454bb377bfeef482aeb0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:58.951591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a8b8a12-1011-4a68-b3c7-8c3056979e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8236c1461345454bb377bfeef482aeb0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:58.951772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a9dce661-2286-4311-8aea-a37e4e236456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf59ff59bfd4145b85c4e61d6673b13', 'request_id': 'req-a9dce661-2286-4311-8aea-a37e4e236456'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:58.968615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a9dce661-2286-4311-8aea-a37e4e236456 admin admin] The token cache is being invalidate because project ebf59ff59bfd4145b85c4e61d6673b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:12:58.968979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a9dce661-2286-4311-8aea-a37e4e236456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:58.969711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a9dce661-2286-4311-8aea-a37e4e236456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:58.975744 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2586/5173] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:12:58 2022] DELETE /identity/v3/projects/ebf59ff59bfd4145b85c4e61d6673b13 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:58.977377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c89b0-d84d-4f16-a7a8-1246c87c2ce5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:58.977674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c89b0-d84d-4f16-a7a8-1246c87c2ce5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:58.978218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c89b0-d84d-4f16-a7a8-1246c87c2ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:58.985527 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2588/5174] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:12:58 2022] DELETE /identity/v3/users/8236c1461345454bb377bfeef482aeb0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:12:58.990118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd435393-8976-4366-a0ba-89d7e7c53772 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:58.990406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd435393-8976-4366-a0ba-89d7e7c53772 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:58.992716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd435393-8976-4366-a0ba-89d7e7c53772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.009321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-660c89b0-d84d-4f16-a7a8-1246c87c2ce5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:59.011656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-660c89b0-d84d-4f16-a7a8-1246c87c2ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:59.026246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-bd435393-8976-4366-a0ba-89d7e7c53772 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:59.029027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bd435393-8976-4366-a0ba-89d7e7c53772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:59.151041 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2587/5175] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:59.154166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42b79d-4a3c-4fad-b7dc-e4f7c3d5c3e1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:59.154559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42b79d-4a3c-4fad-b7dc-e4f7c3d5c3e1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:59.154967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42b79d-4a3c-4fad-b7dc-e4f7c3d5c3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.158284 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2589/5176] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:59.165695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd435393-8976-4366-a0ba-89d7e7c53772 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:59.167802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bd435393-8976-4366-a0ba-89d7e7c53772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:59.180154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7b42b79d-4a3c-4fad-b7dc-e4f7c3d5c3e1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:59.181667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7b42b79d-4a3c-4fad-b7dc-e4f7c3d5c3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:59.194781 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2588/5177] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:59.197090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42b79d-4a3c-4fad-b7dc-e4f7c3d5c3e1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:59.215698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42b79d-4a3c-4fad-b7dc-e4f7c3d5c3e1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:59.223933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96733a-d1c1-45ab-bad0-f061cef1323b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:59.224521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96733a-d1c1-45ab-bad0-f061cef1323b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:59.225033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96733a-d1c1-45ab-bad0-f061cef1323b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:59.225146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96733a-d1c1-45ab-bad0-f061cef1323b admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.226065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96733a-d1c1-45ab-bad0-f061cef1323b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:12:59.226371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96733a-d1c1-45ab-bad0-f061cef1323b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:59.228057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96733a-d1c1-45ab-bad0-f061cef1323b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:59.245341 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2589/5178] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:12:59.266659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd435393-8976-4366-a0ba-89d7e7c53772 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:59.268720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96733a-d1c1-45ab-bad0-f061cef1323b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:59.271699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef160b29-9f19-405c-a30d-c99658d50111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:59.272590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef160b29-9f19-405c-a30d-c99658d50111 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:59.273080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef160b29-9f19-405c-a30d-c99658d50111 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:59.273460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef160b29-9f19-405c-a30d-c99658d50111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.288191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef160b29-9f19-405c-a30d-c99658d50111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:59.289887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef160b29-9f19-405c-a30d-c99658d50111 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:59.307149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96733a-d1c1-45ab-bad0-f061cef1323b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:59.309627 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2590/5179] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:12:59.320419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4649e-f67b-4894-bf76-b7e001f29954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:59.321781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4649e-f67b-4894-bf76-b7e001f29954 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:59.322445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4649e-f67b-4894-bf76-b7e001f29954 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:59.322903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4649e-f67b-4894-bf76-b7e001f29954 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.324415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4649e-f67b-4894-bf76-b7e001f29954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:59.327492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4649e-f67b-4894-bf76-b7e001f29954 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:59.387965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:59.419604 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2590/5180] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:12:59 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:12:59.422694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef160b29-9f19-405c-a30d-c99658d50111 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:59.437853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef160b29-9f19-405c-a30d-c99658d50111 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:59.511845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:12:59.534612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f2f92-992a-49cf-8672-0bdbde088b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:59.535405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f2f92-992a-49cf-8672-0bdbde088b19 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:59.535761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f2f92-992a-49cf-8672-0bdbde088b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:59.536048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f2f92-992a-49cf-8672-0bdbde088b19 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.537070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f2f92-992a-49cf-8672-0bdbde088b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:59.539343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f2f92-992a-49cf-8672-0bdbde088b19 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:59.585072 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2591/5181] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:12:59 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:12:59.590439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4649e-f67b-4894-bf76-b7e001f29954 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:59.602629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4649e-f67b-4894-bf76-b7e001f29954 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:59.609342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb11cc-ebd0-49c9-84dd-eadce1f0f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:59.610188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb11cc-ebd0-49c9-84dd-eadce1f0f28c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:59.610548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb11cc-ebd0-49c9-84dd-eadce1f0f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:59.610932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb11cc-ebd0-49c9-84dd-eadce1f0f28c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.611682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb11cc-ebd0-49c9-84dd-eadce1f0f28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:59.613597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb11cc-ebd0-49c9-84dd-eadce1f0f28c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:59.625578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f2f92-992a-49cf-8672-0bdbde088b19 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:59.630004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bd4f2f92-992a-49cf-8672-0bdbde088b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:59.635225 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2591/5182] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:12:59.637318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb11cc-ebd0-49c9-84dd-eadce1f0f28c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:59.653040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb11cc-ebd0-49c9-84dd-eadce1f0f28c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:59.661324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892f07c-433a-4c22-a578-998b9cd05878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:59.662095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892f07c-433a-4c22-a578-998b9cd05878 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:59.662423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892f07c-433a-4c22-a578-998b9cd05878 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:59.662886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892f07c-433a-4c22-a578-998b9cd05878 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.663092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f2f92-992a-49cf-8672-0bdbde088b19 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:59.663558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892f07c-433a-4c22-a578-998b9cd05878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:59.665877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892f07c-433a-4c22-a578-998b9cd05878 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:59.669404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:59.670409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:59.671041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:59.671041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb admin admin] PATH_INFO: `/v3/projects/c8c16b51899d43559a9d7a0cbb53f101` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.673254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8c16b51899d43559a9d7a0cbb53f101)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:59.675184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:59.679786 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2592/5183] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:12:59.684513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892f07c-433a-4c22-a578-998b9cd05878 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:59.701474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892f07c-433a-4c22-a578-998b9cd05878 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:59.707151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5d3ff-5ce6-4787-97ad-74b6a4163739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:59.708157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5d3ff-5ce6-4787-97ad-74b6a4163739 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:59.708669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5d3ff-5ce6-4787-97ad-74b6a4163739 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:59.709342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5d3ff-5ce6-4787-97ad-74b6a4163739 admin admin] PATH_INFO: `/v3/projects/3ed9d5709b984277bc282bb35a9cbe8d/users/562ef5953322426d9ba4fdc18aa2b900/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.736371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5d3ff-5ce6-4787-97ad-74b6a4163739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed9d5709b984277bc282bb35a9cbe8d, user_id=562ef5953322426d9ba4fdc18aa2b900, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:12:59.739384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5d3ff-5ce6-4787-97ad-74b6a4163739 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:12:59.761743 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2593/5184] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:12:59 2022] PUT /identity/v3/projects/3ed9d5709b984277bc282bb35a9cbe8d/users/562ef5953322426d9ba4fdc18aa2b900/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:12:59.773990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8c16b51899d43559a9d7a0cbb53f101', 'request_id': 'req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:59.773990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8c16b51899d43559a9d7a0cbb53f101', 'request_id': 'req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:59.775427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8e3c5-53e4-4524-a9b9-c41b36a022ac None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:59.775724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8e3c5-53e4-4524-a9b9-c41b36a022ac None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:59.776001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8e3c5-53e4-4524-a9b9-c41b36a022ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.779969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8c16b51899d43559a9d7a0cbb53f101', 'request_id': 'req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:59.796220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb admin admin] The token cache is being invalidate because project c8c16b51899d43559a9d7a0cbb53f101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:12:59.796505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:59.797359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b41694ea-3448-46fc-9fdb-4f7e0b205ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:12:59.799615 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2592/5185] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:12:59 2022] DELETE /identity/v3/projects/c8c16b51899d43559a9d7a0cbb53f101 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:12:59.804486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2efa2c-2287-48d5-91ce-fc949449171d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:59.804689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2efa2c-2287-48d5-91ce-fc949449171d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:59.804942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2efa2c-2287-48d5-91ce-fc949449171d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.816062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d6d8e3c5-53e4-4524-a9b9-c41b36a022ac None None] MFA Rules not processed for user `562ef5953322426d9ba4fdc18aa2b900`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:59.817304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d6d8e3c5-53e4-4524-a9b9-c41b36a022ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:59.833273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fc2efa2c-2287-48d5-91ce-fc949449171d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:59.834523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fc2efa2c-2287-48d5-91ce-fc949449171d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:59.900292 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2594/5186] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:12:59.907323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8e3c5-53e4-4524-a9b9-c41b36a022ac None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:59.909743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d6d8e3c5-53e4-4524-a9b9-c41b36a022ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:59.926833 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2593/5187] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:59.934234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532de5-7a89-4f70-9051-cd9f8eed49c1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:59.934823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532de5-7a89-4f70-9051-cd9f8eed49c1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:59.935375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532de5-7a89-4f70-9051-cd9f8eed49c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.961218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d4532de5-7a89-4f70-9051-cd9f8eed49c1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:12:59.962466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d4532de5-7a89-4f70-9051-cd9f8eed49c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:12:59.974258 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2594/5188] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:12:59.978302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4532de5-7a89-4f70-9051-cd9f8eed49c1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:12:59.990842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4532de5-7a89-4f70-9051-cd9f8eed49c1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:12:59.996784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daefcd-1944-4cbc-9dbb-383a36194464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:12:59.997405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daefcd-1944-4cbc-9dbb-383a36194464 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:12:59.997689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daefcd-1944-4cbc-9dbb-383a36194464 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:12:59.997969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5daefcd-1944-4cbc-9dbb-383a36194464 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:12:59.998629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daefcd-1944-4cbc-9dbb-383a36194464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:12:59.998980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daefcd-1944-4cbc-9dbb-383a36194464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:00.000602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5daefcd-1944-4cbc-9dbb-383a36194464 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:00.006886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8e3c5-53e4-4524-a9b9-c41b36a022ac None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:00.014292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29196327-382b-4f62-9a55-c8db186b6374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:00.015097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29196327-382b-4f62-9a55-c8db186b6374 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.015386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29196327-382b-4f62-9a55-c8db186b6374 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.015657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29196327-382b-4f62-9a55-c8db186b6374 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.016298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29196327-382b-4f62-9a55-c8db186b6374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:00.018384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29196327-382b-4f62-9a55-c8db186b6374 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:00.018815 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2595/5189] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:13:00.019616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daefcd-1944-4cbc-9dbb-383a36194464 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:00.031990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5daefcd-1944-4cbc-9dbb-383a36194464 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:00.043970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a0fc2-bbd2-40d4-beb6-e123e7727c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:00.044952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a0fc2-bbd2-40d4-beb6-e123e7727c44 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.045068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a0fc2-bbd2-40d4-beb6-e123e7727c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.045343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a0fc2-bbd2-40d4-beb6-e123e7727c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.046058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a0fc2-bbd2-40d4-beb6-e123e7727c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:00.048524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a0fc2-bbd2-40d4-beb6-e123e7727c44 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:00.060212 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2595/5190] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:12:59 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:00.065147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29196327-382b-4f62-9a55-c8db186b6374 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:00.087627 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2596/5191] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:13:00 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:00.089918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a0fc2-bbd2-40d4-beb6-e123e7727c44 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:00.111091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:00.141877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:00.188467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29196327-382b-4f62-9a55-c8db186b6374 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:00.210085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a0fc2-bbd2-40d4-beb6-e123e7727c44 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:00.223442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc139-07a0-4b7f-a914-8307f6ca3551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:00.224398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc139-07a0-4b7f-a914-8307f6ca3551 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.224894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc139-07a0-4b7f-a914-8307f6ca3551 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.225272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc139-07a0-4b7f-a914-8307f6ca3551 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.226025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdc139-07a0-4b7f-a914-8307f6ca3551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:00.230044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdc139-07a0-4b7f-a914-8307f6ca3551 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:00.259894 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2597/5192] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:13:00 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:00.261536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc139-07a0-4b7f-a914-8307f6ca3551 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:00.278503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc139-07a0-4b7f-a914-8307f6ca3551 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:00.284653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24fb26-d196-4f5f-b0b6-a1e12686a3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:00.285527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24fb26-d196-4f5f-b0b6-a1e12686a3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.285904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24fb26-d196-4f5f-b0b6-a1e12686a3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.286275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24fb26-d196-4f5f-b0b6-a1e12686a3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.287156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24fb26-d196-4f5f-b0b6-a1e12686a3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:00.289350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24fb26-d196-4f5f-b0b6-a1e12686a3d4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:00.305076 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2598/5193] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:00.308866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d058146-ecba-4949-b3a3-df8bd11a4228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:00.309601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d058146-ecba-4949-b3a3-df8bd11a4228 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.309891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24fb26-d196-4f5f-b0b6-a1e12686a3d4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:00.310105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d058146-ecba-4949-b3a3-df8bd11a4228 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.310213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d058146-ecba-4949-b3a3-df8bd11a4228 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.310906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d058146-ecba-4949-b3a3-df8bd11a4228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:00.313136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d058146-ecba-4949-b3a3-df8bd11a4228 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:00.323282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24fb26-d196-4f5f-b0b6-a1e12686a3d4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:00.329332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67d5c1-a490-4977-9db0-5084cf28dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:00.330199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67d5c1-a490-4977-9db0-5084cf28dbab admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.330568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67d5c1-a490-4977-9db0-5084cf28dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.330923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67d5c1-a490-4977-9db0-5084cf28dbab admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.331665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67d5c1-a490-4977-9db0-5084cf28dbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:00.333326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67d5c1-a490-4977-9db0-5084cf28dbab admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:00.341702 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2596/5194] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:13:00 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:00.345786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d058146-ecba-4949-b3a3-df8bd11a4228 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:00.353621 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2599/5195] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:13:00.359655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67d5c1-a490-4977-9db0-5084cf28dbab admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:00.363242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d058146-ecba-4949-b3a3-df8bd11a4228 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:00.368950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0f88-5195-4043-9f9d-97db4a8d11be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:00.369912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0f88-5195-4043-9f9d-97db4a8d11be admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.371171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0f88-5195-4043-9f9d-97db4a8d11be admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.371458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea0f88-5195-4043-9f9d-97db4a8d11be admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.372115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea0f88-5195-4043-9f9d-97db4a8d11be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:00.372521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67d5c1-a490-4977-9db0-5084cf28dbab admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:00.373926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea0f88-5195-4043-9f9d-97db4a8d11be admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:00.382981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1767df-cbc8-400a-9886-ff211fe95439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:00.384060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1767df-cbc8-400a-9886-ff211fe95439 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.385393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1767df-cbc8-400a-9886-ff211fe95439 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.386552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1767df-cbc8-400a-9886-ff211fe95439 admin admin] PATH_INFO: `/v3/projects/7b57191d80e8400cbe0499f1769b55ec/users/931d1a8492004345b1278a2ada104270/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.394523 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2597/5196] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:13:00.401370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0f88-5195-4043-9f9d-97db4a8d11be admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:00.413813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1767df-cbc8-400a-9886-ff211fe95439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b57191d80e8400cbe0499f1769b55ec, user_id=931d1a8492004345b1278a2ada104270, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:00.421579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1767df-cbc8-400a-9886-ff211fe95439 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:00.421790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea0f88-5195-4043-9f9d-97db4a8d11be admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:00.428044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068b62c-d883-4258-9028-5e49819c3eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:00.428854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068b62c-d883-4258-9028-5e49819c3eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.429132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068b62c-d883-4258-9028-5e49819c3eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.429406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068b62c-d883-4258-9028-5e49819c3eb9 admin admin] PATH_INFO: `/v3/projects/0f15c66e37f9452baf74efb4b5a39a80/users/366d44a3b22c46049b6923efd99445f8/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.444219 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2600/5197] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:13:00 2022] PUT /identity/v3/projects/7b57191d80e8400cbe0499f1769b55ec/users/931d1a8492004345b1278a2ada104270/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:00.455633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f3fe-e034-4714-afd4-8a2cf48652f6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.456321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f3fe-e034-4714-afd4-8a2cf48652f6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.456321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9f3fe-e034-4714-afd4-8a2cf48652f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.464537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068b62c-d883-4258-9028-5e49819c3eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f15c66e37f9452baf74efb4b5a39a80, user_id=366d44a3b22c46049b6923efd99445f8, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:00.467736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068b62c-d883-4258-9028-5e49819c3eb9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:00.490581 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2598/5198] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:13:00 2022] PUT /identity/v3/projects/0f15c66e37f9452baf74efb4b5a39a80/users/366d44a3b22c46049b6923efd99445f8/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:00.497011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d1a9f3fe-e034-4714-afd4-8a2cf48652f6 None None] MFA Rules not processed for user `931d1a8492004345b1278a2ada104270`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:00.511073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068b62c-d883-4258-9028-5e49819c3eb9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:00.512974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d1a9f3fe-e034-4714-afd4-8a2cf48652f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:00.622195 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2601/5199] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:00.634089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9f3fe-e034-4714-afd4-8a2cf48652f6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:00.636602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068b62c-d883-4258-9028-5e49819c3eb9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:00.637292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d1a9f3fe-e034-4714-afd4-8a2cf48652f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:00.645342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a8dba-5dec-4db5-8078-7d89fde34c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:00.646468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a8dba-5dec-4db5-8078-7d89fde34c4c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.646789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a8dba-5dec-4db5-8078-7d89fde34c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.647075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a8dba-5dec-4db5-8078-7d89fde34c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.647947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a8dba-5dec-4db5-8078-7d89fde34c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:00.650979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a8dba-5dec-4db5-8078-7d89fde34c4c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:00.666082 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2599/5200] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:13:00.671308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a8dba-5dec-4db5-8078-7d89fde34c4c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:00.696576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a8dba-5dec-4db5-8078-7d89fde34c4c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:00.707666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce7da4-d540-4afe-ab10-89cd48f3ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:00.711251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7da4-d540-4afe-ab10-89cd48f3ad72 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.712001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7da4-d540-4afe-ab10-89cd48f3ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.712488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7da4-d540-4afe-ab10-89cd48f3ad72 admin admin] PATH_INFO: `/v3/projects/0f15c66e37f9452baf74efb4b5a39a80/users/366d44a3b22c46049b6923efd99445f8/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.717075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce7da4-d540-4afe-ab10-89cd48f3ad72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f15c66e37f9452baf74efb4b5a39a80, user_id=366d44a3b22c46049b6923efd99445f8, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:00.726853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce7da4-d540-4afe-ab10-89cd48f3ad72 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:00.733879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9f3fe-e034-4714-afd4-8a2cf48652f6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:00.739256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca8489-8ecd-4c40-ae0b-d3b21594a80a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:00.739934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca8489-8ecd-4c40-ae0b-d3b21594a80a service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.740214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca8489-8ecd-4c40-ae0b-d3b21594a80a service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.740485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca8489-8ecd-4c40-ae0b-d3b21594a80a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.752639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca8489-8ecd-4c40-ae0b-d3b21594a80a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:00.754986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca8489-8ecd-4c40-ae0b-d3b21594a80a service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:00.769039 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2600/5201] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:13:00 2022] PUT /identity/v3/projects/0f15c66e37f9452baf74efb4b5a39a80/users/366d44a3b22c46049b6923efd99445f8/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:13:00.769500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:00.770133 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2602/5202] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:00.772748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f4144-296f-4960-a9d1-10f7b5979be4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:00.772748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f4144-296f-4960-a9d1-10f7b5979be4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:00.772990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f4144-296f-4960-a9d1-10f7b5979be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:00.806704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:00.824450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d62f4144-296f-4960-a9d1-10f7b5979be4 None None] MFA Rules not processed for user `366d44a3b22c46049b6923efd99445f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:00.827178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d62f4144-296f-4960-a9d1-10f7b5979be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:00.949520 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2601/5203] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:00.961914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca8489-8ecd-4c40-ae0b-d3b21594a80a service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:00.963890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c3ca8489-8ecd-4c40-ae0b-d3b21594a80a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:01.070549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca8489-8ecd-4c40-ae0b-d3b21594a80a service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:01.166423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70eaba-8530-47dd-bc00-978f6804140f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:01.168038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70eaba-8530-47dd-bc00-978f6804140f service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:01.168422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70eaba-8530-47dd-bc00-978f6804140f service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:01.168795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70eaba-8530-47dd-bc00-978f6804140f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:01.258985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70eaba-8530-47dd-bc00-978f6804140f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:01.261398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70eaba-8530-47dd-bc00-978f6804140f service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:01.274211 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2603/5204] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:10.005588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f4144-296f-4960-a9d1-10f7b5979be4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:10.024469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f4144-296f-4960-a9d1-10f7b5979be4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:10.031129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9395e4-acc4-455f-bdbc-618e1250b593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:10.031895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9395e4-acc4-455f-bdbc-618e1250b593 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:10.032270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9395e4-acc4-455f-bdbc-618e1250b593 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:10.032699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9395e4-acc4-455f-bdbc-618e1250b593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:10.048177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9395e4-acc4-455f-bdbc-618e1250b593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:10.051095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9395e4-acc4-455f-bdbc-618e1250b593 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:10.079254 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2602/5205] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:11.269278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=68 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:15.299423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70eaba-8530-47dd-bc00-978f6804140f service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:15.301844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7f70eaba-8530-47dd-bc00-978f6804140f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:15.645489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70eaba-8530-47dd-bc00-978f6804140f service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:15.675468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ccc2c-5d23-4ba7-8866-a5bcc4f5ca55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:15.682296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ccc2c-5d23-4ba7-8866-a5bcc4f5ca55 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:15.685492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ccc2c-5d23-4ba7-8866-a5bcc4f5ca55 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:15.689776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ccc2c-5d23-4ba7-8866-a5bcc4f5ca55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:15.699421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c32ccc2c-5d23-4ba7-8866-a5bcc4f5ca55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:15.749043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ccc2c-5d23-4ba7-8866-a5bcc4f5ca55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:15.752524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ccc2c-5d23-4ba7-8866-a5bcc4f5ca55 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:15.781521 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2604/5206] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:13:19.940266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9395e4-acc4-455f-bdbc-618e1250b593 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:20.128018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9395e4-acc4-455f-bdbc-618e1250b593 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:20.146386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:20.147098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:20.147565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:20.148028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] PATH_INFO: `/v3/users/931d1a8492004345b1278a2ada104270` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:20.149743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=931d1a8492004345b1278a2ada104270)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:20.152848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:20.271350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931d1a8492004345b1278a2ada104270'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:20.304118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931d1a8492004345b1278a2ada104270'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:20.305208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931d1a8492004345b1278a2ada104270'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:20.332461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931d1a8492004345b1278a2ada104270'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:20.333227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931d1a8492004345b1278a2ada104270'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:20.359790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:20.365394 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2603/5207] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:13:19 2022] DELETE /identity/v3/users/931d1a8492004345b1278a2ada104270 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:20.370341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835be55c-590f-48fe-b10d-edabab9331ae None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:20.370930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835be55c-590f-48fe-b10d-edabab9331ae None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:20.371057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835be55c-590f-48fe-b10d-edabab9331ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:20.420769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-835be55c-590f-48fe-b10d-edabab9331ae None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:20.422380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-835be55c-590f-48fe-b10d-edabab9331ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:20.658092 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2605/5208] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:20.666106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:20.668422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:20.776615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c5faf-fa77-45c0-a0f1-f8d5b6fb5775 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:20.781359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec0a6c-bceb-4d95-8e98-90cd8d128888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:20.782291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec0a6c-bceb-4d95-8e98-90cd8d128888 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:20.782693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec0a6c-bceb-4d95-8e98-90cd8d128888 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:20.783100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec0a6c-bceb-4d95-8e98-90cd8d128888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:20.796413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec0a6c-bceb-4d95-8e98-90cd8d128888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:20.798313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec0a6c-bceb-4d95-8e98-90cd8d128888 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:20.813537 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2604/5209] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:21.256746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835be55c-590f-48fe-b10d-edabab9331ae None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:21.259334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-835be55c-590f-48fe-b10d-edabab9331ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:21.290415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835be55c-590f-48fe-b10d-edabab9331ae None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:21.312524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377f2ff-73d9-41c8-b32f-041782cd8ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:21.314028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377f2ff-73d9-41c8-b32f-041782cd8ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:21.314315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377f2ff-73d9-41c8-b32f-041782cd8ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:21.314595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377f2ff-73d9-41c8-b32f-041782cd8ac1 admin admin] PATH_INFO: `/v3/projects/7b57191d80e8400cbe0499f1769b55ec` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:21.319513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377f2ff-73d9-41c8-b32f-041782cd8ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b57191d80e8400cbe0499f1769b55ec)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:21.325557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377f2ff-73d9-41c8-b32f-041782cd8ac1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:21.467438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5377f2ff-73d9-41c8-b32f-041782cd8ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b57191d80e8400cbe0499f1769b55ec', 'request_id': 'req-5377f2ff-73d9-41c8-b32f-041782cd8ac1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:21.491644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5377f2ff-73d9-41c8-b32f-041782cd8ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b57191d80e8400cbe0499f1769b55ec', 'request_id': 'req-5377f2ff-73d9-41c8-b32f-041782cd8ac1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:21.506488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5377f2ff-73d9-41c8-b32f-041782cd8ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b57191d80e8400cbe0499f1769b55ec', 'request_id': 'req-5377f2ff-73d9-41c8-b32f-041782cd8ac1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:21.536419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5377f2ff-73d9-41c8-b32f-041782cd8ac1 admin admin] The token cache is being invalidate because project 7b57191d80e8400cbe0499f1769b55ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:13:21.537300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5377f2ff-73d9-41c8-b32f-041782cd8ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:21.538308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5377f2ff-73d9-41c8-b32f-041782cd8ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:21.540761 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2606/5210] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:13:21 2022] DELETE /identity/v3/projects/7b57191d80e8400cbe0499f1769b55ec => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:21.546415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c6c57-b0a4-408a-a29f-b8a8ecfa4ac1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:21.546950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c6c57-b0a4-408a-a29f-b8a8ecfa4ac1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:21.547062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c6c57-b0a4-408a-a29f-b8a8ecfa4ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:21.614432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-369c6c57-b0a4-408a-a29f-b8a8ecfa4ac1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:21.615720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-369c6c57-b0a4-408a-a29f-b8a8ecfa4ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:21.833326 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2605/5211] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:21.835243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632b1f2-9d3b-48ad-ac81-29db7fb79a27 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:21.835534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632b1f2-9d3b-48ad-ac81-29db7fb79a27 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:21.836453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632b1f2-9d3b-48ad-ac81-29db7fb79a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:21.857401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c6c57-b0a4-408a-a29f-b8a8ecfa4ac1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:21.858577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-369c6c57-b0a4-408a-a29f-b8a8ecfa4ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:21.881898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4632b1f2-9d3b-48ad-ac81-29db7fb79a27 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:21.887109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c6c57-b0a4-408a-a29f-b8a8ecfa4ac1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:21.887225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4632b1f2-9d3b-48ad-ac81-29db7fb79a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:21.892403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:21.893328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:21.893810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:21.894469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] PATH_INFO: `/v3/users/5c52e93e22e14a089145c179740c5c3a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:21.896812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c52e93e22e14a089145c179740c5c3a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:21.902193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:21.907838 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2607/5212] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:21.909869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632b1f2-9d3b-48ad-ac81-29db7fb79a27 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:21.923941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632b1f2-9d3b-48ad-ac81-29db7fb79a27 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:21.931521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a7a96-7f36-451f-b7bd-0cf37f3958cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:21.933102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a7a96-7f36-451f-b7bd-0cf37f3958cf admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:21.933629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a7a96-7f36-451f-b7bd-0cf37f3958cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:21.934093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a7a96-7f36-451f-b7bd-0cf37f3958cf admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:21.935218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a7a96-7f36-451f-b7bd-0cf37f3958cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:13:21.935761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a7a96-7f36-451f-b7bd-0cf37f3958cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:21.938756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a7a96-7f36-451f-b7bd-0cf37f3958cf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:21.941349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:21.962829 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2608/5213] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:13:21.967990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a7a96-7f36-451f-b7bd-0cf37f3958cf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:21.976373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c52e93e22e14a089145c179740c5c3a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:21.980143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a7a96-7f36-451f-b7bd-0cf37f3958cf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:21.985250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a8e74-71c3-40d4-bc85-6965b0768e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:21.985868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a8e74-71c3-40d4-bc85-6965b0768e33 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:21.986152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a8e74-71c3-40d4-bc85-6965b0768e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:21.986432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a8e74-71c3-40d4-bc85-6965b0768e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:21.987119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a8e74-71c3-40d4-bc85-6965b0768e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:21.987975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c52e93e22e14a089145c179740c5c3a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:21.988945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c52e93e22e14a089145c179740c5c3a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:21.989070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a8e74-71c3-40d4-bc85-6965b0768e33 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:22.015499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c52e93e22e14a089145c179740c5c3a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:22.016106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c52e93e22e14a089145c179740c5c3a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:22.039525 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2609/5214] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:13:21 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:13:22.040616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a8e74-71c3-40d4-bc85-6965b0768e33 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:22.043808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e21a8e74-71c3-40d4-bc85-6965b0768e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:22.046483 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2606/5215] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:13:21 2022] DELETE /identity/v3/users/5c52e93e22e14a089145c179740c5c3a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:22.142045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a8e74-71c3-40d4-bc85-6965b0768e33 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:22.229687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd131fe-d2bc-478d-a905-e1be1d6064ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:22.230594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd131fe-d2bc-478d-a905-e1be1d6064ad admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:22.231131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd131fe-d2bc-478d-a905-e1be1d6064ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:22.231407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd131fe-d2bc-478d-a905-e1be1d6064ad admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:22.232059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd131fe-d2bc-478d-a905-e1be1d6064ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:22.234383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd131fe-d2bc-478d-a905-e1be1d6064ad admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:22.266481 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2610/5216] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:13:22 2022] POST /identity/v3/users => generated 285 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:22.272845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:22.274624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd131fe-d2bc-478d-a905-e1be1d6064ad admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:22.275316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:22.303153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df276816-435d-44a4-b33a-3441de9740b1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:22.305916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd131fe-d2bc-478d-a905-e1be1d6064ad admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:22.312774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e63fc-2e8e-4f99-81b3-efe36a016161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:22.313485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e63fc-2e8e-4f99-81b3-efe36a016161 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:22.313878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e63fc-2e8e-4f99-81b3-efe36a016161 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:22.314157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e63fc-2e8e-4f99-81b3-efe36a016161 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:22.314684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5ee22-92b1-40bb-a75d-bde553ae3071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:22.314996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e63fc-2e8e-4f99-81b3-efe36a016161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:22.315920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5ee22-92b1-40bb-a75d-bde553ae3071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:22.316442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5ee22-92b1-40bb-a75d-bde553ae3071 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:22.316953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5ee22-92b1-40bb-a75d-bde553ae3071 admin admin] PATH_INFO: `/v3/projects/07866dd9afc4444887f34f4483858453` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:22.317072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e63fc-2e8e-4f99-81b3-efe36a016161 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:22.319696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5ee22-92b1-40bb-a75d-bde553ae3071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07866dd9afc4444887f34f4483858453)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:22.323868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5ee22-92b1-40bb-a75d-bde553ae3071 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:22.336243 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2611/5217] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:22.341215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e63fc-2e8e-4f99-81b3-efe36a016161 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:22.368154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e63fc-2e8e-4f99-81b3-efe36a016161 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:22.376645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:22.379512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679d3b5-ee94-4815-babf-b91927253b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:22.380303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679d3b5-ee94-4815-babf-b91927253b42 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:22.381049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679d3b5-ee94-4815-babf-b91927253b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:22.381471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679d3b5-ee94-4815-babf-b91927253b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:22.382311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679d3b5-ee94-4815-babf-b91927253b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:22.387978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679d3b5-ee94-4815-babf-b91927253b42 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:22.419381 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2612/5218] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:22.420891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679d3b5-ee94-4815-babf-b91927253b42 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:22.446418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679d3b5-ee94-4815-babf-b91927253b42 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:22.457957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5e5ee22-92b1-40bb-a75d-bde553ae3071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07866dd9afc4444887f34f4483858453', 'request_id': 'req-d5e5ee22-92b1-40bb-a75d-bde553ae3071'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:22.468136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5e5ee22-92b1-40bb-a75d-bde553ae3071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07866dd9afc4444887f34f4483858453', 'request_id': 'req-d5e5ee22-92b1-40bb-a75d-bde553ae3071'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:22.475549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5e5ee22-92b1-40bb-a75d-bde553ae3071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07866dd9afc4444887f34f4483858453', 'request_id': 'req-d5e5ee22-92b1-40bb-a75d-bde553ae3071'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:22.505549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5e5ee22-92b1-40bb-a75d-bde553ae3071 admin admin] The token cache is being invalidate because project 07866dd9afc4444887f34f4483858453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:13:22.506443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5e5ee22-92b1-40bb-a75d-bde553ae3071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:22.507718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5e5ee22-92b1-40bb-a75d-bde553ae3071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:22.515153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:22.515867 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2607/5219] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:13:22 2022] DELETE /identity/v3/projects/07866dd9afc4444887f34f4483858453 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:22.524718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707be10-250e-4253-8115-02768ca8d1aa None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:22.525505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707be10-250e-4253-8115-02768ca8d1aa None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:22.526396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707be10-250e-4253-8115-02768ca8d1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:22.555748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afac72-f3a5-4d04-94c4-e32362509001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:22.556750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afac72-f3a5-4d04-94c4-e32362509001 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:22.557779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afac72-f3a5-4d04-94c4-e32362509001 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:22.558161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afac72-f3a5-4d04-94c4-e32362509001 admin admin] PATH_INFO: `/v3/projects/2e6906a127444b369ea10b45b7d238db/users/c5cc2a493b6f4c2f9c0572a62d36a249/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:22.580531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afac72-f3a5-4d04-94c4-e32362509001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e6906a127444b369ea10b45b7d238db, user_id=c5cc2a493b6f4c2f9c0572a62d36a249, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:22.584080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afac72-f3a5-4d04-94c4-e32362509001 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:22.607317 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2613/5220] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:13:22 2022] PUT /identity/v3/projects/2e6906a127444b369ea10b45b7d238db/users/c5cc2a493b6f4c2f9c0572a62d36a249/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:22.610704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3707be10-250e-4253-8115-02768ca8d1aa None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:22.611973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3707be10-250e-4253-8115-02768ca8d1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:22.621960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa715360-8d28-4ab2-91a3-35c53288e3d2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:22.622589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa715360-8d28-4ab2-91a3-35c53288e3d2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:22.623125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa715360-8d28-4ab2-91a3-35c53288e3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:22.668123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fa715360-8d28-4ab2-91a3-35c53288e3d2 None None] MFA Rules not processed for user `c5cc2a493b6f4c2f9c0572a62d36a249`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:22.669965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fa715360-8d28-4ab2-91a3-35c53288e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:22.736135 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2608/5221] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:22.745049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bcddc-1068-4502-a051-f39706a962d5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:22.745461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bcddc-1068-4502-a051-f39706a962d5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:22.745742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bcddc-1068-4502-a051-f39706a962d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:22.785654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-778bcddc-1068-4502-a051-f39706a962d5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:22.787043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-778bcddc-1068-4502-a051-f39706a962d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:22.799672 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2609/5222] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:22.800828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bcddc-1068-4502-a051-f39706a962d5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:22.813417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bcddc-1068-4502-a051-f39706a962d5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:22.818901 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2614/5223] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:22.832973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa715360-8d28-4ab2-91a3-35c53288e3d2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:22.834025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe91ba-cff4-4403-b7ad-c05b6a98b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:22.834883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe91ba-cff4-4403-b7ad-c05b6a98b099 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:22.835307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe91ba-cff4-4403-b7ad-c05b6a98b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:22.835690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe91ba-cff4-4403-b7ad-c05b6a98b099 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:22.836092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fa715360-8d28-4ab2-91a3-35c53288e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:22.837012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe91ba-cff4-4403-b7ad-c05b6a98b099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:13:22.839013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe91ba-cff4-4403-b7ad-c05b6a98b099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:22.842233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe91ba-cff4-4403-b7ad-c05b6a98b099 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:22.861623 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2610/5224] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:13:22.868059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe91ba-cff4-4403-b7ad-c05b6a98b099 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:22.880639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe91ba-cff4-4403-b7ad-c05b6a98b099 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:22.887084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86be8f-add9-4f32-af63-4bf55b6dc6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:22.888052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86be8f-add9-4f32-af63-4bf55b6dc6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:22.888406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86be8f-add9-4f32-af63-4bf55b6dc6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:22.888757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86be8f-add9-4f32-af63-4bf55b6dc6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:22.889664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86be8f-add9-4f32-af63-4bf55b6dc6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:22.891920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86be8f-add9-4f32-af63-4bf55b6dc6e1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:22.941133 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2611/5225] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:13:22 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:22.947703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86be8f-add9-4f32-af63-4bf55b6dc6e1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:22.973072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa715360-8d28-4ab2-91a3-35c53288e3d2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:23.041188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:23.070469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86be8f-add9-4f32-af63-4bf55b6dc6e1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:23.081937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a13cbf-8552-4676-8a15-74fb290c080b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:23.084015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a13cbf-8552-4676-8a15-74fb290c080b service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:23.084415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a13cbf-8552-4676-8a15-74fb290c080b service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:23.084794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a13cbf-8552-4676-8a15-74fb290c080b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:23.106522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239e314-def4-46b0-ba4c-19cd74d6a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:23.107582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239e314-def4-46b0-ba4c-19cd74d6a39f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:23.109205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239e314-def4-46b0-ba4c-19cd74d6a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:23.112647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239e314-def4-46b0-ba4c-19cd74d6a39f admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:23.114183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239e314-def4-46b0-ba4c-19cd74d6a39f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:23.117161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239e314-def4-46b0-ba4c-19cd74d6a39f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:23.157814 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2612/5226] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:13:22 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:23.159643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239e314-def4-46b0-ba4c-19cd74d6a39f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:23.174059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239e314-def4-46b0-ba4c-19cd74d6a39f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:23.180040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e08f5-0808-4a3a-aa20-016114348156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:23.180934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e08f5-0808-4a3a-aa20-016114348156 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:23.181415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e08f5-0808-4a3a-aa20-016114348156 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:23.181884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e08f5-0808-4a3a-aa20-016114348156 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:23.183678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e08f5-0808-4a3a-aa20-016114348156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:23.185803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e08f5-0808-4a3a-aa20-016114348156 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:23.203863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:23.214592 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2613/5227] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:23.216189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e08f5-0808-4a3a-aa20-016114348156 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:23.230702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e08f5-0808-4a3a-aa20-016114348156 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:23.236325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f680aba-0bde-4fdf-b94b-fd2f63563e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:23.237189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f680aba-0bde-4fdf-b94b-fd2f63563e23 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:23.237650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f680aba-0bde-4fdf-b94b-fd2f63563e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:23.238304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f680aba-0bde-4fdf-b94b-fd2f63563e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:23.239216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f680aba-0bde-4fdf-b94b-fd2f63563e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:23.241425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f680aba-0bde-4fdf-b94b-fd2f63563e23 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:23.266928 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2614/5228] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:23.268326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f680aba-0bde-4fdf-b94b-fd2f63563e23 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:23.276237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a13cbf-8552-4676-8a15-74fb290c080b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:23.277999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a13cbf-8552-4676-8a15-74fb290c080b service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:23.281106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f680aba-0bde-4fdf-b94b-fd2f63563e23 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:23.286339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2f729-edb4-491e-9fda-547116f4084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:23.287449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2f729-edb4-491e-9fda-547116f4084e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:23.288015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2f729-edb4-491e-9fda-547116f4084e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:23.289507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2f729-edb4-491e-9fda-547116f4084e admin admin] PATH_INFO: `/v3/projects/bdd17dc288744a029f17dc0f2b6d32b9/users/46ef6462029e4cabb094ea2baad1d807/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:23.303801 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2615/5229] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:23.336062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2f729-edb4-491e-9fda-547116f4084e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd17dc288744a029f17dc0f2b6d32b9, user_id=46ef6462029e4cabb094ea2baad1d807, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:23.341081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2f729-edb4-491e-9fda-547116f4084e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:23.383351 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2615/5230] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:13:23 2022] PUT /identity/v3/projects/bdd17dc288744a029f17dc0f2b6d32b9/users/46ef6462029e4cabb094ea2baad1d807/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:23.393630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014b721-86a7-4f57-bad2-d252cdf43482 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:23.393986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014b721-86a7-4f57-bad2-d252cdf43482 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:23.394329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014b721-86a7-4f57-bad2-d252cdf43482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:23.476451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a014b721-86a7-4f57-bad2-d252cdf43482 None None] MFA Rules not processed for user `46ef6462029e4cabb094ea2baad1d807`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:23.478596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a014b721-86a7-4f57-bad2-d252cdf43482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:23.679711 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2616/5231] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:23.709082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2f729-edb4-491e-9fda-547116f4084e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:23.711556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e3e2f729-edb4-491e-9fda-547116f4084e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:23.848937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2f729-edb4-491e-9fda-547116f4084e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:23.853164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104356c-29e1-4503-9af7-0d5c93ca2369 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:23.853920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104356c-29e1-4503-9af7-0d5c93ca2369 service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:23.854651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104356c-29e1-4503-9af7-0d5c93ca2369 service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:23.855093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104356c-29e1-4503-9af7-0d5c93ca2369 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:23.869166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104356c-29e1-4503-9af7-0d5c93ca2369 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:23.870850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104356c-29e1-4503-9af7-0d5c93ca2369 service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:23.903146 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2616/5232] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:25.195305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72befdb8-8945-4975-ace8-7643bd090ed5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:25.195775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72befdb8-8945-4975-ace8-7643bd090ed5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:25.195905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72befdb8-8945-4975-ace8-7643bd090ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:25.268375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-72befdb8-8945-4975-ace8-7643bd090ed5 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:25.269892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-72befdb8-8945-4975-ace8-7643bd090ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:25.406627 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2617/5233] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:13:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:13:25.547297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104356c-29e1-4503-9af7-0d5c93ca2369 service glance] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:25.553672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0104356c-29e1-4503-9af7-0d5c93ca2369 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:25.789776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104356c-29e1-4503-9af7-0d5c93ca2369 service glance] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:25.810928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d7920-bb59-461b-bcd1-c1f0be41ba42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:25.810928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d7920-bb59-461b-bcd1-c1f0be41ba42 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:25.810928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d7920-bb59-461b-bcd1-c1f0be41ba42 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:25.810928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d7920-bb59-461b-bcd1-c1f0be41ba42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:25.833040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d7920-bb59-461b-bcd1-c1f0be41ba42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:25.838489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d7920-bb59-461b-bcd1-c1f0be41ba42 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:25.854295 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2617/5234] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:13:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:13:26.348096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72befdb8-8945-4975-ace8-7643bd090ed5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:26.350572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-72befdb8-8945-4975-ace8-7643bd090ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:26.465624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72befdb8-8945-4975-ace8-7643bd090ed5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:26.472345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:26.473516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:26.474007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:26.474727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] PATH_INFO: `/v3/users/562ef5953322426d9ba4fdc18aa2b900` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:26.476217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562ef5953322426d9ba4fdc18aa2b900)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:26.478673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:26.486449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:26.554061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562ef5953322426d9ba4fdc18aa2b900'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:26.574090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562ef5953322426d9ba4fdc18aa2b900'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:26.581848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562ef5953322426d9ba4fdc18aa2b900'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:26.597236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562ef5953322426d9ba4fdc18aa2b900'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:26.598352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562ef5953322426d9ba4fdc18aa2b900'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:26.623653 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2618/5235] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:13:26 2022] DELETE /identity/v3/users/562ef5953322426d9ba4fdc18aa2b900 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:26.628068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d37737-f4f5-42b2-84a8-108c68bbd494 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:26.628586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d37737-f4f5-42b2-84a8-108c68bbd494 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:26.628952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d37737-f4f5-42b2-84a8-108c68bbd494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:26.656208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-49d37737-f4f5-42b2-84a8-108c68bbd494 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:26.658015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-49d37737-f4f5-42b2-84a8-108c68bbd494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:26.695221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:26.755218 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2618/5236] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:13:26.769955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:26.774372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:26.860653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f82a53-a11d-4ec8-8b3e-5fb1eb4f85c3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:26.864863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cbfc6-56df-4415-846e-a2633d6ae6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:26.865588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cbfc6-56df-4415-846e-a2633d6ae6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:26.865937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cbfc6-56df-4415-846e-a2633d6ae6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:26.866277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cbfc6-56df-4415-846e-a2633d6ae6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:26.879812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cbfc6-56df-4415-846e-a2633d6ae6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:26.881878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cbfc6-56df-4415-846e-a2633d6ae6e4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:26.902127 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2619/5237] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:27.382529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d37737-f4f5-42b2-84a8-108c68bbd494 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:27.384045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-49d37737-f4f5-42b2-84a8-108c68bbd494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:27.404781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1ec48-465b-45e1-b77b-38b1a07d8f21 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:27.406645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1ec48-465b-45e1-b77b-38b1a07d8f21 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:27.407356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1ec48-465b-45e1-b77b-38b1a07d8f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:27.445098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d37737-f4f5-42b2-84a8-108c68bbd494 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:27.474707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:27.476527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:27.477358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:27.478086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] PATH_INFO: `/v3/projects/3ed9d5709b984277bc282bb35a9cbe8d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:27.483284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8ec1ec48-465b-45e1-b77b-38b1a07d8f21 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:27.486331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed9d5709b984277bc282bb35a9cbe8d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:27.496543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8ec1ec48-465b-45e1-b77b-38b1a07d8f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:27.501796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:27.643234 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2620/5238] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:13:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 28 19:13:27.665118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1ec48-465b-45e1-b77b-38b1a07d8f21 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:27.667093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8ec1ec48-465b-45e1-b77b-38b1a07d8f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:27.719130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed9d5709b984277bc282bb35a9cbe8d', 'request_id': 'req-66c55eec-a5d4-4ec9-a64e-b0d27a680916'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:27.736105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed9d5709b984277bc282bb35a9cbe8d', 'request_id': 'req-66c55eec-a5d4-4ec9-a64e-b0d27a680916'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:27.744979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:27.747371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed9d5709b984277bc282bb35a9cbe8d', 'request_id': 'req-66c55eec-a5d4-4ec9-a64e-b0d27a680916'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:27.779552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] The token cache is being invalidate because project 3ed9d5709b984277bc282bb35a9cbe8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:13:27.780105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:27.785496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:27.794105 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2619/5239] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:13:27 2022] DELETE /identity/v3/projects/3ed9d5709b984277bc282bb35a9cbe8d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:27.801392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:27.801392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:27.873229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1ec48-465b-45e1-b77b-38b1a07d8f21 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:27.989332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c55eec-a5d4-4ec9-a64e-b0d27a680916 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:28.002354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e781c-8ae6-4dbf-aa2f-5fd4c1440be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:28.003051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e781c-8ae6-4dbf-aa2f-5fd4c1440be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:28.003329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e781c-8ae6-4dbf-aa2f-5fd4c1440be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:28.003604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e781c-8ae6-4dbf-aa2f-5fd4c1440be6 admin admin] PATH_INFO: `/v3/users/366d44a3b22c46049b6923efd99445f8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:28.028475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e781c-8ae6-4dbf-aa2f-5fd4c1440be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=366d44a3b22c46049b6923efd99445f8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:28.032773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e781c-8ae6-4dbf-aa2f-5fd4c1440be6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:28.045908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e7294-3fcc-49e6-a934-6b6d27c7303b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:28.046612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7294-3fcc-49e6-a934-6b6d27c7303b service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:28.047288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7294-3fcc-49e6-a934-6b6d27c7303b service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:28.047613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e7294-3fcc-49e6-a934-6b6d27c7303b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:28.050151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-297e7294-3fcc-49e6-a934-6b6d27c7303b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:28.144604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4e5e781c-8ae6-4dbf-aa2f-5fd4c1440be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366d44a3b22c46049b6923efd99445f8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:28.163690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4e5e781c-8ae6-4dbf-aa2f-5fd4c1440be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366d44a3b22c46049b6923efd99445f8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:28.165828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4e5e781c-8ae6-4dbf-aa2f-5fd4c1440be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366d44a3b22c46049b6923efd99445f8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:28.173082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:28.184114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e7294-3fcc-49e6-a934-6b6d27c7303b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:28.188384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e7294-3fcc-49e6-a934-6b6d27c7303b service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:28.200652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4e5e781c-8ae6-4dbf-aa2f-5fd4c1440be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366d44a3b22c46049b6923efd99445f8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:28.201653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4e5e781c-8ae6-4dbf-aa2f-5fd4c1440be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366d44a3b22c46049b6923efd99445f8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:28.227544 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2621/5240] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:13:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:13:28.238828 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2620/5241] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:13:27 2022] DELETE /identity/v3/users/366d44a3b22c46049b6923efd99445f8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:29.031927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e7294-3fcc-49e6-a934-6b6d27c7303b service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:29.052683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e7294-3fcc-49e6-a934-6b6d27c7303b service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:29.236541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:29.237420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:29.237854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:29.238280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20 admin admin] PATH_INFO: `/v3/projects/0f15c66e37f9452baf74efb4b5a39a80` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:29.239902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f15c66e37f9452baf74efb4b5a39a80)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:29.243508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:29.270848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:29.367270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f15c66e37f9452baf74efb4b5a39a80', 'request_id': 'req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:29.384374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f15c66e37f9452baf74efb4b5a39a80', 'request_id': 'req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:29.398043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f15c66e37f9452baf74efb4b5a39a80', 'request_id': 'req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:29.433238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20 admin admin] The token cache is being invalidate because project 0f15c66e37f9452baf74efb4b5a39a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:13:29.434075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:29.435373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70000d30-cca8-4ff1-8466-cfc4bf7d1f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:29.441645 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2622/5242] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:13:29 2022] DELETE /identity/v3/projects/0f15c66e37f9452baf74efb4b5a39a80 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:29.448896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabe9e1-254b-481f-aa33-1bc42ac9d95a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:29.449499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabe9e1-254b-481f-aa33-1bc42ac9d95a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:29.449820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabe9e1-254b-481f-aa33-1bc42ac9d95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:29.501637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5fabe9e1-254b-481f-aa33-1bc42ac9d95a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:29.505709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5fabe9e1-254b-481f-aa33-1bc42ac9d95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:29.723037 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2621/5243] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:29.731428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c42f3-b118-4c5a-8508-86e387590bf7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:29.732179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c42f3-b118-4c5a-8508-86e387590bf7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:29.732754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c42f3-b118-4c5a-8508-86e387590bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:29.804530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-db6c42f3-b118-4c5a-8508-86e387590bf7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:29.806177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-db6c42f3-b118-4c5a-8508-86e387590bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:29.849820 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2623/5244] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:29.857302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c400399-8c3c-4acb-93d9-d9cd559bddc4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:29.860043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c400399-8c3c-4acb-93d9-d9cd559bddc4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:29.861181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c400399-8c3c-4acb-93d9-d9cd559bddc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:29.874650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c42f3-b118-4c5a-8508-86e387590bf7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:29.896038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c42f3-b118-4c5a-8508-86e387590bf7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:29.904715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e79b2-6f01-455e-860a-9586bed284c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:29.905926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e79b2-6f01-455e-860a-9586bed284c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:29.906219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e79b2-6f01-455e-860a-9586bed284c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:29.906518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e79b2-6f01-455e-860a-9586bed284c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:29.908257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e79b2-6f01-455e-860a-9586bed284c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:13:29.908538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e79b2-6f01-455e-860a-9586bed284c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:29.911000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e79b2-6f01-455e-860a-9586bed284c3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:29.923672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7c400399-8c3c-4acb-93d9-d9cd559bddc4 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:29.925575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7c400399-8c3c-4acb-93d9-d9cd559bddc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:29.936088 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2624/5245] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:13:29.937633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e79b2-6f01-455e-860a-9586bed284c3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:29.951232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e79b2-6f01-455e-860a-9586bed284c3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:29.961750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e5f37-17d3-45f7-9d7e-4e820bca4126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:29.961750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5f37-17d3-45f7-9d7e-4e820bca4126 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:29.961750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5f37-17d3-45f7-9d7e-4e820bca4126 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:29.961750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e5f37-17d3-45f7-9d7e-4e820bca4126 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:29.962665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e5f37-17d3-45f7-9d7e-4e820bca4126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:29.965527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e5f37-17d3-45f7-9d7e-4e820bca4126 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:30.017112 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2625/5246] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:13:29 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:30.023789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e5f37-17d3-45f7-9d7e-4e820bca4126 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:30.097771 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2622/5247] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:13:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:13:30.108024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c400399-8c3c-4acb-93d9-d9cd559bddc4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:30.115781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7c400399-8c3c-4acb-93d9-d9cd559bddc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:30.175625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e5f37-17d3-45f7-9d7e-4e820bca4126 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:30.185402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485f5c7-92fb-4b3d-9cf8-1c10b1f0cb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:30.186042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485f5c7-92fb-4b3d-9cf8-1c10b1f0cb2e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:30.186390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485f5c7-92fb-4b3d-9cf8-1c10b1f0cb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:30.186721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485f5c7-92fb-4b3d-9cf8-1c10b1f0cb2e admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:30.187463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485f5c7-92fb-4b3d-9cf8-1c10b1f0cb2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:30.189560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485f5c7-92fb-4b3d-9cf8-1c10b1f0cb2e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:30.223030 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2626/5248] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:13:30 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:30.233194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485f5c7-92fb-4b3d-9cf8-1c10b1f0cb2e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:30.247812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485f5c7-92fb-4b3d-9cf8-1c10b1f0cb2e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:30.254021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f267ca-c765-49da-98ad-154e7de81baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:30.254847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f267ca-c765-49da-98ad-154e7de81baa admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:30.255241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f267ca-c765-49da-98ad-154e7de81baa admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:30.255776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f267ca-c765-49da-98ad-154e7de81baa admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:30.256551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f267ca-c765-49da-98ad-154e7de81baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:30.258351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f267ca-c765-49da-98ad-154e7de81baa admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:30.274972 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2627/5249] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:30.285472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f267ca-c765-49da-98ad-154e7de81baa admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:30.308614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f267ca-c765-49da-98ad-154e7de81baa admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:30.318258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb08b6-7e61-4726-9e14-2a6a832ee2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:30.319039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb08b6-7e61-4726-9e14-2a6a832ee2de admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:30.319327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb08b6-7e61-4726-9e14-2a6a832ee2de admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:30.319609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb08b6-7e61-4726-9e14-2a6a832ee2de admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:30.320270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb08b6-7e61-4726-9e14-2a6a832ee2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:30.325848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb08b6-7e61-4726-9e14-2a6a832ee2de admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:30.348968 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2628/5250] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:30.371831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb08b6-7e61-4726-9e14-2a6a832ee2de admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:30.391887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb08b6-7e61-4726-9e14-2a6a832ee2de admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:30.411615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c400399-8c3c-4acb-93d9-d9cd559bddc4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:30.414493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0412f79-8a6c-40bf-9155-85290924825b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:30.415365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0412f79-8a6c-40bf-9155-85290924825b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:30.416406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0412f79-8a6c-40bf-9155-85290924825b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:30.417186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0412f79-8a6c-40bf-9155-85290924825b admin admin] PATH_INFO: `/v3/projects/6ff1844c333c4bdabcca0dddc72f725b/users/22608edbccab4b07a32508264aa34408/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:30.484940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:30.498064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0412f79-8a6c-40bf-9155-85290924825b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff1844c333c4bdabcca0dddc72f725b, user_id=22608edbccab4b07a32508264aa34408, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:30.507103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0412f79-8a6c-40bf-9155-85290924825b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:30.553771 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2629/5251] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:13:30 2022] PUT /identity/v3/projects/6ff1844c333c4bdabcca0dddc72f725b/users/22608edbccab4b07a32508264aa34408/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:30.568869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425e4f-fe26-4ff7-83d3-e4f988f832ea None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:30.569463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425e4f-fe26-4ff7-83d3-e4f988f832ea None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:30.570036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425e4f-fe26-4ff7-83d3-e4f988f832ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:30.588093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813e991-9d21-4def-842e-3b05b735e39e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:30.591093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813e991-9d21-4def-842e-3b05b735e39e service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:30.593051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813e991-9d21-4def-842e-3b05b735e39e service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:30.593839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813e991-9d21-4def-842e-3b05b735e39e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:30.607880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:30.648711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5c425e4f-fe26-4ff7-83d3-e4f988f832ea None None] MFA Rules not processed for user `22608edbccab4b07a32508264aa34408`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:30.655102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5c425e4f-fe26-4ff7-83d3-e4f988f832ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:30.755913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813e991-9d21-4def-842e-3b05b735e39e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:30.757548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813e991-9d21-4def-842e-3b05b735e39e service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:30.776148 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2623/5252] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:13:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:13:30.874505 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2630/5253] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:30.890612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813e991-9d21-4def-842e-3b05b735e39e service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:30.892895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6813e991-9d21-4def-842e-3b05b735e39e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:31.079414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813e991-9d21-4def-842e-3b05b735e39e service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:31.187382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431a057-3190-4cd4-8b37-8be29c06d7be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:31.188022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431a057-3190-4cd4-8b37-8be29c06d7be service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:31.188308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431a057-3190-4cd4-8b37-8be29c06d7be service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:31.188645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431a057-3190-4cd4-8b37-8be29c06d7be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:31.206094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431a057-3190-4cd4-8b37-8be29c06d7be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:31.209993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431a057-3190-4cd4-8b37-8be29c06d7be service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:31.251040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520bf31-6fc3-458d-86e8-4b6e1a048c3f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:31.251538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520bf31-6fc3-458d-86e8-4b6e1a048c3f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:31.251618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520bf31-6fc3-458d-86e8-4b6e1a048c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:31.274445 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2624/5254] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:31.321919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d520bf31-6fc3-458d-86e8-4b6e1a048c3f None None] MFA Rules not processed for user `46ef6462029e4cabb094ea2baad1d807`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:31.324486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d520bf31-6fc3-458d-86e8-4b6e1a048c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:31.408573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431a057-3190-4cd4-8b37-8be29c06d7be service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:31.410722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6431a057-3190-4cd4-8b37-8be29c06d7be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:31.494815 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2631/5255] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:13:31.551787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:31.684830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431a057-3190-4cd4-8b37-8be29c06d7be service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:31.700212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37246d-05ea-4847-be56-48fbffe1d058 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:31.701112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37246d-05ea-4847-be56-48fbffe1d058 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:31.701553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37246d-05ea-4847-be56-48fbffe1d058 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:31.702273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37246d-05ea-4847-be56-48fbffe1d058 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:31.707146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ae37246d-05ea-4847-be56-48fbffe1d058 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:31.756110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37246d-05ea-4847-be56-48fbffe1d058 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:31.758131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37246d-05ea-4847-be56-48fbffe1d058 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:31.796426 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2625/5256] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:13:32.953038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06e2e-4d36-4a5a-b390-835dfbb55e7c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:32.953926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06e2e-4d36-4a5a-b390-835dfbb55e7c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:32.954367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06e2e-4d36-4a5a-b390-835dfbb55e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:33.001749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1cb06e2e-4d36-4a5a-b390-835dfbb55e7c None None] MFA Rules not processed for user `46ef6462029e4cabb094ea2baad1d807`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:33.003075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1cb06e2e-4d36-4a5a-b390-835dfbb55e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:33.044462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37246d-05ea-4847-be56-48fbffe1d058 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:33.047285 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2632/5257] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:33.080594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37246d-05ea-4847-be56-48fbffe1d058 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:33.103953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe19ceb-441b-4d62-aa4b-7c080c3a014f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:33.105283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe19ceb-441b-4d62-aa4b-7c080c3a014f service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:33.105990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe19ceb-441b-4d62-aa4b-7c080c3a014f service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:33.106505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe19ceb-441b-4d62-aa4b-7c080c3a014f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:33.116401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bbe19ceb-441b-4d62-aa4b-7c080c3a014f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:33.184720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe19ceb-441b-4d62-aa4b-7c080c3a014f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:33.209213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe19ceb-441b-4d62-aa4b-7c080c3a014f service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:33.255526 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2626/5258] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:33.747905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb06e2e-4d36-4a5a-b390-835dfbb55e7c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:33.750084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1cb06e2e-4d36-4a5a-b390-835dfbb55e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:33.974426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb06e2e-4d36-4a5a-b390-835dfbb55e7c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:33.993939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcdf9c-07dd-435c-a529-b6a070e38982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:34.001732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcdf9c-07dd-435c-a529-b6a070e38982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:34.002021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcdf9c-07dd-435c-a529-b6a070e38982 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:34.005276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcdf9c-07dd-435c-a529-b6a070e38982 admin admin] PATH_INFO: `/v3/users/f30fea146339456b8c8db0d702376af0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:34.006903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcdf9c-07dd-435c-a529-b6a070e38982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30fea146339456b8c8db0d702376af0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:34.016866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcdf9c-07dd-435c-a529-b6a070e38982 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:34.152415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:34.189537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6efcdf9c-07dd-435c-a529-b6a070e38982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30fea146339456b8c8db0d702376af0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:34.221375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6efcdf9c-07dd-435c-a529-b6a070e38982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30fea146339456b8c8db0d702376af0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:34.224199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6efcdf9c-07dd-435c-a529-b6a070e38982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30fea146339456b8c8db0d702376af0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:34.250723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6efcdf9c-07dd-435c-a529-b6a070e38982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30fea146339456b8c8db0d702376af0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:34.253306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6efcdf9c-07dd-435c-a529-b6a070e38982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30fea146339456b8c8db0d702376af0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:34.365358 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2633/5259] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:13:33 2022] DELETE /identity/v3/users/f30fea146339456b8c8db0d702376af0 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:35.475604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe19ceb-441b-4d62-aa4b-7c080c3a014f service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:35.496865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe19ceb-441b-4d62-aa4b-7c080c3a014f service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:35.756653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:35.757414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:35.757875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:35.758155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86 admin admin] PATH_INFO: `/v3/projects/be9c6c59665546dd86cd8f85d5307ba2` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:35.764878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9c6c59665546dd86cd8f85d5307ba2)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:35.768648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:35.880947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9c6c59665546dd86cd8f85d5307ba2', 'request_id': 'req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:35.897291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9c6c59665546dd86cd8f85d5307ba2', 'request_id': 'req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:35.908179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9c6c59665546dd86cd8f85d5307ba2', 'request_id': 'req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:35.925692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86 admin admin] The token cache is being invalidate because project be9c6c59665546dd86cd8f85d5307ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:13:35.926048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:35.926976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5dc7098c-ac8c-4c63-9737-1b99eaff9a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:35.929685 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2627/5260] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:13:35 2022] DELETE /identity/v3/projects/be9c6c59665546dd86cd8f85d5307ba2 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:35.935719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2ff06-5bfd-45dc-ba59-86ea1d463a36 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:35.936241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2ff06-5bfd-45dc-ba59-86ea1d463a36 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:35.936507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2ff06-5bfd-45dc-ba59-86ea1d463a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:36.005744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-32e2ff06-5bfd-45dc-ba59-86ea1d463a36 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:36.009284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-32e2ff06-5bfd-45dc-ba59-86ea1d463a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:36.189722 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2634/5261] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:13:36.198974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187c9b8-e7fe-412b-8a5f-920abc8f0b64 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:36.199616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187c9b8-e7fe-412b-8a5f-920abc8f0b64 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:36.200048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187c9b8-e7fe-412b-8a5f-920abc8f0b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:36.241761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d187c9b8-e7fe-412b-8a5f-920abc8f0b64 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:36.243080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d187c9b8-e7fe-412b-8a5f-920abc8f0b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:36.276607 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2628/5262] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:36.282154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2ff06-5bfd-45dc-ba59-86ea1d463a36 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:36.296824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2ff06-5bfd-45dc-ba59-86ea1d463a36 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:36.303581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaa04d-f5f9-49fc-9ffc-d305d6c6871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:36.304826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaa04d-f5f9-49fc-9ffc-d305d6c6871d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:36.305342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaa04d-f5f9-49fc-9ffc-d305d6c6871d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:36.305800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaa04d-f5f9-49fc-9ffc-d305d6c6871d admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:36.307410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaa04d-f5f9-49fc-9ffc-d305d6c6871d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:13:36.308006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaa04d-f5f9-49fc-9ffc-d305d6c6871d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:36.311994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaa04d-f5f9-49fc-9ffc-d305d6c6871d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:36.343986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187c9b8-e7fe-412b-8a5f-920abc8f0b64 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:36.344956 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2635/5263] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:13:36.362770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187c9b8-e7fe-412b-8a5f-920abc8f0b64 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:36.367714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be41b80-3d60-474d-8f5d-43e0d0ad823c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:36.368606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41b80-3d60-474d-8f5d-43e0d0ad823c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:36.369567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41b80-3d60-474d-8f5d-43e0d0ad823c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:36.370110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41b80-3d60-474d-8f5d-43e0d0ad823c admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:36.371254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be41b80-3d60-474d-8f5d-43e0d0ad823c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:36.386679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be41b80-3d60-474d-8f5d-43e0d0ad823c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:36.453921 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2629/5264] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:13:36 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:13:36.458090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaa04d-f5f9-49fc-9ffc-d305d6c6871d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:36.493522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaa04d-f5f9-49fc-9ffc-d305d6c6871d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:36.686583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000f540-1621-4a35-8544-3561c8199903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:36.688681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000f540-1621-4a35-8544-3561c8199903 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:36.688988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000f540-1621-4a35-8544-3561c8199903 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:36.689277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000f540-1621-4a35-8544-3561c8199903 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:36.690194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000f540-1621-4a35-8544-3561c8199903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:36.692201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000f540-1621-4a35-8544-3561c8199903 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:36.765515 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2636/5265] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:13:36 2022] POST /identity/v3/users => generated 287 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:36.770896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be41b80-3d60-474d-8f5d-43e0d0ad823c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:36.779492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:36.787927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be41b80-3d60-474d-8f5d-43e0d0ad823c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:36.800408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605722ac-3056-4595-a6bd-ae6eca54b134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:36.801578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605722ac-3056-4595-a6bd-ae6eca54b134 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:36.802188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605722ac-3056-4595-a6bd-ae6eca54b134 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:36.804837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605722ac-3056-4595-a6bd-ae6eca54b134 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:36.806423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605722ac-3056-4595-a6bd-ae6eca54b134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:36.809813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605722ac-3056-4595-a6bd-ae6eca54b134 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:36.828530 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2630/5266] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:36.832044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000f540-1621-4a35-8544-3561c8199903 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:36.862756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000f540-1621-4a35-8544-3561c8199903 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:36.874905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57b104-038b-4ae4-bad9-04930a71bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:36.875714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57b104-038b-4ae4-bad9-04930a71bab5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:36.878026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57b104-038b-4ae4-bad9-04930a71bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:36.878026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57b104-038b-4ae4-bad9-04930a71bab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:36.891548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57b104-038b-4ae4-bad9-04930a71bab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:36.893252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57b104-038b-4ae4-bad9-04930a71bab5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:36.936728 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2637/5267] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:36.941626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605722ac-3056-4595-a6bd-ae6eca54b134 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:36.955299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605722ac-3056-4595-a6bd-ae6eca54b134 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:36.960408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7866a1-cd92-4eba-b42a-1448dad92799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:36.961312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7866a1-cd92-4eba-b42a-1448dad92799 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:36.961638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7866a1-cd92-4eba-b42a-1448dad92799 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:36.961920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7866a1-cd92-4eba-b42a-1448dad92799 admin admin] PATH_INFO: `/v3/projects/d25b654916f94ca6826ab050ac2cba70/users/fc65964655dc4cae88e37535a8ca3359/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:37.005548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7866a1-cd92-4eba-b42a-1448dad92799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25b654916f94ca6826ab050ac2cba70, user_id=fc65964655dc4cae88e37535a8ca3359, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:37.008302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7866a1-cd92-4eba-b42a-1448dad92799 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:37.038933 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2631/5268] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:13:36 2022] PUT /identity/v3/projects/d25b654916f94ca6826ab050ac2cba70/users/fc65964655dc4cae88e37535a8ca3359/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:37.051886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e885-1f2a-400c-afac-64b4850f14b8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:37.053650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e885-1f2a-400c-afac-64b4850f14b8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:37.054128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e885-1f2a-400c-afac-64b4850f14b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:37.127843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-21c7e885-1f2a-400c-afac-64b4850f14b8 None None] MFA Rules not processed for user `fc65964655dc4cae88e37535a8ca3359`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:37.129344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-21c7e885-1f2a-400c-afac-64b4850f14b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:37.153384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:37.344507 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2638/5269] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:37.361054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb80df-3627-439f-8010-c37df3d86e0a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:37.361357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb80df-3627-439f-8010-c37df3d86e0a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:37.361666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb80df-3627-439f-8010-c37df3d86e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:37.412499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-faeb80df-3627-439f-8010-c37df3d86e0a None None] MFA Rules not processed for user `fc65964655dc4cae88e37535a8ca3359`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:37.417560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-faeb80df-3627-439f-8010-c37df3d86e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:37.441179 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2632/5270] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:37.454809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7e885-1f2a-400c-afac-64b4850f14b8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:37.456695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-21c7e885-1f2a-400c-afac-64b4850f14b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:37.713594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7e885-1f2a-400c-afac-64b4850f14b8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:37.729230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb008f-a130-4387-aca1-5d58bf777f11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:37.730116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb008f-a130-4387-aca1-5d58bf777f11 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:37.730606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb008f-a130-4387-aca1-5d58bf777f11 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:37.731265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb008f-a130-4387-aca1-5d58bf777f11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:37.775115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb008f-a130-4387-aca1-5d58bf777f11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:37.776869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb008f-a130-4387-aca1-5d58bf777f11 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:37.820199 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2639/5271] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:13:38.415687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac80ca-79c4-42a7-a9e6-5f443995a65b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:38.417078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac80ca-79c4-42a7-a9e6-5f443995a65b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:38.417376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac80ca-79c4-42a7-a9e6-5f443995a65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:38.532008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-37ac80ca-79c4-42a7-a9e6-5f443995a65b None None] MFA Rules not processed for user `fc65964655dc4cae88e37535a8ca3359`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:38.534780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-37ac80ca-79c4-42a7-a9e6-5f443995a65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:38.584083 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2633/5272] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:41.405801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb008f-a130-4387-aca1-5d58bf777f11 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:41.409385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-efcb008f-a130-4387-aca1-5d58bf777f11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:41.639140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb008f-a130-4387-aca1-5d58bf777f11 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:41.663621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:41.664284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:41.664567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:41.664842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] PATH_INFO: `/v3/users/22608edbccab4b07a32508264aa34408` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:41.666295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] RBAC: Authorizing `identity:delete_user(user_id=22608edbccab4b07a32508264aa34408)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:41.672625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:41.762417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:41.801509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22608edbccab4b07a32508264aa34408'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:41.834023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22608edbccab4b07a32508264aa34408'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:41.842211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22608edbccab4b07a32508264aa34408'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:41.873172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22608edbccab4b07a32508264aa34408'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:41.874958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22608edbccab4b07a32508264aa34408'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:41.924018 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2640/5273] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:13:41 2022] DELETE /identity/v3/users/22608edbccab4b07a32508264aa34408 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:41.928435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487033e-4d79-4089-b6e4-8815c58dc7ae None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:41.928991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487033e-4d79-4089-b6e4-8815c58dc7ae None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:41.929104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487033e-4d79-4089-b6e4-8815c58dc7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:41.981350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4487033e-4d79-4089-b6e4-8815c58dc7ae None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:41.984731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4487033e-4d79-4089-b6e4-8815c58dc7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:42.084258 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2634/5274] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:42.113540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:42.115000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:42.294255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870aa22e-9131-4ecc-8a2a-6e150054852d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:42.308277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab6af5-5d44-4260-8963-97c0fbf8e397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:42.309056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab6af5-5d44-4260-8963-97c0fbf8e397 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:42.311209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab6af5-5d44-4260-8963-97c0fbf8e397 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:42.312457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab6af5-5d44-4260-8963-97c0fbf8e397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:42.342211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab6af5-5d44-4260-8963-97c0fbf8e397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:42.345261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab6af5-5d44-4260-8963-97c0fbf8e397 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:42.377021 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2641/5275] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:43.548370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487033e-4d79-4089-b6e4-8815c58dc7ae None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:43.550433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4487033e-4d79-4089-b6e4-8815c58dc7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:43.587836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487033e-4d79-4089-b6e4-8815c58dc7ae None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:43.614590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee45c34-34ee-4693-8632-2898c3cbad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:43.615552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee45c34-34ee-4693-8632-2898c3cbad32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:43.615994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee45c34-34ee-4693-8632-2898c3cbad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:43.616457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee45c34-34ee-4693-8632-2898c3cbad32 admin admin] PATH_INFO: `/v3/projects/6ff1844c333c4bdabcca0dddc72f725b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:43.628763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee45c34-34ee-4693-8632-2898c3cbad32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff1844c333c4bdabcca0dddc72f725b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:43.632171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee45c34-34ee-4693-8632-2898c3cbad32 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:43.763900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dee45c34-34ee-4693-8632-2898c3cbad32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff1844c333c4bdabcca0dddc72f725b', 'request_id': 'req-dee45c34-34ee-4693-8632-2898c3cbad32'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:43.779386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dee45c34-34ee-4693-8632-2898c3cbad32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff1844c333c4bdabcca0dddc72f725b', 'request_id': 'req-dee45c34-34ee-4693-8632-2898c3cbad32'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:43.793022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dee45c34-34ee-4693-8632-2898c3cbad32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff1844c333c4bdabcca0dddc72f725b', 'request_id': 'req-dee45c34-34ee-4693-8632-2898c3cbad32'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:43.810858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dee45c34-34ee-4693-8632-2898c3cbad32 admin admin] The token cache is being invalidate because project 6ff1844c333c4bdabcca0dddc72f725b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:13:43.811425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dee45c34-34ee-4693-8632-2898c3cbad32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:43.813066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dee45c34-34ee-4693-8632-2898c3cbad32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:43.819420 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2635/5276] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:13:43 2022] DELETE /identity/v3/projects/6ff1844c333c4bdabcca0dddc72f725b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:43.820486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487971fe-8844-427a-a0e8-43cae853deb1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:43.820934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487971fe-8844-427a-a0e8-43cae853deb1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:43.821056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487971fe-8844-427a-a0e8-43cae853deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:43.871438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-487971fe-8844-427a-a0e8-43cae853deb1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:43.873292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-487971fe-8844-427a-a0e8-43cae853deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:43.992930 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2642/5277] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:44.002095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a08066-d6de-4c99-bb6f-f0d3960387c5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:44.002382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a08066-d6de-4c99-bb6f-f0d3960387c5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:44.002656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a08066-d6de-4c99-bb6f-f0d3960387c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:44.036201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d2a08066-d6de-4c99-bb6f-f0d3960387c5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:44.039097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d2a08066-d6de-4c99-bb6f-f0d3960387c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:44.050977 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2636/5278] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:13:44.055786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487971fe-8844-427a-a0e8-43cae853deb1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:44.070711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487971fe-8844-427a-a0e8-43cae853deb1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:44.084196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef421b74-ca1c-4475-a8d0-944a80cfbf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:44.085531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef421b74-ca1c-4475-a8d0-944a80cfbf4e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:44.086066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef421b74-ca1c-4475-a8d0-944a80cfbf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:44.086492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef421b74-ca1c-4475-a8d0-944a80cfbf4e admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:44.090217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef421b74-ca1c-4475-a8d0-944a80cfbf4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:13:44.091180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef421b74-ca1c-4475-a8d0-944a80cfbf4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:44.093333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef421b74-ca1c-4475-a8d0-944a80cfbf4e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:44.116987 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2643/5279] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:13:44.125597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a08066-d6de-4c99-bb6f-f0d3960387c5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:44.141893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a08066-d6de-4c99-bb6f-f0d3960387c5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:44.169294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60503d8-0d50-46cd-978d-d5092a252152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:44.170044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60503d8-0d50-46cd-978d-d5092a252152 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:44.179671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60503d8-0d50-46cd-978d-d5092a252152 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:44.180192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60503d8-0d50-46cd-978d-d5092a252152 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:44.181897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60503d8-0d50-46cd-978d-d5092a252152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:44.189299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60503d8-0d50-46cd-978d-d5092a252152 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:44.271039 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2637/5280] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:13:44 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:44.277413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef421b74-ca1c-4475-a8d0-944a80cfbf4e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:44.292236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef421b74-ca1c-4475-a8d0-944a80cfbf4e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:44.375482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:44.428655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e49876-847a-4e18-88e1-ae5b84053cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:44.429625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e49876-847a-4e18-88e1-ae5b84053cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:44.430925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e49876-847a-4e18-88e1-ae5b84053cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:44.431432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60503d8-0d50-46cd-978d-d5092a252152 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:44.432379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e49876-847a-4e18-88e1-ae5b84053cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:44.432553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e49876-847a-4e18-88e1-ae5b84053cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:44.433321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a60503d8-0d50-46cd-978d-d5092a252152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:44.435644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e49876-847a-4e18-88e1-ae5b84053cb9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:44.450869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60503d8-0d50-46cd-978d-d5092a252152 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:44.463624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9eeb0-a564-4f65-9a34-709875b4188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:44.464847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9eeb0-a564-4f65-9a34-709875b4188b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:44.465274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9eeb0-a564-4f65-9a34-709875b4188b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:44.465935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9eeb0-a564-4f65-9a34-709875b4188b admin admin] PATH_INFO: `/v3/users/6068e4a4e13549ab8deab4bbd4804f0d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:44.467578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9eeb0-a564-4f65-9a34-709875b4188b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6068e4a4e13549ab8deab4bbd4804f0d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:44.469825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9eeb0-a564-4f65-9a34-709875b4188b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:44.471975 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2644/5281] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:13:44 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:44.477249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:44.480062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e49876-847a-4e18-88e1-ae5b84053cb9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:44.492281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e49876-847a-4e18-88e1-ae5b84053cb9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:44.498347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c41b3-9cbd-4967-bb2c-2ac34828b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:44.499006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c41b3-9cbd-4967-bb2c-2ac34828b678 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:44.499361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c41b3-9cbd-4967-bb2c-2ac34828b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:44.499560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c41b3-9cbd-4967-bb2c-2ac34828b678 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:44.500218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c41b3-9cbd-4967-bb2c-2ac34828b678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:44.501848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c41b3-9cbd-4967-bb2c-2ac34828b678 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:44.515498 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2645/5282] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:44.519566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c41b3-9cbd-4967-bb2c-2ac34828b678 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:44.535607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c41b3-9cbd-4967-bb2c-2ac34828b678 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:44.545324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba11614-904c-4035-89d5-99fb6b9f801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:44.545722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba11614-904c-4035-89d5-99fb6b9f801a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:44.546067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba11614-904c-4035-89d5-99fb6b9f801a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:44.546322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba11614-904c-4035-89d5-99fb6b9f801a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:44.547177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba11614-904c-4035-89d5-99fb6b9f801a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:44.548820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba11614-904c-4035-89d5-99fb6b9f801a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:44.565304 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2646/5283] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:13:44.565995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba11614-904c-4035-89d5-99fb6b9f801a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:44.579716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ab9eeb0-a564-4f65-9a34-709875b4188b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6068e4a4e13549ab8deab4bbd4804f0d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:44.587105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba11614-904c-4035-89d5-99fb6b9f801a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:44.592680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ab9eeb0-a564-4f65-9a34-709875b4188b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6068e4a4e13549ab8deab4bbd4804f0d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:44.598552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ab9eeb0-a564-4f65-9a34-709875b4188b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6068e4a4e13549ab8deab4bbd4804f0d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:44.604341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e1841-31d1-4f00-84aa-0fa0bfc3755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:44.605368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e1841-31d1-4f00-84aa-0fa0bfc3755f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:44.605822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e1841-31d1-4f00-84aa-0fa0bfc3755f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:44.606268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e1841-31d1-4f00-84aa-0fa0bfc3755f admin admin] PATH_INFO: `/v3/projects/617f27a3e33c4496b18a220479b94504/users/203ce44cfff84b25bf0b1145735d8d61/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:44.618260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ab9eeb0-a564-4f65-9a34-709875b4188b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6068e4a4e13549ab8deab4bbd4804f0d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:44.619862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ab9eeb0-a564-4f65-9a34-709875b4188b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6068e4a4e13549ab8deab4bbd4804f0d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:44.625199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e1841-31d1-4f00-84aa-0fa0bfc3755f admin admin] RBAC: Authorizing `identity:create_grant(project_id=617f27a3e33c4496b18a220479b94504, user_id=203ce44cfff84b25bf0b1145735d8d61, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:44.628392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e1841-31d1-4f00-84aa-0fa0bfc3755f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:44.638632 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2638/5284] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:13:44 2022] DELETE /identity/v3/users/6068e4a4e13549ab8deab4bbd4804f0d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:13:44.646195 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2647/5285] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:13:44 2022] PUT /identity/v3/projects/617f27a3e33c4496b18a220479b94504/users/203ce44cfff84b25bf0b1145735d8d61/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:44.658127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9592-be83-4f29-9aed-2e9da394c9e3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:44.658780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9592-be83-4f29-9aed-2e9da394c9e3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:44.659199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9592-be83-4f29-9aed-2e9da394c9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:44.703907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3d0b9592-be83-4f29-9aed-2e9da394c9e3 None None] MFA Rules not processed for user `203ce44cfff84b25bf0b1145735d8d61`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:44.705282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3d0b9592-be83-4f29-9aed-2e9da394c9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:44.797043 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2639/5286] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:13:44.809331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e1841-31d1-4f00-84aa-0fa0bfc3755f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:44.812062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-777e1841-31d1-4f00-84aa-0fa0bfc3755f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:44.863457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b9592-be83-4f29-9aed-2e9da394c9e3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:44.864993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3d0b9592-be83-4f29-9aed-2e9da394c9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:44.951540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e1841-31d1-4f00-84aa-0fa0bfc3755f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:44.998187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b9592-be83-4f29-9aed-2e9da394c9e3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:45.006724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d322190-b070-4e59-87c9-5e86dd06031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:45.007936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d322190-b070-4e59-87c9-5e86dd06031c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:45.008777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d322190-b070-4e59-87c9-5e86dd06031c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:45.009297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d322190-b070-4e59-87c9-5e86dd06031c admin admin] PATH_INFO: `/v3/projects/f7bc76e114594662bbc2f4c27c3bdb5a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:45.012414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d322190-b070-4e59-87c9-5e86dd06031c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7bc76e114594662bbc2f4c27c3bdb5a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:45.016604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d322190-b070-4e59-87c9-5e86dd06031c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:45.039455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:45.092295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bb404-be59-4a2a-b793-6573f4abd423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:45.093191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bb404-be59-4a2a-b793-6573f4abd423 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:45.093629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bb404-be59-4a2a-b793-6573f4abd423 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:45.094080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bb404-be59-4a2a-b793-6573f4abd423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:45.112126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bb404-be59-4a2a-b793-6573f4abd423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:45.113971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bb404-be59-4a2a-b793-6573f4abd423 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:45.117237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d322190-b070-4e59-87c9-5e86dd06031c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7bc76e114594662bbc2f4c27c3bdb5a', 'request_id': 'req-1d322190-b070-4e59-87c9-5e86dd06031c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:45.135416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d322190-b070-4e59-87c9-5e86dd06031c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7bc76e114594662bbc2f4c27c3bdb5a', 'request_id': 'req-1d322190-b070-4e59-87c9-5e86dd06031c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:45.144273 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2648/5287] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:13:45.170604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d322190-b070-4e59-87c9-5e86dd06031c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7bc76e114594662bbc2f4c27c3bdb5a', 'request_id': 'req-1d322190-b070-4e59-87c9-5e86dd06031c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:45.194781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d322190-b070-4e59-87c9-5e86dd06031c admin admin] The token cache is being invalidate because project f7bc76e114594662bbc2f4c27c3bdb5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:13:45.195271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d322190-b070-4e59-87c9-5e86dd06031c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:45.196368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d322190-b070-4e59-87c9-5e86dd06031c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:45.200622 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2640/5288] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:13:44 2022] DELETE /identity/v3/projects/f7bc76e114594662bbc2f4c27c3bdb5a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:45.207269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c7500-62f7-464c-8e3e-e8cd3773d449 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:45.207561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c7500-62f7-464c-8e3e-e8cd3773d449 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:45.207850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c7500-62f7-464c-8e3e-e8cd3773d449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:45.265391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-426c7500-62f7-464c-8e3e-e8cd3773d449 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:45.272430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-426c7500-62f7-464c-8e3e-e8cd3773d449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:45.486249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:45.584573 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2649/5289] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:45.588524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088db1e-992d-4fa2-ba81-1ad9fd6f8348 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:45.589743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088db1e-992d-4fa2-ba81-1ad9fd6f8348 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:45.590252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088db1e-992d-4fa2-ba81-1ad9fd6f8348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:45.650616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4088db1e-992d-4fa2-ba81-1ad9fd6f8348 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:45.656653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4088db1e-992d-4fa2-ba81-1ad9fd6f8348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:45.682652 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2641/5290] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:45.683884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c7500-62f7-464c-8e3e-e8cd3773d449 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:45.701918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c7500-62f7-464c-8e3e-e8cd3773d449 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:45.749512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9bc27-0540-4fdd-8356-5f18f5f28038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:45.751367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9bc27-0540-4fdd-8356-5f18f5f28038 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:45.751639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9bc27-0540-4fdd-8356-5f18f5f28038 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:45.751918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9bc27-0540-4fdd-8356-5f18f5f28038 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:45.752615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9bc27-0540-4fdd-8356-5f18f5f28038 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:13:45.752928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9bc27-0540-4fdd-8356-5f18f5f28038 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:45.754579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9bc27-0540-4fdd-8356-5f18f5f28038 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:45.779020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088db1e-992d-4fa2-ba81-1ad9fd6f8348 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:45.783994 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2650/5291] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:13:45.800378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088db1e-992d-4fa2-ba81-1ad9fd6f8348 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:45.810623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f24ef-69cd-4472-a11b-7291c5b5af7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:45.813877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f24ef-69cd-4472-a11b-7291c5b5af7b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:45.814837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f24ef-69cd-4472-a11b-7291c5b5af7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:45.816223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f24ef-69cd-4472-a11b-7291c5b5af7b admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:45.817446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f24ef-69cd-4472-a11b-7291c5b5af7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:45.826222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f24ef-69cd-4472-a11b-7291c5b5af7b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:45.903667 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2642/5292] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:13:45 2022] POST /identity/v3/projects => generated 397 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:13:45.907554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9bc27-0540-4fdd-8356-5f18f5f28038 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:45.926487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9bc27-0540-4fdd-8356-5f18f5f28038 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:46.093437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d4118-fed9-4f9b-b61c-f7a223d26946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:46.094156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d4118-fed9-4f9b-b61c-f7a223d26946 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:46.094519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d4118-fed9-4f9b-b61c-f7a223d26946 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:46.094949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d4118-fed9-4f9b-b61c-f7a223d26946 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:46.095678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d4118-fed9-4f9b-b61c-f7a223d26946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:46.097876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d4118-fed9-4f9b-b61c-f7a223d26946 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:46.150937 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2651/5293] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:13:45 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:46.155580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f24ef-69cd-4472-a11b-7291c5b5af7b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:46.174561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f24ef-69cd-4472-a11b-7291c5b5af7b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:46.186288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b937-43a4-4fe1-8bd2-4339e443482b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:46.188922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b937-43a4-4fe1-8bd2-4339e443482b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:46.189756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b937-43a4-4fe1-8bd2-4339e443482b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:46.192616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b937-43a4-4fe1-8bd2-4339e443482b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:46.193753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135b937-43a4-4fe1-8bd2-4339e443482b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:46.198680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135b937-43a4-4fe1-8bd2-4339e443482b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:46.237542 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2643/5294] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:46.239253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d4118-fed9-4f9b-b61c-f7a223d26946 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:46.257451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d4118-fed9-4f9b-b61c-f7a223d26946 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:46.274541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e0d86-9aa4-43e2-803f-b323e62c7e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:46.276027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e0d86-9aa4-43e2-803f-b323e62c7e52 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:46.276545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e0d86-9aa4-43e2-803f-b323e62c7e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:46.277173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e0d86-9aa4-43e2-803f-b323e62c7e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:46.278410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e0d86-9aa4-43e2-803f-b323e62c7e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:46.294374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e0d86-9aa4-43e2-803f-b323e62c7e52 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:46.317787 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2652/5295] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:46.325488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b937-43a4-4fe1-8bd2-4339e443482b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:46.350710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b937-43a4-4fe1-8bd2-4339e443482b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:46.370306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c5fa6-ba21-47c3-89d3-17f9da9cd8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:46.373690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c5fa6-ba21-47c3-89d3-17f9da9cd8e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:46.374275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c5fa6-ba21-47c3-89d3-17f9da9cd8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:46.374720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c5fa6-ba21-47c3-89d3-17f9da9cd8e1 admin admin] PATH_INFO: `/v3/projects/14b4d96a322648f692944ec905ffb064/users/40e6b1af162742d18c8c76d0515257fe/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:46.420156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c5fa6-ba21-47c3-89d3-17f9da9cd8e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b4d96a322648f692944ec905ffb064, user_id=40e6b1af162742d18c8c76d0515257fe, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:46.423754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c5fa6-ba21-47c3-89d3-17f9da9cd8e1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:46.467689 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2644/5296] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:13:46 2022] PUT /identity/v3/projects/14b4d96a322648f692944ec905ffb064/users/40e6b1af162742d18c8c76d0515257fe/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:46.481039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3ea2a-86c6-4b5b-b9ff-c1ca88b59712 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:46.481508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3ea2a-86c6-4b5b-b9ff-c1ca88b59712 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:46.481959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3ea2a-86c6-4b5b-b9ff-c1ca88b59712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:46.567937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-28c3ea2a-86c6-4b5b-b9ff-c1ca88b59712 None None] MFA Rules not processed for user `40e6b1af162742d18c8c76d0515257fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:46.569582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-28c3ea2a-86c6-4b5b-b9ff-c1ca88b59712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:46.695720 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2653/5297] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:46.697717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e21613-bb0c-4942-97b3-e44baba3cbb8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:46.698607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e21613-bb0c-4942-97b3-e44baba3cbb8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:46.698607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e21613-bb0c-4942-97b3-e44baba3cbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:46.727004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-85e21613-bb0c-4942-97b3-e44baba3cbb8 None None] MFA Rules not processed for user `40e6b1af162742d18c8c76d0515257fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:46.730047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-85e21613-bb0c-4942-97b3-e44baba3cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:46.748729 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2645/5298] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:13:46.772363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3ea2a-86c6-4b5b-b9ff-c1ca88b59712 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:46.774686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-28c3ea2a-86c6-4b5b-b9ff-c1ca88b59712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:46.938433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:47.003840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3ea2a-86c6-4b5b-b9ff-c1ca88b59712 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:47.014371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff6c1a-f543-41f8-a42e-62b840404688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:47.015065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff6c1a-f543-41f8-a42e-62b840404688 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:47.015475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff6c1a-f543-41f8-a42e-62b840404688 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:47.015768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff6c1a-f543-41f8-a42e-62b840404688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:47.028467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff6c1a-f543-41f8-a42e-62b840404688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:47.030970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff6c1a-f543-41f8-a42e-62b840404688 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:47.044985 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2654/5299] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:47.114396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc2c23-6792-4f7e-a419-51dd6d7722fd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:47.114988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc2c23-6792-4f7e-a419-51dd6d7722fd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:47.115467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc2c23-6792-4f7e-a419-51dd6d7722fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:47.145432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-43dc2c23-6792-4f7e-a419-51dd6d7722fd None None] MFA Rules not processed for user `40e6b1af162742d18c8c76d0515257fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:47.151592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-43dc2c23-6792-4f7e-a419-51dd6d7722fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:47.168329 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2646/5300] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:47.293888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8545d85-3f3c-44e9-bec0-b8bf06152b31 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:47.294451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8545d85-3f3c-44e9-bec0-b8bf06152b31 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:47.294451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8545d85-3f3c-44e9-bec0-b8bf06152b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:47.333298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a8545d85-3f3c-44e9-bec0-b8bf06152b31 None None] MFA Rules not processed for user `40e6b1af162742d18c8c76d0515257fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:47.334554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a8545d85-3f3c-44e9-bec0-b8bf06152b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:47.346835 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2655/5301] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:13:47.385334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2141d-0fe7-49f8-a596-4c2b806c5c80 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:47.386401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2141d-0fe7-49f8-a596-4c2b806c5c80 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:47.387076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2141d-0fe7-49f8-a596-4c2b806c5c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:47.426041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-99e2141d-0fe7-49f8-a596-4c2b806c5c80 None None] MFA Rules not processed for user `40e6b1af162742d18c8c76d0515257fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:47.427632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-99e2141d-0fe7-49f8-a596-4c2b806c5c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:47.439918 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2647/5302] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:47.497639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d148a-2f2b-4a17-bef2-b52a1b4f2e9e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:47.497951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d148a-2f2b-4a17-bef2-b52a1b4f2e9e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:47.498198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d148a-2f2b-4a17-bef2-b52a1b4f2e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:47.566330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-505d148a-2f2b-4a17-bef2-b52a1b4f2e9e None None] MFA Rules not processed for user `40e6b1af162742d18c8c76d0515257fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:47.567923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-505d148a-2f2b-4a17-bef2-b52a1b4f2e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:47.581528 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2656/5303] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:47.722161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2141d-0fe7-49f8-a596-4c2b806c5c80 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:47.847440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2141d-0fe7-49f8-a596-4c2b806c5c80 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:47.853190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:47.854697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:47.855566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:47.856073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] PATH_INFO: `/v3/users/40e6b1af162742d18c8c76d0515257fe` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:47.857806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e6b1af162742d18c8c76d0515257fe)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:47.860974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:47.901805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:47.946724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e6b1af162742d18c8c76d0515257fe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:47.957364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e6b1af162742d18c8c76d0515257fe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:47.958283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e6b1af162742d18c8c76d0515257fe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:47.984759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e6b1af162742d18c8c76d0515257fe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:47.985570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e6b1af162742d18c8c76d0515257fe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:48.021483 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2648/5304] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:13:47 2022] DELETE /identity/v3/users/40e6b1af162742d18c8c76d0515257fe => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:48.037544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f27d78-49d2-477b-a2fd-976dbd64ed5c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:48.037839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f27d78-49d2-477b-a2fd-976dbd64ed5c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:48.038148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f27d78-49d2-477b-a2fd-976dbd64ed5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:48.062651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-83f27d78-49d2-477b-a2fd-976dbd64ed5c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:48.064535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-83f27d78-49d2-477b-a2fd-976dbd64ed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:48.149372 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2657/5305] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:48.174325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:48.179905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:48.341189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c6e4a-c1e0-4c31-a9db-bf34498aeb60 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:48.349908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da7910-097b-45fd-8d9b-0c0f6da0d501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:48.349908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da7910-097b-45fd-8d9b-0c0f6da0d501 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:48.350344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da7910-097b-45fd-8d9b-0c0f6da0d501 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:48.350626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da7910-097b-45fd-8d9b-0c0f6da0d501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:48.373201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da7910-097b-45fd-8d9b-0c0f6da0d501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:48.375251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da7910-097b-45fd-8d9b-0c0f6da0d501 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:48.406404 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2649/5306] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:49.499694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f27d78-49d2-477b-a2fd-976dbd64ed5c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:49.502119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-83f27d78-49d2-477b-a2fd-976dbd64ed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:49.526137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f27d78-49d2-477b-a2fd-976dbd64ed5c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:49.540574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a17b90-dcae-43d7-8355-0cc330e031df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:49.541754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17b90-dcae-43d7-8355-0cc330e031df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:49.542034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17b90-dcae-43d7-8355-0cc330e031df admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:49.542356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17b90-dcae-43d7-8355-0cc330e031df admin admin] PATH_INFO: `/v3/projects/14b4d96a322648f692944ec905ffb064` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:49.549102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a17b90-dcae-43d7-8355-0cc330e031df admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b4d96a322648f692944ec905ffb064)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:49.551779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a17b90-dcae-43d7-8355-0cc330e031df admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:49.699996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19a17b90-dcae-43d7-8355-0cc330e031df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b4d96a322648f692944ec905ffb064', 'request_id': 'req-19a17b90-dcae-43d7-8355-0cc330e031df'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:49.708221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19a17b90-dcae-43d7-8355-0cc330e031df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b4d96a322648f692944ec905ffb064', 'request_id': 'req-19a17b90-dcae-43d7-8355-0cc330e031df'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:49.718706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19a17b90-dcae-43d7-8355-0cc330e031df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b4d96a322648f692944ec905ffb064', 'request_id': 'req-19a17b90-dcae-43d7-8355-0cc330e031df'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:49.768976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19a17b90-dcae-43d7-8355-0cc330e031df admin admin] The token cache is being invalidate because project 14b4d96a322648f692944ec905ffb064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:13:49.769226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19a17b90-dcae-43d7-8355-0cc330e031df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:49.769951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19a17b90-dcae-43d7-8355-0cc330e031df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:49.771772 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2658/5307] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:13:49 2022] DELETE /identity/v3/projects/14b4d96a322648f692944ec905ffb064 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:49.778579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea464c28-f922-4fee-937a-0482adb47933 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:49.779172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea464c28-f922-4fee-937a-0482adb47933 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:49.779280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea464c28-f922-4fee-937a-0482adb47933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:49.808168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ea464c28-f922-4fee-937a-0482adb47933 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:49.809511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ea464c28-f922-4fee-937a-0482adb47933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:49.919005 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2650/5308] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:13:49.922179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff76d90-0069-40a8-a6bf-4ec3afde9521 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:49.922477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff76d90-0069-40a8-a6bf-4ec3afde9521 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:49.922783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff76d90-0069-40a8-a6bf-4ec3afde9521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:49.966448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3ff76d90-0069-40a8-a6bf-4ec3afde9521 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:49.968464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ff76d90-0069-40a8-a6bf-4ec3afde9521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:50.002275 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2659/5309] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:50.006841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea464c28-f922-4fee-937a-0482adb47933 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:50.018808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea464c28-f922-4fee-937a-0482adb47933 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:50.024655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74debb-36a4-4262-a9c3-958d688ec7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:50.026363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74debb-36a4-4262-a9c3-958d688ec7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:50.026718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74debb-36a4-4262-a9c3-958d688ec7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:50.027159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74debb-36a4-4262-a9c3-958d688ec7e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:50.027951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74debb-36a4-4262-a9c3-958d688ec7e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:13:50.028365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74debb-36a4-4262-a9c3-958d688ec7e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:50.030142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74debb-36a4-4262-a9c3-958d688ec7e8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:50.047830 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2651/5310] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:13:50.052859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff76d90-0069-40a8-a6bf-4ec3afde9521 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:50.063957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff76d90-0069-40a8-a6bf-4ec3afde9521 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:50.068833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c5e21-88f6-4bfc-a1c1-4a436b111e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:50.069451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c5e21-88f6-4bfc-a1c1-4a436b111e68 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:50.069741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c5e21-88f6-4bfc-a1c1-4a436b111e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:50.070021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c5e21-88f6-4bfc-a1c1-4a436b111e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:50.070668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c5e21-88f6-4bfc-a1c1-4a436b111e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:50.073711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c5e21-88f6-4bfc-a1c1-4a436b111e68 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:50.111656 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2660/5311] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:13:50 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:50.116354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74debb-36a4-4262-a9c3-958d688ec7e8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:50.129802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74debb-36a4-4262-a9c3-958d688ec7e8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:50.175109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:50.226786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08dbf4-6672-4423-83e6-f13be8f9a244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:50.227693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08dbf4-6672-4423-83e6-f13be8f9a244 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:50.228137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08dbf4-6672-4423-83e6-f13be8f9a244 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:50.229146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08dbf4-6672-4423-83e6-f13be8f9a244 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:50.230053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08dbf4-6672-4423-83e6-f13be8f9a244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:50.232152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08dbf4-6672-4423-83e6-f13be8f9a244 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:50.265331 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2652/5312] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:13:50 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:13:50.271479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c5e21-88f6-4bfc-a1c1-4a436b111e68 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:50.307694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c5e21-88f6-4bfc-a1c1-4a436b111e68 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:50.319392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6b8b9-4feb-42ee-a2ae-d01aedb51f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:50.320487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6b8b9-4feb-42ee-a2ae-d01aedb51f52 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:50.321388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6b8b9-4feb-42ee-a2ae-d01aedb51f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:50.322646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6b8b9-4feb-42ee-a2ae-d01aedb51f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:50.325573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6b8b9-4feb-42ee-a2ae-d01aedb51f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:50.328903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6b8b9-4feb-42ee-a2ae-d01aedb51f52 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:50.333945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:50.353317 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2661/5313] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:50.358462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08dbf4-6672-4423-83e6-f13be8f9a244 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:50.370428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08dbf4-6672-4423-83e6-f13be8f9a244 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:50.375810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4fe89-8415-485b-8ac1-9c1237aa3cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:50.376451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4fe89-8415-485b-8ac1-9c1237aa3cbd admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:50.376739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4fe89-8415-485b-8ac1-9c1237aa3cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:50.377077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4fe89-8415-485b-8ac1-9c1237aa3cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:50.380382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4fe89-8415-485b-8ac1-9c1237aa3cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:50.380382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4fe89-8415-485b-8ac1-9c1237aa3cbd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:50.394851 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2653/5314] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:50.400433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6b8b9-4feb-42ee-a2ae-d01aedb51f52 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:50.413474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6b8b9-4feb-42ee-a2ae-d01aedb51f52 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:50.427446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd47f1-1d91-4fc1-a48e-3890ffeb7f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:50.432596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd47f1-1d91-4fc1-a48e-3890ffeb7f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:50.433012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd47f1-1d91-4fc1-a48e-3890ffeb7f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:50.433408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd47f1-1d91-4fc1-a48e-3890ffeb7f23 admin admin] PATH_INFO: `/v3/projects/3a00dc9c23eb434886ec9239ccea90a8/users/5ad542867a374435b650914465bffc91/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:50.455972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd47f1-1d91-4fc1-a48e-3890ffeb7f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a00dc9c23eb434886ec9239ccea90a8, user_id=5ad542867a374435b650914465bffc91, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:50.459010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd47f1-1d91-4fc1-a48e-3890ffeb7f23 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:50.477401 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2662/5315] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:13:50 2022] PUT /identity/v3/projects/3a00dc9c23eb434886ec9239ccea90a8/users/5ad542867a374435b650914465bffc91/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:50.485143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e35292-9d43-4760-80c4-e75c2ea2da34 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:50.485519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e35292-9d43-4760-80c4-e75c2ea2da34 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:50.485863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e35292-9d43-4760-80c4-e75c2ea2da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:50.514014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d1e35292-9d43-4760-80c4-e75c2ea2da34 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:50.515465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d1e35292-9d43-4760-80c4-e75c2ea2da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:50.613075 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2654/5316] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:50.628200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd47f1-1d91-4fc1-a48e-3890ffeb7f23 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:50.631504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6fcd47f1-1d91-4fc1-a48e-3890ffeb7f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:50.742663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd47f1-1d91-4fc1-a48e-3890ffeb7f23 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:50.751271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918e00c-76b8-4de9-b707-e797640be980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:50.752426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918e00c-76b8-4de9-b707-e797640be980 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:50.752710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918e00c-76b8-4de9-b707-e797640be980 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:50.756821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918e00c-76b8-4de9-b707-e797640be980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:50.783563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918e00c-76b8-4de9-b707-e797640be980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:50.785139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918e00c-76b8-4de9-b707-e797640be980 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:50.828493 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2663/5317] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:51.898470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e35292-9d43-4760-80c4-e75c2ea2da34 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:51.901013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d1e35292-9d43-4760-80c4-e75c2ea2da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:51.925093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e35292-9d43-4760-80c4-e75c2ea2da34 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:51.942425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:51.943570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:51.943962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:51.944464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] PATH_INFO: `/v3/users/203ce44cfff84b25bf0b1145735d8d61` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:51.946063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] RBAC: Authorizing `identity:delete_user(user_id=203ce44cfff84b25bf0b1145735d8d61)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:51.948972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:52.030983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '203ce44cfff84b25bf0b1145735d8d61'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:52.043005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '203ce44cfff84b25bf0b1145735d8d61'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:52.044076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '203ce44cfff84b25bf0b1145735d8d61'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:52.092670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '203ce44cfff84b25bf0b1145735d8d61'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:52.093507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '203ce44cfff84b25bf0b1145735d8d61'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:52.119894 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2655/5318] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:13:51 2022] DELETE /identity/v3/users/203ce44cfff84b25bf0b1145735d8d61 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:52.126612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f86850-aff8-4222-9d18-6a8f74008172 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:52.127184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f86850-aff8-4222-9d18-6a8f74008172 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:52.127359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f86850-aff8-4222-9d18-6a8f74008172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:52.207077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-94f86850-aff8-4222-9d18-6a8f74008172 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:52.212136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-94f86850-aff8-4222-9d18-6a8f74008172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:52.393621 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2664/5319] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:52.492622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:52.496141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:52.586004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:52.734964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b052cf-f4b0-48af-a7da-b804f2a1568d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:52.746445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57856ef2-506d-4e6c-8f8c-6da26482fa81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:52.748980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57856ef2-506d-4e6c-8f8c-6da26482fa81 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:52.753314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57856ef2-506d-4e6c-8f8c-6da26482fa81 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:52.754978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57856ef2-506d-4e6c-8f8c-6da26482fa81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:52.783435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57856ef2-506d-4e6c-8f8c-6da26482fa81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:52.785096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57856ef2-506d-4e6c-8f8c-6da26482fa81 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:52.799755 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2656/5320] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:13:53.238395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bd0fe-b07a-45d3-9745-83fe369938ad None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:53.239506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bd0fe-b07a-45d3-9745-83fe369938ad None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:53.240017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bd0fe-b07a-45d3-9745-83fe369938ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:53.434295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e61bd0fe-b07a-45d3-9745-83fe369938ad None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:53.435635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e61bd0fe-b07a-45d3-9745-83fe369938ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:53.558317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:53.590154 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2665/5321] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:13:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:13:53.607511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57856ef2-506d-4e6c-8f8c-6da26482fa81 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:53.611803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-57856ef2-506d-4e6c-8f8c-6da26482fa81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:53.824632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57856ef2-506d-4e6c-8f8c-6da26482fa81 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:53.834000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6c03c-5b02-4bcf-919c-1f9996f7b632 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:53.835631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6c03c-5b02-4bcf-919c-1f9996f7b632 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:53.835631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6c03c-5b02-4bcf-919c-1f9996f7b632 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:53.836415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6c03c-5b02-4bcf-919c-1f9996f7b632 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:53.848412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6c03c-5b02-4bcf-919c-1f9996f7b632 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:53.851090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6c03c-5b02-4bcf-919c-1f9996f7b632 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:53.866386 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2657/5322] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:13:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:13:54.243018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bd0fe-b07a-45d3-9745-83fe369938ad None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:54.247580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e61bd0fe-b07a-45d3-9745-83fe369938ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:54.318784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bd0fe-b07a-45d3-9745-83fe369938ad None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:54.340743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7fe5-3d16-430a-9aa9-3208c38884ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:54.341769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7fe5-3d16-430a-9aa9-3208c38884ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:54.342224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7fe5-3d16-430a-9aa9-3208c38884ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:54.342979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7fe5-3d16-430a-9aa9-3208c38884ea admin admin] PATH_INFO: `/v3/projects/617f27a3e33c4496b18a220479b94504` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:54.347747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc7fe5-3d16-430a-9aa9-3208c38884ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=617f27a3e33c4496b18a220479b94504)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:54.357609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc7fe5-3d16-430a-9aa9-3208c38884ea admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:54.524440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36cc7fe5-3d16-430a-9aa9-3208c38884ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '617f27a3e33c4496b18a220479b94504', 'request_id': 'req-36cc7fe5-3d16-430a-9aa9-3208c38884ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:54.533925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36cc7fe5-3d16-430a-9aa9-3208c38884ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '617f27a3e33c4496b18a220479b94504', 'request_id': 'req-36cc7fe5-3d16-430a-9aa9-3208c38884ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:54.549482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36cc7fe5-3d16-430a-9aa9-3208c38884ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '617f27a3e33c4496b18a220479b94504', 'request_id': 'req-36cc7fe5-3d16-430a-9aa9-3208c38884ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:54.585343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36cc7fe5-3d16-430a-9aa9-3208c38884ea admin admin] The token cache is being invalidate because project 617f27a3e33c4496b18a220479b94504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:13:54.585646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36cc7fe5-3d16-430a-9aa9-3208c38884ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:54.586330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-36cc7fe5-3d16-430a-9aa9-3208c38884ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:54.609410 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2666/5323] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:13:54 2022] DELETE /identity/v3/projects/617f27a3e33c4496b18a220479b94504 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:54.611375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0418-5af8-4d0f-becf-f85be471d28a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:54.612848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0418-5af8-4d0f-becf-f85be471d28a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:54.613248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0418-5af8-4d0f-becf-f85be471d28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:54.658172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fb8f0418-5af8-4d0f-becf-f85be471d28a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:54.660036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fb8f0418-5af8-4d0f-becf-f85be471d28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:54.849487 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2658/5324] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:54.858765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54491c-115d-430f-b862-d888157ef61c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:54.859280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54491c-115d-430f-b862-d888157ef61c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:54.860036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54491c-115d-430f-b862-d888157ef61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:54.924583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9b54491c-115d-430f-b862-d888157ef61c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:54.928120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9b54491c-115d-430f-b862-d888157ef61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:54.970537 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2667/5325] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:13:54.971870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f0418-5af8-4d0f-becf-f85be471d28a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:54.988624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f0418-5af8-4d0f-becf-f85be471d28a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:55.006511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd778f47-9890-4751-9610-5ebafac7bd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:55.014610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd778f47-9890-4751-9610-5ebafac7bd45 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:55.015351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd778f47-9890-4751-9610-5ebafac7bd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:55.015683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd778f47-9890-4751-9610-5ebafac7bd45 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:55.017120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd778f47-9890-4751-9610-5ebafac7bd45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:13:55.017595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd778f47-9890-4751-9610-5ebafac7bd45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:55.019762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd778f47-9890-4751-9610-5ebafac7bd45 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:55.049728 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2659/5326] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:13:55.051995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54491c-115d-430f-b862-d888157ef61c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:55.078066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54491c-115d-430f-b862-d888157ef61c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:55.088777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a466b08-a759-42a2-aabf-0832718cd1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:55.091782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466b08-a759-42a2-aabf-0832718cd1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:55.092204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466b08-a759-42a2-aabf-0832718cd1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:55.092734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466b08-a759-42a2-aabf-0832718cd1c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:55.093975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a466b08-a759-42a2-aabf-0832718cd1c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:55.101457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a466b08-a759-42a2-aabf-0832718cd1c1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:55.191962 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2668/5327] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:13:55 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:55.196999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd778f47-9890-4751-9610-5ebafac7bd45 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:55.217439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd778f47-9890-4751-9610-5ebafac7bd45 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:55.293100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:55.377279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d46cb-514a-4d89-b0e9-e111ef9d4263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:55.377941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d46cb-514a-4d89-b0e9-e111ef9d4263 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:55.378222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d46cb-514a-4d89-b0e9-e111ef9d4263 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:55.378493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d46cb-514a-4d89-b0e9-e111ef9d4263 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:55.379180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d46cb-514a-4d89-b0e9-e111ef9d4263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:55.383450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d46cb-514a-4d89-b0e9-e111ef9d4263 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:55.459770 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2660/5328] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:13:55 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:13:55.465055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a466b08-a759-42a2-aabf-0832718cd1c1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:55.487753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a466b08-a759-42a2-aabf-0832718cd1c1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:55.504649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85782-1afb-4dc1-8790-8e7bafe73d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:55.506767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85782-1afb-4dc1-8790-8e7bafe73d43 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:55.507305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85782-1afb-4dc1-8790-8e7bafe73d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:55.508783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85782-1afb-4dc1-8790-8e7bafe73d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:55.512298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c85782-1afb-4dc1-8790-8e7bafe73d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:55.516563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c85782-1afb-4dc1-8790-8e7bafe73d43 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:55.571474 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2669/5329] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:55.576300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d46cb-514a-4d89-b0e9-e111ef9d4263 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:55.596754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d46cb-514a-4d89-b0e9-e111ef9d4263 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:55.621417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6cca7-14cb-4d83-80c4-0fe8a1854acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:55.627169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6cca7-14cb-4d83-80c4-0fe8a1854acd admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:55.630107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6cca7-14cb-4d83-80c4-0fe8a1854acd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:55.630831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6cca7-14cb-4d83-80c4-0fe8a1854acd admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:55.633683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6cca7-14cb-4d83-80c4-0fe8a1854acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:55.642581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6cca7-14cb-4d83-80c4-0fe8a1854acd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:55.690323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85782-1afb-4dc1-8790-8e7bafe73d43 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:55.701670 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2661/5330] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:13:55.704981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c85782-1afb-4dc1-8790-8e7bafe73d43 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:55.723373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457de83-ad58-4eba-80f8-754d52cb1c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:55.725122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457de83-ad58-4eba-80f8-754d52cb1c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:55.725638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457de83-ad58-4eba-80f8-754d52cb1c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:55.730671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457de83-ad58-4eba-80f8-754d52cb1c6b admin admin] PATH_INFO: `/v3/projects/5d02326314594584ad67813273bb0bec/users/b5167fc069d245e793941355180e464c/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:55.792660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457de83-ad58-4eba-80f8-754d52cb1c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d02326314594584ad67813273bb0bec, user_id=b5167fc069d245e793941355180e464c, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:55.813022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457de83-ad58-4eba-80f8-754d52cb1c6b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:55.862484 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2670/5331] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:13:55 2022] PUT /identity/v3/projects/5d02326314594584ad67813273bb0bec/users/b5167fc069d245e793941355180e464c/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:55.872682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045e60c-a3a5-4e8d-8fde-768ffc0971fd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:55.873216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045e60c-a3a5-4e8d-8fde-768ffc0971fd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:55.873631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045e60c-a3a5-4e8d-8fde-768ffc0971fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:55.977467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8045e60c-a3a5-4e8d-8fde-768ffc0971fd None None] MFA Rules not processed for user `b5167fc069d245e793941355180e464c`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:55.979579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8045e60c-a3a5-4e8d-8fde-768ffc0971fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:56.203828 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2662/5332] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:56.211870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457de83-ad58-4eba-80f8-754d52cb1c6b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:56.214709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8457de83-ad58-4eba-80f8-754d52cb1c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:56.451560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457de83-ad58-4eba-80f8-754d52cb1c6b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:56.457389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461a2bc-926a-483c-be95-08bc162487c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:56.458237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a2bc-926a-483c-be95-08bc162487c1 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:56.458932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a2bc-926a-483c-be95-08bc162487c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:56.459316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a2bc-926a-483c-be95-08bc162487c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:56.472992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461a2bc-926a-483c-be95-08bc162487c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:56.475062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461a2bc-926a-483c-be95-08bc162487c1 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:56.527025 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2671/5333] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:56.588256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045e60c-a3a5-4e8d-8fde-768ffc0971fd None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:56.718050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045e60c-a3a5-4e8d-8fde-768ffc0971fd None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:56.730417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:56.731394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:56.731849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:56.732281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] PATH_INFO: `/v3/users/b5167fc069d245e793941355180e464c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:56.734659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5167fc069d245e793941355180e464c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:56.738012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:56.838618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:56.869527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5167fc069d245e793941355180e464c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:56.896102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5167fc069d245e793941355180e464c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:56.903001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5167fc069d245e793941355180e464c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:57.048153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5167fc069d245e793941355180e464c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:57.058087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5167fc069d245e793941355180e464c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:57.116907 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2663/5334] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:13:56 2022] DELETE /identity/v3/users/b5167fc069d245e793941355180e464c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:57.122219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb6da-e027-4dbd-9712-a65a9e684429 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:57.122618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb6da-e027-4dbd-9712-a65a9e684429 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:57.123058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb6da-e027-4dbd-9712-a65a9e684429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:57.200739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f3ddb6da-e027-4dbd-9712-a65a9e684429 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:57.205982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f3ddb6da-e027-4dbd-9712-a65a9e684429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:57.227177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:13:57.440027 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2672/5335] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:57.474791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:57.477293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:57.679435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d813a-e212-43de-aab8-c8cbf075c04e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:57.687698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7a8f7-07ba-4eb7-8b4c-f503747dd1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:57.688356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a8f7-07ba-4eb7-8b4c-f503747dd1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:57.688640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a8f7-07ba-4eb7-8b4c-f503747dd1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:57.688915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7a8f7-07ba-4eb7-8b4c-f503747dd1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:57.716965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7a8f7-07ba-4eb7-8b4c-f503747dd1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:57.718586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7a8f7-07ba-4eb7-8b4c-f503747dd1c9 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:57.735527 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2664/5336] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:13:59.443696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddb6da-e027-4dbd-9712-a65a9e684429 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:13:59.445838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f3ddb6da-e027-4dbd-9712-a65a9e684429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:59.471393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddb6da-e027-4dbd-9712-a65a9e684429 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:13:59.489738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99019c1a-72bb-40e8-aeca-b101972895cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:13:59.490688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99019c1a-72bb-40e8-aeca-b101972895cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:59.491076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99019c1a-72bb-40e8-aeca-b101972895cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:59.491294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99019c1a-72bb-40e8-aeca-b101972895cf admin admin] PATH_INFO: `/v3/projects/5d02326314594584ad67813273bb0bec` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:59.497389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99019c1a-72bb-40e8-aeca-b101972895cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d02326314594584ad67813273bb0bec)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:13:59.501272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99019c1a-72bb-40e8-aeca-b101972895cf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:13:59.687763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-99019c1a-72bb-40e8-aeca-b101972895cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d02326314594584ad67813273bb0bec', 'request_id': 'req-99019c1a-72bb-40e8-aeca-b101972895cf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:59.705892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-99019c1a-72bb-40e8-aeca-b101972895cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d02326314594584ad67813273bb0bec', 'request_id': 'req-99019c1a-72bb-40e8-aeca-b101972895cf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:59.720268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-99019c1a-72bb-40e8-aeca-b101972895cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d02326314594584ad67813273bb0bec', 'request_id': 'req-99019c1a-72bb-40e8-aeca-b101972895cf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:59.747224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-99019c1a-72bb-40e8-aeca-b101972895cf admin admin] The token cache is being invalidate because project 5d02326314594584ad67813273bb0bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:13:59.749354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-99019c1a-72bb-40e8-aeca-b101972895cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:59.750314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-99019c1a-72bb-40e8-aeca-b101972895cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:13:59.754610 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2673/5337] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:13:59 2022] DELETE /identity/v3/projects/5d02326314594584ad67813273bb0bec => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:13:59.761089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd6a08-18d5-406b-bd74-9ca119615a9d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:59.762417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd6a08-18d5-406b-bd74-9ca119615a9d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:59.763136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd6a08-18d5-406b-bd74-9ca119615a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:13:59.807997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-04fd6a08-18d5-406b-bd74-9ca119615a9d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:13:59.809824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-04fd6a08-18d5-406b-bd74-9ca119615a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:13:59.991507 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2665/5338] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:13:59.994454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce85f92-3fae-4a7b-8f61-361065ad423f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:13:59.994880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce85f92-3fae-4a7b-8f61-361065ad423f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:13:59.995489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce85f92-3fae-4a7b-8f61-361065ad423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:00.067562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-bce85f92-3fae-4a7b-8f61-361065ad423f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:00.076361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bce85f92-3fae-4a7b-8f61-361065ad423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:00.092755 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2674/5339] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:00.097781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd6a08-18d5-406b-bd74-9ca119615a9d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:00.120437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd6a08-18d5-406b-bd74-9ca119615a9d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:00.137647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fc1f9-03dd-4e80-a30a-8577715021f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:00.139024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fc1f9-03dd-4e80-a30a-8577715021f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:00.139561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fc1f9-03dd-4e80-a30a-8577715021f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:00.140826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fc1f9-03dd-4e80-a30a-8577715021f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:00.141912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fc1f9-03dd-4e80-a30a-8577715021f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:14:00.155449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fc1f9-03dd-4e80-a30a-8577715021f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:00.157403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fc1f9-03dd-4e80-a30a-8577715021f4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:00.185660 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2666/5340] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:14:00.189980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce85f92-3fae-4a7b-8f61-361065ad423f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:00.203856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce85f92-3fae-4a7b-8f61-361065ad423f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:00.219346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d583522-16d2-4df4-be5b-06a0dbf19dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:00.221428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d583522-16d2-4df4-be5b-06a0dbf19dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:00.224718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d583522-16d2-4df4-be5b-06a0dbf19dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:00.225120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d583522-16d2-4df4-be5b-06a0dbf19dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:00.227516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d583522-16d2-4df4-be5b-06a0dbf19dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:00.232881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d583522-16d2-4df4-be5b-06a0dbf19dc6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:00.320868 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2675/5341] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:14:00 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:14:00.326640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fc1f9-03dd-4e80-a30a-8577715021f4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:00.371539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fc1f9-03dd-4e80-a30a-8577715021f4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:00.476151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:00.519544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d68a2-486b-46f7-8e90-ddcce4688625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:00.520277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d68a2-486b-46f7-8e90-ddcce4688625 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:00.520633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d68a2-486b-46f7-8e90-ddcce4688625 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:00.521936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d68a2-486b-46f7-8e90-ddcce4688625 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:00.521936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d68a2-486b-46f7-8e90-ddcce4688625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:00.525559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d68a2-486b-46f7-8e90-ddcce4688625 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:00.582510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d583522-16d2-4df4-be5b-06a0dbf19dc6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:00.596276 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2667/5342] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:14:00 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:14:00.598110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d583522-16d2-4df4-be5b-06a0dbf19dc6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:00.606207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b361111-f33e-4027-b438-3d7d1349def7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:00.608051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b361111-f33e-4027-b438-3d7d1349def7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:00.608573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b361111-f33e-4027-b438-3d7d1349def7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:00.609037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b361111-f33e-4027-b438-3d7d1349def7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:00.609880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b361111-f33e-4027-b438-3d7d1349def7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:00.611720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b361111-f33e-4027-b438-3d7d1349def7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:00.632830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d68a2-486b-46f7-8e90-ddcce4688625 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:00.633722 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2676/5343] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:14:00.649684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d68a2-486b-46f7-8e90-ddcce4688625 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:00.668268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e52d2-6712-408d-812e-939255565fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:00.672120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e52d2-6712-408d-812e-939255565fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:00.672654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e52d2-6712-408d-812e-939255565fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:00.673138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e52d2-6712-408d-812e-939255565fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:00.674361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e52d2-6712-408d-812e-939255565fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:00.677543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e52d2-6712-408d-812e-939255565fe0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:00.737834 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2668/5344] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:14:00.744905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b361111-f33e-4027-b438-3d7d1349def7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:00.788472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b361111-f33e-4027-b438-3d7d1349def7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:00.810949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed59a8-381f-4718-b3fd-f4f823176961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:00.812633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed59a8-381f-4718-b3fd-f4f823176961 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:00.813443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed59a8-381f-4718-b3fd-f4f823176961 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:00.814309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed59a8-381f-4718-b3fd-f4f823176961 admin admin] PATH_INFO: `/v3/projects/5ab98fff6a764fc19c5386bc6486dd94/users/c67fb1d8b53148a89cfdff2a5a4395f9/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:00.854652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed59a8-381f-4718-b3fd-f4f823176961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab98fff6a764fc19c5386bc6486dd94, user_id=c67fb1d8b53148a89cfdff2a5a4395f9, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:00.861007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed59a8-381f-4718-b3fd-f4f823176961 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:00.933628 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2677/5345] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:14:00 2022] PUT /identity/v3/projects/5ab98fff6a764fc19c5386bc6486dd94/users/c67fb1d8b53148a89cfdff2a5a4395f9/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:00.937700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72e612-f516-4438-8624-5acb461379f2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:00.938490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72e612-f516-4438-8624-5acb461379f2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:00.938924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72e612-f516-4438-8624-5acb461379f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:01.004496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8f72e612-f516-4438-8624-5acb461379f2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:01.005954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8f72e612-f516-4438-8624-5acb461379f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:01.221092 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2669/5346] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:01.281047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed59a8-381f-4718-b3fd-f4f823176961 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:01.283012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8fed59a8-381f-4718-b3fd-f4f823176961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:01.387507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:01.470129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed59a8-381f-4718-b3fd-f4f823176961 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:01.483484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1de0bc-2ee7-408a-938d-df39706b4637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:01.487521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1de0bc-2ee7-408a-938d-df39706b4637 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:01.488109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1de0bc-2ee7-408a-938d-df39706b4637 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:01.488923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1de0bc-2ee7-408a-938d-df39706b4637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:01.518148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1de0bc-2ee7-408a-938d-df39706b4637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:01.519999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1de0bc-2ee7-408a-938d-df39706b4637 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:01.550323 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2678/5347] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:02.001121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9434b3-b836-43bb-8116-0c3817f5af91 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:02.001708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9434b3-b836-43bb-8116-0c3817f5af91 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:02.001708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9434b3-b836-43bb-8116-0c3817f5af91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:02.106545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fe9434b3-b836-43bb-8116-0c3817f5af91 None None] MFA Rules not processed for user `5ad542867a374435b650914465bffc91`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:02.112417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fe9434b3-b836-43bb-8116-0c3817f5af91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:02.373348 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2670/5348] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:02.386372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1de0bc-2ee7-408a-938d-df39706b4637 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:02.388630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7e1de0bc-2ee7-408a-938d-df39706b4637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:02.615626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1de0bc-2ee7-408a-938d-df39706b4637 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:02.623661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1e8ad-68b8-44c4-8f9e-7fb157892867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:02.624327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1e8ad-68b8-44c4-8f9e-7fb157892867 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:02.624613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1e8ad-68b8-44c4-8f9e-7fb157892867 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:02.624890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1e8ad-68b8-44c4-8f9e-7fb157892867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:02.670101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1e8ad-68b8-44c4-8f9e-7fb157892867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:02.673161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1e8ad-68b8-44c4-8f9e-7fb157892867 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:02.739311 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2679/5349] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:03.500573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7bb84-e530-404f-88c4-2699b10a0bb7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:03.501529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7bb84-e530-404f-88c4-2699b10a0bb7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:03.501982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7bb84-e530-404f-88c4-2699b10a0bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:03.598759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1bb7bb84-e530-404f-88c4-2699b10a0bb7 None None] MFA Rules not processed for user `c67fb1d8b53148a89cfdff2a5a4395f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:03.600459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1bb7bb84-e530-404f-88c4-2699b10a0bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:03.777042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:03.892278 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2671/5350] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:03.911179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1e8ad-68b8-44c4-8f9e-7fb157892867 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:03.912898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a3b1e8ad-68b8-44c4-8f9e-7fb157892867 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:04.110766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1e8ad-68b8-44c4-8f9e-7fb157892867 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:04.125276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fdc91-1237-4bb9-ba9f-db8dfebcb3ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:04.127330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fdc91-1237-4bb9-ba9f-db8dfebcb3ac service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:04.132765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fdc91-1237-4bb9-ba9f-db8dfebcb3ac service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:04.134028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fdc91-1237-4bb9-ba9f-db8dfebcb3ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:04.172448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fdc91-1237-4bb9-ba9f-db8dfebcb3ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:04.177916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fdc91-1237-4bb9-ba9f-db8dfebcb3ac service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:04.258476 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2680/5351] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:14:04.838221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938278d-e7c8-43f6-9ce2-48a274ef3d6a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:04.839072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938278d-e7c8-43f6-9ce2-48a274ef3d6a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:04.839072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938278d-e7c8-43f6-9ce2-48a274ef3d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:04.914214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9938278d-e7c8-43f6-9ce2-48a274ef3d6a None None] MFA Rules not processed for user `5ad542867a374435b650914465bffc91`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:04.916001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9938278d-e7c8-43f6-9ce2-48a274ef3d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:04.950107 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2672/5352] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:05.945889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fdc91-1237-4bb9-ba9f-db8dfebcb3ac service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:05.948447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-672fdc91-1237-4bb9-ba9f-db8dfebcb3ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:05.976918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fdc91-1237-4bb9-ba9f-db8dfebcb3ac service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:05.987057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225cf84-e6bb-4786-aba5-eec4eddb4c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:05.987691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225cf84-e6bb-4786-aba5-eec4eddb4c8c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:05.998001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225cf84-e6bb-4786-aba5-eec4eddb4c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:05.998329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225cf84-e6bb-4786-aba5-eec4eddb4c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:06.000459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0225cf84-e6bb-4786-aba5-eec4eddb4c8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:06.053533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225cf84-e6bb-4786-aba5-eec4eddb4c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:06.058152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225cf84-e6bb-4786-aba5-eec4eddb4c8c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:06.083243 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2681/5353] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:08.049161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bbc48-9e53-48fc-9e30-a3c7dbb3fa8e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:08.050068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bbc48-9e53-48fc-9e30-a3c7dbb3fa8e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:08.050501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bbc48-9e53-48fc-9e30-a3c7dbb3fa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:08.099786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d14bbc48-9e53-48fc-9e30-a3c7dbb3fa8e None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:08.104434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d14bbc48-9e53-48fc-9e30-a3c7dbb3fa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:08.248695 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2673/5354] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:14:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:08.270985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225cf84-e6bb-4786-aba5-eec4eddb4c8c service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:08.275829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0225cf84-e6bb-4786-aba5-eec4eddb4c8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:08.435938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:08.509658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225cf84-e6bb-4786-aba5-eec4eddb4c8c service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:08.526511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a1018-be0f-4a57-9667-9a840c0c7735 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:08.529387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a1018-be0f-4a57-9667-9a840c0c7735 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:08.529666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a1018-be0f-4a57-9667-9a840c0c7735 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:08.529941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a1018-be0f-4a57-9667-9a840c0c7735 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:08.549655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a1018-be0f-4a57-9667-9a840c0c7735 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:08.551347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a1018-be0f-4a57-9667-9a840c0c7735 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:08.569698 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2682/5355] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:14:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:14:18.233678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=36 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:18.562310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:22.619866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bbc48-9e53-48fc-9e30-a3c7dbb3fa8e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:22.622237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d14bbc48-9e53-48fc-9e30-a3c7dbb3fa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:22.650948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bbc48-9e53-48fc-9e30-a3c7dbb3fa8e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:22.664434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:22.665791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:22.667393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:22.668116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] PATH_INFO: `/v3/users/c5cc2a493b6f4c2f9c0572a62d36a249` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:22.669769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5cc2a493b6f4c2f9c0572a62d36a249)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:22.675661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:22.944443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5cc2a493b6f4c2f9c0572a62d36a249'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:22.958534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5cc2a493b6f4c2f9c0572a62d36a249'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:22.959449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5cc2a493b6f4c2f9c0572a62d36a249'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:22.999584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5cc2a493b6f4c2f9c0572a62d36a249'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:23.015263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5cc2a493b6f4c2f9c0572a62d36a249'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:23.090455 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2674/5356] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:14:22 2022] DELETE /identity/v3/users/c5cc2a493b6f4c2f9c0572a62d36a249 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:23.095438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc3017-3274-4ff1-b744-b9c11689a742 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:23.095996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc3017-3274-4ff1-b744-b9c11689a742 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:23.095996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc3017-3274-4ff1-b744-b9c11689a742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:23.283945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2edc3017-3274-4ff1-b744-b9c11689a742 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:23.284925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2edc3017-3274-4ff1-b744-b9c11689a742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:23.433515 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2683/5357] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:23.444790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:23.446392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:23.697686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ca3f5-c1b2-4e42-b82d-b06c7dad7a90 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:23.710611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d13fe1-ea4e-4e53-9b7d-5b8286abdde7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:23.712828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d13fe1-ea4e-4e53-9b7d-5b8286abdde7 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:23.713355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d13fe1-ea4e-4e53-9b7d-5b8286abdde7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:23.713898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d13fe1-ea4e-4e53-9b7d-5b8286abdde7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:23.743183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d13fe1-ea4e-4e53-9b7d-5b8286abdde7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:23.745125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d13fe1-ea4e-4e53-9b7d-5b8286abdde7 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:23.776805 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2675/5358] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:14:24.505775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc3017-3274-4ff1-b744-b9c11689a742 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:24.507263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2edc3017-3274-4ff1-b744-b9c11689a742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:24.531006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc3017-3274-4ff1-b744-b9c11689a742 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:24.545940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88393948-637f-47ce-a136-0c891b94a7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:24.546607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393948-637f-47ce-a136-0c891b94a7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:24.546924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393948-637f-47ce-a136-0c891b94a7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:24.547201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393948-637f-47ce-a136-0c891b94a7c6 admin admin] PATH_INFO: `/v3/projects/2e6906a127444b369ea10b45b7d238db` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:24.549114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88393948-637f-47ce-a136-0c891b94a7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e6906a127444b369ea10b45b7d238db)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:24.551418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88393948-637f-47ce-a136-0c891b94a7c6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:24.702132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-88393948-637f-47ce-a136-0c891b94a7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e6906a127444b369ea10b45b7d238db', 'request_id': 'req-88393948-637f-47ce-a136-0c891b94a7c6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.710561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-88393948-637f-47ce-a136-0c891b94a7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e6906a127444b369ea10b45b7d238db', 'request_id': 'req-88393948-637f-47ce-a136-0c891b94a7c6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.717983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-88393948-637f-47ce-a136-0c891b94a7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e6906a127444b369ea10b45b7d238db', 'request_id': 'req-88393948-637f-47ce-a136-0c891b94a7c6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.742360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-88393948-637f-47ce-a136-0c891b94a7c6 admin admin] The token cache is being invalidate because project 2e6906a127444b369ea10b45b7d238db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:14:24.743448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-88393948-637f-47ce-a136-0c891b94a7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.744389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-88393948-637f-47ce-a136-0c891b94a7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:24.752950 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2684/5359] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:14:24 2022] DELETE /identity/v3/projects/2e6906a127444b369ea10b45b7d238db => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:24.757556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29fa6-ff12-4ecc-b59d-9b7988f2c696 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:24.758092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29fa6-ff12-4ecc-b59d-9b7988f2c696 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:24.758092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29fa6-ff12-4ecc-b59d-9b7988f2c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:24.811996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2cf29fa6-ff12-4ecc-b59d-9b7988f2c696 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:24.813851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2cf29fa6-ff12-4ecc-b59d-9b7988f2c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:24.902282 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2676/5360] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:24.904191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5cb7a-1a50-4999-84b1-2281ac887455 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:24.904799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5cb7a-1a50-4999-84b1-2281ac887455 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:24.905289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5cb7a-1a50-4999-84b1-2281ac887455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:24.934440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-aea5cb7a-1a50-4999-84b1-2281ac887455 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:24.936253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aea5cb7a-1a50-4999-84b1-2281ac887455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:24.945524 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2685/5361] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:24.952345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf29fa6-ff12-4ecc-b59d-9b7988f2c696 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:24.983719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf29fa6-ff12-4ecc-b59d-9b7988f2c696 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:24.992166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2c1ec-af8f-48e5-a2b7-52728fbcd905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:24.993274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2c1ec-af8f-48e5-a2b7-52728fbcd905 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:24.994003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2c1ec-af8f-48e5-a2b7-52728fbcd905 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:24.994711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2c1ec-af8f-48e5-a2b7-52728fbcd905 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:24.995640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2c1ec-af8f-48e5-a2b7-52728fbcd905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:14:24.996187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2c1ec-af8f-48e5-a2b7-52728fbcd905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:24.998863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2c1ec-af8f-48e5-a2b7-52728fbcd905 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:25.041772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5cb7a-1a50-4999-84b1-2281ac887455 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:25.052298 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2677/5362] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:14:25.057321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5cb7a-1a50-4999-84b1-2281ac887455 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:25.069061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfde69e-c1d8-42db-bc11-50fd850a70ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:25.069733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfde69e-c1d8-42db-bc11-50fd850a70ac admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:25.074285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfde69e-c1d8-42db-bc11-50fd850a70ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:25.074724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfde69e-c1d8-42db-bc11-50fd850a70ac admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:25.079380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfde69e-c1d8-42db-bc11-50fd850a70ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:25.081970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfde69e-c1d8-42db-bc11-50fd850a70ac admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:25.158966 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2686/5363] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:14:25 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:14:25.166583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2c1ec-af8f-48e5-a2b7-52728fbcd905 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:25.179214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:25.189275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2c1ec-af8f-48e5-a2b7-52728fbcd905 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:25.313323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444ff5-e8f4-497c-add9-626887c37589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:25.315368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444ff5-e8f4-497c-add9-626887c37589 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:25.316178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444ff5-e8f4-497c-add9-626887c37589 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:25.316763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444ff5-e8f4-497c-add9-626887c37589 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:25.319353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f444ff5-e8f4-497c-add9-626887c37589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:25.325032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f444ff5-e8f4-497c-add9-626887c37589 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:25.384352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfde69e-c1d8-42db-bc11-50fd850a70ac admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:25.391335 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2678/5364] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:14:25 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:14:25.404660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfde69e-c1d8-42db-bc11-50fd850a70ac admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:25.412167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6c5eb-7ba1-4eb4-bc6d-c345bc9003cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:25.413543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6c5eb-7ba1-4eb4-bc6d-c345bc9003cb admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:25.413543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6c5eb-7ba1-4eb4-bc6d-c345bc9003cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:25.413992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6c5eb-7ba1-4eb4-bc6d-c345bc9003cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:25.415735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6c5eb-7ba1-4eb4-bc6d-c345bc9003cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:25.418879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6c5eb-7ba1-4eb4-bc6d-c345bc9003cb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:25.444538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444ff5-e8f4-497c-add9-626887c37589 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:25.453061 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2687/5365] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:14:25.463354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444ff5-e8f4-497c-add9-626887c37589 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:25.490492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23ab5b-1c7d-4e9a-888c-a64045f9db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:25.491366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23ab5b-1c7d-4e9a-888c-a64045f9db15 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:25.491871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23ab5b-1c7d-4e9a-888c-a64045f9db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:25.492075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23ab5b-1c7d-4e9a-888c-a64045f9db15 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:25.493449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23ab5b-1c7d-4e9a-888c-a64045f9db15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:25.495540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23ab5b-1c7d-4e9a-888c-a64045f9db15 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:25.511111 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2679/5366] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:14:25.515857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6c5eb-7ba1-4eb4-bc6d-c345bc9003cb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:25.527986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6c5eb-7ba1-4eb4-bc6d-c345bc9003cb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:25.533838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48723ebe-8b27-43b1-a741-e63096f02613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:25.534415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723ebe-8b27-43b1-a741-e63096f02613 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:25.534837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723ebe-8b27-43b1-a741-e63096f02613 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:25.535243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723ebe-8b27-43b1-a741-e63096f02613 admin admin] PATH_INFO: `/v3/projects/c299d8a39a204ad48230af1691ace045/users/b08da48a72304f2697c058aa7a74ea66/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:25.559310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48723ebe-8b27-43b1-a741-e63096f02613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c299d8a39a204ad48230af1691ace045, user_id=b08da48a72304f2697c058aa7a74ea66, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:25.574030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48723ebe-8b27-43b1-a741-e63096f02613 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:25.631492 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2688/5367] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:14:25 2022] PUT /identity/v3/projects/c299d8a39a204ad48230af1691ace045/users/b08da48a72304f2697c058aa7a74ea66/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:25.646406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af9a60-f75b-48cc-9154-a919d244ff30 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:25.646982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af9a60-f75b-48cc-9154-a919d244ff30 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:25.646982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af9a60-f75b-48cc-9154-a919d244ff30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:25.743145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e8af9a60-f75b-48cc-9154-a919d244ff30 None None] MFA Rules not processed for user `b08da48a72304f2697c058aa7a74ea66`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:25.751208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e8af9a60-f75b-48cc-9154-a919d244ff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:26.038963 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2680/5368] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:26.054235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48723ebe-8b27-43b1-a741-e63096f02613 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:26.056377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-48723ebe-8b27-43b1-a741-e63096f02613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:26.091261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:26.197820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48723ebe-8b27-43b1-a741-e63096f02613 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:26.208063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751fcda-c21b-43a5-9782-df95853b7170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:26.209120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751fcda-c21b-43a5-9782-df95853b7170 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:26.209483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751fcda-c21b-43a5-9782-df95853b7170 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:26.209943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751fcda-c21b-43a5-9782-df95853b7170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:26.228776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751fcda-c21b-43a5-9782-df95853b7170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:26.232306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751fcda-c21b-43a5-9782-df95853b7170 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:26.254934 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2689/5369] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:29.994982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab595d-0903-4190-a503-a72cefa41ac8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:29.995518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab595d-0903-4190-a503-a72cefa41ac8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:29.995618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab595d-0903-4190-a503-a72cefa41ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:30.025622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b5ab595d-0903-4190-a503-a72cefa41ac8 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:30.027018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b5ab595d-0903-4190-a503-a72cefa41ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:30.169076 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2681/5370] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:14:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:30.201321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751fcda-c21b-43a5-9782-df95853b7170 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:30.203216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9751fcda-c21b-43a5-9782-df95853b7170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:30.261171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab595d-0903-4190-a503-a72cefa41ac8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:30.262700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b5ab595d-0903-4190-a503-a72cefa41ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:30.314616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:30.416962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751fcda-c21b-43a5-9782-df95853b7170 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:30.431304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4b3e3-60ab-4d6f-87ed-d5835b7dbaf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:30.432176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4b3e3-60ab-4d6f-87ed-d5835b7dbaf2 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:30.433812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4b3e3-60ab-4d6f-87ed-d5835b7dbaf2 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:30.434247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4b3e3-60ab-4d6f-87ed-d5835b7dbaf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:30.449566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab595d-0903-4190-a503-a72cefa41ac8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:30.452806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4b3e3-60ab-4d6f-87ed-d5835b7dbaf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:30.456117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4b3e3-60ab-4d6f-87ed-d5835b7dbaf2 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:30.463433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:30.464439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:30.464920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:30.465447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] PATH_INFO: `/v3/users/fc65964655dc4cae88e37535a8ca3359` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:30.467867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc65964655dc4cae88e37535a8ca3359)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:30.470008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:30.476721 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2690/5371] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:14:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:14:30.581134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc65964655dc4cae88e37535a8ca3359'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:30.592877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc65964655dc4cae88e37535a8ca3359'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:30.593814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc65964655dc4cae88e37535a8ca3359'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:30.609517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc65964655dc4cae88e37535a8ca3359'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:30.610263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc65964655dc4cae88e37535a8ca3359'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:30.628464 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2682/5372] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:14:30 2022] DELETE /identity/v3/users/fc65964655dc4cae88e37535a8ca3359 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:14:30.633997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146343a7-61cd-43ed-a947-c86e2878501a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:30.634562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146343a7-61cd-43ed-a947-c86e2878501a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:30.635260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146343a7-61cd-43ed-a947-c86e2878501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:30.691129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-146343a7-61cd-43ed-a947-c86e2878501a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:30.692648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-146343a7-61cd-43ed-a947-c86e2878501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:30.929647 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2691/5373] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:30.952055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:30.954035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:31.089156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6dadd-5a02-44af-8c8f-546b44aea6c9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:31.100614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f80680-d7a1-4f05-803f-3a93d6ea450f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:31.101418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f80680-d7a1-4f05-803f-3a93d6ea450f service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:31.102431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f80680-d7a1-4f05-803f-3a93d6ea450f service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:31.102844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f80680-d7a1-4f05-803f-3a93d6ea450f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:31.126732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f80680-d7a1-4f05-803f-3a93d6ea450f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:31.128483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f80680-d7a1-4f05-803f-3a93d6ea450f service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:31.155547 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2683/5374] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:31.763208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146343a7-61cd-43ed-a947-c86e2878501a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:31.765178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-146343a7-61cd-43ed-a947-c86e2878501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:31.800192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146343a7-61cd-43ed-a947-c86e2878501a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:31.809487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13fe27-5979-4b43-a6c4-b2be910613ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:31.811876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13fe27-5979-4b43-a6c4-b2be910613ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:31.812373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13fe27-5979-4b43-a6c4-b2be910613ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:31.812937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13fe27-5979-4b43-a6c4-b2be910613ae admin admin] PATH_INFO: `/v3/projects/d25b654916f94ca6826ab050ac2cba70` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:31.814899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13fe27-5979-4b43-a6c4-b2be910613ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25b654916f94ca6826ab050ac2cba70)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:31.817616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13fe27-5979-4b43-a6c4-b2be910613ae admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:31.929365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:31.934728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f13fe27-5979-4b43-a6c4-b2be910613ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25b654916f94ca6826ab050ac2cba70', 'request_id': 'req-2f13fe27-5979-4b43-a6c4-b2be910613ae'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:31.954410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f13fe27-5979-4b43-a6c4-b2be910613ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25b654916f94ca6826ab050ac2cba70', 'request_id': 'req-2f13fe27-5979-4b43-a6c4-b2be910613ae'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:31.981415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f13fe27-5979-4b43-a6c4-b2be910613ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25b654916f94ca6826ab050ac2cba70', 'request_id': 'req-2f13fe27-5979-4b43-a6c4-b2be910613ae'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:32.014396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f13fe27-5979-4b43-a6c4-b2be910613ae admin admin] The token cache is being invalidate because project d25b654916f94ca6826ab050ac2cba70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:14:32.014691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f13fe27-5979-4b43-a6c4-b2be910613ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:32.016438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f13fe27-5979-4b43-a6c4-b2be910613ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:32.031776 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2692/5375] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:14:31 2022] DELETE /identity/v3/projects/d25b654916f94ca6826ab050ac2cba70 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:32.033120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b604b-a57b-4a87-95e0-ba71f1c56bcc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:32.033474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b604b-a57b-4a87-95e0-ba71f1c56bcc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:32.033752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b604b-a57b-4a87-95e0-ba71f1c56bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:32.091188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-302b604b-a57b-4a87-95e0-ba71f1c56bcc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:32.093288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-302b604b-a57b-4a87-95e0-ba71f1c56bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:32.228031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:32.286534 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2684/5376] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:14:32.302844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c302c0-316f-4ccf-855f-669ed5764911 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:32.303267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c302c0-316f-4ccf-855f-669ed5764911 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:32.303689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c302c0-316f-4ccf-855f-669ed5764911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:32.387274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-14c302c0-316f-4ccf-855f-669ed5764911 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:32.388491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-14c302c0-316f-4ccf-855f-669ed5764911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:32.429096 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2693/5377] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:32.430638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b604b-a57b-4a87-95e0-ba71f1c56bcc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:32.449404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b604b-a57b-4a87-95e0-ba71f1c56bcc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:32.469705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647def9b-acb4-45ba-a2da-798f81de664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:32.470387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647def9b-acb4-45ba-a2da-798f81de664a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:32.470676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647def9b-acb4-45ba-a2da-798f81de664a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:32.470974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647def9b-acb4-45ba-a2da-798f81de664a admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:32.471663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647def9b-acb4-45ba-a2da-798f81de664a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:14:32.471973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647def9b-acb4-45ba-a2da-798f81de664a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:32.482370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647def9b-acb4-45ba-a2da-798f81de664a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:32.534385 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2685/5378] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:14:32.534594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c302c0-316f-4ccf-855f-669ed5764911 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:32.550159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c302c0-316f-4ccf-855f-669ed5764911 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:32.576714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a10199-ccff-4a64-b8aa-a121699a0147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:32.578598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a10199-ccff-4a64-b8aa-a121699a0147 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:32.581665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a10199-ccff-4a64-b8aa-a121699a0147 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:32.582128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a10199-ccff-4a64-b8aa-a121699a0147 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:32.588417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a10199-ccff-4a64-b8aa-a121699a0147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:32.595905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a10199-ccff-4a64-b8aa-a121699a0147 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:32.690527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647def9b-acb4-45ba-a2da-798f81de664a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:32.723312 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2694/5379] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:14:32 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:14:32.735971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647def9b-acb4-45ba-a2da-798f81de664a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:32.933657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb428c-1ce1-4b8c-bae5-97d8eacc88f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:32.935914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb428c-1ce1-4b8c-bae5-97d8eacc88f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:32.935914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb428c-1ce1-4b8c-bae5-97d8eacc88f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:32.935914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb428c-1ce1-4b8c-bae5-97d8eacc88f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:32.936576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb428c-1ce1-4b8c-bae5-97d8eacc88f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:32.940404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb428c-1ce1-4b8c-bae5-97d8eacc88f5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:33.004138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a10199-ccff-4a64-b8aa-a121699a0147 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:33.016654 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2686/5380] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:14:32 2022] POST /identity/v3/users => generated 294 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:14:33.046367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a10199-ccff-4a64-b8aa-a121699a0147 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:33.062592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3656a-2653-4d79-af74-3dd772554a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:33.063882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3656a-2653-4d79-af74-3dd772554a7b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:33.064449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3656a-2653-4d79-af74-3dd772554a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:33.064875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3656a-2653-4d79-af74-3dd772554a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:33.065732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3656a-2653-4d79-af74-3dd772554a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:33.067713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3656a-2653-4d79-af74-3dd772554a7b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:33.217467 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2695/5381] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:14:33.222006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb428c-1ce1-4b8c-bae5-97d8eacc88f5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:33.245288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb428c-1ce1-4b8c-bae5-97d8eacc88f5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:33.280595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefcfe6-afff-490f-8aaf-0a51c0940c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:33.282808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefcfe6-afff-490f-8aaf-0a51c0940c7f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:33.288652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefcfe6-afff-490f-8aaf-0a51c0940c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:33.289811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefcfe6-afff-490f-8aaf-0a51c0940c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:33.291666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefcfe6-afff-490f-8aaf-0a51c0940c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:33.295804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefcfe6-afff-490f-8aaf-0a51c0940c7f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:33.358033 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2687/5382] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:14:33.363396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3656a-2653-4d79-af74-3dd772554a7b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:33.386363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3656a-2653-4d79-af74-3dd772554a7b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:33.425362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62754f-76fb-47c7-897b-ea80621bb24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:33.433263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62754f-76fb-47c7-897b-ea80621bb24b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:33.433865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62754f-76fb-47c7-897b-ea80621bb24b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:33.435520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62754f-76fb-47c7-897b-ea80621bb24b admin admin] PATH_INFO: `/v3/projects/f1e0cc3e726141c7ac10fb9abc6fc5b8/users/f624101c5e534b91901a2855863af0db/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:33.523778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62754f-76fb-47c7-897b-ea80621bb24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e0cc3e726141c7ac10fb9abc6fc5b8, user_id=f624101c5e534b91901a2855863af0db, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:33.553045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62754f-76fb-47c7-897b-ea80621bb24b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:33.600264 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2696/5383] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:14:33 2022] PUT /identity/v3/projects/f1e0cc3e726141c7ac10fb9abc6fc5b8/users/f624101c5e534b91901a2855863af0db/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:33.606485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3c515-625e-47a5-9f71-275df49b00ac None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:33.607231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3c515-625e-47a5-9f71-275df49b00ac None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:33.607743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3c515-625e-47a5-9f71-275df49b00ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:33.656570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-66f3c515-625e-47a5-9f71-275df49b00ac None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:33.657958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-66f3c515-625e-47a5-9f71-275df49b00ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:33.796000 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2688/5384] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:33.806293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62754f-76fb-47c7-897b-ea80621bb24b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:33.808347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cc62754f-76fb-47c7-897b-ea80621bb24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:33.882518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62754f-76fb-47c7-897b-ea80621bb24b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:33.888955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b50aa-0fc0-4a03-b1e5-9bbbebc57c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:33.888955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b50aa-0fc0-4a03-b1e5-9bbbebc57c31 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:33.889295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b50aa-0fc0-4a03-b1e5-9bbbebc57c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:33.889827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b50aa-0fc0-4a03-b1e5-9bbbebc57c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:33.906815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b50aa-0fc0-4a03-b1e5-9bbbebc57c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:33.908553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b50aa-0fc0-4a03-b1e5-9bbbebc57c31 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:33.927244 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2697/5385] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:35.993639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6663-5bb0-4472-845f-93413be6503e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:35.994671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6663-5bb0-4472-845f-93413be6503e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:35.995254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6663-5bb0-4472-845f-93413be6503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:36.038546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cb7c6663-5bb0-4472-845f-93413be6503e None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:36.044381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cb7c6663-5bb0-4472-845f-93413be6503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:36.173163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:36.222204 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2689/5386] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:14:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:14:36.237781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b50aa-0fc0-4a03-b1e5-9bbbebc57c31 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:36.239465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-778b50aa-0fc0-4a03-b1e5-9bbbebc57c31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:36.526441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b50aa-0fc0-4a03-b1e5-9bbbebc57c31 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:36.545535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc436c2-51ee-4bd0-850a-1d4b81a3d93a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:36.549427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc436c2-51ee-4bd0-850a-1d4b81a3d93a service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:36.549712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc436c2-51ee-4bd0-850a-1d4b81a3d93a service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:36.549984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc436c2-51ee-4bd0-850a-1d4b81a3d93a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:36.588250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc436c2-51ee-4bd0-850a-1d4b81a3d93a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:36.590038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc436c2-51ee-4bd0-850a-1d4b81a3d93a service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:36.626574 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2698/5387] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:14:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:14:38.557054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6663-5bb0-4472-845f-93413be6503e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:38.565950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cb7c6663-5bb0-4472-845f-93413be6503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:38.844244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6663-5bb0-4472-845f-93413be6503e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:38.856312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567e5b5-e6f3-4982-8dc9-8b957055fe64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:38.856966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567e5b5-e6f3-4982-8dc9-8b957055fe64 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:38.857254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567e5b5-e6f3-4982-8dc9-8b957055fe64 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:38.857533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567e5b5-e6f3-4982-8dc9-8b957055fe64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:38.862900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0567e5b5-e6f3-4982-8dc9-8b957055fe64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:38.903633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567e5b5-e6f3-4982-8dc9-8b957055fe64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:38.905529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567e5b5-e6f3-4982-8dc9-8b957055fe64 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:38.956171 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2690/5388] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:39.552069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc436c2-51ee-4bd0-850a-1d4b81a3d93a service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:39.565793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4bc436c2-51ee-4bd0-850a-1d4b81a3d93a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:39.631785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:39.668028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc436c2-51ee-4bd0-850a-1d4b81a3d93a service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:39.684931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b89bf-fc42-4c30-91e5-e19c452d89fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:39.686003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b89bf-fc42-4c30-91e5-e19c452d89fd service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:39.689526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b89bf-fc42-4c30-91e5-e19c452d89fd service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:39.690155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b89bf-fc42-4c30-91e5-e19c452d89fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:39.697966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-182b89bf-fc42-4c30-91e5-e19c452d89fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:39.715757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b89bf-fc42-4c30-91e5-e19c452d89fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:39.717957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b89bf-fc42-4c30-91e5-e19c452d89fd service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:39.760294 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2699/5389] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:46.360256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567e5b5-e6f3-4982-8dc9-8b957055fe64 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:46.404554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567e5b5-e6f3-4982-8dc9-8b957055fe64 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:46.432661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc388d19-c8be-4be5-bfd4-abba92dc24f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:46.439197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc388d19-c8be-4be5-bfd4-abba92dc24f6 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:46.441028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc388d19-c8be-4be5-bfd4-abba92dc24f6 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:46.448175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc388d19-c8be-4be5-bfd4-abba92dc24f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:46.459981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bc388d19-c8be-4be5-bfd4-abba92dc24f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:46.858875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc388d19-c8be-4be5-bfd4-abba92dc24f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:46.862418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc388d19-c8be-4be5-bfd4-abba92dc24f6 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:46.940780 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2691/5390] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:14:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:14:49.741982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:50.686841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b89bf-fc42-4c30-91e5-e19c452d89fd service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:50.688600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-182b89bf-fc42-4c30-91e5-e19c452d89fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:51.114096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b89bf-fc42-4c30-91e5-e19c452d89fd service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:51.131742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8257f-c995-4268-ae06-8f0e1f9d4247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:51.133726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8257f-c995-4268-ae06-8f0e1f9d4247 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:51.134021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8257f-c995-4268-ae06-8f0e1f9d4247 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:51.134286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8257f-c995-4268-ae06-8f0e1f9d4247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:51.140247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-29c8257f-c995-4268-ae06-8f0e1f9d4247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:51.357808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8257f-c995-4268-ae06-8f0e1f9d4247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:51.359830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8257f-c995-4268-ae06-8f0e1f9d4247 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:51.399698 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2700/5391] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:14:52.252506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc388d19-c8be-4be5-bfd4-abba92dc24f6 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:52.254786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bc388d19-c8be-4be5-bfd4-abba92dc24f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:52.278484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc388d19-c8be-4be5-bfd4-abba92dc24f6 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:52.289799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:52.294685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:52.295367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:52.295875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] PATH_INFO: `/v3/users/5ad542867a374435b650914465bffc91` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:52.298117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad542867a374435b650914465bffc91)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:52.302971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:52.427570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad542867a374435b650914465bffc91'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:52.450367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad542867a374435b650914465bffc91'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:52.451269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad542867a374435b650914465bffc91'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:52.487580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:52.488780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad542867a374435b650914465bffc91'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:52.489602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad542867a374435b650914465bffc91'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:52.526604 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2692/5392] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:14:52 2022] DELETE /identity/v3/users/5ad542867a374435b650914465bffc91 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:53.149736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90464a14-42e0-45dc-881d-b14efd4e66aa None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:53.150452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90464a14-42e0-45dc-881d-b14efd4e66aa None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:53.150452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90464a14-42e0-45dc-881d-b14efd4e66aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:53.239929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-90464a14-42e0-45dc-881d-b14efd4e66aa None None] MFA Rules not processed for user `f624101c5e534b91901a2855863af0db`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:53.241552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-90464a14-42e0-45dc-881d-b14efd4e66aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:53.344885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:53.357107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:53.366210 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2701/5393] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:53.533639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746f951-5fc6-4bb8-afdd-d7664fba4c09 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:53.549550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87770a1f-5074-459f-a0f8-d1f08777274b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:53.549839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770a1f-5074-459f-a0f8-d1f08777274b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:53.549942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770a1f-5074-459f-a0f8-d1f08777274b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:53.552146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770a1f-5074-459f-a0f8-d1f08777274b admin admin] PATH_INFO: `/v3/projects/3a00dc9c23eb434886ec9239ccea90a8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:53.555578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87770a1f-5074-459f-a0f8-d1f08777274b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a00dc9c23eb434886ec9239ccea90a8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:53.560207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87770a1f-5074-459f-a0f8-d1f08777274b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:53.716333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-87770a1f-5074-459f-a0f8-d1f08777274b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a00dc9c23eb434886ec9239ccea90a8', 'request_id': 'req-87770a1f-5074-459f-a0f8-d1f08777274b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:53.731079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-87770a1f-5074-459f-a0f8-d1f08777274b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a00dc9c23eb434886ec9239ccea90a8', 'request_id': 'req-87770a1f-5074-459f-a0f8-d1f08777274b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:53.748271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-87770a1f-5074-459f-a0f8-d1f08777274b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a00dc9c23eb434886ec9239ccea90a8', 'request_id': 'req-87770a1f-5074-459f-a0f8-d1f08777274b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:53.776105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-87770a1f-5074-459f-a0f8-d1f08777274b admin admin] The token cache is being invalidate because project 3a00dc9c23eb434886ec9239ccea90a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:14:53.776378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-87770a1f-5074-459f-a0f8-d1f08777274b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:53.779255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-87770a1f-5074-459f-a0f8-d1f08777274b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:14:53.785292 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2693/5394] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:14:53 2022] DELETE /identity/v3/projects/3a00dc9c23eb434886ec9239ccea90a8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:53.791408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b06c12-5fde-41b4-bba9-590583799c10 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:53.791727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b06c12-5fde-41b4-bba9-590583799c10 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:53.792050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b06c12-5fde-41b4-bba9-590583799c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:53.846978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-54b06c12-5fde-41b4-bba9-590583799c10 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:53.848223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-54b06c12-5fde-41b4-bba9-590583799c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:53.908127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:54.084033 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2702/5395] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:54.090849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4d80b-4ffa-45c1-92a5-3866010883d7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:54.091367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4d80b-4ffa-45c1-92a5-3866010883d7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:54.091753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4d80b-4ffa-45c1-92a5-3866010883d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:54.144532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8be4d80b-4ffa-45c1-92a5-3866010883d7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:54.149301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8be4d80b-4ffa-45c1-92a5-3866010883d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:54.185252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b06c12-5fde-41b4-bba9-590583799c10 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:54.196606 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2694/5396] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:54.198767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b06c12-5fde-41b4-bba9-590583799c10 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:54.204417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03371c-5d1d-4fde-b382-123ab55b045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:54.205300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03371c-5d1d-4fde-b382-123ab55b045f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:54.205690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03371c-5d1d-4fde-b382-123ab55b045f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:54.206074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03371c-5d1d-4fde-b382-123ab55b045f admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:54.207484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03371c-5d1d-4fde-b382-123ab55b045f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:14:54.207484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03371c-5d1d-4fde-b382-123ab55b045f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:54.210087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03371c-5d1d-4fde-b382-123ab55b045f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:54.250902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4d80b-4ffa-45c1-92a5-3866010883d7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:54.263974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4d80b-4ffa-45c1-92a5-3866010883d7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:54.264350 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2703/5397] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:14:54.285994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d0242-8cf2-4d0c-a778-4c71017710be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:54.287320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d0242-8cf2-4d0c-a778-4c71017710be admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:54.288676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d0242-8cf2-4d0c-a778-4c71017710be admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:54.292023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d0242-8cf2-4d0c-a778-4c71017710be admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:54.298340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d0242-8cf2-4d0c-a778-4c71017710be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:54.303570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d0242-8cf2-4d0c-a778-4c71017710be admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:54.410626 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2695/5398] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:14:54 2022] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:14:54.413773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03371c-5d1d-4fde-b382-123ab55b045f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:54.434323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03371c-5d1d-4fde-b382-123ab55b045f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:54.571106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a89199-47d9-41c8-af29-794578d13e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:54.575025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a89199-47d9-41c8-af29-794578d13e40 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:54.575992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a89199-47d9-41c8-af29-794578d13e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:54.576621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a89199-47d9-41c8-af29-794578d13e40 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:54.579469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a89199-47d9-41c8-af29-794578d13e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:54.586910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a89199-47d9-41c8-af29-794578d13e40 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:54.659089 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2704/5399] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:14:54 2022] POST /identity/v3/users => generated 296 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:14:54.663334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d0242-8cf2-4d0c-a778-4c71017710be admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:54.685748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d0242-8cf2-4d0c-a778-4c71017710be admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:54.707804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0c31c-a0c8-4a13-ad63-3331c2dabdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:54.708568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0c31c-a0c8-4a13-ad63-3331c2dabdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:54.710302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0c31c-a0c8-4a13-ad63-3331c2dabdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:54.710814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0c31c-a0c8-4a13-ad63-3331c2dabdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:54.712149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0c31c-a0c8-4a13-ad63-3331c2dabdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:54.716855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0c31c-a0c8-4a13-ad63-3331c2dabdb8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:54.756857 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2696/5400] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:14:54.761589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a89199-47d9-41c8-af29-794578d13e40 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:54.781821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a89199-47d9-41c8-af29-794578d13e40 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:54.797277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f905f8c-3df3-400d-b015-fd48601afca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:54.798291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f905f8c-3df3-400d-b015-fd48601afca1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:54.799952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f905f8c-3df3-400d-b015-fd48601afca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:54.800334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f905f8c-3df3-400d-b015-fd48601afca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:54.801125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f905f8c-3df3-400d-b015-fd48601afca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:54.808565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f905f8c-3df3-400d-b015-fd48601afca1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:54.835143 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2705/5401] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:14:54.839947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0c31c-a0c8-4a13-ad63-3331c2dabdb8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:54.861285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0c31c-a0c8-4a13-ad63-3331c2dabdb8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:54.873597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138ec6b-ec8b-4c03-a680-ae2772fc8e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:54.876546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ec6b-ec8b-4c03-a680-ae2772fc8e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:54.877926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ec6b-ec8b-4c03-a680-ae2772fc8e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:54.878287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138ec6b-ec8b-4c03-a680-ae2772fc8e4f admin admin] PATH_INFO: `/v3/projects/63a3d460cbfa44b384fe763575142602/users/ee83dfdb456f4acc9fa1c5e7c8ef00ff/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:54.928426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138ec6b-ec8b-4c03-a680-ae2772fc8e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a3d460cbfa44b384fe763575142602, user_id=ee83dfdb456f4acc9fa1c5e7c8ef00ff, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:54.938900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138ec6b-ec8b-4c03-a680-ae2772fc8e4f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:54.967461 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2697/5402] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:14:54 2022] PUT /identity/v3/projects/63a3d460cbfa44b384fe763575142602/users/ee83dfdb456f4acc9fa1c5e7c8ef00ff/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:14:54.972391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47544e3a-1972-4bfb-b38b-c284812008f4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:54.972733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47544e3a-1972-4bfb-b38b-c284812008f4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:54.972960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47544e3a-1972-4bfb-b38b-c284812008f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:55.016502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-47544e3a-1972-4bfb-b38b-c284812008f4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:14:55.020744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-47544e3a-1972-4bfb-b38b-c284812008f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:55.219422 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2706/5403] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:14:55.263189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138ec6b-ec8b-4c03-a680-ae2772fc8e4f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:14:55.265192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9138ec6b-ec8b-4c03-a680-ae2772fc8e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:14:55.302479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:14:55.430599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138ec6b-ec8b-4c03-a680-ae2772fc8e4f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:14:55.439493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210543c9-e03c-4471-b2ad-fa059ba05eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:14:55.443178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210543c9-e03c-4471-b2ad-fa059ba05eeb service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:14:55.443178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210543c9-e03c-4471-b2ad-fa059ba05eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:14:55.443178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210543c9-e03c-4471-b2ad-fa059ba05eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:14:55.466153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210543c9-e03c-4471-b2ad-fa059ba05eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:14:55.467693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210543c9-e03c-4471-b2ad-fa059ba05eeb service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:14:55.495043 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2698/5404] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:05.188632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:05.480081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=19 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:06.525293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47544e3a-1972-4bfb-b38b-c284812008f4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:06.528734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-47544e3a-1972-4bfb-b38b-c284812008f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:06.552852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47544e3a-1972-4bfb-b38b-c284812008f4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:06.587140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63ba3a-bebf-40f1-ac41-2785023b4892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:06.590455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63ba3a-bebf-40f1-ac41-2785023b4892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:06.590455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63ba3a-bebf-40f1-ac41-2785023b4892 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:06.590803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63ba3a-bebf-40f1-ac41-2785023b4892 admin admin] PATH_INFO: `/v3/users/f624101c5e534b91901a2855863af0db` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:06.592924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63ba3a-bebf-40f1-ac41-2785023b4892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f624101c5e534b91901a2855863af0db)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:06.594932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63ba3a-bebf-40f1-ac41-2785023b4892 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:06.753799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2b63ba3a-bebf-40f1-ac41-2785023b4892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f624101c5e534b91901a2855863af0db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:06.773137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2b63ba3a-bebf-40f1-ac41-2785023b4892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f624101c5e534b91901a2855863af0db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:06.775484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2b63ba3a-bebf-40f1-ac41-2785023b4892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f624101c5e534b91901a2855863af0db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:06.797954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2b63ba3a-bebf-40f1-ac41-2785023b4892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f624101c5e534b91901a2855863af0db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:06.803363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2b63ba3a-bebf-40f1-ac41-2785023b4892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f624101c5e534b91901a2855863af0db'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:06.942631 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2707/5405] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:15:06 2022] DELETE /identity/v3/users/f624101c5e534b91901a2855863af0db => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:07.471067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210543c9-e03c-4471-b2ad-fa059ba05eeb service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:07.485883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210543c9-e03c-4471-b2ad-fa059ba05eeb service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:07.672751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb961c-d01f-433a-850b-5fc10ee8a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:07.675063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb961c-d01f-433a-850b-5fc10ee8a986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:07.675516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb961c-d01f-433a-850b-5fc10ee8a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:07.676063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb961c-d01f-433a-850b-5fc10ee8a986 admin admin] PATH_INFO: `/v3/projects/f1e0cc3e726141c7ac10fb9abc6fc5b8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:07.677269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb961c-d01f-433a-850b-5fc10ee8a986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e0cc3e726141c7ac10fb9abc6fc5b8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:07.680044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb961c-d01f-433a-850b-5fc10ee8a986 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:07.809938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0bb961c-d01f-433a-850b-5fc10ee8a986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e0cc3e726141c7ac10fb9abc6fc5b8', 'request_id': 'req-f0bb961c-d01f-433a-850b-5fc10ee8a986'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:07.827811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0bb961c-d01f-433a-850b-5fc10ee8a986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e0cc3e726141c7ac10fb9abc6fc5b8', 'request_id': 'req-f0bb961c-d01f-433a-850b-5fc10ee8a986'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:07.853544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0bb961c-d01f-433a-850b-5fc10ee8a986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e0cc3e726141c7ac10fb9abc6fc5b8', 'request_id': 'req-f0bb961c-d01f-433a-850b-5fc10ee8a986'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:07.881954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0bb961c-d01f-433a-850b-5fc10ee8a986 admin admin] The token cache is being invalidate because project f1e0cc3e726141c7ac10fb9abc6fc5b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:15:07.882622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0bb961c-d01f-433a-850b-5fc10ee8a986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:07.886856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0bb961c-d01f-433a-850b-5fc10ee8a986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:07.896315 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2699/5406] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:15:07 2022] DELETE /identity/v3/projects/f1e0cc3e726141c7ac10fb9abc6fc5b8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:07.898898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d480be-8e72-405b-bf7a-a85e9a3d5014 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:07.899509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d480be-8e72-405b-bf7a-a85e9a3d5014 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:07.899719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d480be-8e72-405b-bf7a-a85e9a3d5014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:07.949130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-46d480be-8e72-405b-bf7a-a85e9a3d5014 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:07.951129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-46d480be-8e72-405b-bf7a-a85e9a3d5014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:08.188435 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2708/5407] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:08.198998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61730136-4f9d-44a2-a78d-07704bb1d9d5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:08.201266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61730136-4f9d-44a2-a78d-07704bb1d9d5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:08.201950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61730136-4f9d-44a2-a78d-07704bb1d9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:08.322706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-61730136-4f9d-44a2-a78d-07704bb1d9d5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:08.328527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-61730136-4f9d-44a2-a78d-07704bb1d9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:08.343790 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2700/5408] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:08.345382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d480be-8e72-405b-bf7a-a85e9a3d5014 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:08.357916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d480be-8e72-405b-bf7a-a85e9a3d5014 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:08.363342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8fa5a-bffc-4d86-86ec-c22c8c465f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:08.364252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8fa5a-bffc-4d86-86ec-c22c8c465f7c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:08.364690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8fa5a-bffc-4d86-86ec-c22c8c465f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:08.365120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8fa5a-bffc-4d86-86ec-c22c8c465f7c admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:08.365945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8fa5a-bffc-4d86-86ec-c22c8c465f7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:15:08.367005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8fa5a-bffc-4d86-86ec-c22c8c465f7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:08.369097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8fa5a-bffc-4d86-86ec-c22c8c465f7c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:08.389445 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2709/5409] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:15:08.390003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61730136-4f9d-44a2-a78d-07704bb1d9d5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:08.420368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61730136-4f9d-44a2-a78d-07704bb1d9d5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:08.437837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd9f5c-d6c8-4e78-9c8d-7df42190de47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:08.443220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd9f5c-d6c8-4e78-9c8d-7df42190de47 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:08.443938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd9f5c-d6c8-4e78-9c8d-7df42190de47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:08.444778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd9f5c-d6c8-4e78-9c8d-7df42190de47 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:08.446122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd9f5c-d6c8-4e78-9c8d-7df42190de47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:08.450410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd9f5c-d6c8-4e78-9c8d-7df42190de47 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:08.633398 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2701/5410] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:15:08 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:15:08.639022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8fa5a-bffc-4d86-86ec-c22c8c465f7c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:08.656633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8fa5a-bffc-4d86-86ec-c22c8c465f7c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:08.893402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccee8e6-d77a-4476-9c65-5eea8d6e23c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:08.894040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccee8e6-d77a-4476-9c65-5eea8d6e23c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:08.894323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccee8e6-d77a-4476-9c65-5eea8d6e23c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:08.894603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccee8e6-d77a-4476-9c65-5eea8d6e23c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:08.895287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccee8e6-d77a-4476-9c65-5eea8d6e23c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:08.897502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccee8e6-d77a-4476-9c65-5eea8d6e23c2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:08.950596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:09.026263 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2710/5411] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:15:08 2022] POST /identity/v3/users => generated 292 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:09.026876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd9f5c-d6c8-4e78-9c8d-7df42190de47 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:09.038043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd9f5c-d6c8-4e78-9c8d-7df42190de47 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:09.073822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befd94c-7e64-487f-8921-bc7944ddc515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:09.074736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befd94c-7e64-487f-8921-bc7944ddc515 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:09.075305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befd94c-7e64-487f-8921-bc7944ddc515 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:09.075787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befd94c-7e64-487f-8921-bc7944ddc515 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:09.076786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befd94c-7e64-487f-8921-bc7944ddc515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:09.078518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befd94c-7e64-487f-8921-bc7944ddc515 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:09.094565 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2702/5412] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:15:09.096318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccee8e6-d77a-4476-9c65-5eea8d6e23c2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:09.123961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccee8e6-d77a-4476-9c65-5eea8d6e23c2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:09.143925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf48ab-a221-4429-82a9-5b09939ad41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:09.144965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf48ab-a221-4429-82a9-5b09939ad41b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:09.145462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf48ab-a221-4429-82a9-5b09939ad41b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:09.145949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf48ab-a221-4429-82a9-5b09939ad41b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:09.147413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf48ab-a221-4429-82a9-5b09939ad41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:09.170138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf48ab-a221-4429-82a9-5b09939ad41b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:09.236750 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2711/5413] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:09.241970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befd94c-7e64-487f-8921-bc7944ddc515 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:09.276401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9def3b-1ee4-4a6d-8e0f-55e7446bd904 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:09.277713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9def3b-1ee4-4a6d-8e0f-55e7446bd904 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:09.278665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9def3b-1ee4-4a6d-8e0f-55e7446bd904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:09.282947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befd94c-7e64-487f-8921-bc7944ddc515 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:09.305425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef8116-b6f1-4377-8804-f142ed59cc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:09.306355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef8116-b6f1-4377-8804-f142ed59cc03 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:09.306668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef8116-b6f1-4377-8804-f142ed59cc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:09.311360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef8116-b6f1-4377-8804-f142ed59cc03 admin admin] PATH_INFO: `/v3/projects/4df8ff5a72af4c518043e7ca92f0e3da/users/9bb5aa61c6974b558d710de6237d0d26/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:09.349651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef8116-b6f1-4377-8804-f142ed59cc03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df8ff5a72af4c518043e7ca92f0e3da, user_id=9bb5aa61c6974b558d710de6237d0d26, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:09.351629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7d9def3b-1ee4-4a6d-8e0f-55e7446bd904 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:09.352995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7d9def3b-1ee4-4a6d-8e0f-55e7446bd904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:09.355782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef8116-b6f1-4377-8804-f142ed59cc03 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:09.444001 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2703/5414] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:15:09 2022] PUT /identity/v3/projects/4df8ff5a72af4c518043e7ca92f0e3da/users/9bb5aa61c6974b558d710de6237d0d26/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:09.459081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62637374-fe43-4cb0-8d5b-c42a50c8c023 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:09.459367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62637374-fe43-4cb0-8d5b-c42a50c8c023 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:09.459642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62637374-fe43-4cb0-8d5b-c42a50c8c023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:09.533556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-62637374-fe43-4cb0-8d5b-c42a50c8c023 None None] MFA Rules not processed for user `9bb5aa61c6974b558d710de6237d0d26`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:09.534980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-62637374-fe43-4cb0-8d5b-c42a50c8c023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:09.570866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:09.592381 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2712/5415] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:15:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:09.601370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9def3b-1ee4-4a6d-8e0f-55e7446bd904 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:09.602896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7d9def3b-1ee4-4a6d-8e0f-55e7446bd904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:09.709564 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2704/5416] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:09.832418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9def3b-1ee4-4a6d-8e0f-55e7446bd904 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:09.968208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8787c6d-161a-4bd2-9e9b-7d87ecd8a6d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:09.969485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8787c6d-161a-4bd2-9e9b-7d87ecd8a6d5 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:09.970004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8787c6d-161a-4bd2-9e9b-7d87ecd8a6d5 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:09.970516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8787c6d-161a-4bd2-9e9b-7d87ecd8a6d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:10.024534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:10.077398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8787c6d-161a-4bd2-9e9b-7d87ecd8a6d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:10.081229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8787c6d-161a-4bd2-9e9b-7d87ecd8a6d5 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:10.116069 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2713/5417] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:15:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:15:10.553325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62637374-fe43-4cb0-8d5b-c42a50c8c023 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:10.556393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-62637374-fe43-4cb0-8d5b-c42a50c8c023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:10.946252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62637374-fe43-4cb0-8d5b-c42a50c8c023 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:10.976955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcbae5-5d3d-4e93-a347-e69830c73be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:10.979732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcbae5-5d3d-4e93-a347-e69830c73be6 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:10.980157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcbae5-5d3d-4e93-a347-e69830c73be6 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:10.980452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcbae5-5d3d-4e93-a347-e69830c73be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:11.020903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcbae5-5d3d-4e93-a347-e69830c73be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:11.024102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcbae5-5d3d-4e93-a347-e69830c73be6 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:11.035431 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2705/5418] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:11.208178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf845b-1251-4899-b30a-c7de95bd7cb5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:11.209462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf845b-1251-4899-b30a-c7de95bd7cb5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:11.209733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf845b-1251-4899-b30a-c7de95bd7cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:11.276607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-facf845b-1251-4899-b30a-c7de95bd7cb5 None None] MFA Rules not processed for user `ee83dfdb456f4acc9fa1c5e7c8ef00ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:11.278280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-facf845b-1251-4899-b30a-c7de95bd7cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:11.513735 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2714/5419] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:11.535127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9268b8-99e6-4e0f-b864-2624dc71709a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:11.535429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9268b8-99e6-4e0f-b864-2624dc71709a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:11.535716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9268b8-99e6-4e0f-b864-2624dc71709a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:11.626058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4b9268b8-99e6-4e0f-b864-2624dc71709a None None] MFA Rules not processed for user `ee83dfdb456f4acc9fa1c5e7c8ef00ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:11.635242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4b9268b8-99e6-4e0f-b864-2624dc71709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:11.692664 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2706/5420] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:12.339072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf845b-1251-4899-b30a-c7de95bd7cb5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:12.373584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf845b-1251-4899-b30a-c7de95bd7cb5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:12.415383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aa206-ae6e-436b-bce7-6ad34449029b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:12.422262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aa206-ae6e-436b-bce7-6ad34449029b service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:12.422889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aa206-ae6e-436b-bce7-6ad34449029b service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:12.423372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aa206-ae6e-436b-bce7-6ad34449029b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:12.450385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66aa206-ae6e-436b-bce7-6ad34449029b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:12.458152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66aa206-ae6e-436b-bce7-6ad34449029b service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:12.504603 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2715/5421] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:17.417317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72760892-6a21-489c-8b48-c86b0ac97770 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:17.418784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72760892-6a21-489c-8b48-c86b0ac97770 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:17.419364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72760892-6a21-489c-8b48-c86b0ac97770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:17.470225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811afa-27fa-4bb5-89ef-73985f1103e1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:17.471510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811afa-27fa-4bb5-89ef-73985f1103e1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:17.472210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811afa-27fa-4bb5-89ef-73985f1103e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:17.476626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-72760892-6a21-489c-8b48-c86b0ac97770 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:17.508085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-72760892-6a21-489c-8b48-c86b0ac97770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:17.571483 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2707/5422] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:15:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:17.595137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-90811afa-27fa-4bb5-89ef-73985f1103e1 None None] MFA Rules not processed for user `ee83dfdb456f4acc9fa1c5e7c8ef00ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:17.601915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-90811afa-27fa-4bb5-89ef-73985f1103e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:17.626678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72760892-6a21-489c-8b48-c86b0ac97770 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:17.659313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72760892-6a21-489c-8b48-c86b0ac97770 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:17.680804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f9b3c-5364-40d2-8f6b-531c4ff9bfc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:17.682288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f9b3c-5364-40d2-8f6b-531c4ff9bfc5 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:17.682804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f9b3c-5364-40d2-8f6b-531c4ff9bfc5 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:17.683287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f9b3c-5364-40d2-8f6b-531c4ff9bfc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:17.704410 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2716/5423] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:17.721533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f9b3c-5364-40d2-8f6b-531c4ff9bfc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:17.723664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f9b3c-5364-40d2-8f6b-531c4ff9bfc5 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:17.755403 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2708/5424] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:15:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:15:26.272064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811afa-27fa-4bb5-89ef-73985f1103e1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:26.275210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-90811afa-27fa-4bb5-89ef-73985f1103e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:26.471062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811afa-27fa-4bb5-89ef-73985f1103e1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:26.488601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:26.489873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:26.490452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:26.492002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] PATH_INFO: `/v3/users/b08da48a72304f2697c058aa7a74ea66` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:26.498310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08da48a72304f2697c058aa7a74ea66)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:26.501325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:26.740710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:26.754714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08da48a72304f2697c058aa7a74ea66'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:26.770377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08da48a72304f2697c058aa7a74ea66'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:26.771159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08da48a72304f2697c058aa7a74ea66'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:26.798474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08da48a72304f2697c058aa7a74ea66'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:26.799505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08da48a72304f2697c058aa7a74ea66'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:26.871033 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2717/5425] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:15:26 2022] DELETE /identity/v3/users/b08da48a72304f2697c058aa7a74ea66 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:26.875426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0271d-04c3-49df-9f9d-4b41a663fbd8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:26.875942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0271d-04c3-49df-9f9d-4b41a663fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:26.876248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0271d-04c3-49df-9f9d-4b41a663fbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:26.935537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a1c0271d-04c3-49df-9f9d-4b41a663fbd8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:26.937642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a1c0271d-04c3-49df-9f9d-4b41a663fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:27.126987 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2709/5426] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:27.137668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:27.139535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:27.276072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cad7f-217f-4466-acf9-ca191d81a443 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:27.280073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829c48e-5874-4cf3-ba57-a74caaeba314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:27.281169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c48e-5874-4cf3-ba57-a74caaeba314 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:27.281169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c48e-5874-4cf3-ba57-a74caaeba314 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:27.281444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829c48e-5874-4cf3-ba57-a74caaeba314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:27.296687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829c48e-5874-4cf3-ba57-a74caaeba314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:27.298167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829c48e-5874-4cf3-ba57-a74caaeba314 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:27.310799 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2718/5427] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:27.790568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0271d-04c3-49df-9f9d-4b41a663fbd8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:27.792711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a1c0271d-04c3-49df-9f9d-4b41a663fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:27.831922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0271d-04c3-49df-9f9d-4b41a663fbd8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:27.869283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd54809-8016-447f-9bec-7e714f71f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:27.870734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd54809-8016-447f-9bec-7e714f71f471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:27.871464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd54809-8016-447f-9bec-7e714f71f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:27.872156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd54809-8016-447f-9bec-7e714f71f471 admin admin] PATH_INFO: `/v3/projects/c299d8a39a204ad48230af1691ace045` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:27.874626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd54809-8016-447f-9bec-7e714f71f471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c299d8a39a204ad48230af1691ace045)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:27.879829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd54809-8016-447f-9bec-7e714f71f471 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:27.939779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:28.014040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cbd54809-8016-447f-9bec-7e714f71f471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c299d8a39a204ad48230af1691ace045', 'request_id': 'req-cbd54809-8016-447f-9bec-7e714f71f471'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:28.033996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cbd54809-8016-447f-9bec-7e714f71f471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c299d8a39a204ad48230af1691ace045', 'request_id': 'req-cbd54809-8016-447f-9bec-7e714f71f471'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:28.045887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cbd54809-8016-447f-9bec-7e714f71f471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c299d8a39a204ad48230af1691ace045', 'request_id': 'req-cbd54809-8016-447f-9bec-7e714f71f471'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:28.072395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cbd54809-8016-447f-9bec-7e714f71f471 admin admin] The token cache is being invalidate because project c299d8a39a204ad48230af1691ace045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:15:28.072943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cbd54809-8016-447f-9bec-7e714f71f471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:28.074534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cbd54809-8016-447f-9bec-7e714f71f471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:28.077601 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2710/5428] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:15:27 2022] DELETE /identity/v3/projects/c299d8a39a204ad48230af1691ace045 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:15:28.088744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0444f-b69f-47dd-bddb-4031c49afae6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:28.089774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0444f-b69f-47dd-bddb-4031c49afae6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:28.090429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0444f-b69f-47dd-bddb-4031c49afae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:28.160795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ddb0444f-b69f-47dd-bddb-4031c49afae6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:28.165046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ddb0444f-b69f-47dd-bddb-4031c49afae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:28.374392 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2719/5429] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:28.376929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0601d52-66cc-4812-a03d-9435cc35d253 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:28.377215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0601d52-66cc-4812-a03d-9435cc35d253 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:28.377494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0601d52-66cc-4812-a03d-9435cc35d253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:28.406673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e0601d52-66cc-4812-a03d-9435cc35d253 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:28.407950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e0601d52-66cc-4812-a03d-9435cc35d253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:28.426812 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2711/5430] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:28.427877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0444f-b69f-47dd-bddb-4031c49afae6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:28.441674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0444f-b69f-47dd-bddb-4031c49afae6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:28.461196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb580bb8-f34b-4cc3-a194-ef6d18c4c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:28.462082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb580bb8-f34b-4cc3-a194-ef6d18c4c509 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:28.462642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb580bb8-f34b-4cc3-a194-ef6d18c4c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:28.462961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb580bb8-f34b-4cc3-a194-ef6d18c4c509 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:28.463641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb580bb8-f34b-4cc3-a194-ef6d18c4c509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:15:28.463947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb580bb8-f34b-4cc3-a194-ef6d18c4c509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:28.467736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb580bb8-f34b-4cc3-a194-ef6d18c4c509 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:28.496578 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2720/5431] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:15:28.498328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0601d52-66cc-4812-a03d-9435cc35d253 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:28.513478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0601d52-66cc-4812-a03d-9435cc35d253 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:28.534479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5197b62-5ad9-4dfb-b460-196582e7a44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:28.535079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5197b62-5ad9-4dfb-b460-196582e7a44a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:28.535398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5197b62-5ad9-4dfb-b460-196582e7a44a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:28.535723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5197b62-5ad9-4dfb-b460-196582e7a44a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:28.536531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5197b62-5ad9-4dfb-b460-196582e7a44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:28.547846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5197b62-5ad9-4dfb-b460-196582e7a44a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:28.636743 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2712/5432] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:15:28 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:28.641161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb580bb8-f34b-4cc3-a194-ef6d18c4c509 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:28.669100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb580bb8-f34b-4cc3-a194-ef6d18c4c509 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:28.802066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:28.840090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f0bc3-5203-44e4-ba05-eadc83ffcb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:28.840723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0bc3-5203-44e4-ba05-eadc83ffcb88 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:28.841008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0bc3-5203-44e4-ba05-eadc83ffcb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:28.841281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0bc3-5203-44e4-ba05-eadc83ffcb88 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:28.841938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f0bc3-5203-44e4-ba05-eadc83ffcb88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:28.843898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f0bc3-5203-44e4-ba05-eadc83ffcb88 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:28.885674 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2721/5433] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:15:28 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:28.888801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5197b62-5ad9-4dfb-b460-196582e7a44a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:28.907238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5197b62-5ad9-4dfb-b460-196582e7a44a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:28.928193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be6987-4baa-472e-9d20-3f85934a0005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:28.929642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be6987-4baa-472e-9d20-3f85934a0005 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:28.936842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be6987-4baa-472e-9d20-3f85934a0005 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:28.937340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be6987-4baa-472e-9d20-3f85934a0005 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:28.938882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be6987-4baa-472e-9d20-3f85934a0005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:28.940702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be6987-4baa-472e-9d20-3f85934a0005 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:28.989279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f0bc3-5203-44e4-ba05-eadc83ffcb88 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:28.989924 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2713/5434] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:29.011179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f0bc3-5203-44e4-ba05-eadc83ffcb88 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:29.030711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c1875-9a1b-461a-9662-05e47711fd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:29.030711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c1875-9a1b-461a-9662-05e47711fd65 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:29.031162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c1875-9a1b-461a-9662-05e47711fd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:29.031162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c1875-9a1b-461a-9662-05e47711fd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:29.031786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c1875-9a1b-461a-9662-05e47711fd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:29.033627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c1875-9a1b-461a-9662-05e47711fd65 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:29.067290 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2722/5435] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:15:29.068095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be6987-4baa-472e-9d20-3f85934a0005 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:29.089047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be6987-4baa-472e-9d20-3f85934a0005 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:29.104330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c85691-2d6c-4960-85cf-80b65b6a4745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:29.105023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c85691-2d6c-4960-85cf-80b65b6a4745 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:29.105307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c85691-2d6c-4960-85cf-80b65b6a4745 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:29.105587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c85691-2d6c-4960-85cf-80b65b6a4745 admin admin] PATH_INFO: `/v3/projects/2baa48bb5aaf47f0979ce03f4d9f7c0b/users/1600acc2e7864e4096a61f729b2c2114/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:29.162178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c85691-2d6c-4960-85cf-80b65b6a4745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2baa48bb5aaf47f0979ce03f4d9f7c0b, user_id=1600acc2e7864e4096a61f729b2c2114, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:29.168147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c85691-2d6c-4960-85cf-80b65b6a4745 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:29.235494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60fbaa-46dd-490f-bd79-26274fc6251c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:29.235720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60fbaa-46dd-490f-bd79-26274fc6251c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:29.235970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60fbaa-46dd-490f-bd79-26274fc6251c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:29.239342 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2714/5436] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:15:29 2022] PUT /identity/v3/projects/2baa48bb5aaf47f0979ce03f4d9f7c0b/users/1600acc2e7864e4096a61f729b2c2114/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:15:29.302519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4b60fbaa-46dd-490f-bd79-26274fc6251c None None] MFA Rules not processed for user `1600acc2e7864e4096a61f729b2c2114`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:29.304972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4b60fbaa-46dd-490f-bd79-26274fc6251c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:29.445572 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2723/5437] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:29.457485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c85691-2d6c-4960-85cf-80b65b6a4745 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:29.459352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-61c85691-2d6c-4960-85cf-80b65b6a4745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:29.634102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c85691-2d6c-4960-85cf-80b65b6a4745 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:29.656451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b439ad-b96c-4dab-ad3b-213e2b7dac46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:29.657106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b439ad-b96c-4dab-ad3b-213e2b7dac46 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:29.657398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b439ad-b96c-4dab-ad3b-213e2b7dac46 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:29.657681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b439ad-b96c-4dab-ad3b-213e2b7dac46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:29.684167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b439ad-b96c-4dab-ad3b-213e2b7dac46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:29.685710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b439ad-b96c-4dab-ad3b-213e2b7dac46 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:29.714727 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2715/5438] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:30.484643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60fbaa-46dd-490f-bd79-26274fc6251c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:30.660437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60fbaa-46dd-490f-bd79-26274fc6251c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:30.673241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:30.674229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:30.674229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:30.674475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] PATH_INFO: `/v3/users/1600acc2e7864e4096a61f729b2c2114` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:30.675858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1600acc2e7864e4096a61f729b2c2114)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:30.677815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:30.802355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1600acc2e7864e4096a61f729b2c2114'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:30.832002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1600acc2e7864e4096a61f729b2c2114'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:30.833129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1600acc2e7864e4096a61f729b2c2114'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:30.835429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:30.862829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1600acc2e7864e4096a61f729b2c2114'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:30.864934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1600acc2e7864e4096a61f729b2c2114'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:30.960802 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2724/5439] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:15:30 2022] DELETE /identity/v3/users/1600acc2e7864e4096a61f729b2c2114 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:30.962613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ea2b9-2c67-4940-b5a7-65045bb9f85b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:30.963183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ea2b9-2c67-4940-b5a7-65045bb9f85b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:30.963497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ea2b9-2c67-4940-b5a7-65045bb9f85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:31.008979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e75ea2b9-2c67-4940-b5a7-65045bb9f85b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:31.011958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e75ea2b9-2c67-4940-b5a7-65045bb9f85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:31.121836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:31.191129 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2716/5440] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:31.296248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:31.312419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:31.417701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb9d3f-a404-440b-8c14-9473a0753908 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:31.422684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca605375-8e5c-4b38-b4ee-0229a049d1d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:31.423599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca605375-8e5c-4b38-b4ee-0229a049d1d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:31.424238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca605375-8e5c-4b38-b4ee-0229a049d1d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:31.424724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca605375-8e5c-4b38-b4ee-0229a049d1d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:31.436588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca605375-8e5c-4b38-b4ee-0229a049d1d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:31.438373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca605375-8e5c-4b38-b4ee-0229a049d1d4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:31.463939 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2725/5441] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:32.040242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ea2b9-2c67-4940-b5a7-65045bb9f85b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:32.042474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e75ea2b9-2c67-4940-b5a7-65045bb9f85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:32.075806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ea2b9-2c67-4940-b5a7-65045bb9f85b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:32.119374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:32.120347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:32.131800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:32.134464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69 admin admin] PATH_INFO: `/v3/projects/2baa48bb5aaf47f0979ce03f4d9f7c0b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:32.138829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2baa48bb5aaf47f0979ce03f4d9f7c0b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:32.143778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:32.229255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2baa48bb5aaf47f0979ce03f4d9f7c0b', 'request_id': 'req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:32.242157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2baa48bb5aaf47f0979ce03f4d9f7c0b', 'request_id': 'req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:32.253887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2baa48bb5aaf47f0979ce03f4d9f7c0b', 'request_id': 'req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:32.278898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69 admin admin] The token cache is being invalidate because project 2baa48bb5aaf47f0979ce03f4d9f7c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:15:32.279526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:32.280304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9c2f7cff-c121-4058-b5fa-30fab7f1ba69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:32.282399 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2717/5442] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:15:32 2022] DELETE /identity/v3/projects/2baa48bb5aaf47f0979ce03f4d9f7c0b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:32.287294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b545a8-dd8c-4969-b45d-f56115f4aeff None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:32.288679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b545a8-dd8c-4969-b45d-f56115f4aeff None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:32.288679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b545a8-dd8c-4969-b45d-f56115f4aeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:32.348638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a3b545a8-dd8c-4969-b45d-f56115f4aeff None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:32.350670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a3b545a8-dd8c-4969-b45d-f56115f4aeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:32.525371 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2726/5443] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:32.527932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d83256-77b8-44a9-aa80-851092a6b4e8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:32.527932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d83256-77b8-44a9-aa80-851092a6b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:32.527932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d83256-77b8-44a9-aa80-851092a6b4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:32.572656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-58d83256-77b8-44a9-aa80-851092a6b4e8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:32.572656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-58d83256-77b8-44a9-aa80-851092a6b4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:32.596214 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2718/5444] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:32.597673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b545a8-dd8c-4969-b45d-f56115f4aeff None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:32.617613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b545a8-dd8c-4969-b45d-f56115f4aeff None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:32.630296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458ddf3-a6ca-4f08-9cb3-5ec2ddf1b732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:32.630974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458ddf3-a6ca-4f08-9cb3-5ec2ddf1b732 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:32.631795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458ddf3-a6ca-4f08-9cb3-5ec2ddf1b732 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:32.632081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458ddf3-a6ca-4f08-9cb3-5ec2ddf1b732 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:32.632758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458ddf3-a6ca-4f08-9cb3-5ec2ddf1b732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:15:32.633062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458ddf3-a6ca-4f08-9cb3-5ec2ddf1b732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:32.634900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458ddf3-a6ca-4f08-9cb3-5ec2ddf1b732 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:32.674359 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2727/5445] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:15:32.675611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d83256-77b8-44a9-aa80-851092a6b4e8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:32.693240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d83256-77b8-44a9-aa80-851092a6b4e8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:32.700525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fdb9a-42d4-4d40-a273-087e46e29609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:32.701159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fdb9a-42d4-4d40-a273-087e46e29609 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:32.701445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fdb9a-42d4-4d40-a273-087e46e29609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:32.701724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fdb9a-42d4-4d40-a273-087e46e29609 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:32.702368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fdb9a-42d4-4d40-a273-087e46e29609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:32.704354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fdb9a-42d4-4d40-a273-087e46e29609 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:32.783171 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2719/5446] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:15:32 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:32.784322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458ddf3-a6ca-4f08-9cb3-5ec2ddf1b732 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:32.817369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458ddf3-a6ca-4f08-9cb3-5ec2ddf1b732 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:33.025485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77414bcd-e677-4940-8446-6b81a65ba3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:33.026216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77414bcd-e677-4940-8446-6b81a65ba3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:33.026595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77414bcd-e677-4940-8446-6b81a65ba3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:33.026927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77414bcd-e677-4940-8446-6b81a65ba3d9 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:33.027725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77414bcd-e677-4940-8446-6b81a65ba3d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:33.030298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77414bcd-e677-4940-8446-6b81a65ba3d9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:33.078774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:33.109916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fdb9a-42d4-4d40-a273-087e46e29609 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:33.110719 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2728/5447] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:15:32 2022] POST /identity/v3/users => generated 283 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:33.151208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fdb9a-42d4-4d40-a273-087e46e29609 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:33.187074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb1cae-83ee-4a5b-abfc-0e47be5e56b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:33.187978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb1cae-83ee-4a5b-abfc-0e47be5e56b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:33.188430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb1cae-83ee-4a5b-abfc-0e47be5e56b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:33.188880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb1cae-83ee-4a5b-abfc-0e47be5e56b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:33.189714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb1cae-83ee-4a5b-abfc-0e47be5e56b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:33.192442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb1cae-83ee-4a5b-abfc-0e47be5e56b9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:33.290635 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2720/5448] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:33.294031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77414bcd-e677-4940-8446-6b81a65ba3d9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:33.306602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77414bcd-e677-4940-8446-6b81a65ba3d9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:33.328852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56143d16-7cb2-45c6-8d93-86f1119b2722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:33.333245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143d16-7cb2-45c6-8d93-86f1119b2722 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:33.333567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143d16-7cb2-45c6-8d93-86f1119b2722 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:33.334024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56143d16-7cb2-45c6-8d93-86f1119b2722 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:33.335572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56143d16-7cb2-45c6-8d93-86f1119b2722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:33.339161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56143d16-7cb2-45c6-8d93-86f1119b2722 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:33.382231 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2729/5449] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:33.386113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb1cae-83ee-4a5b-abfc-0e47be5e56b9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:33.400731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb1cae-83ee-4a5b-abfc-0e47be5e56b9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:33.433286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184581b7-c593-4c03-a734-c48566fab335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:33.433995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184581b7-c593-4c03-a734-c48566fab335 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:33.434286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184581b7-c593-4c03-a734-c48566fab335 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:33.434579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184581b7-c593-4c03-a734-c48566fab335 admin admin] PATH_INFO: `/v3/projects/2c5ddc118d7a4c0e9c15de9ac742c89e/users/0217d05909ec455c8080003cdcadb9de/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:33.494508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184581b7-c593-4c03-a734-c48566fab335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5ddc118d7a4c0e9c15de9ac742c89e, user_id=0217d05909ec455c8080003cdcadb9de, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:33.497419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184581b7-c593-4c03-a734-c48566fab335 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:33.538656 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2721/5450] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:15:33 2022] PUT /identity/v3/projects/2c5ddc118d7a4c0e9c15de9ac742c89e/users/0217d05909ec455c8080003cdcadb9de/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:33.548939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2feb52-0935-4580-bdcd-76da873afc67 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:33.549551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2feb52-0935-4580-bdcd-76da873afc67 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:33.550031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2feb52-0935-4580-bdcd-76da873afc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:33.612135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2f2feb52-0935-4580-bdcd-76da873afc67 None None] MFA Rules not processed for user `0217d05909ec455c8080003cdcadb9de`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:33.613813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2f2feb52-0935-4580-bdcd-76da873afc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:33.780535 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2730/5451] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:33.784834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184581b7-c593-4c03-a734-c48566fab335 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:33.977078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:33.987056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184581b7-c593-4c03-a734-c48566fab335 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:34.001792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8447cfe-e744-40db-95a2-52389c767a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:34.002529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8447cfe-e744-40db-95a2-52389c767a22 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:34.002926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8447cfe-e744-40db-95a2-52389c767a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:34.003280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8447cfe-e744-40db-95a2-52389c767a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:34.004123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8447cfe-e744-40db-95a2-52389c767a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:34.009198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8447cfe-e744-40db-95a2-52389c767a22 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:34.081082 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2722/5452] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:15:33 2022] POST /identity/v3/projects => generated 363 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:34.082087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2feb52-0935-4580-bdcd-76da873afc67 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:34.096718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2feb52-0935-4580-bdcd-76da873afc67 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:34.361505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6552a3-38d7-466d-9870-18dea53e9f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:34.362408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6552a3-38d7-466d-9870-18dea53e9f57 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:34.362693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6552a3-38d7-466d-9870-18dea53e9f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:34.363065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6552a3-38d7-466d-9870-18dea53e9f57 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:34.363714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6552a3-38d7-466d-9870-18dea53e9f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:34.366884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6552a3-38d7-466d-9870-18dea53e9f57 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:34.426353 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2731/5453] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:15:34 2022] POST /identity/v3/users => generated 288 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:15:34.426701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8447cfe-e744-40db-95a2-52389c767a22 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:34.447251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8447cfe-e744-40db-95a2-52389c767a22 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:34.455190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967c046-d6d6-420b-8999-3d26ba4a0f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:34.456221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967c046-d6d6-420b-8999-3d26ba4a0f63 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:34.456732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967c046-d6d6-420b-8999-3d26ba4a0f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:34.457255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967c046-d6d6-420b-8999-3d26ba4a0f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:34.458388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967c046-d6d6-420b-8999-3d26ba4a0f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:34.466119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967c046-d6d6-420b-8999-3d26ba4a0f63 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:34.491773 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2723/5454] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:34.496617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6552a3-38d7-466d-9870-18dea53e9f57 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:34.509934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6552a3-38d7-466d-9870-18dea53e9f57 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:34.522593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f832bc-d479-4204-949d-e0e95efd2f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:34.523889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f832bc-d479-4204-949d-e0e95efd2f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:34.524396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f832bc-d479-4204-949d-e0e95efd2f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:34.524921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f832bc-d479-4204-949d-e0e95efd2f3a admin admin] PATH_INFO: `/v3/projects/ea695054cb2f49779bf21aea6ad3af59/users/a5001592cbe04aaba4c11ee8aae53345/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:34.555026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f832bc-d479-4204-949d-e0e95efd2f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea695054cb2f49779bf21aea6ad3af59, user_id=a5001592cbe04aaba4c11ee8aae53345, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:34.558409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f832bc-d479-4204-949d-e0e95efd2f3a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:34.594935 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2732/5455] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:15:34 2022] PUT /identity/v3/projects/ea695054cb2f49779bf21aea6ad3af59/users/a5001592cbe04aaba4c11ee8aae53345/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:34.596311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967c046-d6d6-420b-8999-3d26ba4a0f63 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:34.614466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967c046-d6d6-420b-8999-3d26ba4a0f63 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:34.734772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad249bc-4d80-4730-a698-2fa26267d2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:34.735808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad249bc-4d80-4730-a698-2fa26267d2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:34.736338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad249bc-4d80-4730-a698-2fa26267d2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:34.737353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad249bc-4d80-4730-a698-2fa26267d2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:34.738302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad249bc-4d80-4730-a698-2fa26267d2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:34.740176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad249bc-4d80-4730-a698-2fa26267d2a2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:34.758394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f832bc-d479-4204-949d-e0e95efd2f3a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:34.759139 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2724/5456] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:34.777748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f832bc-d479-4204-949d-e0e95efd2f3a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:34.797065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bb197-bd1b-48c0-ba8d-e93a08f57916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:34.798175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bb197-bd1b-48c0-ba8d-e93a08f57916 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:34.798380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bb197-bd1b-48c0-ba8d-e93a08f57916 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:34.798802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bb197-bd1b-48c0-ba8d-e93a08f57916 admin admin] PATH_INFO: `/v3/projects/ea695054cb2f49779bf21aea6ad3af59/users/a5001592cbe04aaba4c11ee8aae53345/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:34.801369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34bb197-bd1b-48c0-ba8d-e93a08f57916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea695054cb2f49779bf21aea6ad3af59, user_id=a5001592cbe04aaba4c11ee8aae53345, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:34.816776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34bb197-bd1b-48c0-ba8d-e93a08f57916 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:34.857011 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2733/5457] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:15:34 2022] PUT /identity/v3/projects/ea695054cb2f49779bf21aea6ad3af59/users/a5001592cbe04aaba4c11ee8aae53345/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:34.863996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d99d3-4287-41ba-8e02-74ac3eb13479 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:34.864531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d99d3-4287-41ba-8e02-74ac3eb13479 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:34.865265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d99d3-4287-41ba-8e02-74ac3eb13479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:34.920745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7b6d99d3-4287-41ba-8e02-74ac3eb13479 None None] MFA Rules not processed for user `a5001592cbe04aaba4c11ee8aae53345`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:34.924046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7b6d99d3-4287-41ba-8e02-74ac3eb13479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:35.107153 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2725/5458] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:35.119987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bb197-bd1b-48c0-ba8d-e93a08f57916 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:35.121816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a34bb197-bd1b-48c0-ba8d-e93a08f57916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:35.200216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:35.280712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bb197-bd1b-48c0-ba8d-e93a08f57916 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:35.287102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76617fa0-69dd-48bc-9964-f06bbbc150e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:35.288405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76617fa0-69dd-48bc-9964-f06bbbc150e9 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:35.288689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76617fa0-69dd-48bc-9964-f06bbbc150e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:35.289077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76617fa0-69dd-48bc-9964-f06bbbc150e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:35.302783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76617fa0-69dd-48bc-9964-f06bbbc150e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:35.306212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76617fa0-69dd-48bc-9964-f06bbbc150e9 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:35.344942 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2734/5459] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:36.251218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d99d3-4287-41ba-8e02-74ac3eb13479 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:36.426540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:36.450682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d99d3-4287-41ba-8e02-74ac3eb13479 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:36.463373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b870f9-1506-4c70-9051-16d4580845da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:36.464248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b870f9-1506-4c70-9051-16d4580845da admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:36.464650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b870f9-1506-4c70-9051-16d4580845da admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:36.465063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b870f9-1506-4c70-9051-16d4580845da admin admin] PATH_INFO: `/v3/users/0217d05909ec455c8080003cdcadb9de` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:36.467818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b870f9-1506-4c70-9051-16d4580845da admin admin] RBAC: Authorizing `identity:delete_user(user_id=0217d05909ec455c8080003cdcadb9de)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:36.476966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b870f9-1506-4c70-9051-16d4580845da admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:36.625584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-59b870f9-1506-4c70-9051-16d4580845da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0217d05909ec455c8080003cdcadb9de'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:36.635683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-59b870f9-1506-4c70-9051-16d4580845da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0217d05909ec455c8080003cdcadb9de'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:36.636485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-59b870f9-1506-4c70-9051-16d4580845da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0217d05909ec455c8080003cdcadb9de'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:36.670879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-59b870f9-1506-4c70-9051-16d4580845da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0217d05909ec455c8080003cdcadb9de'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:36.671655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-59b870f9-1506-4c70-9051-16d4580845da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0217d05909ec455c8080003cdcadb9de'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:36.705597 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2726/5460] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:15:36 2022] DELETE /identity/v3/users/0217d05909ec455c8080003cdcadb9de => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:36.709718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e8f18-6466-4f14-8e6e-e4ad51277d63 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:36.710900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e8f18-6466-4f14-8e6e-e4ad51277d63 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:36.711353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e8f18-6466-4f14-8e6e-e4ad51277d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:36.754087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b96e8f18-6466-4f14-8e6e-e4ad51277d63 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:36.755882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b96e8f18-6466-4f14-8e6e-e4ad51277d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:36.878576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152cbd4-8851-4a49-ab49-491bdada50f2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:36.882348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152cbd4-8851-4a49-ab49-491bdada50f2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:36.882348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152cbd4-8851-4a49-ab49-491bdada50f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:36.920478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7152cbd4-8851-4a49-ab49-491bdada50f2 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:36.921706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7152cbd4-8851-4a49-ab49-491bdada50f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:37.041182 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2735/5461] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:37.048342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e8f18-6466-4f14-8e6e-e4ad51277d63 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:37.050101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b96e8f18-6466-4f14-8e6e-e4ad51277d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:37.143138 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2727/5462] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:15:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:37.159088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152cbd4-8851-4a49-ab49-491bdada50f2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:37.160700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7152cbd4-8851-4a49-ab49-491bdada50f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:37.206209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e8f18-6466-4f14-8e6e-e4ad51277d63 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:37.224557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49957ed2-e369-4aaf-a1be-50bd65848891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:37.226537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49957ed2-e369-4aaf-a1be-50bd65848891 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:37.226537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49957ed2-e369-4aaf-a1be-50bd65848891 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:37.226798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49957ed2-e369-4aaf-a1be-50bd65848891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:37.264544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49957ed2-e369-4aaf-a1be-50bd65848891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:37.266120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49957ed2-e369-4aaf-a1be-50bd65848891 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:37.308783 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2736/5463] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:15:37.364012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152cbd4-8851-4a49-ab49-491bdada50f2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:37.378116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c59aa-4c99-4b54-ba68-444ebdb66ef8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:37.379981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c59aa-4c99-4b54-ba68-444ebdb66ef8 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:37.380400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c59aa-4c99-4b54-ba68-444ebdb66ef8 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:37.380774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c59aa-4c99-4b54-ba68-444ebdb66ef8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:37.408737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c59aa-4c99-4b54-ba68-444ebdb66ef8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:37.414082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c59aa-4c99-4b54-ba68-444ebdb66ef8 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:37.441731 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2728/5464] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:15:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:15:38.376382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49957ed2-e369-4aaf-a1be-50bd65848891 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:38.378730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-49957ed2-e369-4aaf-a1be-50bd65848891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:38.406024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49957ed2-e369-4aaf-a1be-50bd65848891 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:38.421578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:38.422516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:38.423203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:38.423650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] PATH_INFO: `/v3/projects/2c5ddc118d7a4c0e9c15de9ac742c89e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:38.433016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5ddc118d7a4c0e9c15de9ac742c89e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:38.464215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:38.625222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5ddc118d7a4c0e9c15de9ac742c89e', 'request_id': 'req-2483041a-6245-4ddf-8439-c8c79890a33a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:38.643256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5ddc118d7a4c0e9c15de9ac742c89e', 'request_id': 'req-2483041a-6245-4ddf-8439-c8c79890a33a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:38.673095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5ddc118d7a4c0e9c15de9ac742c89e', 'request_id': 'req-2483041a-6245-4ddf-8439-c8c79890a33a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:38.688851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:38.713490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] The token cache is being invalidate because project 2c5ddc118d7a4c0e9c15de9ac742c89e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:15:38.713971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:38.715015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:38.717967 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2737/5465] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:15:38 2022] DELETE /identity/v3/projects/2c5ddc118d7a4c0e9c15de9ac742c89e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:38.722027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c59aa-4c99-4b54-ba68-444ebdb66ef8 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:38.744294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c59aa-4c99-4b54-ba68-444ebdb66ef8 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:38.760188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:39.008298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d91548-5a88-45c4-9de6-6ad2804243ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:39.009528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d91548-5a88-45c4-9de6-6ad2804243ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:39.011386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d91548-5a88-45c4-9de6-6ad2804243ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:39.013206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d91548-5a88-45c4-9de6-6ad2804243ee admin admin] PATH_INFO: `/v3/users/a5001592cbe04aaba4c11ee8aae53345` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:39.016107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d91548-5a88-45c4-9de6-6ad2804243ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5001592cbe04aaba4c11ee8aae53345)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:39.021374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d91548-5a88-45c4-9de6-6ad2804243ee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:39.196478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-62d91548-5a88-45c4-9de6-6ad2804243ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5001592cbe04aaba4c11ee8aae53345'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:39.232945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-62d91548-5a88-45c4-9de6-6ad2804243ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5001592cbe04aaba4c11ee8aae53345'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:39.236897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-62d91548-5a88-45c4-9de6-6ad2804243ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5001592cbe04aaba4c11ee8aae53345'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:39.330796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-62d91548-5a88-45c4-9de6-6ad2804243ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5001592cbe04aaba4c11ee8aae53345'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:39.333020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-62d91548-5a88-45c4-9de6-6ad2804243ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5001592cbe04aaba4c11ee8aae53345'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:39.384097 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2729/5466] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:15:38 2022] DELETE /identity/v3/users/a5001592cbe04aaba4c11ee8aae53345 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:40.250273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:40.253631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:40.307727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483041a-6245-4ddf-8439-c8c79890a33a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:40.532318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:40.533001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:40.542667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:40.548239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d admin admin] PATH_INFO: `/v3/projects/ea695054cb2f49779bf21aea6ad3af59` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:40.558177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea695054cb2f49779bf21aea6ad3af59)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:40.572718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:40.733098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea695054cb2f49779bf21aea6ad3af59', 'request_id': 'req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:40.776049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea695054cb2f49779bf21aea6ad3af59', 'request_id': 'req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:40.826811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea695054cb2f49779bf21aea6ad3af59', 'request_id': 'req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:40.888197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d admin admin] The token cache is being invalidate because project ea695054cb2f49779bf21aea6ad3af59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:15:40.888498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:40.892693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309db990-3407-4960-bc40-f1744a12cd89 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:40.893239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309db990-3407-4960-bc40-f1744a12cd89 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:40.893239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309db990-3407-4960-bc40-f1744a12cd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:40.913890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fab02969-6fe7-4dd8-a2c1-35307db1aa2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:40.931648 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2738/5467] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:15:40 2022] DELETE /identity/v3/projects/ea695054cb2f49779bf21aea6ad3af59 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:40.937526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926d1f-c80b-4b96-907e-74651bd64e6c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:40.950271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926d1f-c80b-4b96-907e-74651bd64e6c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:40.950624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926d1f-c80b-4b96-907e-74651bd64e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:40.989197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-309db990-3407-4960-bc40-f1744a12cd89 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:40.999897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-309db990-3407-4960-bc40-f1744a12cd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:41.066264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f6926d1f-c80b-4b96-907e-74651bd64e6c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:41.081292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f6926d1f-c80b-4b96-907e-74651bd64e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:41.284962 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2730/5468] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:15:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:41.295312 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2739/5469] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:41.305663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951baf1-a0ac-436e-80a9-5afd6f122c7a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:41.306263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951baf1-a0ac-436e-80a9-5afd6f122c7a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:41.306809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951baf1-a0ac-436e-80a9-5afd6f122c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:41.341381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7951baf1-a0ac-436e-80a9-5afd6f122c7a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:41.342636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7951baf1-a0ac-436e-80a9-5afd6f122c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:41.376705 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2731/5470] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:41.376949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6926d1f-c80b-4b96-907e-74651bd64e6c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:41.394838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6926d1f-c80b-4b96-907e-74651bd64e6c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:41.425927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62f3f8-bb85-4dae-b5a9-8bf036eded22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:41.431248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62f3f8-bb85-4dae-b5a9-8bf036eded22 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:41.431912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62f3f8-bb85-4dae-b5a9-8bf036eded22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:41.438137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62f3f8-bb85-4dae-b5a9-8bf036eded22 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:41.439237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62f3f8-bb85-4dae-b5a9-8bf036eded22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:15:41.439729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62f3f8-bb85-4dae-b5a9-8bf036eded22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:41.442501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62f3f8-bb85-4dae-b5a9-8bf036eded22 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:41.502439 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2740/5471] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:15:41.506616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951baf1-a0ac-436e-80a9-5afd6f122c7a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:41.529054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951baf1-a0ac-436e-80a9-5afd6f122c7a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:41.553458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2066879-e004-4deb-bc4a-061302d34174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:41.554594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2066879-e004-4deb-bc4a-061302d34174 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:41.554927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2066879-e004-4deb-bc4a-061302d34174 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:41.555200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2066879-e004-4deb-bc4a-061302d34174 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:41.555866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2066879-e004-4deb-bc4a-061302d34174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:41.558874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62f3f8-bb85-4dae-b5a9-8bf036eded22 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:41.561847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8a62f3f8-bb85-4dae-b5a9-8bf036eded22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:41.569114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2066879-e004-4deb-bc4a-061302d34174 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:41.603894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:41.757131 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2732/5472] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:15:41 2022] POST /identity/v3/projects => generated 387 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:41.762285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2066879-e004-4deb-bc4a-061302d34174 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:41.775227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:41.880863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62f3f8-bb85-4dae-b5a9-8bf036eded22 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:41.957606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2066879-e004-4deb-bc4a-061302d34174 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:41.978038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e5eac-8bfd-4c06-a733-f51e1a73e6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:41.980554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e5eac-8bfd-4c06-a733-f51e1a73e6cf admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:41.981188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e5eac-8bfd-4c06-a733-f51e1a73e6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:41.981686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e5eac-8bfd-4c06-a733-f51e1a73e6cf admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:41.983535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e5eac-8bfd-4c06-a733-f51e1a73e6cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:41.988094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e5eac-8bfd-4c06-a733-f51e1a73e6cf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:42.057033 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2733/5473] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:15:41 2022] POST /identity/v3/users => generated 294 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:42.061867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e5eac-8bfd-4c06-a733-f51e1a73e6cf admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:42.081577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e5eac-8bfd-4c06-a733-f51e1a73e6cf admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:42.106026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0ee81-ebea-47c9-8060-eb52b8a07738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:42.106299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0ee81-ebea-47c9-8060-eb52b8a07738 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:42.110293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0ee81-ebea-47c9-8060-eb52b8a07738 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:42.110293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0ee81-ebea-47c9-8060-eb52b8a07738 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:42.110293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0ee81-ebea-47c9-8060-eb52b8a07738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:42.110293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0ee81-ebea-47c9-8060-eb52b8a07738 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:42.133463 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2734/5474] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:15:42.137192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0ee81-ebea-47c9-8060-eb52b8a07738 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:42.154436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315a0d0-1666-4ba7-b83e-29a27f40f435 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:42.154580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315a0d0-1666-4ba7-b83e-29a27f40f435 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:42.154950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315a0d0-1666-4ba7-b83e-29a27f40f435 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:42.155150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315a0d0-1666-4ba7-b83e-29a27f40f435 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:42.157893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0ee81-ebea-47c9-8060-eb52b8a07738 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:42.177533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856c0d-4373-4d70-87f9-fd3357452ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:42.178975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856c0d-4373-4d70-87f9-fd3357452ece admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:42.179368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856c0d-4373-4d70-87f9-fd3357452ece admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:42.179740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7856c0d-4373-4d70-87f9-fd3357452ece admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:42.181233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7856c0d-4373-4d70-87f9-fd3357452ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:42.183050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7856c0d-4373-4d70-87f9-fd3357452ece admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:42.208601 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2735/5475] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:15:42.221102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856c0d-4373-4d70-87f9-fd3357452ece admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:42.242626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7856c0d-4373-4d70-87f9-fd3357452ece admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:42.255227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f87a5-6be5-4a3c-9253-c860b3300bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:42.256613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f87a5-6be5-4a3c-9253-c860b3300bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:42.257001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f87a5-6be5-4a3c-9253-c860b3300bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:42.257387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f87a5-6be5-4a3c-9253-c860b3300bdf admin admin] PATH_INFO: `/v3/projects/07658a15d87f4cf6aeada55545e238ba/users/6122b903e2b447cbb9e186e93c3cd3cf/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:42.288543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f87a5-6be5-4a3c-9253-c860b3300bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=07658a15d87f4cf6aeada55545e238ba, user_id=6122b903e2b447cbb9e186e93c3cd3cf, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:42.291685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f87a5-6be5-4a3c-9253-c860b3300bdf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:42.324292 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2736/5476] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:15:42 2022] PUT /identity/v3/projects/07658a15d87f4cf6aeada55545e238ba/users/6122b903e2b447cbb9e186e93c3cd3cf/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:15:42.341942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa9f22-695a-4d08-87a5-7f96af36ea00 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:42.342235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa9f22-695a-4d08-87a5-7f96af36ea00 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:42.343026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa9f22-695a-4d08-87a5-7f96af36ea00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:42.421392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315a0d0-1666-4ba7-b83e-29a27f40f435 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:42.423823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315a0d0-1666-4ba7-b83e-29a27f40f435 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:42.424748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-94aa9f22-695a-4d08-87a5-7f96af36ea00 None None] MFA Rules not processed for user `6122b903e2b447cbb9e186e93c3cd3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:42.426184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-94aa9f22-695a-4d08-87a5-7f96af36ea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:42.467658 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2741/5477] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:15:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 909 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:15:42.697213 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2737/5478] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:42.703023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315a0d0-1666-4ba7-b83e-29a27f40f435 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:42.730350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315a0d0-1666-4ba7-b83e-29a27f40f435 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:42.921326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:42.940647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f1f79-db94-4bf0-ba71-4353d4eb7626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:42.941265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f1f79-db94-4bf0-ba71-4353d4eb7626 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:42.942322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f1f79-db94-4bf0-ba71-4353d4eb7626 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:42.942579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f1f79-db94-4bf0-ba71-4353d4eb7626 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:42.944938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f1f79-db94-4bf0-ba71-4353d4eb7626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:42.946841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f1f79-db94-4bf0-ba71-4353d4eb7626 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:43.029705 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2742/5479] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:15:42 2022] POST /identity/v3/projects => generated 385 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:15:43.034975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa9f22-695a-4d08-87a5-7f96af36ea00 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:43.076037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa9f22-695a-4d08-87a5-7f96af36ea00 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:43.204232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:43.307611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877894a-01eb-44db-8941-9634bdfa0d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:43.308691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877894a-01eb-44db-8941-9634bdfa0d81 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:43.309251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877894a-01eb-44db-8941-9634bdfa0d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:43.309762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877894a-01eb-44db-8941-9634bdfa0d81 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:43.310722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877894a-01eb-44db-8941-9634bdfa0d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:43.313245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877894a-01eb-44db-8941-9634bdfa0d81 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:43.351858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a652e7-df7c-4aea-9e03-3c6d111a97b8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:43.352367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a652e7-df7c-4aea-9e03-3c6d111a97b8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:43.352848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a652e7-df7c-4aea-9e03-3c6d111a97b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:43.379986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e9a652e7-df7c-4aea-9e03-3c6d111a97b8 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:43.383360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e9a652e7-df7c-4aea-9e03-3c6d111a97b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:43.386999 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2738/5480] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:15:43 2022] POST /identity/v3/users => generated 299 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:43.388152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877894a-01eb-44db-8941-9634bdfa0d81 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:43.402530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877894a-01eb-44db-8941-9634bdfa0d81 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:43.408891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8988c49-541b-430c-8660-00e52408fc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:43.409818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988c49-541b-430c-8660-00e52408fc48 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:43.410218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988c49-541b-430c-8660-00e52408fc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:43.410853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8988c49-541b-430c-8660-00e52408fc48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:43.411630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8988c49-541b-430c-8660-00e52408fc48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:43.414032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8988c49-541b-430c-8660-00e52408fc48 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:43.428587 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2739/5481] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:43.432785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8988c49-541b-430c-8660-00e52408fc48 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:43.445670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8988c49-541b-430c-8660-00e52408fc48 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:43.452053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1745104-3572-4287-bd85-9bf544bbdeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:43.453063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745104-3572-4287-bd85-9bf544bbdeae admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:43.453469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745104-3572-4287-bd85-9bf544bbdeae admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:43.453890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745104-3572-4287-bd85-9bf544bbdeae admin admin] PATH_INFO: `/v3/projects/8af74dd8da75413eba42a4f96e74aec8/users/eb410a24aace440e9afb90a8a9842a2a/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:43.474918 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2743/5482] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:15:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:43.481636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1745104-3572-4287-bd85-9bf544bbdeae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af74dd8da75413eba42a4f96e74aec8, user_id=eb410a24aace440e9afb90a8a9842a2a, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:43.485963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1745104-3572-4287-bd85-9bf544bbdeae admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:43.490846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a652e7-df7c-4aea-9e03-3c6d111a97b8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:43.509239 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2740/5483] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:15:43 2022] PUT /identity/v3/projects/8af74dd8da75413eba42a4f96e74aec8/users/eb410a24aace440e9afb90a8a9842a2a/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:43.510505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1745104-3572-4287-bd85-9bf544bbdeae admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:43.598062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1745104-3572-4287-bd85-9bf544bbdeae admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:43.604302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfb2a7-7d24-499e-86a5-023812e81376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:43.606444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfb2a7-7d24-499e-86a5-023812e81376 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:43.606735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfb2a7-7d24-499e-86a5-023812e81376 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:43.607133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfb2a7-7d24-499e-86a5-023812e81376 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:43.607866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfb2a7-7d24-499e-86a5-023812e81376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:43.609388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfb2a7-7d24-499e-86a5-023812e81376 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:43.625580 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2741/5484] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:43.633577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfb2a7-7d24-499e-86a5-023812e81376 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:43.660683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfb2a7-7d24-499e-86a5-023812e81376 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:43.669587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7062c52-a83a-4681-bcec-c8ce0be29416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:43.670491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7062c52-a83a-4681-bcec-c8ce0be29416 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:43.670823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7062c52-a83a-4681-bcec-c8ce0be29416 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:43.671107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7062c52-a83a-4681-bcec-c8ce0be29416 admin admin] PATH_INFO: `/v3/projects/8af74dd8da75413eba42a4f96e74aec8/users/eb410a24aace440e9afb90a8a9842a2a/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:43.675034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7062c52-a83a-4681-bcec-c8ce0be29416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af74dd8da75413eba42a4f96e74aec8, user_id=eb410a24aace440e9afb90a8a9842a2a, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:43.688373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7062c52-a83a-4681-bcec-c8ce0be29416 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:43.723093 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2742/5485] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:15:43 2022] PUT /identity/v3/projects/8af74dd8da75413eba42a4f96e74aec8/users/eb410a24aace440e9afb90a8a9842a2a/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:43.738898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e82841-d616-4c91-b871-a82bfabc06e3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:43.739577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e82841-d616-4c91-b871-a82bfabc06e3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:43.740118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e82841-d616-4c91-b871-a82bfabc06e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:43.764472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a652e7-df7c-4aea-9e03-3c6d111a97b8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:43.801857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-15e82841-d616-4c91-b871-a82bfabc06e3 None None] MFA Rules not processed for user `eb410a24aace440e9afb90a8a9842a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:43.803796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-15e82841-d616-4c91-b871-a82bfabc06e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:43.894634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90a2a1-cd38-46b3-bbfa-38d065929d9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:43.895303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90a2a1-cd38-46b3-bbfa-38d065929d9b service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:43.895586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90a2a1-cd38-46b3-bbfa-38d065929d9b service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:43.895864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90a2a1-cd38-46b3-bbfa-38d065929d9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:43.936995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:43.964530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:43.981917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90a2a1-cd38-46b3-bbfa-38d065929d9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:43.983572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90a2a1-cd38-46b3-bbfa-38d065929d9b service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:43.991366 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2743/5486] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:44.003050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e82841-d616-4c91-b871-a82bfabc06e3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:44.005754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-15e82841-d616-4c91-b871-a82bfabc06e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:44.013275 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2744/5487] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:15:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:15:44.130677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e82841-d616-4c91-b871-a82bfabc06e3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:44.135773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e9e70-88e7-4a46-8d6a-133c4d1e523c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:44.136375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e9e70-88e7-4a46-8d6a-133c4d1e523c service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:44.137110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e9e70-88e7-4a46-8d6a-133c4d1e523c service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:44.137110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e9e70-88e7-4a46-8d6a-133c4d1e523c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:44.158689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e9e70-88e7-4a46-8d6a-133c4d1e523c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:44.163322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e9e70-88e7-4a46-8d6a-133c4d1e523c service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:44.198693 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2744/5488] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:44.403939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90a2a1-cd38-46b3-bbfa-38d065929d9b service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:44.688708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90a2a1-cd38-46b3-bbfa-38d065929d9b service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:44.716622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:44.718643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:44.719298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:44.719620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] PATH_INFO: `/v3/users/6122b903e2b447cbb9e186e93c3cd3cf` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:44.724293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6122b903e2b447cbb9e186e93c3cd3cf)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:44.733192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:44.845167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6122b903e2b447cbb9e186e93c3cd3cf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:44.856390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6122b903e2b447cbb9e186e93c3cd3cf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:44.862486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6122b903e2b447cbb9e186e93c3cd3cf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:44.927355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6122b903e2b447cbb9e186e93c3cd3cf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:44.927355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6122b903e2b447cbb9e186e93c3cd3cf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:45.015085 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2745/5489] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:15:44 2022] DELETE /identity/v3/users/6122b903e2b447cbb9e186e93c3cd3cf => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:45.016951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b71d-852d-41ff-b55a-29830a38ff20 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:45.017269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b71d-852d-41ff-b55a-29830a38ff20 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:45.017705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b71d-852d-41ff-b55a-29830a38ff20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:45.083787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1eb5b71d-852d-41ff-b55a-29830a38ff20 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:45.088715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1eb5b71d-852d-41ff-b55a-29830a38ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:45.184906 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2745/5490] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:45.195652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:45.197648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:45.308370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:45.323130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f077277-ac3a-4c91-bf27-74808ad6344a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:45.332053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa324d-f80c-426b-b646-da23d10388d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:45.332747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa324d-f80c-426b-b646-da23d10388d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:45.333030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa324d-f80c-426b-b646-da23d10388d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:45.333369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa324d-f80c-426b-b646-da23d10388d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:45.375145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa324d-f80c-426b-b646-da23d10388d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:45.377080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa324d-f80c-426b-b646-da23d10388d4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:45.427974 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2746/5491] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:46.093756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b71d-852d-41ff-b55a-29830a38ff20 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:46.095517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1eb5b71d-852d-41ff-b55a-29830a38ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:46.134028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b71d-852d-41ff-b55a-29830a38ff20 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:46.151037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:46.153209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:46.153584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:46.153927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] PATH_INFO: `/v3/projects/07658a15d87f4cf6aeada55545e238ba` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:46.156130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07658a15d87f4cf6aeada55545e238ba)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:46.162948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:46.237557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07658a15d87f4cf6aeada55545e238ba', 'request_id': 'req-dca0065c-46b7-4279-ae56-a94f4386d24e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:46.251285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07658a15d87f4cf6aeada55545e238ba', 'request_id': 'req-dca0065c-46b7-4279-ae56-a94f4386d24e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:46.269293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07658a15d87f4cf6aeada55545e238ba', 'request_id': 'req-dca0065c-46b7-4279-ae56-a94f4386d24e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:46.285105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] The token cache is being invalidate because project 07658a15d87f4cf6aeada55545e238ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:15:46.285668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:46.286414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:46.291868 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2746/5492] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:15:46 2022] DELETE /identity/v3/projects/07658a15d87f4cf6aeada55545e238ba => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:46.292693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa324d-f80c-426b-b646-da23d10388d4 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:46.321675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa324d-f80c-426b-b646-da23d10388d4 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:46.408477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee89614-70e9-45dc-802e-31eaeeb3bd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:46.409355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee89614-70e9-45dc-802e-31eaeeb3bd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:46.411204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee89614-70e9-45dc-802e-31eaeeb3bd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:46.411650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee89614-70e9-45dc-802e-31eaeeb3bd5b admin admin] PATH_INFO: `/v3/users/eb410a24aace440e9afb90a8a9842a2a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:46.413630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee89614-70e9-45dc-802e-31eaeeb3bd5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb410a24aace440e9afb90a8a9842a2a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:46.416625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee89614-70e9-45dc-802e-31eaeeb3bd5b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:46.530030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7ee89614-70e9-45dc-802e-31eaeeb3bd5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb410a24aace440e9afb90a8a9842a2a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:46.540959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7ee89614-70e9-45dc-802e-31eaeeb3bd5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb410a24aace440e9afb90a8a9842a2a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:46.543827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7ee89614-70e9-45dc-802e-31eaeeb3bd5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb410a24aace440e9afb90a8a9842a2a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:46.566597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7ee89614-70e9-45dc-802e-31eaeeb3bd5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb410a24aace440e9afb90a8a9842a2a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:46.567421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7ee89614-70e9-45dc-802e-31eaeeb3bd5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb410a24aace440e9afb90a8a9842a2a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:46.671295 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2747/5493] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:15:46 2022] DELETE /identity/v3/users/eb410a24aace440e9afb90a8a9842a2a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:46.750877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:46.750877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:46.770709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0065c-46b7-4279-ae56-a94f4386d24e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:46.811218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:46.893708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:46.894614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:46.894955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:46.895351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] PATH_INFO: `/v3/users/9bb5aa61c6974b558d710de6237d0d26` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:46.899882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bb5aa61c6974b558d710de6237d0d26)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:46.904420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:46.996255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bb5aa61c6974b558d710de6237d0d26'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:47.016553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bb5aa61c6974b558d710de6237d0d26'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:47.019891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bb5aa61c6974b558d710de6237d0d26'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:47.079971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bb5aa61c6974b558d710de6237d0d26'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:47.085079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bb5aa61c6974b558d710de6237d0d26'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:47.109997 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2747/5494] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:15:46 2022] DELETE /identity/v3/users/9bb5aa61c6974b558d710de6237d0d26 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:47.114462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f30015-ed4c-4654-9f30-6b3cf7734df5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:47.114761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f30015-ed4c-4654-9f30-6b3cf7734df5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:47.115070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f30015-ed4c-4654-9f30-6b3cf7734df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:47.168775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-49f30015-ed4c-4654-9f30-6b3cf7734df5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:47.171643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-49f30015-ed4c-4654-9f30-6b3cf7734df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:47.322212 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2748/5495] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:47.381959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f30015-ed4c-4654-9f30-6b3cf7734df5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:47.382930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:47.383573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-49f30015-ed4c-4654-9f30-6b3cf7734df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:47.385058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:47.402910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f30015-ed4c-4654-9f30-6b3cf7734df5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:47.436349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2126133-bc07-446e-acdf-c70872529cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:47.437019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2126133-bc07-446e-acdf-c70872529cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:47.437458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2126133-bc07-446e-acdf-c70872529cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:47.437581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2126133-bc07-446e-acdf-c70872529cd9 admin admin] PATH_INFO: `/v3/projects/8af74dd8da75413eba42a4f96e74aec8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:47.444013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2126133-bc07-446e-acdf-c70872529cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af74dd8da75413eba42a4f96e74aec8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:47.445985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2126133-bc07-446e-acdf-c70872529cd9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:47.460973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:47.605611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2126133-bc07-446e-acdf-c70872529cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af74dd8da75413eba42a4f96e74aec8', 'request_id': 'req-b2126133-bc07-446e-acdf-c70872529cd9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:47.617259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2126133-bc07-446e-acdf-c70872529cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af74dd8da75413eba42a4f96e74aec8', 'request_id': 'req-b2126133-bc07-446e-acdf-c70872529cd9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:47.644214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2126133-bc07-446e-acdf-c70872529cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af74dd8da75413eba42a4f96e74aec8', 'request_id': 'req-b2126133-bc07-446e-acdf-c70872529cd9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:47.653948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237f47d-b81a-458d-9554-e86e161d287b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:47.694735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2126133-bc07-446e-acdf-c70872529cd9 admin admin] The token cache is being invalidate because project 8af74dd8da75413eba42a4f96e74aec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:15:47.695306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2126133-bc07-446e-acdf-c70872529cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:47.703175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2126133-bc07-446e-acdf-c70872529cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:47.708309 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2749/5496] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:15:47 2022] DELETE /identity/v3/projects/8af74dd8da75413eba42a4f96e74aec8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:47.710419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47f3f5-d3dd-4778-ab4b-1823220ec99e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:47.710840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47f3f5-d3dd-4778-ab4b-1823220ec99e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:47.711125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47f3f5-d3dd-4778-ab4b-1823220ec99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:47.746887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3ae82-8826-4887-a371-a76738e9c4bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:47.747941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3ae82-8826-4887-a371-a76738e9c4bb service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:47.748460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3ae82-8826-4887-a371-a76738e9c4bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:47.749004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3ae82-8826-4887-a371-a76738e9c4bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:47.751203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1ce3ae82-8826-4887-a371-a76738e9c4bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:47.754171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cd47f3f5-d3dd-4778-ab4b-1823220ec99e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:47.755405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cd47f3f5-d3dd-4778-ab4b-1823220ec99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:47.805600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:47.897522 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2750/5497] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:47.904838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3b90e-6e48-4c2a-b7f9-721bb3fbab44 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:47.905191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3b90e-6e48-4c2a-b7f9-721bb3fbab44 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:47.905398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3b90e-6e48-4c2a-b7f9-721bb3fbab44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:47.941698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6bf3b90e-6e48-4c2a-b7f9-721bb3fbab44 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:47.944477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6bf3b90e-6e48-4c2a-b7f9-721bb3fbab44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:47.969433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3ae82-8826-4887-a371-a76738e9c4bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:47.975631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3ae82-8826-4887-a371-a76738e9c4bb service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:47.978862 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2751/5498] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:47.979976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3b90e-6e48-4c2a-b7f9-721bb3fbab44 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:48.030773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3b90e-6e48-4c2a-b7f9-721bb3fbab44 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:48.048731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e50883-0b3f-4b1b-8638-3d5d32e82d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:48.048731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e50883-0b3f-4b1b-8638-3d5d32e82d9c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:48.048731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e50883-0b3f-4b1b-8638-3d5d32e82d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:48.048731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e50883-0b3f-4b1b-8638-3d5d32e82d9c admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:48.049196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e50883-0b3f-4b1b-8638-3d5d32e82d9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:15:48.049196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e50883-0b3f-4b1b-8638-3d5d32e82d9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:48.058334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e50883-0b3f-4b1b-8638-3d5d32e82d9c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:48.059865 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2748/5499] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:48.105860 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2752/5500] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:15:48.107508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3ae82-8826-4887-a371-a76738e9c4bb service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:48.121168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3ae82-8826-4887-a371-a76738e9c4bb service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:48.127199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10631e91-8da7-447a-87b1-a945d691fd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:48.128306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10631e91-8da7-447a-87b1-a945d691fd10 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:48.128789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10631e91-8da7-447a-87b1-a945d691fd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:48.129255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10631e91-8da7-447a-87b1-a945d691fd10 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:48.130159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10631e91-8da7-447a-87b1-a945d691fd10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:48.134505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10631e91-8da7-447a-87b1-a945d691fd10 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:48.178909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e50883-0b3f-4b1b-8638-3d5d32e82d9c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:48.189008 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2749/5501] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:15:48 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:48.192127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e50883-0b3f-4b1b-8638-3d5d32e82d9c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:48.291853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd1b95-8b85-4ad7-838a-2171a97f315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:48.292671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd1b95-8b85-4ad7-838a-2171a97f315e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:48.294288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd1b95-8b85-4ad7-838a-2171a97f315e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:48.294729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd1b95-8b85-4ad7-838a-2171a97f315e admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:48.295552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd1b95-8b85-4ad7-838a-2171a97f315e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:48.302349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd1b95-8b85-4ad7-838a-2171a97f315e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:48.373444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10631e91-8da7-447a-87b1-a945d691fd10 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:48.385984 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2753/5502] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:15:48 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:15:48.390544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10631e91-8da7-447a-87b1-a945d691fd10 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:48.414718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d2431-8ac1-44f6-9d2e-3e2d6974fec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:48.415301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d2431-8ac1-44f6-9d2e-3e2d6974fec4 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:48.415715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d2431-8ac1-44f6-9d2e-3e2d6974fec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:48.416174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d2431-8ac1-44f6-9d2e-3e2d6974fec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:48.417074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d2431-8ac1-44f6-9d2e-3e2d6974fec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:48.419564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d2431-8ac1-44f6-9d2e-3e2d6974fec4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:48.457897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd1b95-8b85-4ad7-838a-2171a97f315e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:48.467769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:48.469940 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2750/5503] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:48.473531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd1b95-8b85-4ad7-838a-2171a97f315e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:48.483306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc8761-8f65-43be-a087-9033523d2b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:48.484924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8761-8f65-43be-a087-9033523d2b84 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:48.486173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8761-8f65-43be-a087-9033523d2b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:48.487423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8761-8f65-43be-a087-9033523d2b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:48.488619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc8761-8f65-43be-a087-9033523d2b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:48.491716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc8761-8f65-43be-a087-9033523d2b84 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:48.515862 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2754/5504] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:48.517761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d2431-8ac1-44f6-9d2e-3e2d6974fec4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:48.539863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d2431-8ac1-44f6-9d2e-3e2d6974fec4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:48.546933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccce17-e2ca-4a00-9a7a-98f2f53941fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:48.547811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccce17-e2ca-4a00-9a7a-98f2f53941fe admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:48.549442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccce17-e2ca-4a00-9a7a-98f2f53941fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:48.549568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccce17-e2ca-4a00-9a7a-98f2f53941fe admin admin] PATH_INFO: `/v3/projects/9645a65061764fd2bee1144155101111/users/41c03d8e91214778bcc8eb8945b325b6/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:48.584875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccce17-e2ca-4a00-9a7a-98f2f53941fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9645a65061764fd2bee1144155101111, user_id=41c03d8e91214778bcc8eb8945b325b6, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:48.598592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccce17-e2ca-4a00-9a7a-98f2f53941fe admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:48.646085 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2751/5505] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:15:48 2022] PUT /identity/v3/projects/9645a65061764fd2bee1144155101111/users/41c03d8e91214778bcc8eb8945b325b6/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:48.657958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a9332-4b62-40c9-8ef9-ff07059625a0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:48.658304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a9332-4b62-40c9-8ef9-ff07059625a0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:48.658697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a9332-4b62-40c9-8ef9-ff07059625a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:48.736351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ba2a9332-4b62-40c9-8ef9-ff07059625a0 None None] MFA Rules not processed for user `41c03d8e91214778bcc8eb8945b325b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:48.738027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ba2a9332-4b62-40c9-8ef9-ff07059625a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:48.887610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccce17-e2ca-4a00-9a7a-98f2f53941fe admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:48.888578 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2755/5506] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:49.040251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccce17-e2ca-4a00-9a7a-98f2f53941fe admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:49.048200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37345-852d-4a51-afd3-6049be6dbc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:49.048926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37345-852d-4a51-afd3-6049be6dbc8b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:49.049219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37345-852d-4a51-afd3-6049be6dbc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:49.049541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37345-852d-4a51-afd3-6049be6dbc8b admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:49.050368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d37345-852d-4a51-afd3-6049be6dbc8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:49.052694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d37345-852d-4a51-afd3-6049be6dbc8b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:49.070832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a9332-4b62-40c9-8ef9-ff07059625a0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:49.072632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ba2a9332-4b62-40c9-8ef9-ff07059625a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:49.096880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a9332-4b62-40c9-8ef9-ff07059625a0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:49.114889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:49.116960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:49.117582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:49.117858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2 admin admin] PATH_INFO: `/v3/projects/4df8ff5a72af4c518043e7ca92f0e3da` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:49.119258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df8ff5a72af4c518043e7ca92f0e3da)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:49.121186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:49.125479 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2752/5507] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:15:48 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:15:49.129406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37345-852d-4a51-afd3-6049be6dbc8b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:49.278249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:49.297675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df8ff5a72af4c518043e7ca92f0e3da', 'request_id': 'req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:49.314282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df8ff5a72af4c518043e7ca92f0e3da', 'request_id': 'req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:49.334298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df8ff5a72af4c518043e7ca92f0e3da', 'request_id': 'req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:49.337497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37345-852d-4a51-afd3-6049be6dbc8b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:49.363748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2 admin admin] The token cache is being invalidate because project 4df8ff5a72af4c518043e7ca92f0e3da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:15:49.365103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:49.367610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aaa2a882-6ba5-4945-ad4e-ef5e96c4fdb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:49.372749 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2756/5508] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:15:49 2022] DELETE /identity/v3/projects/4df8ff5a72af4c518043e7ca92f0e3da => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:15:49.377240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe8ec1-2acb-4124-af30-c2dd7bcd6a8e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:49.377809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe8ec1-2acb-4124-af30-c2dd7bcd6a8e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:49.378192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe8ec1-2acb-4124-af30-c2dd7bcd6a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:49.425574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-12fe8ec1-2acb-4124-af30-c2dd7bcd6a8e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:49.428555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-12fe8ec1-2acb-4124-af30-c2dd7bcd6a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:49.483595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fabe3c-6267-4c90-bd52-88b502c63d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:49.484290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fabe3c-6267-4c90-bd52-88b502c63d40 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:49.484575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fabe3c-6267-4c90-bd52-88b502c63d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:49.484991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fabe3c-6267-4c90-bd52-88b502c63d40 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:49.485819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fabe3c-6267-4c90-bd52-88b502c63d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:49.488781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fabe3c-6267-4c90-bd52-88b502c63d40 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:49.522007 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2753/5509] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:15:49 2022] POST /identity/v3/users => generated 295 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:15:49.526314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fabe3c-6267-4c90-bd52-88b502c63d40 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:49.529957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c2fabe3c-6267-4c90-bd52-88b502c63d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:49.573787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fabe3c-6267-4c90-bd52-88b502c63d40 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:49.578489 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2757/5510] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:49.586121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27963bf-d190-4a21-b296-feeb501bbf97 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:49.586554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27963bf-d190-4a21-b296-feeb501bbf97 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:49.586875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27963bf-d190-4a21-b296-feeb501bbf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:49.589460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16a3d7-15ca-4204-a07a-b077e51d52ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:49.591176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a3d7-15ca-4204-a07a-b077e51d52ec admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:49.591620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a3d7-15ca-4204-a07a-b077e51d52ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:49.592053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a3d7-15ca-4204-a07a-b077e51d52ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:49.592862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16a3d7-15ca-4204-a07a-b077e51d52ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:49.597164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16a3d7-15ca-4204-a07a-b077e51d52ec admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:49.610303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:49.611652 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2754/5511] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:49.620597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d27963bf-d190-4a21-b296-feeb501bbf97 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:49.623422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d27963bf-d190-4a21-b296-feeb501bbf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:49.628030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16a3d7-15ca-4204-a07a-b077e51d52ec admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:49.641935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16a3d7-15ca-4204-a07a-b077e51d52ec admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:49.649858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf589f9-1f51-448b-bd8f-c0ffd14b13e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:49.652202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf589f9-1f51-448b-bd8f-c0ffd14b13e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:49.652670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf589f9-1f51-448b-bd8f-c0ffd14b13e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:49.653209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf589f9-1f51-448b-bd8f-c0ffd14b13e1 admin admin] PATH_INFO: `/v3/projects/25f727012e404cd9ac6e3a8df6671884/users/c84cb28cd63840f0b8c57adb7cf716c4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:49.659643 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2758/5512] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:49.661166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27963bf-d190-4a21-b296-feeb501bbf97 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:49.687395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27963bf-d190-4a21-b296-feeb501bbf97 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:49.690260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf589f9-1f51-448b-bd8f-c0ffd14b13e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f727012e404cd9ac6e3a8df6671884, user_id=c84cb28cd63840f0b8c57adb7cf716c4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:49.693392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf589f9-1f51-448b-bd8f-c0ffd14b13e1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:49.713946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3848b22-1491-4aa2-81c5-57a11f35cadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:49.714580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3848b22-1491-4aa2-81c5-57a11f35cadd admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:49.714892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3848b22-1491-4aa2-81c5-57a11f35cadd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:49.715169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3848b22-1491-4aa2-81c5-57a11f35cadd admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:49.715958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3848b22-1491-4aa2-81c5-57a11f35cadd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:15:49.716410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3848b22-1491-4aa2-81c5-57a11f35cadd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:49.718093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3848b22-1491-4aa2-81c5-57a11f35cadd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:49.731422 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2755/5513] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:15:49 2022] PUT /identity/v3/projects/25f727012e404cd9ac6e3a8df6671884/users/c84cb28cd63840f0b8c57adb7cf716c4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:49.735376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf589f9-1f51-448b-bd8f-c0ffd14b13e1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:49.748783 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2759/5514] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:15:49.749849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3848b22-1491-4aa2-81c5-57a11f35cadd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:49.799766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3848b22-1491-4aa2-81c5-57a11f35cadd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:49.821577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bea6f-b9cf-4434-b205-d6d2f44d49d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:49.822463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bea6f-b9cf-4434-b205-d6d2f44d49d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:49.823123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bea6f-b9cf-4434-b205-d6d2f44d49d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:49.823611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bea6f-b9cf-4434-b205-d6d2f44d49d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:49.824336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bea6f-b9cf-4434-b205-d6d2f44d49d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:49.825838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf589f9-1f51-448b-bd8f-c0ffd14b13e1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:49.826736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bea6f-b9cf-4434-b205-d6d2f44d49d5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:49.832687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b61b97-b57a-4000-bfb8-bdf58aa68850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:49.833726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b61b97-b57a-4000-bfb8-bdf58aa68850 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:49.834727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b61b97-b57a-4000-bfb8-bdf58aa68850 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:49.835289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b61b97-b57a-4000-bfb8-bdf58aa68850 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:49.836107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b61b97-b57a-4000-bfb8-bdf58aa68850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:49.837979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b61b97-b57a-4000-bfb8-bdf58aa68850 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:49.851064 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2756/5515] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:15:49.855435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b61b97-b57a-4000-bfb8-bdf58aa68850 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:49.873813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b61b97-b57a-4000-bfb8-bdf58aa68850 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:49.886369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31a8f-5fa0-42f5-ac84-34260c08397b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:49.890463 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2760/5516] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:15:49 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:49.890611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31a8f-5fa0-42f5-ac84-34260c08397b admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:49.890611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31a8f-5fa0-42f5-ac84-34260c08397b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:49.890611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31a8f-5fa0-42f5-ac84-34260c08397b admin admin] PATH_INFO: `/v3/projects/25f727012e404cd9ac6e3a8df6671884/users/c84cb28cd63840f0b8c57adb7cf716c4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:49.891373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bea6f-b9cf-4434-b205-d6d2f44d49d5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:49.894222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d31a8f-5fa0-42f5-ac84-34260c08397b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f727012e404cd9ac6e3a8df6671884, user_id=c84cb28cd63840f0b8c57adb7cf716c4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:49.898379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d31a8f-5fa0-42f5-ac84-34260c08397b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:49.921557 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2757/5517] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:15:49 2022] PUT /identity/v3/projects/25f727012e404cd9ac6e3a8df6671884/users/c84cb28cd63840f0b8c57adb7cf716c4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:15:50.000889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bea6f-b9cf-4434-b205-d6d2f44d49d5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:50.055283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fc2fd-1ede-45f6-b746-ffadb4578990 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:50.055576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fc2fd-1ede-45f6-b746-ffadb4578990 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:50.055859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fc2fd-1ede-45f6-b746-ffadb4578990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:50.084548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1269cb8-902e-4ed2-aa9d-f07381ce23b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:50.086159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1269cb8-902e-4ed2-aa9d-f07381ce23b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:50.086449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1269cb8-902e-4ed2-aa9d-f07381ce23b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:50.086723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1269cb8-902e-4ed2-aa9d-f07381ce23b0 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:50.087407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1269cb8-902e-4ed2-aa9d-f07381ce23b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:50.089528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1269cb8-902e-4ed2-aa9d-f07381ce23b0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:50.128908 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2761/5518] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:15:49 2022] POST /identity/v3/users => generated 284 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:50.133310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1269cb8-902e-4ed2-aa9d-f07381ce23b0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:50.140957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c39fc2fd-1ede-45f6-b746-ffadb4578990 None None] MFA Rules not processed for user `c84cb28cd63840f0b8c57adb7cf716c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:50.142351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c39fc2fd-1ede-45f6-b746-ffadb4578990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:50.156693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1269cb8-902e-4ed2-aa9d-f07381ce23b0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:50.166634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:50.170975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c7fa7-843e-43c6-8e16-0205c5fbf32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:50.172917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c7fa7-843e-43c6-8e16-0205c5fbf32d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:50.173451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c7fa7-843e-43c6-8e16-0205c5fbf32d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:50.175617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c7fa7-843e-43c6-8e16-0205c5fbf32d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:50.176373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c7fa7-843e-43c6-8e16-0205c5fbf32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:50.179129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c7fa7-843e-43c6-8e16-0205c5fbf32d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:50.198487 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2762/5519] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:15:50.202317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c7fa7-843e-43c6-8e16-0205c5fbf32d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:50.242506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c7fa7-843e-43c6-8e16-0205c5fbf32d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:50.257635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8de0b0-3c76-4d95-b3e7-5c45c687ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:50.258374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8de0b0-3c76-4d95-b3e7-5c45c687ff65 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:50.261159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8de0b0-3c76-4d95-b3e7-5c45c687ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:50.261623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8de0b0-3c76-4d95-b3e7-5c45c687ff65 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:50.262547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8de0b0-3c76-4d95-b3e7-5c45c687ff65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:50.264407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8de0b0-3c76-4d95-b3e7-5c45c687ff65 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:50.293045 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2763/5520] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:50.298291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8de0b0-3c76-4d95-b3e7-5c45c687ff65 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:50.323119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8de0b0-3c76-4d95-b3e7-5c45c687ff65 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:50.332086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2564f-faac-4e41-9017-cd1bd78f7e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:50.333099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2564f-faac-4e41-9017-cd1bd78f7e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:50.334686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2564f-faac-4e41-9017-cd1bd78f7e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:50.335184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2564f-faac-4e41-9017-cd1bd78f7e3e admin admin] PATH_INFO: `/v3/projects/e44393365ce0427796f74199a44c07f2/users/7de9b31956c24aca8fb0293cfab8e3e9/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:50.339397 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2758/5521] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:50.352405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fc2fd-1ede-45f6-b746-ffadb4578990 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:50.355490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c39fc2fd-1ede-45f6-b746-ffadb4578990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:50.363765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2564f-faac-4e41-9017-cd1bd78f7e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44393365ce0427796f74199a44c07f2, user_id=7de9b31956c24aca8fb0293cfab8e3e9, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:50.368007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2564f-faac-4e41-9017-cd1bd78f7e3e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:50.388568 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2764/5522] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:15:50 2022] PUT /identity/v3/projects/e44393365ce0427796f74199a44c07f2/users/7de9b31956c24aca8fb0293cfab8e3e9/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:50.400443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f73125-adef-4c99-a416-9d7ff356a832 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:50.400713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f73125-adef-4c99-a416-9d7ff356a832 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:50.401446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f73125-adef-4c99-a416-9d7ff356a832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:50.465859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-97f73125-adef-4c99-a416-9d7ff356a832 None None] MFA Rules not processed for user `7de9b31956c24aca8fb0293cfab8e3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:50.467226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-97f73125-adef-4c99-a416-9d7ff356a832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:50.479181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:50.532505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fc2fd-1ede-45f6-b746-ffadb4578990 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:50.622941 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2765/5523] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:50.644024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce249a-13a2-43b3-8834-27ea7ee181da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:50.644916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce249a-13a2-43b3-8834-27ea7ee181da service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:50.645409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce249a-13a2-43b3-8834-27ea7ee181da service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:50.645894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce249a-13a2-43b3-8834-27ea7ee181da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:50.737949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637831e-b40e-4fc5-a0bf-a005627b0e46 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:50.738378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637831e-b40e-4fc5-a0bf-a005627b0e46 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:50.742867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637831e-b40e-4fc5-a0bf-a005627b0e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:50.780339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7637831e-b40e-4fc5-a0bf-a005627b0e46 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:50.783635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7637831e-b40e-4fc5-a0bf-a005627b0e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:50.788558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce249a-13a2-43b3-8834-27ea7ee181da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:50.790891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce249a-13a2-43b3-8834-27ea7ee181da service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:50.824679 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2759/5524] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:15:50.884534 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2766/5525] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:15:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:50.904832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce249a-13a2-43b3-8834-27ea7ee181da service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:50.906950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-54ce249a-13a2-43b3-8834-27ea7ee181da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:50.934307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:50.953810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637831e-b40e-4fc5-a0bf-a005627b0e46 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:50.976372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637831e-b40e-4fc5-a0bf-a005627b0e46 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:50.992415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f264b16-b768-4479-ae85-5c79594f71e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:50.993059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264b16-b768-4479-ae85-5c79594f71e5 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:50.993362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264b16-b768-4479-ae85-5c79594f71e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:50.993645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264b16-b768-4479-ae85-5c79594f71e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:51.013709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f264b16-b768-4479-ae85-5c79594f71e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:51.016757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f264b16-b768-4479-ae85-5c79594f71e5 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:51.046731 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2767/5526] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:51.061333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce249a-13a2-43b3-8834-27ea7ee181da service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:51.068884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0292d-05b3-4926-9f48-e7193108f490 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:51.069772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0292d-05b3-4926-9f48-e7193108f490 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:51.070335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0292d-05b3-4926-9f48-e7193108f490 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:51.070807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0292d-05b3-4926-9f48-e7193108f490 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:51.085599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0292d-05b3-4926-9f48-e7193108f490 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:51.087565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0292d-05b3-4926-9f48-e7193108f490 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:51.106642 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2760/5527] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:15:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:15:52.125179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded0e7a-4841-4456-b0d9-8d53f2a7f3ba None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:52.125179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded0e7a-4841-4456-b0d9-8d53f2a7f3ba None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:52.125691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded0e7a-4841-4456-b0d9-8d53f2a7f3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:52.174397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3ded0e7a-4841-4456-b0d9-8d53f2a7f3ba None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:52.175784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ded0e7a-4841-4456-b0d9-8d53f2a7f3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:52.193082 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2768/5528] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:15:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:52.207655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0292d-05b3-4926-9f48-e7193108f490 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:52.222579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0292d-05b3-4926-9f48-e7193108f490 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:52.234619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a6acc-78d6-406e-8524-de45c0e9ee2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:52.235821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a6acc-78d6-406e-8524-de45c0e9ee2c service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:52.236463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a6acc-78d6-406e-8524-de45c0e9ee2c service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:52.237069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a6acc-78d6-406e-8524-de45c0e9ee2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:52.257612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a6acc-78d6-406e-8524-de45c0e9ee2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:52.260956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a6acc-78d6-406e-8524-de45c0e9ee2c service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:52.291973 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2761/5529] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:15:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:15:52.322698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded0e7a-4841-4456-b0d9-8d53f2a7f3ba None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:52.343409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded0e7a-4841-4456-b0d9-8d53f2a7f3ba None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:52.356340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc4d67-f4df-421f-a27c-c0aa3a4dc87c tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb28cd63840f0b8c57adb7cf716c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25f727012e404cd9ac6e3a8df6671884', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:52.361581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc4d67-f4df-421f-a27c-c0aa3a4dc87c tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:52.362028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc4d67-f4df-421f-a27c-c0aa3a4dc87c tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:52.362767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc4d67-f4df-421f-a27c-c0aa3a4dc87c tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:52.363905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc4d67-f4df-421f-a27c-c0aa3a4dc87c tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:15:52.364381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc4d67-f4df-421f-a27c-c0aa3a4dc87c tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:52.366736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc4d67-f4df-421f-a27c-c0aa3a4dc87c tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:52.401206 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2769/5530] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:15:52.402565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a6acc-78d6-406e-8524-de45c0e9ee2c service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:52.418626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a6acc-78d6-406e-8524-de45c0e9ee2c service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:52.432567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bcbe5-e5e7-47dc-947c-0c64897cb1a4 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb28cd63840f0b8c57adb7cf716c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25f727012e404cd9ac6e3a8df6671884', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:52.433317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bcbe5-e5e7-47dc-947c-0c64897cb1a4 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:52.433478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bcbe5-e5e7-47dc-947c-0c64897cb1a4 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:52.433758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bcbe5-e5e7-47dc-947c-0c64897cb1a4 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:52.434405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bcbe5-e5e7-47dc-947c-0c64897cb1a4 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:52.436386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bcbe5-e5e7-47dc-947c-0c64897cb1a4 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:52.505817 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2762/5531] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:15:52 2022] POST /identity/v3/projects => generated 354 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:52.509923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc4d67-f4df-421f-a27c-c0aa3a4dc87c tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:52.527216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc4d67-f4df-421f-a27c-c0aa3a4dc87c tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:52.680440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fce54-45e1-4d83-bbea-d77d2df66656 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb28cd63840f0b8c57adb7cf716c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25f727012e404cd9ac6e3a8df6671884', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:52.681083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fce54-45e1-4d83-bbea-d77d2df66656 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:52.681369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fce54-45e1-4d83-bbea-d77d2df66656 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:52.681644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fce54-45e1-4d83-bbea-d77d2df66656 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:52.682558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fce54-45e1-4d83-bbea-d77d2df66656 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:15:52.682948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fce54-45e1-4d83-bbea-d77d2df66656 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:52.684705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31fce54-45e1-4d83-bbea-d77d2df66656 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:52.738923 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2770/5532] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:15:52.804329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bcbe5-e5e7-47dc-947c-0c64897cb1a4 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:52.825055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bcbe5-e5e7-47dc-947c-0c64897cb1a4 tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:52.846315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c84cb28cd63840f0b8c57adb7cf716c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25f727012e404cd9ac6e3a8df6671884', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:52.848034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:52.850021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:52.851472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] PATH_INFO: `/v3/projects/b0596cc595b6471c86a3be8ccc5086db` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:52.856877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b0596cc595b6471c86a3be8ccc5086db)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:52.862676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:52.986003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0596cc595b6471c86a3be8ccc5086db', 'request_id': 'req-82cccefe-e4b7-47bf-97f8-eadd7813308a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:53.003133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0596cc595b6471c86a3be8ccc5086db', 'request_id': 'req-82cccefe-e4b7-47bf-97f8-eadd7813308a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:53.015158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0596cc595b6471c86a3be8ccc5086db', 'request_id': 'req-82cccefe-e4b7-47bf-97f8-eadd7813308a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:53.052674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] The token cache is being invalidate because project b0596cc595b6471c86a3be8ccc5086db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:15:53.053456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:53.054702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:53.059976 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2763/5533] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:15:52 2022] DELETE /identity/v3/projects/b0596cc595b6471c86a3be8ccc5086db => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:53.106900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a31ae-dc0c-4847-be36-27a4e955792e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:53.107631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a31ae-dc0c-4847-be36-27a4e955792e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:53.108065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a31ae-dc0c-4847-be36-27a4e955792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:53.133362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-840a31ae-dc0c-4847-be36-27a4e955792e None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:53.135933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-840a31ae-dc0c-4847-be36-27a4e955792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:53.154367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:53.321300 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2771/5534] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:15:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:53.322923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:53.326139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:53.520789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:53.554882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cccefe-e4b7-47bf-97f8-eadd7813308a tempest-VolumeQuotaClassesTest-63542066 tempest-VolumeQuotaClassesTest-63542066-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:53.573379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bdb51-d03f-48fb-9106-c3062faa4b11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:53.574362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bdb51-d03f-48fb-9106-c3062faa4b11 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:53.584517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bdb51-d03f-48fb-9106-c3062faa4b11 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:53.585903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bdb51-d03f-48fb-9106-c3062faa4b11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:53.597092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bdb51-d03f-48fb-9106-c3062faa4b11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:53.598793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bdb51-d03f-48fb-9106-c3062faa4b11 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:53.622853 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2764/5535] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:15:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:15:53.638129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a31ae-dc0c-4847-be36-27a4e955792e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:53.640020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-840a31ae-dc0c-4847-be36-27a4e955792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:53.773243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a31ae-dc0c-4847-be36-27a4e955792e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:53.781963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:53.782971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:53.783371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:53.783960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] PATH_INFO: `/v3/users/41c03d8e91214778bcc8eb8945b325b6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:53.786515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c03d8e91214778bcc8eb8945b325b6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:53.790502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:53.885116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c03d8e91214778bcc8eb8945b325b6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:53.895247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c03d8e91214778bcc8eb8945b325b6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:53.897284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c03d8e91214778bcc8eb8945b325b6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:53.921421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c03d8e91214778bcc8eb8945b325b6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:53.922100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c03d8e91214778bcc8eb8945b325b6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:53.991967 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2772/5536] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:15:53 2022] DELETE /identity/v3/users/41c03d8e91214778bcc8eb8945b325b6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:53.996905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65cc77-2916-421a-9414-a29bfa453ac9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:53.997235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65cc77-2916-421a-9414-a29bfa453ac9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:53.997520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65cc77-2916-421a-9414-a29bfa453ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:54.033748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9a65cc77-2916-421a-9414-a29bfa453ac9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:54.035459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9a65cc77-2916-421a-9414-a29bfa453ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:54.177860 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2765/5537] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:54.188334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:54.191717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:54.267758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:54.307794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb3c2d-0a60-40d3-86ad-4f52d5dfbaee admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:54.313735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befaa3c-52fe-4930-bf27-1ca82cc1b32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:54.315679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befaa3c-52fe-4930-bf27-1ca82cc1b32e service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:54.316005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befaa3c-52fe-4930-bf27-1ca82cc1b32e service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:54.316242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befaa3c-52fe-4930-bf27-1ca82cc1b32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:54.330259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befaa3c-52fe-4930-bf27-1ca82cc1b32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:54.332008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befaa3c-52fe-4930-bf27-1ca82cc1b32e service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:54.351084 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2773/5538] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:15:55.528279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65cc77-2916-421a-9414-a29bfa453ac9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:55.529753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9a65cc77-2916-421a-9414-a29bfa453ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:55.552262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65cc77-2916-421a-9414-a29bfa453ac9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:55.587386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:55.588552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:55.589161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:55.589676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] PATH_INFO: `/v3/projects/9645a65061764fd2bee1144155101111` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:55.592059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9645a65061764fd2bee1144155101111)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:55.597643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:55.668317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9645a65061764fd2bee1144155101111', 'request_id': 'req-ec169dc4-ff00-4e08-a172-f68419709ae6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:55.683352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9645a65061764fd2bee1144155101111', 'request_id': 'req-ec169dc4-ff00-4e08-a172-f68419709ae6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:55.692741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9645a65061764fd2bee1144155101111', 'request_id': 'req-ec169dc4-ff00-4e08-a172-f68419709ae6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:55.717249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] The token cache is being invalidate because project 9645a65061764fd2bee1144155101111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:15:55.717796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:55.718594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:55.723831 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2766/5539] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:15:55 2022] DELETE /identity/v3/projects/9645a65061764fd2bee1144155101111 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:55.725628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befaa3c-52fe-4930-bf27-1ca82cc1b32e service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:55.737420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befaa3c-52fe-4930-bf27-1ca82cc1b32e service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:55.910009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433c089-c6b3-4064-a880-32c9e9918a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:55.912741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433c089-c6b3-4064-a880-32c9e9918a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:55.913605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433c089-c6b3-4064-a880-32c9e9918a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:55.914136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433c089-c6b3-4064-a880-32c9e9918a4a admin admin] PATH_INFO: `/v3/users/c84cb28cd63840f0b8c57adb7cf716c4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:55.915864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433c089-c6b3-4064-a880-32c9e9918a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84cb28cd63840f0b8c57adb7cf716c4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:55.930869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433c089-c6b3-4064-a880-32c9e9918a4a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:56.026211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3433c089-c6b3-4064-a880-32c9e9918a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84cb28cd63840f0b8c57adb7cf716c4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:56.037123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3433c089-c6b3-4064-a880-32c9e9918a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84cb28cd63840f0b8c57adb7cf716c4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:56.040761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3433c089-c6b3-4064-a880-32c9e9918a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84cb28cd63840f0b8c57adb7cf716c4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:56.054373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3433c089-c6b3-4064-a880-32c9e9918a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84cb28cd63840f0b8c57adb7cf716c4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:56.056185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3433c089-c6b3-4064-a880-32c9e9918a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84cb28cd63840f0b8c57adb7cf716c4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:56.094863 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2774/5540] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:15:55 2022] DELETE /identity/v3/users/c84cb28cd63840f0b8c57adb7cf716c4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:56.515345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:56.516810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:56.533349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec169dc4-ff00-4e08-a172-f68419709ae6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:56.697794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274930a-3075-4fb4-a46f-76e56fb70dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:56.698585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274930a-3075-4fb4-a46f-76e56fb70dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:56.698911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274930a-3075-4fb4-a46f-76e56fb70dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:56.699367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274930a-3075-4fb4-a46f-76e56fb70dd4 admin admin] PATH_INFO: `/v3/projects/25f727012e404cd9ac6e3a8df6671884` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:56.700535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274930a-3075-4fb4-a46f-76e56fb70dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f727012e404cd9ac6e3a8df6671884)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:56.703274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274930a-3075-4fb4-a46f-76e56fb70dd4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:56.714784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:56.794063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5274930a-3075-4fb4-a46f-76e56fb70dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f727012e404cd9ac6e3a8df6671884', 'request_id': 'req-5274930a-3075-4fb4-a46f-76e56fb70dd4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:56.808322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5274930a-3075-4fb4-a46f-76e56fb70dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f727012e404cd9ac6e3a8df6671884', 'request_id': 'req-5274930a-3075-4fb4-a46f-76e56fb70dd4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:56.827184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5274930a-3075-4fb4-a46f-76e56fb70dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f727012e404cd9ac6e3a8df6671884', 'request_id': 'req-5274930a-3075-4fb4-a46f-76e56fb70dd4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:56.843621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5274930a-3075-4fb4-a46f-76e56fb70dd4 admin admin] The token cache is being invalidate because project 25f727012e404cd9ac6e3a8df6671884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:15:56.844071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5274930a-3075-4fb4-a46f-76e56fb70dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:56.844942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5274930a-3075-4fb4-a46f-76e56fb70dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:15:56.847948 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2767/5541] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:15:56 2022] DELETE /identity/v3/projects/25f727012e404cd9ac6e3a8df6671884 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:56.852933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fb98a-b71e-4b55-9c43-8799207143f9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:56.853842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fb98a-b71e-4b55-9c43-8799207143f9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:56.854270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fb98a-b71e-4b55-9c43-8799207143f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:56.891850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-368fb98a-b71e-4b55-9c43-8799207143f9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:56.893857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-368fb98a-b71e-4b55-9c43-8799207143f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:57.033994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:57.054773 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2775/5542] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:15:57.062305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf340de-16e1-40f9-a706-4e02975419ee None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:57.062595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf340de-16e1-40f9-a706-4e02975419ee None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:57.062902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf340de-16e1-40f9-a706-4e02975419ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:57.092013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fcf340de-16e1-40f9-a706-4e02975419ee None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:57.093273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fcf340de-16e1-40f9-a706-4e02975419ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:57.106728 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2768/5543] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:57.107969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fb98a-b71e-4b55-9c43-8799207143f9 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:57.119774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fb98a-b71e-4b55-9c43-8799207143f9 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:57.135735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00de68-9308-48fb-9ec4-d81a54106456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:57.136370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00de68-9308-48fb-9ec4-d81a54106456 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:57.136831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00de68-9308-48fb-9ec4-d81a54106456 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:57.137264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00de68-9308-48fb-9ec4-d81a54106456 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:57.138196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00de68-9308-48fb-9ec4-d81a54106456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:15:57.138660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00de68-9308-48fb-9ec4-d81a54106456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:57.140450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00de68-9308-48fb-9ec4-d81a54106456 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:57.171001 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2776/5544] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:15:57.175128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf340de-16e1-40f9-a706-4e02975419ee None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:57.187886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf340de-16e1-40f9-a706-4e02975419ee None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:57.199374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeb564-c911-4eae-bdab-881abe563298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:57.200756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeb564-c911-4eae-bdab-881abe563298 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:57.201038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeb564-c911-4eae-bdab-881abe563298 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:57.201312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeb564-c911-4eae-bdab-881abe563298 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:57.202022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adeb564-c911-4eae-bdab-881abe563298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:57.205914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adeb564-c911-4eae-bdab-881abe563298 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:57.288514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00de68-9308-48fb-9ec4-d81a54106456 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:57.288779 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2769/5545] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:15:57 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:15:57.301563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00de68-9308-48fb-9ec4-d81a54106456 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:57.487629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab9205-1105-4a88-a12b-07ed730fbf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:57.488276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab9205-1105-4a88-a12b-07ed730fbf4b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:57.488564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab9205-1105-4a88-a12b-07ed730fbf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:57.488838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab9205-1105-4a88-a12b-07ed730fbf4b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:57.489599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab9205-1105-4a88-a12b-07ed730fbf4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:57.491695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab9205-1105-4a88-a12b-07ed730fbf4b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:57.551472 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2777/5546] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:15:57 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:15:57.556011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeb564-c911-4eae-bdab-881abe563298 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:57.588837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeb564-c911-4eae-bdab-881abe563298 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:57.625037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95738d-b4ed-4572-9010-d247bfd110dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:57.627578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95738d-b4ed-4572-9010-d247bfd110dc admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:57.631198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95738d-b4ed-4572-9010-d247bfd110dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:57.631528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95738d-b4ed-4572-9010-d247bfd110dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:57.632225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95738d-b4ed-4572-9010-d247bfd110dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:57.642438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95738d-b4ed-4572-9010-d247bfd110dc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:57.715918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab9205-1105-4a88-a12b-07ed730fbf4b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:57.718015 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2770/5547] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:57.743302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab9205-1105-4a88-a12b-07ed730fbf4b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:57.787713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d599f-f07f-46dc-922e-ee4722f12131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:57.788344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d599f-f07f-46dc-922e-ee4722f12131 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:57.788631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d599f-f07f-46dc-922e-ee4722f12131 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:57.788908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d599f-f07f-46dc-922e-ee4722f12131 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:57.789572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d599f-f07f-46dc-922e-ee4722f12131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:57.791224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d599f-f07f-46dc-922e-ee4722f12131 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:57.870132 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2778/5548] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:15:57.871440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95738d-b4ed-4572-9010-d247bfd110dc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:57.891257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95738d-b4ed-4572-9010-d247bfd110dc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:57.911230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e57120-e0f0-4362-81a3-6e3c1519bdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:57.914224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e57120-e0f0-4362-81a3-6e3c1519bdbd admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:57.914607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e57120-e0f0-4362-81a3-6e3c1519bdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:57.915983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e57120-e0f0-4362-81a3-6e3c1519bdbd admin admin] PATH_INFO: `/v3/projects/acdfe65dc14b41efb5c7f829bf99984b/users/8c7f681a36ea4d649e28afc3830753ec/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:58.000137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e57120-e0f0-4362-81a3-6e3c1519bdbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdfe65dc14b41efb5c7f829bf99984b, user_id=8c7f681a36ea4d649e28afc3830753ec, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:58.007589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e57120-e0f0-4362-81a3-6e3c1519bdbd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:58.046182 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2771/5549] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:15:57 2022] PUT /identity/v3/projects/acdfe65dc14b41efb5c7f829bf99984b/users/8c7f681a36ea4d649e28afc3830753ec/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:15:58.059452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b22c-5ddd-4397-b548-9e9f5bef58f2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:58.059666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b22c-5ddd-4397-b548-9e9f5bef58f2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:58.059938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5b22c-5ddd-4397-b548-9e9f5bef58f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:58.162388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-46c5b22c-5ddd-4397-b548-9e9f5bef58f2 None None] MFA Rules not processed for user `8c7f681a36ea4d649e28afc3830753ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:58.164689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-46c5b22c-5ddd-4397-b548-9e9f5bef58f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:58.331464 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2779/5550] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:58.332063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e57120-e0f0-4362-81a3-6e3c1519bdbd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:15:58.335701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f5e57120-e0f0-4362-81a3-6e3c1519bdbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:58.431108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166b347-9cd0-4dc9-921e-e3ab43ce38a5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:58.431108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166b347-9cd0-4dc9-921e-e3ab43ce38a5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:58.431108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166b347-9cd0-4dc9-921e-e3ab43ce38a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:58.480579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4166b347-9cd0-4dc9-921e-e3ab43ce38a5 None None] MFA Rules not processed for user `c5265d83d5ae4494b59597802d052593`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:15:58.484219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4166b347-9cd0-4dc9-921e-e3ab43ce38a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:15:58.577650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e57120-e0f0-4362-81a3-6e3c1519bdbd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:15:58.588473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3ca42-c8bd-4123-8a8e-4e6717a478db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:15:58.589200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3ca42-c8bd-4123-8a8e-4e6717a478db service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:15:58.589830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3ca42-c8bd-4123-8a8e-4e6717a478db service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:15:58.590183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3ca42-c8bd-4123-8a8e-4e6717a478db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:15:58.594180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:15:58.612680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3ca42-c8bd-4123-8a8e-4e6717a478db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:15:58.614656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3ca42-c8bd-4123-8a8e-4e6717a478db service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:15:58.625789 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2780/5551] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:15:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:15:58.657546 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2772/5552] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:15:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:06.456026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715e481-7e34-4988-bf4e-d5dd8ae656cb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:06.456861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715e481-7e34-4988-bf4e-d5dd8ae656cb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:06.457317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715e481-7e34-4988-bf4e-d5dd8ae656cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:06.507476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8715e481-7e34-4988-bf4e-d5dd8ae656cb None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:06.508983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8715e481-7e34-4988-bf4e-d5dd8ae656cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:06.721157 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2781/5553] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:16:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:06.766010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3ca42-c8bd-4123-8a8e-4e6717a478db service glance] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:06.767791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fdf3ca42-c8bd-4123-8a8e-4e6717a478db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:06.947307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:07.082416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3ca42-c8bd-4123-8a8e-4e6717a478db service glance] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:07.106204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99c025-2c6a-4a25-8d9b-55adb3cfed84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:07.108400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99c025-2c6a-4a25-8d9b-55adb3cfed84 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:07.118476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99c025-2c6a-4a25-8d9b-55adb3cfed84 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:07.119008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99c025-2c6a-4a25-8d9b-55adb3cfed84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:07.150843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99c025-2c6a-4a25-8d9b-55adb3cfed84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:07.153278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99c025-2c6a-4a25-8d9b-55adb3cfed84 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:07.187817 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2773/5554] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:16:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:16:07.751262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4c6f-8119-4a32-9cef-77d959d6a2b6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:07.751782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4c6f-8119-4a32-9cef-77d959d6a2b6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:07.752101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4c6f-8119-4a32-9cef-77d959d6a2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:07.803878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3b2d4c6f-8119-4a32-9cef-77d959d6a2b6 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:07.805126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3b2d4c6f-8119-4a32-9cef-77d959d6a2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:07.829715 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2782/5555] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:16:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:16:07.846967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99c025-2c6a-4a25-8d9b-55adb3cfed84 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:07.876926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99c025-2c6a-4a25-8d9b-55adb3cfed84 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:07.898755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ad239-e4ad-4ac4-8e87-42ca2bacf19c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:07.899419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ad239-e4ad-4ac4-8e87-42ca2bacf19c service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:07.899731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ad239-e4ad-4ac4-8e87-42ca2bacf19c service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:07.900036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ad239-e4ad-4ac4-8e87-42ca2bacf19c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:07.951730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ad239-e4ad-4ac4-8e87-42ca2bacf19c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:07.954024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ad239-e4ad-4ac4-8e87-42ca2bacf19c service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:08.004752 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2774/5556] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:16:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:16:08.485369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa91da-22ad-4498-aa3a-495ecc79d617 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:08.485369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa91da-22ad-4498-aa3a-495ecc79d617 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:08.485369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa91da-22ad-4498-aa3a-495ecc79d617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:08.525246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c9aa91da-22ad-4498-aa3a-495ecc79d617 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:08.526577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c9aa91da-22ad-4498-aa3a-495ecc79d617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:08.575901 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2783/5557] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:16:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:08.613164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ad239-e4ad-4ac4-8e87-42ca2bacf19c service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:08.633155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ad239-e4ad-4ac4-8e87-42ca2bacf19c service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:08.679719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280bab6-6693-42ac-81b1-ff9bc0b7f944 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:08.683221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280bab6-6693-42ac-81b1-ff9bc0b7f944 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:08.685593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280bab6-6693-42ac-81b1-ff9bc0b7f944 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:08.685929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280bab6-6693-42ac-81b1-ff9bc0b7f944 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:08.740913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280bab6-6693-42ac-81b1-ff9bc0b7f944 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:08.742666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280bab6-6693-42ac-81b1-ff9bc0b7f944 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:08.806694 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2775/5558] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:16:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:16:09.040942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa91da-22ad-4498-aa3a-495ecc79d617 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:09.043041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c9aa91da-22ad-4498-aa3a-495ecc79d617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:09.272305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa91da-22ad-4498-aa3a-495ecc79d617 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:09.280695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:09.281467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:09.281815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:09.282194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] PATH_INFO: `/v3/users/46ef6462029e4cabb094ea2baad1d807` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:09.283417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ef6462029e4cabb094ea2baad1d807)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:09.285610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:09.407725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ef6462029e4cabb094ea2baad1d807'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:09.444573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ef6462029e4cabb094ea2baad1d807'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:09.445705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ef6462029e4cabb094ea2baad1d807'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:09.468357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ef6462029e4cabb094ea2baad1d807'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:09.469815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ef6462029e4cabb094ea2baad1d807'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:09.564798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d0962-ccfa-433b-8206-82debd975799 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:09.565321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d0962-ccfa-433b-8206-82debd975799 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:09.566113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d0962-ccfa-433b-8206-82debd975799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:09.597460 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2784/5559] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:09 2022] DELETE /identity/v3/users/46ef6462029e4cabb094ea2baad1d807 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:09.642799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6c2d0962-ccfa-433b-8206-82debd975799 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:09.644251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6c2d0962-ccfa-433b-8206-82debd975799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:09.774585 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2776/5560] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:09.785356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:09.787440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:09.808095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:09.906013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2a46-91ce-4c98-9673-dcbf892db137 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:09.911097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900e42-6e32-404b-b643-f832135ba4ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:09.913200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900e42-6e32-404b-b643-f832135ba4ef service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:09.913601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900e42-6e32-404b-b643-f832135ba4ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:09.914006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900e42-6e32-404b-b643-f832135ba4ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:09.933042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1900e42-6e32-404b-b643-f832135ba4ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:09.934963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1900e42-6e32-404b-b643-f832135ba4ef service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:09.947133 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2785/5561] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:10.605990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d0962-ccfa-433b-8206-82debd975799 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:10.607494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6c2d0962-ccfa-433b-8206-82debd975799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:10.644325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d0962-ccfa-433b-8206-82debd975799 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:10.681258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:10.682292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:10.682804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:10.683272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e admin admin] PATH_INFO: `/v3/projects/bdd17dc288744a029f17dc0f2b6d32b9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:10.690798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd17dc288744a029f17dc0f2b6d32b9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:10.693225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:10.818970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd17dc288744a029f17dc0f2b6d32b9', 'request_id': 'req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:10.828342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fdb46-3fb3-44f6-abab-1bee2a8626b4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:10.829408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fdb46-3fb3-44f6-abab-1bee2a8626b4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:10.829831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fdb46-3fb3-44f6-abab-1bee2a8626b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:10.835973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd17dc288744a029f17dc0f2b6d32b9', 'request_id': 'req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:10.842370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd17dc288744a029f17dc0f2b6d32b9', 'request_id': 'req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:10.866214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e admin admin] The token cache is being invalidate because project bdd17dc288744a029f17dc0f2b6d32b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:10.866514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:10.871207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f22370fe-86d2-4a15-8f1d-8ca47fc5212e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:10.872836 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2777/5562] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:10 2022] DELETE /identity/v3/projects/bdd17dc288744a029f17dc0f2b6d32b9 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:10.873353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8d1fdb46-3fb3-44f6-abab-1bee2a8626b4 None None] MFA Rules not processed for user `c67fb1d8b53148a89cfdff2a5a4395f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:10.876347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8d1fdb46-3fb3-44f6-abab-1bee2a8626b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:10.877965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941fa5-2448-4199-ac73-ea43c6ee64b0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:10.878260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941fa5-2448-4199-ac73-ea43c6ee64b0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:10.878598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941fa5-2448-4199-ac73-ea43c6ee64b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:10.914994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ec941fa5-2448-4199-ac73-ea43c6ee64b0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:10.916499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ec941fa5-2448-4199-ac73-ea43c6ee64b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:10.930499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:11.038795 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2786/5563] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:11.050632 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2778/5564] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:16:11.059347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8421c-bfec-48a2-bbbb-080a9e940a01 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:11.062292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8421c-bfec-48a2-bbbb-080a9e940a01 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:11.062791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8421c-bfec-48a2-bbbb-080a9e940a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:11.116447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2ca8421c-bfec-48a2-bbbb-080a9e940a01 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:11.117735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2ca8421c-bfec-48a2-bbbb-080a9e940a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:11.126962 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2787/5565] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:11.131742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec941fa5-2448-4199-ac73-ea43c6ee64b0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:11.154906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec941fa5-2448-4199-ac73-ea43c6ee64b0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:11.173845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376c052-18d1-44f6-a9f0-b1509cb4200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:11.174485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376c052-18d1-44f6-a9f0-b1509cb4200f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:11.174792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376c052-18d1-44f6-a9f0-b1509cb4200f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:11.175075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376c052-18d1-44f6-a9f0-b1509cb4200f admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:11.175737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376c052-18d1-44f6-a9f0-b1509cb4200f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:11.176057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376c052-18d1-44f6-a9f0-b1509cb4200f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:11.178190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376c052-18d1-44f6-a9f0-b1509cb4200f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:11.207123 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2779/5566] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:11.212044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8421c-bfec-48a2-bbbb-080a9e940a01 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:11.227058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8421c-bfec-48a2-bbbb-080a9e940a01 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:11.237703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd418-f9fe-452c-a82d-5a2529cb57e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:11.240266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd418-f9fe-452c-a82d-5a2529cb57e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:11.242185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd418-f9fe-452c-a82d-5a2529cb57e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:11.244241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd418-f9fe-452c-a82d-5a2529cb57e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:11.246253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edd418-f9fe-452c-a82d-5a2529cb57e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:11.257478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edd418-f9fe-452c-a82d-5a2529cb57e2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:11.336960 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2788/5567] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:11 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:11.341328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376c052-18d1-44f6-a9f0-b1509cb4200f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:11.355676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376c052-18d1-44f6-a9f0-b1509cb4200f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:11.455195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8c19b-7617-4077-ae82-92ea3c194de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:11.456164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8c19b-7617-4077-ae82-92ea3c194de7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:11.456699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8c19b-7617-4077-ae82-92ea3c194de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:11.457190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8c19b-7617-4077-ae82-92ea3c194de7 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:11.458733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8c19b-7617-4077-ae82-92ea3c194de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:11.461305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8c19b-7617-4077-ae82-92ea3c194de7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:11.522168 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2780/5568] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:11 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:11.525621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd418-f9fe-452c-a82d-5a2529cb57e2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:11.528588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8c19b-7617-4077-ae82-92ea3c194de7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:11.538170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d5a8c19b-7617-4077-ae82-92ea3c194de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:11.540121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd418-f9fe-452c-a82d-5a2529cb57e2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:11.553327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf0e93-753a-4821-a8ea-b6a40f6a8501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:11.555873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf0e93-753a-4821-a8ea-b6a40f6a8501 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:11.556247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf0e93-753a-4821-a8ea-b6a40f6a8501 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:11.556715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf0e93-753a-4821-a8ea-b6a40f6a8501 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:11.557472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf0e93-753a-4821-a8ea-b6a40f6a8501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:11.566206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf0e93-753a-4821-a8ea-b6a40f6a8501 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:11.637614 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2789/5569] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:11.638981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf0e93-753a-4821-a8ea-b6a40f6a8501 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:11.670731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf0e93-753a-4821-a8ea-b6a40f6a8501 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:11.689017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d13eca-cb9a-45a5-8edd-a99b4a3f09a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:11.689836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13eca-cb9a-45a5-8edd-a99b4a3f09a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:11.690704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13eca-cb9a-45a5-8edd-a99b4a3f09a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:11.692273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13eca-cb9a-45a5-8edd-a99b4a3f09a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:11.694587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d13eca-cb9a-45a5-8edd-a99b4a3f09a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:11.699518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d13eca-cb9a-45a5-8edd-a99b4a3f09a4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:11.728545 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2790/5570] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:11.729574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d13eca-cb9a-45a5-8edd-a99b4a3f09a4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:11.739877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8c19b-7617-4077-ae82-92ea3c194de7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:11.746640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d13eca-cb9a-45a5-8edd-a99b4a3f09a4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:11.750076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e1b46-0041-4d76-a921-f1443f166ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:11.753305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e1b46-0041-4d76-a921-f1443f166ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:11.753788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e1b46-0041-4d76-a921-f1443f166ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:11.754804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92946a55-4ced-4704-8549-fb54e8672cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:11.756199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e1b46-0041-4d76-a921-f1443f166ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:11.756338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92946a55-4ced-4704-8549-fb54e8672cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:11.756509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92946a55-4ced-4704-8549-fb54e8672cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:11.757295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92946a55-4ced-4704-8549-fb54e8672cd5 admin admin] PATH_INFO: `/v3/projects/0bf962665f994ec486e83697b1c9d057/users/b434493ec5524befa157e1f8c29995b9/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:11.769971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-850e1b46-0041-4d76-a921-f1443f166ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:11.778730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92946a55-4ced-4704-8549-fb54e8672cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf962665f994ec486e83697b1c9d057, user_id=b434493ec5524befa157e1f8c29995b9, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:11.783614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92946a55-4ced-4704-8549-fb54e8672cd5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:11.819175 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2791/5571] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:11 2022] PUT /identity/v3/projects/0bf962665f994ec486e83697b1c9d057/users/b434493ec5524befa157e1f8c29995b9/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:11.829360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02d9e-aad8-4ba9-9fb4-579f8333ef21 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:11.830025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e1b46-0041-4d76-a921-f1443f166ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:11.830128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02d9e-aad8-4ba9-9fb4-579f8333ef21 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:11.830128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02d9e-aad8-4ba9-9fb4-579f8333ef21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:11.830986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e1b46-0041-4d76-a921-f1443f166ba8 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:11.874012 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2781/5572] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:11.908583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4ee02d9e-aad8-4ba9-9fb4-579f8333ef21 None None] MFA Rules not processed for user `b434493ec5524befa157e1f8c29995b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:11.911077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4ee02d9e-aad8-4ba9-9fb4-579f8333ef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:11.956158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:12.007444 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2792/5573] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:12.112815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e1b46-0041-4d76-a921-f1443f166ba8 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:12.114221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-850e1b46-0041-4d76-a921-f1443f166ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:12.190401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:12.294519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e1b46-0041-4d76-a921-f1443f166ba8 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:12.390575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a9182-c723-48ff-a9d1-14ccefc31a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:12.391379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a9182-c723-48ff-a9d1-14ccefc31a97 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:12.391669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a9182-c723-48ff-a9d1-14ccefc31a97 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:12.391968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a9182-c723-48ff-a9d1-14ccefc31a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:12.402564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a9182-c723-48ff-a9d1-14ccefc31a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:12.404589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a9182-c723-48ff-a9d1-14ccefc31a97 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:12.427075 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2782/5574] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:14.019910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee02d9e-aad8-4ba9-9fb4-579f8333ef21 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:14.203951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee02d9e-aad8-4ba9-9fb4-579f8333ef21 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:14.214508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:14.216798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:14.218559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:14.220749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] PATH_INFO: `/v3/users/b434493ec5524befa157e1f8c29995b9` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:14.224787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b434493ec5524befa157e1f8c29995b9)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:14.228490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:14.335034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b434493ec5524befa157e1f8c29995b9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:14.344364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b434493ec5524befa157e1f8c29995b9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:14.345092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b434493ec5524befa157e1f8c29995b9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:14.371147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b434493ec5524befa157e1f8c29995b9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:14.371852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b434493ec5524befa157e1f8c29995b9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:14.404785 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2793/5575] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:14 2022] DELETE /identity/v3/users/b434493ec5524befa157e1f8c29995b9 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:14.406767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bea23-02cf-45e7-b781-11e9f415a13d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:14.407244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bea23-02cf-45e7-b781-11e9f415a13d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:14.407606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bea23-02cf-45e7-b781-11e9f415a13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:14.434609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-659bea23-02cf-45e7-b781-11e9f415a13d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:14.437297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-659bea23-02cf-45e7-b781-11e9f415a13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:14.543168 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2783/5576] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:14.543999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:14.545469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:14.689672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d7cb9-dad2-4283-81b2-8810b52b0dc0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:14.699206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a6823-3c20-4af1-964e-e958532e1edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:14.699842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a6823-3c20-4af1-964e-e958532e1edd service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:14.700130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a6823-3c20-4af1-964e-e958532e1edd service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:14.700524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a6823-3c20-4af1-964e-e958532e1edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:14.720727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:14.726713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a6823-3c20-4af1-964e-e958532e1edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:14.728399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a6823-3c20-4af1-964e-e958532e1edd service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:14.759105 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2794/5577] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:16:15.457004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bea23-02cf-45e7-b781-11e9f415a13d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:15.459101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-659bea23-02cf-45e7-b781-11e9f415a13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:15.476886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bea23-02cf-45e7-b781-11e9f415a13d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:15.498050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196185b-798d-4f8d-96ae-edc5e3ef237e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:15.499445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196185b-798d-4f8d-96ae-edc5e3ef237e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:15.507330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196185b-798d-4f8d-96ae-edc5e3ef237e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:15.511470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196185b-798d-4f8d-96ae-edc5e3ef237e admin admin] PATH_INFO: `/v3/projects/0bf962665f994ec486e83697b1c9d057` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:15.513528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196185b-798d-4f8d-96ae-edc5e3ef237e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf962665f994ec486e83697b1c9d057)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:15.531039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196185b-798d-4f8d-96ae-edc5e3ef237e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:15.623479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:15.627014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0196185b-798d-4f8d-96ae-edc5e3ef237e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf962665f994ec486e83697b1c9d057', 'request_id': 'req-0196185b-798d-4f8d-96ae-edc5e3ef237e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:15.641514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0196185b-798d-4f8d-96ae-edc5e3ef237e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf962665f994ec486e83697b1c9d057', 'request_id': 'req-0196185b-798d-4f8d-96ae-edc5e3ef237e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:15.650170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0196185b-798d-4f8d-96ae-edc5e3ef237e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf962665f994ec486e83697b1c9d057', 'request_id': 'req-0196185b-798d-4f8d-96ae-edc5e3ef237e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:15.699857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0196185b-798d-4f8d-96ae-edc5e3ef237e admin admin] The token cache is being invalidate because project 0bf962665f994ec486e83697b1c9d057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:15.700205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0196185b-798d-4f8d-96ae-edc5e3ef237e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:15.701216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0196185b-798d-4f8d-96ae-edc5e3ef237e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:15.706096 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2784/5578] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:15 2022] DELETE /identity/v3/projects/0bf962665f994ec486e83697b1c9d057 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:15.707893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057609d-c6af-43c8-9617-b309077025a4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:15.708513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057609d-c6af-43c8-9617-b309077025a4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:15.708928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057609d-c6af-43c8-9617-b309077025a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:15.777003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2057609d-c6af-43c8-9617-b309077025a4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:15.778261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2057609d-c6af-43c8-9617-b309077025a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:15.919311 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2795/5579] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:15.924395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a322c49-2fa9-494c-9334-93066fde6bfe None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:15.924936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a322c49-2fa9-494c-9334-93066fde6bfe None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:15.925425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a322c49-2fa9-494c-9334-93066fde6bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:15.985443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7a322c49-2fa9-494c-9334-93066fde6bfe None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:15.989067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7a322c49-2fa9-494c-9334-93066fde6bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:16.012741 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2785/5580] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:16.017160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057609d-c6af-43c8-9617-b309077025a4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:16.047650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057609d-c6af-43c8-9617-b309077025a4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:16.071354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03755f6-b825-49a6-9a2b-0f3b7d82dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:16.072265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03755f6-b825-49a6-9a2b-0f3b7d82dd18 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:16.072556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03755f6-b825-49a6-9a2b-0f3b7d82dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:16.073313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03755f6-b825-49a6-9a2b-0f3b7d82dd18 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:16.073981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03755f6-b825-49a6-9a2b-0f3b7d82dd18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:16.074288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03755f6-b825-49a6-9a2b-0f3b7d82dd18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:16.086081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03755f6-b825-49a6-9a2b-0f3b7d82dd18 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:16.120279 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2796/5581] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:16.121858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a322c49-2fa9-494c-9334-93066fde6bfe None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:16.137836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a322c49-2fa9-494c-9334-93066fde6bfe None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:16.144492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03755f6-b825-49a6-9a2b-0f3b7d82dd18 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:16.148250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a03755f6-b825-49a6-9a2b-0f3b7d82dd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:16.158394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a381528-8f2b-4cf3-8b80-0c8c50468064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:16.160839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a381528-8f2b-4cf3-8b80-0c8c50468064 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:16.162057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a381528-8f2b-4cf3-8b80-0c8c50468064 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:16.164168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a381528-8f2b-4cf3-8b80-0c8c50468064 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:16.165187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a381528-8f2b-4cf3-8b80-0c8c50468064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:16.169661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03755f6-b825-49a6-9a2b-0f3b7d82dd18 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:16.171406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a381528-8f2b-4cf3-8b80-0c8c50468064 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:16.187091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90652793-669d-416e-bf3a-677f4e21dd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:16.187758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90652793-669d-416e-bf3a-677f4e21dd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:16.188046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90652793-669d-416e-bf3a-677f4e21dd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:16.188324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90652793-669d-416e-bf3a-677f4e21dd02 admin admin] PATH_INFO: `/v3/users/7de9b31956c24aca8fb0293cfab8e3e9` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:16.190313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90652793-669d-416e-bf3a-677f4e21dd02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de9b31956c24aca8fb0293cfab8e3e9)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:16.192350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90652793-669d-416e-bf3a-677f4e21dd02 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:16.246159 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2786/5582] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:16 2022] POST /identity/v3/projects => generated 395 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:16:16.251013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a381528-8f2b-4cf3-8b80-0c8c50468064 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:16.329157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-90652793-669d-416e-bf3a-677f4e21dd02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de9b31956c24aca8fb0293cfab8e3e9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:16.361708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-90652793-669d-416e-bf3a-677f4e21dd02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de9b31956c24aca8fb0293cfab8e3e9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:16.366187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-90652793-669d-416e-bf3a-677f4e21dd02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de9b31956c24aca8fb0293cfab8e3e9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:16.400782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-90652793-669d-416e-bf3a-677f4e21dd02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de9b31956c24aca8fb0293cfab8e3e9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:16.401601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-90652793-669d-416e-bf3a-677f4e21dd02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de9b31956c24aca8fb0293cfab8e3e9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:16.441918 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2797/5583] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:16 2022] DELETE /identity/v3/users/7de9b31956c24aca8fb0293cfab8e3e9 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:16.444022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397021c-9cf5-4d1f-995b-6bb412807d2a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:16.447293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397021c-9cf5-4d1f-995b-6bb412807d2a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:16.447678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397021c-9cf5-4d1f-995b-6bb412807d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:16.481449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a381528-8f2b-4cf3-8b80-0c8c50468064 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:16.498330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a397021c-9cf5-4d1f-995b-6bb412807d2a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:16.500304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a397021c-9cf5-4d1f-995b-6bb412807d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:16.629644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:16.636726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547c67d-5c18-48f1-b12a-f3b1c4c3f635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:16.638569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547c67d-5c18-48f1-b12a-f3b1c4c3f635 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:16.640426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547c67d-5c18-48f1-b12a-f3b1c4c3f635 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:16.640969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547c67d-5c18-48f1-b12a-f3b1c4c3f635 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:16.642592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547c67d-5c18-48f1-b12a-f3b1c4c3f635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:16.646822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547c67d-5c18-48f1-b12a-f3b1c4c3f635 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:16.674408 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2798/5584] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:16.678039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397021c-9cf5-4d1f-995b-6bb412807d2a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:16.680132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a397021c-9cf5-4d1f-995b-6bb412807d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:16.730717 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2787/5585] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:16 2022] POST /identity/v3/users => generated 298 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:16.735826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547c67d-5c18-48f1-b12a-f3b1c4c3f635 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:16.743993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c547c67d-5c18-48f1-b12a-f3b1c4c3f635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:16.783455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397021c-9cf5-4d1f-995b-6bb412807d2a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:16.789117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547c67d-5c18-48f1-b12a-f3b1c4c3f635 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:16.789737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f65a03-13ba-48af-9ec6-556b19492110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:16.790553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f65a03-13ba-48af-9ec6-556b19492110 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:16.791158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f65a03-13ba-48af-9ec6-556b19492110 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:16.791591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f65a03-13ba-48af-9ec6-556b19492110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:16.804656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f65a03-13ba-48af-9ec6-556b19492110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:16.806352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f65a03-13ba-48af-9ec6-556b19492110 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:16.813254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17f806-dd50-421d-8143-00af883a32a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:16.813501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17f806-dd50-421d-8143-00af883a32a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:16.813606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17f806-dd50-421d-8143-00af883a32a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:16.813848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17f806-dd50-421d-8143-00af883a32a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:16.814497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17f806-dd50-421d-8143-00af883a32a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:16.816181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17f806-dd50-421d-8143-00af883a32a9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:16.835508 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2799/5586] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:16.855104 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2788/5587] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:16.859042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f65a03-13ba-48af-9ec6-556b19492110 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:16.871033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f65a03-13ba-48af-9ec6-556b19492110 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:16.906755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb3a85-bdd5-4eb0-ac00-8c4eb0b065db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:16.908110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb3a85-bdd5-4eb0-ac00-8c4eb0b065db admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:16.908566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb3a85-bdd5-4eb0-ac00-8c4eb0b065db admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:16.909133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb3a85-bdd5-4eb0-ac00-8c4eb0b065db admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:16.909945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb3a85-bdd5-4eb0-ac00-8c4eb0b065db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:16.915583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb3a85-bdd5-4eb0-ac00-8c4eb0b065db admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:16.946426 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2800/5588] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:16.952665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17f806-dd50-421d-8143-00af883a32a9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:16.965337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17f806-dd50-421d-8143-00af883a32a9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:17.009078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95135b21-8bf1-46cc-a501-82a36463cfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:17.010054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95135b21-8bf1-46cc-a501-82a36463cfcb admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:17.010563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95135b21-8bf1-46cc-a501-82a36463cfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:17.011106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95135b21-8bf1-46cc-a501-82a36463cfcb admin admin] PATH_INFO: `/v3/projects/024d4b59903b47b387897fd819108b18/users/9f4dbabe14364e9a980983c6103c71d3/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:17.030408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95135b21-8bf1-46cc-a501-82a36463cfcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=024d4b59903b47b387897fd819108b18, user_id=9f4dbabe14364e9a980983c6103c71d3, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:17.037156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95135b21-8bf1-46cc-a501-82a36463cfcb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:17.065931 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2789/5589] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:16 2022] PUT /identity/v3/projects/024d4b59903b47b387897fd819108b18/users/9f4dbabe14364e9a980983c6103c71d3/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:17.068538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39027c29-6e61-465b-afd9-66d40cbc84a4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:17.069078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39027c29-6e61-465b-afd9-66d40cbc84a4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:17.069363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39027c29-6e61-465b-afd9-66d40cbc84a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:17.165387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-39027c29-6e61-465b-afd9-66d40cbc84a4 None None] MFA Rules not processed for user `9f4dbabe14364e9a980983c6103c71d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:17.168375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-39027c29-6e61-465b-afd9-66d40cbc84a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:17.366308 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2801/5590] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:17.378239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95135b21-8bf1-46cc-a501-82a36463cfcb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:17.380892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-95135b21-8bf1-46cc-a501-82a36463cfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:17.410265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:17.497055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39027c29-6e61-465b-afd9-66d40cbc84a4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:17.499497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-39027c29-6e61-465b-afd9-66d40cbc84a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:17.596166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95135b21-8bf1-46cc-a501-82a36463cfcb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:17.609968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844b5a9-3256-4c7f-ac21-8d8f21200f9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:17.610880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844b5a9-3256-4c7f-ac21-8d8f21200f9d service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:17.611507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844b5a9-3256-4c7f-ac21-8d8f21200f9d service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:17.611957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844b5a9-3256-4c7f-ac21-8d8f21200f9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:17.636030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844b5a9-3256-4c7f-ac21-8d8f21200f9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:17.638050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844b5a9-3256-4c7f-ac21-8d8f21200f9d service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:17.678776 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2790/5591] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:17 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:17.684598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39027c29-6e61-465b-afd9-66d40cbc84a4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:17.697037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b20e5-4112-42aa-86ce-c8f83c49a2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:17.697940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b20e5-4112-42aa-86ce-c8f83c49a2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:17.698228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b20e5-4112-42aa-86ce-c8f83c49a2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:17.698603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b20e5-4112-42aa-86ce-c8f83c49a2e8 admin admin] PATH_INFO: `/v3/projects/e44393365ce0427796f74199a44c07f2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:17.705562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b20e5-4112-42aa-86ce-c8f83c49a2e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44393365ce0427796f74199a44c07f2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:17.713234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b20e5-4112-42aa-86ce-c8f83c49a2e8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:17.775033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:17.854807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea967caf-14f8-4c95-8f6b-6ae120fc702a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:17.855164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea967caf-14f8-4c95-8f6b-6ae120fc702a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:17.855382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea967caf-14f8-4c95-8f6b-6ae120fc702a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:17.876865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ea967caf-14f8-4c95-8f6b-6ae120fc702a None None] MFA Rules not processed for user `9f4dbabe14364e9a980983c6103c71d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:17.878093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ea967caf-14f8-4c95-8f6b-6ae120fc702a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:17.905266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-492b20e5-4112-42aa-86ce-c8f83c49a2e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44393365ce0427796f74199a44c07f2', 'request_id': 'req-492b20e5-4112-42aa-86ce-c8f83c49a2e8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:17.939942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-492b20e5-4112-42aa-86ce-c8f83c49a2e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44393365ce0427796f74199a44c07f2', 'request_id': 'req-492b20e5-4112-42aa-86ce-c8f83c49a2e8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:17.955207 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2791/5592] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:17.963681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-492b20e5-4112-42aa-86ce-c8f83c49a2e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44393365ce0427796f74199a44c07f2', 'request_id': 'req-492b20e5-4112-42aa-86ce-c8f83c49a2e8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:17.988977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-492b20e5-4112-42aa-86ce-c8f83c49a2e8 admin admin] The token cache is being invalidate because project e44393365ce0427796f74199a44c07f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:17.989405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-492b20e5-4112-42aa-86ce-c8f83c49a2e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:17.990539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-492b20e5-4112-42aa-86ce-c8f83c49a2e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:17.999434 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2802/5593] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:17 2022] DELETE /identity/v3/projects/e44393365ce0427796f74199a44c07f2 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:17.999971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f903dc2-b265-4520-a9a3-718e2c0c318e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:18.000740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f903dc2-b265-4520-a9a3-718e2c0c318e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:18.001107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f903dc2-b265-4520-a9a3-718e2c0c318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:18.040239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8f903dc2-b265-4520-a9a3-718e2c0c318e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:18.041432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8f903dc2-b265-4520-a9a3-718e2c0c318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:18.170994 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2792/5594] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:18.176469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0472e8-3651-40e1-90a5-321d779dba64 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:18.176469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0472e8-3651-40e1-90a5-321d779dba64 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:18.176469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0472e8-3651-40e1-90a5-321d779dba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:18.199247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ff0472e8-3651-40e1-90a5-321d779dba64 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:18.200751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ff0472e8-3651-40e1-90a5-321d779dba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:18.214371 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2803/5595] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:18.214842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f903dc2-b265-4520-a9a3-718e2c0c318e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:18.226282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f903dc2-b265-4520-a9a3-718e2c0c318e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:18.233392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce1556-4c17-431e-a11a-8637b54c94f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:18.234093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce1556-4c17-431e-a11a-8637b54c94f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:18.234355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce1556-4c17-431e-a11a-8637b54c94f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:18.235135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce1556-4c17-431e-a11a-8637b54c94f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:18.240408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce1556-4c17-431e-a11a-8637b54c94f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:18.240876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce1556-4c17-431e-a11a-8637b54c94f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:18.242897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce1556-4c17-431e-a11a-8637b54c94f2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:18.282289 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2793/5596] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:16:18.283997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0472e8-3651-40e1-90a5-321d779dba64 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:18.304327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0472e8-3651-40e1-90a5-321d779dba64 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:18.311276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcd11c-b43c-425f-ad69-3ca8cfc83584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:18.311906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcd11c-b43c-425f-ad69-3ca8cfc83584 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:18.312235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcd11c-b43c-425f-ad69-3ca8cfc83584 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:18.312460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcd11c-b43c-425f-ad69-3ca8cfc83584 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:18.313617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcd11c-b43c-425f-ad69-3ca8cfc83584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:18.316785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcd11c-b43c-425f-ad69-3ca8cfc83584 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:18.367797 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2804/5597] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:18 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:18.370054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce1556-4c17-431e-a11a-8637b54c94f2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:18.383414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce1556-4c17-431e-a11a-8637b54c94f2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:18.431569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:18.503324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516c2df-8512-4e86-adc7-51027de05bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:18.504706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516c2df-8512-4e86-adc7-51027de05bda admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:18.505704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516c2df-8512-4e86-adc7-51027de05bda admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:18.506645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516c2df-8512-4e86-adc7-51027de05bda admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:18.507589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516c2df-8512-4e86-adc7-51027de05bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:18.509842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516c2df-8512-4e86-adc7-51027de05bda admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:18.551158 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2794/5598] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:18 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:18.551397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcd11c-b43c-425f-ad69-3ca8cfc83584 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:18.584227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcd11c-b43c-425f-ad69-3ca8cfc83584 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:18.589883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbf5e4-ab2b-4ff5-974b-178a109fa070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:18.590506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbf5e4-ab2b-4ff5-974b-178a109fa070 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:18.590839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbf5e4-ab2b-4ff5-974b-178a109fa070 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:18.591123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbf5e4-ab2b-4ff5-974b-178a109fa070 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:18.592048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbf5e4-ab2b-4ff5-974b-178a109fa070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:18.593667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbf5e4-ab2b-4ff5-974b-178a109fa070 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:18.606968 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2805/5599] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:16:18.613070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516c2df-8512-4e86-adc7-51027de05bda admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:18.628474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516c2df-8512-4e86-adc7-51027de05bda admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:18.636016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc0068-c30d-4b04-9bcc-65e3e2f4958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:18.636959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0068-c30d-4b04-9bcc-65e3e2f4958a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:18.637346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0068-c30d-4b04-9bcc-65e3e2f4958a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:18.638224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0068-c30d-4b04-9bcc-65e3e2f4958a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:18.639440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc0068-c30d-4b04-9bcc-65e3e2f4958a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:18.642849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc0068-c30d-4b04-9bcc-65e3e2f4958a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:18.665751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbf5e4-ab2b-4ff5-974b-178a109fa070 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:18.675153 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2795/5600] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:18.680568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbf5e4-ab2b-4ff5-974b-178a109fa070 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:18.697990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dace7c-81ef-43ba-a3eb-c81b9cd1df44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:18.699700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc0068-c30d-4b04-9bcc-65e3e2f4958a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:18.701640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-effc0068-c30d-4b04-9bcc-65e3e2f4958a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:18.709262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dace7c-81ef-43ba-a3eb-c81b9cd1df44 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:18.710944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dace7c-81ef-43ba-a3eb-c81b9cd1df44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:18.711354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dace7c-81ef-43ba-a3eb-c81b9cd1df44 admin admin] PATH_INFO: `/v3/projects/13aeae30aaf34b8ea26ba2d01dba3880/users/931679f2179f4d87aaa8fd639c9651ab/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:18.739054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc0068-c30d-4b04-9bcc-65e3e2f4958a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:18.748390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13f2b8-5c56-4354-a80a-22f3d806d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:18.749335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13f2b8-5c56-4354-a80a-22f3d806d0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:18.749981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13f2b8-5c56-4354-a80a-22f3d806d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:18.750381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13f2b8-5c56-4354-a80a-22f3d806d0c1 admin admin] PATH_INFO: `/v3/users/9f4dbabe14364e9a980983c6103c71d3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:18.751713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13f2b8-5c56-4354-a80a-22f3d806d0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4dbabe14364e9a980983c6103c71d3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:18.754681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13f2b8-5c56-4354-a80a-22f3d806d0c1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:18.769669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dace7c-81ef-43ba-a3eb-c81b9cd1df44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13aeae30aaf34b8ea26ba2d01dba3880, user_id=931679f2179f4d87aaa8fd639c9651ab, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:18.775695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dace7c-81ef-43ba-a3eb-c81b9cd1df44 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:18.821372 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2806/5601] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:18 2022] PUT /identity/v3/projects/13aeae30aaf34b8ea26ba2d01dba3880/users/931679f2179f4d87aaa8fd639c9651ab/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:18.833770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e906e9b-a9a5-46ec-ac1f-1dd02c56eb45 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:18.834315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e906e9b-a9a5-46ec-ac1f-1dd02c56eb45 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:18.834950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e906e9b-a9a5-46ec-ac1f-1dd02c56eb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:18.879491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5e906e9b-a9a5-46ec-ac1f-1dd02c56eb45 None None] MFA Rules not processed for user `931679f2179f4d87aaa8fd639c9651ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:18.880972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5e906e9b-a9a5-46ec-ac1f-1dd02c56eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:18.881721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ef13f2b8-5c56-4354-a80a-22f3d806d0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4dbabe14364e9a980983c6103c71d3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:18.897708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ef13f2b8-5c56-4354-a80a-22f3d806d0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4dbabe14364e9a980983c6103c71d3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:18.899070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ef13f2b8-5c56-4354-a80a-22f3d806d0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4dbabe14364e9a980983c6103c71d3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:18.927301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ef13f2b8-5c56-4354-a80a-22f3d806d0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4dbabe14364e9a980983c6103c71d3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:18.929423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ef13f2b8-5c56-4354-a80a-22f3d806d0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4dbabe14364e9a980983c6103c71d3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:18.952917 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2796/5602] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:18 2022] DELETE /identity/v3/users/9f4dbabe14364e9a980983c6103c71d3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:18.962162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fde5db-7bf9-4062-84c4-84ecc8a8f08b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:18.962528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fde5db-7bf9-4062-84c4-84ecc8a8f08b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:18.962709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fde5db-7bf9-4062-84c4-84ecc8a8f08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:19.009154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-58fde5db-7bf9-4062-84c4-84ecc8a8f08b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:19.010593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-58fde5db-7bf9-4062-84c4-84ecc8a8f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:19.013601 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2807/5603] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:16:19.016901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e906e9b-a9a5-46ec-ac1f-1dd02c56eb45 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:19.018909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5e906e9b-a9a5-46ec-ac1f-1dd02c56eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:19.066715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:19.121952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e906e9b-a9a5-46ec-ac1f-1dd02c56eb45 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:19.150433 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2797/5604] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:19.163161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fde5db-7bf9-4062-84c4-84ecc8a8f08b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:19.164573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-58fde5db-7bf9-4062-84c4-84ecc8a8f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:19.187737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:19.201468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a35c56-5d0f-4504-8b33-eb00c0d34ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:19.202087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a35c56-5d0f-4504-8b33-eb00c0d34ecb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:19.202374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a35c56-5d0f-4504-8b33-eb00c0d34ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:19.202648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a35c56-5d0f-4504-8b33-eb00c0d34ecb admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:19.203344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a35c56-5d0f-4504-8b33-eb00c0d34ecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:19.207976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a35c56-5d0f-4504-8b33-eb00c0d34ecb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:19.243899 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2808/5605] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:19 2022] POST /identity/v3/projects => generated 369 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:16:19.245457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a35c56-5d0f-4504-8b33-eb00c0d34ecb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:19.312658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fde5db-7bf9-4062-84c4-84ecc8a8f08b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:19.364396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a35c56-5d0f-4504-8b33-eb00c0d34ecb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:19.386410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141b6dd-28c9-486f-a6ac-a77434c5fece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:19.387485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141b6dd-28c9-486f-a6ac-a77434c5fece admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:19.387987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141b6dd-28c9-486f-a6ac-a77434c5fece admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:19.388483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141b6dd-28c9-486f-a6ac-a77434c5fece admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:19.389357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141b6dd-28c9-486f-a6ac-a77434c5fece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:19.391836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141b6dd-28c9-486f-a6ac-a77434c5fece admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:19.466840 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2809/5606] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:19 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:16:19.467835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141b6dd-28c9-486f-a6ac-a77434c5fece admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:19.519772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06ea86-9c24-45d7-90a2-b9b711807729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:19.520701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06ea86-9c24-45d7-90a2-b9b711807729 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:19.521686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06ea86-9c24-45d7-90a2-b9b711807729 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:19.522280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06ea86-9c24-45d7-90a2-b9b711807729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:19.528387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141b6dd-28c9-486f-a6ac-a77434c5fece admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:19.534951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06ea86-9c24-45d7-90a2-b9b711807729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:19.537661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06ea86-9c24-45d7-90a2-b9b711807729 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:19.555814 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2798/5607] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:16:19.564260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af10e0-855b-4b21-8a4b-de36c29da0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:19.565739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af10e0-855b-4b21-8a4b-de36c29da0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:19.566003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af10e0-855b-4b21-8a4b-de36c29da0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:19.568138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af10e0-855b-4b21-8a4b-de36c29da0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:19.568523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af10e0-855b-4b21-8a4b-de36c29da0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:19.578947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af10e0-855b-4b21-8a4b-de36c29da0a5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:19.636610 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2810/5608] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:19.641456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06ea86-9c24-45d7-90a2-b9b711807729 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:19.663426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06ea86-9c24-45d7-90a2-b9b711807729 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:19.683432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f5f9c-075b-4806-b055-6d09f9c3c42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:19.684595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f5f9c-075b-4806-b055-6d09f9c3c42d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:19.685132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f5f9c-075b-4806-b055-6d09f9c3c42d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:19.685642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f5f9c-075b-4806-b055-6d09f9c3c42d admin admin] PATH_INFO: `/v3/projects/6334548851d64b3ba6ab182b863e3af8/users/f313e8c7ebb84069bdc8e79cb050ede4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:19.717635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f5f9c-075b-4806-b055-6d09f9c3c42d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6334548851d64b3ba6ab182b863e3af8, user_id=f313e8c7ebb84069bdc8e79cb050ede4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:19.721347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f5f9c-075b-4806-b055-6d09f9c3c42d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:19.746333 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2799/5609] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:19 2022] PUT /identity/v3/projects/6334548851d64b3ba6ab182b863e3af8/users/f313e8c7ebb84069bdc8e79cb050ede4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:19.748525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af10e0-855b-4b21-8a4b-de36c29da0a5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:19.767333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af10e0-855b-4b21-8a4b-de36c29da0a5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:19.862771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:19.893767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a6219-93cb-4aff-9306-f537b591817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:19.895702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6219-93cb-4aff-9306-f537b591817d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:19.896438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6219-93cb-4aff-9306-f537b591817d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:19.899839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6219-93cb-4aff-9306-f537b591817d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:19.900636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a6219-93cb-4aff-9306-f537b591817d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:19.903891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a6219-93cb-4aff-9306-f537b591817d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:19.925663 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2811/5610] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:19.928124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f5f9c-075b-4806-b055-6d09f9c3c42d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:19.948462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f5f9c-075b-4806-b055-6d09f9c3c42d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:19.954202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc677a-b1ac-4de1-a460-778244bf0f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:19.954915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc677a-b1ac-4de1-a460-778244bf0f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:19.955202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc677a-b1ac-4de1-a460-778244bf0f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:19.955991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc677a-b1ac-4de1-a460-778244bf0f0b admin admin] PATH_INFO: `/v3/projects/6334548851d64b3ba6ab182b863e3af8/users/f313e8c7ebb84069bdc8e79cb050ede4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:19.958124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc677a-b1ac-4de1-a460-778244bf0f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6334548851d64b3ba6ab182b863e3af8, user_id=f313e8c7ebb84069bdc8e79cb050ede4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:19.962598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc677a-b1ac-4de1-a460-778244bf0f0b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:19.986915 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2800/5611] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:19 2022] PUT /identity/v3/projects/6334548851d64b3ba6ab182b863e3af8/users/f313e8c7ebb84069bdc8e79cb050ede4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:19.988022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a187cf0-168e-4182-b221-61d64b04675a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:19.988313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a187cf0-168e-4182-b221-61d64b04675a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:19.988588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a187cf0-168e-4182-b221-61d64b04675a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:20.083304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2a187cf0-168e-4182-b221-61d64b04675a None None] MFA Rules not processed for user `f313e8c7ebb84069bdc8e79cb050ede4`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:20.086293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2a187cf0-168e-4182-b221-61d64b04675a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:20.107655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc677a-b1ac-4de1-a460-778244bf0f0b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:20.110487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fdcc677a-b1ac-4de1-a460-778244bf0f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:20.258390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc677a-b1ac-4de1-a460-778244bf0f0b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:20.263676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4300b-a29c-4a18-a031-e8ac03cb4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:20.264471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4300b-a29c-4a18-a031-e8ac03cb4c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:20.264827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4300b-a29c-4a18-a031-e8ac03cb4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:20.265185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4300b-a29c-4a18-a031-e8ac03cb4c90 admin admin] PATH_INFO: `/v3/projects/024d4b59903b47b387897fd819108b18` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:20.266960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4300b-a29c-4a18-a031-e8ac03cb4c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=024d4b59903b47b387897fd819108b18)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:20.269011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4300b-a29c-4a18-a031-e8ac03cb4c90 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:20.299786 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2812/5612] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:20.305661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a187cf0-168e-4182-b221-61d64b04675a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:20.327646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a187cf0-168e-4182-b221-61d64b04675a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:20.331122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:20.340138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25c4300b-a29c-4a18-a031-e8ac03cb4c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024d4b59903b47b387897fd819108b18', 'request_id': 'req-25c4300b-a29c-4a18-a031-e8ac03cb4c90'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:20.355859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25c4300b-a29c-4a18-a031-e8ac03cb4c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024d4b59903b47b387897fd819108b18', 'request_id': 'req-25c4300b-a29c-4a18-a031-e8ac03cb4c90'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:20.366358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25c4300b-a29c-4a18-a031-e8ac03cb4c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024d4b59903b47b387897fd819108b18', 'request_id': 'req-25c4300b-a29c-4a18-a031-e8ac03cb4c90'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:20.384857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25c4300b-a29c-4a18-a031-e8ac03cb4c90 admin admin] The token cache is being invalidate because project 024d4b59903b47b387897fd819108b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:20.385384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25c4300b-a29c-4a18-a031-e8ac03cb4c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:20.386184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25c4300b-a29c-4a18-a031-e8ac03cb4c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:20.391000 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2801/5613] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:20 2022] DELETE /identity/v3/projects/024d4b59903b47b387897fd819108b18 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:20.392844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1e9f3-b1aa-41ff-b108-48ac0e149d42 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:20.393299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1e9f3-b1aa-41ff-b108-48ac0e149d42 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:20.393841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1e9f3-b1aa-41ff-b108-48ac0e149d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:20.441656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaef5e-cd04-4c28-9973-7ab3dcd13b2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:20.442461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaef5e-cd04-4c28-9973-7ab3dcd13b2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:20.443971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaef5e-cd04-4c28-9973-7ab3dcd13b2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:20.444312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaef5e-cd04-4c28-9973-7ab3dcd13b2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:20.444872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-91f1e9f3-b1aa-41ff-b108-48ac0e149d42 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:20.445012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaaef5e-cd04-4c28-9973-7ab3dcd13b2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:20.446407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-91f1e9f3-b1aa-41ff-b108-48ac0e149d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:20.447440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaaef5e-cd04-4c28-9973-7ab3dcd13b2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:20.475679 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2813/5614] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:16:20 2022] POST /identity/v3/domains => generated 276 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:20.477565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaef5e-cd04-4c28-9973-7ab3dcd13b2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:20.490490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-caaaef5e-cd04-4c28-9973-7ab3dcd13b2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:20.563681 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2802/5615] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:20.565769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fedb55-2366-4ab7-ac4f-ccdb5fa5009e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:20.566040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fedb55-2366-4ab7-ac4f-ccdb5fa5009e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:20.566314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fedb55-2366-4ab7-ac4f-ccdb5fa5009e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:20.629200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d1fedb55-2366-4ab7-ac4f-ccdb5fa5009e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:20.633733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:20.635839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d1fedb55-2366-4ab7-ac4f-ccdb5fa5009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:20.644931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaef5e-cd04-4c28-9973-7ab3dcd13b2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:20.657534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03105a-cb9d-4456-be32-962d2236acf2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:20.658490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03105a-cb9d-4456-be32-962d2236acf2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:20.659370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03105a-cb9d-4456-be32-962d2236acf2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:20.660222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03105a-cb9d-4456-be32-962d2236acf2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:20.661241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03105a-cb9d-4456-be32-962d2236acf2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:20.665139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03105a-cb9d-4456-be32-962d2236acf2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:20.761771 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2814/5616] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:20 2022] POST /identity/v3/projects => generated 402 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:20.776970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03105a-cb9d-4456-be32-962d2236acf2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:20.797338 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2803/5617] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:20.801627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fedb55-2366-4ab7-ac4f-ccdb5fa5009e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:20.813231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fedb55-2366-4ab7-ac4f-ccdb5fa5009e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:20.894656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03105a-cb9d-4456-be32-962d2236acf2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:20.901453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d61e35-1f86-4af9-8055-32f99b42992d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:20.902107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d61e35-1f86-4af9-8055-32f99b42992d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:20.902390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d61e35-1f86-4af9-8055-32f99b42992d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:20.902655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d61e35-1f86-4af9-8055-32f99b42992d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:20.903327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d61e35-1f86-4af9-8055-32f99b42992d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:20.905314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d61e35-1f86-4af9-8055-32f99b42992d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:20.917169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea15e5-8670-4cbc-93f2-c7332fcc33ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:20.918547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea15e5-8670-4cbc-93f2-c7332fcc33ca admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:20.919116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea15e5-8670-4cbc-93f2-c7332fcc33ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:20.919623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea15e5-8670-4cbc-93f2-c7332fcc33ca admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:20.920540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea15e5-8670-4cbc-93f2-c7332fcc33ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:20.921071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea15e5-8670-4cbc-93f2-c7332fcc33ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:20.923633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea15e5-8670-4cbc-93f2-c7332fcc33ca admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:20.925487 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2815/5618] 10.222.0.70 () {60 vars in 1147 bytes} [Sun Aug 28 19:16:20 2022] POST /identity/v3/groups => generated 302 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:20.930011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d61e35-1f86-4af9-8055-32f99b42992d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:20.938089 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2804/5619] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:16:20.943679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea15e5-8670-4cbc-93f2-c7332fcc33ca admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:20.945330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d61e35-1f86-4af9-8055-32f99b42992d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:20.951991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3b132-a33a-4786-ac90-a76c402bc43e tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:20.952573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:20.954502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3b132-a33a-4786-ac90-a76c402bc43e tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:20.955110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3b132-a33a-4786-ac90-a76c402bc43e tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:20.955835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3b132-a33a-4786-ac90-a76c402bc43e tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:20.957001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3b132-a33a-4786-ac90-a76c402bc43e tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:20.957577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea15e5-8670-4cbc-93f2-c7332fcc33ca admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:20.962840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3b132-a33a-4786-ac90-a76c402bc43e tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:20.966907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc769bfd-9a73-4741-a140-4bf40ce8edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:20.968699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769bfd-9a73-4741-a140-4bf40ce8edde admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:20.969477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769bfd-9a73-4741-a140-4bf40ce8edde admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:20.970081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc769bfd-9a73-4741-a140-4bf40ce8edde admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:20.972478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc769bfd-9a73-4741-a140-4bf40ce8edde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:20.976881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc769bfd-9a73-4741-a140-4bf40ce8edde admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:21.001261 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2816/5620] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:20 2022] POST /identity/v3/users => generated 445 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:21.006237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3b132-a33a-4786-ac90-a76c402bc43e tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:21.022889 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2805/5621] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:20 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:21.027028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc769bfd-9a73-4741-a140-4bf40ce8edde admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:21.031219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3b132-a33a-4786-ac90-a76c402bc43e tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:21.121961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4bc78-0d18-43f4-a9dd-ce9770479c59 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:21.123209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4bc78-0d18-43f4-a9dd-ce9770479c59 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:21.123502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4bc78-0d18-43f4-a9dd-ce9770479c59 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:21.123790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4bc78-0d18-43f4-a9dd-ce9770479c59 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:21.124769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4bc78-0d18-43f4-a9dd-ce9770479c59 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:21.126393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4bc78-0d18-43f4-a9dd-ce9770479c59 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:21.127360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc769bfd-9a73-4741-a140-4bf40ce8edde admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:21.132665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5250ba-23bc-4606-9e2d-2baf1c9dbd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:21.133488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5250ba-23bc-4606-9e2d-2baf1c9dbd4d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:21.133882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5250ba-23bc-4606-9e2d-2baf1c9dbd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:21.134177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5250ba-23bc-4606-9e2d-2baf1c9dbd4d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:21.137004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5250ba-23bc-4606-9e2d-2baf1c9dbd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:21.139548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5250ba-23bc-4606-9e2d-2baf1c9dbd4d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:21.147624 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2817/5622] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:16:21 2022] POST /identity/v3/roles => generated 240 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:21.151461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4bc78-0d18-43f4-a9dd-ce9770479c59 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:21.172452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4bc78-0d18-43f4-a9dd-ce9770479c59 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:21.176176 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2806/5623] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:21 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:16:21.178022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5250ba-23bc-4606-9e2d-2baf1c9dbd4d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:21.178719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da788866-3c5d-48a1-aed6-9b756b8bd079 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:21.179509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da788866-3c5d-48a1-aed6-9b756b8bd079 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:21.179796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da788866-3c5d-48a1-aed6-9b756b8bd079 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:21.180079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da788866-3c5d-48a1-aed6-9b756b8bd079 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/groups/69d7b183d7d442f5a84f0470b89cd949/roles/352e1fe83356424480f65ba162290417/inherited_to_projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:21.190520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da788866-3c5d-48a1-aed6-9b756b8bd079 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd6c5a237221431b9c5bce7a3862294c, group_id=69d7b183d7d442f5a84f0470b89cd949, role_id=352e1fe83356424480f65ba162290417)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:21.193603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5250ba-23bc-4606-9e2d-2baf1c9dbd4d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:21.194440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da788866-3c5d-48a1-aed6-9b756b8bd079 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:21.201951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34550b8-a4b7-4674-b621-9cb6ae325f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:21.202608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34550b8-a4b7-4674-b621-9cb6ae325f49 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:21.202935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34550b8-a4b7-4674-b621-9cb6ae325f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:21.203209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34550b8-a4b7-4674-b621-9cb6ae325f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:21.204062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34550b8-a4b7-4674-b621-9cb6ae325f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:21.205738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34550b8-a4b7-4674-b621-9cb6ae325f49 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:21.215452 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2818/5624] 10.222.0.70 () {60 vars in 1585 bytes} [Sun Aug 28 19:16:21 2022] PUT /identity/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/groups/69d7b183d7d442f5a84f0470b89cd949/roles/352e1fe83356424480f65ba162290417/inherited_to_projects => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:21.220626 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2807/5625] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:21 2022] GET /identity/v3/roles => generated 1651 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:16:21.220791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da788866-3c5d-48a1-aed6-9b756b8bd079 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:21.222723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34550b8-a4b7-4674-b621-9cb6ae325f49 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:21.238806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34550b8-a4b7-4674-b621-9cb6ae325f49 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:21.308573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1a279-d787-4ab8-9efc-b637eb520384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:21.319173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:21.319395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1a279-d787-4ab8-9efc-b637eb520384 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:21.319831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1a279-d787-4ab8-9efc-b637eb520384 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:21.320866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1a279-d787-4ab8-9efc-b637eb520384 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:21.322114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1a279-d787-4ab8-9efc-b637eb520384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:21.324422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1a279-d787-4ab8-9efc-b637eb520384 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:21.338535 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2808/5626] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:21 2022] GET /identity/v3/roles => generated 1651 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:21.343508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1a279-d787-4ab8-9efc-b637eb520384 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:21.358338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1a279-d787-4ab8-9efc-b637eb520384 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:21.367640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ca473-7fab-4984-9859-767cc094f5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:21.368317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ca473-7fab-4984-9859-767cc094f5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:21.368608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ca473-7fab-4984-9859-767cc094f5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:21.368891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ca473-7fab-4984-9859-767cc094f5b0 admin admin] PATH_INFO: `/v3/projects/22c153b5085848bcb9a8e940b0e73b57/users/df392b197270409b861e7ff7bd5a8135/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:21.376721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da788866-3c5d-48a1-aed6-9b756b8bd079 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:21.387677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94252fa-1137-4471-8df7-3a18f718e21b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:21.389265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94252fa-1137-4471-8df7-3a18f718e21b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:21.390117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94252fa-1137-4471-8df7-3a18f718e21b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:21.390626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94252fa-1137-4471-8df7-3a18f718e21b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/groups/69d7b183d7d442f5a84f0470b89cd949/roles/352e1fe83356424480f65ba162290417/inherited_to_projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:21.393999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94252fa-1137-4471-8df7-3a18f718e21b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:check_grant(project_id=cd6c5a237221431b9c5bce7a3862294c, group_id=69d7b183d7d442f5a84f0470b89cd949, role_id=352e1fe83356424480f65ba162290417)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:21.403058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ca473-7fab-4984-9859-767cc094f5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c153b5085848bcb9a8e940b0e73b57, user_id=df392b197270409b861e7ff7bd5a8135, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:21.405912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ca473-7fab-4984-9859-767cc094f5b0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:21.412768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94252fa-1137-4471-8df7-3a18f718e21b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:21.422195 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2809/5627] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:21 2022] PUT /identity/v3/projects/22c153b5085848bcb9a8e940b0e73b57/users/df392b197270409b861e7ff7bd5a8135/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:21.422707 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2819/5628] 10.222.0.70 () {58 vars in 1567 bytes} [Sun Aug 28 19:16:21 2022] HEAD /identity/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/groups/69d7b183d7d442f5a84f0470b89cd949/roles/352e1fe83356424480f65ba162290417/inherited_to_projects => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:21.427093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ca473-7fab-4984-9859-767cc094f5b0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:21.427705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bff89-b91f-43cd-b16b-d334cbe2c13d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:21.428001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bff89-b91f-43cd-b16b-d334cbe2c13d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:21.428455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bff89-b91f-43cd-b16b-d334cbe2c13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:21.449978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-565bff89-b91f-43cd-b16b-d334cbe2c13d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:21.451245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-565bff89-b91f-43cd-b16b-d334cbe2c13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:21.483124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:21.544474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ca473-7fab-4984-9859-767cc094f5b0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:21.554552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e956a-cfb0-4f7d-a17f-5811cb7228f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:21.555271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e956a-cfb0-4f7d-a17f-5811cb7228f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:21.556703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e956a-cfb0-4f7d-a17f-5811cb7228f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:21.556988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e956a-cfb0-4f7d-a17f-5811cb7228f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/groups/69d7b183d7d442f5a84f0470b89cd949/roles/352e1fe83356424480f65ba162290417/inherited_to_projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:21.562498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e956a-cfb0-4f7d-a17f-5811cb7228f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd6c5a237221431b9c5bce7a3862294c, group_id=69d7b183d7d442f5a84f0470b89cd949, role_id=352e1fe83356424480f65ba162290417)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:21.562662 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2820/5629] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:16:21.563575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e956a-cfb0-4f7d-a17f-5811cb7228f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:21.572899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bff89-b91f-43cd-b16b-d334cbe2c13d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:21.574605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-565bff89-b91f-43cd-b16b-d334cbe2c13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:21.575775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f06e956a-cfb0-4f7d-a17f-5811cb7228f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invalidating the token cache because role 352e1fe83356424480f65ba162290417 was removed from group 69d7b183d7d442f5a84f0470b89cd949 on project cd6c5a237221431b9c5bce7a3862294c. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:21.577750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f06e956a-cfb0-4f7d-a17f-5811cb7228f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:21.579060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f06e956a-cfb0-4f7d-a17f-5811cb7228f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:21.609404 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2810/5630] 10.222.0.70 () {58 vars in 1569 bytes} [Sun Aug 28 19:16:21 2022] DELETE /identity/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/groups/69d7b183d7d442f5a84f0470b89cd949/roles/352e1fe83356424480f65ba162290417/inherited_to_projects => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:21.613557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e956a-cfb0-4f7d-a17f-5811cb7228f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:21.616409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f06e956a-cfb0-4f7d-a17f-5811cb7228f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:21.668311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bff89-b91f-43cd-b16b-d334cbe2c13d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:21.765220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e956a-cfb0-4f7d-a17f-5811cb7228f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:21.766872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60af05-70ba-419e-8788-0c1d00a89169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:21.767524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60af05-70ba-419e-8788-0c1d00a89169 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:21.768688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60af05-70ba-419e-8788-0c1d00a89169 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:21.768973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60af05-70ba-419e-8788-0c1d00a89169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:21.773484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ee60af05-70ba-419e-8788-0c1d00a89169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:21.778136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c987d49-5808-45a0-ab6d-e783229a63e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:21.780413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c987d49-5808-45a0-ab6d-e783229a63e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:21.780719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c987d49-5808-45a0-ab6d-e783229a63e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:21.780999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c987d49-5808-45a0-ab6d-e783229a63e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/roles/352e1fe83356424480f65ba162290417` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:21.784311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c987d49-5808-45a0-ab6d-e783229a63e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:delete_role(role_id=352e1fe83356424480f65ba162290417)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:21.786081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c987d49-5808-45a0-ab6d-e783229a63e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:21.839474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:21.869379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3c987d49-5808-45a0-ab6d-e783229a63e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invalidating the token cache because role 352e1fe83356424480f65ba162290417 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:21.870022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3c987d49-5808-45a0-ab6d-e783229a63e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:21.870395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3c987d49-5808-45a0-ab6d-e783229a63e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:21.876160 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2811/5631] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:21 2022] DELETE /identity/v3/roles/352e1fe83356424480f65ba162290417 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:21.876160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c987d49-5808-45a0-ab6d-e783229a63e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:21.876160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3c987d49-5808-45a0-ab6d-e783229a63e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:21.922509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60af05-70ba-419e-8788-0c1d00a89169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:21.924249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60af05-70ba-419e-8788-0c1d00a89169 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:21.936954 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2821/5632] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:21.938417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60af05-70ba-419e-8788-0c1d00a89169 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:21.950893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60af05-70ba-419e-8788-0c1d00a89169 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:21.982195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c987d49-5808-45a0-ab6d-e783229a63e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:21.992414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ea82e-a23b-4d9e-a22d-2600663cbb2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:21.993079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ea82e-a23b-4d9e-a22d-2600663cbb2f service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:21.993363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ea82e-a23b-4d9e-a22d-2600663cbb2f service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:21.993635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ea82e-a23b-4d9e-a22d-2600663cbb2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:21.997997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3d6ea82e-a23b-4d9e-a22d-2600663cbb2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:22.071831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac54a4-11a1-4f07-9b25-4195b1a41b7f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:22.072826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac54a4-11a1-4f07-9b25-4195b1a41b7f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:22.073791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac54a4-11a1-4f07-9b25-4195b1a41b7f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:22.076253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac54a4-11a1-4f07-9b25-4195b1a41b7f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:22.077215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac54a4-11a1-4f07-9b25-4195b1a41b7f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:22.079966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac54a4-11a1-4f07-9b25-4195b1a41b7f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:22.111707 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2822/5633] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:16:21 2022] POST /identity/v3/roles => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:22.117043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac54a4-11a1-4f07-9b25-4195b1a41b7f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:22.122252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bdac54a4-11a1-4f07-9b25-4195b1a41b7f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:22.147274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:22.161762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac54a4-11a1-4f07-9b25-4195b1a41b7f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:22.170346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5199722-2153-47f7-82ae-470eb18a7ae6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:22.171511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199722-2153-47f7-82ae-470eb18a7ae6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:22.172054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199722-2153-47f7-82ae-470eb18a7ae6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:22.172610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199722-2153-47f7-82ae-470eb18a7ae6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/users/ec837994cae2460d96638e7901eb8e8b/roles/d0a130fa33f147b980b73dd8330a5737/inherited_to_projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:22.199963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5199722-2153-47f7-82ae-470eb18a7ae6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd6c5a237221431b9c5bce7a3862294c, user_id=ec837994cae2460d96638e7901eb8e8b, role_id=d0a130fa33f147b980b73dd8330a5737)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:22.205455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5199722-2153-47f7-82ae-470eb18a7ae6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:22.223043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ea82e-a23b-4d9e-a22d-2600663cbb2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:22.225225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ea82e-a23b-4d9e-a22d-2600663cbb2f service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:22.236989 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2823/5634] 10.222.0.70 () {60 vars in 1582 bytes} [Sun Aug 28 19:16:22 2022] PUT /identity/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/users/ec837994cae2460d96638e7901eb8e8b/roles/d0a130fa33f147b980b73dd8330a5737/inherited_to_projects => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:22.244187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5199722-2153-47f7-82ae-470eb18a7ae6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:22.254773 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2812/5635] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:22.404502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5199722-2153-47f7-82ae-470eb18a7ae6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:22.419254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576f46-cf21-4acd-89c8-fb035bb567b7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:22.420220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576f46-cf21-4acd-89c8-fb035bb567b7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:22.420510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576f46-cf21-4acd-89c8-fb035bb567b7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:22.420884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576f46-cf21-4acd-89c8-fb035bb567b7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/users/ec837994cae2460d96638e7901eb8e8b/roles/d0a130fa33f147b980b73dd8330a5737/inherited_to_projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:22.429811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c576f46-cf21-4acd-89c8-fb035bb567b7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:check_grant(project_id=cd6c5a237221431b9c5bce7a3862294c, user_id=ec837994cae2460d96638e7901eb8e8b, role_id=d0a130fa33f147b980b73dd8330a5737)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:22.430480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c576f46-cf21-4acd-89c8-fb035bb567b7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:22.463064 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2824/5636] 10.222.0.70 () {58 vars in 1564 bytes} [Sun Aug 28 19:16:22 2022] HEAD /identity/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/users/ec837994cae2460d96638e7901eb8e8b/roles/d0a130fa33f147b980b73dd8330a5737/inherited_to_projects => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:22.466979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ea82e-a23b-4d9e-a22d-2600663cbb2f service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:22.483623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ea82e-a23b-4d9e-a22d-2600663cbb2f service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:22.493894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ee272-f881-48f6-b61c-a1def17ea7e4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:22.494590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ee272-f881-48f6-b61c-a1def17ea7e4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:22.494902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ee272-f881-48f6-b61c-a1def17ea7e4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:22.495185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ee272-f881-48f6-b61c-a1def17ea7e4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/users/ec837994cae2460d96638e7901eb8e8b/roles/d0a130fa33f147b980b73dd8330a5737/inherited_to_projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:22.507235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ee272-f881-48f6-b61c-a1def17ea7e4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd6c5a237221431b9c5bce7a3862294c, user_id=ec837994cae2460d96638e7901eb8e8b, role_id=d0a130fa33f147b980b73dd8330a5737)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:22.509959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ee272-f881-48f6-b61c-a1def17ea7e4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:22.538814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e10ee272-f881-48f6-b61c-a1def17ea7e4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invalidating the token cache because role d0a130fa33f147b980b73dd8330a5737 was removed from user ec837994cae2460d96638e7901eb8e8b on project cd6c5a237221431b9c5bce7a3862294c. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:22.539503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e10ee272-f881-48f6-b61c-a1def17ea7e4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:22.541501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e10ee272-f881-48f6-b61c-a1def17ea7e4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:22.599760 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2813/5637] 10.222.0.70 () {58 vars in 1566 bytes} [Sun Aug 28 19:16:22 2022] DELETE /identity/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/users/ec837994cae2460d96638e7901eb8e8b/roles/d0a130fa33f147b980b73dd8330a5737/inherited_to_projects => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:22.601022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576f46-cf21-4acd-89c8-fb035bb567b7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:22.602902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2c576f46-cf21-4acd-89c8-fb035bb567b7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:22.630669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576f46-cf21-4acd-89c8-fb035bb567b7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:22.728603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:22.769762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ab474-83a9-4c21-83b3-24e10aef788d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:22.771618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ab474-83a9-4c21-83b3-24e10aef788d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:22.771961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ab474-83a9-4c21-83b3-24e10aef788d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:22.772322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ab474-83a9-4c21-83b3-24e10aef788d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/roles/d0a130fa33f147b980b73dd8330a5737` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:22.773881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ab474-83a9-4c21-83b3-24e10aef788d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d0a130fa33f147b980b73dd8330a5737)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:22.775588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ab474-83a9-4c21-83b3-24e10aef788d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:22.829683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-773ab474-83a9-4c21-83b3-24e10aef788d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invalidating the token cache because role d0a130fa33f147b980b73dd8330a5737 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:22.830339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-773ab474-83a9-4c21-83b3-24e10aef788d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:22.832442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-773ab474-83a9-4c21-83b3-24e10aef788d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:22.835702 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2825/5638] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:22 2022] DELETE /identity/v3/roles/d0a130fa33f147b980b73dd8330a5737 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:22.840729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ee272-f881-48f6-b61c-a1def17ea7e4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:22.854904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ee272-f881-48f6-b61c-a1def17ea7e4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:22.986368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72b9a7-fbd4-40a1-974e-da8f6117e1e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:22.987173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b9a7-fbd4-40a1-974e-da8f6117e1e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:22.987702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b9a7-fbd4-40a1-974e-da8f6117e1e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:22.988078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b9a7-fbd4-40a1-974e-da8f6117e1e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:22.988855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72b9a7-fbd4-40a1-974e-da8f6117e1e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:22.991981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72b9a7-fbd4-40a1-974e-da8f6117e1e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:23.020145 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2814/5639] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:16:22 2022] POST /identity/v3/roles => generated 240 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:23.024654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ab474-83a9-4c21-83b3-24e10aef788d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:23.026966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-773ab474-83a9-4c21-83b3-24e10aef788d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:23.049594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ab474-83a9-4c21-83b3-24e10aef788d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:23.064454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f5a6d-62f5-4239-a840-fbe1d5c391d7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:23.065962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f5a6d-62f5-4239-a840-fbe1d5c391d7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:23.066268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f5a6d-62f5-4239-a840-fbe1d5c391d7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:23.066559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f5a6d-62f5-4239-a840-fbe1d5c391d7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/groups/69d7b183d7d442f5a84f0470b89cd949/roles/b8de17dad3dc4cde9e41854e7211c0dc/inherited_to_projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:23.070424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f5a6d-62f5-4239-a840-fbe1d5c391d7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=cf017f0eab514221a2144260b625e2a6, group_id=69d7b183d7d442f5a84f0470b89cd949, role_id=b8de17dad3dc4cde9e41854e7211c0dc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:23.073426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f5a6d-62f5-4239-a840-fbe1d5c391d7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:23.108995 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2826/5640] 10.222.0.70 () {60 vars in 1582 bytes} [Sun Aug 28 19:16:23 2022] PUT /identity/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/groups/69d7b183d7d442f5a84f0470b89cd949/roles/b8de17dad3dc4cde9e41854e7211c0dc/inherited_to_projects => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:23.110370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72b9a7-fbd4-40a1-974e-da8f6117e1e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:23.134040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72b9a7-fbd4-40a1-974e-da8f6117e1e6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:23.233088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07a3d1-8c0b-42be-babc-1d48e2b18a2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:23.233338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07a3d1-8c0b-42be-babc-1d48e2b18a2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:23.233605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07a3d1-8c0b-42be-babc-1d48e2b18a2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:23.233965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07a3d1-8c0b-42be-babc-1d48e2b18a2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/groups/69d7b183d7d442f5a84f0470b89cd949/roles/inherited_to_projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:23.237348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07a3d1-8c0b-42be-babc-1d48e2b18a2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=cf017f0eab514221a2144260b625e2a6, group_id=69d7b183d7d442f5a84f0470b89cd949)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:23.241365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07a3d1-8c0b-42be-babc-1d48e2b18a2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:23.264652 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2815/5641] 10.222.0.70 () {58 vars in 1464 bytes} [Sun Aug 28 19:16:23 2022] GET /identity/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/groups/69d7b183d7d442f5a84f0470b89cd949/roles/inherited_to_projects => generated 448 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:23.269213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f5a6d-62f5-4239-a840-fbe1d5c391d7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:23.284987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f5a6d-62f5-4239-a840-fbe1d5c391d7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:23.298540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b517df-24bd-471c-b1a9-1b523a5f4e55 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:23.300867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b517df-24bd-471c-b1a9-1b523a5f4e55 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:23.300867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b517df-24bd-471c-b1a9-1b523a5f4e55 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:23.301122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b517df-24bd-471c-b1a9-1b523a5f4e55 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/groups/69d7b183d7d442f5a84f0470b89cd949/roles/b8de17dad3dc4cde9e41854e7211c0dc/inherited_to_projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:23.307736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b517df-24bd-471c-b1a9-1b523a5f4e55 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=cf017f0eab514221a2144260b625e2a6, group_id=69d7b183d7d442f5a84f0470b89cd949, role_id=b8de17dad3dc4cde9e41854e7211c0dc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:23.315187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b517df-24bd-471c-b1a9-1b523a5f4e55 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:23.331551 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2827/5642] 10.222.0.70 () {58 vars in 1564 bytes} [Sun Aug 28 19:16:23 2022] HEAD /identity/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/groups/69d7b183d7d442f5a84f0470b89cd949/roles/b8de17dad3dc4cde9e41854e7211c0dc/inherited_to_projects => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:23.335114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07a3d1-8c0b-42be-babc-1d48e2b18a2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:23.347990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07a3d1-8c0b-42be-babc-1d48e2b18a2d tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:23.354034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69698b9-1f3f-41cc-a914-2667989edbc9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:23.354921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69698b9-1f3f-41cc-a914-2667989edbc9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:23.355210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69698b9-1f3f-41cc-a914-2667989edbc9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:23.355494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69698b9-1f3f-41cc-a914-2667989edbc9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/groups/69d7b183d7d442f5a84f0470b89cd949/roles/b8de17dad3dc4cde9e41854e7211c0dc/inherited_to_projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:23.358005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69698b9-1f3f-41cc-a914-2667989edbc9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=cf017f0eab514221a2144260b625e2a6, group_id=69d7b183d7d442f5a84f0470b89cd949, role_id=b8de17dad3dc4cde9e41854e7211c0dc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:23.360984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69698b9-1f3f-41cc-a914-2667989edbc9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:23.368313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e69698b9-1f3f-41cc-a914-2667989edbc9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invalidating the token cache because role b8de17dad3dc4cde9e41854e7211c0dc was removed from group 69d7b183d7d442f5a84f0470b89cd949 on domain cf017f0eab514221a2144260b625e2a6. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:23.368768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e69698b9-1f3f-41cc-a914-2667989edbc9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:23.369581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e69698b9-1f3f-41cc-a914-2667989edbc9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:23.401745 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2816/5643] 10.222.0.70 () {58 vars in 1566 bytes} [Sun Aug 28 19:16:23 2022] DELETE /identity/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/groups/69d7b183d7d442f5a84f0470b89cd949/roles/b8de17dad3dc4cde9e41854e7211c0dc/inherited_to_projects => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:23.403974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b517df-24bd-471c-b1a9-1b523a5f4e55 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:23.406229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-30b517df-24bd-471c-b1a9-1b523a5f4e55 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:23.429369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b517df-24bd-471c-b1a9-1b523a5f4e55 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:23.546582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea77fa-c557-46ee-af42-0d9154f82d02 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:23.547960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea77fa-c557-46ee-af42-0d9154f82d02 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:23.548384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea77fa-c557-46ee-af42-0d9154f82d02 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:23.548841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea77fa-c557-46ee-af42-0d9154f82d02 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/roles/b8de17dad3dc4cde9e41854e7211c0dc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:23.550854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea77fa-c557-46ee-af42-0d9154f82d02 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b8de17dad3dc4cde9e41854e7211c0dc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:23.555912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea77fa-c557-46ee-af42-0d9154f82d02 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:23.648013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a7ea77fa-c557-46ee-af42-0d9154f82d02 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invalidating the token cache because role b8de17dad3dc4cde9e41854e7211c0dc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:23.648896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a7ea77fa-c557-46ee-af42-0d9154f82d02 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:23.651026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a7ea77fa-c557-46ee-af42-0d9154f82d02 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:23.659405 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2828/5644] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:23 2022] DELETE /identity/v3/roles/b8de17dad3dc4cde9e41854e7211c0dc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:23.665681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69698b9-1f3f-41cc-a914-2667989edbc9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:23.680049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69698b9-1f3f-41cc-a914-2667989edbc9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:23.740347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:23.797539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4697c-80f2-40d5-96f5-3b37ab043468 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:23.798501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4697c-80f2-40d5-96f5-3b37ab043468 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:23.798993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4697c-80f2-40d5-96f5-3b37ab043468 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:23.799433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4697c-80f2-40d5-96f5-3b37ab043468 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:23.800435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4697c-80f2-40d5-96f5-3b37ab043468 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:23.802367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4697c-80f2-40d5-96f5-3b37ab043468 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:23.835420 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2817/5645] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:16:23 2022] POST /identity/v3/roles => generated 239 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:23.840363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea77fa-c557-46ee-af42-0d9154f82d02 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:23.841922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a7ea77fa-c557-46ee-af42-0d9154f82d02 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:23.861538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea77fa-c557-46ee-af42-0d9154f82d02 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:23.869210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c58b3-7b17-484f-9598-3019fdb2cd18 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:23.870248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c58b3-7b17-484f-9598-3019fdb2cd18 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:23.870703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c58b3-7b17-484f-9598-3019fdb2cd18 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:23.871249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c58b3-7b17-484f-9598-3019fdb2cd18 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/users/ec837994cae2460d96638e7901eb8e8b/roles/7a094931e5e54fa3a7eaf44ddc6e8fa4/inherited_to_projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:23.876848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c58b3-7b17-484f-9598-3019fdb2cd18 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=cf017f0eab514221a2144260b625e2a6, user_id=ec837994cae2460d96638e7901eb8e8b, role_id=7a094931e5e54fa3a7eaf44ddc6e8fa4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:23.882374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c58b3-7b17-484f-9598-3019fdb2cd18 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:23.902182 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2829/5646] 10.222.0.70 () {60 vars in 1579 bytes} [Sun Aug 28 19:16:23 2022] PUT /identity/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/users/ec837994cae2460d96638e7901eb8e8b/roles/7a094931e5e54fa3a7eaf44ddc6e8fa4/inherited_to_projects => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:23.906195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4697c-80f2-40d5-96f5-3b37ab043468 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:23.924303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4697c-80f2-40d5-96f5-3b37ab043468 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:24.092290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df1e9c-cb94-45f2-93de-6c7a7efbc015 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:24.092987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df1e9c-cb94-45f2-93de-6c7a7efbc015 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:24.093259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df1e9c-cb94-45f2-93de-6c7a7efbc015 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:24.093550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df1e9c-cb94-45f2-93de-6c7a7efbc015 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/users/ec837994cae2460d96638e7901eb8e8b/roles/inherited_to_projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:24.102606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df1e9c-cb94-45f2-93de-6c7a7efbc015 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=cf017f0eab514221a2144260b625e2a6, user_id=ec837994cae2460d96638e7901eb8e8b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:24.109159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df1e9c-cb94-45f2-93de-6c7a7efbc015 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:24.120492 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2818/5647] 10.222.0.70 () {58 vars in 1461 bytes} [Sun Aug 28 19:16:23 2022] GET /identity/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/users/ec837994cae2460d96638e7901eb8e8b/roles/inherited_to_projects => generated 446 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:24.124766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c58b3-7b17-484f-9598-3019fdb2cd18 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:24.140071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c58b3-7b17-484f-9598-3019fdb2cd18 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:24.151692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992567cb-5990-4c51-9e5d-81bd6fb770e2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:24.152997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992567cb-5990-4c51-9e5d-81bd6fb770e2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:24.152997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992567cb-5990-4c51-9e5d-81bd6fb770e2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:24.153260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992567cb-5990-4c51-9e5d-81bd6fb770e2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/users/ec837994cae2460d96638e7901eb8e8b/roles/7a094931e5e54fa3a7eaf44ddc6e8fa4/inherited_to_projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:24.155676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992567cb-5990-4c51-9e5d-81bd6fb770e2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=cf017f0eab514221a2144260b625e2a6, user_id=ec837994cae2460d96638e7901eb8e8b, role_id=7a094931e5e54fa3a7eaf44ddc6e8fa4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:24.158970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992567cb-5990-4c51-9e5d-81bd6fb770e2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:24.166931 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2830/5648] 10.222.0.70 () {58 vars in 1561 bytes} [Sun Aug 28 19:16:24 2022] HEAD /identity/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/users/ec837994cae2460d96638e7901eb8e8b/roles/7a094931e5e54fa3a7eaf44ddc6e8fa4/inherited_to_projects => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:24.171054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df1e9c-cb94-45f2-93de-6c7a7efbc015 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:24.184582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df1e9c-cb94-45f2-93de-6c7a7efbc015 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:24.190319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ada3e0-8fd1-4b4e-8241-20e0689d277a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:24.191595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada3e0-8fd1-4b4e-8241-20e0689d277a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:24.191595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada3e0-8fd1-4b4e-8241-20e0689d277a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:24.191830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada3e0-8fd1-4b4e-8241-20e0689d277a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/users/ec837994cae2460d96638e7901eb8e8b/roles/7a094931e5e54fa3a7eaf44ddc6e8fa4/inherited_to_projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:24.194506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ada3e0-8fd1-4b4e-8241-20e0689d277a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=cf017f0eab514221a2144260b625e2a6, user_id=ec837994cae2460d96638e7901eb8e8b, role_id=7a094931e5e54fa3a7eaf44ddc6e8fa4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:24.197480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ada3e0-8fd1-4b4e-8241-20e0689d277a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:24.204157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1ada3e0-8fd1-4b4e-8241-20e0689d277a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invalidating the token cache because role 7a094931e5e54fa3a7eaf44ddc6e8fa4 was removed from user ec837994cae2460d96638e7901eb8e8b on domain cf017f0eab514221a2144260b625e2a6. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:24.204591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1ada3e0-8fd1-4b4e-8241-20e0689d277a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:24.205526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1ada3e0-8fd1-4b4e-8241-20e0689d277a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:24.233666 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2819/5649] 10.222.0.70 () {58 vars in 1563 bytes} [Sun Aug 28 19:16:24 2022] DELETE /identity/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/users/ec837994cae2460d96638e7901eb8e8b/roles/7a094931e5e54fa3a7eaf44ddc6e8fa4/inherited_to_projects => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:24.238054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992567cb-5990-4c51-9e5d-81bd6fb770e2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:24.241862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-992567cb-5990-4c51-9e5d-81bd6fb770e2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:24.268673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992567cb-5990-4c51-9e5d-81bd6fb770e2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:24.339668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:24.415143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c5ae2-cc68-481a-8f9b-4ad46081e037 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:24.415747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c5ae2-cc68-481a-8f9b-4ad46081e037 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:24.416138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c5ae2-cc68-481a-8f9b-4ad46081e037 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:24.416534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c5ae2-cc68-481a-8f9b-4ad46081e037 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/roles/7a094931e5e54fa3a7eaf44ddc6e8fa4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:24.420389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c5ae2-cc68-481a-8f9b-4ad46081e037 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7a094931e5e54fa3a7eaf44ddc6e8fa4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:24.422854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c5ae2-cc68-481a-8f9b-4ad46081e037 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:24.516708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-766c5ae2-cc68-481a-8f9b-4ad46081e037 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invalidating the token cache because role 7a094931e5e54fa3a7eaf44ddc6e8fa4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:24.517177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-766c5ae2-cc68-481a-8f9b-4ad46081e037 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:24.520224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-766c5ae2-cc68-481a-8f9b-4ad46081e037 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:24.527581 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2831/5650] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:24 2022] DELETE /identity/v3/roles/7a094931e5e54fa3a7eaf44ddc6e8fa4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:24.532965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ada3e0-8fd1-4b4e-8241-20e0689d277a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:24.544817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ada3e0-8fd1-4b4e-8241-20e0689d277a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:24.636975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac59dd-45be-4692-8734-815157e1cfd9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:24.638517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac59dd-45be-4692-8734-815157e1cfd9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:24.638848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac59dd-45be-4692-8734-815157e1cfd9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:24.639129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac59dd-45be-4692-8734-815157e1cfd9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:24.639828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac59dd-45be-4692-8734-815157e1cfd9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:24.641585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac59dd-45be-4692-8734-815157e1cfd9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:24.665370 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2820/5651] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:16:24 2022] POST /identity/v3/roles => generated 237 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:24.669386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c5ae2-cc68-481a-8f9b-4ad46081e037 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:24.671191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-766c5ae2-cc68-481a-8f9b-4ad46081e037 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:24.702232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c5ae2-cc68-481a-8f9b-4ad46081e037 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:24.708021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54e48a-c135-4668-8af4-aeadd65c3bdb tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:24.709436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54e48a-c135-4668-8af4-aeadd65c3bdb tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:24.709789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54e48a-c135-4668-8af4-aeadd65c3bdb tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:24.710132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54e48a-c135-4668-8af4-aeadd65c3bdb tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:24.711189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54e48a-c135-4668-8af4-aeadd65c3bdb tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:24.713479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54e48a-c135-4668-8af4-aeadd65c3bdb tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:24.823421 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2832/5652] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:24 2022] POST /identity/v3/projects => generated 410 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:16:24.824420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac59dd-45be-4692-8734-815157e1cfd9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:24.836635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac59dd-45be-4692-8734-815157e1cfd9 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:24.923002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:24.989680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e023673-eb95-4c3f-96ca-512c86acd249 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:24.990607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e023673-eb95-4c3f-96ca-512c86acd249 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:24.992073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e023673-eb95-4c3f-96ca-512c86acd249 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:24.992487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e023673-eb95-4c3f-96ca-512c86acd249 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/users/ec837994cae2460d96638e7901eb8e8b/roles/57f47342892444ec8ec99ae5aba180a7/inherited_to_projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:24.997837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e023673-eb95-4c3f-96ca-512c86acd249 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=cf017f0eab514221a2144260b625e2a6, user_id=ec837994cae2460d96638e7901eb8e8b, role_id=57f47342892444ec8ec99ae5aba180a7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:25.007783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e023673-eb95-4c3f-96ca-512c86acd249 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:25.045107 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2821/5653] 10.222.0.70 () {60 vars in 1579 bytes} [Sun Aug 28 19:16:24 2022] PUT /identity/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/users/ec837994cae2460d96638e7901eb8e8b/roles/57f47342892444ec8ec99ae5aba180a7/inherited_to_projects => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:25.051502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54e48a-c135-4668-8af4-aeadd65c3bdb tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:25.075701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54e48a-c135-4668-8af4-aeadd65c3bdb tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:25.191976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2c791-03d0-482e-8321-6557f0cda851 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:25.192851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2c791-03d0-482e-8321-6557f0cda851 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:25.193295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2c791-03d0-482e-8321-6557f0cda851 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:25.193981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2c791-03d0-482e-8321-6557f0cda851 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:25.194860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2c791-03d0-482e-8321-6557f0cda851 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Adding query filter params (scope.project.id=cd6c5a237221431b9c5bce7a3862294c, user.id=ec837994cae2460d96638e7901eb8e8b) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:25.195280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2c791-03d0-482e-8321-6557f0cda851 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:25.197342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2c791-03d0-482e-8321-6557f0cda851 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:25.285683 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2833/5654] 10.222.0.70 () {58 vars in 1356 bytes} [Sun Aug 28 19:16:25 2022] GET /identity/v3/role_assignments?scope.project.id=cd6c5a237221431b9c5bce7a3862294c&user.id=ec837994cae2460d96638e7901eb8e8b&effective => generated 648 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:25.288122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e023673-eb95-4c3f-96ca-512c86acd249 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:25.303546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e023673-eb95-4c3f-96ca-512c86acd249 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:25.310185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a55877-7b49-449e-8328-8c881b7022b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:25.311238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a55877-7b49-449e-8328-8c881b7022b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:25.311802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a55877-7b49-449e-8328-8c881b7022b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:25.323455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a55877-7b49-449e-8328-8c881b7022b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:25.324680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a55877-7b49-449e-8328-8c881b7022b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Adding query filter params (scope.project.id=0b53741d706745a692482ce7016b94bc, user.id=ec837994cae2460d96638e7901eb8e8b) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:25.325241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a55877-7b49-449e-8328-8c881b7022b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:25.332108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a55877-7b49-449e-8328-8c881b7022b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:25.409031 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2822/5655] 10.222.0.70 () {58 vars in 1356 bytes} [Sun Aug 28 19:16:25 2022] GET /identity/v3/role_assignments?scope.project.id=0b53741d706745a692482ce7016b94bc&user.id=ec837994cae2460d96638e7901eb8e8b&effective => generated 648 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:25.413319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2c791-03d0-482e-8321-6557f0cda851 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:25.423945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2c791-03d0-482e-8321-6557f0cda851 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:25.430579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524137c-8c26-4e39-853f-c2b19cafb0b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:25.431391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524137c-8c26-4e39-853f-c2b19cafb0b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:25.431678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524137c-8c26-4e39-853f-c2b19cafb0b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:25.432059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524137c-8c26-4e39-853f-c2b19cafb0b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/users/ec837994cae2460d96638e7901eb8e8b/roles/57f47342892444ec8ec99ae5aba180a7/inherited_to_projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:25.435110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524137c-8c26-4e39-853f-c2b19cafb0b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=cf017f0eab514221a2144260b625e2a6, user_id=ec837994cae2460d96638e7901eb8e8b, role_id=57f47342892444ec8ec99ae5aba180a7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:25.437919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524137c-8c26-4e39-853f-c2b19cafb0b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:25.445545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c524137c-8c26-4e39-853f-c2b19cafb0b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invalidating the token cache because role 57f47342892444ec8ec99ae5aba180a7 was removed from user ec837994cae2460d96638e7901eb8e8b on domain cf017f0eab514221a2144260b625e2a6. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:25.446089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c524137c-8c26-4e39-853f-c2b19cafb0b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:25.447198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c524137c-8c26-4e39-853f-c2b19cafb0b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:25.477680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a55877-7b49-449e-8328-8c881b7022b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:25.478780 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2834/5656] 10.222.0.70 () {58 vars in 1563 bytes} [Sun Aug 28 19:16:25 2022] DELETE /identity/v3/OS-INHERIT/domains/cf017f0eab514221a2144260b625e2a6/users/ec837994cae2460d96638e7901eb8e8b/roles/57f47342892444ec8ec99ae5aba180a7/inherited_to_projects => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:25.479814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e8a55877-7b49-449e-8328-8c881b7022b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:25.517851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a55877-7b49-449e-8328-8c881b7022b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:25.660869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b176c9a-3ee6-4c71-b133-631ef033dbf3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:25.662365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b176c9a-3ee6-4c71-b133-631ef033dbf3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:25.662662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b176c9a-3ee6-4c71-b133-631ef033dbf3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:25.662975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b176c9a-3ee6-4c71-b133-631ef033dbf3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:25.663729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b176c9a-3ee6-4c71-b133-631ef033dbf3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Adding query filter params (scope.project.id=cd6c5a237221431b9c5bce7a3862294c, user.id=ec837994cae2460d96638e7901eb8e8b) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:25.664044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b176c9a-3ee6-4c71-b133-631ef033dbf3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:25.666427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b176c9a-3ee6-4c71-b133-631ef033dbf3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:25.752203 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2823/5657] 10.222.0.70 () {58 vars in 1356 bytes} [Sun Aug 28 19:16:25 2022] GET /identity/v3/role_assignments?scope.project.id=cd6c5a237221431b9c5bce7a3862294c&user.id=ec837994cae2460d96638e7901eb8e8b&effective => generated 228 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:25.757370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524137c-8c26-4e39-853f-c2b19cafb0b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:25.767695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:25.775078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524137c-8c26-4e39-853f-c2b19cafb0b8 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:25.791786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257d712-6666-43d6-b84f-5056d4f72a6f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:25.795363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d712-6666-43d6-b84f-5056d4f72a6f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:25.795890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d712-6666-43d6-b84f-5056d4f72a6f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:25.796299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d712-6666-43d6-b84f-5056d4f72a6f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:25.797192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257d712-6666-43d6-b84f-5056d4f72a6f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Adding query filter params (scope.project.id=0b53741d706745a692482ce7016b94bc, user.id=ec837994cae2460d96638e7901eb8e8b) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:25.797613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257d712-6666-43d6-b84f-5056d4f72a6f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:25.800458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257d712-6666-43d6-b84f-5056d4f72a6f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:25.943605 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2835/5658] 10.222.0.70 () {58 vars in 1356 bytes} [Sun Aug 28 19:16:25 2022] GET /identity/v3/role_assignments?scope.project.id=0b53741d706745a692482ce7016b94bc&user.id=ec837994cae2460d96638e7901eb8e8b&effective => generated 228 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:25.948163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b176c9a-3ee6-4c71-b133-631ef033dbf3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:25.963868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b176c9a-3ee6-4c71-b133-631ef033dbf3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:25.982288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:25.983156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:25.983569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:25.983950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/projects/0b53741d706745a692482ce7016b94bc` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:25.985578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0b53741d706745a692482ce7016b94bc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:25.987935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:26.064414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:26.106653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b53741d706745a692482ce7016b94bc', 'request_id': 'req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:26.146855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b53741d706745a692482ce7016b94bc', 'request_id': 'req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:26.155393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b53741d706745a692482ce7016b94bc', 'request_id': 'req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:26.183729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] The token cache is being invalidate because project 0b53741d706745a692482ce7016b94bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:26.183729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:26.186282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:26.191185 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2824/5659] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:25 2022] DELETE /identity/v3/projects/0b53741d706745a692482ce7016b94bc => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:26.193110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257d712-6666-43d6-b84f-5056d4f72a6f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:26.196460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1257d712-6666-43d6-b84f-5056d4f72a6f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:26.218232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257d712-6666-43d6-b84f-5056d4f72a6f tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:26.465447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f4cf8-485f-42fb-a1b8-4064f573e7ee tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:26.466815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f4cf8-485f-42fb-a1b8-4064f573e7ee tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:26.467110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f4cf8-485f-42fb-a1b8-4064f573e7ee tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:26.467536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f4cf8-485f-42fb-a1b8-4064f573e7ee tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/roles/57f47342892444ec8ec99ae5aba180a7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:26.469929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f4cf8-485f-42fb-a1b8-4064f573e7ee tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:delete_role(role_id=57f47342892444ec8ec99ae5aba180a7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:26.473275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f4cf8-485f-42fb-a1b8-4064f573e7ee tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:26.547391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5f5f4cf8-485f-42fb-a1b8-4064f573e7ee tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invalidating the token cache because role 57f47342892444ec8ec99ae5aba180a7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:26.548182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5f5f4cf8-485f-42fb-a1b8-4064f573e7ee tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:26.558181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5f5f4cf8-485f-42fb-a1b8-4064f573e7ee tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:26.568871 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2836/5660] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:26 2022] DELETE /identity/v3/roles/57f47342892444ec8ec99ae5aba180a7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:26.573983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:26.596240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad0917-d9b6-4b44-8b5d-e74e08ab10e0 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:26.717146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d974d19-b666-44d9-84d8-b7a0ca90fbfc tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:26.718571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d974d19-b666-44d9-84d8-b7a0ca90fbfc tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:26.719049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d974d19-b666-44d9-84d8-b7a0ca90fbfc tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:26.719638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d974d19-b666-44d9-84d8-b7a0ca90fbfc tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:26.720333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d974d19-b666-44d9-84d8-b7a0ca90fbfc tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:26.721974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d974d19-b666-44d9-84d8-b7a0ca90fbfc tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:26.747074 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2825/5661] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:16:26 2022] POST /identity/v3/roles => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:26.751087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f4cf8-485f-42fb-a1b8-4064f573e7ee tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:26.752775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5f5f4cf8-485f-42fb-a1b8-4064f573e7ee tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:26.776601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f4cf8-485f-42fb-a1b8-4064f573e7ee tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:26.783784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1933e34-6936-4a2a-b311-e9bce1ee6d61 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:26.784786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1933e34-6936-4a2a-b311-e9bce1ee6d61 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:26.784786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1933e34-6936-4a2a-b311-e9bce1ee6d61 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:26.785480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1933e34-6936-4a2a-b311-e9bce1ee6d61 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:26.786627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1933e34-6936-4a2a-b311-e9bce1ee6d61 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:26.789590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1933e34-6936-4a2a-b311-e9bce1ee6d61 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:26.873111 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2837/5662] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:26 2022] POST /identity/v3/projects => generated 410 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:26.877038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d974d19-b666-44d9-84d8-b7a0ca90fbfc tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:26.924410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d974d19-b666-44d9-84d8-b7a0ca90fbfc tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:27.059238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19969ea-0948-4ba6-8c26-0b1b7225aff6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:27.059882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19969ea-0948-4ba6-8c26-0b1b7225aff6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:27.060173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19969ea-0948-4ba6-8c26-0b1b7225aff6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:27.060459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19969ea-0948-4ba6-8c26-0b1b7225aff6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/users/ec837994cae2460d96638e7901eb8e8b/roles/8632827c928f410cb76ef868d418f150/inherited_to_projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:27.070585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19969ea-0948-4ba6-8c26-0b1b7225aff6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cd6c5a237221431b9c5bce7a3862294c, user_id=ec837994cae2460d96638e7901eb8e8b, role_id=8632827c928f410cb76ef868d418f150)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:27.080416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19969ea-0948-4ba6-8c26-0b1b7225aff6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:27.116768 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2826/5663] 10.222.0.70 () {60 vars in 1582 bytes} [Sun Aug 28 19:16:26 2022] PUT /identity/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/users/ec837994cae2460d96638e7901eb8e8b/roles/8632827c928f410cb76ef868d418f150/inherited_to_projects => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:27.120802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1933e34-6936-4a2a-b311-e9bce1ee6d61 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:27.136622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1933e34-6936-4a2a-b311-e9bce1ee6d61 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:27.274853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:27.298434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891e5d0-0035-4cad-bb85-37be405e982c tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:27.299817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e5d0-0035-4cad-bb85-37be405e982c tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:27.300247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e5d0-0035-4cad-bb85-37be405e982c tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:27.300435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891e5d0-0035-4cad-bb85-37be405e982c tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:27.301135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e5d0-0035-4cad-bb85-37be405e982c tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Adding query filter params (scope.project.id=608c2227080f4e26b84dfbdade00cb07, user.id=ec837994cae2460d96638e7901eb8e8b) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:27.302134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e5d0-0035-4cad-bb85-37be405e982c tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:27.306089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891e5d0-0035-4cad-bb85-37be405e982c tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:27.450593 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2838/5664] 10.222.0.70 () {58 vars in 1356 bytes} [Sun Aug 28 19:16:27 2022] GET /identity/v3/role_assignments?scope.project.id=608c2227080f4e26b84dfbdade00cb07&user.id=ec837994cae2460d96638e7901eb8e8b&effective => generated 649 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:27.455129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19969ea-0948-4ba6-8c26-0b1b7225aff6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:27.474710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19969ea-0948-4ba6-8c26-0b1b7225aff6 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:27.489053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d70f02-9eee-4e28-949b-b97952297ca4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:27.489763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d70f02-9eee-4e28-949b-b97952297ca4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:27.490055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d70f02-9eee-4e28-949b-b97952297ca4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:27.490340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d70f02-9eee-4e28-949b-b97952297ca4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/users/ec837994cae2460d96638e7901eb8e8b/roles/8632827c928f410cb76ef868d418f150/inherited_to_projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:27.498035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d70f02-9eee-4e28-949b-b97952297ca4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=cd6c5a237221431b9c5bce7a3862294c, user_id=ec837994cae2460d96638e7901eb8e8b, role_id=8632827c928f410cb76ef868d418f150)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:27.500762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d70f02-9eee-4e28-949b-b97952297ca4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:27.519061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-97d70f02-9eee-4e28-949b-b97952297ca4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invalidating the token cache because role 8632827c928f410cb76ef868d418f150 was removed from user ec837994cae2460d96638e7901eb8e8b on project cd6c5a237221431b9c5bce7a3862294c. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:27.519372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-97d70f02-9eee-4e28-949b-b97952297ca4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:27.527895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-97d70f02-9eee-4e28-949b-b97952297ca4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:27.570053 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2827/5665] 10.222.0.70 () {58 vars in 1566 bytes} [Sun Aug 28 19:16:27 2022] DELETE /identity/v3/OS-INHERIT/projects/cd6c5a237221431b9c5bce7a3862294c/users/ec837994cae2460d96638e7901eb8e8b/roles/8632827c928f410cb76ef868d418f150/inherited_to_projects => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:27.574161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891e5d0-0035-4cad-bb85-37be405e982c tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:27.576076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3891e5d0-0035-4cad-bb85-37be405e982c tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:27.603830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891e5d0-0035-4cad-bb85-37be405e982c tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:27.767767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67572161-5641-4b79-875b-99239fcd2020 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:27.771362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572161-5641-4b79-875b-99239fcd2020 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:27.771692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572161-5641-4b79-875b-99239fcd2020 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:27.773905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572161-5641-4b79-875b-99239fcd2020 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:27.776259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67572161-5641-4b79-875b-99239fcd2020 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Adding query filter params (scope.project.id=608c2227080f4e26b84dfbdade00cb07, user.id=ec837994cae2460d96638e7901eb8e8b) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:27.776611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67572161-5641-4b79-875b-99239fcd2020 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:27.779656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67572161-5641-4b79-875b-99239fcd2020 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:27.909139 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2839/5666] 10.222.0.70 () {58 vars in 1356 bytes} [Sun Aug 28 19:16:27 2022] GET /identity/v3/role_assignments?scope.project.id=608c2227080f4e26b84dfbdade00cb07&user.id=ec837994cae2460d96638e7901eb8e8b&effective => generated 228 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:27.910424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d70f02-9eee-4e28-949b-b97952297ca4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:27.929263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d70f02-9eee-4e28-949b-b97952297ca4 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:27.943512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:27.944688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:27.945537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:27.946670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/projects/608c2227080f4e26b84dfbdade00cb07` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:27.952018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=608c2227080f4e26b84dfbdade00cb07)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:27.955555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:28.021477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:28.118130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608c2227080f4e26b84dfbdade00cb07', 'request_id': 'req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:28.148248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608c2227080f4e26b84dfbdade00cb07', 'request_id': 'req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:28.159017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608c2227080f4e26b84dfbdade00cb07', 'request_id': 'req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:28.211289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] The token cache is being invalidate because project 608c2227080f4e26b84dfbdade00cb07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:28.211397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:28.220370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:28.231459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67572161-5641-4b79-875b-99239fcd2020 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:28.231690 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2828/5667] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:27 2022] DELETE /identity/v3/projects/608c2227080f4e26b84dfbdade00cb07 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:28.234428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-67572161-5641-4b79-875b-99239fcd2020 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:28.267338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67572161-5641-4b79-875b-99239fcd2020 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:28.394528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc629bb-aba6-4d4e-b4f5-c1db6775a3a3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:28.395988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc629bb-aba6-4d4e-b4f5-c1db6775a3a3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:28.396607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc629bb-aba6-4d4e-b4f5-c1db6775a3a3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:28.396887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc629bb-aba6-4d4e-b4f5-c1db6775a3a3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/roles/8632827c928f410cb76ef868d418f150` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:28.398685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc629bb-aba6-4d4e-b4f5-c1db6775a3a3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8632827c928f410cb76ef868d418f150)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:28.400483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc629bb-aba6-4d4e-b4f5-c1db6775a3a3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:28.403301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:28.496330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8cc629bb-aba6-4d4e-b4f5-c1db6775a3a3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invalidating the token cache because role 8632827c928f410cb76ef868d418f150 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:28.496660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8cc629bb-aba6-4d4e-b4f5-c1db6775a3a3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:28.500342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8cc629bb-aba6-4d4e-b4f5-c1db6775a3a3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:28.506455 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2840/5668] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:28 2022] DELETE /identity/v3/roles/8632827c928f410cb76ef868d418f150 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:28.513332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:28.560406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca01c4-1749-4167-a07b-5eb02a0d1f9b tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:28.683166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:28.685580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:28.685580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:28.685580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/users/ec837994cae2460d96638e7901eb8e8b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:28.686578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ec837994cae2460d96638e7901eb8e8b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:28.688583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:28.800943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec837994cae2460d96638e7901eb8e8b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:28.826852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec837994cae2460d96638e7901eb8e8b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:28.828465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec837994cae2460d96638e7901eb8e8b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:28.906335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec837994cae2460d96638e7901eb8e8b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:28.907106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec837994cae2460d96638e7901eb8e8b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:28.951908 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2829/5669] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:28 2022] DELETE /identity/v3/users/ec837994cae2460d96638e7901eb8e8b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:28.956556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc629bb-aba6-4d4e-b4f5-c1db6775a3a3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:28.958592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8cc629bb-aba6-4d4e-b4f5-c1db6775a3a3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:29.013103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc629bb-aba6-4d4e-b4f5-c1db6775a3a3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:29.211758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88477593-de31-4eae-96a7-cc008e97fac2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:29.212431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88477593-de31-4eae-96a7-cc008e97fac2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:29.213135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88477593-de31-4eae-96a7-cc008e97fac2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:29.213135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88477593-de31-4eae-96a7-cc008e97fac2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/groups/69d7b183d7d442f5a84f0470b89cd949` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:29.219182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88477593-de31-4eae-96a7-cc008e97fac2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:delete_group(group_id=69d7b183d7d442f5a84f0470b89cd949)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:29.221152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88477593-de31-4eae-96a7-cc008e97fac2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:29.300623 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2841/5670] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:16:28 2022] DELETE /identity/v3/groups/69d7b183d7d442f5a84f0470b89cd949 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:29.305072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:29.306954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:29.337243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18fc33-caa6-4cf4-80aa-dc651f16807a tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:29.373734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:29.451538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:29.452746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:29.452746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:29.453196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/projects/cd6c5a237221431b9c5bce7a3862294c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:29.455445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cd6c5a237221431b9c5bce7a3862294c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:29.458359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:29.615833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6c5a237221431b9c5bce7a3862294c', 'request_id': 'req-9804fd59-973b-4f23-95b8-5de9a0d071f7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:29.630404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6c5a237221431b9c5bce7a3862294c', 'request_id': 'req-9804fd59-973b-4f23-95b8-5de9a0d071f7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:29.637980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6c5a237221431b9c5bce7a3862294c', 'request_id': 'req-9804fd59-973b-4f23-95b8-5de9a0d071f7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:29.652029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] The token cache is being invalidate because project cd6c5a237221431b9c5bce7a3862294c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:29.653397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:29.653397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:29.655116 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2830/5671] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:29 2022] DELETE /identity/v3/projects/cd6c5a237221431b9c5bce7a3862294c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:29.659166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88477593-de31-4eae-96a7-cc008e97fac2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:29.661433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-88477593-de31-4eae-96a7-cc008e97fac2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:29.676643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88477593-de31-4eae-96a7-cc008e97fac2 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:29.764023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fcf58-e70f-4243-912b-beb3a3c39a07 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:29.764883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fcf58-e70f-4243-912b-beb3a3c39a07 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:29.765267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fcf58-e70f-4243-912b-beb3a3c39a07 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:29.765725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fcf58-e70f-4243-912b-beb3a3c39a07 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/domains/cf017f0eab514221a2144260b625e2a6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:29.767986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fcf58-e70f-4243-912b-beb3a3c39a07 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cf017f0eab514221a2144260b625e2a6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:29.770153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fcf58-e70f-4243-912b-beb3a3c39a07 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:29.800293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d00fcf58-e70f-4243-912b-beb3a3c39a07 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cf017f0eab514221a2144260b625e2a6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:29.801426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d00fcf58-e70f-4243-912b-beb3a3c39a07 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cf017f0eab514221a2144260b625e2a6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:29.839302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:29.877062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d00fcf58-e70f-4243-912b-beb3a3c39a07 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cf017f0eab514221a2144260b625e2a6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:29.877963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d00fcf58-e70f-4243-912b-beb3a3c39a07 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cf017f0eab514221a2144260b625e2a6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:29.885471 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2842/5672] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:16:29 2022] PATCH /identity/v3/domains/cf017f0eab514221a2144260b625e2a6 => generated 277 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:29.889024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:29.903092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804fd59-973b-4f23-95b8-5de9a0d071f7 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:30.023401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f313e8c7ebb84069bdc8e79cb050ede4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6334548851d64b3ba6ab182b863e3af8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:30.024053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:30.024341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:30.024626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] PATH_INFO: `/v3/domains/cf017f0eab514221a2144260b625e2a6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:30.063880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cf017f0eab514221a2144260b625e2a6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:30.065593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:30.139538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cf017f0eab514221a2144260b625e2a6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:30.151224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cf017f0eab514221a2144260b625e2a6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:30.327832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:30.405652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf017f0eab514221a2144260b625e2a6', 'request_id': 'req-1b21daca-98a1-42b3-839c-87a41db18eb3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:30.431723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf017f0eab514221a2144260b625e2a6', 'request_id': 'req-1b21daca-98a1-42b3-839c-87a41db18eb3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:30.439429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf017f0eab514221a2144260b625e2a6', 'request_id': 'req-1b21daca-98a1-42b3-839c-87a41db18eb3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:30.478608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] The token cache is being invalidate because project cf017f0eab514221a2144260b625e2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:30.478974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:30.488553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:30.505154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cf017f0eab514221a2144260b625e2a6', 'request_id': 'req-1b21daca-98a1-42b3-839c-87a41db18eb3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:30.510267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cf017f0eab514221a2144260b625e2a6', 'request_id': 'req-1b21daca-98a1-42b3-839c-87a41db18eb3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:30.518611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1b21daca-98a1-42b3-839c-87a41db18eb3 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cf017f0eab514221a2144260b625e2a6', 'request_id': 'req-1b21daca-98a1-42b3-839c-87a41db18eb3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:30.533205 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2831/5673] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:16:29 2022] DELETE /identity/v3/domains/cf017f0eab514221a2144260b625e2a6 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:30.533476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fcf58-e70f-4243-912b-beb3a3c39a07 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:30.536990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d00fcf58-e70f-4243-912b-beb3a3c39a07 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:30.687646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fcf58-e70f-4243-912b-beb3a3c39a07 tempest-InheritsV3TestJSON-23215034 tempest-InheritsV3TestJSON-23215034-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:30.887686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34729246-bdea-415e-b630-04ecb5c561ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:30.888351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34729246-bdea-415e-b630-04ecb5c561ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:30.888638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34729246-bdea-415e-b630-04ecb5c561ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:30.888917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34729246-bdea-415e-b630-04ecb5c561ce admin admin] PATH_INFO: `/v3/users/931679f2179f4d87aaa8fd639c9651ab` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:30.894020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34729246-bdea-415e-b630-04ecb5c561ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=931679f2179f4d87aaa8fd639c9651ab)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:30.897228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34729246-bdea-415e-b630-04ecb5c561ce admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:31.041784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-34729246-bdea-415e-b630-04ecb5c561ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931679f2179f4d87aaa8fd639c9651ab'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:31.056827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-34729246-bdea-415e-b630-04ecb5c561ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931679f2179f4d87aaa8fd639c9651ab'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:31.060785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-34729246-bdea-415e-b630-04ecb5c561ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931679f2179f4d87aaa8fd639c9651ab'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:31.089785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-34729246-bdea-415e-b630-04ecb5c561ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931679f2179f4d87aaa8fd639c9651ab'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:31.090667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-34729246-bdea-415e-b630-04ecb5c561ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931679f2179f4d87aaa8fd639c9651ab'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:31.163207 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2843/5674] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:30 2022] DELETE /identity/v3/users/931679f2179f4d87aaa8fd639c9651ab => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:31.168553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07deb-1472-431f-9259-25b3ab751f1b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:31.169087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07deb-1472-431f-9259-25b3ab751f1b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:31.169410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb07deb-1472-431f-9259-25b3ab751f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:31.221415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1fb07deb-1472-431f-9259-25b3ab751f1b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:31.224935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1fb07deb-1472-431f-9259-25b3ab751f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:31.366180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9abd0-fa79-4da9-89d7-654195f397de None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:31.366455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9abd0-fa79-4da9-89d7-654195f397de None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:31.366750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9abd0-fa79-4da9-89d7-654195f397de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:31.432013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a0e9abd0-fa79-4da9-89d7-654195f397de None None] MFA Rules not processed for user `df392b197270409b861e7ff7bd5a8135`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:31.433925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a0e9abd0-fa79-4da9-89d7-654195f397de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:31.443268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:UPDATE=1,keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:31.451111 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2832/5675] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:31.532636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb07deb-1472-431f-9259-25b3ab751f1b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:31.532636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1fb07deb-1472-431f-9259-25b3ab751f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:31.658569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb07deb-1472-431f-9259-25b3ab751f1b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:31.666614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26826b24-7860-40c9-852f-243eacb8de17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:31.666846 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2844/5676] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:31.667210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26826b24-7860-40c9-852f-243eacb8de17 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:31.667210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26826b24-7860-40c9-852f-243eacb8de17 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:31.667210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26826b24-7860-40c9-852f-243eacb8de17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:31.673736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9abd0-fa79-4da9-89d7-654195f397de None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:31.679366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a0e9abd0-fa79-4da9-89d7-654195f397de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:31.709520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26826b24-7860-40c9-852f-243eacb8de17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:31.712471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26826b24-7860-40c9-852f-243eacb8de17 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:31.724173 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2833/5677] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:16:31.905278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9abd0-fa79-4da9-89d7-654195f397de None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:31.944919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5983a3e-6f22-49fa-9a0b-2dfc3075f9c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:31.946088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5983a3e-6f22-49fa-9a0b-2dfc3075f9c5 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:31.946688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5983a3e-6f22-49fa-9a0b-2dfc3075f9c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:31.947285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5983a3e-6f22-49fa-9a0b-2dfc3075f9c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:31.969724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5983a3e-6f22-49fa-9a0b-2dfc3075f9c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:31.972969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5983a3e-6f22-49fa-9a0b-2dfc3075f9c5 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:32.002060 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2845/5678] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:32.916163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26826b24-7860-40c9-852f-243eacb8de17 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:32.919184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-26826b24-7860-40c9-852f-243eacb8de17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:32.963898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26826b24-7860-40c9-852f-243eacb8de17 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:32.994816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:32.995518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:32.995764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:32.996048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] PATH_INFO: `/v3/projects/13aeae30aaf34b8ea26ba2d01dba3880` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:32.997395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=13aeae30aaf34b8ea26ba2d01dba3880)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:33.003810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:33.147388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:33.171124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13aeae30aaf34b8ea26ba2d01dba3880', 'request_id': 'req-d3d5b686-59e5-4dae-855d-573cbdf5b49d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:33.204987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13aeae30aaf34b8ea26ba2d01dba3880', 'request_id': 'req-d3d5b686-59e5-4dae-855d-573cbdf5b49d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:33.220883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13aeae30aaf34b8ea26ba2d01dba3880', 'request_id': 'req-d3d5b686-59e5-4dae-855d-573cbdf5b49d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:33.281575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] The token cache is being invalidate because project 13aeae30aaf34b8ea26ba2d01dba3880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:33.281889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:33.283657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:33.291743 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2834/5679] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:32 2022] DELETE /identity/v3/projects/13aeae30aaf34b8ea26ba2d01dba3880 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:33.296031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5983a3e-6f22-49fa-9a0b-2dfc3075f9c5 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:33.343113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5983a3e-6f22-49fa-9a0b-2dfc3075f9c5 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:33.604543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35d7fc-94c5-425e-8c36-a4499dd56891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:33.605209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35d7fc-94c5-425e-8c36-a4499dd56891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:33.605493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35d7fc-94c5-425e-8c36-a4499dd56891 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:33.605768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35d7fc-94c5-425e-8c36-a4499dd56891 admin admin] PATH_INFO: `/v3/users/f313e8c7ebb84069bdc8e79cb050ede4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:33.608765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35d7fc-94c5-425e-8c36-a4499dd56891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f313e8c7ebb84069bdc8e79cb050ede4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:33.610713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35d7fc-94c5-425e-8c36-a4499dd56891 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:33.702200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:33.736717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce35d7fc-94c5-425e-8c36-a4499dd56891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f313e8c7ebb84069bdc8e79cb050ede4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:33.750677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce35d7fc-94c5-425e-8c36-a4499dd56891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f313e8c7ebb84069bdc8e79cb050ede4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:33.751766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce35d7fc-94c5-425e-8c36-a4499dd56891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f313e8c7ebb84069bdc8e79cb050ede4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:33.774503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce35d7fc-94c5-425e-8c36-a4499dd56891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f313e8c7ebb84069bdc8e79cb050ede4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:33.775450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce35d7fc-94c5-425e-8c36-a4499dd56891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f313e8c7ebb84069bdc8e79cb050ede4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:33.822103 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2846/5680] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:33 2022] DELETE /identity/v3/users/f313e8c7ebb84069bdc8e79cb050ede4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:34.561265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:34.562953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:34.597110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5b686-59e5-4dae-855d-573cbdf5b49d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:34.706375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:34.707370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:34.708826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:34.709264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9 admin admin] PATH_INFO: `/v3/projects/6334548851d64b3ba6ab182b863e3af8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:34.710673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6334548851d64b3ba6ab182b863e3af8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:34.712830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:34.783709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6334548851d64b3ba6ab182b863e3af8', 'request_id': 'req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:34.797281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6334548851d64b3ba6ab182b863e3af8', 'request_id': 'req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:34.805370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6334548851d64b3ba6ab182b863e3af8', 'request_id': 'req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:34.821449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9 admin admin] The token cache is being invalidate because project 6334548851d64b3ba6ab182b863e3af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:34.821796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:34.822772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1068ed0-1bb0-4eed-84bc-f6116a8745f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:34.824939 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2835/5681] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:34 2022] DELETE /identity/v3/projects/6334548851d64b3ba6ab182b863e3af8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:34.831097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadb747-041b-4628-ba2e-032130d861d3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:34.832044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadb747-041b-4628-ba2e-032130d861d3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:34.832573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadb747-041b-4628-ba2e-032130d861d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:34.872957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0dadb747-041b-4628-ba2e-032130d861d3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:34.874364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0dadb747-041b-4628-ba2e-032130d861d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:34.977487 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2847/5682] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:34.985934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a1aab-59a5-49bf-93f0-aa965e97f86e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:34.986160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a1aab-59a5-49bf-93f0-aa965e97f86e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:34.986436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a1aab-59a5-49bf-93f0-aa965e97f86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:35.019676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6a4a1aab-59a5-49bf-93f0-aa965e97f86e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:35.021765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6a4a1aab-59a5-49bf-93f0-aa965e97f86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:35.035805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadb747-041b-4628-ba2e-032130d861d3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:35.044877 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2836/5683] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:35.049385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadb747-041b-4628-ba2e-032130d861d3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:35.068341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dae37d-f691-42f1-a104-39abdaed78d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:35.071710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dae37d-f691-42f1-a104-39abdaed78d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:35.072336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dae37d-f691-42f1-a104-39abdaed78d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:35.072735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dae37d-f691-42f1-a104-39abdaed78d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:35.073645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dae37d-f691-42f1-a104-39abdaed78d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:35.075376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dae37d-f691-42f1-a104-39abdaed78d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:35.080085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dae37d-f691-42f1-a104-39abdaed78d0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:35.131729 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2848/5684] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:35.133829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a1aab-59a5-49bf-93f0-aa965e97f86e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:35.148038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a1aab-59a5-49bf-93f0-aa965e97f86e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:35.153935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba548559-5960-41e2-a8c5-6d2f3ccbb399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:35.154668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba548559-5960-41e2-a8c5-6d2f3ccbb399 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:35.155062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba548559-5960-41e2-a8c5-6d2f3ccbb399 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:35.155416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba548559-5960-41e2-a8c5-6d2f3ccbb399 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:35.156125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba548559-5960-41e2-a8c5-6d2f3ccbb399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:35.158130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba548559-5960-41e2-a8c5-6d2f3ccbb399 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:35.219531 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2837/5685] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:35 2022] POST /identity/v3/projects => generated 397 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:35.225068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dae37d-f691-42f1-a104-39abdaed78d0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:35.266060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dae37d-f691-42f1-a104-39abdaed78d0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:35.376462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d998c-2b2c-48f4-bae1-c9e968b5368d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:35.376762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d998c-2b2c-48f4-bae1-c9e968b5368d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:35.377091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d998c-2b2c-48f4-bae1-c9e968b5368d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:35.388617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44bbdb-6675-45ce-bd4d-55dc08f49609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:35.389409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44bbdb-6675-45ce-bd4d-55dc08f49609 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:35.389899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44bbdb-6675-45ce-bd4d-55dc08f49609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:35.391000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44bbdb-6675-45ce-bd4d-55dc08f49609 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:35.392473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44bbdb-6675-45ce-bd4d-55dc08f49609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:35.397392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44bbdb-6675-45ce-bd4d-55dc08f49609 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:35.428700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1c3d998c-2b2c-48f4-bae1-c9e968b5368d None None] MFA Rules not processed for user `df392b197270409b861e7ff7bd5a8135`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:35.433509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1c3d998c-2b2c-48f4-bae1-c9e968b5368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:35.457412 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2849/5686] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:35 2022] POST /identity/v3/users => generated 299 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:35.461794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44bbdb-6675-45ce-bd4d-55dc08f49609 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:35.484802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:35.488260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44bbdb-6675-45ce-bd4d-55dc08f49609 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:35.503384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7826dc-cfbf-4359-b540-16f38e27c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:35.518989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7826dc-cfbf-4359-b540-16f38e27c595 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:35.518989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7826dc-cfbf-4359-b540-16f38e27c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:35.518989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7826dc-cfbf-4359-b540-16f38e27c595 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:35.518989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7826dc-cfbf-4359-b540-16f38e27c595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:35.518989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7826dc-cfbf-4359-b540-16f38e27c595 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:35.552934 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2850/5687] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:16:35.556376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7826dc-cfbf-4359-b540-16f38e27c595 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:35.579746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7826dc-cfbf-4359-b540-16f38e27c595 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:35.591947 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2838/5688] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:35.605618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba586c-f2e5-4249-ae4b-6225f1071676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:35.606241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba586c-f2e5-4249-ae4b-6225f1071676 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:35.606526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba586c-f2e5-4249-ae4b-6225f1071676 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:35.607470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba586c-f2e5-4249-ae4b-6225f1071676 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:35.608137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba586c-f2e5-4249-ae4b-6225f1071676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:35.609733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba586c-f2e5-4249-ae4b-6225f1071676 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:35.623980 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2851/5689] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:16:35.630229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d998c-2b2c-48f4-bae1-c9e968b5368d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:35.642110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d998c-2b2c-48f4-bae1-c9e968b5368d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:35.650676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ef862-a4da-4844-881b-1d210ae4b50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:35.664669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ef862-a4da-4844-881b-1d210ae4b50a admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:35.666162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ef862-a4da-4844-881b-1d210ae4b50a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:35.666561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ef862-a4da-4844-881b-1d210ae4b50a admin admin] PATH_INFO: `/v3/projects/56889e8fd9c746c380c2309e2532e991/users/60a84952d7ed4a1cb2ed194cd424d94f/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:35.712576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ef862-a4da-4844-881b-1d210ae4b50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56889e8fd9c746c380c2309e2532e991, user_id=60a84952d7ed4a1cb2ed194cd424d94f, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:35.715800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ef862-a4da-4844-881b-1d210ae4b50a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:35.746528 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2839/5690] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:35 2022] PUT /identity/v3/projects/56889e8fd9c746c380c2309e2532e991/users/60a84952d7ed4a1cb2ed194cd424d94f/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:35.758957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaccae-c665-4614-abb7-95958ededf8f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:35.759661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaccae-c665-4614-abb7-95958ededf8f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:35.760058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaccae-c665-4614-abb7-95958ededf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:35.780288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:35.832024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-54eaccae-c665-4614-abb7-95958ededf8f None None] MFA Rules not processed for user `60a84952d7ed4a1cb2ed194cd424d94f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:35.833676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-54eaccae-c665-4614-abb7-95958ededf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:36.018896 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2852/5691] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:36.031937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ef862-a4da-4844-881b-1d210ae4b50a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:36.639112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ef862-a4da-4844-881b-1d210ae4b50a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:36.665713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ffa58-535b-4793-8d69-0a0f725a906c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:36.666277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ffa58-535b-4793-8d69-0a0f725a906c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:36.666564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ffa58-535b-4793-8d69-0a0f725a906c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:36.666868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ffa58-535b-4793-8d69-0a0f725a906c admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:36.667520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ffa58-535b-4793-8d69-0a0f725a906c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:36.674130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ffa58-535b-4793-8d69-0a0f725a906c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:36.737922 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2840/5692] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:36 2022] POST /identity/v3/projects => generated 397 bytes in 714 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:36.742503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eaccae-c665-4614-abb7-95958ededf8f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:36.758053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eaccae-c665-4614-abb7-95958ededf8f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:36.932233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73d35b-94f4-4d00-87a7-0892429c9930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:36.933657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d35b-94f4-4d00-87a7-0892429c9930 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:36.934151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d35b-94f4-4d00-87a7-0892429c9930 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:36.934666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73d35b-94f4-4d00-87a7-0892429c9930 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:36.935560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73d35b-94f4-4d00-87a7-0892429c9930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:36.948869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73d35b-94f4-4d00-87a7-0892429c9930 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:37.011105 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2853/5693] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:36 2022] POST /identity/v3/users => generated 305 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:37.014965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ffa58-535b-4793-8d69-0a0f725a906c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:37.038960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ffa58-535b-4793-8d69-0a0f725a906c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:37.049610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed817b-e16c-4c9e-8ba6-e6455719c6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:37.050186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed817b-e16c-4c9e-8ba6-e6455719c6bb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:37.050502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed817b-e16c-4c9e-8ba6-e6455719c6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:37.050733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed817b-e16c-4c9e-8ba6-e6455719c6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:37.051521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed817b-e16c-4c9e-8ba6-e6455719c6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:37.053287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed817b-e16c-4c9e-8ba6-e6455719c6bb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:37.076249 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2841/5694] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:37.080520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73d35b-94f4-4d00-87a7-0892429c9930 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:37.109786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73d35b-94f4-4d00-87a7-0892429c9930 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:37.120604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef86372-ad94-412e-a2bf-d819eb1e0adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:37.121557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef86372-ad94-412e-a2bf-d819eb1e0adf admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:37.122248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef86372-ad94-412e-a2bf-d819eb1e0adf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:37.122805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef86372-ad94-412e-a2bf-d819eb1e0adf admin admin] PATH_INFO: `/v3/projects/331fab872fc548fcaba02f8863cb84f1/users/9ea62aff3d3b458c967b74eeac5eabd0/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:37.186853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef86372-ad94-412e-a2bf-d819eb1e0adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=331fab872fc548fcaba02f8863cb84f1, user_id=9ea62aff3d3b458c967b74eeac5eabd0, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:37.196775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef86372-ad94-412e-a2bf-d819eb1e0adf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:37.227323 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2854/5695] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:37 2022] PUT /identity/v3/projects/331fab872fc548fcaba02f8863cb84f1/users/9ea62aff3d3b458c967b74eeac5eabd0/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:37.231422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed817b-e16c-4c9e-8ba6-e6455719c6bb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:37.249641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed817b-e16c-4c9e-8ba6-e6455719c6bb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:37.373173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6fcc2-e98f-4113-8b92-9b1fc97203c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:37.373906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6fcc2-e98f-4113-8b92-9b1fc97203c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:37.374269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6fcc2-e98f-4113-8b92-9b1fc97203c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:37.374625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6fcc2-e98f-4113-8b92-9b1fc97203c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:37.375426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6fcc2-e98f-4113-8b92-9b1fc97203c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:37.377596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6fcc2-e98f-4113-8b92-9b1fc97203c0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:37.390998 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2842/5696] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:37.396927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef86372-ad94-412e-a2bf-d819eb1e0adf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:37.420424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef86372-ad94-412e-a2bf-d819eb1e0adf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:37.428415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b640e-65d3-4172-abeb-bd07bc172f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:37.429360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b640e-65d3-4172-abeb-bd07bc172f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:37.430070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b640e-65d3-4172-abeb-bd07bc172f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:37.430457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b640e-65d3-4172-abeb-bd07bc172f4f admin admin] PATH_INFO: `/v3/projects/331fab872fc548fcaba02f8863cb84f1/users/9ea62aff3d3b458c967b74eeac5eabd0/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:37.432924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b640e-65d3-4172-abeb-bd07bc172f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=331fab872fc548fcaba02f8863cb84f1, user_id=9ea62aff3d3b458c967b74eeac5eabd0, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:37.437304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b640e-65d3-4172-abeb-bd07bc172f4f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:37.462347 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2855/5697] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:37 2022] PUT /identity/v3/projects/331fab872fc548fcaba02f8863cb84f1/users/9ea62aff3d3b458c967b74eeac5eabd0/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:37.470712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8eb5a-8287-4d0e-96e0-144fa0aa424d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:37.471512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8eb5a-8287-4d0e-96e0-144fa0aa424d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:37.472007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8eb5a-8287-4d0e-96e0-144fa0aa424d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:37.517700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b8b8eb5a-8287-4d0e-96e0-144fa0aa424d None None] MFA Rules not processed for user `9ea62aff3d3b458c967b74eeac5eabd0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:37.519916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b8b8eb5a-8287-4d0e-96e0-144fa0aa424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:37.533504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:37.635096 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2843/5698] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:37 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:37.635678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b640e-65d3-4172-abeb-bd07bc172f4f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:37.746004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:37.770712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b640e-65d3-4172-abeb-bd07bc172f4f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:37.780880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a859231-2b70-46e4-aadc-d1526faa0847 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60a84952d7ed4a1cb2ed194cd424d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56889e8fd9c746c380c2309e2532e991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:37.783067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a859231-2b70-46e4-aadc-d1526faa0847 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:37.783358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a859231-2b70-46e4-aadc-d1526faa0847 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:37.783641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a859231-2b70-46e4-aadc-d1526faa0847 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:37.784290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a859231-2b70-46e4-aadc-d1526faa0847 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-0a859231-2b70-46e4-aadc-d1526faa0847 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Aug 28 19:16:37.800793 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 28 19:16:37.802479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 28 19:16:37.802479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 28 19:16:37.802479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 28 19:16:37.802479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 28 19:16:37.802479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 28 19:16:37.802479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 28 19:16:37.802479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 28 19:16:37.802479 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:37.803609 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2856/5699] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:16:37 2022] POST /identity/v3/projects => generated 136 bytes in 169 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Aug 28 19:16:37.808927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8eb5a-8287-4d0e-96e0-144fa0aa424d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:37.821941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8eb5a-8287-4d0e-96e0-144fa0aa424d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:37.828306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb8a00-1774-4e27-9c61-8f84102ae700 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea62aff3d3b458c967b74eeac5eabd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '331fab872fc548fcaba02f8863cb84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:37.828822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb8a00-1774-4e27-9c61-8f84102ae700 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:37.829118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb8a00-1774-4e27-9c61-8f84102ae700 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:37.829398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb8a00-1774-4e27-9c61-8f84102ae700 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:37.830029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb8a00-1774-4e27-9c61-8f84102ae700 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:37.832033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb8a00-1774-4e27-9c61-8f84102ae700 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-5abb8a00-1774-4e27-9c61-8f84102ae700 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Invalid input for field 'name': '' is too short Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: On instance['name']: Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: Failed validating 'minLength' in schema['properties']['name']: Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: On instance['name']: Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: '' Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise error Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application On instance['name']: Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application '' Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:16:37.853345 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 19:16:37.855254 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 19:16:37.856491 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 19:16:37.856491 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 28 19:16:37.856491 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:16:37.856491 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 28 19:16:37.856491 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:16:37.856491 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:16:37.856491 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application On instance['name']: Aug 28 19:16:37.856491 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application '' Aug 28 19:16:37.856491 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:16:37.863252 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2844/5700] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:16:37 2022] POST /identity/v3/projects => generated 283 bytes in 55 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 19:16:37.864621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a859231-2b70-46e4-aadc-d1526faa0847 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:37.897184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a859231-2b70-46e4-aadc-d1526faa0847 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:37.922231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b71394-4a48-451f-a472-becb82ff78b8 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea62aff3d3b458c967b74eeac5eabd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '331fab872fc548fcaba02f8863cb84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:37.922891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b71394-4a48-451f-a472-becb82ff78b8 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:37.923180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b71394-4a48-451f-a472-becb82ff78b8 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:37.923460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b71394-4a48-451f-a472-becb82ff78b8 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:37.924096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b71394-4a48-451f-a472-becb82ff78b8 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:37.947723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b71394-4a48-451f-a472-becb82ff78b8 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-e3b71394-4a48-451f-a472-becb82ff78b8 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: On instance['name']: Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: Failed validating 'maxLength' in schema['properties']['name']: Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: On instance['name']: Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise error Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 19:16:37.980261 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application On instance['name']: Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:16:37.981512 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 28 19:16:37.983733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 28 19:16:37.983733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 19:16:37.983733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 19:16:37.983733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 19:16:37.983733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 19:16:37.983733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 28 19:16:37.983733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:37.983733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 28 19:16:37.983733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 28 19:16:37.983733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:37.983733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application On instance['name']: Aug 28 19:16:37.983733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 28 19:16:37.983733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:37.989408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb8a00-1774-4e27-9c61-8f84102ae700 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:37.990193 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2857/5701] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:16:37 2022] POST /identity/v3/projects => generated 412 bytes in 127 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 19:16:38.018385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb8a00-1774-4e27-9c61-8f84102ae700 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:38.038120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af6e3e-3406-403c-97a2-b1aa1f952229 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea62aff3d3b458c967b74eeac5eabd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '331fab872fc548fcaba02f8863cb84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:38.041847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af6e3e-3406-403c-97a2-b1aa1f952229 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:38.043222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af6e3e-3406-403c-97a2-b1aa1f952229 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:38.043676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af6e3e-3406-403c-97a2-b1aa1f952229 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] PATH_INFO: `/v3/projects/e23009f7b40949adbefb17358004f78b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:38.071795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af6e3e-3406-403c-97a2-b1aa1f952229 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e23009f7b40949adbefb17358004f78b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:38.079621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af6e3e-3406-403c-97a2-b1aa1f952229 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-e5af6e3e-3406-403c-97a2-b1aa1f952229 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Could not find project: e23009f7b40949adbefb17358004f78b.: keystone.exception.ProjectNotFound: Could not find project: e23009f7b40949adbefb17358004f78b. Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 28 19:16:38.121447 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 28 19:16:38.122766 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:16:38.122766 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:16:38.122766 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 28 19:16:38.122766 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 28 19:16:38.122766 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:16:38.122766 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:16:38.122766 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:16:38.122766 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:16:38.122766 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e23009f7b40949adbefb17358004f78b. Aug 28 19:16:38.122766 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:16:38.130467 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2845/5702] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:37 2022] DELETE /identity/v3/projects/e23009f7b40949adbefb17358004f78b => generated 113 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:16:38.136084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b71394-4a48-451f-a472-becb82ff78b8 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:38.166466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b71394-4a48-451f-a472-becb82ff78b8 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:38.194105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f5e9c-c1c8-4e84-88e3-6a0eb8de4559 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60a84952d7ed4a1cb2ed194cd424d94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56889e8fd9c746c380c2309e2532e991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:38.196182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f5e9c-c1c8-4e84-88e3-6a0eb8de4559 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:38.196182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f5e9c-c1c8-4e84-88e3-6a0eb8de4559 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:38.196182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f5e9c-c1c8-4e84-88e3-6a0eb8de4559 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:38.196182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f5e9c-c1c8-4e84-88e3-6a0eb8de4559 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:38.212715 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-d33f5e9c-c1c8-4e84-88e3-6a0eb8de4559 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:16:38.212715 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:16:38.212715 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-d33f5e9c-c1c8-4e84-88e3-6a0eb8de4559 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Aug 28 19:16:38.245250 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._list_projects() Aug 28 19:16:38.246450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Aug 28 19:16:38.246450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Aug 28 19:16:38.246450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 28 19:16:38.246450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 28 19:16:38.246450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 28 19:16:38.246450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 28 19:16:38.246450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 28 19:16:38.246450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 28 19:16:38.246450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 28 19:16:38.246450 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:38.257409 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2858/5703] 10.222.0.70 () {58 vars in 1131 bytes} [Sun Aug 28 19:16:38 2022] GET /identity/v3/projects => generated 135 bytes in 120 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:16:38.273871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af6e3e-3406-403c-97a2-b1aa1f952229 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:38.312748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af6e3e-3406-403c-97a2-b1aa1f952229 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:38.336258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43369eae-c163-41e5-8e09-3c669ec0fded tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea62aff3d3b458c967b74eeac5eabd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '331fab872fc548fcaba02f8863cb84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:38.337105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43369eae-c163-41e5-8e09-3c669ec0fded tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:38.337589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43369eae-c163-41e5-8e09-3c669ec0fded tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:38.341944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43369eae-c163-41e5-8e09-3c669ec0fded tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:38.342614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43369eae-c163-41e5-8e09-3c669ec0fded tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:38.350489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43369eae-c163-41e5-8e09-3c669ec0fded tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:38.480334 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2846/5704] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:38 2022] POST /identity/v3/projects => generated 359 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:38.484356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f5e9c-c1c8-4e84-88e3-6a0eb8de4559 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:38.512189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f5e9c-c1c8-4e84-88e3-6a0eb8de4559 tempest-ProjectsNegativeStaticTestJSON-1320010487 tempest-ProjectsNegativeStaticTestJSON-1320010487-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:38.742360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da1331-c6fc-427d-9339-5a3beb4f9ce2 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea62aff3d3b458c967b74eeac5eabd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '331fab872fc548fcaba02f8863cb84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:38.744075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da1331-c6fc-427d-9339-5a3beb4f9ce2 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:38.744613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da1331-c6fc-427d-9339-5a3beb4f9ce2 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:38.745268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da1331-c6fc-427d-9339-5a3beb4f9ce2 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:38.746072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da1331-c6fc-427d-9339-5a3beb4f9ce2 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:38.748079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da1331-c6fc-427d-9339-5a3beb4f9ce2 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:38.780160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.sql.core [None req-40da1331-c6fc-427d-9339-5a3beb4f9ce2 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1101878949' for key 'project.ixu_project_name_domain_id'") Aug 28 19:16:38.780160 n-d-854118-7 devstack@keystone.service[88375]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 19:16:38.780160 n-d-854118-7 devstack@keystone.service[88375]: [parameters: {'id': '32eaf993187f45969f739c759ec9748a', 'name': 'tempest-project-dup-1101878949', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 19:16:38.780160 n-d-854118-7 devstack@keystone.service[88375]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88375) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 19:16:38.792285 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-40da1331-c6fc-427d-9339-5a3beb4f9ce2 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1101878949, project id 32eaf993187f45969f739c759ec9748a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1101878949, project id 32eaf993187f45969f739c759ec9748a. Aug 28 19:16:38.792285 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:16:38.792285 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 19:16:38.792285 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 19:16:38.792285 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 19:16:38.792285 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 19:16:38.792285 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 19:16:38.792285 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 19:16:38.792285 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 19:16:38.792285 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application conn.query(q) Aug 28 19:16:38.792285 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 19:16:38.792285 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result.read() Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1101878949' for key 'project.ixu_project_name_domain_id'") Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 19:16:38.793132 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application next(self.gen) Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application yield resource Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application next(self.gen) Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise self.value Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 19:16:38.794208 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application session.commit() Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.session.flush() Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application compat.raise_( Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 19:16:38.796336 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 19:16:38.798252 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application conn.query(q) Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result.read() Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 19:16:38.799453 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1101878949' for key 'project.ixu_project_name_domain_id'") Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [parameters: {'id': '32eaf993187f45969f739c759ec9748a', 'name': 'tempest-project-dup-1101878949', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:16:38.800768 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1101878949 at domain ID default. Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:16:38.802260 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:16:38.803541 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:16:38.803541 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 28 19:16:38.803541 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 28 19:16:38.803541 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:16:38.803541 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:16:38.803541 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 19:16:38.803541 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 19:16:38.803541 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1101878949, project id 32eaf993187f45969f739c759ec9748a. Aug 28 19:16:38.803541 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:38.803541 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2859/5705] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:16:38 2022] POST /identity/v3/projects => generated 285 bytes in 314 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:16:38.804444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43369eae-c163-41e5-8e09-3c669ec0fded tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:38.841954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43369eae-c163-41e5-8e09-3c669ec0fded tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:38.866322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea62aff3d3b458c967b74eeac5eabd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '331fab872fc548fcaba02f8863cb84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:38.867412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:38.867906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:38.868350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] PATH_INFO: `/v3/projects/4ad9b861735b49dab87aec1551fdbee3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:38.870707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4ad9b861735b49dab87aec1551fdbee3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:38.873027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:38.981922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad9b861735b49dab87aec1551fdbee3', 'request_id': 'req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:39.008285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad9b861735b49dab87aec1551fdbee3', 'request_id': 'req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:39.037571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad9b861735b49dab87aec1551fdbee3', 'request_id': 'req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:39.091588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] The token cache is being invalidate because project 4ad9b861735b49dab87aec1551fdbee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:39.091731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:39.094522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d09c1a9c-92c5-46f5-bc68-09bfd3bb7491 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:39.100710 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2847/5706] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:38 2022] DELETE /identity/v3/projects/4ad9b861735b49dab87aec1551fdbee3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:39.108424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da1331-c6fc-427d-9339-5a3beb4f9ce2 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:39.110956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-40da1331-c6fc-427d-9339-5a3beb4f9ce2 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:39.232588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da1331-c6fc-427d-9339-5a3beb4f9ce2 tempest-ProjectsNegativeStaticTestJSON-1655797845 tempest-ProjectsNegativeStaticTestJSON-1655797845-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:39.337916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:39.338626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:39.338974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:39.339261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] PATH_INFO: `/v3/users/60a84952d7ed4a1cb2ed194cd424d94f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:39.340513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a84952d7ed4a1cb2ed194cd424d94f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:39.343606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:39.384444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:39.456392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a84952d7ed4a1cb2ed194cd424d94f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:39.467053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a84952d7ed4a1cb2ed194cd424d94f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:39.467842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a84952d7ed4a1cb2ed194cd424d94f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:39.481862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a84952d7ed4a1cb2ed194cd424d94f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:39.484569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a84952d7ed4a1cb2ed194cd424d94f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:39.536495 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2860/5707] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:39 2022] DELETE /identity/v3/users/60a84952d7ed4a1cb2ed194cd424d94f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:39.541617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc0a70-0260-4d41-bb7a-b2858a98c6bb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:39.542826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc0a70-0260-4d41-bb7a-b2858a98c6bb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:39.543174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc0a70-0260-4d41-bb7a-b2858a98c6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:39.626132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-28bc0a70-0260-4d41-bb7a-b2858a98c6bb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:39.627807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28bc0a70-0260-4d41-bb7a-b2858a98c6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:39.776203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:39.813759 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2848/5708] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:39.820578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:39.822029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:39.903530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374365a-b1f3-43e6-a398-c1b6d50c83c1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:39.914606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061dd3e-6c83-4eb6-987e-e7a7435d4285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:39.915387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061dd3e-6c83-4eb6-987e-e7a7435d4285 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:39.916678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061dd3e-6c83-4eb6-987e-e7a7435d4285 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:39.918372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061dd3e-6c83-4eb6-987e-e7a7435d4285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:39.940328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061dd3e-6c83-4eb6-987e-e7a7435d4285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:39.941929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061dd3e-6c83-4eb6-987e-e7a7435d4285 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:39.956075 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2861/5709] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:40.524785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc0a70-0260-4d41-bb7a-b2858a98c6bb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:40.526243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28bc0a70-0260-4d41-bb7a-b2858a98c6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:40.541558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc0a70-0260-4d41-bb7a-b2858a98c6bb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:40.556365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:40.556948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:40.557346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:40.557492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] PATH_INFO: `/v3/projects/56889e8fd9c746c380c2309e2532e991` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:40.559837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56889e8fd9c746c380c2309e2532e991)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:40.562123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:40.674423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56889e8fd9c746c380c2309e2532e991', 'request_id': 'req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:40.695142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56889e8fd9c746c380c2309e2532e991', 'request_id': 'req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:40.704726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56889e8fd9c746c380c2309e2532e991', 'request_id': 'req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:40.719182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] The token cache is being invalidate because project 56889e8fd9c746c380c2309e2532e991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:40.719839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:40.720725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:40.722429 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2849/5710] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:40 2022] DELETE /identity/v3/projects/56889e8fd9c746c380c2309e2532e991 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:40.728717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061dd3e-6c83-4eb6-987e-e7a7435d4285 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:40.742012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061dd3e-6c83-4eb6-987e-e7a7435d4285 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:40.787452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:40.789140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:40.874121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a844c65-367f-42e5-81de-3d0c16e29c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:40.875395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a844c65-367f-42e5-81de-3d0c16e29c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:40.875866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a844c65-367f-42e5-81de-3d0c16e29c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:40.876404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a844c65-367f-42e5-81de-3d0c16e29c7d admin admin] PATH_INFO: `/v3/users/9ea62aff3d3b458c967b74eeac5eabd0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:40.877876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a844c65-367f-42e5-81de-3d0c16e29c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea62aff3d3b458c967b74eeac5eabd0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:40.881218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a844c65-367f-42e5-81de-3d0c16e29c7d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:40.928157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f7dd9-9b6e-4ea6-ac06-1d768ed1a407 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:40.945783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:40.946869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:40.947306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:40.947754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] PATH_INFO: `/v3/users/8c7f681a36ea4d649e28afc3830753ec` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:40.949128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7f681a36ea4d649e28afc3830753ec)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:40.951243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:41.014567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:41.018490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a844c65-367f-42e5-81de-3d0c16e29c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea62aff3d3b458c967b74eeac5eabd0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:41.036843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a844c65-367f-42e5-81de-3d0c16e29c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea62aff3d3b458c967b74eeac5eabd0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:41.039005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a844c65-367f-42e5-81de-3d0c16e29c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea62aff3d3b458c967b74eeac5eabd0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:41.068145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7f681a36ea4d649e28afc3830753ec'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:41.074724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a844c65-367f-42e5-81de-3d0c16e29c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea62aff3d3b458c967b74eeac5eabd0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:41.076255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a844c65-367f-42e5-81de-3d0c16e29c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea62aff3d3b458c967b74eeac5eabd0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:41.082322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7f681a36ea4d649e28afc3830753ec'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:41.087875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7f681a36ea4d649e28afc3830753ec'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:41.114828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:41.121071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7f681a36ea4d649e28afc3830753ec'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:41.123843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7f681a36ea4d649e28afc3830753ec'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:41.152046 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2862/5711] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:40 2022] DELETE /identity/v3/users/9ea62aff3d3b458c967b74eeac5eabd0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:41.161736 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2850/5712] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:40 2022] DELETE /identity/v3/users/8c7f681a36ea4d649e28afc3830753ec => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:41.166419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54d6c2-e0f2-493b-93db-0334f519e72b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:41.166811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54d6c2-e0f2-493b-93db-0334f519e72b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:41.167100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54d6c2-e0f2-493b-93db-0334f519e72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:41.205734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ab54d6c2-e0f2-493b-93db-0334f519e72b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:41.205734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ab54d6c2-e0f2-493b-93db-0334f519e72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:41.312540 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2863/5713] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:16:41.329795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:41.332054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:41.464155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae7994-0c4d-406a-a4a5-6d4cacc6a191 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:41.473837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95091bbd-60a8-456a-a6d8-c44450b49397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:41.473837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95091bbd-60a8-456a-a6d8-c44450b49397 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:41.474150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95091bbd-60a8-456a-a6d8-c44450b49397 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:41.474753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95091bbd-60a8-456a-a6d8-c44450b49397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:41.489753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95091bbd-60a8-456a-a6d8-c44450b49397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:41.491444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95091bbd-60a8-456a-a6d8-c44450b49397 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:41.507174 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2851/5714] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:41.998887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54d6c2-e0f2-493b-93db-0334f519e72b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:42.001292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ab54d6c2-e0f2-493b-93db-0334f519e72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:42.032830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54d6c2-e0f2-493b-93db-0334f519e72b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:42.078068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed6e1c-1fc1-4761-828d-0ebd174616f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:42.079486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6e1c-1fc1-4761-828d-0ebd174616f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:42.085225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6e1c-1fc1-4761-828d-0ebd174616f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:42.085836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6e1c-1fc1-4761-828d-0ebd174616f1 admin admin] PATH_INFO: `/v3/projects/331fab872fc548fcaba02f8863cb84f1` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:42.089274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed6e1c-1fc1-4761-828d-0ebd174616f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=331fab872fc548fcaba02f8863cb84f1)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:42.107128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed6e1c-1fc1-4761-828d-0ebd174616f1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:42.320364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3bed6e1c-1fc1-4761-828d-0ebd174616f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '331fab872fc548fcaba02f8863cb84f1', 'request_id': 'req-3bed6e1c-1fc1-4761-828d-0ebd174616f1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:42.336347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3bed6e1c-1fc1-4761-828d-0ebd174616f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '331fab872fc548fcaba02f8863cb84f1', 'request_id': 'req-3bed6e1c-1fc1-4761-828d-0ebd174616f1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:42.351607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3bed6e1c-1fc1-4761-828d-0ebd174616f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '331fab872fc548fcaba02f8863cb84f1', 'request_id': 'req-3bed6e1c-1fc1-4761-828d-0ebd174616f1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:42.382347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3bed6e1c-1fc1-4761-828d-0ebd174616f1 admin admin] The token cache is being invalidate because project 331fab872fc548fcaba02f8863cb84f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:42.382828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3bed6e1c-1fc1-4761-828d-0ebd174616f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:42.385716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3bed6e1c-1fc1-4761-828d-0ebd174616f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:42.392473 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2864/5715] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:41 2022] DELETE /identity/v3/projects/331fab872fc548fcaba02f8863cb84f1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:42.396377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa19c8-bb60-469c-af6c-1d009f1bd81c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:42.398198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa19c8-bb60-469c-af6c-1d009f1bd81c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:42.398908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa19c8-bb60-469c-af6c-1d009f1bd81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:42.456177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6faa19c8-bb60-469c-af6c-1d009f1bd81c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:42.459524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6faa19c8-bb60-469c-af6c-1d009f1bd81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:42.660888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1ed60-0428-42d3-9d93-ae80eeeaa22c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:42.661221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1ed60-0428-42d3-9d93-ae80eeeaa22c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:42.661451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1ed60-0428-42d3-9d93-ae80eeeaa22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:42.664726 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2852/5716] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:42.722440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa19c8-bb60-469c-af6c-1d009f1bd81c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:42.724448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6faa19c8-bb60-469c-af6c-1d009f1bd81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:42.731867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-30c1ed60-0428-42d3-9d93-ae80eeeaa22c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:42.735516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-30c1ed60-0428-42d3-9d93-ae80eeeaa22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:42.750123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa19c8-bb60-469c-af6c-1d009f1bd81c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:42.767081 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2865/5717] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:42.770692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:42.771818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:42.775051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:42.775051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] PATH_INFO: `/v3/projects/acdfe65dc14b41efb5c7f829bf99984b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:42.775246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1ed60-0428-42d3-9d93-ae80eeeaa22c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:42.775339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=acdfe65dc14b41efb5c7f829bf99984b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:42.777315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:42.813803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1ed60-0428-42d3-9d93-ae80eeeaa22c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:42.828937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456d9ed-d470-4019-8910-e44d647b012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:42.831479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456d9ed-d470-4019-8910-e44d647b012c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:42.831828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456d9ed-d470-4019-8910-e44d647b012c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:42.832354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456d9ed-d470-4019-8910-e44d647b012c admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:42.833137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456d9ed-d470-4019-8910-e44d647b012c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:42.833501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456d9ed-d470-4019-8910-e44d647b012c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:42.835569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456d9ed-d470-4019-8910-e44d647b012c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:42.866763 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2866/5718] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:16:42.870555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456d9ed-d470-4019-8910-e44d647b012c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:42.887565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdfe65dc14b41efb5c7f829bf99984b', 'request_id': 'req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:42.906096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456d9ed-d470-4019-8910-e44d647b012c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:42.913303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdfe65dc14b41efb5c7f829bf99984b', 'request_id': 'req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:42.939999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdfe65dc14b41efb5c7f829bf99984b', 'request_id': 'req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:42.947285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:42.974686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] The token cache is being invalidate because project acdfe65dc14b41efb5c7f829bf99984b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:42.974984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:42.977266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:42.981135 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2853/5719] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:42 2022] DELETE /identity/v3/projects/acdfe65dc14b41efb5c7f829bf99984b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:42.983579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:42.985284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:43.008481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:43.010355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16b2e5-28fe-4030-bbb4-d39d3e8ca1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:43.011129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16b2e5-28fe-4030-bbb4-d39d3e8ca1df admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:43.011661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16b2e5-28fe-4030-bbb4-d39d3e8ca1df admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:43.012138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16b2e5-28fe-4030-bbb4-d39d3e8ca1df admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:43.013011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16b2e5-28fe-4030-bbb4-d39d3e8ca1df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:43.015052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16b2e5-28fe-4030-bbb4-d39d3e8ca1df admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:43.067874 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2867/5720] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:42 2022] POST /identity/v3/projects => generated 393 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:16:43.070066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474c17b-a4e1-480e-a15e-e458c1fa0fbb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:43.072136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474c17b-a4e1-480e-a15e-e458c1fa0fbb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:43.072136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474c17b-a4e1-480e-a15e-e458c1fa0fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:43.095984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3d82-02f0-4eed-a5b2-f67cf5f05c7b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:43.113496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8474c17b-a4e1-480e-a15e-e458c1fa0fbb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:43.114553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8474c17b-a4e1-480e-a15e-e458c1fa0fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:43.218515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:43.219231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:43.219525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:43.219976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] PATH_INFO: `/v3/users/e8ac4ee4e0c047b9b415607fcf64ae74` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:43.224337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ac4ee4e0c047b9b415607fcf64ae74)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:43.227648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:43.231801 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2868/5721] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:43.233958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474c17b-a4e1-480e-a15e-e458c1fa0fbb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:43.249790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8474c17b-a4e1-480e-a15e-e458c1fa0fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:43.263656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474c17b-a4e1-480e-a15e-e458c1fa0fbb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:43.268888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4b1b6-7bef-4780-8022-d879cb144187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:43.269516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4b1b6-7bef-4780-8022-d879cb144187 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:43.269876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4b1b6-7bef-4780-8022-d879cb144187 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:43.270315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4b1b6-7bef-4780-8022-d879cb144187 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:43.271288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4b1b6-7bef-4780-8022-d879cb144187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:43.273231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4b1b6-7bef-4780-8022-d879cb144187 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:43.308690 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2869/5722] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:43 2022] POST /identity/v3/users => generated 297 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:43.309675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb5813-0e7c-4ad6-8d49-843adcd194f7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:43.309964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb5813-0e7c-4ad6-8d49-843adcd194f7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:43.310309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb5813-0e7c-4ad6-8d49-843adcd194f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:43.320489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ac4ee4e0c047b9b415607fcf64ae74'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:43.336602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5fdb5813-0e7c-4ad6-8d49-843adcd194f7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:43.338445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5fdb5813-0e7c-4ad6-8d49-843adcd194f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:43.341067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ac4ee4e0c047b9b415607fcf64ae74'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:43.341353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ac4ee4e0c047b9b415607fcf64ae74'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:43.360147 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2870/5723] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:43.361254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb5813-0e7c-4ad6-8d49-843adcd194f7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:43.374133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ac4ee4e0c047b9b415607fcf64ae74'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:43.374876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb5813-0e7c-4ad6-8d49-843adcd194f7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:43.375921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ac4ee4e0c047b9b415607fcf64ae74'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:43.382150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c525e-41cc-4023-a429-cf219d0c5df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:43.383295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c525e-41cc-4023-a429-cf219d0c5df0 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:43.383701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c525e-41cc-4023-a429-cf219d0c5df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:43.384661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c525e-41cc-4023-a429-cf219d0c5df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:43.385394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c525e-41cc-4023-a429-cf219d0c5df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:43.387268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c525e-41cc-4023-a429-cf219d0c5df0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:43.404830 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2854/5724] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:42 2022] DELETE /identity/v3/users/e8ac4ee4e0c047b9b415607fcf64ae74 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:43.406395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:43.408325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:43.413674 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2871/5725] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:43.415082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c525e-41cc-4023-a429-cf219d0c5df0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:43.417012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8a7c525e-41cc-4023-a429-cf219d0c5df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:43.457225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c525e-41cc-4023-a429-cf219d0c5df0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:43.487143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:43.540893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4498301-5191-4c56-b601-62d36ff8564b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:43.549774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570e752-33a6-4fab-aa4c-c2a5b1376e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:43.550419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570e752-33a6-4fab-aa4c-c2a5b1376e2c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:43.550681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570e752-33a6-4fab-aa4c-c2a5b1376e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:43.551059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570e752-33a6-4fab-aa4c-c2a5b1376e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:43.551931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570e752-33a6-4fab-aa4c-c2a5b1376e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:43.552397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570e752-33a6-4fab-aa4c-c2a5b1376e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:43.555416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570e752-33a6-4fab-aa4c-c2a5b1376e2c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:43.591068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac28e4-76b3-45ea-beda-78d0889709e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:43.593218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac28e4-76b3-45ea-beda-78d0889709e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:43.593673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac28e4-76b3-45ea-beda-78d0889709e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:43.594104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac28e4-76b3-45ea-beda-78d0889709e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:43.598634 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2855/5726] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:43.599499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac28e4-76b3-45ea-beda-78d0889709e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:43.600309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570e752-33a6-4fab-aa4c-c2a5b1376e2c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:43.601531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac28e4-76b3-45ea-beda-78d0889709e2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:43.612736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570e752-33a6-4fab-aa4c-c2a5b1376e2c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:43.621897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934477e6-78e6-4365-9e93-aa5436f1e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:43.622607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934477e6-78e6-4365-9e93-aa5436f1e287 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:43.623001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934477e6-78e6-4365-9e93-aa5436f1e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:43.623344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934477e6-78e6-4365-9e93-aa5436f1e287 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:43.624141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934477e6-78e6-4365-9e93-aa5436f1e287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:43.628259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934477e6-78e6-4365-9e93-aa5436f1e287 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:43.630634 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2872/5727] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:43.637008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac28e4-76b3-45ea-beda-78d0889709e2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:43.669319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac28e4-76b3-45ea-beda-78d0889709e2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:43.686069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983fe29-d9fc-43c6-b036-202e3305554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:43.688308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983fe29-d9fc-43c6-b036-202e3305554e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:43.688887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983fe29-d9fc-43c6-b036-202e3305554e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:43.689382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983fe29-d9fc-43c6-b036-202e3305554e admin admin] PATH_INFO: `/v3/projects/8e7f6e6ea51a491197bd582dfc5e9525/users/d0c8f1f6619247f393fc9ff140e877fc/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:43.690560 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2856/5728] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:43 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:43.695703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934477e6-78e6-4365-9e93-aa5436f1e287 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:43.715322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:43.731119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983fe29-d9fc-43c6-b036-202e3305554e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7f6e6ea51a491197bd582dfc5e9525, user_id=d0c8f1f6619247f393fc9ff140e877fc, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:43.734133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983fe29-d9fc-43c6-b036-202e3305554e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:43.762495 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2873/5729] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:43 2022] PUT /identity/v3/projects/8e7f6e6ea51a491197bd582dfc5e9525/users/d0c8f1f6619247f393fc9ff140e877fc/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:43.773739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47fc64-8e80-4c3b-9869-6cb2e4b1452f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:43.774203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47fc64-8e80-4c3b-9869-6cb2e4b1452f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:43.774587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47fc64-8e80-4c3b-9869-6cb2e4b1452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:43.849258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7f47fc64-8e80-4c3b-9869-6cb2e4b1452f None None] MFA Rules not processed for user `d0c8f1f6619247f393fc9ff140e877fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:43.859662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934477e6-78e6-4365-9e93-aa5436f1e287 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:43.864033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7f47fc64-8e80-4c3b-9869-6cb2e4b1452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:43.959548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c8e77-6283-487a-aaf7-bd94da612524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:43.961173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c8e77-6283-487a-aaf7-bd94da612524 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:43.974302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c8e77-6283-487a-aaf7-bd94da612524 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:43.974724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c8e77-6283-487a-aaf7-bd94da612524 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:43.975724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c8e77-6283-487a-aaf7-bd94da612524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:43.979731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c8e77-6283-487a-aaf7-bd94da612524 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:44.014552 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2857/5730] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:43 2022] POST /identity/v3/users => generated 288 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:44.015523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c8e77-6283-487a-aaf7-bd94da612524 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:44.017890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6f5c8e77-6283-487a-aaf7-bd94da612524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:44.040148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c8e77-6283-487a-aaf7-bd94da612524 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:44.048317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:44.048967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:44.049250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:44.049652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] PATH_INFO: `/v3/projects/bcb5e029af8e4fb1b314576e73d75410` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:44.050852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb5e029af8e4fb1b314576e73d75410)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:44.053017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:44.054409 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2874/5731] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:16:44.056471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47fc64-8e80-4c3b-9869-6cb2e4b1452f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:44.075892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47fc64-8e80-4c3b-9869-6cb2e4b1452f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:44.086522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5535-1afb-45d3-b304-854beb403001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:44.087250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5535-1afb-45d3-b304-854beb403001 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:44.087514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5535-1afb-45d3-b304-854beb403001 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:44.088058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff5535-1afb-45d3-b304-854beb403001 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:44.088723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff5535-1afb-45d3-b304-854beb403001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:44.090840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff5535-1afb-45d3-b304-854beb403001 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:44.110328 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2875/5732] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:44.112261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5535-1afb-45d3-b304-854beb403001 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:44.126377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:44.126642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff5535-1afb-45d3-b304-854beb403001 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:44.132032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb5e029af8e4fb1b314576e73d75410', 'request_id': 'req-deda33a1-508e-4611-83ed-ddf1f16a13df'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:44.143750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb5e029af8e4fb1b314576e73d75410', 'request_id': 'req-deda33a1-508e-4611-83ed-ddf1f16a13df'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:44.161398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb5e029af8e4fb1b314576e73d75410', 'request_id': 'req-deda33a1-508e-4611-83ed-ddf1f16a13df'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:44.180688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] The token cache is being invalidate because project bcb5e029af8e4fb1b314576e73d75410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:44.180688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:44.180993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:44.183078 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2858/5733] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:44 2022] DELETE /identity/v3/projects/bcb5e029af8e4fb1b314576e73d75410 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:44.184426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:44.188449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:44.227774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e5452-9699-45c2-921c-05e47f7d7407 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:44.228681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e5452-9699-45c2-921c-05e47f7d7407 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:44.229401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e5452-9699-45c2-921c-05e47f7d7407 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:44.229870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e5452-9699-45c2-921c-05e47f7d7407 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:44.230699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e5452-9699-45c2-921c-05e47f7d7407 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:create_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:44.232079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e5452-9699-45c2-921c-05e47f7d7407 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:44.309421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda33a1-508e-4611-83ed-ddf1f16a13df admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:44.326977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a5114-044a-4da9-b2d0-b21ad4bd609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:44.327618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a5114-044a-4da9-b2d0-b21ad4bd609b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:44.327913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a5114-044a-4da9-b2d0-b21ad4bd609b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:44.328189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a5114-044a-4da9-b2d0-b21ad4bd609b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:44.328840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a5114-044a-4da9-b2d0-b21ad4bd609b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:44.331202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a5114-044a-4da9-b2d0-b21ad4bd609b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:44.352141 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2859/5734] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:44.352595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a5114-044a-4da9-b2d0-b21ad4bd609b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:44.354885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cf3a5114-044a-4da9-b2d0-b21ad4bd609b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:44.368825 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2876/5735] 10.222.0.70 () {60 vars in 1314 bytes} [Sun Aug 28 19:16:44 2022] POST /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials => generated 788 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:44.370256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e5452-9699-45c2-921c-05e47f7d7407 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:44.377060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a5114-044a-4da9-b2d0-b21ad4bd609b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:44.384560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5c640-7f48-4c0a-a26f-ea37405cf089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:44.385466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5c640-7f48-4c0a-a26f-ea37405cf089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:44.385937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5c640-7f48-4c0a-a26f-ea37405cf089 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:44.386628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5c640-7f48-4c0a-a26f-ea37405cf089 admin admin] PATH_INFO: `/v3/users/b78fc23d55064b56873795fe500e822e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:44.388615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5c640-7f48-4c0a-a26f-ea37405cf089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b78fc23d55064b56873795fe500e822e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:44.389157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e5452-9699-45c2-921c-05e47f7d7407 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:44.390972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5c640-7f48-4c0a-a26f-ea37405cf089 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:44.399515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597566b2-de2e-4167-82ba-44fa23389dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:44.400279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597566b2-de2e-4167-82ba-44fa23389dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:44.400911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597566b2-de2e-4167-82ba-44fa23389dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:44.401919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597566b2-de2e-4167-82ba-44fa23389dfe admin admin] PATH_INFO: `/v3/projects/11e4febb3fea4e9da7a146531cf1f902/users/3277e171d77e47af8d51ad15cfe9b121/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:44.418269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:44.423957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597566b2-de2e-4167-82ba-44fa23389dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e4febb3fea4e9da7a146531cf1f902, user_id=3277e171d77e47af8d51ad15cfe9b121, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:44.426847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597566b2-de2e-4167-82ba-44fa23389dfe admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:44.457791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-61f5c640-7f48-4c0a-a26f-ea37405cf089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b78fc23d55064b56873795fe500e822e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:44.458894 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2877/5736] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:44 2022] PUT /identity/v3/projects/11e4febb3fea4e9da7a146531cf1f902/users/3277e171d77e47af8d51ad15cfe9b121/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:44.460346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597566b2-de2e-4167-82ba-44fa23389dfe admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:44.466844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-61f5c640-7f48-4c0a-a26f-ea37405cf089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b78fc23d55064b56873795fe500e822e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:44.467650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-61f5c640-7f48-4c0a-a26f-ea37405cf089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b78fc23d55064b56873795fe500e822e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:44.468424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-597566b2-de2e-4167-82ba-44fa23389dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:44.486115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-61f5c640-7f48-4c0a-a26f-ea37405cf089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b78fc23d55064b56873795fe500e822e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:44.487254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-61f5c640-7f48-4c0a-a26f-ea37405cf089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b78fc23d55064b56873795fe500e822e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:44.507471 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2860/5737] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:44 2022] DELETE /identity/v3/users/b78fc23d55064b56873795fe500e822e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:44.509327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975162f9-ad04-48ce-85a8-49bc4a3bcec6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:44.509621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975162f9-ad04-48ce-85a8-49bc4a3bcec6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:44.509954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975162f9-ad04-48ce-85a8-49bc4a3bcec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:44.576594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597566b2-de2e-4167-82ba-44fa23389dfe admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:44.584186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-975162f9-ad04-48ce-85a8-49bc4a3bcec6 None None] MFA Rules not processed for user `3277e171d77e47af8d51ad15cfe9b121`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:44.591423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-975162f9-ad04-48ce-85a8-49bc4a3bcec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:44.655524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:44.691206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2f7bb-fc44-4283-97cf-378ee565c768 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:44.692750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2f7bb-fc44-4283-97cf-378ee565c768 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:44.693226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2f7bb-fc44-4283-97cf-378ee565c768 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:44.693849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2f7bb-fc44-4283-97cf-378ee565c768 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/a533379ba56c48f496ae0470ad327c28` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:44.714115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2f7bb-fc44-4283-97cf-378ee565c768 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:get_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc, application_credential_id=a533379ba56c48f496ae0470ad327c28)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:44.719099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2f7bb-fc44-4283-97cf-378ee565c768 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:44.724072 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2878/5738] 10.222.0.70 () {58 vars in 1392 bytes} [Sun Aug 28 19:16:44 2022] GET /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/a533379ba56c48f496ae0470ad327c28 => generated 688 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:44.725632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df8e9d-589f-42bb-bb74-09a25f4f3165 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:44.725927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df8e9d-589f-42bb-bb74-09a25f4f3165 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:44.726207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df8e9d-589f-42bb-bb74-09a25f4f3165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:44.748817 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2861/5739] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:44.753326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975162f9-ad04-48ce-85a8-49bc4a3bcec6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:44.758346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-975162f9-ad04-48ce-85a8-49bc4a3bcec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:44.765728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-08df8e9d-589f-42bb-bb74-09a25f4f3165 None None] MFA Rules not processed for user `d0c8f1f6619247f393fc9ff140e877fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:44.765728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-08df8e9d-589f-42bb-bb74-09a25f4f3165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:44.892588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975162f9-ad04-48ce-85a8-49bc4a3bcec6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:44.899240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c8674-a864-4c47-b94a-5a08d063991b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:44.899880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c8674-a864-4c47-b94a-5a08d063991b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:44.900170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c8674-a864-4c47-b94a-5a08d063991b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:44.900442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c8674-a864-4c47-b94a-5a08d063991b admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:44.901150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c8674-a864-4c47-b94a-5a08d063991b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:44.903132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c8674-a864-4c47-b94a-5a08d063991b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:44.959823 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2862/5740] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:44 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:44.962460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c8674-a864-4c47-b94a-5a08d063991b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:44.967454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-638c8674-a864-4c47-b94a-5a08d063991b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:44.972296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:44.987786 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2879/5741] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:44 2022] POST /identity/v3/auth/tokens => generated 3426 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 28 19:16:44.989500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df8e9d-589f-42bb-bb74-09a25f4f3165 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:45.088632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c8674-a864-4c47-b94a-5a08d063991b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:45.094320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:45.097090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:45.097561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:45.097955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] PATH_INFO: `/v3/projects/71c6a02231f84b38ba6e2eb4ab578707` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:45.100697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c6a02231f84b38ba6e2eb4ab578707)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:45.102961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:45.134883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df8e9d-589f-42bb-bb74-09a25f4f3165 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:45.141977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2365e85-0c14-4037-ae10-e5f6818e2081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:45.142973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2365e85-0c14-4037-ae10-e5f6818e2081 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:45.143622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2365e85-0c14-4037-ae10-e5f6818e2081 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:45.144407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2365e85-0c14-4037-ae10-e5f6818e2081 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:45.146630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2365e85-0c14-4037-ae10-e5f6818e2081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:45.149234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2365e85-0c14-4037-ae10-e5f6818e2081 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:45.175213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c6a02231f84b38ba6e2eb4ab578707', 'request_id': 'req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:45.189672 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2880/5742] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:44 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:45.189672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2365e85-0c14-4037-ae10-e5f6818e2081 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:45.189998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c6a02231f84b38ba6e2eb4ab578707', 'request_id': 'req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:45.190522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:45.191675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b2365e85-0c14-4037-ae10-e5f6818e2081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:45.197905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c6a02231f84b38ba6e2eb4ab578707', 'request_id': 'req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:45.214919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] The token cache is being invalidate because project 71c6a02231f84b38ba6e2eb4ab578707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:45.215339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:45.216041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:45.218195 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2863/5743] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:44 2022] DELETE /identity/v3/projects/71c6a02231f84b38ba6e2eb4ab578707 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:45.224930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:45.226814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:45.312886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2365e85-0c14-4037-ae10-e5f6818e2081 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:45.341403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae9748-3565-4d2d-aeaf-d0d80d2c4e22 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:45.355240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ab992-3056-40ba-913e-fb6ce54a37ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:45.356068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ab992-3056-40ba-913e-fb6ce54a37ed admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:45.356456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ab992-3056-40ba-913e-fb6ce54a37ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:45.357370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ab992-3056-40ba-913e-fb6ce54a37ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:45.358929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ab992-3056-40ba-913e-fb6ce54a37ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:45.365323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ab992-3056-40ba-913e-fb6ce54a37ed admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:45.377521 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2864/5744] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:45.380457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a4e24-e7b2-4292-9559-0396cf2485dd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:45.380457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a4e24-e7b2-4292-9559-0396cf2485dd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:45.380457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a4e24-e7b2-4292-9559-0396cf2485dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:45.407260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962754b-7579-46f0-a59a-eb1ade8d5663 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:45.408865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962754b-7579-46f0-a59a-eb1ade8d5663 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:45.411158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962754b-7579-46f0-a59a-eb1ade8d5663 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:45.411626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962754b-7579-46f0-a59a-eb1ade8d5663 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/a533379ba56c48f496ae0470ad327c28` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:45.413919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962754b-7579-46f0-a59a-eb1ade8d5663 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc, application_credential_id=a533379ba56c48f496ae0470ad327c28)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:45.416444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962754b-7579-46f0-a59a-eb1ade8d5663 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:45.434217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8a7a4e24-e7b2-4292-9559-0396cf2485dd None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:45.436156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8a7a4e24-e7b2-4292-9559-0396cf2485dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:45.461354 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2881/5745] 10.222.0.70 () {58 vars in 1395 bytes} [Sun Aug 28 19:16:45 2022] DELETE /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/a533379ba56c48f496ae0470ad327c28 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:45.461354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962754b-7579-46f0-a59a-eb1ade8d5663 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:45.461660 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2865/5746] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:45.461660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b153b-3ce7-491b-8f6c-eb14a5c264ce None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:45.461660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b153b-3ce7-491b-8f6c-eb14a5c264ce None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:45.461660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b153b-3ce7-491b-8f6c-eb14a5c264ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:45.485059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962754b-7579-46f0-a59a-eb1ade8d5663 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:45.485252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6b6b153b-3ce7-491b-8f6c-eb14a5c264ce None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:45.486527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6b6b153b-3ce7-491b-8f6c-eb14a5c264ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:45.492218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036d8f6-6691-431d-b6f5-3b4dc9b4c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:45.492951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036d8f6-6691-431d-b6f5-3b4dc9b4c560 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:45.493237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036d8f6-6691-431d-b6f5-3b4dc9b4c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:45.493514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036d8f6-6691-431d-b6f5-3b4dc9b4c560 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:45.494170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036d8f6-6691-431d-b6f5-3b4dc9b4c560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:45.496097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036d8f6-6691-431d-b6f5-3b4dc9b4c560 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:45.502831 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2866/5747] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:45.503900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b153b-3ce7-491b-8f6c-eb14a5c264ce None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:45.506244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6b6b153b-3ce7-491b-8f6c-eb14a5c264ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:45.512819 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2882/5748] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:45.513800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036d8f6-6691-431d-b6f5-3b4dc9b4c560 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:45.522955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b153b-3ce7-491b-8f6c-eb14a5c264ce None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:45.526472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036d8f6-6691-431d-b6f5-3b4dc9b4c560 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:45.531104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b91a2-4e63-46d1-9ac2-b9629cee99c1 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:45.531838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b91a2-4e63-46d1-9ac2-b9629cee99c1 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:45.532064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c26305-f13a-4f89-a5fa-b8a619ac149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:45.532231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b91a2-4e63-46d1-9ac2-b9629cee99c1 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:45.532572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b91a2-4e63-46d1-9ac2-b9629cee99c1 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:45.532693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c26305-f13a-4f89-a5fa-b8a619ac149e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:45.532939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c26305-f13a-4f89-a5fa-b8a619ac149e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:45.533283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c26305-f13a-4f89-a5fa-b8a619ac149e admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:45.533750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b91a2-4e63-46d1-9ac2-b9629cee99c1 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:create_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:45.533942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c26305-f13a-4f89-a5fa-b8a619ac149e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:45.534250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c26305-f13a-4f89-a5fa-b8a619ac149e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:45.536005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c26305-f13a-4f89-a5fa-b8a619ac149e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:45.537811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b91a2-4e63-46d1-9ac2-b9629cee99c1 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:45.556363 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2883/5749] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:45.557724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c26305-f13a-4f89-a5fa-b8a619ac149e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:45.563824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:45.571054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c26305-f13a-4f89-a5fa-b8a619ac149e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:45.590901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdc98c-f319-4e93-8be1-ca6637a21a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:45.591839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc98c-f319-4e93-8be1-ca6637a21a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:45.592200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc98c-f319-4e93-8be1-ca6637a21a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:45.592538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc98c-f319-4e93-8be1-ca6637a21a1b admin admin] PATH_INFO: `/v3/projects/2d7d399c37b542688949a538af957b52/users/08a1a471688e49f3805a409f139645ce/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:45.615660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdc98c-f319-4e93-8be1-ca6637a21a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7d399c37b542688949a538af957b52, user_id=08a1a471688e49f3805a409f139645ce, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:45.618520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdc98c-f319-4e93-8be1-ca6637a21a1b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:45.654295 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2884/5750] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:45 2022] PUT /identity/v3/projects/2d7d399c37b542688949a538af957b52/users/08a1a471688e49f3805a409f139645ce/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:45.659714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdc98c-f319-4e93-8be1-ca6637a21a1b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:45.718145 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2867/5751] 10.222.0.70 () {60 vars in 1315 bytes} [Sun Aug 28 19:16:45 2022] POST /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials => generated 921 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:45.719633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c154bdb-bb67-4c3e-a922-0141a25cd924 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:45.719939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c154bdb-bb67-4c3e-a922-0141a25cd924 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:45.720494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c154bdb-bb67-4c3e-a922-0141a25cd924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:45.751836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8c154bdb-bb67-4c3e-a922-0141a25cd924 None None] MFA Rules not processed for user `08a1a471688e49f3805a409f139645ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:45.753198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8c154bdb-bb67-4c3e-a922-0141a25cd924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:45.781813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdc98c-f319-4e93-8be1-ca6637a21a1b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:45.788225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948edfc-c898-461d-8481-00384a92fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:45.789108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948edfc-c898-461d-8481-00384a92fe34 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:45.789578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948edfc-c898-461d-8481-00384a92fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:45.789999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948edfc-c898-461d-8481-00384a92fe34 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:45.790841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948edfc-c898-461d-8481-00384a92fe34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:45.793008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948edfc-c898-461d-8481-00384a92fe34 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:45.841413 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2885/5752] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:45 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:45.843986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948edfc-c898-461d-8481-00384a92fe34 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:45.844756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:45.889909 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2868/5753] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:45.894331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c154bdb-bb67-4c3e-a922-0141a25cd924 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:45.903540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c154bdb-bb67-4c3e-a922-0141a25cd924 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:45.950583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948edfc-c898-461d-8481-00384a92fe34 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:45.956282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af471ca-07dd-4eaa-bd85-f221b9b5cf78 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:45.957832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af471ca-07dd-4eaa-bd85-f221b9b5cf78 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:45.958371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af471ca-07dd-4eaa-bd85-f221b9b5cf78 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:45.958693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af471ca-07dd-4eaa-bd85-f221b9b5cf78 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/4052abf9954b4ef29130519a25079b78` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:45.977716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af471ca-07dd-4eaa-bd85-f221b9b5cf78 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc, application_credential_id=4052abf9954b4ef29130519a25079b78)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:45.982148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af471ca-07dd-4eaa-bd85-f221b9b5cf78 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.012565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64839a-1c59-4701-92e1-c72748a69c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:46.013257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64839a-1c59-4701-92e1-c72748a69c7d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.013520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64839a-1c59-4701-92e1-c72748a69c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.013801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64839a-1c59-4701-92e1-c72748a69c7d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.014494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64839a-1c59-4701-92e1-c72748a69c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:46.016993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64839a-1c59-4701-92e1-c72748a69c7d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.017919 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2886/5754] 10.222.0.70 () {58 vars in 1395 bytes} [Sun Aug 28 19:16:45 2022] DELETE /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/4052abf9954b4ef29130519a25079b78 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:46.018654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af471ca-07dd-4eaa-bd85-f221b9b5cf78 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.039132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af471ca-07dd-4eaa-bd85-f221b9b5cf78 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:46.039132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e71b4-5e35-4b58-8df0-ff241fc9dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:46.039132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e71b4-5e35-4b58-8df0-ff241fc9dc24 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.039542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e71b4-5e35-4b58-8df0-ff241fc9dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.039542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e71b4-5e35-4b58-8df0-ff241fc9dc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.039716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e71b4-5e35-4b58-8df0-ff241fc9dc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:46.041984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e71b4-5e35-4b58-8df0-ff241fc9dc24 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.053026 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2869/5755] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:45 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:46.053720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64839a-1c59-4701-92e1-c72748a69c7d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.066975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64839a-1c59-4701-92e1-c72748a69c7d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:46.072009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbcef7-7867-42a6-8dd4-aa7f8ead4f8f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:46.072934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbcef7-7867-42a6-8dd4-aa7f8ead4f8f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.073317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbcef7-7867-42a6-8dd4-aa7f8ead4f8f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.073744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbcef7-7867-42a6-8dd4-aa7f8ead4f8f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.074515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbcef7-7867-42a6-8dd4-aa7f8ead4f8f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:create_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:46.075982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbcef7-7867-42a6-8dd4-aa7f8ead4f8f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.113673 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2887/5756] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:46 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:46.113673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e71b4-5e35-4b58-8df0-ff241fc9dc24 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.136620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:46.185590 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2870/5757] 10.222.0.70 () {60 vars in 1315 bytes} [Sun Aug 28 19:16:46 2022] POST /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials => generated 812 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:46.186999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbcef7-7867-42a6-8dd4-aa7f8ead4f8f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.204728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbcef7-7867-42a6-8dd4-aa7f8ead4f8f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:46.237214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e71b4-5e35-4b58-8df0-ff241fc9dc24 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:46.250849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0195a4-48f5-4f65-a401-cc823681994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:46.251433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0195a4-48f5-4f65-a401-cc823681994e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.251721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0195a4-48f5-4f65-a401-cc823681994e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.252855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0195a4-48f5-4f65-a401-cc823681994e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.253684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0195a4-48f5-4f65-a401-cc823681994e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:46.256611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0195a4-48f5-4f65-a401-cc823681994e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.269861 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2888/5758] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:46.270764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0195a4-48f5-4f65-a401-cc823681994e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.292934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd66a8-a7e1-476c-88df-99c37e4f37a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:46.293896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd66a8-a7e1-476c-88df-99c37e4f37a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.294062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd66a8-a7e1-476c-88df-99c37e4f37a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.294250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd66a8-a7e1-476c-88df-99c37e4f37a1 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.295099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd66a8-a7e1-476c-88df-99c37e4f37a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:46.297484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd66a8-a7e1-476c-88df-99c37e4f37a1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.320534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:46.330352 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2871/5759] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:46 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:46.331318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd66a8-a7e1-476c-88df-99c37e4f37a1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.341717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd66a8-a7e1-476c-88df-99c37e4f37a1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:46.349762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0195a4-48f5-4f65-a401-cc823681994e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:46.352093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79220a-bbce-46e1-9f64-5b957e4e5b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:46.352801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79220a-bbce-46e1-9f64-5b957e4e5b00 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.353149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79220a-bbce-46e1-9f64-5b957e4e5b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.353513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79220a-bbce-46e1-9f64-5b957e4e5b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.354235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79220a-bbce-46e1-9f64-5b957e4e5b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:46.354814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d684047-9db4-41f9-ab63-19318e252474 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:46.355557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d684047-9db4-41f9-ab63-19318e252474 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.356021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d684047-9db4-41f9-ab63-19318e252474 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.356529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79220a-bbce-46e1-9f64-5b957e4e5b00 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.356649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d684047-9db4-41f9-ab63-19318e252474 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/4a812d4935c24e5bbe90653058102b95` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.368279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d684047-9db4-41f9-ab63-19318e252474 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc, application_credential_id=4a812d4935c24e5bbe90653058102b95)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:46.370212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d684047-9db4-41f9-ab63-19318e252474 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.373602 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2872/5760] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:46.374575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79220a-bbce-46e1-9f64-5b957e4e5b00 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.385328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79220a-bbce-46e1-9f64-5b957e4e5b00 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:46.392399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61db5b-bb27-40e8-b343-99c519afc16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:46.393058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61db5b-bb27-40e8-b343-99c519afc16d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.393305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61db5b-bb27-40e8-b343-99c519afc16d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.393564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61db5b-bb27-40e8-b343-99c519afc16d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.394272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61db5b-bb27-40e8-b343-99c519afc16d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:46.398580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61db5b-bb27-40e8-b343-99c519afc16d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.401167 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2889/5761] 10.222.0.70 () {58 vars in 1395 bytes} [Sun Aug 28 19:16:46 2022] DELETE /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/4a812d4935c24e5bbe90653058102b95 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:46.406605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d684047-9db4-41f9-ab63-19318e252474 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.422811 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2873/5762] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:46.422811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61db5b-bb27-40e8-b343-99c519afc16d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.432511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d684047-9db4-41f9-ab63-19318e252474 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:46.438710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b6ea-2df1-4708-8650-4d4cc944eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:46.439646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b6ea-2df1-4708-8650-4d4cc944eca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.440580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b6ea-2df1-4708-8650-4d4cc944eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.440979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b6ea-2df1-4708-8650-4d4cc944eca1 admin admin] PATH_INFO: `/v3/projects/e9b9067e60fe41fcab77d14d01416f2c/users/2784fed2749f43a0aa3f48265de14df8/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.450421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61db5b-bb27-40e8-b343-99c519afc16d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:46.462689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6b6ea-2df1-4708-8650-4d4cc944eca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9b9067e60fe41fcab77d14d01416f2c, user_id=2784fed2749f43a0aa3f48265de14df8, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:46.464876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268cf31-2b5f-4c25-a5a0-6df18459408f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:46.466516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6b6ea-2df1-4708-8650-4d4cc944eca1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.467853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268cf31-2b5f-4c25-a5a0-6df18459408f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.468153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268cf31-2b5f-4c25-a5a0-6df18459408f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.468440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268cf31-2b5f-4c25-a5a0-6df18459408f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.471320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268cf31-2b5f-4c25-a5a0-6df18459408f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:create_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:46.472579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268cf31-2b5f-4c25-a5a0-6df18459408f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.488643 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2890/5763] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:46 2022] PUT /identity/v3/projects/e9b9067e60fe41fcab77d14d01416f2c/users/2784fed2749f43a0aa3f48265de14df8/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:46.491000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b6ea-2df1-4708-8650-4d4cc944eca1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.588768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b6ea-2df1-4708-8650-4d4cc944eca1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:46.595746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9132f7-7c95-45dd-9977-7001d771930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:46.596436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9132f7-7c95-45dd-9977-7001d771930e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.596716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9132f7-7c95-45dd-9977-7001d771930e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.596992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9132f7-7c95-45dd-9977-7001d771930e admin admin] PATH_INFO: `/v3/projects/d1ccd6d5f2274ecca80e099316d62d3b/users/c70e09b6009241de98d56e3f384140d7/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.610252 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2874/5764] 10.222.0.70 () {60 vars in 1314 bytes} [Sun Aug 28 19:16:46 2022] POST /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials => generated 789 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:46.611593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268cf31-2b5f-4c25-a5a0-6df18459408f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.614035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f268cf31-2b5f-4c25-a5a0-6df18459408f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:46.618969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9132f7-7c95-45dd-9977-7001d771930e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ccd6d5f2274ecca80e099316d62d3b, user_id=c70e09b6009241de98d56e3f384140d7, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:46.622565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9132f7-7c95-45dd-9977-7001d771930e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.625593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:46.645288 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2891/5765] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:46 2022] PUT /identity/v3/projects/d1ccd6d5f2274ecca80e099316d62d3b/users/c70e09b6009241de98d56e3f384140d7/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:46.647120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dd258-2126-4358-ac02-a547fe823e21 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.647414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dd258-2126-4358-ac02-a547fe823e21 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.647715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dd258-2126-4358-ac02-a547fe823e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.693162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-905dd258-2126-4358-ac02-a547fe823e21 None None] MFA Rules not processed for user `2784fed2749f43a0aa3f48265de14df8`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:46.694474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-905dd258-2126-4358-ac02-a547fe823e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:46.715915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268cf31-2b5f-4c25-a5a0-6df18459408f tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:46.773788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ead14-de95-4b0a-ace4-8beebdae005c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:46.774411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ead14-de95-4b0a-ace4-8beebdae005c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.774697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ead14-de95-4b0a-ace4-8beebdae005c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.775032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ead14-de95-4b0a-ace4-8beebdae005c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.777116 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2892/5766] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:46.783051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-430ead14-de95-4b0a-ace4-8beebdae005c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:46.783189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dd258-2126-4358-ac02-a547fe823e21 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.838794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:46.857091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dd258-2126-4358-ac02-a547fe823e21 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:46.862906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab243c92-c161-41a8-868c-a228db5cefe3 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:46.864469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab243c92-c161-41a8-868c-a228db5cefe3 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:46.864980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab243c92-c161-41a8-868c-a228db5cefe3 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:46.865503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab243c92-c161-41a8-868c-a228db5cefe3 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:46.866609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab243c92-c161-41a8-868c-a228db5cefe3 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:create_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:46.868638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab243c92-c161-41a8-868c-a228db5cefe3 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.876786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ead14-de95-4b0a-ace4-8beebdae005c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:46.878270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ead14-de95-4b0a-ace4-8beebdae005c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:46.892827 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2875/5767] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:46.893694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ead14-de95-4b0a-ace4-8beebdae005c service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.975397 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2893/5768] 10.222.0.70 () {60 vars in 1314 bytes} [Sun Aug 28 19:16:46 2022] POST /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials => generated 787 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:46.975397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab243c92-c161-41a8-868c-a228db5cefe3 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:46.980660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ab243c92-c161-41a8-868c-a228db5cefe3 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:47.003727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab243c92-c161-41a8-868c-a228db5cefe3 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.005700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ead14-de95-4b0a-ace4-8beebdae005c service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.010831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ded57-6c6d-436c-a8b7-8c68fc51ddb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.011316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ded57-6c6d-436c-a8b7-8c68fc51ddb6 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.012483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ded57-6c6d-436c-a8b7-8c68fc51ddb6 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.012774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ded57-6c6d-436c-a8b7-8c68fc51ddb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.024409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd165f7-9c93-43f6-88ef-216319f053b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.024988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd165f7-9c93-43f6-88ef-216319f053b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.025276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd165f7-9c93-43f6-88ef-216319f053b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.025557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd165f7-9c93-43f6-88ef-216319f053b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.026233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd165f7-9c93-43f6-88ef-216319f053b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.028707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ded57-6c6d-436c-a8b7-8c68fc51ddb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.028846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd165f7-9c93-43f6-88ef-216319f053b4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.029553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ded57-6c6d-436c-a8b7-8c68fc51ddb6 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.039733 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2876/5769] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:47.040612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd165f7-9c93-43f6-88ef-216319f053b4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:47.058075 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2894/5770] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:47.060124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd165f7-9c93-43f6-88ef-216319f053b4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.061862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ded57-6c6d-436c-a8b7-8c68fc51ddb6 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:47.068449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a156c7c-118f-4dd7-84bd-52cacd6e7521 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.069105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a156c7c-118f-4dd7-84bd-52cacd6e7521 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.069395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a156c7c-118f-4dd7-84bd-52cacd6e7521 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.069679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a156c7c-118f-4dd7-84bd-52cacd6e7521 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.070305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a156c7c-118f-4dd7-84bd-52cacd6e7521 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:list_application_credentials(user_id=d0c8f1f6619247f393fc9ff140e877fc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.072427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a156c7c-118f-4dd7-84bd-52cacd6e7521 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.090089 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2877/5771] 10.222.0.70 () {58 vars in 1293 bytes} [Sun Aug 28 19:16:47 2022] GET /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials => generated 1500 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:47.091560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a3f80-13aa-4448-8ac0-ca8a5e355ef6 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.092077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a3f80-13aa-4448-8ac0-ca8a5e355ef6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.092457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a3f80-13aa-4448-8ac0-ca8a5e355ef6 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.092871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ded57-6c6d-436c-a8b7-8c68fc51ddb6 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.094139 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2878/5772] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:16:47.094971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a3f80-13aa-4448-8ac0-ca8a5e355ef6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:47.109538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a3f80-13aa-4448-8ac0-ca8a5e355ef6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.111166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2918f3-3014-4968-a8d6-41b58b2ef26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.112100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2918f3-3014-4968-a8d6-41b58b2ef26c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.112386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2918f3-3014-4968-a8d6-41b58b2ef26c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.112968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2918f3-3014-4968-a8d6-41b58b2ef26c admin admin] PATH_INFO: `/v3/projects/d1ccd6d5f2274ecca80e099316d62d3b/users/c70e09b6009241de98d56e3f384140d7/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.114821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a73f-3a72-4ec1-bee5-354cafc3cad6 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.115473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a73f-3a72-4ec1-bee5-354cafc3cad6 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.115763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a73f-3a72-4ec1-bee5-354cafc3cad6 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.116046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a73f-3a72-4ec1-bee5-354cafc3cad6 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/839f0add1d70416b8216112002903a20` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.116162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2918f3-3014-4968-a8d6-41b58b2ef26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ccd6d5f2274ecca80e099316d62d3b, user_id=c70e09b6009241de98d56e3f384140d7, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.119577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2918f3-3014-4968-a8d6-41b58b2ef26c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.128522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a73f-3a72-4ec1-bee5-354cafc3cad6 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc, application_credential_id=839f0add1d70416b8216112002903a20)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.130857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a73f-3a72-4ec1-bee5-354cafc3cad6 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.140823 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2895/5773] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:47 2022] PUT /identity/v3/projects/d1ccd6d5f2274ecca80e099316d62d3b/users/c70e09b6009241de98d56e3f384140d7/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:47.141838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2918f3-3014-4968-a8d6-41b58b2ef26c admin admin] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:16:47.150870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:47.158066 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2879/5774] 10.222.0.70 () {58 vars in 1395 bytes} [Sun Aug 28 19:16:47 2022] DELETE /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/839f0add1d70416b8216112002903a20 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:47.159727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f4ab2-4bbb-4513-8dc8-4bd6e36ccae6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.160030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f4ab2-4bbb-4513-8dc8-4bd6e36ccae6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.160475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f4ab2-4bbb-4513-8dc8-4bd6e36ccae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.215529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3b6f4ab2-4bbb-4513-8dc8-4bd6e36ccae6 None None] MFA Rules not processed for user `c70e09b6009241de98d56e3f384140d7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:47.217666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3b6f4ab2-4bbb-4513-8dc8-4bd6e36ccae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:47.244896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2918f3-3014-4968-a8d6-41b58b2ef26c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:47.330535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2918f3-3014-4968-a8d6-41b58b2ef26c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.336524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f23e02-20ca-4187-b57f-b7b47a4ee5a3 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784fed2749f43a0aa3f48265de14df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9b9067e60fe41fcab77d14d01416f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.337259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23e02-20ca-4187-b57f-b7b47a4ee5a3 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.337542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23e02-20ca-4187-b57f-b7b47a4ee5a3 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.337858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f23e02-20ca-4187-b57f-b7b47a4ee5a3 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] PATH_INFO: `/v3/projects/e9b9067e60fe41fcab77d14d01416f2c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.338832 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2880/5775] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:47.339115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f23e02-20ca-4187-b57f-b7b47a4ee5a3 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: Authorizing `identity:get_project(project_id=e9b9067e60fe41fcab77d14d01416f2c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.340908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f23e02-20ca-4187-b57f-b7b47a4ee5a3 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.341338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f4ab2-4bbb-4513-8dc8-4bd6e36ccae6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:47.347151 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2896/5776] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:16:47 2022] GET /identity/v3/projects/e9b9067e60fe41fcab77d14d01416f2c => generated 365 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:47.349983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:47.353188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f23e02-20ca-4187-b57f-b7b47a4ee5a3 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:47.356238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-98f23e02-20ca-4187-b57f-b7b47a4ee5a3 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:47.438313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f4ab2-4bbb-4513-8dc8-4bd6e36ccae6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.442324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f23e02-20ca-4187-b57f-b7b47a4ee5a3 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.443003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa97d2-946d-481a-b56c-80dcdf77be7d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.444096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa97d2-946d-481a-b56c-80dcdf77be7d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.444337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa97d2-946d-481a-b56c-80dcdf77be7d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.445093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa97d2-946d-481a-b56c-80dcdf77be7d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/13cc1df295b44c668bee8754459edb77` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.446182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54420f04-18b4-42c8-8679-82881a630425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.446947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54420f04-18b4-42c8-8679-82881a630425 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.447306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54420f04-18b4-42c8-8679-82881a630425 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.447658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54420f04-18b4-42c8-8679-82881a630425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.450483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-54420f04-18b4-42c8-8679-82881a630425 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:47.456153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa97d2-946d-481a-b56c-80dcdf77be7d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc, application_credential_id=13cc1df295b44c668bee8754459edb77)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.459053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa97d2-946d-481a-b56c-80dcdf77be7d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.485741 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2881/5777] 10.222.0.70 () {58 vars in 1395 bytes} [Sun Aug 28 19:16:47 2022] DELETE /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/13cc1df295b44c668bee8754459edb77 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:47.487220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9ae62-472d-4cbf-b30a-e51c6f0951d2 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.487963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9ae62-472d-4cbf-b30a-e51c6f0951d2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.488340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9ae62-472d-4cbf-b30a-e51c6f0951d2 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.490691 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2882/5778] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:16:47.491580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9ae62-472d-4cbf-b30a-e51c6f0951d2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:47.508956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9ae62-472d-4cbf-b30a-e51c6f0951d2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.513895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651691a0-40cf-4d57-a181-2f0d4bcdb04d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.514546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651691a0-40cf-4d57-a181-2f0d4bcdb04d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.514861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651691a0-40cf-4d57-a181-2f0d4bcdb04d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.515147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651691a0-40cf-4d57-a181-2f0d4bcdb04d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.515818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651691a0-40cf-4d57-a181-2f0d4bcdb04d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:create_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.517271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651691a0-40cf-4d57-a181-2f0d4bcdb04d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.544695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54420f04-18b4-42c8-8679-82881a630425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.546152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54420f04-18b4-42c8-8679-82881a630425 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.553436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:47.566003 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2897/5779] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:47.568295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54420f04-18b4-42c8-8679-82881a630425 service cinder] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:16:47.602110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54420f04-18b4-42c8-8679-82881a630425 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:47.630005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54420f04-18b4-42c8-8679-82881a630425 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.633558 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2883/5780] 10.222.0.70 () {60 vars in 1314 bytes} [Sun Aug 28 19:16:47 2022] POST /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials => generated 789 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:47.634845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651691a0-40cf-4d57-a181-2f0d4bcdb04d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:47.640311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed09975-202e-4bde-9719-3c7eee7d8bb1 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784fed2749f43a0aa3f48265de14df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9b9067e60fe41fcab77d14d01416f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.641066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed09975-202e-4bde-9719-3c7eee7d8bb1 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.641423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed09975-202e-4bde-9719-3c7eee7d8bb1 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.641773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed09975-202e-4bde-9719-3c7eee7d8bb1 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] PATH_INFO: `/v3/projects/e9b9067e60fe41fcab77d14d01416f2c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.643151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed09975-202e-4bde-9719-3c7eee7d8bb1 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: Authorizing `identity:get_project(project_id=e9b9067e60fe41fcab77d14d01416f2c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.647134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed09975-202e-4bde-9719-3c7eee7d8bb1 tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.648403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651691a0-40cf-4d57-a181-2f0d4bcdb04d tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.649286 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2898/5781] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:16:47 2022] GET /identity/v3/projects/e9b9067e60fe41fcab77d14d01416f2c => generated 365 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:47.653269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58738d91-1e09-4698-8c0f-0307e7284013 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.653998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58738d91-1e09-4698-8c0f-0307e7284013 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.654358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58738d91-1e09-4698-8c0f-0307e7284013 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.654835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58738d91-1e09-4698-8c0f-0307e7284013 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.655507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58738d91-1e09-4698-8c0f-0307e7284013 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:create_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.661574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58738d91-1e09-4698-8c0f-0307e7284013 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.750274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66585e0e-6d35-41f2-b4fa-d500a09514b4 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.750274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66585e0e-6d35-41f2-b4fa-d500a09514b4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.750274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66585e0e-6d35-41f2-b4fa-d500a09514b4 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.750610 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2899/5782] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:16:47.757548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66585e0e-6d35-41f2-b4fa-d500a09514b4 None None] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:16:47.759011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-66585e0e-6d35-41f2-b4fa-d500a09514b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:47.790890 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2884/5783] 10.222.0.70 () {60 vars in 1314 bytes} [Sun Aug 28 19:16:47 2022] POST /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials => generated 788 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:47.790890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e32b0-55a0-41f7-b38e-79c65041cafb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.790890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e32b0-55a0-41f7-b38e-79c65041cafb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.790890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e32b0-55a0-41f7-b38e-79c65041cafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.796155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66585e0e-6d35-41f2-b4fa-d500a09514b4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:47.809532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66585e0e-6d35-41f2-b4fa-d500a09514b4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.815239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effee946-958c-4549-9dab-b29148508eee tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784fed2749f43a0aa3f48265de14df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9b9067e60fe41fcab77d14d01416f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.815947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effee946-958c-4549-9dab-b29148508eee tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.816306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effee946-958c-4549-9dab-b29148508eee tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.816705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effee946-958c-4549-9dab-b29148508eee tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] PATH_INFO: `/v3/projects/e9b9067e60fe41fcab77d14d01416f2c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.818245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effee946-958c-4549-9dab-b29148508eee tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: Authorizing `identity:get_project(project_id=e9b9067e60fe41fcab77d14d01416f2c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.820369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effee946-958c-4549-9dab-b29148508eee tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.822870 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2900/5784] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:16:47 2022] GET /identity/v3/projects/e9b9067e60fe41fcab77d14d01416f2c => generated 365 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:16:47.823239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ba3e32b0-55a0-41f7-b38e-79c65041cafb None None] MFA Rules not processed for user `c5265d83d5ae4494b59597802d052593`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:47.823798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effee946-958c-4549-9dab-b29148508eee tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:47.824584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ba3e32b0-55a0-41f7-b38e-79c65041cafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:47.835264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effee946-958c-4549-9dab-b29148508eee tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.851098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a264e2-aeef-4ebd-a058-ab6dec3a213b tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.851957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a264e2-aeef-4ebd-a058-ab6dec3a213b tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.852384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a264e2-aeef-4ebd-a058-ab6dec3a213b tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.852669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a264e2-aeef-4ebd-a058-ab6dec3a213b tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.853203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:47.854062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a264e2-aeef-4ebd-a058-ab6dec3a213b tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Adding query filter params (name=tempest-application_credential-666430463) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:47.854385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a264e2-aeef-4ebd-a058-ab6dec3a213b tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:list_application_credentials(user_id=d0c8f1f6619247f393fc9ff140e877fc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.857038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a264e2-aeef-4ebd-a058-ab6dec3a213b tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.879084 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2901/5785] 10.222.0.70 () {58 vars in 1384 bytes} [Sun Aug 28 19:16:47 2022] GET /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials?name=tempest-application_credential-666430463 => generated 885 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:47.881317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41479169-d581-4f8e-8ca5-6cdda0ce6b60 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.881856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41479169-d581-4f8e-8ca5-6cdda0ce6b60 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.882148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41479169-d581-4f8e-8ca5-6cdda0ce6b60 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.883958 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2902/5786] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:16:47.884890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41479169-d581-4f8e-8ca5-6cdda0ce6b60 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:47.909833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41479169-d581-4f8e-8ca5-6cdda0ce6b60 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:47.916993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd6a2-68ae-400d-91a7-7d6d1d18a1c5 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:47.918883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd6a2-68ae-400d-91a7-7d6d1d18a1c5 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:47.919269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd6a2-68ae-400d-91a7-7d6d1d18a1c5 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:47.919625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd6a2-68ae-400d-91a7-7d6d1d18a1c5 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/1e1ed535f88a41ed9e64f26f0c38e2ef` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:47.936681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dd6a2-68ae-400d-91a7-7d6d1d18a1c5 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc, application_credential_id=1e1ed535f88a41ed9e64f26f0c38e2ef)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:47.938866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dd6a2-68ae-400d-91a7-7d6d1d18a1c5 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:47.965827 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2903/5787] 10.222.0.70 () {58 vars in 1395 bytes} [Sun Aug 28 19:16:47 2022] DELETE /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/1e1ed535f88a41ed9e64f26f0c38e2ef => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:47.965827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd6a2-68ae-400d-91a7-7d6d1d18a1c5 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:16:47.979380 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2885/5788] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:47.980177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e32b0-55a0-41f7-b38e-79c65041cafb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:47.991277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd6a2-68ae-400d-91a7-7d6d1d18a1c5 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:48.001351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e32b0-55a0-41f7-b38e-79c65041cafb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:48.006886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd6a2-68ae-400d-91a7-7d6d1d18a1c5 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:48.007964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4d243-f6c0-4e17-9d40-445a5ab36135 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0c8f1f6619247f393fc9ff140e877fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e7f6e6ea51a491197bd582dfc5e9525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:48.009138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4d243-f6c0-4e17-9d40-445a5ab36135 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:48.011637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4d243-f6c0-4e17-9d40-445a5ab36135 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:48.011637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4d243-f6c0-4e17-9d40-445a5ab36135 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/b3bbae8fb4364d55b5afad5f2528ab06` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:48.011899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f844703-0f3c-4ebf-8d7e-8a6ce4bd967a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784fed2749f43a0aa3f48265de14df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9b9067e60fe41fcab77d14d01416f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:48.012286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844703-0f3c-4ebf-8d7e-8a6ce4bd967a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:48.012633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844703-0f3c-4ebf-8d7e-8a6ce4bd967a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:48.012921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844703-0f3c-4ebf-8d7e-8a6ce4bd967a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] PATH_INFO: `/v3/projects/e9b9067e60fe41fcab77d14d01416f2c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:48.014121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f844703-0f3c-4ebf-8d7e-8a6ce4bd967a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: Authorizing `identity:get_project(project_id=e9b9067e60fe41fcab77d14d01416f2c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:48.016071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f844703-0f3c-4ebf-8d7e-8a6ce4bd967a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:48.018227 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2904/5789] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:16:47 2022] GET /identity/v3/projects/e9b9067e60fe41fcab77d14d01416f2c => generated 365 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:48.023537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4d243-f6c0-4e17-9d40-445a5ab36135 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorizing `identity:delete_application_credential(user_id=d0c8f1f6619247f393fc9ff140e877fc, application_credential_id=b3bbae8fb4364d55b5afad5f2528ab06)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:48.025494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4d243-f6c0-4e17-9d40-445a5ab36135 tempest-ApplicationCredentialsV3Test-1837220252 tempest-ApplicationCredentialsV3Test-1837220252-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:48.052500 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2886/5790] 10.222.0.70 () {58 vars in 1395 bytes} [Sun Aug 28 19:16:47 2022] DELETE /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc/application_credentials/b3bbae8fb4364d55b5afad5f2528ab06 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:48.057905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f844703-0f3c-4ebf-8d7e-8a6ce4bd967a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:48.059800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4f844703-0f3c-4ebf-8d7e-8a6ce4bd967a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:48.069928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4fc37-74c5-4f00-a524-49707d4e61fb None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:48.070816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4fc37-74c5-4f00-a524-49707d4e61fb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:48.070816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4fc37-74c5-4f00-a524-49707d4e61fb None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:48.072301 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2887/5791] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 19:16:48.079762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4fc37-74c5-4f00-a524-49707d4e61fb None None] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:16:48.103016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4fc37-74c5-4f00-a524-49707d4e61fb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:48.114646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4fc37-74c5-4f00-a524-49707d4e61fb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:48.120456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bfa71-06b5-4552-a05c-9b605201f94a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2784fed2749f43a0aa3f48265de14df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9b9067e60fe41fcab77d14d01416f2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:48.120456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bfa71-06b5-4552-a05c-9b605201f94a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:48.120742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bfa71-06b5-4552-a05c-9b605201f94a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:48.121071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bfa71-06b5-4552-a05c-9b605201f94a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] PATH_INFO: `/v3/projects/e9b9067e60fe41fcab77d14d01416f2c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:48.123521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bfa71-06b5-4552-a05c-9b605201f94a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: Authorizing `identity:get_project(project_id=e9b9067e60fe41fcab77d14d01416f2c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:48.130674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bfa71-06b5-4552-a05c-9b605201f94a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:48.133405 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2888/5792] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:16:48 2022] GET /identity/v3/projects/e9b9067e60fe41fcab77d14d01416f2c => generated 365 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:48.209951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f844703-0f3c-4ebf-8d7e-8a6ce4bd967a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:48.219761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafca12-6a4a-4086-a071-b293addb0b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:48.220448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafca12-6a4a-4086-a071-b293addb0b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:48.220816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafca12-6a4a-4086-a071-b293addb0b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:48.221182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafca12-6a4a-4086-a071-b293addb0b6a admin admin] PATH_INFO: `/v3/users/d0c8f1f6619247f393fc9ff140e877fc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:48.222710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafca12-6a4a-4086-a071-b293addb0b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c8f1f6619247f393fc9ff140e877fc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:48.225699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafca12-6a4a-4086-a071-b293addb0b6a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:48.234068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bfa71-06b5-4552-a05c-9b605201f94a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:48.259431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bfa71-06b5-4552-a05c-9b605201f94a tempest-QuotasTestJSON-2068554179 tempest-QuotasTestJSON-2068554179-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:48.266921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1c9c6-0329-4499-aa40-0f3dd4f46272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:48.268339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1c9c6-0329-4499-aa40-0f3dd4f46272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:48.269116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1c9c6-0329-4499-aa40-0f3dd4f46272 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:48.270293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1c9c6-0329-4499-aa40-0f3dd4f46272 admin admin] PATH_INFO: `/v3/users/2784fed2749f43a0aa3f48265de14df8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:48.272321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1c9c6-0329-4499-aa40-0f3dd4f46272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2784fed2749f43a0aa3f48265de14df8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:48.275121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1c9c6-0329-4499-aa40-0f3dd4f46272 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:48.317452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2dafca12-6a4a-4086-a071-b293addb0b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c8f1f6619247f393fc9ff140e877fc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:48.328381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2dafca12-6a4a-4086-a071-b293addb0b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c8f1f6619247f393fc9ff140e877fc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:48.329117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2dafca12-6a4a-4086-a071-b293addb0b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c8f1f6619247f393fc9ff140e877fc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:48.340863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2dafca12-6a4a-4086-a071-b293addb0b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c8f1f6619247f393fc9ff140e877fc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:48.341636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2dafca12-6a4a-4086-a071-b293addb0b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c8f1f6619247f393fc9ff140e877fc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:48.390807 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2905/5793] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:48 2022] DELETE /identity/v3/users/d0c8f1f6619247f393fc9ff140e877fc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:48.393775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f596cdd-9a94-4226-9a69-37c82953bb26 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:48.394072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f596cdd-9a94-4226-9a69-37c82953bb26 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:48.395348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f596cdd-9a94-4226-9a69-37c82953bb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:48.405281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5a1c9c6-0329-4499-aa40-0f3dd4f46272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2784fed2749f43a0aa3f48265de14df8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:48.417652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:48.437311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5a1c9c6-0329-4499-aa40-0f3dd4f46272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2784fed2749f43a0aa3f48265de14df8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:48.437769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2f596cdd-9a94-4226-9a69-37c82953bb26 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:48.439524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5a1c9c6-0329-4499-aa40-0f3dd4f46272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2784fed2749f43a0aa3f48265de14df8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:48.440404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2f596cdd-9a94-4226-9a69-37c82953bb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:48.482059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5a1c9c6-0329-4499-aa40-0f3dd4f46272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2784fed2749f43a0aa3f48265de14df8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:48.483414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5a1c9c6-0329-4499-aa40-0f3dd4f46272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2784fed2749f43a0aa3f48265de14df8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:48.528294 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2889/5794] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:48 2022] DELETE /identity/v3/users/2784fed2749f43a0aa3f48265de14df8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:48.529964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bfe72-7719-47c2-bdfd-7021e215cf9d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:48.530264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bfe72-7719-47c2-bdfd-7021e215cf9d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:48.530550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bfe72-7719-47c2-bdfd-7021e215cf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:48.574759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c48bfe72-7719-47c2-bdfd-7021e215cf9d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:48.577001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c48bfe72-7719-47c2-bdfd-7021e215cf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:48.601965 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2906/5795] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:48.608886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f596cdd-9a94-4226-9a69-37c82953bb26 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:48.610840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2f596cdd-9a94-4226-9a69-37c82953bb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:48.681436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:48.705406 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2890/5796] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:48.717440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bfe72-7719-47c2-bdfd-7021e215cf9d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:48.724992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f596cdd-9a94-4226-9a69-37c82953bb26 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:48.808954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bfe72-7719-47c2-bdfd-7021e215cf9d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:48.814361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189a557-1a6c-4a75-946e-5525a89add6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:48.815102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189a557-1a6c-4a75-946e-5525a89add6a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:48.815416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189a557-1a6c-4a75-946e-5525a89add6a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:48.815972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189a557-1a6c-4a75-946e-5525a89add6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:48.818227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b17a2f-be87-4d36-adfc-996654a7efcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:48.819092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b17a2f-be87-4d36-adfc-996654a7efcf service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:48.819527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b17a2f-be87-4d36-adfc-996654a7efcf service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:48.819945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b17a2f-be87-4d36-adfc-996654a7efcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:48.834145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b17a2f-be87-4d36-adfc-996654a7efcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:48.837832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b17a2f-be87-4d36-adfc-996654a7efcf service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:48.837980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189a557-1a6c-4a75-946e-5525a89add6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:48.839389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189a557-1a6c-4a75-946e-5525a89add6a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:48.854432 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2907/5797] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:48.860783 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2891/5798] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:49.899579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b17a2f-be87-4d36-adfc-996654a7efcf service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:49.901289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-15b17a2f-be87-4d36-adfc-996654a7efcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:49.941298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b17a2f-be87-4d36-adfc-996654a7efcf service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:49.972203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a260aec-9e5d-461c-b7b5-745acd149b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:49.975542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a260aec-9e5d-461c-b7b5-745acd149b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:49.975875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a260aec-9e5d-461c-b7b5-745acd149b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:49.976183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a260aec-9e5d-461c-b7b5-745acd149b69 admin admin] PATH_INFO: `/v3/projects/e9b9067e60fe41fcab77d14d01416f2c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:49.978095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a260aec-9e5d-461c-b7b5-745acd149b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9b9067e60fe41fcab77d14d01416f2c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:49.981980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a260aec-9e5d-461c-b7b5-745acd149b69 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:50.018775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189a557-1a6c-4a75-946e-5525a89add6a service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:50.021791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5189a557-1a6c-4a75-946e-5525a89add6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:50.041276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189a557-1a6c-4a75-946e-5525a89add6a service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:50.047515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110f9ef-d83b-4c04-8f18-73679e1004d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:50.048845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110f9ef-d83b-4c04-8f18-73679e1004d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:50.049423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110f9ef-d83b-4c04-8f18-73679e1004d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:50.049775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110f9ef-d83b-4c04-8f18-73679e1004d4 admin admin] PATH_INFO: `/v3/projects/8e7f6e6ea51a491197bd582dfc5e9525` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:50.053252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110f9ef-d83b-4c04-8f18-73679e1004d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7f6e6ea51a491197bd582dfc5e9525)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:50.055453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110f9ef-d83b-4c04-8f18-73679e1004d4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:50.088312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a260aec-9e5d-461c-b7b5-745acd149b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9b9067e60fe41fcab77d14d01416f2c', 'request_id': 'req-6a260aec-9e5d-461c-b7b5-745acd149b69'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:50.099661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a260aec-9e5d-461c-b7b5-745acd149b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9b9067e60fe41fcab77d14d01416f2c', 'request_id': 'req-6a260aec-9e5d-461c-b7b5-745acd149b69'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:50.103827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:50.115778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a260aec-9e5d-461c-b7b5-745acd149b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9b9067e60fe41fcab77d14d01416f2c', 'request_id': 'req-6a260aec-9e5d-461c-b7b5-745acd149b69'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:50.137175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a260aec-9e5d-461c-b7b5-745acd149b69 admin admin] The token cache is being invalidate because project e9b9067e60fe41fcab77d14d01416f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:50.137897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a260aec-9e5d-461c-b7b5-745acd149b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:50.138605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6a260aec-9e5d-461c-b7b5-745acd149b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:50.147351 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2908/5799] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:49 2022] DELETE /identity/v3/projects/e9b9067e60fe41fcab77d14d01416f2c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:50.155291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a0d4-2bfd-4a1d-bbda-478979f03ac1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:50.155757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a0d4-2bfd-4a1d-bbda-478979f03ac1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:50.156314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a0d4-2bfd-4a1d-bbda-478979f03ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:50.173026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f110f9ef-d83b-4c04-8f18-73679e1004d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7f6e6ea51a491197bd582dfc5e9525', 'request_id': 'req-f110f9ef-d83b-4c04-8f18-73679e1004d4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:50.185004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b2d7a0d4-2bfd-4a1d-bbda-478979f03ac1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:50.186376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b2d7a0d4-2bfd-4a1d-bbda-478979f03ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:50.192683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f110f9ef-d83b-4c04-8f18-73679e1004d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7f6e6ea51a491197bd582dfc5e9525', 'request_id': 'req-f110f9ef-d83b-4c04-8f18-73679e1004d4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:50.204337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f110f9ef-d83b-4c04-8f18-73679e1004d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7f6e6ea51a491197bd582dfc5e9525', 'request_id': 'req-f110f9ef-d83b-4c04-8f18-73679e1004d4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:50.228912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f110f9ef-d83b-4c04-8f18-73679e1004d4 admin admin] The token cache is being invalidate because project 8e7f6e6ea51a491197bd582dfc5e9525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:50.229332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f110f9ef-d83b-4c04-8f18-73679e1004d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:50.230961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f110f9ef-d83b-4c04-8f18-73679e1004d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:50.235347 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2892/5800] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:50 2022] DELETE /identity/v3/projects/8e7f6e6ea51a491197bd582dfc5e9525 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:50.239652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7262d-6a8f-451c-9f38-9f4520bcb4ff None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:50.240084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7262d-6a8f-451c-9f38-9f4520bcb4ff None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:50.240966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7262d-6a8f-451c-9f38-9f4520bcb4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:50.277495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f6a7262d-6a8f-451c-9f38-9f4520bcb4ff None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:50.280898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f6a7262d-6a8f-451c-9f38-9f4520bcb4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:50.299268 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2909/5801] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:50.305021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52b3f0-ccce-4ad2-b178-16b8b0d05707 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:50.305317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52b3f0-ccce-4ad2-b178-16b8b0d05707 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:50.305604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52b3f0-ccce-4ad2-b178-16b8b0d05707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:50.350469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3f52b3f0-ccce-4ad2-b178-16b8b0d05707 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:50.352042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3f52b3f0-ccce-4ad2-b178-16b8b0d05707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:50.367087 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2910/5802] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:50.369395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52b3f0-ccce-4ad2-b178-16b8b0d05707 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:50.383655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52b3f0-ccce-4ad2-b178-16b8b0d05707 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:50.389978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7393a3-0e66-4f62-9934-05c2e701f7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:50.390812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7393a3-0e66-4f62-9934-05c2e701f7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:50.391267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7393a3-0e66-4f62-9934-05c2e701f7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:50.392299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7393a3-0e66-4f62-9934-05c2e701f7e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:50.393133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7393a3-0e66-4f62-9934-05c2e701f7e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:50.393602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7393a3-0e66-4f62-9934-05c2e701f7e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:50.395975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7393a3-0e66-4f62-9934-05c2e701f7e3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:50.428089 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2911/5803] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:16:50.433898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7393a3-0e66-4f62-9934-05c2e701f7e3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:50.463804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7393a3-0e66-4f62-9934-05c2e701f7e3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:50.478953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45294a-0908-441e-90c6-a2f526607c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:50.480021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45294a-0908-441e-90c6-a2f526607c80 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:50.482129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45294a-0908-441e-90c6-a2f526607c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:50.482445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45294a-0908-441e-90c6-a2f526607c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:50.484071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45294a-0908-441e-90c6-a2f526607c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:50.489279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45294a-0908-441e-90c6-a2f526607c80 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:50.491881 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2893/5804] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:50.500654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea4131-edef-4f1b-a3b4-61c2997be7b9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:50.501193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea4131-edef-4f1b-a3b4-61c2997be7b9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:50.501652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea4131-edef-4f1b-a3b4-61c2997be7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:50.553307 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2912/5805] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:50 2022] POST /identity/v3/projects => generated 359 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:50.559552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45294a-0908-441e-90c6-a2f526607c80 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:50.580173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f5ea4131-edef-4f1b-a3b4-61c2997be7b9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:50.581445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f5ea4131-edef-4f1b-a3b4-61c2997be7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:50.647617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:50.727439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45294a-0908-441e-90c6-a2f526607c80 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:50.737628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559e8e0-252f-4906-b4ce-61e50177a03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:50.738368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559e8e0-252f-4906-b4ce-61e50177a03c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:50.738615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559e8e0-252f-4906-b4ce-61e50177a03c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:50.740116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559e8e0-252f-4906-b4ce-61e50177a03c admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:50.742189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559e8e0-252f-4906-b4ce-61e50177a03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:50.745706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559e8e0-252f-4906-b4ce-61e50177a03c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:50.757946 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2894/5806] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:50.759289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea4131-edef-4f1b-a3b4-61c2997be7b9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:50.769829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f5ea4131-edef-4f1b-a3b4-61c2997be7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:50.816001 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2913/5807] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:50 2022] POST /identity/v3/users => generated 280 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:50.819286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559e8e0-252f-4906-b4ce-61e50177a03c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:50.837252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559e8e0-252f-4906-b4ce-61e50177a03c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:50.851353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3f387-655d-4b6a-8904-19adfaf5b58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:50.852077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3f387-655d-4b6a-8904-19adfaf5b58c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:50.852432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3f387-655d-4b6a-8904-19adfaf5b58c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:50.852791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3f387-655d-4b6a-8904-19adfaf5b58c admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:50.853528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3f387-655d-4b6a-8904-19adfaf5b58c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:50.853915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3f387-655d-4b6a-8904-19adfaf5b58c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:50.855780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3f387-655d-4b6a-8904-19adfaf5b58c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:50.873618 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2914/5808] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:50.876450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3f387-655d-4b6a-8904-19adfaf5b58c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:50.876814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea4131-edef-4f1b-a3b4-61c2997be7b9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:50.883115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e1f01-f8a3-4169-ae4c-c74bf91c97f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:50.883872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e1f01-f8a3-4169-ae4c-c74bf91c97f5 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:50.884229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e1f01-f8a3-4169-ae4c-c74bf91c97f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:50.884597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e1f01-f8a3-4169-ae4c-c74bf91c97f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:50.886509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f75e1f01-f8a3-4169-ae4c-c74bf91c97f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:50.892084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3f387-655d-4b6a-8904-19adfaf5b58c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:50.902583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0a922-9a6d-4308-9763-1ab0d0226624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:50.903367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0a922-9a6d-4308-9763-1ab0d0226624 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:50.903843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0a922-9a6d-4308-9763-1ab0d0226624 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:50.906247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0a922-9a6d-4308-9763-1ab0d0226624 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:50.906247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0a922-9a6d-4308-9763-1ab0d0226624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:50.908491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0a922-9a6d-4308-9763-1ab0d0226624 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:50.930490 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2915/5809] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:50.931681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0a922-9a6d-4308-9763-1ab0d0226624 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:50.960430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0a922-9a6d-4308-9763-1ab0d0226624 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:50.967171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1a470-8e41-4718-a909-ec0ea2cd8b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:50.967920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1a470-8e41-4718-a909-ec0ea2cd8b26 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:50.968210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1a470-8e41-4718-a909-ec0ea2cd8b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:50.968490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1a470-8e41-4718-a909-ec0ea2cd8b26 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:50.969266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1a470-8e41-4718-a909-ec0ea2cd8b26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:50.972150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1a470-8e41-4718-a909-ec0ea2cd8b26 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:50.985959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:50.990077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e1f01-f8a3-4169-ae4c-c74bf91c97f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:50.991622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e1f01-f8a3-4169-ae4c-c74bf91c97f5 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:51.003067 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2895/5810] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:51.004187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e1f01-f8a3-4169-ae4c-c74bf91c97f5 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:51.011518 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2916/5811] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:50 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:51.015498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1a470-8e41-4718-a909-ec0ea2cd8b26 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:51.018619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e1f01-f8a3-4169-ae4c-c74bf91c97f5 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:51.105353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1a470-8e41-4718-a909-ec0ea2cd8b26 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:51.110542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e3ea2-e7ca-4aea-a228-920edce5da79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:51.111224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e3ea2-e7ca-4aea-a228-920edce5da79 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:51.111624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e3ea2-e7ca-4aea-a228-920edce5da79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:51.111878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e3ea2-e7ca-4aea-a228-920edce5da79 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:51.112522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e3ea2-e7ca-4aea-a228-920edce5da79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:51.114881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a2c7f-93ba-4504-aa27-06656a35ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:51.116533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a2c7f-93ba-4504-aa27-06656a35ffd7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:51.116729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e3ea2-e7ca-4aea-a228-920edce5da79 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:51.117186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a2c7f-93ba-4504-aa27-06656a35ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:51.117470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a2c7f-93ba-4504-aa27-06656a35ffd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:51.118573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a2c7f-93ba-4504-aa27-06656a35ffd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:51.121216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a2c7f-93ba-4504-aa27-06656a35ffd7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:51.139004 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2896/5812] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:51.142234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a2c7f-93ba-4504-aa27-06656a35ffd7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:51.152226 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2917/5813] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:51 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:51.153444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e3ea2-e7ca-4aea-a228-920edce5da79 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:51.158179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a2c7f-93ba-4504-aa27-06656a35ffd7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:51.166225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e3ea2-e7ca-4aea-a228-920edce5da79 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:51.166566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf1ca4-6fe6-4e4d-824c-981f34d09e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:51.168474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf1ca4-6fe6-4e4d-824c-981f34d09e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:51.168798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf1ca4-6fe6-4e4d-824c-981f34d09e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:51.169127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf1ca4-6fe6-4e4d-824c-981f34d09e72 admin admin] PATH_INFO: `/v3/projects/a7b6b0573bac4718934f8690df0cdabc/users/0c200d481f8b4a5890eb169b6d5d50ef/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:51.174881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081547f-6965-4ecb-b58e-48204e02ed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:51.175620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081547f-6965-4ecb-b58e-48204e02ed1d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:51.176507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081547f-6965-4ecb-b58e-48204e02ed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:51.176974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081547f-6965-4ecb-b58e-48204e02ed1d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:51.177991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081547f-6965-4ecb-b58e-48204e02ed1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:51.180000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081547f-6965-4ecb-b58e-48204e02ed1d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:51.186460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:51.195082 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2918/5814] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:51.196717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf1ca4-6fe6-4e4d-824c-981f34d09e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b6b0573bac4718934f8690df0cdabc, user_id=0c200d481f8b4a5890eb169b6d5d50ef, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:51.197564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081547f-6965-4ecb-b58e-48204e02ed1d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:51.199706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf1ca4-6fe6-4e4d-824c-981f34d09e72 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:51.209623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081547f-6965-4ecb-b58e-48204e02ed1d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:51.218946 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2897/5815] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:51 2022] PUT /identity/v3/projects/a7b6b0573bac4718934f8690df0cdabc/users/0c200d481f8b4a5890eb169b6d5d50ef/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:51.232330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749592e-d48b-4e0b-b34a-317bb5dbd671 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:51.232653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749592e-d48b-4e0b-b34a-317bb5dbd671 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:51.232887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749592e-d48b-4e0b-b34a-317bb5dbd671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:51.338425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d7d19-76ff-4b93-8fd4-834d0c041446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:51.339337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d7d19-76ff-4b93-8fd4-834d0c041446 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:51.339463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d7d19-76ff-4b93-8fd4-834d0c041446 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:51.339722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d7d19-76ff-4b93-8fd4-834d0c041446 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:51.341338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d7d19-76ff-4b93-8fd4-834d0c041446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:51.344069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d7d19-76ff-4b93-8fd4-834d0c041446 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:51.358265 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2919/5816] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:51.372838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d7d19-76ff-4b93-8fd4-834d0c041446 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:51.376266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b749592e-d48b-4e0b-b34a-317bb5dbd671 None None] MFA Rules not processed for user `0c200d481f8b4a5890eb169b6d5d50ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:51.376266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b749592e-d48b-4e0b-b34a-317bb5dbd671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:51.405312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d7d19-76ff-4b93-8fd4-834d0c041446 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:51.420248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5fbff-ec67-48aa-9fc9-f90654da612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:51.421719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5fbff-ec67-48aa-9fc9-f90654da612b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:51.421889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5fbff-ec67-48aa-9fc9-f90654da612b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:51.422059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5fbff-ec67-48aa-9fc9-f90654da612b admin admin] PATH_INFO: `/v3/projects/9f018a89a2a94e1f848e1b3073affa54/users/dd3b890fb0f84c81b64801da1abe82c9/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:51.479938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5fbff-ec67-48aa-9fc9-f90654da612b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f018a89a2a94e1f848e1b3073affa54, user_id=dd3b890fb0f84c81b64801da1abe82c9, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:51.490520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5fbff-ec67-48aa-9fc9-f90654da612b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:51.530016 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2920/5817] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:51 2022] PUT /identity/v3/projects/9f018a89a2a94e1f848e1b3073affa54/users/dd3b890fb0f84c81b64801da1abe82c9/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:51.541534 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2898/5818] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:16:51.542136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc08852-7e4d-4b40-af0c-5ce819da010d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:51.542432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc08852-7e4d-4b40-af0c-5ce819da010d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:51.544771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc08852-7e4d-4b40-af0c-5ce819da010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:51.590414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749592e-d48b-4e0b-b34a-317bb5dbd671 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:51.621965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749592e-d48b-4e0b-b34a-317bb5dbd671 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:51.630455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5cc08852-7e4d-4b40-af0c-5ce819da010d None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:51.631768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5cc08852-7e4d-4b40-af0c-5ce819da010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:51.699897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:51.818650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dabaf8-af1e-4e05-87f3-35f95d917986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:51.820349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dabaf8-af1e-4e05-87f3-35f95d917986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:51.821768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dabaf8-af1e-4e05-87f3-35f95d917986 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:51.822221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dabaf8-af1e-4e05-87f3-35f95d917986 admin admin] PATH_INFO: `/v3/users/0c200d481f8b4a5890eb169b6d5d50ef` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:51.822733 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2921/5819] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:51.824227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dabaf8-af1e-4e05-87f3-35f95d917986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c200d481f8b4a5890eb169b6d5d50ef)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:51.827654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dabaf8-af1e-4e05-87f3-35f95d917986 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:51.828157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc08852-7e4d-4b40-af0c-5ce819da010d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:51.858821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc08852-7e4d-4b40-af0c-5ce819da010d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:51.870411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce816900-852a-4988-8725-4ba95ef0fb35 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b890fb0f84c81b64801da1abe82c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f018a89a2a94e1f848e1b3073affa54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:51.871112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce816900-852a-4988-8725-4ba95ef0fb35 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:51.874863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce816900-852a-4988-8725-4ba95ef0fb35 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:51.874863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce816900-852a-4988-8725-4ba95ef0fb35 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] PATH_INFO: `/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:51.951482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49dabaf8-af1e-4e05-87f3-35f95d917986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c200d481f8b4a5890eb169b6d5d50ef'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:51.985852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49dabaf8-af1e-4e05-87f3-35f95d917986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c200d481f8b4a5890eb169b6d5d50ef'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:51.987753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ce816900-852a-4988-8725-4ba95ef0fb35 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:51.990405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49dabaf8-af1e-4e05-87f3-35f95d917986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c200d481f8b4a5890eb169b6d5d50ef'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:52.002775 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2922/5820] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:16:51 2022] POST /identity/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:52.002775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce816900-852a-4988-8725-4ba95ef0fb35 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:52.007660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ce816900-852a-4988-8725-4ba95ef0fb35 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:52.054521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49dabaf8-af1e-4e05-87f3-35f95d917986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c200d481f8b4a5890eb169b6d5d50ef'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:52.056464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49dabaf8-af1e-4e05-87f3-35f95d917986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c200d481f8b4a5890eb169b6d5d50ef'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:52.062465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:52.093812 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2899/5821] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:51 2022] DELETE /identity/v3/users/0c200d481f8b4a5890eb169b6d5d50ef => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:52.093812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dc661-40ec-418a-a939-01d5d1bb7334 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:52.093812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dc661-40ec-418a-a939-01d5d1bb7334 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:52.093812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dc661-40ec-418a-a939-01d5d1bb7334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:52.143248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b87dc661-40ec-418a-a939-01d5d1bb7334 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:52.145664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b87dc661-40ec-418a-a939-01d5d1bb7334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:52.170325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce816900-852a-4988-8725-4ba95ef0fb35 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:52.245519 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2900/5822] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:52.246698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dc661-40ec-418a-a939-01d5d1bb7334 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:52.248590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b87dc661-40ec-418a-a939-01d5d1bb7334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:52.266372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55b334-2b08-4e62-b9db-29adb422d534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:52.266911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55b334-2b08-4e62-b9db-29adb422d534 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:52.267868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55b334-2b08-4e62-b9db-29adb422d534 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:52.267868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55b334-2b08-4e62-b9db-29adb422d534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:52.270204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0c55b334-2b08-4e62-b9db-29adb422d534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:52.326286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dc661-40ec-418a-a939-01d5d1bb7334 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:52.331552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df5609-b17f-4b7b-aea3-414a60ad4ee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:52.332627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df5609-b17f-4b7b-aea3-414a60ad4ee4 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:52.332981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df5609-b17f-4b7b-aea3-414a60ad4ee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:52.333322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df5609-b17f-4b7b-aea3-414a60ad4ee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:52.335820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e7df5609-b17f-4b7b-aea3-414a60ad4ee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:52.372842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:52.383816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55b334-2b08-4e62-b9db-29adb422d534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:52.389291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55b334-2b08-4e62-b9db-29adb422d534 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:52.414921 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2923/5823] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:52.417779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55b334-2b08-4e62-b9db-29adb422d534 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:52.421421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0c55b334-2b08-4e62-b9db-29adb422d534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:52.438644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55b334-2b08-4e62-b9db-29adb422d534 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:52.442120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df5609-b17f-4b7b-aea3-414a60ad4ee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:52.443812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df5609-b17f-4b7b-aea3-414a60ad4ee4 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:52.443974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d778523-22c9-447b-9232-74ff5b5bca49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:52.444485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778523-22c9-447b-9232-74ff5b5bca49 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:52.444779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778523-22c9-447b-9232-74ff5b5bca49 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:52.445062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778523-22c9-447b-9232-74ff5b5bca49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:52.455394 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2901/5824] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:52.457722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d778523-22c9-447b-9232-74ff5b5bca49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:52.459414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d778523-22c9-447b-9232-74ff5b5bca49 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:52.473185 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2924/5825] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:16:53.007782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7f502-11a0-4499-bb1c-2419b8ca587b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:53.008613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7f502-11a0-4499-bb1c-2419b8ca587b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:53.009208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7f502-11a0-4499-bb1c-2419b8ca587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:53.038554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5ff7f502-11a0-4499-bb1c-2419b8ca587b None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:53.040529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5ff7f502-11a0-4499-bb1c-2419b8ca587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:53.052169 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2902/5826] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:53 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:16:53.056295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797d09d-7c0f-4ef9-ba48-7d96758cd0d8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:53.056787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797d09d-7c0f-4ef9-ba48-7d96758cd0d8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:53.056907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797d09d-7c0f-4ef9-ba48-7d96758cd0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:53.102284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4797d09d-7c0f-4ef9-ba48-7d96758cd0d8 None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:53.104405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4797d09d-7c0f-4ef9-ba48-7d96758cd0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:53.248682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7f502-11a0-4499-bb1c-2419b8ca587b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:53.250087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5ff7f502-11a0-4499-bb1c-2419b8ca587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:53.252449 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2925/5827] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:53.258584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797d09d-7c0f-4ef9-ba48-7d96758cd0d8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:53.274536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797d09d-7c0f-4ef9-ba48-7d96758cd0d8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:53.282160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823328-9491-4584-b2b2-79f8b9d28f76 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b890fb0f84c81b64801da1abe82c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f018a89a2a94e1f848e1b3073affa54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:53.283250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823328-9491-4584-b2b2-79f8b9d28f76 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:53.283971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823328-9491-4584-b2b2-79f8b9d28f76 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:53.284423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823328-9491-4584-b2b2-79f8b9d28f76 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] PATH_INFO: `/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:53.308509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7f502-11a0-4499-bb1c-2419b8ca587b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:53.330467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:53.331160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:53.331505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:53.331788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9 admin admin] PATH_INFO: `/v3/projects/a7b6b0573bac4718934f8690df0cdabc` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:53.333254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b6b0573bac4718934f8690df0cdabc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:53.335251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:53.389172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-85823328-9491-4584-b2b2-79f8b9d28f76 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 19:16:53.389172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:16:53.389172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:16:53.389172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:16:53.389172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:16:53.389172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:16:53.389172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:16:53.389172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:16:53.389172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:16:53.389172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:16:53.389172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:16:53.389172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:16:53.389172 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 19:16:53.390372 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:53.404029 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2926/5828] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:16:53 2022] POST /identity/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password => generated 188 bytes in 146 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 19:16:53.407580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823328-9491-4584-b2b2-79f8b9d28f76 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:53.425334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823328-9491-4584-b2b2-79f8b9d28f76 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:53.437268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df92bbc-db6b-4d39-90c4-1f55f6de3e1a tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b890fb0f84c81b64801da1abe82c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f018a89a2a94e1f848e1b3073affa54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:53.438583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df92bbc-db6b-4d39-90c4-1f55f6de3e1a tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:53.438899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df92bbc-db6b-4d39-90c4-1f55f6de3e1a tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:53.439179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df92bbc-db6b-4d39-90c4-1f55f6de3e1a tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] PATH_INFO: `/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:53.442085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:53.469366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b6b0573bac4718934f8690df0cdabc', 'request_id': 'req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:53.497548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b6b0573bac4718934f8690df0cdabc', 'request_id': 'req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:53.516695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b6b0573bac4718934f8690df0cdabc', 'request_id': 'req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:53.545829 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-0df92bbc-db6b-4d39-90c4-1f55f6de3e1a tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 19:16:53.545829 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:16:53.545829 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:16:53.545829 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:16:53.545829 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:16:53.545829 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:16:53.545829 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:16:53.545829 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:16:53.545829 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:16:53.545829 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:16:53.545829 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:16:53.545829 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:16:53.545829 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 28 19:16:53.547097 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:16:53.551899 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2927/5829] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:16:53 2022] POST /identity/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password => generated 188 bytes in 141 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 19:16:53.552804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df92bbc-db6b-4d39-90c4-1f55f6de3e1a tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:53.553526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9 admin admin] The token cache is being invalidate because project a7b6b0573bac4718934f8690df0cdabc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:16:53.554095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:53.555124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4f20d13c-f180-4b12-b429-3a4b5d0deaa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:53.557430 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2903/5830] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:16:53 2022] DELETE /identity/v3/projects/a7b6b0573bac4718934f8690df0cdabc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:53.565183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c5901-5a4e-4639-9c77-8d240f3e0d40 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:53.565708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c5901-5a4e-4639-9c77-8d240f3e0d40 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:53.565988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c5901-5a4e-4639-9c77-8d240f3e0d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:53.575153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df92bbc-db6b-4d39-90c4-1f55f6de3e1a tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:53.620035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2a5c5901-5a4e-4639-9c77-8d240f3e0d40 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:53.621272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2a5c5901-5a4e-4639-9c77-8d240f3e0d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:53.706837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7ea0b-1e0e-4478-808e-9d6ebc881b1c tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b890fb0f84c81b64801da1abe82c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f018a89a2a94e1f848e1b3073affa54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:53.708370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7ea0b-1e0e-4478-808e-9d6ebc881b1c tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:53.708657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7ea0b-1e0e-4478-808e-9d6ebc881b1c tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:53.708924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7ea0b-1e0e-4478-808e-9d6ebc881b1c tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] PATH_INFO: `/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:53.860029 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2904/5831] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:16:53.878700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b8c7ea0b-1e0e-4478-808e-9d6ebc881b1c tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:53.913454 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2928/5832] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:16:53 2022] POST /identity/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:53.951841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6116f22-9832-43aa-9dcc-e354106a4145 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:53.952253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6116f22-9832-43aa-9dcc-e354106a4145 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:53.952726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6116f22-9832-43aa-9dcc-e354106a4145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:53.996128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c6116f22-9832-43aa-9dcc-e354106a4145 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:53.997758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c6116f22-9832-43aa-9dcc-e354106a4145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:54.013671 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2905/5833] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:54.017572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7ea0b-1e0e-4478-808e-9d6ebc881b1c tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:54.030912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7ea0b-1e0e-4478-808e-9d6ebc881b1c tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:54.044979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110f434-26f5-4fa5-a6d4-b2972029599d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:54.045237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110f434-26f5-4fa5-a6d4-b2972029599d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:54.045568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110f434-26f5-4fa5-a6d4-b2972029599d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:54.045946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110f434-26f5-4fa5-a6d4-b2972029599d admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:54.046798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110f434-26f5-4fa5-a6d4-b2972029599d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:16:54.047214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110f434-26f5-4fa5-a6d4-b2972029599d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:54.049680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110f434-26f5-4fa5-a6d4-b2972029599d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:54.074245 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2929/5834] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:54.085923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6116f22-9832-43aa-9dcc-e354106a4145 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:54.106644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6116f22-9832-43aa-9dcc-e354106a4145 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:54.117488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299ec8-899e-40a1-8b73-b9cadf7350ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:54.118719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299ec8-899e-40a1-8b73-b9cadf7350ab admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:54.119226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299ec8-899e-40a1-8b73-b9cadf7350ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:54.119502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299ec8-899e-40a1-8b73-b9cadf7350ab admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:54.120154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299ec8-899e-40a1-8b73-b9cadf7350ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:54.122974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299ec8-899e-40a1-8b73-b9cadf7350ab admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:54.166064 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2906/5835] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:54 2022] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:54.167162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110f434-26f5-4fa5-a6d4-b2972029599d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:54.181483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110f434-26f5-4fa5-a6d4-b2972029599d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:54.187846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:54.278932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17c53c-1609-41c0-ac70-dd6143ce5a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:54.279657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17c53c-1609-41c0-ac70-dd6143ce5a68 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:54.280165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17c53c-1609-41c0-ac70-dd6143ce5a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:54.280549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17c53c-1609-41c0-ac70-dd6143ce5a68 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:54.281308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17c53c-1609-41c0-ac70-dd6143ce5a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:54.283995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17c53c-1609-41c0-ac70-dd6143ce5a68 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:54.314894 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2930/5836] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:54 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:16:54.317813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299ec8-899e-40a1-8b73-b9cadf7350ab admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:54.332108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299ec8-899e-40a1-8b73-b9cadf7350ab admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:54.339135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4800103-4627-4c23-942c-7ea884047010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:54.340069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4800103-4627-4c23-942c-7ea884047010 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:54.340525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4800103-4627-4c23-942c-7ea884047010 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:54.341093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4800103-4627-4c23-942c-7ea884047010 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:54.341822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4800103-4627-4c23-942c-7ea884047010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:54.344072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4800103-4627-4c23-942c-7ea884047010 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:54.362428 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2907/5837] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:54.364489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17c53c-1609-41c0-ac70-dd6143ce5a68 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:54.382897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17c53c-1609-41c0-ac70-dd6143ce5a68 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:54.388979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615007c-35ce-49a1-b445-314647eded72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:54.389752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615007c-35ce-49a1-b445-314647eded72 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:54.390644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615007c-35ce-49a1-b445-314647eded72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:54.390644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615007c-35ce-49a1-b445-314647eded72 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:54.391739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615007c-35ce-49a1-b445-314647eded72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:54.393362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615007c-35ce-49a1-b445-314647eded72 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:54.406873 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2931/5838] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:54.411863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4800103-4627-4c23-942c-7ea884047010 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:54.424491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4800103-4627-4c23-942c-7ea884047010 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:54.438466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c5fe7-3bd9-4661-a005-dcd589f46aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:54.445263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c5fe7-3bd9-4661-a005-dcd589f46aae admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:54.445558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c5fe7-3bd9-4661-a005-dcd589f46aae admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:54.445835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c5fe7-3bd9-4661-a005-dcd589f46aae admin admin] PATH_INFO: `/v3/projects/9cfb62246e804db592aea2f2e564c49e/users/665aa4d5804a46e1a775bd9831fdde22/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:54.477364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c5fe7-3bd9-4661-a005-dcd589f46aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cfb62246e804db592aea2f2e564c49e, user_id=665aa4d5804a46e1a775bd9831fdde22, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:54.480636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c5fe7-3bd9-4661-a005-dcd589f46aae admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:54.500713 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2908/5839] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:54 2022] PUT /identity/v3/projects/9cfb62246e804db592aea2f2e564c49e/users/665aa4d5804a46e1a775bd9831fdde22/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:54.510659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2e71e-c335-46ff-8b6a-633b4cc852b7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:54.510985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2e71e-c335-46ff-8b6a-633b4cc852b7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:54.511299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2e71e-c335-46ff-8b6a-633b4cc852b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:54.557461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d2d2e71e-c335-46ff-8b6a-633b4cc852b7 None None] MFA Rules not processed for user `665aa4d5804a46e1a775bd9831fdde22`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:54.558821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d2d2e71e-c335-46ff-8b6a-633b4cc852b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:54.654899 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2932/5840] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:54.658993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c5fe7-3bd9-4661-a005-dcd589f46aae admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:54.756365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c5fe7-3bd9-4661-a005-dcd589f46aae admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:54.767755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492839f5-dce2-4390-a6fb-4ead4cb06a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:54.768528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492839f5-dce2-4390-a6fb-4ead4cb06a4b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:54.769291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492839f5-dce2-4390-a6fb-4ead4cb06a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:54.769992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492839f5-dce2-4390-a6fb-4ead4cb06a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:54.775363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492839f5-dce2-4390-a6fb-4ead4cb06a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:54.778869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492839f5-dce2-4390-a6fb-4ead4cb06a4b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:54.792698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:54.855579 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2909/5841] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:16:54 2022] POST /identity/v3/projects => generated 363 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:54.856882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2e71e-c335-46ff-8b6a-633b4cc852b7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:54.873561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2e71e-c335-46ff-8b6a-633b4cc852b7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:54.919729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67a759-e638-4b88-a09f-61ca8b2c3fd2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:54.920020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67a759-e638-4b88-a09f-61ca8b2c3fd2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:54.920322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67a759-e638-4b88-a09f-61ca8b2c3fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:54.970454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9c67a759-e638-4b88-a09f-61ca8b2c3fd2 None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:54.973273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9c67a759-e638-4b88-a09f-61ca8b2c3fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:54.990602 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2910/5842] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:54 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:16:54.992089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ce7b-dcc4-4015-a2f9-306d752b7406 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:54.992382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ce7b-dcc4-4015-a2f9-306d752b7406 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:54.992659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4ce7b-dcc4-4015-a2f9-306d752b7406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:55.019358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-73c4ce7b-dcc4-4015-a2f9-306d752b7406 None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:55.022101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-73c4ce7b-dcc4-4015-a2f9-306d752b7406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:55.045934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12f698-914a-4020-819f-75288b87e050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:55.046468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12f698-914a-4020-819f-75288b87e050 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:55.046774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12f698-914a-4020-819f-75288b87e050 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:55.047131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12f698-914a-4020-819f-75288b87e050 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:55.047847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12f698-914a-4020-819f-75288b87e050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:55.049834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12f698-914a-4020-819f-75288b87e050 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:55.100199 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2933/5843] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:54 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:55.103719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12f698-914a-4020-819f-75288b87e050 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:55.110483 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2911/5844] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:55.116231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4ce7b-dcc4-4015-a2f9-306d752b7406 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:55.126406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4ce7b-dcc4-4015-a2f9-306d752b7406 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:55.131878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cc4c5-a552-4f0c-b679-4321d0f89518 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b890fb0f84c81b64801da1abe82c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f018a89a2a94e1f848e1b3073affa54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:55.132682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cc4c5-a552-4f0c-b679-4321d0f89518 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:55.132979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cc4c5-a552-4f0c-b679-4321d0f89518 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:55.133263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cc4c5-a552-4f0c-b679-4321d0f89518 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] PATH_INFO: `/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:55.134483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:55.148437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12f698-914a-4020-819f-75288b87e050 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:55.166558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd5246-b68e-437c-9c9e-4991d4e283a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:55.167400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd5246-b68e-437c-9c9e-4991d4e283a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:55.167781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd5246-b68e-437c-9c9e-4991d4e283a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:55.168155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd5246-b68e-437c-9c9e-4991d4e283a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:55.168921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd5246-b68e-437c-9c9e-4991d4e283a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:55.170674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd5246-b68e-437c-9c9e-4991d4e283a9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:55.201640 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2934/5845] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:16:55.203215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd5246-b68e-437c-9c9e-4991d4e283a9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:55.232061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd5246-b68e-437c-9c9e-4991d4e283a9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:55.244238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb604db4-1794-4c8f-b0c6-3c8818f56236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:55.245419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb604db4-1794-4c8f-b0c6-3c8818f56236 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:55.245943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb604db4-1794-4c8f-b0c6-3c8818f56236 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:55.246200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb604db4-1794-4c8f-b0c6-3c8818f56236 admin admin] PATH_INFO: `/v3/projects/bde515766b9b4a959d4eecc593338539/users/4f624d1da6ea463dbbb8485000febc16/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:55.265122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6b4cc4c5-a552-4f0c-b679-4321d0f89518 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:55.280147 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2912/5846] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:16:55 2022] POST /identity/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:55.280388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb604db4-1794-4c8f-b0c6-3c8818f56236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde515766b9b4a959d4eecc593338539, user_id=4f624d1da6ea463dbbb8485000febc16, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:55.283038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb604db4-1794-4c8f-b0c6-3c8818f56236 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:55.310780 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2935/5847] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:55 2022] PUT /identity/v3/projects/bde515766b9b4a959d4eecc593338539/users/4f624d1da6ea463dbbb8485000febc16/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:55.314426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cc4c5-a552-4f0c-b679-4321d0f89518 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:55.333227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cc4c5-a552-4f0c-b679-4321d0f89518 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:55.425971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6794f05-93d6-465c-863c-6a40654c7aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:55.427232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6794f05-93d6-465c-863c-6a40654c7aea admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:55.427633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6794f05-93d6-465c-863c-6a40654c7aea admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:55.428411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6794f05-93d6-465c-863c-6a40654c7aea admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:55.429299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6794f05-93d6-465c-863c-6a40654c7aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:55.431254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6794f05-93d6-465c-863c-6a40654c7aea admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:55.446059 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2913/5848] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:55.449748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb604db4-1794-4c8f-b0c6-3c8818f56236 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:55.462449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb604db4-1794-4c8f-b0c6-3c8818f56236 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:55.472026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbabc7-0659-480a-8771-e7b0ba3d28b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:55.473345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbabc7-0659-480a-8771-e7b0ba3d28b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:55.473532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbabc7-0659-480a-8771-e7b0ba3d28b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:55.473759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbabc7-0659-480a-8771-e7b0ba3d28b9 admin admin] PATH_INFO: `/v3/projects/bde515766b9b4a959d4eecc593338539/users/4f624d1da6ea463dbbb8485000febc16/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:55.488411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbabc7-0659-480a-8771-e7b0ba3d28b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde515766b9b4a959d4eecc593338539, user_id=4f624d1da6ea463dbbb8485000febc16, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:55.488411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbabc7-0659-480a-8771-e7b0ba3d28b9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:55.495179 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2936/5849] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:16:55 2022] PUT /identity/v3/projects/bde515766b9b4a959d4eecc593338539/users/4f624d1da6ea463dbbb8485000febc16/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:55.508933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1231c1-96a9-4440-b0f1-af31662383ef None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:55.510358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1231c1-96a9-4440-b0f1-af31662383ef None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:55.510358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1231c1-96a9-4440-b0f1-af31662383ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:55.589021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6b1231c1-96a9-4440-b0f1-af31662383ef None None] MFA Rules not processed for user `4f624d1da6ea463dbbb8485000febc16`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:55.590453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6b1231c1-96a9-4440-b0f1-af31662383ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:55.664100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:55.730063 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2914/5850] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:55.730726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbabc7-0659-480a-8771-e7b0ba3d28b9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:55.743685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbabc7-0659-480a-8771-e7b0ba3d28b9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:55.748875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fba53-0831-4b6d-8f6f-064e7332516b tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:55.749779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fba53-0831-4b6d-8f6f-064e7332516b tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:55.750946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fba53-0831-4b6d-8f6f-064e7332516b tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:55.751348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fba53-0831-4b6d-8f6f-064e7332516b tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:55.752150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fba53-0831-4b6d-8f6f-064e7332516b tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:55.755661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fba53-0831-4b6d-8f6f-064e7332516b tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:55.789494 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2937/5851] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:16:55 2022] POST /identity/v3/domains => generated 277 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:16:55.791069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1231c1-96a9-4440-b0f1-af31662383ef None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:55.805045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1231c1-96a9-4440-b0f1-af31662383ef None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:55.935748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464dbfa-9180-48b9-bb3b-e1435a35e4e0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:55.936401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464dbfa-9180-48b9-bb3b-e1435a35e4e0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:55.936675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464dbfa-9180-48b9-bb3b-e1435a35e4e0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:55.937493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464dbfa-9180-48b9-bb3b-e1435a35e4e0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:55.937688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464dbfa-9180-48b9-bb3b-e1435a35e4e0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:55.939031 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-7464dbfa-9180-48b9-bb3b-e1435a35e4e0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:16:55.939031 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:16:55.939031 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:16:55.940260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464dbfa-9180-48b9-bb3b-e1435a35e4e0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:56.003547 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2915/5852] 10.222.0.70 () {60 vars in 1147 bytes} [Sun Aug 28 19:16:55 2022] POST /identity/v3/groups => generated 280 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:56.008670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fba53-0831-4b6d-8f6f-064e7332516b tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:56.022906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fba53-0831-4b6d-8f6f-064e7332516b tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:56.030794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc6394-6180-46a6-b38e-b8630ade99a5 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:56.031800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc6394-6180-46a6-b38e-b8630ade99a5 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:56.032862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc6394-6180-46a6-b38e-b8630ade99a5 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:56.033420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc6394-6180-46a6-b38e-b8630ade99a5 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/6395b172646342e0a0fc16da786d37af` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:56.041394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc6394-6180-46a6-b38e-b8630ade99a5 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:update_group(group_id=6395b172646342e0a0fc16da786d37af)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:56.042837 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-27bc6394-6180-46a6-b38e-b8630ade99a5 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:16:56.042837 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:16:56.042837 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:16:56.044624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc6394-6180-46a6-b38e-b8630ade99a5 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:56.079048 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2938/5853] 10.222.0.70 () {60 vars in 1247 bytes} [Sun Aug 28 19:16:56 2022] PATCH /identity/v3/groups/6395b172646342e0a0fc16da786d37af => generated 292 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:56.079678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464dbfa-9180-48b9-bb3b-e1435a35e4e0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:56.096933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464dbfa-9180-48b9-bb3b-e1435a35e4e0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:56.107185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ec964-1fa8-4183-b713-b290a2b8632c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:56.109612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ec964-1fa8-4183-b713-b290a2b8632c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:56.110142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ec964-1fa8-4183-b713-b290a2b8632c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:56.110676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ec964-1fa8-4183-b713-b290a2b8632c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/6395b172646342e0a0fc16da786d37af` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:56.120701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ec964-1fa8-4183-b713-b290a2b8632c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:get_group(group_id=6395b172646342e0a0fc16da786d37af)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:56.123009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ec964-1fa8-4183-b713-b290a2b8632c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:56.125217 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2916/5854] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:56 2022] GET /identity/v3/groups/6395b172646342e0a0fc16da786d37af => generated 292 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:56.129206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc6394-6180-46a6-b38e-b8630ade99a5 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:56.140490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc6394-6180-46a6-b38e-b8630ade99a5 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:56.149664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fe603-9d36-41de-bd13-df5ff536d144 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:56.150489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe603-9d36-41de-bd13-df5ff536d144 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:56.150922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe603-9d36-41de-bd13-df5ff536d144 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:56.151310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fe603-9d36-41de-bd13-df5ff536d144 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/6395b172646342e0a0fc16da786d37af` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:56.153190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fe603-9d36-41de-bd13-df5ff536d144 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:update_group(group_id=6395b172646342e0a0fc16da786d37af)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:56.155343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fe603-9d36-41de-bd13-df5ff536d144 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:56.183177 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2939/5855] 10.222.0.70 () {60 vars in 1246 bytes} [Sun Aug 28 19:16:56 2022] PATCH /identity/v3/groups/6395b172646342e0a0fc16da786d37af => generated 307 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:16:56.188636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ec964-1fa8-4183-b713-b290a2b8632c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:56.203145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ec964-1fa8-4183-b713-b290a2b8632c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:56.209247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f94d8b-1842-4920-b9fb-415b900ab66d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:56.210066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f94d8b-1842-4920-b9fb-415b900ab66d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:56.210549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f94d8b-1842-4920-b9fb-415b900ab66d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:56.210931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f94d8b-1842-4920-b9fb-415b900ab66d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/6395b172646342e0a0fc16da786d37af` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:56.219743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f94d8b-1842-4920-b9fb-415b900ab66d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6395b172646342e0a0fc16da786d37af)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:56.222769 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-c6f94d8b-1842-4920-b9fb-415b900ab66d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:16:56.222769 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:16:56.222769 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:16:56.225505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f94d8b-1842-4920-b9fb-415b900ab66d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:56.288436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0114b7-b53a-4e12-a484-08866b5841de None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:56.288747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0114b7-b53a-4e12-a484-08866b5841de None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:56.289315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0114b7-b53a-4e12-a484-08866b5841de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:56.323607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4e0114b7-b53a-4e12-a484-08866b5841de None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:56.325980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4e0114b7-b53a-4e12-a484-08866b5841de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:56.335478 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2940/5856] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:56 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:16:56.337461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac29c-b144-4a64-a9a7-9f626838663d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:56.337461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac29c-b144-4a64-a9a7-9f626838663d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:56.340053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac29c-b144-4a64-a9a7-9f626838663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:56.356269 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2917/5857] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:16:56 2022] DELETE /identity/v3/groups/6395b172646342e0a0fc16da786d37af => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:56.361124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f94d8b-1842-4920-b9fb-415b900ab66d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:56.386895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f3aac29c-b144-4a64-a9a7-9f626838663d None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:56.388178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f3aac29c-b144-4a64-a9a7-9f626838663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:56.490949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:56.514623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f94d8b-1842-4920-b9fb-415b900ab66d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:56.518784 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2941/5858] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:16:56.525331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac29c-b144-4a64-a9a7-9f626838663d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:56.526977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5e743-d359-4f59-a345-b61fc7f46ad3 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:56.528644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5e743-d359-4f59-a345-b61fc7f46ad3 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:56.528958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5e743-d359-4f59-a345-b61fc7f46ad3 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:56.529289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5e743-d359-4f59-a345-b61fc7f46ad3 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:56.530000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5e743-d359-4f59-a345-b61fc7f46ad3 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:56.532275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5e743-d359-4f59-a345-b61fc7f46ad3 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:56.556703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac29c-b144-4a64-a9a7-9f626838663d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:56.569520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34897e9-eb48-4bf7-95c4-d342e41d18d4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b890fb0f84c81b64801da1abe82c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f018a89a2a94e1f848e1b3073affa54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:56.570201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34897e9-eb48-4bf7-95c4-d342e41d18d4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:56.570648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34897e9-eb48-4bf7-95c4-d342e41d18d4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:56.570959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34897e9-eb48-4bf7-95c4-d342e41d18d4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] PATH_INFO: `/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:56.603297 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2918/5859] 10.222.0.70 () {60 vars in 1147 bytes} [Sun Aug 28 19:16:56 2022] POST /identity/v3/groups => generated 326 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:56.606164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5e743-d359-4f59-a345-b61fc7f46ad3 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:56.638764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a34897e9-eb48-4bf7-95c4-d342e41d18d4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:56.648555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5e743-d359-4f59-a345-b61fc7f46ad3 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:56.661619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf502f-d63b-46d0-8a85-ffea1b46bd16 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:56.662533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf502f-d63b-46d0-8a85-ffea1b46bd16 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:56.662961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf502f-d63b-46d0-8a85-ffea1b46bd16 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:56.665078 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2942/5860] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:16:56 2022] POST /identity/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:56.665243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf502f-d63b-46d0-8a85-ffea1b46bd16 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:56.665243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf502f-d63b-46d0-8a85-ffea1b46bd16 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:56.672144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf502f-d63b-46d0-8a85-ffea1b46bd16 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:56.735630 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2919/5861] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:56 2022] POST /identity/v3/users => generated 323 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:56.739833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34897e9-eb48-4bf7-95c4-d342e41d18d4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:56.756409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34897e9-eb48-4bf7-95c4-d342e41d18d4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:56.766363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca6006-5eaa-4d30-a2dd-a3b1d1292f13 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:56.767256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca6006-5eaa-4d30-a2dd-a3b1d1292f13 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:56.767639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca6006-5eaa-4d30-a2dd-a3b1d1292f13 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:56.768044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca6006-5eaa-4d30-a2dd-a3b1d1292f13 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/51b3ba60325748f88004ce53429e3be0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:56.803221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca6006-5eaa-4d30-a2dd-a3b1d1292f13 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ede45fc147074b98b3cc66451d6c162c, user_id=51b3ba60325748f88004ce53429e3be0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:56.806437 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-44ca6006-5eaa-4d30-a2dd-a3b1d1292f13 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:16:56.806437 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:16:56.806437 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:16:56.810660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca6006-5eaa-4d30-a2dd-a3b1d1292f13 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:56.826403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:UPDATE=3,keystone:DELETE=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:56.847656 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2943/5862] 10.222.0.70 () {60 vars in 1360 bytes} [Sun Aug 28 19:16:56 2022] PUT /identity/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/51b3ba60325748f88004ce53429e3be0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:56.850903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf502f-d63b-46d0-8a85-ffea1b46bd16 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:56.863650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf502f-d63b-46d0-8a85-ffea1b46bd16 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:56.938332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250499b5-81e5-4252-ad55-71707530bf14 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:56.939272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250499b5-81e5-4252-ad55-71707530bf14 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:56.939564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250499b5-81e5-4252-ad55-71707530bf14 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:56.939852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250499b5-81e5-4252-ad55-71707530bf14 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:56.940497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250499b5-81e5-4252-ad55-71707530bf14 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:56.947076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250499b5-81e5-4252-ad55-71707530bf14 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:56.987109 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2920/5863] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:56 2022] POST /identity/v3/users => generated 323 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:56.989258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca6006-5eaa-4d30-a2dd-a3b1d1292f13 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:57.002394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca6006-5eaa-4d30-a2dd-a3b1d1292f13 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:57.009170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5ab08-08ae-4eb6-a124-6c5d77c182a4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:57.010100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5ab08-08ae-4eb6-a124-6c5d77c182a4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:57.010494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5ab08-08ae-4eb6-a124-6c5d77c182a4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:57.010916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5ab08-08ae-4eb6-a124-6c5d77c182a4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/f25d7a9558464b8e8ce21f53815b5eb8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:57.030970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5ab08-08ae-4eb6-a124-6c5d77c182a4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ede45fc147074b98b3cc66451d6c162c, user_id=f25d7a9558464b8e8ce21f53815b5eb8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:57.033281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5ab08-08ae-4eb6-a124-6c5d77c182a4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:57.067258 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2944/5864] 10.222.0.70 () {60 vars in 1360 bytes} [Sun Aug 28 19:16:56 2022] PUT /identity/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/f25d7a9558464b8e8ce21f53815b5eb8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:57.071354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250499b5-81e5-4252-ad55-71707530bf14 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:57.104271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250499b5-81e5-4252-ad55-71707530bf14 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:57.261053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c3a54-ea08-46cc-b22b-2883c1518d45 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:57.261709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c3a54-ea08-46cc-b22b-2883c1518d45 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:57.262002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c3a54-ea08-46cc-b22b-2883c1518d45 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:57.262289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c3a54-ea08-46cc-b22b-2883c1518d45 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:57.263167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c3a54-ea08-46cc-b22b-2883c1518d45 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:57.267651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c3a54-ea08-46cc-b22b-2883c1518d45 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:57.310881 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2921/5865] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:16:57 2022] POST /identity/v3/users => generated 321 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:57.314178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5ab08-08ae-4eb6-a124-6c5d77c182a4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:57.328998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5ab08-08ae-4eb6-a124-6c5d77c182a4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:57.336040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b2c0c-43c6-4fcc-8c81-3c2cec80a21f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:57.337047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b2c0c-43c6-4fcc-8c81-3c2cec80a21f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:57.337414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b2c0c-43c6-4fcc-8c81-3c2cec80a21f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:57.338194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b2c0c-43c6-4fcc-8c81-3c2cec80a21f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/c31bcf3e8b054d1fbfa729c6a3c7bc51` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:57.364226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b2c0c-43c6-4fcc-8c81-3c2cec80a21f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ede45fc147074b98b3cc66451d6c162c, user_id=c31bcf3e8b054d1fbfa729c6a3c7bc51)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:57.366868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b2c0c-43c6-4fcc-8c81-3c2cec80a21f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:57.403704 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2945/5866] 10.222.0.70 () {60 vars in 1360 bytes} [Sun Aug 28 19:16:57 2022] PUT /identity/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/c31bcf3e8b054d1fbfa729c6a3c7bc51 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:57.411325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c3a54-ea08-46cc-b22b-2883c1518d45 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:57.427521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c3a54-ea08-46cc-b22b-2883c1518d45 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:57.525445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:57.555219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b5da0-062f-4221-9b95-a34840e81509 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:57.555989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b5da0-062f-4221-9b95-a34840e81509 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:57.556714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b5da0-062f-4221-9b95-a34840e81509 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:57.557113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b5da0-062f-4221-9b95-a34840e81509 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/ede45fc147074b98b3cc66451d6c162c/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:57.558602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b5da0-062f-4221-9b95-a34840e81509 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=ede45fc147074b98b3cc66451d6c162c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:57.560128 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-6f3b5da0-062f-4221-9b95-a34840e81509 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:16:57.560128 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:16:57.560128 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:16:57.561797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b5da0-062f-4221-9b95-a34840e81509 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:57.597175 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2922/5867] 10.222.0.70 () {58 vars in 1242 bytes} [Sun Aug 28 19:16:57 2022] GET /identity/v3/groups/ede45fc147074b98b3cc66451d6c162c/users => generated 1083 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:16:57.600781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b2c0c-43c6-4fcc-8c81-3c2cec80a21f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:57.620021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b2c0c-43c6-4fcc-8c81-3c2cec80a21f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:57.625452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433bd4a-0143-486d-adf6-46a750b1927d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:57.626414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433bd4a-0143-486d-adf6-46a750b1927d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:57.626799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433bd4a-0143-486d-adf6-46a750b1927d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:57.627154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433bd4a-0143-486d-adf6-46a750b1927d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/51b3ba60325748f88004ce53429e3be0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:57.630485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433bd4a-0143-486d-adf6-46a750b1927d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=ede45fc147074b98b3cc66451d6c162c, user_id=51b3ba60325748f88004ce53429e3be0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:57.631636 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-6433bd4a-0143-486d-adf6-46a750b1927d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:16:57.631636 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:16:57.631636 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:16:57.633804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433bd4a-0143-486d-adf6-46a750b1927d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:57.669188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5feefa0-ae97-4d5c-98f8-fe917a740575 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:57.669570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5feefa0-ae97-4d5c-98f8-fe917a740575 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:57.669889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5feefa0-ae97-4d5c-98f8-fe917a740575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:57.685469 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2946/5868] 10.222.0.70 () {58 vars in 1342 bytes} [Sun Aug 28 19:16:57 2022] HEAD /identity/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/51b3ba60325748f88004ce53429e3be0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:57.686635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433bd4a-0143-486d-adf6-46a750b1927d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:57.699591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433bd4a-0143-486d-adf6-46a750b1927d tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:57.705531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf1a9-eb52-459e-bcec-07de9cbe5172 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:57.706295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf1a9-eb52-459e-bcec-07de9cbe5172 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:57.706651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf1a9-eb52-459e-bcec-07de9cbe5172 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:57.707200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf1a9-eb52-459e-bcec-07de9cbe5172 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/51b3ba60325748f88004ce53429e3be0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:57.711031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf1a9-eb52-459e-bcec-07de9cbe5172 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=ede45fc147074b98b3cc66451d6c162c, user_id=51b3ba60325748f88004ce53429e3be0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:57.715894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf1a9-eb52-459e-bcec-07de9cbe5172 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:57.718049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c5feefa0-ae97-4d5c-98f8-fe917a740575 None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:57.723022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c5feefa0-ae97-4d5c-98f8-fe917a740575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:57.733090 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2923/5869] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:57 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:16:57.735536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f32da2-387f-4195-9f95-a2b1b62d1894 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:57.735915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f32da2-387f-4195-9f95-a2b1b62d1894 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:57.736267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f32da2-387f-4195-9f95-a2b1b62d1894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:57.747564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5bddf1a9-eb52-459e-bcec-07de9cbe5172 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '51b3ba60325748f88004ce53429e3be0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:57.768937 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2947/5870] 10.222.0.70 () {58 vars in 1344 bytes} [Sun Aug 28 19:16:57 2022] DELETE /identity/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/51b3ba60325748f88004ce53429e3be0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:57.775384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-36f32da2-387f-4195-9f95-a2b1b62d1894 None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:57.776302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf1a9-eb52-459e-bcec-07de9cbe5172 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:57.776894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-36f32da2-387f-4195-9f95-a2b1b62d1894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:57.996490 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2924/5871] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:16:58.001440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f32da2-387f-4195-9f95-a2b1b62d1894 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:58.016851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f32da2-387f-4195-9f95-a2b1b62d1894 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:58.023157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ef509-0de9-4fa9-9f3d-aca7b98cb408 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b890fb0f84c81b64801da1abe82c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f018a89a2a94e1f848e1b3073affa54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:58.024274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef509-0de9-4fa9-9f3d-aca7b98cb408 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:58.024848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef509-0de9-4fa9-9f3d-aca7b98cb408 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:58.025584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef509-0de9-4fa9-9f3d-aca7b98cb408 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] PATH_INFO: `/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:58.027194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf1a9-eb52-459e-bcec-07de9cbe5172 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:58.047450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f12e-6908-47c3-b689-bb2f1f783d5f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:58.048134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f12e-6908-47c3-b689-bb2f1f783d5f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:58.048419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f12e-6908-47c3-b689-bb2f1f783d5f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:58.048695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f12e-6908-47c3-b689-bb2f1f783d5f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/f25d7a9558464b8e8ce21f53815b5eb8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:58.050417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6f12e-6908-47c3-b689-bb2f1f783d5f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=ede45fc147074b98b3cc66451d6c162c, user_id=f25d7a9558464b8e8ce21f53815b5eb8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:58.053232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6f12e-6908-47c3-b689-bb2f1f783d5f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:58.087377 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2948/5872] 10.222.0.70 () {58 vars in 1342 bytes} [Sun Aug 28 19:16:57 2022] HEAD /identity/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/f25d7a9558464b8e8ce21f53815b5eb8 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:58.091958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f12e-6908-47c3-b689-bb2f1f783d5f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:58.104050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-851ef509-0de9-4fa9-9f3d-aca7b98cb408 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:58.111441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f12e-6908-47c3-b689-bb2f1f783d5f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:58.125012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477625ef-54c4-4eb1-b0cf-4cfcd706f2b1 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:58.126690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477625ef-54c4-4eb1-b0cf-4cfcd706f2b1 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:58.127250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477625ef-54c4-4eb1-b0cf-4cfcd706f2b1 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:58.127729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477625ef-54c4-4eb1-b0cf-4cfcd706f2b1 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/f25d7a9558464b8e8ce21f53815b5eb8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:58.130863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477625ef-54c4-4eb1-b0cf-4cfcd706f2b1 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=ede45fc147074b98b3cc66451d6c162c, user_id=f25d7a9558464b8e8ce21f53815b5eb8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:58.134446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477625ef-54c4-4eb1-b0cf-4cfcd706f2b1 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:58.137471 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2925/5873] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:16:58 2022] POST /identity/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:58.163290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-477625ef-54c4-4eb1-b0cf-4cfcd706f2b1 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f25d7a9558464b8e8ce21f53815b5eb8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:58.202330 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2949/5874] 10.222.0.70 () {58 vars in 1344 bytes} [Sun Aug 28 19:16:58 2022] DELETE /identity/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/f25d7a9558464b8e8ce21f53815b5eb8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:58.207576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ef509-0de9-4fa9-9f3d-aca7b98cb408 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:58.223614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ef509-0de9-4fa9-9f3d-aca7b98cb408 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:58.313750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd69f05-8c08-4f7d-b3f3-30b58fcbb7cd tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:58.314441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd69f05-8c08-4f7d-b3f3-30b58fcbb7cd tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:58.314793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd69f05-8c08-4f7d-b3f3-30b58fcbb7cd tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:58.315083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd69f05-8c08-4f7d-b3f3-30b58fcbb7cd tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/c31bcf3e8b054d1fbfa729c6a3c7bc51` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:58.317579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd69f05-8c08-4f7d-b3f3-30b58fcbb7cd tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=ede45fc147074b98b3cc66451d6c162c, user_id=c31bcf3e8b054d1fbfa729c6a3c7bc51)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:58.318704 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-4bd69f05-8c08-4f7d-b3f3-30b58fcbb7cd tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:16:58.318704 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:16:58.318704 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:16:58.319992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd69f05-8c08-4f7d-b3f3-30b58fcbb7cd tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:58.346812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477625ef-54c4-4eb1-b0cf-4cfcd706f2b1 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:58.347417 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2926/5875] 10.222.0.70 () {58 vars in 1342 bytes} [Sun Aug 28 19:16:58 2022] HEAD /identity/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/c31bcf3e8b054d1fbfa729c6a3c7bc51 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:58.359719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477625ef-54c4-4eb1-b0cf-4cfcd706f2b1 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:58.365751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b5b67-b63d-48d9-b63b-6021322baa8f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:58.366974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b5b67-b63d-48d9-b63b-6021322baa8f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:58.367465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b5b67-b63d-48d9-b63b-6021322baa8f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:58.367970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b5b67-b63d-48d9-b63b-6021322baa8f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/c31bcf3e8b054d1fbfa729c6a3c7bc51` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:58.370048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b5b67-b63d-48d9-b63b-6021322baa8f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=ede45fc147074b98b3cc66451d6c162c, user_id=c31bcf3e8b054d1fbfa729c6a3c7bc51)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:58.373350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b5b67-b63d-48d9-b63b-6021322baa8f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:58.384381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-755b5b67-b63d-48d9-b63b-6021322baa8f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c31bcf3e8b054d1fbfa729c6a3c7bc51'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:58.397943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=6,keystone:SELECT=88,keystone:DELETE=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:58.405978 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2950/5876] 10.222.0.70 () {58 vars in 1344 bytes} [Sun Aug 28 19:16:58 2022] DELETE /identity/v3/groups/ede45fc147074b98b3cc66451d6c162c/users/c31bcf3e8b054d1fbfa729c6a3c7bc51 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:58.411545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd69f05-8c08-4f7d-b3f3-30b58fcbb7cd tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:58.427747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd69f05-8c08-4f7d-b3f3-30b58fcbb7cd tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:58.472822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:58.517763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1687a3-4831-47e6-8dfa-6c56890b8eee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:58.518575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1687a3-4831-47e6-8dfa-6c56890b8eee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:58.523151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1687a3-4831-47e6-8dfa-6c56890b8eee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:58.524366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1687a3-4831-47e6-8dfa-6c56890b8eee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/ede45fc147074b98b3cc66451d6c162c/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:58.526628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1687a3-4831-47e6-8dfa-6c56890b8eee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=ede45fc147074b98b3cc66451d6c162c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:58.530400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1687a3-4831-47e6-8dfa-6c56890b8eee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:58.554408 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2927/5877] 10.222.0.70 () {58 vars in 1242 bytes} [Sun Aug 28 19:16:58 2022] GET /identity/v3/groups/ede45fc147074b98b3cc66451d6c162c/users => generated 145 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:16:58.558942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b5b67-b63d-48d9-b63b-6021322baa8f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:58.575549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b5b67-b63d-48d9-b63b-6021322baa8f tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:58.593086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ab7a5-9a42-407c-9dcf-9c8b25b28610 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:58.593956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ab7a5-9a42-407c-9dcf-9c8b25b28610 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:58.594250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ab7a5-9a42-407c-9dcf-9c8b25b28610 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:58.594622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ab7a5-9a42-407c-9dcf-9c8b25b28610 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/users/c31bcf3e8b054d1fbfa729c6a3c7bc51` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:58.595936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ab7a5-9a42-407c-9dcf-9c8b25b28610 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c31bcf3e8b054d1fbfa729c6a3c7bc51)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:58.598518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ab7a5-9a42-407c-9dcf-9c8b25b28610 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:58.663582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a53ab7a5-9a42-407c-9dcf-9c8b25b28610 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31bcf3e8b054d1fbfa729c6a3c7bc51'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:58.673398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a53ab7a5-9a42-407c-9dcf-9c8b25b28610 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31bcf3e8b054d1fbfa729c6a3c7bc51'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:58.676787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a53ab7a5-9a42-407c-9dcf-9c8b25b28610 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31bcf3e8b054d1fbfa729c6a3c7bc51'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:58.688621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a53ab7a5-9a42-407c-9dcf-9c8b25b28610 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31bcf3e8b054d1fbfa729c6a3c7bc51'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:58.689648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a53ab7a5-9a42-407c-9dcf-9c8b25b28610 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31bcf3e8b054d1fbfa729c6a3c7bc51'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:58.725704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1687a3-4831-47e6-8dfa-6c56890b8eee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:58.726143 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2951/5878] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:58 2022] DELETE /identity/v3/users/c31bcf3e8b054d1fbfa729c6a3c7bc51 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:58.728263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0d1687a3-4831-47e6-8dfa-6c56890b8eee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:58.750295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1687a3-4831-47e6-8dfa-6c56890b8eee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:58.864651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545e73d-b0a6-4fb7-933a-8cea632fa7e2 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:58.865840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545e73d-b0a6-4fb7-933a-8cea632fa7e2 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:58.866126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545e73d-b0a6-4fb7-933a-8cea632fa7e2 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:58.866405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545e73d-b0a6-4fb7-933a-8cea632fa7e2 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/users/f25d7a9558464b8e8ce21f53815b5eb8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:58.869485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545e73d-b0a6-4fb7-933a-8cea632fa7e2 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f25d7a9558464b8e8ce21f53815b5eb8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:58.871648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545e73d-b0a6-4fb7-933a-8cea632fa7e2 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:58.952415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1545e73d-b0a6-4fb7-933a-8cea632fa7e2 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25d7a9558464b8e8ce21f53815b5eb8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:58.964804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1545e73d-b0a6-4fb7-933a-8cea632fa7e2 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25d7a9558464b8e8ce21f53815b5eb8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:58.965707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1545e73d-b0a6-4fb7-933a-8cea632fa7e2 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25d7a9558464b8e8ce21f53815b5eb8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:58.992460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1545e73d-b0a6-4fb7-933a-8cea632fa7e2 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25d7a9558464b8e8ce21f53815b5eb8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:58.992460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1545e73d-b0a6-4fb7-933a-8cea632fa7e2 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25d7a9558464b8e8ce21f53815b5eb8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:59.034071 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2928/5879] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:58 2022] DELETE /identity/v3/users/f25d7a9558464b8e8ce21f53815b5eb8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:16:59.038980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ab7a5-9a42-407c-9dcf-9c8b25b28610 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:59.050276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ab7a5-9a42-407c-9dcf-9c8b25b28610 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:59.144197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9749db-6394-4e27-b4cc-ac59e72d7a22 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:59.144603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9749db-6394-4e27-b4cc-ac59e72d7a22 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:59.145400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9749db-6394-4e27-b4cc-ac59e72d7a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:59.182145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ea9749db-6394-4e27-b4cc-ac59e72d7a22 None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:16:59.185733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ea9749db-6394-4e27-b4cc-ac59e72d7a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:59.186539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:59.187335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:59.188847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:59.189232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/users/51b3ba60325748f88004ce53429e3be0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:59.192895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:delete_user(user_id=51b3ba60325748f88004ce53429e3be0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:59.196192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:59.202446 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2929/5880] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:16:59 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:16:59.294158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b3ba60325748f88004ce53429e3be0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:59.309595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b3ba60325748f88004ce53429e3be0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:59.310363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b3ba60325748f88004ce53429e3be0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:59.334705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b3ba60325748f88004ce53429e3be0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:59.335378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b3ba60325748f88004ce53429e3be0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:16:59.345643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:59.374502 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2952/5881] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:16:59 2022] DELETE /identity/v3/users/51b3ba60325748f88004ce53429e3be0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:59.380169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9749db-6394-4e27-b4cc-ac59e72d7a22 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:59.382858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ea9749db-6394-4e27-b4cc-ac59e72d7a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:59.510229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:16:59.580160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9749db-6394-4e27-b4cc-ac59e72d7a22 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:59.600314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de4b2e-3416-4929-a597-681d2c68b801 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:59.600985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de4b2e-3416-4929-a597-681d2c68b801 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:59.601276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de4b2e-3416-4929-a597-681d2c68b801 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:59.601561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de4b2e-3416-4929-a597-681d2c68b801 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/ede45fc147074b98b3cc66451d6c162c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:59.603251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de4b2e-3416-4929-a597-681d2c68b801 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ede45fc147074b98b3cc66451d6c162c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:59.605659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de4b2e-3416-4929-a597-681d2c68b801 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:59.667753 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2930/5882] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:16:59 2022] DELETE /identity/v3/groups/ede45fc147074b98b3cc66451d6c162c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:16:59.674241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:59.676466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:59.708849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab94478-b047-4e54-96c4-01a367d81343 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:59.807608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d35f57-bb48-4646-bf2d-2c174f1f4bc4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:59.809120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d35f57-bb48-4646-bf2d-2c174f1f4bc4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:59.809584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d35f57-bb48-4646-bf2d-2c174f1f4bc4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:59.810034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d35f57-bb48-4646-bf2d-2c174f1f4bc4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:59.810891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d35f57-bb48-4646-bf2d-2c174f1f4bc4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:59.813268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d35f57-bb48-4646-bf2d-2c174f1f4bc4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:59.854765 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2953/5883] 10.222.0.70 () {60 vars in 1147 bytes} [Sun Aug 28 19:16:59 2022] POST /identity/v3/groups => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:59.861179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de4b2e-3416-4929-a597-681d2c68b801 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:59.864965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-60de4b2e-3416-4929-a597-681d2c68b801 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:16:59.867275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d35f57-bb48-4646-bf2d-2c174f1f4bc4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:16:59.904765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d35f57-bb48-4646-bf2d-2c174f1f4bc4 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:16:59.923641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09f414-21bd-4f95-be13-3c342b72c42c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:16:59.930628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09f414-21bd-4f95-be13-3c342b72c42c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:16:59.930628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09f414-21bd-4f95-be13-3c342b72c42c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:16:59.930628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09f414-21bd-4f95-be13-3c342b72c42c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:16:59.930628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09f414-21bd-4f95-be13-3c342b72c42c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:16:59.938543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09f414-21bd-4f95-be13-3c342b72c42c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:16:59.986547 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2954/5884] 10.222.0.70 () {60 vars in 1147 bytes} [Sun Aug 28 19:16:59 2022] POST /identity/v3/groups => generated 326 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:16:59.989145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09f414-21bd-4f95-be13-3c342b72c42c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:00.017403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09f414-21bd-4f95-be13-3c342b72c42c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:00.036130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787d26e-494d-45c4-9b33-aa5d54837277 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:00.036756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787d26e-494d-45c4-9b33-aa5d54837277 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.037040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787d26e-494d-45c4-9b33-aa5d54837277 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.037319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787d26e-494d-45c4-9b33-aa5d54837277 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.037951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787d26e-494d-45c4-9b33-aa5d54837277 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:00.052620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787d26e-494d-45c4-9b33-aa5d54837277 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:00.102250 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2955/5885] 10.222.0.70 () {60 vars in 1147 bytes} [Sun Aug 28 19:16:59 2022] POST /identity/v3/groups => generated 325 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:00.105473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787d26e-494d-45c4-9b33-aa5d54837277 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:00.115883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de4b2e-3416-4929-a597-681d2c68b801 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:00.133676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787d26e-494d-45c4-9b33-aa5d54837277 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:00.134837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28713dfa-c870-4bf9-bd6a-bacbadd94546 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:00.135805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28713dfa-c870-4bf9-bd6a-bacbadd94546 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.136353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28713dfa-c870-4bf9-bd6a-bacbadd94546 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.136853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28713dfa-c870-4bf9-bd6a-bacbadd94546 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.139108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa5ed-fc53-4fea-86d6-69dfa640da93 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:00.139810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa5ed-fc53-4fea-86d6-69dfa640da93 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.140102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa5ed-fc53-4fea-86d6-69dfa640da93 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.140614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa5ed-fc53-4fea-86d6-69dfa640da93 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.141364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fa5ed-fc53-4fea-86d6-69dfa640da93 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:00.141771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28713dfa-c870-4bf9-bd6a-bacbadd94546 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:00.142866 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-e48fa5ed-fc53-4fea-86d6-69dfa640da93 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:17:00.142866 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:17:00.142866 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:17:00.145116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fa5ed-fc53-4fea-86d6-69dfa640da93 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:00.167024 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2956/5886] 10.222.0.70 () {58 vars in 1125 bytes} [Sun Aug 28 19:17:00 2022] GET /identity/v3/groups => generated 1488 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:17:00.168042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa5ed-fc53-4fea-86d6-69dfa640da93 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:00.175776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28713dfa-c870-4bf9-bd6a-bacbadd94546 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:00.178114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28713dfa-c870-4bf9-bd6a-bacbadd94546 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:00.181613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa5ed-fc53-4fea-86d6-69dfa640da93 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:00.188238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b7e15-1ab5-4e04-9079-6f59636222ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:00.188972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b7e15-1ab5-4e04-9079-6f59636222ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.189210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b7e15-1ab5-4e04-9079-6f59636222ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.189442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b7e15-1ab5-4e04-9079-6f59636222ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/d40998401da940dea8c79f5a6c597f07` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.193898 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2931/5887] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:16:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:00.195835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b7e15-1ab5-4e04-9079-6f59636222ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d40998401da940dea8c79f5a6c597f07)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:00.198435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b7e15-1ab5-4e04-9079-6f59636222ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:00.205153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8cd2c-ebc0-4d5f-9166-dff24da39d43 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.205310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8cd2c-ebc0-4d5f-9166-dff24da39d43 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.205578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8cd2c-ebc0-4d5f-9166-dff24da39d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.231268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-10d8cd2c-ebc0-4d5f-9166-dff24da39d43 None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:00.234582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-10d8cd2c-ebc0-4d5f-9166-dff24da39d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:00.274294 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2957/5888] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:17:00 2022] DELETE /identity/v3/groups/d40998401da940dea8c79f5a6c597f07 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:00.278217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b7e15-1ab5-4e04-9079-6f59636222ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:00.380995 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2932/5889] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:00.383813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8bf2-320e-49e2-9369-917765c62e0b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.386847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8bf2-320e-49e2-9369-917765c62e0b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.386847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8bf2-320e-49e2-9369-917765c62e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.427092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5d6b8bf2-320e-49e2-9369-917765c62e0b None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:00.430731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5d6b8bf2-320e-49e2-9369-917765c62e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:00.436302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:00.444924 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2933/5890] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:00 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:17:00.449294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4173f9-e5be-456c-b333-c22b8c669ea7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.452058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b7e15-1ab5-4e04-9079-6f59636222ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:00.453103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4173f9-e5be-456c-b333-c22b8c669ea7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.453655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4173f9-e5be-456c-b333-c22b8c669ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.464141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a0a93-cb8e-4233-8f11-bb0a033226ae tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:00.467115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0a93-cb8e-4233-8f11-bb0a033226ae tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.467474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0a93-cb8e-4233-8f11-bb0a033226ae tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.467835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0a93-cb8e-4233-8f11-bb0a033226ae tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/583f6bf8f6154ec886c68623308153c4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.480314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a0a93-cb8e-4233-8f11-bb0a033226ae tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:delete_group(group_id=583f6bf8f6154ec886c68623308153c4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:00.482543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a0a93-cb8e-4233-8f11-bb0a033226ae tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:00.558107 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2958/5891] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:17:00 2022] DELETE /identity/v3/groups/583f6bf8f6154ec886c68623308153c4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:00.558312 n-d-854118-7 devstack@keystone.service[88374]: WARNING keystone.server.flask.application [None req-9f4173f9-e5be-456c-b333-c22b8c669ea7 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.70: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 19:17:00.561192 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2934/5892] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:00 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 115 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Aug 28 19:17:00.563400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07465a-3b23-4f91-bd99-513fca8a0997 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.563694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07465a-3b23-4f91-bd99-513fca8a0997 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.564093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07465a-3b23-4f91-bd99-513fca8a0997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.566780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a0a93-cb8e-4233-8f11-bb0a033226ae tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:00.588552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:00.623781 n-d-854118-7 devstack@keystone.service[88374]: WARNING keystone.server.flask.application [None req-5c07465a-3b23-4f91-bd99-513fca8a0997 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.70: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 19:17:00.626292 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2935/5893] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:00 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 64 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 19:17:00.632335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1c68b-c813-4c26-8add-1ab94ee10134 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.632644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1c68b-c813-4c26-8add-1ab94ee10134 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.632905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1c68b-c813-4c26-8add-1ab94ee10134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.672218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a0a93-cb8e-4233-8f11-bb0a033226ae tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:00.678176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5d0dc-998e-4539-aafc-ef78e15c1a62 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:00.678852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5d0dc-998e-4539-aafc-ef78e15c1a62 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.679140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5d0dc-998e-4539-aafc-ef78e15c1a62 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.679419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5d0dc-998e-4539-aafc-ef78e15c1a62 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/089ad94a3731472a9dac2e41a03b4003` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.685179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5d0dc-998e-4539-aafc-ef78e15c1a62 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:delete_group(group_id=089ad94a3731472a9dac2e41a03b4003)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:00.687742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5d0dc-998e-4539-aafc-ef78e15c1a62 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:00.694817 n-d-854118-7 devstack@keystone.service[88374]: WARNING keystone.server.flask.application [None req-80f1c68b-c813-4c26-8add-1ab94ee10134 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.70: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 19:17:00.696754 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2936/5894] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:00 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 65 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 19:17:00.758216 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2959/5895] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:17:00 2022] DELETE /identity/v3/groups/089ad94a3731472a9dac2e41a03b4003 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:00.759400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1c68b-c813-4c26-8add-1ab94ee10134 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:00.843604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1c68b-c813-4c26-8add-1ab94ee10134 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:00.849360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05db65-af39-4157-a338-0494859a15ee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:00.850095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05db65-af39-4157-a338-0494859a15ee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.850656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05db65-af39-4157-a338-0494859a15ee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.851066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05db65-af39-4157-a338-0494859a15ee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.852012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05db65-af39-4157-a338-0494859a15ee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:00.854066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05db65-af39-4157-a338-0494859a15ee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:00.892045 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2937/5896] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:00 2022] POST /identity/v3/users => generated 323 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:00.897850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5d0dc-998e-4539-aafc-ef78e15c1a62 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:00.910851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5d0dc-998e-4539-aafc-ef78e15c1a62 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:00.916170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76226a2-022d-407e-aeff-7aeeadb6fb5c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:00.916991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76226a2-022d-407e-aeff-7aeeadb6fb5c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.917382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76226a2-022d-407e-aeff-7aeeadb6fb5c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.917763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76226a2-022d-407e-aeff-7aeeadb6fb5c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:00.918631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76226a2-022d-407e-aeff-7aeeadb6fb5c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:00.921789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76226a2-022d-407e-aeff-7aeeadb6fb5c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:00.949366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05db65-af39-4157-a338-0494859a15ee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:00.975247 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2960/5897] 10.222.0.70 () {60 vars in 1147 bytes} [Sun Aug 28 19:17:00 2022] POST /identity/v3/groups => generated 327 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:00.977780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05db65-af39-4157-a338-0494859a15ee tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:00.998582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc811e-5ed1-4270-bdd6-2ba00452cf98 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:00.999389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc811e-5ed1-4270-bdd6-2ba00452cf98 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:00.999676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc811e-5ed1-4270-bdd6-2ba00452cf98 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:00.999953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc811e-5ed1-4270-bdd6-2ba00452cf98 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/6dd3368d9f1b43fb878b16a80cf158f8/users/9613f0963d04443bacf1da28ca349ef8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:01.051653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc811e-5ed1-4270-bdd6-2ba00452cf98 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6dd3368d9f1b43fb878b16a80cf158f8, user_id=9613f0963d04443bacf1da28ca349ef8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:01.053811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc811e-5ed1-4270-bdd6-2ba00452cf98 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:01.098555 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2938/5898] 10.222.0.70 () {60 vars in 1360 bytes} [Sun Aug 28 19:17:00 2022] PUT /identity/v3/groups/6dd3368d9f1b43fb878b16a80cf158f8/users/9613f0963d04443bacf1da28ca349ef8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:01.102484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76226a2-022d-407e-aeff-7aeeadb6fb5c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:01.123694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76226a2-022d-407e-aeff-7aeeadb6fb5c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:01.229910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:01.246945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5516cea-4e18-4d7a-a625-66465bba4f96 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:01.247784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5516cea-4e18-4d7a-a625-66465bba4f96 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:01.248171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5516cea-4e18-4d7a-a625-66465bba4f96 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:01.248555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5516cea-4e18-4d7a-a625-66465bba4f96 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:01.249543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5516cea-4e18-4d7a-a625-66465bba4f96 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:01.253251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5516cea-4e18-4d7a-a625-66465bba4f96 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:01.289594 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2961/5899] 10.222.0.70 () {60 vars in 1147 bytes} [Sun Aug 28 19:17:01 2022] POST /identity/v3/groups => generated 326 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:17:01.291414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc811e-5ed1-4270-bdd6-2ba00452cf98 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:01.318152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc811e-5ed1-4270-bdd6-2ba00452cf98 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:01.325401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea955e7a-10e5-4b54-8ad0-7f8195054ba0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:01.326668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea955e7a-10e5-4b54-8ad0-7f8195054ba0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:01.327241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea955e7a-10e5-4b54-8ad0-7f8195054ba0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:01.328651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea955e7a-10e5-4b54-8ad0-7f8195054ba0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/0302dfe8dd2f4e5f8045790f975fc580/users/9613f0963d04443bacf1da28ca349ef8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:01.342721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea955e7a-10e5-4b54-8ad0-7f8195054ba0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0302dfe8dd2f4e5f8045790f975fc580, user_id=9613f0963d04443bacf1da28ca349ef8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:01.345503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea955e7a-10e5-4b54-8ad0-7f8195054ba0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:01.390036 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2939/5900] 10.222.0.70 () {60 vars in 1360 bytes} [Sun Aug 28 19:17:01 2022] PUT /identity/v3/groups/0302dfe8dd2f4e5f8045790f975fc580/users/9613f0963d04443bacf1da28ca349ef8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:01.395355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5516cea-4e18-4d7a-a625-66465bba4f96 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:01.409655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5516cea-4e18-4d7a-a625-66465bba4f96 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:01.601302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa1f64-9261-49ed-a042-8f3634ef1819 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:01.606373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa1f64-9261-49ed-a042-8f3634ef1819 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:01.607988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa1f64-9261-49ed-a042-8f3634ef1819 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:01.608322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa1f64-9261-49ed-a042-8f3634ef1819 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/users/9613f0963d04443bacf1da28ca349ef8/groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:01.618148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa1f64-9261-49ed-a042-8f3634ef1819 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=9613f0963d04443bacf1da28ca349ef8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:01.623819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa1f64-9261-49ed-a042-8f3634ef1819 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:01.658695 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2962/5901] 10.222.0.70 () {58 vars in 1242 bytes} [Sun Aug 28 19:17:01 2022] GET /identity/v3/users/9613f0963d04443bacf1da28ca349ef8/groups => generated 839 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:01.664297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea955e7a-10e5-4b54-8ad0-7f8195054ba0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:01.680825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea955e7a-10e5-4b54-8ad0-7f8195054ba0 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:01.697365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dae4c-da56-41ba-b488-438b4a44f59e tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:01.700528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dae4c-da56-41ba-b488-438b4a44f59e tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:01.701250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dae4c-da56-41ba-b488-438b4a44f59e tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:01.701536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dae4c-da56-41ba-b488-438b4a44f59e tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/0302dfe8dd2f4e5f8045790f975fc580` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:01.709142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dae4c-da56-41ba-b488-438b4a44f59e tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0302dfe8dd2f4e5f8045790f975fc580)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:01.716720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dae4c-da56-41ba-b488-438b4a44f59e tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:01.837547 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2940/5902] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:17:01 2022] DELETE /identity/v3/groups/0302dfe8dd2f4e5f8045790f975fc580 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:01.841547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa1f64-9261-49ed-a042-8f3634ef1819 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:01.868442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa1f64-9261-49ed-a042-8f3634ef1819 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:02.005666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8be54-8d23-4ed9-81d3-c127ee19ac9c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:02.006600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8be54-8d23-4ed9-81d3-c127ee19ac9c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:02.007788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8be54-8d23-4ed9-81d3-c127ee19ac9c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:02.008070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8be54-8d23-4ed9-81d3-c127ee19ac9c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/groups/6dd3368d9f1b43fb878b16a80cf158f8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:02.009637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8be54-8d23-4ed9-81d3-c127ee19ac9c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6dd3368d9f1b43fb878b16a80cf158f8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:02.011833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8be54-8d23-4ed9-81d3-c127ee19ac9c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:02.157191 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2963/5903] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:17:01 2022] DELETE /identity/v3/groups/6dd3368d9f1b43fb878b16a80cf158f8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:02.161845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dae4c-da56-41ba-b488-438b4a44f59e tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:02.176425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dae4c-da56-41ba-b488-438b4a44f59e tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:02.200092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:02.293352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbe60e-13b6-4b4a-be8a-83bbe7f165ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:02.294439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbe60e-13b6-4b4a-be8a-83bbe7f165ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:02.295112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbe60e-13b6-4b4a-be8a-83bbe7f165ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:02.295112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbe60e-13b6-4b4a-be8a-83bbe7f165ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/users/9613f0963d04443bacf1da28ca349ef8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:02.297417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbe60e-13b6-4b4a-be8a-83bbe7f165ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9613f0963d04443bacf1da28ca349ef8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:02.299410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbe60e-13b6-4b4a-be8a-83bbe7f165ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:02.385612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-79fbe60e-13b6-4b4a-be8a-83bbe7f165ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9613f0963d04443bacf1da28ca349ef8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.404244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-79fbe60e-13b6-4b4a-be8a-83bbe7f165ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9613f0963d04443bacf1da28ca349ef8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.405104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-79fbe60e-13b6-4b4a-be8a-83bbe7f165ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9613f0963d04443bacf1da28ca349ef8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.426594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-79fbe60e-13b6-4b4a-be8a-83bbe7f165ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9613f0963d04443bacf1da28ca349ef8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.427357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-79fbe60e-13b6-4b4a-be8a-83bbe7f165ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9613f0963d04443bacf1da28ca349ef8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.449185 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2941/5904] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:02 2022] DELETE /identity/v3/users/9613f0963d04443bacf1da28ca349ef8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:02.455486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8be54-8d23-4ed9-81d3-c127ee19ac9c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:02.457861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-98d8be54-8d23-4ed9-81d3-c127ee19ac9c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:02.471558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8be54-8d23-4ed9-81d3-c127ee19ac9c tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:02.521600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:02.619118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec76b6-73af-40b9-a22b-73899402d982 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:02.619786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec76b6-73af-40b9-a22b-73899402d982 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:02.620209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec76b6-73af-40b9-a22b-73899402d982 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:02.620411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec76b6-73af-40b9-a22b-73899402d982 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/domains/ad30b62ccb464192aef5646e5fd2be1d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:02.623289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec76b6-73af-40b9-a22b-73899402d982 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ad30b62ccb464192aef5646e5fd2be1d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:02.625087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec76b6-73af-40b9-a22b-73899402d982 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:02.661350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2fec76b6-73af-40b9-a22b-73899402d982 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ad30b62ccb464192aef5646e5fd2be1d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.662363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2fec76b6-73af-40b9-a22b-73899402d982 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ad30b62ccb464192aef5646e5fd2be1d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.703592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2fec76b6-73af-40b9-a22b-73899402d982 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ad30b62ccb464192aef5646e5fd2be1d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.704459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2fec76b6-73af-40b9-a22b-73899402d982 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ad30b62ccb464192aef5646e5fd2be1d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.711924 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2964/5905] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:17:02 2022] PATCH /identity/v3/domains/ad30b62ccb464192aef5646e5fd2be1d => generated 278 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:02.713556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbe60e-13b6-4b4a-be8a-83bbe7f165ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:02.727979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbe60e-13b6-4b4a-be8a-83bbe7f165ec tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:02.783965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec76b6-73af-40b9-a22b-73899402d982 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:02.786831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2fec76b6-73af-40b9-a22b-73899402d982 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:02.799893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f624d1da6ea463dbbb8485000febc16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bde515766b9b4a959d4eecc593338539', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:02.801087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:02.801560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:02.802003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] PATH_INFO: `/v3/domains/ad30b62ccb464192aef5646e5fd2be1d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:02.828950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ad30b62ccb464192aef5646e5fd2be1d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:02.830913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:02.860428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ad30b62ccb464192aef5646e5fd2be1d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.864680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ad30b62ccb464192aef5646e5fd2be1d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.866298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:02.921064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad30b62ccb464192aef5646e5fd2be1d', 'request_id': 'req-5c774702-434b-4ac8-80de-9d0a3aef7d34'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.931301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad30b62ccb464192aef5646e5fd2be1d', 'request_id': 'req-5c774702-434b-4ac8-80de-9d0a3aef7d34'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.938137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad30b62ccb464192aef5646e5fd2be1d', 'request_id': 'req-5c774702-434b-4ac8-80de-9d0a3aef7d34'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.953996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec76b6-73af-40b9-a22b-73899402d982 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:02.954230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] The token cache is being invalidate because project ad30b62ccb464192aef5646e5fd2be1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:02.954523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.955247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.965575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ad30b62ccb464192aef5646e5fd2be1d', 'request_id': 'req-5c774702-434b-4ac8-80de-9d0a3aef7d34'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.969925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ad30b62ccb464192aef5646e5fd2be1d', 'request_id': 'req-5c774702-434b-4ac8-80de-9d0a3aef7d34'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.970657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ad30b62ccb464192aef5646e5fd2be1d', 'request_id': 'req-5c774702-434b-4ac8-80de-9d0a3aef7d34'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:02.982972 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2942/5906] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:17:02 2022] DELETE /identity/v3/domains/ad30b62ccb464192aef5646e5fd2be1d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:02.983936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:02.986200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:03.105477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429551ca-0dbc-4964-ac99-41b33006a75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:03.106145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429551ca-0dbc-4964-ac99-41b33006a75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:03.106439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429551ca-0dbc-4964-ac99-41b33006a75b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:03.106724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429551ca-0dbc-4964-ac99-41b33006a75b admin admin] PATH_INFO: `/v3/users/3277e171d77e47af8d51ad15cfe9b121` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:03.111365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429551ca-0dbc-4964-ac99-41b33006a75b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3277e171d77e47af8d51ad15cfe9b121)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:03.115969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429551ca-0dbc-4964-ac99-41b33006a75b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:03.169096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c774702-434b-4ac8-80de-9d0a3aef7d34 tempest-GroupsV3TestJSON-2961574 tempest-GroupsV3TestJSON-2961574-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:03.184442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dafeb-8241-4e23-bcf0-f4cb7f3f3084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:03.185148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dafeb-8241-4e23-bcf0-f4cb7f3f3084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:03.185587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dafeb-8241-4e23-bcf0-f4cb7f3f3084 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:03.186060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dafeb-8241-4e23-bcf0-f4cb7f3f3084 admin admin] PATH_INFO: `/v3/users/665aa4d5804a46e1a775bd9831fdde22` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:03.187448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dafeb-8241-4e23-bcf0-f4cb7f3f3084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665aa4d5804a46e1a775bd9831fdde22)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:03.189447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dafeb-8241-4e23-bcf0-f4cb7f3f3084 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:03.211164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-429551ca-0dbc-4964-ac99-41b33006a75b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3277e171d77e47af8d51ad15cfe9b121'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:03.212515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:03.220051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-429551ca-0dbc-4964-ac99-41b33006a75b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3277e171d77e47af8d51ad15cfe9b121'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:03.221388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-429551ca-0dbc-4964-ac99-41b33006a75b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3277e171d77e47af8d51ad15cfe9b121'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:03.246910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-429551ca-0dbc-4964-ac99-41b33006a75b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3277e171d77e47af8d51ad15cfe9b121'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:03.247876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-429551ca-0dbc-4964-ac99-41b33006a75b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3277e171d77e47af8d51ad15cfe9b121'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:03.281652 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2965/5907] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:02 2022] DELETE /identity/v3/users/3277e171d77e47af8d51ad15cfe9b121 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:03.286566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cda097-a446-411d-b8ac-2fbd82cd9f5d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:03.286976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cda097-a446-411d-b8ac-2fbd82cd9f5d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:03.287406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cda097-a446-411d-b8ac-2fbd82cd9f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:03.293227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a13dafeb-8241-4e23-bcf0-f4cb7f3f3084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665aa4d5804a46e1a775bd9831fdde22'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:03.303115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a13dafeb-8241-4e23-bcf0-f4cb7f3f3084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665aa4d5804a46e1a775bd9831fdde22'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:03.303872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a13dafeb-8241-4e23-bcf0-f4cb7f3f3084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665aa4d5804a46e1a775bd9831fdde22'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:03.313774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a5cda097-a446-411d-b8ac-2fbd82cd9f5d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:03.316519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a5cda097-a446-411d-b8ac-2fbd82cd9f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:03.317979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=79,keystone:DELETE=20,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:03.319560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a13dafeb-8241-4e23-bcf0-f4cb7f3f3084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665aa4d5804a46e1a775bd9831fdde22'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:03.320481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a13dafeb-8241-4e23-bcf0-f4cb7f3f3084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665aa4d5804a46e1a775bd9831fdde22'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:03.355217 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2943/5908] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:02 2022] DELETE /identity/v3/users/665aa4d5804a46e1a775bd9831fdde22 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:03.358892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb8f9c-26dc-4ba5-9b2b-de2c977a59c9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:03.361015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb8f9c-26dc-4ba5-9b2b-de2c977a59c9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:03.361388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb8f9c-26dc-4ba5-9b2b-de2c977a59c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:03.386323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-54cb8f9c-26dc-4ba5-9b2b-de2c977a59c9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:03.388155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-54cb8f9c-26dc-4ba5-9b2b-de2c977a59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:03.423235 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2966/5909] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:03.433921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cda097-a446-411d-b8ac-2fbd82cd9f5d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:03.435672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a5cda097-a446-411d-b8ac-2fbd82cd9f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:03.472805 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2944/5910] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:03.483297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb8f9c-26dc-4ba5-9b2b-de2c977a59c9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:03.484992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-54cb8f9c-26dc-4ba5-9b2b-de2c977a59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:03.535861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cda097-a446-411d-b8ac-2fbd82cd9f5d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:03.586513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb8f9c-26dc-4ba5-9b2b-de2c977a59c9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:03.614885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287be253-3677-4109-88ba-b5b0bef7e1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:03.615796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287be253-3677-4109-88ba-b5b0bef7e1ee service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:03.616248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287be253-3677-4109-88ba-b5b0bef7e1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:03.616759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287be253-3677-4109-88ba-b5b0bef7e1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:03.646639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287be253-3677-4109-88ba-b5b0bef7e1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:03.648174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287be253-3677-4109-88ba-b5b0bef7e1ee service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:03.660471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90575255-0f3e-4bfa-9804-d162b87298b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:03.661022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90575255-0f3e-4bfa-9804-d162b87298b4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:03.661242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90575255-0f3e-4bfa-9804-d162b87298b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:03.662571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90575255-0f3e-4bfa-9804-d162b87298b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:03.673295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90575255-0f3e-4bfa-9804-d162b87298b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:03.676808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90575255-0f3e-4bfa-9804-d162b87298b4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:03.694450 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2945/5911] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:17:03.703734 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2967/5912] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:04.108045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287be253-3677-4109-88ba-b5b0bef7e1ee service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:04.109787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-287be253-3677-4109-88ba-b5b0bef7e1ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:04.167283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287be253-3677-4109-88ba-b5b0bef7e1ee service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:04.173406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:04.174055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:04.174856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:04.174856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] PATH_INFO: `/v3/projects/9cfb62246e804db592aea2f2e564c49e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:04.186120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cfb62246e804db592aea2f2e564c49e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:04.188405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:04.293959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cfb62246e804db592aea2f2e564c49e', 'request_id': 'req-22623f33-409f-4239-80ae-b558031b6786'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.304974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cfb62246e804db592aea2f2e564c49e', 'request_id': 'req-22623f33-409f-4239-80ae-b558031b6786'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.336178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cfb62246e804db592aea2f2e564c49e', 'request_id': 'req-22623f33-409f-4239-80ae-b558031b6786'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.370194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] The token cache is being invalidate because project 9cfb62246e804db592aea2f2e564c49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:04.370503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.371246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.375041 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2946/5913] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:04 2022] DELETE /identity/v3/projects/9cfb62246e804db592aea2f2e564c49e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:04.376951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90575255-0f3e-4bfa-9804-d162b87298b4 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:04.399834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90575255-0f3e-4bfa-9804-d162b87298b4 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:04.445660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:04.543975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:04.544411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:04.544842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:04.545214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] PATH_INFO: `/v3/users/4f624d1da6ea463dbbb8485000febc16` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:04.546528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f624d1da6ea463dbbb8485000febc16)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:04.548984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:04.569487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:04.571327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:04.594124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623f33-409f-4239-80ae-b558031b6786 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:04.603263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:04.604021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:04.604312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:04.604600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] PATH_INFO: `/v3/projects/11e4febb3fea4e9da7a146531cf1f902` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:04.606023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e4febb3fea4e9da7a146531cf1f902)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:04.609709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:04.625130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:04.628606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f624d1da6ea463dbbb8485000febc16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.637539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f624d1da6ea463dbbb8485000febc16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.638979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f624d1da6ea463dbbb8485000febc16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.649193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f624d1da6ea463dbbb8485000febc16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.649951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f624d1da6ea463dbbb8485000febc16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.674907 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2968/5914] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:04 2022] DELETE /identity/v3/users/4f624d1da6ea463dbbb8485000febc16 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:04.676948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e4febb3fea4e9da7a146531cf1f902', 'request_id': 'req-146219eb-87c5-4ea1-b87d-1ce470a56cd0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.685657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e4febb3fea4e9da7a146531cf1f902', 'request_id': 'req-146219eb-87c5-4ea1-b87d-1ce470a56cd0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.692461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e4febb3fea4e9da7a146531cf1f902', 'request_id': 'req-146219eb-87c5-4ea1-b87d-1ce470a56cd0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.705397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] The token cache is being invalidate because project 11e4febb3fea4e9da7a146531cf1f902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:04.705829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.707171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.709153 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2947/5915] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:04 2022] DELETE /identity/v3/projects/11e4febb3fea4e9da7a146531cf1f902 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:04.713031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:04.714573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:04.792736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506eaad3-8aaa-4ab3-8310-cb47a9561b22 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:04.798201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2894e5-674b-4922-9cdd-b3e8babfe6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:04.799173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2894e5-674b-4922-9cdd-b3e8babfe6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:04.799310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2894e5-674b-4922-9cdd-b3e8babfe6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:04.799611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2894e5-674b-4922-9cdd-b3e8babfe6a7 admin admin] PATH_INFO: `/v3/users/08a1a471688e49f3805a409f139645ce` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:04.801347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2894e5-674b-4922-9cdd-b3e8babfe6a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a1a471688e49f3805a409f139645ce)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:04.803674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2894e5-674b-4922-9cdd-b3e8babfe6a7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:04.876910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:04.880496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e2894e5-674b-4922-9cdd-b3e8babfe6a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a1a471688e49f3805a409f139645ce'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.890331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e2894e5-674b-4922-9cdd-b3e8babfe6a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a1a471688e49f3805a409f139645ce'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.891083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e2894e5-674b-4922-9cdd-b3e8babfe6a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a1a471688e49f3805a409f139645ce'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.901552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e2894e5-674b-4922-9cdd-b3e8babfe6a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a1a471688e49f3805a409f139645ce'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.902344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e2894e5-674b-4922-9cdd-b3e8babfe6a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a1a471688e49f3805a409f139645ce'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:04.922144 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2969/5916] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:04 2022] DELETE /identity/v3/users/08a1a471688e49f3805a409f139645ce => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:05.002205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:05.005349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:05.081378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146219eb-87c5-4ea1-b87d-1ce470a56cd0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:05.146538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:05.148634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:05.148996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:05.149487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] PATH_INFO: `/v3/projects/bde515766b9b4a959d4eecc593338539` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:05.150800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bde515766b9b4a959d4eecc593338539)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:05.152835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:05.208110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde515766b9b4a959d4eecc593338539', 'request_id': 'req-10822d4c-2de9-4dbb-8cc5-ddf20267e093'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.210142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:05.220611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde515766b9b4a959d4eecc593338539', 'request_id': 'req-10822d4c-2de9-4dbb-8cc5-ddf20267e093'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.229517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde515766b9b4a959d4eecc593338539', 'request_id': 'req-10822d4c-2de9-4dbb-8cc5-ddf20267e093'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.243823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] The token cache is being invalidate because project bde515766b9b4a959d4eecc593338539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:05.243823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.244932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.246245 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2948/5917] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:05 2022] DELETE /identity/v3/projects/bde515766b9b4a959d4eecc593338539 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:05.251476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63697d9f-2ff8-4e59-ac1e-c1ad23368e87 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:05.252026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63697d9f-2ff8-4e59-ac1e-c1ad23368e87 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:05.252515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63697d9f-2ff8-4e59-ac1e-c1ad23368e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:05.285111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:05.286842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:05.293369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-63697d9f-2ff8-4e59-ac1e-c1ad23368e87 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:05.300167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-63697d9f-2ff8-4e59-ac1e-c1ad23368e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:05.400543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10822d4c-2de9-4dbb-8cc5-ddf20267e093 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:05.407097 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2970/5918] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:05.409385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89103948-e2b8-4261-8648-0e254dc55d9f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:05.409851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89103948-e2b8-4261-8648-0e254dc55d9f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:05.410222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89103948-e2b8-4261-8648-0e254dc55d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:05.418265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:05.418966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:05.419258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:05.419543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] PATH_INFO: `/v3/projects/2d7d399c37b542688949a538af957b52` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:05.420808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7d399c37b542688949a538af957b52)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:05.422708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:05.465683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-89103948-e2b8-4261-8648-0e254dc55d9f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:05.467519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-89103948-e2b8-4261-8648-0e254dc55d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:05.492084 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2971/5919] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:05.495335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89103948-e2b8-4261-8648-0e254dc55d9f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:05.520392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7d399c37b542688949a538af957b52', 'request_id': 'req-df81aa44-05cd-4e9b-876f-62ac4d576261'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.525341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89103948-e2b8-4261-8648-0e254dc55d9f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:05.545623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7d399c37b542688949a538af957b52', 'request_id': 'req-df81aa44-05cd-4e9b-876f-62ac4d576261'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.557597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7d399c37b542688949a538af957b52', 'request_id': 'req-df81aa44-05cd-4e9b-876f-62ac4d576261'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.588630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] The token cache is being invalidate because project 2d7d399c37b542688949a538af957b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:05.589135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.590246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.593673 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2949/5920] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:05 2022] DELETE /identity/v3/projects/2d7d399c37b542688949a538af957b52 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:05.596566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:05.600064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:05.647343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c1fce-be13-43c2-943e-5bade6f1e624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:05.648152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c1fce-be13-43c2-943e-5bade6f1e624 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:05.648540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c1fce-be13-43c2-943e-5bade6f1e624 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:05.648888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c1fce-be13-43c2-943e-5bade6f1e624 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:05.649574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c1fce-be13-43c2-943e-5bade6f1e624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:05.649880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c1fce-be13-43c2-943e-5bade6f1e624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:05.651524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c1fce-be13-43c2-943e-5bade6f1e624 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:05.664889 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2972/5921] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:05.669136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c1fce-be13-43c2-943e-5bade6f1e624 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:05.671401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fe6c1fce-be13-43c2-943e-5bade6f1e624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:05.685365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c1fce-be13-43c2-943e-5bade6f1e624 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:05.692263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d10ea8-58c0-4a5c-a6a9-5ecb178e0e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:05.693009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d10ea8-58c0-4a5c-a6a9-5ecb178e0e3d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:05.693359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d10ea8-58c0-4a5c-a6a9-5ecb178e0e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:05.693723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d10ea8-58c0-4a5c-a6a9-5ecb178e0e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:05.694759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d10ea8-58c0-4a5c-a6a9-5ecb178e0e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:05.697216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d10ea8-58c0-4a5c-a6a9-5ecb178e0e3d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:05.730411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81aa44-05cd-4e9b-876f-62ac4d576261 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:05.737713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:05.738918 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2973/5922] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:05 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:05.739421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:05.739717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:05.740022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] PATH_INFO: `/v3/users/c70e09b6009241de98d56e3f384140d7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:05.741422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70e09b6009241de98d56e3f384140d7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:05.742578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d10ea8-58c0-4a5c-a6a9-5ecb178e0e3d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:05.745495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:05.755308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:05.811296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:05.829353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70e09b6009241de98d56e3f384140d7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.841066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70e09b6009241de98d56e3f384140d7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.841897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70e09b6009241de98d56e3f384140d7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.857748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d10ea8-58c0-4a5c-a6a9-5ecb178e0e3d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:05.861267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70e09b6009241de98d56e3f384140d7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.862232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70e09b6009241de98d56e3f384140d7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:05.863806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c6fed-56ad-4c54-8d98-a44c641e8ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:05.864628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c6fed-56ad-4c54-8d98-a44c641e8ded admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:05.864918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c6fed-56ad-4c54-8d98-a44c641e8ded admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:05.865197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c6fed-56ad-4c54-8d98-a44c641e8ded admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:05.865842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c6fed-56ad-4c54-8d98-a44c641e8ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:05.868089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c6fed-56ad-4c54-8d98-a44c641e8ded admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:05.885822 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2950/5923] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:05 2022] DELETE /identity/v3/users/c70e09b6009241de98d56e3f384140d7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:05.898801 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2974/5924] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:05 2022] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:05.906585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:05.912816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:06.009678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5c8fc-1a62-4e04-8066-7a9517c10fee admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:06.016630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ae7a4-b56c-4d1c-8866-080c4961bdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:06.018047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ae7a4-b56c-4d1c-8866-080c4961bdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.018438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ae7a4-b56c-4d1c-8866-080c4961bdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.018855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ae7a4-b56c-4d1c-8866-080c4961bdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.021403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ae7a4-b56c-4d1c-8866-080c4961bdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:06.024456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ae7a4-b56c-4d1c-8866-080c4961bdf2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:06.040578 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2951/5925] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:06.044324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c6fed-56ad-4c54-8d98-a44c641e8ded admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:06.056495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c6fed-56ad-4c54-8d98-a44c641e8ded admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:06.062664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea4b4a-a4b6-4024-af58-59cceb983a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:06.063598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea4b4a-a4b6-4024-af58-59cceb983a71 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.063986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea4b4a-a4b6-4024-af58-59cceb983a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.064363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea4b4a-a4b6-4024-af58-59cceb983a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.065348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea4b4a-a4b6-4024-af58-59cceb983a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:06.068487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea4b4a-a4b6-4024-af58-59cceb983a71 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:06.086023 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2975/5926] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:17:06.089953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ae7a4-b56c-4d1c-8866-080c4961bdf2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:06.101894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ae7a4-b56c-4d1c-8866-080c4961bdf2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:06.107176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e875f3-7267-4680-afce-ced55027e805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:06.108762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e875f3-7267-4680-afce-ced55027e805 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.109318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e875f3-7267-4680-afce-ced55027e805 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.109794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e875f3-7267-4680-afce-ced55027e805 admin admin] PATH_INFO: `/v3/projects/93bbd0411f8948cf81778421db0052e4/users/69a403111b1a41fa92593f021a623838/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.127338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e875f3-7267-4680-afce-ced55027e805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93bbd0411f8948cf81778421db0052e4, user_id=69a403111b1a41fa92593f021a623838, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:06.130949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e875f3-7267-4680-afce-ced55027e805 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:06.148046 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2952/5927] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:06 2022] PUT /identity/v3/projects/93bbd0411f8948cf81778421db0052e4/users/69a403111b1a41fa92593f021a623838/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:06.158209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b0963-f5ad-4cbd-a22b-69c44ed8461e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.158506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b0963-f5ad-4cbd-a22b-69c44ed8461e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.158796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b0963-f5ad-4cbd-a22b-69c44ed8461e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.194867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-804b0963-f5ad-4cbd-a22b-69c44ed8461e None None] MFA Rules not processed for user `69a403111b1a41fa92593f021a623838`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:06.196783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-804b0963-f5ad-4cbd-a22b-69c44ed8461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:06.290637 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2976/5928] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:06.292030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e875f3-7267-4680-afce-ced55027e805 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:06.382523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:06.389407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b0963-f5ad-4cbd-a22b-69c44ed8461e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:06.392520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-804b0963-f5ad-4cbd-a22b-69c44ed8461e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:06.404202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e875f3-7267-4680-afce-ced55027e805 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:06.411285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b207c1-a72a-4588-a716-8df3d97d3aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:06.411902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b207c1-a72a-4588-a716-8df3d97d3aab admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.412193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b207c1-a72a-4588-a716-8df3d97d3aab admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.412470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b207c1-a72a-4588-a716-8df3d97d3aab admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.413394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b207c1-a72a-4588-a716-8df3d97d3aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:06.415605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b207c1-a72a-4588-a716-8df3d97d3aab admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:06.436787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b0963-f5ad-4cbd-a22b-69c44ed8461e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:06.448031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:06.448745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.449060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.449340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1 admin admin] PATH_INFO: `/v3/projects/d1ccd6d5f2274ecca80e099316d62d3b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.452476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ccd6d5f2274ecca80e099316d62d3b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:06.454473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:06.458593 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2953/5929] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:06 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:17:06.460256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b207c1-a72a-4588-a716-8df3d97d3aab admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:06.557744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ccd6d5f2274ecca80e099316d62d3b', 'request_id': 'req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:06.587822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b207c1-a72a-4588-a716-8df3d97d3aab admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:06.593181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ccd6d5f2274ecca80e099316d62d3b', 'request_id': 'req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:06.607461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ccd6d5f2274ecca80e099316d62d3b', 'request_id': 'req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:06.638218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1 admin admin] The token cache is being invalidate because project d1ccd6d5f2274ecca80e099316d62d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:06.638698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:06.643425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3f6ef57a-18e8-47d2-bb84-31a9858da5f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:06.647020 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2977/5930] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:06 2022] DELETE /identity/v3/projects/d1ccd6d5f2274ecca80e099316d62d3b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:06.652140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0775ec-d30a-4c98-8275-d2d5970e38f8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.652506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0775ec-d30a-4c98-8275-d2d5970e38f8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.652860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0775ec-d30a-4c98-8275-d2d5970e38f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.667995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5224059-ccfd-4ee1-ac59-0694af8a6789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:06.668257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5224059-ccfd-4ee1-ac59-0694af8a6789 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.668632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5224059-ccfd-4ee1-ac59-0694af8a6789 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.668982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5224059-ccfd-4ee1-ac59-0694af8a6789 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.669695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5224059-ccfd-4ee1-ac59-0694af8a6789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:06.671769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5224059-ccfd-4ee1-ac59-0694af8a6789 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:06.676009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ba0775ec-d30a-4c98-8275-d2d5970e38f8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:06.678552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ba0775ec-d30a-4c98-8275-d2d5970e38f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:06.690396 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2978/5931] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:06.701444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb53696-5b53-4a23-8dce-8e9965b27d95 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.702092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb53696-5b53-4a23-8dce-8e9965b27d95 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.702432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb53696-5b53-4a23-8dce-8e9965b27d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.718683 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2954/5932] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:06 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:06.721818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5224059-ccfd-4ee1-ac59-0694af8a6789 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:06.724623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b5224059-ccfd-4ee1-ac59-0694af8a6789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:06.740154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9fb53696-5b53-4a23-8dce-8e9965b27d95 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:06.740952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5224059-ccfd-4ee1-ac59-0694af8a6789 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:06.742546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9fb53696-5b53-4a23-8dce-8e9965b27d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:06.746789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c48ec8-b81f-423c-8c0a-992f5c47f175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:06.747307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48ec8-b81f-423c-8c0a-992f5c47f175 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.747700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48ec8-b81f-423c-8c0a-992f5c47f175 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.748050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48ec8-b81f-423c-8c0a-992f5c47f175 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.749107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c48ec8-b81f-423c-8c0a-992f5c47f175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:06.750829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c48ec8-b81f-423c-8c0a-992f5c47f175 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:06.758208 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2979/5933] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:06.759235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb53696-5b53-4a23-8dce-8e9965b27d95 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:06.768210 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2955/5934] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:17:06.770346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb53696-5b53-4a23-8dce-8e9965b27d95 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:06.770504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c48ec8-b81f-423c-8c0a-992f5c47f175 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:06.782405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506926e-22f1-4caf-a528-442873ceec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:06.782886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c48ec8-b81f-423c-8c0a-992f5c47f175 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:06.783731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506926e-22f1-4caf-a528-442873ceec29 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.784282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506926e-22f1-4caf-a528-442873ceec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.785029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506926e-22f1-4caf-a528-442873ceec29 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.786039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506926e-22f1-4caf-a528-442873ceec29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:06.786634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506926e-22f1-4caf-a528-442873ceec29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:06.789151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506926e-22f1-4caf-a528-442873ceec29 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:06.789802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee06e4-2ca0-4d3b-a5ef-2d6037b6754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:06.790550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee06e4-2ca0-4d3b-a5ef-2d6037b6754d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.790947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee06e4-2ca0-4d3b-a5ef-2d6037b6754d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.791295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee06e4-2ca0-4d3b-a5ef-2d6037b6754d admin admin] PATH_INFO: `/v3/projects/13e308368e694ba0a6860a9e995a72b0/users/0a064a195cab460eb5bbc555e7e01bc4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.792215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:06.813671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee06e4-2ca0-4d3b-a5ef-2d6037b6754d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e308368e694ba0a6860a9e995a72b0, user_id=0a064a195cab460eb5bbc555e7e01bc4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:06.817183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee06e4-2ca0-4d3b-a5ef-2d6037b6754d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:06.818526 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2980/5935] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:06.820016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506926e-22f1-4caf-a528-442873ceec29 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:06.835374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506926e-22f1-4caf-a528-442873ceec29 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:06.839056 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2956/5936] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:06 2022] PUT /identity/v3/projects/13e308368e694ba0a6860a9e995a72b0/users/0a064a195cab460eb5bbc555e7e01bc4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:06.843511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee06e4-2ca0-4d3b-a5ef-2d6037b6754d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:06.917132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:06.920123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81941c1-63bb-472e-acaf-0eafe3b9cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:06.922103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81941c1-63bb-472e-acaf-0eafe3b9cfb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.922419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81941c1-63bb-472e-acaf-0eafe3b9cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.922693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81941c1-63bb-472e-acaf-0eafe3b9cfb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.923507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81941c1-63bb-472e-acaf-0eafe3b9cfb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:06.927244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81941c1-63bb-472e-acaf-0eafe3b9cfb0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:06.961699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee06e4-2ca0-4d3b-a5ef-2d6037b6754d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:06.971944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f26781-0261-4b3c-90fa-0cb09b1488e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:06.973353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f26781-0261-4b3c-90fa-0cb09b1488e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:06.974003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f26781-0261-4b3c-90fa-0cb09b1488e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:06.974396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f26781-0261-4b3c-90fa-0cb09b1488e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:06.975255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f26781-0261-4b3c-90fa-0cb09b1488e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:06.980001 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2981/5937] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:06 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:06.980179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f26781-0261-4b3c-90fa-0cb09b1488e7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:06.981458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81941c1-63bb-472e-acaf-0eafe3b9cfb0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:06.992415 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2957/5938] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:17:06.997638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f26781-0261-4b3c-90fa-0cb09b1488e7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.013555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f26781-0261-4b3c-90fa-0cb09b1488e7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.072214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81941c1-63bb-472e-acaf-0eafe3b9cfb0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.077328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096a089-f2b9-49ea-b77e-0b6a74eb28dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.077953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096a089-f2b9-49ea-b77e-0b6a74eb28dc admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.078235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096a089-f2b9-49ea-b77e-0b6a74eb28dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.078498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096a089-f2b9-49ea-b77e-0b6a74eb28dc admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.079168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096a089-f2b9-49ea-b77e-0b6a74eb28dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.081112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096a089-f2b9-49ea-b77e-0b6a74eb28dc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.109476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f96cf2-7b12-455d-a20e-7deef383a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.110393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f96cf2-7b12-455d-a20e-7deef383a2be admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.110821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f96cf2-7b12-455d-a20e-7deef383a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.111180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f96cf2-7b12-455d-a20e-7deef383a2be admin admin] PATH_INFO: `/v3/projects/13e308368e694ba0a6860a9e995a72b0/users/0a064a195cab460eb5bbc555e7e01bc4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.111793 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2982/5939] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:06 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:17:07.114014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f96cf2-7b12-455d-a20e-7deef383a2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e308368e694ba0a6860a9e995a72b0, user_id=0a064a195cab460eb5bbc555e7e01bc4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.117058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f96cf2-7b12-455d-a20e-7deef383a2be admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.117495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096a089-f2b9-49ea-b77e-0b6a74eb28dc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.130406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096a089-f2b9-49ea-b77e-0b6a74eb28dc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.134837 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2958/5940] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:06 2022] PUT /identity/v3/projects/13e308368e694ba0a6860a9e995a72b0/users/0a064a195cab460eb5bbc555e7e01bc4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:07.160906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aba3f9-ab83-4cac-a811-d4516897e36f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.161626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aba3f9-ab83-4cac-a811-d4516897e36f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.161626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aba3f9-ab83-4cac-a811-d4516897e36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.208897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e4aba3f9-ab83-4cac-a811-d4516897e36f None None] MFA Rules not processed for user `0a064a195cab460eb5bbc555e7e01bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:07.210150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e4aba3f9-ab83-4cac-a811-d4516897e36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:07.226247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef87239-18e2-4e74-a006-1c831b471c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.227363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef87239-18e2-4e74-a006-1c831b471c86 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.227992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef87239-18e2-4e74-a006-1c831b471c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.228704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef87239-18e2-4e74-a006-1c831b471c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.229564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef87239-18e2-4e74-a006-1c831b471c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.231708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef87239-18e2-4e74-a006-1c831b471c86 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.246263 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2983/5941] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:07.247944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305e1f-ab2c-4e2c-a41c-d7c31c85e703 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.248638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305e1f-ab2c-4e2c-a41c-d7c31c85e703 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.249334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305e1f-ab2c-4e2c-a41c-d7c31c85e703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.261006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:07.273500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a2305e1f-ab2c-4e2c-a41c-d7c31c85e703 None None] MFA Rules not processed for user `ee83dfdb456f4acc9fa1c5e7c8ef00ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:07.274702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a2305e1f-ab2c-4e2c-a41c-d7c31c85e703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:07.304687 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2959/5942] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:07.305675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aba3f9-ab83-4cac-a811-d4516897e36f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.316509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aba3f9-ab83-4cac-a811-d4516897e36f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.321837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a3fed-a5cb-4a00-9b28-a97a751731d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.322457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a3fed-a5cb-4a00-9b28-a97a751731d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.322829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a3fed-a5cb-4a00-9b28-a97a751731d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.323063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a3fed-a5cb-4a00-9b28-a97a751731d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.323703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a3fed-a5cb-4a00-9b28-a97a751731d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.325308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a3fed-a5cb-4a00-9b28-a97a751731d1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.340337 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2984/5943] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:07.340573 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2960/5944] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:07.340669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2305e1f-ab2c-4e2c-a41c-d7c31c85e703 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.340762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a3fed-a5cb-4a00-9b28-a97a751731d1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.352926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2305e1f-ab2c-4e2c-a41c-d7c31c85e703 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.353321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a3fed-a5cb-4a00-9b28-a97a751731d1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.357764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57f312-b629-46c3-b0a6-9251c8ddd882 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.358383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57f312-b629-46c3-b0a6-9251c8ddd882 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.358518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804df02b-5270-4faf-bf2a-8c70445d3570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.358728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57f312-b629-46c3-b0a6-9251c8ddd882 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.358964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57f312-b629-46c3-b0a6-9251c8ddd882 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.359269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804df02b-5270-4faf-bf2a-8c70445d3570 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.359560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804df02b-5270-4faf-bf2a-8c70445d3570 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.359685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57f312-b629-46c3-b0a6-9251c8ddd882 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.359866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804df02b-5270-4faf-bf2a-8c70445d3570 admin admin] PATH_INFO: `/v3/projects/a3933a34d332491981270944ac4f9e4c/users/6f8442e91abe4b1f8439b1571a4ee385/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.360624 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-3e57f312-b629-46c3-b0a6-9251c8ddd882 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:17:07.360624 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:17:07.360624 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:17:07.361797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57f312-b629-46c3-b0a6-9251c8ddd882 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.380244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804df02b-5270-4faf-bf2a-8c70445d3570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3933a34d332491981270944ac4f9e4c, user_id=6f8442e91abe4b1f8439b1571a4ee385, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.384822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804df02b-5270-4faf-bf2a-8c70445d3570 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.393492 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2985/5945] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:17:07 2022] POST /identity/v3/regions => generated 222 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:07.398907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57f312-b629-46c3-b0a6-9251c8ddd882 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.412507 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2961/5946] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:07 2022] PUT /identity/v3/projects/a3933a34d332491981270944ac4f9e4c/users/6f8442e91abe4b1f8439b1571a4ee385/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:07.413989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227eb12-eda0-409f-876f-1af37567bc07 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.414336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227eb12-eda0-409f-876f-1af37567bc07 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.414618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227eb12-eda0-409f-876f-1af37567bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.424562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57f312-b629-46c3-b0a6-9251c8ddd882 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.466606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a227eb12-eda0-409f-876f-1af37567bc07 None None] MFA Rules not processed for user `6f8442e91abe4b1f8439b1571a4ee385`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:07.468370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a227eb12-eda0-409f-876f-1af37567bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:07.485362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:07.507162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a0e80-ebd0-49b5-b39e-aa80811daea6 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.508127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a0e80-ebd0-49b5-b39e-aa80811daea6 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.508423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a0e80-ebd0-49b5-b39e-aa80811daea6 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.508853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a0e80-ebd0-49b5-b39e-aa80811daea6 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.510310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a0e80-ebd0-49b5-b39e-aa80811daea6 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.512257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a0e80-ebd0-49b5-b39e-aa80811daea6 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.546607 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2986/5947] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:17:07 2022] POST /identity/v3/regions => generated 224 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:17:07.549656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a0e80-ebd0-49b5-b39e-aa80811daea6 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.586779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a0e80-ebd0-49b5-b39e-aa80811daea6 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.593903 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2962/5948] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:07.598234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ca409-784f-4feb-98a3-82cce7501560 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.598234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca409-784f-4feb-98a3-82cce7501560 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.598234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca409-784f-4feb-98a3-82cce7501560 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.598545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca409-784f-4feb-98a3-82cce7501560 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions/4a176252-65b3-4fb1-90db-c7add38a3b4e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.598870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ca409-784f-4feb-98a3-82cce7501560 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:create_region(region_id=4a176252-65b3-4fb1-90db-c7add38a3b4e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.599775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227eb12-eda0-409f-876f-1af37567bc07 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.600948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ca409-784f-4feb-98a3-82cce7501560 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.655624 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2987/5949] 10.222.0.70 () {60 vars in 1259 bytes} [Sun Aug 28 19:17:07 2022] PUT /identity/v3/regions/4a176252-65b3-4fb1-90db-c7add38a3b4e => generated 231 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:07.658062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ca409-784f-4feb-98a3-82cce7501560 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.687209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ca409-784f-4feb-98a3-82cce7501560 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.694272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705ab49-3655-4a22-98b4-53e2464dd4eb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.695683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705ab49-3655-4a22-98b4-53e2464dd4eb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.697921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705ab49-3655-4a22-98b4-53e2464dd4eb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.698315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705ab49-3655-4a22-98b4-53e2464dd4eb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions/4a176252-65b3-4fb1-90db-c7add38a3b4e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.699070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705ab49-3655-4a22-98b4-53e2464dd4eb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:delete_region(region_id=4a176252-65b3-4fb1-90db-c7add38a3b4e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.702691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705ab49-3655-4a22-98b4-53e2464dd4eb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.711625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227eb12-eda0-409f-876f-1af37567bc07 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.735205 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2988/5950] 10.222.0.70 () {58 vars in 1242 bytes} [Sun Aug 28 19:17:07 2022] DELETE /identity/v3/regions/4a176252-65b3-4fb1-90db-c7add38a3b4e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:07.741747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705ab49-3655-4a22-98b4-53e2464dd4eb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.742266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9cf77-88a9-4939-b9a6-44b0bc739e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.743040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9cf77-88a9-4939-b9a6-44b0bc739e65 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.743429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9cf77-88a9-4939-b9a6-44b0bc739e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.743810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9cf77-88a9-4939-b9a6-44b0bc739e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.744553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9cf77-88a9-4939-b9a6-44b0bc739e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.746604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9cf77-88a9-4939-b9a6-44b0bc739e65 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.787845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705ab49-3655-4a22-98b4-53e2464dd4eb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.791099 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2963/5951] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:07 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:07.792346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9cf77-88a9-4939-b9a6-44b0bc739e65 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.797839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:07.881389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694e6da-ba16-4e95-9e95-e68923de62d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.881836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694e6da-ba16-4e95-9e95-e68923de62d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.882111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694e6da-ba16-4e95-9e95-e68923de62d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.882401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694e6da-ba16-4e95-9e95-e68923de62d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.883108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694e6da-ba16-4e95-9e95-e68923de62d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.884909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694e6da-ba16-4e95-9e95-e68923de62d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.888472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9cf77-88a9-4939-b9a6-44b0bc739e65 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.911407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71557d17-d34d-4383-a8e8-8aaedd954c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.912508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71557d17-d34d-4383-a8e8-8aaedd954c91 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.913074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71557d17-d34d-4383-a8e8-8aaedd954c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.913509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71557d17-d34d-4383-a8e8-8aaedd954c91 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.914389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71557d17-d34d-4383-a8e8-8aaedd954c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.915028 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2989/5952] 10.222.0.70 () {60 vars in 1150 bytes} [Sun Aug 28 19:17:07 2022] POST /identity/v3/regions => generated 254 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:07.915925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694e6da-ba16-4e95-9e95-e68923de62d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.917274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71557d17-d34d-4383-a8e8-8aaedd954c91 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.948197 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2964/5953] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:07 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:07.952169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71557d17-d34d-4383-a8e8-8aaedd954c91 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:07.952661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694e6da-ba16-4e95-9e95-e68923de62d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.960768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:07.961082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03e155-0c37-4293-a621-308df6fad876 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.962600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03e155-0c37-4293-a621-308df6fad876 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.963495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03e155-0c37-4293-a621-308df6fad876 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.963495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03e155-0c37-4293-a621-308df6fad876 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions/7cfd6e6ef2be41c5b584a9bf22eb7035` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.964085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03e155-0c37-4293-a621-308df6fad876 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:update_region(region_id=7cfd6e6ef2be41c5b584a9bf22eb7035)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.967272 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-6d03e155-0c37-4293-a621-308df6fad876 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:17:07.967272 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:17:07.967272 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:17:07.968212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03e155-0c37-4293-a621-308df6fad876 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.969190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71557d17-d34d-4383-a8e8-8aaedd954c91 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:07.991581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecbc6c-db89-4055-9639-631b547b8217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:07.992598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecbc6c-db89-4055-9639-631b547b8217 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:07.993057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecbc6c-db89-4055-9639-631b547b8217 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:07.993526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecbc6c-db89-4055-9639-631b547b8217 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:07.994470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecbc6c-db89-4055-9639-631b547b8217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:07.996679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecbc6c-db89-4055-9639-631b547b8217 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:07.997756 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2990/5954] 10.222.0.70 () {60 vars in 1250 bytes} [Sun Aug 28 19:17:07 2022] PATCH /identity/v3/regions/7cfd6e6ef2be41c5b584a9bf22eb7035 => generated 254 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:08.002303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03e155-0c37-4293-a621-308df6fad876 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.013834 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2965/5955] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:08.015005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecbc6c-db89-4055-9639-631b547b8217 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.027634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecbc6c-db89-4055-9639-631b547b8217 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.034445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03e155-0c37-4293-a621-308df6fad876 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.041161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9636b7-ab98-4b8c-8752-44085b815894 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.041834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9636b7-ab98-4b8c-8752-44085b815894 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.042125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9636b7-ab98-4b8c-8752-44085b815894 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.042406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9636b7-ab98-4b8c-8752-44085b815894 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions/7cfd6e6ef2be41c5b584a9bf22eb7035` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.044252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9636b7-ab98-4b8c-8752-44085b815894 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:get_region(region_id=7cfd6e6ef2be41c5b584a9bf22eb7035)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.045510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9636b7-ab98-4b8c-8752-44085b815894 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.047242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5026032-b9ac-45c5-8049-a752d40d738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.047921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5026032-b9ac-45c5-8049-a752d40d738d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.048205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5026032-b9ac-45c5-8049-a752d40d738d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.048482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5026032-b9ac-45c5-8049-a752d40d738d admin admin] PATH_INFO: `/v3/projects/9781504710d54e16b190bf5c7c702066/users/b60d1cff5c8e458b943787ccf2f4a35e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.052626 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2991/5956] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:17:08 2022] GET /identity/v3/regions/7cfd6e6ef2be41c5b584a9bf22eb7035 => generated 254 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:08.056647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9636b7-ab98-4b8c-8752-44085b815894 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.067032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5026032-b9ac-45c5-8049-a752d40d738d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9781504710d54e16b190bf5c7c702066, user_id=b60d1cff5c8e458b943787ccf2f4a35e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.068271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9636b7-ab98-4b8c-8752-44085b815894 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.069829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5026032-b9ac-45c5-8049-a752d40d738d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.074026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977d1f3-3eab-488b-b5d6-b79bedc45ef0 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.074666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977d1f3-3eab-488b-b5d6-b79bedc45ef0 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.075201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977d1f3-3eab-488b-b5d6-b79bedc45ef0 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.075358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977d1f3-3eab-488b-b5d6-b79bedc45ef0 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions/7cfd6e6ef2be41c5b584a9bf22eb7035` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.076081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977d1f3-3eab-488b-b5d6-b79bedc45ef0 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7cfd6e6ef2be41c5b584a9bf22eb7035)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.077894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977d1f3-3eab-488b-b5d6-b79bedc45ef0 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.108766 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2966/5957] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:08 2022] PUT /identity/v3/projects/9781504710d54e16b190bf5c7c702066/users/b60d1cff5c8e458b943787ccf2f4a35e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:08.110015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5026032-b9ac-45c5-8049-a752d40d738d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.111826 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2992/5958] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:17:08 2022] DELETE /identity/v3/regions/7cfd6e6ef2be41c5b584a9bf22eb7035 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:08.115753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977d1f3-3eab-488b-b5d6-b79bedc45ef0 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.142594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977d1f3-3eab-488b-b5d6-b79bedc45ef0 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.198333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5026032-b9ac-45c5-8049-a752d40d738d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.217789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7777bc-a8f0-4845-bc91-b8128efdee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.218572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7777bc-a8f0-4845-bc91-b8128efdee0b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.219391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7777bc-a8f0-4845-bc91-b8128efdee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.219391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7777bc-a8f0-4845-bc91-b8128efdee0b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.219941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7777bc-a8f0-4845-bc91-b8128efdee0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.221821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7777bc-a8f0-4845-bc91-b8128efdee0b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.225358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03792b1-d615-4f61-a920-f5c20d716326 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.225986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03792b1-d615-4f61-a920-f5c20d716326 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.226279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03792b1-d615-4f61-a920-f5c20d716326 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.226561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03792b1-d615-4f61-a920-f5c20d716326 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.227266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03792b1-d615-4f61-a920-f5c20d716326 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.228345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03792b1-d615-4f61-a920-f5c20d716326 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.234633 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2967/5959] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:08.236705 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2993/5960] 10.222.0.70 () {58 vars in 1128 bytes} [Sun Aug 28 19:17:08 2022] GET /identity/v3/regions => generated 668 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:08.242827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03792b1-d615-4f61-a920-f5c20d716326 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.244099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7777bc-a8f0-4845-bc91-b8128efdee0b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.259112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7777bc-a8f0-4845-bc91-b8128efdee0b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.261627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03792b1-d615-4f61-a920-f5c20d716326 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.265230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1dafd-82ea-433d-8f3c-7280bd304a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.266008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1dafd-82ea-433d-8f3c-7280bd304a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.266416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1dafd-82ea-433d-8f3c-7280bd304a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.266836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1dafd-82ea-433d-8f3c-7280bd304a10 admin admin] PATH_INFO: `/v3/projects/9781504710d54e16b190bf5c7c702066/users/b60d1cff5c8e458b943787ccf2f4a35e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.268986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc5605-6612-4081-8608-697dd314047a tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.269185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1dafd-82ea-433d-8f3c-7280bd304a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9781504710d54e16b190bf5c7c702066, user_id=b60d1cff5c8e458b943787ccf2f4a35e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.269905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc5605-6612-4081-8608-697dd314047a tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.270036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc5605-6612-4081-8608-697dd314047a tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.270295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc5605-6612-4081-8608-697dd314047a tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions/7cfd6e6ef2be41c5b584a9bf22eb7035` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.271530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc5605-6612-4081-8608-697dd314047a tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7cfd6e6ef2be41c5b584a9bf22eb7035)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.273492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1dafd-82ea-433d-8f3c-7280bd304a10 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.273646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc5605-6612-4081-8608-697dd314047a tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.285350 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2968/5961] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:08 2022] PUT /identity/v3/projects/9781504710d54e16b190bf5c7c702066/users/b60d1cff5c8e458b943787ccf2f4a35e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:08.296264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd852d-9b57-4aac-b16d-0bfe9e43c4cc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.296264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd852d-9b57-4aac-b16d-0bfe9e43c4cc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.296561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd852d-9b57-4aac-b16d-0bfe9e43c4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-a4cc5605-6612-4081-8608-697dd314047a tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Could not find region: 7cfd6e6ef2be41c5b584a9bf22eb7035.: keystone.exception.RegionNotFound: Could not find region: 7cfd6e6ef2be41c5b584a9bf22eb7035. Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 7cfd6e6ef2be41c5b584a9bf22eb7035. Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:17:08.309111 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 7cfd6e6ef2be41c5b584a9bf22eb7035. Aug 28 19:17:08.310595 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:17:08.314486 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2994/5962] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:17:08 2022] DELETE /identity/v3/regions/7cfd6e6ef2be41c5b584a9bf22eb7035 => generated 112 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:17:08.315421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc5605-6612-4081-8608-697dd314047a tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.341245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc5605-6612-4081-8608-697dd314047a tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.341245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:08.343187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cbbd852d-9b57-4aac-b16d-0bfe9e43c4cc None None] MFA Rules not processed for user `b60d1cff5c8e458b943787ccf2f4a35e`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:08.346885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cbbd852d-9b57-4aac-b16d-0bfe9e43c4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:08.419516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ae98b-84de-4665-9e17-a3c0fd4495d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.420404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ae98b-84de-4665-9e17-a3c0fd4495d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.420971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ae98b-84de-4665-9e17-a3c0fd4495d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.421713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ae98b-84de-4665-9e17-a3c0fd4495d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.422675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ae98b-84de-4665-9e17-a3c0fd4495d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.424602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ae98b-84de-4665-9e17-a3c0fd4495d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.439126 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2995/5963] 10.222.0.70 () {58 vars in 1128 bytes} [Sun Aug 28 19:17:08 2022] GET /identity/v3/regions => generated 668 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:08.440104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ae98b-84de-4665-9e17-a3c0fd4495d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.453844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ae98b-84de-4665-9e17-a3c0fd4495d8 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.455708 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2969/5964] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:08.465997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ccbb5-fc17-4db2-bfb0-ef4d6ee2cc72 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.466772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ccbb5-fc17-4db2-bfb0-ef4d6ee2cc72 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.467173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ccbb5-fc17-4db2-bfb0-ef4d6ee2cc72 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.467559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ccbb5-fc17-4db2-bfb0-ef4d6ee2cc72 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.468312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ccbb5-fc17-4db2-bfb0-ef4d6ee2cc72 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.468733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd852d-9b57-4aac-b16d-0bfe9e43c4cc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.470287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ccbb5-fc17-4db2-bfb0-ef4d6ee2cc72 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.471756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cbbd852d-9b57-4aac-b16d-0bfe9e43c4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:08.484355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:08.503086 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2996/5965] 10.222.0.70 () {60 vars in 1150 bytes} [Sun Aug 28 19:17:08 2022] POST /identity/v3/regions => generated 253 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:08.506004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ccbb5-fc17-4db2-bfb0-ef4d6ee2cc72 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.536476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ccbb5-fc17-4db2-bfb0-ef4d6ee2cc72 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.568807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e186b77-c4e2-4065-b617-6dc20b6d9bbb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.569473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e186b77-c4e2-4065-b617-6dc20b6d9bbb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.569765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e186b77-c4e2-4065-b617-6dc20b6d9bbb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.570097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e186b77-c4e2-4065-b617-6dc20b6d9bbb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.570827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e186b77-c4e2-4065-b617-6dc20b6d9bbb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Adding query filter params (parent_region_id=7db26cd02df44ffc92130d3303ae9311) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:08.571150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e186b77-c4e2-4065-b617-6dc20b6d9bbb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.572439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e186b77-c4e2-4065-b617-6dc20b6d9bbb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.576076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd852d-9b57-4aac-b16d-0bfe9e43c4cc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.590212 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2997/5966] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:17:08 2022] GET /identity/v3/regions?parent_region_id=7db26cd02df44ffc92130d3303ae9311 => generated 399 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:08.591587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e186b77-c4e2-4065-b617-6dc20b6d9bbb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.602670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05495d7a-3185-4763-9693-af26d05d59d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.603430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05495d7a-3185-4763-9693-af26d05d59d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.603822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05495d7a-3185-4763-9693-af26d05d59d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.604208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05495d7a-3185-4763-9693-af26d05d59d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.604429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e186b77-c4e2-4065-b617-6dc20b6d9bbb tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.610043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a1084-d80c-4498-9157-528ff162e697 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.610704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a1084-d80c-4498-9157-528ff162e697 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.611147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a1084-d80c-4498-9157-528ff162e697 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.611434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a1084-d80c-4498-9157-528ff162e697 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions/6d1a4f09916c4949945b35b13c6acc75` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.612369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a1084-d80c-4498-9157-528ff162e697 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:delete_region(region_id=6d1a4f09916c4949945b35b13c6acc75)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.614513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a1084-d80c-4498-9157-528ff162e697 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.657193 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2998/5967] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:17:08 2022] DELETE /identity/v3/regions/6d1a4f09916c4949945b35b13c6acc75 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:08.662543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a1084-d80c-4498-9157-528ff162e697 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.693700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a1084-d80c-4498-9157-528ff162e697 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.712565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05495d7a-3185-4763-9693-af26d05d59d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.714070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05495d7a-3185-4763-9693-af26d05d59d4 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.718180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaf8df-15ca-4f53-a678-7113da286de3 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.718946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf8df-15ca-4f53-a678-7113da286de3 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.719310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf8df-15ca-4f53-a678-7113da286de3 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.719658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf8df-15ca-4f53-a678-7113da286de3 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions/fb3cae30a05a424e8a1db58ec31d4656` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.720318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcaf8df-15ca-4f53-a678-7113da286de3 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:delete_region(region_id=fb3cae30a05a424e8a1db58ec31d4656)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.722009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcaf8df-15ca-4f53-a678-7113da286de3 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.737502 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2970/5968] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:08.750823 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 2999/5969] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:17:08 2022] DELETE /identity/v3/regions/fb3cae30a05a424e8a1db58ec31d4656 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:08.754710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05495d7a-3185-4763-9693-af26d05d59d4 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.776718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05495d7a-3185-4763-9693-af26d05d59d4 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.800039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d7467-4419-4d78-91aa-192f2c0d3fcc tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a064a195cab460eb5bbc555e7e01bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13e308368e694ba0a6860a9e995a72b0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.800955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d7467-4419-4d78-91aa-192f2c0d3fcc tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.801904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d7467-4419-4d78-91aa-192f2c0d3fcc tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.802259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d7467-4419-4d78-91aa-192f2c0d3fcc tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] PATH_INFO: `/v3/regions/7db26cd02df44ffc92130d3303ae9311` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.803035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d7467-4419-4d78-91aa-192f2c0d3fcc tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7db26cd02df44ffc92130d3303ae9311)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.805069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d7467-4419-4d78-91aa-192f2c0d3fcc tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:08.830400 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2971/5970] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:17:08 2022] DELETE /identity/v3/regions/7db26cd02df44ffc92130d3303ae9311 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:08.835306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaf8df-15ca-4f53-a678-7113da286de3 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:08.959349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaf8df-15ca-4f53-a678-7113da286de3 tempest-RegionsTestJSON-613732040 tempest-RegionsTestJSON-613732040-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:08.983248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:08.989101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:08.990220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:08.990608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:08.991124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] PATH_INFO: `/v3/users/69a403111b1a41fa92593f021a623838` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:08.994969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a403111b1a41fa92593f021a623838)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:08.999079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:09.073674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a403111b1a41fa92593f021a623838'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:09.082866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a403111b1a41fa92593f021a623838'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:09.083645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a403111b1a41fa92593f021a623838'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:09.092419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a403111b1a41fa92593f021a623838'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:09.093249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a403111b1a41fa92593f021a623838'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:09.115248 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3000/5971] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:08 2022] DELETE /identity/v3/users/69a403111b1a41fa92593f021a623838 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:09.119936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66211931-e60f-4cbe-a94c-61a35f0a5352 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:09.120256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66211931-e60f-4cbe-a94c-61a35f0a5352 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:09.120560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66211931-e60f-4cbe-a94c-61a35f0a5352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:09.172836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-66211931-e60f-4cbe-a94c-61a35f0a5352 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:09.175611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-66211931-e60f-4cbe-a94c-61a35f0a5352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:09.303301 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2972/5972] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:09.314255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:09.317282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:09.412410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800c2a5-3979-4746-b2f4-6de8312b973a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:09.416416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bc562-800a-4965-9352-7cee8017a191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:09.417245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bc562-800a-4965-9352-7cee8017a191 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:09.417593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bc562-800a-4965-9352-7cee8017a191 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:09.418068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bc562-800a-4965-9352-7cee8017a191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:09.429244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bc562-800a-4965-9352-7cee8017a191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:09.430926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bc562-800a-4965-9352-7cee8017a191 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:09.444217 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3001/5973] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:17:10.443449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66211931-e60f-4cbe-a94c-61a35f0a5352 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:10.445020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-66211931-e60f-4cbe-a94c-61a35f0a5352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:10.458051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66211931-e60f-4cbe-a94c-61a35f0a5352 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:10.463073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:10.463801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:10.464157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:10.464510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] PATH_INFO: `/v3/projects/93bbd0411f8948cf81778421db0052e4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:10.465910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93bbd0411f8948cf81778421db0052e4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:10.467993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:10.469776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:10.524176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93bbd0411f8948cf81778421db0052e4', 'request_id': 'req-2913cb29-20dc-445f-ba7d-c9b136d47ba1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:10.536046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93bbd0411f8948cf81778421db0052e4', 'request_id': 'req-2913cb29-20dc-445f-ba7d-c9b136d47ba1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:10.544556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93bbd0411f8948cf81778421db0052e4', 'request_id': 'req-2913cb29-20dc-445f-ba7d-c9b136d47ba1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:10.560042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] The token cache is being invalidate because project 93bbd0411f8948cf81778421db0052e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:10.561443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:10.562393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:10.565419 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2973/5974] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:10 2022] DELETE /identity/v3/projects/93bbd0411f8948cf81778421db0052e4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:10.569260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bc562-800a-4965-9352-7cee8017a191 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:10.584060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bc562-800a-4965-9352-7cee8017a191 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:10.649864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa7f88-8311-491e-9f3c-2a646c1f7dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:10.650517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa7f88-8311-491e-9f3c-2a646c1f7dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:10.651894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa7f88-8311-491e-9f3c-2a646c1f7dad admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:10.652201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa7f88-8311-491e-9f3c-2a646c1f7dad admin admin] PATH_INFO: `/v3/users/0a064a195cab460eb5bbc555e7e01bc4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:10.653496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa7f88-8311-491e-9f3c-2a646c1f7dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a064a195cab460eb5bbc555e7e01bc4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:10.655695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa7f88-8311-491e-9f3c-2a646c1f7dad admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:10.672526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:10.712679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19aa7f88-8311-491e-9f3c-2a646c1f7dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a064a195cab460eb5bbc555e7e01bc4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:10.720677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19aa7f88-8311-491e-9f3c-2a646c1f7dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a064a195cab460eb5bbc555e7e01bc4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:10.721387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19aa7f88-8311-491e-9f3c-2a646c1f7dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a064a195cab460eb5bbc555e7e01bc4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:10.730113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19aa7f88-8311-491e-9f3c-2a646c1f7dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a064a195cab460eb5bbc555e7e01bc4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:10.730982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-19aa7f88-8311-491e-9f3c-2a646c1f7dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a064a195cab460eb5bbc555e7e01bc4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:10.750873 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3002/5975] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:10 2022] DELETE /identity/v3/users/0a064a195cab460eb5bbc555e7e01bc4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:11.051510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:11.053239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:11.072700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913cb29-20dc-445f-ba7d-c9b136d47ba1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:11.144980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7b78-5b70-4e23-ac76-05607d2edc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:11.145982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7b78-5b70-4e23-ac76-05607d2edc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:11.146268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7b78-5b70-4e23-ac76-05607d2edc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:11.146546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7b78-5b70-4e23-ac76-05607d2edc8d admin admin] PATH_INFO: `/v3/projects/13e308368e694ba0a6860a9e995a72b0` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:11.147770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b7b78-5b70-4e23-ac76-05607d2edc8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e308368e694ba0a6860a9e995a72b0)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:11.149733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b7b78-5b70-4e23-ac76-05607d2edc8d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:11.199055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df9b7b78-5b70-4e23-ac76-05607d2edc8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e308368e694ba0a6860a9e995a72b0', 'request_id': 'req-df9b7b78-5b70-4e23-ac76-05607d2edc8d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:11.207646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df9b7b78-5b70-4e23-ac76-05607d2edc8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e308368e694ba0a6860a9e995a72b0', 'request_id': 'req-df9b7b78-5b70-4e23-ac76-05607d2edc8d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:11.214038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df9b7b78-5b70-4e23-ac76-05607d2edc8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e308368e694ba0a6860a9e995a72b0', 'request_id': 'req-df9b7b78-5b70-4e23-ac76-05607d2edc8d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:11.227393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df9b7b78-5b70-4e23-ac76-05607d2edc8d admin admin] The token cache is being invalidate because project 13e308368e694ba0a6860a9e995a72b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:11.227618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df9b7b78-5b70-4e23-ac76-05607d2edc8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:11.228890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df9b7b78-5b70-4e23-ac76-05607d2edc8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:11.230422 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2974/5976] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:11 2022] DELETE /identity/v3/projects/13e308368e694ba0a6860a9e995a72b0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:11.236225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4281fdd-e434-44f0-90f9-098cec20bbb5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:11.236588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4281fdd-e434-44f0-90f9-098cec20bbb5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:11.236931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4281fdd-e434-44f0-90f9-098cec20bbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:11.260982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f4281fdd-e434-44f0-90f9-098cec20bbb5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:11.261769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f4281fdd-e434-44f0-90f9-098cec20bbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:11.329273 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3003/5977] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:11.337600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1454c3-3704-48db-8333-79a7a4505a33 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:11.337891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1454c3-3704-48db-8333-79a7a4505a33 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:11.338177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1454c3-3704-48db-8333-79a7a4505a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:11.357928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bc1454c3-3704-48db-8333-79a7a4505a33 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:11.359183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bc1454c3-3704-48db-8333-79a7a4505a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:11.368121 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2975/5978] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:11.372513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4281fdd-e434-44f0-90f9-098cec20bbb5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:11.383376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4281fdd-e434-44f0-90f9-098cec20bbb5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:11.388201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cad5f-0fce-46d9-837e-4ecafb442a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:11.388818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cad5f-0fce-46d9-837e-4ecafb442a48 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:11.389106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cad5f-0fce-46d9-837e-4ecafb442a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:11.389382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cad5f-0fce-46d9-837e-4ecafb442a48 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:11.390029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cad5f-0fce-46d9-837e-4ecafb442a48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:11.390341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cad5f-0fce-46d9-837e-4ecafb442a48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:11.392061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cad5f-0fce-46d9-837e-4ecafb442a48 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:11.405106 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3004/5979] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:11.409500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1454c3-3704-48db-8333-79a7a4505a33 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:11.419709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1454c3-3704-48db-8333-79a7a4505a33 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:11.424432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371ec64-34a9-4a73-b0f3-10016112d638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:11.425043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371ec64-34a9-4a73-b0f3-10016112d638 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:11.425917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371ec64-34a9-4a73-b0f3-10016112d638 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:11.426256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371ec64-34a9-4a73-b0f3-10016112d638 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:11.427256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371ec64-34a9-4a73-b0f3-10016112d638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:11.429203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371ec64-34a9-4a73-b0f3-10016112d638 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:11.442018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:11.462028 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2976/5980] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:11 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:11.466451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cad5f-0fce-46d9-837e-4ecafb442a48 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:11.478146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cad5f-0fce-46d9-837e-4ecafb442a48 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:11.549623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ed6f7-07e2-4e4f-b3bf-12f1d2536584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:11.550346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ed6f7-07e2-4e4f-b3bf-12f1d2536584 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:11.550696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ed6f7-07e2-4e4f-b3bf-12f1d2536584 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:11.551423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ed6f7-07e2-4e4f-b3bf-12f1d2536584 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:11.551670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ed6f7-07e2-4e4f-b3bf-12f1d2536584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:11.553625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ed6f7-07e2-4e4f-b3bf-12f1d2536584 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:11.590435 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3005/5981] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:11 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:11.592278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371ec64-34a9-4a73-b0f3-10016112d638 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:11.605303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371ec64-34a9-4a73-b0f3-10016112d638 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:11.611952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbffc9-4da9-40c6-aab7-d89885ea5647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:11.612521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbffc9-4da9-40c6-aab7-d89885ea5647 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:11.612988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbffc9-4da9-40c6-aab7-d89885ea5647 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:11.613275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbffc9-4da9-40c6-aab7-d89885ea5647 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:11.614080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbffc9-4da9-40c6-aab7-d89885ea5647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:11.615902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbffc9-4da9-40c6-aab7-d89885ea5647 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:11.627419 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2977/5982] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:11.633262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ed6f7-07e2-4e4f-b3bf-12f1d2536584 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:11.648715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ed6f7-07e2-4e4f-b3bf-12f1d2536584 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:11.648929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbffc9-4da9-40c6-aab7-d89885ea5647 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:11.650706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cddbffc9-4da9-40c6-aab7-d89885ea5647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:11.658260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3453343-5349-4c9b-8fcd-e45bbf8eedf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:11.662059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453343-5349-4c9b-8fcd-e45bbf8eedf1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:11.662366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453343-5349-4c9b-8fcd-e45bbf8eedf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:11.662655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453343-5349-4c9b-8fcd-e45bbf8eedf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:11.663587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3453343-5349-4c9b-8fcd-e45bbf8eedf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:11.666532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3453343-5349-4c9b-8fcd-e45bbf8eedf1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:11.668867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:11.686166 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3006/5983] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:11.690227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3453343-5349-4c9b-8fcd-e45bbf8eedf1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:11.709017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3453343-5349-4c9b-8fcd-e45bbf8eedf1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:11.717199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e203b-942a-4b12-82fb-392d846e811f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:11.718731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e203b-942a-4b12-82fb-392d846e811f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:11.719070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e203b-942a-4b12-82fb-392d846e811f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:11.719356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e203b-942a-4b12-82fb-392d846e811f admin admin] PATH_INFO: `/v3/projects/d976c82921904ec180fba9b3d66f4341/users/c284d109d6bc4e1fbdffb2034faa6d67/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:11.740883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e203b-942a-4b12-82fb-392d846e811f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d976c82921904ec180fba9b3d66f4341, user_id=c284d109d6bc4e1fbdffb2034faa6d67, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:11.743732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e203b-942a-4b12-82fb-392d846e811f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:11.752745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbffc9-4da9-40c6-aab7-d89885ea5647 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:11.766873 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3007/5984] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:11 2022] PUT /identity/v3/projects/d976c82921904ec180fba9b3d66f4341/users/c284d109d6bc4e1fbdffb2034faa6d67/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:11.766873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a66b9e-ffa6-476c-a35d-27b965bb5ac0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:11.766873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a66b9e-ffa6-476c-a35d-27b965bb5ac0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:11.766873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a66b9e-ffa6-476c-a35d-27b965bb5ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:11.821950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d0a66b9e-ffa6-476c-a35d-27b965bb5ac0 None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:11.823067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d0a66b9e-ffa6-476c-a35d-27b965bb5ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:11.826684 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3008/5985] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:11 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:17:11.827795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b121be-f230-408b-a794-ba2fc011fcce None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:11.828221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b121be-f230-408b-a794-ba2fc011fcce None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:11.830438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b121be-f230-408b-a794-ba2fc011fcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:11.843885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de04380-5644-4534-bc06-87a510212139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:11.844715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de04380-5644-4534-bc06-87a510212139 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:11.845050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de04380-5644-4534-bc06-87a510212139 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:11.845331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de04380-5644-4534-bc06-87a510212139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:11.847718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6de04380-5644-4534-bc06-87a510212139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:11.860512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de04380-5644-4534-bc06-87a510212139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:11.863212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de04380-5644-4534-bc06-87a510212139 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:11.869894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-11b121be-f230-408b-a794-ba2fc011fcce None None] MFA Rules not processed for user `c284d109d6bc4e1fbdffb2034faa6d67`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:11.871139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-11b121be-f230-408b-a794-ba2fc011fcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:11.877816 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2978/5986] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:11.879875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de04380-5644-4534-bc06-87a510212139 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:11.881423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6de04380-5644-4534-bc06-87a510212139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:11.993876 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3009/5987] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:11.997917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de04380-5644-4534-bc06-87a510212139 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:11.999739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b121be-f230-408b-a794-ba2fc011fcce None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:12.002945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4027d53-d483-457b-b447-e32f1a2f97e4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b890fb0f84c81b64801da1abe82c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f018a89a2a94e1f848e1b3073affa54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:12.004520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4027d53-d483-457b-b447-e32f1a2f97e4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:12.004973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4027d53-d483-457b-b447-e32f1a2f97e4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:12.005260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4027d53-d483-457b-b447-e32f1a2f97e4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] PATH_INFO: `/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:12.010517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b121be-f230-408b-a794-ba2fc011fcce None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:12.015243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7094d64-625e-4a82-81ca-ff110c805db4 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c284d109d6bc4e1fbdffb2034faa6d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd976c82921904ec180fba9b3d66f4341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:12.015877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7094d64-625e-4a82-81ca-ff110c805db4 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:12.016164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7094d64-625e-4a82-81ca-ff110c805db4 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:12.016754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7094d64-625e-4a82-81ca-ff110c805db4 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] PATH_INFO: `/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/application_credentials` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:12.017099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7094d64-625e-4a82-81ca-ff110c805db4 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorizing `identity:create_application_credential(user_id=c284d109d6bc4e1fbdffb2034faa6d67)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:12.018311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7094d64-625e-4a82-81ca-ff110c805db4 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:12.058501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c4027d53-d483-457b-b447-e32f1a2f97e4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:12.088244 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2979/5988] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:17:11 2022] POST /identity/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:12.138619 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3010/5989] 10.222.0.70 () {60 vars in 1315 bytes} [Sun Aug 28 19:17:11 2022] POST /identity/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/application_credentials => generated 921 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:12.139985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4027d53-d483-457b-b447-e32f1a2f97e4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:12.157719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4027d53-d483-457b-b447-e32f1a2f97e4 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:12.163075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc39b8e-064d-447d-a935-e85a1dfb98dd tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c284d109d6bc4e1fbdffb2034faa6d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd976c82921904ec180fba9b3d66f4341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:12.164043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc39b8e-064d-447d-a935-e85a1dfb98dd tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:12.164404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc39b8e-064d-447d-a935-e85a1dfb98dd tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:12.164755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc39b8e-064d-447d-a935-e85a1dfb98dd tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] PATH_INFO: `/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/access_rules/389d95fbfd1d4c108bae5b73f52c9a40` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:12.165991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc39b8e-064d-447d-a935-e85a1dfb98dd tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorizing `identity:delete_access_rule(user_id=c284d109d6bc4e1fbdffb2034faa6d67, access_rule_id=389d95fbfd1d4c108bae5b73f52c9a40)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:12.167622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc39b8e-064d-447d-a935-e85a1dfb98dd tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:12.169695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:12.195617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7094d64-625e-4a82-81ca-ff110c805db4 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:12.197927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d7094d64-625e-4a82-81ca-ff110c805db4 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:12.213954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7094d64-625e-4a82-81ca-ff110c805db4 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:12.218457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea953765-0704-41c5-8fc8-06a590986ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:12.219302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea953765-0704-41c5-8fc8-06a590986ddb service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:12.219745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea953765-0704-41c5-8fc8-06a590986ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:12.220223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea953765-0704-41c5-8fc8-06a590986ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:12.222171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ea953765-0704-41c5-8fc8-06a590986ddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-1bc39b8e-064d-447d-a935-e85a1dfb98dd tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application session.delete(ref) Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application next(self.gen) Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application yield resource Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application next(self.gen) Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 19:17:12.226018 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise self.value Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application session.commit() Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.session.flush() Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 19:17:12.227375 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application compat.raise_( Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._synchronize( Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise AssertionError( Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Aug 28 19:17:12.228579 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:12.229610 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:12.231426 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Aug 28 19:17:12.231426 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Aug 28 19:17:12.231426 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Aug 28 19:17:12.231426 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 28 19:17:12.231426 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 28 19:17:12.231426 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:17:12.232481 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2980/5990] 10.222.0.70 () {58 vars in 1362 bytes} [Sun Aug 28 19:17:12 2022] DELETE /identity/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/access_rules/389d95fbfd1d4c108bae5b73f52c9a40 => generated 89 bytes in 93 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:17:12.236750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc39b8e-064d-447d-a935-e85a1dfb98dd tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:12.250331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc39b8e-064d-447d-a935-e85a1dfb98dd tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:12.261680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:12.263680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839da77-13eb-4a04-b8fc-793c0eaf323f tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c284d109d6bc4e1fbdffb2034faa6d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd976c82921904ec180fba9b3d66f4341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:12.265425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839da77-13eb-4a04-b8fc-793c0eaf323f tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:12.265425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839da77-13eb-4a04-b8fc-793c0eaf323f tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:12.265746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839da77-13eb-4a04-b8fc-793c0eaf323f tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] PATH_INFO: `/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/application_credentials/16c3cd88a7314235b2207b0946492956` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:12.282311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839da77-13eb-4a04-b8fc-793c0eaf323f tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorizing `identity:delete_application_credential(user_id=c284d109d6bc4e1fbdffb2034faa6d67, application_credential_id=16c3cd88a7314235b2207b0946492956)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:12.284342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839da77-13eb-4a04-b8fc-793c0eaf323f tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:12.318841 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2981/5991] 10.222.0.70 () {58 vars in 1395 bytes} [Sun Aug 28 19:17:12 2022] DELETE /identity/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/application_credentials/16c3cd88a7314235b2207b0946492956 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:12.320471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839da77-13eb-4a04-b8fc-793c0eaf323f tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:12.338661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839da77-13eb-4a04-b8fc-793c0eaf323f tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:12.341039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea953765-0704-41c5-8fc8-06a590986ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:12.343669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816995a-b9bf-4e5f-8b5a-8d0546fd81c1 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c284d109d6bc4e1fbdffb2034faa6d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd976c82921904ec180fba9b3d66f4341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:12.343905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea953765-0704-41c5-8fc8-06a590986ddb service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:12.344326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816995a-b9bf-4e5f-8b5a-8d0546fd81c1 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:12.344915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816995a-b9bf-4e5f-8b5a-8d0546fd81c1 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:12.344915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816995a-b9bf-4e5f-8b5a-8d0546fd81c1 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] PATH_INFO: `/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/access_rules` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:12.346356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816995a-b9bf-4e5f-8b5a-8d0546fd81c1 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorizing `identity:list_access_rules(user_id=c284d109d6bc4e1fbdffb2034faa6d67)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:12.348638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816995a-b9bf-4e5f-8b5a-8d0546fd81c1 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:12.357996 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2982/5992] 10.222.0.70 () {58 vars in 1260 bytes} [Sun Aug 28 19:17:12 2022] GET /identity/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/access_rules => generated 369 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:12.359158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816995a-b9bf-4e5f-8b5a-8d0546fd81c1 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:12.369880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816995a-b9bf-4e5f-8b5a-8d0546fd81c1 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:12.374161 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3011/5993] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:17:12.376963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f677f1-930e-40ce-ad27-92420286493a tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c284d109d6bc4e1fbdffb2034faa6d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd976c82921904ec180fba9b3d66f4341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:12.378997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f677f1-930e-40ce-ad27-92420286493a tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:12.379294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f677f1-930e-40ce-ad27-92420286493a tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:12.380153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f677f1-930e-40ce-ad27-92420286493a tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] PATH_INFO: `/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/access_rules/389d95fbfd1d4c108bae5b73f52c9a40` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:12.381445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f677f1-930e-40ce-ad27-92420286493a tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorizing `identity:delete_access_rule(user_id=c284d109d6bc4e1fbdffb2034faa6d67, access_rule_id=389d95fbfd1d4c108bae5b73f52c9a40)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:12.383007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f677f1-930e-40ce-ad27-92420286493a tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:12.414887 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2983/5994] 10.222.0.70 () {58 vars in 1362 bytes} [Sun Aug 28 19:17:12 2022] DELETE /identity/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/access_rules/389d95fbfd1d4c108bae5b73f52c9a40 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:12.416091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea953765-0704-41c5-8fc8-06a590986ddb service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:12.433744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea953765-0704-41c5-8fc8-06a590986ddb service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:12.440538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bbe51-40fe-4f98-8976-22fda2d71154 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c284d109d6bc4e1fbdffb2034faa6d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd976c82921904ec180fba9b3d66f4341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:12.441485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bbe51-40fe-4f98-8976-22fda2d71154 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:12.441938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bbe51-40fe-4f98-8976-22fda2d71154 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:12.442377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bbe51-40fe-4f98-8976-22fda2d71154 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] PATH_INFO: `/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/access_rules` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:12.443873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bbe51-40fe-4f98-8976-22fda2d71154 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorizing `identity:list_access_rules(user_id=c284d109d6bc4e1fbdffb2034faa6d67)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:12.445611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bbe51-40fe-4f98-8976-22fda2d71154 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:12.462650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f677f1-930e-40ce-ad27-92420286493a tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:12.470131 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3012/5995] 10.222.0.70 () {58 vars in 1260 bytes} [Sun Aug 28 19:17:12 2022] GET /identity/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/access_rules => generated 158 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:17:12.478099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f677f1-930e-40ce-ad27-92420286493a tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:12.483392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd47cbd-66e4-4eec-b61c-871efb149b7c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c284d109d6bc4e1fbdffb2034faa6d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd976c82921904ec180fba9b3d66f4341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:12.484263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd47cbd-66e4-4eec-b61c-871efb149b7c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:12.484741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd47cbd-66e4-4eec-b61c-871efb149b7c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:12.485234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd47cbd-66e4-4eec-b61c-871efb149b7c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] PATH_INFO: `/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/application_credentials` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:12.486073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd47cbd-66e4-4eec-b61c-871efb149b7c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorizing `identity:create_application_credential(user_id=c284d109d6bc4e1fbdffb2034faa6d67)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:12.487424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd47cbd-66e4-4eec-b61c-871efb149b7c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:12.634705 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2984/5996] 10.222.0.70 () {60 vars in 1315 bytes} [Sun Aug 28 19:17:12 2022] POST /identity/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/application_credentials => generated 921 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:12.636151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bbe51-40fe-4f98-8976-22fda2d71154 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:12.650897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bbe51-40fe-4f98-8976-22fda2d71154 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:12.663058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ff636-8444-4a96-8ac3-9abd793d2853 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c284d109d6bc4e1fbdffb2034faa6d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd976c82921904ec180fba9b3d66f4341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:12.663899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ff636-8444-4a96-8ac3-9abd793d2853 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:12.664265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ff636-8444-4a96-8ac3-9abd793d2853 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:12.664760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ff636-8444-4a96-8ac3-9abd793d2853 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] PATH_INFO: `/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/access_rules` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:12.666042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ff636-8444-4a96-8ac3-9abd793d2853 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorizing `identity:list_access_rules(user_id=c284d109d6bc4e1fbdffb2034faa6d67)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:12.667787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ff636-8444-4a96-8ac3-9abd793d2853 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:12.683364 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3013/5997] 10.222.0.70 () {58 vars in 1260 bytes} [Sun Aug 28 19:17:12 2022] GET /identity/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/access_rules => generated 369 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:12.684851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd47cbd-66e4-4eec-b61c-871efb149b7c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:12.696858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd47cbd-66e4-4eec-b61c-871efb149b7c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:12.701182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542e79c-deb8-455f-b164-76ae1f93d53c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c284d109d6bc4e1fbdffb2034faa6d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd976c82921904ec180fba9b3d66f4341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:12.701919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542e79c-deb8-455f-b164-76ae1f93d53c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:12.702112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542e79c-deb8-455f-b164-76ae1f93d53c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:12.702393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542e79c-deb8-455f-b164-76ae1f93d53c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] PATH_INFO: `/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/application_credentials` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:12.703357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542e79c-deb8-455f-b164-76ae1f93d53c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorizing `identity:create_application_credential(user_id=c284d109d6bc4e1fbdffb2034faa6d67)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:12.705494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542e79c-deb8-455f-b164-76ae1f93d53c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:12.860773 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2985/5998] 10.222.0.70 () {60 vars in 1315 bytes} [Sun Aug 28 19:17:12 2022] POST /identity/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/application_credentials => generated 920 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:12.861845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ff636-8444-4a96-8ac3-9abd793d2853 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:12.881564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ff636-8444-4a96-8ac3-9abd793d2853 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:12.891265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c58aa-4f46-4d78-ad1a-7d41765c70e6 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c284d109d6bc4e1fbdffb2034faa6d67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd976c82921904ec180fba9b3d66f4341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:12.892585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c58aa-4f46-4d78-ad1a-7d41765c70e6 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:12.893294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c58aa-4f46-4d78-ad1a-7d41765c70e6 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:12.893794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c58aa-4f46-4d78-ad1a-7d41765c70e6 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] PATH_INFO: `/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/access_rules/d0f65df02e3d4f909d612b7445dedbd1` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:12.896717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c58aa-4f46-4d78-ad1a-7d41765c70e6 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorizing `identity:get_access_rule(user_id=c284d109d6bc4e1fbdffb2034faa6d67, access_rule_id=d0f65df02e3d4f909d612b7445dedbd1)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:12.898527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c58aa-4f46-4d78-ad1a-7d41765c70e6 tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:12.908606 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3014/5999] 10.222.0.70 () {58 vars in 1359 bytes} [Sun Aug 28 19:17:12 2022] GET /identity/v3/users/c284d109d6bc4e1fbdffb2034faa6d67/access_rules/d0f65df02e3d4f909d612b7445dedbd1 => generated 229 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:12.916711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542e79c-deb8-455f-b164-76ae1f93d53c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:12.928835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=4,keystone:INSERT=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:13.077492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542e79c-deb8-455f-b164-76ae1f93d53c tempest-AccessRulesV3Test-827995334 tempest-AccessRulesV3Test-827995334-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:13.088277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b0e64-0db2-424f-96bd-1283556ae947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:13.089140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b0e64-0db2-424f-96bd-1283556ae947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:13.089486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b0e64-0db2-424f-96bd-1283556ae947 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:13.089772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b0e64-0db2-424f-96bd-1283556ae947 admin admin] PATH_INFO: `/v3/users/c284d109d6bc4e1fbdffb2034faa6d67` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:13.093055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b0e64-0db2-424f-96bd-1283556ae947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c284d109d6bc4e1fbdffb2034faa6d67)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:13.096252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fe39a-cd78-44a7-8ed6-30f4956a9f69 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:13.098525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fe39a-cd78-44a7-8ed6-30f4956a9f69 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:13.098525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fe39a-cd78-44a7-8ed6-30f4956a9f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:13.099220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b0e64-0db2-424f-96bd-1283556ae947 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:13.130967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d37fe39a-cd78-44a7-8ed6-30f4956a9f69 None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:13.133572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d37fe39a-cd78-44a7-8ed6-30f4956a9f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:13.139253 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3015/6000] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:13 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:17:13.145836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338348cd-30ae-4ae2-aab4-a1a50755fcf4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:13.146268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338348cd-30ae-4ae2-aab4-a1a50755fcf4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:13.147532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338348cd-30ae-4ae2-aab4-a1a50755fcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:13.197798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-941b0e64-0db2-424f-96bd-1283556ae947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c284d109d6bc4e1fbdffb2034faa6d67'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:13.208166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-941b0e64-0db2-424f-96bd-1283556ae947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c284d109d6bc4e1fbdffb2034faa6d67'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:13.209169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-941b0e64-0db2-424f-96bd-1283556ae947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c284d109d6bc4e1fbdffb2034faa6d67'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-338348cd-30ae-4ae2-aab4-a1a50755fcf4 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 28 19:17:13.214759 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:13.216219 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:13.217418 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 28 19:17:13.217418 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 28 19:17:13.217418 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:13.217418 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:13.217418 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 28 19:17:13.217418 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 28 19:17:13.217418 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:13.217418 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:13.217418 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 28 19:17:13.217418 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 28 19:17:13.217418 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 28 19:17:13.217418 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:17:13.220730 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3016/6001] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:13 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 19:17:13.227778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567444ff-ecb9-443e-977e-009791308a73 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:13.230147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567444ff-ecb9-443e-977e-009791308a73 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:13.230687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567444ff-ecb9-443e-977e-009791308a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:13.340040 n-d-854118-7 devstack@keystone.service[88375]: WARNING keystone.server.flask.application [None req-567444ff-ecb9-443e-977e-009791308a73 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.70: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 28 19:17:13.341466 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3017/6002] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:13 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 120 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 28 19:17:13.348868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb815e1f-446a-4e34-9940-65364373fa8b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:13.349109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb815e1f-446a-4e34-9940-65364373fa8b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:13.349387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb815e1f-446a-4e34-9940-65364373fa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:13.361551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-941b0e64-0db2-424f-96bd-1283556ae947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c284d109d6bc4e1fbdffb2034faa6d67'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:13.362399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-941b0e64-0db2-424f-96bd-1283556ae947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c284d109d6bc4e1fbdffb2034faa6d67'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:13.386008 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2986/6003] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:12 2022] DELETE /identity/v3/users/c284d109d6bc4e1fbdffb2034faa6d67 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:13.390803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661db4a-0233-4832-84f3-8b58a246bf0c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:13.391208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661db4a-0233-4832-84f3-8b58a246bf0c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:13.391597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661db4a-0233-4832-84f3-8b58a246bf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:13.411621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fb815e1f-446a-4e34-9940-65364373fa8b None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:13.414063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fb815e1f-446a-4e34-9940-65364373fa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:13.416847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a661db4a-0233-4832-84f3-8b58a246bf0c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:13.417440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a661db4a-0233-4832-84f3-8b58a246bf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:13.486327 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3018/6004] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:13.491381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb815e1f-446a-4e34-9940-65364373fa8b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:13.495528 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2987/6005] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:13.501978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661db4a-0233-4832-84f3-8b58a246bf0c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:13.505045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a661db4a-0233-4832-84f3-8b58a246bf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:13.510163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb815e1f-446a-4e34-9940-65364373fa8b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:13.511300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:13.515764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5e107-fc55-4fac-9737-956c675b4297 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b890fb0f84c81b64801da1abe82c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f018a89a2a94e1f848e1b3073affa54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:13.516907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5e107-fc55-4fac-9737-956c675b4297 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:13.517195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5e107-fc55-4fac-9737-956c675b4297 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:13.517475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5e107-fc55-4fac-9737-956c675b4297 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] PATH_INFO: `/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:13.586795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-54c5e107-fc55-4fac-9737-956c675b4297 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:13.599555 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3019/6006] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:17:13 2022] POST /identity/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:13.614423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661db4a-0233-4832-84f3-8b58a246bf0c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:13.619262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abdc3b-2abc-4924-98c3-b458e1ebe36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:13.620011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abdc3b-2abc-4924-98c3-b458e1ebe36c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:13.620378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abdc3b-2abc-4924-98c3-b458e1ebe36c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:13.620733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abdc3b-2abc-4924-98c3-b458e1ebe36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:13.632503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abdc3b-2abc-4924-98c3-b458e1ebe36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:13.634300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abdc3b-2abc-4924-98c3-b458e1ebe36c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:13.647480 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2988/6007] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:17:13.974929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5e107-fc55-4fac-9737-956c675b4297 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:13.976746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-54c5e107-fc55-4fac-9737-956c675b4297 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:14.025517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5e107-fc55-4fac-9737-956c675b4297 tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:14.031335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfd2b6-7e36-4188-85bf-554179c21378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:14.032412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfd2b6-7e36-4188-85bf-554179c21378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:14.032770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfd2b6-7e36-4188-85bf-554179c21378 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:14.033137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfd2b6-7e36-4188-85bf-554179c21378 admin admin] PATH_INFO: `/v3/projects/d976c82921904ec180fba9b3d66f4341` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:14.035074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfd2b6-7e36-4188-85bf-554179c21378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d976c82921904ec180fba9b3d66f4341)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:14.037224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfd2b6-7e36-4188-85bf-554179c21378 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:14.048691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:UPDATE=3,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:14.125800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a8cfd2b6-7e36-4188-85bf-554179c21378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd976c82921904ec180fba9b3d66f4341', 'request_id': 'req-a8cfd2b6-7e36-4188-85bf-554179c21378'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:14.138316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a8cfd2b6-7e36-4188-85bf-554179c21378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd976c82921904ec180fba9b3d66f4341', 'request_id': 'req-a8cfd2b6-7e36-4188-85bf-554179c21378'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:14.146404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a8cfd2b6-7e36-4188-85bf-554179c21378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd976c82921904ec180fba9b3d66f4341', 'request_id': 'req-a8cfd2b6-7e36-4188-85bf-554179c21378'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:14.166568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a8cfd2b6-7e36-4188-85bf-554179c21378 admin admin] The token cache is being invalidate because project d976c82921904ec180fba9b3d66f4341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:14.166996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a8cfd2b6-7e36-4188-85bf-554179c21378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:14.168589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a8cfd2b6-7e36-4188-85bf-554179c21378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:14.169629 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3020/6008] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:13 2022] DELETE /identity/v3/projects/d976c82921904ec180fba9b3d66f4341 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:14.175828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ca197-a1b6-463d-a7d4-88421db3327b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:14.178062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ca197-a1b6-463d-a7d4-88421db3327b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:14.179093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ca197-a1b6-463d-a7d4-88421db3327b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:14.229876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-953ca197-a1b6-463d-a7d4-88421db3327b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:14.231232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-953ca197-a1b6-463d-a7d4-88421db3327b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:14.342949 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2989/6009] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:14.344642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17653e1-f3bf-4014-89c3-20838758e19a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:14.345037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17653e1-f3bf-4014-89c3-20838758e19a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:14.345203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17653e1-f3bf-4014-89c3-20838758e19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:14.425720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b17653e1-f3bf-4014-89c3-20838758e19a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:14.427612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b17653e1-f3bf-4014-89c3-20838758e19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:14.455961 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3021/6010] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:14.461063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ca197-a1b6-463d-a7d4-88421db3327b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:14.472978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ca197-a1b6-463d-a7d4-88421db3327b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:14.483929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2797ec-4f7f-4bd2-a70e-131274a2a29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:14.484871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2797ec-4f7f-4bd2-a70e-131274a2a29e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:14.485344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2797ec-4f7f-4bd2-a70e-131274a2a29e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:14.485786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2797ec-4f7f-4bd2-a70e-131274a2a29e admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:14.486615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2797ec-4f7f-4bd2-a70e-131274a2a29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:14.487120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2797ec-4f7f-4bd2-a70e-131274a2a29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:14.489960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2797ec-4f7f-4bd2-a70e-131274a2a29e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:14.506171 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2990/6011] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:14.511712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17653e1-f3bf-4014-89c3-20838758e19a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:14.523988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17653e1-f3bf-4014-89c3-20838758e19a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:14.529581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557049cc-6866-45c9-bba0-f646fb332eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:14.530976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557049cc-6866-45c9-bba0-f646fb332eee admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:14.532992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557049cc-6866-45c9-bba0-f646fb332eee admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:14.533483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557049cc-6866-45c9-bba0-f646fb332eee admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:14.534347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557049cc-6866-45c9-bba0-f646fb332eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:14.537337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557049cc-6866-45c9-bba0-f646fb332eee admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:14.596144 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3022/6012] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:14 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:14.597865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2797ec-4f7f-4bd2-a70e-131274a2a29e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:14.608032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f019975-8a18-4ae6-adcc-fc460bf36468 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:14.612360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2797ec-4f7f-4bd2-a70e-131274a2a29e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:14.613619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f019975-8a18-4ae6-adcc-fc460bf36468 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:14.614194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f019975-8a18-4ae6-adcc-fc460bf36468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:14.650650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1f019975-8a18-4ae6-adcc-fc460bf36468 None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:14.651930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1f019975-8a18-4ae6-adcc-fc460bf36468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:14.658817 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3023/6013] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:14 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:17:14.660842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfd2f6-cceb-4965-b8ca-6167432a27b3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:14.661139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfd2f6-cceb-4965-b8ca-6167432a27b3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:14.661426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfd2f6-cceb-4965-b8ca-6167432a27b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:14.698205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-68bfd2f6-cceb-4965-b8ca-6167432a27b3 None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:14.699482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-68bfd2f6-cceb-4965-b8ca-6167432a27b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:14.745307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe340a5-a08c-4d21-b810-0a025429bbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:14.746051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe340a5-a08c-4d21-b810-0a025429bbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:14.746436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe340a5-a08c-4d21-b810-0a025429bbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:14.747584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe340a5-a08c-4d21-b810-0a025429bbf0 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:14.747878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe340a5-a08c-4d21-b810-0a025429bbf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:14.750868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe340a5-a08c-4d21-b810-0a025429bbf0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:14.799538 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2991/6014] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:14 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:14.802479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe340a5-a08c-4d21-b810-0a025429bbf0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:14.815475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe340a5-a08c-4d21-b810-0a025429bbf0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:14.823600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d01db3-4e70-47e2-ae78-816bbad6462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:14.824518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d01db3-4e70-47e2-ae78-816bbad6462f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:14.825024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d01db3-4e70-47e2-ae78-816bbad6462f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:14.826123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d01db3-4e70-47e2-ae78-816bbad6462f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:14.827196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d01db3-4e70-47e2-ae78-816bbad6462f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:14.829268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d01db3-4e70-47e2-ae78-816bbad6462f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:14.845201 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3024/6015] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:14.846477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfd2f6-cceb-4965-b8ca-6167432a27b3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:14.857195 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2992/6016] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:17:14.861639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d01db3-4e70-47e2-ae78-816bbad6462f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:14.863702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfd2f6-cceb-4965-b8ca-6167432a27b3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:14.868840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef594d-5612-4497-8c34-e5180674149e tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b890fb0f84c81b64801da1abe82c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f018a89a2a94e1f848e1b3073affa54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:14.869645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef594d-5612-4497-8c34-e5180674149e tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:14.870058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef594d-5612-4497-8c34-e5180674149e tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:14.870430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef594d-5612-4497-8c34-e5180674149e tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] PATH_INFO: `/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:14.877038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d01db3-4e70-47e2-ae78-816bbad6462f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:14.890603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a30cd-3346-48f2-8877-f3c3304aac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:14.891832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a30cd-3346-48f2-8877-f3c3304aac0b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:14.891832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a30cd-3346-48f2-8877-f3c3304aac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:14.891832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a30cd-3346-48f2-8877-f3c3304aac0b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:14.893211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a30cd-3346-48f2-8877-f3c3304aac0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:14.896207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a30cd-3346-48f2-8877-f3c3304aac0b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:14.903359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:14.915216 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2993/6017] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:14.927194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a30cd-3346-48f2-8877-f3c3304aac0b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:14.944956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a30cd-3346-48f2-8877-f3c3304aac0b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:14.955370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32f965-7051-4009-aca1-81f8e33c07bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:14.960477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32f965-7051-4009-aca1-81f8e33c07bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:14.961239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32f965-7051-4009-aca1-81f8e33c07bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:14.961523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32f965-7051-4009-aca1-81f8e33c07bf admin admin] PATH_INFO: `/v3/projects/e1981b3fbb714effbd5b30914c02c000/users/651bceed3e924a8e9a41af91bf3fa5b6/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:14.983998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9fef594d-5612-4497-8c34-e5180674149e tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:15.000207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32f965-7051-4009-aca1-81f8e33c07bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1981b3fbb714effbd5b30914c02c000, user_id=651bceed3e924a8e9a41af91bf3fa5b6, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:15.003327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32f965-7051-4009-aca1-81f8e33c07bf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:15.009760 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3025/6018] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:17:14 2022] POST /identity/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:15.038440 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2994/6019] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:14 2022] PUT /identity/v3/projects/e1981b3fbb714effbd5b30914c02c000/users/651bceed3e924a8e9a41af91bf3fa5b6/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:15.049262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd87a0-351e-42dc-b69c-5993df9631ad None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:15.049555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd87a0-351e-42dc-b69c-5993df9631ad None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:15.049842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd87a0-351e-42dc-b69c-5993df9631ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:15.101063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6afd87a0-351e-42dc-b69c-5993df9631ad None None] MFA Rules not processed for user `651bceed3e924a8e9a41af91bf3fa5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:15.102591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6afd87a0-351e-42dc-b69c-5993df9631ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:15.130851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:15.239973 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3026/6020] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:15.241950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32f965-7051-4009-aca1-81f8e33c07bf admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:15.255674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32f965-7051-4009-aca1-81f8e33c07bf admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:15.264076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f4a36-b3fc-43c2-b179-d6656e16eb8f tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '651bceed3e924a8e9a41af91bf3fa5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1981b3fbb714effbd5b30914c02c000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:15.264707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f4a36-b3fc-43c2-b179-d6656e16eb8f tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:15.265003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f4a36-b3fc-43c2-b179-d6656e16eb8f tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:15.265282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f4a36-b3fc-43c2-b179-d6656e16eb8f tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] PATH_INFO: `/v3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:15.266652 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2995/6021] 10.222.0.70 () {58 vars in 1104 bytes} [Sun Aug 28 19:17:15 2022] GET /identity/v3 => generated 255 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:15.272845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd87a0-351e-42dc-b69c-5993df9631ad None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:15.281983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd87a0-351e-42dc-b69c-5993df9631ad None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:15.286716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f13ed1-c394-45d6-892b-58698232c1c8 tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '651bceed3e924a8e9a41af91bf3fa5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1981b3fbb714effbd5b30914c02c000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:15.287387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f13ed1-c394-45d6-892b-58698232c1c8 tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:15.287676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f13ed1-c394-45d6-892b-58698232c1c8 tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:15.287953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f13ed1-c394-45d6-892b-58698232c1c8 tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] PATH_INFO: `/v3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:15.289674 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3027/6022] 10.222.0.70 () {58 vars in 1104 bytes} [Sun Aug 28 19:17:15 2022] GET /identity/v3 => generated 255 bytes in 17 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:15.294641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f4a36-b3fc-43c2-b179-d6656e16eb8f tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:15.310020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f4a36-b3fc-43c2-b179-d6656e16eb8f tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:15.314786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ccc21-2929-46d4-986f-cc455dd7392b tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '651bceed3e924a8e9a41af91bf3fa5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1981b3fbb714effbd5b30914c02c000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:15.315398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ccc21-2929-46d4-986f-cc455dd7392b tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:15.316219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ccc21-2929-46d4-986f-cc455dd7392b tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:15.316499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ccc21-2929-46d4-986f-cc455dd7392b tempest-TestApiDiscovery-622369037 tempest-TestApiDiscovery-622369037-project] PATH_INFO: `/v3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:15.318467 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2996/6023] 10.222.0.70 () {58 vars in 1104 bytes} [Sun Aug 28 19:17:15 2022] GET /identity/v3 => generated 255 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:15.324098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc8125-b398-475c-bab0-afe37b2ed993 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:15.324384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc8125-b398-475c-bab0-afe37b2ed993 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:15.324661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc8125-b398-475c-bab0-afe37b2ed993 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:15.326175 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3028/6024] 10.222.0.70 () {56 vars in 895 bytes} [Sun Aug 28 19:17:15 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:17:15.332283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc241ad2-f4a2-47d3-a92c-9bf6e3973d8e None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:15.332878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc241ad2-f4a2-47d3-a92c-9bf6e3973d8e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:15.333315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc241ad2-f4a2-47d3-a92c-9bf6e3973d8e None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:15.335007 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2997/6025] 10.222.0.70 () {56 vars in 895 bytes} [Sun Aug 28 19:17:15 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:17:15.339596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc8125-b398-475c-bab0-afe37b2ed993 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:15.416621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc8125-b398-475c-bab0-afe37b2ed993 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:15.421838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:15.422492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:15.422801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:15.423083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] PATH_INFO: `/v3/users/651bceed3e924a8e9a41af91bf3fa5b6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:15.424338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=651bceed3e924a8e9a41af91bf3fa5b6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:15.427304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:15.483129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651bceed3e924a8e9a41af91bf3fa5b6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:15.491053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651bceed3e924a8e9a41af91bf3fa5b6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:15.491775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651bceed3e924a8e9a41af91bf3fa5b6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:15.499507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651bceed3e924a8e9a41af91bf3fa5b6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:15.500444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651bceed3e924a8e9a41af91bf3fa5b6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:15.521502 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3029/6026] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:15 2022] DELETE /identity/v3/users/651bceed3e924a8e9a41af91bf3fa5b6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:15.527503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ab371-ca92-4a1f-bdf6-5288d880ce41 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:15.528095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ab371-ca92-4a1f-bdf6-5288d880ce41 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:15.528095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ab371-ca92-4a1f-bdf6-5288d880ce41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:15.553422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-781ab371-ca92-4a1f-bdf6-5288d880ce41 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:15.554682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-781ab371-ca92-4a1f-bdf6-5288d880ce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:15.634308 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2998/6027] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:15.645097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:15.647839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:15.695663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:15.719348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8c136-e15b-46ac-addd-034ea75a4e8f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:15.723711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b10a06-e00c-40f7-baba-86fba06f15a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:15.724459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10a06-e00c-40f7-baba-86fba06f15a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:15.724884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10a06-e00c-40f7-baba-86fba06f15a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:15.725277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b10a06-e00c-40f7-baba-86fba06f15a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:15.736568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b10a06-e00c-40f7-baba-86fba06f15a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:15.738984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b10a06-e00c-40f7-baba-86fba06f15a8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:15.762885 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3030/6028] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:16.014884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e203c-f362-4cbd-a67e-56233728a2af None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:16.015479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e203c-f362-4cbd-a67e-56233728a2af None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:16.015998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e203c-f362-4cbd-a67e-56233728a2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:16.047269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-561e203c-f362-4cbd-a67e-56233728a2af None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:16.049711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-561e203c-f362-4cbd-a67e-56233728a2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:16.063896 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 2999/6029] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:16 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:17:16.067762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d91fc-3fc5-4376-9d0c-12dfb618f1ee None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:16.068277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d91fc-3fc5-4376-9d0c-12dfb618f1ee None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:16.068580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d91fc-3fc5-4376-9d0c-12dfb618f1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:16.114880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-695d91fc-3fc5-4376-9d0c-12dfb618f1ee None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:16.116153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-695d91fc-3fc5-4376-9d0c-12dfb618f1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:16.260558 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3031/6030] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:16.262049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e203c-f362-4cbd-a67e-56233728a2af None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:16.281442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e203c-f362-4cbd-a67e-56233728a2af None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:16.285183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d91fc-3fc5-4376-9d0c-12dfb618f1ee None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:16.287141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-695d91fc-3fc5-4376-9d0c-12dfb618f1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:16.296005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55439ca8-52c1-47b1-b9c7-e3957678ef6d tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd3b890fb0f84c81b64801da1abe82c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f018a89a2a94e1f848e1b3073affa54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:16.297065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55439ca8-52c1-47b1-b9c7-e3957678ef6d tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:16.297577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55439ca8-52c1-47b1-b9c7-e3957678ef6d tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:16.298083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55439ca8-52c1-47b1-b9c7-e3957678ef6d tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] PATH_INFO: `/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:16.323712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d91fc-3fc5-4376-9d0c-12dfb618f1ee None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:16.338725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65baa4-e640-4382-8564-8e8ad819b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:16.339450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65baa4-e640-4382-8564-8e8ad819b156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:16.339820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65baa4-e640-4382-8564-8e8ad819b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:16.340008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65baa4-e640-4382-8564-8e8ad819b156 admin admin] PATH_INFO: `/v3/projects/e1981b3fbb714effbd5b30914c02c000` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:16.343239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65baa4-e640-4382-8564-8e8ad819b156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1981b3fbb714effbd5b30914c02c000)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:16.344616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65baa4-e640-4382-8564-8e8ad819b156 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:16.394769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-55439ca8-52c1-47b1-b9c7-e3957678ef6d tempest-IdentityV3UsersTest-231353031 tempest-IdentityV3UsersTest-231353031-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:16.411873 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3000/6031] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:17:16 2022] POST /identity/v3/users/dd3b890fb0f84c81b64801da1abe82c9/password => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:16.432137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0a65baa4-e640-4382-8564-8e8ad819b156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1981b3fbb714effbd5b30914c02c000', 'request_id': 'req-0a65baa4-e640-4382-8564-8e8ad819b156'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:16.441593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0a65baa4-e640-4382-8564-8e8ad819b156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1981b3fbb714effbd5b30914c02c000', 'request_id': 'req-0a65baa4-e640-4382-8564-8e8ad819b156'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:16.451127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0a65baa4-e640-4382-8564-8e8ad819b156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1981b3fbb714effbd5b30914c02c000', 'request_id': 'req-0a65baa4-e640-4382-8564-8e8ad819b156'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:16.492939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0a65baa4-e640-4382-8564-8e8ad819b156 admin admin] The token cache is being invalidate because project e1981b3fbb714effbd5b30914c02c000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:16.493505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0a65baa4-e640-4382-8564-8e8ad819b156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:16.494906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0a65baa4-e640-4382-8564-8e8ad819b156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:16.499047 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3032/6032] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:16 2022] DELETE /identity/v3/projects/e1981b3fbb714effbd5b30914c02c000 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:16.504542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6398c-f6ca-4c7b-9fea-e5f7977a135c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:16.505185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6398c-f6ca-4c7b-9fea-e5f7977a135c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:16.505526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6398c-f6ca-4c7b-9fea-e5f7977a135c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:16.559988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3ca6398c-f6ca-4c7b-9fea-e5f7977a135c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:16.564839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3ca6398c-f6ca-4c7b-9fea-e5f7977a135c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:16.763323 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3001/6033] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:16.771220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095912b-f643-4798-a64b-2debe7abe4f7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:16.771508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095912b-f643-4798-a64b-2debe7abe4f7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:16.772299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095912b-f643-4798-a64b-2debe7abe4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:16.816336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0095912b-f643-4798-a64b-2debe7abe4f7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:16.817843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0095912b-f643-4798-a64b-2debe7abe4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:16.827914 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3033/6034] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:16.832480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6398c-f6ca-4c7b-9fea-e5f7977a135c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:16.851279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6398c-f6ca-4c7b-9fea-e5f7977a135c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:16.859791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffe0e0-5b48-4bae-a67e-6f7f85f5ac02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:16.861478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffe0e0-5b48-4bae-a67e-6f7f85f5ac02 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:16.862567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffe0e0-5b48-4bae-a67e-6f7f85f5ac02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:16.864340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffe0e0-5b48-4bae-a67e-6f7f85f5ac02 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:16.865373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffe0e0-5b48-4bae-a67e-6f7f85f5ac02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:16.869522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffe0e0-5b48-4bae-a67e-6f7f85f5ac02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:16.872099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffe0e0-5b48-4bae-a67e-6f7f85f5ac02 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:16.890841 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3002/6035] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:16.895723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095912b-f643-4798-a64b-2debe7abe4f7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:16.906702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095912b-f643-4798-a64b-2debe7abe4f7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:16.914347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6544232-77ae-4b2c-9924-4a5f31e25e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:16.915343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6544232-77ae-4b2c-9924-4a5f31e25e4a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:16.915843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6544232-77ae-4b2c-9924-4a5f31e25e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:16.916329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6544232-77ae-4b2c-9924-4a5f31e25e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:16.917199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6544232-77ae-4b2c-9924-4a5f31e25e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:16.919491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6544232-77ae-4b2c-9924-4a5f31e25e4a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:17.009995 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3034/6036] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:16 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:17.013841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffe0e0-5b48-4bae-a67e-6f7f85f5ac02 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:17.041117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffe0e0-5b48-4bae-a67e-6f7f85f5ac02 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:17.058664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:17.183577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb4437-f938-441d-8b12-4955a0e983fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:17.184735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb4437-f938-441d-8b12-4955a0e983fc admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:17.185244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb4437-f938-441d-8b12-4955a0e983fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:17.185620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb4437-f938-441d-8b12-4955a0e983fc admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:17.186362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb4437-f938-441d-8b12-4955a0e983fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:17.188984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb4437-f938-441d-8b12-4955a0e983fc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:17.234527 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3003/6037] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:17 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:17.238908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6544232-77ae-4b2c-9924-4a5f31e25e4a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:17.254399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6544232-77ae-4b2c-9924-4a5f31e25e4a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:17.279625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59e0c0-08a3-45bf-aa49-2e9fa1d954bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:17.280307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59e0c0-08a3-45bf-aa49-2e9fa1d954bb admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:17.280598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59e0c0-08a3-45bf-aa49-2e9fa1d954bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:17.280880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59e0c0-08a3-45bf-aa49-2e9fa1d954bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:17.281535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59e0c0-08a3-45bf-aa49-2e9fa1d954bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:17.283478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59e0c0-08a3-45bf-aa49-2e9fa1d954bb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:17.299720 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3035/6038] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:17.308551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb4437-f938-441d-8b12-4955a0e983fc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:17.324061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb4437-f938-441d-8b12-4955a0e983fc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:17.343174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1f012-b9d7-4950-b04c-41e9fbd68a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:17.344396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1f012-b9d7-4950-b04c-41e9fbd68a91 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:17.344689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1f012-b9d7-4950-b04c-41e9fbd68a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:17.344970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1f012-b9d7-4950-b04c-41e9fbd68a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:17.345844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1f012-b9d7-4950-b04c-41e9fbd68a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:17.350801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1f012-b9d7-4950-b04c-41e9fbd68a91 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:17.385533 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3004/6039] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:17.392181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59e0c0-08a3-45bf-aa49-2e9fa1d954bb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:17.411860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59e0c0-08a3-45bf-aa49-2e9fa1d954bb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:17.417186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebacb9-7b1b-4d31-9253-4fb97d62bf7b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:17.417417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebacb9-7b1b-4d31-9253-4fb97d62bf7b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:17.417673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebacb9-7b1b-4d31-9253-4fb97d62bf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:17.425811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31141ecd-8339-446a-a6a4-ebc1ea079990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:17.426917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141ecd-8339-446a-a6a4-ebc1ea079990 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:17.427443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141ecd-8339-446a-a6a4-ebc1ea079990 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:17.427951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31141ecd-8339-446a-a6a4-ebc1ea079990 admin admin] PATH_INFO: `/v3/projects/12697009708f448bb8813ca381ff74bf/users/6d1fb396d78e4f04988d8276c24b7bed/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:17.457524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-35ebacb9-7b1b-4d31-9253-4fb97d62bf7b None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:17.458838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-35ebacb9-7b1b-4d31-9253-4fb97d62bf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:17.472496 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3005/6040] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:17 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:17:17.513129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31141ecd-8339-446a-a6a4-ebc1ea079990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12697009708f448bb8813ca381ff74bf, user_id=6d1fb396d78e4f04988d8276c24b7bed, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:17.515971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31141ecd-8339-446a-a6a4-ebc1ea079990 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:17.558711 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3036/6041] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:17 2022] PUT /identity/v3/projects/12697009708f448bb8813ca381ff74bf/users/6d1fb396d78e4f04988d8276c24b7bed/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:17.571464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f8730-3888-48e1-b2aa-de31352fd735 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:17.572032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f8730-3888-48e1-b2aa-de31352fd735 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:17.572139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f8730-3888-48e1-b2aa-de31352fd735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:17.652022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-843f8730-3888-48e1-b2aa-de31352fd735 None None] MFA Rules not processed for user `6d1fb396d78e4f04988d8276c24b7bed`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:17.653560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-843f8730-3888-48e1-b2aa-de31352fd735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:17.807180 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3006/6042] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:17.811857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31141ecd-8339-446a-a6a4-ebc1ea079990 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:17.817861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:17.830282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31141ecd-8339-446a-a6a4-ebc1ea079990 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:17.855471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5f9e5-b6e5-4525-9a12-83a58ae04c77 tempest-IdentityCatalogTest-1636196055 tempest-IdentityCatalogTest-1636196055-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1fb396d78e4f04988d8276c24b7bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12697009708f448bb8813ca381ff74bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:17.857779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5f9e5-b6e5-4525-9a12-83a58ae04c77 tempest-IdentityCatalogTest-1636196055 tempest-IdentityCatalogTest-1636196055-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:17.858289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5f9e5-b6e5-4525-9a12-83a58ae04c77 tempest-IdentityCatalogTest-1636196055 tempest-IdentityCatalogTest-1636196055-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:17.858977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5f9e5-b6e5-4525-9a12-83a58ae04c77 tempest-IdentityCatalogTest-1636196055 tempest-IdentityCatalogTest-1636196055-project] PATH_INFO: `/v3/auth/catalog` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:17.859792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5f9e5-b6e5-4525-9a12-83a58ae04c77 tempest-IdentityCatalogTest-1636196055 tempest-IdentityCatalogTest-1636196055-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:17.864517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5f9e5-b6e5-4525-9a12-83a58ae04c77 tempest-IdentityCatalogTest-1636196055 tempest-IdentityCatalogTest-1636196055-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:17.871665 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3037/6043] 10.222.0.70 () {58 vars in 1143 bytes} [Sun Aug 28 19:17:17 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:17.873000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f8730-3888-48e1-b2aa-de31352fd735 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:18.021908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f8730-3888-48e1-b2aa-de31352fd735 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:18.028894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:18.029737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:18.030127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:18.030504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] PATH_INFO: `/v3/users/6d1fb396d78e4f04988d8276c24b7bed` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:18.031973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1fb396d78e4f04988d8276c24b7bed)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:18.034457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:18.058664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:18.120545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1fb396d78e4f04988d8276c24b7bed'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:18.140007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1fb396d78e4f04988d8276c24b7bed'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:18.144128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1fb396d78e4f04988d8276c24b7bed'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:18.167849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1fb396d78e4f04988d8276c24b7bed'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:18.168613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1fb396d78e4f04988d8276c24b7bed'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:18.187101 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3007/6044] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:17 2022] DELETE /identity/v3/users/6d1fb396d78e4f04988d8276c24b7bed => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:18.192362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7c204-911c-4bc8-8eec-79b121ef1f69 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:18.193553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7c204-911c-4bc8-8eec-79b121ef1f69 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:18.193553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7c204-911c-4bc8-8eec-79b121ef1f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:18.221640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-37d7c204-911c-4bc8-8eec-79b121ef1f69 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:18.221640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-37d7c204-911c-4bc8-8eec-79b121ef1f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:18.326728 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3038/6045] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:18.337441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:18.340454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:18.434725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caea4d-5095-4193-a785-ddae40da740c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:18.440962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee9a1f-e019-4d89-9921-02ece4bf0ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:18.441904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee9a1f-e019-4d89-9921-02ece4bf0ffc service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:18.442324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee9a1f-e019-4d89-9921-02ece4bf0ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:18.442914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee9a1f-e019-4d89-9921-02ece4bf0ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:18.454195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee9a1f-e019-4d89-9921-02ece4bf0ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:18.455898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee9a1f-e019-4d89-9921-02ece4bf0ffc service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:18.476726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627f5f-5608-415d-b99f-3e9a504134f5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:18.477196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627f5f-5608-415d-b99f-3e9a504134f5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:18.477758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627f5f-5608-415d-b99f-3e9a504134f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:18.497855 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3008/6046] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:18.511608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d3627f5f-5608-415d-b99f-3e9a504134f5 None None] MFA Rules not processed for user `dd3b890fb0f84c81b64801da1abe82c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:18.513685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d3627f5f-5608-415d-b99f-3e9a504134f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:18.647032 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3039/6047] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:18.655756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee9a1f-e019-4d89-9921-02ece4bf0ffc service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:18.657980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9aee9a1f-e019-4d89-9921-02ece4bf0ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:18.690656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee9a1f-e019-4d89-9921-02ece4bf0ffc service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:18.711395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:18.714562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:18.715013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:18.715536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] PATH_INFO: `/v3/users/dd3b890fb0f84c81b64801da1abe82c9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:18.720320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3b890fb0f84c81b64801da1abe82c9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:18.726019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:18.856625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:18.871759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:18.872919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:18.929021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:18.931180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3b890fb0f84c81b64801da1abe82c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:18.961549 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3009/6048] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:18 2022] DELETE /identity/v3/users/dd3b890fb0f84c81b64801da1abe82c9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:18.969213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852dbe5-9e9a-472a-a609-3b09c295dccb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:18.969599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852dbe5-9e9a-472a-a609-3b09c295dccb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:18.969951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852dbe5-9e9a-472a-a609-3b09c295dccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:19.020974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5852dbe5-9e9a-472a-a609-3b09c295dccb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:19.024146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5852dbe5-9e9a-472a-a609-3b09c295dccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:19.184525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:19.187530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:19.218192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:19.324364 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3040/6049] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:19.363816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852dbe5-9e9a-472a-a609-3b09c295dccb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:19.366769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5852dbe5-9e9a-472a-a609-3b09c295dccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:19.392152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f9794-05f5-4270-ac7b-5d795e9a5c94 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:19.400125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008e4c8-d089-4f57-9138-eebbf6c610d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:19.401337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008e4c8-d089-4f57-9138-eebbf6c610d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:19.402061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008e4c8-d089-4f57-9138-eebbf6c610d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:19.402567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008e4c8-d089-4f57-9138-eebbf6c610d6 admin admin] PATH_INFO: `/v3/projects/12697009708f448bb8813ca381ff74bf` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:19.405210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008e4c8-d089-4f57-9138-eebbf6c610d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12697009708f448bb8813ca381ff74bf)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:19.408998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008e4c8-d089-4f57-9138-eebbf6c610d6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:19.467594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:19.488486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852dbe5-9e9a-472a-a609-3b09c295dccb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:19.545608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2008e4c8-d089-4f57-9138-eebbf6c610d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12697009708f448bb8813ca381ff74bf', 'request_id': 'req-2008e4c8-d089-4f57-9138-eebbf6c610d6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:19.578953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2008e4c8-d089-4f57-9138-eebbf6c610d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12697009708f448bb8813ca381ff74bf', 'request_id': 'req-2008e4c8-d089-4f57-9138-eebbf6c610d6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:19.605367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2008e4c8-d089-4f57-9138-eebbf6c610d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12697009708f448bb8813ca381ff74bf', 'request_id': 'req-2008e4c8-d089-4f57-9138-eebbf6c610d6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:19.644782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2008e4c8-d089-4f57-9138-eebbf6c610d6 admin admin] The token cache is being invalidate because project 12697009708f448bb8813ca381ff74bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:19.644782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2008e4c8-d089-4f57-9138-eebbf6c610d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:19.648333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c667dc3-6a9e-4b6d-8868-fdaa87982eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:19.648333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c667dc3-6a9e-4b6d-8868-fdaa87982eea service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:19.648333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c667dc3-6a9e-4b6d-8868-fdaa87982eea service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:19.648333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c667dc3-6a9e-4b6d-8868-fdaa87982eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:19.648729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2008e4c8-d089-4f57-9138-eebbf6c610d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:19.648729 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3010/6050] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:19 2022] DELETE /identity/v3/projects/12697009708f448bb8813ca381ff74bf => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:19.655783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03a4f0-e647-4773-91d7-c867d4e23d12 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:19.655783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03a4f0-e647-4773-91d7-c867d4e23d12 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:19.655783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03a4f0-e647-4773-91d7-c867d4e23d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:19.703328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cd03a4f0-e647-4773-91d7-c867d4e23d12 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:19.704995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cd03a4f0-e647-4773-91d7-c867d4e23d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:19.825893 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3011/6051] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:19.827684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e4936-4024-4633-b8f8-e2c67dd0a56a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:19.828006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e4936-4024-4633-b8f8-e2c67dd0a56a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:19.830981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e4936-4024-4633-b8f8-e2c67dd0a56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:19.871670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9e5e4936-4024-4633-b8f8-e2c67dd0a56a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:19.883276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c667dc3-6a9e-4b6d-8868-fdaa87982eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:19.885766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c667dc3-6a9e-4b6d-8868-fdaa87982eea service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:19.890600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9e5e4936-4024-4633-b8f8-e2c67dd0a56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:19.910210 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3041/6052] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:19.922471 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3012/6053] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:19.925034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c667dc3-6a9e-4b6d-8868-fdaa87982eea service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:19.931979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8c667dc3-6a9e-4b6d-8868-fdaa87982eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:19.950605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c667dc3-6a9e-4b6d-8868-fdaa87982eea service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:19.962056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fb1cf-081d-45be-a5b2-393dc780b778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:19.962987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb1cf-081d-45be-a5b2-393dc780b778 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:19.963572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb1cf-081d-45be-a5b2-393dc780b778 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:19.964334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb1cf-081d-45be-a5b2-393dc780b778 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:19.965192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fb1cf-081d-45be-a5b2-393dc780b778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:19.965745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fb1cf-081d-45be-a5b2-393dc780b778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:19.967737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fb1cf-081d-45be-a5b2-393dc780b778 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:20.002462 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3042/6054] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:20.007927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e4936-4024-4633-b8f8-e2c67dd0a56a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:20.024373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e4936-4024-4633-b8f8-e2c67dd0a56a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:20.034821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bd694-ba0f-4dc4-bd74-e34002bf683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:20.035462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bd694-ba0f-4dc4-bd74-e34002bf683d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:20.035748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bd694-ba0f-4dc4-bd74-e34002bf683d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:20.036020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bd694-ba0f-4dc4-bd74-e34002bf683d admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:20.036665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bd694-ba0f-4dc4-bd74-e34002bf683d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:20.038607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bd694-ba0f-4dc4-bd74-e34002bf683d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:20.102846 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3013/6055] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:20 2022] POST /identity/v3/projects => generated 361 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:20.107784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fb1cf-081d-45be-a5b2-393dc780b778 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:20.120838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fb1cf-081d-45be-a5b2-393dc780b778 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:20.215969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58057b28-8a11-4480-bc05-34f3e9538129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:20.216759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58057b28-8a11-4480-bc05-34f3e9538129 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:20.217136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58057b28-8a11-4480-bc05-34f3e9538129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:20.217748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58057b28-8a11-4480-bc05-34f3e9538129 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:20.218486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58057b28-8a11-4480-bc05-34f3e9538129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:20.220789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58057b28-8a11-4480-bc05-34f3e9538129 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:20.266510 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3043/6056] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:20 2022] POST /identity/v3/users => generated 281 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:20.270177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bd694-ba0f-4dc4-bd74-e34002bf683d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:20.285098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bd694-ba0f-4dc4-bd74-e34002bf683d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:20.293934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def808a0-227c-4ae2-bdd6-d1d934df7f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:20.293934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def808a0-227c-4ae2-bdd6-d1d934df7f3a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:20.293934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def808a0-227c-4ae2-bdd6-d1d934df7f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:20.293934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def808a0-227c-4ae2-bdd6-d1d934df7f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:20.294294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def808a0-227c-4ae2-bdd6-d1d934df7f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:20.296239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def808a0-227c-4ae2-bdd6-d1d934df7f3a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:20.309386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:20.346988 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3014/6057] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:20.354002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58057b28-8a11-4480-bc05-34f3e9538129 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:20.390976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58057b28-8a11-4480-bc05-34f3e9538129 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:20.405731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b157f-c38a-49bd-ad92-9ac514f30530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:20.407451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b157f-c38a-49bd-ad92-9ac514f30530 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:20.434096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b157f-c38a-49bd-ad92-9ac514f30530 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:20.434391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b157f-c38a-49bd-ad92-9ac514f30530 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:20.436808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b157f-c38a-49bd-ad92-9ac514f30530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:20.441386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b157f-c38a-49bd-ad92-9ac514f30530 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:20.468439 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3044/6058] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:20.469448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def808a0-227c-4ae2-bdd6-d1d934df7f3a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:20.490443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def808a0-227c-4ae2-bdd6-d1d934df7f3a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:20.499031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618ba18-592f-4f65-b33a-a90931ffb5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:20.500080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618ba18-592f-4f65-b33a-a90931ffb5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:20.500341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618ba18-592f-4f65-b33a-a90931ffb5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:20.500696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618ba18-592f-4f65-b33a-a90931ffb5f6 admin admin] PATH_INFO: `/v3/projects/97bfa20bfc0f4dca9bcf39c7441629cb/users/4eab34604d66400388d07c55e6481453/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:20.540671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618ba18-592f-4f65-b33a-a90931ffb5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97bfa20bfc0f4dca9bcf39c7441629cb, user_id=4eab34604d66400388d07c55e6481453, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:20.552746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618ba18-592f-4f65-b33a-a90931ffb5f6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:20.606382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b157f-c38a-49bd-ad92-9ac514f30530 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:20.608257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-350b157f-c38a-49bd-ad92-9ac514f30530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:20.609856 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3015/6059] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:20 2022] PUT /identity/v3/projects/97bfa20bfc0f4dca9bcf39c7441629cb/users/4eab34604d66400388d07c55e6481453/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:20.625302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04975d05-83a6-46f8-8fb6-9d57705bcad7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:20.625473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04975d05-83a6-46f8-8fb6-9d57705bcad7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:20.625743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04975d05-83a6-46f8-8fb6-9d57705bcad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:20.652046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b157f-c38a-49bd-ad92-9ac514f30530 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:20.673115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:20.702731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-04975d05-83a6-46f8-8fb6-9d57705bcad7 None None] MFA Rules not processed for user `4eab34604d66400388d07c55e6481453`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:20.703814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-04975d05-83a6-46f8-8fb6-9d57705bcad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:20.795464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b21aa-9495-46e4-a609-fa98706320fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:20.796549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b21aa-9495-46e4-a609-fa98706320fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:20.797050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b21aa-9495-46e4-a609-fa98706320fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:20.797453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b21aa-9495-46e4-a609-fa98706320fe admin admin] PATH_INFO: `/v3/projects/9f018a89a2a94e1f848e1b3073affa54` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:20.799785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b21aa-9495-46e4-a609-fa98706320fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f018a89a2a94e1f848e1b3073affa54)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:20.803845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b21aa-9495-46e4-a609-fa98706320fe admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:20.839421 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3016/6060] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:20.844899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d12d9-edac-45cc-aae7-21fdaec91bb7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:20.845615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d12d9-edac-45cc-aae7-21fdaec91bb7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:20.846199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d12d9-edac-45cc-aae7-21fdaec91bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:20.875013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-082d12d9-edac-45cc-aae7-21fdaec91bb7 None None] MFA Rules not processed for user `4eab34604d66400388d07c55e6481453`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:20.876935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-082d12d9-edac-45cc-aae7-21fdaec91bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:20.882542 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3017/6061] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:20 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:17:20.888135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb4aec-394b-426b-9d90-78990bef6e9b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:20.888790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb4aec-394b-426b-9d90-78990bef6e9b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:20.889314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb4aec-394b-426b-9d90-78990bef6e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:20.922785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c3eb4aec-394b-426b-9d90-78990bef6e9b None None] MFA Rules not processed for user `4eab34604d66400388d07c55e6481453`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:20.922785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c3eb4aec-394b-426b-9d90-78990bef6e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:20.927520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e06b21aa-9495-46e4-a609-fa98706320fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f018a89a2a94e1f848e1b3073affa54', 'request_id': 'req-e06b21aa-9495-46e4-a609-fa98706320fe'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:20.931116 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3018/6062] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:20 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:17:20.937105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb4aec-394b-426b-9d90-78990bef6e9b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:20.956981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e06b21aa-9495-46e4-a609-fa98706320fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f018a89a2a94e1f848e1b3073affa54', 'request_id': 'req-e06b21aa-9495-46e4-a609-fa98706320fe'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:20.969503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e06b21aa-9495-46e4-a609-fa98706320fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f018a89a2a94e1f848e1b3073affa54', 'request_id': 'req-e06b21aa-9495-46e4-a609-fa98706320fe'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:20.990796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e06b21aa-9495-46e4-a609-fa98706320fe admin admin] The token cache is being invalidate because project 9f018a89a2a94e1f848e1b3073affa54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:20.991322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e06b21aa-9495-46e4-a609-fa98706320fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:20.992222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e06b21aa-9495-46e4-a609-fa98706320fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:20.994548 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3045/6063] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:20 2022] DELETE /identity/v3/projects/9f018a89a2a94e1f848e1b3073affa54 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:20.999227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6a325-9895-436c-ba0c-4ab125529d37 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:20.999765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6a325-9895-436c-ba0c-4ab125529d37 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.000371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6a325-9895-436c-ba0c-4ab125529d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.023686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb4aec-394b-426b-9d90-78990bef6e9b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.026888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-97d6a325-9895-436c-ba0c-4ab125529d37 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:21.028452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-97d6a325-9895-436c-ba0c-4ab125529d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:21.029751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79022b2-31d1-4370-98ca-a38f10dca1be tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab34604d66400388d07c55e6481453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97bfa20bfc0f4dca9bcf39c7441629cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:21.030601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79022b2-31d1-4370-98ca-a38f10dca1be tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] REQUEST_METHOD: `HEAD` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.031101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79022b2-31d1-4370-98ca-a38f10dca1be tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.031649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79022b2-31d1-4370-98ca-a38f10dca1be tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.033867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c79022b2-31d1-4370-98ca-a38f10dca1be tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:21.045754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79022b2-31d1-4370-98ca-a38f10dca1be tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: Authorizing `identity:check_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:21.050232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79022b2-31d1-4370-98ca-a38f10dca1be tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:21.064056 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3019/6064] 10.222.0.70 () {56 vars in 1264 bytes} [Sun Aug 28 19:17:20 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:17:21.068032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79022b2-31d1-4370-98ca-a38f10dca1be tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:21.071622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c79022b2-31d1-4370-98ca-a38f10dca1be tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:21.090438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79022b2-31d1-4370-98ca-a38f10dca1be tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.099730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c0ee4-42fd-475d-907e-426b95c84f99 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab34604d66400388d07c55e6481453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97bfa20bfc0f4dca9bcf39c7441629cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:21.100368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c0ee4-42fd-475d-907e-426b95c84f99 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.100670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c0ee4-42fd-475d-907e-426b95c84f99 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.100948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c0ee4-42fd-475d-907e-426b95c84f99 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.115660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c0ee4-42fd-475d-907e-426b95c84f99 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:21.120055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c0ee4-42fd-475d-907e-426b95c84f99 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:21.144873 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3020/6065] 10.222.0.70 () {56 vars in 1263 bytes} [Sun Aug 28 19:17:21 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 19:17:21.145763 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3046/6066] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:21.155646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c0ee4-42fd-475d-907e-426b95c84f99 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:21.157646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc660390-30fd-49a7-a623-87a87e3a599c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.162377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc660390-30fd-49a7-a623-87a87e3a599c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.163094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc660390-30fd-49a7-a623-87a87e3a599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.174059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c0ee4-42fd-475d-907e-426b95c84f99 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.183791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e88f6-6842-4f3b-b4d7-7885dd3466d9 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab34604d66400388d07c55e6481453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97bfa20bfc0f4dca9bcf39c7441629cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:21.187076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e88f6-6842-4f3b-b4d7-7885dd3466d9 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.187430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e88f6-6842-4f3b-b4d7-7885dd3466d9 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.187730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e88f6-6842-4f3b-b4d7-7885dd3466d9 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.201427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-bc660390-30fd-49a7-a623-87a87e3a599c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:21.201653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e88f6-6842-4f3b-b4d7-7885dd3466d9 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:21.202974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bc660390-30fd-49a7-a623-87a87e3a599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:21.203713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e88f6-6842-4f3b-b4d7-7885dd3466d9 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:21.213122 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3047/6067] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:21.217648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc660390-30fd-49a7-a623-87a87e3a599c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:21.228713 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3021/6068] 10.222.0.70 () {56 vars in 1266 bytes} [Sun Aug 28 19:17:21 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:21.231191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc660390-30fd-49a7-a623-87a87e3a599c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.233448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e88f6-6842-4f3b-b4d7-7885dd3466d9 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:21.239598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b88aa-7198-4f6e-bbfa-3c6210f9bf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:21.240238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b88aa-7198-4f6e-bbfa-3c6210f9bf50 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.240522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b88aa-7198-4f6e-bbfa-3c6210f9bf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.240799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b88aa-7198-4f6e-bbfa-3c6210f9bf50 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.241563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b88aa-7198-4f6e-bbfa-3c6210f9bf50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:21.242061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b88aa-7198-4f6e-bbfa-3c6210f9bf50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:21.243925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b88aa-7198-4f6e-bbfa-3c6210f9bf50 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:21.251415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e88f6-6842-4f3b-b4d7-7885dd3466d9 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.261615 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3048/6069] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:21.266557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b88aa-7198-4f6e-bbfa-3c6210f9bf50 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:21.269402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259409c-068f-44be-96f6-36843084a566 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab34604d66400388d07c55e6481453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97bfa20bfc0f4dca9bcf39c7441629cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:21.271042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259409c-068f-44be-96f6-36843084a566 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] REQUEST_METHOD: `HEAD` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.271442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259409c-068f-44be-96f6-36843084a566 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.271929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259409c-068f-44be-96f6-36843084a566 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.276682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9259409c-068f-44be-96f6-36843084a566 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:21.283937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b88aa-7198-4f6e-bbfa-3c6210f9bf50 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.292872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd6657-71d4-4e80-8d61-17a7d1cc05d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:21.293489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd6657-71d4-4e80-8d61-17a7d1cc05d6 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.293771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd6657-71d4-4e80-8d61-17a7d1cc05d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.294051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd6657-71d4-4e80-8d61-17a7d1cc05d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.295458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd6657-71d4-4e80-8d61-17a7d1cc05d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:21.297697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd6657-71d4-4e80-8d61-17a7d1cc05d6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-9259409c-068f-44be-96f6-36843084a566 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Aug 28 19:17:21.302434 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 28 19:17:21.303872 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 28 19:17:21.305247 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:21.305247 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:21.305247 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 28 19:17:21.305247 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 28 19:17:21.305247 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 28 19:17:21.305247 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:17:21.305782 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3022/6070] 10.222.0.70 () {56 vars in 1264 bytes} [Sun Aug 28 19:17:21 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:17:21.311469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b526a-f8a1-4a41-862f-cdd2a1adb92a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.311849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b526a-f8a1-4a41-862f-cdd2a1adb92a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.312201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b526a-f8a1-4a41-862f-cdd2a1adb92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.338144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-aa9b526a-f8a1-4a41-862f-cdd2a1adb92a None None] MFA Rules not processed for user `4eab34604d66400388d07c55e6481453`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:21.339674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aa9b526a-f8a1-4a41-862f-cdd2a1adb92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:21.345700 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3023/6071] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:21 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:17:21.350496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b526a-f8a1-4a41-862f-cdd2a1adb92a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:21.362109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:21.382586 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3049/6072] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:21 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:17:21.382832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b526a-f8a1-4a41-862f-cdd2a1adb92a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.387073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd6657-71d4-4e80-8d61-17a7d1cc05d6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:21.401771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:21.497281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82be692-859f-42b8-98ee-128189787cfb tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab34604d66400388d07c55e6481453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97bfa20bfc0f4dca9bcf39c7441629cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:21.498069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82be692-859f-42b8-98ee-128189787cfb tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.498288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82be692-859f-42b8-98ee-128189787cfb tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.501547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82be692-859f-42b8-98ee-128189787cfb tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.524306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82be692-859f-42b8-98ee-128189787cfb tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:21.529038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82be692-859f-42b8-98ee-128189787cfb tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:21.537794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd6657-71d4-4e80-8d61-17a7d1cc05d6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.540469 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3024/6073] 10.222.0.70 () {56 vars in 1263 bytes} [Sun Aug 28 19:17:21 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 19:17:21.547004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82be692-859f-42b8-98ee-128189787cfb tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:21.547409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60739dd7-ffb8-4023-ab0e-94dd51de326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:21.548173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60739dd7-ffb8-4023-ab0e-94dd51de326d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.548302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60739dd7-ffb8-4023-ab0e-94dd51de326d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.548579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60739dd7-ffb8-4023-ab0e-94dd51de326d admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.549221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60739dd7-ffb8-4023-ab0e-94dd51de326d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:21.552090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60739dd7-ffb8-4023-ab0e-94dd51de326d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:21.573552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82be692-859f-42b8-98ee-128189787cfb tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.579767 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3050/6074] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:21 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:21.586911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60739dd7-ffb8-4023-ab0e-94dd51de326d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:21.589737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef3630-2649-4aff-b8f9-7057d137b102 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab34604d66400388d07c55e6481453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97bfa20bfc0f4dca9bcf39c7441629cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:21.590656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef3630-2649-4aff-b8f9-7057d137b102 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.591442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef3630-2649-4aff-b8f9-7057d137b102 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.592315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef3630-2649-4aff-b8f9-7057d137b102 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.605269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef3630-2649-4aff-b8f9-7057d137b102 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:21.606811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60739dd7-ffb8-4023-ab0e-94dd51de326d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.607277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef3630-2649-4aff-b8f9-7057d137b102 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:21.615837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977b3a1-6a88-462f-851e-edb2fb329a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:21.616873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b3a1-6a88-462f-851e-edb2fb329a03 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.617210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b3a1-6a88-462f-851e-edb2fb329a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.617811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b3a1-6a88-462f-851e-edb2fb329a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.623040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977b3a1-6a88-462f-851e-edb2fb329a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:21.627474 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3025/6075] 10.222.0.70 () {56 vars in 1266 bytes} [Sun Aug 28 19:17:21 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:21.632952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef3630-2649-4aff-b8f9-7057d137b102 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:21.636226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977b3a1-6a88-462f-851e-edb2fb329a03 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:21.646944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef3630-2649-4aff-b8f9-7057d137b102 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.652722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab845910-cb8b-4ea7-b158-8803743eb354 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eab34604d66400388d07c55e6481453', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97bfa20bfc0f4dca9bcf39c7441629cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:21.653915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab845910-cb8b-4ea7-b158-8803743eb354 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.654359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab845910-cb8b-4ea7-b158-8803743eb354 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.654783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab845910-cb8b-4ea7-b158-8803743eb354 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.657234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ab845910-cb8b-4ea7-b158-8803743eb354 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:21.661978 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3051/6076] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-ab845910-cb8b-4ea7-b158-8803743eb354 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Aug 28 19:17:21.672163 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 28 19:17:21.674181 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 28 19:17:21.676367 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:17:21.676367 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:17:21.676367 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 28 19:17:21.676367 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 28 19:17:21.676367 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 28 19:17:21.676367 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:17:21.676877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977b3a1-6a88-462f-851e-edb2fb329a03 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:21.681930 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3026/6077] 10.222.0.70 () {56 vars in 1263 bytes} [Sun Aug 28 19:17:21 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:17:21.683101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab845910-cb8b-4ea7-b158-8803743eb354 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:21.685112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ab845910-cb8b-4ea7-b158-8803743eb354 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:21.697763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977b3a1-6a88-462f-851e-edb2fb329a03 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.718811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837465b4-681c-4729-a5f0-e9b026301df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:21.719603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837465b4-681c-4729-a5f0-e9b026301df7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.719957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837465b4-681c-4729-a5f0-e9b026301df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.720360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837465b4-681c-4729-a5f0-e9b026301df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.721577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837465b4-681c-4729-a5f0-e9b026301df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:21.724348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837465b4-681c-4729-a5f0-e9b026301df7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:21.727823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab845910-cb8b-4ea7-b158-8803743eb354 tempest-TokensV3Test-1078457079 tempest-TokensV3Test-1078457079-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.741049 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3052/6078] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:21.743423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db4901-064a-4190-a1a3-7ca7df9125c6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.743825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db4901-064a-4190-a1a3-7ca7df9125c6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.744921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cd5d8-50e6-4b28-b6b0-3f0190fdce32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:21.745663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cd5d8-50e6-4b28-b6b0-3f0190fdce32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.746045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cd5d8-50e6-4b28-b6b0-3f0190fdce32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.746422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cd5d8-50e6-4b28-b6b0-3f0190fdce32 admin admin] PATH_INFO: `/v3/users/4eab34604d66400388d07c55e6481453` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.747397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db4901-064a-4190-a1a3-7ca7df9125c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:21.747873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cd5d8-50e6-4b28-b6b0-3f0190fdce32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eab34604d66400388d07c55e6481453)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:21.750030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cd5d8-50e6-4b28-b6b0-3f0190fdce32 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:21.800743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f8db4901-064a-4190-a1a3-7ca7df9125c6 None None] MFA Rules not processed for user `6f8442e91abe4b1f8439b1571a4ee385`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:21.802184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f8db4901-064a-4190-a1a3-7ca7df9125c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:21.857227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f1cd5d8-50e6-4b28-b6b0-3f0190fdce32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eab34604d66400388d07c55e6481453'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:21.873753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f1cd5d8-50e6-4b28-b6b0-3f0190fdce32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eab34604d66400388d07c55e6481453'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:21.874637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f1cd5d8-50e6-4b28-b6b0-3f0190fdce32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eab34604d66400388d07c55e6481453'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:21.897453 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3053/6079] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:21.902398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db4901-064a-4190-a1a3-7ca7df9125c6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:21.904279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f1cd5d8-50e6-4b28-b6b0-3f0190fdce32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eab34604d66400388d07c55e6481453'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:21.904982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6f1cd5d8-50e6-4b28-b6b0-3f0190fdce32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eab34604d66400388d07c55e6481453'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:21.935032 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3027/6080] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:21 2022] DELETE /identity/v3/users/4eab34604d66400388d07c55e6481453 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:21.935321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db4901-064a-4190-a1a3-7ca7df9125c6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:21.940259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a67d6c-8a92-4ad1-a35f-3997bde638c3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:21.940740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a67d6c-8a92-4ad1-a35f-3997bde638c3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:21.941644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a67d6c-8a92-4ad1-a35f-3997bde638c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:22.016164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d3a67d6c-8a92-4ad1-a35f-3997bde638c3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:22.017593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d3a67d6c-8a92-4ad1-a35f-3997bde638c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:22.107278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda32d3c-4b50-4251-8e6c-4bc1bac4c935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:22.108458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda32d3c-4b50-4251-8e6c-4bc1bac4c935 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:22.108993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda32d3c-4b50-4251-8e6c-4bc1bac4c935 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:22.109512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda32d3c-4b50-4251-8e6c-4bc1bac4c935 admin admin] PATH_INFO: `/v3/projects/d857e4c8fa0d438cbeea93df7a8920da/users/7a90dbc92b1843b9bdd7461f924a104d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:22.152544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:22.158648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:22.163448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda32d3c-4b50-4251-8e6c-4bc1bac4c935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d857e4c8fa0d438cbeea93df7a8920da, user_id=7a90dbc92b1843b9bdd7461f924a104d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:22.173735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda32d3c-4b50-4251-8e6c-4bc1bac4c935 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:22.203409 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3028/6081] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:22.209813 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3054/6082] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:21 2022] PUT /identity/v3/projects/d857e4c8fa0d438cbeea93df7a8920da/users/7a90dbc92b1843b9bdd7461f924a104d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:22.227560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9f54-f80b-4402-be7b-a206c655d67a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:22.228160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9f54-f80b-4402-be7b-a206c655d67a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:22.228564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b9f54-f80b-4402-be7b-a206c655d67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:22.237132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda32d3c-4b50-4251-8e6c-4bc1bac4c935 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:22.247592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fda32d3c-4b50-4251-8e6c-4bc1bac4c935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:22.287761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d74b9f54-f80b-4402-be7b-a206c655d67a None None] MFA Rules not processed for user `7a90dbc92b1843b9bdd7461f924a104d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:22.289209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d74b9f54-f80b-4402-be7b-a206c655d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:22.351395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda32d3c-4b50-4251-8e6c-4bc1bac4c935 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:22.356617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e327675-3394-4225-8f1a-5948acfae85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:22.357242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e327675-3394-4225-8f1a-5948acfae85a service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:22.357530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e327675-3394-4225-8f1a-5948acfae85a service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:22.357813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e327675-3394-4225-8f1a-5948acfae85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:22.429488 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3029/6083] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:22.434236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b9f54-f80b-4402-be7b-a206c655d67a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:22.445848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d74b9f54-f80b-4402-be7b-a206c655d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:22.482005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e327675-3394-4225-8f1a-5948acfae85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:22.484150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e327675-3394-4225-8f1a-5948acfae85a service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:22.496903 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3055/6084] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:22.664189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b9f54-f80b-4402-be7b-a206c655d67a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:22.674224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc360407-2a9e-42e6-9e87-468a7b429f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:22.675467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc360407-2a9e-42e6-9e87-468a7b429f68 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:22.675786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc360407-2a9e-42e6-9e87-468a7b429f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:22.676086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc360407-2a9e-42e6-9e87-468a7b429f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:22.676906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc360407-2a9e-42e6-9e87-468a7b429f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:22.682213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc360407-2a9e-42e6-9e87-468a7b429f68 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:22.760673 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3030/6085] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:22 2022] POST /identity/v3/projects => generated 383 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:22.766208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e327675-3394-4225-8f1a-5948acfae85a service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:22.783670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e327675-3394-4225-8f1a-5948acfae85a service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:22.905312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd5a76-6128-4768-9881-5ca2c9c35699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:22.905952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd5a76-6128-4768-9881-5ca2c9c35699 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:22.906236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd5a76-6128-4768-9881-5ca2c9c35699 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:22.906509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd5a76-6128-4768-9881-5ca2c9c35699 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:22.907209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd5a76-6128-4768-9881-5ca2c9c35699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:22.909752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd5a76-6128-4768-9881-5ca2c9c35699 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:22.952561 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3056/6086] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:22 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:22.957285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc360407-2a9e-42e6-9e87-468a7b429f68 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:22.968118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd5a76-6128-4768-9881-5ca2c9c35699 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:22.969925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc360407-2a9e-42e6-9e87-468a7b429f68 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:22.976004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-07bd5a76-6128-4768-9881-5ca2c9c35699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:22.983980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da66d1-95c9-4931-bdc9-0e6728e88871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:22.984905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da66d1-95c9-4931-bdc9-0e6728e88871 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:22.985063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da66d1-95c9-4931-bdc9-0e6728e88871 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:22.985573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da66d1-95c9-4931-bdc9-0e6728e88871 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:22.986464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da66d1-95c9-4931-bdc9-0e6728e88871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:22.989377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da66d1-95c9-4931-bdc9-0e6728e88871 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:23.017096 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3031/6087] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:23.021709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da66d1-95c9-4931-bdc9-0e6728e88871 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:23.029176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd5a76-6128-4768-9881-5ca2c9c35699 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:23.033148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da66d1-95c9-4931-bdc9-0e6728e88871 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:23.036535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bbb37-0542-4615-b70b-adabb472443a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:23.037280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bbb37-0542-4615-b70b-adabb472443a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.037609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bbb37-0542-4615-b70b-adabb472443a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.038029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bbb37-0542-4615-b70b-adabb472443a admin admin] PATH_INFO: `/v3/projects/97bfa20bfc0f4dca9bcf39c7441629cb` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.039820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bbb37-0542-4615-b70b-adabb472443a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97bfa20bfc0f4dca9bcf39c7441629cb)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:23.039991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c812e2a-4946-4453-939b-b99cd11e27ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:23.040186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c812e2a-4946-4453-939b-b99cd11e27ee admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.040533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c812e2a-4946-4453-939b-b99cd11e27ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.040879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c812e2a-4946-4453-939b-b99cd11e27ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.041488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bbb37-0542-4615-b70b-adabb472443a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:23.041655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c812e2a-4946-4453-939b-b99cd11e27ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:23.043352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c812e2a-4946-4453-939b-b99cd11e27ee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:23.057995 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3032/6088] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:23.060581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c812e2a-4946-4453-939b-b99cd11e27ee admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:23.075659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c812e2a-4946-4453-939b-b99cd11e27ee admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:23.080803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:23.082263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694f8ce-9716-4aac-a4ae-05823eb783c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:23.083138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694f8ce-9716-4aac-a4ae-05823eb783c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.083496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694f8ce-9716-4aac-a4ae-05823eb783c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.083787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694f8ce-9716-4aac-a4ae-05823eb783c7 admin admin] PATH_INFO: `/v3/projects/6030a7ce0eaa4eaf96496de92ca0701e/users/04480384988845b6b02d86b4a6b32ae8/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.104896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694f8ce-9716-4aac-a4ae-05823eb783c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6030a7ce0eaa4eaf96496de92ca0701e, user_id=04480384988845b6b02d86b4a6b32ae8, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:23.107807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694f8ce-9716-4aac-a4ae-05823eb783c7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:23.109422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e6bbb37-0542-4615-b70b-adabb472443a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97bfa20bfc0f4dca9bcf39c7441629cb', 'request_id': 'req-6e6bbb37-0542-4615-b70b-adabb472443a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:23.117196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e6bbb37-0542-4615-b70b-adabb472443a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97bfa20bfc0f4dca9bcf39c7441629cb', 'request_id': 'req-6e6bbb37-0542-4615-b70b-adabb472443a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:23.126605 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3033/6089] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:23 2022] PUT /identity/v3/projects/6030a7ce0eaa4eaf96496de92ca0701e/users/04480384988845b6b02d86b4a6b32ae8/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:23.127861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e6bbb37-0542-4615-b70b-adabb472443a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97bfa20bfc0f4dca9bcf39c7441629cb', 'request_id': 'req-6e6bbb37-0542-4615-b70b-adabb472443a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:23.139724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba810b-aa27-4cfa-a823-e55c29d0a7e8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.139724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba810b-aa27-4cfa-a823-e55c29d0a7e8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.139724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba810b-aa27-4cfa-a823-e55c29d0a7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.156165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e6bbb37-0542-4615-b70b-adabb472443a admin admin] The token cache is being invalidate because project 97bfa20bfc0f4dca9bcf39c7441629cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:23.156450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e6bbb37-0542-4615-b70b-adabb472443a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:23.157776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e6bbb37-0542-4615-b70b-adabb472443a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:23.162883 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3057/6090] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:22 2022] DELETE /identity/v3/projects/97bfa20bfc0f4dca9bcf39c7441629cb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:23.166310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd883d0-b154-452c-bd84-884a4e5b556b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.166830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd883d0-b154-452c-bd84-884a4e5b556b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.167115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd883d0-b154-452c-bd84-884a4e5b556b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.170198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:23.174120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-daba810b-aa27-4cfa-a823-e55c29d0a7e8 None None] MFA Rules not processed for user `04480384988845b6b02d86b4a6b32ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:23.176110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-daba810b-aa27-4cfa-a823-e55c29d0a7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:23.194312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1dd883d0-b154-452c-bd84-884a4e5b556b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:23.195573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1dd883d0-b154-452c-bd84-884a4e5b556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:23.270009 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3034/6091] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:23.274917 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3058/6092] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:23.283263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d925015-d99b-4654-9d31-3974d00712a3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.283558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d925015-d99b-4654-9d31-3974d00712a3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.283843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d925015-d99b-4654-9d31-3974d00712a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.290985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd883d0-b154-452c-bd84-884a4e5b556b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:23.292825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1dd883d0-b154-452c-bd84-884a4e5b556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:23.308127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3d925015-d99b-4654-9d31-3974d00712a3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:23.309532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3d925015-d99b-4654-9d31-3974d00712a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:23.324911 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3035/6093] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:23.326003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d925015-d99b-4654-9d31-3974d00712a3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:23.337368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d925015-d99b-4654-9d31-3974d00712a3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:23.344803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511321c-51ac-4c37-bb6d-f5c43e364f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:23.345449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511321c-51ac-4c37-bb6d-f5c43e364f95 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.345736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511321c-51ac-4c37-bb6d-f5c43e364f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.346016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511321c-51ac-4c37-bb6d-f5c43e364f95 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.346825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511321c-51ac-4c37-bb6d-f5c43e364f95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:23.347445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511321c-51ac-4c37-bb6d-f5c43e364f95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:23.349515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511321c-51ac-4c37-bb6d-f5c43e364f95 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:23.368633 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3036/6094] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:17:23.372610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511321c-51ac-4c37-bb6d-f5c43e364f95 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:23.390966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511321c-51ac-4c37-bb6d-f5c43e364f95 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:23.393680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd883d0-b154-452c-bd84-884a4e5b556b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:23.399871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c647168-3aa4-4b67-9dbd-7385b1fcdb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:23.400582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d459c-0baa-4daa-90bb-462f3c4e7bc2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:23.401340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d459c-0baa-4daa-90bb-462f3c4e7bc2 service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.401531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c647168-3aa4-4b67-9dbd-7385b1fcdb14 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.401718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d459c-0baa-4daa-90bb-462f3c4e7bc2 service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.402117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d459c-0baa-4daa-90bb-462f3c4e7bc2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.402565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c647168-3aa4-4b67-9dbd-7385b1fcdb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.403067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c647168-3aa4-4b67-9dbd-7385b1fcdb14 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.404169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c647168-3aa4-4b67-9dbd-7385b1fcdb14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:23.404821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0d9d459c-0baa-4daa-90bb-462f3c4e7bc2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:23.406914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c647168-3aa4-4b67-9dbd-7385b1fcdb14 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:23.471951 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3037/6095] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:23 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:17:23.476985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c647168-3aa4-4b67-9dbd-7385b1fcdb14 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:23.531014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d459c-0baa-4daa-90bb-462f3c4e7bc2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:23.532648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d459c-0baa-4daa-90bb-462f3c4e7bc2 service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:23.538164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:23.555176 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3059/6096] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:23.602001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c647168-3aa4-4b67-9dbd-7385b1fcdb14 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:23.614926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94caba-7277-47cb-808b-063ae45ea7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:23.615956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94caba-7277-47cb-808b-063ae45ea7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.616788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94caba-7277-47cb-808b-063ae45ea7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.617705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94caba-7277-47cb-808b-063ae45ea7b8 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.618628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94caba-7277-47cb-808b-063ae45ea7b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:23.628785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94caba-7277-47cb-808b-063ae45ea7b8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:23.690039 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3038/6097] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:23 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:23.695772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d459c-0baa-4daa-90bb-462f3c4e7bc2 service glance] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:23.715492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d459c-0baa-4daa-90bb-462f3c4e7bc2 service glance] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:23.725694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caa1b3-7132-4b69-9c84-8176082a4ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:23.726477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caa1b3-7132-4b69-9c84-8176082a4ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.726903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caa1b3-7132-4b69-9c84-8176082a4ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.727263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caa1b3-7132-4b69-9c84-8176082a4ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.729698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caa1b3-7132-4b69-9c84-8176082a4ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:23.735896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caa1b3-7132-4b69-9c84-8176082a4ba8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:23.744056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94caba-7277-47cb-808b-063ae45ea7b8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:23.750513 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3060/6098] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:17:23.755115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caa1b3-7132-4b69-9c84-8176082a4ba8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:23.769976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caa1b3-7132-4b69-9c84-8176082a4ba8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:23.778872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40b774-f50f-43ff-8f15-995bef58240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:23.781177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40b774-f50f-43ff-8f15-995bef58240e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.781957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40b774-f50f-43ff-8f15-995bef58240e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.783089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40b774-f50f-43ff-8f15-995bef58240e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.784704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40b774-f50f-43ff-8f15-995bef58240e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:23.787736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40b774-f50f-43ff-8f15-995bef58240e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:23.807637 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3061/6099] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:17:23.824661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40b774-f50f-43ff-8f15-995bef58240e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:23.860149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40b774-f50f-43ff-8f15-995bef58240e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:23.868051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94caba-7277-47cb-808b-063ae45ea7b8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:23.872562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cbcba-3d8d-4f2b-8547-a6274a965930 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:23.873186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cbcba-3d8d-4f2b-8547-a6274a965930 service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.873693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cbcba-3d8d-4f2b-8547-a6274a965930 service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.873970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cbcba-3d8d-4f2b-8547-a6274a965930 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.880097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:23.884456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc8e00-f68b-4cf3-aa1f-2edaadf5d82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:23.885067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8e00-f68b-4cf3-aa1f-2edaadf5d82f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.885343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8e00-f68b-4cf3-aa1f-2edaadf5d82f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.885628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8e00-f68b-4cf3-aa1f-2edaadf5d82f admin admin] PATH_INFO: `/v3/projects/649393a995eb42a3b893200c2f39bdf4/users/102c1b905fae4f1d8ece205d85178bdc/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.926312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc8e00-f68b-4cf3-aa1f-2edaadf5d82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=649393a995eb42a3b893200c2f39bdf4, user_id=102c1b905fae4f1d8ece205d85178bdc, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:23.931481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc8e00-f68b-4cf3-aa1f-2edaadf5d82f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:23.958838 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3062/6100] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:23 2022] PUT /identity/v3/projects/649393a995eb42a3b893200c2f39bdf4/users/102c1b905fae4f1d8ece205d85178bdc/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:23.963902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb3b7-ded7-474d-b524-d506ffe85e7c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:23.964192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb3b7-ded7-474d-b524-d506ffe85e7c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:23.964469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb3b7-ded7-474d-b524-d506ffe85e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:23.964579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cbcba-3d8d-4f2b-8547-a6274a965930 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:23.966044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cbcba-3d8d-4f2b-8547-a6274a965930 service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:23.977228 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3039/6101] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:17:24.013521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-919cb3b7-ded7-474d-b524-d506ffe85e7c None None] MFA Rules not processed for user `102c1b905fae4f1d8ece205d85178bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:24.015095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-919cb3b7-ded7-474d-b524-d506ffe85e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:24.097870 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3063/6102] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:24.114926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cbcba-3d8d-4f2b-8547-a6274a965930 service glance] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:24.128765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cbcba-3d8d-4f2b-8547-a6274a965930 service glance] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:24.239874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627135a2-1621-447c-af92-a7033d8b0a8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:24.241774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627135a2-1621-447c-af92-a7033d8b0a8a service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:24.243132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627135a2-1621-447c-af92-a7033d8b0a8a service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:24.243538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627135a2-1621-447c-af92-a7033d8b0a8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:24.255572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627135a2-1621-447c-af92-a7033d8b0a8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:24.257278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627135a2-1621-447c-af92-a7033d8b0a8a service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:24.302515 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3040/6103] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:24.504713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42222b-bb02-47ee-998b-13573d76548c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:24.505025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42222b-bb02-47ee-998b-13573d76548c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:24.505276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42222b-bb02-47ee-998b-13573d76548c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:24.541004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9b42222b-bb02-47ee-998b-13573d76548c None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:24.542273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9b42222b-bb02-47ee-998b-13573d76548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:24.580645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627135a2-1621-447c-af92-a7033d8b0a8a service glance] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:24.582908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-627135a2-1621-447c-af92-a7033d8b0a8a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:24.744881 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3064/6104] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:17:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:24.756540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627135a2-1621-447c-af92-a7033d8b0a8a service glance] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:24.770058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3c878-9149-4010-8542-902d8930d25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:24.771422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3c878-9149-4010-8542-902d8930d25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:24.771805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3c878-9149-4010-8542-902d8930d25e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:24.772186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3c878-9149-4010-8542-902d8930d25e admin admin] PATH_INFO: `/v3/users/7a90dbc92b1843b9bdd7461f924a104d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:24.773527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3c878-9149-4010-8542-902d8930d25e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a90dbc92b1843b9bdd7461f924a104d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:24.776391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3c878-9149-4010-8542-902d8930d25e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:24.843382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42222b-bb02-47ee-998b-13573d76548c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:24.844965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9b42222b-bb02-47ee-998b-13573d76548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:24.879468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ccb3c878-9149-4010-8542-902d8930d25e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a90dbc92b1843b9bdd7461f924a104d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:24.882158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:24.889360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ccb3c878-9149-4010-8542-902d8930d25e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a90dbc92b1843b9bdd7461f924a104d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:24.890408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ccb3c878-9149-4010-8542-902d8930d25e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a90dbc92b1843b9bdd7461f924a104d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:24.910593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ccb3c878-9149-4010-8542-902d8930d25e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a90dbc92b1843b9bdd7461f924a104d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:24.911583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ccb3c878-9149-4010-8542-902d8930d25e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a90dbc92b1843b9bdd7461f924a104d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:24.955909 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3041/6105] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:24 2022] DELETE /identity/v3/users/7a90dbc92b1843b9bdd7461f924a104d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:24.960728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519311db-4723-43b9-9d5b-4bd400e3cbaa None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:24.961016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519311db-4723-43b9-9d5b-4bd400e3cbaa None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:24.961288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519311db-4723-43b9-9d5b-4bd400e3cbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:24.971008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:25.069639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-519311db-4723-43b9-9d5b-4bd400e3cbaa None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:25.070901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-519311db-4723-43b9-9d5b-4bd400e3cbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:25.073749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42222b-bb02-47ee-998b-13573d76548c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:25.196887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed0146-d820-430c-81ad-222d02ffef70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:25.196887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed0146-d820-430c-81ad-222d02ffef70 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:25.197246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed0146-d820-430c-81ad-222d02ffef70 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:25.197374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed0146-d820-430c-81ad-222d02ffef70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:25.199754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8aed0146-d820-430c-81ad-222d02ffef70 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:25.205214 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3042/6106] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:25.214413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519311db-4723-43b9-9d5b-4bd400e3cbaa None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:25.216500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-519311db-4723-43b9-9d5b-4bd400e3cbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:25.302437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed0146-d820-430c-81ad-222d02ffef70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:25.304748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed0146-d820-430c-81ad-222d02ffef70 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:25.317278 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3065/6107] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:17:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:17:25.366478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519311db-4723-43b9-9d5b-4bd400e3cbaa None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:25.375253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d90b6-4ce1-41d2-b61f-7cb422e8acb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:25.376145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d90b6-4ce1-41d2-b61f-7cb422e8acb6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:25.376607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d90b6-4ce1-41d2-b61f-7cb422e8acb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:25.377090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d90b6-4ce1-41d2-b61f-7cb422e8acb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:25.401664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d90b6-4ce1-41d2-b61f-7cb422e8acb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:25.404158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d90b6-4ce1-41d2-b61f-7cb422e8acb6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:25.432912 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3043/6108] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:17:25.935144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8e814-35ab-458d-8c07-b63ac1dc153e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:25.935646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8e814-35ab-458d-8c07-b63ac1dc153e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:25.935646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8e814-35ab-458d-8c07-b63ac1dc153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:25.967282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d1e8e814-35ab-458d-8c07-b63ac1dc153e None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:25.968270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d1e8e814-35ab-458d-8c07-b63ac1dc153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:25.977357 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3066/6109] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:17:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:26.026376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d90b6-4ce1-41d2-b61f-7cb422e8acb6 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:26.027877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-798d90b6-4ce1-41d2-b61f-7cb422e8acb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:26.060812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d90b6-4ce1-41d2-b61f-7cb422e8acb6 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:26.083111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb789b40-7e79-45d0-a964-b1e06e40ed7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:26.088294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb789b40-7e79-45d0-a964-b1e06e40ed7f service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:26.088294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb789b40-7e79-45d0-a964-b1e06e40ed7f service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:26.088294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb789b40-7e79-45d0-a964-b1e06e40ed7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:26.121399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb789b40-7e79-45d0-a964-b1e06e40ed7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:26.123644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb789b40-7e79-45d0-a964-b1e06e40ed7f service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:26.151700 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3044/6110] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:17:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:17:26.663447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b3ac4-7a7e-4388-9769-9c8cb5494383 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:26.663739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b3ac4-7a7e-4388-9769-9c8cb5494383 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:26.664023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b3ac4-7a7e-4388-9769-9c8cb5494383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:26.684025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ad9b3ac4-7a7e-4388-9769-9c8cb5494383 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:26.685263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ad9b3ac4-7a7e-4388-9769-9c8cb5494383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:26.689009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb789b40-7e79-45d0-a964-b1e06e40ed7f service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:26.694939 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3067/6111] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:17:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:26.695855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cb789b40-7e79-45d0-a964-b1e06e40ed7f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:26.712185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b3ac4-7a7e-4388-9769-9c8cb5494383 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:26.727106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb789b40-7e79-45d0-a964-b1e06e40ed7f service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:26.743237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b3ac4-7a7e-4388-9769-9c8cb5494383 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:26.744514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa3d2d-abf8-4c38-b174-9115800db0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:26.745240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa3d2d-abf8-4c38-b174-9115800db0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:26.745526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa3d2d-abf8-4c38-b174-9115800db0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:26.745808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa3d2d-abf8-4c38-b174-9115800db0eb admin admin] PATH_INFO: `/v3/projects/d857e4c8fa0d438cbeea93df7a8920da` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:26.746991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa3d2d-abf8-4c38-b174-9115800db0eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d857e4c8fa0d438cbeea93df7a8920da)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:26.749823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa3d2d-abf8-4c38-b174-9115800db0eb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:26.750990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83152ac4-8c8e-42b6-9c3a-be4791ac233f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:26.752141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83152ac4-8c8e-42b6-9c3a-be4791ac233f service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:26.753383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83152ac4-8c8e-42b6-9c3a-be4791ac233f service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:26.754441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83152ac4-8c8e-42b6-9c3a-be4791ac233f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:26.764413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83152ac4-8c8e-42b6-9c3a-be4791ac233f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:26.766784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83152ac4-8c8e-42b6-9c3a-be4791ac233f service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:26.778044 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3068/6112] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:17:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:17:26.839695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ffa3d2d-abf8-4c38-b174-9115800db0eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd857e4c8fa0d438cbeea93df7a8920da', 'request_id': 'req-6ffa3d2d-abf8-4c38-b174-9115800db0eb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:26.844432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:26.861011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ffa3d2d-abf8-4c38-b174-9115800db0eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd857e4c8fa0d438cbeea93df7a8920da', 'request_id': 'req-6ffa3d2d-abf8-4c38-b174-9115800db0eb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:26.883282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ffa3d2d-abf8-4c38-b174-9115800db0eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd857e4c8fa0d438cbeea93df7a8920da', 'request_id': 'req-6ffa3d2d-abf8-4c38-b174-9115800db0eb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:26.897514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ffa3d2d-abf8-4c38-b174-9115800db0eb admin admin] The token cache is being invalidate because project d857e4c8fa0d438cbeea93df7a8920da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:26.897829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ffa3d2d-abf8-4c38-b174-9115800db0eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:26.898948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ffa3d2d-abf8-4c38-b174-9115800db0eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:26.901046 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3045/6113] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:26 2022] DELETE /identity/v3/projects/d857e4c8fa0d438cbeea93df7a8920da => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:26.904837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83152ac4-8c8e-42b6-9c3a-be4791ac233f service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:26.916919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83152ac4-8c8e-42b6-9c3a-be4791ac233f service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:26.999714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:27.030306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0cfc7-4057-46a9-bf5a-111325228b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:27.031013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0cfc7-4057-46a9-bf5a-111325228b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:27.031336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0cfc7-4057-46a9-bf5a-111325228b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:27.031590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0cfc7-4057-46a9-bf5a-111325228b18 admin admin] PATH_INFO: `/v3/users/04480384988845b6b02d86b4a6b32ae8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:27.033895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0cfc7-4057-46a9-bf5a-111325228b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04480384988845b6b02d86b4a6b32ae8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:27.035982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0cfc7-4057-46a9-bf5a-111325228b18 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:27.059600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d216a97-4115-4f31-84fb-c353b792d594 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:27.060440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d216a97-4115-4f31-84fb-c353b792d594 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:27.061157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d216a97-4115-4f31-84fb-c353b792d594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:27.092293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2d216a97-4115-4f31-84fb-c353b792d594 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:27.094871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2d216a97-4115-4f31-84fb-c353b792d594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:27.121920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-92d0cfc7-4057-46a9-bf5a-111325228b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04480384988845b6b02d86b4a6b32ae8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:27.134153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-92d0cfc7-4057-46a9-bf5a-111325228b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04480384988845b6b02d86b4a6b32ae8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:27.135075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-92d0cfc7-4057-46a9-bf5a-111325228b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04480384988845b6b02d86b4a6b32ae8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:27.151628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-92d0cfc7-4057-46a9-bf5a-111325228b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04480384988845b6b02d86b4a6b32ae8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:27.153881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-92d0cfc7-4057-46a9-bf5a-111325228b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04480384988845b6b02d86b4a6b32ae8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:27.203916 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3046/6114] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:17:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:27.215423 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3069/6115] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:26 2022] DELETE /identity/v3/users/04480384988845b6b02d86b4a6b32ae8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:27.220104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d216a97-4115-4f31-84fb-c353b792d594 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:27.223936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2d216a97-4115-4f31-84fb-c353b792d594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:27.399437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d216a97-4115-4f31-84fb-c353b792d594 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:27.501422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05de9b-a0c1-4f66-964d-ff51ec99d4a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:27.504101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05de9b-a0c1-4f66-964d-ff51ec99d4a4 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:27.504622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05de9b-a0c1-4f66-964d-ff51ec99d4a4 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:27.505121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05de9b-a0c1-4f66-964d-ff51ec99d4a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:27.574568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:27.618317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05de9b-a0c1-4f66-964d-ff51ec99d4a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:27.621065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05de9b-a0c1-4f66-964d-ff51ec99d4a4 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:27.633188 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3047/6116] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:17:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:17:28.098650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeb5be-1832-4b55-b8b2-a32d9fc95624 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:28.099850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeb5be-1832-4b55-b8b2-a32d9fc95624 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:28.100224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeb5be-1832-4b55-b8b2-a32d9fc95624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:28.125352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-febeb5be-1832-4b55-b8b2-a32d9fc95624 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:28.127094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-febeb5be-1832-4b55-b8b2-a32d9fc95624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:28.135697 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3070/6117] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:17:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:28.152078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05de9b-a0c1-4f66-964d-ff51ec99d4a4 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:28.166098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05de9b-a0c1-4f66-964d-ff51ec99d4a4 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:28.173130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a61896-d3c6-46bd-8314-7438c4c0fdc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:28.173770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a61896-d3c6-46bd-8314-7438c4c0fdc2 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:28.174064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a61896-d3c6-46bd-8314-7438c4c0fdc2 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:28.174346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a61896-d3c6-46bd-8314-7438c4c0fdc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:28.185636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a61896-d3c6-46bd-8314-7438c4c0fdc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:28.187218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a61896-d3c6-46bd-8314-7438c4c0fdc2 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:28.199400 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3048/6118] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:17:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:17:28.291340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeb5be-1832-4b55-b8b2-a32d9fc95624 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:28.293053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-febeb5be-1832-4b55-b8b2-a32d9fc95624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:28.396288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeb5be-1832-4b55-b8b2-a32d9fc95624 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:28.406249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03d735-122d-44e9-9cf7-e87bce84c5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:28.407422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03d735-122d-44e9-9cf7-e87bce84c5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:28.407715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03d735-122d-44e9-9cf7-e87bce84c5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:28.408178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03d735-122d-44e9-9cf7-e87bce84c5ea admin admin] PATH_INFO: `/v3/projects/6030a7ce0eaa4eaf96496de92ca0701e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:28.410374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03d735-122d-44e9-9cf7-e87bce84c5ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=6030a7ce0eaa4eaf96496de92ca0701e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:28.412504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03d735-122d-44e9-9cf7-e87bce84c5ea admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:28.477097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fc03d735-122d-44e9-9cf7-e87bce84c5ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6030a7ce0eaa4eaf96496de92ca0701e', 'request_id': 'req-fc03d735-122d-44e9-9cf7-e87bce84c5ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:28.486088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fc03d735-122d-44e9-9cf7-e87bce84c5ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6030a7ce0eaa4eaf96496de92ca0701e', 'request_id': 'req-fc03d735-122d-44e9-9cf7-e87bce84c5ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:28.494166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fc03d735-122d-44e9-9cf7-e87bce84c5ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6030a7ce0eaa4eaf96496de92ca0701e', 'request_id': 'req-fc03d735-122d-44e9-9cf7-e87bce84c5ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:28.496404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:28.507479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d179-d4db-4d99-90b0-891c2e74a77b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:28.508037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d179-d4db-4d99-90b0-891c2e74a77b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:28.508827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5d179-d4db-4d99-90b0-891c2e74a77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:28.522800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fc03d735-122d-44e9-9cf7-e87bce84c5ea admin admin] The token cache is being invalidate because project 6030a7ce0eaa4eaf96496de92ca0701e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:28.523295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fc03d735-122d-44e9-9cf7-e87bce84c5ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:28.524034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fc03d735-122d-44e9-9cf7-e87bce84c5ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:28.532375 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3071/6119] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:28 2022] DELETE /identity/v3/projects/6030a7ce0eaa4eaf96496de92ca0701e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:28.533872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497088c-e3e1-4714-be72-0adab4acd31c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:28.534890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497088c-e3e1-4714-be72-0adab4acd31c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:28.535285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497088c-e3e1-4714-be72-0adab4acd31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:28.536379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-21b5d179-d4db-4d99-90b0-891c2e74a77b None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:28.538063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-21b5d179-d4db-4d99-90b0-891c2e74a77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:28.583180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6497088c-e3e1-4714-be72-0adab4acd31c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:28.585301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6497088c-e3e1-4714-be72-0adab4acd31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:28.629058 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3049/6120] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:17:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:28.641656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5d179-d4db-4d99-90b0-891c2e74a77b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:28.644140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-21b5d179-d4db-4d99-90b0-891c2e74a77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:28.690723 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3072/6121] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:28.692231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809883e-c050-4302-8933-b0df0c5552d7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:28.692556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809883e-c050-4302-8933-b0df0c5552d7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:28.692834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809883e-c050-4302-8933-b0df0c5552d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:28.720609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2809883e-c050-4302-8933-b0df0c5552d7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:28.723606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2809883e-c050-4302-8933-b0df0c5552d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:28.736796 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3073/6122] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:28.737773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809883e-c050-4302-8933-b0df0c5552d7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:28.742718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5d179-d4db-4d99-90b0-891c2e74a77b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:28.749354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809883e-c050-4302-8933-b0df0c5552d7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:28.750177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad4d59-81f8-478d-a196-bfc60a1eca45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:28.751116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad4d59-81f8-478d-a196-bfc60a1eca45 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:28.751675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad4d59-81f8-478d-a196-bfc60a1eca45 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:28.752193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad4d59-81f8-478d-a196-bfc60a1eca45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:28.763243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08bbe8-4e4f-4846-aac4-a8bf26c7c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:28.764095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08bbe8-4e4f-4846-aac4-a8bf26c7c820 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:28.764391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08bbe8-4e4f-4846-aac4-a8bf26c7c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:28.764651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad4d59-81f8-478d-a196-bfc60a1eca45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:28.765504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08bbe8-4e4f-4846-aac4-a8bf26c7c820 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:28.766236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08bbe8-4e4f-4846-aac4-a8bf26c7c820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:28.766631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad4d59-81f8-478d-a196-bfc60a1eca45 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:28.766808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08bbe8-4e4f-4846-aac4-a8bf26c7c820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:28.768286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08bbe8-4e4f-4846-aac4-a8bf26c7c820 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:28.778727 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3050/6123] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:17:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:17:28.828108 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3074/6124] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:28.836415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad4d59-81f8-478d-a196-bfc60a1eca45 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:28.860911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad4d59-81f8-478d-a196-bfc60a1eca45 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:28.867522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d78c1-61a5-4ba6-9903-cf2ebcea8c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:28.868265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d78c1-61a5-4ba6-9903-cf2ebcea8c99 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:28.868541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d78c1-61a5-4ba6-9903-cf2ebcea8c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:28.868816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d78c1-61a5-4ba6-9903-cf2ebcea8c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:28.870912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d78c1-61a5-4ba6-9903-cf2ebcea8c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:28.874128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d78c1-61a5-4ba6-9903-cf2ebcea8c99 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:28.926976 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3051/6125] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:28 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:28.931068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08bbe8-4e4f-4846-aac4-a8bf26c7c820 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:28.947073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08bbe8-4e4f-4846-aac4-a8bf26c7c820 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:29.044626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d78c1-61a5-4ba6-9903-cf2ebcea8c99 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:29.046618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-229d78c1-61a5-4ba6-9903-cf2ebcea8c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:29.059347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0dee5-f1e0-4b47-b69e-58c8644bb78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:29.059981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0dee5-f1e0-4b47-b69e-58c8644bb78f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:29.060269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0dee5-f1e0-4b47-b69e-58c8644bb78f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:29.060606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0dee5-f1e0-4b47-b69e-58c8644bb78f admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:29.061217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0dee5-f1e0-4b47-b69e-58c8644bb78f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:29.064517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0dee5-f1e0-4b47-b69e-58c8644bb78f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:29.098692 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3075/6126] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:28 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:17:29.104654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0dee5-f1e0-4b47-b69e-58c8644bb78f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:29.109294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:29.131216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0dee5-f1e0-4b47-b69e-58c8644bb78f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:29.143245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633cd8d-9188-4b2b-8c20-8e5786a141a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:29.145175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633cd8d-9188-4b2b-8c20-8e5786a141a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:29.145731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633cd8d-9188-4b2b-8c20-8e5786a141a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:29.146012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633cd8d-9188-4b2b-8c20-8e5786a141a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:29.146885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633cd8d-9188-4b2b-8c20-8e5786a141a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:29.148693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633cd8d-9188-4b2b-8c20-8e5786a141a0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:29.162074 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3076/6127] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:29.165572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d78c1-61a5-4ba6-9903-cf2ebcea8c99 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:29.170649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:29.171414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:29.171699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:29.172131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] PATH_INFO: `/v3/users/102c1b905fae4f1d8ece205d85178bdc` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:29.173483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=102c1b905fae4f1d8ece205d85178bdc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:29.175785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:29.250724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102c1b905fae4f1d8ece205d85178bdc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:29.258146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633cd8d-9188-4b2b-8c20-8e5786a141a0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:29.274705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102c1b905fae4f1d8ece205d85178bdc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:29.275793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102c1b905fae4f1d8ece205d85178bdc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:29.286480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633cd8d-9188-4b2b-8c20-8e5786a141a0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:29.293162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b5e31-9175-4451-b8c7-9e21d63b2b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:29.294622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b5e31-9175-4451-b8c7-9e21d63b2b95 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:29.295296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b5e31-9175-4451-b8c7-9e21d63b2b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:29.295840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b5e31-9175-4451-b8c7-9e21d63b2b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:29.296652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b5e31-9175-4451-b8c7-9e21d63b2b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:29.301082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b5e31-9175-4451-b8c7-9e21d63b2b95 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:29.306264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102c1b905fae4f1d8ece205d85178bdc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:29.307844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102c1b905fae4f1d8ece205d85178bdc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:29.313815 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3077/6128] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:17:29.316344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b5e31-9175-4451-b8c7-9e21d63b2b95 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:29.319745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-586b5e31-9175-4451-b8c7-9e21d63b2b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:29.339504 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3052/6129] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:29 2022] DELETE /identity/v3/users/102c1b905fae4f1d8ece205d85178bdc => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:29.340695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:29.344029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:29.430082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:29.450340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625839e-8608-4f2a-91a2-f49442681769 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:29.457509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d6bd7-5977-42a3-90fa-e927292246a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:29.458335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d6bd7-5977-42a3-90fa-e927292246a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:29.458819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d6bd7-5977-42a3-90fa-e927292246a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:29.459157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d6bd7-5977-42a3-90fa-e927292246a2 admin admin] PATH_INFO: `/v3/projects/e8f284960f2f429b9d781b863bd0d238/users/a6037ef140814c6e947e446e1895c266/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:29.478948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d6bd7-5977-42a3-90fa-e927292246a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f284960f2f429b9d781b863bd0d238, user_id=a6037ef140814c6e947e446e1895c266, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:29.481898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d6bd7-5977-42a3-90fa-e927292246a2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:29.490127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b5e31-9175-4451-b8c7-9e21d63b2b95 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:29.502581 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3053/6130] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:29 2022] PUT /identity/v3/projects/e8f284960f2f429b9d781b863bd0d238/users/a6037ef140814c6e947e446e1895c266/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:29.505238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc20d-944c-43a6-b00a-2e6194633302 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:29.505678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc20d-944c-43a6-b00a-2e6194633302 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:29.506188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc20d-944c-43a6-b00a-2e6194633302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:29.528698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-386fc20d-944c-43a6-b00a-2e6194633302 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:29.530469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-386fc20d-944c-43a6-b00a-2e6194633302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:29.583252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:29.588721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f2dee-e1ea-4424-bd10-7f4cc9e2af28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:29.589526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f2dee-e1ea-4424-bd10-7f4cc9e2af28 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:29.590754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f2dee-e1ea-4424-bd10-7f4cc9e2af28 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:29.591249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f2dee-e1ea-4424-bd10-7f4cc9e2af28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:29.595558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-666f2dee-e1ea-4424-bd10-7f4cc9e2af28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:29.626375 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3054/6131] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:29.628959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767f41-5790-4d28-bc29-04994cd8b397 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:29.635987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767f41-5790-4d28-bc29-04994cd8b397 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:29.636340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767f41-5790-4d28-bc29-04994cd8b397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:29.669223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8a767f41-5790-4d28-bc29-04994cd8b397 None None] MFA Rules not processed for user `a6037ef140814c6e947e446e1895c266`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:29.670559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8a767f41-5790-4d28-bc29-04994cd8b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:29.691061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f2dee-e1ea-4424-bd10-7f4cc9e2af28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:29.693816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f2dee-e1ea-4424-bd10-7f4cc9e2af28 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:29.715877 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3078/6132] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:29.717306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f2dee-e1ea-4424-bd10-7f4cc9e2af28 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:29.718965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-666f2dee-e1ea-4424-bd10-7f4cc9e2af28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:29.750239 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3055/6133] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:29.764043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a767f41-5790-4d28-bc29-04994cd8b397 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:29.765657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8a767f41-5790-4d28-bc29-04994cd8b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:29.791175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f2dee-e1ea-4424-bd10-7f4cc9e2af28 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:29.803759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:29.850502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a767f41-5790-4d28-bc29-04994cd8b397 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:29.854845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ff304-2e32-48bc-9b34-fb67819b6765 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:29.855548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ff304-2e32-48bc-9b34-fb67819b6765 service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:29.855925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ff304-2e32-48bc-9b34-fb67819b6765 service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:29.856274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ff304-2e32-48bc-9b34-fb67819b6765 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:29.860200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceadb79-fb02-4350-90ec-c2ac614c616e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:29.861131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceadb79-fb02-4350-90ec-c2ac614c616e service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:29.861523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceadb79-fb02-4350-90ec-c2ac614c616e service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:29.862809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceadb79-fb02-4350-90ec-c2ac614c616e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:29.866710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ff304-2e32-48bc-9b34-fb67819b6765 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:29.868189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ff304-2e32-48bc-9b34-fb67819b6765 service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:29.874349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceadb79-fb02-4350-90ec-c2ac614c616e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:29.875983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceadb79-fb02-4350-90ec-c2ac614c616e service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:29.879836 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3056/6134] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:29.887590 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3079/6135] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:30.268377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ff304-2e32-48bc-9b34-fb67819b6765 service glance] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:30.272012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e20ff304-2e32-48bc-9b34-fb67819b6765 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:30.299173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ff304-2e32-48bc-9b34-fb67819b6765 service glance] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:30.316084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbb14e-4ed6-44d2-881c-3d751986df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:30.317663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbb14e-4ed6-44d2-881c-3d751986df1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:30.318160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbb14e-4ed6-44d2-881c-3d751986df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:30.318735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbb14e-4ed6-44d2-881c-3d751986df1d admin admin] PATH_INFO: `/v3/projects/649393a995eb42a3b893200c2f39bdf4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:30.320188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbb14e-4ed6-44d2-881c-3d751986df1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=649393a995eb42a3b893200c2f39bdf4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:30.323204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbb14e-4ed6-44d2-881c-3d751986df1d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:30.382644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceadb79-fb02-4350-90ec-c2ac614c616e service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:30.396475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceadb79-fb02-4350-90ec-c2ac614c616e service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:30.401849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-77dbb14e-4ed6-44d2-881c-3d751986df1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649393a995eb42a3b893200c2f39bdf4', 'request_id': 'req-77dbb14e-4ed6-44d2-881c-3d751986df1d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:30.414336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-77dbb14e-4ed6-44d2-881c-3d751986df1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649393a995eb42a3b893200c2f39bdf4', 'request_id': 'req-77dbb14e-4ed6-44d2-881c-3d751986df1d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:30.415304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:30.435494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-77dbb14e-4ed6-44d2-881c-3d751986df1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649393a995eb42a3b893200c2f39bdf4', 'request_id': 'req-77dbb14e-4ed6-44d2-881c-3d751986df1d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:30.470139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-77dbb14e-4ed6-44d2-881c-3d751986df1d admin admin] The token cache is being invalidate because project 649393a995eb42a3b893200c2f39bdf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:30.471000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-77dbb14e-4ed6-44d2-881c-3d751986df1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:30.472345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-77dbb14e-4ed6-44d2-881c-3d751986df1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:30.478906 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3057/6136] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:30 2022] DELETE /identity/v3/projects/649393a995eb42a3b893200c2f39bdf4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:30.480426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1028f-d57e-44bb-bc69-ac73a59ae5a7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:30.480648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1028f-d57e-44bb-bc69-ac73a59ae5a7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:30.481071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1028f-d57e-44bb-bc69-ac73a59ae5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:30.490883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2700839-da95-4f2b-98f3-caa3ae9d5fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:30.492451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2700839-da95-4f2b-98f3-caa3ae9d5fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:30.493111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2700839-da95-4f2b-98f3-caa3ae9d5fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:30.493558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2700839-da95-4f2b-98f3-caa3ae9d5fb1 admin admin] PATH_INFO: `/v3/users/a6037ef140814c6e947e446e1895c266` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:30.494995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2700839-da95-4f2b-98f3-caa3ae9d5fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6037ef140814c6e947e446e1895c266)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:30.497258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2700839-da95-4f2b-98f3-caa3ae9d5fb1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:30.505116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-33a1028f-d57e-44bb-bc69-ac73a59ae5a7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:30.505758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-33a1028f-d57e-44bb-bc69-ac73a59ae5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:30.523416 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3058/6137] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:30.524756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f71fc4-f1a3-49e3-baaf-7d0d2904e5c7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:30.525047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f71fc4-f1a3-49e3-baaf-7d0d2904e5c7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:30.525329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f71fc4-f1a3-49e3-baaf-7d0d2904e5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:30.548832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e4f71fc4-f1a3-49e3-baaf-7d0d2904e5c7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:30.550403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e4f71fc4-f1a3-49e3-baaf-7d0d2904e5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:30.560055 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3059/6138] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:30.561856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2700839-da95-4f2b-98f3-caa3ae9d5fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6037ef140814c6e947e446e1895c266'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:30.568726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f71fc4-f1a3-49e3-baaf-7d0d2904e5c7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:30.578508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2700839-da95-4f2b-98f3-caa3ae9d5fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6037ef140814c6e947e446e1895c266'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:30.579616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2700839-da95-4f2b-98f3-caa3ae9d5fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6037ef140814c6e947e446e1895c266'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:30.580007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f71fc4-f1a3-49e3-baaf-7d0d2904e5c7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:30.589303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb66b7c-52b4-4135-b896-bb3c10aa6edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:30.590081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb66b7c-52b4-4135-b896-bb3c10aa6edb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:30.590359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb66b7c-52b4-4135-b896-bb3c10aa6edb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:30.590644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb66b7c-52b4-4135-b896-bb3c10aa6edb admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:30.591396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb66b7c-52b4-4135-b896-bb3c10aa6edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:30.591717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb66b7c-52b4-4135-b896-bb3c10aa6edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:30.592358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2700839-da95-4f2b-98f3-caa3ae9d5fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6037ef140814c6e947e446e1895c266'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:30.593313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2700839-da95-4f2b-98f3-caa3ae9d5fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6037ef140814c6e947e446e1895c266'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:30.593630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb66b7c-52b4-4135-b896-bb3c10aa6edb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:30.610788 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3060/6139] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:17:30.614412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb66b7c-52b4-4135-b896-bb3c10aa6edb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:30.619542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ceb66b7c-52b4-4135-b896-bb3c10aa6edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:30.622958 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3080/6140] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:30 2022] DELETE /identity/v3/users/a6037ef140814c6e947e446e1895c266 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:30.627103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16cea-bad6-44aa-87cb-9f882417503a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:30.627559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16cea-bad6-44aa-87cb-9f882417503a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:30.628629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f16cea-bad6-44aa-87cb-9f882417503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:30.639200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb66b7c-52b4-4135-b896-bb3c10aa6edb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:30.653000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-39f16cea-bad6-44aa-87cb-9f882417503a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:30.655337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-39f16cea-bad6-44aa-87cb-9f882417503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:30.705157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:30.820123 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3081/6141] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:30.831165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f16cea-bad6-44aa-87cb-9f882417503a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:30.832803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-39f16cea-bad6-44aa-87cb-9f882417503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:30.833547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9bf23-534d-49e0-b173-716c4758e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:30.836956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9bf23-534d-49e0-b173-716c4758e83e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:30.837377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9bf23-534d-49e0-b173-716c4758e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:30.837797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9bf23-534d-49e0-b173-716c4758e83e admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:30.841346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9bf23-534d-49e0-b173-716c4758e83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:30.849085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9bf23-534d-49e0-b173-716c4758e83e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:30.933839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f16cea-bad6-44aa-87cb-9f882417503a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:30.937908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b0012-083a-4762-b9d6-50d7f16db505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:30.938528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b0012-083a-4762-b9d6-50d7f16db505 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:30.942466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b0012-083a-4762-b9d6-50d7f16db505 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:30.942466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b0012-083a-4762-b9d6-50d7f16db505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:30.956413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b0012-083a-4762-b9d6-50d7f16db505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:30.958901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b0012-083a-4762-b9d6-50d7f16db505 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:30.963069 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3061/6142] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:30 2022] POST /identity/v3/projects => generated 385 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:30.964002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9bf23-534d-49e0-b173-716c4758e83e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:30.982018 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3082/6143] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:31.079282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9bf23-534d-49e0-b173-716c4758e83e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:31.085953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44b1d1-3e7b-4a1f-9def-99c664e8d57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:31.086638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44b1d1-3e7b-4a1f-9def-99c664e8d57a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:31.087123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44b1d1-3e7b-4a1f-9def-99c664e8d57a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:31.087401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44b1d1-3e7b-4a1f-9def-99c664e8d57a admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:31.089569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44b1d1-3e7b-4a1f-9def-99c664e8d57a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:31.092607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44b1d1-3e7b-4a1f-9def-99c664e8d57a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:31.132851 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3062/6144] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:30 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:31.134465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b0012-083a-4762-b9d6-50d7f16db505 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:31.147498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b0012-083a-4762-b9d6-50d7f16db505 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:31.153642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ecae7-cfcb-425b-bb8b-df958d3c1101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:31.155172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ecae7-cfcb-425b-bb8b-df958d3c1101 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:31.155616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ecae7-cfcb-425b-bb8b-df958d3c1101 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:31.156036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ecae7-cfcb-425b-bb8b-df958d3c1101 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:31.156803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ecae7-cfcb-425b-bb8b-df958d3c1101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:31.159468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ecae7-cfcb-425b-bb8b-df958d3c1101 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:31.175905 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3083/6145] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:31.176884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44b1d1-3e7b-4a1f-9def-99c664e8d57a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:31.216523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44b1d1-3e7b-4a1f-9def-99c664e8d57a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:31.229123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daebde-a32f-44c8-a4f4-8b45141663c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:31.230100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daebde-a32f-44c8-a4f4-8b45141663c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:31.230585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daebde-a32f-44c8-a4f4-8b45141663c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:31.231201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daebde-a32f-44c8-a4f4-8b45141663c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:31.232059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daebde-a32f-44c8-a4f4-8b45141663c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:31.234701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daebde-a32f-44c8-a4f4-8b45141663c0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:31.252595 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3063/6146] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:31.257058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ecae7-cfcb-425b-bb8b-df958d3c1101 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:31.272827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ecae7-cfcb-425b-bb8b-df958d3c1101 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:31.287601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7c985-c5b6-4249-b09c-65a2925dfccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:31.287780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c985-c5b6-4249-b09c-65a2925dfccf admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:31.288070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c985-c5b6-4249-b09c-65a2925dfccf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:31.288326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c985-c5b6-4249-b09c-65a2925dfccf admin admin] PATH_INFO: `/v3/projects/3e40072130c743c8bc9a2f37b3bb7072/users/cab11bd231d842798477873c89e02b5b/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:31.310046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7c985-c5b6-4249-b09c-65a2925dfccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e40072130c743c8bc9a2f37b3bb7072, user_id=cab11bd231d842798477873c89e02b5b, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:31.313450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7c985-c5b6-4249-b09c-65a2925dfccf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:31.335794 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3084/6147] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:31 2022] PUT /identity/v3/projects/3e40072130c743c8bc9a2f37b3bb7072/users/cab11bd231d842798477873c89e02b5b/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:31.348374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97d30c-b180-4677-8bda-0cdb30f4e8a6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:31.349031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97d30c-b180-4677-8bda-0cdb30f4e8a6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:31.349031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97d30c-b180-4677-8bda-0cdb30f4e8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:31.400570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2d97d30c-b180-4677-8bda-0cdb30f4e8a6 None None] MFA Rules not processed for user `cab11bd231d842798477873c89e02b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:31.402550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2d97d30c-b180-4677-8bda-0cdb30f4e8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:31.411311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7c985-c5b6-4249-b09c-65a2925dfccf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:31.413284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-13a7c985-c5b6-4249-b09c-65a2925dfccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:31.420401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:31.536668 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3064/6148] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:31.539002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7c985-c5b6-4249-b09c-65a2925dfccf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:31.541073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97d30c-b180-4677-8bda-0cdb30f4e8a6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:31.546067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:31.546923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:31.547734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:31.548022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60 admin admin] PATH_INFO: `/v3/projects/e8f284960f2f429b9d781b863bd0d238` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:31.550644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f284960f2f429b9d781b863bd0d238)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:31.552958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:31.554329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97d30c-b180-4677-8bda-0cdb30f4e8a6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:31.566518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b616d0-68f0-42e2-8308-69f6975635aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:31.573243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b616d0-68f0-42e2-8308-69f6975635aa admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:31.573617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b616d0-68f0-42e2-8308-69f6975635aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:31.574377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b616d0-68f0-42e2-8308-69f6975635aa admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:31.581749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b616d0-68f0-42e2-8308-69f6975635aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:31.581749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b616d0-68f0-42e2-8308-69f6975635aa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:31.624333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:31.630438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f284960f2f429b9d781b863bd0d238', 'request_id': 'req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:31.639420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f284960f2f429b9d781b863bd0d238', 'request_id': 'req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:31.650694 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3065/6149] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:31 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:17:31.654672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b616d0-68f0-42e2-8308-69f6975635aa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:31.661554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f284960f2f429b9d781b863bd0d238', 'request_id': 'req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:31.698219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60 admin admin] The token cache is being invalidate because project e8f284960f2f429b9d781b863bd0d238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:31.698617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:31.703238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f1d80dbe-c05d-4bda-bf08-910faf1d3d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:31.704860 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3085/6150] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:31 2022] DELETE /identity/v3/projects/e8f284960f2f429b9d781b863bd0d238 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:31.710887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510baa7-4c75-4192-a2c8-6fdf6a38869e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:31.711185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510baa7-4c75-4192-a2c8-6fdf6a38869e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:31.711451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510baa7-4c75-4192-a2c8-6fdf6a38869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:31.751819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7510baa7-4c75-4192-a2c8-6fdf6a38869e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:31.754323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b616d0-68f0-42e2-8308-69f6975635aa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:31.756459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7510baa7-4c75-4192-a2c8-6fdf6a38869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:31.765626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91b5d6-7764-4881-9a11-1261ef91deb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:31.767688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91b5d6-7764-4881-9a11-1261ef91deb9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:31.769252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91b5d6-7764-4881-9a11-1261ef91deb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:31.770613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91b5d6-7764-4881-9a11-1261ef91deb9 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:31.772256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91b5d6-7764-4881-9a11-1261ef91deb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:31.781688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91b5d6-7764-4881-9a11-1261ef91deb9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:31.782351 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3086/6151] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:31.790051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c284e-e2c5-47ef-b7f3-4bb25db58369 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:31.791603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c284e-e2c5-47ef-b7f3-4bb25db58369 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:31.792989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c284e-e2c5-47ef-b7f3-4bb25db58369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:31.837073 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3066/6152] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:31 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:31.838112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91b5d6-7764-4881-9a11-1261ef91deb9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:31.840689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-220c284e-e2c5-47ef-b7f3-4bb25db58369 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:31.841707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6b91b5d6-7764-4881-9a11-1261ef91deb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:31.844038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-220c284e-e2c5-47ef-b7f3-4bb25db58369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:31.859896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91b5d6-7764-4881-9a11-1261ef91deb9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:31.860794 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3087/6153] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:31.862843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c284e-e2c5-47ef-b7f3-4bb25db58369 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:31.866006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9d47c-3c4d-4399-868a-3ed0a71ec49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:31.866904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9d47c-3c4d-4399-868a-3ed0a71ec49d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:31.867274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9d47c-3c4d-4399-868a-3ed0a71ec49d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:31.867611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9d47c-3c4d-4399-868a-3ed0a71ec49d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:31.868343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9d47c-3c4d-4399-868a-3ed0a71ec49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:31.870495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9d47c-3c4d-4399-868a-3ed0a71ec49d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:31.880578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c284e-e2c5-47ef-b7f3-4bb25db58369 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:31.886728 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3067/6154] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:31.887916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9d47c-3c4d-4399-868a-3ed0a71ec49d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:31.890424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd038c6-6b27-4655-939d-197d411c015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:31.892577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd038c6-6b27-4655-939d-197d411c015a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:31.893102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd038c6-6b27-4655-939d-197d411c015a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:31.894550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd038c6-6b27-4655-939d-197d411c015a admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:31.895965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd038c6-6b27-4655-939d-197d411c015a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:31.897462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd038c6-6b27-4655-939d-197d411c015a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:31.899842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd038c6-6b27-4655-939d-197d411c015a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:31.900616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9d47c-3c4d-4399-868a-3ed0a71ec49d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:31.908343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb0765-20cc-4316-b837-9fc8125ddc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:31.909822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb0765-20cc-4316-b837-9fc8125ddc86 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:31.910100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb0765-20cc-4316-b837-9fc8125ddc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:31.910727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb0765-20cc-4316-b837-9fc8125ddc86 admin admin] PATH_INFO: `/v3/projects/f2512813b5544538a01a11de22bcbeab/users/c414a30c879d4c47b09578c5dd0cc993/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:31.933680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb0765-20cc-4316-b837-9fc8125ddc86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2512813b5544538a01a11de22bcbeab, user_id=c414a30c879d4c47b09578c5dd0cc993, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:31.936870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb0765-20cc-4316-b837-9fc8125ddc86 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:31.951885 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3088/6155] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:31.954718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd038c6-6b27-4655-939d-197d411c015a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:31.974123 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3068/6156] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:31 2022] PUT /identity/v3/projects/f2512813b5544538a01a11de22bcbeab/users/c414a30c879d4c47b09578c5dd0cc993/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:31.997671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb0765-20cc-4316-b837-9fc8125ddc86 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:32.002447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd038c6-6b27-4655-939d-197d411c015a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:32.093346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:32.124705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f6281-15ea-4ddb-a3ad-60ae218f6486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:32.125066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb0765-20cc-4316-b837-9fc8125ddc86 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:32.125411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f6281-15ea-4ddb-a3ad-60ae218f6486 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:32.125695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f6281-15ea-4ddb-a3ad-60ae218f6486 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:32.125975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f6281-15ea-4ddb-a3ad-60ae218f6486 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:32.126784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f6281-15ea-4ddb-a3ad-60ae218f6486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:32.129295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f6281-15ea-4ddb-a3ad-60ae218f6486 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:32.131834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025535ce-3d55-4076-8215-3ce8581a95c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:32.132718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025535ce-3d55-4076-8215-3ce8581a95c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:32.133203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025535ce-3d55-4076-8215-3ce8581a95c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:32.133924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025535ce-3d55-4076-8215-3ce8581a95c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:32.135116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025535ce-3d55-4076-8215-3ce8581a95c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:32.137440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025535ce-3d55-4076-8215-3ce8581a95c3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:32.156841 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3069/6157] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:32.161223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025535ce-3d55-4076-8215-3ce8581a95c3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:32.177886 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3089/6158] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:31 2022] POST /identity/v3/projects => generated 395 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:17:32.179042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025535ce-3d55-4076-8215-3ce8581a95c3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:32.182412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f6281-15ea-4ddb-a3ad-60ae218f6486 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:32.276293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f6281-15ea-4ddb-a3ad-60ae218f6486 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:32.279453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4437c1e-a4d5-4ea7-a57a-67aa7fbbd770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:32.280423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4437c1e-a4d5-4ea7-a57a-67aa7fbbd770 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:32.281019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4437c1e-a4d5-4ea7-a57a-67aa7fbbd770 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:32.281395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4444d2-8a6a-4d55-bed1-4e072a8f9df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:32.281977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4437c1e-a4d5-4ea7-a57a-67aa7fbbd770 admin admin] PATH_INFO: `/v3/projects/f2512813b5544538a01a11de22bcbeab/users/c414a30c879d4c47b09578c5dd0cc993/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:32.282104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4444d2-8a6a-4d55-bed1-4e072a8f9df1 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:32.282347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4444d2-8a6a-4d55-bed1-4e072a8f9df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:32.282625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4444d2-8a6a-4d55-bed1-4e072a8f9df1 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:32.283309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4444d2-8a6a-4d55-bed1-4e072a8f9df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:32.286423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4444d2-8a6a-4d55-bed1-4e072a8f9df1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:32.286632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4437c1e-a4d5-4ea7-a57a-67aa7fbbd770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2512813b5544538a01a11de22bcbeab, user_id=c414a30c879d4c47b09578c5dd0cc993, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:32.290034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4437c1e-a4d5-4ea7-a57a-67aa7fbbd770 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:32.317339 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3070/6159] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:32 2022] PUT /identity/v3/projects/f2512813b5544538a01a11de22bcbeab/users/c414a30c879d4c47b09578c5dd0cc993/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:17:32.319666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7a4ee-1fef-47a2-986a-76bec4bdd2ba None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:32.322569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7a4ee-1fef-47a2-986a-76bec4bdd2ba None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:32.322941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7a4ee-1fef-47a2-986a-76bec4bdd2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:32.330899 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3090/6160] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:32 2022] POST /identity/v3/users => generated 298 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:32.334724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4444d2-8a6a-4d55-bed1-4e072a8f9df1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:32.351064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4444d2-8a6a-4d55-bed1-4e072a8f9df1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:32.380542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:32.386604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-51a7a4ee-1fef-47a2-986a-76bec4bdd2ba None None] MFA Rules not processed for user `c414a30c879d4c47b09578c5dd0cc993`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:32.387947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-51a7a4ee-1fef-47a2-986a-76bec4bdd2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:32.462912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b07316-11dc-4199-bca9-b4502b3d268f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:32.463582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07316-11dc-4199-bca9-b4502b3d268f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:32.463896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07316-11dc-4199-bca9-b4502b3d268f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:32.464186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07316-11dc-4199-bca9-b4502b3d268f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:32.465178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b07316-11dc-4199-bca9-b4502b3d268f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:32.467367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b07316-11dc-4199-bca9-b4502b3d268f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:32.485912 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3091/6161] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:17:32.486869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b07316-11dc-4199-bca9-b4502b3d268f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:32.492349 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3071/6162] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:32.503965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b07316-11dc-4199-bca9-b4502b3d268f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:32.505768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7a4ee-1fef-47a2-986a-76bec4bdd2ba None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:32.507675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-51a7a4ee-1fef-47a2-986a-76bec4bdd2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:32.509496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89ed49-11cd-467b-bbc7-727841b25bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:32.510121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89ed49-11cd-467b-bbc7-727841b25bbb admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:32.510410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89ed49-11cd-467b-bbc7-727841b25bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:32.510687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89ed49-11cd-467b-bbc7-727841b25bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:32.511393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89ed49-11cd-467b-bbc7-727841b25bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:32.513789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89ed49-11cd-467b-bbc7-727841b25bbb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:32.535581 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3092/6163] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:17:32.536530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89ed49-11cd-467b-bbc7-727841b25bbb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:32.549433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89ed49-11cd-467b-bbc7-727841b25bbb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:32.556623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a8e9d-7385-4750-91ac-c368fc3f23c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:32.558249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8e9d-7385-4750-91ac-c368fc3f23c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:32.558679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8e9d-7385-4750-91ac-c368fc3f23c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:32.559434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8e9d-7385-4750-91ac-c368fc3f23c8 admin admin] PATH_INFO: `/v3/projects/cf71b04a2b664c65bc2f5a4a072a9c9f/users/f80a4e3ef3a34386902928b284f3fe8c/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:32.587028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a8e9d-7385-4750-91ac-c368fc3f23c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf71b04a2b664c65bc2f5a4a072a9c9f, user_id=f80a4e3ef3a34386902928b284f3fe8c, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:32.588268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7a4ee-1fef-47a2-986a-76bec4bdd2ba None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:32.590026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a8e9d-7385-4750-91ac-c368fc3f23c8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:32.593429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebfe6c-8fab-4714-8fa1-0f3d4990a128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:32.594365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebfe6c-8fab-4714-8fa1-0f3d4990a128 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:32.594959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebfe6c-8fab-4714-8fa1-0f3d4990a128 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:32.595530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebfe6c-8fab-4714-8fa1-0f3d4990a128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:32.599326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-efebfe6c-8fab-4714-8fa1-0f3d4990a128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:32.610922 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3093/6164] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:32 2022] PUT /identity/v3/projects/cf71b04a2b664c65bc2f5a4a072a9c9f/users/f80a4e3ef3a34386902928b284f3fe8c/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:32.620323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1b09c-24ea-4db8-b39c-ca52ac8accfd None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:32.621509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1b09c-24ea-4db8-b39c-ca52ac8accfd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:32.622295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1b09c-24ea-4db8-b39c-ca52ac8accfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:32.632303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:32.665653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0bb1b09c-24ea-4db8-b39c-ca52ac8accfd None None] MFA Rules not processed for user `f80a4e3ef3a34386902928b284f3fe8c`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:32.668241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0bb1b09c-24ea-4db8-b39c-ca52ac8accfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:32.723911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebfe6c-8fab-4714-8fa1-0f3d4990a128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:32.725700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebfe6c-8fab-4714-8fa1-0f3d4990a128 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:32.751652 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3072/6165] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:32.794136 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3094/6166] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:32.810985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebfe6c-8fab-4714-8fa1-0f3d4990a128 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:32.821896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebfe6c-8fab-4714-8fa1-0f3d4990a128 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:32.885016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d2d1e-249e-4975-bb8c-58b0def0e768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:32.885620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d2d1e-249e-4975-bb8c-58b0def0e768 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:32.885934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d2d1e-249e-4975-bb8c-58b0def0e768 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:32.886226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d2d1e-249e-4975-bb8c-58b0def0e768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:32.899118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d2d1e-249e-4975-bb8c-58b0def0e768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:32.900789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d2d1e-249e-4975-bb8c-58b0def0e768 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:32.911537 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3073/6167] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:32 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:17:33.260864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1b09c-24ea-4db8-b39c-ca52ac8accfd None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:33.262594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0bb1b09c-24ea-4db8-b39c-ca52ac8accfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:33.290662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1b09c-24ea-4db8-b39c-ca52ac8accfd None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:33.308925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100e59b-6fab-4adf-9c01-6b84f5b94fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:33.309604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100e59b-6fab-4adf-9c01-6b84f5b94fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:33.309891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100e59b-6fab-4adf-9c01-6b84f5b94fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:33.310168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100e59b-6fab-4adf-9c01-6b84f5b94fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:33.432308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100e59b-6fab-4adf-9c01-6b84f5b94fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:33.433751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100e59b-6fab-4adf-9c01-6b84f5b94fc4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:33.444864 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3095/6168] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:42.906537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=46 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:43.439732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:43.660621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d2d1e-249e-4975-bb8c-58b0def0e768 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:43.672023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d2d1e-249e-4975-bb8c-58b0def0e768 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:43.677983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3abf32-9c19-4a2b-896c-05519031ad15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:43.678621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3abf32-9c19-4a2b-896c-05519031ad15 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:43.678953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3abf32-9c19-4a2b-896c-05519031ad15 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:43.679234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3abf32-9c19-4a2b-896c-05519031ad15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:43.681821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ec3abf32-9c19-4a2b-896c-05519031ad15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:43.699004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3abf32-9c19-4a2b-896c-05519031ad15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:43.700572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3abf32-9c19-4a2b-896c-05519031ad15 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:43.714342 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3074/6169] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:45.015465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100e59b-6fab-4adf-9c01-6b84f5b94fc4 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:45.108384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100e59b-6fab-4adf-9c01-6b84f5b94fc4 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:45.124358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:45.124936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:45.125227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:45.125509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] PATH_INFO: `/v3/users/cab11bd231d842798477873c89e02b5b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:45.126801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab11bd231d842798477873c89e02b5b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:45.130145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:45.206876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab11bd231d842798477873c89e02b5b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:45.215353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab11bd231d842798477873c89e02b5b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:45.217651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab11bd231d842798477873c89e02b5b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:45.228294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab11bd231d842798477873c89e02b5b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:45.229012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab11bd231d842798477873c89e02b5b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:45.255382 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3096/6170] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:45 2022] DELETE /identity/v3/users/cab11bd231d842798477873c89e02b5b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:45.261024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337aad8-de1c-4efb-bfe1-2e3308b1b6c2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:45.262073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337aad8-de1c-4efb-bfe1-2e3308b1b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:45.262073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337aad8-de1c-4efb-bfe1-2e3308b1b6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:45.291702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7337aad8-de1c-4efb-bfe1-2e3308b1b6c2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:45.293634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7337aad8-de1c-4efb-bfe1-2e3308b1b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:45.383317 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3075/6171] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:17:45.398207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:45.400163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:45.546474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccc420-16fd-4131-83f8-3e3bf7171510 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:45.559334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f530db-698e-4f87-9663-eca617ed3ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:45.560037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f530db-698e-4f87-9663-eca617ed3ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:45.560618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f530db-698e-4f87-9663-eca617ed3ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:45.561140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f530db-698e-4f87-9663-eca617ed3ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:45.574735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f530db-698e-4f87-9663-eca617ed3ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:45.576315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f530db-698e-4f87-9663-eca617ed3ed4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:45.602371 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3097/6172] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:45.909953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337aad8-de1c-4efb-bfe1-2e3308b1b6c2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:45.916799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7337aad8-de1c-4efb-bfe1-2e3308b1b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:45.959207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337aad8-de1c-4efb-bfe1-2e3308b1b6c2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:45.967837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:45.969126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:45.970062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:45.970354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] PATH_INFO: `/v3/projects/3e40072130c743c8bc9a2f37b3bb7072` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:45.972267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e40072130c743c8bc9a2f37b3bb7072)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:45.974513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:46.077907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e40072130c743c8bc9a2f37b3bb7072', 'request_id': 'req-2eb01686-d405-4495-b535-729e5e2ea988'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.090272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e40072130c743c8bc9a2f37b3bb7072', 'request_id': 'req-2eb01686-d405-4495-b535-729e5e2ea988'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.099667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e40072130c743c8bc9a2f37b3bb7072', 'request_id': 'req-2eb01686-d405-4495-b535-729e5e2ea988'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.112835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] The token cache is being invalidate because project 3e40072130c743c8bc9a2f37b3bb7072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:46.113127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.113813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.115377 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3076/6173] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:45 2022] DELETE /identity/v3/projects/3e40072130c743c8bc9a2f37b3bb7072 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:46.119605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f530db-698e-4f87-9663-eca617ed3ed4 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:46.130069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f530db-698e-4f87-9663-eca617ed3ed4 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:46.150700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:46.212101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc62abf-056a-4b99-8be0-8fef315c803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:46.213139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62abf-056a-4b99-8be0-8fef315c803e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:46.213523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62abf-056a-4b99-8be0-8fef315c803e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:46.214048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62abf-056a-4b99-8be0-8fef315c803e admin admin] PATH_INFO: `/v3/users/c414a30c879d4c47b09578c5dd0cc993` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:46.215761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc62abf-056a-4b99-8be0-8fef315c803e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c414a30c879d4c47b09578c5dd0cc993)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:46.218018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc62abf-056a-4b99-8be0-8fef315c803e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:46.273377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-efc62abf-056a-4b99-8be0-8fef315c803e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c414a30c879d4c47b09578c5dd0cc993'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.280803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-efc62abf-056a-4b99-8be0-8fef315c803e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c414a30c879d4c47b09578c5dd0cc993'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.281540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-efc62abf-056a-4b99-8be0-8fef315c803e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c414a30c879d4c47b09578c5dd0cc993'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.292491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-efc62abf-056a-4b99-8be0-8fef315c803e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c414a30c879d4c47b09578c5dd0cc993'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.293253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-efc62abf-056a-4b99-8be0-8fef315c803e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c414a30c879d4c47b09578c5dd0cc993'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.312773 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3098/6174] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:46 2022] DELETE /identity/v3/users/c414a30c879d4c47b09578c5dd0cc993 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:46.523394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:46.525457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:46.544841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb01686-d405-4495-b535-729e5e2ea988 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:46.638701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dd964-6524-4165-a43c-43a5b0827eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:46.639391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd964-6524-4165-a43c-43a5b0827eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:46.639675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd964-6524-4165-a43c-43a5b0827eae admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:46.639953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd964-6524-4165-a43c-43a5b0827eae admin admin] PATH_INFO: `/v3/projects/f2512813b5544538a01a11de22bcbeab` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:46.641104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dd964-6524-4165-a43c-43a5b0827eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2512813b5544538a01a11de22bcbeab)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:46.643698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dd964-6524-4165-a43c-43a5b0827eae admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:46.664682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:46.730293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-191dd964-6524-4165-a43c-43a5b0827eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2512813b5544538a01a11de22bcbeab', 'request_id': 'req-191dd964-6524-4165-a43c-43a5b0827eae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.742667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-191dd964-6524-4165-a43c-43a5b0827eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2512813b5544538a01a11de22bcbeab', 'request_id': 'req-191dd964-6524-4165-a43c-43a5b0827eae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.753559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-191dd964-6524-4165-a43c-43a5b0827eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2512813b5544538a01a11de22bcbeab', 'request_id': 'req-191dd964-6524-4165-a43c-43a5b0827eae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.771649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-191dd964-6524-4165-a43c-43a5b0827eae admin admin] The token cache is being invalidate because project f2512813b5544538a01a11de22bcbeab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:46.772723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-191dd964-6524-4165-a43c-43a5b0827eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.774012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-191dd964-6524-4165-a43c-43a5b0827eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:46.780993 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3077/6175] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:46 2022] DELETE /identity/v3/projects/f2512813b5544538a01a11de22bcbeab => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:46.782284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409ac1f-0282-4536-b298-ef403600b0fb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:46.782575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409ac1f-0282-4536-b298-ef403600b0fb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:46.782886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409ac1f-0282-4536-b298-ef403600b0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:46.836419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c409ac1f-0282-4536-b298-ef403600b0fb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:46.838083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c409ac1f-0282-4536-b298-ef403600b0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:46.927753 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3099/6176] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:46.931336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d900d5b-ad89-4873-9c17-1efe60559682 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:46.931632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d900d5b-ad89-4873-9c17-1efe60559682 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:46.931909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d900d5b-ad89-4873-9c17-1efe60559682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:46.956536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6d900d5b-ad89-4873-9c17-1efe60559682 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:46.957781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6d900d5b-ad89-4873-9c17-1efe60559682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:46.969858 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3078/6177] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:46.972441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409ac1f-0282-4536-b298-ef403600b0fb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:46.983083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409ac1f-0282-4536-b298-ef403600b0fb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:46.988734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5671b-5ea5-4068-a80d-5e9ae18070c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:46.989392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5671b-5ea5-4068-a80d-5e9ae18070c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:46.989690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5671b-5ea5-4068-a80d-5e9ae18070c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:46.990048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5671b-5ea5-4068-a80d-5e9ae18070c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:46.990979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5671b-5ea5-4068-a80d-5e9ae18070c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:46.991287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5671b-5ea5-4068-a80d-5e9ae18070c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:46.993054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5671b-5ea5-4068-a80d-5e9ae18070c3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:47.039636 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3100/6178] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:17:47.040346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d900d5b-ad89-4873-9c17-1efe60559682 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:47.056137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d900d5b-ad89-4873-9c17-1efe60559682 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:47.061184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e26a78-1ddb-4377-b1d7-c761b43a5c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:47.061857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e26a78-1ddb-4377-b1d7-c761b43a5c7a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:47.062198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e26a78-1ddb-4377-b1d7-c761b43a5c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:47.062543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e26a78-1ddb-4377-b1d7-c761b43a5c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:47.063276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e26a78-1ddb-4377-b1d7-c761b43a5c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:47.065851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e26a78-1ddb-4377-b1d7-c761b43a5c7a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:47.102663 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3079/6179] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:47 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:47.104081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5671b-5ea5-4068-a80d-5e9ae18070c3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:47.115671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5671b-5ea5-4068-a80d-5e9ae18070c3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:47.148591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:47.187701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b575f-b9da-4f88-ba71-a6f4a7b20012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:47.188675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b575f-b9da-4f88-ba71-a6f4a7b20012 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:47.189062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b575f-b9da-4f88-ba71-a6f4a7b20012 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:47.189447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b575f-b9da-4f88-ba71-a6f4a7b20012 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:47.191028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b575f-b9da-4f88-ba71-a6f4a7b20012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:47.193290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b575f-b9da-4f88-ba71-a6f4a7b20012 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:47.221826 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3101/6180] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:47 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:47.222564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e26a78-1ddb-4377-b1d7-c761b43a5c7a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:47.234698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e26a78-1ddb-4377-b1d7-c761b43a5c7a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:47.250947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38451797-a503-41b5-8974-f2b83e8ff4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:47.251943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38451797-a503-41b5-8974-f2b83e8ff4ea admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:47.252418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38451797-a503-41b5-8974-f2b83e8ff4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:47.253425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38451797-a503-41b5-8974-f2b83e8ff4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:47.255453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38451797-a503-41b5-8974-f2b83e8ff4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:47.257108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38451797-a503-41b5-8974-f2b83e8ff4ea admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:47.271965 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3080/6181] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:17:47.275801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b575f-b9da-4f88-ba71-a6f4a7b20012 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:47.287254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b575f-b9da-4f88-ba71-a6f4a7b20012 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:47.292732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caac29-7945-4a84-b82e-b71ccce59427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:47.293333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caac29-7945-4a84-b82e-b71ccce59427 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:47.293833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caac29-7945-4a84-b82e-b71ccce59427 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:47.294299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caac29-7945-4a84-b82e-b71ccce59427 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:47.295252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caac29-7945-4a84-b82e-b71ccce59427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:47.296979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caac29-7945-4a84-b82e-b71ccce59427 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:47.312747 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3102/6182] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:17:47.317406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38451797-a503-41b5-8974-f2b83e8ff4ea admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:47.328418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38451797-a503-41b5-8974-f2b83e8ff4ea admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:47.334492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27605328-1078-4690-a2b9-360708f47cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:47.335433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27605328-1078-4690-a2b9-360708f47cad admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:47.335737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27605328-1078-4690-a2b9-360708f47cad admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:47.336018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27605328-1078-4690-a2b9-360708f47cad admin admin] PATH_INFO: `/v3/projects/72d3eecf7a0b4d92937a41063b86ca71/users/b8edeb08e8274a4889c9837296181451/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:47.353298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27605328-1078-4690-a2b9-360708f47cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d3eecf7a0b4d92937a41063b86ca71, user_id=b8edeb08e8274a4889c9837296181451, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:47.356156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27605328-1078-4690-a2b9-360708f47cad admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:47.370984 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3081/6183] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:47 2022] PUT /identity/v3/projects/72d3eecf7a0b4d92937a41063b86ca71/users/b8edeb08e8274a4889c9837296181451/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:47.382033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cc847-74d8-469e-b063-9cce4966cd88 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:47.382326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cc847-74d8-469e-b063-9cce4966cd88 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:47.382834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cc847-74d8-469e-b063-9cce4966cd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:47.417446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-865cc847-74d8-469e-b063-9cce4966cd88 None None] MFA Rules not processed for user `b8edeb08e8274a4889c9837296181451`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:47.418678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-865cc847-74d8-469e-b063-9cce4966cd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:47.513984 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3103/6184] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:47.525942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27605328-1078-4690-a2b9-360708f47cad admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:47.528003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-27605328-1078-4690-a2b9-360708f47cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:47.629196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27605328-1078-4690-a2b9-360708f47cad admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:47.634205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69772b2-f79c-461c-85c3-7ee692a15f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:47.634857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69772b2-f79c-461c-85c3-7ee692a15f6e service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:47.635343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69772b2-f79c-461c-85c3-7ee692a15f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:47.635778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69772b2-f79c-461c-85c3-7ee692a15f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:47.655761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69772b2-f79c-461c-85c3-7ee692a15f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:47.657335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69772b2-f79c-461c-85c3-7ee692a15f6e service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:47.676259 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3082/6185] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:50.019173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cc847-74d8-469e-b063-9cce4966cd88 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:50.021515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-865cc847-74d8-469e-b063-9cce4966cd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:50.131545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cc847-74d8-469e-b063-9cce4966cd88 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:50.161841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:50.163558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:50.164879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:50.165477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] PATH_INFO: `/v3/users/f80a4e3ef3a34386902928b284f3fe8c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:50.169381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80a4e3ef3a34386902928b284f3fe8c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:50.176824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:50.267270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:50.276838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80a4e3ef3a34386902928b284f3fe8c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:50.288174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80a4e3ef3a34386902928b284f3fe8c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:50.289250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80a4e3ef3a34386902928b284f3fe8c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:50.305192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80a4e3ef3a34386902928b284f3fe8c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:50.309630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80a4e3ef3a34386902928b284f3fe8c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:50.352887 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3104/6186] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:17:50 2022] DELETE /identity/v3/users/f80a4e3ef3a34386902928b284f3fe8c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:50.357321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897251f2-6b6a-46d3-956a-0b858fc4b561 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:50.357804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897251f2-6b6a-46d3-956a-0b858fc4b561 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:50.357953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897251f2-6b6a-46d3-956a-0b858fc4b561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:50.399057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-897251f2-6b6a-46d3-956a-0b858fc4b561 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:50.402508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-897251f2-6b6a-46d3-956a-0b858fc4b561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:50.497161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:50.553918 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3083/6187] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:50.608951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:50.610958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:50.727175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ceb66-2a31-4ba6-9aab-fa0e448a023d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:50.735825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105fadf-543d-4572-b2cf-cd364c364f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:50.738909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105fadf-543d-4572-b2cf-cd364c364f77 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:50.739204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105fadf-543d-4572-b2cf-cd364c364f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:50.739492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105fadf-543d-4572-b2cf-cd364c364f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:50.759827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105fadf-543d-4572-b2cf-cd364c364f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:50.761354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105fadf-543d-4572-b2cf-cd364c364f77 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:50.790652 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3105/6188] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:51.287534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897251f2-6b6a-46d3-956a-0b858fc4b561 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:51.292288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-897251f2-6b6a-46d3-956a-0b858fc4b561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:51.341881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897251f2-6b6a-46d3-956a-0b858fc4b561 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:51.382934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6fdc3-a922-4a25-8465-62083ffdffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:51.385408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6fdc3-a922-4a25-8465-62083ffdffa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:51.386034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6fdc3-a922-4a25-8465-62083ffdffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:51.386601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6fdc3-a922-4a25-8465-62083ffdffa1 admin admin] PATH_INFO: `/v3/projects/cf71b04a2b664c65bc2f5a4a072a9c9f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:51.391674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6fdc3-a922-4a25-8465-62083ffdffa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf71b04a2b664c65bc2f5a4a072a9c9f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:51.396024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6fdc3-a922-4a25-8465-62083ffdffa1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:51.505647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4cc6fdc3-a922-4a25-8465-62083ffdffa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf71b04a2b664c65bc2f5a4a072a9c9f', 'request_id': 'req-4cc6fdc3-a922-4a25-8465-62083ffdffa1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:51.522721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4cc6fdc3-a922-4a25-8465-62083ffdffa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf71b04a2b664c65bc2f5a4a072a9c9f', 'request_id': 'req-4cc6fdc3-a922-4a25-8465-62083ffdffa1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:51.530649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4cc6fdc3-a922-4a25-8465-62083ffdffa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf71b04a2b664c65bc2f5a4a072a9c9f', 'request_id': 'req-4cc6fdc3-a922-4a25-8465-62083ffdffa1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:51.552413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4cc6fdc3-a922-4a25-8465-62083ffdffa1 admin admin] The token cache is being invalidate because project cf71b04a2b664c65bc2f5a4a072a9c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:17:51.552811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4cc6fdc3-a922-4a25-8465-62083ffdffa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:51.553771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4cc6fdc3-a922-4a25-8465-62083ffdffa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:17:51.556753 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3084/6189] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:17:51 2022] DELETE /identity/v3/projects/cf71b04a2b664c65bc2f5a4a072a9c9f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:51.563345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91cbe2-7237-4a0c-a5b0-6877b05a1c28 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:51.564439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91cbe2-7237-4a0c-a5b0-6877b05a1c28 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:51.565180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91cbe2-7237-4a0c-a5b0-6877b05a1c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:51.618184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-de91cbe2-7237-4a0c-a5b0-6877b05a1c28 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:51.623907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-de91cbe2-7237-4a0c-a5b0-6877b05a1c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:51.730923 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3106/6190] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:51.739007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f7e2d-1bc8-4005-b733-efcaf1467082 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:51.739709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f7e2d-1bc8-4005-b733-efcaf1467082 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:51.740925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f7e2d-1bc8-4005-b733-efcaf1467082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:51.777128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c91f7e2d-1bc8-4005-b733-efcaf1467082 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:51.778376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c91f7e2d-1bc8-4005-b733-efcaf1467082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:51.795302 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3085/6191] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:51.800035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91cbe2-7237-4a0c-a5b0-6877b05a1c28 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:51.810141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91cbe2-7237-4a0c-a5b0-6877b05a1c28 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:51.815140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f43fa3-ede7-43b8-8179-fd52b6eea54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:51.815734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f43fa3-ede7-43b8-8179-fd52b6eea54e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:51.816017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f43fa3-ede7-43b8-8179-fd52b6eea54e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:51.816292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f43fa3-ede7-43b8-8179-fd52b6eea54e admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:51.816973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f43fa3-ede7-43b8-8179-fd52b6eea54e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:17:51.817277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f43fa3-ede7-43b8-8179-fd52b6eea54e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:51.818933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f43fa3-ede7-43b8-8179-fd52b6eea54e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:51.849091 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3107/6192] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:17:51.853598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f7e2d-1bc8-4005-b733-efcaf1467082 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:51.867565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f7e2d-1bc8-4005-b733-efcaf1467082 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:51.877199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a950cf-3e15-44e9-9756-38b4af8898da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:51.878005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a950cf-3e15-44e9-9756-38b4af8898da admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:51.878532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a950cf-3e15-44e9-9756-38b4af8898da admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:51.878851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a950cf-3e15-44e9-9756-38b4af8898da admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:51.879499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a950cf-3e15-44e9-9756-38b4af8898da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:51.881434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a950cf-3e15-44e9-9756-38b4af8898da admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:51.921226 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3086/6193] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:17:51 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:51.925534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f43fa3-ede7-43b8-8179-fd52b6eea54e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:51.937539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f43fa3-ede7-43b8-8179-fd52b6eea54e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:51.989508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:17:52.024288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9f6b5-87b9-4ff4-adff-d71a23cb1357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:52.024963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f6b5-87b9-4ff4-adff-d71a23cb1357 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:52.025215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f6b5-87b9-4ff4-adff-d71a23cb1357 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:52.025495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f6b5-87b9-4ff4-adff-d71a23cb1357 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:52.026145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9f6b5-87b9-4ff4-adff-d71a23cb1357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:52.028129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9f6b5-87b9-4ff4-adff-d71a23cb1357 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:52.061937 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3108/6194] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:17:51 2022] POST /identity/v3/users => generated 295 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:17:52.063789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a950cf-3e15-44e9-9756-38b4af8898da admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:52.076782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a950cf-3e15-44e9-9756-38b4af8898da admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:52.082392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381d402-6ed7-4e89-ac34-efa4853c5646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:52.083195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381d402-6ed7-4e89-ac34-efa4853c5646 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:52.083651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381d402-6ed7-4e89-ac34-efa4853c5646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:52.084043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381d402-6ed7-4e89-ac34-efa4853c5646 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:52.084879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381d402-6ed7-4e89-ac34-efa4853c5646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:52.086657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381d402-6ed7-4e89-ac34-efa4853c5646 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:52.101833 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3087/6195] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:17:52.103489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9f6b5-87b9-4ff4-adff-d71a23cb1357 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:52.114974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9f6b5-87b9-4ff4-adff-d71a23cb1357 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:52.120624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15e2f1-bbc7-48bc-b9cf-f5e30bd4b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:52.120849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15e2f1-bbc7-48bc-b9cf-f5e30bd4b6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:52.121138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15e2f1-bbc7-48bc-b9cf-f5e30bd4b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:52.121419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15e2f1-bbc7-48bc-b9cf-f5e30bd4b6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:52.122072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15e2f1-bbc7-48bc-b9cf-f5e30bd4b6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:52.123901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15e2f1-bbc7-48bc-b9cf-f5e30bd4b6d5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:52.138784 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3109/6196] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:17:52.142443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381d402-6ed7-4e89-ac34-efa4853c5646 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:52.154345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381d402-6ed7-4e89-ac34-efa4853c5646 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:52.160537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa80fd-800f-434e-b8b8-8eeaa921b882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:52.161228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa80fd-800f-434e-b8b8-8eeaa921b882 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:52.161684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa80fd-800f-434e-b8b8-8eeaa921b882 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:52.161971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa80fd-800f-434e-b8b8-8eeaa921b882 admin admin] PATH_INFO: `/v3/projects/2290fd2f35a74bb8b2171b0c01ba72bb/users/73b7719d58974d3faa838a6d4c3c0865/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:52.182980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa80fd-800f-434e-b8b8-8eeaa921b882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2290fd2f35a74bb8b2171b0c01ba72bb, user_id=73b7719d58974d3faa838a6d4c3c0865, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:52.183664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa80fd-800f-434e-b8b8-8eeaa921b882 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:52.203757 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3088/6197] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:17:52 2022] PUT /identity/v3/projects/2290fd2f35a74bb8b2171b0c01ba72bb/users/73b7719d58974d3faa838a6d4c3c0865/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:17:52.214792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13bd3-dbbf-42bc-b54e-b4d05d97750c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:52.215285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13bd3-dbbf-42bc-b54e-b4d05d97750c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:52.216022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b13bd3-dbbf-42bc-b54e-b4d05d97750c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:52.275001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a0b13bd3-dbbf-42bc-b54e-b4d05d97750c None None] MFA Rules not processed for user `73b7719d58974d3faa838a6d4c3c0865`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:52.276292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a0b13bd3-dbbf-42bc-b54e-b4d05d97750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:52.374701 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3110/6198] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:17:52.382065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa80fd-800f-434e-b8b8-8eeaa921b882 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:17:52.384349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-39fa80fd-800f-434e-b8b8-8eeaa921b882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:52.486028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa80fd-800f-434e-b8b8-8eeaa921b882 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:17:52.493686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1b7cb-fd6d-45f5-9a8b-9b08ba9ec044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:17:52.494320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b7cb-fd6d-45f5-9a8b-9b08ba9ec044 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:52.494601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b7cb-fd6d-45f5-9a8b-9b08ba9ec044 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:52.494914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b7cb-fd6d-45f5-9a8b-9b08ba9ec044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:52.505584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1b7cb-fd6d-45f5-9a8b-9b08ba9ec044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:17:52.508009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1b7cb-fd6d-45f5-9a8b-9b08ba9ec044 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:17:52.531033 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3089/6199] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:17:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:17:55.867259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c05fd-3879-424e-aa5f-068154904610 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:17:55.867259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c05fd-3879-424e-aa5f-068154904610 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:17:55.867902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c05fd-3879-424e-aa5f-068154904610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:17:55.903107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4f0c05fd-3879-424e-aa5f-068154904610 None None] MFA Rules not processed for user `c67fb1d8b53148a89cfdff2a5a4395f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:17:55.904681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4f0c05fd-3879-424e-aa5f-068154904610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:17:56.049238 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3111/6200] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:17:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:01.484992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1b7cb-fd6d-45f5-9a8b-9b08ba9ec044 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:01.487578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6ff1b7cb-fd6d-45f5-9a8b-9b08ba9ec044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:01.497236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:01.611091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1b7cb-fd6d-45f5-9a8b-9b08ba9ec044 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:01.617226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbc72f-42d6-4877-a9fb-ae8f2c32519e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:01.618233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbc72f-42d6-4877-a9fb-ae8f2c32519e service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:01.618819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbc72f-42d6-4877-a9fb-ae8f2c32519e service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:01.619324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbc72f-42d6-4877-a9fb-ae8f2c32519e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:01.621378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6adbc72f-42d6-4877-a9fb-ae8f2c32519e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:01.641821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbc72f-42d6-4877-a9fb-ae8f2c32519e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:01.644648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbc72f-42d6-4877-a9fb-ae8f2c32519e service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:01.670393 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3090/6201] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:18:06.039134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:09.780983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c05fd-3879-424e-aa5f-068154904610 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:09.878619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c05fd-3879-424e-aa5f-068154904610 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:09.885065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:09.885548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:09.885833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:09.886106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] PATH_INFO: `/v3/users/73b7719d58974d3faa838a6d4c3c0865` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:09.889354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b7719d58974d3faa838a6d4c3c0865)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:09.895402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:09.906234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbc72f-42d6-4877-a9fb-ae8f2c32519e service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:09.908413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6adbc72f-42d6-4877-a9fb-ae8f2c32519e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:09.927839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbc72f-42d6-4877-a9fb-ae8f2c32519e service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:09.934424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad7143-af20-4fac-86a2-71819db8ddd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:09.935692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad7143-af20-4fac-86a2-71819db8ddd7 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:09.936201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad7143-af20-4fac-86a2-71819db8ddd7 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:09.936711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad7143-af20-4fac-86a2-71819db8ddd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:09.939078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-40ad7143-af20-4fac-86a2-71819db8ddd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:09.955426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad7143-af20-4fac-86a2-71819db8ddd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:09.957616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad7143-af20-4fac-86a2-71819db8ddd7 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:09.966470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b7719d58974d3faa838a6d4c3c0865'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:09.972430 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3091/6202] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:09.975332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b7719d58974d3faa838a6d4c3c0865'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:09.976276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b7719d58974d3faa838a6d4c3c0865'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:09.992829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b7719d58974d3faa838a6d4c3c0865'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:09.993792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b7719d58974d3faa838a6d4c3c0865'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:10.027359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64546805-3cb3-47ac-a772-0b73f794f0fe None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:10.028529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64546805-3cb3-47ac-a772-0b73f794f0fe None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:10.028889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64546805-3cb3-47ac-a772-0b73f794f0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:10.037826 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3112/6203] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:18:09 2022] DELETE /identity/v3/users/73b7719d58974d3faa838a6d4c3c0865 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:18:10.060158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-64546805-3cb3-47ac-a772-0b73f794f0fe None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:10.061741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-64546805-3cb3-47ac-a772-0b73f794f0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:10.160893 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3092/6204] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:10.203224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:10.204816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:10.268018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104a7ec-14cb-4da2-bbb3-6b0e6377688d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:10.272773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a736ad3-2f7e-4c21-b0f2-483f63f73eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:10.273512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736ad3-2f7e-4c21-b0f2-483f63f73eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:10.273933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736ad3-2f7e-4c21-b0f2-483f63f73eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:10.274292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736ad3-2f7e-4c21-b0f2-483f63f73eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:10.286585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a736ad3-2f7e-4c21-b0f2-483f63f73eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:10.288152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a736ad3-2f7e-4c21-b0f2-483f63f73eb9 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:10.308425 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3113/6205] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:10.515063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64546805-3cb3-47ac-a772-0b73f794f0fe None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:10.516620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-64546805-3cb3-47ac-a772-0b73f794f0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:10.544039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64546805-3cb3-47ac-a772-0b73f794f0fe None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:10.549948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe5565-a9ea-42c7-900d-59a5f407eb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:10.550711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe5565-a9ea-42c7-900d-59a5f407eb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:10.550988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe5565-a9ea-42c7-900d-59a5f407eb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:10.551409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe5565-a9ea-42c7-900d-59a5f407eb9c admin admin] PATH_INFO: `/v3/projects/2290fd2f35a74bb8b2171b0c01ba72bb` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:10.552910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe5565-a9ea-42c7-900d-59a5f407eb9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2290fd2f35a74bb8b2171b0c01ba72bb)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:10.555261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe5565-a9ea-42c7-900d-59a5f407eb9c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:10.620161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3efe5565-a9ea-42c7-900d-59a5f407eb9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2290fd2f35a74bb8b2171b0c01ba72bb', 'request_id': 'req-3efe5565-a9ea-42c7-900d-59a5f407eb9c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:10.630486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3efe5565-a9ea-42c7-900d-59a5f407eb9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2290fd2f35a74bb8b2171b0c01ba72bb', 'request_id': 'req-3efe5565-a9ea-42c7-900d-59a5f407eb9c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:10.638411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3efe5565-a9ea-42c7-900d-59a5f407eb9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2290fd2f35a74bb8b2171b0c01ba72bb', 'request_id': 'req-3efe5565-a9ea-42c7-900d-59a5f407eb9c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:10.648042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:10.655622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3efe5565-a9ea-42c7-900d-59a5f407eb9c admin admin] The token cache is being invalidate because project 2290fd2f35a74bb8b2171b0c01ba72bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:18:10.656133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3efe5565-a9ea-42c7-900d-59a5f407eb9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:10.658862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3efe5565-a9ea-42c7-900d-59a5f407eb9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:10.665661 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3093/6206] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:18:10 2022] DELETE /identity/v3/projects/2290fd2f35a74bb8b2171b0c01ba72bb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:18:10.667036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a348b1-b1ad-4ed7-a8e8-ec3ae6153194 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:10.667329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a348b1-b1ad-4ed7-a8e8-ec3ae6153194 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:10.667612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a348b1-b1ad-4ed7-a8e8-ec3ae6153194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:10.688506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-19a348b1-b1ad-4ed7-a8e8-ec3ae6153194 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:10.689891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-19a348b1-b1ad-4ed7-a8e8-ec3ae6153194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:10.710525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:10.779127 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3114/6207] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:18:10.789477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23d1ef-4653-4805-878f-b5895de15d73 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:10.791291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23d1ef-4653-4805-878f-b5895de15d73 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:10.791579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23d1ef-4653-4805-878f-b5895de15d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:10.815921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ed23d1ef-4653-4805-878f-b5895de15d73 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:10.817316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ed23d1ef-4653-4805-878f-b5895de15d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:10.826181 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3094/6208] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:10.830346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a348b1-b1ad-4ed7-a8e8-ec3ae6153194 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:10.840299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a348b1-b1ad-4ed7-a8e8-ec3ae6153194 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:10.846696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27aac87-48bb-4869-b52e-4447edc6249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:10.847739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27aac87-48bb-4869-b52e-4447edc6249e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:10.848281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27aac87-48bb-4869-b52e-4447edc6249e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:10.848622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27aac87-48bb-4869-b52e-4447edc6249e admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:10.849514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27aac87-48bb-4869-b52e-4447edc6249e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:18:10.849899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27aac87-48bb-4869-b52e-4447edc6249e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:10.851708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27aac87-48bb-4869-b52e-4447edc6249e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:10.869790 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3115/6209] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:18:10.871269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23d1ef-4653-4805-878f-b5895de15d73 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:10.882295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23d1ef-4653-4805-878f-b5895de15d73 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:10.888656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1a226-80a4-4748-9b04-f249abaf4673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:10.889428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1a226-80a4-4748-9b04-f249abaf4673 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:10.889783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1a226-80a4-4748-9b04-f249abaf4673 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:10.890134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1a226-80a4-4748-9b04-f249abaf4673 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:10.891558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1a226-80a4-4748-9b04-f249abaf4673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:10.895368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1a226-80a4-4748-9b04-f249abaf4673 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:10.932614 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3095/6210] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:18:10 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:18:10.936762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27aac87-48bb-4869-b52e-4447edc6249e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:10.948800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27aac87-48bb-4869-b52e-4447edc6249e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:11.025186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2e3ac-7012-476e-890a-bad41af34b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:11.025818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2e3ac-7012-476e-890a-bad41af34b60 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:11.026320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2e3ac-7012-476e-890a-bad41af34b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:11.026605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2e3ac-7012-476e-890a-bad41af34b60 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:11.027283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2e3ac-7012-476e-890a-bad41af34b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:11.029492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2e3ac-7012-476e-890a-bad41af34b60 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:11.060179 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3116/6211] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:18:10 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:18:11.067493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1a226-80a4-4748-9b04-f249abaf4673 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:11.080604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1a226-80a4-4748-9b04-f249abaf4673 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:11.085781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad1943-aa19-45af-b7b6-f28bb7bd80c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:11.086425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad1943-aa19-45af-b7b6-f28bb7bd80c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:11.086713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad1943-aa19-45af-b7b6-f28bb7bd80c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:11.087399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad1943-aa19-45af-b7b6-f28bb7bd80c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:11.088241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad1943-aa19-45af-b7b6-f28bb7bd80c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:11.089912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad1943-aa19-45af-b7b6-f28bb7bd80c2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:11.101203 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3096/6212] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:18:11.105228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2e3ac-7012-476e-890a-bad41af34b60 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:11.117074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2e3ac-7012-476e-890a-bad41af34b60 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:11.122170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90af388-c3bd-473c-b3e9-73f8af618a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:11.122817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90af388-c3bd-473c-b3e9-73f8af618a08 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:11.123104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90af388-c3bd-473c-b3e9-73f8af618a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:11.123382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90af388-c3bd-473c-b3e9-73f8af618a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:11.124031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90af388-c3bd-473c-b3e9-73f8af618a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:11.125663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90af388-c3bd-473c-b3e9-73f8af618a08 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:11.140941 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3117/6213] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:18:11.142090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad1943-aa19-45af-b7b6-f28bb7bd80c2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:11.155745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad1943-aa19-45af-b7b6-f28bb7bd80c2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:11.166960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007189e4-b04f-46e8-a6c7-9c05d23bbd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:11.167849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007189e4-b04f-46e8-a6c7-9c05d23bbd35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:11.168785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007189e4-b04f-46e8-a6c7-9c05d23bbd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:11.168785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007189e4-b04f-46e8-a6c7-9c05d23bbd35 admin admin] PATH_INFO: `/v3/projects/807a43472a214e8093094362dd13bb1f/users/4d66267e942e4eeab6272fe83912a6b5/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:11.186424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007189e4-b04f-46e8-a6c7-9c05d23bbd35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807a43472a214e8093094362dd13bb1f, user_id=4d66267e942e4eeab6272fe83912a6b5, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:11.190075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007189e4-b04f-46e8-a6c7-9c05d23bbd35 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:11.206876 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3097/6214] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:18:11 2022] PUT /identity/v3/projects/807a43472a214e8093094362dd13bb1f/users/4d66267e942e4eeab6272fe83912a6b5/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:18:11.217498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe730e9-a169-4993-a51b-97e8e2dc6ae2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:11.217794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe730e9-a169-4993-a51b-97e8e2dc6ae2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:11.218067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe730e9-a169-4993-a51b-97e8e2dc6ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:11.247773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3fe730e9-a169-4993-a51b-97e8e2dc6ae2 None None] MFA Rules not processed for user `4d66267e942e4eeab6272fe83912a6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:11.249102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3fe730e9-a169-4993-a51b-97e8e2dc6ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:11.360940 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3118/6215] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:18:11.366459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007189e4-b04f-46e8-a6c7-9c05d23bbd35 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:11.368718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-007189e4-b04f-46e8-a6c7-9c05d23bbd35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:11.437446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007189e4-b04f-46e8-a6c7-9c05d23bbd35 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:11.450721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db136e-ba01-456f-a528-897bf8201da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:11.451452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db136e-ba01-456f-a528-897bf8201da2 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:11.451737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db136e-ba01-456f-a528-897bf8201da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:11.452008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db136e-ba01-456f-a528-897bf8201da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:11.461894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db136e-ba01-456f-a528-897bf8201da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:11.463373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db136e-ba01-456f-a528-897bf8201da2 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:11.478925 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3098/6216] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:11.833500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe730e9-a169-4993-a51b-97e8e2dc6ae2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:11.853963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:11.915401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe730e9-a169-4993-a51b-97e8e2dc6ae2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:11.920160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:11.920873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:11.921276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:11.921666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] PATH_INFO: `/v3/users/4d66267e942e4eeab6272fe83912a6b5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:11.922930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d66267e942e4eeab6272fe83912a6b5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:11.925101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:11.979728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d66267e942e4eeab6272fe83912a6b5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:11.990554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d66267e942e4eeab6272fe83912a6b5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:11.991351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d66267e942e4eeab6272fe83912a6b5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:12.006708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d66267e942e4eeab6272fe83912a6b5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:12.007594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d66267e942e4eeab6272fe83912a6b5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:12.046479 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3119/6217] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:18:11 2022] DELETE /identity/v3/users/4d66267e942e4eeab6272fe83912a6b5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:18:12.051194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bec7eb-5bc2-4461-a6fc-cc2d9f9ddf03 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:12.052196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bec7eb-5bc2-4461-a6fc-cc2d9f9ddf03 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:12.052490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bec7eb-5bc2-4461-a6fc-cc2d9f9ddf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:12.081464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f2bec7eb-5bc2-4461-a6fc-cc2d9f9ddf03 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:12.083140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f2bec7eb-5bc2-4461-a6fc-cc2d9f9ddf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:12.156926 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3099/6218] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:12.166891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:12.168381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:12.235163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdea9f-a5ed-4b94-9e51-1bd3820b516c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:12.240570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cea6a0-ea23-46c4-a4d4-ad8f426c074c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:12.240858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cea6a0-ea23-46c4-a4d4-ad8f426c074c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:12.241139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cea6a0-ea23-46c4-a4d4-ad8f426c074c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:12.241419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cea6a0-ea23-46c4-a4d4-ad8f426c074c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:12.252242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cea6a0-ea23-46c4-a4d4-ad8f426c074c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:12.254168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cea6a0-ea23-46c4-a4d4-ad8f426c074c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:12.280818 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3120/6219] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:12.671074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bec7eb-5bc2-4461-a6fc-cc2d9f9ddf03 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:12.672886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f2bec7eb-5bc2-4461-a6fc-cc2d9f9ddf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:12.691553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bec7eb-5bc2-4461-a6fc-cc2d9f9ddf03 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:12.698087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eefae3-7041-4003-a5ef-a575c5c7e89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:12.698702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eefae3-7041-4003-a5ef-a575c5c7e89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:12.699202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eefae3-7041-4003-a5ef-a575c5c7e89b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:12.699579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eefae3-7041-4003-a5ef-a575c5c7e89b admin admin] PATH_INFO: `/v3/projects/807a43472a214e8093094362dd13bb1f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:12.702316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eefae3-7041-4003-a5ef-a575c5c7e89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=807a43472a214e8093094362dd13bb1f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:12.705574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eefae3-7041-4003-a5ef-a575c5c7e89b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:12.798913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:12.826337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83eefae3-7041-4003-a5ef-a575c5c7e89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807a43472a214e8093094362dd13bb1f', 'request_id': 'req-83eefae3-7041-4003-a5ef-a575c5c7e89b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:12.849139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83eefae3-7041-4003-a5ef-a575c5c7e89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807a43472a214e8093094362dd13bb1f', 'request_id': 'req-83eefae3-7041-4003-a5ef-a575c5c7e89b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:12.877972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83eefae3-7041-4003-a5ef-a575c5c7e89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807a43472a214e8093094362dd13bb1f', 'request_id': 'req-83eefae3-7041-4003-a5ef-a575c5c7e89b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:12.919971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83eefae3-7041-4003-a5ef-a575c5c7e89b admin admin] The token cache is being invalidate because project 807a43472a214e8093094362dd13bb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:18:12.920282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83eefae3-7041-4003-a5ef-a575c5c7e89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:12.920975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83eefae3-7041-4003-a5ef-a575c5c7e89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:12.930128 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3100/6220] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:18:12 2022] DELETE /identity/v3/projects/807a43472a214e8093094362dd13bb1f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:18:12.931834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37e3d-26cb-419d-adc3-cda21f1c08e8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:12.932334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37e3d-26cb-419d-adc3-cda21f1c08e8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:12.932607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b37e3d-26cb-419d-adc3-cda21f1c08e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:12.999461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c8b37e3d-26cb-419d-adc3-cda21f1c08e8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:13.001150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c8b37e3d-26cb-419d-adc3-cda21f1c08e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:13.050930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:13.094146 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3121/6221] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:13.103179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf9dd7-303f-4b79-8663-ae978f57c8a3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:13.104104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf9dd7-303f-4b79-8663-ae978f57c8a3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:13.104630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf9dd7-303f-4b79-8663-ae978f57c8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:13.151746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cfcf9dd7-303f-4b79-8663-ae978f57c8a3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:13.153130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cfcf9dd7-303f-4b79-8663-ae978f57c8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:13.171264 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3101/6222] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:13.172256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b37e3d-26cb-419d-adc3-cda21f1c08e8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:13.187866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b37e3d-26cb-419d-adc3-cda21f1c08e8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:13.198972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aead14f-479c-4a22-885d-947f7617f354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:13.200077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead14f-479c-4a22-885d-947f7617f354 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:13.200537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead14f-479c-4a22-885d-947f7617f354 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:13.201046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aead14f-479c-4a22-885d-947f7617f354 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:13.210943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aead14f-479c-4a22-885d-947f7617f354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:18:13.211361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aead14f-479c-4a22-885d-947f7617f354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:13.213484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aead14f-479c-4a22-885d-947f7617f354 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:13.238788 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3122/6223] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:18:13.244760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf9dd7-303f-4b79-8663-ae978f57c8a3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:13.260678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf9dd7-303f-4b79-8663-ae978f57c8a3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:13.266819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e95d24-8644-402a-94dd-789ae836a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:13.268048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e95d24-8644-402a-94dd-789ae836a2fd admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:13.268474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e95d24-8644-402a-94dd-789ae836a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:13.268715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e95d24-8644-402a-94dd-789ae836a2fd admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:13.269384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e95d24-8644-402a-94dd-789ae836a2fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:13.271855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e95d24-8644-402a-94dd-789ae836a2fd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:13.326568 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3102/6224] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:18:13 2022] POST /identity/v3/projects => generated 363 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:18:13.331604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aead14f-479c-4a22-885d-947f7617f354 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:13.349588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aead14f-479c-4a22-885d-947f7617f354 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:13.428831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a08b9-0add-4757-9eff-546e9a56a663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:13.429410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a08b9-0add-4757-9eff-546e9a56a663 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:13.429796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a08b9-0add-4757-9eff-546e9a56a663 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:13.430082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a08b9-0add-4757-9eff-546e9a56a663 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:13.430935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a08b9-0add-4757-9eff-546e9a56a663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:13.433033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a08b9-0add-4757-9eff-546e9a56a663 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:13.465417 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3123/6225] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:18:13 2022] POST /identity/v3/users => generated 282 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:18:13.466832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e95d24-8644-402a-94dd-789ae836a2fd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:13.478476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e95d24-8644-402a-94dd-789ae836a2fd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:13.483309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b4fbd-e36b-4712-9a2f-06e7210e051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:13.484102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b4fbd-e36b-4712-9a2f-06e7210e051a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:13.484392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b4fbd-e36b-4712-9a2f-06e7210e051a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:13.484671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b4fbd-e36b-4712-9a2f-06e7210e051a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:13.485315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b4fbd-e36b-4712-9a2f-06e7210e051a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:13.488592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b4fbd-e36b-4712-9a2f-06e7210e051a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:13.499825 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3103/6226] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:18:13.504771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a08b9-0add-4757-9eff-546e9a56a663 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:13.517729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a08b9-0add-4757-9eff-546e9a56a663 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:13.527587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c311458-acb4-4a0c-bf04-f4bd50c480e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:13.528307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311458-acb4-4a0c-bf04-f4bd50c480e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:13.528911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311458-acb4-4a0c-bf04-f4bd50c480e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:13.529344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311458-acb4-4a0c-bf04-f4bd50c480e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:13.530016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c311458-acb4-4a0c-bf04-f4bd50c480e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:13.531806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c311458-acb4-4a0c-bf04-f4bd50c480e4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:13.556892 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3124/6227] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:18:13.557810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b4fbd-e36b-4712-9a2f-06e7210e051a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:13.574127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b4fbd-e36b-4712-9a2f-06e7210e051a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:13.583316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753628c-01dd-4747-a148-c8cbbb1319f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:13.584358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753628c-01dd-4747-a148-c8cbbb1319f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:13.584843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753628c-01dd-4747-a148-c8cbbb1319f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:13.585961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753628c-01dd-4747-a148-c8cbbb1319f4 admin admin] PATH_INFO: `/v3/projects/22c6fc0d76864cb79230ec5c025a2c9f/users/a7a8a32221544b60b5d974fcc5eda643/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:13.620197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753628c-01dd-4747-a148-c8cbbb1319f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c6fc0d76864cb79230ec5c025a2c9f, user_id=a7a8a32221544b60b5d974fcc5eda643, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:13.622767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753628c-01dd-4747-a148-c8cbbb1319f4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:13.652794 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3104/6228] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:18:13 2022] PUT /identity/v3/projects/22c6fc0d76864cb79230ec5c025a2c9f/users/a7a8a32221544b60b5d974fcc5eda643/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:18:13.654322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39912124-7eb9-42e9-ba08-8fe25e390328 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:13.654616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39912124-7eb9-42e9-ba08-8fe25e390328 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:13.654934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39912124-7eb9-42e9-ba08-8fe25e390328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:13.702563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-39912124-7eb9-42e9-ba08-8fe25e390328 None None] MFA Rules not processed for user `a7a8a32221544b60b5d974fcc5eda643`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:13.705885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-39912124-7eb9-42e9-ba08-8fe25e390328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:13.868749 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3125/6229] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:13.879896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753628c-01dd-4747-a148-c8cbbb1319f4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:13.881925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a753628c-01dd-4747-a148-c8cbbb1319f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:14.082174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753628c-01dd-4747-a148-c8cbbb1319f4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:14.091652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc39147-c05f-4f6c-b4dd-a28a0cd9771d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:14.093003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc39147-c05f-4f6c-b4dd-a28a0cd9771d service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:14.095536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc39147-c05f-4f6c-b4dd-a28a0cd9771d service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:14.096396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc39147-c05f-4f6c-b4dd-a28a0cd9771d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:14.116930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc39147-c05f-4f6c-b4dd-a28a0cd9771d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:14.120415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc39147-c05f-4f6c-b4dd-a28a0cd9771d service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:14.134556 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3105/6230] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:20.909737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39912124-7eb9-42e9-ba08-8fe25e390328 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:20.911212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-39912124-7eb9-42e9-ba08-8fe25e390328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:21.016564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:21.090873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39912124-7eb9-42e9-ba08-8fe25e390328 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:21.094564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b67ba5-693c-4788-9084-e817a94ad9f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:21.096852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b67ba5-693c-4788-9084-e817a94ad9f2 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:21.097146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b67ba5-693c-4788-9084-e817a94ad9f2 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:21.097428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b67ba5-693c-4788-9084-e817a94ad9f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:21.099335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c0b67ba5-693c-4788-9084-e817a94ad9f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:21.114353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b67ba5-693c-4788-9084-e817a94ad9f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:21.125253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b67ba5-693c-4788-9084-e817a94ad9f2 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:21.145361 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3126/6231] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:24.132127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:30.119179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc39147-c05f-4f6c-b4dd-a28a0cd9771d service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:30.120653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6cc39147-c05f-4f6c-b4dd-a28a0cd9771d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:30.255093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc39147-c05f-4f6c-b4dd-a28a0cd9771d service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:30.265225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:30.267501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:30.270285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:30.270285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] PATH_INFO: `/v3/users/df392b197270409b861e7ff7bd5a8135` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:30.273620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] RBAC: Authorizing `identity:delete_user(user_id=df392b197270409b861e7ff7bd5a8135)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:30.276768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:30.317248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7811ac-4c90-4e2a-9fba-7fedb503f19d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:30.317740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7811ac-4c90-4e2a-9fba-7fedb503f19d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:30.317982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7811ac-4c90-4e2a-9fba-7fedb503f19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:30.362404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6c7811ac-4c90-4e2a-9fba-7fedb503f19d None None] MFA Rules not processed for user `ee83dfdb456f4acc9fa1c5e7c8ef00ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:30.364215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6c7811ac-4c90-4e2a-9fba-7fedb503f19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:30.412184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df392b197270409b861e7ff7bd5a8135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:30.430170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df392b197270409b861e7ff7bd5a8135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:30.436689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df392b197270409b861e7ff7bd5a8135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:30.488436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df392b197270409b861e7ff7bd5a8135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:30.489192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df392b197270409b861e7ff7bd5a8135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:30.521660 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3106/6232] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:18:30 2022] DELETE /identity/v3/users/df392b197270409b861e7ff7bd5a8135 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:18:30.584396 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3127/6233] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:32.003007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:32.005033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:32.205117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94868507-b6b3-4dd3-8478-49b1b41c661a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:32.212411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d80d51-0aed-4926-885f-f5180968e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:32.218223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d80d51-0aed-4926-885f-f5180968e2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:32.218569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d80d51-0aed-4926-885f-f5180968e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:32.218880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d80d51-0aed-4926-885f-f5180968e2b0 admin admin] PATH_INFO: `/v3/projects/22c153b5085848bcb9a8e940b0e73b57` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:32.222019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d80d51-0aed-4926-885f-f5180968e2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c153b5085848bcb9a8e940b0e73b57)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:32.224614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d80d51-0aed-4926-885f-f5180968e2b0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:32.271353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:32.308403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c2d80d51-0aed-4926-885f-f5180968e2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c153b5085848bcb9a8e940b0e73b57', 'request_id': 'req-c2d80d51-0aed-4926-885f-f5180968e2b0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:32.323059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c2d80d51-0aed-4926-885f-f5180968e2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c153b5085848bcb9a8e940b0e73b57', 'request_id': 'req-c2d80d51-0aed-4926-885f-f5180968e2b0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:32.340990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c2d80d51-0aed-4926-885f-f5180968e2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c153b5085848bcb9a8e940b0e73b57', 'request_id': 'req-c2d80d51-0aed-4926-885f-f5180968e2b0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:32.367675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c2d80d51-0aed-4926-885f-f5180968e2b0 admin admin] The token cache is being invalidate because project 22c153b5085848bcb9a8e940b0e73b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:18:32.367995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c2d80d51-0aed-4926-885f-f5180968e2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:32.369045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c2d80d51-0aed-4926-885f-f5180968e2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:32.374796 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3107/6234] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:18:32 2022] DELETE /identity/v3/projects/22c153b5085848bcb9a8e940b0e73b57 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:18:32.378573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2defa-8be3-41e3-b26c-6c279a767cee None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:32.381868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2defa-8be3-41e3-b26c-6c279a767cee None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:32.382332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2defa-8be3-41e3-b26c-6c279a767cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:32.463438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-22e2defa-8be3-41e3-b26c-6c279a767cee None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:32.465761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-22e2defa-8be3-41e3-b26c-6c279a767cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:32.657416 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3128/6235] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:32.660952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2785d5-d806-4dc8-99dc-4703776ccd08 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:32.661248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2785d5-d806-4dc8-99dc-4703776ccd08 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:32.661526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2785d5-d806-4dc8-99dc-4703776ccd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:32.792129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4a2785d5-d806-4dc8-99dc-4703776ccd08 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:32.797719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4a2785d5-d806-4dc8-99dc-4703776ccd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:32.848687 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3108/6236] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:32.857222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2defa-8be3-41e3-b26c-6c279a767cee None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:32.903596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2defa-8be3-41e3-b26c-6c279a767cee None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:32.912061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ace1b-ade1-4814-958e-b35ae8ef26ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:32.912061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ace1b-ade1-4814-958e-b35ae8ef26ae admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:32.912461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ace1b-ade1-4814-958e-b35ae8ef26ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:32.912575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ace1b-ade1-4814-958e-b35ae8ef26ae admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:32.913508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ace1b-ade1-4814-958e-b35ae8ef26ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:18:32.913816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ace1b-ade1-4814-958e-b35ae8ef26ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:32.915990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ace1b-ade1-4814-958e-b35ae8ef26ae admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:32.936332 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3129/6237] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:18:32.937551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2785d5-d806-4dc8-99dc-4703776ccd08 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:32.953071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2785d5-d806-4dc8-99dc-4703776ccd08 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:32.970646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db108c-8331-4263-825f-45f3c2128ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:32.972075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db108c-8331-4263-825f-45f3c2128ffb admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:32.972369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db108c-8331-4263-825f-45f3c2128ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:32.972646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db108c-8331-4263-825f-45f3c2128ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:32.973925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db108c-8331-4263-825f-45f3c2128ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:32.977607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db108c-8331-4263-825f-45f3c2128ffb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:33.035869 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3109/6238] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:18:32 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:18:33.037045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ace1b-ade1-4814-958e-b35ae8ef26ae admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:33.066295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ace1b-ade1-4814-958e-b35ae8ef26ae admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:33.163601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:33.193789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113d7ca-8b7b-4c11-89de-1f0e48c8fc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:33.194730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113d7ca-8b7b-4c11-89de-1f0e48c8fc97 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:33.195222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113d7ca-8b7b-4c11-89de-1f0e48c8fc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:33.195668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113d7ca-8b7b-4c11-89de-1f0e48c8fc97 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:33.196504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113d7ca-8b7b-4c11-89de-1f0e48c8fc97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:33.198605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113d7ca-8b7b-4c11-89de-1f0e48c8fc97 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:33.229417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db108c-8331-4263-825f-45f3c2128ffb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:33.230617 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3130/6239] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:18:33 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:18:33.251306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db108c-8331-4263-825f-45f3c2128ffb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:33.257717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace812d-4abb-4ab4-b846-8d6223bca3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:33.259409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace812d-4abb-4ab4-b846-8d6223bca3eb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:33.259861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace812d-4abb-4ab4-b846-8d6223bca3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:33.260298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace812d-4abb-4ab4-b846-8d6223bca3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:33.263546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace812d-4abb-4ab4-b846-8d6223bca3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:33.269890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace812d-4abb-4ab4-b846-8d6223bca3eb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:33.287252 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3110/6240] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:18:33.290964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113d7ca-8b7b-4c11-89de-1f0e48c8fc97 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:33.303276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113d7ca-8b7b-4c11-89de-1f0e48c8fc97 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:33.308202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82567231-5214-40c2-8f75-9e64b4596e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:33.308824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82567231-5214-40c2-8f75-9e64b4596e28 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:33.309105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82567231-5214-40c2-8f75-9e64b4596e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:33.309671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82567231-5214-40c2-8f75-9e64b4596e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:33.310247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82567231-5214-40c2-8f75-9e64b4596e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:33.311886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82567231-5214-40c2-8f75-9e64b4596e28 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:33.326079 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3131/6241] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:18:33.330778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace812d-4abb-4ab4-b846-8d6223bca3eb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:33.346230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace812d-4abb-4ab4-b846-8d6223bca3eb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:33.353259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675988d-3eca-4e42-b1d1-c0044ba7fcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:33.354957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675988d-3eca-4e42-b1d1-c0044ba7fcc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:33.355465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675988d-3eca-4e42-b1d1-c0044ba7fcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:33.355954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675988d-3eca-4e42-b1d1-c0044ba7fcc8 admin admin] PATH_INFO: `/v3/projects/7f3877326ec642deb513f53a49523010/users/7c002dbee4ea45f29da28777ae211006/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:33.375698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675988d-3eca-4e42-b1d1-c0044ba7fcc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3877326ec642deb513f53a49523010, user_id=7c002dbee4ea45f29da28777ae211006, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:33.380069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675988d-3eca-4e42-b1d1-c0044ba7fcc8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:33.406858 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3111/6242] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:18:33 2022] PUT /identity/v3/projects/7f3877326ec642deb513f53a49523010/users/7c002dbee4ea45f29da28777ae211006/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:18:33.413300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a5faa-b96b-4261-9091-ba27a8197a5a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:33.413758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a5faa-b96b-4261-9091-ba27a8197a5a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:33.414284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a5faa-b96b-4261-9091-ba27a8197a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:33.451554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d11a5faa-b96b-4261-9091-ba27a8197a5a None None] MFA Rules not processed for user `7c002dbee4ea45f29da28777ae211006`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:33.452860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d11a5faa-b96b-4261-9091-ba27a8197a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:33.556437 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3132/6243] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:33.567706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4893eca-349e-457b-b08c-dc94b89500d8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:33.568125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4893eca-349e-457b-b08c-dc94b89500d8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:33.568523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4893eca-349e-457b-b08c-dc94b89500d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:33.595362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c4893eca-349e-457b-b08c-dc94b89500d8 None None] MFA Rules not processed for user `7c002dbee4ea45f29da28777ae211006`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:33.599025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c4893eca-349e-457b-b08c-dc94b89500d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:33.608741 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3112/6244] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:18:33.620265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a5faa-b96b-4261-9091-ba27a8197a5a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:33.621725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d11a5faa-b96b-4261-9091-ba27a8197a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:33.740141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a5faa-b96b-4261-9091-ba27a8197a5a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:33.753091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446ece1-5756-4bbc-aca8-aea3bd5ca6b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:33.753776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446ece1-5756-4bbc-aca8-aea3bd5ca6b9 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:33.754065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446ece1-5756-4bbc-aca8-aea3bd5ca6b9 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:33.754349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446ece1-5756-4bbc-aca8-aea3bd5ca6b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:33.767989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446ece1-5756-4bbc-aca8-aea3bd5ca6b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:33.770343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446ece1-5756-4bbc-aca8-aea3bd5ca6b9 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:33.786257 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3133/6245] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:34.051537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4893eca-349e-457b-b08c-dc94b89500d8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:34.053070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c4893eca-349e-457b-b08c-dc94b89500d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:34.308399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4893eca-349e-457b-b08c-dc94b89500d8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:34.322483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca19434-3465-4ef8-8fa2-e1b62e2a13a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:34.323990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca19434-3465-4ef8-8fa2-e1b62e2a13a6 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:34.324533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca19434-3465-4ef8-8fa2-e1b62e2a13a6 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:34.324993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca19434-3465-4ef8-8fa2-e1b62e2a13a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:34.330539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1ca19434-3465-4ef8-8fa2-e1b62e2a13a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:34.372370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca19434-3465-4ef8-8fa2-e1b62e2a13a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:34.374018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca19434-3465-4ef8-8fa2-e1b62e2a13a6 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:34.415934 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3113/6246] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:43.780443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:43.905607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446ece1-5756-4bbc-aca8-aea3bd5ca6b9 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:44.022200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446ece1-5756-4bbc-aca8-aea3bd5ca6b9 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:44.029295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:44.030772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:44.031316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:44.032495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] PATH_INFO: `/v3/users/7c002dbee4ea45f29da28777ae211006` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:44.035526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c002dbee4ea45f29da28777ae211006)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:44.038465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:44.186271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c002dbee4ea45f29da28777ae211006'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:44.202567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c002dbee4ea45f29da28777ae211006'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:44.204521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c002dbee4ea45f29da28777ae211006'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:44.217454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c002dbee4ea45f29da28777ae211006'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:44.221292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c002dbee4ea45f29da28777ae211006'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:44.264200 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3134/6247] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:18:43 2022] DELETE /identity/v3/users/7c002dbee4ea45f29da28777ae211006 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:18:44.270379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0c9b3-6f0d-4111-acb9-0e0a27e16eff None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:44.271361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0c9b3-6f0d-4111-acb9-0e0a27e16eff None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:44.272001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0c9b3-6f0d-4111-acb9-0e0a27e16eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:44.340133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6db0c9b3-6f0d-4111-acb9-0e0a27e16eff None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:44.341478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6db0c9b3-6f0d-4111-acb9-0e0a27e16eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:44.411447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:44.526708 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3114/6248] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:44.608247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:44.612483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:44.794460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46120cb6-1cc1-4af1-a29e-18c160ec748b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:44.799808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c43ee0-ec11-495a-b3e9-847724911983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:44.800532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c43ee0-ec11-495a-b3e9-847724911983 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:44.802712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c43ee0-ec11-495a-b3e9-847724911983 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:44.803113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c43ee0-ec11-495a-b3e9-847724911983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:44.819757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c43ee0-ec11-495a-b3e9-847724911983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:44.821307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c43ee0-ec11-495a-b3e9-847724911983 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:44.843877 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3135/6249] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:45.790264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0c9b3-6f0d-4111-acb9-0e0a27e16eff None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:45.792569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6db0c9b3-6f0d-4111-acb9-0e0a27e16eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:45.816450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0c9b3-6f0d-4111-acb9-0e0a27e16eff None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:45.823577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed61ee-e3dc-4f0f-ba90-005cac09e918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:45.824595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed61ee-e3dc-4f0f-ba90-005cac09e918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:45.825364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed61ee-e3dc-4f0f-ba90-005cac09e918 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:45.825878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed61ee-e3dc-4f0f-ba90-005cac09e918 admin admin] PATH_INFO: `/v3/projects/7f3877326ec642deb513f53a49523010` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:45.829875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed61ee-e3dc-4f0f-ba90-005cac09e918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f3877326ec642deb513f53a49523010)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:45.833081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed61ee-e3dc-4f0f-ba90-005cac09e918 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:45.947993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-86ed61ee-e3dc-4f0f-ba90-005cac09e918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f3877326ec642deb513f53a49523010', 'request_id': 'req-86ed61ee-e3dc-4f0f-ba90-005cac09e918'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:45.965503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-86ed61ee-e3dc-4f0f-ba90-005cac09e918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f3877326ec642deb513f53a49523010', 'request_id': 'req-86ed61ee-e3dc-4f0f-ba90-005cac09e918'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:45.980995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-86ed61ee-e3dc-4f0f-ba90-005cac09e918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f3877326ec642deb513f53a49523010', 'request_id': 'req-86ed61ee-e3dc-4f0f-ba90-005cac09e918'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:46.004633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-86ed61ee-e3dc-4f0f-ba90-005cac09e918 admin admin] The token cache is being invalidate because project 7f3877326ec642deb513f53a49523010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:18:46.004934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-86ed61ee-e3dc-4f0f-ba90-005cac09e918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:46.007720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-86ed61ee-e3dc-4f0f-ba90-005cac09e918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:18:46.012787 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3115/6250] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:18:45 2022] DELETE /identity/v3/projects/7f3877326ec642deb513f53a49523010 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:18:46.020028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e70ce6-0089-4cf9-bc73-d2955019a0f5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:46.020541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e70ce6-0089-4cf9-bc73-d2955019a0f5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:46.020637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e70ce6-0089-4cf9-bc73-d2955019a0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:46.069240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-27e70ce6-0089-4cf9-bc73-d2955019a0f5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:46.070769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-27e70ce6-0089-4cf9-bc73-d2955019a0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:46.123221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:46.233173 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3136/6251] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:46.235909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4252d34-93f3-47c6-9cd9-a325f02bb80b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:46.236307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4252d34-93f3-47c6-9cd9-a325f02bb80b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:46.236596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4252d34-93f3-47c6-9cd9-a325f02bb80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:46.298085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f4252d34-93f3-47c6-9cd9-a325f02bb80b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:46.302829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f4252d34-93f3-47c6-9cd9-a325f02bb80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:46.325457 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3116/6252] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:46.329669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e70ce6-0089-4cf9-bc73-d2955019a0f5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:46.344716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e70ce6-0089-4cf9-bc73-d2955019a0f5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:46.357774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa076db-f17c-4eee-aa5e-440ba463e5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:46.358659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa076db-f17c-4eee-aa5e-440ba463e5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:46.359136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa076db-f17c-4eee-aa5e-440ba463e5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:46.359580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa076db-f17c-4eee-aa5e-440ba463e5d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:46.360978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa076db-f17c-4eee-aa5e-440ba463e5d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:18:46.363144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa076db-f17c-4eee-aa5e-440ba463e5d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:46.365471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa076db-f17c-4eee-aa5e-440ba463e5d8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:46.394932 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3137/6253] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:18:46.398440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4252d34-93f3-47c6-9cd9-a325f02bb80b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:46.418978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4252d34-93f3-47c6-9cd9-a325f02bb80b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:46.431623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfcc81-d435-4545-b766-ccdcf1abe0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:46.432279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfcc81-d435-4545-b766-ccdcf1abe0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:46.432572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfcc81-d435-4545-b766-ccdcf1abe0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:46.432854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfcc81-d435-4545-b766-ccdcf1abe0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:46.433635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfcc81-d435-4545-b766-ccdcf1abe0b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:46.435633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfcc81-d435-4545-b766-ccdcf1abe0b6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:46.500721 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3117/6254] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:18:46 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:18:46.503081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa076db-f17c-4eee-aa5e-440ba463e5d8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:46.515929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa076db-f17c-4eee-aa5e-440ba463e5d8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:46.664245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74a987-0c2d-434b-bc9f-94ee679d6b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:46.665163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74a987-0c2d-434b-bc9f-94ee679d6b90 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:46.665607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74a987-0c2d-434b-bc9f-94ee679d6b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:46.669777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74a987-0c2d-434b-bc9f-94ee679d6b90 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:46.675751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74a987-0c2d-434b-bc9f-94ee679d6b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:46.678100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74a987-0c2d-434b-bc9f-94ee679d6b90 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:46.710242 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3138/6255] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:18:46 2022] POST /identity/v3/users => generated 290 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:18:46.714050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfcc81-d435-4545-b766-ccdcf1abe0b6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:46.737738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfcc81-d435-4545-b766-ccdcf1abe0b6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:46.747567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57037-c88e-4e59-8e2c-ebe3f0171172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:46.748506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57037-c88e-4e59-8e2c-ebe3f0171172 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:46.748970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57037-c88e-4e59-8e2c-ebe3f0171172 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:46.749405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57037-c88e-4e59-8e2c-ebe3f0171172 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:46.750255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b57037-c88e-4e59-8e2c-ebe3f0171172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:46.752909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b57037-c88e-4e59-8e2c-ebe3f0171172 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:46.786006 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3118/6256] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:18:46.789871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74a987-0c2d-434b-bc9f-94ee679d6b90 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:46.807125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74a987-0c2d-434b-bc9f-94ee679d6b90 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:46.814784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccba3e-688a-46d4-9fa6-42f4e27d071c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:46.815740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccba3e-688a-46d4-9fa6-42f4e27d071c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:46.816113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccba3e-688a-46d4-9fa6-42f4e27d071c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:46.816538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccba3e-688a-46d4-9fa6-42f4e27d071c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:46.817358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccba3e-688a-46d4-9fa6-42f4e27d071c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:46.819794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccba3e-688a-46d4-9fa6-42f4e27d071c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:46.839825 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3139/6257] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:18:46.843609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57037-c88e-4e59-8e2c-ebe3f0171172 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:46.861500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57037-c88e-4e59-8e2c-ebe3f0171172 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:46.874307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d97db2-c5fc-4ea2-a1c9-c2367eadcdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:46.875071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d97db2-c5fc-4ea2-a1c9-c2367eadcdae admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:46.875939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d97db2-c5fc-4ea2-a1c9-c2367eadcdae admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:46.876384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d97db2-c5fc-4ea2-a1c9-c2367eadcdae admin admin] PATH_INFO: `/v3/projects/535c51ce72534fd38bf9a0492b7bd6da/users/6695ec9531304e5d89c9dd6212f1cbd7/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:46.906008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d97db2-c5fc-4ea2-a1c9-c2367eadcdae admin admin] RBAC: Authorizing `identity:create_grant(project_id=535c51ce72534fd38bf9a0492b7bd6da, user_id=6695ec9531304e5d89c9dd6212f1cbd7, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:46.910321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d97db2-c5fc-4ea2-a1c9-c2367eadcdae admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:46.933594 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3119/6258] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:18:46 2022] PUT /identity/v3/projects/535c51ce72534fd38bf9a0492b7bd6da/users/6695ec9531304e5d89c9dd6212f1cbd7/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:18:46.940412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fba91-e362-477c-9b1d-98cffd4715f6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:46.941510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fba91-e362-477c-9b1d-98cffd4715f6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:46.941792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fba91-e362-477c-9b1d-98cffd4715f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:46.983282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a37fba91-e362-477c-9b1d-98cffd4715f6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:46.984737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a37fba91-e362-477c-9b1d-98cffd4715f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:47.182033 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3140/6259] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:18:47.224309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d97db2-c5fc-4ea2-a1c9-c2367eadcdae admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:47.226902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-36d97db2-c5fc-4ea2-a1c9-c2367eadcdae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:47.420871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:47.438539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d97db2-c5fc-4ea2-a1c9-c2367eadcdae admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:47.446591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94ecc8-43d5-4288-9711-e0241903284a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:47.447328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94ecc8-43d5-4288-9711-e0241903284a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:47.447955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94ecc8-43d5-4288-9711-e0241903284a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:47.447955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94ecc8-43d5-4288-9711-e0241903284a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:47.481444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94ecc8-43d5-4288-9711-e0241903284a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:47.483051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94ecc8-43d5-4288-9711-e0241903284a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:47.530467 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3120/6260] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:49.031218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fba91-e362-477c-9b1d-98cffd4715f6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:18:49.033728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a37fba91-e362-477c-9b1d-98cffd4715f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:49.079242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:18:49.161708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fba91-e362-477c-9b1d-98cffd4715f6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:18:49.172152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587fc90-8a35-4d9a-96da-ce32d5ea6778 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:18:49.177429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587fc90-8a35-4d9a-96da-ce32d5ea6778 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:49.177930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587fc90-8a35-4d9a-96da-ce32d5ea6778 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:49.178334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587fc90-8a35-4d9a-96da-ce32d5ea6778 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:49.182471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2587fc90-8a35-4d9a-96da-ce32d5ea6778 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:49.242201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587fc90-8a35-4d9a-96da-ce32d5ea6778 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:18:49.244998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587fc90-8a35-4d9a-96da-ce32d5ea6778 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:18:49.284084 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3141/6261] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:18:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:18:52.414967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4a8b-a5b6-448c-9d24-d81cda9007d3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:18:52.415548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4a8b-a5b6-448c-9d24-d81cda9007d3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:18:52.415759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4a8b-a5b6-448c-9d24-d81cda9007d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:18:52.473035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-adcf4a8b-a5b6-448c-9d24-d81cda9007d3 None None] MFA Rules not processed for user `c5265d83d5ae4494b59597802d052593`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:18:52.479293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-adcf4a8b-a5b6-448c-9d24-d81cda9007d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:18:52.820966 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3121/6262] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:18:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:18:59.271633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=19 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:00.170398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c0327-4b07-40ae-bcfb-52ecc063f4bb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:00.171075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c0327-4b07-40ae-bcfb-52ecc063f4bb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:00.171590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c0327-4b07-40ae-bcfb-52ecc063f4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:00.224928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e47c0327-4b07-40ae-bcfb-52ecc063f4bb None None] MFA Rules not processed for user `6f8442e91abe4b1f8439b1571a4ee385`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:00.235335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e47c0327-4b07-40ae-bcfb-52ecc063f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:00.443402 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3142/6263] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:02.772704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=29 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:04.506447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4a8b-a5b6-448c-9d24-d81cda9007d3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:04.507969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-adcf4a8b-a5b6-448c-9d24-d81cda9007d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:04.709286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4a8b-a5b6-448c-9d24-d81cda9007d3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:04.716625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a3196-442a-49f1-ba48-04617fd236c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:04.717641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a3196-442a-49f1-ba48-04617fd236c5 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:04.718102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a3196-442a-49f1-ba48-04617fd236c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:04.718551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a3196-442a-49f1-ba48-04617fd236c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:04.721116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f82a3196-442a-49f1-ba48-04617fd236c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:04.851181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a3196-442a-49f1-ba48-04617fd236c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:04.852760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a3196-442a-49f1-ba48-04617fd236c5 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:04.878341 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3122/6264] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:19:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:19:07.888826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad936be3-f6f4-4556-99df-053f8d1b5e48 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:07.889770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad936be3-f6f4-4556-99df-053f8d1b5e48 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:07.890225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad936be3-f6f4-4556-99df-053f8d1b5e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:07.935614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ad936be3-f6f4-4556-99df-053f8d1b5e48 None None] MFA Rules not processed for user `6695ec9531304e5d89c9dd6212f1cbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:07.937814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ad936be3-f6f4-4556-99df-053f8d1b5e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:08.105807 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3143/6265] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:19:08.112868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a3196-442a-49f1-ba48-04617fd236c5 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:08.114645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f82a3196-442a-49f1-ba48-04617fd236c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:08.271657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a3196-442a-49f1-ba48-04617fd236c5 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:08.279276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bc366-a97a-468d-a396-599feb655b5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:08.279973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bc366-a97a-468d-a396-599feb655b5a service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:08.280399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bc366-a97a-468d-a396-599feb655b5a service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:08.280681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bc366-a97a-468d-a396-599feb655b5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:08.303547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bc366-a97a-468d-a396-599feb655b5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:08.305197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bc366-a97a-468d-a396-599feb655b5a service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:08.339287 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3123/6266] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:19:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:19:18.092743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=57 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:18.325156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:21.378444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad936be3-f6f4-4556-99df-053f8d1b5e48 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:21.461292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad936be3-f6f4-4556-99df-053f8d1b5e48 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:21.474006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5091365-c2ca-451f-b223-2fc6cc9aad3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:21.474669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5091365-c2ca-451f-b223-2fc6cc9aad3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:21.475092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5091365-c2ca-451f-b223-2fc6cc9aad3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:21.475311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5091365-c2ca-451f-b223-2fc6cc9aad3b admin admin] PATH_INFO: `/v3/users/6695ec9531304e5d89c9dd6212f1cbd7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:21.476477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5091365-c2ca-451f-b223-2fc6cc9aad3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6695ec9531304e5d89c9dd6212f1cbd7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:21.483370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5091365-c2ca-451f-b223-2fc6cc9aad3b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:21.626472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5091365-c2ca-451f-b223-2fc6cc9aad3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6695ec9531304e5d89c9dd6212f1cbd7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:21.636893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5091365-c2ca-451f-b223-2fc6cc9aad3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6695ec9531304e5d89c9dd6212f1cbd7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:21.637840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5091365-c2ca-451f-b223-2fc6cc9aad3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6695ec9531304e5d89c9dd6212f1cbd7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:21.658037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5091365-c2ca-451f-b223-2fc6cc9aad3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6695ec9531304e5d89c9dd6212f1cbd7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:21.658996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5091365-c2ca-451f-b223-2fc6cc9aad3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6695ec9531304e5d89c9dd6212f1cbd7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:21.686370 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3144/6267] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:19:21 2022] DELETE /identity/v3/users/6695ec9531304e5d89c9dd6212f1cbd7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:22.376849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bc366-a97a-468d-a396-599feb655b5a service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:22.461990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bc366-a97a-468d-a396-599feb655b5a service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:22.652950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45ca8f-b0ca-40cc-a236-829a93b933b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:22.659434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45ca8f-b0ca-40cc-a236-829a93b933b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:22.659730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45ca8f-b0ca-40cc-a236-829a93b933b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:22.660251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45ca8f-b0ca-40cc-a236-829a93b933b6 admin admin] PATH_INFO: `/v3/projects/535c51ce72534fd38bf9a0492b7bd6da` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:22.661760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45ca8f-b0ca-40cc-a236-829a93b933b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=535c51ce72534fd38bf9a0492b7bd6da)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:22.664684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45ca8f-b0ca-40cc-a236-829a93b933b6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:22.782788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f45ca8f-b0ca-40cc-a236-829a93b933b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535c51ce72534fd38bf9a0492b7bd6da', 'request_id': 'req-7f45ca8f-b0ca-40cc-a236-829a93b933b6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:22.813106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f45ca8f-b0ca-40cc-a236-829a93b933b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535c51ce72534fd38bf9a0492b7bd6da', 'request_id': 'req-7f45ca8f-b0ca-40cc-a236-829a93b933b6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:22.822038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f45ca8f-b0ca-40cc-a236-829a93b933b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535c51ce72534fd38bf9a0492b7bd6da', 'request_id': 'req-7f45ca8f-b0ca-40cc-a236-829a93b933b6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:22.841095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f45ca8f-b0ca-40cc-a236-829a93b933b6 admin admin] The token cache is being invalidate because project 535c51ce72534fd38bf9a0492b7bd6da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:19:22.841989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f45ca8f-b0ca-40cc-a236-829a93b933b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:22.844523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f45ca8f-b0ca-40cc-a236-829a93b933b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:22.850606 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3124/6268] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:19:22 2022] DELETE /identity/v3/projects/535c51ce72534fd38bf9a0492b7bd6da => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:22.851821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba197d9b-42f4-4c85-a64f-669f2c0b40e8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:22.852290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba197d9b-42f4-4c85-a64f-669f2c0b40e8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:22.852407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba197d9b-42f4-4c85-a64f-669f2c0b40e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:22.942010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ba197d9b-42f4-4c85-a64f-669f2c0b40e8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:22.943275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ba197d9b-42f4-4c85-a64f-669f2c0b40e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:23.095988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93934b8e-1cda-4b91-9f4a-0ea8135667a9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:23.096827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93934b8e-1cda-4b91-9f4a-0ea8135667a9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:23.097317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93934b8e-1cda-4b91-9f4a-0ea8135667a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:23.107056 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3145/6269] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:23.121815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-93934b8e-1cda-4b91-9f4a-0ea8135667a9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:23.123120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-93934b8e-1cda-4b91-9f4a-0ea8135667a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:23.139876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba197d9b-42f4-4c85-a64f-669f2c0b40e8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:23.152291 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3125/6270] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:23.156430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba197d9b-42f4-4c85-a64f-669f2c0b40e8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:23.163935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34aebe-83e2-407a-9152-362b076b097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:23.164999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34aebe-83e2-407a-9152-362b076b097e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:23.165653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34aebe-83e2-407a-9152-362b076b097e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:23.166235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34aebe-83e2-407a-9152-362b076b097e admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:23.167879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34aebe-83e2-407a-9152-362b076b097e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:19:23.168406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34aebe-83e2-407a-9152-362b076b097e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:23.172141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34aebe-83e2-407a-9152-362b076b097e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:23.198221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93934b8e-1cda-4b91-9f4a-0ea8135667a9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:23.209272 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3146/6271] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:19:23.232657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93934b8e-1cda-4b91-9f4a-0ea8135667a9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:23.239264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa09c0a-ce9d-4e78-b897-57409fa9183b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:23.241218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa09c0a-ce9d-4e78-b897-57409fa9183b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:23.241453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa09c0a-ce9d-4e78-b897-57409fa9183b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:23.241743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa09c0a-ce9d-4e78-b897-57409fa9183b admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:23.242398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa09c0a-ce9d-4e78-b897-57409fa9183b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:23.244828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa09c0a-ce9d-4e78-b897-57409fa9183b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:23.317476 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3126/6272] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:19:23 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:23.322138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34aebe-83e2-407a-9152-362b076b097e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:23.342680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34aebe-83e2-407a-9152-362b076b097e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:23.400487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:23.450574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84df95e-6469-4e95-9442-527acec760c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:23.451457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df95e-6469-4e95-9442-527acec760c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:23.452166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df95e-6469-4e95-9442-527acec760c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:23.453420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df95e-6469-4e95-9442-527acec760c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:23.454308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84df95e-6469-4e95-9442-527acec760c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:23.456724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84df95e-6469-4e95-9442-527acec760c1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:23.493972 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3147/6273] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:19:23 2022] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:23.498097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa09c0a-ce9d-4e78-b897-57409fa9183b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:23.531832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa09c0a-ce9d-4e78-b897-57409fa9183b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:23.549884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ede50-0dc2-4905-af39-e3ef31a7f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:23.551494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ede50-0dc2-4905-af39-e3ef31a7f971 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:23.552444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ede50-0dc2-4905-af39-e3ef31a7f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:23.552731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ede50-0dc2-4905-af39-e3ef31a7f971 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:23.555288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ede50-0dc2-4905-af39-e3ef31a7f971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:23.556937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ede50-0dc2-4905-af39-e3ef31a7f971 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:23.604246 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3127/6274] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:19:23.608282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84df95e-6469-4e95-9442-527acec760c1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:23.624484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84df95e-6469-4e95-9442-527acec760c1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:23.631691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba6085-30b3-4cb9-98c7-d91feffaeee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:23.632488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba6085-30b3-4cb9-98c7-d91feffaeee1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:23.632862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba6085-30b3-4cb9-98c7-d91feffaeee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:23.633233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba6085-30b3-4cb9-98c7-d91feffaeee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:23.634138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba6085-30b3-4cb9-98c7-d91feffaeee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:23.636064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba6085-30b3-4cb9-98c7-d91feffaeee1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:23.652603 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3148/6275] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:19:23.657080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ede50-0dc2-4905-af39-e3ef31a7f971 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:23.674532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ede50-0dc2-4905-af39-e3ef31a7f971 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:23.693430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445641c-4b4c-41f5-9f16-6abfe17e659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:23.694427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445641c-4b4c-41f5-9f16-6abfe17e659a admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:23.694846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445641c-4b4c-41f5-9f16-6abfe17e659a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:23.695222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445641c-4b4c-41f5-9f16-6abfe17e659a admin admin] PATH_INFO: `/v3/projects/bb257f36e38c4afeaa3381ec790b3352/users/e5f7a5b2070145bd9e09adf2352deb84/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:23.716365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445641c-4b4c-41f5-9f16-6abfe17e659a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb257f36e38c4afeaa3381ec790b3352, user_id=e5f7a5b2070145bd9e09adf2352deb84, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:23.720247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445641c-4b4c-41f5-9f16-6abfe17e659a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:23.757085 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3128/6276] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:19:23 2022] PUT /identity/v3/projects/bb257f36e38c4afeaa3381ec790b3352/users/e5f7a5b2070145bd9e09adf2352deb84/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:19:23.758940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d0899-89c7-4933-aec1-a73908d6c90d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:23.759227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d0899-89c7-4933-aec1-a73908d6c90d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:23.759500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d0899-89c7-4933-aec1-a73908d6c90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:23.814186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ae6d0899-89c7-4933-aec1-a73908d6c90d None None] MFA Rules not processed for user `e5f7a5b2070145bd9e09adf2352deb84`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:23.815510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ae6d0899-89c7-4933-aec1-a73908d6c90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:23.954621 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3149/6277] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:24.520660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445641c-4b4c-41f5-9f16-6abfe17e659a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:24.523632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5445641c-4b4c-41f5-9f16-6abfe17e659a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:24.527219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:24.696859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445641c-4b4c-41f5-9f16-6abfe17e659a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:24.705587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78e57e-3a49-4a08-83ef-6892158dbabf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:24.706230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78e57e-3a49-4a08-83ef-6892158dbabf service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:24.706510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78e57e-3a49-4a08-83ef-6892158dbabf service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:24.707037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78e57e-3a49-4a08-83ef-6892158dbabf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:24.718916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78e57e-3a49-4a08-83ef-6892158dbabf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:24.721027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78e57e-3a49-4a08-83ef-6892158dbabf service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:24.751212 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3129/6278] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:19:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:19:24.860965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d0899-89c7-4933-aec1-a73908d6c90d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:25.024108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d0899-89c7-4933-aec1-a73908d6c90d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:25.029079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:25.029734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:25.030023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:25.030300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] PATH_INFO: `/v3/users/e5f7a5b2070145bd9e09adf2352deb84` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:25.035678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f7a5b2070145bd9e09adf2352deb84)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:25.037997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:25.152815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:25.165148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f7a5b2070145bd9e09adf2352deb84'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:25.182715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f7a5b2070145bd9e09adf2352deb84'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:25.183677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f7a5b2070145bd9e09adf2352deb84'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:25.199542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f7a5b2070145bd9e09adf2352deb84'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:25.200616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f7a5b2070145bd9e09adf2352deb84'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:25.248777 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3150/6279] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:19:24 2022] DELETE /identity/v3/users/e5f7a5b2070145bd9e09adf2352deb84 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:25.254206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f42cf8-996d-4d23-bb3d-04a2b428bced None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:25.254714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f42cf8-996d-4d23-bb3d-04a2b428bced None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:25.255223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f42cf8-996d-4d23-bb3d-04a2b428bced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:25.297096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-43f42cf8-996d-4d23-bb3d-04a2b428bced None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:25.303694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-43f42cf8-996d-4d23-bb3d-04a2b428bced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:25.547786 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3130/6280] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:19:25.616697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:25.618221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:25.823809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8505a-f884-49cb-abb2-7b5890d23a5b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:25.840930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916b2ab-3c83-48e3-bb7a-9f02f3187249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:25.841761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916b2ab-3c83-48e3-bb7a-9f02f3187249 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:25.842048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916b2ab-3c83-48e3-bb7a-9f02f3187249 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:25.842324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916b2ab-3c83-48e3-bb7a-9f02f3187249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:25.878352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916b2ab-3c83-48e3-bb7a-9f02f3187249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:25.880116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916b2ab-3c83-48e3-bb7a-9f02f3187249 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:25.902899 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3151/6281] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:19:28.194561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f42cf8-996d-4d23-bb3d-04a2b428bced None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:28.196340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-43f42cf8-996d-4d23-bb3d-04a2b428bced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:28.213067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f42cf8-996d-4d23-bb3d-04a2b428bced None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:28.244996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff71da1-1205-4c49-8233-81aa33062bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:28.247598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff71da1-1205-4c49-8233-81aa33062bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:28.248762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff71da1-1205-4c49-8233-81aa33062bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:28.256503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff71da1-1205-4c49-8233-81aa33062bd9 admin admin] PATH_INFO: `/v3/projects/bb257f36e38c4afeaa3381ec790b3352` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:28.261180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff71da1-1205-4c49-8233-81aa33062bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb257f36e38c4afeaa3381ec790b3352)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:28.273206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff71da1-1205-4c49-8233-81aa33062bd9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:28.410882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bff71da1-1205-4c49-8233-81aa33062bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb257f36e38c4afeaa3381ec790b3352', 'request_id': 'req-bff71da1-1205-4c49-8233-81aa33062bd9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:28.421523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bff71da1-1205-4c49-8233-81aa33062bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb257f36e38c4afeaa3381ec790b3352', 'request_id': 'req-bff71da1-1205-4c49-8233-81aa33062bd9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:28.440427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bff71da1-1205-4c49-8233-81aa33062bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb257f36e38c4afeaa3381ec790b3352', 'request_id': 'req-bff71da1-1205-4c49-8233-81aa33062bd9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:28.442909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:28.465581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bff71da1-1205-4c49-8233-81aa33062bd9 admin admin] The token cache is being invalidate because project bb257f36e38c4afeaa3381ec790b3352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:19:28.465925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bff71da1-1205-4c49-8233-81aa33062bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:28.478491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bff71da1-1205-4c49-8233-81aa33062bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:28.480504 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3131/6282] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:19:28 2022] DELETE /identity/v3/projects/bb257f36e38c4afeaa3381ec790b3352 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:28.485298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ce20-c458-412b-a27a-584432181b5a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:28.485788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ce20-c458-412b-a27a-584432181b5a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:28.486009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ce20-c458-412b-a27a-584432181b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:28.544222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ae61ce20-c458-412b-a27a-584432181b5a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:28.548708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ae61ce20-c458-412b-a27a-584432181b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:28.687553 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3152/6283] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:28.696022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939a89-82fa-47dc-b19a-752aa6f44c65 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:28.696022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939a89-82fa-47dc-b19a-752aa6f44c65 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:28.696544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939a89-82fa-47dc-b19a-752aa6f44c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:28.747343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2d939a89-82fa-47dc-b19a-752aa6f44c65 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:28.749052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2d939a89-82fa-47dc-b19a-752aa6f44c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:28.775834 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3132/6284] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:28.780268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61ce20-c458-412b-a27a-584432181b5a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:28.797605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61ce20-c458-412b-a27a-584432181b5a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:28.811540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a67013-721a-4938-a876-631ccb3a481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:28.812763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a67013-721a-4938-a876-631ccb3a481b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:28.813225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a67013-721a-4938-a876-631ccb3a481b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:28.813669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a67013-721a-4938-a876-631ccb3a481b admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:28.814509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a67013-721a-4938-a876-631ccb3a481b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:19:28.815049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a67013-721a-4938-a876-631ccb3a481b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:28.817597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a67013-721a-4938-a876-631ccb3a481b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:28.852180 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3153/6285] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:19:28.856811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d939a89-82fa-47dc-b19a-752aa6f44c65 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:28.875214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d939a89-82fa-47dc-b19a-752aa6f44c65 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:28.886778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b399cba-ddc4-416d-8dca-151f6e696775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:28.888443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b399cba-ddc4-416d-8dca-151f6e696775 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:28.890615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b399cba-ddc4-416d-8dca-151f6e696775 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:28.891854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b399cba-ddc4-416d-8dca-151f6e696775 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:28.893587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b399cba-ddc4-416d-8dca-151f6e696775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:28.898588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b399cba-ddc4-416d-8dca-151f6e696775 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:29.012630 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3133/6286] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:19:28 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:29.017592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a67013-721a-4938-a876-631ccb3a481b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:29.041071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a67013-721a-4938-a876-631ccb3a481b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:29.148730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:29.181518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc074882-aa86-4cb1-8160-45e0bf09a21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:29.181897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc074882-aa86-4cb1-8160-45e0bf09a21c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:29.182231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc074882-aa86-4cb1-8160-45e0bf09a21c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:29.182489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc074882-aa86-4cb1-8160-45e0bf09a21c admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:29.183311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc074882-aa86-4cb1-8160-45e0bf09a21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:29.185316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc074882-aa86-4cb1-8160-45e0bf09a21c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:29.249921 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3154/6287] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:19:29 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:29.254151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b399cba-ddc4-416d-8dca-151f6e696775 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:29.267167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b399cba-ddc4-416d-8dca-151f6e696775 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:29.299308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd06e8a-3dc5-462c-af47-7762f6384d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:29.299853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd06e8a-3dc5-462c-af47-7762f6384d18 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:29.300146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd06e8a-3dc5-462c-af47-7762f6384d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:29.300424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd06e8a-3dc5-462c-af47-7762f6384d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:29.301297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd06e8a-3dc5-462c-af47-7762f6384d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:29.303658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd06e8a-3dc5-462c-af47-7762f6384d18 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:29.329652 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3134/6288] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:19:29.334787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc074882-aa86-4cb1-8160-45e0bf09a21c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:29.363726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc074882-aa86-4cb1-8160-45e0bf09a21c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:29.388193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29e7aa-347b-4e1e-a1e8-8e25474749f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:29.388193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29e7aa-347b-4e1e-a1e8-8e25474749f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:29.388193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29e7aa-347b-4e1e-a1e8-8e25474749f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:29.388193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29e7aa-347b-4e1e-a1e8-8e25474749f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:29.388833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29e7aa-347b-4e1e-a1e8-8e25474749f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:29.391979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29e7aa-347b-4e1e-a1e8-8e25474749f8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:29.414107 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3155/6289] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:19:29.418360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd06e8a-3dc5-462c-af47-7762f6384d18 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:29.432604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd06e8a-3dc5-462c-af47-7762f6384d18 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:29.447495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024173b-13f8-4fa8-8d54-7e5e609630df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:29.448570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024173b-13f8-4fa8-8d54-7e5e609630df admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:29.449115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024173b-13f8-4fa8-8d54-7e5e609630df admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:29.449641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024173b-13f8-4fa8-8d54-7e5e609630df admin admin] PATH_INFO: `/v3/projects/b19da1e4c3ea45cb9dc4998499e84272/users/4fc4f9d949d4402599c845fc6c88e2fb/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:29.485203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024173b-13f8-4fa8-8d54-7e5e609630df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19da1e4c3ea45cb9dc4998499e84272, user_id=4fc4f9d949d4402599c845fc6c88e2fb, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:29.489597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024173b-13f8-4fa8-8d54-7e5e609630df admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:29.510395 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3135/6290] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:19:29 2022] PUT /identity/v3/projects/b19da1e4c3ea45cb9dc4998499e84272/users/4fc4f9d949d4402599c845fc6c88e2fb/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:29.522157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3d981-4286-4864-95b0-55d61d2f30cd None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:29.522788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3d981-4286-4864-95b0-55d61d2f30cd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:29.522788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3d981-4286-4864-95b0-55d61d2f30cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:29.599755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-abd3d981-4286-4864-95b0-55d61d2f30cd None None] MFA Rules not processed for user `4fc4f9d949d4402599c845fc6c88e2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:29.601141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-abd3d981-4286-4864-95b0-55d61d2f30cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:29.704682 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3156/6291] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:19:30.211723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce6a41-d8b4-4d41-8073-94f625eebe8d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:30.212506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce6a41-d8b4-4d41-8073-94f625eebe8d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:30.214017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3d981-4286-4864-95b0-55d61d2f30cd None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:30.215126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce6a41-d8b4-4d41-8073-94f625eebe8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:30.220271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-abd3d981-4286-4864-95b0-55d61d2f30cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:30.308094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-61ce6a41-d8b4-4d41-8073-94f625eebe8d None None] MFA Rules not processed for user `c5265d83d5ae4494b59597802d052593`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:30.309378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-61ce6a41-d8b4-4d41-8073-94f625eebe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:30.445079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3d981-4286-4864-95b0-55d61d2f30cd None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:30.473598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0920c-a507-46d0-a7c9-35780cb3dd4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:30.473598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0920c-a507-46d0-a7c9-35780cb3dd4b service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:30.473598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0920c-a507-46d0-a7c9-35780cb3dd4b service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:30.473598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0920c-a507-46d0-a7c9-35780cb3dd4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:30.522752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0920c-a507-46d0-a7c9-35780cb3dd4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:30.524421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0920c-a507-46d0-a7c9-35780cb3dd4b service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:30.544864 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3136/6292] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:30.571938 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3157/6293] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:19:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:19:32.106498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce6a41-d8b4-4d41-8073-94f625eebe8d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:32.257107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce6a41-d8b4-4d41-8073-94f625eebe8d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:32.274242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:32.274940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:32.275245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:32.275531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] PATH_INFO: `/v3/users/4fc4f9d949d4402599c845fc6c88e2fb` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:32.278368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc4f9d949d4402599c845fc6c88e2fb)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:32.283183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:32.418188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:32.436055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc4f9d949d4402599c845fc6c88e2fb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:32.459193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc4f9d949d4402599c845fc6c88e2fb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:32.461960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc4f9d949d4402599c845fc6c88e2fb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:32.503670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc4f9d949d4402599c845fc6c88e2fb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:32.505256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc4f9d949d4402599c845fc6c88e2fb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:32.541003 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3137/6294] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:19:32 2022] DELETE /identity/v3/users/4fc4f9d949d4402599c845fc6c88e2fb => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:32.545342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e53cb-9989-41d6-b649-044f3470afc8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:32.546948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e53cb-9989-41d6-b649-044f3470afc8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:32.547448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e53cb-9989-41d6-b649-044f3470afc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:32.602011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-941e53cb-9989-41d6-b649-044f3470afc8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:32.603997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-941e53cb-9989-41d6-b649-044f3470afc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:32.707724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:32.764506 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3158/6295] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:32.823648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:32.825973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:33.025084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fc58a-3945-4689-ad26-465b168de371 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:33.039360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345968d-87f3-4da5-97dd-6985a02c7bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:33.040203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345968d-87f3-4da5-97dd-6985a02c7bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:33.040656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345968d-87f3-4da5-97dd-6985a02c7bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:33.041783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345968d-87f3-4da5-97dd-6985a02c7bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:33.073694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345968d-87f3-4da5-97dd-6985a02c7bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:33.075732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345968d-87f3-4da5-97dd-6985a02c7bc2 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:33.113994 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3138/6296] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:19:34.967519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e53cb-9989-41d6-b649-044f3470afc8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:34.970517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-941e53cb-9989-41d6-b649-044f3470afc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:35.026715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e53cb-9989-41d6-b649-044f3470afc8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:35.064535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:35.068213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:35.069330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:35.069330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827 admin admin] PATH_INFO: `/v3/projects/b19da1e4c3ea45cb9dc4998499e84272` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:35.074481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19da1e4c3ea45cb9dc4998499e84272)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:35.079820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:35.220964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19da1e4c3ea45cb9dc4998499e84272', 'request_id': 'req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:35.239405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19da1e4c3ea45cb9dc4998499e84272', 'request_id': 'req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:35.263842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19da1e4c3ea45cb9dc4998499e84272', 'request_id': 'req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:35.303973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827 admin admin] The token cache is being invalidate because project b19da1e4c3ea45cb9dc4998499e84272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:19:35.304649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:35.307225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8dd2def4-b3ea-44ba-a7eb-56c05be4e827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:35.315120 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3159/6297] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:19:34 2022] DELETE /identity/v3/projects/b19da1e4c3ea45cb9dc4998499e84272 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:35.317388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f884849-e964-4be0-899b-5a182f1d9017 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:35.317855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f884849-e964-4be0-899b-5a182f1d9017 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:35.318113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f884849-e964-4be0-899b-5a182f1d9017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:35.388380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9f884849-e964-4be0-899b-5a182f1d9017 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:35.390451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9f884849-e964-4be0-899b-5a182f1d9017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:35.553582 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3139/6298] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:19:35.563197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6d195-5d87-4c64-b344-79932cf57118 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:35.563773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6d195-5d87-4c64-b344-79932cf57118 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:35.565582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6d195-5d87-4c64-b344-79932cf57118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:35.611036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3ce6d195-5d87-4c64-b344-79932cf57118 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:35.612517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ce6d195-5d87-4c64-b344-79932cf57118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:35.636619 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3160/6299] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:19:35.641381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f884849-e964-4be0-899b-5a182f1d9017 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:35.662264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f884849-e964-4be0-899b-5a182f1d9017 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:35.679546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5acc5-fc69-47f3-b2b2-66b1bfb65128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:35.680441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5acc5-fc69-47f3-b2b2-66b1bfb65128 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:35.680960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5acc5-fc69-47f3-b2b2-66b1bfb65128 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:35.681459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5acc5-fc69-47f3-b2b2-66b1bfb65128 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:35.682732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5acc5-fc69-47f3-b2b2-66b1bfb65128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:19:35.683293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5acc5-fc69-47f3-b2b2-66b1bfb65128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:35.685339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5acc5-fc69-47f3-b2b2-66b1bfb65128 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:35.720124 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3140/6300] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:19:35.728379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6d195-5d87-4c64-b344-79932cf57118 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:35.744209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6d195-5d87-4c64-b344-79932cf57118 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:35.751212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298707e-56d6-4731-a48c-45b6aeb1dca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:35.751851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298707e-56d6-4731-a48c-45b6aeb1dca2 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:35.752487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298707e-56d6-4731-a48c-45b6aeb1dca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:35.752487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298707e-56d6-4731-a48c-45b6aeb1dca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:35.753047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298707e-56d6-4731-a48c-45b6aeb1dca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:35.755416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298707e-56d6-4731-a48c-45b6aeb1dca2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:35.815418 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3161/6301] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:19:35 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:35.816642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5acc5-fc69-47f3-b2b2-66b1bfb65128 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:35.837269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5acc5-fc69-47f3-b2b2-66b1bfb65128 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:35.912870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:35.935814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a004c13-6851-4760-b0d2-9e5f80071937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:35.937789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a004c13-6851-4760-b0d2-9e5f80071937 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:35.938652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a004c13-6851-4760-b0d2-9e5f80071937 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:35.939179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a004c13-6851-4760-b0d2-9e5f80071937 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:35.940032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a004c13-6851-4760-b0d2-9e5f80071937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:35.942878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a004c13-6851-4760-b0d2-9e5f80071937 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:35.987611 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3141/6302] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:19:35 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:19:35.991675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298707e-56d6-4731-a48c-45b6aeb1dca2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:36.007881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298707e-56d6-4731-a48c-45b6aeb1dca2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:36.016112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b32d75-934f-4f13-b37a-e6248489d1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:36.017656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b32d75-934f-4f13-b37a-e6248489d1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:36.018119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b32d75-934f-4f13-b37a-e6248489d1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:36.019074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b32d75-934f-4f13-b37a-e6248489d1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:36.020577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b32d75-934f-4f13-b37a-e6248489d1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:36.023062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b32d75-934f-4f13-b37a-e6248489d1d2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:36.043468 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3162/6303] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:19:36.048092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a004c13-6851-4760-b0d2-9e5f80071937 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:36.071801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a004c13-6851-4760-b0d2-9e5f80071937 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:36.080743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d80d5-f42e-4627-a338-47c8ff6de6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:36.082651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d80d5-f42e-4627-a338-47c8ff6de6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:36.082990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d80d5-f42e-4627-a338-47c8ff6de6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:36.083277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d80d5-f42e-4627-a338-47c8ff6de6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:36.083930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d80d5-f42e-4627-a338-47c8ff6de6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:36.086057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d80d5-f42e-4627-a338-47c8ff6de6f0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:36.104210 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3142/6304] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:19:36.107949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b32d75-934f-4f13-b37a-e6248489d1d2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:36.123390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b32d75-934f-4f13-b37a-e6248489d1d2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:36.130833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7c65d-5380-43b7-badc-62743c96102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:36.132472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7c65d-5380-43b7-badc-62743c96102f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:36.133148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7c65d-5380-43b7-badc-62743c96102f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:36.133793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7c65d-5380-43b7-badc-62743c96102f admin admin] PATH_INFO: `/v3/projects/372e007324c2461ab2845b2810007143/users/a42e6501407645e18e9c9a3583103983/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:36.158203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7c65d-5380-43b7-badc-62743c96102f admin admin] RBAC: Authorizing `identity:create_grant(project_id=372e007324c2461ab2845b2810007143, user_id=a42e6501407645e18e9c9a3583103983, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:36.161364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7c65d-5380-43b7-badc-62743c96102f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:36.194139 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3163/6305] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:19:36 2022] PUT /identity/v3/projects/372e007324c2461ab2845b2810007143/users/a42e6501407645e18e9c9a3583103983/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:19:36.195706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364266f-060d-4e89-8276-a4aca89e7759 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:36.196005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364266f-060d-4e89-8276-a4aca89e7759 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:36.197213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364266f-060d-4e89-8276-a4aca89e7759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:36.239248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6364266f-060d-4e89-8276-a4aca89e7759 None None] MFA Rules not processed for user `a42e6501407645e18e9c9a3583103983`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:36.240960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6364266f-060d-4e89-8276-a4aca89e7759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:36.455547 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3143/6306] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:36.460000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7c65d-5380-43b7-badc-62743c96102f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:36.651334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7c65d-5380-43b7-badc-62743c96102f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:36.660708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86a885-4ef1-4863-b68e-6595d9b55199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:36.661677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86a885-4ef1-4863-b68e-6595d9b55199 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:36.662170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86a885-4ef1-4863-b68e-6595d9b55199 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:36.663899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86a885-4ef1-4863-b68e-6595d9b55199 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:36.665558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86a885-4ef1-4863-b68e-6595d9b55199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:36.667848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86a885-4ef1-4863-b68e-6595d9b55199 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:36.692264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:36.737298 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3164/6307] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:19:36 2022] POST /identity/v3/projects => generated 375 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:36.741380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364266f-060d-4e89-8276-a4aca89e7759 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:36.759442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364266f-060d-4e89-8276-a4aca89e7759 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:36.943485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71802d13-5cff-4353-ba2d-55494ffa700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:36.944120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71802d13-5cff-4353-ba2d-55494ffa700a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:36.944399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71802d13-5cff-4353-ba2d-55494ffa700a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:36.944673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71802d13-5cff-4353-ba2d-55494ffa700a admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:36.945318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71802d13-5cff-4353-ba2d-55494ffa700a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:36.947300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71802d13-5cff-4353-ba2d-55494ffa700a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:37.030717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86a885-4ef1-4863-b68e-6595d9b55199 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:37.031601 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3144/6308] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:19:36 2022] POST /identity/v3/users => generated 294 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:37.047630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86a885-4ef1-4863-b68e-6595d9b55199 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:37.063715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8d676-99fc-43da-bc50-cc451a5b33e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:37.064344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8d676-99fc-43da-bc50-cc451a5b33e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:37.064625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8d676-99fc-43da-bc50-cc451a5b33e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:37.064898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8d676-99fc-43da-bc50-cc451a5b33e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:37.065547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8d676-99fc-43da-bc50-cc451a5b33e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:37.067210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8d676-99fc-43da-bc50-cc451a5b33e6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:37.088711 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3165/6309] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:19:37.097981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71802d13-5cff-4353-ba2d-55494ffa700a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:37.129604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71802d13-5cff-4353-ba2d-55494ffa700a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:37.153058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccfe07-d3fe-4ecd-ad27-966f430919f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:37.153906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccfe07-d3fe-4ecd-ad27-966f430919f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:37.154348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccfe07-d3fe-4ecd-ad27-966f430919f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:37.154947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccfe07-d3fe-4ecd-ad27-966f430919f0 admin admin] PATH_INFO: `/v3/projects/095763a007b7480d985beece805f5e49/users/71eaf7c5fa4e4736bbf1b9d4ebcd3135/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:37.199560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ccfe07-d3fe-4ecd-ad27-966f430919f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095763a007b7480d985beece805f5e49, user_id=71eaf7c5fa4e4736bbf1b9d4ebcd3135, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:37.202847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ccfe07-d3fe-4ecd-ad27-966f430919f0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:37.248225 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3145/6310] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:19:37 2022] PUT /identity/v3/projects/095763a007b7480d985beece805f5e49/users/71eaf7c5fa4e4736bbf1b9d4ebcd3135/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:37.252816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8d676-99fc-43da-bc50-cc451a5b33e6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:37.271691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8d676-99fc-43da-bc50-cc451a5b33e6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:37.552783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647ca12-b3c6-4a61-ad62-f77c18121919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:37.553668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647ca12-b3c6-4a61-ad62-f77c18121919 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:37.553668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647ca12-b3c6-4a61-ad62-f77c18121919 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:37.554356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647ca12-b3c6-4a61-ad62-f77c18121919 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:37.555606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647ca12-b3c6-4a61-ad62-f77c18121919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:37.559208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647ca12-b3c6-4a61-ad62-f77c18121919 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:37.605249 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3166/6311] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:19:37.611214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccfe07-d3fe-4ecd-ad27-966f430919f0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:37.637901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccfe07-d3fe-4ecd-ad27-966f430919f0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:37.671233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5b15b-05fa-46d9-baef-ce9d9fabecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:37.676409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5b15b-05fa-46d9-baef-ce9d9fabecce admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:37.677918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5b15b-05fa-46d9-baef-ce9d9fabecce admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:37.678465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5b15b-05fa-46d9-baef-ce9d9fabecce admin admin] PATH_INFO: `/v3/projects/095763a007b7480d985beece805f5e49/users/71eaf7c5fa4e4736bbf1b9d4ebcd3135/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:37.692086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5b15b-05fa-46d9-baef-ce9d9fabecce admin admin] RBAC: Authorizing `identity:create_grant(project_id=095763a007b7480d985beece805f5e49, user_id=71eaf7c5fa4e4736bbf1b9d4ebcd3135, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:37.714335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5b15b-05fa-46d9-baef-ce9d9fabecce admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:37.778165 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3146/6312] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:19:37 2022] PUT /identity/v3/projects/095763a007b7480d985beece805f5e49/users/71eaf7c5fa4e4736bbf1b9d4ebcd3135/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:37.791114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85739f0-ca1e-4aa6-b7c0-6997c6b8c070 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:37.792182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85739f0-ca1e-4aa6-b7c0-6997c6b8c070 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:37.792592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85739f0-ca1e-4aa6-b7c0-6997c6b8c070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:37.830671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f85739f0-ca1e-4aa6-b7c0-6997c6b8c070 None None] MFA Rules not processed for user `71eaf7c5fa4e4736bbf1b9d4ebcd3135`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:37.831958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f85739f0-ca1e-4aa6-b7c0-6997c6b8c070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:37.928875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5b15b-05fa-46d9-baef-ce9d9fabecce admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:37.935274 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3167/6313] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:37.944658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5b15b-05fa-46d9-baef-ce9d9fabecce admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:37.949879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc8e9-416a-424d-98f1-7c36b0d7763b tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71eaf7c5fa4e4736bbf1b9d4ebcd3135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095763a007b7480d985beece805f5e49', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:37.950515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc8e9-416a-424d-98f1-7c36b0d7763b tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:37.951619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc8e9-416a-424d-98f1-7c36b0d7763b tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:37.952033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecc8e9-416a-424d-98f1-7c36b0d7763b tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:37.956120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecc8e9-416a-424d-98f1-7c36b0d7763b tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:37.956120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecc8e9-416a-424d-98f1-7c36b0d7763b tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:37.962581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:38.012379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85739f0-ca1e-4aa6-b7c0-6997c6b8c070 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:38.026025 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3147/6314] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:19:37 2022] POST /identity/v3/domains => generated 246 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:38.029534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85739f0-ca1e-4aa6-b7c0-6997c6b8c070 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:38.286364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b74a1-648a-42f5-9ca5-c9ab14bc37c7 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71eaf7c5fa4e4736bbf1b9d4ebcd3135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095763a007b7480d985beece805f5e49', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:38.287123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b74a1-648a-42f5-9ca5-c9ab14bc37c7 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:38.287912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b74a1-648a-42f5-9ca5-c9ab14bc37c7 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:38.288455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b74a1-648a-42f5-9ca5-c9ab14bc37c7 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:38.289348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b74a1-648a-42f5-9ca5-c9ab14bc37c7 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:38.294626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b74a1-648a-42f5-9ca5-c9ab14bc37c7 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:38.335343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:38.495989 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3168/6315] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:19:38 2022] POST /identity/v3/projects => generated 408 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:19:38.501047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc8e9-416a-424d-98f1-7c36b0d7763b tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:38.528535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecc8e9-416a-424d-98f1-7c36b0d7763b tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:38.749983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf786e-4a21-4678-8b11-b7a92882cedd tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71eaf7c5fa4e4736bbf1b9d4ebcd3135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095763a007b7480d985beece805f5e49', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:38.750870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf786e-4a21-4678-8b11-b7a92882cedd tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:38.751167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf786e-4a21-4678-8b11-b7a92882cedd tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:38.751307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf786e-4a21-4678-8b11-b7a92882cedd tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:38.751953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf786e-4a21-4678-8b11-b7a92882cedd tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:38.756764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf786e-4a21-4678-8b11-b7a92882cedd tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:38.830841 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3148/6316] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:19:38 2022] POST /identity/v3/users => generated 347 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:38.832306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b74a1-648a-42f5-9ca5-c9ab14bc37c7 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:38.850320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b74a1-648a-42f5-9ca5-c9ab14bc37c7 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:38.869840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f11c21-7db0-4968-af59-ed7aa780e8af tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71eaf7c5fa4e4736bbf1b9d4ebcd3135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095763a007b7480d985beece805f5e49', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:38.871386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f11c21-7db0-4968-af59-ed7aa780e8af tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:38.871386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f11c21-7db0-4968-af59-ed7aa780e8af tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:38.871638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f11c21-7db0-4968-af59-ed7aa780e8af tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:38.872347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f11c21-7db0-4968-af59-ed7aa780e8af tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:38.881691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f11c21-7db0-4968-af59-ed7aa780e8af tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:38.927450 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3169/6317] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:19:38.946491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf786e-4a21-4678-8b11-b7a92882cedd tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:38.966793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf786e-4a21-4678-8b11-b7a92882cedd tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:38.989552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48409534-9547-433c-a415-91b4c1fcea0c tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71eaf7c5fa4e4736bbf1b9d4ebcd3135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095763a007b7480d985beece805f5e49', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:38.990360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48409534-9547-433c-a415-91b4c1fcea0c tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:38.990726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48409534-9547-433c-a415-91b4c1fcea0c tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:38.991225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48409534-9547-433c-a415-91b4c1fcea0c tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] PATH_INFO: `/v3/projects/39cec81c449e4276abff4b4173d1ce78/users/b5b7e8ae51fd4ed79843f40dc2786af8/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:39.091171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48409534-9547-433c-a415-91b4c1fcea0c tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorizing `identity:create_grant(project_id=39cec81c449e4276abff4b4173d1ce78, user_id=b5b7e8ae51fd4ed79843f40dc2786af8, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:39.104784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48409534-9547-433c-a415-91b4c1fcea0c tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:39.164262 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3149/6318] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:19:38 2022] PUT /identity/v3/projects/39cec81c449e4276abff4b4173d1ce78/users/b5b7e8ae51fd4ed79843f40dc2786af8/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:39.172132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48660580-946f-4c3d-8163-365994af513e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:39.172437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48660580-946f-4c3d-8163-365994af513e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:39.172937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48660580-946f-4c3d-8163-365994af513e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:39.414942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-48660580-946f-4c3d-8163-365994af513e None None] MFA Rules not processed for user `b5b7e8ae51fd4ed79843f40dc2786af8`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:39.417056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-48660580-946f-4c3d-8163-365994af513e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:39.449430 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3170/6319] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:39.466773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b01cbd-ed18-413f-9ebc-2f80d67cffff None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:39.466974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b01cbd-ed18-413f-9ebc-2f80d67cffff None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:39.467263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b01cbd-ed18-413f-9ebc-2f80d67cffff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:39.512401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-91b01cbd-ed18-413f-9ebc-2f80d67cffff None None] MFA Rules not processed for user `b5b7e8ae51fd4ed79843f40dc2786af8`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:39.513651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-91b01cbd-ed18-413f-9ebc-2f80d67cffff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:39.534119 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3150/6320] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:39.539580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48660580-946f-4c3d-8163-365994af513e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:39.558570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48660580-946f-4c3d-8163-365994af513e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:39.575476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcff414-c0a1-4343-8594-325bc5ad8704 tempest-test_project-453625569 tempest-user-927926699] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5b7e8ae51fd4ed79843f40dc2786af8', 'user_domain_id': '18055aae94a6426f98481096db69e8ff', 'system_scope': None, 'project_id': '39cec81c449e4276abff4b4173d1ce78', 'project_domain_id': '18055aae94a6426f98481096db69e8ff', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:39.576133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcff414-c0a1-4343-8594-325bc5ad8704 tempest-test_project-453625569 tempest-user-927926699] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:39.577543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcff414-c0a1-4343-8594-325bc5ad8704 tempest-test_project-453625569 tempest-user-927926699] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:39.577543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcff414-c0a1-4343-8594-325bc5ad8704 tempest-test_project-453625569 tempest-user-927926699] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:39.597765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcff414-c0a1-4343-8594-325bc5ad8704 tempest-test_project-453625569 tempest-user-927926699] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:39.599553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcff414-c0a1-4343-8594-325bc5ad8704 tempest-test_project-453625569 tempest-user-927926699] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:39.627028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b01cbd-ed18-413f-9ebc-2f80d67cffff None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:39.627899 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3171/6321] 10.222.0.70 () {56 vars in 1284 bytes} [Sun Aug 28 19:19:39 2022] GET /identity/v3/auth/tokens => generated 3361 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:19:39.859612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b01cbd-ed18-413f-9ebc-2f80d67cffff None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:39.873589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71eaf7c5fa4e4736bbf1b9d4ebcd3135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095763a007b7480d985beece805f5e49', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:39.874458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:39.877836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:39.877836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] PATH_INFO: `/v3/users/b5b7e8ae51fd4ed79843f40dc2786af8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:39.878063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b5b7e8ae51fd4ed79843f40dc2786af8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:39.880143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:39.996511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b7e8ae51fd4ed79843f40dc2786af8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.009130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:40.016778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b7e8ae51fd4ed79843f40dc2786af8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.018221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b7e8ae51fd4ed79843f40dc2786af8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.042291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b7e8ae51fd4ed79843f40dc2786af8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.043611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b7e8ae51fd4ed79843f40dc2786af8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.074997 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3151/6322] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:19:39 2022] DELETE /identity/v3/users/b5b7e8ae51fd4ed79843f40dc2786af8 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:19:40.079670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcff414-c0a1-4343-8594-325bc5ad8704 tempest-test_project-453625569 tempest-user-927926699] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:40.098396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcff414-c0a1-4343-8594-325bc5ad8704 tempest-test_project-453625569 tempest-user-927926699] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:40.332158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71eaf7c5fa4e4736bbf1b9d4ebcd3135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095763a007b7480d985beece805f5e49', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:40.339423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:40.339423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:40.339423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] PATH_INFO: `/v3/projects/39cec81c449e4276abff4b4173d1ce78` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:40.345505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorizing `identity:delete_project(project_id=39cec81c449e4276abff4b4173d1ce78)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:40.353699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:40.460196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:40.528157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39cec81c449e4276abff4b4173d1ce78', 'request_id': 'req-998fa4c4-ab5d-47d8-a46c-1f50073afddf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.549732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39cec81c449e4276abff4b4173d1ce78', 'request_id': 'req-998fa4c4-ab5d-47d8-a46c-1f50073afddf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.566145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39cec81c449e4276abff4b4173d1ce78', 'request_id': 'req-998fa4c4-ab5d-47d8-a46c-1f50073afddf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.603098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] The token cache is being invalidate because project 39cec81c449e4276abff4b4173d1ce78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:19:40.603641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.604407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.618896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:40.620583 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3172/6323] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:19:40 2022] DELETE /identity/v3/projects/39cec81c449e4276abff4b4173d1ce78 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:40.620720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:40.663413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb2cf8-88ab-4778-8e03-c69cf8608a11 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:40.834356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f303f83-a560-497c-845b-4c9c85016334 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71eaf7c5fa4e4736bbf1b9d4ebcd3135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095763a007b7480d985beece805f5e49', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:40.835276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f303f83-a560-497c-845b-4c9c85016334 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:40.836916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f303f83-a560-497c-845b-4c9c85016334 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:40.837216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f303f83-a560-497c-845b-4c9c85016334 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] PATH_INFO: `/v3/domains/18055aae94a6426f98481096db69e8ff` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:40.843150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f303f83-a560-497c-845b-4c9c85016334 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=18055aae94a6426f98481096db69e8ff)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:40.845969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f303f83-a560-497c-845b-4c9c85016334 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:40.908158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9f303f83-a560-497c-845b-4c9c85016334 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '18055aae94a6426f98481096db69e8ff'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.910188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9f303f83-a560-497c-845b-4c9c85016334 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '18055aae94a6426f98481096db69e8ff'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.960489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9f303f83-a560-497c-845b-4c9c85016334 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '18055aae94a6426f98481096db69e8ff'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.961474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9f303f83-a560-497c-845b-4c9c85016334 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '18055aae94a6426f98481096db69e8ff'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:40.985311 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3152/6324] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:19:40 2022] PATCH /identity/v3/domains/18055aae94a6426f98481096db69e8ff => generated 247 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:19:40.986919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:40.988724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:41.019363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fa4c4-ab5d-47d8-a46c-1f50073afddf tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:41.223260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71eaf7c5fa4e4736bbf1b9d4ebcd3135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '095763a007b7480d985beece805f5e49', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:41.224017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:41.224305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:41.224587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] PATH_INFO: `/v3/domains/18055aae94a6426f98481096db69e8ff` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:41.251569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=18055aae94a6426f98481096db69e8ff)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:41.253342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:41.315784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '18055aae94a6426f98481096db69e8ff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:41.320757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '18055aae94a6426f98481096db69e8ff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:41.412496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18055aae94a6426f98481096db69e8ff', 'request_id': 'req-e5070161-7ed3-462e-bc39-77e37c4cf982'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:41.430875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18055aae94a6426f98481096db69e8ff', 'request_id': 'req-e5070161-7ed3-462e-bc39-77e37c4cf982'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:41.452399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18055aae94a6426f98481096db69e8ff', 'request_id': 'req-e5070161-7ed3-462e-bc39-77e37c4cf982'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:41.483021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] The token cache is being invalidate because project 18055aae94a6426f98481096db69e8ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:19:41.484346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:41.484580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:41.498193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:41.506561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '18055aae94a6426f98481096db69e8ff', 'request_id': 'req-e5070161-7ed3-462e-bc39-77e37c4cf982'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:41.507396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '18055aae94a6426f98481096db69e8ff', 'request_id': 'req-e5070161-7ed3-462e-bc39-77e37c4cf982'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:41.512626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e5070161-7ed3-462e-bc39-77e37c4cf982 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '18055aae94a6426f98481096db69e8ff', 'request_id': 'req-e5070161-7ed3-462e-bc39-77e37c4cf982'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:41.526577 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3173/6325] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:19:40 2022] DELETE /identity/v3/domains/18055aae94a6426f98481096db69e8ff => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:41.533133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f303f83-a560-497c-845b-4c9c85016334 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:41.534723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9f303f83-a560-497c-845b-4c9c85016334 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:41.729047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f303f83-a560-497c-845b-4c9c85016334 tempest-TestDefaultProjectId-808438794 tempest-TestDefaultProjectId-808438794-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:41.910702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:41.982991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:41.988075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:41.991326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:41.991728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] PATH_INFO: `/v3/users/a42e6501407645e18e9c9a3583103983` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:41.996834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42e6501407645e18e9c9a3583103983)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:42.008552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:42.115569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42e6501407645e18e9c9a3583103983'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:42.128494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42e6501407645e18e9c9a3583103983'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:42.130039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42e6501407645e18e9c9a3583103983'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:42.150579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42e6501407645e18e9c9a3583103983'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:42.153198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42e6501407645e18e9c9a3583103983'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:42.184988 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3153/6326] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:19:41 2022] DELETE /identity/v3/users/a42e6501407645e18e9c9a3583103983 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:42.199558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d10d-3549-4241-a497-a9c55b0b9f00 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:42.200368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d10d-3549-4241-a497-a9c55b0b9f00 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:42.200817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0d10d-3549-4241-a497-a9c55b0b9f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:42.263116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-94b0d10d-3549-4241-a497-a9c55b0b9f00 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:42.271535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-94b0d10d-3549-4241-a497-a9c55b0b9f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:42.477428 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3174/6327] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:42.509876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:42.511713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:42.680093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1438c5-43f4-4408-b4ea-8a4b65f842ba admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:42.685297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a3ba0-6751-4583-b842-b5b50bd13b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:42.687540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3ba0-6751-4583-b842-b5b50bd13b19 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:42.687940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3ba0-6751-4583-b842-b5b50bd13b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:42.688370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3ba0-6751-4583-b842-b5b50bd13b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:42.710658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a3ba0-6751-4583-b842-b5b50bd13b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:42.712307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a3ba0-6751-4583-b842-b5b50bd13b19 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:42.778592 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3154/6328] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:19:43.655893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0d10d-3549-4241-a497-a9c55b0b9f00 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:43.657727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-94b0d10d-3549-4241-a497-a9c55b0b9f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:43.980517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0d10d-3549-4241-a497-a9c55b0b9f00 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:44.047621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80762462-f566-4579-8180-c29bde64c7ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:44.059128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80762462-f566-4579-8180-c29bde64c7ba service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:44.060711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80762462-f566-4579-8180-c29bde64c7ba service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:44.063190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80762462-f566-4579-8180-c29bde64c7ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:44.071798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-80762462-f566-4579-8180-c29bde64c7ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:44.122822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80762462-f566-4579-8180-c29bde64c7ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:44.126758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80762462-f566-4579-8180-c29bde64c7ba service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:44.131749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a3ba0-6751-4583-b842-b5b50bd13b19 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:44.138199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f57a3ba0-6751-4583-b842-b5b50bd13b19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:44.174282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a3ba0-6751-4583-b842-b5b50bd13b19 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:44.192664 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3175/6329] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:19:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:19:44.201669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2ec46-ab59-4d58-bb69-2c33773bfd39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:44.207502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2ec46-ab59-4d58-bb69-2c33773bfd39 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:44.207790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2ec46-ab59-4d58-bb69-2c33773bfd39 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:44.208068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2ec46-ab59-4d58-bb69-2c33773bfd39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:44.224035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-25b2ec46-ab59-4d58-bb69-2c33773bfd39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:44.263446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2ec46-ab59-4d58-bb69-2c33773bfd39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:44.266380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2ec46-ab59-4d58-bb69-2c33773bfd39 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:44.295503 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3155/6330] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:19:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:19:44.662296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80762462-f566-4579-8180-c29bde64c7ba service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:44.664312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-80762462-f566-4579-8180-c29bde64c7ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:44.746825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80762462-f566-4579-8180-c29bde64c7ba service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:44.771405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:44.772067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:44.772358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:44.772741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] PATH_INFO: `/v3/projects/372e007324c2461ab2845b2810007143` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:44.773909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=372e007324c2461ab2845b2810007143)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:44.775956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:44.892670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '372e007324c2461ab2845b2810007143', 'request_id': 'req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:44.901748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '372e007324c2461ab2845b2810007143', 'request_id': 'req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:44.911110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '372e007324c2461ab2845b2810007143', 'request_id': 'req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:44.913225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=8,keystone:SELECT=92 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:44.938943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] The token cache is being invalidate because project 372e007324c2461ab2845b2810007143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:19:44.939291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:44.940856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:44.948229 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3176/6331] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:19:44 2022] DELETE /identity/v3/projects/372e007324c2461ab2845b2810007143 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:44.949053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2ec46-ab59-4d58-bb69-2c33773bfd39 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:44.974325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2ec46-ab59-4d58-bb69-2c33773bfd39 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:45.158608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:45.191541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26e9b7-726e-4838-a6cf-9a7d2ff0cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:45.192535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26e9b7-726e-4838-a6cf-9a7d2ff0cfb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:45.193000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26e9b7-726e-4838-a6cf-9a7d2ff0cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:45.193655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26e9b7-726e-4838-a6cf-9a7d2ff0cfb0 admin admin] PATH_INFO: `/v3/users/71eaf7c5fa4e4736bbf1b9d4ebcd3135` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:45.197374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26e9b7-726e-4838-a6cf-9a7d2ff0cfb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71eaf7c5fa4e4736bbf1b9d4ebcd3135)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:45.199400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26e9b7-726e-4838-a6cf-9a7d2ff0cfb0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:45.380154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bb26e9b7-726e-4838-a6cf-9a7d2ff0cfb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71eaf7c5fa4e4736bbf1b9d4ebcd3135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:45.442211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bb26e9b7-726e-4838-a6cf-9a7d2ff0cfb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71eaf7c5fa4e4736bbf1b9d4ebcd3135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:45.444423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bb26e9b7-726e-4838-a6cf-9a7d2ff0cfb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71eaf7c5fa4e4736bbf1b9d4ebcd3135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:45.464899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bb26e9b7-726e-4838-a6cf-9a7d2ff0cfb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71eaf7c5fa4e4736bbf1b9d4ebcd3135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:45.465906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bb26e9b7-726e-4838-a6cf-9a7d2ff0cfb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71eaf7c5fa4e4736bbf1b9d4ebcd3135'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:45.496252 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3156/6332] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:19:44 2022] DELETE /identity/v3/users/71eaf7c5fa4e4736bbf1b9d4ebcd3135 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:46.133605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:46.136692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:46.170318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9ea66-6fde-41be-ac0b-afb3cf3fb2b3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:46.311380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b48b2-8229-462b-bcf5-a4037b278d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:46.314190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b48b2-8229-462b-bcf5-a4037b278d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:46.316256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b48b2-8229-462b-bcf5-a4037b278d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:46.317679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b48b2-8229-462b-bcf5-a4037b278d20 admin admin] PATH_INFO: `/v3/projects/095763a007b7480d985beece805f5e49` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:46.325296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b48b2-8229-462b-bcf5-a4037b278d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=095763a007b7480d985beece805f5e49)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:46.344164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b48b2-8229-462b-bcf5-a4037b278d20 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:46.524089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e87b48b2-8229-462b-bcf5-a4037b278d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095763a007b7480d985beece805f5e49', 'request_id': 'req-e87b48b2-8229-462b-bcf5-a4037b278d20'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:46.547575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e87b48b2-8229-462b-bcf5-a4037b278d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095763a007b7480d985beece805f5e49', 'request_id': 'req-e87b48b2-8229-462b-bcf5-a4037b278d20'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:46.588183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e87b48b2-8229-462b-bcf5-a4037b278d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095763a007b7480d985beece805f5e49', 'request_id': 'req-e87b48b2-8229-462b-bcf5-a4037b278d20'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:46.632928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e87b48b2-8229-462b-bcf5-a4037b278d20 admin admin] The token cache is being invalidate because project 095763a007b7480d985beece805f5e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:19:46.635495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e87b48b2-8229-462b-bcf5-a4037b278d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:46.637828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e87b48b2-8229-462b-bcf5-a4037b278d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:46.647334 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3177/6333] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:19:46 2022] DELETE /identity/v3/projects/095763a007b7480d985beece805f5e49 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:46.649320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71737630-a91f-462f-a2ef-cd988eda64cd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:46.649787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71737630-a91f-462f-a2ef-cd988eda64cd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:46.650084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71737630-a91f-462f-a2ef-cd988eda64cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:46.755104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-71737630-a91f-462f-a2ef-cd988eda64cd None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:46.760076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-71737630-a91f-462f-a2ef-cd988eda64cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:46.951080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf777bc-3b0c-4836-91c2-960594372072 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:46.951619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf777bc-3b0c-4836-91c2-960594372072 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:46.952560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf777bc-3b0c-4836-91c2-960594372072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:46.956255 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3157/6334] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:46.978271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fcf777bc-3b0c-4836-91c2-960594372072 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:46.980623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fcf777bc-3b0c-4836-91c2-960594372072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:47.007646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71737630-a91f-462f-a2ef-cd988eda64cd None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:47.011072 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3178/6335] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:47.023435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71737630-a91f-462f-a2ef-cd988eda64cd None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:47.049093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039f645-6bec-4d70-8ebd-7fb61ddd451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:47.049350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039f645-6bec-4d70-8ebd-7fb61ddd451b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:47.049639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039f645-6bec-4d70-8ebd-7fb61ddd451b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:47.050392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039f645-6bec-4d70-8ebd-7fb61ddd451b admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:47.050936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039f645-6bec-4d70-8ebd-7fb61ddd451b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:19:47.051252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039f645-6bec-4d70-8ebd-7fb61ddd451b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:47.054374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039f645-6bec-4d70-8ebd-7fb61ddd451b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:47.097195 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3158/6336] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:19:47.101609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf777bc-3b0c-4836-91c2-960594372072 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:47.116863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf777bc-3b0c-4836-91c2-960594372072 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:47.129392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709761f4-777c-409a-9599-914c8dc398b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:47.135986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709761f4-777c-409a-9599-914c8dc398b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:47.136943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709761f4-777c-409a-9599-914c8dc398b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:47.138845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709761f4-777c-409a-9599-914c8dc398b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:47.153361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709761f4-777c-409a-9599-914c8dc398b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:47.161382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709761f4-777c-409a-9599-914c8dc398b2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:47.241528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039f645-6bec-4d70-8ebd-7fb61ddd451b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:47.245543 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3179/6337] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:19:47 2022] POST /identity/v3/projects => generated 389 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:19:47.261004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039f645-6bec-4d70-8ebd-7fb61ddd451b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:47.453914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:47.488917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e66b28-a146-4c33-8340-59af33f6401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:47.489555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e66b28-a146-4c33-8340-59af33f6401f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:47.489845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e66b28-a146-4c33-8340-59af33f6401f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:47.490130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e66b28-a146-4c33-8340-59af33f6401f admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:47.490790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e66b28-a146-4c33-8340-59af33f6401f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:47.493316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e66b28-a146-4c33-8340-59af33f6401f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:47.556957 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3159/6338] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:19:47 2022] POST /identity/v3/users => generated 295 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:47.557526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709761f4-777c-409a-9599-914c8dc398b2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:47.586219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709761f4-777c-409a-9599-914c8dc398b2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:47.601094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8252902-54cd-425d-ab63-ce66989c2954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:47.602141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8252902-54cd-425d-ab63-ce66989c2954 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:47.602589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8252902-54cd-425d-ab63-ce66989c2954 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:47.603642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8252902-54cd-425d-ab63-ce66989c2954 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:47.605708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8252902-54cd-425d-ab63-ce66989c2954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:47.610470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8252902-54cd-425d-ab63-ce66989c2954 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:47.639994 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3180/6339] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:19:47.642498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e66b28-a146-4c33-8340-59af33f6401f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:47.668168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e66b28-a146-4c33-8340-59af33f6401f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:47.685030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0df87-46ee-46e1-8f4b-82213a10bfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:47.685605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0df87-46ee-46e1-8f4b-82213a10bfbc admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:47.685894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0df87-46ee-46e1-8f4b-82213a10bfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:47.686704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0df87-46ee-46e1-8f4b-82213a10bfbc admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:47.697435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0df87-46ee-46e1-8f4b-82213a10bfbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:47.699389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0df87-46ee-46e1-8f4b-82213a10bfbc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:47.746321 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3160/6340] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:19:47.747253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8252902-54cd-425d-ab63-ce66989c2954 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:47.767753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8252902-54cd-425d-ab63-ce66989c2954 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:47.783847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed71f0-f7a0-4c78-803c-6c42eb029c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:47.784541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed71f0-f7a0-4c78-803c-6c42eb029c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:47.785211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed71f0-f7a0-4c78-803c-6c42eb029c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:47.785211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed71f0-f7a0-4c78-803c-6c42eb029c21 admin admin] PATH_INFO: `/v3/projects/328a326935bf4ce0a380aaa106277d1f/users/5f09cf594b2446d38b484a9c367845a4/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:47.822249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed71f0-f7a0-4c78-803c-6c42eb029c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328a326935bf4ce0a380aaa106277d1f, user_id=5f09cf594b2446d38b484a9c367845a4, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:47.826135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed71f0-f7a0-4c78-803c-6c42eb029c21 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:47.872864 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3181/6341] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:19:47 2022] PUT /identity/v3/projects/328a326935bf4ce0a380aaa106277d1f/users/5f09cf594b2446d38b484a9c367845a4/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:47.883828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca470a-b488-46d2-9aff-478ba3d6ffd7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:47.884123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca470a-b488-46d2-9aff-478ba3d6ffd7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:47.884406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca470a-b488-46d2-9aff-478ba3d6ffd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:47.954343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-73ca470a-b488-46d2-9aff-478ba3d6ffd7 None None] MFA Rules not processed for user `5f09cf594b2446d38b484a9c367845a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:47.955641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-73ca470a-b488-46d2-9aff-478ba3d6ffd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:48.098824 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3161/6342] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:48.104642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed71f0-f7a0-4c78-803c-6c42eb029c21 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:48.152739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:48.223081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed71f0-f7a0-4c78-803c-6c42eb029c21 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:48.245090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f8df0-54f9-4d57-9a4b-ee950494862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:48.246245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f8df0-54f9-4d57-9a4b-ee950494862c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:48.246708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f8df0-54f9-4d57-9a4b-ee950494862c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:48.247348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f8df0-54f9-4d57-9a4b-ee950494862c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:48.248159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f8df0-54f9-4d57-9a4b-ee950494862c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:48.254497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f8df0-54f9-4d57-9a4b-ee950494862c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:48.335245 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3182/6343] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:19:48 2022] POST /identity/v3/projects => generated 391 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:48.339466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca470a-b488-46d2-9aff-478ba3d6ffd7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:48.377120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca470a-b488-46d2-9aff-478ba3d6ffd7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:48.610942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95557cd0-1851-46d8-8d9a-3252a76ab938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:48.611799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95557cd0-1851-46d8-8d9a-3252a76ab938 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:48.612200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95557cd0-1851-46d8-8d9a-3252a76ab938 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:48.612592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95557cd0-1851-46d8-8d9a-3252a76ab938 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:48.613550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95557cd0-1851-46d8-8d9a-3252a76ab938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:48.618307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95557cd0-1851-46d8-8d9a-3252a76ab938 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:48.688200 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3162/6344] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:19:48 2022] POST /identity/v3/users => generated 302 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:48.689436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f8df0-54f9-4d57-9a4b-ee950494862c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:48.710393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f8df0-54f9-4d57-9a4b-ee950494862c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:48.717757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3a329-ec5f-486e-b4c4-936d95df2cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:48.718420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3a329-ec5f-486e-b4c4-936d95df2cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:48.719283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3a329-ec5f-486e-b4c4-936d95df2cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:48.719742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3a329-ec5f-486e-b4c4-936d95df2cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:48.722189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3a329-ec5f-486e-b4c4-936d95df2cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:48.724483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3a329-ec5f-486e-b4c4-936d95df2cd2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:48.751478 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3183/6345] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:19:48.754826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95557cd0-1851-46d8-8d9a-3252a76ab938 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:48.787834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95557cd0-1851-46d8-8d9a-3252a76ab938 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:48.794258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071055a8-af2c-4594-b130-a6665a7e48b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:48.795309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071055a8-af2c-4594-b130-a6665a7e48b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:48.796372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071055a8-af2c-4594-b130-a6665a7e48b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:48.796868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071055a8-af2c-4594-b130-a6665a7e48b7 admin admin] PATH_INFO: `/v3/projects/408b159b2e6247309a7e1cad7fa941f5/users/532580a105194e8c83470cbb0cc5c060/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:48.833133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071055a8-af2c-4594-b130-a6665a7e48b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408b159b2e6247309a7e1cad7fa941f5, user_id=532580a105194e8c83470cbb0cc5c060, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:48.836014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071055a8-af2c-4594-b130-a6665a7e48b7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:48.869295 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3163/6346] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:19:48 2022] PUT /identity/v3/projects/408b159b2e6247309a7e1cad7fa941f5/users/532580a105194e8c83470cbb0cc5c060/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:48.870914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3a329-ec5f-486e-b4c4-936d95df2cd2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:48.890994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3a329-ec5f-486e-b4c4-936d95df2cd2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:49.059445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d3d2d-0601-4e6d-87ca-9d518cf7f03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:49.060358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3d2d-0601-4e6d-87ca-9d518cf7f03a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:49.060752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3d2d-0601-4e6d-87ca-9d518cf7f03a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:49.061790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3d2d-0601-4e6d-87ca-9d518cf7f03a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:49.062572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d3d2d-0601-4e6d-87ca-9d518cf7f03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:49.065395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d3d2d-0601-4e6d-87ca-9d518cf7f03a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:49.089350 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3184/6347] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:19:49.094203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071055a8-af2c-4594-b130-a6665a7e48b7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:49.109245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071055a8-af2c-4594-b130-a6665a7e48b7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:49.125728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9765e-e2c6-44e8-bd26-5d8faac1f2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:49.126607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9765e-e2c6-44e8-bd26-5d8faac1f2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:49.127185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9765e-e2c6-44e8-bd26-5d8faac1f2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:49.127704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9765e-e2c6-44e8-bd26-5d8faac1f2c6 admin admin] PATH_INFO: `/v3/projects/408b159b2e6247309a7e1cad7fa941f5/users/532580a105194e8c83470cbb0cc5c060/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:49.131477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9765e-e2c6-44e8-bd26-5d8faac1f2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=408b159b2e6247309a7e1cad7fa941f5, user_id=532580a105194e8c83470cbb0cc5c060, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:49.142573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9765e-e2c6-44e8-bd26-5d8faac1f2c6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:49.163608 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3164/6348] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:19:49 2022] PUT /identity/v3/projects/408b159b2e6247309a7e1cad7fa941f5/users/532580a105194e8c83470cbb0cc5c060/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:49.172490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235f6f7-6245-4229-9b9f-caeee4a33555 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:49.173075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235f6f7-6245-4229-9b9f-caeee4a33555 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:49.173075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235f6f7-6245-4229-9b9f-caeee4a33555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:49.226129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9235f6f7-6245-4229-9b9f-caeee4a33555 None None] MFA Rules not processed for user `532580a105194e8c83470cbb0cc5c060`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:49.227366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9235f6f7-6245-4229-9b9f-caeee4a33555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:49.463547 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3185/6349] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:49 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:49.470818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9765e-e2c6-44e8-bd26-5d8faac1f2c6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:49.491096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9765e-e2c6-44e8-bd26-5d8faac1f2c6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:49.501555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920af38-cf6e-4fbf-a27c-9315b7cbe545 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:49.505160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920af38-cf6e-4fbf-a27c-9315b7cbe545 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:49.505581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920af38-cf6e-4fbf-a27c-9315b7cbe545 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:49.505936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920af38-cf6e-4fbf-a27c-9315b7cbe545 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:49.507799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920af38-cf6e-4fbf-a27c-9315b7cbe545 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:49.509752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920af38-cf6e-4fbf-a27c-9315b7cbe545 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:49.539596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:49.586240 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3165/6350] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:19:49 2022] POST /identity/v3/domains => generated 275 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:49.590145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235f6f7-6245-4229-9b9f-caeee4a33555 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:49.608733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235f6f7-6245-4229-9b9f-caeee4a33555 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:49.626970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:49.731621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc71971-13e2-4fbe-9789-1df62687932c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:49.732327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71971-13e2-4fbe-9789-1df62687932c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:49.732619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71971-13e2-4fbe-9789-1df62687932c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:49.732948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71971-13e2-4fbe-9789-1df62687932c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/1913758f1a4a480f8057f0779bae7a30/config` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:49.734022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc71971-13e2-4fbe-9789-1df62687932c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=1913758f1a4a480f8057f0779bae7a30)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:49.735182 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-6cc71971-13e2-4fbe-9789-1df62687932c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:19:49.735182 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:19:49.735182 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:19:49.736131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc71971-13e2-4fbe-9789-1df62687932c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:49.847483 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3186/6351] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:19:49 2022] PUT /identity/v3/domains/1913758f1a4a480f8057f0779bae7a30/config => generated 138 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:49.848743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920af38-cf6e-4fbf-a27c-9315b7cbe545 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:49.861910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920af38-cf6e-4fbf-a27c-9315b7cbe545 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:49.871728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89cb7-bc4c-402f-80e5-41782a6edfaa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:49.872645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89cb7-bc4c-402f-80e5-41782a6edfaa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:49.873096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89cb7-bc4c-402f-80e5-41782a6edfaa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:49.873537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e89cb7-bc4c-402f-80e5-41782a6edfaa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/1913758f1a4a480f8057f0779bae7a30/config/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:49.875923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e89cb7-bc4c-402f-80e5-41782a6edfaa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1913758f1a4a480f8057f0779bae7a30, group=identity)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:49.877407 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-50e89cb7-bc4c-402f-80e5-41782a6edfaa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:19:49.877407 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:19:49.877407 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:19:49.878723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e89cb7-bc4c-402f-80e5-41782a6edfaa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:49.900006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc71971-13e2-4fbe-9789-1df62687932c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:49.913018 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3166/6352] 10.222.0.70 () {58 vars in 1275 bytes} [Sun Aug 28 19:19:49 2022] GET /identity/v3/domains/1913758f1a4a480f8057f0779bae7a30/config/identity => generated 45 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:49.915960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc71971-13e2-4fbe-9789-1df62687932c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:49.921679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f2887-c915-4ea5-8ad5-fd1e6bc95986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:49.922403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2887-c915-4ea5-8ad5-fd1e6bc95986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:49.922687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2887-c915-4ea5-8ad5-fd1e6bc95986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:49.923060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2887-c915-4ea5-8ad5-fd1e6bc95986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/1913758f1a4a480f8057f0779bae7a30/config/identity/driver` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:49.924905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f2887-c915-4ea5-8ad5-fd1e6bc95986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1913758f1a4a480f8057f0779bae7a30, group=identity, option=driver)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:49.925933 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-783f2887-c915-4ea5-8ad5-fd1e6bc95986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:19:49.925933 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:19:49.925933 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:19:49.926862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f2887-c915-4ea5-8ad5-fd1e6bc95986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:49.939533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89cb7-bc4c-402f-80e5-41782a6edfaa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:49.946699 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3187/6353] 10.222.0.70 () {58 vars in 1296 bytes} [Sun Aug 28 19:19:49 2022] GET /identity/v3/domains/1913758f1a4a480f8057f0779bae7a30/config/identity/driver => generated 31 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:49.953271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e89cb7-bc4c-402f-80e5-41782a6edfaa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:49.968046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ad356-c9a5-439c-83d0-05a76125383e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:49.968046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ad356-c9a5-439c-83d0-05a76125383e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:49.968046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ad356-c9a5-439c-83d0-05a76125383e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:49.969217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ad356-c9a5-439c-83d0-05a76125383e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/1913758f1a4a480f8057f0779bae7a30/config/ldap` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:49.971472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ad356-c9a5-439c-83d0-05a76125383e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1913758f1a4a480f8057f0779bae7a30, group=ldap)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:49.975460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ad356-c9a5-439c-83d0-05a76125383e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:49.991625 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3167/6354] 10.222.0.70 () {58 vars in 1263 bytes} [Sun Aug 28 19:19:49 2022] GET /identity/v3/domains/1913758f1a4a480f8057f0779bae7a30/config/ldap => generated 106 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:19:49.996806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f2887-c915-4ea5-8ad5-fd1e6bc95986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:50.015827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f2887-c915-4ea5-8ad5-fd1e6bc95986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:50.027416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b38b1-07b0-4710-b72b-74e4fdbf63df tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:50.027583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b38b1-07b0-4710-b72b-74e4fdbf63df tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:50.027772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b38b1-07b0-4710-b72b-74e4fdbf63df tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:50.028005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b38b1-07b0-4710-b72b-74e4fdbf63df tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/1913758f1a4a480f8057f0779bae7a30/config/ldap/url` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:50.030717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b38b1-07b0-4710-b72b-74e4fdbf63df tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1913758f1a4a480f8057f0779bae7a30, group=ldap, option=url)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:50.032561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b38b1-07b0-4710-b72b-74e4fdbf63df tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:50.048479 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3188/6355] 10.222.0.70 () {58 vars in 1275 bytes} [Sun Aug 28 19:19:49 2022] GET /identity/v3/domains/1913758f1a4a480f8057f0779bae7a30/config/ldap/url => generated 46 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:50.050847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ad356-c9a5-439c-83d0-05a76125383e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:50.072666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ad356-c9a5-439c-83d0-05a76125383e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:50.089945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f853e-4858-4ecb-8d77-f80161ee7842 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:50.090826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f853e-4858-4ecb-8d77-f80161ee7842 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:50.091232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f853e-4858-4ecb-8d77-f80161ee7842 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:50.091630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f853e-4858-4ecb-8d77-f80161ee7842 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/1913758f1a4a480f8057f0779bae7a30/config/ldap/user_tree_dn` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:50.093721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f853e-4858-4ecb-8d77-f80161ee7842 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1913758f1a4a480f8057f0779bae7a30, group=ldap, option=user_tree_dn)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:50.096551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f853e-4858-4ecb-8d77-f80161ee7842 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:50.111924 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3168/6356] 10.222.0.70 () {58 vars in 1302 bytes} [Sun Aug 28 19:19:50 2022] GET /identity/v3/domains/1913758f1a4a480f8057f0779bae7a30/config/ldap/user_tree_dn => generated 63 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:50.112891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b38b1-07b0-4710-b72b-74e4fdbf63df tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:50.131544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b38b1-07b0-4710-b72b-74e4fdbf63df tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:50.141360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d91ef9-7c95-42b4-8d74-d0feb233193b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:50.142158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d91ef9-7c95-42b4-8d74-d0feb233193b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:50.144652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d91ef9-7c95-42b4-8d74-d0feb233193b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:50.145002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d91ef9-7c95-42b4-8d74-d0feb233193b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/1913758f1a4a480f8057f0779bae7a30/config` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:50.145696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d91ef9-7c95-42b4-8d74-d0feb233193b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=1913758f1a4a480f8057f0779bae7a30)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:50.146875 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-f5d91ef9-7c95-42b4-8d74-d0feb233193b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:19:50.146875 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:19:50.146875 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:19:50.147884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d91ef9-7c95-42b4-8d74-d0feb233193b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:50.175911 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3189/6357] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:19:50 2022] DELETE /identity/v3/domains/1913758f1a4a480f8057f0779bae7a30/config => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:50.178511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f853e-4858-4ecb-8d77-f80161ee7842 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:50.193735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f853e-4858-4ecb-8d77-f80161ee7842 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:50.208831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826355b-29d8-49d2-bafd-280a99c22ca8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:50.209931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826355b-29d8-49d2-bafd-280a99c22ca8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:50.211815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826355b-29d8-49d2-bafd-280a99c22ca8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:50.212825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826355b-29d8-49d2-bafd-280a99c22ca8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/1913758f1a4a480f8057f0779bae7a30` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:50.219415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826355b-29d8-49d2-bafd-280a99c22ca8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1913758f1a4a480f8057f0779bae7a30)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:50.226363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826355b-29d8-49d2-bafd-280a99c22ca8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:50.296859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f826355b-29d8-49d2-bafd-280a99c22ca8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1913758f1a4a480f8057f0779bae7a30'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:50.299268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f826355b-29d8-49d2-bafd-280a99c22ca8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1913758f1a4a480f8057f0779bae7a30'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:50.348498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f826355b-29d8-49d2-bafd-280a99c22ca8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1913758f1a4a480f8057f0779bae7a30'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:50.354693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f826355b-29d8-49d2-bafd-280a99c22ca8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1913758f1a4a480f8057f0779bae7a30'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:50.359414 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3169/6358] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:19:50 2022] PATCH /identity/v3/domains/1913758f1a4a480f8057f0779bae7a30 => generated 276 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:19:50.363710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d91ef9-7c95-42b4-8d74-d0feb233193b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:50.365528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f5d91ef9-7c95-42b4-8d74-d0feb233193b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:50.408205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d91ef9-7c95-42b4-8d74-d0feb233193b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:50.667289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:50.667954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:50.668242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:50.668520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/1913758f1a4a480f8057f0779bae7a30` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:50.695558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1913758f1a4a480f8057f0779bae7a30)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:50.698080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:50.760629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1913758f1a4a480f8057f0779bae7a30'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:50.783702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1913758f1a4a480f8057f0779bae7a30'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:50.902664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:50.962894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1913758f1a4a480f8057f0779bae7a30', 'request_id': 'req-70324e55-56c2-49d3-b235-0e064db82135'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:50.991404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1913758f1a4a480f8057f0779bae7a30', 'request_id': 'req-70324e55-56c2-49d3-b235-0e064db82135'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:51.006046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1913758f1a4a480f8057f0779bae7a30', 'request_id': 'req-70324e55-56c2-49d3-b235-0e064db82135'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:51.060291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] The token cache is being invalidate because project 1913758f1a4a480f8057f0779bae7a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:19:51.062287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:51.064448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:51.087794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1913758f1a4a480f8057f0779bae7a30', 'request_id': 'req-70324e55-56c2-49d3-b235-0e064db82135'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:51.088817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1913758f1a4a480f8057f0779bae7a30', 'request_id': 'req-70324e55-56c2-49d3-b235-0e064db82135'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:51.098385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1913758f1a4a480f8057f0779bae7a30', 'request_id': 'req-70324e55-56c2-49d3-b235-0e064db82135'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:51.110594 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3190/6359] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:19:50 2022] DELETE /identity/v3/domains/1913758f1a4a480f8057f0779bae7a30 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:51.111889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826355b-29d8-49d2-bafd-280a99c22ca8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:51.122913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826355b-29d8-49d2-bafd-280a99c22ca8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:51.279598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9672fe-0972-4b7f-9e06-9aab85c0ba31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:51.280840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9672fe-0972-4b7f-9e06-9aab85c0ba31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:51.281322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9672fe-0972-4b7f-9e06-9aab85c0ba31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:51.281791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9672fe-0972-4b7f-9e06-9aab85c0ba31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:51.282630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9672fe-0972-4b7f-9e06-9aab85c0ba31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:51.284493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9672fe-0972-4b7f-9e06-9aab85c0ba31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:51.325820 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3170/6360] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:19:51 2022] POST /identity/v3/domains => generated 275 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:51.327096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:51.328835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:51.345875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70324e55-56c2-49d3-b235-0e064db82135 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:51.564698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b373dc-9214-4b7a-ac84-2575d81e8d93 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:51.567288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b373dc-9214-4b7a-ac84-2575d81e8d93 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:51.567727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b373dc-9214-4b7a-ac84-2575d81e8d93 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:51.568823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b373dc-9214-4b7a-ac84-2575d81e8d93 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/ae72c750126048cf852205d07756cba6/config` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:51.569705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b373dc-9214-4b7a-ac84-2575d81e8d93 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=ae72c750126048cf852205d07756cba6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:51.575777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b373dc-9214-4b7a-ac84-2575d81e8d93 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:51.658551 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3191/6361] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:19:51 2022] PUT /identity/v3/domains/ae72c750126048cf852205d07756cba6/config => generated 138 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:51.662400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9672fe-0972-4b7f-9e06-9aab85c0ba31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:51.678695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9672fe-0972-4b7f-9e06-9aab85c0ba31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:51.692222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7012-53a9-43cd-bcc0-824311c8e54f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:51.692886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7012-53a9-43cd-bcc0-824311c8e54f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:51.693176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7012-53a9-43cd-bcc0-824311c8e54f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:51.693456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7012-53a9-43cd-bcc0-824311c8e54f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/ae72c750126048cf852205d07756cba6/config` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:51.694413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7012-53a9-43cd-bcc0-824311c8e54f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=ae72c750126048cf852205d07756cba6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:51.695487 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-369d7012-53a9-43cd-bcc0-824311c8e54f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:19:51.695487 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:19:51.695487 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:19:51.698683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7012-53a9-43cd-bcc0-824311c8e54f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:51.755802 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3171/6362] 10.222.0.70 () {60 vars in 1271 bytes} [Sun Aug 28 19:19:51 2022] PATCH /identity/v3/domains/ae72c750126048cf852205d07756cba6/config => generated 142 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:19:51.760177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b373dc-9214-4b7a-ac84-2575d81e8d93 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:51.773893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b373dc-9214-4b7a-ac84-2575d81e8d93 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:51.793730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a937b-9706-49bd-b9e6-b3df11608799 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:51.794397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a937b-9706-49bd-b9e6-b3df11608799 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:51.794734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a937b-9706-49bd-b9e6-b3df11608799 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:51.794994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a937b-9706-49bd-b9e6-b3df11608799 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/ae72c750126048cf852205d07756cba6/config` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:51.797234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a937b-9706-49bd-b9e6-b3df11608799 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=ae72c750126048cf852205d07756cba6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:51.798894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a937b-9706-49bd-b9e6-b3df11608799 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:51.809529 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3192/6363] 10.222.0.70 () {58 vars in 1248 bytes} [Sun Aug 28 19:19:51 2022] GET /identity/v3/domains/ae72c750126048cf852205d07756cba6/config => generated 142 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:19:51.814348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7012-53a9-43cd-bcc0-824311c8e54f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:51.831730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7012-53a9-43cd-bcc0-824311c8e54f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:51.842378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0eddb-5c08-4dad-8ae7-3c476b6543fb tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:51.843393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0eddb-5c08-4dad-8ae7-3c476b6543fb tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:51.843827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0eddb-5c08-4dad-8ae7-3c476b6543fb tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:51.843939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0eddb-5c08-4dad-8ae7-3c476b6543fb tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/ae72c750126048cf852205d07756cba6/config` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:51.844570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0eddb-5c08-4dad-8ae7-3c476b6543fb tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ae72c750126048cf852205d07756cba6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:51.845744 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-3aa0eddb-5c08-4dad-8ae7-3c476b6543fb tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:19:51.845744 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:19:51.845744 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:19:51.846672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0eddb-5c08-4dad-8ae7-3c476b6543fb tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:51.881848 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3172/6364] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:19:51 2022] DELETE /identity/v3/domains/ae72c750126048cf852205d07756cba6/config => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:51.885874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a937b-9706-49bd-b9e6-b3df11608799 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:51.903767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a937b-9706-49bd-b9e6-b3df11608799 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:51.916129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcf339-dc83-4ba3-8f3b-e49628842a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:51.916787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcf339-dc83-4ba3-8f3b-e49628842a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:51.917074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcf339-dc83-4ba3-8f3b-e49628842a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:51.917356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcf339-dc83-4ba3-8f3b-e49628842a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/ae72c750126048cf852205d07756cba6/config` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:51.922726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcf339-dc83-4ba3-8f3b-e49628842a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=ae72c750126048cf852205d07756cba6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:51.924580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcf339-dc83-4ba3-8f3b-e49628842a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:51.944575 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-b9dcf339-dc83-4ba3-8f3b-e49628842a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Could not find any options in domain configuration for domain ae72c750126048cf852205d07756cba6.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain ae72c750126048cf852205d07756cba6. Aug 28 19:19:51.944575 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:19:51.944575 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:19:51.944575 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:19:51.944575 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:19:51.944575 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:19:51.944575 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:19:51.944575 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:19:51.944575 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:19:51.944575 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:19:51.944575 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:19:51.944575 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:19:51.944575 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 28 19:19:51.945786 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 28 19:19:51.945786 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 28 19:19:51.945786 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 28 19:19:51.945786 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:19:51.945786 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:19:51.945786 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 28 19:19:51.945786 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 28 19:19:51.945786 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain ae72c750126048cf852205d07756cba6. Aug 28 19:19:51.945786 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:19:51.946923 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3193/6365] 10.222.0.70 () {58 vars in 1248 bytes} [Sun Aug 28 19:19:51 2022] GET /identity/v3/domains/ae72c750126048cf852205d07756cba6/config => generated 151 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:19:51.950330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0eddb-5c08-4dad-8ae7-3c476b6543fb tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:51.969665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0eddb-5c08-4dad-8ae7-3c476b6543fb tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:51.999901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b82db5-78f9-45ee-8303-587cbaf400dd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:52.000674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b82db5-78f9-45ee-8303-587cbaf400dd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:52.000971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b82db5-78f9-45ee-8303-587cbaf400dd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:52.001260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b82db5-78f9-45ee-8303-587cbaf400dd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/ae72c750126048cf852205d07756cba6/config` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:52.001867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b82db5-78f9-45ee-8303-587cbaf400dd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ae72c750126048cf852205d07756cba6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:52.003599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b82db5-78f9-45ee-8303-587cbaf400dd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:52.031371 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3173/6366] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:19:51 2022] DELETE /identity/v3/domains/ae72c750126048cf852205d07756cba6/config => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:52.035298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcf339-dc83-4ba3-8f3b-e49628842a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:52.050636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcf339-dc83-4ba3-8f3b-e49628842a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:52.068437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1603cc-eda0-4653-bff2-30c94b545d40 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:52.069317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1603cc-eda0-4653-bff2-30c94b545d40 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:52.069611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1603cc-eda0-4653-bff2-30c94b545d40 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:52.069896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1603cc-eda0-4653-bff2-30c94b545d40 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/ae72c750126048cf852205d07756cba6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:52.072907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1603cc-eda0-4653-bff2-30c94b545d40 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ae72c750126048cf852205d07756cba6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:52.074531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1603cc-eda0-4653-bff2-30c94b545d40 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:52.129211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3c1603cc-eda0-4653-bff2-30c94b545d40 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ae72c750126048cf852205d07756cba6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.130480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3c1603cc-eda0-4653-bff2-30c94b545d40 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ae72c750126048cf852205d07756cba6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.180246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3c1603cc-eda0-4653-bff2-30c94b545d40 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ae72c750126048cf852205d07756cba6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.180985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3c1603cc-eda0-4653-bff2-30c94b545d40 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ae72c750126048cf852205d07756cba6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.184183 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3194/6367] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:19:52 2022] PATCH /identity/v3/domains/ae72c750126048cf852205d07756cba6 => generated 276 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:19:52.188719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b82db5-78f9-45ee-8303-587cbaf400dd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:52.193575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d1b82db5-78f9-45ee-8303-587cbaf400dd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:52.222204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b82db5-78f9-45ee-8303-587cbaf400dd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:52.273606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:52.334098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:52.334893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:52.335447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:52.335913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/ae72c750126048cf852205d07756cba6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:52.366819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ae72c750126048cf852205d07756cba6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:52.368654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:52.433571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ae72c750126048cf852205d07756cba6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.443500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ae72c750126048cf852205d07756cba6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.582522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae72c750126048cf852205d07756cba6', 'request_id': 'req-8814dead-6f06-4ab1-90d4-ce03b4aa1986'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.613513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae72c750126048cf852205d07756cba6', 'request_id': 'req-8814dead-6f06-4ab1-90d4-ce03b4aa1986'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.621617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae72c750126048cf852205d07756cba6', 'request_id': 'req-8814dead-6f06-4ab1-90d4-ce03b4aa1986'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.663938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] The token cache is being invalidate because project ae72c750126048cf852205d07756cba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:19:52.667883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.675736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.714634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ae72c750126048cf852205d07756cba6', 'request_id': 'req-8814dead-6f06-4ab1-90d4-ce03b4aa1986'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.727461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ae72c750126048cf852205d07756cba6', 'request_id': 'req-8814dead-6f06-4ab1-90d4-ce03b4aa1986'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.733064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ae72c750126048cf852205d07756cba6', 'request_id': 'req-8814dead-6f06-4ab1-90d4-ce03b4aa1986'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:52.754268 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3174/6368] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:19:52 2022] DELETE /identity/v3/domains/ae72c750126048cf852205d07756cba6 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:52.759553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1603cc-eda0-4653-bff2-30c94b545d40 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:52.795091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1603cc-eda0-4653-bff2-30c94b545d40 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:52.805359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:52.956235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983ab17-1d62-42f4-90ef-15ad258a6912 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:52.957075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ab17-1d62-42f4-90ef-15ad258a6912 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:52.957485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ab17-1d62-42f4-90ef-15ad258a6912 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:52.958981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983ab17-1d62-42f4-90ef-15ad258a6912 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:52.959544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983ab17-1d62-42f4-90ef-15ad258a6912 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:52.961533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983ab17-1d62-42f4-90ef-15ad258a6912 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:53.022608 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3195/6369] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:19:52 2022] POST /identity/v3/domains => generated 276 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:53.023967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:53.025931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:53.049704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814dead-6f06-4ab1-90d4-ce03b4aa1986 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:53.219109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd9f22-b32d-423e-9aa2-2593a2e2e062 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:53.220709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd9f22-b32d-423e-9aa2-2593a2e2e062 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:53.221242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd9f22-b32d-423e-9aa2-2593a2e2e062 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:53.221773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd9f22-b32d-423e-9aa2-2593a2e2e062 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:53.222814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd9f22-b32d-423e-9aa2-2593a2e2e062 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=e2ba0d47140b4e4e92552aeb271e08c8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:53.301305 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-b8bd9f22-b32d-423e-9aa2-2593a2e2e062 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:19:53.301305 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:19:53.301305 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:19:53.301305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd9f22-b32d-423e-9aa2-2593a2e2e062 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:53.301305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:53.351708 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3175/6370] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:19:53 2022] PUT /identity/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config => generated 138 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:19:53.357406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983ab17-1d62-42f4-90ef-15ad258a6912 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:53.376022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983ab17-1d62-42f4-90ef-15ad258a6912 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:53.385116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdf89c-5f58-4a57-940e-50f12d7241b2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:53.391032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdf89c-5f58-4a57-940e-50f12d7241b2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:53.391801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdf89c-5f58-4a57-940e-50f12d7241b2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:53.392321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdf89c-5f58-4a57-940e-50f12d7241b2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:53.393770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdf89c-5f58-4a57-940e-50f12d7241b2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=e2ba0d47140b4e4e92552aeb271e08c8, group=identity)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:53.395036 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-d3cdf89c-5f58-4a57-940e-50f12d7241b2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:19:53.395036 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:19:53.395036 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:19:53.396429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdf89c-5f58-4a57-940e-50f12d7241b2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:53.492520 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3196/6371] 10.222.0.70 () {60 vars in 1297 bytes} [Sun Aug 28 19:19:53 2022] PATCH /identity/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config/identity => generated 176 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:19:53.495400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd9f22-b32d-423e-9aa2-2593a2e2e062 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:53.513684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd9f22-b32d-423e-9aa2-2593a2e2e062 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:53.543106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf6958-74c2-4ce7-b51d-424109187db2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:53.544080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf6958-74c2-4ce7-b51d-424109187db2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:53.544818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf6958-74c2-4ce7-b51d-424109187db2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:53.546852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf6958-74c2-4ce7-b51d-424109187db2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config/identity/driver` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:53.549937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf6958-74c2-4ce7-b51d-424109187db2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=e2ba0d47140b4e4e92552aeb271e08c8, group=identity, option=driver)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:53.554478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf6958-74c2-4ce7-b51d-424109187db2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:53.619189 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3176/6372] 10.222.0.70 () {60 vars in 1318 bytes} [Sun Aug 28 19:19:53 2022] PATCH /identity/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config/identity/driver => generated 177 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:19:53.625627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdf89c-5f58-4a57-940e-50f12d7241b2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:53.650405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdf89c-5f58-4a57-940e-50f12d7241b2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:53.673661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd394a3-cdb6-4a7c-9aeb-0d9090958057 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:53.675542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd394a3-cdb6-4a7c-9aeb-0d9090958057 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:53.675843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd394a3-cdb6-4a7c-9aeb-0d9090958057 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:53.676167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd394a3-cdb6-4a7c-9aeb-0d9090958057 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config/identity/driver` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:53.683834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd394a3-cdb6-4a7c-9aeb-0d9090958057 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e2ba0d47140b4e4e92552aeb271e08c8, group=identity, option=driver)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:53.691836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd394a3-cdb6-4a7c-9aeb-0d9090958057 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:53.767658 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3197/6373] 10.222.0.70 () {58 vars in 1299 bytes} [Sun Aug 28 19:19:53 2022] DELETE /identity/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config/identity/driver => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:53.772161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf6958-74c2-4ce7-b51d-424109187db2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:53.791086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf6958-74c2-4ce7-b51d-424109187db2 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:53.799730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8950ba-86b1-422d-804f-1e6c52cc0bf5 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:53.800646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8950ba-86b1-422d-804f-1e6c52cc0bf5 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:53.801057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8950ba-86b1-422d-804f-1e6c52cc0bf5 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:53.801441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8950ba-86b1-422d-804f-1e6c52cc0bf5 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config/identity/driver` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:53.802885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8950ba-86b1-422d-804f-1e6c52cc0bf5 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=e2ba0d47140b4e4e92552aeb271e08c8, group=identity, option=driver)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:53.804949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8950ba-86b1-422d-804f-1e6c52cc0bf5 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:53.817979 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-7d8950ba-86b1-422d-804f-1e6c52cc0bf5 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Could not find option driver in group identity in domain configuration for domain e2ba0d47140b4e4e92552aeb271e08c8.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain e2ba0d47140b4e4e92552aeb271e08c8. Aug 28 19:19:53.817979 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:19:53.817979 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:19:53.817979 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:19:53.817979 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:19:53.817979 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:19:53.817979 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:19:53.817979 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:19:53.817979 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:19:53.817979 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:19:53.817979 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:19:53.817979 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:19:53.817979 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 28 19:19:53.818722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 28 19:19:53.818722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 28 19:19:53.818722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 28 19:19:53.818722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:19:53.818722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:19:53.818722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 28 19:19:53.818722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 28 19:19:53.818722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain e2ba0d47140b4e4e92552aeb271e08c8. Aug 28 19:19:53.818722 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:19:53.821599 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3177/6374] 10.222.0.70 () {58 vars in 1296 bytes} [Sun Aug 28 19:19:53 2022] GET /identity/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config/identity/driver => generated 171 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:19:53.831090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd394a3-cdb6-4a7c-9aeb-0d9090958057 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:53.851435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd394a3-cdb6-4a7c-9aeb-0d9090958057 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:53.859335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5cf63-f229-4d16-9485-2c004ebba0e7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:53.863460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5cf63-f229-4d16-9485-2c004ebba0e7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:53.863974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5cf63-f229-4d16-9485-2c004ebba0e7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:53.865163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5cf63-f229-4d16-9485-2c004ebba0e7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:53.865163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5cf63-f229-4d16-9485-2c004ebba0e7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e2ba0d47140b4e4e92552aeb271e08c8, group=identity)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:53.867534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5cf63-f229-4d16-9485-2c004ebba0e7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:53.915890 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3198/6375] 10.222.0.70 () {58 vars in 1278 bytes} [Sun Aug 28 19:19:53 2022] DELETE /identity/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config/identity => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:53.921110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8950ba-86b1-422d-804f-1e6c52cc0bf5 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:53.939695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8950ba-86b1-422d-804f-1e6c52cc0bf5 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:53.951543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cf0ab-480f-40f8-ad0b-0ef99c7e13ee tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:53.952440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cf0ab-480f-40f8-ad0b-0ef99c7e13ee tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:53.952735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cf0ab-480f-40f8-ad0b-0ef99c7e13ee tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:53.953015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cf0ab-480f-40f8-ad0b-0ef99c7e13ee tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:53.954339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cf0ab-480f-40f8-ad0b-0ef99c7e13ee tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=e2ba0d47140b4e4e92552aeb271e08c8, group=identity)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:53.956180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cf0ab-480f-40f8-ad0b-0ef99c7e13ee tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:53.965822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-708cf0ab-480f-40f8-ad0b-0ef99c7e13ee tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Could not find group identity in domain configuration for domain e2ba0d47140b4e4e92552aeb271e08c8.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain e2ba0d47140b4e4e92552aeb271e08c8. Aug 28 19:19:53.965822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:19:53.965822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:19:53.965822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:19:53.965822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:19:53.965822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:19:53.965822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:19:53.965822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:19:53.965822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:19:53.965822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:19:53.965822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:19:53.965822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:19:53.965822 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 28 19:19:53.966668 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 28 19:19:53.966668 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 28 19:19:53.966668 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 28 19:19:53.966668 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:19:53.966668 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:19:53.966668 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 28 19:19:53.966668 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 28 19:19:53.966668 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain e2ba0d47140b4e4e92552aeb271e08c8. Aug 28 19:19:53.966668 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:19:53.967652 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3178/6376] 10.222.0.70 () {58 vars in 1275 bytes} [Sun Aug 28 19:19:53 2022] GET /identity/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config/identity => generated 154 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:19:53.971456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5cf63-f229-4d16-9485-2c004ebba0e7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:53.986854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5cf63-f229-4d16-9485-2c004ebba0e7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:54.013368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcaa38-d23f-4967-8756-6006a65c42a8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:54.015299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcaa38-d23f-4967-8756-6006a65c42a8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:54.015608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcaa38-d23f-4967-8756-6006a65c42a8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:54.017203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcaa38-d23f-4967-8756-6006a65c42a8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:54.017860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcaa38-d23f-4967-8756-6006a65c42a8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e2ba0d47140b4e4e92552aeb271e08c8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:54.023720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcaa38-d23f-4967-8756-6006a65c42a8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:54.038763 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3199/6377] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:19:53 2022] DELETE /identity/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8/config => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:54.044025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cf0ab-480f-40f8-ad0b-0ef99c7e13ee tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:54.062508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cf0ab-480f-40f8-ad0b-0ef99c7e13ee tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:54.069917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc2590-1d83-4525-bacf-efc1f23e7a1f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:54.071325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc2590-1d83-4525-bacf-efc1f23e7a1f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:54.071836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc2590-1d83-4525-bacf-efc1f23e7a1f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:54.072394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc2590-1d83-4525-bacf-efc1f23e7a1f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:54.076169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc2590-1d83-4525-bacf-efc1f23e7a1f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e2ba0d47140b4e4e92552aeb271e08c8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:54.079134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc2590-1d83-4525-bacf-efc1f23e7a1f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:54.112785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-64fc2590-1d83-4525-bacf-efc1f23e7a1f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e2ba0d47140b4e4e92552aeb271e08c8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.113954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-64fc2590-1d83-4525-bacf-efc1f23e7a1f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e2ba0d47140b4e4e92552aeb271e08c8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.151576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-64fc2590-1d83-4525-bacf-efc1f23e7a1f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e2ba0d47140b4e4e92552aeb271e08c8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.152481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-64fc2590-1d83-4525-bacf-efc1f23e7a1f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e2ba0d47140b4e4e92552aeb271e08c8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.155775 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3179/6378] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:19:54 2022] PATCH /identity/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8 => generated 277 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:19:54.159654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcaa38-d23f-4967-8756-6006a65c42a8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:54.161483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-06fcaa38-d23f-4967-8756-6006a65c42a8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:54.190367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcaa38-d23f-4967-8756-6006a65c42a8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:54.294889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:54.296849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:54.297587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:54.298350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:54.314614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e2ba0d47140b4e4e92552aeb271e08c8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:54.316705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:54.330382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:54.347321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e2ba0d47140b4e4e92552aeb271e08c8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.351398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e2ba0d47140b4e4e92552aeb271e08c8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.424914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ba0d47140b4e4e92552aeb271e08c8', 'request_id': 'req-7d8c9e45-a994-4122-986b-edc0d0be29a9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.432954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ba0d47140b4e4e92552aeb271e08c8', 'request_id': 'req-7d8c9e45-a994-4122-986b-edc0d0be29a9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.441629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ba0d47140b4e4e92552aeb271e08c8', 'request_id': 'req-7d8c9e45-a994-4122-986b-edc0d0be29a9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.479334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] The token cache is being invalidate because project e2ba0d47140b4e4e92552aeb271e08c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:19:54.480107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.481187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.520630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e2ba0d47140b4e4e92552aeb271e08c8', 'request_id': 'req-7d8c9e45-a994-4122-986b-edc0d0be29a9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.521837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e2ba0d47140b4e4e92552aeb271e08c8', 'request_id': 'req-7d8c9e45-a994-4122-986b-edc0d0be29a9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.533955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e2ba0d47140b4e4e92552aeb271e08c8', 'request_id': 'req-7d8c9e45-a994-4122-986b-edc0d0be29a9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:54.549883 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3200/6379] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:19:54 2022] DELETE /identity/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:19:54.555032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc2590-1d83-4525-bacf-efc1f23e7a1f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:54.584891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc2590-1d83-4525-bacf-efc1f23e7a1f tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:54.711748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627411-9787-47e1-b85c-6d0d58a84de8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:54.712398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627411-9787-47e1-b85c-6d0d58a84de8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:54.712688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627411-9787-47e1-b85c-6d0d58a84de8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:54.712973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3627411-9787-47e1-b85c-6d0d58a84de8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:54.713556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3627411-9787-47e1-b85c-6d0d58a84de8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:54.714591 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-c3627411-9787-47e1-b85c-6d0d58a84de8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:19:54.714591 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:19:54.714591 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:19:54.719524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3627411-9787-47e1-b85c-6d0d58a84de8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:54.732034 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3180/6380] 10.222.0.70 () {58 vars in 1173 bytes} [Sun Aug 28 19:19:54 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:19:54.737124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:54.738778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:54.765258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c9e45-a994-4122-986b-edc0d0be29a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:54.774486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66add2d-aea4-4e42-af8d-ce4847156c46 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:54.775391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66add2d-aea4-4e42-af8d-ce4847156c46 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:54.775786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66add2d-aea4-4e42-af8d-ce4847156c46 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:54.776174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66add2d-aea4-4e42-af8d-ce4847156c46 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:54.776904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66add2d-aea4-4e42-af8d-ce4847156c46 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:54.778114 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-d66add2d-aea4-4e42-af8d-ce4847156c46 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:19:54.778114 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:19:54.778114 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:19:54.779206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66add2d-aea4-4e42-af8d-ce4847156c46 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:54.781507 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3201/6381] 10.222.0.70 () {58 vars in 1200 bytes} [Sun Aug 28 19:19:54 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:54.785318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627411-9787-47e1-b85c-6d0d58a84de8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:54.806303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3627411-9787-47e1-b85c-6d0d58a84de8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:54.823666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155eacb-aa52-4416-828a-d740cab1cd5e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:54.824470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155eacb-aa52-4416-828a-d740cab1cd5e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:54.824718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155eacb-aa52-4416-828a-d740cab1cd5e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:54.825008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155eacb-aa52-4416-828a-d740cab1cd5e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:54.825608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155eacb-aa52-4416-828a-d740cab1cd5e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:54.827830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155eacb-aa52-4416-828a-d740cab1cd5e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:54.830345 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3181/6382] 10.222.0.70 () {58 vars in 1221 bytes} [Sun Aug 28 19:19:54 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:54.833274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66add2d-aea4-4e42-af8d-ce4847156c46 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:54.850266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66add2d-aea4-4e42-af8d-ce4847156c46 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:54.855572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155ab5-8922-4760-a74a-2edcd90dfc50 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:54.856537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155ab5-8922-4760-a74a-2edcd90dfc50 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:54.856537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155ab5-8922-4760-a74a-2edcd90dfc50 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:54.856770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155ab5-8922-4760-a74a-2edcd90dfc50 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:54.857369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155ab5-8922-4760-a74a-2edcd90dfc50 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:54.860049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155ab5-8922-4760-a74a-2edcd90dfc50 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:54.861422 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3202/6383] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:19:54 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:54.865149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155eacb-aa52-4416-828a-d740cab1cd5e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:54.898794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155eacb-aa52-4416-828a-d740cab1cd5e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:54.916948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd2267-5aee-451c-b6e4-f743c0ff2bd9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:54.917628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd2267-5aee-451c-b6e4-f743c0ff2bd9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:54.917920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd2267-5aee-451c-b6e4-f743c0ff2bd9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:54.918198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd2267-5aee-451c-b6e4-f743c0ff2bd9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:54.918837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd2267-5aee-451c-b6e4-f743c0ff2bd9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:54.922191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd2267-5aee-451c-b6e4-f743c0ff2bd9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:54.924303 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3182/6384] 10.222.0.70 () {58 vars in 1188 bytes} [Sun Aug 28 19:19:54 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:19:54.929955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155ab5-8922-4760-a74a-2edcd90dfc50 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:54.950527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155ab5-8922-4760-a74a-2edcd90dfc50 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:54.959495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32d63d-fcc5-4185-b607-6c1174500372 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:54.960234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32d63d-fcc5-4185-b607-6c1174500372 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:54.960645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32d63d-fcc5-4185-b607-6c1174500372 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:54.960928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32d63d-fcc5-4185-b607-6c1174500372 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:54.961682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32d63d-fcc5-4185-b607-6c1174500372 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:54.963679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32d63d-fcc5-4185-b607-6c1174500372 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:54.968502 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3203/6385] 10.222.0.70 () {58 vars in 1200 bytes} [Sun Aug 28 19:19:54 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:54.972689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd2267-5aee-451c-b6e4-f743c0ff2bd9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:54.988104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd2267-5aee-451c-b6e4-f743c0ff2bd9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:54.995319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8fabb-ec0a-4d4a-9afc-acf376c28a07 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:54.997112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8fabb-ec0a-4d4a-9afc-acf376c28a07 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:54.997675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8fabb-ec0a-4d4a-9afc-acf376c28a07 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:54.998156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8fabb-ec0a-4d4a-9afc-acf376c28a07 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:54.999897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8fabb-ec0a-4d4a-9afc-acf376c28a07 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.002048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8fabb-ec0a-4d4a-9afc-acf376c28a07 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.005111 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3183/6386] 10.222.0.70 () {58 vars in 1203 bytes} [Sun Aug 28 19:19:54 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.008930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32d63d-fcc5-4185-b607-6c1174500372 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.028647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32d63d-fcc5-4185-b607-6c1174500372 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.045313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f427a23-ab53-4033-8853-18455676d6b8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.046526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f427a23-ab53-4033-8853-18455676d6b8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.046968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f427a23-ab53-4033-8853-18455676d6b8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.050836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f427a23-ab53-4033-8853-18455676d6b8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.053049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f427a23-ab53-4033-8853-18455676d6b8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.058679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f427a23-ab53-4033-8853-18455676d6b8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.061996 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3204/6387] 10.222.0.70 () {58 vars in 1209 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.065787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8fabb-ec0a-4d4a-9afc-acf376c28a07 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.082994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8fabb-ec0a-4d4a-9afc-acf376c28a07 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.089073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe8840-ee90-4187-9540-aefc858d6979 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.090500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe8840-ee90-4187-9540-aefc858d6979 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.091787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe8840-ee90-4187-9540-aefc858d6979 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.091787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe8840-ee90-4187-9540-aefc858d6979 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.093312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe8840-ee90-4187-9540-aefc858d6979 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.100985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe8840-ee90-4187-9540-aefc858d6979 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.105868 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3184/6388] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.107341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f427a23-ab53-4033-8853-18455676d6b8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.126944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f427a23-ab53-4033-8853-18455676d6b8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.148017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecd50f-fa9d-4eb7-be93-769b73794d1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.149256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd50f-fa9d-4eb7-be93-769b73794d1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.149256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd50f-fa9d-4eb7-be93-769b73794d1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.149411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd50f-fa9d-4eb7-be93-769b73794d1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.150197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecd50f-fa9d-4eb7-be93-769b73794d1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.155507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecd50f-fa9d-4eb7-be93-769b73794d1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.157869 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3205/6389] 10.222.0.70 () {58 vars in 1218 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.161389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe8840-ee90-4187-9540-aefc858d6979 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.181304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe8840-ee90-4187-9540-aefc858d6979 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.203062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b922a3a-8066-49e3-b037-b5e914155a15 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.204480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b922a3a-8066-49e3-b037-b5e914155a15 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.205004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b922a3a-8066-49e3-b037-b5e914155a15 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.205518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b922a3a-8066-49e3-b037-b5e914155a15 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.207931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b922a3a-8066-49e3-b037-b5e914155a15 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.213489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b922a3a-8066-49e3-b037-b5e914155a15 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.216010 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3185/6390] 10.222.0.70 () {58 vars in 1248 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.220219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecd50f-fa9d-4eb7-be93-769b73794d1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.234313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecd50f-fa9d-4eb7-be93-769b73794d1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.246206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fa147-1be3-44ee-b464-33b25e0cb8bf tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.246804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fa147-1be3-44ee-b464-33b25e0cb8bf tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.247095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fa147-1be3-44ee-b464-33b25e0cb8bf tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.247378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fa147-1be3-44ee-b464-33b25e0cb8bf tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.247974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01fa147-1be3-44ee-b464-33b25e0cb8bf tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.254924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01fa147-1be3-44ee-b464-33b25e0cb8bf tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.258643 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3206/6391] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.260690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b922a3a-8066-49e3-b037-b5e914155a15 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.276507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b922a3a-8066-49e3-b037-b5e914155a15 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.288086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901748f-cf82-49a4-af85-d17558fdcb31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.288605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901748f-cf82-49a4-af85-d17558fdcb31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.289488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901748f-cf82-49a4-af85-d17558fdcb31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.289863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901748f-cf82-49a4-af85-d17558fdcb31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.290490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901748f-cf82-49a4-af85-d17558fdcb31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.292229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901748f-cf82-49a4-af85-d17558fdcb31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.299457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fa147-1be3-44ee-b464-33b25e0cb8bf tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.299826 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3186/6392] 10.222.0.70 () {58 vars in 1236 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.315839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fa147-1be3-44ee-b464-33b25e0cb8bf tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.359407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475bc22-7f44-4fae-9052-766558dd2164 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.361394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475bc22-7f44-4fae-9052-766558dd2164 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.362688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475bc22-7f44-4fae-9052-766558dd2164 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.366865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475bc22-7f44-4fae-9052-766558dd2164 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.367648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475bc22-7f44-4fae-9052-766558dd2164 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.375251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475bc22-7f44-4fae-9052-766558dd2164 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.376910 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3207/6393] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.382029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901748f-cf82-49a4-af85-d17558fdcb31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.400269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901748f-cf82-49a4-af85-d17558fdcb31 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.429203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f75ff0-8a03-4f12-9da0-e824156f2b72 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.430183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f75ff0-8a03-4f12-9da0-e824156f2b72 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.430637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f75ff0-8a03-4f12-9da0-e824156f2b72 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.431095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f75ff0-8a03-4f12-9da0-e824156f2b72 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.431827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f75ff0-8a03-4f12-9da0-e824156f2b72 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.433670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f75ff0-8a03-4f12-9da0-e824156f2b72 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.437031 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3187/6394] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.442543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475bc22-7f44-4fae-9052-766558dd2164 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.457184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475bc22-7f44-4fae-9052-766558dd2164 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.470860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17cdb3-9e80-4949-a332-464325ed58fd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.471875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17cdb3-9e80-4949-a332-464325ed58fd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.473879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17cdb3-9e80-4949-a332-464325ed58fd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.474373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17cdb3-9e80-4949-a332-464325ed58fd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.475140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17cdb3-9e80-4949-a332-464325ed58fd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.480825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17cdb3-9e80-4949-a332-464325ed58fd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.484832 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3208/6395] 10.222.0.70 () {58 vars in 1239 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.490071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f75ff0-8a03-4f12-9da0-e824156f2b72 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.508653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f75ff0-8a03-4f12-9da0-e824156f2b72 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.526302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45221747-a939-4dfd-a503-091d8d1e151d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.527018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45221747-a939-4dfd-a503-091d8d1e151d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.527309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45221747-a939-4dfd-a503-091d8d1e151d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.527591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45221747-a939-4dfd-a503-091d8d1e151d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.528192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45221747-a939-4dfd-a503-091d8d1e151d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.529899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45221747-a939-4dfd-a503-091d8d1e151d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.531062 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3188/6396] 10.222.0.70 () {58 vars in 1242 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.535188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17cdb3-9e80-4949-a332-464325ed58fd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.549153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17cdb3-9e80-4949-a332-464325ed58fd tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.558234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b327a-9da8-49c9-9b6f-3987261de9fa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.559107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b327a-9da8-49c9-9b6f-3987261de9fa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.563559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b327a-9da8-49c9-9b6f-3987261de9fa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.563559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b327a-9da8-49c9-9b6f-3987261de9fa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.563559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b327a-9da8-49c9-9b6f-3987261de9fa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.564142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b327a-9da8-49c9-9b6f-3987261de9fa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.567520 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3209/6397] 10.222.0.70 () {58 vars in 1248 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.585005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45221747-a939-4dfd-a503-091d8d1e151d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.598541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45221747-a939-4dfd-a503-091d8d1e151d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.610093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e0c22-50e3-4d3c-80e2-df15868e0b03 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.611199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0c22-50e3-4d3c-80e2-df15868e0b03 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.611656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0c22-50e3-4d3c-80e2-df15868e0b03 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.612435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e0c22-50e3-4d3c-80e2-df15868e0b03 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.613196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e0c22-50e3-4d3c-80e2-df15868e0b03 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.615075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e0c22-50e3-4d3c-80e2-df15868e0b03 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.616851 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3189/6398] 10.222.0.70 () {58 vars in 1248 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.620546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b327a-9da8-49c9-9b6f-3987261de9fa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.637988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b327a-9da8-49c9-9b6f-3987261de9fa tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.647405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873833e-fdc7-4ed5-973c-f2d7053d0098 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.648116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873833e-fdc7-4ed5-973c-f2d7053d0098 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.648408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873833e-fdc7-4ed5-973c-f2d7053d0098 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.648689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873833e-fdc7-4ed5-973c-f2d7053d0098 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.649365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873833e-fdc7-4ed5-973c-f2d7053d0098 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.651181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873833e-fdc7-4ed5-973c-f2d7053d0098 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.652667 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3210/6399] 10.222.0.70 () {58 vars in 1269 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 19:19:55.657351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e0c22-50e3-4d3c-80e2-df15868e0b03 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.674571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e0c22-50e3-4d3c-80e2-df15868e0b03 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.687955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8afa54-13ef-421e-95be-b5ac7e13f0b0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.688658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8afa54-13ef-421e-95be-b5ac7e13f0b0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.689000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8afa54-13ef-421e-95be-b5ac7e13f0b0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.689296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8afa54-13ef-421e-95be-b5ac7e13f0b0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.689903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8afa54-13ef-421e-95be-b5ac7e13f0b0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.691574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8afa54-13ef-421e-95be-b5ac7e13f0b0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.696226 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3190/6400] 10.222.0.70 () {58 vars in 1248 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 19:19:55.697107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873833e-fdc7-4ed5-973c-f2d7053d0098 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.719360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873833e-fdc7-4ed5-973c-f2d7053d0098 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.724333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79a283-a8ac-4838-8980-0fa4be6f74f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.725028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79a283-a8ac-4838-8980-0fa4be6f74f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.725317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79a283-a8ac-4838-8980-0fa4be6f74f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.725593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79a283-a8ac-4838-8980-0fa4be6f74f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.726189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79a283-a8ac-4838-8980-0fa4be6f74f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.727888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79a283-a8ac-4838-8980-0fa4be6f74f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.729121 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3211/6401] 10.222.0.70 () {58 vars in 1257 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 19:19:55.733241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8afa54-13ef-421e-95be-b5ac7e13f0b0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.753124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8afa54-13ef-421e-95be-b5ac7e13f0b0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.759853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b9fea-68b3-4e85-a818-55e561a3eb04 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.760542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b9fea-68b3-4e85-a818-55e561a3eb04 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.760885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b9fea-68b3-4e85-a818-55e561a3eb04 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.761112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b9fea-68b3-4e85-a818-55e561a3eb04 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.761722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b9fea-68b3-4e85-a818-55e561a3eb04 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.763387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b9fea-68b3-4e85-a818-55e561a3eb04 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.765422 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3191/6402] 10.222.0.70 () {58 vars in 1248 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.769721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79a283-a8ac-4838-8980-0fa4be6f74f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.786245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79a283-a8ac-4838-8980-0fa4be6f74f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.793092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5aceb-5685-4cde-a054-548855f3612d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.793985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5aceb-5685-4cde-a054-548855f3612d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.794416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5aceb-5685-4cde-a054-548855f3612d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.794881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5aceb-5685-4cde-a054-548855f3612d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.796553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5aceb-5685-4cde-a054-548855f3612d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.798645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5aceb-5685-4cde-a054-548855f3612d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.802454 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3212/6403] 10.222.0.70 () {58 vars in 1242 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.806225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b9fea-68b3-4e85-a818-55e561a3eb04 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.821139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b9fea-68b3-4e85-a818-55e561a3eb04 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.833757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06326b71-1781-4a02-a9b4-eb8521928fa0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.834437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06326b71-1781-4a02-a9b4-eb8521928fa0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.834728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06326b71-1781-4a02-a9b4-eb8521928fa0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.835040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06326b71-1781-4a02-a9b4-eb8521928fa0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.835645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06326b71-1781-4a02-a9b4-eb8521928fa0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.837294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06326b71-1781-4a02-a9b4-eb8521928fa0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.838564 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3192/6404] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.843852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5aceb-5685-4cde-a054-548855f3612d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.857897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5aceb-5685-4cde-a054-548855f3612d tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.873878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290868e-9ecd-4f3e-83e7-880a771e46f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.874406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290868e-9ecd-4f3e-83e7-880a771e46f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.874857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290868e-9ecd-4f3e-83e7-880a771e46f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.875147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290868e-9ecd-4f3e-83e7-880a771e46f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.875893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290868e-9ecd-4f3e-83e7-880a771e46f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.879206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290868e-9ecd-4f3e-83e7-880a771e46f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.881281 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3213/6405] 10.222.0.70 () {58 vars in 1254 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.885528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06326b71-1781-4a02-a9b4-eb8521928fa0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.900294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06326b71-1781-4a02-a9b4-eb8521928fa0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.905952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:55.913992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc2566-e3a6-4821-833f-3e355e61b5d3 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.915155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc2566-e3a6-4821-833f-3e355e61b5d3 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.915458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc2566-e3a6-4821-833f-3e355e61b5d3 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.916372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc2566-e3a6-4821-833f-3e355e61b5d3 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.917266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc2566-e3a6-4821-833f-3e355e61b5d3 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.919951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc2566-e3a6-4821-833f-3e355e61b5d3 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.928136 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3193/6406] 10.222.0.70 () {58 vars in 1290 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.929687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290868e-9ecd-4f3e-83e7-880a771e46f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.945988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290868e-9ecd-4f3e-83e7-880a771e46f7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.954435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dffd63-b160-426f-b8af-2e5495ffd18c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.955710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dffd63-b160-426f-b8af-2e5495ffd18c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.956178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dffd63-b160-426f-b8af-2e5495ffd18c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.956656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dffd63-b160-426f-b8af-2e5495ffd18c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:55.961103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dffd63-b160-426f-b8af-2e5495ffd18c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:55.963937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dffd63-b160-426f-b8af-2e5495ffd18c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:55.971280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc2566-e3a6-4821-833f-3e355e61b5d3 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:55.978414 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3214/6407] 10.222.0.70 () {58 vars in 1257 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:55.984892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc2566-e3a6-4821-833f-3e355e61b5d3 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:55.996839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518600-6070-4c9c-a9c9-3ebaeea2e370 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:55.997718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518600-6070-4c9c-a9c9-3ebaeea2e370 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:55.998235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518600-6070-4c9c-a9c9-3ebaeea2e370 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:55.999543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518600-6070-4c9c-a9c9-3ebaeea2e370 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.000660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1518600-6070-4c9c-a9c9-3ebaeea2e370 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.002715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1518600-6070-4c9c-a9c9-3ebaeea2e370 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.004000 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3194/6408] 10.222.0.70 () {58 vars in 1266 bytes} [Sun Aug 28 19:19:55 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.008290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dffd63-b160-426f-b8af-2e5495ffd18c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.023572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dffd63-b160-426f-b8af-2e5495ffd18c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.029083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6b189-5861-4a35-b5c5-574a56a081c0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.030304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6b189-5861-4a35-b5c5-574a56a081c0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.030839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6b189-5861-4a35-b5c5-574a56a081c0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.031253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6b189-5861-4a35-b5c5-574a56a081c0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.032158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6b189-5861-4a35-b5c5-574a56a081c0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.034072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6b189-5861-4a35-b5c5-574a56a081c0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.037073 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3215/6409] 10.222.0.70 () {58 vars in 1308 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 19:19:56.042245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518600-6070-4c9c-a9c9-3ebaeea2e370 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.058512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518600-6070-4c9c-a9c9-3ebaeea2e370 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.067608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d2da7-acf3-45be-91f4-95bd5e3b8a4b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.068618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d2da7-acf3-45be-91f4-95bd5e3b8a4b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.069032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d2da7-acf3-45be-91f4-95bd5e3b8a4b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.069523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d2da7-acf3-45be-91f4-95bd5e3b8a4b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.070491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d2da7-acf3-45be-91f4-95bd5e3b8a4b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.073145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d2da7-acf3-45be-91f4-95bd5e3b8a4b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.075668 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3195/6410] 10.222.0.70 () {58 vars in 1290 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.080290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6b189-5861-4a35-b5c5-574a56a081c0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.095928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6b189-5861-4a35-b5c5-574a56a081c0 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.107198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00480bdc-bcf9-4cb9-9b89-9aa5c3309fa9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.108330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00480bdc-bcf9-4cb9-9b89-9aa5c3309fa9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.108756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00480bdc-bcf9-4cb9-9b89-9aa5c3309fa9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.109170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00480bdc-bcf9-4cb9-9b89-9aa5c3309fa9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.109920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00480bdc-bcf9-4cb9-9b89-9aa5c3309fa9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.112016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00480bdc-bcf9-4cb9-9b89-9aa5c3309fa9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.113833 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3216/6411] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.122289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d2da7-acf3-45be-91f4-95bd5e3b8a4b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.142554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d2da7-acf3-45be-91f4-95bd5e3b8a4b tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.158999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b5b9d-399c-4226-bb4a-b8765951f666 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.159601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b5b9d-399c-4226-bb4a-b8765951f666 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.159886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b5b9d-399c-4226-bb4a-b8765951f666 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.160164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b5b9d-399c-4226-bb4a-b8765951f666 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.160829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b5b9d-399c-4226-bb4a-b8765951f666 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.163906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b5b9d-399c-4226-bb4a-b8765951f666 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.169400 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3196/6412] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.174225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00480bdc-bcf9-4cb9-9b89-9aa5c3309fa9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.192405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00480bdc-bcf9-4cb9-9b89-9aa5c3309fa9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.206688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a25e8-62d9-4a63-acf5-4ee5d801d582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.208500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a25e8-62d9-4a63-acf5-4ee5d801d582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.208938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a25e8-62d9-4a63-acf5-4ee5d801d582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.209449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a25e8-62d9-4a63-acf5-4ee5d801d582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.210359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a25e8-62d9-4a63-acf5-4ee5d801d582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.212257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a25e8-62d9-4a63-acf5-4ee5d801d582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.214789 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3217/6413] 10.222.0.70 () {58 vars in 1242 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.218667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b5b9d-399c-4226-bb4a-b8765951f666 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.250639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b5b9d-399c-4226-bb4a-b8765951f666 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.260840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d05329-5b4c-4d6d-95d7-c5d71232b488 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.261817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d05329-5b4c-4d6d-95d7-c5d71232b488 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.262208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d05329-5b4c-4d6d-95d7-c5d71232b488 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.263016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d05329-5b4c-4d6d-95d7-c5d71232b488 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.263602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d05329-5b4c-4d6d-95d7-c5d71232b488 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.267433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d05329-5b4c-4d6d-95d7-c5d71232b488 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.269372 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3197/6414] 10.222.0.70 () {58 vars in 1245 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 19:19:56.273456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a25e8-62d9-4a63-acf5-4ee5d801d582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.287476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a25e8-62d9-4a63-acf5-4ee5d801d582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.293526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d630d5a-9a28-4c64-bcdb-d1fb2a3236f1 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.294235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d630d5a-9a28-4c64-bcdb-d1fb2a3236f1 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.294686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d630d5a-9a28-4c64-bcdb-d1fb2a3236f1 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.295006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d630d5a-9a28-4c64-bcdb-d1fb2a3236f1 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.296974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d630d5a-9a28-4c64-bcdb-d1fb2a3236f1 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.300237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d630d5a-9a28-4c64-bcdb-d1fb2a3236f1 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.301727 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3218/6415] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.308399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d05329-5b4c-4d6d-95d7-c5d71232b488 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.324545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d05329-5b4c-4d6d-95d7-c5d71232b488 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.330898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00192566-0409-40b8-b376-18a53cef7202 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.331700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00192566-0409-40b8-b376-18a53cef7202 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.332108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00192566-0409-40b8-b376-18a53cef7202 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.332498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00192566-0409-40b8-b376-18a53cef7202 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.333224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00192566-0409-40b8-b376-18a53cef7202 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.335371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00192566-0409-40b8-b376-18a53cef7202 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.336878 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3198/6416] 10.222.0.70 () {58 vars in 1254 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.340899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d630d5a-9a28-4c64-bcdb-d1fb2a3236f1 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.354178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d630d5a-9a28-4c64-bcdb-d1fb2a3236f1 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.362134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff525b-2dcc-4294-8e41-f69fbf90512e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.363000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff525b-2dcc-4294-8e41-f69fbf90512e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.363396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff525b-2dcc-4294-8e41-f69fbf90512e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.363783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff525b-2dcc-4294-8e41-f69fbf90512e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.364537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff525b-2dcc-4294-8e41-f69fbf90512e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.368284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff525b-2dcc-4294-8e41-f69fbf90512e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.372658 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3219/6417] 10.222.0.70 () {58 vars in 1257 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.374835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00192566-0409-40b8-b376-18a53cef7202 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.385813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00192566-0409-40b8-b376-18a53cef7202 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.393115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbfcd9-683a-4570-8062-272422538759 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.394042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbfcd9-683a-4570-8062-272422538759 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.394512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbfcd9-683a-4570-8062-272422538759 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.394830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbfcd9-683a-4570-8062-272422538759 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.395423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbfcd9-683a-4570-8062-272422538759 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.398047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbfcd9-683a-4570-8062-272422538759 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.402320 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3199/6418] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.403331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff525b-2dcc-4294-8e41-f69fbf90512e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.417095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff525b-2dcc-4294-8e41-f69fbf90512e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.423548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7a1ed-4223-45d2-add9-1bf496d716c7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.424797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7a1ed-4223-45d2-add9-1bf496d716c7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.424902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7a1ed-4223-45d2-add9-1bf496d716c7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.425242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7a1ed-4223-45d2-add9-1bf496d716c7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.426448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7a1ed-4223-45d2-add9-1bf496d716c7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.428493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7a1ed-4223-45d2-add9-1bf496d716c7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.430704 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3220/6419] 10.222.0.70 () {58 vars in 1257 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 19:19:56.435397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbfcd9-683a-4570-8062-272422538759 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.450226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbfcd9-683a-4570-8062-272422538759 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.456271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee327d8-c4e0-4f1f-aacf-ea2abe410c55 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.457083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee327d8-c4e0-4f1f-aacf-ea2abe410c55 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.457473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee327d8-c4e0-4f1f-aacf-ea2abe410c55 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.458012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee327d8-c4e0-4f1f-aacf-ea2abe410c55 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.458931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee327d8-c4e0-4f1f-aacf-ea2abe410c55 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.461556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee327d8-c4e0-4f1f-aacf-ea2abe410c55 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.468505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7a1ed-4223-45d2-add9-1bf496d716c7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.469700 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3200/6420] 10.222.0.70 () {58 vars in 1293 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.492820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7a1ed-4223-45d2-add9-1bf496d716c7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.499964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353169ef-84ce-4786-ab40-045f26a5ef14 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.500765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353169ef-84ce-4786-ab40-045f26a5ef14 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.501145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353169ef-84ce-4786-ab40-045f26a5ef14 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.501522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353169ef-84ce-4786-ab40-045f26a5ef14 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.502212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353169ef-84ce-4786-ab40-045f26a5ef14 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.504878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353169ef-84ce-4786-ab40-045f26a5ef14 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.508651 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3221/6421] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.509519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee327d8-c4e0-4f1f-aacf-ea2abe410c55 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.534689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee327d8-c4e0-4f1f-aacf-ea2abe410c55 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.544366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff004d2-9249-4d93-bdad-7eeed01eb52e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.545061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff004d2-9249-4d93-bdad-7eeed01eb52e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.546008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff004d2-9249-4d93-bdad-7eeed01eb52e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.546885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff004d2-9249-4d93-bdad-7eeed01eb52e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.555545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff004d2-9249-4d93-bdad-7eeed01eb52e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.557599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff004d2-9249-4d93-bdad-7eeed01eb52e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.559783 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3201/6422] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 19:19:56.564135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353169ef-84ce-4786-ab40-045f26a5ef14 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.576844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353169ef-84ce-4786-ab40-045f26a5ef14 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.587297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573dac3-f6e5-4f41-b0b4-22a462c7a3ba tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.588094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573dac3-f6e5-4f41-b0b4-22a462c7a3ba tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.588478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573dac3-f6e5-4f41-b0b4-22a462c7a3ba tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.588851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573dac3-f6e5-4f41-b0b4-22a462c7a3ba tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.589542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573dac3-f6e5-4f41-b0b4-22a462c7a3ba tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.591303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573dac3-f6e5-4f41-b0b4-22a462c7a3ba tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.593581 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3222/6423] 10.222.0.70 () {58 vars in 1212 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.597801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff004d2-9249-4d93-bdad-7eeed01eb52e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.613994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff004d2-9249-4d93-bdad-7eeed01eb52e tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.625900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393a143-6f05-4886-acc6-d68a9285a876 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.626953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393a143-6f05-4886-acc6-d68a9285a876 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.627589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393a143-6f05-4886-acc6-d68a9285a876 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.628278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393a143-6f05-4886-acc6-d68a9285a876 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.629111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393a143-6f05-4886-acc6-d68a9285a876 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.631632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1393a143-6f05-4886-acc6-d68a9285a876 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.639090 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3202/6424] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.639173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573dac3-f6e5-4f41-b0b4-22a462c7a3ba tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.656241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573dac3-f6e5-4f41-b0b4-22a462c7a3ba tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.662916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f2b04-c9c1-4b06-a8f6-6974c2c961a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.664153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f2b04-c9c1-4b06-a8f6-6974c2c961a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.664709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f2b04-c9c1-4b06-a8f6-6974c2c961a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.665200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f2b04-c9c1-4b06-a8f6-6974c2c961a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.666061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f2b04-c9c1-4b06-a8f6-6974c2c961a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.669020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f2b04-c9c1-4b06-a8f6-6974c2c961a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.677649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393a143-6f05-4886-acc6-d68a9285a876 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.686465 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3223/6425] 10.222.0.70 () {58 vars in 1215 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.698016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393a143-6f05-4886-acc6-d68a9285a876 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.704336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecb104-f6fd-4fde-bc23-ec47428bf958 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.705818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb104-f6fd-4fde-bc23-ec47428bf958 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.706208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb104-f6fd-4fde-bc23-ec47428bf958 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.706589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecb104-f6fd-4fde-bc23-ec47428bf958 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.707731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecb104-f6fd-4fde-bc23-ec47428bf958 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.709739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecb104-f6fd-4fde-bc23-ec47428bf958 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.711980 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3203/6426] 10.222.0.70 () {58 vars in 1218 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.716813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f2b04-c9c1-4b06-a8f6-6974c2c961a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.728418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f2b04-c9c1-4b06-a8f6-6974c2c961a9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.734456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dca3da-857e-4298-a371-be03106d5c42 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.735478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dca3da-857e-4298-a371-be03106d5c42 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.735781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dca3da-857e-4298-a371-be03106d5c42 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.736220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dca3da-857e-4298-a371-be03106d5c42 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.737077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dca3da-857e-4298-a371-be03106d5c42 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.738977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dca3da-857e-4298-a371-be03106d5c42 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.744400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecb104-f6fd-4fde-bc23-ec47428bf958 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.750514 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3224/6427] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.758976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecb104-f6fd-4fde-bc23-ec47428bf958 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.768217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165593f-c797-4a07-9a22-ec7b5936524a tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.769474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165593f-c797-4a07-9a22-ec7b5936524a tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.770098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165593f-c797-4a07-9a22-ec7b5936524a tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.770712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165593f-c797-4a07-9a22-ec7b5936524a tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.771654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165593f-c797-4a07-9a22-ec7b5936524a tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.774230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165593f-c797-4a07-9a22-ec7b5936524a tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.780022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dca3da-857e-4298-a371-be03106d5c42 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.789052 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3204/6428] 10.222.0.70 () {58 vars in 1239 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 19:19:56.795314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dca3da-857e-4298-a371-be03106d5c42 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.803656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2f7aa-e151-487a-9f87-bacb28299c47 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.805771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2f7aa-e151-487a-9f87-bacb28299c47 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.806268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2f7aa-e151-487a-9f87-bacb28299c47 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.806850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2f7aa-e151-487a-9f87-bacb28299c47 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.808354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2f7aa-e151-487a-9f87-bacb28299c47 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.811697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2f7aa-e151-487a-9f87-bacb28299c47 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.819621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165593f-c797-4a07-9a22-ec7b5936524a tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.836265 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3225/6429] 10.222.0.70 () {58 vars in 1260 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 19:19:56.844507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165593f-c797-4a07-9a22-ec7b5936524a tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.853327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db616a6a-a640-4fc2-9e8b-3999cbfeacd8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.854408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616a6a-a640-4fc2-9e8b-3999cbfeacd8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.854950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616a6a-a640-4fc2-9e8b-3999cbfeacd8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.855627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616a6a-a640-4fc2-9e8b-3999cbfeacd8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.856593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db616a6a-a640-4fc2-9e8b-3999cbfeacd8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.859506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db616a6a-a640-4fc2-9e8b-3999cbfeacd8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.864668 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3205/6430] 10.222.0.70 () {58 vars in 1263 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.867035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2f7aa-e151-487a-9f87-bacb28299c47 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.886709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:19:56.904167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2f7aa-e151-487a-9f87-bacb28299c47 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.915333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd8102-c6dc-4673-b0dd-945ff988b8ed tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.916302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd8102-c6dc-4673-b0dd-945ff988b8ed tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.917134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd8102-c6dc-4673-b0dd-945ff988b8ed tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.917607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd8102-c6dc-4673-b0dd-945ff988b8ed tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.918529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd8102-c6dc-4673-b0dd-945ff988b8ed tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.922198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd8102-c6dc-4673-b0dd-945ff988b8ed tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.928177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db616a6a-a640-4fc2-9e8b-3999cbfeacd8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.936919 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3226/6431] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.944704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db616a6a-a640-4fc2-9e8b-3999cbfeacd8 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:56.963073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19abe8-44cd-4f87-9eec-18d5ab645a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:56.967278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19abe8-44cd-4f87-9eec-18d5ab645a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:56.968052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19abe8-44cd-4f87-9eec-18d5ab645a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:56.969183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19abe8-44cd-4f87-9eec-18d5ab645a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:56.971530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19abe8-44cd-4f87-9eec-18d5ab645a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:56.974972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19abe8-44cd-4f87-9eec-18d5ab645a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:56.980603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd8102-c6dc-4673-b0dd-945ff988b8ed tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:56.988458 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3206/6432] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:19:56.995565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd8102-c6dc-4673-b0dd-945ff988b8ed tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:57.004004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abbe80-40eb-47b8-8be3-e4155abec1b9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:57.005574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abbe80-40eb-47b8-8be3-e4155abec1b9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:57.006060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abbe80-40eb-47b8-8be3-e4155abec1b9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:57.006663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abbe80-40eb-47b8-8be3-e4155abec1b9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:57.009156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abbe80-40eb-47b8-8be3-e4155abec1b9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:57.012145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abbe80-40eb-47b8-8be3-e4155abec1b9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:57.029708 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3227/6433] 10.222.0.70 () {58 vars in 1278 bytes} [Sun Aug 28 19:19:56 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 28 19:19:57.031654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19abe8-44cd-4f87-9eec-18d5ab645a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:57.055056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19abe8-44cd-4f87-9eec-18d5ab645a1c tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:57.071953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df59b1-73f5-4634-8381-b723cbf904b7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:57.072693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df59b1-73f5-4634-8381-b723cbf904b7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:57.073055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df59b1-73f5-4634-8381-b723cbf904b7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:57.073394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df59b1-73f5-4634-8381-b723cbf904b7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:57.087822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df59b1-73f5-4634-8381-b723cbf904b7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-62df59b1-73f5-4634-8381-b723cbf904b7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Could not find domain: e2ba0d47140b4e4e92552aeb271e08c8.: keystone.exception.DomainNotFound: Could not find domain: e2ba0d47140b4e4e92552aeb271e08c8. Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e2ba0d47140b4e4e92552aeb271e08c8. Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:19:57.095278 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:19:57.098031 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:19:57.098991 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e2ba0d47140b4e4e92552aeb271e08c8. Aug 28 19:19:57.099997 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:19:57.099997 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3207/6434] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:19:57 2022] PATCH /identity/v3/domains/e2ba0d47140b4e4e92552aeb271e08c8 => generated 112 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:19:57.101479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abbe80-40eb-47b8-8be3-e4155abec1b9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:57.120965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abbe80-40eb-47b8-8be3-e4155abec1b9 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:57.132508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af048e54-3c4b-447a-9c5f-c79b46bcf4da tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:57.133165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af048e54-3c4b-447a-9c5f-c79b46bcf4da tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:57.133449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af048e54-3c4b-447a-9c5f-c79b46bcf4da tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:57.133727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af048e54-3c4b-447a-9c5f-c79b46bcf4da tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/ae72c750126048cf852205d07756cba6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:57.156567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af048e54-3c4b-447a-9c5f-c79b46bcf4da tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-af048e54-3c4b-447a-9c5f-c79b46bcf4da tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Could not find domain: ae72c750126048cf852205d07756cba6.: keystone.exception.DomainNotFound: Could not find domain: ae72c750126048cf852205d07756cba6. Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ae72c750126048cf852205d07756cba6. Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:19:57.168195 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:19:57.168968 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:19:57.169687 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ae72c750126048cf852205d07756cba6. Aug 28 19:19:57.171280 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:19:57.171280 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3228/6435] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:19:57 2022] PATCH /identity/v3/domains/ae72c750126048cf852205d07756cba6 => generated 112 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:19:57.174234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df59b1-73f5-4634-8381-b723cbf904b7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:57.194137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df59b1-73f5-4634-8381-b723cbf904b7 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:57.223093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb5804-61da-48e1-930a-7eeb0c762582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '532580a105194e8c83470cbb0cc5c060', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '408b159b2e6247309a7e1cad7fa941f5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:57.223786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb5804-61da-48e1-930a-7eeb0c762582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:57.224056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb5804-61da-48e1-930a-7eeb0c762582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:57.226458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb5804-61da-48e1-930a-7eeb0c762582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] PATH_INFO: `/v3/domains/1913758f1a4a480f8057f0779bae7a30` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:57.299788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb5804-61da-48e1-930a-7eeb0c762582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-81cb5804-61da-48e1-930a-7eeb0c762582 tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Could not find domain: 1913758f1a4a480f8057f0779bae7a30.: keystone.exception.DomainNotFound: Could not find domain: 1913758f1a4a480f8057f0779bae7a30. Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1913758f1a4a480f8057f0779bae7a30. Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:19:57.334459 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:19:57.335357 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:19:57.336172 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1913758f1a4a480f8057f0779bae7a30. Aug 28 19:19:57.337013 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:19:57.337088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af048e54-3c4b-447a-9c5f-c79b46bcf4da tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:57.337088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-af048e54-3c4b-447a-9c5f-c79b46bcf4da tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:57.341801 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3208/6436] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:19:57 2022] PATCH /identity/v3/domains/1913758f1a4a480f8057f0779bae7a30 => generated 112 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:19:57.535282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af048e54-3c4b-447a-9c5f-c79b46bcf4da tempest-DomainConfigurationTestJSON-1772009396 tempest-DomainConfigurationTestJSON-1772009396-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:57.555743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:57.574104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:57.574309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:57.574629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] PATH_INFO: `/v3/users/5f09cf594b2446d38b484a9c367845a4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:57.583608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f09cf594b2446d38b484a9c367845a4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:57.585473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:57.685680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f09cf594b2446d38b484a9c367845a4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:57.704192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f09cf594b2446d38b484a9c367845a4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:57.705031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f09cf594b2446d38b484a9c367845a4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:57.730952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f09cf594b2446d38b484a9c367845a4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:57.731600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f09cf594b2446d38b484a9c367845a4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:19:57.779646 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3229/6437] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:19:57 2022] DELETE /identity/v3/users/5f09cf594b2446d38b484a9c367845a4 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:19:57.786872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44464b45-bee2-4c06-8e59-4fc7beb7d1dc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:57.787359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44464b45-bee2-4c06-8e59-4fc7beb7d1dc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:57.787731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44464b45-bee2-4c06-8e59-4fc7beb7d1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:57.848396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-44464b45-bee2-4c06-8e59-4fc7beb7d1dc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:19:57.856592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-44464b45-bee2-4c06-8e59-4fc7beb7d1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:58.059199 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3209/6438] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:19:58.168840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:19:58.173631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:19:58.285735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd14aab-763f-48b1-ad8b-48e5aeb985c7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:19:58.301784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab312b-a112-4545-98e0-a0c20af8781e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:19:58.302431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab312b-a112-4545-98e0-a0c20af8781e service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:19:58.302904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab312b-a112-4545-98e0-a0c20af8781e service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:19:58.303218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab312b-a112-4545-98e0-a0c20af8781e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:19:58.323857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab312b-a112-4545-98e0-a0c20af8781e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:19:58.325508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab312b-a112-4545-98e0-a0c20af8781e service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:19:58.352717 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3230/6439] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:00.377163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44464b45-bee2-4c06-8e59-4fc7beb7d1dc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:00.379786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-44464b45-bee2-4c06-8e59-4fc7beb7d1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:00.433927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44464b45-bee2-4c06-8e59-4fc7beb7d1dc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:00.459995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:00.463331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:00.463559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:00.463842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] PATH_INFO: `/v3/projects/328a326935bf4ce0a380aaa106277d1f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:00.472524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] RBAC: Authorizing `identity:delete_project(project_id=328a326935bf4ce0a380aaa106277d1f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:00.477238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:00.611299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328a326935bf4ce0a380aaa106277d1f', 'request_id': 'req-bf604f29-51a9-491f-858d-3e73108de10e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:00.626515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328a326935bf4ce0a380aaa106277d1f', 'request_id': 'req-bf604f29-51a9-491f-858d-3e73108de10e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:00.646030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328a326935bf4ce0a380aaa106277d1f', 'request_id': 'req-bf604f29-51a9-491f-858d-3e73108de10e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:00.680952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] The token cache is being invalidate because project 328a326935bf4ce0a380aaa106277d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:00.681484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:00.682459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:00.695572 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3210/6440] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:00 2022] DELETE /identity/v3/projects/328a326935bf4ce0a380aaa106277d1f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:00.695750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab312b-a112-4545-98e0-a0c20af8781e service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:00.703539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab312b-a112-4545-98e0-a0c20af8781e service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:00.722092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:00.858596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3a4a1-f48f-4148-9164-05da2f4bdb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:00.859378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3a4a1-f48f-4148-9164-05da2f4bdb8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:00.859704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3a4a1-f48f-4148-9164-05da2f4bdb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:00.859999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3a4a1-f48f-4148-9164-05da2f4bdb8e admin admin] PATH_INFO: `/v3/users/532580a105194e8c83470cbb0cc5c060` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:00.862185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3a4a1-f48f-4148-9164-05da2f4bdb8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=532580a105194e8c83470cbb0cc5c060)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:00.867706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3a4a1-f48f-4148-9164-05da2f4bdb8e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:00.968536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-93e3a4a1-f48f-4148-9164-05da2f4bdb8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532580a105194e8c83470cbb0cc5c060'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:00.986407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-93e3a4a1-f48f-4148-9164-05da2f4bdb8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532580a105194e8c83470cbb0cc5c060'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:00.987747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-93e3a4a1-f48f-4148-9164-05da2f4bdb8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532580a105194e8c83470cbb0cc5c060'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:01.019251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-93e3a4a1-f48f-4148-9164-05da2f4bdb8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532580a105194e8c83470cbb0cc5c060'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:01.020731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-93e3a4a1-f48f-4148-9164-05da2f4bdb8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532580a105194e8c83470cbb0cc5c060'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:01.070617 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3231/6441] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:00 2022] DELETE /identity/v3/users/532580a105194e8c83470cbb0cc5c060 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:01.835843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:01.837636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:01.854435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf604f29-51a9-491f-858d-3e73108de10e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:01.861233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:01.987581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1113561-32de-45cc-8bc5-1d08a305d35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:01.988479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1113561-32de-45cc-8bc5-1d08a305d35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:01.988771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1113561-32de-45cc-8bc5-1d08a305d35c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:01.989049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1113561-32de-45cc-8bc5-1d08a305d35c admin admin] PATH_INFO: `/v3/projects/408b159b2e6247309a7e1cad7fa941f5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:01.990965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1113561-32de-45cc-8bc5-1d08a305d35c admin admin] RBAC: Authorizing `identity:delete_project(project_id=408b159b2e6247309a7e1cad7fa941f5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:01.992939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1113561-32de-45cc-8bc5-1d08a305d35c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:02.070968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1113561-32de-45cc-8bc5-1d08a305d35c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408b159b2e6247309a7e1cad7fa941f5', 'request_id': 'req-b1113561-32de-45cc-8bc5-1d08a305d35c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:02.087364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1113561-32de-45cc-8bc5-1d08a305d35c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408b159b2e6247309a7e1cad7fa941f5', 'request_id': 'req-b1113561-32de-45cc-8bc5-1d08a305d35c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:02.101097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1113561-32de-45cc-8bc5-1d08a305d35c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408b159b2e6247309a7e1cad7fa941f5', 'request_id': 'req-b1113561-32de-45cc-8bc5-1d08a305d35c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:02.128196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1113561-32de-45cc-8bc5-1d08a305d35c admin admin] The token cache is being invalidate because project 408b159b2e6247309a7e1cad7fa941f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:02.129049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1113561-32de-45cc-8bc5-1d08a305d35c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:02.129961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1113561-32de-45cc-8bc5-1d08a305d35c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:02.140844 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3211/6442] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:01 2022] DELETE /identity/v3/projects/408b159b2e6247309a7e1cad7fa941f5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:02.141876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b4f76-4de3-41fa-b848-9353841e16a8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:02.142680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b4f76-4de3-41fa-b848-9353841e16a8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:02.143546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b4f76-4de3-41fa-b848-9353841e16a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:02.171095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-091b4f76-4de3-41fa-b848-9353841e16a8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:02.172663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-091b4f76-4de3-41fa-b848-9353841e16a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:02.270123 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3232/6443] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:20:02.282235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87dc4e-d9c1-4519-873b-a03bfd9b483d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:02.286912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87dc4e-d9c1-4519-873b-a03bfd9b483d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:02.288650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87dc4e-d9c1-4519-873b-a03bfd9b483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:02.320248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5c87dc4e-d9c1-4519-873b-a03bfd9b483d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:02.321796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5c87dc4e-d9c1-4519-873b-a03bfd9b483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:02.340255 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3212/6444] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:02.341441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b4f76-4de3-41fa-b848-9353841e16a8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:02.353446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b4f76-4de3-41fa-b848-9353841e16a8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:02.360006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0e596-bd03-45e7-a933-d73ddd0ab54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:02.360636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0e596-bd03-45e7-a933-d73ddd0ab54f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:02.361283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0e596-bd03-45e7-a933-d73ddd0ab54f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:02.361697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0e596-bd03-45e7-a933-d73ddd0ab54f admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:02.362500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0e596-bd03-45e7-a933-d73ddd0ab54f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:02.363122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0e596-bd03-45e7-a933-d73ddd0ab54f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:02.365170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0e596-bd03-45e7-a933-d73ddd0ab54f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:02.382182 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3233/6445] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:02.386319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87dc4e-d9c1-4519-873b-a03bfd9b483d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:02.400487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87dc4e-d9c1-4519-873b-a03bfd9b483d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:02.410824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efe94c-a0a8-4630-85b3-ae343e3f5d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:02.411885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efe94c-a0a8-4630-85b3-ae343e3f5d5a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:02.422789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efe94c-a0a8-4630-85b3-ae343e3f5d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:02.424080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efe94c-a0a8-4630-85b3-ae343e3f5d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:02.426309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efe94c-a0a8-4630-85b3-ae343e3f5d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:02.431187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efe94c-a0a8-4630-85b3-ae343e3f5d5a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:02.521188 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3213/6446] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:02 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:20:02.525013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0e596-bd03-45e7-a933-d73ddd0ab54f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:02.536846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0e596-bd03-45e7-a933-d73ddd0ab54f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:02.591128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:02.664505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf17116-08e5-4df7-8970-1e67cee0a3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:02.666012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17116-08e5-4df7-8970-1e67cee0a3af admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:02.666012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17116-08e5-4df7-8970-1e67cee0a3af admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:02.666422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17116-08e5-4df7-8970-1e67cee0a3af admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:02.667284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf17116-08e5-4df7-8970-1e67cee0a3af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:02.669536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf17116-08e5-4df7-8970-1e67cee0a3af admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:02.748262 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3234/6447] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:02 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:02.749435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efe94c-a0a8-4630-85b3-ae343e3f5d5a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:02.776993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efe94c-a0a8-4630-85b3-ae343e3f5d5a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:02.796370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7c1a1-0d2c-4392-9e74-d07b7d0ade58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:02.796370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7c1a1-0d2c-4392-9e74-d07b7d0ade58 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:02.796370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7c1a1-0d2c-4392-9e74-d07b7d0ade58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:02.796370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7c1a1-0d2c-4392-9e74-d07b7d0ade58 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:02.798218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7c1a1-0d2c-4392-9e74-d07b7d0ade58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:02.822413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7c1a1-0d2c-4392-9e74-d07b7d0ade58 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:02.869310 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3214/6448] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:02.870045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf17116-08e5-4df7-8970-1e67cee0a3af admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:02.890521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf17116-08e5-4df7-8970-1e67cee0a3af admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:02.910981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ea9dc-7035-4ba4-a502-b3dffd3f49e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:02.911683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ea9dc-7035-4ba4-a502-b3dffd3f49e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:02.912218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ea9dc-7035-4ba4-a502-b3dffd3f49e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:02.914695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ea9dc-7035-4ba4-a502-b3dffd3f49e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:02.917967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ea9dc-7035-4ba4-a502-b3dffd3f49e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:02.923959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ea9dc-7035-4ba4-a502-b3dffd3f49e3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:02.965197 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3235/6449] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:02.972229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7c1a1-0d2c-4392-9e74-d07b7d0ade58 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:02.985526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7c1a1-0d2c-4392-9e74-d07b7d0ade58 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:02.997385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9d08b-efbc-4e88-9823-b8335b196023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:03.015204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d08b-efbc-4e88-9823-b8335b196023 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:03.017579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d08b-efbc-4e88-9823-b8335b196023 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:03.018061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d08b-efbc-4e88-9823-b8335b196023 admin admin] PATH_INFO: `/v3/projects/24d57a4965364bbfbf7af38ca9e8667c/users/d8e228ff80434738aeb4e1734017b28e/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:03.081284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9d08b-efbc-4e88-9823-b8335b196023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d57a4965364bbfbf7af38ca9e8667c, user_id=d8e228ff80434738aeb4e1734017b28e, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:03.084721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9d08b-efbc-4e88-9823-b8335b196023 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:03.134815 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3215/6450] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:02 2022] PUT /identity/v3/projects/24d57a4965364bbfbf7af38ca9e8667c/users/d8e228ff80434738aeb4e1734017b28e/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:03.136857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538e343-deed-42ae-81cb-85daca2bb907 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:03.137356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538e343-deed-42ae-81cb-85daca2bb907 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:03.137816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538e343-deed-42ae-81cb-85daca2bb907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:03.194651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7538e343-deed-42ae-81cb-85daca2bb907 None None] MFA Rules not processed for user `d8e228ff80434738aeb4e1734017b28e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:03.196069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7538e343-deed-42ae-81cb-85daca2bb907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:03.335306 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3236/6451] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:03.339860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9d08b-efbc-4e88-9823-b8335b196023 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:03.441487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:03.504309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9d08b-efbc-4e88-9823-b8335b196023 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:03.521873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2105a-8e44-43ad-ad8b-3e9d943aaac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:03.522682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2105a-8e44-43ad-ad8b-3e9d943aaac7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:03.523102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2105a-8e44-43ad-ad8b-3e9d943aaac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:03.524084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2105a-8e44-43ad-ad8b-3e9d943aaac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:03.524863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2105a-8e44-43ad-ad8b-3e9d943aaac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:03.527130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2105a-8e44-43ad-ad8b-3e9d943aaac7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:03.601221 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3216/6452] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:03 2022] POST /identity/v3/projects => generated 375 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:03.606011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538e343-deed-42ae-81cb-85daca2bb907 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:03.621802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538e343-deed-42ae-81cb-85daca2bb907 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:03.766647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141465e-0383-4390-aa7b-f2808ca4c16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:03.767323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141465e-0383-4390-aa7b-f2808ca4c16f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:03.767600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141465e-0383-4390-aa7b-f2808ca4c16f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:03.767880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141465e-0383-4390-aa7b-f2808ca4c16f admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:03.768768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141465e-0383-4390-aa7b-f2808ca4c16f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:03.770728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141465e-0383-4390-aa7b-f2808ca4c16f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:03.831113 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3237/6453] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:03 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:03.832251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2105a-8e44-43ad-ad8b-3e9d943aaac7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:03.872193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2105a-8e44-43ad-ad8b-3e9d943aaac7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:03.891562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a7d58-5f8e-4831-a49e-0581df90cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:03.894699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a7d58-5f8e-4831-a49e-0581df90cd24 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:03.895773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a7d58-5f8e-4831-a49e-0581df90cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:03.896917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a7d58-5f8e-4831-a49e-0581df90cd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:03.898942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a7d58-5f8e-4831-a49e-0581df90cd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:03.901894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a7d58-5f8e-4831-a49e-0581df90cd24 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:03.963708 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3217/6454] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:03.969065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141465e-0383-4390-aa7b-f2808ca4c16f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:03.985817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141465e-0383-4390-aa7b-f2808ca4c16f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:03.997758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688e132-3066-4a30-bb7f-f95754403611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:03.999024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688e132-3066-4a30-bb7f-f95754403611 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:03.999315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688e132-3066-4a30-bb7f-f95754403611 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:03.999593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688e132-3066-4a30-bb7f-f95754403611 admin admin] PATH_INFO: `/v3/projects/e63fce98d0724e85a4cd202d1dcfb782/users/bb8ea2d97f75470e9bde000178ac0b8e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:04.059249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:04.071541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688e132-3066-4a30-bb7f-f95754403611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63fce98d0724e85a4cd202d1dcfb782, user_id=bb8ea2d97f75470e9bde000178ac0b8e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:04.082594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688e132-3066-4a30-bb7f-f95754403611 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:04.137739 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3238/6455] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:03 2022] PUT /identity/v3/projects/e63fce98d0724e85a4cd202d1dcfb782/users/bb8ea2d97f75470e9bde000178ac0b8e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:04.154184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a7d58-5f8e-4831-a49e-0581df90cd24 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:04.177022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a7d58-5f8e-4831-a49e-0581df90cd24 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:04.304079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de04a-8860-4d5a-a2bb-5b0d85319ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:04.306669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de04a-8860-4d5a-a2bb-5b0d85319ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:04.307118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de04a-8860-4d5a-a2bb-5b0d85319ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:04.308913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de04a-8860-4d5a-a2bb-5b0d85319ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:04.309734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8de04a-8860-4d5a-a2bb-5b0d85319ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:04.312997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8de04a-8860-4d5a-a2bb-5b0d85319ad7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:04.329910 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3218/6456] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:04.334446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688e132-3066-4a30-bb7f-f95754403611 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:04.350075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688e132-3066-4a30-bb7f-f95754403611 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:04.357077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be37010-be69-4c8c-bdc3-b27ea5ce0e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:04.359069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be37010-be69-4c8c-bdc3-b27ea5ce0e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:04.360488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be37010-be69-4c8c-bdc3-b27ea5ce0e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:04.360983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be37010-be69-4c8c-bdc3-b27ea5ce0e50 admin admin] PATH_INFO: `/v3/projects/e63fce98d0724e85a4cd202d1dcfb782/users/bb8ea2d97f75470e9bde000178ac0b8e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:04.364150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be37010-be69-4c8c-bdc3-b27ea5ce0e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63fce98d0724e85a4cd202d1dcfb782, user_id=bb8ea2d97f75470e9bde000178ac0b8e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:04.367433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be37010-be69-4c8c-bdc3-b27ea5ce0e50 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:04.399691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22e82e-266d-49c9-a418-af1c4ba24a7f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:04.402504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22e82e-266d-49c9-a418-af1c4ba24a7f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:04.402955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22e82e-266d-49c9-a418-af1c4ba24a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:04.408619 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3239/6457] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:04 2022] PUT /identity/v3/projects/e63fce98d0724e85a4cd202d1dcfb782/users/bb8ea2d97f75470e9bde000178ac0b8e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:04.474256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cc22e82e-266d-49c9-a418-af1c4ba24a7f None None] MFA Rules not processed for user `bb8ea2d97f75470e9bde000178ac0b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:04.476018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cc22e82e-266d-49c9-a418-af1c4ba24a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:04.686000 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3219/6458] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:04.689247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be37010-be69-4c8c-bdc3-b27ea5ce0e50 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:04.731680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be37010-be69-4c8c-bdc3-b27ea5ce0e50 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:04.761385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58376132-1712-4fc0-bb50-77225d841230 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ea2d97f75470e9bde000178ac0b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63fce98d0724e85a4cd202d1dcfb782', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:04.762080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58376132-1712-4fc0-bb50-77225d841230 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:04.762366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58376132-1712-4fc0-bb50-77225d841230 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:04.762651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58376132-1712-4fc0-bb50-77225d841230 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:04.763400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58376132-1712-4fc0-bb50-77225d841230 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:04.770401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58376132-1712-4fc0-bb50-77225d841230 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:04.870356 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3240/6459] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:04 2022] POST /identity/v3/projects => generated 334 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:04.871234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22e82e-266d-49c9-a418-af1c4ba24a7f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:04.886323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22e82e-266d-49c9-a418-af1c4ba24a7f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:04.960990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:05.055714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d7cee-2447-4ddb-a6df-76435721699f tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ea2d97f75470e9bde000178ac0b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63fce98d0724e85a4cd202d1dcfb782', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:05.056364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d7cee-2447-4ddb-a6df-76435721699f tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:05.056656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d7cee-2447-4ddb-a6df-76435721699f tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:05.056940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d7cee-2447-4ddb-a6df-76435721699f tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:05.057598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d7cee-2447-4ddb-a6df-76435721699f tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:05.059521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d7cee-2447-4ddb-a6df-76435721699f tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:05.135030 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3220/6460] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:20:04 2022] POST /identity/v3/projects => generated 333 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:20:05.143650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58376132-1712-4fc0-bb50-77225d841230 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:05.160739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58376132-1712-4fc0-bb50-77225d841230 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:05.504381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e991f-0fa8-44d7-8cc5-9a90c605d1c7 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ea2d97f75470e9bde000178ac0b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63fce98d0724e85a4cd202d1dcfb782', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:05.505620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e991f-0fa8-44d7-8cc5-9a90c605d1c7 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:05.505968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e991f-0fa8-44d7-8cc5-9a90c605d1c7 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:05.506220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e991f-0fa8-44d7-8cc5-9a90c605d1c7 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:05.507306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e991f-0fa8-44d7-8cc5-9a90c605d1c7 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:05.509699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e991f-0fa8-44d7-8cc5-9a90c605d1c7 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:05.572534 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3241/6461] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:05 2022] POST /identity/v3/projects => generated 358 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:05.578681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d7cee-2447-4ddb-a6df-76435721699f tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:05.597725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d7cee-2447-4ddb-a6df-76435721699f tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:05.693471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8009-73a2-4d73-9b2e-85a63b8e4013 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ea2d97f75470e9bde000178ac0b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63fce98d0724e85a4cd202d1dcfb782', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:05.694194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8009-73a2-4d73-9b2e-85a63b8e4013 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:05.694670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8009-73a2-4d73-9b2e-85a63b8e4013 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:05.695562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8009-73a2-4d73-9b2e-85a63b8e4013 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:05.696344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab8009-73a2-4d73-9b2e-85a63b8e4013 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:05.699341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab8009-73a2-4d73-9b2e-85a63b8e4013 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:05.732271 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3221/6462] 10.222.0.70 () {58 vars in 1131 bytes} [Sun Aug 28 19:20:05 2022] GET /identity/v3/projects => generated 6819 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:05.739087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e991f-0fa8-44d7-8cc5-9a90c605d1c7 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:05.752281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e991f-0fa8-44d7-8cc5-9a90c605d1c7 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:05.757662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf6819-20ed-433a-b2da-aa34084986c4 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ea2d97f75470e9bde000178ac0b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63fce98d0724e85a4cd202d1dcfb782', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:05.758302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf6819-20ed-433a-b2da-aa34084986c4 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:05.758606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf6819-20ed-433a-b2da-aa34084986c4 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:05.758918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf6819-20ed-433a-b2da-aa34084986c4 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:05.759604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf6819-20ed-433a-b2da-aa34084986c4 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:05.759919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf6819-20ed-433a-b2da-aa34084986c4 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:05.761960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf6819-20ed-433a-b2da-aa34084986c4 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:05.804639 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3242/6463] 10.222.0.70 () {58 vars in 1158 bytes} [Sun Aug 28 19:20:05 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:05.809994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8009-73a2-4d73-9b2e-85a63b8e4013 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:05.822202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8009-73a2-4d73-9b2e-85a63b8e4013 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:05.828868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1326b7-a8cf-4015-9928-160d1ca93399 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ea2d97f75470e9bde000178ac0b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63fce98d0724e85a4cd202d1dcfb782', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:05.829517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1326b7-a8cf-4015-9928-160d1ca93399 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:05.829803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1326b7-a8cf-4015-9928-160d1ca93399 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:05.830083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1326b7-a8cf-4015-9928-160d1ca93399 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:05.830781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1326b7-a8cf-4015-9928-160d1ca93399 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Adding query filter params (parent_id=d904064f905644e8a07f1e2f98d2713a) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:05.841117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1326b7-a8cf-4015-9928-160d1ca93399 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:05.843254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1326b7-a8cf-4015-9928-160d1ca93399 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:05.882226 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3222/6464] 10.222.0.70 () {58 vars in 1216 bytes} [Sun Aug 28 19:20:05 2022] GET /identity/v3/projects?parent_id=d904064f905644e8a07f1e2f98d2713a => generated 498 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:20:05.887771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf6819-20ed-433a-b2da-aa34084986c4 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:05.910466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf6819-20ed-433a-b2da-aa34084986c4 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:05.928353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ea2d97f75470e9bde000178ac0b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63fce98d0724e85a4cd202d1dcfb782', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:05.929631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:05.930086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:05.930551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] PATH_INFO: `/v3/projects/9d81f73be2a04e51bbb3482c03769543` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:05.933530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d81f73be2a04e51bbb3482c03769543)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:05.936585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:06.037069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d81f73be2a04e51bbb3482c03769543', 'request_id': 'req-8da3bea3-d5b1-499c-94dd-41efba1a1955'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:06.049367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d81f73be2a04e51bbb3482c03769543', 'request_id': 'req-8da3bea3-d5b1-499c-94dd-41efba1a1955'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:06.057859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d81f73be2a04e51bbb3482c03769543', 'request_id': 'req-8da3bea3-d5b1-499c-94dd-41efba1a1955'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:06.129943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] The token cache is being invalidate because project 9d81f73be2a04e51bbb3482c03769543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:06.132889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:06.133890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:06.140055 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3243/6465] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:05 2022] DELETE /identity/v3/projects/9d81f73be2a04e51bbb3482c03769543 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:06.157286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1326b7-a8cf-4015-9928-160d1ca93399 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:06.169326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8b1326b7-a8cf-4015-9928-160d1ca93399 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:06.186495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1326b7-a8cf-4015-9928-160d1ca93399 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:06.398592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ea2d97f75470e9bde000178ac0b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63fce98d0724e85a4cd202d1dcfb782', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:06.401705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:06.403805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:06.405178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] PATH_INFO: `/v3/projects/d904064f905644e8a07f1e2f98d2713a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:06.410307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d904064f905644e8a07f1e2f98d2713a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:06.412817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:06.571404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:06.608995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd904064f905644e8a07f1e2f98d2713a', 'request_id': 'req-c851a704-4210-4394-9dc5-1a934a18c9e8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:06.633593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd904064f905644e8a07f1e2f98d2713a', 'request_id': 'req-c851a704-4210-4394-9dc5-1a934a18c9e8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:06.642364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd904064f905644e8a07f1e2f98d2713a', 'request_id': 'req-c851a704-4210-4394-9dc5-1a934a18c9e8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:06.666038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] The token cache is being invalidate because project d904064f905644e8a07f1e2f98d2713a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:06.666399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:06.667187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:06.674111 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3223/6466] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:06 2022] DELETE /identity/v3/projects/d904064f905644e8a07f1e2f98d2713a => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:06.677849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:06.684337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:06.693403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3bea3-d5b1-499c-94dd-41efba1a1955 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:06.847479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c753df-a747-4480-b378-2275abfe5f57 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8ea2d97f75470e9bde000178ac0b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e63fce98d0724e85a4cd202d1dcfb782', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:06.849380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c753df-a747-4480-b378-2275abfe5f57 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:06.849543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c753df-a747-4480-b378-2275abfe5f57 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:06.849729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c753df-a747-4480-b378-2275abfe5f57 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] PATH_INFO: `/v3/projects/c3af9ef8d73d454797d900ddcf44a382` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:06.852676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c753df-a747-4480-b378-2275abfe5f57 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c3af9ef8d73d454797d900ddcf44a382)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:06.859001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c753df-a747-4480-b378-2275abfe5f57 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:07.021044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73c753df-a747-4480-b378-2275abfe5f57 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3af9ef8d73d454797d900ddcf44a382', 'request_id': 'req-73c753df-a747-4480-b378-2275abfe5f57'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:07.036122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73c753df-a747-4480-b378-2275abfe5f57 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3af9ef8d73d454797d900ddcf44a382', 'request_id': 'req-73c753df-a747-4480-b378-2275abfe5f57'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:07.049033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73c753df-a747-4480-b378-2275abfe5f57 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3af9ef8d73d454797d900ddcf44a382', 'request_id': 'req-73c753df-a747-4480-b378-2275abfe5f57'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:07.077989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73c753df-a747-4480-b378-2275abfe5f57 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] The token cache is being invalidate because project c3af9ef8d73d454797d900ddcf44a382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:07.078285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73c753df-a747-4480-b378-2275abfe5f57 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:07.079226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73c753df-a747-4480-b378-2275abfe5f57 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:07.081043 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3244/6467] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:06 2022] DELETE /identity/v3/projects/c3af9ef8d73d454797d900ddcf44a382 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:07.085108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:07.086710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:07.352218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851a704-4210-4394-9dc5-1a934a18c9e8 tempest-ListProjectsTestJSON-635079435 tempest-ListProjectsTestJSON-635079435-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:07.483605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:07.484530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:07.484827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:07.485171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] PATH_INFO: `/v3/users/d8e228ff80434738aeb4e1734017b28e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:07.486583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e228ff80434738aeb4e1734017b28e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:07.489120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:07.662909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e228ff80434738aeb4e1734017b28e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:07.681070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e228ff80434738aeb4e1734017b28e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:07.682107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e228ff80434738aeb4e1734017b28e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:07.683622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:07.708446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e228ff80434738aeb4e1734017b28e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:07.709909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e228ff80434738aeb4e1734017b28e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:07.740434 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3224/6468] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:07 2022] DELETE /identity/v3/users/d8e228ff80434738aeb4e1734017b28e => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:07.744123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467970f-b866-43de-800b-e1ec95d6cb74 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:07.744612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467970f-b866-43de-800b-e1ec95d6cb74 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:07.745962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467970f-b866-43de-800b-e1ec95d6cb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:07.771886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5467970f-b866-43de-800b-e1ec95d6cb74 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:07.773493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5467970f-b866-43de-800b-e1ec95d6cb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:07.832061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:07.834603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:07.881509 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3245/6469] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:07.893525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467970f-b866-43de-800b-e1ec95d6cb74 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:07.896432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5467970f-b866-43de-800b-e1ec95d6cb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:07.961888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:07.992290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c70548-8d46-4ff3-ac65-8671181b93a4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:08.015351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467970f-b866-43de-800b-e1ec95d6cb74 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:08.016122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:08.016910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:08.017206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:08.017491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] PATH_INFO: `/v3/users/b8edeb08e8274a4889c9837296181451` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:08.021855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae5878-dbd8-4f30-8aff-7771d8513d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:08.022686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae5878-dbd8-4f30-8aff-7771d8513d73 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:08.022974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8edeb08e8274a4889c9837296181451)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:08.023180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae5878-dbd8-4f30-8aff-7771d8513d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:08.023551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae5878-dbd8-4f30-8aff-7771d8513d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:08.026116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:08.038453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae5878-dbd8-4f30-8aff-7771d8513d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:08.040276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae5878-dbd8-4f30-8aff-7771d8513d73 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:08.055971 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3246/6470] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:08.132592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8edeb08e8274a4889c9837296181451'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:08.156373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8edeb08e8274a4889c9837296181451'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:08.160060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8edeb08e8274a4889c9837296181451'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:08.205965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8edeb08e8274a4889c9837296181451'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:08.206761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8edeb08e8274a4889c9837296181451'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:08.241992 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3225/6471] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:07 2022] DELETE /identity/v3/users/b8edeb08e8274a4889c9837296181451 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:08.246795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a88d1-bfa7-4317-9f12-e2a21c38807b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:08.247223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a88d1-bfa7-4317-9f12-e2a21c38807b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:08.247659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a88d1-bfa7-4317-9f12-e2a21c38807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:08.288265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-393a88d1-bfa7-4317-9f12-e2a21c38807b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:08.292618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-393a88d1-bfa7-4317-9f12-e2a21c38807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:08.436236 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3247/6472] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:08.449199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:08.450718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:08.563388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c51f9c-55d4-4aab-a514-7d6ce0a761b0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:08.586094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20196bc5-270c-4fc3-b8d8-81d9f54f97db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:08.586984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20196bc5-270c-4fc3-b8d8-81d9f54f97db service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:08.587282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20196bc5-270c-4fc3-b8d8-81d9f54f97db service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:08.588831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20196bc5-270c-4fc3-b8d8-81d9f54f97db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:08.623853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a88d1-bfa7-4317-9f12-e2a21c38807b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:08.626122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-393a88d1-bfa7-4317-9f12-e2a21c38807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:08.661666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:08.664904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a88d1-bfa7-4317-9f12-e2a21c38807b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:08.673807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20196bc5-270c-4fc3-b8d8-81d9f54f97db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:08.675780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20196bc5-270c-4fc3-b8d8-81d9f54f97db service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:08.689757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d33de-c448-4f02-92be-8c5eb2c034db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:08.690390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d33de-c448-4f02-92be-8c5eb2c034db service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:08.690675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d33de-c448-4f02-92be-8c5eb2c034db service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:08.691049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d33de-c448-4f02-92be-8c5eb2c034db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:08.695485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ea7d33de-c448-4f02-92be-8c5eb2c034db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:08.720992 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3226/6473] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:08.746926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d33de-c448-4f02-92be-8c5eb2c034db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:08.746926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d33de-c448-4f02-92be-8c5eb2c034db service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:08.760638 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3248/6474] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:20:09.251343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20196bc5-270c-4fc3-b8d8-81d9f54f97db service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:09.252884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-20196bc5-270c-4fc3-b8d8-81d9f54f97db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:09.283236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20196bc5-270c-4fc3-b8d8-81d9f54f97db service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:09.309007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:09.309534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:09.309820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:09.310097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] PATH_INFO: `/v3/projects/24d57a4965364bbfbf7af38ca9e8667c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:09.323193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d57a4965364bbfbf7af38ca9e8667c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:09.325171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:09.401872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d57a4965364bbfbf7af38ca9e8667c', 'request_id': 'req-51977847-8be5-435c-8184-04cdef66ee5e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:09.414692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d57a4965364bbfbf7af38ca9e8667c', 'request_id': 'req-51977847-8be5-435c-8184-04cdef66ee5e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:09.422636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d57a4965364bbfbf7af38ca9e8667c', 'request_id': 'req-51977847-8be5-435c-8184-04cdef66ee5e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:09.438986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] The token cache is being invalidate because project 24d57a4965364bbfbf7af38ca9e8667c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:09.439573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:09.440617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:09.447775 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3227/6475] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:09 2022] DELETE /identity/v3/projects/24d57a4965364bbfbf7af38ca9e8667c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:09.448996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d33de-c448-4f02-92be-8c5eb2c034db service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:09.466286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d33de-c448-4f02-92be-8c5eb2c034db service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:09.636771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:09.637842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:09.639532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:09.641190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] PATH_INFO: `/v3/users/bb8ea2d97f75470e9bde000178ac0b8e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:09.646324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8ea2d97f75470e9bde000178ac0b8e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:09.649958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:09.751978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8ea2d97f75470e9bde000178ac0b8e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:09.765553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8ea2d97f75470e9bde000178ac0b8e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:09.767175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8ea2d97f75470e9bde000178ac0b8e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:09.793422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8ea2d97f75470e9bde000178ac0b8e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:09.794223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8ea2d97f75470e9bde000178ac0b8e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:09.798103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:09.835172 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3249/6476] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:09 2022] DELETE /identity/v3/users/bb8ea2d97f75470e9bde000178ac0b8e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:10.681162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:10.682689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:10.711768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51977847-8be5-435c-8184-04cdef66ee5e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:10.891782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639d812-a39c-4ae2-b827-fd53cb50ad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:10.892797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d812-a39c-4ae2-b827-fd53cb50ad13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:10.893539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d812-a39c-4ae2-b827-fd53cb50ad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:10.893922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d812-a39c-4ae2-b827-fd53cb50ad13 admin admin] PATH_INFO: `/v3/projects/72d3eecf7a0b4d92937a41063b86ca71` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:10.895648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639d812-a39c-4ae2-b827-fd53cb50ad13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d3eecf7a0b4d92937a41063b86ca71)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:10.897958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639d812-a39c-4ae2-b827-fd53cb50ad13 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:10.929981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:10.931463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:10.953478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69bbfa-ebfd-42e7-8f2d-18510206e03f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:10.968100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:10.968737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:10.969018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:10.969284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] PATH_INFO: `/v3/projects/e63fce98d0724e85a4cd202d1dcfb782` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:10.971638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e63fce98d0724e85a4cd202d1dcfb782)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:10.973691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:11.042652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b639d812-a39c-4ae2-b827-fd53cb50ad13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d3eecf7a0b4d92937a41063b86ca71', 'request_id': 'req-b639d812-a39c-4ae2-b827-fd53cb50ad13'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.055479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b639d812-a39c-4ae2-b827-fd53cb50ad13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d3eecf7a0b4d92937a41063b86ca71', 'request_id': 'req-b639d812-a39c-4ae2-b827-fd53cb50ad13'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.067782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b639d812-a39c-4ae2-b827-fd53cb50ad13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d3eecf7a0b4d92937a41063b86ca71', 'request_id': 'req-b639d812-a39c-4ae2-b827-fd53cb50ad13'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.097797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e63fce98d0724e85a4cd202d1dcfb782', 'request_id': 'req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.100995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b639d812-a39c-4ae2-b827-fd53cb50ad13 admin admin] The token cache is being invalidate because project 72d3eecf7a0b4d92937a41063b86ca71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:11.101228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b639d812-a39c-4ae2-b827-fd53cb50ad13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.102343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b639d812-a39c-4ae2-b827-fd53cb50ad13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.110909 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3228/6477] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:10 2022] DELETE /identity/v3/projects/72d3eecf7a0b4d92937a41063b86ca71 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:11.113575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca464c8-f190-465b-b1c6-8adc9933a6e5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:11.113876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca464c8-f190-465b-b1c6-8adc9933a6e5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:11.114159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca464c8-f190-465b-b1c6-8adc9933a6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:11.114309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e63fce98d0724e85a4cd202d1dcfb782', 'request_id': 'req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.123790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e63fce98d0724e85a4cd202d1dcfb782', 'request_id': 'req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.152013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] The token cache is being invalidate because project e63fce98d0724e85a4cd202d1dcfb782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:11.155166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5ca464c8-f190-465b-b1c6-8adc9933a6e5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:11.155539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.157042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.157165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5ca464c8-f190-465b-b1c6-8adc9933a6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:11.160465 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3250/6478] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:10 2022] DELETE /identity/v3/projects/e63fce98d0724e85a4cd202d1dcfb782 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:11.162538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:11.163239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:11.168002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:11.260595 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3229/6479] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:11.260595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de649462-0f11-4d9d-b11e-6c6b6b570d7c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:11.260595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de649462-0f11-4d9d-b11e-6c6b6b570d7c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:11.260595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de649462-0f11-4d9d-b11e-6c6b6b570d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:11.281904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-de649462-0f11-4d9d-b11e-6c6b6b570d7c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:11.283450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-de649462-0f11-4d9d-b11e-6c6b6b570d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:11.301177 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3230/6480] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:11.301177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d6201-d966-4061-8777-c2f0c9f94cd3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:11.301177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d6201-d966-4061-8777-c2f0c9f94cd3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:11.301177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d6201-d966-4061-8777-c2f0c9f94cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:11.323190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7f9d6201-d966-4061-8777-c2f0c9f94cd3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:11.324649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7f9d6201-d966-4061-8777-c2f0c9f94cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:11.338067 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3231/6481] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:11.339793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beed0c-729f-494b-ae71-4779b1918308 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:11.340303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beed0c-729f-494b-ae71-4779b1918308 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:11.340785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1beed0c-729f-494b-ae71-4779b1918308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:11.365717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c1beed0c-729f-494b-ae71-4779b1918308 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:11.368115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c1beed0c-729f-494b-ae71-4779b1918308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:11.374596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda3f46-325b-4fe2-bd2d-9253904bb8ad admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:11.379024 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3232/6482] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:11.383539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1beed0c-729f-494b-ae71-4779b1918308 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:11.392957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:11.395158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1beed0c-729f-494b-ae71-4779b1918308 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:11.396247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:11.396543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:11.396824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] PATH_INFO: `/v3/users/a7a8a32221544b60b5d974fcc5eda643` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:11.401430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cc278-7f31-4797-bea3-3dc0f0be6b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:11.402526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a8a32221544b60b5d974fcc5eda643)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:11.402958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cc278-7f31-4797-bea3-3dc0f0be6b4f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:11.402958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cc278-7f31-4797-bea3-3dc0f0be6b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:11.403307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cc278-7f31-4797-bea3-3dc0f0be6b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:11.404084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cc278-7f31-4797-bea3-3dc0f0be6b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:11.404998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cc278-7f31-4797-bea3-3dc0f0be6b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:11.407214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cc278-7f31-4797-bea3-3dc0f0be6b4f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:11.412715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:11.421168 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3233/6483] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:11.425358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cc278-7f31-4797-bea3-3dc0f0be6b4f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:11.436262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cc278-7f31-4797-bea3-3dc0f0be6b4f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:11.445692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1431171-6cce-4e37-9cf5-789d70aa5887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:11.447366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1431171-6cce-4e37-9cf5-789d70aa5887 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:11.447740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1431171-6cce-4e37-9cf5-789d70aa5887 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:11.448800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1431171-6cce-4e37-9cf5-789d70aa5887 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:11.449789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1431171-6cce-4e37-9cf5-789d70aa5887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:11.452498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1431171-6cce-4e37-9cf5-789d70aa5887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:11.453927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1431171-6cce-4e37-9cf5-789d70aa5887 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:11.482147 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3234/6484] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:11.485726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1431171-6cce-4e37-9cf5-789d70aa5887 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:11.513372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1431171-6cce-4e37-9cf5-789d70aa5887 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:11.520386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a8a32221544b60b5d974fcc5eda643'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.523972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52845e0f-dfd0-4c97-a9c3-6e197d857384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:11.524670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52845e0f-dfd0-4c97-a9c3-6e197d857384 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:11.524963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52845e0f-dfd0-4c97-a9c3-6e197d857384 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:11.525563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52845e0f-dfd0-4c97-a9c3-6e197d857384 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:11.526221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52845e0f-dfd0-4c97-a9c3-6e197d857384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:11.528267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52845e0f-dfd0-4c97-a9c3-6e197d857384 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:11.536858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a8a32221544b60b5d974fcc5eda643'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.538365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a8a32221544b60b5d974fcc5eda643'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.558966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a8a32221544b60b5d974fcc5eda643'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.559655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a8a32221544b60b5d974fcc5eda643'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:11.566615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:11.577510 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3235/6485] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:11 2022] POST /identity/v3/projects => generated 357 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:11.578442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52845e0f-dfd0-4c97-a9c3-6e197d857384 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:11.582277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-52845e0f-dfd0-4c97-a9c3-6e197d857384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:11.606418 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3251/6486] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:11 2022] DELETE /identity/v3/users/a7a8a32221544b60b5d974fcc5eda643 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:11.608150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:11.610424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:11.740518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52845e0f-dfd0-4c97-a9c3-6e197d857384 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:11.802705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9a38b-e78b-49c0-8e88-d4cf1511a487 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:11.819002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f4d20-5ab6-4fc1-9fd4-a4ced95203a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:11.820268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4d20-5ab6-4fc1-9fd4-a4ced95203a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:11.820562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4d20-5ab6-4fc1-9fd4-a4ced95203a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:11.820849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4d20-5ab6-4fc1-9fd4-a4ced95203a6 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:11.821727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f4d20-5ab6-4fc1-9fd4-a4ced95203a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:11.824979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f4d20-5ab6-4fc1-9fd4-a4ced95203a6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:11.850856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:11.875236 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3252/6487] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:11 2022] POST /identity/v3/users => generated 279 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:11.879333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514c84d-8dbf-467c-a248-b871f6a1314f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:11.879673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514c84d-8dbf-467c-a248-b871f6a1314f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:11.879960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514c84d-8dbf-467c-a248-b871f6a1314f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:11.884366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a43cb-5dc8-4946-949e-c44eaf3e170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:11.885180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a43cb-5dc8-4946-949e-c44eaf3e170d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:11.885919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a43cb-5dc8-4946-949e-c44eaf3e170d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:11.885919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a43cb-5dc8-4946-949e-c44eaf3e170d admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:11.886455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a43cb-5dc8-4946-949e-c44eaf3e170d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:11.888409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a43cb-5dc8-4946-949e-c44eaf3e170d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:11.930789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2514c84d-8dbf-467c-a248-b871f6a1314f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:11.933732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2514c84d-8dbf-467c-a248-b871f6a1314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:11.950058 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3253/6488] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:11.950058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514c84d-8dbf-467c-a248-b871f6a1314f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:11.971769 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3236/6489] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:11 2022] POST /identity/v3/projects => generated 387 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:11.972495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbffb5-d09e-4f32-95bb-43bb450245bb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:11.972799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbffb5-d09e-4f32-95bb-43bb450245bb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:11.973223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbffb5-d09e-4f32-95bb-43bb450245bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:11.986516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514c84d-8dbf-467c-a248-b871f6a1314f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:12.026691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-37cbffb5-d09e-4f32-95bb-43bb450245bb None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:12.028915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-37cbffb5-d09e-4f32-95bb-43bb450245bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:12.159419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab12045-50e8-4536-b6c9-737625fe5e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:12.161649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab12045-50e8-4536-b6c9-737625fe5e0b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:12.161958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab12045-50e8-4536-b6c9-737625fe5e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:12.162241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab12045-50e8-4536-b6c9-737625fe5e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:12.162937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab12045-50e8-4536-b6c9-737625fe5e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:12.168325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab12045-50e8-4536-b6c9-737625fe5e0b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:12.181993 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3237/6490] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:20:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:12.182940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbffb5-d09e-4f32-95bb-43bb450245bb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:12.221405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbffb5-d09e-4f32-95bb-43bb450245bb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:12.221997 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3254/6491] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:12.228457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab12045-50e8-4536-b6c9-737625fe5e0b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:12.231382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c8b6-669b-46bc-b1bf-351d2c2bc8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:12.232144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c8b6-669b-46bc-b1bf-351d2c2bc8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:12.232561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c8b6-669b-46bc-b1bf-351d2c2bc8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:12.233310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1c8b6-669b-46bc-b1bf-351d2c2bc8c5 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:12.234048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1c8b6-669b-46bc-b1bf-351d2c2bc8c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:12.235179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fab12045-50e8-4536-b6c9-737625fe5e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:12.235965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1c8b6-669b-46bc-b1bf-351d2c2bc8c5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:12.283874 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3238/6492] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:12 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:12.284433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c8b6-669b-46bc-b1bf-351d2c2bc8c5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:12.313476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1c8b6-669b-46bc-b1bf-351d2c2bc8c5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:12.318537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24b319-d3b0-4653-9662-05fef4eed13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:12.319257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24b319-d3b0-4653-9662-05fef4eed13e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:12.319537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24b319-d3b0-4653-9662-05fef4eed13e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:12.319810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24b319-d3b0-4653-9662-05fef4eed13e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:12.320452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24b319-d3b0-4653-9662-05fef4eed13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:12.322073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24b319-d3b0-4653-9662-05fef4eed13e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:12.357025 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3239/6493] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:12.358711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24b319-d3b0-4653-9662-05fef4eed13e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:12.379698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8a24b319-d3b0-4653-9662-05fef4eed13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:12.383327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab12045-50e8-4536-b6c9-737625fe5e0b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:12.392557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd374d-18b4-41ee-8617-ded640bd48ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:12.393448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd374d-18b4-41ee-8617-ded640bd48ca service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:12.393733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd374d-18b4-41ee-8617-ded640bd48ca service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:12.394134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd374d-18b4-41ee-8617-ded640bd48ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:12.414982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd374d-18b4-41ee-8617-ded640bd48ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:12.416440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd374d-18b4-41ee-8617-ded640bd48ca service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:12.439843 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3255/6494] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:12.440728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd374d-18b4-41ee-8617-ded640bd48ca service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:12.460003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd374d-18b4-41ee-8617-ded640bd48ca service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:12.475611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3a2dc-62f7-4af3-8401-2b0f0d58f3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:12.476821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3a2dc-62f7-4af3-8401-2b0f0d58f3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:12.477113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3a2dc-62f7-4af3-8401-2b0f0d58f3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:12.477393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3a2dc-62f7-4af3-8401-2b0f0d58f3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:12.478050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3a2dc-62f7-4af3-8401-2b0f0d58f3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:12.483919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3a2dc-62f7-4af3-8401-2b0f0d58f3c5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:12.485656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:12.509104 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3256/6495] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:12.510040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3a2dc-62f7-4af3-8401-2b0f0d58f3c5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:12.533205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3a2dc-62f7-4af3-8401-2b0f0d58f3c5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:12.545623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48178ff-a961-44fc-ae54-5e5368831cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:12.546304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48178ff-a961-44fc-ae54-5e5368831cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:12.546588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48178ff-a961-44fc-ae54-5e5368831cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:12.546897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48178ff-a961-44fc-ae54-5e5368831cbb admin admin] PATH_INFO: `/v3/projects/7b8beb450e494f0d8dfaeba994d97f0f/users/0ce2c6459c6a48fcb46606214def3ec2/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:12.552237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24b319-d3b0-4653-9662-05fef4eed13e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:12.570611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ed255-09d2-44de-86a5-c224946f548e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:12.571344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ed255-09d2-44de-86a5-c224946f548e service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:12.571632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ed255-09d2-44de-86a5-c224946f548e service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:12.571908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ed255-09d2-44de-86a5-c224946f548e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:12.584939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48178ff-a961-44fc-ae54-5e5368831cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8beb450e494f0d8dfaeba994d97f0f, user_id=0ce2c6459c6a48fcb46606214def3ec2, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:12.587634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48178ff-a961-44fc-ae54-5e5368831cbb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:12.590547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ed255-09d2-44de-86a5-c224946f548e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:12.592610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ed255-09d2-44de-86a5-c224946f548e service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:12.604378 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3240/6496] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:20:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:20:12.605232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ed255-09d2-44de-86a5-c224946f548e service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:12.614565 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3257/6497] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:12 2022] PUT /identity/v3/projects/7b8beb450e494f0d8dfaeba994d97f0f/users/0ce2c6459c6a48fcb46606214def3ec2/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:12.617168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ed255-09d2-44de-86a5-c224946f548e service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:12.625126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145adda-5bc7-4e0c-b940-4d42df0fdb3e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:12.625408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145adda-5bc7-4e0c-b940-4d42df0fdb3e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:12.625689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145adda-5bc7-4e0c-b940-4d42df0fdb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:12.682521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4145adda-5bc7-4e0c-b940-4d42df0fdb3e None None] MFA Rules not processed for user `0ce2c6459c6a48fcb46606214def3ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:12.683927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4145adda-5bc7-4e0c-b940-4d42df0fdb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:12.737585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:12.782036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19d1c3-8855-4a32-b697-df4586904411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:12.782798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19d1c3-8855-4a32-b697-df4586904411 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:12.782962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19d1c3-8855-4a32-b697-df4586904411 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:12.783234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19d1c3-8855-4a32-b697-df4586904411 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:12.784082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19d1c3-8855-4a32-b697-df4586904411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:12.785725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19d1c3-8855-4a32-b697-df4586904411 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:12.814959 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3241/6498] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:12.815959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19d1c3-8855-4a32-b697-df4586904411 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:12.837420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19d1c3-8855-4a32-b697-df4586904411 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:12.859513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2057866-a7d5-4281-b521-336aa2352881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:12.860216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2057866-a7d5-4281-b521-336aa2352881 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:12.863032 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3258/6499] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:12.864304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2057866-a7d5-4281-b521-336aa2352881 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:12.864602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2057866-a7d5-4281-b521-336aa2352881 admin admin] PATH_INFO: `/v3/projects/cdfb4f8a8faf406dadf0738b3cc5c079/users/eccc010283e54ddda291f5e31deb17f8/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:12.875145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145adda-5bc7-4e0c-b940-4d42df0fdb3e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:12.876693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4145adda-5bc7-4e0c-b940-4d42df0fdb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:12.925020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2057866-a7d5-4281-b521-336aa2352881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfb4f8a8faf406dadf0738b3cc5c079, user_id=eccc010283e54ddda291f5e31deb17f8, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:12.936705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2057866-a7d5-4281-b521-336aa2352881 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:12.987758 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3242/6500] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:12 2022] PUT /identity/v3/projects/cdfb4f8a8faf406dadf0738b3cc5c079/users/eccc010283e54ddda291f5e31deb17f8/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:12.988693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10514a48-3f55-4cad-be77-c8421afbded5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:12.988990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10514a48-3f55-4cad-be77-c8421afbded5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:12.989267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10514a48-3f55-4cad-be77-c8421afbded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:13.036481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145adda-5bc7-4e0c-b940-4d42df0fdb3e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:13.089275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-10514a48-3f55-4cad-be77-c8421afbded5 None None] MFA Rules not processed for user `eccc010283e54ddda291f5e31deb17f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:13.090563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-10514a48-3f55-4cad-be77-c8421afbded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:13.227181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70e082-afe5-451b-ab6a-cabbd71260f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:13.227911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70e082-afe5-451b-ab6a-cabbd71260f7 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:13.228205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70e082-afe5-451b-ab6a-cabbd71260f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:13.230309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70e082-afe5-451b-ab6a-cabbd71260f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:13.328552 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3243/6501] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:13.332781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10514a48-3f55-4cad-be77-c8421afbded5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:13.338886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-10514a48-3f55-4cad-be77-c8421afbded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:13.340180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:13.398877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70e082-afe5-451b-ab6a-cabbd71260f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:13.409884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70e082-afe5-451b-ab6a-cabbd71260f7 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:13.426727 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3259/6502] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:20:13.427608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70e082-afe5-451b-ab6a-cabbd71260f7 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:13.532524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10514a48-3f55-4cad-be77-c8421afbded5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:13.546857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:13.547526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:13.547815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:13.548090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78 admin admin] PATH_INFO: `/v3/projects/22c6fc0d76864cb79230ec5c025a2c9f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:13.549734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c6fc0d76864cb79230ec5c025a2c9f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:13.551706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:13.591137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70e082-afe5-451b-ab6a-cabbd71260f7 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:13.616421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a3044-225e-4779-98ae-817c5be4fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:13.620509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a3044-225e-4779-98ae-817c5be4fa84 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:13.620813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a3044-225e-4779-98ae-817c5be4fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:13.623682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a3044-225e-4779-98ae-817c5be4fa84 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:13.627550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a3044-225e-4779-98ae-817c5be4fa84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:13.637037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a3044-225e-4779-98ae-817c5be4fa84 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:13.668921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:13.673290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c6fc0d76864cb79230ec5c025a2c9f', 'request_id': 'req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:13.688347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c6fc0d76864cb79230ec5c025a2c9f', 'request_id': 'req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:13.695895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c6fc0d76864cb79230ec5c025a2c9f', 'request_id': 'req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:13.719849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78 admin admin] The token cache is being invalidate because project 22c6fc0d76864cb79230ec5c025a2c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:13.720311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:13.721153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8af5703b-cc5e-45b2-8eb8-3805aa20ee78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:13.724965 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3244/6503] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:13 2022] DELETE /identity/v3/projects/22c6fc0d76864cb79230ec5c025a2c9f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:13.730214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d4d39-8390-45e2-9374-202c864b5d26 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:13.730558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d4d39-8390-45e2-9374-202c864b5d26 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:13.730896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d4d39-8390-45e2-9374-202c864b5d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:13.749682 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3260/6504] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:13 2022] POST /identity/v3/projects => generated 385 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:13.750963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a3044-225e-4779-98ae-817c5be4fa84 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:13.756332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-825a3044-225e-4779-98ae-817c5be4fa84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:13.779551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-043d4d39-8390-45e2-9374-202c864b5d26 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:13.781614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-043d4d39-8390-45e2-9374-202c864b5d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:13.953456 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3245/6505] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:13.955080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc919cf-d0e4-4d79-a78f-6e56587d1277 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:13.955559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc919cf-d0e4-4d79-a78f-6e56587d1277 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:13.958372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc919cf-d0e4-4d79-a78f-6e56587d1277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:14.010650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2bc919cf-d0e4-4d79-a78f-6e56587d1277 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:14.015640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2bc919cf-d0e4-4d79-a78f-6e56587d1277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:14.038967 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3246/6506] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:14.043548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc919cf-d0e4-4d79-a78f-6e56587d1277 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:14.061604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc919cf-d0e4-4d79-a78f-6e56587d1277 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:14.070693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a3044-225e-4779-98ae-817c5be4fa84 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:14.075805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8eeea-e915-42f6-81e1-ed0b784fd184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:14.077366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8eeea-e915-42f6-81e1-ed0b784fd184 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:14.077857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8eeea-e915-42f6-81e1-ed0b784fd184 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:14.078329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8eeea-e915-42f6-81e1-ed0b784fd184 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:14.079220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8eeea-e915-42f6-81e1-ed0b784fd184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:14.079746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8eeea-e915-42f6-81e1-ed0b784fd184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:14.081627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8eeea-e915-42f6-81e1-ed0b784fd184 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:14.092349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af2a0-1c66-4fc2-88c3-f8ddaf6b10a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:14.094459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af2a0-1c66-4fc2-88c3-f8ddaf6b10a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:14.094781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af2a0-1c66-4fc2-88c3-f8ddaf6b10a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:14.095224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9af2a0-1c66-4fc2-88c3-f8ddaf6b10a0 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:14.098142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9af2a0-1c66-4fc2-88c3-f8ddaf6b10a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:14.103905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9af2a0-1c66-4fc2-88c3-f8ddaf6b10a0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:14.112127 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3247/6507] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:20:14.117479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8eeea-e915-42f6-81e1-ed0b784fd184 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:14.129792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8eeea-e915-42f6-81e1-ed0b784fd184 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:14.155489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97207c7-20ec-4acb-b1ea-2bac2d819d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:14.156506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97207c7-20ec-4acb-b1ea-2bac2d819d67 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:14.156991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97207c7-20ec-4acb-b1ea-2bac2d819d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:14.157465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97207c7-20ec-4acb-b1ea-2bac2d819d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:14.158302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97207c7-20ec-4acb-b1ea-2bac2d819d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:14.160507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97207c7-20ec-4acb-b1ea-2bac2d819d67 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:14.166588 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3261/6508] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:13 2022] POST /identity/v3/users => generated 299 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:14.168175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af2a0-1c66-4fc2-88c3-f8ddaf6b10a0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:14.189539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9af2a0-1c66-4fc2-88c3-f8ddaf6b10a0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:14.200219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041d65c-8621-4200-8597-86889521834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:14.201812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041d65c-8621-4200-8597-86889521834f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:14.202164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041d65c-8621-4200-8597-86889521834f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:14.202464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041d65c-8621-4200-8597-86889521834f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:14.203404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041d65c-8621-4200-8597-86889521834f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:14.213329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041d65c-8621-4200-8597-86889521834f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:14.229637 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3248/6509] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:14 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:14.234296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97207c7-20ec-4acb-b1ea-2bac2d819d67 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:14.250942 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3262/6510] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:14.259072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041d65c-8621-4200-8597-86889521834f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:14.297806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041d65c-8621-4200-8597-86889521834f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:14.372382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97207c7-20ec-4acb-b1ea-2bac2d819d67 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:14.386262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae776-2973-42c2-8871-44731d785e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:14.387137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae776-2973-42c2-8871-44731d785e8d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:14.387466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae776-2973-42c2-8871-44731d785e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:14.387846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae776-2973-42c2-8871-44731d785e8d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:14.389256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae776-2973-42c2-8871-44731d785e8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:14.390198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:14.392100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae776-2973-42c2-8871-44731d785e8d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:14.443848 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3249/6511] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:14 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:14.447460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae776-2973-42c2-8871-44731d785e8d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:14.471178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae776-2973-42c2-8871-44731d785e8d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:14.477678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b85ca6-8c9a-4683-9e59-567fcff72931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:14.478358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b85ca6-8c9a-4683-9e59-567fcff72931 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:14.479257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b85ca6-8c9a-4683-9e59-567fcff72931 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:14.481520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b85ca6-8c9a-4683-9e59-567fcff72931 admin admin] PATH_INFO: `/v3/projects/6c35fe596d39487995b8c8c0ca87ae27/users/5acbe09729844017ae9ae82dea0ba887/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:14.491375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07100ed-83d3-427b-9224-7b55e54f2f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:14.492005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07100ed-83d3-427b-9224-7b55e54f2f40 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:14.492292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07100ed-83d3-427b-9224-7b55e54f2f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:14.492569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07100ed-83d3-427b-9224-7b55e54f2f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:14.493222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07100ed-83d3-427b-9224-7b55e54f2f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:14.496554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07100ed-83d3-427b-9224-7b55e54f2f40 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:14.531057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b85ca6-8c9a-4683-9e59-567fcff72931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c35fe596d39487995b8c8c0ca87ae27, user_id=5acbe09729844017ae9ae82dea0ba887, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:14.533470 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3250/6512] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:14.534413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07100ed-83d3-427b-9224-7b55e54f2f40 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:14.535930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b85ca6-8c9a-4683-9e59-567fcff72931 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:14.585493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07100ed-83d3-427b-9224-7b55e54f2f40 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:14.599178 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3263/6513] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:14 2022] PUT /identity/v3/projects/6c35fe596d39487995b8c8c0ca87ae27/users/5acbe09729844017ae9ae82dea0ba887/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:14.602854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b85ca6-8c9a-4683-9e59-567fcff72931 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:14.647351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:14.844589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b85ca6-8c9a-4683-9e59-567fcff72931 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:14.857568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116737ea-6b68-43ed-9f5f-30ed34ddcbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:14.858385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116737ea-6b68-43ed-9f5f-30ed34ddcbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:14.858677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116737ea-6b68-43ed-9f5f-30ed34ddcbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:14.858981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116737ea-6b68-43ed-9f5f-30ed34ddcbd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:14.859651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116737ea-6b68-43ed-9f5f-30ed34ddcbd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:14.861313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116737ea-6b68-43ed-9f5f-30ed34ddcbd8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:14.895357 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3264/6514] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:14.898286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116737ea-6b68-43ed-9f5f-30ed34ddcbd8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:14.931890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116737ea-6b68-43ed-9f5f-30ed34ddcbd8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:14.935060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b89394-1595-43c5-84c4-fa7644dc9182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:14.936788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b89394-1595-43c5-84c4-fa7644dc9182 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:14.938272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b89394-1595-43c5-84c4-fa7644dc9182 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:14.938272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b89394-1595-43c5-84c4-fa7644dc9182 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:14.938907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b89394-1595-43c5-84c4-fa7644dc9182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:14.940567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b89394-1595-43c5-84c4-fa7644dc9182 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:14.949277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d022c0c-19c5-4540-896e-dc5264e14c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:14.950523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d022c0c-19c5-4540-896e-dc5264e14c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:14.950988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d022c0c-19c5-4540-896e-dc5264e14c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:14.951344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d022c0c-19c5-4540-896e-dc5264e14c94 admin admin] PATH_INFO: `/v3/projects/6c35fe596d39487995b8c8c0ca87ae27/users/5acbe09729844017ae9ae82dea0ba887/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:14.956560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d022c0c-19c5-4540-896e-dc5264e14c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c35fe596d39487995b8c8c0ca87ae27, user_id=5acbe09729844017ae9ae82dea0ba887, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:14.977618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d022c0c-19c5-4540-896e-dc5264e14c94 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:14.990486 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3251/6515] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:14.994413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b89394-1595-43c5-84c4-fa7644dc9182 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:15.025739 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3265/6516] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:14 2022] PUT /identity/v3/projects/6c35fe596d39487995b8c8c0ca87ae27/users/5acbe09729844017ae9ae82dea0ba887/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:15.027467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98781f-eb57-4571-8e27-61059ec94915 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:15.027760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98781f-eb57-4571-8e27-61059ec94915 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:15.028035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98781f-eb57-4571-8e27-61059ec94915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:15.043925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b89394-1595-43c5-84c4-fa7644dc9182 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:15.127216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ae98781f-eb57-4571-8e27-61059ec94915 None None] MFA Rules not processed for user `5acbe09729844017ae9ae82dea0ba887`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:15.131400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ae98781f-eb57-4571-8e27-61059ec94915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:15.301371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6656939-94c7-44a2-b333-bb2a92939c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:15.302822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656939-94c7-44a2-b333-bb2a92939c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:15.304611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656939-94c7-44a2-b333-bb2a92939c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:15.304748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656939-94c7-44a2-b333-bb2a92939c4a admin admin] PATH_INFO: `/v3/projects/4e06e4d243334f2a8d29a1eaae652063/users/9493e5d946744b53aaaa25fc7a91d6cf/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:15.354005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6656939-94c7-44a2-b333-bb2a92939c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e06e4d243334f2a8d29a1eaae652063, user_id=9493e5d946744b53aaaa25fc7a91d6cf, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:15.359159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6656939-94c7-44a2-b333-bb2a92939c4a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:15.399039 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3252/6517] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:14 2022] PUT /identity/v3/projects/4e06e4d243334f2a8d29a1eaae652063/users/9493e5d946744b53aaaa25fc7a91d6cf/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:15.401909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdc050-a1cc-4ba9-9451-0a948a50a559 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:15.402586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdc050-a1cc-4ba9-9451-0a948a50a559 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:15.403085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdc050-a1cc-4ba9-9451-0a948a50a559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:15.448517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-52bdc050-a1cc-4ba9-9451-0a948a50a559 None None] MFA Rules not processed for user `9493e5d946744b53aaaa25fc7a91d6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:15.451964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-52bdc050-a1cc-4ba9-9451-0a948a50a559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:15.472879 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3266/6518] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:20:15.473885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98781f-eb57-4571-8e27-61059ec94915 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:15.524948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98781f-eb57-4571-8e27-61059ec94915 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:15.592928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:15.640678 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3253/6519] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:15.675537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a9f54-5671-48ca-a8be-37433930eb1c tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5acbe09729844017ae9ae82dea0ba887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c35fe596d39487995b8c8c0ca87ae27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:15.676165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a9f54-5671-48ca-a8be-37433930eb1c tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:15.676448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a9f54-5671-48ca-a8be-37433930eb1c tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:15.676721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a9f54-5671-48ca-a8be-37433930eb1c tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:15.677476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a9f54-5671-48ca-a8be-37433930eb1c tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:15.679284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a9f54-5671-48ca-a8be-37433930eb1c tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:15.773587 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3267/6520] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:15 2022] POST /identity/v3/projects => generated 359 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:15.779497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdc050-a1cc-4ba9-9451-0a948a50a559 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:15.805299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a9f54-5671-48ca-a8be-37433930eb1c tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:15.807437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b10a9f54-5671-48ca-a8be-37433930eb1c tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:15.820022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdc050-a1cc-4ba9-9451-0a948a50a559 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:15.874369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:15.993272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a9f54-5671-48ca-a8be-37433930eb1c tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:16.011545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642c529-8588-4aae-ab63-665494e07d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:16.012448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642c529-8588-4aae-ab63-665494e07d12 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:16.012877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642c529-8588-4aae-ab63-665494e07d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:16.024398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642c529-8588-4aae-ab63-665494e07d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:16.130001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642c529-8588-4aae-ab63-665494e07d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:16.135243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1038ee-ea11-4d8b-8270-a6279922e745 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5acbe09729844017ae9ae82dea0ba887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c35fe596d39487995b8c8c0ca87ae27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:16.136325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1038ee-ea11-4d8b-8270-a6279922e745 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:16.137656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642c529-8588-4aae-ab63-665494e07d12 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:16.137803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1038ee-ea11-4d8b-8270-a6279922e745 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:16.138107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1038ee-ea11-4d8b-8270-a6279922e745 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] PATH_INFO: `/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags/tempest-tag-1505657747` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:16.144108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1038ee-ea11-4d8b-8270-a6279922e745 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=49cb8a11f8e44830a47c7917e4fcca51, value=tempest-tag-1505657747)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:16.152804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1038ee-ea11-4d8b-8270-a6279922e745 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:16.157770 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3268/6521] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:20:16.181463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642c529-8588-4aae-ab63-665494e07d12 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:16.306889 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-8a1038ee-ea11-4d8b-8270-a6279922e745 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1505657747. To ensure interoperability, identifiers should be a valid uuid. Aug 28 19:20:16.306889 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 19:20:16.306889 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:20:16.321489 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3254/6522] 10.222.0.70 () {60 vars in 1333 bytes} [Sun Aug 28 19:20:15 2022] PUT /identity/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags/tempest-tag-1505657747 => generated 0 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 291 bytes (2 switches on core 0) Aug 28 19:20:16.324256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1038ee-ea11-4d8b-8270-a6279922e745 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:16.350064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1038ee-ea11-4d8b-8270-a6279922e745 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:16.367488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e2bfd-0fbe-46f0-b02a-6d6c9a05898f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5acbe09729844017ae9ae82dea0ba887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c35fe596d39487995b8c8c0ca87ae27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:16.369550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e2bfd-0fbe-46f0-b02a-6d6c9a05898f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:16.371514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e2bfd-0fbe-46f0-b02a-6d6c9a05898f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:16.373830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e2bfd-0fbe-46f0-b02a-6d6c9a05898f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] PATH_INFO: `/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags/tempest-tag-1505657747` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:16.402534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642c529-8588-4aae-ab63-665494e07d12 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:16.414393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20301734-f442-45ca-bf16-607bab655b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:16.415614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e2bfd-0fbe-46f0-b02a-6d6c9a05898f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=49cb8a11f8e44830a47c7917e4fcca51, value=tempest-tag-1505657747)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:16.416338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20301734-f442-45ca-bf16-607bab655b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:16.418481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20301734-f442-45ca-bf16-607bab655b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:16.419019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20301734-f442-45ca-bf16-607bab655b77 admin admin] PATH_INFO: `/v3/users/9493e5d946744b53aaaa25fc7a91d6cf` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:16.425641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e2bfd-0fbe-46f0-b02a-6d6c9a05898f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:16.427234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20301734-f442-45ca-bf16-607bab655b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9493e5d946744b53aaaa25fc7a91d6cf)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:16.429315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20301734-f442-45ca-bf16-607bab655b77 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:16.465507 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3255/6523] 10.222.0.70 () {58 vars in 1314 bytes} [Sun Aug 28 19:20:16 2022] GET /identity/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags/tempest-tag-1505657747 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:16.467243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e2bfd-0fbe-46f0-b02a-6d6c9a05898f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:16.470381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:16.496783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e2bfd-0fbe-46f0-b02a-6d6c9a05898f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:16.516957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e01c7-6e77-429a-a439-0ff242abc402 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5acbe09729844017ae9ae82dea0ba887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c35fe596d39487995b8c8c0ca87ae27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:16.519820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e01c7-6e77-429a-a439-0ff242abc402 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:16.520242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e01c7-6e77-429a-a439-0ff242abc402 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:16.520721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e01c7-6e77-429a-a439-0ff242abc402 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] PATH_INFO: `/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:16.523717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e01c7-6e77-429a-a439-0ff242abc402 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=49cb8a11f8e44830a47c7917e4fcca51)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:16.535184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e01c7-6e77-429a-a439-0ff242abc402 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:16.636884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-20301734-f442-45ca-bf16-607bab655b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9493e5d946744b53aaaa25fc7a91d6cf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:16.667717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-20301734-f442-45ca-bf16-607bab655b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9493e5d946744b53aaaa25fc7a91d6cf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:16.668589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-20301734-f442-45ca-bf16-607bab655b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9493e5d946744b53aaaa25fc7a91d6cf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:16.693296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-20301734-f442-45ca-bf16-607bab655b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9493e5d946744b53aaaa25fc7a91d6cf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:16.694067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-20301734-f442-45ca-bf16-607bab655b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9493e5d946744b53aaaa25fc7a91d6cf'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:16.723383 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3256/6524] 10.222.0.70 () {60 vars in 1265 bytes} [Sun Aug 28 19:20:16 2022] PUT /identity/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags => generated 139 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:16.727530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e01c7-6e77-429a-a439-0ff242abc402 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:16.732369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ac6e01c7-6e77-429a-a439-0ff242abc402 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:16.762554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e01c7-6e77-429a-a439-0ff242abc402 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:16.765131 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3269/6525] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:16 2022] DELETE /identity/v3/users/9493e5d946744b53aaaa25fc7a91d6cf => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:16.776756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3e00f-522c-4dee-bc79-9aa13f457acc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:16.777049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3e00f-522c-4dee-bc79-9aa13f457acc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:16.782391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3e00f-522c-4dee-bc79-9aa13f457acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:16.839509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a6b3e00f-522c-4dee-bc79-9aa13f457acc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:16.844703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a6b3e00f-522c-4dee-bc79-9aa13f457acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:16.939160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ed2ea-2020-4011-8e41-3e08595e593f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5acbe09729844017ae9ae82dea0ba887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c35fe596d39487995b8c8c0ca87ae27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:16.939790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ed2ea-2020-4011-8e41-3e08595e593f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:16.940078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ed2ea-2020-4011-8e41-3e08595e593f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:16.940358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ed2ea-2020-4011-8e41-3e08595e593f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] PATH_INFO: `/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:17.010882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ed2ea-2020-4011-8e41-3e08595e593f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=49cb8a11f8e44830a47c7917e4fcca51)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:17.013012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ed2ea-2020-4011-8e41-3e08595e593f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:17.024153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:17.061527 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3257/6526] 10.222.0.70 () {58 vars in 1245 bytes} [Sun Aug 28 19:20:16 2022] GET /identity/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags => generated 139 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:17.062088 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3270/6527] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:17.065612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ed2ea-2020-4011-8e41-3e08595e593f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:17.103574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ed2ea-2020-4011-8e41-3e08595e593f tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:17.127222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3e00f-522c-4dee-bc79-9aa13f457acc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:17.127430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddff67-fd6e-4285-93d2-b2284dfbc0e8 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5acbe09729844017ae9ae82dea0ba887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c35fe596d39487995b8c8c0ca87ae27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:17.129010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a6b3e00f-522c-4dee-bc79-9aa13f457acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:17.132490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddff67-fd6e-4285-93d2-b2284dfbc0e8 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:17.134974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddff67-fd6e-4285-93d2-b2284dfbc0e8 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:17.135392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddff67-fd6e-4285-93d2-b2284dfbc0e8 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] PATH_INFO: `/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags/tempest-tag-1204976147` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:17.140455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddff67-fd6e-4285-93d2-b2284dfbc0e8 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=49cb8a11f8e44830a47c7917e4fcca51, value=tempest-tag-1204976147)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:17.151336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddff67-fd6e-4285-93d2-b2284dfbc0e8 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:17.254544 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-41ddff67-fd6e-4285-93d2-b2284dfbc0e8 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1204976147. To ensure interoperability, identifiers should be a valid uuid. Aug 28 19:20:17.254544 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 19:20:17.254544 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:20:17.266328 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3258/6528] 10.222.0.70 () {58 vars in 1317 bytes} [Sun Aug 28 19:20:17 2022] DELETE /identity/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags/tempest-tag-1204976147 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:17.274513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddff67-fd6e-4285-93d2-b2284dfbc0e8 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:17.309244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddff67-fd6e-4285-93d2-b2284dfbc0e8 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:17.332228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7cb33f-58b5-48bf-9c56-2b7d6285b815 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5acbe09729844017ae9ae82dea0ba887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c35fe596d39487995b8c8c0ca87ae27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:17.333430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cb33f-58b5-48bf-9c56-2b7d6285b815 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:17.335430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cb33f-58b5-48bf-9c56-2b7d6285b815 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:17.337102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7cb33f-58b5-48bf-9c56-2b7d6285b815 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] PATH_INFO: `/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags/tempest-tag-1204976147` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:17.367921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3e00f-522c-4dee-bc79-9aa13f457acc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:17.380736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7cb33f-58b5-48bf-9c56-2b7d6285b815 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=49cb8a11f8e44830a47c7917e4fcca51, value=tempest-tag-1204976147)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:17.390615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7cb33f-58b5-48bf-9c56-2b7d6285b815 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:17.393813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863917a-d702-4250-bcdb-7e6dc04dcb02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:17.394621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863917a-d702-4250-bcdb-7e6dc04dcb02 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:17.398298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863917a-d702-4250-bcdb-7e6dc04dcb02 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:17.398827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863917a-d702-4250-bcdb-7e6dc04dcb02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-2f7cb33f-58b5-48bf-9c56-2b7d6285b815 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Could not find project tag: tempest-tag-1204976147.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1204976147. Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Aug 28 19:20:17.436973 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Aug 28 19:20:17.437911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:20:17.437911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:20:17.437911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Aug 28 19:20:17.437911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Aug 28 19:20:17.437911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1204976147. Aug 28 19:20:17.437911 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:20:17.459222 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3259/6529] 10.222.0.70 () {58 vars in 1314 bytes} [Sun Aug 28 19:20:17 2022] GET /identity/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags/tempest-tag-1204976147 => generated 107 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:20:17.460335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7cb33f-58b5-48bf-9c56-2b7d6285b815 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:17.485148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863917a-d702-4250-bcdb-7e6dc04dcb02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:17.490537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863917a-d702-4250-bcdb-7e6dc04dcb02 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:17.495819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7cb33f-58b5-48bf-9c56-2b7d6285b815 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:17.519751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a8b12-79f5-4a7f-a08a-f841ea1e3421 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5acbe09729844017ae9ae82dea0ba887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c35fe596d39487995b8c8c0ca87ae27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:17.520527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a8b12-79f5-4a7f-a08a-f841ea1e3421 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:17.520931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a8b12-79f5-4a7f-a08a-f841ea1e3421 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:17.521326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a8b12-79f5-4a7f-a08a-f841ea1e3421 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] PATH_INFO: `/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:17.524951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a8b12-79f5-4a7f-a08a-f841ea1e3421 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=49cb8a11f8e44830a47c7917e4fcca51)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:17.535566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a8b12-79f5-4a7f-a08a-f841ea1e3421 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:17.579773 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3271/6530] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:20:17.741396 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3260/6531] 10.222.0.70 () {58 vars in 1248 bytes} [Sun Aug 28 19:20:17 2022] DELETE /identity/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:17.745734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863917a-d702-4250-bcdb-7e6dc04dcb02 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:17.765600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863917a-d702-4250-bcdb-7e6dc04dcb02 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:17.811469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012fcb2-25c0-4410-b344-b940539b2717 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5acbe09729844017ae9ae82dea0ba887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c35fe596d39487995b8c8c0ca87ae27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:17.814336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012fcb2-25c0-4410-b344-b940539b2717 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:17.817839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012fcb2-25c0-4410-b344-b940539b2717 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:17.819350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012fcb2-25c0-4410-b344-b940539b2717 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] PATH_INFO: `/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:17.870263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012fcb2-25c0-4410-b344-b940539b2717 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=49cb8a11f8e44830a47c7917e4fcca51)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:17.878725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012fcb2-25c0-4410-b344-b940539b2717 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:17.934300 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3272/6532] 10.222.0.70 () {58 vars in 1245 bytes} [Sun Aug 28 19:20:17 2022] GET /identity/v3/projects/49cb8a11f8e44830a47c7917e4fcca51/tags => generated 66 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 28 19:20:17.938158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a8b12-79f5-4a7f-a08a-f841ea1e3421 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:17.965385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a8b12-79f5-4a7f-a08a-f841ea1e3421 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:17.977369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5acbe09729844017ae9ae82dea0ba887', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c35fe596d39487995b8c8c0ca87ae27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:17.978065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:17.978358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:17.978644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] PATH_INFO: `/v3/projects/49cb8a11f8e44830a47c7917e4fcca51` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:17.985198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorizing `identity:delete_project(project_id=49cb8a11f8e44830a47c7917e4fcca51)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:17.987394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:18.156040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49cb8a11f8e44830a47c7917e4fcca51', 'request_id': 'req-69c963e0-71a0-4206-b3df-e8f9111c65f4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.193268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49cb8a11f8e44830a47c7917e4fcca51', 'request_id': 'req-69c963e0-71a0-4206-b3df-e8f9111c65f4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.203887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49cb8a11f8e44830a47c7917e4fcca51', 'request_id': 'req-69c963e0-71a0-4206-b3df-e8f9111c65f4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.279959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] The token cache is being invalidate because project 49cb8a11f8e44830a47c7917e4fcca51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:18.280491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.285239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.292765 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3261/6533] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:17 2022] DELETE /identity/v3/projects/49cb8a11f8e44830a47c7917e4fcca51 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:18.301607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012fcb2-25c0-4410-b344-b940539b2717 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:18.306188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9012fcb2-25c0-4410-b344-b940539b2717 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:18.368219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012fcb2-25c0-4410-b344-b940539b2717 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:18.380793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:18.416617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:18.419287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:18.583865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:18.599365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caae061-fe21-41af-8fe2-9f72fb582467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:18.604979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caae061-fe21-41af-8fe2-9f72fb582467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:18.605157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caae061-fe21-41af-8fe2-9f72fb582467 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:18.605453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caae061-fe21-41af-8fe2-9f72fb582467 admin admin] PATH_INFO: `/v3/users/eccc010283e54ddda291f5e31deb17f8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:18.608524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caae061-fe21-41af-8fe2-9f72fb582467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eccc010283e54ddda291f5e31deb17f8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:18.613202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caae061-fe21-41af-8fe2-9f72fb582467 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:18.675980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c963e0-71a0-4206-b3df-e8f9111c65f4 tempest-IdentityV3ProjectTagsTest-823500830 tempest-IdentityV3ProjectTagsTest-823500830-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:18.699930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:18.700675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:18.701183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:18.701589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05 admin admin] PATH_INFO: `/v3/projects/4e06e4d243334f2a8d29a1eaae652063` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:18.706780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e06e4d243334f2a8d29a1eaae652063)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:18.708789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:18.780618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9caae061-fe21-41af-8fe2-9f72fb582467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eccc010283e54ddda291f5e31deb17f8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.792473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9caae061-fe21-41af-8fe2-9f72fb582467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eccc010283e54ddda291f5e31deb17f8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.793240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9caae061-fe21-41af-8fe2-9f72fb582467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eccc010283e54ddda291f5e31deb17f8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.824891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9caae061-fe21-41af-8fe2-9f72fb582467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eccc010283e54ddda291f5e31deb17f8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.825496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9caae061-fe21-41af-8fe2-9f72fb582467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eccc010283e54ddda291f5e31deb17f8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.836615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e06e4d243334f2a8d29a1eaae652063', 'request_id': 'req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.860655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e06e4d243334f2a8d29a1eaae652063', 'request_id': 'req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.885425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e06e4d243334f2a8d29a1eaae652063', 'request_id': 'req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.890676 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3273/6534] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:18 2022] DELETE /identity/v3/users/eccc010283e54ddda291f5e31deb17f8 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:18.893956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d19e-d520-4b8c-ae9f-afc5ab8ac890 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:18.894945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d19e-d520-4b8c-ae9f-afc5ab8ac890 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:18.895332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d19e-d520-4b8c-ae9f-afc5ab8ac890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:18.922455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05 admin admin] The token cache is being invalidate because project 4e06e4d243334f2a8d29a1eaae652063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:18.922671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.923573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-11bae5d5-a5ef-4d01-ab25-a207c0b91e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:18.927179 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3262/6535] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:18 2022] DELETE /identity/v3/projects/4e06e4d243334f2a8d29a1eaae652063 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:18.933462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83875098-a7be-474a-952a-14cac861d35f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:18.933761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83875098-a7be-474a-952a-14cac861d35f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:18.934045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83875098-a7be-474a-952a-14cac861d35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:18.985186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a860d19e-d520-4b8c-ae9f-afc5ab8ac890 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:18.986585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a860d19e-d520-4b8c-ae9f-afc5ab8ac890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:18.991282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-83875098-a7be-474a-952a-14cac861d35f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:18.992506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-83875098-a7be-474a-952a-14cac861d35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:19.131445 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3263/6536] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:19.139947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0756c-e3c4-4568-8f6c-882fec6f1c9d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:19.140554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0756c-e3c4-4568-8f6c-882fec6f1c9d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:19.141151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0756c-e3c4-4568-8f6c-882fec6f1c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:19.167640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1dd0756c-e3c4-4568-8f6c-882fec6f1c9d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:19.177428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1dd0756c-e3c4-4568-8f6c-882fec6f1c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:19.181221 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3274/6537] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:19.203237 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3264/6538] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:19.204037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860d19e-d520-4b8c-ae9f-afc5ab8ac890 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:19.205893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a860d19e-d520-4b8c-ae9f-afc5ab8ac890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:19.207197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0756c-e3c4-4568-8f6c-882fec6f1c9d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:19.224492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0756c-e3c4-4568-8f6c-882fec6f1c9d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:19.250500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66f1f9-c59a-4963-a4ae-ec51c82fd7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:19.257728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66f1f9-c59a-4963-a4ae-ec51c82fd7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:19.258263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66f1f9-c59a-4963-a4ae-ec51c82fd7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:19.258811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66f1f9-c59a-4963-a4ae-ec51c82fd7d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:19.260050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66f1f9-c59a-4963-a4ae-ec51c82fd7d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:19.260536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66f1f9-c59a-4963-a4ae-ec51c82fd7d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:19.262539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66f1f9-c59a-4963-a4ae-ec51c82fd7d2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:19.288156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:19.318157 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3265/6539] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:19.322531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66f1f9-c59a-4963-a4ae-ec51c82fd7d2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:19.348660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66f1f9-c59a-4963-a4ae-ec51c82fd7d2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:19.358977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf31b3b-bf99-4f0b-99b3-283465183bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:19.359650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf31b3b-bf99-4f0b-99b3-283465183bfb admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:19.359940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf31b3b-bf99-4f0b-99b3-283465183bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:19.360223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf31b3b-bf99-4f0b-99b3-283465183bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:19.360894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf31b3b-bf99-4f0b-99b3-283465183bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:19.362871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf31b3b-bf99-4f0b-99b3-283465183bfb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:19.434230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860d19e-d520-4b8c-ae9f-afc5ab8ac890 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:19.434850 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3266/6540] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:19 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:19.441772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf31b3b-bf99-4f0b-99b3-283465183bfb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:19.510987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:19.535257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a723d-77a7-477c-8e95-0f78979959b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:19.536059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a723d-77a7-477c-8e95-0f78979959b3 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:19.536450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a723d-77a7-477c-8e95-0f78979959b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:19.536830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a723d-77a7-477c-8e95-0f78979959b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:19.586010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf31b3b-bf99-4f0b-99b3-283465183bfb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:19.597138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75876f9e-9feb-440d-ae11-0ca740f830a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:19.597939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75876f9e-9feb-440d-ae11-0ca740f830a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:19.598335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75876f9e-9feb-440d-ae11-0ca740f830a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:19.599083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75876f9e-9feb-440d-ae11-0ca740f830a9 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:19.601785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75876f9e-9feb-440d-ae11-0ca740f830a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:19.603968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75876f9e-9feb-440d-ae11-0ca740f830a9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:19.669784 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3267/6541] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:19 2022] POST /identity/v3/users => generated 302 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:19.671092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75876f9e-9feb-440d-ae11-0ca740f830a9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:19.671215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a723d-77a7-477c-8e95-0f78979959b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:19.672819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a723d-77a7-477c-8e95-0f78979959b3 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:19.685492 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3275/6542] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:19.693431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75876f9e-9feb-440d-ae11-0ca740f830a9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:19.701779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e8f2a-73da-419e-885e-1cb411fd19af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:19.702546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e8f2a-73da-419e-885e-1cb411fd19af admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:19.702993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e8f2a-73da-419e-885e-1cb411fd19af admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:19.704130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e8f2a-73da-419e-885e-1cb411fd19af admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:19.704933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e8f2a-73da-419e-885e-1cb411fd19af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:19.706970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e8f2a-73da-419e-885e-1cb411fd19af admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:19.723303 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3268/6543] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:19.727851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a723d-77a7-477c-8e95-0f78979959b3 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:19.744265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a723d-77a7-477c-8e95-0f78979959b3 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:19.753966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8fa410-aed6-43ab-bfdd-da7d53058f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:19.753966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa410-aed6-43ab-bfdd-da7d53058f46 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:19.754483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa410-aed6-43ab-bfdd-da7d53058f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:19.754916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8fa410-aed6-43ab-bfdd-da7d53058f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:19.755686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8fa410-aed6-43ab-bfdd-da7d53058f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:19.758208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8fa410-aed6-43ab-bfdd-da7d53058f46 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:19.772631 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3276/6544] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:19.776813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e8f2a-73da-419e-885e-1cb411fd19af admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:19.794588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e8f2a-73da-419e-885e-1cb411fd19af admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:19.801861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6040a9-b2f1-4864-b158-faf4784b8381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:19.802690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6040a9-b2f1-4864-b158-faf4784b8381 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:19.803133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6040a9-b2f1-4864-b158-faf4784b8381 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:19.803863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6040a9-b2f1-4864-b158-faf4784b8381 admin admin] PATH_INFO: `/v3/projects/a561c7213c4d457cb224677fec4de60b/users/35e64f76f6704c719c723a504d513d2a/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:19.827572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6040a9-b2f1-4864-b158-faf4784b8381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a561c7213c4d457cb224677fec4de60b, user_id=35e64f76f6704c719c723a504d513d2a, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:19.831243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6040a9-b2f1-4864-b158-faf4784b8381 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:19.855022 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3269/6545] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:19 2022] PUT /identity/v3/projects/a561c7213c4d457cb224677fec4de60b/users/35e64f76f6704c719c723a504d513d2a/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:19.862341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e6d2d-d27e-4eba-8f08-5e43a585dfe4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:19.863135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e6d2d-d27e-4eba-8f08-5e43a585dfe4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:19.863624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e6d2d-d27e-4eba-8f08-5e43a585dfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:19.898819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8b9e6d2d-d27e-4eba-8f08-5e43a585dfe4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:19.901211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8b9e6d2d-d27e-4eba-8f08-5e43a585dfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:20.001831 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3277/6546] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:20.026507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6040a9-b2f1-4864-b158-faf4784b8381 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:20.202831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6040a9-b2f1-4864-b158-faf4784b8381 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:20.222069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08cb27-d572-4fcd-9781-f9f1e4533999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:20.223087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08cb27-d572-4fcd-9781-f9f1e4533999 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:20.223469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08cb27-d572-4fcd-9781-f9f1e4533999 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:20.223843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08cb27-d572-4fcd-9781-f9f1e4533999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:20.252062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08cb27-d572-4fcd-9781-f9f1e4533999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:20.254284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08cb27-d572-4fcd-9781-f9f1e4533999 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:20.270246 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3270/6547] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:21.094903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e6d2d-d27e-4eba-8f08-5e43a585dfe4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:21.096559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8b9e6d2d-d27e-4eba-8f08-5e43a585dfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:21.107701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:21.118258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e6d2d-d27e-4eba-8f08-5e43a585dfe4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:21.135741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:21.136508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:21.137002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:21.137336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] PATH_INFO: `/v3/projects/cdfb4f8a8faf406dadf0738b3cc5c079` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:21.138786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfb4f8a8faf406dadf0738b3cc5c079)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:21.141193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:21.412393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfb4f8a8faf406dadf0738b3cc5c079', 'request_id': 'req-b8602c8d-bbf7-452f-a105-12fe4d41730f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.430950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfb4f8a8faf406dadf0738b3cc5c079', 'request_id': 'req-b8602c8d-bbf7-452f-a105-12fe4d41730f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.448125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfb4f8a8faf406dadf0738b3cc5c079', 'request_id': 'req-b8602c8d-bbf7-452f-a105-12fe4d41730f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.478059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] The token cache is being invalidate because project cdfb4f8a8faf406dadf0738b3cc5c079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:21.478566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.479820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.482285 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3278/6548] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:21 2022] DELETE /identity/v3/projects/cdfb4f8a8faf406dadf0738b3cc5c079 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:21.486352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08cb27-d572-4fcd-9781-f9f1e4533999 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:21.502132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08cb27-d572-4fcd-9781-f9f1e4533999 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:21.687551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:21.688958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:21.689430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:21.689862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] PATH_INFO: `/v3/users/5acbe09729844017ae9ae82dea0ba887` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:21.691392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5acbe09729844017ae9ae82dea0ba887)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:21.695507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:21.788521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:21.791152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:21.793024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:21.825298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8602c8d-bbf7-452f-a105-12fe4d41730f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:21.840587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5acbe09729844017ae9ae82dea0ba887'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.842756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:21.843453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:21.844393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:21.845532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] PATH_INFO: `/v3/users/ee83dfdb456f4acc9fa1c5e7c8ef00ff` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:21.846885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee83dfdb456f4acc9fa1c5e7c8ef00ff)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:21.849968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:21.850897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5acbe09729844017ae9ae82dea0ba887'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.851739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5acbe09729844017ae9ae82dea0ba887'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.872039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5acbe09729844017ae9ae82dea0ba887'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.874124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5acbe09729844017ae9ae82dea0ba887'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.916721 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3271/6549] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:21 2022] DELETE /identity/v3/users/5acbe09729844017ae9ae82dea0ba887 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:21.961265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee83dfdb456f4acc9fa1c5e7c8ef00ff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.972736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee83dfdb456f4acc9fa1c5e7c8ef00ff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.975143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee83dfdb456f4acc9fa1c5e7c8ef00ff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.994817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee83dfdb456f4acc9fa1c5e7c8ef00ff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:21.996930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee83dfdb456f4acc9fa1c5e7c8ef00ff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:22.067679 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3279/6550] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:21 2022] DELETE /identity/v3/users/ee83dfdb456f4acc9fa1c5e7c8ef00ff => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:23.003033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:23.004522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:23.230119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd83446-9949-4080-9035-b8f287e1e37d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:23.411592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:23.413588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:23.433532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:23.434941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:23.435790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:23.437525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940 admin admin] PATH_INFO: `/v3/projects/63a3d460cbfa44b384fe763575142602` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:23.439435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a3d460cbfa44b384fe763575142602)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:23.443851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:23.459925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81959a-e953-46df-944c-ae96d9786a12 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:23.477235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124acb3-ff5c-41ec-9689-32d9e5209980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:23.478456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124acb3-ff5c-41ec-9689-32d9e5209980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:23.479656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124acb3-ff5c-41ec-9689-32d9e5209980 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:23.481159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124acb3-ff5c-41ec-9689-32d9e5209980 admin admin] PATH_INFO: `/v3/projects/6c35fe596d39487995b8c8c0ca87ae27` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:23.490246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124acb3-ff5c-41ec-9689-32d9e5209980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c35fe596d39487995b8c8c0ca87ae27)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:23.493914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124acb3-ff5c-41ec-9689-32d9e5209980 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:23.612844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a3d460cbfa44b384fe763575142602', 'request_id': 'req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:23.630468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:23.636671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2124acb3-ff5c-41ec-9689-32d9e5209980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c35fe596d39487995b8c8c0ca87ae27', 'request_id': 'req-2124acb3-ff5c-41ec-9689-32d9e5209980'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:23.641432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a3d460cbfa44b384fe763575142602', 'request_id': 'req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:23.650349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a3d460cbfa44b384fe763575142602', 'request_id': 'req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:23.657228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=76,keystone:DELETE=22,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:23.663640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2124acb3-ff5c-41ec-9689-32d9e5209980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c35fe596d39487995b8c8c0ca87ae27', 'request_id': 'req-2124acb3-ff5c-41ec-9689-32d9e5209980'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:23.676471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940 admin admin] The token cache is being invalidate because project 63a3d460cbfa44b384fe763575142602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:23.679977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:23.682463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2124acb3-ff5c-41ec-9689-32d9e5209980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c35fe596d39487995b8c8c0ca87ae27', 'request_id': 'req-2124acb3-ff5c-41ec-9689-32d9e5209980'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:23.685975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d7b7baa6-04e3-4e6e-9b46-a4ceafb22940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:23.691685 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3272/6551] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:23 2022] DELETE /identity/v3/projects/63a3d460cbfa44b384fe763575142602 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:23.694894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f65b-b01f-4608-baf5-ac105ea3c4f8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:23.697026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f65b-b01f-4608-baf5-ac105ea3c4f8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:23.697387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f65b-b01f-4608-baf5-ac105ea3c4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:23.712825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2124acb3-ff5c-41ec-9689-32d9e5209980 admin admin] The token cache is being invalidate because project 6c35fe596d39487995b8c8c0ca87ae27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:23.713131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2124acb3-ff5c-41ec-9689-32d9e5209980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:23.714130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2124acb3-ff5c-41ec-9689-32d9e5209980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:23.720539 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3280/6552] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:23 2022] DELETE /identity/v3/projects/6c35fe596d39487995b8c8c0ca87ae27 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:23.722463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192a2a-3590-4201-8f1c-c03d805147be None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:23.723091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192a2a-3590-4201-8f1c-c03d805147be None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:23.723607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192a2a-3590-4201-8f1c-c03d805147be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:23.759002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f6c0f65b-b01f-4608-baf5-ac105ea3c4f8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:23.760662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f6c0f65b-b01f-4608-baf5-ac105ea3c4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:23.782285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-22192a2a-3590-4201-8f1c-c03d805147be None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:23.787821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-22192a2a-3590-4201-8f1c-c03d805147be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:23.933910 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3273/6553] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:20:23.950367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88fe4f-79cc-4dad-b76c-a7ee7a373868 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:23.951569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88fe4f-79cc-4dad-b76c-a7ee7a373868 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:23.952137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88fe4f-79cc-4dad-b76c-a7ee7a373868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:23.996067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8b88fe4f-79cc-4dad-b76c-a7ee7a373868 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:23.999284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8b88fe4f-79cc-4dad-b76c-a7ee7a373868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:24.024095 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3281/6554] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:20:24.024477 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3274/6555] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:24.034107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22192a2a-3590-4201-8f1c-c03d805147be None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:24.036838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edce28a-88fa-4ec4-85b5-43b4b8bf4da2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:24.037127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edce28a-88fa-4ec4-85b5-43b4b8bf4da2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:24.039265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edce28a-88fa-4ec4-85b5-43b4b8bf4da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:24.074025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22192a2a-3590-4201-8f1c-c03d805147be None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:24.092279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae3085-f09f-41e8-8657-18f2538fefe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:24.095931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae3085-f09f-41e8-8657-18f2538fefe5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:24.097654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae3085-f09f-41e8-8657-18f2538fefe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:24.098302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae3085-f09f-41e8-8657-18f2538fefe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:24.102135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae3085-f09f-41e8-8657-18f2538fefe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:24.108484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae3085-f09f-41e8-8657-18f2538fefe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:24.113809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae3085-f09f-41e8-8657-18f2538fefe5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:24.117071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9edce28a-88fa-4ec4-85b5-43b4b8bf4da2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:24.118348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9edce28a-88fa-4ec4-85b5-43b4b8bf4da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:24.142631 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3282/6556] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:24.147111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae3085-f09f-41e8-8657-18f2538fefe5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:24.152233 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3275/6557] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:24.159112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edce28a-88fa-4ec4-85b5-43b4b8bf4da2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:24.178869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae3085-f09f-41e8-8657-18f2538fefe5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:24.183294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edce28a-88fa-4ec4-85b5-43b4b8bf4da2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:24.191840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55288-a4e8-4d3a-b7ca-870237114917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:24.194413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834de733-72d0-4929-8a1a-2e302479ffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:24.194561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55288-a4e8-4d3a-b7ca-870237114917 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:24.194776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55288-a4e8-4d3a-b7ca-870237114917 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:24.195066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff55288-a4e8-4d3a-b7ca-870237114917 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:24.195439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834de733-72d0-4929-8a1a-2e302479ffe2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:24.195951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834de733-72d0-4929-8a1a-2e302479ffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:24.196844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834de733-72d0-4929-8a1a-2e302479ffe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:24.198375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834de733-72d0-4929-8a1a-2e302479ffe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:24.198860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834de733-72d0-4929-8a1a-2e302479ffe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:24.201206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff55288-a4e8-4d3a-b7ca-870237114917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:24.201843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834de733-72d0-4929-8a1a-2e302479ffe2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:24.208081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff55288-a4e8-4d3a-b7ca-870237114917 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:24.229702 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3276/6558] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:24.231342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898e4ec-c380-451e-95ae-600a7b10fade None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:24.231743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898e4ec-c380-451e-95ae-600a7b10fade None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:24.232212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898e4ec-c380-451e-95ae-600a7b10fade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:24.301540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c898e4ec-c380-451e-95ae-600a7b10fade None None] MFA Rules not processed for user `35e64f76f6704c719c723a504d513d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:24.303122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c898e4ec-c380-451e-95ae-600a7b10fade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:24.364110 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3283/6559] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:24 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:20:24.365831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55288-a4e8-4d3a-b7ca-870237114917 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:24.550209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff55288-a4e8-4d3a-b7ca-870237114917 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:24.562203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebde381-03a2-40d8-bcf9-bbe3d93043eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:24.563394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebde381-03a2-40d8-bcf9-bbe3d93043eb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:24.563678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebde381-03a2-40d8-bcf9-bbe3d93043eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:24.563957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebde381-03a2-40d8-bcf9-bbe3d93043eb admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:24.564609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebde381-03a2-40d8-bcf9-bbe3d93043eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:24.570534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebde381-03a2-40d8-bcf9-bbe3d93043eb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:24.572656 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3277/6560] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:24.573524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898e4ec-c380-451e-95ae-600a7b10fade None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:24.603929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898e4ec-c380-451e-95ae-600a7b10fade None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:24.617158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a681f5-6bc4-46e1-aca5-a6ec586a1194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:24.617810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a681f5-6bc4-46e1-aca5-a6ec586a1194 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:24.618119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a681f5-6bc4-46e1-aca5-a6ec586a1194 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:24.618397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a681f5-6bc4-46e1-aca5-a6ec586a1194 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:24.619104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a681f5-6bc4-46e1-aca5-a6ec586a1194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:24.625784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a681f5-6bc4-46e1-aca5-a6ec586a1194 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:24.675276 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3278/6561] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:24 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:24.676138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a681f5-6bc4-46e1-aca5-a6ec586a1194 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:24.682123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-97a681f5-6bc4-46e1-aca5-a6ec586a1194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:24.701732 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3284/6562] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:24 2022] POST /identity/v3/projects => generated 365 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:24.703024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebde381-03a2-40d8-bcf9-bbe3d93043eb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:24.728679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a681f5-6bc4-46e1-aca5-a6ec586a1194 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:24.830293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:24.838915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:24.916138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebde381-03a2-40d8-bcf9-bbe3d93043eb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:24.932717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03b50c-82da-4ad9-8dba-50485a7fc054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:24.932947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41555cc7-b373-40b4-a9fb-4cb7f0c0abe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:24.933362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b50c-82da-4ad9-8dba-50485a7fc054 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:24.933649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b50c-82da-4ad9-8dba-50485a7fc054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:24.933758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555cc7-b373-40b4-a9fb-4cb7f0c0abe0 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:24.933933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b50c-82da-4ad9-8dba-50485a7fc054 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:24.934049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555cc7-b373-40b4-a9fb-4cb7f0c0abe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:24.934296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41555cc7-b373-40b4-a9fb-4cb7f0c0abe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:24.934579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03b50c-82da-4ad9-8dba-50485a7fc054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:24.935581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41555cc7-b373-40b4-a9fb-4cb7f0c0abe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:24.937721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03b50c-82da-4ad9-8dba-50485a7fc054 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:24.944481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41555cc7-b373-40b4-a9fb-4cb7f0c0abe0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:24.966187 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3285/6563] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:24.976711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41555cc7-b373-40b4-a9fb-4cb7f0c0abe0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:25.017791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41555cc7-b373-40b4-a9fb-4cb7f0c0abe0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:25.039498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10344c-da94-460e-9903-23ea2c5dbef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:25.040129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10344c-da94-460e-9903-23ea2c5dbef3 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:25.040415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10344c-da94-460e-9903-23ea2c5dbef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:25.040694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10344c-da94-460e-9903-23ea2c5dbef3 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:25.041343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10344c-da94-460e-9903-23ea2c5dbef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:25.054764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10344c-da94-460e-9903-23ea2c5dbef3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:25.062542 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3279/6564] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:24 2022] POST /identity/v3/projects => generated 405 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:25.064269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03b50c-82da-4ad9-8dba-50485a7fc054 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:25.143469 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3286/6565] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:24 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:25.144317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10344c-da94-460e-9903-23ea2c5dbef3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:25.167981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10344c-da94-460e-9903-23ea2c5dbef3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:25.238017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03b50c-82da-4ad9-8dba-50485a7fc054 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:25.253584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265668ce-b984-4960-bf9f-339cdc9da42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:25.254632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265668ce-b984-4960-bf9f-339cdc9da42e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:25.255242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265668ce-b984-4960-bf9f-339cdc9da42e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:25.255750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265668ce-b984-4960-bf9f-339cdc9da42e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:25.256636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265668ce-b984-4960-bf9f-339cdc9da42e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:25.258529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265668ce-b984-4960-bf9f-339cdc9da42e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:25.270700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3c6e2-5617-43b9-8ace-6d5376edf805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:25.271771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3c6e2-5617-43b9-8ace-6d5376edf805 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:25.272066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3c6e2-5617-43b9-8ace-6d5376edf805 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:25.273081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3c6e2-5617-43b9-8ace-6d5376edf805 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:25.273760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3c6e2-5617-43b9-8ace-6d5376edf805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:25.276605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3c6e2-5617-43b9-8ace-6d5376edf805 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:25.286667 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3280/6566] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:25.287963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265668ce-b984-4960-bf9f-339cdc9da42e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:25.314034 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3287/6567] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:25 2022] POST /identity/v3/users => generated 309 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:25.314638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3c6e2-5617-43b9-8ace-6d5376edf805 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:25.315620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265668ce-b984-4960-bf9f-339cdc9da42e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:25.332967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3c6e2-5617-43b9-8ace-6d5376edf805 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:25.333287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b29ec-084a-4b3c-8a9a-38585679a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:25.333949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b29ec-084a-4b3c-8a9a-38585679a459 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:25.334242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b29ec-084a-4b3c-8a9a-38585679a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:25.334528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b29ec-084a-4b3c-8a9a-38585679a459 admin admin] PATH_INFO: `/v3/projects/67287edba1d54d0b902b7f6776e647b3/users/d0bd3c83dff64f27bd048defad379622/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:25.349219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c604-bcc6-432e-91a8-ad6d3c34fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:25.350249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c604-bcc6-432e-91a8-ad6d3c34fc25 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:25.350813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c604-bcc6-432e-91a8-ad6d3c34fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:25.351328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898c604-bcc6-432e-91a8-ad6d3c34fc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:25.352205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898c604-bcc6-432e-91a8-ad6d3c34fc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:25.353796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b29ec-084a-4b3c-8a9a-38585679a459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67287edba1d54d0b902b7f6776e647b3, user_id=d0bd3c83dff64f27bd048defad379622, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:25.354356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898c604-bcc6-432e-91a8-ad6d3c34fc25 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:25.358171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b29ec-084a-4b3c-8a9a-38585679a459 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:25.384496 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3281/6568] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:25.385731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c604-bcc6-432e-91a8-ad6d3c34fc25 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:25.405690 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3288/6569] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:25 2022] PUT /identity/v3/projects/67287edba1d54d0b902b7f6776e647b3/users/d0bd3c83dff64f27bd048defad379622/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:25.406394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b29ec-084a-4b3c-8a9a-38585679a459 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:25.407370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898c604-bcc6-432e-91a8-ad6d3c34fc25 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:25.507182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b29ec-084a-4b3c-8a9a-38585679a459 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:25.513715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe9c37-1334-46ac-b40e-624746ac845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:25.514358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe9c37-1334-46ac-b40e-624746ac845d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:25.514701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe9c37-1334-46ac-b40e-624746ac845d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:25.515700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe9c37-1334-46ac-b40e-624746ac845d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:25.516381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe9c37-1334-46ac-b40e-624746ac845d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:25.519548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe9c37-1334-46ac-b40e-624746ac845d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:25.534454 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3289/6570] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:25.536009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563adc3-96d6-4abb-99bd-3d884228b4f5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:25.536304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563adc3-96d6-4abb-99bd-3d884228b4f5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:25.536584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563adc3-96d6-4abb-99bd-3d884228b4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:25.546017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca4551-a065-497c-9833-1d99f8832d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:25.548166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca4551-a065-497c-9833-1d99f8832d46 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:25.548730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca4551-a065-497c-9833-1d99f8832d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:25.549238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca4551-a065-497c-9833-1d99f8832d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:25.552151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca4551-a065-497c-9833-1d99f8832d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:25.554848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca4551-a065-497c-9833-1d99f8832d46 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:25.559585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d563adc3-96d6-4abb-99bd-3d884228b4f5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:25.561395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d563adc3-96d6-4abb-99bd-3d884228b4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:25.572959 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3290/6571] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:25.573883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563adc3-96d6-4abb-99bd-3d884228b4f5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:25.597743 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3282/6572] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:25.601035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563adc3-96d6-4abb-99bd-3d884228b4f5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:25.602164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca4551-a065-497c-9833-1d99f8832d46 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:25.615870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137ed25-68bf-461a-b075-12271fd9d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:25.616582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137ed25-68bf-461a-b075-12271fd9d7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:25.616876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137ed25-68bf-461a-b075-12271fd9d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:25.617159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137ed25-68bf-461a-b075-12271fd9d7a1 admin admin] PATH_INFO: `/v3/projects/d0836995987d45e6b344ac1fa47e8014/users/270097abd24e45bd8a3f58c898b9fa60/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:25.625185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:25.627175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca4551-a065-497c-9833-1d99f8832d46 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:25.641748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cdf06-d673-49a4-a845-78e5038eef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:25.643672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cdf06-d673-49a4-a845-78e5038eef27 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:25.644888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cdf06-d673-49a4-a845-78e5038eef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:25.647267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cdf06-d673-49a4-a845-78e5038eef27 admin admin] PATH_INFO: `/v3/projects/840fb91cda9c4bf59950beac9224c9c9/users/37a3807e0a9b47e9b3306b4d955674b4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:25.665389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137ed25-68bf-461a-b075-12271fd9d7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0836995987d45e6b344ac1fa47e8014, user_id=270097abd24e45bd8a3f58c898b9fa60, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:25.668219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137ed25-68bf-461a-b075-12271fd9d7a1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:25.703095 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3291/6573] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:25 2022] PUT /identity/v3/projects/d0836995987d45e6b344ac1fa47e8014/users/270097abd24e45bd8a3f58c898b9fa60/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:25.704271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137ed25-68bf-461a-b075-12271fd9d7a1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:25.708642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4137ed25-68bf-461a-b075-12271fd9d7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:25.708803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cdf06-d673-49a4-a845-78e5038eef27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=840fb91cda9c4bf59950beac9224c9c9, user_id=37a3807e0a9b47e9b3306b4d955674b4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:25.722139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cdf06-d673-49a4-a845-78e5038eef27 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:25.763798 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3283/6574] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:25 2022] PUT /identity/v3/projects/840fb91cda9c4bf59950beac9224c9c9/users/37a3807e0a9b47e9b3306b4d955674b4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:25.769761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17a285-82bc-4cf8-9f66-ed8911c48804 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:25.770073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17a285-82bc-4cf8-9f66-ed8911c48804 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:25.771935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17a285-82bc-4cf8-9f66-ed8911c48804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:25.828832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137ed25-68bf-461a-b075-12271fd9d7a1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:25.833631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:25.848790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-eb17a285-82bc-4cf8-9f66-ed8911c48804 None None] MFA Rules not processed for user `270097abd24e45bd8a3f58c898b9fa60`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:25.850811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eb17a285-82bc-4cf8-9f66-ed8911c48804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:25.962416 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3284/6575] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:25.963425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17a285-82bc-4cf8-9f66-ed8911c48804 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:26.010415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0c67a-e5dd-4e73-9894-056c2f508991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:26.011393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0c67a-e5dd-4e73-9894-056c2f508991 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:26.011783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0c67a-e5dd-4e73-9894-056c2f508991 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:26.012154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0c67a-e5dd-4e73-9894-056c2f508991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:26.110118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17a285-82bc-4cf8-9f66-ed8911c48804 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:26.139743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b992b83-fea4-4021-b9a4-ebe2c26a5b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:26.144538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b992b83-fea4-4021-b9a4-ebe2c26a5b8f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:26.144848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b992b83-fea4-4021-b9a4-ebe2c26a5b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:26.145330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b992b83-fea4-4021-b9a4-ebe2c26a5b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:26.146009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b992b83-fea4-4021-b9a4-ebe2c26a5b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:26.149171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b992b83-fea4-4021-b9a4-ebe2c26a5b8f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:26.175646 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3285/6576] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:26.177023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b992b83-fea4-4021-b9a4-ebe2c26a5b8f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:26.179968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0c67a-e5dd-4e73-9894-056c2f508991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:26.181431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0c67a-e5dd-4e73-9894-056c2f508991 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:26.209123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b992b83-fea4-4021-b9a4-ebe2c26a5b8f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:26.226722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902941d-56bb-4fcf-8e4d-39a996e00827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:26.227633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902941d-56bb-4fcf-8e4d-39a996e00827 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:26.228073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902941d-56bb-4fcf-8e4d-39a996e00827 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:26.228500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902941d-56bb-4fcf-8e4d-39a996e00827 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:26.229304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902941d-56bb-4fcf-8e4d-39a996e00827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:26.238422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902941d-56bb-4fcf-8e4d-39a996e00827 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:26.242451 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3292/6577] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:26.246884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0c67a-e5dd-4e73-9894-056c2f508991 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:26.321483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0c67a-e5dd-4e73-9894-056c2f508991 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:26.335507 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3286/6578] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:26 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:26.338821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902941d-56bb-4fcf-8e4d-39a996e00827 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:26.550620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902941d-56bb-4fcf-8e4d-39a996e00827 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:26.567872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404abb7-6a86-432a-825f-2ebe7402456e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:26.569136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404abb7-6a86-432a-825f-2ebe7402456e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:26.569509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404abb7-6a86-432a-825f-2ebe7402456e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:26.569888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404abb7-6a86-432a-825f-2ebe7402456e admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:26.570798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404abb7-6a86-432a-825f-2ebe7402456e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:26.573274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404abb7-6a86-432a-825f-2ebe7402456e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:26.597451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:26.632843 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3287/6579] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:26 2022] POST /identity/v3/users => generated 291 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:26.636814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404abb7-6a86-432a-825f-2ebe7402456e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:26.650077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:26.657149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404abb7-6a86-432a-825f-2ebe7402456e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:26.672820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95c60d-2caa-4446-9e51-f9006c5a5d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:26.673524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95c60d-2caa-4446-9e51-f9006c5a5d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:26.673842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95c60d-2caa-4446-9e51-f9006c5a5d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:26.674114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95c60d-2caa-4446-9e51-f9006c5a5d5d admin admin] PATH_INFO: `/v3/projects/840fb91cda9c4bf59950beac9224c9c9/users/37a3807e0a9b47e9b3306b4d955674b4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:26.679973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d072999-fadc-415d-a09a-77407768f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:26.680685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d072999-fadc-415d-a09a-77407768f7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:26.681044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d072999-fadc-415d-a09a-77407768f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:26.681390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d072999-fadc-415d-a09a-77407768f7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:26.682135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d072999-fadc-415d-a09a-77407768f7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:26.686038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d072999-fadc-415d-a09a-77407768f7b2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:26.688669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95c60d-2caa-4446-9e51-f9006c5a5d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=840fb91cda9c4bf59950beac9224c9c9, user_id=37a3807e0a9b47e9b3306b4d955674b4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:26.704067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95c60d-2caa-4446-9e51-f9006c5a5d5d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:26.713042 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3288/6580] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:26.715618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d072999-fadc-415d-a09a-77407768f7b2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:26.739939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d072999-fadc-415d-a09a-77407768f7b2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:26.760513 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3293/6581] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:26 2022] PUT /identity/v3/projects/840fb91cda9c4bf59950beac9224c9c9/users/37a3807e0a9b47e9b3306b4d955674b4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:26.885767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87fb29-4bfd-4449-999b-1bb44cc59752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:26.887800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87fb29-4bfd-4449-999b-1bb44cc59752 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:26.890140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87fb29-4bfd-4449-999b-1bb44cc59752 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:26.890700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87fb29-4bfd-4449-999b-1bb44cc59752 admin admin] PATH_INFO: `/v3/projects/ccaff74c421e4672815e906cb40e4dd6/users/7ebec8c7808b4f9485a631ac6beababa/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:26.930282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87fb29-4bfd-4449-999b-1bb44cc59752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccaff74c421e4672815e906cb40e4dd6, user_id=7ebec8c7808b4f9485a631ac6beababa, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:26.935083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87fb29-4bfd-4449-999b-1bb44cc59752 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:26.957016 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3289/6582] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:26 2022] PUT /identity/v3/projects/ccaff74c421e4672815e906cb40e4dd6/users/7ebec8c7808b4f9485a631ac6beababa/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:26.957730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95c60d-2caa-4446-9e51-f9006c5a5d5d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:26.976636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95c60d-2caa-4446-9e51-f9006c5a5d5d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:27.114827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833088b-faf5-497b-a4e4-99d9a45d551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:27.115454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833088b-faf5-497b-a4e4-99d9a45d551d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:27.115738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833088b-faf5-497b-a4e4-99d9a45d551d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:27.116006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833088b-faf5-497b-a4e4-99d9a45d551d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:27.116652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833088b-faf5-497b-a4e4-99d9a45d551d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:27.118268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833088b-faf5-497b-a4e4-99d9a45d551d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:27.144397 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3294/6583] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:27.146126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87fb29-4bfd-4449-999b-1bb44cc59752 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:27.189780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87fb29-4bfd-4449-999b-1bb44cc59752 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:27.215463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1f1e1-c963-43dd-b0ed-8805d60f7b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:27.220656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f1e1-c963-43dd-b0ed-8805d60f7b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:27.225299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f1e1-c963-43dd-b0ed-8805d60f7b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:27.229337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f1e1-c963-43dd-b0ed-8805d60f7b52 admin admin] PATH_INFO: `/v3/projects/ccaff74c421e4672815e906cb40e4dd6/users/7ebec8c7808b4f9485a631ac6beababa/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:27.236123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1f1e1-c963-43dd-b0ed-8805d60f7b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccaff74c421e4672815e906cb40e4dd6, user_id=7ebec8c7808b4f9485a631ac6beababa, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:27.250525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1f1e1-c963-43dd-b0ed-8805d60f7b52 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:27.313946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206b82b-9f75-4c4d-bfe5-b7b60eb138cf None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:27.314441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206b82b-9f75-4c4d-bfe5-b7b60eb138cf None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:27.314841 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3290/6584] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:27 2022] PUT /identity/v3/projects/ccaff74c421e4672815e906cb40e4dd6/users/7ebec8c7808b4f9485a631ac6beababa/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:27.315039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206b82b-9f75-4c4d-bfe5-b7b60eb138cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:27.393452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a206b82b-9f75-4c4d-bfe5-b7b60eb138cf None None] MFA Rules not processed for user `7ebec8c7808b4f9485a631ac6beababa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:27.395552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a206b82b-9f75-4c4d-bfe5-b7b60eb138cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:27.579396 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3295/6585] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:20:27.583964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1f1e1-c963-43dd-b0ed-8805d60f7b52 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:27.598989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1f1e1-c963-43dd-b0ed-8805d60f7b52 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:27.604748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33895282-12aa-490d-a5f3-b72baa2ed251 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:27.605634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33895282-12aa-490d-a5f3-b72baa2ed251 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:27.606100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33895282-12aa-490d-a5f3-b72baa2ed251 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:27.606607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33895282-12aa-490d-a5f3-b72baa2ed251 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:27.608086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33895282-12aa-490d-a5f3-b72baa2ed251 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:27.610113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33895282-12aa-490d-a5f3-b72baa2ed251 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:27.648190 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3291/6586] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:20:27 2022] POST /identity/v3/services => generated 241 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:27.652246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206b82b-9f75-4c4d-bfe5-b7b60eb138cf None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:27.666112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206b82b-9f75-4c4d-bfe5-b7b60eb138cf None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:27.718532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca61ce-706c-43a9-9e99-a37551ec16fb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:27.720614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca61ce-706c-43a9-9e99-a37551ec16fb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:27.720914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca61ce-706c-43a9-9e99-a37551ec16fb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:27.722501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca61ce-706c-43a9-9e99-a37551ec16fb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services/0ecf583e069944e99dc90bed1420b05c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:27.724610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca61ce-706c-43a9-9e99-a37551ec16fb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0ecf583e069944e99dc90bed1420b05c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:27.726358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca61ce-706c-43a9-9e99-a37551ec16fb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:27.840846 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3296/6587] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:27 2022] DELETE /identity/v3/services/0ecf583e069944e99dc90bed1420b05c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:27.848233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33895282-12aa-490d-a5f3-b72baa2ed251 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:27.904306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33895282-12aa-490d-a5f3-b72baa2ed251 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:27.984933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2e021-66bc-43d9-8f50-40c8e3f69b02 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:27.987888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2e021-66bc-43d9-8f50-40c8e3f69b02 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:27.988397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2e021-66bc-43d9-8f50-40c8e3f69b02 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:27.988865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2e021-66bc-43d9-8f50-40c8e3f69b02 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:27.993942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2e021-66bc-43d9-8f50-40c8e3f69b02 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:28.000524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2e021-66bc-43d9-8f50-40c8e3f69b02 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:28.034997 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3292/6588] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:27 2022] POST /identity/v3/services => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:28.039028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca61ce-706c-43a9-9e99-a37551ec16fb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:28.073672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca61ce-706c-43a9-9e99-a37551ec16fb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:28.129131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec93ff-7316-4b11-be13-467c0b07cff1 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:28.130489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec93ff-7316-4b11-be13-467c0b07cff1 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:28.131268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec93ff-7316-4b11-be13-467c0b07cff1 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:28.131949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec93ff-7316-4b11-be13-467c0b07cff1 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services/a5313d2ebe4e4d31aabdcb911459d841` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:28.134374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec93ff-7316-4b11-be13-467c0b07cff1 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:update_service(service_id=a5313d2ebe4e4d31aabdcb911459d841)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:28.136559 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-7aec93ff-7316-4b11-be13-467c0b07cff1 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:20:28.136559 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:20:28.136559 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:20:28.151457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec93ff-7316-4b11-be13-467c0b07cff1 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:28.258783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2e021-66bc-43d9-8f50-40c8e3f69b02 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:28.268328 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3297/6589] 10.222.0.70 () {60 vars in 1252 bytes} [Sun Aug 28 19:20:28 2022] PATCH /identity/v3/services/a5313d2ebe4e4d31aabdcb911459d841 => generated 279 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:28.277909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2e021-66bc-43d9-8f50-40c8e3f69b02 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:28.360897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed20da3-8c74-4e65-a140-832e8f08bcd4 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:28.362178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed20da3-8c74-4e65-a140-832e8f08bcd4 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:28.362774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed20da3-8c74-4e65-a140-832e8f08bcd4 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:28.369653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed20da3-8c74-4e65-a140-832e8f08bcd4 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services/a5313d2ebe4e4d31aabdcb911459d841` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:28.371170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed20da3-8c74-4e65-a140-832e8f08bcd4 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:get_service(service_id=a5313d2ebe4e4d31aabdcb911459d841)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:28.373640 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-0ed20da3-8c74-4e65-a140-832e8f08bcd4 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:20:28.373640 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:20:28.373640 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:20:28.375383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed20da3-8c74-4e65-a140-832e8f08bcd4 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:28.397786 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3293/6590] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:20:28 2022] GET /identity/v3/services/a5313d2ebe4e4d31aabdcb911459d841 => generated 279 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:28.401541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec93ff-7316-4b11-be13-467c0b07cff1 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:28.423840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec93ff-7316-4b11-be13-467c0b07cff1 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:28.446396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44adc3-6165-41e1-8e91-cedae57f3ce5 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:28.447135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44adc3-6165-41e1-8e91-cedae57f3ce5 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:28.447432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44adc3-6165-41e1-8e91-cedae57f3ce5 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:28.447721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44adc3-6165-41e1-8e91-cedae57f3ce5 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services/a5313d2ebe4e4d31aabdcb911459d841` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:28.448751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44adc3-6165-41e1-8e91-cedae57f3ce5 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a5313d2ebe4e4d31aabdcb911459d841)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:28.449974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44adc3-6165-41e1-8e91-cedae57f3ce5 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:28.452627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:28.536835 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3298/6591] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:28 2022] DELETE /identity/v3/services/a5313d2ebe4e4d31aabdcb911459d841 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:28.538525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed20da3-8c74-4e65-a140-832e8f08bcd4 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:28.599843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed20da3-8c74-4e65-a140-832e8f08bcd4 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:28.697461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4241f-4b7c-40e7-b4e5-b5a20c249bf9 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:28.699742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4241f-4b7c-40e7-b4e5-b5a20c249bf9 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:28.703500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4241f-4b7c-40e7-b4e5-b5a20c249bf9 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:28.711121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4241f-4b7c-40e7-b4e5-b5a20c249bf9 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services/a5313d2ebe4e4d31aabdcb911459d841` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:28.721869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4241f-4b7c-40e7-b4e5-b5a20c249bf9 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:get_service(service_id=a5313d2ebe4e4d31aabdcb911459d841)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:28.728903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4241f-4b7c-40e7-b4e5-b5a20c249bf9 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-1ff4241f-4b7c-40e7-b4e5-b5a20c249bf9 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Could not find service: a5313d2ebe4e4d31aabdcb911459d841.: keystone.exception.ServiceNotFound: Could not find service: a5313d2ebe4e4d31aabdcb911459d841. Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: a5313d2ebe4e4d31aabdcb911459d841. Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:20:28.787711 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:20:28.788707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: a5313d2ebe4e4d31aabdcb911459d841. Aug 28 19:20:28.789553 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:20:28.793559 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3294/6592] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:20:28 2022] GET /identity/v3/services/a5313d2ebe4e4d31aabdcb911459d841 => generated 113 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:20:28.798878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44adc3-6165-41e1-8e91-cedae57f3ce5 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:28.800620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4241f-4b7c-40e7-b4e5-b5a20c249bf9 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:28.869171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4241f-4b7c-40e7-b4e5-b5a20c249bf9 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:28.920306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6889ac4-cfc5-421a-86fa-02d9aa948fce tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:28.923777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6889ac4-cfc5-421a-86fa-02d9aa948fce tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:28.925090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6889ac4-cfc5-421a-86fa-02d9aa948fce tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:28.928384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6889ac4-cfc5-421a-86fa-02d9aa948fce tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:28.930934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6889ac4-cfc5-421a-86fa-02d9aa948fce tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:28.932736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6889ac4-cfc5-421a-86fa-02d9aa948fce tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:28.959458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44adc3-6165-41e1-8e91-cedae57f3ce5 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:28.968056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b1c74-ad5f-4ee0-abd9-6ee27fef7244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:28.969270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b1c74-ad5f-4ee0-abd9-6ee27fef7244 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:28.969706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b1c74-ad5f-4ee0-abd9-6ee27fef7244 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:28.970056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b1c74-ad5f-4ee0-abd9-6ee27fef7244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:28.973180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2f9b1c74-ad5f-4ee0-abd9-6ee27fef7244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:28.991635 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3295/6593] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:28 2022] POST /identity/v3/services => generated 275 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:28.995546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6889ac4-cfc5-421a-86fa-02d9aa948fce tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:29.080405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6889ac4-cfc5-421a-86fa-02d9aa948fce tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:29.092627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487232f-c703-49c5-b0a9-4f2ce35a1e1a tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:29.093533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487232f-c703-49c5-b0a9-4f2ce35a1e1a tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:29.094025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487232f-c703-49c5-b0a9-4f2ce35a1e1a tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:29.094447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487232f-c703-49c5-b0a9-4f2ce35a1e1a tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:29.098057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487232f-c703-49c5-b0a9-4f2ce35a1e1a tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:29.102586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487232f-c703-49c5-b0a9-4f2ce35a1e1a tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:29.147757 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3296/6594] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:28 2022] POST /identity/v3/services => generated 275 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:29.151417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487232f-c703-49c5-b0a9-4f2ce35a1e1a tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:29.177696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b1c74-ad5f-4ee0-abd9-6ee27fef7244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:29.181517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b1c74-ad5f-4ee0-abd9-6ee27fef7244 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:29.196413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487232f-c703-49c5-b0a9-4f2ce35a1e1a tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:29.218713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c5f6e-2b42-4e42-bcc7-50549689bf19 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:29.219606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c5f6e-2b42-4e42-bcc7-50549689bf19 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:29.220095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c5f6e-2b42-4e42-bcc7-50549689bf19 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:29.222600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c5f6e-2b42-4e42-bcc7-50549689bf19 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:29.223525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c5f6e-2b42-4e42-bcc7-50549689bf19 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:29.225325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c5f6e-2b42-4e42-bcc7-50549689bf19 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:29.238948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:29.245026 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3299/6595] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:28 2022] GET /identity/v3/auth/tokens => generated 3575 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:29.265537 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3297/6596] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:29 2022] POST /identity/v3/services => generated 275 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:29.269564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b1c74-ad5f-4ee0-abd9-6ee27fef7244 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:29.292979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b1c74-ad5f-4ee0-abd9-6ee27fef7244 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:29.337062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecbcce-c02b-4777-8393-592d812a76bc tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:29.337902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecbcce-c02b-4777-8393-592d812a76bc tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:29.339414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecbcce-c02b-4777-8393-592d812a76bc tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:29.339781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecbcce-c02b-4777-8393-592d812a76bc tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:29.343681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecbcce-c02b-4777-8393-592d812a76bc tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:29.344904 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-d0ecbcce-c02b-4777-8393-592d812a76bc tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:20:29.344904 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:20:29.344904 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:20:29.346146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecbcce-c02b-4777-8393-592d812a76bc tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:29.364025 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3300/6597] 10.222.0.70 () {58 vars in 1131 bytes} [Sun Aug 28 19:20:29 2022] GET /identity/v3/services => generated 2980 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:29.368718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c5f6e-2b42-4e42-bcc7-50549689bf19 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:29.391669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c5f6e-2b42-4e42-bcc7-50549689bf19 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:29.411328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce1d7-a07f-4b04-95e9-1c2ca713e884 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:29.412251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce1d7-a07f-4b04-95e9-1c2ca713e884 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:29.412682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce1d7-a07f-4b04-95e9-1c2ca713e884 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:29.413103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce1d7-a07f-4b04-95e9-1c2ca713e884 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:29.413929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ce1d7-a07f-4b04-95e9-1c2ca713e884 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1317735440) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:29.414393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ce1d7-a07f-4b04-95e9-1c2ca713e884 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:29.420891 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-372ce1d7-a07f-4b04-95e9-1c2ca713e884 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:20:29.420891 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:20:29.420891 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:20:29.421858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ce1d7-a07f-4b04-95e9-1c2ca713e884 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:29.443136 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3298/6598] 10.222.0.70 () {58 vars in 1222 bytes} [Sun Aug 28 19:20:29 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1317735440 => generated 418 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:20:29.447392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecbcce-c02b-4777-8393-592d812a76bc tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:29.480524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecbcce-c02b-4777-8393-592d812a76bc tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:29.491538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d741a83-d095-4a5e-a825-075ea46e1feb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:29.493281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d741a83-d095-4a5e-a825-075ea46e1feb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:29.493586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d741a83-d095-4a5e-a825-075ea46e1feb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:29.493873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d741a83-d095-4a5e-a825-075ea46e1feb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:29.495477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d741a83-d095-4a5e-a825-075ea46e1feb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1169732150) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:29.495797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d741a83-d095-4a5e-a825-075ea46e1feb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:29.501136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d741a83-d095-4a5e-a825-075ea46e1feb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:29.519682 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3301/6599] 10.222.0.70 () {58 vars in 1222 bytes} [Sun Aug 28 19:20:29 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1169732150 => generated 418 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:29.523478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce1d7-a07f-4b04-95e9-1c2ca713e884 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:29.554928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce1d7-a07f-4b04-95e9-1c2ca713e884 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:29.591613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcdb7e-5b7d-4a0e-a60c-a3b6cc8116f8 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:29.592424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcdb7e-5b7d-4a0e-a60c-a3b6cc8116f8 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:29.592854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcdb7e-5b7d-4a0e-a60c-a3b6cc8116f8 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:29.593080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcdb7e-5b7d-4a0e-a60c-a3b6cc8116f8 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:29.593989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcdb7e-5b7d-4a0e-a60c-a3b6cc8116f8 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1341818224) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:29.594297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcdb7e-5b7d-4a0e-a60c-a3b6cc8116f8 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:29.602246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fcdb7e-5b7d-4a0e-a60c-a3b6cc8116f8 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:29.619032 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3299/6600] 10.222.0.70 () {58 vars in 1222 bytes} [Sun Aug 28 19:20:29 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1341818224 => generated 418 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:29.622362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d741a83-d095-4a5e-a825-075ea46e1feb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:29.641632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d741a83-d095-4a5e-a825-075ea46e1feb tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:29.667425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d65d0-f4a2-4bb6-ae1d-8344a4ea7fcf tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:29.668107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d65d0-f4a2-4bb6-ae1d-8344a4ea7fcf tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:29.668577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d65d0-f4a2-4bb6-ae1d-8344a4ea7fcf tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:29.668860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d65d0-f4a2-4bb6-ae1d-8344a4ea7fcf tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services/a51675982fe642eb8d761dbb2d0d26f8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:29.670141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d65d0-f4a2-4bb6-ae1d-8344a4ea7fcf tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a51675982fe642eb8d761dbb2d0d26f8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:29.672208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d65d0-f4a2-4bb6-ae1d-8344a4ea7fcf tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:29.718848 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3302/6601] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:29 2022] DELETE /identity/v3/services/a51675982fe642eb8d761dbb2d0d26f8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:29.722602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcdb7e-5b7d-4a0e-a60c-a3b6cc8116f8 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:29.736152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcdb7e-5b7d-4a0e-a60c-a3b6cc8116f8 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:29.799380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f10566-2abf-4a8f-8036-2811e8aab0ff tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:29.801912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f10566-2abf-4a8f-8036-2811e8aab0ff tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:29.803053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f10566-2abf-4a8f-8036-2811e8aab0ff tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:29.804576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f10566-2abf-4a8f-8036-2811e8aab0ff tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services/73b092decbb746d89384a19a0da165a7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:29.805807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f10566-2abf-4a8f-8036-2811e8aab0ff tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:delete_service(service_id=73b092decbb746d89384a19a0da165a7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:29.811649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f10566-2abf-4a8f-8036-2811e8aab0ff tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:29.887814 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3300/6602] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:29 2022] DELETE /identity/v3/services/73b092decbb746d89384a19a0da165a7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:29.892406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d65d0-f4a2-4bb6-ae1d-8344a4ea7fcf tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:29.925239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d65d0-f4a2-4bb6-ae1d-8344a4ea7fcf tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:29.993850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f9539-84a1-40e3-9493-2c306e709e98 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ebec8c7808b4f9485a631ac6beababa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccaff74c421e4672815e906cb40e4dd6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:29.995357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9539-84a1-40e3-9493-2c306e709e98 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:29.995807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9539-84a1-40e3-9493-2c306e709e98 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:29.996339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9539-84a1-40e3-9493-2c306e709e98 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] PATH_INFO: `/v3/services/4c36c02f8e884dbca84a7d90be1e6501` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:29.997289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f9539-84a1-40e3-9493-2c306e709e98 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4c36c02f8e884dbca84a7d90be1e6501)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:30.000465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f9539-84a1-40e3-9493-2c306e709e98 tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:30.016075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:30.049388 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3303/6603] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:29 2022] DELETE /identity/v3/services/4c36c02f8e884dbca84a7d90be1e6501 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:30.051133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f10566-2abf-4a8f-8036-2811e8aab0ff tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:30.088390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f10566-2abf-4a8f-8036-2811e8aab0ff tempest-ServicesTestJSON-1324659011 tempest-ServicesTestJSON-1324659011-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:30.110528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:30.111242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:30.111527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:30.111799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] PATH_INFO: `/v3/users/270097abd24e45bd8a3f58c898b9fa60` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:30.113830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=270097abd24e45bd8a3f58c898b9fa60)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:30.115966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:30.287748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270097abd24e45bd8a3f58c898b9fa60'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:30.323887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270097abd24e45bd8a3f58c898b9fa60'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:30.325291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270097abd24e45bd8a3f58c898b9fa60'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:30.364540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270097abd24e45bd8a3f58c898b9fa60'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:30.367354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270097abd24e45bd8a3f58c898b9fa60'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:30.407966 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3301/6604] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:30 2022] DELETE /identity/v3/users/270097abd24e45bd8a3f58c898b9fa60 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:30.412114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d25c1-7626-4b2d-bb67-6a9a71f5c8cd None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:30.412609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d25c1-7626-4b2d-bb67-6a9a71f5c8cd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:30.413053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d25c1-7626-4b2d-bb67-6a9a71f5c8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:30.452433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ca9d25c1-7626-4b2d-bb67-6a9a71f5c8cd None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:30.453955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ca9d25c1-7626-4b2d-bb67-6a9a71f5c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:30.640282 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3304/6605] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:30.724982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:30.726476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:30.943814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd12f3b-b5e6-4b67-946a-d16bac4b7b67 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:30.962167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3155f1a-1d2f-494c-a0db-78b67b834739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:30.962860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3155f1a-1d2f-494c-a0db-78b67b834739 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:30.963153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3155f1a-1d2f-494c-a0db-78b67b834739 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:30.963434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3155f1a-1d2f-494c-a0db-78b67b834739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:30.980595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:30.994627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3155f1a-1d2f-494c-a0db-78b67b834739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:31.001272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3155f1a-1d2f-494c-a0db-78b67b834739 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:31.057416 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3302/6606] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:31.339093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813e87a-0e10-430f-a8ba-18e3524e1eab None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:31.340328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813e87a-0e10-430f-a8ba-18e3524e1eab None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:31.340619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813e87a-0e10-430f-a8ba-18e3524e1eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:31.439024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1813e87a-0e10-430f-a8ba-18e3524e1eab None None] MFA Rules not processed for user `37a3807e0a9b47e9b3306b4d955674b4`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:31.446343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1813e87a-0e10-430f-a8ba-18e3524e1eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:31.614270 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3305/6607] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:31 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:34.265198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3155f1a-1d2f-494c-a0db-78b67b834739 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:34.266699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f3155f1a-1d2f-494c-a0db-78b67b834739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:34.296107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3155f1a-1d2f-494c-a0db-78b67b834739 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:34.308654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:34.309097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:34.309386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:34.309672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] PATH_INFO: `/v3/users/c67fb1d8b53148a89cfdff2a5a4395f9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:34.311337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67fb1d8b53148a89cfdff2a5a4395f9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:34.313223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:34.426278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67fb1d8b53148a89cfdff2a5a4395f9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:34.434643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67fb1d8b53148a89cfdff2a5a4395f9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:34.435757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67fb1d8b53148a89cfdff2a5a4395f9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:34.457958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813e87a-0e10-430f-a8ba-18e3524e1eab None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:34.460356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1813e87a-0e10-430f-a8ba-18e3524e1eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:34.479581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67fb1d8b53148a89cfdff2a5a4395f9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:34.480758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67fb1d8b53148a89cfdff2a5a4395f9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:34.488345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813e87a-0e10-430f-a8ba-18e3524e1eab None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:34.522377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:34.523347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:34.524897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:34.525500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] PATH_INFO: `/v3/projects/d0836995987d45e6b344ac1fa47e8014` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:34.527861 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3303/6608] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:34 2022] DELETE /identity/v3/users/c67fb1d8b53148a89cfdff2a5a4395f9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:34.529976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0836995987d45e6b344ac1fa47e8014)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:34.538064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:34.647463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0836995987d45e6b344ac1fa47e8014', 'request_id': 'req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:34.663832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0836995987d45e6b344ac1fa47e8014', 'request_id': 'req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:34.676988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0836995987d45e6b344ac1fa47e8014', 'request_id': 'req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:34.709000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:34.711271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] The token cache is being invalidate because project d0836995987d45e6b344ac1fa47e8014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:34.711578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:34.712550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:34.716071 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3306/6609] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:34 2022] DELETE /identity/v3/projects/d0836995987d45e6b344ac1fa47e8014 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:34.720479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:34.722019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:34.933009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33a00f-172e-4b93-abbc-e295da30f9e8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:35.049702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadf3be-607b-4e3e-829f-9a10b733b296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:35.050541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadf3be-607b-4e3e-829f-9a10b733b296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:35.050986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadf3be-607b-4e3e-829f-9a10b733b296 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:35.051375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadf3be-607b-4e3e-829f-9a10b733b296 admin admin] PATH_INFO: `/v3/users/7ebec8c7808b4f9485a631ac6beababa` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:35.052953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beadf3be-607b-4e3e-829f-9a10b733b296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ebec8c7808b4f9485a631ac6beababa)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:35.055253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beadf3be-607b-4e3e-829f-9a10b733b296 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:35.072621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:35.145594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-beadf3be-607b-4e3e-829f-9a10b733b296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ebec8c7808b4f9485a631ac6beababa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:35.159991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-beadf3be-607b-4e3e-829f-9a10b733b296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ebec8c7808b4f9485a631ac6beababa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:35.162427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-beadf3be-607b-4e3e-829f-9a10b733b296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ebec8c7808b4f9485a631ac6beababa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:35.198300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-beadf3be-607b-4e3e-829f-9a10b733b296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ebec8c7808b4f9485a631ac6beababa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:35.199180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-beadf3be-607b-4e3e-829f-9a10b733b296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ebec8c7808b4f9485a631ac6beababa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:35.233602 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3304/6610] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:34 2022] DELETE /identity/v3/users/7ebec8c7808b4f9485a631ac6beababa => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:35.560246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:35.562391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:35.597426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba538f9-8f07-41fc-9e93-3518df7ce2ff admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:35.898893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb99cc1-a607-4dd3-b7fc-035b557977f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:35.900057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb99cc1-a607-4dd3-b7fc-035b557977f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:35.900510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb99cc1-a607-4dd3-b7fc-035b557977f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:35.901714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb99cc1-a607-4dd3-b7fc-035b557977f2 admin admin] PATH_INFO: `/v3/projects/5ab98fff6a764fc19c5386bc6486dd94` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:35.902559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb99cc1-a607-4dd3-b7fc-035b557977f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab98fff6a764fc19c5386bc6486dd94)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:35.905149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb99cc1-a607-4dd3-b7fc-035b557977f2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:35.979295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7bb99cc1-a607-4dd3-b7fc-035b557977f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab98fff6a764fc19c5386bc6486dd94', 'request_id': 'req-7bb99cc1-a607-4dd3-b7fc-035b557977f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:35.987946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7bb99cc1-a607-4dd3-b7fc-035b557977f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab98fff6a764fc19c5386bc6486dd94', 'request_id': 'req-7bb99cc1-a607-4dd3-b7fc-035b557977f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:35.996601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7bb99cc1-a607-4dd3-b7fc-035b557977f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab98fff6a764fc19c5386bc6486dd94', 'request_id': 'req-7bb99cc1-a607-4dd3-b7fc-035b557977f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:36.024371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7bb99cc1-a607-4dd3-b7fc-035b557977f2 admin admin] The token cache is being invalidate because project 5ab98fff6a764fc19c5386bc6486dd94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:36.024985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7bb99cc1-a607-4dd3-b7fc-035b557977f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:36.026240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7bb99cc1-a607-4dd3-b7fc-035b557977f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:36.028295 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3307/6611] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:35 2022] DELETE /identity/v3/projects/5ab98fff6a764fc19c5386bc6486dd94 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:36.037451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200bc5-09a6-47e7-93b3-a51c0e73bbbd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:36.037988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200bc5-09a6-47e7-93b3-a51c0e73bbbd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:36.037988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200bc5-09a6-47e7-93b3-a51c0e73bbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:36.163491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ce200bc5-09a6-47e7-93b3-a51c0e73bbbd None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:36.165861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ce200bc5-09a6-47e7-93b3-a51c0e73bbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:36.338441 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3305/6612] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:36.340279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40af3ed-4419-495b-97aa-db5e487d4016 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:36.340570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40af3ed-4419-495b-97aa-db5e487d4016 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:36.341373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40af3ed-4419-495b-97aa-db5e487d4016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:36.369794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a40af3ed-4419-495b-97aa-db5e487d4016 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:36.371060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a40af3ed-4419-495b-97aa-db5e487d4016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:36.384149 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3308/6613] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:36.385362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce200bc5-09a6-47e7-93b3-a51c0e73bbbd None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:36.400115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce200bc5-09a6-47e7-93b3-a51c0e73bbbd None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:36.425306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202da64-ed73-4d12-90ad-1f3a1bfce849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:36.425953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202da64-ed73-4d12-90ad-1f3a1bfce849 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:36.426237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202da64-ed73-4d12-90ad-1f3a1bfce849 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:36.426518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202da64-ed73-4d12-90ad-1f3a1bfce849 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:36.427223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202da64-ed73-4d12-90ad-1f3a1bfce849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:36.427505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202da64-ed73-4d12-90ad-1f3a1bfce849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:36.429146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202da64-ed73-4d12-90ad-1f3a1bfce849 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:36.459509 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3306/6614] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:36.467217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40af3ed-4419-495b-97aa-db5e487d4016 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:36.493504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40af3ed-4419-495b-97aa-db5e487d4016 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:36.517077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656db51-c6b0-4685-83ce-8f4b6769783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:36.518202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656db51-c6b0-4685-83ce-8f4b6769783b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:36.518567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656db51-c6b0-4685-83ce-8f4b6769783b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:36.518938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656db51-c6b0-4685-83ce-8f4b6769783b admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:36.519773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656db51-c6b0-4685-83ce-8f4b6769783b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:36.521828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656db51-c6b0-4685-83ce-8f4b6769783b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:36.610599 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3309/6615] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:36 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:36.615215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202da64-ed73-4d12-90ad-1f3a1bfce849 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:36.635718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202da64-ed73-4d12-90ad-1f3a1bfce849 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:36.792626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4158cf6-9ab7-450e-82e2-12db85ccb6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:36.797672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4158cf6-9ab7-450e-82e2-12db85ccb6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:36.798253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4158cf6-9ab7-450e-82e2-12db85ccb6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:36.798799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4158cf6-9ab7-450e-82e2-12db85ccb6c9 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:36.799876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4158cf6-9ab7-450e-82e2-12db85ccb6c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:36.804274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4158cf6-9ab7-450e-82e2-12db85ccb6c9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:36.827559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:36.843766 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3307/6616] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:36 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:36.848655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656db51-c6b0-4685-83ce-8f4b6769783b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:36.870574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656db51-c6b0-4685-83ce-8f4b6769783b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:36.882392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bc5e5-cb84-403a-894b-656ed44011e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:36.883678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bc5e5-cb84-403a-894b-656ed44011e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:36.884248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bc5e5-cb84-403a-894b-656ed44011e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:36.884708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bc5e5-cb84-403a-894b-656ed44011e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:36.885545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bc5e5-cb84-403a-894b-656ed44011e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:36.887520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bc5e5-cb84-403a-894b-656ed44011e6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:36.913550 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3310/6617] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:36.918067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4158cf6-9ab7-450e-82e2-12db85ccb6c9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:36.945166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4158cf6-9ab7-450e-82e2-12db85ccb6c9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:36.963375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a934a-8f11-4910-878d-510255e61d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:36.964605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a934a-8f11-4910-878d-510255e61d3d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:36.965140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a934a-8f11-4910-878d-510255e61d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:36.965645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a934a-8f11-4910-878d-510255e61d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:36.967558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a934a-8f11-4910-878d-510255e61d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:36.970933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a934a-8f11-4910-878d-510255e61d3d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:37.004559 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3308/6618] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:37.008480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bc5e5-cb84-403a-894b-656ed44011e6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:37.064279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bc5e5-cb84-403a-894b-656ed44011e6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:37.073387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c293da-fcdd-45b5-908d-0ba6fda046a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:37.074080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c293da-fcdd-45b5-908d-0ba6fda046a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:37.078631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c293da-fcdd-45b5-908d-0ba6fda046a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:37.079034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c293da-fcdd-45b5-908d-0ba6fda046a3 admin admin] PATH_INFO: `/v3/projects/e733e229eb7e4a99a88b200409e75ec5/users/656876150d884e58a510d2f949cd3f86/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:37.080090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a934a-8f11-4910-878d-510255e61d3d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:37.083702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d13a934a-8f11-4910-878d-510255e61d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:37.103497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c293da-fcdd-45b5-908d-0ba6fda046a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e733e229eb7e4a99a88b200409e75ec5, user_id=656876150d884e58a510d2f949cd3f86, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:37.107464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c293da-fcdd-45b5-908d-0ba6fda046a3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:37.129948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a934a-8f11-4910-878d-510255e61d3d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:37.135493 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3311/6619] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:37 2022] PUT /identity/v3/projects/e733e229eb7e4a99a88b200409e75ec5/users/656876150d884e58a510d2f949cd3f86/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:37.143354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62548bc-281f-4119-9d48-965d0b35d161 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:37.143354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62548bc-281f-4119-9d48-965d0b35d161 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:37.143354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62548bc-281f-4119-9d48-965d0b35d161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:37.198767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e62548bc-281f-4119-9d48-965d0b35d161 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:37.201346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e62548bc-281f-4119-9d48-965d0b35d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:37.290570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:37.412954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fa15b-73f6-4030-a32c-b3d10b5eabb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:37.415870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fa15b-73f6-4030-a32c-b3d10b5eabb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:37.416722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fa15b-73f6-4030-a32c-b3d10b5eabb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:37.418250 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3312/6620] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:37.419609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fa15b-73f6-4030-a32c-b3d10b5eabb5 admin admin] PATH_INFO: `/v3/projects/ccaff74c421e4672815e906cb40e4dd6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:37.427419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fa15b-73f6-4030-a32c-b3d10b5eabb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccaff74c421e4672815e906cb40e4dd6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:37.440381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fa15b-73f6-4030-a32c-b3d10b5eabb5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:37.542572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62548bc-281f-4119-9d48-965d0b35d161 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:37.546868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e62548bc-281f-4119-9d48-965d0b35d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:37.643884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-571fa15b-73f6-4030-a32c-b3d10b5eabb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccaff74c421e4672815e906cb40e4dd6', 'request_id': 'req-571fa15b-73f6-4030-a32c-b3d10b5eabb5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:37.685657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-571fa15b-73f6-4030-a32c-b3d10b5eabb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccaff74c421e4672815e906cb40e4dd6', 'request_id': 'req-571fa15b-73f6-4030-a32c-b3d10b5eabb5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:37.685657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-571fa15b-73f6-4030-a32c-b3d10b5eabb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccaff74c421e4672815e906cb40e4dd6', 'request_id': 'req-571fa15b-73f6-4030-a32c-b3d10b5eabb5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:37.692497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62548bc-281f-4119-9d48-965d0b35d161 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:37.730758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-571fa15b-73f6-4030-a32c-b3d10b5eabb5 admin admin] The token cache is being invalidate because project ccaff74c421e4672815e906cb40e4dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:37.733224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-571fa15b-73f6-4030-a32c-b3d10b5eabb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:37.735249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-571fa15b-73f6-4030-a32c-b3d10b5eabb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:37.739801 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3309/6621] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:37 2022] DELETE /identity/v3/projects/ccaff74c421e4672815e906cb40e4dd6 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:37.747019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40847d68-6ffc-4cfb-869e-e23f4e559929 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:37.748961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40847d68-6ffc-4cfb-869e-e23f4e559929 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:37.749481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40847d68-6ffc-4cfb-869e-e23f4e559929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:37.798439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e4e37-1560-4368-b1b1-cfad137eb6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:37.799029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e4e37-1560-4368-b1b1-cfad137eb6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:37.799313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e4e37-1560-4368-b1b1-cfad137eb6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:37.799593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e4e37-1560-4368-b1b1-cfad137eb6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:37.801371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-297e4e37-1560-4368-b1b1-cfad137eb6a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:37.802559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-40847d68-6ffc-4cfb-869e-e23f4e559929 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:37.803996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-40847d68-6ffc-4cfb-869e-e23f4e559929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:37.922469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e4e37-1560-4368-b1b1-cfad137eb6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:37.923967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e4e37-1560-4368-b1b1-cfad137eb6a9 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:37.935509 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3313/6622] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:37.941605 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3310/6623] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:37.943892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c48a-b824-4892-9114-c52b0122b8b9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:37.944189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c48a-b824-4892-9114-c52b0122b8b9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:37.944473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933c48a-b824-4892-9114-c52b0122b8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:37.968834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d933c48a-b824-4892-9114-c52b0122b8b9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:37.970074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d933c48a-b824-4892-9114-c52b0122b8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:37.982811 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3314/6624] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:37.984141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40847d68-6ffc-4cfb-869e-e23f4e559929 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:37.994521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40847d68-6ffc-4cfb-869e-e23f4e559929 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:38.003343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77b34e-1e2f-478e-91c2-23478c635d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:38.003712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b34e-1e2f-478e-91c2-23478c635d7f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:38.004105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b34e-1e2f-478e-91c2-23478c635d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:38.004496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b34e-1e2f-478e-91c2-23478c635d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:38.005297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77b34e-1e2f-478e-91c2-23478c635d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:38.005714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77b34e-1e2f-478e-91c2-23478c635d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:38.007876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77b34e-1e2f-478e-91c2-23478c635d7f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:38.021679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:38.036961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933c48a-b824-4892-9114-c52b0122b8b9 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:38.051791 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3311/6625] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:20:38.053604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933c48a-b824-4892-9114-c52b0122b8b9 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:38.060706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b01720-1952-4a86-86c9-e97ea1cca874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:38.061564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b01720-1952-4a86-86c9-e97ea1cca874 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:38.062132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b01720-1952-4a86-86c9-e97ea1cca874 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:38.062584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b01720-1952-4a86-86c9-e97ea1cca874 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:38.063683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b01720-1952-4a86-86c9-e97ea1cca874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:38.066780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b01720-1952-4a86-86c9-e97ea1cca874 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:38.116309 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3315/6626] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:38 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:38.123415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77b34e-1e2f-478e-91c2-23478c635d7f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:38.141583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77b34e-1e2f-478e-91c2-23478c635d7f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:38.253657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413ec74-651b-4777-8d2d-d80594e57def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:38.254825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ec74-651b-4777-8d2d-d80594e57def admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:38.255116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ec74-651b-4777-8d2d-d80594e57def admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:38.255406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ec74-651b-4777-8d2d-d80594e57def admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:38.256860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413ec74-651b-4777-8d2d-d80594e57def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:38.260102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413ec74-651b-4777-8d2d-d80594e57def admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:38.304107 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3312/6627] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:38 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:38.306445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b01720-1952-4a86-86c9-e97ea1cca874 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:38.315657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:38.327511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b01720-1952-4a86-86c9-e97ea1cca874 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:38.344933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d2158-f7e8-4e34-afdc-c7e703c981d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:38.346253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d2158-f7e8-4e34-afdc-c7e703c981d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:38.346639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d2158-f7e8-4e34-afdc-c7e703c981d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:38.347040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d2158-f7e8-4e34-afdc-c7e703c981d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:38.348669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d2158-f7e8-4e34-afdc-c7e703c981d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:38.351665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d2158-f7e8-4e34-afdc-c7e703c981d4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:38.370464 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3316/6628] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:38.375379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413ec74-651b-4777-8d2d-d80594e57def admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:38.389296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413ec74-651b-4777-8d2d-d80594e57def admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:38.396313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37728b-9cf6-4b59-942d-5471f8940220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:38.396932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37728b-9cf6-4b59-942d-5471f8940220 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:38.397213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37728b-9cf6-4b59-942d-5471f8940220 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:38.397487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37728b-9cf6-4b59-942d-5471f8940220 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:38.398133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37728b-9cf6-4b59-942d-5471f8940220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:38.400793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37728b-9cf6-4b59-942d-5471f8940220 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:38.420736 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3313/6629] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:38.425657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d2158-f7e8-4e34-afdc-c7e703c981d4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:38.442544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d2158-f7e8-4e34-afdc-c7e703c981d4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:38.451845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34904d35-a608-4ac3-8f79-d191d33abe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:38.453479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34904d35-a608-4ac3-8f79-d191d33abe12 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:38.453869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34904d35-a608-4ac3-8f79-d191d33abe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:38.454799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34904d35-a608-4ac3-8f79-d191d33abe12 admin admin] PATH_INFO: `/v3/projects/1221a520a42841b487070ba8f66c7e64/users/b77092d5d97145f8b6e2b41d7eb8cf7c/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:38.503740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34904d35-a608-4ac3-8f79-d191d33abe12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1221a520a42841b487070ba8f66c7e64, user_id=b77092d5d97145f8b6e2b41d7eb8cf7c, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:38.508301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34904d35-a608-4ac3-8f79-d191d33abe12 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:38.546311 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3317/6630] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:38 2022] PUT /identity/v3/projects/1221a520a42841b487070ba8f66c7e64/users/b77092d5d97145f8b6e2b41d7eb8cf7c/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:38.663942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e8f1-3e22-478a-8697-c09f34aa8dce None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:38.664237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e8f1-3e22-478a-8697-c09f34aa8dce None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:38.664510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e8f1-3e22-478a-8697-c09f34aa8dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:38.702537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8fd7e8f1-3e22-478a-8697-c09f34aa8dce None None] MFA Rules not processed for user `b77092d5d97145f8b6e2b41d7eb8cf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:38.704086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8fd7e8f1-3e22-478a-8697-c09f34aa8dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:38.813491 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3314/6631] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:38.814726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34904d35-a608-4ac3-8f79-d191d33abe12 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:38.983588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34904d35-a608-4ac3-8f79-d191d33abe12 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:38.992442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4275803-db9a-459f-91ff-edd4b7d00711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:38.994312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4275803-db9a-459f-91ff-edd4b7d00711 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:38.994312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4275803-db9a-459f-91ff-edd4b7d00711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:38.994312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4275803-db9a-459f-91ff-edd4b7d00711 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:38.994564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4275803-db9a-459f-91ff-edd4b7d00711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:39.011760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4275803-db9a-459f-91ff-edd4b7d00711 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:39.108049 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3318/6632] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:38 2022] POST /identity/v3/projects => generated 367 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:20:39.112429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7e8f1-3e22-478a-8697-c09f34aa8dce None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:39.147012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7e8f1-3e22-478a-8697-c09f34aa8dce None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:39.237906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f87dd-d13a-4f5b-8978-7333d318c112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:39.238931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f87dd-d13a-4f5b-8978-7333d318c112 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:39.239264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f87dd-d13a-4f5b-8978-7333d318c112 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:39.239630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f87dd-d13a-4f5b-8978-7333d318c112 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:39.240287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f87dd-d13a-4f5b-8978-7333d318c112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:39.242248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f87dd-d13a-4f5b-8978-7333d318c112 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:39.266438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:39.277179 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3315/6633] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:39 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:39.279112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4275803-db9a-459f-91ff-edd4b7d00711 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:39.293010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4275803-db9a-459f-91ff-edd4b7d00711 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:39.300635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c311d6e-8169-400d-a5ee-03f83ac5fc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:39.301258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311d6e-8169-400d-a5ee-03f83ac5fc2a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:39.301554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311d6e-8169-400d-a5ee-03f83ac5fc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:39.302366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311d6e-8169-400d-a5ee-03f83ac5fc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:39.302832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c311d6e-8169-400d-a5ee-03f83ac5fc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:39.306438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c311d6e-8169-400d-a5ee-03f83ac5fc2a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:39.322136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f87dd-d13a-4f5b-8978-7333d318c112 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:39.325509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-250f87dd-d13a-4f5b-8978-7333d318c112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:39.328381 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3319/6634] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:39.332856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c311d6e-8169-400d-a5ee-03f83ac5fc2a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:39.365776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f87dd-d13a-4f5b-8978-7333d318c112 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:39.368766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c311d6e-8169-400d-a5ee-03f83ac5fc2a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:39.379399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30fe51-484f-4e47-b889-399fe4483941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:39.380575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30fe51-484f-4e47-b889-399fe4483941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:39.381120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30fe51-484f-4e47-b889-399fe4483941 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:39.381551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30fe51-484f-4e47-b889-399fe4483941 admin admin] PATH_INFO: `/v3/users/35e64f76f6704c719c723a504d513d2a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:39.383433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30fe51-484f-4e47-b889-399fe4483941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e64f76f6704c719c723a504d513d2a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:39.386630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757aea5-e6e5-46aa-85b1-1e7cdd7de3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:39.386822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30fe51-484f-4e47-b889-399fe4483941 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:39.387406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757aea5-e6e5-46aa-85b1-1e7cdd7de3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:39.388421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757aea5-e6e5-46aa-85b1-1e7cdd7de3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:39.388706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757aea5-e6e5-46aa-85b1-1e7cdd7de3ad admin admin] PATH_INFO: `/v3/projects/d4fee0b4969d4d58ba18badf22adc5aa/users/54e2fe3092484116943f826f92a45c10/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:39.417667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757aea5-e6e5-46aa-85b1-1e7cdd7de3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4fee0b4969d4d58ba18badf22adc5aa, user_id=54e2fe3092484116943f826f92a45c10, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:39.422569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757aea5-e6e5-46aa-85b1-1e7cdd7de3ad admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:39.453241 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3320/6635] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:39 2022] PUT /identity/v3/projects/d4fee0b4969d4d58ba18badf22adc5aa/users/54e2fe3092484116943f826f92a45c10/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:39.458660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757aea5-e6e5-46aa-85b1-1e7cdd7de3ad admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:39.501061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2b30fe51-484f-4e47-b889-399fe4483941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e64f76f6704c719c723a504d513d2a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:39.519226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2b30fe51-484f-4e47-b889-399fe4483941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e64f76f6704c719c723a504d513d2a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:39.521510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2b30fe51-484f-4e47-b889-399fe4483941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e64f76f6704c719c723a504d513d2a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:39.562604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757aea5-e6e5-46aa-85b1-1e7cdd7de3ad admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:39.562825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2b30fe51-484f-4e47-b889-399fe4483941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e64f76f6704c719c723a504d513d2a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:39.564640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2b30fe51-484f-4e47-b889-399fe4483941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e64f76f6704c719c723a504d513d2a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:39.568491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0f66b-c23e-4ae8-a079-469bdc136946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:39.570903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0f66b-c23e-4ae8-a079-469bdc136946 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:39.570903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0f66b-c23e-4ae8-a079-469bdc136946 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:39.570903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0f66b-c23e-4ae8-a079-469bdc136946 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:39.570903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0f66b-c23e-4ae8-a079-469bdc136946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:39.572481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0f66b-c23e-4ae8-a079-469bdc136946 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:39.589834 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3321/6636] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:39.604779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0f66b-c23e-4ae8-a079-469bdc136946 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:39.608568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-75c0f66b-c23e-4ae8-a079-469bdc136946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:39.613194 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3316/6637] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:39 2022] DELETE /identity/v3/users/35e64f76f6704c719c723a504d513d2a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:39.629962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0f66b-c23e-4ae8-a079-469bdc136946 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:39.650382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:39.738295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cd67d-169c-4751-afc2-76a6f88301fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:39.739382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cd67d-169c-4751-afc2-76a6f88301fe admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:39.739966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cd67d-169c-4751-afc2-76a6f88301fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:39.740441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cd67d-169c-4751-afc2-76a6f88301fe admin admin] PATH_INFO: `/v3/projects/d4fee0b4969d4d58ba18badf22adc5aa/users/54e2fe3092484116943f826f92a45c10/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:39.743228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cd67d-169c-4751-afc2-76a6f88301fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4fee0b4969d4d58ba18badf22adc5aa, user_id=54e2fe3092484116943f826f92a45c10, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:39.750529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cd67d-169c-4751-afc2-76a6f88301fe admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:39.765313 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3322/6638] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:39 2022] PUT /identity/v3/projects/d4fee0b4969d4d58ba18badf22adc5aa/users/54e2fe3092484116943f826f92a45c10/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:39.777999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069bc77-27f0-4cfc-8794-d612151fbb0c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:39.778483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069bc77-27f0-4cfc-8794-d612151fbb0c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:39.779036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069bc77-27f0-4cfc-8794-d612151fbb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:39.846026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e069bc77-27f0-4cfc-8794-d612151fbb0c None None] MFA Rules not processed for user `54e2fe3092484116943f826f92a45c10`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:39.847465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e069bc77-27f0-4cfc-8794-d612151fbb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:40.019145 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3317/6639] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:40.022952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cd67d-169c-4751-afc2-76a6f88301fe admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:40.227110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cd67d-169c-4751-afc2-76a6f88301fe admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:40.234984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dac2c4-c5e2-4671-98ca-55b64b4a2bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:40.235860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dac2c4-c5e2-4671-98ca-55b64b4a2bdc admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:40.236297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dac2c4-c5e2-4671-98ca-55b64b4a2bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:40.236912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dac2c4-c5e2-4671-98ca-55b64b4a2bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:40.237708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dac2c4-c5e2-4671-98ca-55b64b4a2bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:40.239885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dac2c4-c5e2-4671-98ca-55b64b4a2bdc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:40.286918 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3323/6640] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:40 2022] POST /identity/v3/projects => generated 369 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:40.288132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069bc77-27f0-4cfc-8794-d612151fbb0c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:40.330594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069bc77-27f0-4cfc-8794-d612151fbb0c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:40.437834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:40.445031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b4178-9a6f-483c-8830-cdc04d1291bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:40.445866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b4178-9a6f-483c-8830-cdc04d1291bf admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:40.446297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b4178-9a6f-483c-8830-cdc04d1291bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:40.446679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b4178-9a6f-483c-8830-cdc04d1291bf admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:40.448100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b4178-9a6f-483c-8830-cdc04d1291bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:40.450803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b4178-9a6f-483c-8830-cdc04d1291bf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:40.489013 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3318/6641] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:40 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:40.493220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dac2c4-c5e2-4671-98ca-55b64b4a2bdc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:40.507814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dac2c4-c5e2-4671-98ca-55b64b4a2bdc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:40.515075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c278d-a4e4-4996-9984-e362d7bcf762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:40.515845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c278d-a4e4-4996-9984-e362d7bcf762 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:40.516250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c278d-a4e4-4996-9984-e362d7bcf762 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:40.516636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c278d-a4e4-4996-9984-e362d7bcf762 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:40.517494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c278d-a4e4-4996-9984-e362d7bcf762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:40.519782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c278d-a4e4-4996-9984-e362d7bcf762 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:40.539026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b4178-9a6f-483c-8830-cdc04d1291bf admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:40.539230 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3324/6642] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:40.551646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b4178-9a6f-483c-8830-cdc04d1291bf admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:40.557713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e74c35-7435-46d3-87dd-395e23556ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:40.558353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e74c35-7435-46d3-87dd-395e23556ddd admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:40.565664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e74c35-7435-46d3-87dd-395e23556ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:40.565664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e74c35-7435-46d3-87dd-395e23556ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:40.565664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e74c35-7435-46d3-87dd-395e23556ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:40.565664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e74c35-7435-46d3-87dd-395e23556ddd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:40.580003 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3319/6643] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:40.587825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c278d-a4e4-4996-9984-e362d7bcf762 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:40.606304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c278d-a4e4-4996-9984-e362d7bcf762 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:40.616278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fdd1f-b5e9-41f8-8ab6-954d54db3fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:40.617142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fdd1f-b5e9-41f8-8ab6-954d54db3fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:40.617431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fdd1f-b5e9-41f8-8ab6-954d54db3fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:40.617718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fdd1f-b5e9-41f8-8ab6-954d54db3fb7 admin admin] PATH_INFO: `/v3/projects/6d8e48a9c1ce4b6e83709cd1119950a5/users/5d6815766d9e43a294e66a0aa99057fd/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:40.641955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fdd1f-b5e9-41f8-8ab6-954d54db3fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8e48a9c1ce4b6e83709cd1119950a5, user_id=5d6815766d9e43a294e66a0aa99057fd, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:40.645858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fdd1f-b5e9-41f8-8ab6-954d54db3fb7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:40.682851 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3325/6644] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:40 2022] PUT /identity/v3/projects/6d8e48a9c1ce4b6e83709cd1119950a5/users/5d6815766d9e43a294e66a0aa99057fd/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:40.683575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf4309-e06a-4277-a602-421b3961a19d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:40.683876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf4309-e06a-4277-a602-421b3961a19d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:40.684158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf4309-e06a-4277-a602-421b3961a19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:40.749971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3aaf4309-e06a-4277-a602-421b3961a19d None None] MFA Rules not processed for user `5d6815766d9e43a294e66a0aa99057fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:40.753287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3aaf4309-e06a-4277-a602-421b3961a19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:40.849705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fdd1f-b5e9-41f8-8ab6-954d54db3fb7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:40.862138 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3320/6645] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:20:40.933522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fdd1f-b5e9-41f8-8ab6-954d54db3fb7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:40.940437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc52f2d-7b22-421d-887b-a56837511298 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:40.941526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc52f2d-7b22-421d-887b-a56837511298 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:40.942159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc52f2d-7b22-421d-887b-a56837511298 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:40.942671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc52f2d-7b22-421d-887b-a56837511298 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:40.943605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc52f2d-7b22-421d-887b-a56837511298 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:40.945462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc52f2d-7b22-421d-887b-a56837511298 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:40.949961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:40.979605 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3326/6646] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:20:40 2022] POST /identity/v3/domains => generated 276 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:40.981253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf4309-e06a-4277-a602-421b3961a19d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:40.998634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf4309-e06a-4277-a602-421b3961a19d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:41.094139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a4278-b2ca-493b-aff3-647d56425579 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:41.095279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a4278-b2ca-493b-aff3-647d56425579 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:41.096253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a4278-b2ca-493b-aff3-647d56425579 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:41.096780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a4278-b2ca-493b-aff3-647d56425579 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:41.097771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a4278-b2ca-493b-aff3-647d56425579 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:41.102299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a4278-b2ca-493b-aff3-647d56425579 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:41.106581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc52f2d-7b22-421d-887b-a56837511298 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:41.109965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3cc52f2d-7b22-421d-887b-a56837511298 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:41.144941 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3321/6647] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:20:40 2022] POST /identity/v3/roles => generated 240 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:41.146903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a4278-b2ca-493b-aff3-647d56425579 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:41.175534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a4278-b2ca-493b-aff3-647d56425579 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:41.204703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d1a3f-dc63-4091-9d6d-eeb3d0d2b811 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:41.206639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d1a3f-dc63-4091-9d6d-eeb3d0d2b811 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:41.207406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d1a3f-dc63-4091-9d6d-eeb3d0d2b811 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:41.207978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d1a3f-dc63-4091-9d6d-eeb3d0d2b811 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/bf917c5c57e64385bfa384c2995d6983/users/5d6815766d9e43a294e66a0aa99057fd/roles/f7513232cab64b929d39e89e633d1aa4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:41.271939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d1a3f-dc63-4091-9d6d-eeb3d0d2b811 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=bf917c5c57e64385bfa384c2995d6983, user_id=5d6815766d9e43a294e66a0aa99057fd, role_id=f7513232cab64b929d39e89e633d1aa4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:41.283189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d1a3f-dc63-4091-9d6d-eeb3d0d2b811 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:41.329241 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3322/6648] 10.222.0.70 () {60 vars in 1480 bytes} [Sun Aug 28 19:20:41 2022] PUT /identity/v3/domains/bf917c5c57e64385bfa384c2995d6983/users/5d6815766d9e43a294e66a0aa99057fd/roles/f7513232cab64b929d39e89e633d1aa4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:41.333164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d1a3f-dc63-4091-9d6d-eeb3d0d2b811 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:41.350491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc52f2d-7b22-421d-887b-a56837511298 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:41.433174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:41.495009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:41.496085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:41.496578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:41.498780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] PATH_INFO: `/v3/projects/a561c7213c4d457cb224677fec4de60b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:41.500152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d1a3f-dc63-4091-9d6d-eeb3d0d2b811 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:41.500595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a561c7213c4d457cb224677fec4de60b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:41.502933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:41.507554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae98168-4e0d-4a09-ab17-42a19a2c8cfe tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:41.508676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae98168-4e0d-4a09-ab17-42a19a2c8cfe tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:41.509938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae98168-4e0d-4a09-ab17-42a19a2c8cfe tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:41.510477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae98168-4e0d-4a09-ab17-42a19a2c8cfe tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:41.511482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae98168-4e0d-4a09-ab17-42a19a2c8cfe tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:41.517564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae98168-4e0d-4a09-ab17-42a19a2c8cfe tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:41.562383 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3323/6649] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:20:41 2022] POST /identity/v3/domains => generated 276 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:41.565981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae98168-4e0d-4a09-ab17-42a19a2c8cfe tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:41.640913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a561c7213c4d457cb224677fec4de60b', 'request_id': 'req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:41.652367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a561c7213c4d457cb224677fec4de60b', 'request_id': 'req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:41.662215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae98168-4e0d-4a09-ab17-42a19a2c8cfe tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:41.663589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a561c7213c4d457cb224677fec4de60b', 'request_id': 'req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:41.690759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] The token cache is being invalidate because project a561c7213c4d457cb224677fec4de60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:41.691431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:41.692404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:41.695695 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3327/6650] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:41 2022] DELETE /identity/v3/projects/a561c7213c4d457cb224677fec4de60b => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:41.699402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:41.702945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:41.762226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac3676-53dc-4ab7-941a-36ab1e0f3d13 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:41.764441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac3676-53dc-4ab7-941a-36ab1e0f3d13 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:41.764750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac3676-53dc-4ab7-941a-36ab1e0f3d13 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:41.766248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac3676-53dc-4ab7-941a-36ab1e0f3d13 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:41.767013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac3676-53dc-4ab7-941a-36ab1e0f3d13 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:41.772975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac3676-53dc-4ab7-941a-36ab1e0f3d13 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:41.774732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:41.821499 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3324/6651] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:20:41 2022] POST /identity/v3/roles => generated 240 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:20:41.829177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac3676-53dc-4ab7-941a-36ab1e0f3d13 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:41.833673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-78ac3676-53dc-4ab7-941a-36ab1e0f3d13 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:41.858557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8d8e9-2e5c-4b53-b2d8-f80e3fef97ea admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:41.867455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac3676-53dc-4ab7-941a-36ab1e0f3d13 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:41.874586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:41.875340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:41.875860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:41.875968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] PATH_INFO: `/v3/users/37a3807e0a9b47e9b3306b4d955674b4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:41.880435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c8988-ace0-4365-871a-e078814c199a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:41.881427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c8988-ace0-4365-871a-e078814c199a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:41.881948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c8988-ace0-4365-871a-e078814c199a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:41.882423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c8988-ace0-4365-871a-e078814c199a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/groups` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:41.883449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c8988-ace0-4365-871a-e078814c199a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:41.883682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a3807e0a9b47e9b3306b4d955674b4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:41.885767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:41.886224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c8988-ace0-4365-871a-e078814c199a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:41.946983 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3325/6652] 10.222.0.70 () {60 vars in 1147 bytes} [Sun Aug 28 19:20:41 2022] POST /identity/v3/groups => generated 327 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:41.957604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c8988-ace0-4365-871a-e078814c199a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:41.979493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a3807e0a9b47e9b3306b4d955674b4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:41.984826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c8988-ace0-4365-871a-e078814c199a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:42.002698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a3807e0a9b47e9b3306b4d955674b4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:42.003660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d621e7a-eaeb-46f5-8ae9-472b949e215e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:42.004548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a3807e0a9b47e9b3306b4d955674b4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:42.006766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d621e7a-eaeb-46f5-8ae9-472b949e215e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:42.007092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d621e7a-eaeb-46f5-8ae9-472b949e215e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:42.007373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d621e7a-eaeb-46f5-8ae9-472b949e215e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/groups/9ad698df483244179eb99578a4282cd7/users/5d6815766d9e43a294e66a0aa99057fd` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:42.019233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d621e7a-eaeb-46f5-8ae9-472b949e215e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=9ad698df483244179eb99578a4282cd7, user_id=5d6815766d9e43a294e66a0aa99057fd)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:42.021685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d621e7a-eaeb-46f5-8ae9-472b949e215e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:42.034131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a3807e0a9b47e9b3306b4d955674b4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:42.034777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a3807e0a9b47e9b3306b4d955674b4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:42.084855 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3328/6653] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:41 2022] DELETE /identity/v3/users/37a3807e0a9b47e9b3306b4d955674b4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:42.089952 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3326/6654] 10.222.0.70 () {60 vars in 1360 bytes} [Sun Aug 28 19:20:41 2022] PUT /identity/v3/groups/9ad698df483244179eb99578a4282cd7/users/5d6815766d9e43a294e66a0aa99057fd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:42.096962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:42.099394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:42.199566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4af98b-a22c-4160-9689-1982f59a4d32 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:42.304621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:42.314367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dd0ba-835e-4b44-a1b6-42b435f58631 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:42.315887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dd0ba-835e-4b44-a1b6-42b435f58631 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:42.316450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dd0ba-835e-4b44-a1b6-42b435f58631 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:42.316946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dd0ba-835e-4b44-a1b6-42b435f58631 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/385a95801ff24177b3e6f5cfffde6538/groups/9ad698df483244179eb99578a4282cd7/roles/de66dc2dac854a72930e2114dbce372e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:42.321511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dd0ba-835e-4b44-a1b6-42b435f58631 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=385a95801ff24177b3e6f5cfffde6538, group_id=9ad698df483244179eb99578a4282cd7, role_id=de66dc2dac854a72930e2114dbce372e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:42.327537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dd0ba-835e-4b44-a1b6-42b435f58631 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:42.360077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d621e7a-eaeb-46f5-8ae9-472b949e215e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:42.360869 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3329/6655] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:42 2022] PUT /identity/v3/domains/385a95801ff24177b3e6f5cfffde6538/groups/9ad698df483244179eb99578a4282cd7/roles/de66dc2dac854a72930e2114dbce372e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:42.374009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d621e7a-eaeb-46f5-8ae9-472b949e215e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:42.407699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:42.459357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7e020-faef-493f-a799-1333555921c9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:42.461258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7e020-faef-493f-a799-1333555921c9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:42.461794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7e020-faef-493f-a799-1333555921c9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:42.462314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7e020-faef-493f-a799-1333555921c9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:42.463300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7e020-faef-493f-a799-1333555921c9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:42.465959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7e020-faef-493f-a799-1333555921c9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:42.502421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dd0ba-835e-4b44-a1b6-42b435f58631 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:42.515722 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3327/6656] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:20:42 2022] POST /identity/v3/domains => generated 276 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:20:42.519140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dd0ba-835e-4b44-a1b6-42b435f58631 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:42.702624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703396ba-6aaf-46de-9da8-b8b92c5a35a8 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:42.704493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703396ba-6aaf-46de-9da8-b8b92c5a35a8 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:42.705080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703396ba-6aaf-46de-9da8-b8b92c5a35a8 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:42.705481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703396ba-6aaf-46de-9da8-b8b92c5a35a8 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:42.706343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703396ba-6aaf-46de-9da8-b8b92c5a35a8 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:42.709176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703396ba-6aaf-46de-9da8-b8b92c5a35a8 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:42.760467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7e020-faef-493f-a799-1333555921c9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:42.769786 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3330/6657] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:20:42 2022] POST /identity/v3/roles => generated 239 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:42.774773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7e020-faef-493f-a799-1333555921c9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:42.787195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052f335-28f8-4493-90b3-586f85a9c773 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:42.788958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f335-28f8-4493-90b3-586f85a9c773 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:42.789778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f335-28f8-4493-90b3-586f85a9c773 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:42.789778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f335-28f8-4493-90b3-586f85a9c773 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/8cd73fbc720e464ea68b31363bc9785c/users/5d6815766d9e43a294e66a0aa99057fd/roles/cda8cfe5ca7840cab64b78ae2e53bca2` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:42.844827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052f335-28f8-4493-90b3-586f85a9c773 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=8cd73fbc720e464ea68b31363bc9785c, user_id=5d6815766d9e43a294e66a0aa99057fd, role_id=cda8cfe5ca7840cab64b78ae2e53bca2)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:42.847606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052f335-28f8-4493-90b3-586f85a9c773 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:42.887798 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3328/6658] 10.222.0.70 () {60 vars in 1480 bytes} [Sun Aug 28 19:20:42 2022] PUT /identity/v3/domains/8cd73fbc720e464ea68b31363bc9785c/users/5d6815766d9e43a294e66a0aa99057fd/roles/cda8cfe5ca7840cab64b78ae2e53bca2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:42.895876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703396ba-6aaf-46de-9da8-b8b92c5a35a8 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:42.915699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703396ba-6aaf-46de-9da8-b8b92c5a35a8 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:43.053832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a1801-06fe-451c-8bcb-c0ae05d4c3e1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:43.054910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a1801-06fe-451c-8bcb-c0ae05d4c3e1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:43.055273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a1801-06fe-451c-8bcb-c0ae05d4c3e1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:43.055628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a1801-06fe-451c-8bcb-c0ae05d4c3e1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:43.056486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a1801-06fe-451c-8bcb-c0ae05d4c3e1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:43.058696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a1801-06fe-451c-8bcb-c0ae05d4c3e1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:43.105702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052f335-28f8-4493-90b3-586f85a9c773 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:43.106476 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3331/6659] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:20:42 2022] POST /identity/v3/domains => generated 277 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:43.125133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052f335-28f8-4493-90b3-586f85a9c773 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:43.353211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33cacb-1560-4eca-a9c4-3142f12b3999 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:43.353875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33cacb-1560-4eca-a9c4-3142f12b3999 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:43.354169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33cacb-1560-4eca-a9c4-3142f12b3999 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:43.354453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33cacb-1560-4eca-a9c4-3142f12b3999 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:43.355186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33cacb-1560-4eca-a9c4-3142f12b3999 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:43.357010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33cacb-1560-4eca-a9c4-3142f12b3999 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:43.399386 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3329/6660] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:20:43 2022] POST /identity/v3/roles => generated 240 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:20:43.402897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a1801-06fe-451c-8bcb-c0ae05d4c3e1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:43.447776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a1801-06fe-451c-8bcb-c0ae05d4c3e1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:43.456312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68b5ae-3d30-44b6-96d2-ced5ba73c21a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:43.456938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68b5ae-3d30-44b6-96d2-ced5ba73c21a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:43.457247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68b5ae-3d30-44b6-96d2-ced5ba73c21a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:43.457525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68b5ae-3d30-44b6-96d2-ced5ba73c21a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/groups` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:43.458206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68b5ae-3d30-44b6-96d2-ced5ba73c21a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:43.460262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68b5ae-3d30-44b6-96d2-ced5ba73c21a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:43.508138 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3332/6661] 10.222.0.70 () {60 vars in 1147 bytes} [Sun Aug 28 19:20:43 2022] POST /identity/v3/groups => generated 326 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:43.509347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33cacb-1560-4eca-a9c4-3142f12b3999 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:43.527918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33cacb-1560-4eca-a9c4-3142f12b3999 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:43.538797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eab655-780b-4e87-83f9-3fdb97b71bd2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:43.539495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eab655-780b-4e87-83f9-3fdb97b71bd2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:43.539847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eab655-780b-4e87-83f9-3fdb97b71bd2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:43.540131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eab655-780b-4e87-83f9-3fdb97b71bd2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/groups/8be96c619f7b430f84f5493abe5a5c56/users/5d6815766d9e43a294e66a0aa99057fd` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:43.552570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eab655-780b-4e87-83f9-3fdb97b71bd2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8be96c619f7b430f84f5493abe5a5c56, user_id=5d6815766d9e43a294e66a0aa99057fd)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:43.554585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eab655-780b-4e87-83f9-3fdb97b71bd2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:43.630224 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3330/6662] 10.222.0.70 () {60 vars in 1360 bytes} [Sun Aug 28 19:20:43 2022] PUT /identity/v3/groups/8be96c619f7b430f84f5493abe5a5c56/users/5d6815766d9e43a294e66a0aa99057fd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:43.631014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68b5ae-3d30-44b6-96d2-ced5ba73c21a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:43.669656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68b5ae-3d30-44b6-96d2-ced5ba73c21a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:43.713667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eab655-780b-4e87-83f9-3fdb97b71bd2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:43.715482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-09eab655-780b-4e87-83f9-3fdb97b71bd2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:43.801226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:43.819986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccece4d1-45d3-4550-8038-ccea53a18b8d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:43.823072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccece4d1-45d3-4550-8038-ccea53a18b8d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:43.823362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccece4d1-45d3-4550-8038-ccea53a18b8d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:43.823647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccece4d1-45d3-4550-8038-ccea53a18b8d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/3cc08f9d6a36457f8ae49334da5953e4/groups/8be96c619f7b430f84f5493abe5a5c56/roles/448cfb44514848b48b5d01e1cfdacc6e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:43.835966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccece4d1-45d3-4550-8038-ccea53a18b8d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3cc08f9d6a36457f8ae49334da5953e4, group_id=8be96c619f7b430f84f5493abe5a5c56, role_id=448cfb44514848b48b5d01e1cfdacc6e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:43.840102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccece4d1-45d3-4550-8038-ccea53a18b8d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:43.874262 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3333/6663] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:43 2022] PUT /identity/v3/domains/3cc08f9d6a36457f8ae49334da5953e4/groups/8be96c619f7b430f84f5493abe5a5c56/roles/448cfb44514848b48b5d01e1cfdacc6e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:43.885632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccece4d1-45d3-4550-8038-ccea53a18b8d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:43.891158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ccece4d1-45d3-4550-8038-ccea53a18b8d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:43.930692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eab655-780b-4e87-83f9-3fdb97b71bd2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:43.964905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:44.172253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccece4d1-45d3-4550-8038-ccea53a18b8d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:44.182289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fad45-c308-4bc5-8a75-87ddda07a47c tempest-TokensV3TestJSON-2011307941 tempest-TokensV3TestJSON-2011307941-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d6815766d9e43a294e66a0aa99057fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d8e48a9c1ce4b6e83709cd1119950a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:44.183262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fad45-c308-4bc5-8a75-87ddda07a47c tempest-TokensV3TestJSON-2011307941 tempest-TokensV3TestJSON-2011307941-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:44.183557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fad45-c308-4bc5-8a75-87ddda07a47c tempest-TokensV3TestJSON-2011307941 tempest-TokensV3TestJSON-2011307941-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:44.183843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fad45-c308-4bc5-8a75-87ddda07a47c tempest-TokensV3TestJSON-2011307941 tempest-TokensV3TestJSON-2011307941-project] PATH_INFO: `/v3/auth/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:44.184687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fad45-c308-4bc5-8a75-87ddda07a47c tempest-TokensV3TestJSON-2011307941 tempest-TokensV3TestJSON-2011307941-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:44.185604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fad45-c308-4bc5-8a75-87ddda07a47c tempest-TokensV3TestJSON-2011307941 tempest-TokensV3TestJSON-2011307941-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:44.188864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f2175-78ab-4634-8e66-d37263f0f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:44.189596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2175-78ab-4634-8e66-d37263f0f039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:44.190616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2175-78ab-4634-8e66-d37263f0f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:44.192109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2175-78ab-4634-8e66-d37263f0f039 admin admin] PATH_INFO: `/v3/projects/840fb91cda9c4bf59950beac9224c9c9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:44.195738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f2175-78ab-4634-8e66-d37263f0f039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=840fb91cda9c4bf59950beac9224c9c9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:44.203827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f2175-78ab-4634-8e66-d37263f0f039 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:44.376557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a11f2175-78ab-4634-8e66-d37263f0f039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840fb91cda9c4bf59950beac9224c9c9', 'request_id': 'req-a11f2175-78ab-4634-8e66-d37263f0f039'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:44.405481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a11f2175-78ab-4634-8e66-d37263f0f039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840fb91cda9c4bf59950beac9224c9c9', 'request_id': 'req-a11f2175-78ab-4634-8e66-d37263f0f039'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:44.416852 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3334/6664] 10.222.0.70 () {58 vars in 1143 bytes} [Sun Aug 28 19:20:43 2022] GET /identity/v3/auth/domains => generated 1173 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:44.422092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a11f2175-78ab-4634-8e66-d37263f0f039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840fb91cda9c4bf59950beac9224c9c9', 'request_id': 'req-a11f2175-78ab-4634-8e66-d37263f0f039'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:44.424186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fad45-c308-4bc5-8a75-87ddda07a47c tempest-TokensV3TestJSON-2011307941 tempest-TokensV3TestJSON-2011307941-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:44.463368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a11f2175-78ab-4634-8e66-d37263f0f039 admin admin] The token cache is being invalidate because project 840fb91cda9c4bf59950beac9224c9c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:44.463684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a11f2175-78ab-4634-8e66-d37263f0f039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:44.472216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a11f2175-78ab-4634-8e66-d37263f0f039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:44.475041 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3331/6665] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:43 2022] DELETE /identity/v3/projects/840fb91cda9c4bf59950beac9224c9c9 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:44.480558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4d931-bc4d-43fa-9d9d-8be1ad6a8969 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:44.480858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4d931-bc4d-43fa-9d9d-8be1ad6a8969 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:44.481137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4d931-bc4d-43fa-9d9d-8be1ad6a8969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:44.579081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-14b4d931-bc4d-43fa-9d9d-8be1ad6a8969 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:44.583548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-14b4d931-bc4d-43fa-9d9d-8be1ad6a8969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:44.679027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fad45-c308-4bc5-8a75-87ddda07a47c tempest-TokensV3TestJSON-2011307941 tempest-TokensV3TestJSON-2011307941-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:44.705628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:44.713109 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3332/6666] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:44.726920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a300ec-943b-41a6-aabc-277c591d01ac None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:44.727702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a300ec-943b-41a6-aabc-277c591d01ac None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:44.728454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a300ec-943b-41a6-aabc-277c591d01ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:44.804591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-90a300ec-943b-41a6-aabc-277c591d01ac None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:44.819592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-90a300ec-943b-41a6-aabc-277c591d01ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:44.856027 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3333/6667] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:44.860929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a300ec-943b-41a6-aabc-277c591d01ac None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:44.879727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a300ec-943b-41a6-aabc-277c591d01ac None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:44.894931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec144ef-3b38-409a-a310-3ef6119b3e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:44.911790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec144ef-3b38-409a-a310-3ef6119b3e6f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:44.913828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec144ef-3b38-409a-a310-3ef6119b3e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:44.915887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec144ef-3b38-409a-a310-3ef6119b3e6f admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:44.917479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec144ef-3b38-409a-a310-3ef6119b3e6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:20:44.918017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec144ef-3b38-409a-a310-3ef6119b3e6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:44.926834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec144ef-3b38-409a-a310-3ef6119b3e6f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:44.946796 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3334/6668] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:44.951585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec144ef-3b38-409a-a310-3ef6119b3e6f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:44.966591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec144ef-3b38-409a-a310-3ef6119b3e6f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:44.973273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4694b-95d8-4d0f-a4a3-a085781cdcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:44.974232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4694b-95d8-4d0f-a4a3-a085781cdcf3 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:44.974784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4694b-95d8-4d0f-a4a3-a085781cdcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:44.975291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4694b-95d8-4d0f-a4a3-a085781cdcf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:44.976154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4694b-95d8-4d0f-a4a3-a085781cdcf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:44.977975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff5035-7346-496e-9332-5d9151bb42bf tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:44.978671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5035-7346-496e-9332-5d9151bb42bf tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:44.979068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5035-7346-496e-9332-5d9151bb42bf tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:44.979663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5035-7346-496e-9332-5d9151bb42bf tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/3cc08f9d6a36457f8ae49334da5953e4/groups/8be96c619f7b430f84f5493abe5a5c56/roles/448cfb44514848b48b5d01e1cfdacc6e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:44.980039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4694b-95d8-4d0f-a4a3-a085781cdcf3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:44.984088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff5035-7346-496e-9332-5d9151bb42bf tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3cc08f9d6a36457f8ae49334da5953e4, group_id=8be96c619f7b430f84f5493abe5a5c56, role_id=448cfb44514848b48b5d01e1cfdacc6e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:44.986807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff5035-7346-496e-9332-5d9151bb42bf tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:45.008661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-60ff5035-7346-496e-9332-5d9151bb42bf tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invalidating the token cache because role 448cfb44514848b48b5d01e1cfdacc6e was removed from group 8be96c619f7b430f84f5493abe5a5c56 on domain 3cc08f9d6a36457f8ae49334da5953e4. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:45.008977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-60ff5035-7346-496e-9332-5d9151bb42bf tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:45.011699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-60ff5035-7346-496e-9332-5d9151bb42bf tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:45.026117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:45.057138 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3335/6669] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:44 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:45.061161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4694b-95d8-4d0f-a4a3-a085781cdcf3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:45.066671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-49f4694b-95d8-4d0f-a4a3-a085781cdcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:45.070238 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3335/6670] 10.222.0.70 () {58 vars in 1467 bytes} [Sun Aug 28 19:20:44 2022] DELETE /identity/v3/domains/3cc08f9d6a36457f8ae49334da5953e4/groups/8be96c619f7b430f84f5493abe5a5c56/roles/448cfb44514848b48b5d01e1cfdacc6e => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:45.086256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff5035-7346-496e-9332-5d9151bb42bf tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:45.089793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-60ff5035-7346-496e-9332-5d9151bb42bf tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:45.195288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4694b-95d8-4d0f-a4a3-a085781cdcf3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:45.318538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff5035-7346-496e-9332-5d9151bb42bf tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:45.333457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e4235-3891-4f05-a230-1d38e7200ae9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:45.334204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e4235-3891-4f05-a230-1d38e7200ae9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:45.334605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e4235-3891-4f05-a230-1d38e7200ae9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:45.334941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e4235-3891-4f05-a230-1d38e7200ae9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/groups/8be96c619f7b430f84f5493abe5a5c56/users/5d6815766d9e43a294e66a0aa99057fd` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:45.337354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e4235-3891-4f05-a230-1d38e7200ae9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8be96c619f7b430f84f5493abe5a5c56, user_id=5d6815766d9e43a294e66a0aa99057fd)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:45.340439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e4235-3891-4f05-a230-1d38e7200ae9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:45.357102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-490e4235-3891-4f05-a230-1d38e7200ae9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5d6815766d9e43a294e66a0aa99057fd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:45.385914 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3336/6671] 10.222.0.70 () {58 vars in 1344 bytes} [Sun Aug 28 19:20:45 2022] DELETE /identity/v3/groups/8be96c619f7b430f84f5493abe5a5c56/users/5d6815766d9e43a294e66a0aa99057fd => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:45.390287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e4235-3891-4f05-a230-1d38e7200ae9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:45.413222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509279f6-55c9-4ed1-9f92-536fc2665853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:45.416424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509279f6-55c9-4ed1-9f92-536fc2665853 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:45.416424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509279f6-55c9-4ed1-9f92-536fc2665853 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:45.416619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509279f6-55c9-4ed1-9f92-536fc2665853 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:45.418476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509279f6-55c9-4ed1-9f92-536fc2665853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:45.422332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509279f6-55c9-4ed1-9f92-536fc2665853 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:45.509854 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3336/6672] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:45 2022] POST /identity/v3/users => generated 289 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:45.515380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509279f6-55c9-4ed1-9f92-536fc2665853 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:45.531529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509279f6-55c9-4ed1-9f92-536fc2665853 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:45.540712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e4235-3891-4f05-a230-1d38e7200ae9 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:45.559228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8523d28-b4c4-4b5d-bdde-7539a12ec405 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:45.564786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8523d28-b4c4-4b5d-bdde-7539a12ec405 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:45.564786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8523d28-b4c4-4b5d-bdde-7539a12ec405 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:45.564786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8523d28-b4c4-4b5d-bdde-7539a12ec405 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/groups/8be96c619f7b430f84f5493abe5a5c56` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:45.566057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8523d28-b4c4-4b5d-bdde-7539a12ec405 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8be96c619f7b430f84f5493abe5a5c56)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:45.568416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8523d28-b4c4-4b5d-bdde-7539a12ec405 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:45.640118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:45.670547 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3337/6673] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:20:45 2022] DELETE /identity/v3/groups/8be96c619f7b430f84f5493abe5a5c56 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:45.674955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8523d28-b4c4-4b5d-bdde-7539a12ec405 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:45.685936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a7a4a-ef54-4c75-8c6f-8d87cb38288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:45.686557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7a4a-ef54-4c75-8c6f-8d87cb38288f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:45.687348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7a4a-ef54-4c75-8c6f-8d87cb38288f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:45.687632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a7a4a-ef54-4c75-8c6f-8d87cb38288f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:45.688486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a7a4a-ef54-4c75-8c6f-8d87cb38288f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:45.690166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a7a4a-ef54-4c75-8c6f-8d87cb38288f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:45.727156 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3337/6674] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:45 2022] GET /identity/v3/roles => generated 2343 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:45.733873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a7a4a-ef54-4c75-8c6f-8d87cb38288f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:45.763618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a7a4a-ef54-4c75-8c6f-8d87cb38288f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:45.829180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:45.865526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8523d28-b4c4-4b5d-bdde-7539a12ec405 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:45.885106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a334c-1f88-4cb7-9693-7a464ef1bc75 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:45.885787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a334c-1f88-4cb7-9693-7a464ef1bc75 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:45.886072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a334c-1f88-4cb7-9693-7a464ef1bc75 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:45.886361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a334c-1f88-4cb7-9693-7a464ef1bc75 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/roles/448cfb44514848b48b5d01e1cfdacc6e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:45.894215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a334c-1f88-4cb7-9693-7a464ef1bc75 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_role(role_id=448cfb44514848b48b5d01e1cfdacc6e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:45.895999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a334c-1f88-4cb7-9693-7a464ef1bc75 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:45.909109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04ffb3-d17f-42bf-b5b3-74f04083790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:45.918883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04ffb3-d17f-42bf-b5b3-74f04083790f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:45.920656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04ffb3-d17f-42bf-b5b3-74f04083790f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:45.922300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04ffb3-d17f-42bf-b5b3-74f04083790f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:45.924950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04ffb3-d17f-42bf-b5b3-74f04083790f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:45.933642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04ffb3-d17f-42bf-b5b3-74f04083790f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:45.971762 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3338/6675] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:45 2022] GET /identity/v3/roles => generated 2343 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:45.975858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04ffb3-d17f-42bf-b5b3-74f04083790f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:45.983847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b52a334c-1f88-4cb7-9693-7a464ef1bc75 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invalidating the token cache because role 448cfb44514848b48b5d01e1cfdacc6e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:45.984425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b52a334c-1f88-4cb7-9693-7a464ef1bc75 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:45.985637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b52a334c-1f88-4cb7-9693-7a464ef1bc75 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:45.987920 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3338/6676] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:45 2022] DELETE /identity/v3/roles/448cfb44514848b48b5d01e1cfdacc6e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:45.992826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a334c-1f88-4cb7-9693-7a464ef1bc75 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:45.994542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b52a334c-1f88-4cb7-9693-7a464ef1bc75 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:45.999777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04ffb3-d17f-42bf-b5b3-74f04083790f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:46.098383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbaa82-3db2-4fc0-8c81-b23d5697ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:46.099098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbaa82-3db2-4fc0-8c81-b23d5697ce36 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:46.099383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbaa82-3db2-4fc0-8c81-b23d5697ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:46.099909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbaa82-3db2-4fc0-8c81-b23d5697ce36 admin admin] PATH_INFO: `/v3/projects/cf0fd1b7e5194e14a2576c4b4ecd795f/users/bb9f11c941cd4f23ab4ba84a8accf4e4/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:46.109916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a334c-1f88-4cb7-9693-7a464ef1bc75 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:46.124089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fb46e-b48e-4d21-9c95-a5f0bfee936e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:46.124667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fb46e-b48e-4d21-9c95-a5f0bfee936e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:46.124957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fb46e-b48e-4d21-9c95-a5f0bfee936e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:46.125234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fb46e-b48e-4d21-9c95-a5f0bfee936e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/3cc08f9d6a36457f8ae49334da5953e4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:46.127556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbaa82-3db2-4fc0-8c81-b23d5697ce36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0fd1b7e5194e14a2576c4b4ecd795f, user_id=bb9f11c941cd4f23ab4ba84a8accf4e4, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:46.131030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fb46e-b48e-4d21-9c95-a5f0bfee936e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3cc08f9d6a36457f8ae49334da5953e4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:46.132646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fb46e-b48e-4d21-9c95-a5f0bfee936e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:46.135571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbaa82-3db2-4fc0-8c81-b23d5697ce36 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:46.175376 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3339/6677] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:45 2022] PUT /identity/v3/projects/cf0fd1b7e5194e14a2576c4b4ecd795f/users/bb9f11c941cd4f23ab4ba84a8accf4e4/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:46.178095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032ed48-10ae-4f49-9cc3-ed4805658eac None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:46.178394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032ed48-10ae-4f49-9cc3-ed4805658eac None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:46.178677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032ed48-10ae-4f49-9cc3-ed4805658eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:46.209707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-090fb46e-b48e-4d21-9c95-a5f0bfee936e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3cc08f9d6a36457f8ae49334da5953e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.211831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-090fb46e-b48e-4d21-9c95-a5f0bfee936e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3cc08f9d6a36457f8ae49334da5953e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.250027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7032ed48-10ae-4f49-9cc3-ed4805658eac None None] MFA Rules not processed for user `bb9f11c941cd4f23ab4ba84a8accf4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:46.251385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7032ed48-10ae-4f49-9cc3-ed4805658eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:46.283222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-090fb46e-b48e-4d21-9c95-a5f0bfee936e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3cc08f9d6a36457f8ae49334da5953e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.284812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-090fb46e-b48e-4d21-9c95-a5f0bfee936e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3cc08f9d6a36457f8ae49334da5953e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.293239 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3339/6678] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:20:45 2022] PATCH /identity/v3/domains/3cc08f9d6a36457f8ae49334da5953e4 => generated 278 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:46.295298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fb46e-b48e-4d21-9c95-a5f0bfee936e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:46.300458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-090fb46e-b48e-4d21-9c95-a5f0bfee936e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:46.358632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:46.447066 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3340/6679] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:20:46.448241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032ed48-10ae-4f49-9cc3-ed4805658eac None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:46.451252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7032ed48-10ae-4f49-9cc3-ed4805658eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:46.474118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fb46e-b48e-4d21-9c95-a5f0bfee936e tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:46.494968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:46.495449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:46.495846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:46.496246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/3cc08f9d6a36457f8ae49334da5953e4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:46.524373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3cc08f9d6a36457f8ae49334da5953e4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:46.526282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:46.548164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:46.593268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3cc08f9d6a36457f8ae49334da5953e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.603281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3cc08f9d6a36457f8ae49334da5953e4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.612166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032ed48-10ae-4f49-9cc3-ed4805658eac None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:46.617446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd639315-dfc0-4d31-847e-581d78c66bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:46.632234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd639315-dfc0-4d31-847e-581d78c66bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:46.632655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd639315-dfc0-4d31-847e-581d78c66bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:46.632937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd639315-dfc0-4d31-847e-581d78c66bd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:46.633632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd639315-dfc0-4d31-847e-581d78c66bd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:46.639338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd639315-dfc0-4d31-847e-581d78c66bd0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:46.697509 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3341/6680] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:46 2022] POST /identity/v3/projects => generated 377 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:46.709972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd639315-dfc0-4d31-847e-581d78c66bd0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:46.734257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc08f9d6a36457f8ae49334da5953e4', 'request_id': 'req-3e25179c-abe7-467a-90c4-f3536b13e6b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.751680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc08f9d6a36457f8ae49334da5953e4', 'request_id': 'req-3e25179c-abe7-467a-90c4-f3536b13e6b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.777185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc08f9d6a36457f8ae49334da5953e4', 'request_id': 'req-3e25179c-abe7-467a-90c4-f3536b13e6b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.806628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] The token cache is being invalidate because project 3cc08f9d6a36457f8ae49334da5953e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:46.807292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.807952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.830541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3cc08f9d6a36457f8ae49334da5953e4', 'request_id': 'req-3e25179c-abe7-467a-90c4-f3536b13e6b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.831346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3cc08f9d6a36457f8ae49334da5953e4', 'request_id': 'req-3e25179c-abe7-467a-90c4-f3536b13e6b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.838937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3cc08f9d6a36457f8ae49334da5953e4', 'request_id': 'req-3e25179c-abe7-467a-90c4-f3536b13e6b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:46.855000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd639315-dfc0-4d31-847e-581d78c66bd0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:46.863585 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3340/6681] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:20:46 2022] DELETE /identity/v3/domains/3cc08f9d6a36457f8ae49334da5953e4 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:46.864593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:46.867818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23d2f5-71b6-4f65-977f-827c9803e99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:46.868467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23d2f5-71b6-4f65-977f-827c9803e99a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:46.868774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23d2f5-71b6-4f65-977f-827c9803e99a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:46.869063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23d2f5-71b6-4f65-977f-827c9803e99a admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:46.869701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23d2f5-71b6-4f65-977f-827c9803e99a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:46.869839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:46.872963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23d2f5-71b6-4f65-977f-827c9803e99a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:46.914885 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3342/6682] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:46 2022] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:46.919785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23d2f5-71b6-4f65-977f-827c9803e99a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:46.922378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2d23d2f5-71b6-4f65-977f-827c9803e99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:46.942691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23d2f5-71b6-4f65-977f-827c9803e99a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:46.948889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6832a-87dc-4188-be23-921303e84ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:46.949799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6832a-87dc-4188-be23-921303e84ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:46.950940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6832a-87dc-4188-be23-921303e84ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:46.951929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6832a-87dc-4188-be23-921303e84ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:46.953261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6832a-87dc-4188-be23-921303e84ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:46.957056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6832a-87dc-4188-be23-921303e84ad5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:46.978392 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3343/6683] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:46 2022] GET /identity/v3/roles => generated 2112 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:20:46.981642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6832a-87dc-4188-be23-921303e84ad5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:46.981973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:46.990595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25179c-abe7-467a-90c4-f3536b13e6b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:47.007768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6832a-87dc-4188-be23-921303e84ad5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:47.024856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520a3e9-e281-45aa-a7aa-e84292d4dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:47.025563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a3e9-e281-45aa-a7aa-e84292d4dd76 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:47.026149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a3e9-e281-45aa-a7aa-e84292d4dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:47.026439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a3e9-e281-45aa-a7aa-e84292d4dd76 admin admin] PATH_INFO: `/v3/projects/d017bb979e4f4da59ca09d5ad8e722bd/users/41b6ac5f74b44e83b2b63e936f337d05/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:47.070488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520a3e9-e281-45aa-a7aa-e84292d4dd76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d017bb979e4f4da59ca09d5ad8e722bd, user_id=41b6ac5f74b44e83b2b63e936f337d05, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:47.074251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520a3e9-e281-45aa-a7aa-e84292d4dd76 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:47.094569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919733a-1add-4542-947e-e0eaa5e39501 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:47.096060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919733a-1add-4542-947e-e0eaa5e39501 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:47.096583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919733a-1add-4542-947e-e0eaa5e39501 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:47.097124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919733a-1add-4542-947e-e0eaa5e39501 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/8cd73fbc720e464ea68b31363bc9785c/users/5d6815766d9e43a294e66a0aa99057fd/roles/cda8cfe5ca7840cab64b78ae2e53bca2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:47.103589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919733a-1add-4542-947e-e0eaa5e39501 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=8cd73fbc720e464ea68b31363bc9785c, user_id=5d6815766d9e43a294e66a0aa99057fd, role_id=cda8cfe5ca7840cab64b78ae2e53bca2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:47.107784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919733a-1add-4542-947e-e0eaa5e39501 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:47.108346 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3344/6684] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:46 2022] PUT /identity/v3/projects/d017bb979e4f4da59ca09d5ad8e722bd/users/41b6ac5f74b44e83b2b63e936f337d05/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:47.112121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520a3e9-e281-45aa-a7aa-e84292d4dd76 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:47.116029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8919733a-1add-4542-947e-e0eaa5e39501 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invalidating the token cache because role cda8cfe5ca7840cab64b78ae2e53bca2 was removed from user 5d6815766d9e43a294e66a0aa99057fd on domain 8cd73fbc720e464ea68b31363bc9785c. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:47.116677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8919733a-1add-4542-947e-e0eaa5e39501 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:47.117611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8919733a-1add-4542-947e-e0eaa5e39501 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:47.159674 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3341/6685] 10.222.0.70 () {58 vars in 1464 bytes} [Sun Aug 28 19:20:46 2022] DELETE /identity/v3/domains/8cd73fbc720e464ea68b31363bc9785c/users/5d6815766d9e43a294e66a0aa99057fd/roles/cda8cfe5ca7840cab64b78ae2e53bca2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:47.164122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919733a-1add-4542-947e-e0eaa5e39501 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:47.167101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8919733a-1add-4542-947e-e0eaa5e39501 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:47.308869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520a3e9-e281-45aa-a7aa-e84292d4dd76 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:47.445972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919733a-1add-4542-947e-e0eaa5e39501 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:47.455975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:47.471287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2ab61-f144-4ff2-aa3b-6edd3df3be3c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:47.471958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2ab61-f144-4ff2-aa3b-6edd3df3be3c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:47.472243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2ab61-f144-4ff2-aa3b-6edd3df3be3c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:47.472522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2ab61-f144-4ff2-aa3b-6edd3df3be3c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/roles/cda8cfe5ca7840cab64b78ae2e53bca2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:47.475057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2ab61-f144-4ff2-aa3b-6edd3df3be3c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cda8cfe5ca7840cab64b78ae2e53bca2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:47.487507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2ab61-f144-4ff2-aa3b-6edd3df3be3c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:47.536117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f6d64-c212-4266-b80c-dc807e90cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:47.536860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f6d64-c212-4266-b80c-dc807e90cdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:47.537312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f6d64-c212-4266-b80c-dc807e90cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:47.537639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f6d64-c212-4266-b80c-dc807e90cdc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:47.538601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f6d64-c212-4266-b80c-dc807e90cdc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:47.551591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09f2ab61-f144-4ff2-aa3b-6edd3df3be3c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invalidating the token cache because role cda8cfe5ca7840cab64b78ae2e53bca2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:47.552219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09f2ab61-f144-4ff2-aa3b-6edd3df3be3c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:47.561207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09f2ab61-f144-4ff2-aa3b-6edd3df3be3c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:47.563612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f6d64-c212-4266-b80c-dc807e90cdc5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:47.567224 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3342/6686] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:47 2022] DELETE /identity/v3/roles/cda8cfe5ca7840cab64b78ae2e53bca2 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:47.571594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2ab61-f144-4ff2-aa3b-6edd3df3be3c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:47.573791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-09f2ab61-f144-4ff2-aa3b-6edd3df3be3c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:47.593011 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3345/6687] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:47 2022] GET /identity/v3/roles => generated 1882 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:20:47.594479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f6d64-c212-4266-b80c-dc807e90cdc5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:47.596961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0b9f6d64-c212-4266-b80c-dc807e90cdc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:47.613071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f6d64-c212-4266-b80c-dc807e90cdc5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:47.703924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac41aa4-d0d3-4529-bc8b-9b369e9fb458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:47.705198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41aa4-d0d3-4529-bc8b-9b369e9fb458 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:47.706294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41aa4-d0d3-4529-bc8b-9b369e9fb458 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:47.707162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac41aa4-d0d3-4529-bc8b-9b369e9fb458 admin admin] PATH_INFO: `/v3/projects/d017bb979e4f4da59ca09d5ad8e722bd/users/41b6ac5f74b44e83b2b63e936f337d05/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:47.710486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac41aa4-d0d3-4529-bc8b-9b369e9fb458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d017bb979e4f4da59ca09d5ad8e722bd, user_id=41b6ac5f74b44e83b2b63e936f337d05, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:47.717524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac41aa4-d0d3-4529-bc8b-9b369e9fb458 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:47.742986 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3346/6688] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:47 2022] PUT /identity/v3/projects/d017bb979e4f4da59ca09d5ad8e722bd/users/41b6ac5f74b44e83b2b63e936f337d05/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:47.745219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db268195-10f2-4c6e-a734-23a7219421ec None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:47.745624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db268195-10f2-4c6e-a734-23a7219421ec None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:47.746028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db268195-10f2-4c6e-a734-23a7219421ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:47.763896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:47.770946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2ab61-f144-4ff2-aa3b-6edd3df3be3c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:47.804889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-db268195-10f2-4c6e-a734-23a7219421ec None None] MFA Rules not processed for user `d0bd3c83dff64f27bd048defad379622`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:47.806243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-db268195-10f2-4c6e-a734-23a7219421ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:47.862779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7a21b-9d6c-489e-8acb-86dad08eb436 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:47.863602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7a21b-9d6c-489e-8acb-86dad08eb436 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:47.865011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7a21b-9d6c-489e-8acb-86dad08eb436 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:47.865373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7a21b-9d6c-489e-8acb-86dad08eb436 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/8cd73fbc720e464ea68b31363bc9785c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:47.869449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7a21b-9d6c-489e-8acb-86dad08eb436 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8cd73fbc720e464ea68b31363bc9785c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:47.875292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7a21b-9d6c-489e-8acb-86dad08eb436 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:47.936447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2db7a21b-9d6c-489e-8acb-86dad08eb436 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8cd73fbc720e464ea68b31363bc9785c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:47.937110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2db7a21b-9d6c-489e-8acb-86dad08eb436 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8cd73fbc720e464ea68b31363bc9785c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:47.975332 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3347/6689] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:47.977224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d8eeb-d68a-491c-9b3c-8fb5da9ca910 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:47.977519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d8eeb-d68a-491c-9b3c-8fb5da9ca910 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:47.978647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d8eeb-d68a-491c-9b3c-8fb5da9ca910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:48.017502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2db7a21b-9d6c-489e-8acb-86dad08eb436 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8cd73fbc720e464ea68b31363bc9785c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:48.024481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2db7a21b-9d6c-489e-8acb-86dad08eb436 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8cd73fbc720e464ea68b31363bc9785c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:48.030240 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3343/6690] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:20:47 2022] PATCH /identity/v3/domains/8cd73fbc720e464ea68b31363bc9785c => generated 277 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:48.031106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7a21b-9d6c-489e-8acb-86dad08eb436 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:48.044614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2db7a21b-9d6c-489e-8acb-86dad08eb436 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:48.115381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-859d8eeb-d68a-491c-9b3c-8fb5da9ca910 None None] MFA Rules not processed for user `41b6ac5f74b44e83b2b63e936f337d05`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:48.128174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-859d8eeb-d68a-491c-9b3c-8fb5da9ca910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:48.231031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:48.316309 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3348/6691] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:48.322890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d8eeb-d68a-491c-9b3c-8fb5da9ca910 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:48.327574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-859d8eeb-d68a-491c-9b3c-8fb5da9ca910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:48.364917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7a21b-9d6c-489e-8acb-86dad08eb436 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:48.384338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c85654-4d72-4b61-9acc-c6f22c1598f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:48.384733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c85654-4d72-4b61-9acc-c6f22c1598f5 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:48.384957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c85654-4d72-4b61-9acc-c6f22c1598f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:48.385230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c85654-4d72-4b61-9acc-c6f22c1598f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:48.389323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a0c85654-4d72-4b61-9acc-c6f22c1598f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:48.479462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:48.487272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d8eeb-d68a-491c-9b3c-8fb5da9ca910 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:48.500977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:48.501636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:48.501925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:48.502246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/8cd73fbc720e464ea68b31363bc9785c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:48.519999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c85654-4d72-4b61-9acc-c6f22c1598f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:48.521743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c85654-4d72-4b61-9acc-c6f22c1598f5 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:48.534537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8cd73fbc720e464ea68b31363bc9785c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:48.536226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:48.545978 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3344/6692] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:48.547083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c85654-4d72-4b61-9acc-c6f22c1598f5 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:48.550364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a0c85654-4d72-4b61-9acc-c6f22c1598f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:48.593004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8cd73fbc720e464ea68b31363bc9785c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:48.597895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8cd73fbc720e464ea68b31363bc9785c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:48.696137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cd73fbc720e464ea68b31363bc9785c', 'request_id': 'req-399118de-ece8-456d-b0b4-f89951ecce69'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:48.721122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cd73fbc720e464ea68b31363bc9785c', 'request_id': 'req-399118de-ece8-456d-b0b4-f89951ecce69'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:48.737164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cd73fbc720e464ea68b31363bc9785c', 'request_id': 'req-399118de-ece8-456d-b0b4-f89951ecce69'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:48.765179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] The token cache is being invalidate because project 8cd73fbc720e464ea68b31363bc9785c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:48.768068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:48.769481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:48.772741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c85654-4d72-4b61-9acc-c6f22c1598f5 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:48.794618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8cd73fbc720e464ea68b31363bc9785c', 'request_id': 'req-399118de-ece8-456d-b0b4-f89951ecce69'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:48.803293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8cd73fbc720e464ea68b31363bc9785c', 'request_id': 'req-399118de-ece8-456d-b0b4-f89951ecce69'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:48.804907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8cd73fbc720e464ea68b31363bc9785c', 'request_id': 'req-399118de-ece8-456d-b0b4-f89951ecce69'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:48.821993 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3349/6693] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:20:48 2022] DELETE /identity/v3/domains/8cd73fbc720e464ea68b31363bc9785c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:48.827543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:48.830571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:48.840639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568940dc-fc81-4622-a52d-2533d59f9c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:48.842303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568940dc-fc81-4622-a52d-2533d59f9c14 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:48.842303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568940dc-fc81-4622-a52d-2533d59f9c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:48.842520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568940dc-fc81-4622-a52d-2533d59f9c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:48.845056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-568940dc-fc81-4622-a52d-2533d59f9c14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:48.858350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:49.002630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399118de-ece8-456d-b0b4-f89951ecce69 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:49.008489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568940dc-fc81-4622-a52d-2533d59f9c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:49.011472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568940dc-fc81-4622-a52d-2533d59f9c14 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:49.015645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a90e2e-c914-48cb-a5f8-a5dcdcfbf4ad tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:49.017921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a90e2e-c914-48cb-a5f8-a5dcdcfbf4ad tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:49.018427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a90e2e-c914-48cb-a5f8-a5dcdcfbf4ad tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:49.019146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a90e2e-c914-48cb-a5f8-a5dcdcfbf4ad tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/385a95801ff24177b3e6f5cfffde6538/groups/9ad698df483244179eb99578a4282cd7/roles/de66dc2dac854a72930e2114dbce372e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:49.024290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a90e2e-c914-48cb-a5f8-a5dcdcfbf4ad tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=385a95801ff24177b3e6f5cfffde6538, group_id=9ad698df483244179eb99578a4282cd7, role_id=de66dc2dac854a72930e2114dbce372e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:49.031234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a90e2e-c914-48cb-a5f8-a5dcdcfbf4ad tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:49.042911 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3345/6694] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:49.048189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-64a90e2e-c914-48cb-a5f8-a5dcdcfbf4ad tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invalidating the token cache because role de66dc2dac854a72930e2114dbce372e was removed from group 9ad698df483244179eb99578a4282cd7 on domain 385a95801ff24177b3e6f5cfffde6538. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:49.048818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-64a90e2e-c914-48cb-a5f8-a5dcdcfbf4ad tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:49.049761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-64a90e2e-c914-48cb-a5f8-a5dcdcfbf4ad tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:49.078318 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3350/6695] 10.222.0.70 () {58 vars in 1467 bytes} [Sun Aug 28 19:20:48 2022] DELETE /identity/v3/domains/385a95801ff24177b3e6f5cfffde6538/groups/9ad698df483244179eb99578a4282cd7/roles/de66dc2dac854a72930e2114dbce372e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:49.084756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568940dc-fc81-4622-a52d-2533d59f9c14 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:49.103180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568940dc-fc81-4622-a52d-2533d59f9c14 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:49.157045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:49.220611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b177052-0699-4bd9-a917-bbe7db256877 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:49.222127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b177052-0699-4bd9-a917-bbe7db256877 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:49.222568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b177052-0699-4bd9-a917-bbe7db256877 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:49.223081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b177052-0699-4bd9-a917-bbe7db256877 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/groups/9ad698df483244179eb99578a4282cd7/users/5d6815766d9e43a294e66a0aa99057fd` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:49.226007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b177052-0699-4bd9-a917-bbe7db256877 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=9ad698df483244179eb99578a4282cd7, user_id=5d6815766d9e43a294e66a0aa99057fd)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:49.230105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b177052-0699-4bd9-a917-bbe7db256877 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:49.242099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6b177052-0699-4bd9-a917-bbe7db256877 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5d6815766d9e43a294e66a0aa99057fd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:49.275954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a90e2e-c914-48cb-a5f8-a5dcdcfbf4ad tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:49.277316 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3346/6696] 10.222.0.70 () {58 vars in 1344 bytes} [Sun Aug 28 19:20:49 2022] DELETE /identity/v3/groups/9ad698df483244179eb99578a4282cd7/users/5d6815766d9e43a294e66a0aa99057fd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:49.279716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-64a90e2e-c914-48cb-a5f8-a5dcdcfbf4ad tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:49.318163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a90e2e-c914-48cb-a5f8-a5dcdcfbf4ad tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:49.452043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b18f8-d544-42f3-8561-5e43f0ef1c0b tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:49.453873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b18f8-d544-42f3-8561-5e43f0ef1c0b tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:49.454185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b18f8-d544-42f3-8561-5e43f0ef1c0b tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:49.454568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b18f8-d544-42f3-8561-5e43f0ef1c0b tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/groups/9ad698df483244179eb99578a4282cd7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:49.456947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b18f8-d544-42f3-8561-5e43f0ef1c0b tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9ad698df483244179eb99578a4282cd7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:49.463275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b18f8-d544-42f3-8561-5e43f0ef1c0b tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:49.633725 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3351/6697] 10.222.0.70 () {58 vars in 1227 bytes} [Sun Aug 28 19:20:49 2022] DELETE /identity/v3/groups/9ad698df483244179eb99578a4282cd7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:49.635720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b177052-0699-4bd9-a917-bbe7db256877 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:49.658345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b177052-0699-4bd9-a917-bbe7db256877 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:49.818412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895457e-7366-4b6b-972c-56a1b7130597 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:49.819566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895457e-7366-4b6b-972c-56a1b7130597 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:49.820027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895457e-7366-4b6b-972c-56a1b7130597 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:49.820515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895457e-7366-4b6b-972c-56a1b7130597 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/roles/de66dc2dac854a72930e2114dbce372e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:49.828322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895457e-7366-4b6b-972c-56a1b7130597 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_role(role_id=de66dc2dac854a72930e2114dbce372e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:49.830823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895457e-7366-4b6b-972c-56a1b7130597 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:49.931588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4895457e-7366-4b6b-972c-56a1b7130597 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invalidating the token cache because role de66dc2dac854a72930e2114dbce372e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:49.931890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4895457e-7366-4b6b-972c-56a1b7130597 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:49.934796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4895457e-7366-4b6b-972c-56a1b7130597 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:49.946053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b18f8-d544-42f3-8561-5e43f0ef1c0b tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:49.947328 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3347/6698] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:49 2022] DELETE /identity/v3/roles/de66dc2dac854a72930e2114dbce372e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:49.949006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a16b18f8-d544-42f3-8561-5e43f0ef1c0b tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:49.974349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b18f8-d544-42f3-8561-5e43f0ef1c0b tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:50.086232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:50.103188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253c165-7e32-4095-8215-205dcfdb5cfb tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:50.104850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253c165-7e32-4095-8215-205dcfdb5cfb tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:50.105382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253c165-7e32-4095-8215-205dcfdb5cfb tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:50.106847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253c165-7e32-4095-8215-205dcfdb5cfb tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/385a95801ff24177b3e6f5cfffde6538` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:50.108556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253c165-7e32-4095-8215-205dcfdb5cfb tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=385a95801ff24177b3e6f5cfffde6538)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:50.110783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253c165-7e32-4095-8215-205dcfdb5cfb tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:50.163206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2253c165-7e32-4095-8215-205dcfdb5cfb tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '385a95801ff24177b3e6f5cfffde6538'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.165369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2253c165-7e32-4095-8215-205dcfdb5cfb tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '385a95801ff24177b3e6f5cfffde6538'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.223991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2253c165-7e32-4095-8215-205dcfdb5cfb tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '385a95801ff24177b3e6f5cfffde6538'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.224650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2253c165-7e32-4095-8215-205dcfdb5cfb tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '385a95801ff24177b3e6f5cfffde6538'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.241631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895457e-7366-4b6b-972c-56a1b7130597 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:50.243644 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3352/6699] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:20:49 2022] PATCH /identity/v3/domains/385a95801ff24177b3e6f5cfffde6538 => generated 277 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:50.257938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895457e-7366-4b6b-972c-56a1b7130597 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:50.427186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:50.427857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:50.428152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:50.428434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/385a95801ff24177b3e6f5cfffde6538` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:50.457705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=385a95801ff24177b3e6f5cfffde6538)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:50.459396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:50.490931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:50.507403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '385a95801ff24177b3e6f5cfffde6538'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.547909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '385a95801ff24177b3e6f5cfffde6538'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.678505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385a95801ff24177b3e6f5cfffde6538', 'request_id': 'req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.696641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385a95801ff24177b3e6f5cfffde6538', 'request_id': 'req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.730060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385a95801ff24177b3e6f5cfffde6538', 'request_id': 'req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.758247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] The token cache is being invalidate because project 385a95801ff24177b3e6f5cfffde6538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:50.758552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.762093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.798107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '385a95801ff24177b3e6f5cfffde6538', 'request_id': 'req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.798840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '385a95801ff24177b3e6f5cfffde6538', 'request_id': 'req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.812707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '385a95801ff24177b3e6f5cfffde6538', 'request_id': 'req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:50.829902 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3348/6700] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:20:50 2022] DELETE /identity/v3/domains/385a95801ff24177b3e6f5cfffde6538 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:50.834180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253c165-7e32-4095-8215-205dcfdb5cfb tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:50.836651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2253c165-7e32-4095-8215-205dcfdb5cfb tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:50.860229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253c165-7e32-4095-8215-205dcfdb5cfb tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:51.020628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7534962-c061-4702-b341-0c4c37231ee7 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:51.021336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7534962-c061-4702-b341-0c4c37231ee7 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:51.021631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7534962-c061-4702-b341-0c4c37231ee7 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:51.021912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7534962-c061-4702-b341-0c4c37231ee7 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/bf917c5c57e64385bfa384c2995d6983/users/5d6815766d9e43a294e66a0aa99057fd/roles/f7513232cab64b929d39e89e633d1aa4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:51.025788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7534962-c061-4702-b341-0c4c37231ee7 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=bf917c5c57e64385bfa384c2995d6983, user_id=5d6815766d9e43a294e66a0aa99057fd, role_id=f7513232cab64b929d39e89e633d1aa4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:51.029169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7534962-c061-4702-b341-0c4c37231ee7 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:51.040576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a7534962-c061-4702-b341-0c4c37231ee7 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invalidating the token cache because role f7513232cab64b929d39e89e633d1aa4 was removed from user 5d6815766d9e43a294e66a0aa99057fd on domain bf917c5c57e64385bfa384c2995d6983. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:51.040923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a7534962-c061-4702-b341-0c4c37231ee7 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:51.041662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a7534962-c061-4702-b341-0c4c37231ee7 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:51.079563 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3353/6701] 10.222.0.70 () {58 vars in 1464 bytes} [Sun Aug 28 19:20:50 2022] DELETE /identity/v3/domains/bf917c5c57e64385bfa384c2995d6983/users/5d6815766d9e43a294e66a0aa99057fd/roles/f7513232cab64b929d39e89e633d1aa4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:51.085785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:51.087423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:51.111481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a92117-b3f6-49ae-b1c1-4132f77f5bb1 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:51.312838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5857a-937e-4db4-aaaa-df3595a0f669 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:51.313823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5857a-937e-4db4-aaaa-df3595a0f669 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:51.314218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5857a-937e-4db4-aaaa-df3595a0f669 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:51.314606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5857a-937e-4db4-aaaa-df3595a0f669 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/roles/f7513232cab64b929d39e89e633d1aa4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:51.324077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5857a-937e-4db4-aaaa-df3595a0f669 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f7513232cab64b929d39e89e633d1aa4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:51.326970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5857a-937e-4db4-aaaa-df3595a0f669 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:51.430622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b5c5857a-937e-4db4-aaaa-df3595a0f669 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invalidating the token cache because role f7513232cab64b929d39e89e633d1aa4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:51.431144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b5c5857a-937e-4db4-aaaa-df3595a0f669 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:51.432589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b5c5857a-937e-4db4-aaaa-df3595a0f669 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:51.436205 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3349/6702] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:51 2022] DELETE /identity/v3/roles/f7513232cab64b929d39e89e633d1aa4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:51.440735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7534962-c061-4702-b341-0c4c37231ee7 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:51.448594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a7534962-c061-4702-b341-0c4c37231ee7 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:51.461014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7534962-c061-4702-b341-0c4c37231ee7 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:51.576150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54099c64-7704-40ef-81ed-42ab538672a3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:51.577726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54099c64-7704-40ef-81ed-42ab538672a3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:51.578172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54099c64-7704-40ef-81ed-42ab538672a3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:51.578597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54099c64-7704-40ef-81ed-42ab538672a3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/bf917c5c57e64385bfa384c2995d6983` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:51.582180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54099c64-7704-40ef-81ed-42ab538672a3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bf917c5c57e64385bfa384c2995d6983)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:51.585017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54099c64-7704-40ef-81ed-42ab538672a3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:51.617701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-54099c64-7704-40ef-81ed-42ab538672a3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bf917c5c57e64385bfa384c2995d6983'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:51.618697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-54099c64-7704-40ef-81ed-42ab538672a3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bf917c5c57e64385bfa384c2995d6983'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:51.677127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-54099c64-7704-40ef-81ed-42ab538672a3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bf917c5c57e64385bfa384c2995d6983'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:51.677850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-54099c64-7704-40ef-81ed-42ab538672a3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bf917c5c57e64385bfa384c2995d6983'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:51.684521 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3354/6703] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:20:51 2022] PATCH /identity/v3/domains/bf917c5c57e64385bfa384c2995d6983 => generated 277 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:51.688837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5857a-937e-4db4-aaaa-df3595a0f669 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:51.690943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b5c5857a-937e-4db4-aaaa-df3595a0f669 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:51.715558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5857a-937e-4db4-aaaa-df3595a0f669 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:51.769023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:51.836907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:51.838961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:51.839426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:51.840012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/bf917c5c57e64385bfa384c2995d6983` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:51.860906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bf917c5c57e64385bfa384c2995d6983)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:51.863205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:51.909953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bf917c5c57e64385bfa384c2995d6983'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:51.914673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bf917c5c57e64385bfa384c2995d6983'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:52.045402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf917c5c57e64385bfa384c2995d6983', 'request_id': 'req-dbcd1005-e344-48e6-bb31-a398d80b10d5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:52.056868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf917c5c57e64385bfa384c2995d6983', 'request_id': 'req-dbcd1005-e344-48e6-bb31-a398d80b10d5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:52.073088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf917c5c57e64385bfa384c2995d6983', 'request_id': 'req-dbcd1005-e344-48e6-bb31-a398d80b10d5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:52.118450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] The token cache is being invalidate because project bf917c5c57e64385bfa384c2995d6983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:52.119030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:52.120669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:52.156523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bf917c5c57e64385bfa384c2995d6983', 'request_id': 'req-dbcd1005-e344-48e6-bb31-a398d80b10d5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:52.157725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bf917c5c57e64385bfa384c2995d6983', 'request_id': 'req-dbcd1005-e344-48e6-bb31-a398d80b10d5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:52.163279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bf917c5c57e64385bfa384c2995d6983', 'request_id': 'req-dbcd1005-e344-48e6-bb31-a398d80b10d5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:52.172127 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3350/6704] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:20:51 2022] DELETE /identity/v3/domains/bf917c5c57e64385bfa384c2995d6983 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:52.178613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54099c64-7704-40ef-81ed-42ab538672a3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:52.179451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-54099c64-7704-40ef-81ed-42ab538672a3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:52.216701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54099c64-7704-40ef-81ed-42ab538672a3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:52.248697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:UPDATE=2,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:52.342226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff529f-a46f-402c-8afe-13129302d219 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:52.343127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff529f-a46f-402c-8afe-13129302d219 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:52.343470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff529f-a46f-402c-8afe-13129302d219 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:52.343808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff529f-a46f-402c-8afe-13129302d219 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:52.344747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff529f-a46f-402c-8afe-13129302d219 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:52.347196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff529f-a46f-402c-8afe-13129302d219 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:52.384131 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3355/6705] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:52.384655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:52.386624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:52.412420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd1005-e344-48e6-bb31-a398d80b10d5 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:52.435300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5d066-1ebd-4c01-acee-75f47f39a009 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:52.436003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5d066-1ebd-4c01-acee-75f47f39a009 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:52.436292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5d066-1ebd-4c01-acee-75f47f39a009 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:52.436614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5d066-1ebd-4c01-acee-75f47f39a009 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/projects/1221a520a42841b487070ba8f66c7e64/users/54e2fe3092484116943f826f92a45c10/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:52.452331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5d066-1ebd-4c01-acee-75f47f39a009 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1221a520a42841b487070ba8f66c7e64, user_id=54e2fe3092484116943f826f92a45c10, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:52.455094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5d066-1ebd-4c01-acee-75f47f39a009 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:52.493318 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3351/6706] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:52 2022] PUT /identity/v3/projects/1221a520a42841b487070ba8f66c7e64/users/54e2fe3092484116943f826f92a45c10/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:20:52.500094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff529f-a46f-402c-8afe-13129302d219 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:52.519871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff529f-a46f-402c-8afe-13129302d219 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:52.728615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5aaf6-64e7-46d2-bcee-bd52a5c6c771 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:52.729297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5aaf6-64e7-46d2-bcee-bd52a5c6c771 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:52.732429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5aaf6-64e7-46d2-bcee-bd52a5c6c771 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:52.732736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5aaf6-64e7-46d2-bcee-bd52a5c6c771 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:52.733346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5aaf6-64e7-46d2-bcee-bd52a5c6c771 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:52.734514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5aaf6-64e7-46d2-bcee-bd52a5c6c771 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:52.842619 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3356/6707] 10.222.0.70 () {58 vars in 1146 bytes} [Sun Aug 28 19:20:52 2022] GET /identity/v3/auth/projects => generated 826 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:20:52.848396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5d066-1ebd-4c01-acee-75f47f39a009 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:52.865626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5d066-1ebd-4c01-acee-75f47f39a009 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:52.890455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c8dfa-b423-4252-844d-8f27b0e5e280 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:52.895319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c8dfa-b423-4252-844d-8f27b0e5e280 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:52.895690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c8dfa-b423-4252-844d-8f27b0e5e280 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:52.896048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c8dfa-b423-4252-844d-8f27b0e5e280 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/projects/1221a520a42841b487070ba8f66c7e64/users/54e2fe3092484116943f826f92a45c10/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:52.900794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c8dfa-b423-4252-844d-8f27b0e5e280 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1221a520a42841b487070ba8f66c7e64, user_id=54e2fe3092484116943f826f92a45c10, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:52.911201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c8dfa-b423-4252-844d-8f27b0e5e280 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:52.928072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee5c8dfa-b423-4252-844d-8f27b0e5e280 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invalidating the token cache because role 9f40fd4221dd48e99cfdb0def78f267a was removed from user 54e2fe3092484116943f826f92a45c10 on project 1221a520a42841b487070ba8f66c7e64. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:52.928365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee5c8dfa-b423-4252-844d-8f27b0e5e280 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:52.932987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee5c8dfa-b423-4252-844d-8f27b0e5e280 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:52.984643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5aaf6-64e7-46d2-bcee-bd52a5c6c771 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:52.985232 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3352/6708] 10.222.0.70 () {58 vars in 1467 bytes} [Sun Aug 28 19:20:52 2022] DELETE /identity/v3/projects/1221a520a42841b487070ba8f66c7e64/users/54e2fe3092484116943f826f92a45c10/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:52.986677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-33b5aaf6-64e7-46d2-bcee-bd52a5c6c771 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:53.014830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5aaf6-64e7-46d2-bcee-bd52a5c6c771 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:53.149441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737309b-029c-4425-b54d-9e546ae1d543 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:53.150189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737309b-029c-4425-b54d-9e546ae1d543 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:53.150554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737309b-029c-4425-b54d-9e546ae1d543 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:53.150925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737309b-029c-4425-b54d-9e546ae1d543 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:53.151659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737309b-029c-4425-b54d-9e546ae1d543 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:53.153861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737309b-029c-4425-b54d-9e546ae1d543 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:53.212228 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3357/6709] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:52 2022] POST /identity/v3/users => generated 323 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:53.217155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c8dfa-b423-4252-844d-8f27b0e5e280 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:53.238086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c8dfa-b423-4252-844d-8f27b0e5e280 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:53.251111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e481ac-1e55-4a0c-bf6f-d6b77493bd2d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:53.252578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e481ac-1e55-4a0c-bf6f-d6b77493bd2d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:53.252578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e481ac-1e55-4a0c-bf6f-d6b77493bd2d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:53.253020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e481ac-1e55-4a0c-bf6f-d6b77493bd2d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:53.253923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e481ac-1e55-4a0c-bf6f-d6b77493bd2d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:53.258070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e481ac-1e55-4a0c-bf6f-d6b77493bd2d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:53.357450 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3353/6710] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:53 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:53.359826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737309b-029c-4425-b54d-9e546ae1d543 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:53.367267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:53.376265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737309b-029c-4425-b54d-9e546ae1d543 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:53.551809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fcca6-1187-4073-9914-2fabec1cd57a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:53.552463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fcca6-1187-4073-9914-2fabec1cd57a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:53.552811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fcca6-1187-4073-9914-2fabec1cd57a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:53.553100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fcca6-1187-4073-9914-2fabec1cd57a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:53.553760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fcca6-1187-4073-9914-2fabec1cd57a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:53.555751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fcca6-1187-4073-9914-2fabec1cd57a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:53.656258 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3358/6711] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:53 2022] POST /identity/v3/projects => generated 362 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:53.657556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e481ac-1e55-4a0c-bf6f-d6b77493bd2d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:53.678413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e481ac-1e55-4a0c-bf6f-d6b77493bd2d tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:53.706987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:53.854124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07f5dc-b032-41ff-8df7-791817ab9a7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:53.855204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07f5dc-b032-41ff-8df7-791817ab9a7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:53.855684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07f5dc-b032-41ff-8df7-791817ab9a7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:53.856019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07f5dc-b032-41ff-8df7-791817ab9a7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:53.857123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07f5dc-b032-41ff-8df7-791817ab9a7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:53.858927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07f5dc-b032-41ff-8df7-791817ab9a7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:53.884840 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3354/6712] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:20:53 2022] POST /identity/v3/roles => generated 239 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:53.886663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fcca6-1187-4073-9914-2fabec1cd57a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:53.907926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fcca6-1187-4073-9914-2fabec1cd57a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:53.929131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c5f64-d12f-4512-a81e-3e5665261d7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:53.930043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c5f64-d12f-4512-a81e-3e5665261d7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:53.930527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c5f64-d12f-4512-a81e-3e5665261d7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:53.931167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c5f64-d12f-4512-a81e-3e5665261d7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/projects/3287919317ec40a8a6d2e6f558aea188/users/921c222d770a412d8a16993785852fa9/roles/f555ed6fde9e4f18ac35208703589a38` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:53.993442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c5f64-d12f-4512-a81e-3e5665261d7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3287919317ec40a8a6d2e6f558aea188, user_id=921c222d770a412d8a16993785852fa9, role_id=f555ed6fde9e4f18ac35208703589a38)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:54.001647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c5f64-d12f-4512-a81e-3e5665261d7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:54.046174 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3359/6713] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:53 2022] PUT /identity/v3/projects/3287919317ec40a8a6d2e6f558aea188/users/921c222d770a412d8a16993785852fa9/roles/f555ed6fde9e4f18ac35208703589a38 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:54.051617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07f5dc-b032-41ff-8df7-791817ab9a7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:54.094329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07f5dc-b032-41ff-8df7-791817ab9a7f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:54.253423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54c2ff-7374-47ad-be95-41b920b9a51c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:54.254462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c2ff-7374-47ad-be95-41b920b9a51c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:54.254994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c2ff-7374-47ad-be95-41b920b9a51c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:54.255472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c2ff-7374-47ad-be95-41b920b9a51c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/projects/6d6e344ccbec4c269fd56bedc20b88a3/users/921c222d770a412d8a16993785852fa9/roles/f555ed6fde9e4f18ac35208703589a38` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:54.264299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54c2ff-7374-47ad-be95-41b920b9a51c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e344ccbec4c269fd56bedc20b88a3, user_id=921c222d770a412d8a16993785852fa9, role_id=f555ed6fde9e4f18ac35208703589a38)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:54.267417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54c2ff-7374-47ad-be95-41b920b9a51c tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:54.313166 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3355/6714] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:54 2022] PUT /identity/v3/projects/6d6e344ccbec4c269fd56bedc20b88a3/users/921c222d770a412d8a16993785852fa9/roles/f555ed6fde9e4f18ac35208703589a38 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:54.317603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4460cd6-393c-4ffa-8ddb-c6ac9c03b2c1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:54.318104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4460cd6-393c-4ffa-8ddb-c6ac9c03b2c1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:54.318393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4460cd6-393c-4ffa-8ddb-c6ac9c03b2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:54.408436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c4460cd6-393c-4ffa-8ddb-c6ac9c03b2c1 None None] MFA Rules not processed for user `921c222d770a412d8a16993785852fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:54.412498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c4460cd6-393c-4ffa-8ddb-c6ac9c03b2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:54.423861 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3360/6715] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:54 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 19:20:54.430126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19671125-2aed-477e-a954-f8462c211a12 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:54.430126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19671125-2aed-477e-a954-f8462c211a12 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:54.432449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19671125-2aed-477e-a954-f8462c211a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:54.456596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-19671125-2aed-477e-a954-f8462c211a12 None None] MFA Rules not processed for user `921c222d770a412d8a16993785852fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:54.458147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-19671125-2aed-477e-a954-f8462c211a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:54.650935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aed20f-867b-4d74-88cd-4e6316d6c184 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:54.651391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aed20f-867b-4d74-88cd-4e6316d6c184 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:54.651845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aed20f-867b-4d74-88cd-4e6316d6c184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:54.740205 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3356/6716] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:54 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 28 19:20:54.744025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19671125-2aed-477e-a954-f8462c211a12 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:54.775805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c4aed20f-867b-4d74-88cd-4e6316d6c184 None None] MFA Rules not processed for user `656876150d884e58a510d2f949cd3f86`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:54.779292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c4aed20f-867b-4d74-88cd-4e6316d6c184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:54.910067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:54.989982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19671125-2aed-477e-a954-f8462c211a12 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:55.011560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2ec01-91bf-4e9b-9653-12432a80dba2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:55.014326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2ec01-91bf-4e9b-9653-12432a80dba2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:55.015684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2ec01-91bf-4e9b-9653-12432a80dba2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:55.016719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2ec01-91bf-4e9b-9653-12432a80dba2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:55.020899 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3361/6717] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:55.024816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aed20f-867b-4d74-88cd-4e6316d6c184 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:55.027464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c4aed20f-867b-4d74-88cd-4e6316d6c184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:55.038924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2ec01-91bf-4e9b-9653-12432a80dba2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:55.044690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2ec01-91bf-4e9b-9653-12432a80dba2 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:55.090033 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3357/6718] 10.222.0.70 () {56 vars in 1308 bytes} [Sun Aug 28 19:20:54 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:55.092823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e890b53-8275-4187-82d0-a33b35bc8e6d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:55.093159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e890b53-8275-4187-82d0-a33b35bc8e6d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:55.093443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e890b53-8275-4187-82d0-a33b35bc8e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:55.113872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1e890b53-8275-4187-82d0-a33b35bc8e6d None None] MFA Rules not processed for user `921c222d770a412d8a16993785852fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:55.115106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1e890b53-8275-4187-82d0-a33b35bc8e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:55.155698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:55.207687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aed20f-867b-4d74-88cd-4e6316d6c184 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:55.233984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32b10e-40f6-4242-a532-69136f8a45bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:55.234724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32b10e-40f6-4242-a532-69136f8a45bb admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:55.235047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32b10e-40f6-4242-a532-69136f8a45bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:55.235324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32b10e-40f6-4242-a532-69136f8a45bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:55.235973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32b10e-40f6-4242-a532-69136f8a45bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:55.243437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32b10e-40f6-4242-a532-69136f8a45bb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:55.299451 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3358/6719] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:55 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 28 19:20:55.300531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e890b53-8275-4187-82d0-a33b35bc8e6d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:55.335133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e890b53-8275-4187-82d0-a33b35bc8e6d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:55.336221 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3362/6720] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:20:55 2022] POST /identity/v3/projects => generated 371 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:55.340887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32b10e-40f6-4242-a532-69136f8a45bb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:55.453841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951d318-e284-48a6-aa72-5242f9282f8a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:55.454412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951d318-e284-48a6-aa72-5242f9282f8a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:55.454701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951d318-e284-48a6-aa72-5242f9282f8a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:55.455012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951d318-e284-48a6-aa72-5242f9282f8a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/roles/f555ed6fde9e4f18ac35208703589a38` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:55.457258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951d318-e284-48a6-aa72-5242f9282f8a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f555ed6fde9e4f18ac35208703589a38)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:55.463095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951d318-e284-48a6-aa72-5242f9282f8a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:55.485278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32b10e-40f6-4242-a532-69136f8a45bb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:55.499991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4762b3b-e3c6-4d54-94d7-d86925938039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:55.501398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4762b3b-e3c6-4d54-94d7-d86925938039 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:55.501695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4762b3b-e3c6-4d54-94d7-d86925938039 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:55.501993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4762b3b-e3c6-4d54-94d7-d86925938039 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:55.502952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4762b3b-e3c6-4d54-94d7-d86925938039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:55.510266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4762b3b-e3c6-4d54-94d7-d86925938039 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:55.550954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c951d318-e284-48a6-aa72-5242f9282f8a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invalidating the token cache because role f555ed6fde9e4f18ac35208703589a38 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:55.551337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c951d318-e284-48a6-aa72-5242f9282f8a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:55.554003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c951d318-e284-48a6-aa72-5242f9282f8a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:55.563428 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3359/6721] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:55 2022] DELETE /identity/v3/roles/f555ed6fde9e4f18ac35208703589a38 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:55.566371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951d318-e284-48a6-aa72-5242f9282f8a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:55.567548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c951d318-e284-48a6-aa72-5242f9282f8a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:55.570303 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3363/6722] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:20:55 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:20:55.573878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4762b3b-e3c6-4d54-94d7-d86925938039 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:55.581069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c4762b3b-e3c6-4d54-94d7-d86925938039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:55.604003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4762b3b-e3c6-4d54-94d7-d86925938039 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:55.665511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:55.715585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951d318-e284-48a6-aa72-5242f9282f8a tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:55.755750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:55.756746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:55.757318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:55.761449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/projects/6d6e344ccbec4c269fd56bedc20b88a3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:55.768271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d6e344ccbec4c269fd56bedc20b88a3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:55.782272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:55.818196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc9b75-7ab7-4262-a476-42eeb88bd651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:55.819201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc9b75-7ab7-4262-a476-42eeb88bd651 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:55.819684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc9b75-7ab7-4262-a476-42eeb88bd651 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:55.820150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc9b75-7ab7-4262-a476-42eeb88bd651 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:55.820990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc9b75-7ab7-4262-a476-42eeb88bd651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:55.822948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc9b75-7ab7-4262-a476-42eeb88bd651 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:55.853863 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3364/6723] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:55.859139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc9b75-7ab7-4262-a476-42eeb88bd651 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:55.877938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc9b75-7ab7-4262-a476-42eeb88bd651 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:55.931040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a5149-3df9-40ef-9ff5-5fef9c6ae4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:55.932017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a5149-3df9-40ef-9ff5-5fef9c6ae4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:55.940713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a5149-3df9-40ef-9ff5-5fef9c6ae4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:55.941364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a5149-3df9-40ef-9ff5-5fef9c6ae4b4 admin admin] PATH_INFO: `/v3/projects/d2e5a1e3f1c34fe696781bad6a4272e4/users/3106e17937d2423a914c6e8d132a5de2/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:55.985324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a5149-3df9-40ef-9ff5-5fef9c6ae4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e5a1e3f1c34fe696781bad6a4272e4, user_id=3106e17937d2423a914c6e8d132a5de2, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:55.995226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a5149-3df9-40ef-9ff5-5fef9c6ae4b4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:56.026731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6e344ccbec4c269fd56bedc20b88a3', 'request_id': 'req-a3ca070f-af72-4cad-bd41-c1964d6f978f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:56.036956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6e344ccbec4c269fd56bedc20b88a3', 'request_id': 'req-a3ca070f-af72-4cad-bd41-c1964d6f978f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:56.042860 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3365/6724] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:55 2022] PUT /identity/v3/projects/d2e5a1e3f1c34fe696781bad6a4272e4/users/3106e17937d2423a914c6e8d132a5de2/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:56.045638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a5149-3df9-40ef-9ff5-5fef9c6ae4b4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:56.052146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6e344ccbec4c269fd56bedc20b88a3', 'request_id': 'req-a3ca070f-af72-4cad-bd41-c1964d6f978f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:56.084035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] The token cache is being invalidate because project 6d6e344ccbec4c269fd56bedc20b88a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:56.084837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:56.089414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:56.095730 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3360/6725] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:55 2022] DELETE /identity/v3/projects/6d6e344ccbec4c269fd56bedc20b88a3 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:56.099459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:56.102105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:56.148800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:56.205239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a5149-3df9-40ef-9ff5-5fef9c6ae4b4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:56.211124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb3fe5-3c7f-48e4-b175-f304afc66c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:56.211764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb3fe5-3c7f-48e4-b175-f304afc66c42 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:56.212051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb3fe5-3c7f-48e4-b175-f304afc66c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:56.212329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb3fe5-3c7f-48e4-b175-f304afc66c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:56.212984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb3fe5-3c7f-48e4-b175-f304afc66c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:56.216145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb3fe5-3c7f-48e4-b175-f304afc66c42 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:56.233544 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3366/6726] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:20:56.234078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb3fe5-3c7f-48e4-b175-f304afc66c42 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:56.236281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fcdb3fe5-3c7f-48e4-b175-f304afc66c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:56.247248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca070f-af72-4cad-bd41-c1964d6f978f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:56.252439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb3fe5-3c7f-48e4-b175-f304afc66c42 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:56.258726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d83049-7bb4-4d6c-b929-a07f114e07b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:56.266333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83049-7bb4-4d6c-b929-a07f114e07b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:56.267189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83049-7bb4-4d6c-b929-a07f114e07b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:56.267741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83049-7bb4-4d6c-b929-a07f114e07b2 admin admin] PATH_INFO: `/v3/projects/d2e5a1e3f1c34fe696781bad6a4272e4/users/3106e17937d2423a914c6e8d132a5de2/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:56.270222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d83049-7bb4-4d6c-b929-a07f114e07b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e5a1e3f1c34fe696781bad6a4272e4, user_id=3106e17937d2423a914c6e8d132a5de2, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:56.272798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d83049-7bb4-4d6c-b929-a07f114e07b2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:56.311739 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3367/6727] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:20:56 2022] PUT /identity/v3/projects/d2e5a1e3f1c34fe696781bad6a4272e4/users/3106e17937d2423a914c6e8d132a5de2/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:56.367450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc438b-9c62-4f9d-a82f-1bd990d44063 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:56.367959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc438b-9c62-4f9d-a82f-1bd990d44063 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:56.368244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc438b-9c62-4f9d-a82f-1bd990d44063 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:56.368518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc438b-9c62-4f9d-a82f-1bd990d44063 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/projects/6d6e344ccbec4c269fd56bedc20b88a3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:56.378125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc438b-9c62-4f9d-a82f-1bd990d44063 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d6e344ccbec4c269fd56bedc20b88a3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:56.380340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc438b-9c62-4f9d-a82f-1bd990d44063 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-d3dc438b-9c62-4f9d-a82f-1bd990d44063 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Could not find project: 6d6e344ccbec4c269fd56bedc20b88a3.: keystone.exception.ProjectNotFound: Could not find project: 6d6e344ccbec4c269fd56bedc20b88a3. Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 28 19:20:56.400035 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 28 19:20:56.401112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:20:56.401112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:20:56.401112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 28 19:20:56.401112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 28 19:20:56.401112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:20:56.401112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:20:56.401112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:20:56.401112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:20:56.401112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6d6e344ccbec4c269fd56bedc20b88a3. Aug 28 19:20:56.401112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:20:56.401828 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3361/6728] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:56 2022] DELETE /identity/v3/projects/6d6e344ccbec4c269fd56bedc20b88a3 => generated 113 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:20:56.405647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d83049-7bb4-4d6c-b929-a07f114e07b2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:56.584329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d83049-7bb4-4d6c-b929-a07f114e07b2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:56.600907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:56.601960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:56.602390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:56.602500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/projects/3287919317ec40a8a6d2e6f558aea188` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:56.608629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3287919317ec40a8a6d2e6f558aea188)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:56.612205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:56.683445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee865c-930c-4332-b633-bfbd3e78d8f0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:56.684130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee865c-930c-4332-b633-bfbd3e78d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:56.685704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee865c-930c-4332-b633-bfbd3e78d8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:56.724226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:56.738359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fcee865c-930c-4332-b633-bfbd3e78d8f0 None None] MFA Rules not processed for user `d0bd3c83dff64f27bd048defad379622`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:56.739966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3287919317ec40a8a6d2e6f558aea188', 'request_id': 'req-b0ed8780-e55b-42d3-b1de-a209073c66b3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:56.741710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fcee865c-930c-4332-b633-bfbd3e78d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:56.766436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3287919317ec40a8a6d2e6f558aea188', 'request_id': 'req-b0ed8780-e55b-42d3-b1de-a209073c66b3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:56.774257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3287919317ec40a8a6d2e6f558aea188', 'request_id': 'req-b0ed8780-e55b-42d3-b1de-a209073c66b3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:56.833488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] The token cache is being invalidate because project 3287919317ec40a8a6d2e6f558aea188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:20:56.837906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:56.839717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:56.843673 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3368/6729] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:20:56 2022] DELETE /identity/v3/projects/3287919317ec40a8a6d2e6f558aea188 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:56.861800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:56.867060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:56.874435 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3362/6730] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:20:56.876240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee865c-930c-4332-b633-bfbd3e78d8f0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:56.877916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fcee865c-930c-4332-b633-bfbd3e78d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:56.981999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee865c-930c-4332-b633-bfbd3e78d8f0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:56.988465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:56.989576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:56.990091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:56.990934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/users/921c222d770a412d8a16993785852fa9` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:56.993413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorizing `identity:delete_user(user_id=921c222d770a412d8a16993785852fa9)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:56.998109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:57.018715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:57.061383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed8780-e55b-42d3-b1de-a209073c66b3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:57.073658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3009d7-2e03-4b36-a284-d736c1525f6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:57.076677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3009d7-2e03-4b36-a284-d736c1525f6d service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:57.078241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3009d7-2e03-4b36-a284-d736c1525f6d service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:57.078691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3009d7-2e03-4b36-a284-d736c1525f6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:57.085117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dc3009d7-2e03-4b36-a284-d736c1525f6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:57.091768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '921c222d770a412d8a16993785852fa9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:57.110660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '921c222d770a412d8a16993785852fa9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:57.112740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '921c222d770a412d8a16993785852fa9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:57.131731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '921c222d770a412d8a16993785852fa9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:57.134136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '921c222d770a412d8a16993785852fa9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:57.196194 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3363/6731] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:56 2022] DELETE /identity/v3/users/921c222d770a412d8a16993785852fa9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:57.202564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:57.205192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:57.306765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3009d7-2e03-4b36-a284-d736c1525f6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:57.308961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3009d7-2e03-4b36-a284-d736c1525f6d service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:57.332476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:57.335325 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3369/6732] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:57.423975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d19eb-8879-4340-aec5-f6c0c5460a3f tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:57.436858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fa23f-3a60-4586-a046-ef687599c6f3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:57.437537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa23f-3a60-4586-a046-ef687599c6f3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:57.437820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa23f-3a60-4586-a046-ef687599c6f3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:57.438095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa23f-3a60-4586-a046-ef687599c6f3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/3cc08f9d6a36457f8ae49334da5953e4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:57.461276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fa23f-3a60-4586-a046-ef687599c6f3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-830fa23f-3a60-4586-a046-ef687599c6f3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Could not find domain: 3cc08f9d6a36457f8ae49334da5953e4.: keystone.exception.DomainNotFound: Could not find domain: 3cc08f9d6a36457f8ae49334da5953e4. Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3cc08f9d6a36457f8ae49334da5953e4. Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:20:57.493227 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:20:57.494245 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3cc08f9d6a36457f8ae49334da5953e4. Aug 28 19:20:57.495156 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:20:57.499935 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3364/6733] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:20:57 2022] PATCH /identity/v3/domains/3cc08f9d6a36457f8ae49334da5953e4 => generated 112 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:20:57.505635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3009d7-2e03-4b36-a284-d736c1525f6d service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:57.524515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3009d7-2e03-4b36-a284-d736c1525f6d service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:57.541226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3a5e7-c910-404c-828e-73b8db5c3315 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:57.542093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3a5e7-c910-404c-828e-73b8db5c3315 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:57.542365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3a5e7-c910-404c-828e-73b8db5c3315 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:57.542649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3a5e7-c910-404c-828e-73b8db5c3315 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/8cd73fbc720e464ea68b31363bc9785c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:57.594145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3a5e7-c910-404c-828e-73b8db5c3315 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-43c3a5e7-c910-404c-828e-73b8db5c3315 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Could not find domain: 8cd73fbc720e464ea68b31363bc9785c.: keystone.exception.DomainNotFound: Could not find domain: 8cd73fbc720e464ea68b31363bc9785c. Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8cd73fbc720e464ea68b31363bc9785c. Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:20:57.599369 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:20:57.601263 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8cd73fbc720e464ea68b31363bc9785c. Aug 28 19:20:57.602318 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:20:57.604862 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3370/6734] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:20:57 2022] PATCH /identity/v3/domains/8cd73fbc720e464ea68b31363bc9785c => generated 112 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:20:57.605350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fa23f-3a60-4586-a046-ef687599c6f3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:57.625124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fa23f-3a60-4586-a046-ef687599c6f3 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:57.636551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe94175-eb69-4f94-a3ef-1a2e2742bc51 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:57.637702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe94175-eb69-4f94-a3ef-1a2e2742bc51 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:57.637874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe94175-eb69-4f94-a3ef-1a2e2742bc51 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:57.638059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe94175-eb69-4f94-a3ef-1a2e2742bc51 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/385a95801ff24177b3e6f5cfffde6538` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:57.723503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe94175-eb69-4f94-a3ef-1a2e2742bc51 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-1fe94175-eb69-4f94-a3ef-1a2e2742bc51 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Could not find domain: 385a95801ff24177b3e6f5cfffde6538.: keystone.exception.DomainNotFound: Could not find domain: 385a95801ff24177b3e6f5cfffde6538. Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 385a95801ff24177b3e6f5cfffde6538. Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:20:57.752694 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:20:57.753748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 385a95801ff24177b3e6f5cfffde6538. Aug 28 19:20:57.754586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:20:57.759424 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3365/6735] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:20:57 2022] PATCH /identity/v3/domains/385a95801ff24177b3e6f5cfffde6538 => generated 112 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:20:57.761341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3a5e7-c910-404c-828e-73b8db5c3315 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:57.779096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3a5e7-c910-404c-828e-73b8db5c3315 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:57.804277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d5409-e311-4a5d-b501-bcf51198b532 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2fe3092484116943f826f92a45c10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4fee0b4969d4d58ba18badf22adc5aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:57.807174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d5409-e311-4a5d-b501-bcf51198b532 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:57.807174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d5409-e311-4a5d-b501-bcf51198b532 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:57.807174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d5409-e311-4a5d-b501-bcf51198b532 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] PATH_INFO: `/v3/domains/bf917c5c57e64385bfa384c2995d6983` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:57.826094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d5409-e311-4a5d-b501-bcf51198b532 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-9e2d5409-e311-4a5d-b501-bcf51198b532 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Could not find domain: bf917c5c57e64385bfa384c2995d6983.: keystone.exception.DomainNotFound: Could not find domain: bf917c5c57e64385bfa384c2995d6983. Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bf917c5c57e64385bfa384c2995d6983. Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:20:57.852662 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:20:57.853748 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bf917c5c57e64385bfa384c2995d6983. Aug 28 19:20:57.854582 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:20:57.859766 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3371/6736] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:20:57 2022] PATCH /identity/v3/domains/bf917c5c57e64385bfa384c2995d6983 => generated 112 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:20:57.861870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe94175-eb69-4f94-a3ef-1a2e2742bc51 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:57.864523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1fe94175-eb69-4f94-a3ef-1a2e2742bc51 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:58.135401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe94175-eb69-4f94-a3ef-1a2e2742bc51 tempest-TokensV3TestJSON-106555605 tempest-TokensV3TestJSON-106555605-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:58.179980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:58.181052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:58.189006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:58.189006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] PATH_INFO: `/v3/users/b77092d5d97145f8b6e2b41d7eb8cf7c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:58.197594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b77092d5d97145f8b6e2b41d7eb8cf7c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:58.202591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:58.356786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b77092d5d97145f8b6e2b41d7eb8cf7c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:58.366196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b77092d5d97145f8b6e2b41d7eb8cf7c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:58.367010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b77092d5d97145f8b6e2b41d7eb8cf7c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:58.390275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b77092d5d97145f8b6e2b41d7eb8cf7c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:58.391220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b77092d5d97145f8b6e2b41d7eb8cf7c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:20:58.421792 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3366/6737] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:20:57 2022] DELETE /identity/v3/users/b77092d5d97145f8b6e2b41d7eb8cf7c => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:20:58.423386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0f02c-c885-4803-8675-580db3346018 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:58.423679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0f02c-c885-4803-8675-580db3346018 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:58.424030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0f02c-c885-4803-8675-580db3346018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:58.463979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a2f0f02c-c885-4803-8675-580db3346018 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:20:58.466372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a2f0f02c-c885-4803-8675-580db3346018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:58.678755 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3372/6738] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:20:58.896959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:58.899465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:59.072963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:20:59.130130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7093d-efeb-482f-9513-840ba605be41 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:59.150396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682662d-58bb-462b-b547-bd59b6f31aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:59.151102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682662d-58bb-462b-b547-bd59b6f31aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:59.151353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682662d-58bb-462b-b547-bd59b6f31aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:59.151631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682662d-58bb-462b-b547-bd59b6f31aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:59.185977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682662d-58bb-462b-b547-bd59b6f31aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:59.187493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682662d-58bb-462b-b547-bd59b6f31aa4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:59.222850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0f02c-c885-4803-8675-580db3346018 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:20:59.234360 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3367/6739] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:20:59.254964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0f02c-c885-4803-8675-580db3346018 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:20:59.265805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac00f-9c4e-4ebb-9082-d97ccb69ab6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:20:59.266463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac00f-9c4e-4ebb-9082-d97ccb69ab6a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:20:59.266675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac00f-9c4e-4ebb-9082-d97ccb69ab6a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:20:59.266994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac00f-9c4e-4ebb-9082-d97ccb69ab6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:20:59.276029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-67aac00f-9c4e-4ebb-9082-d97ccb69ab6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:20:59.299736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aac00f-9c4e-4ebb-9082-d97ccb69ab6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:20:59.301306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aac00f-9c4e-4ebb-9082-d97ccb69ab6a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:20:59.330944 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3373/6740] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:20:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:21:01.025835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682662d-58bb-462b-b547-bd59b6f31aa4 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:01.027506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b682662d-58bb-462b-b547-bd59b6f31aa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:01.091447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682662d-58bb-462b-b547-bd59b6f31aa4 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:01.119242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:01.119986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:01.120275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:01.120576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] PATH_INFO: `/v3/projects/1221a520a42841b487070ba8f66c7e64` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:01.131354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1221a520a42841b487070ba8f66c7e64)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:01.133339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:01.298372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1221a520a42841b487070ba8f66c7e64', 'request_id': 'req-aaadcb73-f7a2-4eae-9598-0acb9f54b515'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:01.311381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1221a520a42841b487070ba8f66c7e64', 'request_id': 'req-aaadcb73-f7a2-4eae-9598-0acb9f54b515'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:01.331663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1221a520a42841b487070ba8f66c7e64', 'request_id': 'req-aaadcb73-f7a2-4eae-9598-0acb9f54b515'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:01.353991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] The token cache is being invalidate because project 1221a520a42841b487070ba8f66c7e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:01.354300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:01.355112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:01.358544 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3368/6741] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:01 2022] DELETE /identity/v3/projects/1221a520a42841b487070ba8f66c7e64 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:01.362194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac00f-9c4e-4ebb-9082-d97ccb69ab6a service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:01.378943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac00f-9c4e-4ebb-9082-d97ccb69ab6a service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:01.499468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:01.501115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:01.501460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:01.501828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] PATH_INFO: `/v3/users/54e2fe3092484116943f826f92a45c10` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:01.503286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e2fe3092484116943f826f92a45c10)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:01.507156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:01.510854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:01.659628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e2fe3092484116943f826f92a45c10'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:01.693748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e2fe3092484116943f826f92a45c10'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:01.696338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e2fe3092484116943f826f92a45c10'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:01.787335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e2fe3092484116943f826f92a45c10'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:01.790958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e2fe3092484116943f826f92a45c10'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:01.860994 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3374/6742] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:01 2022] DELETE /identity/v3/users/54e2fe3092484116943f826f92a45c10 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:21:02.991602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:02.993201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:03.015703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadcb73-f7a2-4eae-9598-0acb9f54b515 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:03.137781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8473e-3de1-4cc8-9679-0595bacf5e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:03.139236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8473e-3de1-4cc8-9679-0595bacf5e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:03.139927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8473e-3de1-4cc8-9679-0595bacf5e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:03.140356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8473e-3de1-4cc8-9679-0595bacf5e5d admin admin] PATH_INFO: `/v3/projects/d4fee0b4969d4d58ba18badf22adc5aa` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:03.143231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8473e-3de1-4cc8-9679-0595bacf5e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4fee0b4969d4d58ba18badf22adc5aa)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:03.147476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8473e-3de1-4cc8-9679-0595bacf5e5d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:03.251811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-72b8473e-3de1-4cc8-9679-0595bacf5e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4fee0b4969d4d58ba18badf22adc5aa', 'request_id': 'req-72b8473e-3de1-4cc8-9679-0595bacf5e5d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:03.273188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-72b8473e-3de1-4cc8-9679-0595bacf5e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4fee0b4969d4d58ba18badf22adc5aa', 'request_id': 'req-72b8473e-3de1-4cc8-9679-0595bacf5e5d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:03.290528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-72b8473e-3de1-4cc8-9679-0595bacf5e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4fee0b4969d4d58ba18badf22adc5aa', 'request_id': 'req-72b8473e-3de1-4cc8-9679-0595bacf5e5d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:03.296105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:03.320968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-72b8473e-3de1-4cc8-9679-0595bacf5e5d admin admin] The token cache is being invalidate because project d4fee0b4969d4d58ba18badf22adc5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:03.321257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-72b8473e-3de1-4cc8-9679-0595bacf5e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:03.321912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-72b8473e-3de1-4cc8-9679-0595bacf5e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:03.323605 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3369/6743] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:02 2022] DELETE /identity/v3/projects/d4fee0b4969d4d58ba18badf22adc5aa => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:03.328632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:03.330248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:03.356520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ec563-1e13-40aa-a2aa-45de077e626f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:03.545638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:03.546518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:03.547085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:03.547535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] PATH_INFO: `/v3/users/5d6815766d9e43a294e66a0aa99057fd` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:03.549604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6815766d9e43a294e66a0aa99057fd)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:03.559984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:03.665529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7417c3b-b76c-4534-9bb5-2e9df7da8612 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:03.665829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7417c3b-b76c-4534-9bb5-2e9df7da8612 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:03.666129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7417c3b-b76c-4534-9bb5-2e9df7da8612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:03.711749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6815766d9e43a294e66a0aa99057fd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:03.722445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c7417c3b-b76c-4534-9bb5-2e9df7da8612 None None] MFA Rules not processed for user `6f8442e91abe4b1f8439b1571a4ee385`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:03.725019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c7417c3b-b76c-4534-9bb5-2e9df7da8612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:03.732185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6815766d9e43a294e66a0aa99057fd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:03.732926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6815766d9e43a294e66a0aa99057fd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:03.761173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6815766d9e43a294e66a0aa99057fd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:03.762050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6815766d9e43a294e66a0aa99057fd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:03.787399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:03.792470 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3375/6744] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:03 2022] DELETE /identity/v3/users/5d6815766d9e43a294e66a0aa99057fd => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:03.935548 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3370/6745] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:04.568035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:04.571242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:04.719988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4def79-ac81-43ff-a342-9500c7c5f8e3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:04.733360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28007a0a-780c-4c42-89db-37e550dad556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:04.735568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28007a0a-780c-4c42-89db-37e550dad556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:04.736061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28007a0a-780c-4c42-89db-37e550dad556 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:04.736801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28007a0a-780c-4c42-89db-37e550dad556 admin admin] PATH_INFO: `/v3/projects/6d8e48a9c1ce4b6e83709cd1119950a5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:04.744417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28007a0a-780c-4c42-89db-37e550dad556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8e48a9c1ce4b6e83709cd1119950a5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:04.748483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28007a0a-780c-4c42-89db-37e550dad556 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:04.863332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28007a0a-780c-4c42-89db-37e550dad556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8e48a9c1ce4b6e83709cd1119950a5', 'request_id': 'req-28007a0a-780c-4c42-89db-37e550dad556'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:04.886838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28007a0a-780c-4c42-89db-37e550dad556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8e48a9c1ce4b6e83709cd1119950a5', 'request_id': 'req-28007a0a-780c-4c42-89db-37e550dad556'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:04.897972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28007a0a-780c-4c42-89db-37e550dad556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8e48a9c1ce4b6e83709cd1119950a5', 'request_id': 'req-28007a0a-780c-4c42-89db-37e550dad556'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:04.932573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28007a0a-780c-4c42-89db-37e550dad556 admin admin] The token cache is being invalidate because project 6d8e48a9c1ce4b6e83709cd1119950a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:04.932880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28007a0a-780c-4c42-89db-37e550dad556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:04.933975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-28007a0a-780c-4c42-89db-37e550dad556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:04.936307 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3376/6746] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:04 2022] DELETE /identity/v3/projects/6d8e48a9c1ce4b6e83709cd1119950a5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:04.941181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84085e5-f970-4222-8ac0-98a2bd7b27ee None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:04.942155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84085e5-f970-4222-8ac0-98a2bd7b27ee None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:04.942996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84085e5-f970-4222-8ac0-98a2bd7b27ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:05.008030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e84085e5-f970-4222-8ac0-98a2bd7b27ee None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:05.013246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e84085e5-f970-4222-8ac0-98a2bd7b27ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:05.131278 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3371/6747] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:05.134260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3c702-88c4-49bd-8324-6e417511ebb8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:05.134580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3c702-88c4-49bd-8324-6e417511ebb8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:05.134890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3c702-88c4-49bd-8324-6e417511ebb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:05.175171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ace3c702-88c4-49bd-8324-6e417511ebb8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:05.175714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ace3c702-88c4-49bd-8324-6e417511ebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:05.192378 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3377/6748] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:05.199312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84085e5-f970-4222-8ac0-98a2bd7b27ee None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:05.236907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84085e5-f970-4222-8ac0-98a2bd7b27ee None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:05.254941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3882489-5fc4-44fb-82a7-9ff63d4063d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:05.255819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3882489-5fc4-44fb-82a7-9ff63d4063d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:05.258247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3882489-5fc4-44fb-82a7-9ff63d4063d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:05.259366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3882489-5fc4-44fb-82a7-9ff63d4063d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:05.260631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3882489-5fc4-44fb-82a7-9ff63d4063d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:21:05.265161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3882489-5fc4-44fb-82a7-9ff63d4063d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:05.268259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3882489-5fc4-44fb-82a7-9ff63d4063d8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:05.308532 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3372/6749] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:05.313600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3c702-88c4-49bd-8324-6e417511ebb8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:05.335426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3c702-88c4-49bd-8324-6e417511ebb8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:05.352273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a1541-06c3-4059-b670-f738a9eafc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:05.353540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a1541-06c3-4059-b670-f738a9eafc5d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:05.353946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a1541-06c3-4059-b670-f738a9eafc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:05.361068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a1541-06c3-4059-b670-f738a9eafc5d admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:05.362218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a1541-06c3-4059-b670-f738a9eafc5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:05.364382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a1541-06c3-4059-b670-f738a9eafc5d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:05.458780 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3378/6750] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:05 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:05.460168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3882489-5fc4-44fb-82a7-9ff63d4063d8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:05.475149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3882489-5fc4-44fb-82a7-9ff63d4063d8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:05.589544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb84c78-689c-4965-a73c-fd5413afce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:05.608697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb84c78-689c-4965-a73c-fd5413afce87 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:05.609334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb84c78-689c-4965-a73c-fd5413afce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:05.609634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb84c78-689c-4965-a73c-fd5413afce87 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:05.610356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb84c78-689c-4965-a73c-fd5413afce87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:05.612419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb84c78-689c-4965-a73c-fd5413afce87 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:05.681863 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3373/6751] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:05 2022] POST /identity/v3/users => generated 284 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:05.685471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a1541-06c3-4059-b670-f738a9eafc5d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:05.703552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a1541-06c3-4059-b670-f738a9eafc5d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:05.717772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec44d90-65a2-4113-a5ba-10d40bb4ee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:05.718586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec44d90-65a2-4113-a5ba-10d40bb4ee0b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:05.719165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec44d90-65a2-4113-a5ba-10d40bb4ee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:05.719462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec44d90-65a2-4113-a5ba-10d40bb4ee0b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:05.720127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec44d90-65a2-4113-a5ba-10d40bb4ee0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:05.721762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec44d90-65a2-4113-a5ba-10d40bb4ee0b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:05.752846 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3379/6752] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:05.754590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb84c78-689c-4965-a73c-fd5413afce87 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:05.768282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb84c78-689c-4965-a73c-fd5413afce87 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:05.782316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035b208-7cbe-41bd-9d34-1d745b3ec3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:05.783571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035b208-7cbe-41bd-9d34-1d745b3ec3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:05.784071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035b208-7cbe-41bd-9d34-1d745b3ec3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:05.784706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035b208-7cbe-41bd-9d34-1d745b3ec3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:05.785908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035b208-7cbe-41bd-9d34-1d745b3ec3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:05.789596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035b208-7cbe-41bd-9d34-1d745b3ec3c1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:05.793652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:05.826683 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3374/6753] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:05.827762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec44d90-65a2-4113-a5ba-10d40bb4ee0b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:05.845214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec44d90-65a2-4113-a5ba-10d40bb4ee0b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:05.861691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35f5c9-8f90-4e99-bf27-3232247ae322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:05.864028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35f5c9-8f90-4e99-bf27-3232247ae322 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:05.864324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35f5c9-8f90-4e99-bf27-3232247ae322 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:05.864607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35f5c9-8f90-4e99-bf27-3232247ae322 admin admin] PATH_INFO: `/v3/projects/28456a95dd0a4a5da99fe75d4adb2307/users/861df4962fbb4b66bd3a82aa545dc85e/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:05.891414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35f5c9-8f90-4e99-bf27-3232247ae322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28456a95dd0a4a5da99fe75d4adb2307, user_id=861df4962fbb4b66bd3a82aa545dc85e, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:05.896394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35f5c9-8f90-4e99-bf27-3232247ae322 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:05.939447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d4daf-00a4-4cd0-9e5d-7ad1cc288e0e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:05.939884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d4daf-00a4-4cd0-9e5d-7ad1cc288e0e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:05.940271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d4daf-00a4-4cd0-9e5d-7ad1cc288e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:05.943297 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3380/6754] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:05 2022] PUT /identity/v3/projects/28456a95dd0a4a5da99fe75d4adb2307/users/861df4962fbb4b66bd3a82aa545dc85e/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:05.980494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-de9d4daf-00a4-4cd0-9e5d-7ad1cc288e0e None None] MFA Rules not processed for user `861df4962fbb4b66bd3a82aa545dc85e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:05.982297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-de9d4daf-00a4-4cd0-9e5d-7ad1cc288e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:06.104282 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3375/6755] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:06.109690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35f5c9-8f90-4e99-bf27-3232247ae322 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:06.183682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:06.271306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35f5c9-8f90-4e99-bf27-3232247ae322 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:06.287251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440dbd6-1042-4062-8e75-792e749ca354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:06.287906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440dbd6-1042-4062-8e75-792e749ca354 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:06.288205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440dbd6-1042-4062-8e75-792e749ca354 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:06.288491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440dbd6-1042-4062-8e75-792e749ca354 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:06.289789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440dbd6-1042-4062-8e75-792e749ca354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:06.295411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440dbd6-1042-4062-8e75-792e749ca354 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:06.384304 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3381/6756] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:06 2022] POST /identity/v3/projects => generated 363 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:06.389895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d4daf-00a4-4cd0-9e5d-7ad1cc288e0e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:06.414178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d4daf-00a4-4cd0-9e5d-7ad1cc288e0e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:06.540235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acee32-1a57-4510-aa99-05a4bd6dff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:06.540876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acee32-1a57-4510-aa99-05a4bd6dff53 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:06.541264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acee32-1a57-4510-aa99-05a4bd6dff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:06.541448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acee32-1a57-4510-aa99-05a4bd6dff53 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:06.542068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acee32-1a57-4510-aa99-05a4bd6dff53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:06.545472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acee32-1a57-4510-aa99-05a4bd6dff53 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:06.616224 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3376/6757] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:06 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:21:06.620609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440dbd6-1042-4062-8e75-792e749ca354 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:06.635841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440dbd6-1042-4062-8e75-792e749ca354 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:06.643287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82636fed-20d0-4e9b-b785-1d6fcf68b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:06.644013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82636fed-20d0-4e9b-b785-1d6fcf68b5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:06.644376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82636fed-20d0-4e9b-b785-1d6fcf68b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:06.644726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82636fed-20d0-4e9b-b785-1d6fcf68b5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:06.647237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82636fed-20d0-4e9b-b785-1d6fcf68b5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:06.650029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82636fed-20d0-4e9b-b785-1d6fcf68b5f8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:06.666518 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3382/6758] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:06.669537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acee32-1a57-4510-aa99-05a4bd6dff53 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:06.685742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acee32-1a57-4510-aa99-05a4bd6dff53 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:06.698109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd706a59-cb3f-49be-b2a1-fbb3598e3130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:06.698922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd706a59-cb3f-49be-b2a1-fbb3598e3130 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:06.699795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd706a59-cb3f-49be-b2a1-fbb3598e3130 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:06.701067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd706a59-cb3f-49be-b2a1-fbb3598e3130 admin admin] PATH_INFO: `/v3/projects/5a2fe0a6de4a4f769c3fa1c5668fe960/users/f7f6e55692b6473aba20be67ac9d43a5/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:06.729226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd706a59-cb3f-49be-b2a1-fbb3598e3130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2fe0a6de4a4f769c3fa1c5668fe960, user_id=f7f6e55692b6473aba20be67ac9d43a5, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:06.732990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd706a59-cb3f-49be-b2a1-fbb3598e3130 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:06.755456 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3377/6759] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:06 2022] PUT /identity/v3/projects/5a2fe0a6de4a4f769c3fa1c5668fe960/users/f7f6e55692b6473aba20be67ac9d43a5/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:21:06.756673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82636fed-20d0-4e9b-b785-1d6fcf68b5f8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:06.773287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82636fed-20d0-4e9b-b785-1d6fcf68b5f8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:06.953233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b18e60-dc0d-47e5-89f9-d1d3a6c3f3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:06.954017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b18e60-dc0d-47e5-89f9-d1d3a6c3f3cb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:06.955233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b18e60-dc0d-47e5-89f9-d1d3a6c3f3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:06.955520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b18e60-dc0d-47e5-89f9-d1d3a6c3f3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:06.956190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b18e60-dc0d-47e5-89f9-d1d3a6c3f3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:06.957849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b18e60-dc0d-47e5-89f9-d1d3a6c3f3cb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:06.989626 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3383/6760] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:06.995479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd706a59-cb3f-49be-b2a1-fbb3598e3130 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:07.019025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd706a59-cb3f-49be-b2a1-fbb3598e3130 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:07.025607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fe739-451a-49b6-aab7-006a3eae004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:07.026543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fe739-451a-49b6-aab7-006a3eae004b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:07.026932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fe739-451a-49b6-aab7-006a3eae004b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:07.027216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fe739-451a-49b6-aab7-006a3eae004b admin admin] PATH_INFO: `/v3/projects/5a2fe0a6de4a4f769c3fa1c5668fe960/users/f7f6e55692b6473aba20be67ac9d43a5/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:07.030438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fe739-451a-49b6-aab7-006a3eae004b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2fe0a6de4a4f769c3fa1c5668fe960, user_id=f7f6e55692b6473aba20be67ac9d43a5, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:07.034537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fe739-451a-49b6-aab7-006a3eae004b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:07.066970 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3378/6761] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:06 2022] PUT /identity/v3/projects/5a2fe0a6de4a4f769c3fa1c5668fe960/users/f7f6e55692b6473aba20be67ac9d43a5/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:07.078930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8df799-201f-4281-a370-f614048b8c07 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:07.079437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8df799-201f-4281-a370-f614048b8c07 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:07.080456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8df799-201f-4281-a370-f614048b8c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:07.126211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fd8df799-201f-4281-a370-f614048b8c07 None None] MFA Rules not processed for user `f7f6e55692b6473aba20be67ac9d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:07.128176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fd8df799-201f-4281-a370-f614048b8c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:07.259118 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3384/6762] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:07.260032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fe739-451a-49b6-aab7-006a3eae004b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:07.274232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fe739-451a-49b6-aab7-006a3eae004b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:07.280146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd294858-ee90-4e54-9089-1ce7ff1afe60 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:07.280858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd294858-ee90-4e54-9089-1ce7ff1afe60 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:07.281215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd294858-ee90-4e54-9089-1ce7ff1afe60 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:07.281609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd294858-ee90-4e54-9089-1ce7ff1afe60 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:07.282363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd294858-ee90-4e54-9089-1ce7ff1afe60 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:07.284668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd294858-ee90-4e54-9089-1ce7ff1afe60 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:07.332707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8df799-201f-4281-a370-f614048b8c07 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:07.343523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8df799-201f-4281-a370-f614048b8c07 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:07.344142 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3379/6763] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:07 2022] POST /identity/v3/projects => generated 360 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:07.371319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:07.455112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1399ac-e6fd-469b-b66b-a7b099d6e7bc tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:07.455804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1399ac-e6fd-469b-b66b-a7b099d6e7bc tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:07.456100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1399ac-e6fd-469b-b66b-a7b099d6e7bc tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:07.456383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1399ac-e6fd-469b-b66b-a7b099d6e7bc tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:07.457475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1399ac-e6fd-469b-b66b-a7b099d6e7bc tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:07.459984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1399ac-e6fd-469b-b66b-a7b099d6e7bc tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:07.513977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd294858-ee90-4e54-9089-1ce7ff1afe60 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:07.538541 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3385/6764] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:07 2022] POST /identity/v3/users => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:07.549963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd294858-ee90-4e54-9089-1ce7ff1afe60 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:07.565150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd72c0-beb1-4acd-981c-6a403e7a0c58 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:07.567539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd72c0-beb1-4acd-981c-6a403e7a0c58 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:07.567708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd72c0-beb1-4acd-981c-6a403e7a0c58 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:07.568632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd72c0-beb1-4acd-981c-6a403e7a0c58 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/ff2a698044ef4764bfce2c7ec176a836` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:07.593593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd72c0-beb1-4acd-981c-6a403e7a0c58 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:get_user(user_id=ff2a698044ef4764bfce2c7ec176a836)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:07.596295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd72c0-beb1-4acd-981c-6a403e7a0c58 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:07.603425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1399ac-e6fd-469b-b66b-a7b099d6e7bc tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:07.615340 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3380/6765] 10.222.0.70 () {58 vars in 1221 bytes} [Sun Aug 28 19:21:07 2022] GET /identity/v3/users/ff2a698044ef4764bfce2c7ec176a836 => generated 373 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:07.619980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1399ac-e6fd-469b-b66b-a7b099d6e7bc tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:07.628867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164a7be-b7f3-4a77-bad5-3ae0464787b0 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:07.629558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164a7be-b7f3-4a77-bad5-3ae0464787b0 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:07.629876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164a7be-b7f3-4a77-bad5-3ae0464787b0 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:07.630214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164a7be-b7f3-4a77-bad5-3ae0464787b0 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/ff2a698044ef4764bfce2c7ec176a836` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:07.632235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164a7be-b7f3-4a77-bad5-3ae0464787b0 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ff2a698044ef4764bfce2c7ec176a836)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:07.641762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164a7be-b7f3-4a77-bad5-3ae0464787b0 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:07.760739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0164a7be-b7f3-4a77-bad5-3ae0464787b0 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2a698044ef4764bfce2c7ec176a836'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:07.776843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0164a7be-b7f3-4a77-bad5-3ae0464787b0 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2a698044ef4764bfce2c7ec176a836'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:07.779672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0164a7be-b7f3-4a77-bad5-3ae0464787b0 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2a698044ef4764bfce2c7ec176a836'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:07.808468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0164a7be-b7f3-4a77-bad5-3ae0464787b0 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2a698044ef4764bfce2c7ec176a836'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:07.810398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0164a7be-b7f3-4a77-bad5-3ae0464787b0 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2a698044ef4764bfce2c7ec176a836'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:07.842434 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3386/6766] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:07 2022] DELETE /identity/v3/users/ff2a698044ef4764bfce2c7ec176a836 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:07.846595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd72c0-beb1-4acd-981c-6a403e7a0c58 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:07.849158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1ddd72c0-beb1-4acd-981c-6a403e7a0c58 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:07.866163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:07.884837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd72c0-beb1-4acd-981c-6a403e7a0c58 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:07.997706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:07.998225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:07.998225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:07.998660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects/a14ef316e66b4ecea4fd399d031b1bbc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:08.001122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a14ef316e66b4ecea4fd399d031b1bbc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:08.004923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:08.121640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14ef316e66b4ecea4fd399d031b1bbc', 'request_id': 'req-4e8f66ea-640f-4f2f-9970-592759b3416c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:08.138054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14ef316e66b4ecea4fd399d031b1bbc', 'request_id': 'req-4e8f66ea-640f-4f2f-9970-592759b3416c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:08.152522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14ef316e66b4ecea4fd399d031b1bbc', 'request_id': 'req-4e8f66ea-640f-4f2f-9970-592759b3416c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:08.179029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] The token cache is being invalidate because project a14ef316e66b4ecea4fd399d031b1bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:08.179324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:08.180431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:08.191043 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3381/6767] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:07 2022] DELETE /identity/v3/projects/a14ef316e66b4ecea4fd399d031b1bbc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:08.193259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164a7be-b7f3-4a77-bad5-3ae0464787b0 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:08.208899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164a7be-b7f3-4a77-bad5-3ae0464787b0 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:08.391901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414242c7-b160-43a1-b251-0c7a8dff08bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:08.395527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414242c7-b160-43a1-b251-0c7a8dff08bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:08.396041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414242c7-b160-43a1-b251-0c7a8dff08bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:08.396477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414242c7-b160-43a1-b251-0c7a8dff08bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:08.398579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414242c7-b160-43a1-b251-0c7a8dff08bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:08.408278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414242c7-b160-43a1-b251-0c7a8dff08bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:08.505561 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3387/6768] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:08 2022] POST /identity/v3/projects => generated 359 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:08.505748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:08.507382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:08.539083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f66ea-640f-4f2f-9970-592759b3416c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:08.873257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b769a-b28e-48b4-8ca0-9ffb28a151bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:08.873911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b769a-b28e-48b4-8ca0-9ffb28a151bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:08.874194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b769a-b28e-48b4-8ca0-9ffb28a151bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:08.874478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b769a-b28e-48b4-8ca0-9ffb28a151bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:08.876847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b769a-b28e-48b4-8ca0-9ffb28a151bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:08.878589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b769a-b28e-48b4-8ca0-9ffb28a151bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:09.048977 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3382/6769] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:08 2022] POST /identity/v3/users => generated 417 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:09.050995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414242c7-b160-43a1-b251-0c7a8dff08bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:09.064740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414242c7-b160-43a1-b251-0c7a8dff08bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:09.097838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837ba1e-eaa4-46fe-87ee-442955395294 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:09.098729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837ba1e-eaa4-46fe-87ee-442955395294 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:09.100199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837ba1e-eaa4-46fe-87ee-442955395294 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:09.100892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837ba1e-eaa4-46fe-87ee-442955395294 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:09.106923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837ba1e-eaa4-46fe-87ee-442955395294 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:09.118932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837ba1e-eaa4-46fe-87ee-442955395294 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:09.132597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:09.178459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b769a-b28e-48b4-8ca0-9ffb28a151bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:09.191929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b769a-b28e-48b4-8ca0-9ffb28a151bb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:09.192909 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3388/6770] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:21:09 2022] POST /identity/v3/roles => generated 239 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:09.212796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d955e-8ba5-4e9c-a861-78cf57361b85 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:09.213461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d955e-8ba5-4e9c-a861-78cf57361b85 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:09.213752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d955e-8ba5-4e9c-a861-78cf57361b85 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:09.214036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d955e-8ba5-4e9c-a861-78cf57361b85 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/212f015ab687467eb8f36b649afff087` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:09.248347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d955e-8ba5-4e9c-a861-78cf57361b85 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:get_user(user_id=212f015ab687467eb8f36b649afff087)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:09.252442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d955e-8ba5-4e9c-a861-78cf57361b85 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:09.270395 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3383/6771] 10.222.0.70 () {58 vars in 1221 bytes} [Sun Aug 28 19:21:09 2022] GET /identity/v3/users/212f015ab687467eb8f36b649afff087 => generated 417 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:09.273873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837ba1e-eaa4-46fe-87ee-442955395294 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:09.303070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837ba1e-eaa4-46fe-87ee-442955395294 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:09.322358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1ad45-9cbd-4932-aaa3-0d24188f960d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:09.323074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ad45-9cbd-4932-aaa3-0d24188f960d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:09.328395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ad45-9cbd-4932-aaa3-0d24188f960d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:09.328886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1ad45-9cbd-4932-aaa3-0d24188f960d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/roles/39dfa2e68fe74400a837dfb26c14edde` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:09.333439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1ad45-9cbd-4932-aaa3-0d24188f960d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:get_role(role_id=39dfa2e68fe74400a837dfb26c14edde)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:09.341657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1ad45-9cbd-4932-aaa3-0d24188f960d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:09.348082 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3389/6772] 10.222.0.70 () {58 vars in 1221 bytes} [Sun Aug 28 19:21:09 2022] GET /identity/v3/roles/39dfa2e68fe74400a837dfb26c14edde => generated 239 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:21:09.353313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d955e-8ba5-4e9c-a861-78cf57361b85 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:09.379803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d955e-8ba5-4e9c-a861-78cf57361b85 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:09.392064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe9583-edf9-490b-a1a4-a922d5f0737d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:09.393285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe9583-edf9-490b-a1a4-a922d5f0737d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:09.393984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe9583-edf9-490b-a1a4-a922d5f0737d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:09.394735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe9583-edf9-490b-a1a4-a922d5f0737d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:09.396266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe9583-edf9-490b-a1a4-a922d5f0737d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:09.400957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe9583-edf9-490b-a1a4-a922d5f0737d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:09.419967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:09.496804 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3384/6773] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:09 2022] POST /identity/v3/projects => generated 360 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:21:09.498076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1ad45-9cbd-4932-aaa3-0d24188f960d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:09.515465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1ad45-9cbd-4932-aaa3-0d24188f960d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:09.713069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ba767-c2c6-4691-8be3-27315b76792e tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:09.714414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba767-c2c6-4691-8be3-27315b76792e tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:09.716165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba767-c2c6-4691-8be3-27315b76792e tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:09.717370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba767-c2c6-4691-8be3-27315b76792e tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects/cedca1a9039e4b4582168ccbe4d0c311` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:09.721094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ba767-c2c6-4691-8be3-27315b76792e tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:get_project(project_id=cedca1a9039e4b4582168ccbe4d0c311)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:09.725344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ba767-c2c6-4691-8be3-27315b76792e tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:09.733390 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3390/6774] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:21:09 2022] GET /identity/v3/projects/cedca1a9039e4b4582168ccbe4d0c311 => generated 360 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:09.737910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe9583-edf9-490b-a1a4-a922d5f0737d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:09.769591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe9583-edf9-490b-a1a4-a922d5f0737d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:09.786596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef30b55-e8cd-485e-9e8f-543a94f6e7f3 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:09.788065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef30b55-e8cd-485e-9e8f-543a94f6e7f3 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:09.788357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef30b55-e8cd-485e-9e8f-543a94f6e7f3 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:09.788651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef30b55-e8cd-485e-9e8f-543a94f6e7f3 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects/cedca1a9039e4b4582168ccbe4d0c311/users/212f015ab687467eb8f36b649afff087/roles/39dfa2e68fe74400a837dfb26c14edde` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:09.810240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef30b55-e8cd-485e-9e8f-543a94f6e7f3 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cedca1a9039e4b4582168ccbe4d0c311, user_id=212f015ab687467eb8f36b649afff087, role_id=39dfa2e68fe74400a837dfb26c14edde)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:09.813135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef30b55-e8cd-485e-9e8f-543a94f6e7f3 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:09.837135 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3385/6775] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:09 2022] PUT /identity/v3/projects/cedca1a9039e4b4582168ccbe4d0c311/users/212f015ab687467eb8f36b649afff087/roles/39dfa2e68fe74400a837dfb26c14edde => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:09.843762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ba767-c2c6-4691-8be3-27315b76792e tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:09.892555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ba767-c2c6-4691-8be3-27315b76792e tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:10.191939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0b42c-6b3d-432e-9416-621abe3a1670 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:10.193555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0b42c-6b3d-432e-9416-621abe3a1670 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:10.193929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0b42c-6b3d-432e-9416-621abe3a1670 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:10.194320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0b42c-6b3d-432e-9416-621abe3a1670 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:10.195087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0b42c-6b3d-432e-9416-621abe3a1670 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:10.197895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0b42c-6b3d-432e-9416-621abe3a1670 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:10.294518 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3391/6776] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:09 2022] POST /identity/v3/projects => generated 360 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:10.295614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef30b55-e8cd-485e-9e8f-543a94f6e7f3 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:10.311489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef30b55-e8cd-485e-9e8f-543a94f6e7f3 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:10.422531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdaee4-33da-410c-93ba-6fe6e22245bf tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:10.423533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdaee4-33da-410c-93ba-6fe6e22245bf tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:10.425647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdaee4-33da-410c-93ba-6fe6e22245bf tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:10.426006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdaee4-33da-410c-93ba-6fe6e22245bf tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects/842a059e021a4f08a3a78930ea114ea5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:10.428791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdaee4-33da-410c-93ba-6fe6e22245bf tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:get_project(project_id=842a059e021a4f08a3a78930ea114ea5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:10.432393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdaee4-33da-410c-93ba-6fe6e22245bf tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:10.435354 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3386/6777] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:21:10 2022] GET /identity/v3/projects/842a059e021a4f08a3a78930ea114ea5 => generated 360 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:10.439724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0b42c-6b3d-432e-9416-621abe3a1670 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:10.452669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0b42c-6b3d-432e-9416-621abe3a1670 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:10.460497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bf678-fe17-48f9-b9e4-6fe82c0dc970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:10.461346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bf678-fe17-48f9-b9e4-6fe82c0dc970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:10.461861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bf678-fe17-48f9-b9e4-6fe82c0dc970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:10.462234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bf678-fe17-48f9-b9e4-6fe82c0dc970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects/842a059e021a4f08a3a78930ea114ea5/users/212f015ab687467eb8f36b649afff087/roles/39dfa2e68fe74400a837dfb26c14edde` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:10.466199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bf678-fe17-48f9-b9e4-6fe82c0dc970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:create_grant(project_id=842a059e021a4f08a3a78930ea114ea5, user_id=212f015ab687467eb8f36b649afff087, role_id=39dfa2e68fe74400a837dfb26c14edde)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:10.470326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bf678-fe17-48f9-b9e4-6fe82c0dc970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:10.498891 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3392/6778] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:10 2022] PUT /identity/v3/projects/842a059e021a4f08a3a78930ea114ea5/users/212f015ab687467eb8f36b649afff087/roles/39dfa2e68fe74400a837dfb26c14edde => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:10.502858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdaee4-33da-410c-93ba-6fe6e22245bf tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:10.520927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdaee4-33da-410c-93ba-6fe6e22245bf tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:10.663421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71098198-b236-42f2-80ed-4725fb914169 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:10.664096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71098198-b236-42f2-80ed-4725fb914169 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:10.664385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71098198-b236-42f2-80ed-4725fb914169 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:10.664673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71098198-b236-42f2-80ed-4725fb914169 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/212f015ab687467eb8f36b649afff087/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:10.666560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71098198-b236-42f2-80ed-4725fb914169 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=212f015ab687467eb8f36b649afff087)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:10.673240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71098198-b236-42f2-80ed-4725fb914169 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:10.760670 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3387/6779] 10.222.0.70 () {58 vars in 1248 bytes} [Sun Aug 28 19:21:10 2022] GET /identity/v3/users/212f015ab687467eb8f36b649afff087/projects => generated 844 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:10.761855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bf678-fe17-48f9-b9e4-6fe82c0dc970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:10.796489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bf678-fe17-48f9-b9e4-6fe82c0dc970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:10.809994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b268413-7d5a-42d8-8974-0e9ba66a0076 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:10.810648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b268413-7d5a-42d8-8974-0e9ba66a0076 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:10.812604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b268413-7d5a-42d8-8974-0e9ba66a0076 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:10.812842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b268413-7d5a-42d8-8974-0e9ba66a0076 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects/842a059e021a4f08a3a78930ea114ea5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:10.815559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b268413-7d5a-42d8-8974-0e9ba66a0076 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:delete_project(project_id=842a059e021a4f08a3a78930ea114ea5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:10.822726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b268413-7d5a-42d8-8974-0e9ba66a0076 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:10.994970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8b268413-7d5a-42d8-8974-0e9ba66a0076 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842a059e021a4f08a3a78930ea114ea5', 'request_id': 'req-8b268413-7d5a-42d8-8974-0e9ba66a0076'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.014545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8b268413-7d5a-42d8-8974-0e9ba66a0076 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842a059e021a4f08a3a78930ea114ea5', 'request_id': 'req-8b268413-7d5a-42d8-8974-0e9ba66a0076'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.021185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:11.024511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8b268413-7d5a-42d8-8974-0e9ba66a0076 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842a059e021a4f08a3a78930ea114ea5', 'request_id': 'req-8b268413-7d5a-42d8-8974-0e9ba66a0076'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.047706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8b268413-7d5a-42d8-8974-0e9ba66a0076 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] The token cache is being invalidate because project 842a059e021a4f08a3a78930ea114ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:11.048008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8b268413-7d5a-42d8-8974-0e9ba66a0076 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.051663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8b268413-7d5a-42d8-8974-0e9ba66a0076 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.056175 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3393/6780] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:10 2022] DELETE /identity/v3/projects/842a059e021a4f08a3a78930ea114ea5 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:11.062339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71098198-b236-42f2-80ed-4725fb914169 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:11.070337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-71098198-b236-42f2-80ed-4725fb914169 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:11.080169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1299b-2860-404b-a0c0-25c90f4a010d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:11.080734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1299b-2860-404b-a0c0-25c90f4a010d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:11.081189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1299b-2860-404b-a0c0-25c90f4a010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:11.100150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71098198-b236-42f2-80ed-4725fb914169 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:11.125080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8bf1299b-2860-404b-a0c0-25c90f4a010d None None] MFA Rules not processed for user `3106e17937d2423a914c6e8d132a5de2`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:11.126581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8bf1299b-2860-404b-a0c0-25c90f4a010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:11.240777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:11.281501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:11.282276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:11.283883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:11.286385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects/cedca1a9039e4b4582168ccbe4d0c311` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:11.289092 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3394/6781] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:11.291968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cedca1a9039e4b4582168ccbe4d0c311)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:11.292782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:11.367236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cedca1a9039e4b4582168ccbe4d0c311', 'request_id': 'req-46e9aa6b-fe6b-4667-90bc-31e36da7278c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.375259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cedca1a9039e4b4582168ccbe4d0c311', 'request_id': 'req-46e9aa6b-fe6b-4667-90bc-31e36da7278c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.384384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cedca1a9039e4b4582168ccbe4d0c311', 'request_id': 'req-46e9aa6b-fe6b-4667-90bc-31e36da7278c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.401983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] The token cache is being invalidate because project cedca1a9039e4b4582168ccbe4d0c311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:11.403319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.404324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.406449 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3388/6782] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:11 2022] DELETE /identity/v3/projects/cedca1a9039e4b4582168ccbe4d0c311 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:11.411654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1299b-2860-404b-a0c0-25c90f4a010d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:11.432360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1299b-2860-404b-a0c0-25c90f4a010d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:11.531135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48859b5b-c318-4c87-b291-14aa9c11bdcb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:11.532194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48859b5b-c318-4c87-b291-14aa9c11bdcb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:11.532688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48859b5b-c318-4c87-b291-14aa9c11bdcb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:11.533170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48859b5b-c318-4c87-b291-14aa9c11bdcb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/roles/39dfa2e68fe74400a837dfb26c14edde` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:11.539812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48859b5b-c318-4c87-b291-14aa9c11bdcb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:delete_role(role_id=39dfa2e68fe74400a837dfb26c14edde)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:11.541641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48859b5b-c318-4c87-b291-14aa9c11bdcb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:11.591026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-48859b5b-c318-4c87-b291-14aa9c11bdcb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invalidating the token cache because role 39dfa2e68fe74400a837dfb26c14edde has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:11.591448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-48859b5b-c318-4c87-b291-14aa9c11bdcb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.592175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-48859b5b-c318-4c87-b291-14aa9c11bdcb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.597288 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3395/6783] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:11 2022] DELETE /identity/v3/roles/39dfa2e68fe74400a837dfb26c14edde => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:11.598342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:11.599833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:11.617491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9aa6b-fe6b-4667-90bc-31e36da7278c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:11.728726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:11.729389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:11.729698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:11.729961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/212f015ab687467eb8f36b649afff087` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:11.733127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=212f015ab687467eb8f36b649afff087)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:11.740870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:11.847187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '212f015ab687467eb8f36b649afff087'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.855509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '212f015ab687467eb8f36b649afff087'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.857267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '212f015ab687467eb8f36b649afff087'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.872099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '212f015ab687467eb8f36b649afff087'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.872942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '212f015ab687467eb8f36b649afff087'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:11.895871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:11.908381 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3389/6784] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:11 2022] DELETE /identity/v3/users/212f015ab687467eb8f36b649afff087 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:21:11.910007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48859b5b-c318-4c87-b291-14aa9c11bdcb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:11.912311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-48859b5b-c318-4c87-b291-14aa9c11bdcb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:11.940040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48859b5b-c318-4c87-b291-14aa9c11bdcb tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:12.008250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:12.049504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:12.050335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:12.050733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:12.051239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects/23fd3961b81b4dd6823346983866b108` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:12.055143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:delete_project(project_id=23fd3961b81b4dd6823346983866b108)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:12.058841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:12.191539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23fd3961b81b4dd6823346983866b108', 'request_id': 'req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:12.203940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23fd3961b81b4dd6823346983866b108', 'request_id': 'req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:12.213213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23fd3961b81b4dd6823346983866b108', 'request_id': 'req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:12.234502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] The token cache is being invalidate because project 23fd3961b81b4dd6823346983866b108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:12.235005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:12.236139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:12.247879 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3396/6785] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:11 2022] DELETE /identity/v3/projects/23fd3961b81b4dd6823346983866b108 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:12.248851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:12.250361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:12.265189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09f495-8379-49a5-8040-cba292fbba62 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:12.451995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7bf5a-9b48-4270-bc82-d336f627e564 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:12.453088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7bf5a-9b48-4270-bc82-d336f627e564 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:12.453393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7bf5a-9b48-4270-bc82-d336f627e564 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:12.453687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7bf5a-9b48-4270-bc82-d336f627e564 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/861df4962fbb4b66bd3a82aa545dc85e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:12.458885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7bf5a-9b48-4270-bc82-d336f627e564 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:update_user(user_id=861df4962fbb4b66bd3a82aa545dc85e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:12.459850 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-30b7bf5a-9b48-4270-bc82-d336f627e564 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:21:12.459850 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:21:12.459850 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:21:12.461087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7bf5a-9b48-4270-bc82-d336f627e564 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:12.468102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:12.471175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:12.567163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-30b7bf5a-9b48-4270-bc82-d336f627e564 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '861df4962fbb4b66bd3a82aa545dc85e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:12.597150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-30b7bf5a-9b48-4270-bc82-d336f627e564 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invalidating the token cache because user 861df4962fbb4b66bd3a82aa545dc85e was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:12.597525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-30b7bf5a-9b48-4270-bc82-d336f627e564 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:12.599187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-30b7bf5a-9b48-4270-bc82-d336f627e564 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:12.605575 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3390/6786] 10.222.0.70 () {60 vars in 1243 bytes} [Sun Aug 28 19:21:12 2022] PATCH /identity/v3/users/861df4962fbb4b66bd3a82aa545dc85e => generated 297 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:12.607721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e48dc-6869-445b-91ec-11a6c52d7d16 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:12.608231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e48dc-6869-445b-91ec-11a6c52d7d16 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:12.608819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e48dc-6869-445b-91ec-11a6c52d7d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:12.662193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-206e48dc-6869-445b-91ec-11a6c52d7d16 None None] MFA Rules not processed for user `861df4962fbb4b66bd3a82aa545dc85e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:12.664117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-206e48dc-6869-445b-91ec-11a6c52d7d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:12.673388 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3391/6787] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:12 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:21:12.674943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e48dc-6869-445b-91ec-11a6c52d7d16 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:12.676733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-206e48dc-6869-445b-91ec-11a6c52d7d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:12.696017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e48dc-6869-445b-91ec-11a6c52d7d16 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:12.712527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e758e-90c2-4288-8a87-536f3d1932ae tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:12.713232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e758e-90c2-4288-8a87-536f3d1932ae tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:12.713939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e758e-90c2-4288-8a87-536f3d1932ae tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:12.714153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde8409-ae62-4323-b3ed-37d6c2d6fd7c tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:12.714261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e758e-90c2-4288-8a87-536f3d1932ae tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/861df4962fbb4b66bd3a82aa545dc85e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:12.716245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e758e-90c2-4288-8a87-536f3d1932ae tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:update_user(user_id=861df4962fbb4b66bd3a82aa545dc85e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:12.718364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e758e-90c2-4288-8a87-536f3d1932ae tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:12.721919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf3557-e6f6-4248-b9eb-1b92f8cc33c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:12.722906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf3557-e6f6-4248-b9eb-1b92f8cc33c2 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:12.723754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf3557-e6f6-4248-b9eb-1b92f8cc33c2 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:12.724435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf3557-e6f6-4248-b9eb-1b92f8cc33c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:12.728210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-addf3557-e6f6-4248-b9eb-1b92f8cc33c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:12.812644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-952e758e-90c2-4288-8a87-536f3d1932ae tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '861df4962fbb4b66bd3a82aa545dc85e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:12.822590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf3557-e6f6-4248-b9eb-1b92f8cc33c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:12.825135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf3557-e6f6-4248-b9eb-1b92f8cc33c2 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:12.838238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-952e758e-90c2-4288-8a87-536f3d1932ae tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invalidating the token cache because user 861df4962fbb4b66bd3a82aa545dc85e was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:12.838882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-952e758e-90c2-4288-8a87-536f3d1932ae tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:12.840241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-952e758e-90c2-4288-8a87-536f3d1932ae tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:12.846484 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3397/6788] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:12.847064 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3392/6789] 10.222.0.70 () {60 vars in 1243 bytes} [Sun Aug 28 19:21:12 2022] PATCH /identity/v3/users/861df4962fbb4b66bd3a82aa545dc85e => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:12.847884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf3557-e6f6-4248-b9eb-1b92f8cc33c2 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:12.911876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf3557-e6f6-4248-b9eb-1b92f8cc33c2 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:12.934363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c314b5f-74bf-42b3-ad36-875e8d576e03 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:12.935648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c314b5f-74bf-42b3-ad36-875e8d576e03 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:12.935838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c314b5f-74bf-42b3-ad36-875e8d576e03 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:12.937270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c314b5f-74bf-42b3-ad36-875e8d576e03 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/861df4962fbb4b66bd3a82aa545dc85e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:12.947773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:12.986881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c314b5f-74bf-42b3-ad36-875e8d576e03 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:update_user(user_id=861df4962fbb4b66bd3a82aa545dc85e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:12.992264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c314b5f-74bf-42b3-ad36-875e8d576e03 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:13.091320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0c314b5f-74bf-42b3-ad36-875e8d576e03 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '861df4962fbb4b66bd3a82aa545dc85e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:13.125018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0c314b5f-74bf-42b3-ad36-875e8d576e03 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invalidating the token cache because user 861df4962fbb4b66bd3a82aa545dc85e was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:13.125437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0c314b5f-74bf-42b3-ad36-875e8d576e03 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:13.126086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0c314b5f-74bf-42b3-ad36-875e8d576e03 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:13.130810 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3398/6790] 10.222.0.70 () {60 vars in 1243 bytes} [Sun Aug 28 19:21:12 2022] PATCH /identity/v3/users/861df4962fbb4b66bd3a82aa545dc85e => generated 297 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:13.132831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc49ed7-3964-44d8-b990-d2607b0cb16e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:13.133343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc49ed7-3964-44d8-b990-d2607b0cb16e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:13.133803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc49ed7-3964-44d8-b990-d2607b0cb16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:13.176233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6fc49ed7-3964-44d8-b990-d2607b0cb16e None None] MFA Rules not processed for user `861df4962fbb4b66bd3a82aa545dc85e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:13.177879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6fc49ed7-3964-44d8-b990-d2607b0cb16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:13.185219 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3393/6791] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:13 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:21:13.186796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c314b5f-74bf-42b3-ad36-875e8d576e03 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:13.189396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0c314b5f-74bf-42b3-ad36-875e8d576e03 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:13.213618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c314b5f-74bf-42b3-ad36-875e8d576e03 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:13.222540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043660f-3576-4c8e-95e6-089fb444e866 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:13.223997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043660f-3576-4c8e-95e6-089fb444e866 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:13.224449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043660f-3576-4c8e-95e6-089fb444e866 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:13.225411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043660f-3576-4c8e-95e6-089fb444e866 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/861df4962fbb4b66bd3a82aa545dc85e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:13.227662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043660f-3576-4c8e-95e6-089fb444e866 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:update_user(user_id=861df4962fbb4b66bd3a82aa545dc85e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:13.231293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043660f-3576-4c8e-95e6-089fb444e866 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:13.337145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0043660f-3576-4c8e-95e6-089fb444e866 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '861df4962fbb4b66bd3a82aa545dc85e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:13.359978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0043660f-3576-4c8e-95e6-089fb444e866 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invalidating the token cache because user 861df4962fbb4b66bd3a82aa545dc85e was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:13.360752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0043660f-3576-4c8e-95e6-089fb444e866 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:13.362508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0043660f-3576-4c8e-95e6-089fb444e866 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:13.367948 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3399/6792] 10.222.0.70 () {60 vars in 1243 bytes} [Sun Aug 28 19:21:13 2022] PATCH /identity/v3/users/861df4962fbb4b66bd3a82aa545dc85e => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:21:13.373443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc49ed7-3964-44d8-b990-d2607b0cb16e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:13.398101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc49ed7-3964-44d8-b990-d2607b0cb16e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:13.416012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb6a15-25ad-4ec5-b03e-22526c6aeb96 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:13.416948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb6a15-25ad-4ec5-b03e-22526c6aeb96 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:13.417419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb6a15-25ad-4ec5-b03e-22526c6aeb96 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:13.419768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb6a15-25ad-4ec5-b03e-22526c6aeb96 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:13.422105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb6a15-25ad-4ec5-b03e-22526c6aeb96 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:13.428570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb6a15-25ad-4ec5-b03e-22526c6aeb96 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:13.505076 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3394/6793] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:21:13 2022] POST /identity/v3/users => generated 265 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:13.512572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043660f-3576-4c8e-95e6-089fb444e866 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:13.519242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0043660f-3576-4c8e-95e6-089fb444e866 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:13.535307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043660f-3576-4c8e-95e6-089fb444e866 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:13.541738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ace9f8-a037-41b3-9e09-492c2eae2352 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:13.542625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ace9f8-a037-41b3-9e09-492c2eae2352 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:13.543832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ace9f8-a037-41b3-9e09-492c2eae2352 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:13.544343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ace9f8-a037-41b3-9e09-492c2eae2352 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/44171fd75ed64c1197acaebc167b896d/password` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:13.693819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b2ace9f8-a037-41b3-9e09-492c2eae2352 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '44171fd75ed64c1197acaebc167b896d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:13.710506 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3400/6794] 10.222.0.70 () {60 vars in 1269 bytes} [Sun Aug 28 19:21:13 2022] POST /identity/v3/users/44171fd75ed64c1197acaebc167b896d/password => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:14.717179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f277376-336d-433e-9c49-c6e2e7490b15 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:14.721279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f277376-336d-433e-9c49-c6e2e7490b15 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:14.721855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f277376-336d-433e-9c49-c6e2e7490b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:14.786430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0f277376-336d-433e-9c49-c6e2e7490b15 None None] MFA Rules not processed for user `44171fd75ed64c1197acaebc167b896d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:14.798293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0f277376-336d-433e-9c49-c6e2e7490b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:14.805083 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3395/6795] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:14 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 19:21:14.810091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ace9f8-a037-41b3-9e09-492c2eae2352 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:14.832105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ace9f8-a037-41b3-9e09-492c2eae2352 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:14.849472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5789d-9bf5-44e3-806a-370762ee0dc1 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:14.850447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5789d-9bf5-44e3-806a-370762ee0dc1 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:14.851131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5789d-9bf5-44e3-806a-370762ee0dc1 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:14.851974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5789d-9bf5-44e3-806a-370762ee0dc1 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:14.868535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5789d-9bf5-44e3-806a-370762ee0dc1 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:14.873327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5789d-9bf5-44e3-806a-370762ee0dc1 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:14.902885 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3401/6796] 10.222.0.70 () {56 vars in 1263 bytes} [Sun Aug 28 19:21:14 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 19:21:14.907179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f277376-336d-433e-9c49-c6e2e7490b15 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:14.941828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f277376-336d-433e-9c49-c6e2e7490b15 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:14.992330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:14.993194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:14.994942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:14.995813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/44171fd75ed64c1197acaebc167b896d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:14.999266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=44171fd75ed64c1197acaebc167b896d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:15.001591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:15.106175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=8,keystone:SELECT=83,keystone:UPDATE=2,keystone:INSERT=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:15.127979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44171fd75ed64c1197acaebc167b896d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:15.143750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44171fd75ed64c1197acaebc167b896d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:15.144666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44171fd75ed64c1197acaebc167b896d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:15.171275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44171fd75ed64c1197acaebc167b896d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:15.172060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44171fd75ed64c1197acaebc167b896d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:15.220200 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3396/6797] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:14 2022] DELETE /identity/v3/users/44171fd75ed64c1197acaebc167b896d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:15.225546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5789d-9bf5-44e3-806a-370762ee0dc1 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:15.242532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5789d-9bf5-44e3-806a-370762ee0dc1 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:15.344025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ccb05-f15c-474a-982f-0d4a2a95b2b7 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:15.345881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ccb05-f15c-474a-982f-0d4a2a95b2b7 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:15.348010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ccb05-f15c-474a-982f-0d4a2a95b2b7 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:15.348289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ccb05-f15c-474a-982f-0d4a2a95b2b7 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:15.350395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ccb05-f15c-474a-982f-0d4a2a95b2b7 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:15.352485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ccb05-f15c-474a-982f-0d4a2a95b2b7 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:15.408227 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3402/6798] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:15 2022] POST /identity/v3/users => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:15.413849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:15.415596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:15.439445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0c4d5-84e4-40bc-b8b9-d8a6d62ae7d6 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:15.461478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276b8be-d041-4ce4-ab0e-f86d30f10970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:15.462128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276b8be-d041-4ce4-ab0e-f86d30f10970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:15.463210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276b8be-d041-4ce4-ab0e-f86d30f10970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:15.463520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276b8be-d041-4ce4-ab0e-f86d30f10970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:15.464164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276b8be-d041-4ce4-ab0e-f86d30f10970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:15.467403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276b8be-d041-4ce4-ab0e-f86d30f10970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:15.538791 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3397/6799] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:15 2022] POST /identity/v3/projects => generated 359 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:15.542074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ccb05-f15c-474a-982f-0d4a2a95b2b7 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:15.559772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ccb05-f15c-474a-982f-0d4a2a95b2b7 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:15.612140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=83,keystone:UPDATE=3,keystone:INSERT=9,keystone:DELETE=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:15.683234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250e081-2c6c-4279-b712-edba1fb0d078 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:15.685900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250e081-2c6c-4279-b712-edba1fb0d078 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:15.686197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250e081-2c6c-4279-b712-edba1fb0d078 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:15.686484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250e081-2c6c-4279-b712-edba1fb0d078 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/a5361e7aad4e4961ba125d7613862bb2` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:15.719462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250e081-2c6c-4279-b712-edba1fb0d078 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:update_user(user_id=a5361e7aad4e4961ba125d7613862bb2)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:15.728656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250e081-2c6c-4279-b712-edba1fb0d078 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:15.814630 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3403/6800] 10.222.0.70 () {60 vars in 1244 bytes} [Sun Aug 28 19:21:15 2022] PATCH /identity/v3/users/a5361e7aad4e4961ba125d7613862bb2 => generated 522 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:15.815306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276b8be-d041-4ce4-ab0e-f86d30f10970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:15.837862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276b8be-d041-4ce4-ab0e-f86d30f10970 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:15.848134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067768bc-38b9-4e5e-aef9-4bdba1291c59 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:15.850140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067768bc-38b9-4e5e-aef9-4bdba1291c59 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:15.850674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067768bc-38b9-4e5e-aef9-4bdba1291c59 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:15.851197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067768bc-38b9-4e5e-aef9-4bdba1291c59 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/a5361e7aad4e4961ba125d7613862bb2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:15.890714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067768bc-38b9-4e5e-aef9-4bdba1291c59 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:get_user(user_id=a5361e7aad4e4961ba125d7613862bb2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:15.898626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067768bc-38b9-4e5e-aef9-4bdba1291c59 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:15.908071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250e081-2c6c-4279-b712-edba1fb0d078 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:15.924486 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3398/6801] 10.222.0.70 () {58 vars in 1221 bytes} [Sun Aug 28 19:21:15 2022] GET /identity/v3/users/a5361e7aad4e4961ba125d7613862bb2 => generated 389 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:21:15.937062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250e081-2c6c-4279-b712-edba1fb0d078 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:15.963888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:15.966125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:15.981062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:15.983872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/projects/9caa9c55826046589173e8de88a44bb7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:15.996844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9caa9c55826046589173e8de88a44bb7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:16.009242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:16.154986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9caa9c55826046589173e8de88a44bb7', 'request_id': 'req-5640748b-1e89-4589-83d9-ff08677af81d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.173056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9caa9c55826046589173e8de88a44bb7', 'request_id': 'req-5640748b-1e89-4589-83d9-ff08677af81d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.184964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9caa9c55826046589173e8de88a44bb7', 'request_id': 'req-5640748b-1e89-4589-83d9-ff08677af81d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.227619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] The token cache is being invalidate because project 9caa9c55826046589173e8de88a44bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:16.230270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.232627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.240299 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3404/6802] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:15 2022] DELETE /identity/v3/projects/9caa9c55826046589173e8de88a44bb7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:16.241652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067768bc-38b9-4e5e-aef9-4bdba1291c59 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:16.244021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-067768bc-38b9-4e5e-aef9-4bdba1291c59 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:16.271612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067768bc-38b9-4e5e-aef9-4bdba1291c59 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:16.427450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658410b-a72a-4999-83b3-562ca568ba37 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7f6e55692b6473aba20be67ac9d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:16.428448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658410b-a72a-4999-83b3-562ca568ba37 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:16.429122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658410b-a72a-4999-83b3-562ca568ba37 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:16.429656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658410b-a72a-4999-83b3-562ca568ba37 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] PATH_INFO: `/v3/users/a5361e7aad4e4961ba125d7613862bb2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:16.444496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658410b-a72a-4999-83b3-562ca568ba37 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a5361e7aad4e4961ba125d7613862bb2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:16.447094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658410b-a72a-4999-83b3-562ca568ba37 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:16.553688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f658410b-a72a-4999-83b3-562ca568ba37 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5361e7aad4e4961ba125d7613862bb2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.571011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f658410b-a72a-4999-83b3-562ca568ba37 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5361e7aad4e4961ba125d7613862bb2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.571902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f658410b-a72a-4999-83b3-562ca568ba37 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5361e7aad4e4961ba125d7613862bb2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.593234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f658410b-a72a-4999-83b3-562ca568ba37 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5361e7aad4e4961ba125d7613862bb2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.594386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f658410b-a72a-4999-83b3-562ca568ba37 tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5361e7aad4e4961ba125d7613862bb2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.611754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:16.624721 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3399/6803] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:16 2022] DELETE /identity/v3/users/a5361e7aad4e4961ba125d7613862bb2 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:16.629709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:16.631439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:16.727173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640748b-1e89-4589-83d9-ff08677af81d tempest-UsersV3TestJSON-64587503 tempest-UsersV3TestJSON-64587503-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:16.748040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:16.816033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:16.817061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:16.817447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:16.817826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] PATH_INFO: `/v3/users/861df4962fbb4b66bd3a82aa545dc85e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:16.836867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=861df4962fbb4b66bd3a82aa545dc85e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:16.839553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:16.915691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861df4962fbb4b66bd3a82aa545dc85e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.925929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861df4962fbb4b66bd3a82aa545dc85e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.926922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861df4962fbb4b66bd3a82aa545dc85e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.945020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861df4962fbb4b66bd3a82aa545dc85e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.946090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861df4962fbb4b66bd3a82aa545dc85e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:16.973717 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3405/6804] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:16 2022] DELETE /identity/v3/users/861df4962fbb4b66bd3a82aa545dc85e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:16.974981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239c48a-1cee-49c7-8dac-f43841e772be None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:16.976791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239c48a-1cee-49c7-8dac-f43841e772be None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:16.977226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239c48a-1cee-49c7-8dac-f43841e772be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:17.019520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7239c48a-1cee-49c7-8dac-f43841e772be None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:17.021745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7239c48a-1cee-49c7-8dac-f43841e772be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:17.120986 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3400/6805] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:21:17.148394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:17.151480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:17.329166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23501e6d-0e65-42f9-8b99-429aaa980c93 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:17.345152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84083d13-982b-460f-bd61-115d32224a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:17.346264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84083d13-982b-460f-bd61-115d32224a36 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:17.349126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84083d13-982b-460f-bd61-115d32224a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:17.349454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84083d13-982b-460f-bd61-115d32224a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:17.379459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84083d13-982b-460f-bd61-115d32224a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:17.382945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84083d13-982b-460f-bd61-115d32224a36 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:17.463797 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3406/6806] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:17.826593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7405b1b-28f6-48e1-9c46-a96b3c956d76 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:17.826983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7405b1b-28f6-48e1-9c46-a96b3c956d76 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:17.827195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7405b1b-28f6-48e1-9c46-a96b3c956d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:17.866382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a7405b1b-28f6-48e1-9c46-a96b3c956d76 None None] MFA Rules not processed for user `656876150d884e58a510d2f949cd3f86`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:17.867671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a7405b1b-28f6-48e1-9c46-a96b3c956d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:18.010946 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3401/6807] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:19.681959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84083d13-982b-460f-bd61-115d32224a36 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:19.685296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-84083d13-982b-460f-bd61-115d32224a36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:19.709722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84083d13-982b-460f-bd61-115d32224a36 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:19.715756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:19.716543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:19.716926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:19.717301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] PATH_INFO: `/v3/projects/28456a95dd0a4a5da99fe75d4adb2307` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:19.720739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28456a95dd0a4a5da99fe75d4adb2307)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:19.722891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:19.778964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:19.823277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7405b1b-28f6-48e1-9c46-a96b3c956d76 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:19.860780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7405b1b-28f6-48e1-9c46-a96b3c956d76 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:19.872996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28456a95dd0a4a5da99fe75d4adb2307', 'request_id': 'req-f1cf339a-cdbf-47b5-9bff-7030919f6da2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:19.903259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28456a95dd0a4a5da99fe75d4adb2307', 'request_id': 'req-f1cf339a-cdbf-47b5-9bff-7030919f6da2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:19.911712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28456a95dd0a4a5da99fe75d4adb2307', 'request_id': 'req-f1cf339a-cdbf-47b5-9bff-7030919f6da2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:19.938906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] The token cache is being invalidate because project 28456a95dd0a4a5da99fe75d4adb2307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:19.939254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:19.941459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:19.944501 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3407/6808] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:19 2022] DELETE /identity/v3/projects/28456a95dd0a4a5da99fe75d4adb2307 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:19.953486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:19.957957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:20.008163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a92178-8646-452b-a3e2-f94c7274777e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:20.008986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a92178-8646-452b-a3e2-f94c7274777e service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:20.010520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a92178-8646-452b-a3e2-f94c7274777e service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:20.010857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a92178-8646-452b-a3e2-f94c7274777e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:20.019976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-03a92178-8646-452b-a3e2-f94c7274777e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:20.057551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a92178-8646-452b-a3e2-f94c7274777e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:20.059970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a92178-8646-452b-a3e2-f94c7274777e service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:20.077025 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3402/6809] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:20.181331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf339a-cdbf-47b5-9bff-7030919f6da2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:20.195883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf05b20-fcc3-42a2-a7c6-572a501b23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:20.196715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf05b20-fcc3-42a2-a7c6-572a501b23c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:20.197029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf05b20-fcc3-42a2-a7c6-572a501b23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:20.197315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf05b20-fcc3-42a2-a7c6-572a501b23c0 admin admin] PATH_INFO: `/v3/users/f7f6e55692b6473aba20be67ac9d43a5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:20.202032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf05b20-fcc3-42a2-a7c6-572a501b23c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f6e55692b6473aba20be67ac9d43a5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:20.204108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf05b20-fcc3-42a2-a7c6-572a501b23c0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:20.329089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2bf05b20-fcc3-42a2-a7c6-572a501b23c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f6e55692b6473aba20be67ac9d43a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:20.345595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2bf05b20-fcc3-42a2-a7c6-572a501b23c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f6e55692b6473aba20be67ac9d43a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:20.346499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2bf05b20-fcc3-42a2-a7c6-572a501b23c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f6e55692b6473aba20be67ac9d43a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:20.376642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2bf05b20-fcc3-42a2-a7c6-572a501b23c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f6e55692b6473aba20be67ac9d43a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:20.377397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2bf05b20-fcc3-42a2-a7c6-572a501b23c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f6e55692b6473aba20be67ac9d43a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:20.420293 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3408/6810] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:19 2022] DELETE /identity/v3/users/f7f6e55692b6473aba20be67ac9d43a5 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:21.681636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a92178-8646-452b-a3e2-f94c7274777e service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:21.725164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a92178-8646-452b-a3e2-f94c7274777e service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:21.878605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:21.942424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:21.943042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:21.943324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:21.943605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2 admin admin] PATH_INFO: `/v3/projects/5a2fe0a6de4a4f769c3fa1c5668fe960` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:21.950868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a2fe0a6de4a4f769c3fa1c5668fe960)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:21.954425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:22.122880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'request_id': 'req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:22.139829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'request_id': 'req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:22.157351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a2fe0a6de4a4f769c3fa1c5668fe960', 'request_id': 'req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:22.209627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2 admin admin] The token cache is being invalidate because project 5a2fe0a6de4a4f769c3fa1c5668fe960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:22.210186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:22.211185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-190bb1a5-bb04-41d3-ac50-1aaa44c870f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:22.220840 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3403/6811] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:21 2022] DELETE /identity/v3/projects/5a2fe0a6de4a4f769c3fa1c5668fe960 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:22.230090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb78bc-dcfe-483e-99e0-71a749c8e107 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:22.231210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb78bc-dcfe-483e-99e0-71a749c8e107 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:22.231439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb78bc-dcfe-483e-99e0-71a749c8e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:22.282839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b6cb78bc-dcfe-483e-99e0-71a749c8e107 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:22.286362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b6cb78bc-dcfe-483e-99e0-71a749c8e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:22.332474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:22.383060 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3409/6812] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:22.391891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188063-ef22-42b8-b674-a4f3bc1e90d5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:22.392432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188063-ef22-42b8-b674-a4f3bc1e90d5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:22.393220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188063-ef22-42b8-b674-a4f3bc1e90d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:22.419475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6f188063-ef22-42b8-b674-a4f3bc1e90d5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:22.426194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6f188063-ef22-42b8-b674-a4f3bc1e90d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:22.446978 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3404/6813] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:21:22.451666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb78bc-dcfe-483e-99e0-71a749c8e107 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:22.470212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb78bc-dcfe-483e-99e0-71a749c8e107 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:22.484767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f66cd-829a-4706-91a0-5350f032ac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:22.485822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f66cd-829a-4706-91a0-5350f032ac67 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:22.486317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f66cd-829a-4706-91a0-5350f032ac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:22.486938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f66cd-829a-4706-91a0-5350f032ac67 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:22.487839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f66cd-829a-4706-91a0-5350f032ac67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:21:22.488345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f66cd-829a-4706-91a0-5350f032ac67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:22.490225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f66cd-829a-4706-91a0-5350f032ac67 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:22.515058 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3410/6814] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:22.516777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f188063-ef22-42b8-b674-a4f3bc1e90d5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:22.530586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f188063-ef22-42b8-b674-a4f3bc1e90d5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:22.545441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa9cf8-cfd6-4042-84ba-1ba4d455e14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:22.546077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa9cf8-cfd6-4042-84ba-1ba4d455e14d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:22.546392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa9cf8-cfd6-4042-84ba-1ba4d455e14d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:22.546680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa9cf8-cfd6-4042-84ba-1ba4d455e14d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:22.547353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa9cf8-cfd6-4042-84ba-1ba4d455e14d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:22.549323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa9cf8-cfd6-4042-84ba-1ba4d455e14d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:22.620252 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3405/6815] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:22 2022] POST /identity/v3/projects => generated 395 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:22.625044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f66cd-829a-4706-91a0-5350f032ac67 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:22.640112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f66cd-829a-4706-91a0-5350f032ac67 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:22.788655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d7ea6-6418-4d00-9c1e-a9c800050c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:22.789321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d7ea6-6418-4d00-9c1e-a9c800050c26 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:22.789660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d7ea6-6418-4d00-9c1e-a9c800050c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:22.789900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d7ea6-6418-4d00-9c1e-a9c800050c26 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:22.790550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d7ea6-6418-4d00-9c1e-a9c800050c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:22.794004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d7ea6-6418-4d00-9c1e-a9c800050c26 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:22.876569 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3411/6816] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:22 2022] POST /identity/v3/users => generated 304 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:22.879202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa9cf8-cfd6-4042-84ba-1ba4d455e14d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:22.894375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa9cf8-cfd6-4042-84ba-1ba4d455e14d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:22.909460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321da563-8c73-4f7f-9128-9bbd66c09ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:22.910355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321da563-8c73-4f7f-9128-9bbd66c09ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:22.910880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321da563-8c73-4f7f-9128-9bbd66c09ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:22.911316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321da563-8c73-4f7f-9128-9bbd66c09ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:22.912127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321da563-8c73-4f7f-9128-9bbd66c09ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:22.913901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321da563-8c73-4f7f-9128-9bbd66c09ff0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:22.948045 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3406/6817] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:22.952745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d7ea6-6418-4d00-9c1e-a9c800050c26 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:22.967122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d7ea6-6418-4d00-9c1e-a9c800050c26 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:22.977689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6092300-775a-4912-92cc-aa415b4b346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:22.978526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6092300-775a-4912-92cc-aa415b4b346e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:22.978932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6092300-775a-4912-92cc-aa415b4b346e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:22.979311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6092300-775a-4912-92cc-aa415b4b346e admin admin] PATH_INFO: `/v3/projects/0762a7af68aa40649d1ea02b50bdbf9a/users/9c4a3b5b5aa64e7cbde945b16d5aaed8/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:23.028743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6092300-775a-4912-92cc-aa415b4b346e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0762a7af68aa40649d1ea02b50bdbf9a, user_id=9c4a3b5b5aa64e7cbde945b16d5aaed8, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:23.032013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6092300-775a-4912-92cc-aa415b4b346e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:23.065495 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3412/6818] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:22 2022] PUT /identity/v3/projects/0762a7af68aa40649d1ea02b50bdbf9a/users/9c4a3b5b5aa64e7cbde945b16d5aaed8/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:23.069207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321da563-8c73-4f7f-9128-9bbd66c09ff0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:23.079909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321da563-8c73-4f7f-9128-9bbd66c09ff0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:23.193607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c124a23-6b40-420b-bca7-94bbeef2a431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:23.195361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c124a23-6b40-420b-bca7-94bbeef2a431 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:23.195817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c124a23-6b40-420b-bca7-94bbeef2a431 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:23.196263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c124a23-6b40-420b-bca7-94bbeef2a431 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:23.197099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c124a23-6b40-420b-bca7-94bbeef2a431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:23.200157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c124a23-6b40-420b-bca7-94bbeef2a431 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:23.219069 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3407/6819] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:23.223159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6092300-775a-4912-92cc-aa415b4b346e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:23.236209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6092300-775a-4912-92cc-aa415b4b346e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:23.246833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f1279-7305-4299-ae1d-4ab1dc35f3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:23.247817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f1279-7305-4299-ae1d-4ab1dc35f3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:23.248406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f1279-7305-4299-ae1d-4ab1dc35f3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:23.248692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f1279-7305-4299-ae1d-4ab1dc35f3fa admin admin] PATH_INFO: `/v3/projects/0762a7af68aa40649d1ea02b50bdbf9a/users/9c4a3b5b5aa64e7cbde945b16d5aaed8/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:23.250959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f1279-7305-4299-ae1d-4ab1dc35f3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0762a7af68aa40649d1ea02b50bdbf9a, user_id=9c4a3b5b5aa64e7cbde945b16d5aaed8, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:23.253751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f1279-7305-4299-ae1d-4ab1dc35f3fa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:23.279731 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3413/6820] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:23 2022] PUT /identity/v3/projects/0762a7af68aa40649d1ea02b50bdbf9a/users/9c4a3b5b5aa64e7cbde945b16d5aaed8/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:23.293254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd37ee6-8398-4a19-9cbe-b8b6c7c3f4fc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:23.293951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd37ee6-8398-4a19-9cbe-b8b6c7c3f4fc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:23.294420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd37ee6-8398-4a19-9cbe-b8b6c7c3f4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:23.359433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9bd37ee6-8398-4a19-9cbe-b8b6c7c3f4fc None None] MFA Rules not processed for user `9c4a3b5b5aa64e7cbde945b16d5aaed8`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:23.360666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9bd37ee6-8398-4a19-9cbe-b8b6c7c3f4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:23.385653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:23.473579 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3408/6821] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:23 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:23.474685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f1279-7305-4299-ae1d-4ab1dc35f3fa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:23.723707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f1279-7305-4299-ae1d-4ab1dc35f3fa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:23.732156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b4c69-8482-4fae-9484-a3519951510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:23.733419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b4c69-8482-4fae-9484-a3519951510d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:23.733809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b4c69-8482-4fae-9484-a3519951510d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:23.734193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b4c69-8482-4fae-9484-a3519951510d admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:23.735044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b4c69-8482-4fae-9484-a3519951510d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:23.737174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b4c69-8482-4fae-9484-a3519951510d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:23.757990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:23.783688 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3414/6822] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:23 2022] POST /identity/v3/projects => generated 397 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:23.787468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd37ee6-8398-4a19-9cbe-b8b6c7c3f4fc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:23.801552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd37ee6-8398-4a19-9cbe-b8b6c7c3f4fc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:23.916842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6060ef2-3aa8-49b7-8c9e-f7ed6074ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:23.918555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6060ef2-3aa8-49b7-8c9e-f7ed6074ad0b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:23.919177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6060ef2-3aa8-49b7-8c9e-f7ed6074ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:23.919790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6060ef2-3aa8-49b7-8c9e-f7ed6074ad0b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:23.920854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6060ef2-3aa8-49b7-8c9e-f7ed6074ad0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:23.925538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6060ef2-3aa8-49b7-8c9e-f7ed6074ad0b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:23.984168 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3409/6823] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:23 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:23.985006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b4c69-8482-4fae-9484-a3519951510d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:24.002339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b4c69-8482-4fae-9484-a3519951510d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:24.009622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84269e-fbc8-41ea-9644-34138e2e1d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:24.010409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84269e-fbc8-41ea-9644-34138e2e1d7b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:24.010934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84269e-fbc8-41ea-9644-34138e2e1d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:24.011827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84269e-fbc8-41ea-9644-34138e2e1d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:24.012620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84269e-fbc8-41ea-9644-34138e2e1d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:24.014593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84269e-fbc8-41ea-9644-34138e2e1d7b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:24.030590 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3415/6824] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:21:24.034193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6060ef2-3aa8-49b7-8c9e-f7ed6074ad0b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:24.046941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6060ef2-3aa8-49b7-8c9e-f7ed6074ad0b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:24.053093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707557e3-118a-4b11-8d6f-c296c307fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:24.053932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707557e3-118a-4b11-8d6f-c296c307fe4a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:24.054329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707557e3-118a-4b11-8d6f-c296c307fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:24.054679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707557e3-118a-4b11-8d6f-c296c307fe4a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:24.055519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707557e3-118a-4b11-8d6f-c296c307fe4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:24.057245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707557e3-118a-4b11-8d6f-c296c307fe4a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:24.070571 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3410/6825] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:21:24.075564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84269e-fbc8-41ea-9644-34138e2e1d7b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:24.087593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84269e-fbc8-41ea-9644-34138e2e1d7b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:24.093699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3b34e-563a-41a9-92b1-8dd5e142abf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:24.094569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3b34e-563a-41a9-92b1-8dd5e142abf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:24.095133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3b34e-563a-41a9-92b1-8dd5e142abf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:24.095510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3b34e-563a-41a9-92b1-8dd5e142abf3 admin admin] PATH_INFO: `/v3/projects/15cf35096c36471b818a6df365a0307d/users/eb1e22aeca51438da005c01527be6d4d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:24.118142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3b34e-563a-41a9-92b1-8dd5e142abf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cf35096c36471b818a6df365a0307d, user_id=eb1e22aeca51438da005c01527be6d4d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:24.123077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3b34e-563a-41a9-92b1-8dd5e142abf3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:24.163245 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3416/6826] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:24 2022] PUT /identity/v3/projects/15cf35096c36471b818a6df365a0307d/users/eb1e22aeca51438da005c01527be6d4d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:24.174055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489500c-f8d9-4ff0-9bfb-fbc0e668d522 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:24.174055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489500c-f8d9-4ff0-9bfb-fbc0e668d522 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:24.174392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489500c-f8d9-4ff0-9bfb-fbc0e668d522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:24.211959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c489500c-f8d9-4ff0-9bfb-fbc0e668d522 None None] MFA Rules not processed for user `eb1e22aeca51438da005c01527be6d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:24.213370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c489500c-f8d9-4ff0-9bfb-fbc0e668d522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:24.302425 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3411/6827] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:21:24.317018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3b34e-563a-41a9-92b1-8dd5e142abf3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:24.320562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1de3b34e-563a-41a9-92b1-8dd5e142abf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:24.539723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3b34e-563a-41a9-92b1-8dd5e142abf3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:24.550474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e174b-0c4d-46d6-9927-11fc04c3b4a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:24.551280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e174b-0c4d-46d6-9927-11fc04c3b4a9 service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:24.552438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e174b-0c4d-46d6-9927-11fc04c3b4a9 service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:24.552438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e174b-0c4d-46d6-9927-11fc04c3b4a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:24.748641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e174b-0c4d-46d6-9927-11fc04c3b4a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:24.750434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e174b-0c4d-46d6-9927-11fc04c3b4a9 service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:24.769653 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3417/6828] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:24 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:25.367144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c330c-0912-4a22-ad7d-4558270c62e4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:25.368008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c330c-0912-4a22-ad7d-4558270c62e4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:25.368298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c330c-0912-4a22-ad7d-4558270c62e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:25.411861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e174b-0c4d-46d6-9927-11fc04c3b4a9 service glance] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:25.412613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-297c330c-0912-4a22-ad7d-4558270c62e4 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:25.413142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-297c330c-0912-4a22-ad7d-4558270c62e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:25.455508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:25.574855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e174b-0c4d-46d6-9927-11fc04c3b4a9 service glance] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:25.589658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0ccf6-4490-4e15-b126-0aa0050b568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:25.590334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0ccf6-4490-4e15-b126-0aa0050b568f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:25.591148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0ccf6-4490-4e15-b126-0aa0050b568f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:25.591148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0ccf6-4490-4e15-b126-0aa0050b568f admin admin] PATH_INFO: `/v3/users/9c4a3b5b5aa64e7cbde945b16d5aaed8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:25.598380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0ccf6-4490-4e15-b126-0aa0050b568f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4a3b5b5aa64e7cbde945b16d5aaed8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:25.600479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0ccf6-4490-4e15-b126-0aa0050b568f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:25.615355 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3412/6829] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:21:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:25.617776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:25.724187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c330c-0912-4a22-ad7d-4558270c62e4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:25.729559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-297c330c-0912-4a22-ad7d-4558270c62e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:25.743534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-29a0ccf6-4490-4e15-b126-0aa0050b568f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4a3b5b5aa64e7cbde945b16d5aaed8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:25.762558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-29a0ccf6-4490-4e15-b126-0aa0050b568f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4a3b5b5aa64e7cbde945b16d5aaed8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:25.763675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-29a0ccf6-4490-4e15-b126-0aa0050b568f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4a3b5b5aa64e7cbde945b16d5aaed8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:25.791460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-29a0ccf6-4490-4e15-b126-0aa0050b568f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4a3b5b5aa64e7cbde945b16d5aaed8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:25.795179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-29a0ccf6-4490-4e15-b126-0aa0050b568f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4a3b5b5aa64e7cbde945b16d5aaed8'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:25.828331 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3418/6830] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:25 2022] DELETE /identity/v3/users/9c4a3b5b5aa64e7cbde945b16d5aaed8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:25.833196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f04697-01fb-49d6-96b4-3c82b73d832f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:25.833494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f04697-01fb-49d6-96b4-3c82b73d832f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:25.833917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f04697-01fb-49d6-96b4-3c82b73d832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:25.882264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-02f04697-01fb-49d6-96b4-3c82b73d832f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:25.903494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-02f04697-01fb-49d6-96b4-3c82b73d832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:25.955828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c330c-0912-4a22-ad7d-4558270c62e4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:26.033908 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3419/6831] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:26.050344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f04697-01fb-49d6-96b4-3c82b73d832f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:26.052246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-02f04697-01fb-49d6-96b4-3c82b73d832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:26.143733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df689709-12e9-4ace-860e-4eb8c7c6f040 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:26.144382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df689709-12e9-4ace-860e-4eb8c7c6f040 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:26.144672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df689709-12e9-4ace-860e-4eb8c7c6f040 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:26.147547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df689709-12e9-4ace-860e-4eb8c7c6f040 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:26.154407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-df689709-12e9-4ace-860e-4eb8c7c6f040 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:26.197004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f04697-01fb-49d6-96b4-3c82b73d832f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:26.206060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bee44-eef0-4622-9304-70004d057bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:26.208791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bee44-eef0-4622-9304-70004d057bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:26.209317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bee44-eef0-4622-9304-70004d057bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:26.209807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bee44-eef0-4622-9304-70004d057bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:26.235147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bee44-eef0-4622-9304-70004d057bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:26.237374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bee44-eef0-4622-9304-70004d057bd6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:26.276330 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3420/6832] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:26.303156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:26.309270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df689709-12e9-4ace-860e-4eb8c7c6f040 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:26.311726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df689709-12e9-4ace-860e-4eb8c7c6f040 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:26.333519 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3413/6833] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:21:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:21:27.376091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bee44-eef0-4622-9304-70004d057bd6 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:27.377726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-084bee44-eef0-4622-9304-70004d057bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:27.399676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bee44-eef0-4622-9304-70004d057bd6 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:27.414216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:27.414671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:27.414993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:27.415276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] PATH_INFO: `/v3/projects/0762a7af68aa40649d1ea02b50bdbf9a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:27.420125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0762a7af68aa40649d1ea02b50bdbf9a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:27.422859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:27.480971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:27.604452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0762a7af68aa40649d1ea02b50bdbf9a', 'request_id': 'req-2438237d-4ec7-4843-89b6-8639f05d0e48'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:27.624821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0762a7af68aa40649d1ea02b50bdbf9a', 'request_id': 'req-2438237d-4ec7-4843-89b6-8639f05d0e48'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:27.649807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0762a7af68aa40649d1ea02b50bdbf9a', 'request_id': 'req-2438237d-4ec7-4843-89b6-8639f05d0e48'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:27.675468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] The token cache is being invalidate because project 0762a7af68aa40649d1ea02b50bdbf9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:27.677250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:27.679076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:27.681151 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3421/6834] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:27 2022] DELETE /identity/v3/projects/0762a7af68aa40649d1ea02b50bdbf9a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:27.686423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df689709-12e9-4ace-860e-4eb8c7c6f040 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:27.703773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df689709-12e9-4ace-860e-4eb8c7c6f040 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:27.812724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:27.813859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:27.814298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:27.814975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] PATH_INFO: `/v3/users/eb1e22aeca51438da005c01527be6d4d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:27.817522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1e22aeca51438da005c01527be6d4d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:27.820439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:27.926030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1e22aeca51438da005c01527be6d4d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:27.956083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1e22aeca51438da005c01527be6d4d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:27.957137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1e22aeca51438da005c01527be6d4d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:27.967946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1e22aeca51438da005c01527be6d4d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:27.968744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1e22aeca51438da005c01527be6d4d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:27.997712 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3414/6835] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:27 2022] DELETE /identity/v3/users/eb1e22aeca51438da005c01527be6d4d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:29.788967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:29.791115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:29.964412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438237d-4ec7-4843-89b6-8639f05d0e48 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:30.060553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561d8be-67b2-432c-89a7-0eb775afa5af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:30.061580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561d8be-67b2-432c-89a7-0eb775afa5af service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:30.062080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561d8be-67b2-432c-89a7-0eb775afa5af service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:30.062592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561d8be-67b2-432c-89a7-0eb775afa5af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:30.064821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c561d8be-67b2-432c-89a7-0eb775afa5af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:30.083250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561d8be-67b2-432c-89a7-0eb775afa5af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:30.085468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561d8be-67b2-432c-89a7-0eb775afa5af service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:30.102172 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3422/6836] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:30.854306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:30.856232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:30.976390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b8871-b337-453f-b077-9df7a63ca7eb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:31.003424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73061bbd-d1de-4c83-8bae-649f79489325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:31.004377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061bbd-d1de-4c83-8bae-649f79489325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:31.004767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061bbd-d1de-4c83-8bae-649f79489325 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:31.005150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73061bbd-d1de-4c83-8bae-649f79489325 admin admin] PATH_INFO: `/v3/projects/15cf35096c36471b818a6df365a0307d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:31.007541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73061bbd-d1de-4c83-8bae-649f79489325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15cf35096c36471b818a6df365a0307d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:31.009641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73061bbd-d1de-4c83-8bae-649f79489325 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:31.032747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:31.110271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73061bbd-d1de-4c83-8bae-649f79489325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15cf35096c36471b818a6df365a0307d', 'request_id': 'req-73061bbd-d1de-4c83-8bae-649f79489325'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:31.122355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73061bbd-d1de-4c83-8bae-649f79489325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15cf35096c36471b818a6df365a0307d', 'request_id': 'req-73061bbd-d1de-4c83-8bae-649f79489325'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:31.156335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73061bbd-d1de-4c83-8bae-649f79489325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15cf35096c36471b818a6df365a0307d', 'request_id': 'req-73061bbd-d1de-4c83-8bae-649f79489325'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:31.184848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73061bbd-d1de-4c83-8bae-649f79489325 admin admin] The token cache is being invalidate because project 15cf35096c36471b818a6df365a0307d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:31.185157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73061bbd-d1de-4c83-8bae-649f79489325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:31.186777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73061bbd-d1de-4c83-8bae-649f79489325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:31.189007 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3415/6837] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:30 2022] DELETE /identity/v3/projects/15cf35096c36471b818a6df365a0307d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:31.195529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98d82f-9e58-4001-b1a2-c723831b81ee None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:31.198100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98d82f-9e58-4001-b1a2-c723831b81ee None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:31.198600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98d82f-9e58-4001-b1a2-c723831b81ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:31.248038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ee98d82f-9e58-4001-b1a2-c723831b81ee None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:31.254021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ee98d82f-9e58-4001-b1a2-c723831b81ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:31.305608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:31.404371 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3423/6838] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:31.413271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2960e1-ea8a-4513-8f38-864881099411 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:31.413786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2960e1-ea8a-4513-8f38-864881099411 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:31.414387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2960e1-ea8a-4513-8f38-864881099411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:31.456995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9c2960e1-ea8a-4513-8f38-864881099411 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:31.460152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9c2960e1-ea8a-4513-8f38-864881099411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:31.483277 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3416/6839] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:31.486508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98d82f-9e58-4001-b1a2-c723831b81ee None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:31.505206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98d82f-9e58-4001-b1a2-c723831b81ee None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:31.510093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0f64-652e-4686-bf42-df5dc5d9801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:31.511939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0f64-652e-4686-bf42-df5dc5d9801c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:31.512249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0f64-652e-4686-bf42-df5dc5d9801c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:31.512440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0f64-652e-4686-bf42-df5dc5d9801c admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:31.513251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe0f64-652e-4686-bf42-df5dc5d9801c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:21:31.513702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe0f64-652e-4686-bf42-df5dc5d9801c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:31.515529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe0f64-652e-4686-bf42-df5dc5d9801c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:31.540012 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3424/6840] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:31.540383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2960e1-ea8a-4513-8f38-864881099411 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:31.555546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2960e1-ea8a-4513-8f38-864881099411 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:31.597011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d44821-97fc-4e9e-871e-c650d32a9692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:31.598999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44821-97fc-4e9e-871e-c650d32a9692 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:31.599501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44821-97fc-4e9e-871e-c650d32a9692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:31.600039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d44821-97fc-4e9e-871e-c650d32a9692 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:31.613085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d44821-97fc-4e9e-871e-c650d32a9692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:31.619662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d44821-97fc-4e9e-871e-c650d32a9692 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:31.692251 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3417/6841] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:31 2022] POST /identity/v3/projects => generated 399 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:21:31.696102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0f64-652e-4686-bf42-df5dc5d9801c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:31.732971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0f64-652e-4686-bf42-df5dc5d9801c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:31.884233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebca05-f434-4594-bfe0-a79fecb6cdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:31.885146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebca05-f434-4594-bfe0-a79fecb6cdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:31.885436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebca05-f434-4594-bfe0-a79fecb6cdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:31.885713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebca05-f434-4594-bfe0-a79fecb6cdf4 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:31.887602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebca05-f434-4594-bfe0-a79fecb6cdf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:31.889952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebca05-f434-4594-bfe0-a79fecb6cdf4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:31.956305 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3425/6842] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:31 2022] POST /identity/v3/users => generated 306 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:31.960019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d44821-97fc-4e9e-871e-c650d32a9692 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:31.976419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d44821-97fc-4e9e-871e-c650d32a9692 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:31.994899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3b243-47f7-48f5-ac37-524f26150abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:31.997893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3b243-47f7-48f5-ac37-524f26150abc admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:31.998192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3b243-47f7-48f5-ac37-524f26150abc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:31.998476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3b243-47f7-48f5-ac37-524f26150abc admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:31.999181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3b243-47f7-48f5-ac37-524f26150abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:32.005312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3b243-47f7-48f5-ac37-524f26150abc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:32.027768 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3418/6843] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:32.031936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebca05-f434-4594-bfe0-a79fecb6cdf4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:32.043027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebca05-f434-4594-bfe0-a79fecb6cdf4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:32.048465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895f94-2e85-404a-abcf-627208e03a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:32.049345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895f94-2e85-404a-abcf-627208e03a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:32.049736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895f94-2e85-404a-abcf-627208e03a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:32.050123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895f94-2e85-404a-abcf-627208e03a64 admin admin] PATH_INFO: `/v3/projects/7f7206c7cee0413ca03089f686766474/users/0d4ddeec46d04420a9b8bdb74c1e35b8/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:32.068914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf895f94-2e85-404a-abcf-627208e03a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7206c7cee0413ca03089f686766474, user_id=0d4ddeec46d04420a9b8bdb74c1e35b8, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:32.071925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf895f94-2e85-404a-abcf-627208e03a64 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:32.098922 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3426/6844] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:32 2022] PUT /identity/v3/projects/7f7206c7cee0413ca03089f686766474/users/0d4ddeec46d04420a9b8bdb74c1e35b8/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:32.102810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3b243-47f7-48f5-ac37-524f26150abc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:32.116247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3b243-47f7-48f5-ac37-524f26150abc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:32.269068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e50a3-ee8f-43ca-8f03-e1ed8984cb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:32.270001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e50a3-ee8f-43ca-8f03-e1ed8984cb06 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:32.270602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e50a3-ee8f-43ca-8f03-e1ed8984cb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:32.271254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e50a3-ee8f-43ca-8f03-e1ed8984cb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:32.272084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e50a3-ee8f-43ca-8f03-e1ed8984cb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:32.273932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e50a3-ee8f-43ca-8f03-e1ed8984cb06 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:32.297600 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3419/6845] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:32.299450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895f94-2e85-404a-abcf-627208e03a64 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:32.323058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895f94-2e85-404a-abcf-627208e03a64 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:32.338878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93365a16-b6bb-4238-95a1-92bb304491ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:32.340375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93365a16-b6bb-4238-95a1-92bb304491ca admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:32.341086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93365a16-b6bb-4238-95a1-92bb304491ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:32.341462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93365a16-b6bb-4238-95a1-92bb304491ca admin admin] PATH_INFO: `/v3/projects/7f7206c7cee0413ca03089f686766474/users/0d4ddeec46d04420a9b8bdb74c1e35b8/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:32.343873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93365a16-b6bb-4238-95a1-92bb304491ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7206c7cee0413ca03089f686766474, user_id=0d4ddeec46d04420a9b8bdb74c1e35b8, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:32.349293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93365a16-b6bb-4238-95a1-92bb304491ca admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:32.364815 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3427/6846] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:32 2022] PUT /identity/v3/projects/7f7206c7cee0413ca03089f686766474/users/0d4ddeec46d04420a9b8bdb74c1e35b8/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:32.378479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385338bf-d48a-4227-a72f-3787686245a4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:32.378813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385338bf-d48a-4227-a72f-3787686245a4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:32.379181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385338bf-d48a-4227-a72f-3787686245a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:32.441630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-385338bf-d48a-4227-a72f-3787686245a4 None None] MFA Rules not processed for user `0d4ddeec46d04420a9b8bdb74c1e35b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:32.443547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-385338bf-d48a-4227-a72f-3787686245a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:32.518108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:32.555644 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3420/6847] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:32 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:32.555841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93365a16-b6bb-4238-95a1-92bb304491ca admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:32.700640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93365a16-b6bb-4238-95a1-92bb304491ca admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:32.720358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30858f0-206a-485f-a92d-d00a00606d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:32.721571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30858f0-206a-485f-a92d-d00a00606d42 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:32.722048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30858f0-206a-485f-a92d-d00a00606d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:32.722564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30858f0-206a-485f-a92d-d00a00606d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:32.723546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30858f0-206a-485f-a92d-d00a00606d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:32.726150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30858f0-206a-485f-a92d-d00a00606d42 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:32.777913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:32.819862 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3428/6848] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:32 2022] POST /identity/v3/projects => generated 397 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:21:32.822043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385338bf-d48a-4227-a72f-3787686245a4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:32.838328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385338bf-d48a-4227-a72f-3787686245a4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:32.963052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d96457-5ea3-4079-8322-cc94b56cc999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:32.963881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d96457-5ea3-4079-8322-cc94b56cc999 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:32.964315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d96457-5ea3-4079-8322-cc94b56cc999 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:32.965230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d96457-5ea3-4079-8322-cc94b56cc999 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:32.965907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d96457-5ea3-4079-8322-cc94b56cc999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:32.968848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d96457-5ea3-4079-8322-cc94b56cc999 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:33.010050 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3421/6849] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:32 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:33.010484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30858f0-206a-485f-a92d-d00a00606d42 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:33.024360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30858f0-206a-485f-a92d-d00a00606d42 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:33.036561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef022d28-db57-4e42-8053-e3f710f0d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:33.037215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef022d28-db57-4e42-8053-e3f710f0d1ba admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:33.037510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef022d28-db57-4e42-8053-e3f710f0d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:33.037790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef022d28-db57-4e42-8053-e3f710f0d1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:33.038500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef022d28-db57-4e42-8053-e3f710f0d1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:33.040477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef022d28-db57-4e42-8053-e3f710f0d1ba admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:33.056856 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3429/6850] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:33.058265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d96457-5ea3-4079-8322-cc94b56cc999 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:33.073313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d96457-5ea3-4079-8322-cc94b56cc999 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:33.082650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b070c-0f5a-44d6-a36f-87e2d8ad7f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:33.084535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b070c-0f5a-44d6-a36f-87e2d8ad7f45 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:33.085756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b070c-0f5a-44d6-a36f-87e2d8ad7f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:33.086957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b070c-0f5a-44d6-a36f-87e2d8ad7f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:33.087862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b070c-0f5a-44d6-a36f-87e2d8ad7f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:33.091107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b070c-0f5a-44d6-a36f-87e2d8ad7f45 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:33.104483 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3422/6851] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:33.109158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef022d28-db57-4e42-8053-e3f710f0d1ba admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:33.121883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef022d28-db57-4e42-8053-e3f710f0d1ba admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:33.127851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946fba8-f257-4b90-bdfc-c1c9820d0f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:33.128817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946fba8-f257-4b90-bdfc-c1c9820d0f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:33.129363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946fba8-f257-4b90-bdfc-c1c9820d0f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:33.129877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946fba8-f257-4b90-bdfc-c1c9820d0f2d admin admin] PATH_INFO: `/v3/projects/26d2b91b6ed74b88aee5a17e195d25cc/users/d8ea1903d58b42cb8bfb30188e352ff0/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:33.151188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946fba8-f257-4b90-bdfc-c1c9820d0f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d2b91b6ed74b88aee5a17e195d25cc, user_id=d8ea1903d58b42cb8bfb30188e352ff0, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:33.155167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946fba8-f257-4b90-bdfc-c1c9820d0f2d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:33.181460 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3430/6852] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:33 2022] PUT /identity/v3/projects/26d2b91b6ed74b88aee5a17e195d25cc/users/d8ea1903d58b42cb8bfb30188e352ff0/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:33.193547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee0143-826f-4990-b81a-2434e47556cf None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:33.195059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee0143-826f-4990-b81a-2434e47556cf None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:33.195700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee0143-826f-4990-b81a-2434e47556cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:33.250358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-46ee0143-826f-4990-b81a-2434e47556cf None None] MFA Rules not processed for user `d8ea1903d58b42cb8bfb30188e352ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:33.252578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-46ee0143-826f-4990-b81a-2434e47556cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:33.432617 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3423/6853] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:33.446111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946fba8-f257-4b90-bdfc-c1c9820d0f2d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:33.448590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9946fba8-f257-4b90-bdfc-c1c9820d0f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:33.531940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946fba8-f257-4b90-bdfc-c1c9820d0f2d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:33.541791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5053d-7fe0-40e0-b97c-e1a8a17164fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:33.543140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5053d-7fe0-40e0-b97c-e1a8a17164fe service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:33.543439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5053d-7fe0-40e0-b97c-e1a8a17164fe service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:33.543721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5053d-7fe0-40e0-b97c-e1a8a17164fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:33.660152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5053d-7fe0-40e0-b97c-e1a8a17164fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:33.662129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5053d-7fe0-40e0-b97c-e1a8a17164fe service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:33.678039 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3431/6854] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:33 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:34.354101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee0143-826f-4990-b81a-2434e47556cf None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:34.477750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:34.496344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee0143-826f-4990-b81a-2434e47556cf None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:34.507049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:34.507801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:34.508155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:34.508499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] PATH_INFO: `/v3/users/0d4ddeec46d04420a9b8bdb74c1e35b8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:34.513374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4ddeec46d04420a9b8bdb74c1e35b8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:34.515926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:34.653901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4ddeec46d04420a9b8bdb74c1e35b8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:34.664734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4ddeec46d04420a9b8bdb74c1e35b8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:34.665660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4ddeec46d04420a9b8bdb74c1e35b8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:34.684775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4ddeec46d04420a9b8bdb74c1e35b8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:34.693846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4ddeec46d04420a9b8bdb74c1e35b8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:34.736814 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3424/6855] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:34 2022] DELETE /identity/v3/users/0d4ddeec46d04420a9b8bdb74c1e35b8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:34.740943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f0c9-067c-488c-8e84-c5d3c8ddcf97 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:34.741431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f0c9-067c-488c-8e84-c5d3c8ddcf97 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:34.741542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f0c9-067c-488c-8e84-c5d3c8ddcf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:34.766529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bc92f0c9-067c-488c-8e84-c5d3c8ddcf97 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:34.768246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bc92f0c9-067c-488c-8e84-c5d3c8ddcf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:34.900742 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3432/6856] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:21:34.911841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:34.913591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:35.038069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92f0c9-067c-488c-8e84-c5d3c8ddcf97 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:35.038847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bc92f0c9-067c-488c-8e84-c5d3c8ddcf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:35.047969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fbd2b-b62e-44fc-89b7-2b2136f1871f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:35.055998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec30b2-d8e9-48db-9558-353180177c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:35.057035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec30b2-d8e9-48db-9558-353180177c0f service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:35.058817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec30b2-d8e9-48db-9558-353180177c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:35.059319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec30b2-d8e9-48db-9558-353180177c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:35.061634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92f0c9-067c-488c-8e84-c5d3c8ddcf97 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:35.070088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:35.070328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:35.070603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:35.070909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] PATH_INFO: `/v3/users/bb9f11c941cd4f23ab4ba84a8accf4e4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:35.083702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9f11c941cd4f23ab4ba84a8accf4e4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:35.085727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:35.086952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec30b2-d8e9-48db-9558-353180177c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:35.089778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec30b2-d8e9-48db-9558-353180177c0f service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:35.091738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:35.111759 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3425/6857] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:35.181962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9f11c941cd4f23ab4ba84a8accf4e4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:35.192265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9f11c941cd4f23ab4ba84a8accf4e4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:35.193207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9f11c941cd4f23ab4ba84a8accf4e4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:35.210939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9f11c941cd4f23ab4ba84a8accf4e4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:35.212813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9f11c941cd4f23ab4ba84a8accf4e4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:35.238819 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3433/6858] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:35 2022] DELETE /identity/v3/users/bb9f11c941cd4f23ab4ba84a8accf4e4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:21:35.244366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fabae-b2a7-4bb6-9e18-5800446052ec None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:35.244825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fabae-b2a7-4bb6-9e18-5800446052ec None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:35.245202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fabae-b2a7-4bb6-9e18-5800446052ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:35.281516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d46fabae-b2a7-4bb6-9e18-5800446052ec None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:35.284023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d46fabae-b2a7-4bb6-9e18-5800446052ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:35.435353 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3426/6859] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:35.520220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:35.524535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:35.717412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b4029-5c84-4eb3-9f2b-7a1146381b90 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:35.724223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f977f-e356-42d5-b75c-ec219842d579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:35.727507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f977f-e356-42d5-b75c-ec219842d579 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:35.727989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f977f-e356-42d5-b75c-ec219842d579 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:35.728377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f977f-e356-42d5-b75c-ec219842d579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:35.760719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f977f-e356-42d5-b75c-ec219842d579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:35.764617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f977f-e356-42d5-b75c-ec219842d579 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:35.811635 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3434/6860] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:37.007460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fabae-b2a7-4bb6-9e18-5800446052ec None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:37.012564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d46fabae-b2a7-4bb6-9e18-5800446052ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:37.053369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fabae-b2a7-4bb6-9e18-5800446052ec None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:37.070002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:37.071013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:37.071458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:37.071884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] PATH_INFO: `/v3/projects/7f7206c7cee0413ca03089f686766474` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:37.073613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7206c7cee0413ca03089f686766474)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:37.081078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:37.164118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:37.299928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7206c7cee0413ca03089f686766474', 'request_id': 'req-57d17e98-7333-48b1-93ba-9ddd400c3399'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:37.311289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7206c7cee0413ca03089f686766474', 'request_id': 'req-57d17e98-7333-48b1-93ba-9ddd400c3399'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:37.341371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7206c7cee0413ca03089f686766474', 'request_id': 'req-57d17e98-7333-48b1-93ba-9ddd400c3399'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:37.394237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] The token cache is being invalidate because project 7f7206c7cee0413ca03089f686766474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:37.394548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:37.397556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:37.403284 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3427/6861] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:37 2022] DELETE /identity/v3/projects/7f7206c7cee0413ca03089f686766474 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:37.407558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f977f-e356-42d5-b75c-ec219842d579 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:37.429608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f977f-e356-42d5-b75c-ec219842d579 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:37.532267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:37.532924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:37.533210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:37.533486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] PATH_INFO: `/v3/users/d8ea1903d58b42cb8bfb30188e352ff0` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:37.534641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ea1903d58b42cb8bfb30188e352ff0)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:37.536704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:37.628257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:37.677226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ea1903d58b42cb8bfb30188e352ff0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:37.688081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ea1903d58b42cb8bfb30188e352ff0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:37.689630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ea1903d58b42cb8bfb30188e352ff0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:37.711403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ea1903d58b42cb8bfb30188e352ff0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:37.712394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ea1903d58b42cb8bfb30188e352ff0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:37.746527 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3435/6862] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:37 2022] DELETE /identity/v3/users/d8ea1903d58b42cb8bfb30188e352ff0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:37.950143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:37.951120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:38.000002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d17e98-7333-48b1-93ba-9ddd400c3399 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:38.109284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:38.110683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:38.111224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:38.111683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] PATH_INFO: `/v3/projects/cf0fd1b7e5194e14a2576c4b4ecd795f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:38.113121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0fd1b7e5194e14a2576c4b4ecd795f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:38.115311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:38.181418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0fd1b7e5194e14a2576c4b4ecd795f', 'request_id': 'req-b6579b45-5f50-42bd-9c24-0e664deac0ce'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:38.189881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0fd1b7e5194e14a2576c4b4ecd795f', 'request_id': 'req-b6579b45-5f50-42bd-9c24-0e664deac0ce'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:38.200163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0fd1b7e5194e14a2576c4b4ecd795f', 'request_id': 'req-b6579b45-5f50-42bd-9c24-0e664deac0ce'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:38.225627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] The token cache is being invalidate because project cf0fd1b7e5194e14a2576c4b4ecd795f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:38.226052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:38.226875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:38.229383 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3428/6863] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:37 2022] DELETE /identity/v3/projects/cf0fd1b7e5194e14a2576c4b4ecd795f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:38.233916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:38.235623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:38.251110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39383c3-8165-4219-9e30-f5873ee43e38 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:38.334802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9184df4-647e-4b4a-9450-454702016757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:38.335473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9184df4-647e-4b4a-9450-454702016757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:38.335758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9184df4-647e-4b4a-9450-454702016757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:38.336037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9184df4-647e-4b4a-9450-454702016757 admin admin] PATH_INFO: `/v3/users/41b6ac5f74b44e83b2b63e936f337d05` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:38.337215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9184df4-647e-4b4a-9450-454702016757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b6ac5f74b44e83b2b63e936f337d05)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:38.340106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9184df4-647e-4b4a-9450-454702016757 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:38.407886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9184df4-647e-4b4a-9450-454702016757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b6ac5f74b44e83b2b63e936f337d05'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:38.417867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9184df4-647e-4b4a-9450-454702016757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b6ac5f74b44e83b2b63e936f337d05'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:38.420310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9184df4-647e-4b4a-9450-454702016757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b6ac5f74b44e83b2b63e936f337d05'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:38.455373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9184df4-647e-4b4a-9450-454702016757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b6ac5f74b44e83b2b63e936f337d05'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:38.456833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9184df4-647e-4b4a-9450-454702016757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b6ac5f74b44e83b2b63e936f337d05'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:38.490325 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3436/6864] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:38 2022] DELETE /identity/v3/users/41b6ac5f74b44e83b2b63e936f337d05 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:38.988215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:38.989750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:39.009745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6579b45-5f50-42bd-9c24-0e664deac0ce admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:39.061331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:39.126123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:39.126927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:39.127192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:39.127469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] PATH_INFO: `/v3/projects/26d2b91b6ed74b88aee5a17e195d25cc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:39.128941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d2b91b6ed74b88aee5a17e195d25cc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:39.130922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:39.234017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d2b91b6ed74b88aee5a17e195d25cc', 'request_id': 'req-1856f502-27f0-4161-b7ba-384f2e5364c9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:39.250279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d2b91b6ed74b88aee5a17e195d25cc', 'request_id': 'req-1856f502-27f0-4161-b7ba-384f2e5364c9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:39.260126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d2b91b6ed74b88aee5a17e195d25cc', 'request_id': 'req-1856f502-27f0-4161-b7ba-384f2e5364c9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:39.288936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] The token cache is being invalidate because project 26d2b91b6ed74b88aee5a17e195d25cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:39.288936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:39.290314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:39.293763 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3429/6865] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:38 2022] DELETE /identity/v3/projects/26d2b91b6ed74b88aee5a17e195d25cc => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:39.299890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f825-180b-4a04-9c1e-416800c5df22 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:39.300386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f825-180b-4a04-9c1e-416800c5df22 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:39.300744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883f825-180b-4a04-9c1e-416800c5df22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:39.325772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:39.328054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:39.349515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4883f825-180b-4a04-9c1e-416800c5df22 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:39.350857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4883f825-180b-4a04-9c1e-416800c5df22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:39.410193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:39.497909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856f502-27f0-4161-b7ba-384f2e5364c9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:39.502058 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3437/6866] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:21:39.509677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfe563-6579-4b58-a561-48e635de066e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:39.509973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfe563-6579-4b58-a561-48e635de066e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:39.510255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfe563-6579-4b58-a561-48e635de066e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:39.514952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af53f7c-ebbd-458b-93b5-922fab0220af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:39.517808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af53f7c-ebbd-458b-93b5-922fab0220af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:39.518201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af53f7c-ebbd-458b-93b5-922fab0220af admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:39.520016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af53f7c-ebbd-458b-93b5-922fab0220af admin admin] PATH_INFO: `/v3/projects/d017bb979e4f4da59ca09d5ad8e722bd` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:39.522727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af53f7c-ebbd-458b-93b5-922fab0220af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d017bb979e4f4da59ca09d5ad8e722bd)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:39.529218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af53f7c-ebbd-458b-93b5-922fab0220af admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:39.544291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-74dfe563-6579-4b58-a561-48e635de066e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:39.545977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-74dfe563-6579-4b58-a561-48e635de066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:39.556957 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3438/6867] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:39.566520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfe563-6579-4b58-a561-48e635de066e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:39.592220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfe563-6579-4b58-a561-48e635de066e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:39.621910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2af53f7c-ebbd-458b-93b5-922fab0220af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd017bb979e4f4da59ca09d5ad8e722bd', 'request_id': 'req-2af53f7c-ebbd-458b-93b5-922fab0220af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:39.635454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2af53f7c-ebbd-458b-93b5-922fab0220af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd017bb979e4f4da59ca09d5ad8e722bd', 'request_id': 'req-2af53f7c-ebbd-458b-93b5-922fab0220af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:39.639203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:39.647432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2af53f7c-ebbd-458b-93b5-922fab0220af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd017bb979e4f4da59ca09d5ad8e722bd', 'request_id': 'req-2af53f7c-ebbd-458b-93b5-922fab0220af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:39.687735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2af53f7c-ebbd-458b-93b5-922fab0220af admin admin] The token cache is being invalidate because project d017bb979e4f4da59ca09d5ad8e722bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:39.688097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2af53f7c-ebbd-458b-93b5-922fab0220af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:39.689013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2af53f7c-ebbd-458b-93b5-922fab0220af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:39.691575 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3430/6868] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:39 2022] DELETE /identity/v3/projects/d017bb979e4f4da59ca09d5ad8e722bd => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:39.696822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f3857-f86e-4600-83c2-5df622aab657 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:39.697067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f3857-f86e-4600-83c2-5df622aab657 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:39.697346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f3857-f86e-4600-83c2-5df622aab657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:39.699863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b22af2-cb00-4a7c-8192-62c7f139f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:39.701410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b22af2-cb00-4a7c-8192-62c7f139f9af admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:39.702376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b22af2-cb00-4a7c-8192-62c7f139f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:39.702903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b22af2-cb00-4a7c-8192-62c7f139f9af admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:39.705217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b22af2-cb00-4a7c-8192-62c7f139f9af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:21:39.705739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b22af2-cb00-4a7c-8192-62c7f139f9af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:39.709032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b22af2-cb00-4a7c-8192-62c7f139f9af admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:39.719728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1c4f3857-f86e-4600-83c2-5df622aab657 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:39.721043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1c4f3857-f86e-4600-83c2-5df622aab657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:39.731991 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3431/6869] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:39.734291 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3439/6870] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:39.739455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f3857-f86e-4600-83c2-5df622aab657 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:39.740888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1c4f3857-f86e-4600-83c2-5df622aab657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:39.741769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d8f7-9af6-4572-ae78-d48181668247 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:39.742286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d8f7-9af6-4572-ae78-d48181668247 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:39.742933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d8f7-9af6-4572-ae78-d48181668247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:39.754351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f3857-f86e-4600-83c2-5df622aab657 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:39.759273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9cfd3-5d3b-464f-a6c4-57b13d3b5c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:39.759894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9cfd3-5d3b-464f-a6c4-57b13d3b5c61 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:39.760180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9cfd3-5d3b-464f-a6c4-57b13d3b5c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:39.760459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9cfd3-5d3b-464f-a6c4-57b13d3b5c61 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:39.761266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9cfd3-5d3b-464f-a6c4-57b13d3b5c61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:39.763778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9cfd3-5d3b-464f-a6c4-57b13d3b5c61 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:39.785326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d062d8f7-9af6-4572-ae78-d48181668247 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:39.788795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d062d8f7-9af6-4572-ae78-d48181668247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:39.800629 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3432/6871] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:39 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:39.803709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9cfd3-5d3b-464f-a6c4-57b13d3b5c61 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:39.909949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9cfd3-5d3b-464f-a6c4-57b13d3b5c61 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:39.923017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0edc61-ec25-4b9a-95b3-10043a67d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:39.924475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0edc61-ec25-4b9a-95b3-10043a67d52a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:39.924767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0edc61-ec25-4b9a-95b3-10043a67d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:39.925173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0edc61-ec25-4b9a-95b3-10043a67d52a admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:39.925823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0edc61-ec25-4b9a-95b3-10043a67d52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:39.928188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0edc61-ec25-4b9a-95b3-10043a67d52a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:39.928826 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3440/6872] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:39.933957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d8f7-9af6-4572-ae78-d48181668247 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:39.947953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d8f7-9af6-4572-ae78-d48181668247 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:39.955625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ab345-11d7-40a0-b7bf-454e8e6688c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:39.956466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ab345-11d7-40a0-b7bf-454e8e6688c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:39.956745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ab345-11d7-40a0-b7bf-454e8e6688c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:39.957029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ab345-11d7-40a0-b7bf-454e8e6688c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:39.958539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ab345-11d7-40a0-b7bf-454e8e6688c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:21:39.958880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ab345-11d7-40a0-b7bf-454e8e6688c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:39.961265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ab345-11d7-40a0-b7bf-454e8e6688c9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:39.980680 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3441/6874] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:21:39.981012 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3433/6874] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:39 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:21:39.984145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ab345-11d7-40a0-b7bf-454e8e6688c9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:39.987450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0edc61-ec25-4b9a-95b3-10043a67d52a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:40.000264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ab345-11d7-40a0-b7bf-454e8e6688c9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:40.008234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32e009-3d99-4416-8245-7e4851b3d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:40.009219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32e009-3d99-4416-8245-7e4851b3d385 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:40.009780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32e009-3d99-4416-8245-7e4851b3d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:40.009986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32e009-3d99-4416-8245-7e4851b3d385 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:40.010945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32e009-3d99-4416-8245-7e4851b3d385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:40.011402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0edc61-ec25-4b9a-95b3-10043a67d52a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:40.013595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32e009-3d99-4416-8245-7e4851b3d385 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:40.024370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c22e28-fe55-41ac-bad3-135fffd0b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:40.025883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c22e28-fe55-41ac-bad3-135fffd0b3ab admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:40.027491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c22e28-fe55-41ac-bad3-135fffd0b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:40.028179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c22e28-fe55-41ac-bad3-135fffd0b3ab admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:40.029039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c22e28-fe55-41ac-bad3-135fffd0b3ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:40.032743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c22e28-fe55-41ac-bad3-135fffd0b3ab admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:40.035965 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3442/6875] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:40.042843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32e009-3d99-4416-8245-7e4851b3d385 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:40.061705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32e009-3d99-4416-8245-7e4851b3d385 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:40.076501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911f038-1772-45e3-ac2b-a06a4bdb4412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:40.078090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911f038-1772-45e3-ac2b-a06a4bdb4412 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:40.080695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911f038-1772-45e3-ac2b-a06a4bdb4412 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:40.080988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911f038-1772-45e3-ac2b-a06a4bdb4412 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:40.088137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911f038-1772-45e3-ac2b-a06a4bdb4412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:40.088697 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3434/6876] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:39 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:21:40.093235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911f038-1772-45e3-ac2b-a06a4bdb4412 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:40.094183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c22e28-fe55-41ac-bad3-135fffd0b3ab admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:40.125588 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3443/6877] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:21:40.125987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911f038-1772-45e3-ac2b-a06a4bdb4412 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:40.138766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911f038-1772-45e3-ac2b-a06a4bdb4412 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:40.156172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:40.254391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c22e28-fe55-41ac-bad3-135fffd0b3ab admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:40.255612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26634577-d877-4244-9613-2a23d28bbed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:40.256516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634577-d877-4244-9613-2a23d28bbed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:40.256957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634577-d877-4244-9613-2a23d28bbed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:40.257363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634577-d877-4244-9613-2a23d28bbed7 admin admin] PATH_INFO: `/v3/projects/cb8adcf0655b44e5afbb292b2530bc69/users/9ff25b969b8d47f0bcb3a6952e07593e/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:40.267347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f027fe-29d3-4eb2-9906-24e69e6f18b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:40.267974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f027fe-29d3-4eb2-9906-24e69e6f18b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:40.268263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f027fe-29d3-4eb2-9906-24e69e6f18b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:40.268597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f027fe-29d3-4eb2-9906-24e69e6f18b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:40.269256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f027fe-29d3-4eb2-9906-24e69e6f18b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:40.271264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f027fe-29d3-4eb2-9906-24e69e6f18b3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:40.291598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26634577-d877-4244-9613-2a23d28bbed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb8adcf0655b44e5afbb292b2530bc69, user_id=9ff25b969b8d47f0bcb3a6952e07593e, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:40.303583 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3435/6878] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:40 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:40.303879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26634577-d877-4244-9613-2a23d28bbed7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:40.307406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f027fe-29d3-4eb2-9906-24e69e6f18b3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:40.324605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f027fe-29d3-4eb2-9906-24e69e6f18b3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:40.332040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221a549-3da9-47c1-9603-bf1804cc5439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:40.332900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221a549-3da9-47c1-9603-bf1804cc5439 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:40.333294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221a549-3da9-47c1-9603-bf1804cc5439 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:40.333770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221a549-3da9-47c1-9603-bf1804cc5439 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:40.334947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221a549-3da9-47c1-9603-bf1804cc5439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:40.337065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221a549-3da9-47c1-9603-bf1804cc5439 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:40.346793 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3444/6879] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:40 2022] PUT /identity/v3/projects/cb8adcf0655b44e5afbb292b2530bc69/users/9ff25b969b8d47f0bcb3a6952e07593e/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:40.352237 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3436/6880] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:40.352886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5439f3-5caa-43aa-b4da-4014cb73df99 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:40.353182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5439f3-5caa-43aa-b4da-4014cb73df99 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:40.353459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5439f3-5caa-43aa-b4da-4014cb73df99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:40.358054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221a549-3da9-47c1-9603-bf1804cc5439 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:40.370136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221a549-3da9-47c1-9603-bf1804cc5439 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:40.376983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:INSERT=9,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:40.451282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6b5439f3-5caa-43aa-b4da-4014cb73df99 None None] MFA Rules not processed for user `9ff25b969b8d47f0bcb3a6952e07593e`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:40.452526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6b5439f3-5caa-43aa-b4da-4014cb73df99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:40.489653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56dda-1a6c-4642-bc5e-c0796b700569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:40.490586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56dda-1a6c-4642-bc5e-c0796b700569 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:40.491302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56dda-1a6c-4642-bc5e-c0796b700569 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:40.491928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e56dda-1a6c-4642-bc5e-c0796b700569 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:40.493617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e56dda-1a6c-4642-bc5e-c0796b700569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:40.497513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e56dda-1a6c-4642-bc5e-c0796b700569 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:40.518809 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3437/6881] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:21:40.522865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56dda-1a6c-4642-bc5e-c0796b700569 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:40.537570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e56dda-1a6c-4642-bc5e-c0796b700569 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:40.544485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887687dc-d4fc-4354-83c7-f323eff2bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:40.545852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887687dc-d4fc-4354-83c7-f323eff2bcc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:40.546294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887687dc-d4fc-4354-83c7-f323eff2bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:40.548708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887687dc-d4fc-4354-83c7-f323eff2bcc3 admin admin] PATH_INFO: `/v3/projects/c1a3dc7b30a141d2aa752c3e236593c8/users/77b6cb3ca0cb4b1fbb9c73ef1a62f93b/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:40.571746 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3445/6882] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:40.572032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5439f3-5caa-43aa-b4da-4014cb73df99 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:40.577881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887687dc-d4fc-4354-83c7-f323eff2bcc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a3dc7b30a141d2aa752c3e236593c8, user_id=77b6cb3ca0cb4b1fbb9c73ef1a62f93b, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:40.580965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887687dc-d4fc-4354-83c7-f323eff2bcc3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:40.598053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5439f3-5caa-43aa-b4da-4014cb73df99 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:40.625624 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3438/6883] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:40 2022] PUT /identity/v3/projects/c1a3dc7b30a141d2aa752c3e236593c8/users/77b6cb3ca0cb4b1fbb9c73ef1a62f93b/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:40.640076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2f14f-a588-4a42-a03b-9f324b80a5e1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:40.640745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2f14f-a588-4a42-a03b-9f324b80a5e1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:40.642432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2f14f-a588-4a42-a03b-9f324b80a5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:40.717688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f8f2f14f-a588-4a42-a03b-9f324b80a5e1 None None] MFA Rules not processed for user `77b6cb3ca0cb4b1fbb9c73ef1a62f93b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:40.719134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f8f2f14f-a588-4a42-a03b-9f324b80a5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:40.845567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904378a-76c5-475b-8150-43b5e37946dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:40.848779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904378a-76c5-475b-8150-43b5e37946dd admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:40.849826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904378a-76c5-475b-8150-43b5e37946dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:40.851870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904378a-76c5-475b-8150-43b5e37946dd admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:40.855510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904378a-76c5-475b-8150-43b5e37946dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:40.863133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904378a-76c5-475b-8150-43b5e37946dd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:40.899886 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3439/6884] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:40.905680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2f14f-a588-4a42-a03b-9f324b80a5e1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:40.929312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2f14f-a588-4a42-a03b-9f324b80a5e1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:40.942471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52926b-2aa5-4e8b-9ab5-078c753df9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:40.943146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52926b-2aa5-4e8b-9ab5-078c753df9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:40.943437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52926b-2aa5-4e8b-9ab5-078c753df9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:40.943705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52926b-2aa5-4e8b-9ab5-078c753df9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:40.944353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52926b-2aa5-4e8b-9ab5-078c753df9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:40.946394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52926b-2aa5-4e8b-9ab5-078c753df9b5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:40.960537 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3446/6885] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:40 2022] POST /identity/v3/projects => generated 373 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:40.967587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904378a-76c5-475b-8150-43b5e37946dd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:40.990815 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3440/6886] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:40 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:21:40.994138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52926b-2aa5-4e8b-9ab5-078c753df9b5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:40.994855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:41.074771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904378a-76c5-475b-8150-43b5e37946dd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.081684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:41.099989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52926b-2aa5-4e8b-9ab5-078c753df9b5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.106381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9b174-ed4e-4c00-b51b-a71eeae9148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.108822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9b174-ed4e-4c00-b51b-a71eeae9148e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.108822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9b174-ed4e-4c00-b51b-a71eeae9148e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.108822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9b174-ed4e-4c00-b51b-a71eeae9148e admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.108822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9b174-ed4e-4c00-b51b-a71eeae9148e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.110288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9b174-ed4e-4c00-b51b-a71eeae9148e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.138960 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3441/6887] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:40 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:21:41.141412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9b174-ed4e-4c00-b51b-a71eeae9148e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.145522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881b96b-7b78-450d-b1a4-8e0af38f1331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.146725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881b96b-7b78-450d-b1a4-8e0af38f1331 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.147070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881b96b-7b78-450d-b1a4-8e0af38f1331 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.147411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881b96b-7b78-450d-b1a4-8e0af38f1331 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.148058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881b96b-7b78-450d-b1a4-8e0af38f1331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.150680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881b96b-7b78-450d-b1a4-8e0af38f1331 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.152956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9b174-ed4e-4c00-b51b-a71eeae9148e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.158108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3f0ab-a07e-4c9e-b298-fa82a9ca5ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.158778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3f0ab-a07e-4c9e-b298-fa82a9ca5ece admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.159304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3f0ab-a07e-4c9e-b298-fa82a9ca5ece admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.159304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3f0ab-a07e-4c9e-b298-fa82a9ca5ece admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.159919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3f0ab-a07e-4c9e-b298-fa82a9ca5ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.161501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3f0ab-a07e-4c9e-b298-fa82a9ca5ece admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.177525 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3442/6888] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:21:41.177685 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3447/6889] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:40 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:41.178702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3f0ab-a07e-4c9e-b298-fa82a9ca5ece admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.180126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881b96b-7b78-450d-b1a4-8e0af38f1331 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.190096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3f0ab-a07e-4c9e-b298-fa82a9ca5ece admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.194953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38270ce8-6cb2-4815-989e-ac1d3926eae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.195558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38270ce8-6cb2-4815-989e-ac1d3926eae7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.195842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38270ce8-6cb2-4815-989e-ac1d3926eae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.196101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881b96b-7b78-450d-b1a4-8e0af38f1331 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.196217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38270ce8-6cb2-4815-989e-ac1d3926eae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.196742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38270ce8-6cb2-4815-989e-ac1d3926eae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.198981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38270ce8-6cb2-4815-989e-ac1d3926eae7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.203647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5bdcd-7b45-4129-af23-f149fe3d81e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.204408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5bdcd-7b45-4129-af23-f149fe3d81e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.204703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5bdcd-7b45-4129-af23-f149fe3d81e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.204982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5bdcd-7b45-4129-af23-f149fe3d81e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.205639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5bdcd-7b45-4129-af23-f149fe3d81e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.207964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5bdcd-7b45-4129-af23-f149fe3d81e5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.216313 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3443/6890] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:21:41.220251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38270ce8-6cb2-4815-989e-ac1d3926eae7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.230947 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3448/6891] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:21:41.233420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5bdcd-7b45-4129-af23-f149fe3d81e5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.236694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38270ce8-6cb2-4815-989e-ac1d3926eae7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.241901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880affd5-d5e9-4238-afab-c067b719d838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.242958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880affd5-d5e9-4238-afab-c067b719d838 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.243361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880affd5-d5e9-4238-afab-c067b719d838 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.243738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880affd5-d5e9-4238-afab-c067b719d838 admin admin] PATH_INFO: `/v3/projects/92113aeff79041449f36bb0b11cab12c/users/e5683c1856834315ba2a36ed700f26aa/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.246799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5bdcd-7b45-4129-af23-f149fe3d81e5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.252528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9df23-fe48-43fc-8dba-de6c34d141a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.253441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9df23-fe48-43fc-8dba-de6c34d141a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.253911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9df23-fe48-43fc-8dba-de6c34d141a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.254441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9df23-fe48-43fc-8dba-de6c34d141a5 admin admin] PATH_INFO: `/v3/projects/4d18292430cb42638c2df7e18f52e0d7/users/7731647abf864349b77c9c93abbc095b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.268779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880affd5-d5e9-4238-afab-c067b719d838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92113aeff79041449f36bb0b11cab12c, user_id=e5683c1856834315ba2a36ed700f26aa, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.271812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880affd5-d5e9-4238-afab-c067b719d838 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.281821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9df23-fe48-43fc-8dba-de6c34d141a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d18292430cb42638c2df7e18f52e0d7, user_id=7731647abf864349b77c9c93abbc095b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.300381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9df23-fe48-43fc-8dba-de6c34d141a5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.301882 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3444/6892] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:41 2022] PUT /identity/v3/projects/92113aeff79041449f36bb0b11cab12c/users/e5683c1856834315ba2a36ed700f26aa/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:41.317727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6642-7646-4036-ba1d-2b55d01a1148 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.318460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6642-7646-4036-ba1d-2b55d01a1148 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.322715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6642-7646-4036-ba1d-2b55d01a1148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.325872 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3449/6893] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:41 2022] PUT /identity/v3/projects/4d18292430cb42638c2df7e18f52e0d7/users/7731647abf864349b77c9c93abbc095b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:41.329563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9df23-fe48-43fc-8dba-de6c34d141a5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.382009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-dd5d6642-7646-4036-ba1d-2b55d01a1148 None None] MFA Rules not processed for user `e5683c1856834315ba2a36ed700f26aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:41.383811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dd5d6642-7646-4036-ba1d-2b55d01a1148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:41.439718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9df23-fe48-43fc-8dba-de6c34d141a5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.448912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e1d74-1453-48eb-910d-54a96d98d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.450163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e1d74-1453-48eb-910d-54a96d98d4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.450607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e1d74-1453-48eb-910d-54a96d98d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.451262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e1d74-1453-48eb-910d-54a96d98d4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.452112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e1d74-1453-48eb-910d-54a96d98d4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.455198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e1d74-1453-48eb-910d-54a96d98d4c6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.469638 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3450/6894] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:21:41.473387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e1d74-1453-48eb-910d-54a96d98d4c6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.486420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e1d74-1453-48eb-910d-54a96d98d4c6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.496401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4b74d-71b9-417e-aa8a-e69a00edf5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.498185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4b74d-71b9-417e-aa8a-e69a00edf5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.498976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4b74d-71b9-417e-aa8a-e69a00edf5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.499414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4b74d-71b9-417e-aa8a-e69a00edf5e0 admin admin] PATH_INFO: `/v3/projects/4d18292430cb42638c2df7e18f52e0d7/users/7731647abf864349b77c9c93abbc095b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.502601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4b74d-71b9-417e-aa8a-e69a00edf5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d18292430cb42638c2df7e18f52e0d7, user_id=7731647abf864349b77c9c93abbc095b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.506296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4b74d-71b9-417e-aa8a-e69a00edf5e0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.519288 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3445/6895] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:41.519414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:41.522159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6642-7646-4036-ba1d-2b55d01a1148 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.528193 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3451/6896] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:41 2022] PUT /identity/v3/projects/4d18292430cb42638c2df7e18f52e0d7/users/7731647abf864349b77c9c93abbc095b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:21:41.536092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6642-7646-4036-ba1d-2b55d01a1148 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.538333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006457c-cdc5-4ee6-8f02-cb08374ad3ff None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.538625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006457c-cdc5-4ee6-8f02-cb08374ad3ff None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.538952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006457c-cdc5-4ee6-8f02-cb08374ad3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.572618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5006457c-cdc5-4ee6-8f02-cb08374ad3ff None None] MFA Rules not processed for user `7731647abf864349b77c9c93abbc095b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:41.574471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5006457c-cdc5-4ee6-8f02-cb08374ad3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:41.613267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac31da-f42c-4da2-b095-83400c5f08d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.613897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac31da-f42c-4da2-b095-83400c5f08d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.614177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac31da-f42c-4da2-b095-83400c5f08d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.614454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac31da-f42c-4da2-b095-83400c5f08d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.615146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac31da-f42c-4da2-b095-83400c5f08d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.617429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac31da-f42c-4da2-b095-83400c5f08d9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.651160 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3446/6897] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:41 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:41.655495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac31da-f42c-4da2-b095-83400c5f08d9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.658663 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3452/6898] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:21:41.661400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:41.663897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006457c-cdc5-4ee6-8f02-cb08374ad3ff None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.675537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006457c-cdc5-4ee6-8f02-cb08374ad3ff None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.737756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac31da-f42c-4da2-b095-83400c5f08d9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.744748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18693d-3469-499b-b29c-69a4cf527097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.746470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18693d-3469-499b-b29c-69a4cf527097 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.746470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18693d-3469-499b-b29c-69a4cf527097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.746640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18693d-3469-499b-b29c-69a4cf527097 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.747303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18693d-3469-499b-b29c-69a4cf527097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.749324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18693d-3469-499b-b29c-69a4cf527097 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.760304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb2f5c-2b89-4afe-a4c9-53738ac4cc64 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7731647abf864349b77c9c93abbc095b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d18292430cb42638c2df7e18f52e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.761900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb2f5c-2b89-4afe-a4c9-53738ac4cc64 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.762361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb2f5c-2b89-4afe-a4c9-53738ac4cc64 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.762647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb2f5c-2b89-4afe-a4c9-53738ac4cc64 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.763436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb2f5c-2b89-4afe-a4c9-53738ac4cc64 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:21:41.763779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb2f5c-2b89-4afe-a4c9-53738ac4cc64 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.765521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb2f5c-2b89-4afe-a4c9-53738ac4cc64 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.773179 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3447/6899] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:41 2022] POST /identity/v3/users => generated 300 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:21:41.777566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18693d-3469-499b-b29c-69a4cf527097 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.782959 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3453/6900] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:21:41.785073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb2f5c-2b89-4afe-a4c9-53738ac4cc64 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.789444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18693d-3469-499b-b29c-69a4cf527097 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.795513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00ddaf-4c27-42e2-92aa-1cd0f34a666b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.796129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00ddaf-4c27-42e2-92aa-1cd0f34a666b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.796413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00ddaf-4c27-42e2-92aa-1cd0f34a666b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.796690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00ddaf-4c27-42e2-92aa-1cd0f34a666b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.797370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00ddaf-4c27-42e2-92aa-1cd0f34a666b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.798414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb2f5c-2b89-4afe-a4c9-53738ac4cc64 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.799004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00ddaf-4c27-42e2-92aa-1cd0f34a666b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.803542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2b830-bbd2-438a-800d-905e1940d28e tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7731647abf864349b77c9c93abbc095b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d18292430cb42638c2df7e18f52e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.804309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2b830-bbd2-438a-800d-905e1940d28e tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.805023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2b830-bbd2-438a-800d-905e1940d28e tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.805023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2b830-bbd2-438a-800d-905e1940d28e tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.805717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2b830-bbd2-438a-800d-905e1940d28e tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.808115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2b830-bbd2-438a-800d-905e1940d28e tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.810701 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3448/6901] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:21:41.814659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00ddaf-4c27-42e2-92aa-1cd0f34a666b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.825890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00ddaf-4c27-42e2-92aa-1cd0f34a666b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.833199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd2596-3a0e-49a9-8318-0125ece75999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.834247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd2596-3a0e-49a9-8318-0125ece75999 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.834967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd2596-3a0e-49a9-8318-0125ece75999 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.835357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd2596-3a0e-49a9-8318-0125ece75999 admin admin] PATH_INFO: `/v3/projects/8b4e00ba07f7494eb72ffd9ee1489829/users/0688b9819c0b4014b6cd17500bd5dd79/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.846944 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3454/6902] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:41 2022] POST /identity/v3/projects => generated 349 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:21:41.850864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2b830-bbd2-438a-800d-905e1940d28e tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.858208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd2596-3a0e-49a9-8318-0125ece75999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4e00ba07f7494eb72ffd9ee1489829, user_id=0688b9819c0b4014b6cd17500bd5dd79, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.860919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd2596-3a0e-49a9-8318-0125ece75999 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.885372 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3449/6903] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:41 2022] PUT /identity/v3/projects/8b4e00ba07f7494eb72ffd9ee1489829/users/0688b9819c0b4014b6cd17500bd5dd79/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:21:41.887250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd2596-3a0e-49a9-8318-0125ece75999 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.925020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:41.929529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2b830-bbd2-438a-800d-905e1940d28e tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.954839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd2596-3a0e-49a9-8318-0125ece75999 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.959576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ea308-2352-4f0e-9131-b6137d8d83fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.960185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ea308-2352-4f0e-9131-b6137d8d83fa admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.960465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ea308-2352-4f0e-9131-b6137d8d83fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.961368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ea308-2352-4f0e-9131-b6137d8d83fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.962019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ea308-2352-4f0e-9131-b6137d8d83fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:41.963644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ea308-2352-4f0e-9131-b6137d8d83fa admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:41.978146 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3450/6904] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:21:41.979190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ea308-2352-4f0e-9131-b6137d8d83fa admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:41.989749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ea308-2352-4f0e-9131-b6137d8d83fa admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:41.995639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776189d0-273d-42d2-be59-7e651653f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:41.996301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776189d0-273d-42d2-be59-7e651653f7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:41.996581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776189d0-273d-42d2-be59-7e651653f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:41.996858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776189d0-273d-42d2-be59-7e651653f7b0 admin admin] PATH_INFO: `/v3/projects/8b4e00ba07f7494eb72ffd9ee1489829/users/0688b9819c0b4014b6cd17500bd5dd79/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:41.998934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776189d0-273d-42d2-be59-7e651653f7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4e00ba07f7494eb72ffd9ee1489829, user_id=0688b9819c0b4014b6cd17500bd5dd79, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:42.000702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f6f1c-305b-4ecc-bcef-0950ec62cf19 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7731647abf864349b77c9c93abbc095b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d18292430cb42638c2df7e18f52e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:42.001424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f6f1c-305b-4ecc-bcef-0950ec62cf19 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:42.001572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776189d0-273d-42d2-be59-7e651653f7b0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:42.001907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f6f1c-305b-4ecc-bcef-0950ec62cf19 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:42.002287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f6f1c-305b-4ecc-bcef-0950ec62cf19 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:42.003084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f6f1c-305b-4ecc-bcef-0950ec62cf19 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:21:42.003499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f6f1c-305b-4ecc-bcef-0950ec62cf19 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:42.005200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f6f1c-305b-4ecc-bcef-0950ec62cf19 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:42.019241 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3451/6905] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:41 2022] PUT /identity/v3/projects/8b4e00ba07f7494eb72ffd9ee1489829/users/0688b9819c0b4014b6cd17500bd5dd79/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:21:42.022390 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3455/6906] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:42.029738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8952-1a83-498d-83fa-80aba2a9631c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:42.030025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8952-1a83-498d-83fa-80aba2a9631c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:42.030301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a8952-1a83-498d-83fa-80aba2a9631c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:42.032830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f6f1c-305b-4ecc-bcef-0950ec62cf19 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:42.034818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a51f6f1c-305b-4ecc-bcef-0950ec62cf19 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:42.065292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b40a8952-1a83-498d-83fa-80aba2a9631c None None] MFA Rules not processed for user `0688b9819c0b4014b6cd17500bd5dd79`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:42.066649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b40a8952-1a83-498d-83fa-80aba2a9631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:42.124821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f6f1c-305b-4ecc-bcef-0950ec62cf19 tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:42.133976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:42.202021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc463c99-2083-4a2a-9992-819dce21597a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:42.204003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc463c99-2083-4a2a-9992-819dce21597a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:42.205656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc463c99-2083-4a2a-9992-819dce21597a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:42.206047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc463c99-2083-4a2a-9992-819dce21597a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:42.221372 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3452/6907] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:42.234449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8952-1a83-498d-83fa-80aba2a9631c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:42.237014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b40a8952-1a83-498d-83fa-80aba2a9631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:42.321790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc463c99-2083-4a2a-9992-819dce21597a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:42.323866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc463c99-2083-4a2a-9992-819dce21597a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:42.345338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a8952-1a83-498d-83fa-80aba2a9631c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:42.347180 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3456/6908] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:21:42.351761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4053c-db2c-4d29-ab74-c747ede42353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:42.352460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4053c-db2c-4d29-ab74-c747ede42353 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:42.352813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4053c-db2c-4d29-ab74-c747ede42353 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:42.353182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4053c-db2c-4d29-ab74-c747ede42353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:42.368548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4053c-db2c-4d29-ab74-c747ede42353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:42.371146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4053c-db2c-4d29-ab74-c747ede42353 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:42.387064 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3453/6909] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:21:43.122892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc463c99-2083-4a2a-9992-819dce21597a service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:43.125391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bc463c99-2083-4a2a-9992-819dce21597a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:43.138456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:43.155871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc463c99-2083-4a2a-9992-819dce21597a service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:43.164106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f554e0b-fa3e-44e7-99f2-e1b98bd77c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:43.165543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f554e0b-fa3e-44e7-99f2-e1b98bd77c6e service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:43.165842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f554e0b-fa3e-44e7-99f2-e1b98bd77c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:43.166117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f554e0b-fa3e-44e7-99f2-e1b98bd77c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:43.174159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8f554e0b-fa3e-44e7-99f2-e1b98bd77c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:43.239852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4053c-db2c-4d29-ab74-c747ede42353 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:43.242938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-15e4053c-db2c-4d29-ab74-c747ede42353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:43.274156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4053c-db2c-4d29-ab74-c747ede42353 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:43.297769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09495617-9b78-419c-a10f-ee3a3138b54e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:43.299242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09495617-9b78-419c-a10f-ee3a3138b54e service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:43.300256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09495617-9b78-419c-a10f-ee3a3138b54e service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:43.300939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09495617-9b78-419c-a10f-ee3a3138b54e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:43.338593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f554e0b-fa3e-44e7-99f2-e1b98bd77c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:43.341569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f554e0b-fa3e-44e7-99f2-e1b98bd77c6e service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:43.371576 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3457/6910] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:43.451493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09495617-9b78-419c-a10f-ee3a3138b54e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:43.453882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09495617-9b78-419c-a10f-ee3a3138b54e service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:43.468592 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3454/6911] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:46.785965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f554e0b-fa3e-44e7-99f2-e1b98bd77c6e service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:46.803236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f554e0b-fa3e-44e7-99f2-e1b98bd77c6e service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:46.818497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cb27c-5da6-460b-880b-84c8c635b30d tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7731647abf864349b77c9c93abbc095b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d18292430cb42638c2df7e18f52e0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:46.819197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb27c-5da6-460b-880b-84c8c635b30d tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:46.819490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb27c-5da6-460b-880b-84c8c635b30d tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:46.819770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cb27c-5da6-460b-880b-84c8c635b30d tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] PATH_INFO: `/v3/projects/85b1c0ff0640458384ef73fe2c4fc6e3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:46.825142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cb27c-5da6-460b-880b-84c8c635b30d tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: Authorizing `identity:delete_project(project_id=85b1c0ff0640458384ef73fe2c4fc6e3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:46.827169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cb27c-5da6-460b-880b-84c8c635b30d tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:46.955200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2a4cb27c-5da6-460b-880b-84c8c635b30d tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b1c0ff0640458384ef73fe2c4fc6e3', 'request_id': 'req-2a4cb27c-5da6-460b-880b-84c8c635b30d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:46.979241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2a4cb27c-5da6-460b-880b-84c8c635b30d tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b1c0ff0640458384ef73fe2c4fc6e3', 'request_id': 'req-2a4cb27c-5da6-460b-880b-84c8c635b30d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:46.987163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2a4cb27c-5da6-460b-880b-84c8c635b30d tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b1c0ff0640458384ef73fe2c4fc6e3', 'request_id': 'req-2a4cb27c-5da6-460b-880b-84c8c635b30d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:47.039713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2a4cb27c-5da6-460b-880b-84c8c635b30d tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] The token cache is being invalidate because project 85b1c0ff0640458384ef73fe2c4fc6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:47.040031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2a4cb27c-5da6-460b-880b-84c8c635b30d tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:47.043643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2a4cb27c-5da6-460b-880b-84c8c635b30d tempest-QuotasNegativeTest-1785425359 tempest-QuotasNegativeTest-1785425359-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:47.047322 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3458/6912] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:46 2022] DELETE /identity/v3/projects/85b1c0ff0640458384ef73fe2c4fc6e3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:47.052550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09495617-9b78-419c-a10f-ee3a3138b54e service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:47.231817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09495617-9b78-419c-a10f-ee3a3138b54e service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:47.263321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:47.399305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:47.399978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:47.400262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:47.400540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] PATH_INFO: `/v3/users/9ff25b969b8d47f0bcb3a6952e07593e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:47.405763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff25b969b8d47f0bcb3a6952e07593e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:47.407957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:47.531248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff25b969b8d47f0bcb3a6952e07593e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:47.558854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff25b969b8d47f0bcb3a6952e07593e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:47.559878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff25b969b8d47f0bcb3a6952e07593e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:47.575506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff25b969b8d47f0bcb3a6952e07593e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:47.576269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff25b969b8d47f0bcb3a6952e07593e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:47.624870 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3455/6913] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:47 2022] DELETE /identity/v3/users/9ff25b969b8d47f0bcb3a6952e07593e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:47.626105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc56b51-e5e5-4252-83ad-8acbdb9b1cb7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:47.626399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc56b51-e5e5-4252-83ad-8acbdb9b1cb7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:47.626677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc56b51-e5e5-4252-83ad-8acbdb9b1cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:47.675358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-dbc56b51-e5e5-4252-83ad-8acbdb9b1cb7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:47.675908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dbc56b51-e5e5-4252-83ad-8acbdb9b1cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:47.803256 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3459/6914] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:21:47.857653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:47.859232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:47.995903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf515a-a450-4661-9eab-a12309bc86ad admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:48.011500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf26419-f7aa-4e98-af89-3163d81b3912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:48.012151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf26419-f7aa-4e98-af89-3163d81b3912 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:48.012435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf26419-f7aa-4e98-af89-3163d81b3912 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:48.012710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf26419-f7aa-4e98-af89-3163d81b3912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:48.031597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc56b51-e5e5-4252-83ad-8acbdb9b1cb7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:48.033457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dbc56b51-e5e5-4252-83ad-8acbdb9b1cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:48.035782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf26419-f7aa-4e98-af89-3163d81b3912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:48.037373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf26419-f7aa-4e98-af89-3163d81b3912 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:48.049208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc56b51-e5e5-4252-83ad-8acbdb9b1cb7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:48.060598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf71f70-52bd-4e18-af82-b7ac15d1a0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:48.061726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf71f70-52bd-4e18-af82-b7ac15d1a0ac service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:48.062160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf71f70-52bd-4e18-af82-b7ac15d1a0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:48.062581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf71f70-52bd-4e18-af82-b7ac15d1a0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:48.063705 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3456/6915] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:48.068297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eaf71f70-52bd-4e18-af82-b7ac15d1a0ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:48.093478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:48.165881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf71f70-52bd-4e18-af82-b7ac15d1a0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:48.168127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf71f70-52bd-4e18-af82-b7ac15d1a0ac service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:48.183819 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3460/6916] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:21:49.432865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf26419-f7aa-4e98-af89-3163d81b3912 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:49.435178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ccf26419-f7aa-4e98-af89-3163d81b3912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:49.471388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf26419-f7aa-4e98-af89-3163d81b3912 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:49.485126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:49.486163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:49.486602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:49.487099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] PATH_INFO: `/v3/projects/cb8adcf0655b44e5afbb292b2530bc69` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:49.488480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb8adcf0655b44e5afbb292b2530bc69)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:49.496107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:49.614506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:49.672359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb8adcf0655b44e5afbb292b2530bc69', 'request_id': 'req-73a67ec2-3529-4caf-b071-67be76cc565d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:49.704702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb8adcf0655b44e5afbb292b2530bc69', 'request_id': 'req-73a67ec2-3529-4caf-b071-67be76cc565d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:49.723423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb8adcf0655b44e5afbb292b2530bc69', 'request_id': 'req-73a67ec2-3529-4caf-b071-67be76cc565d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:49.755525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] The token cache is being invalidate because project cb8adcf0655b44e5afbb292b2530bc69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:49.755734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:49.757627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:49.759371 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3457/6917] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:49 2022] DELETE /identity/v3/projects/cb8adcf0655b44e5afbb292b2530bc69 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:49.763882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf71f70-52bd-4e18-af82-b7ac15d1a0ac service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:49.781235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf71f70-52bd-4e18-af82-b7ac15d1a0ac service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:49.946768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3beef-43aa-44d8-bbf5-b63c834b279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:49.946768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3beef-43aa-44d8-bbf5-b63c834b279a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:49.946768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3beef-43aa-44d8-bbf5-b63c834b279a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:49.946768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3beef-43aa-44d8-bbf5-b63c834b279a admin admin] PATH_INFO: `/v3/users/7731647abf864349b77c9c93abbc095b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:49.947509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3beef-43aa-44d8-bbf5-b63c834b279a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7731647abf864349b77c9c93abbc095b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:49.949607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3beef-43aa-44d8-bbf5-b63c834b279a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:50.063224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91f3beef-43aa-44d8-bbf5-b63c834b279a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7731647abf864349b77c9c93abbc095b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:50.080941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91f3beef-43aa-44d8-bbf5-b63c834b279a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7731647abf864349b77c9c93abbc095b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:50.082378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91f3beef-43aa-44d8-bbf5-b63c834b279a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7731647abf864349b77c9c93abbc095b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:50.109945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91f3beef-43aa-44d8-bbf5-b63c834b279a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7731647abf864349b77c9c93abbc095b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:50.112447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91f3beef-43aa-44d8-bbf5-b63c834b279a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7731647abf864349b77c9c93abbc095b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:50.158856 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3461/6918] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:49 2022] DELETE /identity/v3/users/7731647abf864349b77c9c93abbc095b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:50.708130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:50.710054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:50.736716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a67ec2-3529-4caf-b071-67be76cc565d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:50.863306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a5cf4-3945-4739-9e6e-32dc59d6992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:50.863979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a5cf4-3945-4739-9e6e-32dc59d6992d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:50.864267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a5cf4-3945-4739-9e6e-32dc59d6992d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:50.864550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a5cf4-3945-4739-9e6e-32dc59d6992d admin admin] PATH_INFO: `/v3/projects/4d18292430cb42638c2df7e18f52e0d7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:50.866398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a5cf4-3945-4739-9e6e-32dc59d6992d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d18292430cb42638c2df7e18f52e0d7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:50.872499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a5cf4-3945-4739-9e6e-32dc59d6992d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:51.045022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-395a5cf4-3945-4739-9e6e-32dc59d6992d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d18292430cb42638c2df7e18f52e0d7', 'request_id': 'req-395a5cf4-3945-4739-9e6e-32dc59d6992d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:51.071697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-395a5cf4-3945-4739-9e6e-32dc59d6992d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d18292430cb42638c2df7e18f52e0d7', 'request_id': 'req-395a5cf4-3945-4739-9e6e-32dc59d6992d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:51.091536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-395a5cf4-3945-4739-9e6e-32dc59d6992d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d18292430cb42638c2df7e18f52e0d7', 'request_id': 'req-395a5cf4-3945-4739-9e6e-32dc59d6992d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:51.114372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-395a5cf4-3945-4739-9e6e-32dc59d6992d admin admin] The token cache is being invalidate because project 4d18292430cb42638c2df7e18f52e0d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:21:51.114813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-395a5cf4-3945-4739-9e6e-32dc59d6992d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:51.115550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-395a5cf4-3945-4739-9e6e-32dc59d6992d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:21:51.122808 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3458/6919] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:21:50 2022] DELETE /identity/v3/projects/4d18292430cb42638c2df7e18f52e0d7 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:51.128781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d203ab-a153-4c8b-925a-305972ca57bf None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:51.129915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d203ab-a153-4c8b-925a-305972ca57bf None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:51.130415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d203ab-a153-4c8b-925a-305972ca57bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:51.172736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-96d203ab-a153-4c8b-925a-305972ca57bf None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:51.178375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-96d203ab-a153-4c8b-925a-305972ca57bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:51.243708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:51.355026 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3462/6920] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:51.375419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62b51-8a04-405f-b68c-4d7e4de171f8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:51.375849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62b51-8a04-405f-b68c-4d7e4de171f8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:51.377346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e62b51-8a04-405f-b68c-4d7e4de171f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:51.471476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-42e62b51-8a04-405f-b68c-4d7e4de171f8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:51.472758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-42e62b51-8a04-405f-b68c-4d7e4de171f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:51.509452 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3459/6921] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:51.515095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d203ab-a153-4c8b-925a-305972ca57bf None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:51.534805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d203ab-a153-4c8b-925a-305972ca57bf None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:51.555818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291ff08-eb94-4673-8a1a-238ae7563177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:51.556484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ff08-eb94-4673-8a1a-238ae7563177 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:51.556804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ff08-eb94-4673-8a1a-238ae7563177 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:51.557075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ff08-eb94-4673-8a1a-238ae7563177 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:51.558236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291ff08-eb94-4673-8a1a-238ae7563177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:21:51.558236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291ff08-eb94-4673-8a1a-238ae7563177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:51.568652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291ff08-eb94-4673-8a1a-238ae7563177 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:51.601312 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3463/6922] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:21:51.608053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62b51-8a04-405f-b68c-4d7e4de171f8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:51.617767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e62b51-8a04-405f-b68c-4d7e4de171f8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:51.629892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798b7bc-d61b-4f12-8382-6ae29dafdc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:51.633045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798b7bc-d61b-4f12-8382-6ae29dafdc8a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:51.634234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798b7bc-d61b-4f12-8382-6ae29dafdc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:51.634548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798b7bc-d61b-4f12-8382-6ae29dafdc8a admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:51.635230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798b7bc-d61b-4f12-8382-6ae29dafdc8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:51.648605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798b7bc-d61b-4f12-8382-6ae29dafdc8a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:51.783125 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3460/6923] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:51 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:51.785504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291ff08-eb94-4673-8a1a-238ae7563177 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:51.811880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291ff08-eb94-4673-8a1a-238ae7563177 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:52.029176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486e080-df79-4540-ba50-33676912055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:52.029826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486e080-df79-4540-ba50-33676912055b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:52.030108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486e080-df79-4540-ba50-33676912055b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:52.033442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486e080-df79-4540-ba50-33676912055b admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:52.034191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486e080-df79-4540-ba50-33676912055b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:52.037596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486e080-df79-4540-ba50-33676912055b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:52.090652 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3464/6924] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:51 2022] POST /identity/v3/users => generated 289 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:52.095306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798b7bc-d61b-4f12-8382-6ae29dafdc8a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:52.139561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798b7bc-d61b-4f12-8382-6ae29dafdc8a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:52.161749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdfe8f-d7a2-4e79-9112-493ff9ae10b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:52.162618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdfe8f-d7a2-4e79-9112-493ff9ae10b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:52.163038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdfe8f-d7a2-4e79-9112-493ff9ae10b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:52.163417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdfe8f-d7a2-4e79-9112-493ff9ae10b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:52.164185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdfe8f-d7a2-4e79-9112-493ff9ae10b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:52.167296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdfe8f-d7a2-4e79-9112-493ff9ae10b9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:52.183264 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3461/6925] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:52.187392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486e080-df79-4540-ba50-33676912055b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:52.205047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486e080-df79-4540-ba50-33676912055b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:52.223224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d9b58-328e-431c-87fd-bfcbebab7d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:52.224047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9b58-328e-431c-87fd-bfcbebab7d99 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:52.226925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9b58-328e-431c-87fd-bfcbebab7d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:52.227387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9b58-328e-431c-87fd-bfcbebab7d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:52.228227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d9b58-328e-431c-87fd-bfcbebab7d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:52.238715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d9b58-328e-431c-87fd-bfcbebab7d99 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:52.316119 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3465/6926] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:52.321044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdfe8f-d7a2-4e79-9112-493ff9ae10b9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:52.328196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:52.341509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdfe8f-d7a2-4e79-9112-493ff9ae10b9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:52.359372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafda0f-1850-4f2b-8134-e1648758311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:52.360264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafda0f-1850-4f2b-8134-e1648758311f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:52.360931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafda0f-1850-4f2b-8134-e1648758311f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:52.361350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafda0f-1850-4f2b-8134-e1648758311f admin admin] PATH_INFO: `/v3/projects/3d86908f9d6e404dba7468d5d8f8dc88/users/7b371da2cc354c0fa07ee93d78678bbf/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:52.449574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafda0f-1850-4f2b-8134-e1648758311f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d86908f9d6e404dba7468d5d8f8dc88, user_id=7b371da2cc354c0fa07ee93d78678bbf, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:52.452390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafda0f-1850-4f2b-8134-e1648758311f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:52.518812 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3462/6927] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:52 2022] PUT /identity/v3/projects/3d86908f9d6e404dba7468d5d8f8dc88/users/7b371da2cc354c0fa07ee93d78678bbf/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:52.537749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189afe8-673c-4def-aa4d-a3a31fea879c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:52.538488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189afe8-673c-4def-aa4d-a3a31fea879c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:52.539025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189afe8-673c-4def-aa4d-a3a31fea879c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:52.606720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8189afe8-673c-4def-aa4d-a3a31fea879c None None] MFA Rules not processed for user `7b371da2cc354c0fa07ee93d78678bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:52.608463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8189afe8-673c-4def-aa4d-a3a31fea879c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:52.725102 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3466/6928] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:52.729988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafda0f-1850-4f2b-8134-e1648758311f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:52.893419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafda0f-1850-4f2b-8134-e1648758311f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:52.908233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124cccf-37b7-4961-bb05-66b52754fe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:52.909306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124cccf-37b7-4961-bb05-66b52754fe33 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:52.910009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124cccf-37b7-4961-bb05-66b52754fe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:52.910483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124cccf-37b7-4961-bb05-66b52754fe33 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:52.911644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124cccf-37b7-4961-bb05-66b52754fe33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:52.919291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124cccf-37b7-4961-bb05-66b52754fe33 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:52.999901 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3463/6929] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:21:52 2022] POST /identity/v3/projects => generated 375 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:21:53.004439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189afe8-673c-4def-aa4d-a3a31fea879c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:53.009467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124cccf-37b7-4961-bb05-66b52754fe33 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:53.012213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9124cccf-37b7-4961-bb05-66b52754fe33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:53.025573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189afe8-673c-4def-aa4d-a3a31fea879c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:53.069470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:53.163312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124cccf-37b7-4961-bb05-66b52754fe33 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:53.174785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b196bb-36be-4060-808d-decc04e6de27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:53.177654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b196bb-36be-4060-808d-decc04e6de27 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:53.179322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b196bb-36be-4060-808d-decc04e6de27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:53.181382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b196bb-36be-4060-808d-decc04e6de27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:53.184123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-73b196bb-36be-4060-808d-decc04e6de27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:53.189211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf8c53-c411-49b2-96bc-904dc9560d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:53.190394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf8c53-c411-49b2-96bc-904dc9560d68 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:53.191582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf8c53-c411-49b2-96bc-904dc9560d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:53.192710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf8c53-c411-49b2-96bc-904dc9560d68 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:53.193448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf8c53-c411-49b2-96bc-904dc9560d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:53.203930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf8c53-c411-49b2-96bc-904dc9560d68 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:53.222340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b196bb-36be-4060-808d-decc04e6de27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:53.223932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b196bb-36be-4060-808d-decc04e6de27 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:53.259101 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3467/6930] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:21:53 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:21:53.261747 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3464/6931] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:53.262239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf8c53-c411-49b2-96bc-904dc9560d68 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:53.274707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf8c53-c411-49b2-96bc-904dc9560d68 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:53.287637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d594dba-c859-4daf-a2f7-d453a4f6c1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:53.288607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d594dba-c859-4daf-a2f7-d453a4f6c1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:53.289241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d594dba-c859-4daf-a2f7-d453a4f6c1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:53.289697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d594dba-c859-4daf-a2f7-d453a4f6c1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:53.290532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d594dba-c859-4daf-a2f7-d453a4f6c1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:53.293831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d594dba-c859-4daf-a2f7-d453a4f6c1e8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:53.312159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b196bb-36be-4060-808d-decc04e6de27 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:53.325649 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3468/6932] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:53.332125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b196bb-36be-4060-808d-decc04e6de27 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:53.338352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f6db7-77e1-42a4-b72f-0efa4848b3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:53.340004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f6db7-77e1-42a4-b72f-0efa4848b3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:53.340287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f6db7-77e1-42a4-b72f-0efa4848b3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:53.340563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f6db7-77e1-42a4-b72f-0efa4848b3c2 admin admin] PATH_INFO: `/v3/projects/826ff249ece84d2faac968ed31f7202f/users/0c6aaa1aa7464c289da2d6ad7f2134f8/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:53.358791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f6db7-77e1-42a4-b72f-0efa4848b3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826ff249ece84d2faac968ed31f7202f, user_id=0c6aaa1aa7464c289da2d6ad7f2134f8, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:53.362048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f6db7-77e1-42a4-b72f-0efa4848b3c2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:53.390223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d594dba-c859-4daf-a2f7-d453a4f6c1e8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:53.390864 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3465/6933] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:53 2022] PUT /identity/v3/projects/826ff249ece84d2faac968ed31f7202f/users/0c6aaa1aa7464c289da2d6ad7f2134f8/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:53.413607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d594dba-c859-4daf-a2f7-d453a4f6c1e8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:53.623409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2e0fa-fda0-48cc-b65c-482ab2dadb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:53.624268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e0fa-fda0-48cc-b65c-482ab2dadb39 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:53.626279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e0fa-fda0-48cc-b65c-482ab2dadb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:53.626975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e0fa-fda0-48cc-b65c-482ab2dadb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:53.628398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2e0fa-fda0-48cc-b65c-482ab2dadb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:53.633819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2e0fa-fda0-48cc-b65c-482ab2dadb39 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:53.667994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f6db7-77e1-42a4-b72f-0efa4848b3c2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:53.680776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f6db7-77e1-42a4-b72f-0efa4848b3c2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:53.681293 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3469/6934] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:21:53.706996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218796e-9872-4264-a3d2-ea8e8c943cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:53.708748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218796e-9872-4264-a3d2-ea8e8c943cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:53.711010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218796e-9872-4264-a3d2-ea8e8c943cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:53.711385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218796e-9872-4264-a3d2-ea8e8c943cfc admin admin] PATH_INFO: `/v3/projects/826ff249ece84d2faac968ed31f7202f/users/0c6aaa1aa7464c289da2d6ad7f2134f8/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:53.714251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218796e-9872-4264-a3d2-ea8e8c943cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=826ff249ece84d2faac968ed31f7202f, user_id=0c6aaa1aa7464c289da2d6ad7f2134f8, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:53.717645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218796e-9872-4264-a3d2-ea8e8c943cfc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:53.753342 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3466/6935] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:21:53 2022] PUT /identity/v3/projects/826ff249ece84d2faac968ed31f7202f/users/0c6aaa1aa7464c289da2d6ad7f2134f8/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:21:53.754183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f78a0-7364-4d7c-a623-9b2c201d0840 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:53.754484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f78a0-7364-4d7c-a623-9b2c201d0840 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:53.754818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f78a0-7364-4d7c-a623-9b2c201d0840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:53.822841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1d9f78a0-7364-4d7c-a623-9b2c201d0840 None None] MFA Rules not processed for user `0c6aaa1aa7464c289da2d6ad7f2134f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:21:53.824957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1d9f78a0-7364-4d7c-a623-9b2c201d0840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:53.959008 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3470/6936] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:21:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:21:53.973821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218796e-9872-4264-a3d2-ea8e8c943cfc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:53.983535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c218796e-9872-4264-a3d2-ea8e8c943cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:54.027949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:54.081889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218796e-9872-4264-a3d2-ea8e8c943cfc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:54.086780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d0227-9010-49fb-ba84-09fc9a68cb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:54.087457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d0227-9010-49fb-ba84-09fc9a68cb27 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:54.088193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d0227-9010-49fb-ba84-09fc9a68cb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:54.088193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d0227-9010-49fb-ba84-09fc9a68cb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:54.107526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d0227-9010-49fb-ba84-09fc9a68cb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:54.109135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d0227-9010-49fb-ba84-09fc9a68cb27 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:54.128069 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3467/6937] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:54.312279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f78a0-7364-4d7c-a623-9b2c201d0840 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:54.314629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1d9f78a0-7364-4d7c-a623-9b2c201d0840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:54.348956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:21:54.393311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f78a0-7364-4d7c-a623-9b2c201d0840 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:21:54.398683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902447bb-5de0-4fc7-b125-c83ee13e1949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:21:54.399601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902447bb-5de0-4fc7-b125-c83ee13e1949 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:21:54.400587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902447bb-5de0-4fc7-b125-c83ee13e1949 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:21:54.400587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902447bb-5de0-4fc7-b125-c83ee13e1949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:21:54.403388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-902447bb-5de0-4fc7-b125-c83ee13e1949 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:21:54.526752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902447bb-5de0-4fc7-b125-c83ee13e1949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:21:54.528237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902447bb-5de0-4fc7-b125-c83ee13e1949 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:21:54.542395 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3471/6938] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:21:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:21:59.954056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d0227-9010-49fb-ba84-09fc9a68cb27 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:21:59.955566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-182d0227-9010-49fb-ba84-09fc9a68cb27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:00.179149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d0227-9010-49fb-ba84-09fc9a68cb27 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:00.205156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:00.205755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:00.206047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:00.206337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] PATH_INFO: `/v3/users/77b6cb3ca0cb4b1fbb9c73ef1a62f93b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:00.207906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b6cb3ca0cb4b1fbb9c73ef1a62f93b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:00.209899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:00.327917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b6cb3ca0cb4b1fbb9c73ef1a62f93b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:00.351114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b6cb3ca0cb4b1fbb9c73ef1a62f93b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:00.352229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b6cb3ca0cb4b1fbb9c73ef1a62f93b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:00.375864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b6cb3ca0cb4b1fbb9c73ef1a62f93b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:00.377292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b6cb3ca0cb4b1fbb9c73ef1a62f93b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:00.403364 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3468/6939] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:21:59 2022] DELETE /identity/v3/users/77b6cb3ca0cb4b1fbb9c73ef1a62f93b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:00.408095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1bcd1-8671-41ab-b4ce-d9ca57bd59a6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:00.409051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1bcd1-8671-41ab-b4ce-d9ca57bd59a6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:00.409505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1bcd1-8671-41ab-b4ce-d9ca57bd59a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:00.465793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-73a1bcd1-8671-41ab-b4ce-d9ca57bd59a6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:00.470025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-73a1bcd1-8671-41ab-b4ce-d9ca57bd59a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:00.614287 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3472/6940] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:00.685726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:00.687930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:00.811979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edd7b4-a88f-457d-80e7-374901817f24 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:00.816505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5781878-317f-49b4-9b42-9b420e93b480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:00.817141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5781878-317f-49b4-9b42-9b420e93b480 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:00.817428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5781878-317f-49b4-9b42-9b420e93b480 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:00.817705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5781878-317f-49b4-9b42-9b420e93b480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:00.826057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:00.831093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5781878-317f-49b4-9b42-9b420e93b480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:00.832626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5781878-317f-49b4-9b42-9b420e93b480 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:00.861095 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3469/6941] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:02.081745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1bcd1-8671-41ab-b4ce-d9ca57bd59a6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:02.083242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-73a1bcd1-8671-41ab-b4ce-d9ca57bd59a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:02.103097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1bcd1-8671-41ab-b4ce-d9ca57bd59a6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:02.110247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:02.111431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:02.111431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:02.111590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] PATH_INFO: `/v3/projects/c1a3dc7b30a141d2aa752c3e236593c8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:02.112696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a3dc7b30a141d2aa752c3e236593c8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:02.114832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:02.148711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5781878-317f-49b4-9b42-9b420e93b480 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:02.150384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a5781878-317f-49b4-9b42-9b420e93b480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:02.195398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a3dc7b30a141d2aa752c3e236593c8', 'request_id': 'req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:02.227223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a3dc7b30a141d2aa752c3e236593c8', 'request_id': 'req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:02.257394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a3dc7b30a141d2aa752c3e236593c8', 'request_id': 'req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:02.264031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5781878-317f-49b4-9b42-9b420e93b480 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:02.269616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:02.274680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] The token cache is being invalidate because project c1a3dc7b30a141d2aa752c3e236593c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:02.275386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:02.277416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:02.280382 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3473/6942] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:02 2022] DELETE /identity/v3/projects/c1a3dc7b30a141d2aa752c3e236593c8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:02.283678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:02.291092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:02.472123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3688b81-144a-4378-b78c-65f4463c1a05 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6aaa1aa7464c289da2d6ad7f2134f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '826ff249ece84d2faac968ed31f7202f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:02.472918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688b81-144a-4378-b78c-65f4463c1a05 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:02.473497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688b81-144a-4378-b78c-65f4463c1a05 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:02.474969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688b81-144a-4378-b78c-65f4463c1a05 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:02.475771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3688b81-144a-4378-b78c-65f4463c1a05 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:22:02.486858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3688b81-144a-4378-b78c-65f4463c1a05 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:02.486858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3688b81-144a-4378-b78c-65f4463c1a05 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:02.494973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3f29c-ebb0-4c80-a963-e5f907cd06f3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:02.511966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:02.516240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:02.517116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:02.520485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] PATH_INFO: `/v3/users/e5683c1856834315ba2a36ed700f26aa` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:02.523539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5683c1856834315ba2a36ed700f26aa)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:02.527092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:02.534389 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3470/6943] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:22:02.535872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3688b81-144a-4378-b78c-65f4463c1a05 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:02.540343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f3688b81-144a-4378-b78c-65f4463c1a05 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:02.577111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3688b81-144a-4378-b78c-65f4463c1a05 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:02.596531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f5082-d0fc-4f48-8919-9e409f2132b0 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6aaa1aa7464c289da2d6ad7f2134f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '826ff249ece84d2faac968ed31f7202f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:02.597426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f5082-d0fc-4f48-8919-9e409f2132b0 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:02.597934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f5082-d0fc-4f48-8919-9e409f2132b0 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:02.598416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f5082-d0fc-4f48-8919-9e409f2132b0 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:02.599351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f5082-d0fc-4f48-8919-9e409f2132b0 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:02.603532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f5082-d0fc-4f48-8919-9e409f2132b0 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:02.671252 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3471/6944] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:02 2022] POST /identity/v3/projects => generated 348 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:02.674154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f5082-d0fc-4f48-8919-9e409f2132b0 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:02.709142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5683c1856834315ba2a36ed700f26aa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:02.724702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5683c1856834315ba2a36ed700f26aa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:02.726177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5683c1856834315ba2a36ed700f26aa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:02.758803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5683c1856834315ba2a36ed700f26aa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:02.760546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5683c1856834315ba2a36ed700f26aa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:02.772175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f5082-d0fc-4f48-8919-9e409f2132b0 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:02.785534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b1314-1d1f-4922-9030-af11a13960f2 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6aaa1aa7464c289da2d6ad7f2134f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '826ff249ece84d2faac968ed31f7202f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:02.786699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b1314-1d1f-4922-9030-af11a13960f2 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:02.799161 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3474/6945] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:02 2022] DELETE /identity/v3/users/e5683c1856834315ba2a36ed700f26aa => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:02.799795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b1314-1d1f-4922-9030-af11a13960f2 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:02.800309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b1314-1d1f-4922-9030-af11a13960f2 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:02.801233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b1314-1d1f-4922-9030-af11a13960f2 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:22:02.801858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b1314-1d1f-4922-9030-af11a13960f2 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:02.804111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b1314-1d1f-4922-9030-af11a13960f2 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:02.819427 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3472/6946] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:22:03.797710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:03.799566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:04.038201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab69f9d-06fe-477c-b3f9-e712878d9ce0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:04.052073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:04.052751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:04.053038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:04.053574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] PATH_INFO: `/v3/projects/92113aeff79041449f36bb0b11cab12c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:04.054935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92113aeff79041449f36bb0b11cab12c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:04.057605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:04.112596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:04.164063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92113aeff79041449f36bb0b11cab12c', 'request_id': 'req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:04.195198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92113aeff79041449f36bb0b11cab12c', 'request_id': 'req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:04.205856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92113aeff79041449f36bb0b11cab12c', 'request_id': 'req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:04.239487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] The token cache is being invalidate because project 92113aeff79041449f36bb0b11cab12c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:04.239630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:04.249790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:04.252555 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3475/6947] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:03 2022] DELETE /identity/v3/projects/92113aeff79041449f36bb0b11cab12c => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:04.256383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b1314-1d1f-4922-9030-af11a13960f2 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:04.258422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b87b1314-1d1f-4922-9030-af11a13960f2 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:04.287449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:04.414602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b1314-1d1f-4922-9030-af11a13960f2 tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:04.543645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:04.544683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:04.544683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:04.544991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] PATH_INFO: `/v3/users/0688b9819c0b4014b6cd17500bd5dd79` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:04.552351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0688b9819c0b4014b6cd17500bd5dd79)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:04.555113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:04.681754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0688b9819c0b4014b6cd17500bd5dd79'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:04.700143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0688b9819c0b4014b6cd17500bd5dd79'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:04.700912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0688b9819c0b4014b6cd17500bd5dd79'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:04.724922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0688b9819c0b4014b6cd17500bd5dd79'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:04.725585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0688b9819c0b4014b6cd17500bd5dd79'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:04.768403 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3473/6948] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:04 2022] DELETE /identity/v3/users/0688b9819c0b4014b6cd17500bd5dd79 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:05.214693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:05.218405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:05.240578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:05.246006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:05.374550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:05.461052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd76d9-3aa2-43c6-9ab9-fd3110c9073a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:05.486637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecef9b-8cdd-4059-a6b9-ea5863e9535f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:05.501483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:05.502148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:05.502521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:05.503095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] PATH_INFO: `/v3/users/c5265d83d5ae4494b59597802d052593` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:05.504311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5265d83d5ae4494b59597802d052593)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:05.506379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:05.591338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5265d83d5ae4494b59597802d052593'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:05.615750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5265d83d5ae4494b59597802d052593'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:05.616651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5265d83d5ae4494b59597802d052593'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:05.638188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5265d83d5ae4494b59597802d052593'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:05.639185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5265d83d5ae4494b59597802d052593'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:05.687588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c6aaa1aa7464c289da2d6ad7f2134f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '826ff249ece84d2faac968ed31f7202f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:05.697287 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3474/6949] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:05 2022] DELETE /identity/v3/users/c5265d83d5ae4494b59597802d052593 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:22:05.699072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:05.700488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:05.701009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] PATH_INFO: `/v3/projects/311222440fc143e0886875541d67991e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:05.703475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: Authorizing `identity:delete_project(project_id=311222440fc143e0886875541d67991e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:05.719139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:05.851323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '311222440fc143e0886875541d67991e', 'request_id': 'req-30afb42b-d5c8-420d-8aeb-cb93a87086ad'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:05.864743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '311222440fc143e0886875541d67991e', 'request_id': 'req-30afb42b-d5c8-420d-8aeb-cb93a87086ad'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:05.867726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:05.874551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '311222440fc143e0886875541d67991e', 'request_id': 'req-30afb42b-d5c8-420d-8aeb-cb93a87086ad'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:05.897079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] The token cache is being invalidate because project 311222440fc143e0886875541d67991e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:05.897377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:05.900840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:05.912101 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3476/6950] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:05 2022] DELETE /identity/v3/projects/311222440fc143e0886875541d67991e => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:05.945686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:05.947416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:06.022351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:06.023996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:06.078340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b18db-9c29-4256-95e2-429c497e262f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:06.171116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37174f-3caf-48f2-b438-a32387b9f9d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:06.171892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37174f-3caf-48f2-b438-a32387b9f9d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:06.172181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37174f-3caf-48f2-b438-a32387b9f9d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:06.172460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37174f-3caf-48f2-b438-a32387b9f9d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:06.174922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9a37174f-3caf-48f2-b438-a32387b9f9d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:06.207823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afb42b-d5c8-420d-8aeb-cb93a87086ad tempest-RoutersIpV6AdminTest-949797812 tempest-RoutersIpV6AdminTest-949797812-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:06.208959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:06.213515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:06.214966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:06.215875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:06.216297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] PATH_INFO: `/v3/projects/8b4e00ba07f7494eb72ffd9ee1489829` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:06.217885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b4e00ba07f7494eb72ffd9ee1489829)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:06.221835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:06.295518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37174f-3caf-48f2-b438-a32387b9f9d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:06.297744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37174f-3caf-48f2-b438-a32387b9f9d1 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:06.310544 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3475/6951] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:06.312177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37174f-3caf-48f2-b438-a32387b9f9d1 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:06.314343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9a37174f-3caf-48f2-b438-a32387b9f9d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:06.340477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37174f-3caf-48f2-b438-a32387b9f9d1 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:06.341505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b4e00ba07f7494eb72ffd9ee1489829', 'request_id': 'req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:06.371251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b4e00ba07f7494eb72ffd9ee1489829', 'request_id': 'req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:06.387262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b4e00ba07f7494eb72ffd9ee1489829', 'request_id': 'req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:06.423336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] The token cache is being invalidate because project 8b4e00ba07f7494eb72ffd9ee1489829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:06.423644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:06.425052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:06.426290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e745e-a440-4956-8796-0b57e864eeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:06.427221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e745e-a440-4956-8796-0b57e864eeea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:06.427655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e745e-a440-4956-8796-0b57e864eeea admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:06.427947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e745e-a440-4956-8796-0b57e864eeea admin admin] PATH_INFO: `/v3/projects/eaa59de15bec4f9fbeb72bf62b18e40b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:06.432293 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3477/6952] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:06 2022] DELETE /identity/v3/projects/8b4e00ba07f7494eb72ffd9ee1489829 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:06.436081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e745e-a440-4956-8796-0b57e864eeea admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa59de15bec4f9fbeb72bf62b18e40b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:06.436212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:06.436790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:06.437965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e745e-a440-4956-8796-0b57e864eeea admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:06.598946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4a3e745e-a440-4956-8796-0b57e864eeea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa59de15bec4f9fbeb72bf62b18e40b', 'request_id': 'req-4a3e745e-a440-4956-8796-0b57e864eeea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:06.620156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4a3e745e-a440-4956-8796-0b57e864eeea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa59de15bec4f9fbeb72bf62b18e40b', 'request_id': 'req-4a3e745e-a440-4956-8796-0b57e864eeea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:06.626906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617dad05-3ce8-4ed1-ae82-fcc1cd0fd7f9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:06.637301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4a3e745e-a440-4956-8796-0b57e864eeea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa59de15bec4f9fbeb72bf62b18e40b', 'request_id': 'req-4a3e745e-a440-4956-8796-0b57e864eeea'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:06.667633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4a3e745e-a440-4956-8796-0b57e864eeea admin admin] The token cache is being invalidate because project eaa59de15bec4f9fbeb72bf62b18e40b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:06.668775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4a3e745e-a440-4956-8796-0b57e864eeea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:06.669998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4a3e745e-a440-4956-8796-0b57e864eeea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:06.671971 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3476/6953] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:06 2022] DELETE /identity/v3/projects/eaa59de15bec4f9fbeb72bf62b18e40b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:06.673565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da32900-fae7-48df-bbf8-c367e643c9a9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:06.673958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da32900-fae7-48df-bbf8-c367e643c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:06.674335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da32900-fae7-48df-bbf8-c367e643c9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:06.702164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:06.705759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5da32900-fae7-48df-bbf8-c367e643c9a9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:06.709681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5da32900-fae7-48df-bbf8-c367e643c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:06.734008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad645c-5faf-4126-ba2b-fb302ae243c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:06.734642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad645c-5faf-4126-ba2b-fb302ae243c8 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:06.734960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad645c-5faf-4126-ba2b-fb302ae243c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:06.735219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad645c-5faf-4126-ba2b-fb302ae243c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:06.737235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b7ad645c-5faf-4126-ba2b-fb302ae243c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:06.836526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:06.888024 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3477/6954] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:06.889851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6eeb7-ec39-4bf9-a0a6-1558cfe5a542 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:06.890410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6eeb7-ec39-4bf9-a0a6-1558cfe5a542 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:06.891012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db6eeb7-ec39-4bf9-a0a6-1558cfe5a542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:06.903878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad645c-5faf-4126-ba2b-fb302ae243c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:06.907484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad645c-5faf-4126-ba2b-fb302ae243c8 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:06.952633 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3478/6955] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:06.956094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8a1e5-a95f-433a-adc6-546f3bc85392 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:06.956399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8a1e5-a95f-433a-adc6-546f3bc85392 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:06.958696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8a1e5-a95f-433a-adc6-546f3bc85392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:06.968417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4db6eeb7-ec39-4bf9-a0a6-1558cfe5a542 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:06.969649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4db6eeb7-ec39-4bf9-a0a6-1558cfe5a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:06.990816 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3478/6956] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:06.992052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a2b8a1e5-a95f-433a-adc6-546f3bc85392 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:06.993425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a2b8a1e5-a95f-433a-adc6-546f3bc85392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:06.999373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c157-12b3-4828-9f36-f8abbcae416f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:06.999850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c157-12b3-4828-9f36-f8abbcae416f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.000136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c157-12b3-4828-9f36-f8abbcae416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.015458 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3479/6957] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:07.022871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8a1e5-a95f-433a-adc6-546f3bc85392 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.025610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8a11c157-12b3-4828-9f36-f8abbcae416f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:07.027234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8a11c157-12b3-4828-9f36-f8abbcae416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:07.040550 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3479/6958] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:07.041561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11c157-12b3-4828-9f36-f8abbcae416f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.044642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8a1e5-a95f-433a-adc6-546f3bc85392 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:07.052346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65cdab-0704-4398-94e2-5fbcb90c4c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:07.053033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11c157-12b3-4828-9f36-f8abbcae416f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:07.053199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65cdab-0704-4398-94e2-5fbcb90c4c86 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.053583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65cdab-0704-4398-94e2-5fbcb90c4c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.054080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65cdab-0704-4398-94e2-5fbcb90c4c86 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.054951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65cdab-0704-4398-94e2-5fbcb90c4c86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:22:07.055361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65cdab-0704-4398-94e2-5fbcb90c4c86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:07.060209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6145b7-a3c6-4da6-8a1f-16cfd89691e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:07.060836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6145b7-a3c6-4da6-8a1f-16cfd89691e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.061288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6145b7-a3c6-4da6-8a1f-16cfd89691e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.061571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6145b7-a3c6-4da6-8a1f-16cfd89691e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.062233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6145b7-a3c6-4da6-8a1f-16cfd89691e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:22:07.062537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6145b7-a3c6-4da6-8a1f-16cfd89691e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:07.064212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6145b7-a3c6-4da6-8a1f-16cfd89691e6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:07.072210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65cdab-0704-4398-94e2-5fbcb90c4c86 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:07.089920 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3480/6959] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:22:07.096038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6145b7-a3c6-4da6-8a1f-16cfd89691e6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.100463 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3480/6960] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:22:07.105099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65cdab-0704-4398-94e2-5fbcb90c4c86 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.115946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6145b7-a3c6-4da6-8a1f-16cfd89691e6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:07.125633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5a10a-2211-4a28-bf51-f5b1dd38dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:07.127105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5a10a-2211-4a28-bf51-f5b1dd38dc80 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.127486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5a10a-2211-4a28-bf51-f5b1dd38dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.127830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5a10a-2211-4a28-bf51-f5b1dd38dc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.128562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5a10a-2211-4a28-bf51-f5b1dd38dc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:07.129203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65cdab-0704-4398-94e2-5fbcb90c4c86 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:07.131120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5a10a-2211-4a28-bf51-f5b1dd38dc80 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:07.144927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6fe7a-250b-4210-8f32-9703d9b1c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:07.145912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6fe7a-250b-4210-8f32-9703d9b1c892 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.146287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6fe7a-250b-4210-8f32-9703d9b1c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.146569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6fe7a-250b-4210-8f32-9703d9b1c892 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.147888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6fe7a-250b-4210-8f32-9703d9b1c892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:07.162236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6fe7a-250b-4210-8f32-9703d9b1c892 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:07.172452 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3481/6961] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:07 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:07.177233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5a10a-2211-4a28-bf51-f5b1dd38dc80 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.222918 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3481/6962] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:07 2022] POST /identity/v3/projects => generated 399 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:07.224889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6fe7a-250b-4210-8f32-9703d9b1c892 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.271478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5a10a-2211-4a28-bf51-f5b1dd38dc80 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:07.335606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6fe7a-250b-4210-8f32-9703d9b1c892 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:07.347100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063c091-92d3-4b4e-a1d9-7f1030e1eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:07.348156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063c091-92d3-4b4e-a1d9-7f1030e1eb31 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.348536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063c091-92d3-4b4e-a1d9-7f1030e1eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.349045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063c091-92d3-4b4e-a1d9-7f1030e1eb31 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.349971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063c091-92d3-4b4e-a1d9-7f1030e1eb31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:07.352594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063c091-92d3-4b4e-a1d9-7f1030e1eb31 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:07.402286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc27dcb-e409-4eea-9a36-2258dee9defb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:07.402966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc27dcb-e409-4eea-9a36-2258dee9defb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.403322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc27dcb-e409-4eea-9a36-2258dee9defb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.403603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc27dcb-e409-4eea-9a36-2258dee9defb admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.404309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc27dcb-e409-4eea-9a36-2258dee9defb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:07.406585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc27dcb-e409-4eea-9a36-2258dee9defb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:07.410074 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3482/6963] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:07 2022] POST /identity/v3/users => generated 300 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:07.414962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063c091-92d3-4b4e-a1d9-7f1030e1eb31 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.442654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063c091-92d3-4b4e-a1d9-7f1030e1eb31 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:07.448232 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3482/6964] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:07 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:07.449683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc27dcb-e409-4eea-9a36-2258dee9defb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.454635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3744-2967-4278-a133-86ff8c6b3c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:07.455504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3744-2967-4278-a133-86ff8c6b3c03 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.455940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3744-2967-4278-a133-86ff8c6b3c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.456367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc3744-2967-4278-a133-86ff8c6b3c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.457177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc3744-2967-4278-a133-86ff8c6b3c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:07.459139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc3744-2967-4278-a133-86ff8c6b3c03 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:07.472407 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3483/6965] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:07.475035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc27dcb-e409-4eea-9a36-2258dee9defb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:07.476808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3744-2967-4278-a133-86ff8c6b3c03 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.489680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc3744-2967-4278-a133-86ff8c6b3c03 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:07.495256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568d44a-74e2-44a9-afcb-45ab74501eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:07.496327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee2385-23c8-41cb-90a7-d2959a3423d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:07.496997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee2385-23c8-41cb-90a7-d2959a3423d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.497520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee2385-23c8-41cb-90a7-d2959a3423d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.497854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee2385-23c8-41cb-90a7-d2959a3423d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.498131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568d44a-74e2-44a9-afcb-45ab74501eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.498500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee2385-23c8-41cb-90a7-d2959a3423d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:07.499371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568d44a-74e2-44a9-afcb-45ab74501eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.500572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee2385-23c8-41cb-90a7-d2959a3423d1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:07.500916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568d44a-74e2-44a9-afcb-45ab74501eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.501603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568d44a-74e2-44a9-afcb-45ab74501eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:07.505894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568d44a-74e2-44a9-afcb-45ab74501eb4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:07.508997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:07.525103 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3483/6966] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:07.530860 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3484/6967] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:22:07.530988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568d44a-74e2-44a9-afcb-45ab74501eb4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.535369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee2385-23c8-41cb-90a7-d2959a3423d1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.578907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee2385-23c8-41cb-90a7-d2959a3423d1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:07.587490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568d44a-74e2-44a9-afcb-45ab74501eb4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:07.592688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914c9da-0aeb-46d2-964c-dcf9ecf6244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:07.594706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914c9da-0aeb-46d2-964c-dcf9ecf6244a admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.595977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914c9da-0aeb-46d2-964c-dcf9ecf6244a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.597064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914c9da-0aeb-46d2-964c-dcf9ecf6244a admin admin] PATH_INFO: `/v3/projects/e25c0e59b6eb4bfbb2e9bc37ddef94bb/users/c3dbccae1b2249f5a0c698a8d56b1867/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.602994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da441178-8b0a-4c06-b7a9-e1c9592edb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:07.604605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da441178-8b0a-4c06-b7a9-e1c9592edb6f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.605102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da441178-8b0a-4c06-b7a9-e1c9592edb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.605915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da441178-8b0a-4c06-b7a9-e1c9592edb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.606836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da441178-8b0a-4c06-b7a9-e1c9592edb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:07.609161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da441178-8b0a-4c06-b7a9-e1c9592edb6f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:07.628217 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3484/6968] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:07.633251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914c9da-0aeb-46d2-964c-dcf9ecf6244a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25c0e59b6eb4bfbb2e9bc37ddef94bb, user_id=c3dbccae1b2249f5a0c698a8d56b1867, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:07.633907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da441178-8b0a-4c06-b7a9-e1c9592edb6f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.648018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da441178-8b0a-4c06-b7a9-e1c9592edb6f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:07.650691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914c9da-0aeb-46d2-964c-dcf9ecf6244a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:07.654344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe6cf2-094e-4826-97f4-e9f35636e041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:07.655809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6cf2-094e-4826-97f4-e9f35636e041 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.656542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6cf2-094e-4826-97f4-e9f35636e041 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.657023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6cf2-094e-4826-97f4-e9f35636e041 admin admin] PATH_INFO: `/v3/projects/ccf55210931e495482126df98a1434ce/users/d79608fb44284568ae21a2a37e3fbe51/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.684664 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3485/6969] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:07 2022] PUT /identity/v3/projects/e25c0e59b6eb4bfbb2e9bc37ddef94bb/users/c3dbccae1b2249f5a0c698a8d56b1867/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:07.699291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da5d74-86ad-4010-b082-feda561a116d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.700548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da5d74-86ad-4010-b082-feda561a116d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.700946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da5d74-86ad-4010-b082-feda561a116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.709628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe6cf2-094e-4826-97f4-e9f35636e041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf55210931e495482126df98a1434ce, user_id=d79608fb44284568ae21a2a37e3fbe51, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:07.717195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe6cf2-094e-4826-97f4-e9f35636e041 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:07.724000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:07.754720 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3485/6970] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:07 2022] PUT /identity/v3/projects/ccf55210931e495482126df98a1434ce/users/d79608fb44284568ae21a2a37e3fbe51/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:22:07.756770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bebd01-4bb7-4529-80c9-f79765094e87 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:07.757064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bebd01-4bb7-4529-80c9-f79765094e87 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:07.757342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bebd01-4bb7-4529-80c9-f79765094e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:07.780990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b2da5d74-86ad-4010-b082-feda561a116d None None] MFA Rules not processed for user `c3dbccae1b2249f5a0c698a8d56b1867`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:07.782259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b2da5d74-86ad-4010-b082-feda561a116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:07.793379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a6bebd01-4bb7-4529-80c9-f79765094e87 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:07.803556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a6bebd01-4bb7-4529-80c9-f79765094e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:07.882195 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3486/6971] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:07.888866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da5d74-86ad-4010-b082-feda561a116d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.933606 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3486/6972] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:22:07.943677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bebd01-4bb7-4529-80c9-f79765094e87 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:07.945155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a6bebd01-4bb7-4529-80c9-f79765094e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:08.013648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da5d74-86ad-4010-b082-feda561a116d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:08.025049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d6804-0d4f-4966-9c3a-f100f9ef1ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:08.028545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d6804-0d4f-4966-9c3a-f100f9ef1ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:08.028977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d6804-0d4f-4966-9c3a-f100f9ef1ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:08.029736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d6804-0d4f-4966-9c3a-f100f9ef1ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:08.030026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d6804-0d4f-4966-9c3a-f100f9ef1ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:08.032084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d6804-0d4f-4966-9c3a-f100f9ef1ce6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:08.065321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bebd01-4bb7-4529-80c9-f79765094e87 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:08.072061 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3487/6973] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:07 2022] POST /identity/v3/projects => generated 399 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:08.074473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d6804-0d4f-4966-9c3a-f100f9ef1ce6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:08.075604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89f57-35ae-4719-bb92-60f3a2275c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:08.076446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89f57-35ae-4719-bb92-60f3a2275c80 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:08.077085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89f57-35ae-4719-bb92-60f3a2275c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:08.077611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e89f57-35ae-4719-bb92-60f3a2275c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:08.091897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e89f57-35ae-4719-bb92-60f3a2275c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:08.093623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e89f57-35ae-4719-bb92-60f3a2275c80 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:08.124887 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3487/6974] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:22:08.151917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:08.165353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d6804-0d4f-4966-9c3a-f100f9ef1ce6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:08.173023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52e71a-3518-40ae-a13f-7c54c55d8d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:08.173819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52e71a-3518-40ae-a13f-7c54c55d8d99 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:08.174893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52e71a-3518-40ae-a13f-7c54c55d8d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:08.175249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52e71a-3518-40ae-a13f-7c54c55d8d99 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:08.175968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52e71a-3518-40ae-a13f-7c54c55d8d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:08.178761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52e71a-3518-40ae-a13f-7c54c55d8d99 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:08.210015 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3488/6975] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:08 2022] POST /identity/v3/users => generated 306 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:08.211488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89f57-35ae-4719-bb92-60f3a2275c80 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:08.227279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e89f57-35ae-4719-bb92-60f3a2275c80 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:08.242024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43a04c-04b9-4705-862e-800c7d751bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:08.243508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43a04c-04b9-4705-862e-800c7d751bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:08.243801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43a04c-04b9-4705-862e-800c7d751bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:08.244267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43a04c-04b9-4705-862e-800c7d751bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:08.245531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43a04c-04b9-4705-862e-800c7d751bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:08.246686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43a04c-04b9-4705-862e-800c7d751bc8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:08.274199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52e71a-3518-40ae-a13f-7c54c55d8d99 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:08.276417 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3488/6976] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:08.286048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52e71a-3518-40ae-a13f-7c54c55d8d99 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:08.292887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1797d6b-1fc6-4f02-8d70-9581c53307b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:08.293611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1797d6b-1fc6-4f02-8d70-9581c53307b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:08.293837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1797d6b-1fc6-4f02-8d70-9581c53307b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:08.294116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1797d6b-1fc6-4f02-8d70-9581c53307b1 admin admin] PATH_INFO: `/v3/projects/1d13f33ab0694855a4e01599de6ca2bc/users/22639198fddb4c08831c68bb4d8add9e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:08.316145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1797d6b-1fc6-4f02-8d70-9581c53307b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d13f33ab0694855a4e01599de6ca2bc, user_id=22639198fddb4c08831c68bb4d8add9e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:08.319661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1797d6b-1fc6-4f02-8d70-9581c53307b1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:08.341898 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3489/6977] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:08 2022] PUT /identity/v3/projects/1d13f33ab0694855a4e01599de6ca2bc/users/22639198fddb4c08831c68bb4d8add9e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:22:08.346229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43a04c-04b9-4705-862e-800c7d751bc8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:08.358634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43a04c-04b9-4705-862e-800c7d751bc8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:08.436484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0ab27-a57e-42d2-adee-4a4d5fc73e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:08.455920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0ab27-a57e-42d2-adee-4a4d5fc73e03 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:08.456502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0ab27-a57e-42d2-adee-4a4d5fc73e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:08.457224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0ab27-a57e-42d2-adee-4a4d5fc73e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:08.458014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0ab27-a57e-42d2-adee-4a4d5fc73e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:08.464785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0ab27-a57e-42d2-adee-4a4d5fc73e03 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:08.512485 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3489/6978] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:08.514172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1797d6b-1fc6-4f02-8d70-9581c53307b1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:08.541861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1797d6b-1fc6-4f02-8d70-9581c53307b1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:08.566582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6c79a-af44-4d57-977a-81b62575bd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:08.569711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6c79a-af44-4d57-977a-81b62575bd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:08.570624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6c79a-af44-4d57-977a-81b62575bd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:08.571924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6c79a-af44-4d57-977a-81b62575bd4d admin admin] PATH_INFO: `/v3/projects/1d13f33ab0694855a4e01599de6ca2bc/users/22639198fddb4c08831c68bb4d8add9e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:08.594566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6c79a-af44-4d57-977a-81b62575bd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d13f33ab0694855a4e01599de6ca2bc, user_id=22639198fddb4c08831c68bb4d8add9e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:08.610056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6c79a-af44-4d57-977a-81b62575bd4d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:08.677632 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3490/6979] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:08 2022] PUT /identity/v3/projects/1d13f33ab0694855a4e01599de6ca2bc/users/22639198fddb4c08831c68bb4d8add9e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:08.697314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ab583-43e7-4d7c-a8bb-fb8b7e9509f0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:08.697314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ab583-43e7-4d7c-a8bb-fb8b7e9509f0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:08.697314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ab583-43e7-4d7c-a8bb-fb8b7e9509f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:08.823711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-568ab583-43e7-4d7c-a8bb-fb8b7e9509f0 None None] MFA Rules not processed for user `22639198fddb4c08831c68bb4d8add9e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:08.833385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-568ab583-43e7-4d7c-a8bb-fb8b7e9509f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:08.897167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:09.059543 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3490/6980] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:08 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:09.070634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6c79a-af44-4d57-977a-81b62575bd4d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:09.074720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2bf6c79a-af44-4d57-977a-81b62575bd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:09.221605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6c79a-af44-4d57-977a-81b62575bd4d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:09.236815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832363fe-498f-4334-9650-8385e2a3901a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:09.240190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832363fe-498f-4334-9650-8385e2a3901a service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:09.241767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832363fe-498f-4334-9650-8385e2a3901a service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:09.241767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832363fe-498f-4334-9650-8385e2a3901a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:09.263596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832363fe-498f-4334-9650-8385e2a3901a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:09.265194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832363fe-498f-4334-9650-8385e2a3901a service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:09.300780 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3491/6981] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:09.457946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ab583-43e7-4d7c-a8bb-fb8b7e9509f0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:09.477803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ab583-43e7-4d7c-a8bb-fb8b7e9509f0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:09.490719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03fd6c-e585-4c90-b62e-80138dbc77a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:09.491437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03fd6c-e585-4c90-b62e-80138dbc77a5 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:09.491728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03fd6c-e585-4c90-b62e-80138dbc77a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:09.492083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03fd6c-e585-4c90-b62e-80138dbc77a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:09.622628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03fd6c-e585-4c90-b62e-80138dbc77a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:09.625632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03fd6c-e585-4c90-b62e-80138dbc77a5 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:09.656223 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3491/6982] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:17.944890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832363fe-498f-4334-9650-8385e2a3901a service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:17.946560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-832363fe-498f-4334-9650-8385e2a3901a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:18.091389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832363fe-498f-4334-9650-8385e2a3901a service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:18.100119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359873b4-2e8f-4784-96c1-741e71c325a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:18.100928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359873b4-2e8f-4784-96c1-741e71c325a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:18.102914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359873b4-2e8f-4784-96c1-741e71c325a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:18.103880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359873b4-2e8f-4784-96c1-741e71c325a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:18.110038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-359873b4-2e8f-4784-96c1-741e71c325a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:18.134676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359873b4-2e8f-4784-96c1-741e71c325a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:18.136229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359873b4-2e8f-4784-96c1-741e71c325a7 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:18.150773 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3492/6983] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:22:18.505640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03fd6c-e585-4c90-b62e-80138dbc77a5 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:18.600152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03fd6c-e585-4c90-b62e-80138dbc77a5 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:18.609868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afb4f0-fcbb-4ad3-bfa1-bc4ebe6e15d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:18.610196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb4f0-fcbb-4ad3-bfa1-bc4ebe6e15d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:18.610497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb4f0-fcbb-4ad3-bfa1-bc4ebe6e15d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:18.610792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb4f0-fcbb-4ad3-bfa1-bc4ebe6e15d4 admin admin] PATH_INFO: `/v3/users/c3dbccae1b2249f5a0c698a8d56b1867` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:18.612094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afb4f0-fcbb-4ad3-bfa1-bc4ebe6e15d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3dbccae1b2249f5a0c698a8d56b1867)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:18.614842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afb4f0-fcbb-4ad3-bfa1-bc4ebe6e15d4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:18.721065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2afb4f0-fcbb-4ad3-bfa1-bc4ebe6e15d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3dbccae1b2249f5a0c698a8d56b1867'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:18.726581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:18.736114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2afb4f0-fcbb-4ad3-bfa1-bc4ebe6e15d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3dbccae1b2249f5a0c698a8d56b1867'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:18.737246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2afb4f0-fcbb-4ad3-bfa1-bc4ebe6e15d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3dbccae1b2249f5a0c698a8d56b1867'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:18.773834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2afb4f0-fcbb-4ad3-bfa1-bc4ebe6e15d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3dbccae1b2249f5a0c698a8d56b1867'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:18.774829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b2afb4f0-fcbb-4ad3-bfa1-bc4ebe6e15d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3dbccae1b2249f5a0c698a8d56b1867'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:18.812442 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3492/6984] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:18 2022] DELETE /identity/v3/users/c3dbccae1b2249f5a0c698a8d56b1867 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:18.817249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d11c6-65ac-4817-8a8f-056b821302bf None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:18.817539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d11c6-65ac-4817-8a8f-056b821302bf None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:18.817824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d11c6-65ac-4817-8a8f-056b821302bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:18.857519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-634d11c6-65ac-4817-8a8f-056b821302bf None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:18.858782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-634d11c6-65ac-4817-8a8f-056b821302bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:19.001975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d29f71-d4e7-468f-8a67-ff2a85d552e7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:19.002268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d29f71-d4e7-468f-8a67-ff2a85d552e7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:19.002545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d29f71-d4e7-468f-8a67-ff2a85d552e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:19.013431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:19.059806 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3493/6985] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:19.072152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d11c6-65ac-4817-8a8f-056b821302bf None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:19.074916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-634d11c6-65ac-4817-8a8f-056b821302bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:19.087229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-12d29f71-d4e7-468f-8a67-ff2a85d552e7 None None] MFA Rules not processed for user `d79608fb44284568ae21a2a37e3fbe51`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:19.088615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-12d29f71-d4e7-468f-8a67-ff2a85d552e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:19.220750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d11c6-65ac-4817-8a8f-056b821302bf None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:19.232096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46997bce-ded5-4b3e-b5fd-e1a058c9f8ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:19.233556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46997bce-ded5-4b3e-b5fd-e1a058c9f8ce service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:19.233907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46997bce-ded5-4b3e-b5fd-e1a058c9f8ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:19.234310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46997bce-ded5-4b3e-b5fd-e1a058c9f8ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:19.260889 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3493/6986] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:19.261128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46997bce-ded5-4b3e-b5fd-e1a058c9f8ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:19.261944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46997bce-ded5-4b3e-b5fd-e1a058c9f8ce service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:19.263154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0435e-5e20-42b9-bbb1-a1c208006195 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:19.263617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0435e-5e20-42b9-bbb1-a1c208006195 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:19.263910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0435e-5e20-42b9-bbb1-a1c208006195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:19.286784 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3494/6987] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:22:19.328715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3ea0435e-5e20-42b9-bbb1-a1c208006195 None None] MFA Rules not processed for user `d79608fb44284568ae21a2a37e3fbe51`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:19.332552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ea0435e-5e20-42b9-bbb1-a1c208006195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:19.351314 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3494/6988] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:22:19.364952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46997bce-ded5-4b3e-b5fd-e1a058c9f8ce service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:19.369098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-46997bce-ded5-4b3e-b5fd-e1a058c9f8ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:19.504972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46997bce-ded5-4b3e-b5fd-e1a058c9f8ce service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:19.514358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df593cab-bdce-4741-bcc0-5d424e9859d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:19.515326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df593cab-bdce-4741-bcc0-5d424e9859d1 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:19.515665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df593cab-bdce-4741-bcc0-5d424e9859d1 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:19.515955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df593cab-bdce-4741-bcc0-5d424e9859d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:19.529635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df593cab-bdce-4741-bcc0-5d424e9859d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:19.532550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df593cab-bdce-4741-bcc0-5d424e9859d1 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:19.565870 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3495/6989] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:20.704173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0435e-5e20-42b9-bbb1-a1c208006195 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:20.706681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ea0435e-5e20-42b9-bbb1-a1c208006195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:20.736812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0435e-5e20-42b9-bbb1-a1c208006195 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:20.748741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:20.750174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:20.750996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:20.753863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] PATH_INFO: `/v3/projects/e25c0e59b6eb4bfbb2e9bc37ddef94bb` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:20.756802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25c0e59b6eb4bfbb2e9bc37ddef94bb)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:20.763962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:20.902736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25c0e59b6eb4bfbb2e9bc37ddef94bb', 'request_id': 'req-a8f15fd7-6106-4375-bce8-15b7cb3f7674'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:20.921676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25c0e59b6eb4bfbb2e9bc37ddef94bb', 'request_id': 'req-a8f15fd7-6106-4375-bce8-15b7cb3f7674'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:20.941093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25c0e59b6eb4bfbb2e9bc37ddef94bb', 'request_id': 'req-a8f15fd7-6106-4375-bce8-15b7cb3f7674'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:20.975518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] The token cache is being invalidate because project e25c0e59b6eb4bfbb2e9bc37ddef94bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:20.976095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:20.978044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:20.981537 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3495/6990] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:20 2022] DELETE /identity/v3/projects/e25c0e59b6eb4bfbb2e9bc37ddef94bb => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:20.985958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df593cab-bdce-4741-bcc0-5d424e9859d1 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:21.010143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df593cab-bdce-4741-bcc0-5d424e9859d1 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:21.139890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624a98a-1036-47f0-8bf6-a82a149532d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:21.140801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624a98a-1036-47f0-8bf6-a82a149532d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:21.141195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624a98a-1036-47f0-8bf6-a82a149532d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:21.142515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624a98a-1036-47f0-8bf6-a82a149532d2 admin admin] PATH_INFO: `/v3/users/22639198fddb4c08831c68bb4d8add9e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:21.143803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624a98a-1036-47f0-8bf6-a82a149532d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22639198fddb4c08831c68bb4d8add9e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:21.145896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624a98a-1036-47f0-8bf6-a82a149532d2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:21.178165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:21.237470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3624a98a-1036-47f0-8bf6-a82a149532d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22639198fddb4c08831c68bb4d8add9e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:21.249391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3624a98a-1036-47f0-8bf6-a82a149532d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22639198fddb4c08831c68bb4d8add9e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:21.250146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3624a98a-1036-47f0-8bf6-a82a149532d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22639198fddb4c08831c68bb4d8add9e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:21.268652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3624a98a-1036-47f0-8bf6-a82a149532d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22639198fddb4c08831c68bb4d8add9e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:21.269944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3624a98a-1036-47f0-8bf6-a82a149532d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22639198fddb4c08831c68bb4d8add9e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:21.332085 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3496/6991] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:20 2022] DELETE /identity/v3/users/22639198fddb4c08831c68bb4d8add9e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:22.351472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:22.352946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:22.367906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f15fd7-6106-4375-bce8-15b7cb3f7674 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:22.423683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:22.494219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc99d9-8379-4443-b8e5-89a6290afd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:22.495993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc99d9-8379-4443-b8e5-89a6290afd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:22.496385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc99d9-8379-4443-b8e5-89a6290afd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:22.496762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc99d9-8379-4443-b8e5-89a6290afd15 admin admin] PATH_INFO: `/v3/projects/1d13f33ab0694855a4e01599de6ca2bc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:22.498195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc99d9-8379-4443-b8e5-89a6290afd15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d13f33ab0694855a4e01599de6ca2bc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:22.502023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc99d9-8379-4443-b8e5-89a6290afd15 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:22.618002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7edc99d9-8379-4443-b8e5-89a6290afd15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d13f33ab0694855a4e01599de6ca2bc', 'request_id': 'req-7edc99d9-8379-4443-b8e5-89a6290afd15'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:22.637851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7edc99d9-8379-4443-b8e5-89a6290afd15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d13f33ab0694855a4e01599de6ca2bc', 'request_id': 'req-7edc99d9-8379-4443-b8e5-89a6290afd15'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:22.687502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7edc99d9-8379-4443-b8e5-89a6290afd15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d13f33ab0694855a4e01599de6ca2bc', 'request_id': 'req-7edc99d9-8379-4443-b8e5-89a6290afd15'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:22.721406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7edc99d9-8379-4443-b8e5-89a6290afd15 admin admin] The token cache is being invalidate because project 1d13f33ab0694855a4e01599de6ca2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:22.721949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7edc99d9-8379-4443-b8e5-89a6290afd15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:22.723097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7edc99d9-8379-4443-b8e5-89a6290afd15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:22.726550 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3496/6992] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:22 2022] DELETE /identity/v3/projects/1d13f33ab0694855a4e01599de6ca2bc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:22.732856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291ab36-6284-412f-9ea1-8d1fa5bc890f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:22.734351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291ab36-6284-412f-9ea1-8d1fa5bc890f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:22.734902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291ab36-6284-412f-9ea1-8d1fa5bc890f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:22.780616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8291ab36-6284-412f-9ea1-8d1fa5bc890f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:22.782698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8291ab36-6284-412f-9ea1-8d1fa5bc890f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:22.960182 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3497/6993] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:22.968718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82164f0-5a70-445a-85d5-23079eeafb20 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:22.969435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82164f0-5a70-445a-85d5-23079eeafb20 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:22.970260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82164f0-5a70-445a-85d5-23079eeafb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:23.006655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e82164f0-5a70-445a-85d5-23079eeafb20 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:23.008116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e82164f0-5a70-445a-85d5-23079eeafb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:23.018795 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3497/6994] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:23.022641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291ab36-6284-412f-9ea1-8d1fa5bc890f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:23.036704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291ab36-6284-412f-9ea1-8d1fa5bc890f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:23.043600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2685a4-d024-4419-a8a1-79c4feb3d972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:23.044338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2685a4-d024-4419-a8a1-79c4feb3d972 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:23.044984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2685a4-d024-4419-a8a1-79c4feb3d972 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:23.044984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2685a4-d024-4419-a8a1-79c4feb3d972 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:23.045827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2685a4-d024-4419-a8a1-79c4feb3d972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:22:23.046468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2685a4-d024-4419-a8a1-79c4feb3d972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:23.048393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2685a4-d024-4419-a8a1-79c4feb3d972 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:23.074336 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3498/6995] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:22:23.077812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82164f0-5a70-445a-85d5-23079eeafb20 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:23.092907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82164f0-5a70-445a-85d5-23079eeafb20 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:23.098806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0f8a7-cd56-4598-900c-f89dc4bda55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:23.099933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0f8a7-cd56-4598-900c-f89dc4bda55f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:23.100289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0f8a7-cd56-4598-900c-f89dc4bda55f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:23.100995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0f8a7-cd56-4598-900c-f89dc4bda55f admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:23.101971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0f8a7-cd56-4598-900c-f89dc4bda55f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:23.104206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0f8a7-cd56-4598-900c-f89dc4bda55f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:23.176980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2685a4-d024-4419-a8a1-79c4feb3d972 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:23.178367 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3498/6996] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:23 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:23.200373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2685a4-d024-4419-a8a1-79c4feb3d972 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:23.354706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618aba5-2fff-445d-9f03-3ec0fd06ab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:23.365811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618aba5-2fff-445d-9f03-3ec0fd06ab0d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:23.366307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618aba5-2fff-445d-9f03-3ec0fd06ab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:23.366682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618aba5-2fff-445d-9f03-3ec0fd06ab0d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:23.367539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618aba5-2fff-445d-9f03-3ec0fd06ab0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:23.369857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618aba5-2fff-445d-9f03-3ec0fd06ab0d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:23.416844 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3499/6997] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:23 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:22:23.418126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0f8a7-cd56-4598-900c-f89dc4bda55f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:23.435335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0f8a7-cd56-4598-900c-f89dc4bda55f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:23.459451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bd588-ca13-429c-8078-03ac07bd021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:23.463318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd588-ca13-429c-8078-03ac07bd021d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:23.463318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd588-ca13-429c-8078-03ac07bd021d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:23.464479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bd588-ca13-429c-8078-03ac07bd021d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:23.465323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bd588-ca13-429c-8078-03ac07bd021d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:23.471906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bd588-ca13-429c-8078-03ac07bd021d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:23.517202 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3499/6998] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:22:23.521095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618aba5-2fff-445d-9f03-3ec0fd06ab0d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:23.539692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618aba5-2fff-445d-9f03-3ec0fd06ab0d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:23.553254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82efa2-9307-4be9-81ff-f980fd03a9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:23.553901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82efa2-9307-4be9-81ff-f980fd03a9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:23.554189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82efa2-9307-4be9-81ff-f980fd03a9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:23.554467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82efa2-9307-4be9-81ff-f980fd03a9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:23.558966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82efa2-9307-4be9-81ff-f980fd03a9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:23.562116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82efa2-9307-4be9-81ff-f980fd03a9a2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:23.611283 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3500/6999] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:23.614997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bd588-ca13-429c-8078-03ac07bd021d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:23.637696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bd588-ca13-429c-8078-03ac07bd021d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:23.649433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d894909-401c-4788-9c05-40c36f637532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:23.651010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d894909-401c-4788-9c05-40c36f637532 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:23.651010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d894909-401c-4788-9c05-40c36f637532 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:23.651339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d894909-401c-4788-9c05-40c36f637532 admin admin] PATH_INFO: `/v3/projects/e8bbdbab9eef45398f53239a74746cf9/users/ac6a8c8c708f4b149fec0ef598df8503/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:23.704488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d894909-401c-4788-9c05-40c36f637532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8bbdbab9eef45398f53239a74746cf9, user_id=ac6a8c8c708f4b149fec0ef598df8503, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:23.707241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d894909-401c-4788-9c05-40c36f637532 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:23.727780 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3500/7000] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:23 2022] PUT /identity/v3/projects/e8bbdbab9eef45398f53239a74746cf9/users/ac6a8c8c708f4b149fec0ef598df8503/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:23.739797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e89755-529e-401a-b148-008a3d7987de None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:23.740373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e89755-529e-401a-b148-008a3d7987de None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:23.740373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e89755-529e-401a-b148-008a3d7987de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:23.753922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:23.800294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e0e89755-529e-401a-b148-008a3d7987de None None] MFA Rules not processed for user `ac6a8c8c708f4b149fec0ef598df8503`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:23.801741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e0e89755-529e-401a-b148-008a3d7987de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:23.921098 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3501/7001] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:23.922516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d894909-401c-4788-9c05-40c36f637532 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:24.042510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d894909-401c-4788-9c05-40c36f637532 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:24.063026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8499f-ea2c-492f-b71a-8fd3ff0fca54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:24.064152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8499f-ea2c-492f-b71a-8fd3ff0fca54 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:24.065312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8499f-ea2c-492f-b71a-8fd3ff0fca54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:24.065773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8499f-ea2c-492f-b71a-8fd3ff0fca54 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:24.067473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8499f-ea2c-492f-b71a-8fd3ff0fca54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:24.073265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8499f-ea2c-492f-b71a-8fd3ff0fca54 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:24.084009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:24.150950 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3501/7002] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:23 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:24.154137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e89755-529e-401a-b148-008a3d7987de None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:24.181349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e89755-529e-401a-b148-008a3d7987de None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:24.281426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055aaa7-0745-4707-a3c2-2fec8d368e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:24.282325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055aaa7-0745-4707-a3c2-2fec8d368e8e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:24.282693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055aaa7-0745-4707-a3c2-2fec8d368e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:24.283116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055aaa7-0745-4707-a3c2-2fec8d368e8e admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:24.285970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055aaa7-0745-4707-a3c2-2fec8d368e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:24.288358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055aaa7-0745-4707-a3c2-2fec8d368e8e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:24.326035 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3502/7003] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:24 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:24.330025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8499f-ea2c-492f-b71a-8fd3ff0fca54 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:24.346571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8499f-ea2c-492f-b71a-8fd3ff0fca54 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:24.352990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e3d2e-78c1-4954-b389-f1f75c4ee83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:24.354441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e3d2e-78c1-4954-b389-f1f75c4ee83a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:24.354892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e3d2e-78c1-4954-b389-f1f75c4ee83a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:24.355078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e3d2e-78c1-4954-b389-f1f75c4ee83a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:24.355694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e3d2e-78c1-4954-b389-f1f75c4ee83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:24.357438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e3d2e-78c1-4954-b389-f1f75c4ee83a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:24.371112 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3502/7004] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:24.374932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055aaa7-0745-4707-a3c2-2fec8d368e8e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:24.389851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055aaa7-0745-4707-a3c2-2fec8d368e8e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:24.395014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e165d-9c9c-4078-a20e-9511c162985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:24.395704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e165d-9c9c-4078-a20e-9511c162985c admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:24.395992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e165d-9c9c-4078-a20e-9511c162985c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:24.396351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e165d-9c9c-4078-a20e-9511c162985c admin admin] PATH_INFO: `/v3/projects/c3b21d95591941108e0cb314a71d9078/users/d9d08083a66b4311b11434e022db0b66/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:24.420368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e165d-9c9c-4078-a20e-9511c162985c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b21d95591941108e0cb314a71d9078, user_id=d9d08083a66b4311b11434e022db0b66, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:24.423834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e165d-9c9c-4078-a20e-9511c162985c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:24.455037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e3d2e-78c1-4954-b389-f1f75c4ee83a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:24.455561 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3503/7005] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:24 2022] PUT /identity/v3/projects/c3b21d95591941108e0cb314a71d9078/users/d9d08083a66b4311b11434e022db0b66/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:24.474838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e3d2e-78c1-4954-b389-f1f75c4ee83a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:24.647912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4579b55-bc58-4912-bb54-495fc5ba3457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:24.648769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4579b55-bc58-4912-bb54-495fc5ba3457 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:24.649123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4579b55-bc58-4912-bb54-495fc5ba3457 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:24.650495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4579b55-bc58-4912-bb54-495fc5ba3457 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:24.651612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4579b55-bc58-4912-bb54-495fc5ba3457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:24.660499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4579b55-bc58-4912-bb54-495fc5ba3457 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:24.680475 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3503/7006] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:22:24.682189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e165d-9c9c-4078-a20e-9511c162985c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:24.706582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e165d-9c9c-4078-a20e-9511c162985c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:24.727943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71370f9f-b4b2-481b-88b7-f6d69d5701fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:24.729229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71370f9f-b4b2-481b-88b7-f6d69d5701fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:24.729525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71370f9f-b4b2-481b-88b7-f6d69d5701fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:24.729807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71370f9f-b4b2-481b-88b7-f6d69d5701fa admin admin] PATH_INFO: `/v3/projects/c3b21d95591941108e0cb314a71d9078/users/d9d08083a66b4311b11434e022db0b66/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:24.736305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71370f9f-b4b2-481b-88b7-f6d69d5701fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b21d95591941108e0cb314a71d9078, user_id=d9d08083a66b4311b11434e022db0b66, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:24.740915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71370f9f-b4b2-481b-88b7-f6d69d5701fa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:24.782924 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3504/7007] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:24 2022] PUT /identity/v3/projects/c3b21d95591941108e0cb314a71d9078/users/d9d08083a66b4311b11434e022db0b66/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:22:24.783708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25f175-9e5b-41ca-841b-6ac5e50d0d6d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:24.784003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25f175-9e5b-41ca-841b-6ac5e50d0d6d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:24.784284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25f175-9e5b-41ca-841b-6ac5e50d0d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:24.820339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-dc25f175-9e5b-41ca-841b-6ac5e50d0d6d None None] MFA Rules not processed for user `d9d08083a66b4311b11434e022db0b66`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:24.822889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dc25f175-9e5b-41ca-841b-6ac5e50d0d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:24.974522 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3504/7008] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:24.988972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71370f9f-b4b2-481b-88b7-f6d69d5701fa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:24.991216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-71370f9f-b4b2-481b-88b7-f6d69d5701fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:25.079930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:25.098736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71370f9f-b4b2-481b-88b7-f6d69d5701fa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:25.105857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722c447-e560-4053-a304-267d6b42b543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:25.106493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722c447-e560-4053-a304-267d6b42b543 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:25.106883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722c447-e560-4053-a304-267d6b42b543 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:25.107168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722c447-e560-4053-a304-267d6b42b543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:25.124006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722c447-e560-4053-a304-267d6b42b543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:25.128645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722c447-e560-4053-a304-267d6b42b543 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:25.148154 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3505/7009] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:25.369469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25f175-9e5b-41ca-841b-6ac5e50d0d6d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:25.500080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:25.508165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25f175-9e5b-41ca-841b-6ac5e50d0d6d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:25.513954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:25.515209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:25.515676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:25.516162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] PATH_INFO: `/v3/users/ac6a8c8c708f4b149fec0ef598df8503` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:25.517799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6a8c8c708f4b149fec0ef598df8503)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:25.520682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:25.592403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6a8c8c708f4b149fec0ef598df8503'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:25.601221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6a8c8c708f4b149fec0ef598df8503'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:25.602230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6a8c8c708f4b149fec0ef598df8503'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:25.619897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6a8c8c708f4b149fec0ef598df8503'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:25.621017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6a8c8c708f4b149fec0ef598df8503'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:25.667700 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3505/7010] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:25 2022] DELETE /identity/v3/users/ac6a8c8c708f4b149fec0ef598df8503 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:25.672957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cceafd-e492-40d6-9abf-ad2ec97ee2ca None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:25.673252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cceafd-e492-40d6-9abf-ad2ec97ee2ca None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:25.673530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cceafd-e492-40d6-9abf-ad2ec97ee2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:25.739865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-71cceafd-e492-40d6-9abf-ad2ec97ee2ca None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:25.741241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-71cceafd-e492-40d6-9abf-ad2ec97ee2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:25.929998 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3506/7011] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:25.946391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:25.948830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:26.109953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdb968-f3be-423a-8416-f780399b9da8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:26.120729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db4cca-6d26-412b-98c8-e3e6dc721c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:26.121610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db4cca-6d26-412b-98c8-e3e6dc721c8c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:26.122008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db4cca-6d26-412b-98c8-e3e6dc721c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:26.122398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db4cca-6d26-412b-98c8-e3e6dc721c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:26.142455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db4cca-6d26-412b-98c8-e3e6dc721c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:26.144385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db4cca-6d26-412b-98c8-e3e6dc721c8c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:26.171966 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3506/7012] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:26.959116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cceafd-e492-40d6-9abf-ad2ec97ee2ca None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:26.960738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-71cceafd-e492-40d6-9abf-ad2ec97ee2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:26.982529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cceafd-e492-40d6-9abf-ad2ec97ee2ca None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:26.991651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:26.992402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:26.992753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:26.993111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] PATH_INFO: `/v3/projects/e8bbdbab9eef45398f53239a74746cf9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:26.994923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8bbdbab9eef45398f53239a74746cf9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:26.997097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:27.128342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8bbdbab9eef45398f53239a74746cf9', 'request_id': 'req-b763b753-b8bc-4020-93d1-b77cec077880'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:27.137843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8bbdbab9eef45398f53239a74746cf9', 'request_id': 'req-b763b753-b8bc-4020-93d1-b77cec077880'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:27.149084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8bbdbab9eef45398f53239a74746cf9', 'request_id': 'req-b763b753-b8bc-4020-93d1-b77cec077880'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:27.177414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] The token cache is being invalidate because project e8bbdbab9eef45398f53239a74746cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:27.177414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:27.177849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:27.183102 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3507/7013] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:26 2022] DELETE /identity/v3/projects/e8bbdbab9eef45398f53239a74746cf9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:27.184588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db4cca-6d26-412b-98c8-e3e6dc721c8c service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:27.199277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db4cca-6d26-412b-98c8-e3e6dc721c8c service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:27.345542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853f01d-3a54-49c3-b5c8-b9bfefd39e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:27.346188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853f01d-3a54-49c3-b5c8-b9bfefd39e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:27.346466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853f01d-3a54-49c3-b5c8-b9bfefd39e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:27.346768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853f01d-3a54-49c3-b5c8-b9bfefd39e2a admin admin] PATH_INFO: `/v3/users/d9d08083a66b4311b11434e022db0b66` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:27.347900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853f01d-3a54-49c3-b5c8-b9bfefd39e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d08083a66b4311b11434e022db0b66)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:27.349816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853f01d-3a54-49c3-b5c8-b9bfefd39e2a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:27.376623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:27.428892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3853f01d-3a54-49c3-b5c8-b9bfefd39e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d08083a66b4311b11434e022db0b66'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:27.440339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3853f01d-3a54-49c3-b5c8-b9bfefd39e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d08083a66b4311b11434e022db0b66'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:27.441330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3853f01d-3a54-49c3-b5c8-b9bfefd39e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d08083a66b4311b11434e022db0b66'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:27.452350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3853f01d-3a54-49c3-b5c8-b9bfefd39e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d08083a66b4311b11434e022db0b66'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:27.453216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3853f01d-3a54-49c3-b5c8-b9bfefd39e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d08083a66b4311b11434e022db0b66'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:27.480629 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3507/7014] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:27 2022] DELETE /identity/v3/users/d9d08083a66b4311b11434e022db0b66 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:28.916705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:28.918214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:28.933422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763b753-b8bc-4020-93d1-b77cec077880 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:29.013259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:29.014293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:29.014821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:29.015347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533 admin admin] PATH_INFO: `/v3/projects/c3b21d95591941108e0cb314a71d9078` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:29.016972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b21d95591941108e0cb314a71d9078)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:29.019160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:29.036607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:29.095860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b21d95591941108e0cb314a71d9078', 'request_id': 'req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:29.105885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b21d95591941108e0cb314a71d9078', 'request_id': 'req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:29.116947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b21d95591941108e0cb314a71d9078', 'request_id': 'req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:29.135568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533 admin admin] The token cache is being invalidate because project c3b21d95591941108e0cb314a71d9078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:29.136077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:29.136778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee0a96ab-608d-4ef9-9b7c-cdd6ff988533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:29.139158 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3508/7015] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:28 2022] DELETE /identity/v3/projects/c3b21d95591941108e0cb314a71d9078 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:29.144959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60b2bb-781d-47b6-abc6-9162e50ab5c6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:29.147680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60b2bb-781d-47b6-abc6-9162e50ab5c6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:29.148382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60b2bb-781d-47b6-abc6-9162e50ab5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:29.176024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5d60b2bb-781d-47b6-abc6-9162e50ab5c6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:29.177577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5d60b2bb-781d-47b6-abc6-9162e50ab5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:29.262304 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3508/7016] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:29.270057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c3ee1-e239-4c24-b8b9-b63efb79ed89 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:29.270345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c3ee1-e239-4c24-b8b9-b63efb79ed89 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:29.271533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c3ee1-e239-4c24-b8b9-b63efb79ed89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:29.296338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1a7c3ee1-e239-4c24-b8b9-b63efb79ed89 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:29.299174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1a7c3ee1-e239-4c24-b8b9-b63efb79ed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:29.314866 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3509/7017] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:22:29.318947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60b2bb-781d-47b6-abc6-9162e50ab5c6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:29.334697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60b2bb-781d-47b6-abc6-9162e50ab5c6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:29.345203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e339469-9f74-41bf-a42f-bbaa70cad804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:29.346110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e339469-9f74-41bf-a42f-bbaa70cad804 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:29.347710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e339469-9f74-41bf-a42f-bbaa70cad804 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:29.348163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e339469-9f74-41bf-a42f-bbaa70cad804 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:29.349202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e339469-9f74-41bf-a42f-bbaa70cad804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:22:29.349873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e339469-9f74-41bf-a42f-bbaa70cad804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:29.352289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e339469-9f74-41bf-a42f-bbaa70cad804 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:29.371879 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3509/7018] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:22:29.376605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c3ee1-e239-4c24-b8b9-b63efb79ed89 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:29.392156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c3ee1-e239-4c24-b8b9-b63efb79ed89 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:29.399818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0931f-4d74-415b-9863-8d4480256e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:29.401136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0931f-4d74-415b-9863-8d4480256e8a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:29.401815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0931f-4d74-415b-9863-8d4480256e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:29.402318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0931f-4d74-415b-9863-8d4480256e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:29.403276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0931f-4d74-415b-9863-8d4480256e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:29.405713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f0931f-4d74-415b-9863-8d4480256e8a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:29.446584 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3510/7019] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:29 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:29.450844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e339469-9f74-41bf-a42f-bbaa70cad804 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:29.465489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e339469-9f74-41bf-a42f-bbaa70cad804 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:29.553442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d69b5c-d683-4ee0-aa0f-14f276e2aaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:29.554527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d69b5c-d683-4ee0-aa0f-14f276e2aaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:29.554883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d69b5c-d683-4ee0-aa0f-14f276e2aaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:29.555169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d69b5c-d683-4ee0-aa0f-14f276e2aaf3 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:29.555842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d69b5c-d683-4ee0-aa0f-14f276e2aaf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:29.559746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d69b5c-d683-4ee0-aa0f-14f276e2aaf3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:29.604278 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3510/7020] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:29 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:29.604839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0931f-4d74-415b-9863-8d4480256e8a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:29.624718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0931f-4d74-415b-9863-8d4480256e8a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:29.630889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8238207-fd7c-4924-9f24-88680f585b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:29.631377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8238207-fd7c-4924-9f24-88680f585b69 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:29.631569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8238207-fd7c-4924-9f24-88680f585b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:29.639065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8238207-fd7c-4924-9f24-88680f585b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:29.639635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8238207-fd7c-4924-9f24-88680f585b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:29.642076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8238207-fd7c-4924-9f24-88680f585b69 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:29.654626 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3511/7021] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:29.658463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d69b5c-d683-4ee0-aa0f-14f276e2aaf3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:29.671009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d69b5c-d683-4ee0-aa0f-14f276e2aaf3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:29.677940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683a6bc-e5b4-4339-9a86-30be93197f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:29.680416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683a6bc-e5b4-4339-9a86-30be93197f59 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:29.680416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683a6bc-e5b4-4339-9a86-30be93197f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:29.680416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683a6bc-e5b4-4339-9a86-30be93197f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:29.680416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683a6bc-e5b4-4339-9a86-30be93197f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:29.682856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683a6bc-e5b4-4339-9a86-30be93197f59 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:29.708986 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3511/7022] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:29.710175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8238207-fd7c-4924-9f24-88680f585b69 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:29.724474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8238207-fd7c-4924-9f24-88680f585b69 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:29.730664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73638d43-fe4a-4773-a154-ca73b5a0f88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:29.731462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73638d43-fe4a-4773-a154-ca73b5a0f88e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:29.731849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73638d43-fe4a-4773-a154-ca73b5a0f88e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:29.732206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73638d43-fe4a-4773-a154-ca73b5a0f88e admin admin] PATH_INFO: `/v3/projects/c4f0f76cdb014a4ab86631f6964abc18/users/842b7887529d4a719d95f787c43e2659/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:29.751119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73638d43-fe4a-4773-a154-ca73b5a0f88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f0f76cdb014a4ab86631f6964abc18, user_id=842b7887529d4a719d95f787c43e2659, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:29.753966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73638d43-fe4a-4773-a154-ca73b5a0f88e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:29.812081 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3512/7023] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:29 2022] PUT /identity/v3/projects/c4f0f76cdb014a4ab86631f6964abc18/users/842b7887529d4a719d95f787c43e2659/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:29.932497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63344a39-f190-463e-a142-aa9a1c77ee8e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:29.933441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63344a39-f190-463e-a142-aa9a1c77ee8e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:29.934194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63344a39-f190-463e-a142-aa9a1c77ee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:29.943527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:29.996701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-63344a39-f190-463e-a142-aa9a1c77ee8e None None] MFA Rules not processed for user `842b7887529d4a719d95f787c43e2659`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:29.998555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-63344a39-f190-463e-a142-aa9a1c77ee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:30.127146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73638d43-fe4a-4773-a154-ca73b5a0f88e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:30.128950 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3512/7024] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:30.261166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73638d43-fe4a-4773-a154-ca73b5a0f88e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:30.269912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01388f-ece1-4f74-b073-3fcdb852c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:30.271796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01388f-ece1-4f74-b073-3fcdb852c521 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:30.272994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01388f-ece1-4f74-b073-3fcdb852c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:30.273598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01388f-ece1-4f74-b073-3fcdb852c521 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:30.275082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01388f-ece1-4f74-b073-3fcdb852c521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:30.277429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01388f-ece1-4f74-b073-3fcdb852c521 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:30.328559 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3513/7025] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:30 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:22:30.330958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63344a39-f190-463e-a142-aa9a1c77ee8e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:30.344894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63344a39-f190-463e-a142-aa9a1c77ee8e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:30.438071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27a014-5c35-4ea5-9588-d1a8866d34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:30.439693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27a014-5c35-4ea5-9588-d1a8866d34e4 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:30.440055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27a014-5c35-4ea5-9588-d1a8866d34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:30.440406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27a014-5c35-4ea5-9588-d1a8866d34e4 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:30.441271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27a014-5c35-4ea5-9588-d1a8866d34e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:30.445044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27a014-5c35-4ea5-9588-d1a8866d34e4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:30.476390 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3513/7026] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:30 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:22:30.477311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01388f-ece1-4f74-b073-3fcdb852c521 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:30.494489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01388f-ece1-4f74-b073-3fcdb852c521 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:30.502016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf8727-9e23-46c0-8681-1155ab6bcb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:30.502964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf8727-9e23-46c0-8681-1155ab6bcb22 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:30.503792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf8727-9e23-46c0-8681-1155ab6bcb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:30.504311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf8727-9e23-46c0-8681-1155ab6bcb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:30.505625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf8727-9e23-46c0-8681-1155ab6bcb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:30.507992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf8727-9e23-46c0-8681-1155ab6bcb22 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:30.529886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27a014-5c35-4ea5-9588-d1a8866d34e4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:30.541166 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3514/7027] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:22:30.543776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27a014-5c35-4ea5-9588-d1a8866d34e4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:30.549484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268db9ec-372a-4ca3-85d9-cf7df4ff4b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:30.550825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268db9ec-372a-4ca3-85d9-cf7df4ff4b60 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:30.551350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268db9ec-372a-4ca3-85d9-cf7df4ff4b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:30.551830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268db9ec-372a-4ca3-85d9-cf7df4ff4b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:30.552688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268db9ec-372a-4ca3-85d9-cf7df4ff4b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:30.555466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268db9ec-372a-4ca3-85d9-cf7df4ff4b60 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:30.573592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf8727-9e23-46c0-8681-1155ab6bcb22 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:30.580568 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3514/7028] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:30.590028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf8727-9e23-46c0-8681-1155ab6bcb22 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:30.602981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36bc9f-32cb-4433-bc7c-6a87f79e5f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:30.603699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36bc9f-32cb-4433-bc7c-6a87f79e5f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:30.606902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36bc9f-32cb-4433-bc7c-6a87f79e5f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:30.607219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36bc9f-32cb-4433-bc7c-6a87f79e5f9c admin admin] PATH_INFO: `/v3/projects/f192ac40d099484f9d7727fb0ca53009/users/8607480cad8c413c90d8d3a788d462fa/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:30.631251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:30.655453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36bc9f-32cb-4433-bc7c-6a87f79e5f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f192ac40d099484f9d7727fb0ca53009, user_id=8607480cad8c413c90d8d3a788d462fa, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:30.658416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36bc9f-32cb-4433-bc7c-6a87f79e5f9c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:30.709638 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3515/7029] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:30 2022] PUT /identity/v3/projects/f192ac40d099484f9d7727fb0ca53009/users/8607480cad8c413c90d8d3a788d462fa/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:30.721263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aaa36-fcb1-4c35-97c3-80f17a0e55ec None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:30.721884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aaa36-fcb1-4c35-97c3-80f17a0e55ec None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:30.722393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aaa36-fcb1-4c35-97c3-80f17a0e55ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:30.773062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9b9aaa36-fcb1-4c35-97c3-80f17a0e55ec None None] MFA Rules not processed for user `8607480cad8c413c90d8d3a788d462fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:30.774382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9b9aaa36-fcb1-4c35-97c3-80f17a0e55ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:30.951104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:30.965564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36bc9f-32cb-4433-bc7c-6a87f79e5f9c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:30.970873 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3515/7030] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:22:31.091351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36bc9f-32cb-4433-bc7c-6a87f79e5f9c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:31.107148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc1df6-6c9d-48d8-a0af-c90967fe9cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:31.108883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc1df6-6c9d-48d8-a0af-c90967fe9cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:31.108883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc1df6-6c9d-48d8-a0af-c90967fe9cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:31.109100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc1df6-6c9d-48d8-a0af-c90967fe9cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:31.112362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc1df6-6c9d-48d8-a0af-c90967fe9cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:31.117206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc1df6-6c9d-48d8-a0af-c90967fe9cf4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:31.195257 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3516/7031] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:30 2022] POST /identity/v3/projects => generated 379 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:22:31.199764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aaa36-fcb1-4c35-97c3-80f17a0e55ec None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:31.214874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9aaa36-fcb1-4c35-97c3-80f17a0e55ec None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:31.391514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7031f5-7888-4ae6-bb0b-757c9957965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:31.394634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7031f5-7888-4ae6-bb0b-757c9957965a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:31.397854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7031f5-7888-4ae6-bb0b-757c9957965a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:31.398484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7031f5-7888-4ae6-bb0b-757c9957965a admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:31.399427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7031f5-7888-4ae6-bb0b-757c9957965a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:31.402981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7031f5-7888-4ae6-bb0b-757c9957965a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:31.450560 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3516/7032] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:31 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:22:31.451190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc1df6-6c9d-48d8-a0af-c90967fe9cf4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:31.466424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc1df6-6c9d-48d8-a0af-c90967fe9cf4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:31.473829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fe2e8-451e-4442-8edc-ab4787088f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:31.487214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fe2e8-451e-4442-8edc-ab4787088f4e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:31.487214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fe2e8-451e-4442-8edc-ab4787088f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:31.487214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fe2e8-451e-4442-8edc-ab4787088f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:31.487214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fe2e8-451e-4442-8edc-ab4787088f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:31.487214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fe2e8-451e-4442-8edc-ab4787088f4e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:31.505532 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3517/7033] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:31.506825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7031f5-7888-4ae6-bb0b-757c9957965a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:31.518864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7031f5-7888-4ae6-bb0b-757c9957965a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:31.524766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8083a-2043-4dc5-99bd-56391847a00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:31.525646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8083a-2043-4dc5-99bd-56391847a00f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:31.526143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8083a-2043-4dc5-99bd-56391847a00f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:31.526540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8083a-2043-4dc5-99bd-56391847a00f admin admin] PATH_INFO: `/v3/projects/48ca2c8aa6dc4bfbac10e6b132e3ffdc/users/876a44de2b9a4a349f511e16c433ffc4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:31.545863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8083a-2043-4dc5-99bd-56391847a00f admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ca2c8aa6dc4bfbac10e6b132e3ffdc, user_id=876a44de2b9a4a349f511e16c433ffc4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:31.549382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8083a-2043-4dc5-99bd-56391847a00f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:31.582374 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3517/7034] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:31 2022] PUT /identity/v3/projects/48ca2c8aa6dc4bfbac10e6b132e3ffdc/users/876a44de2b9a4a349f511e16c433ffc4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:31.583777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fe2e8-451e-4442-8edc-ab4787088f4e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:31.596090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fe2e8-451e-4442-8edc-ab4787088f4e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:31.710642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f43594-7f8d-4227-b3f3-74aad523b017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:31.711365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f43594-7f8d-4227-b3f3-74aad523b017 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:31.711655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f43594-7f8d-4227-b3f3-74aad523b017 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:31.711978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f43594-7f8d-4227-b3f3-74aad523b017 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:31.712719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f43594-7f8d-4227-b3f3-74aad523b017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:31.714547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f43594-7f8d-4227-b3f3-74aad523b017 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:31.733365 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3518/7035] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:31.734616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8083a-2043-4dc5-99bd-56391847a00f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:31.764435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8083a-2043-4dc5-99bd-56391847a00f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:31.774297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391af6e1-be95-4f87-8d6d-3d65603d30b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:31.775932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391af6e1-be95-4f87-8d6d-3d65603d30b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:31.776617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391af6e1-be95-4f87-8d6d-3d65603d30b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:31.777107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391af6e1-be95-4f87-8d6d-3d65603d30b3 admin admin] PATH_INFO: `/v3/projects/48ca2c8aa6dc4bfbac10e6b132e3ffdc/users/876a44de2b9a4a349f511e16c433ffc4/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:31.779534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391af6e1-be95-4f87-8d6d-3d65603d30b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ca2c8aa6dc4bfbac10e6b132e3ffdc, user_id=876a44de2b9a4a349f511e16c433ffc4, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:31.783293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391af6e1-be95-4f87-8d6d-3d65603d30b3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:31.811511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65529a-742e-4c83-8476-775f0f349a5a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:31.812116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65529a-742e-4c83-8476-775f0f349a5a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:31.812693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65529a-742e-4c83-8476-775f0f349a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:31.825977 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3518/7036] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:31 2022] PUT /identity/v3/projects/48ca2c8aa6dc4bfbac10e6b132e3ffdc/users/876a44de2b9a4a349f511e16c433ffc4/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:22:31.864647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3e65529a-742e-4c83-8476-775f0f349a5a None None] MFA Rules not processed for user `876a44de2b9a4a349f511e16c433ffc4`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:31.867677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3e65529a-742e-4c83-8476-775f0f349a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:31.956829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:32.014780 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3519/7037] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:32.023295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391af6e1-be95-4f87-8d6d-3d65603d30b3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:32.027038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-391af6e1-be95-4f87-8d6d-3d65603d30b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:32.106548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391af6e1-be95-4f87-8d6d-3d65603d30b3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:32.111769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b4a60-5557-4136-b675-e48131f9a69a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:32.112689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b4a60-5557-4136-b675-e48131f9a69a service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:32.113187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b4a60-5557-4136-b675-e48131f9a69a service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:32.113675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b4a60-5557-4136-b675-e48131f9a69a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:32.125819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b4a60-5557-4136-b675-e48131f9a69a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:32.128144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b4a60-5557-4136-b675-e48131f9a69a service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:32.142669 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3519/7038] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:32.200075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65529a-742e-4c83-8476-775f0f349a5a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:32.202194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3e65529a-742e-4c83-8476-775f0f349a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:32.219922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65529a-742e-4c83-8476-775f0f349a5a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:32.226030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f58e55-a62e-40de-bdd1-30dbfe5d3b7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:32.226803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58e55-a62e-40de-bdd1-30dbfe5d3b7c service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:32.227170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58e55-a62e-40de-bdd1-30dbfe5d3b7c service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:32.227522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58e55-a62e-40de-bdd1-30dbfe5d3b7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:32.299001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f58e55-a62e-40de-bdd1-30dbfe5d3b7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:32.300505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f58e55-a62e-40de-bdd1-30dbfe5d3b7c service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:32.314011 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3520/7039] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:37.117765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b4a60-5557-4136-b675-e48131f9a69a service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:37.119811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d45b4a60-5557-4136-b675-e48131f9a69a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:37.241252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b4a60-5557-4136-b675-e48131f9a69a service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:37.246264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121f6fe-431f-4b1e-b041-fe3180931260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:37.246982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121f6fe-431f-4b1e-b041-fe3180931260 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:37.247267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121f6fe-431f-4b1e-b041-fe3180931260 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:37.247547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121f6fe-431f-4b1e-b041-fe3180931260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:37.251014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6121f6fe-431f-4b1e-b041-fe3180931260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:37.264492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:37.344343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121f6fe-431f-4b1e-b041-fe3180931260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:37.345840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121f6fe-431f-4b1e-b041-fe3180931260 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:37.357958 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3520/7040] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:37.845334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f58e55-a62e-40de-bdd1-30dbfe5d3b7c service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:37.985767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f58e55-a62e-40de-bdd1-30dbfe5d3b7c service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:37.995073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:37.998811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:37.999307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:38.014000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] PATH_INFO: `/v3/users/842b7887529d4a719d95f787c43e2659` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:38.021703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=842b7887529d4a719d95f787c43e2659)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:38.021703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:38.118124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842b7887529d4a719d95f787c43e2659'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:38.126400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842b7887529d4a719d95f787c43e2659'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:38.127554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842b7887529d4a719d95f787c43e2659'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:38.144311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842b7887529d4a719d95f787c43e2659'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:38.145154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842b7887529d4a719d95f787c43e2659'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:38.172187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:38.178785 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3521/7041] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:37 2022] DELETE /identity/v3/users/842b7887529d4a719d95f787c43e2659 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:38.183799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b397758-3110-4952-ae94-2c963ec4ed68 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:38.184308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b397758-3110-4952-ae94-2c963ec4ed68 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:38.184559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b397758-3110-4952-ae94-2c963ec4ed68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:38.220464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8b397758-3110-4952-ae94-2c963ec4ed68 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:38.224410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8b397758-3110-4952-ae94-2c963ec4ed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:38.366416 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3521/7042] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:38.430676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:38.433662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:38.527120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54c749-ca39-4cb3-ab2f-d74ffe9675ed admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:38.531384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2f187-a000-4a21-b111-6c8ff1e7ea41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:38.532401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2f187-a000-4a21-b111-6c8ff1e7ea41 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:38.532850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2f187-a000-4a21-b111-6c8ff1e7ea41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:38.533191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2f187-a000-4a21-b111-6c8ff1e7ea41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:38.547466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2f187-a000-4a21-b111-6c8ff1e7ea41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:38.549050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2f187-a000-4a21-b111-6c8ff1e7ea41 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:38.563576 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3522/7043] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:39.527987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b397758-3110-4952-ae94-2c963ec4ed68 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:39.530480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8b397758-3110-4952-ae94-2c963ec4ed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:39.551024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b397758-3110-4952-ae94-2c963ec4ed68 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:39.566156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:39.567472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:39.568005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:39.568449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] PATH_INFO: `/v3/projects/c4f0f76cdb014a4ab86631f6964abc18` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:39.571112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f0f76cdb014a4ab86631f6964abc18)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:39.583496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:39.660509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f0f76cdb014a4ab86631f6964abc18', 'request_id': 'req-b00fbec9-9155-489c-a577-5131aefdc810'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:39.667576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f0f76cdb014a4ab86631f6964abc18', 'request_id': 'req-b00fbec9-9155-489c-a577-5131aefdc810'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:39.674295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f0f76cdb014a4ab86631f6964abc18', 'request_id': 'req-b00fbec9-9155-489c-a577-5131aefdc810'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:39.693514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] The token cache is being invalidate because project c4f0f76cdb014a4ab86631f6964abc18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:39.693743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:39.694396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:39.696154 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3522/7044] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:39 2022] DELETE /identity/v3/projects/c4f0f76cdb014a4ab86631f6964abc18 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:39.700643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2f187-a000-4a21-b111-6c8ff1e7ea41 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:39.713821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2f187-a000-4a21-b111-6c8ff1e7ea41 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:39.784768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:39.785893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:39.786227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:39.786776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] PATH_INFO: `/v3/users/8607480cad8c413c90d8d3a788d462fa` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:39.788200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8607480cad8c413c90d8d3a788d462fa)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:39.790783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:39.854077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8607480cad8c413c90d8d3a788d462fa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:39.861861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8607480cad8c413c90d8d3a788d462fa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:39.863138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8607480cad8c413c90d8d3a788d462fa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:39.879380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8607480cad8c413c90d8d3a788d462fa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:39.883102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8607480cad8c413c90d8d3a788d462fa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:39.903570 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3523/7045] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:39 2022] DELETE /identity/v3/users/8607480cad8c413c90d8d3a788d462fa => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:40.292640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:40.294166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:40.319231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fbec9-9155-489c-a577-5131aefdc810 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:40.427999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:40.509810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313e3e3-8a48-4af3-9913-29f352483713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:40.510683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313e3e3-8a48-4af3-9913-29f352483713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:40.511051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313e3e3-8a48-4af3-9913-29f352483713 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:40.511455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313e3e3-8a48-4af3-9913-29f352483713 admin admin] PATH_INFO: `/v3/users/0ce2c6459c6a48fcb46606214def3ec2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:40.512577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313e3e3-8a48-4af3-9913-29f352483713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce2c6459c6a48fcb46606214def3ec2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:40.514627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313e3e3-8a48-4af3-9913-29f352483713 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:40.595802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0313e3e3-8a48-4af3-9913-29f352483713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce2c6459c6a48fcb46606214def3ec2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:40.617737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0313e3e3-8a48-4af3-9913-29f352483713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce2c6459c6a48fcb46606214def3ec2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:40.631372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0313e3e3-8a48-4af3-9913-29f352483713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce2c6459c6a48fcb46606214def3ec2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:40.647307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0313e3e3-8a48-4af3-9913-29f352483713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce2c6459c6a48fcb46606214def3ec2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:40.648033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0313e3e3-8a48-4af3-9913-29f352483713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce2c6459c6a48fcb46606214def3ec2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:40.654426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:40.656294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:40.696930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd893a2-ebd0-4cfc-9de2-acb85a7d1ab0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:40.708189 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3523/7046] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:40 2022] DELETE /identity/v3/users/0ce2c6459c6a48fcb46606214def3ec2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:40.708786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:40.711083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:40.711456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:40.711812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] PATH_INFO: `/v3/projects/f192ac40d099484f9d7727fb0ca53009` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:40.713749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95923d-4f86-4d57-8e1e-765bcd220df9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:40.714243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95923d-4f86-4d57-8e1e-765bcd220df9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:40.714844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f192ac40d099484f9d7727fb0ca53009)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:40.715139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95923d-4f86-4d57-8e1e-765bcd220df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:40.720268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:40.752086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7e95923d-4f86-4d57-8e1e-765bcd220df9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:40.753391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7e95923d-4f86-4d57-8e1e-765bcd220df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:40.761625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:40.827282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f192ac40d099484f9d7727fb0ca53009', 'request_id': 'req-0a2e8c37-e6e4-46c6-8804-63466e3464d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:40.842820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f192ac40d099484f9d7727fb0ca53009', 'request_id': 'req-0a2e8c37-e6e4-46c6-8804-63466e3464d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:40.855231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f192ac40d099484f9d7727fb0ca53009', 'request_id': 'req-0a2e8c37-e6e4-46c6-8804-63466e3464d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:40.880384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] The token cache is being invalidate because project f192ac40d099484f9d7727fb0ca53009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:40.883212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:40.883397 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3524/7047] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:40.883503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:40.890036 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3524/7048] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:40 2022] DELETE /identity/v3/projects/f192ac40d099484f9d7727fb0ca53009 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:40.891623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95923d-4f86-4d57-8e1e-765bcd220df9 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:40.893181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7e95923d-4f86-4d57-8e1e-765bcd220df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:40.907476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95923d-4f86-4d57-8e1e-765bcd220df9 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:40.923143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:40.926104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:41.031719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:41.049805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:41.051884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:41.052793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:41.053082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] PATH_INFO: `/v3/users/876a44de2b9a4a349f511e16c433ffc4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:41.054863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e8c37-e6e4-46c6-8804-63466e3464d5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:41.055060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=876a44de2b9a4a349f511e16c433ffc4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:41.058964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:41.067388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079b9cb-9d34-49bc-95b8-0c568b4ec9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:41.068239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079b9cb-9d34-49bc-95b8-0c568b4ec9da service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:41.068712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079b9cb-9d34-49bc-95b8-0c568b4ec9da service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:41.069150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079b9cb-9d34-49bc-95b8-0c568b4ec9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:41.072362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0079b9cb-9d34-49bc-95b8-0c568b4ec9da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:41.107522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079b9cb-9d34-49bc-95b8-0c568b4ec9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:41.109000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079b9cb-9d34-49bc-95b8-0c568b4ec9da service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:41.126886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876a44de2b9a4a349f511e16c433ffc4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.128565 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3525/7049] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:22:41.137569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876a44de2b9a4a349f511e16c433ffc4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.138234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876a44de2b9a4a349f511e16c433ffc4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.149584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876a44de2b9a4a349f511e16c433ffc4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.150413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876a44de2b9a4a349f511e16c433ffc4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.169359 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3525/7050] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:40 2022] DELETE /identity/v3/users/876a44de2b9a4a349f511e16c433ffc4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:41.496488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079b9cb-9d34-49bc-95b8-0c568b4ec9da service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:41.498051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0079b9cb-9d34-49bc-95b8-0c568b4ec9da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:41.521560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079b9cb-9d34-49bc-95b8-0c568b4ec9da service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:41.564309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:41.565834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:41.627133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e807343-7bc4-4818-a78a-f614151b66d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:41.627780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e807343-7bc4-4818-a78a-f614151b66d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:41.628062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e807343-7bc4-4818-a78a-f614151b66d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:41.628351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e807343-7bc4-4818-a78a-f614151b66d4 admin admin] PATH_INFO: `/v3/projects/48ca2c8aa6dc4bfbac10e6b132e3ffdc` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:41.629610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e807343-7bc4-4818-a78a-f614151b66d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ca2c8aa6dc4bfbac10e6b132e3ffdc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:41.631678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e807343-7bc4-4818-a78a-f614151b66d4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:41.662359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91382a24-4f54-496c-9850-c8475f8bf353 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:41.669858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624ba11-76ed-407c-b321-968d4a50c5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:41.672304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624ba11-76ed-407c-b321-968d4a50c5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:41.672607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624ba11-76ed-407c-b321-968d4a50c5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:41.673447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624ba11-76ed-407c-b321-968d4a50c5fd admin admin] PATH_INFO: `/v3/projects/7b8beb450e494f0d8dfaeba994d97f0f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:41.674721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624ba11-76ed-407c-b321-968d4a50c5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8beb450e494f0d8dfaeba994d97f0f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:41.678119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624ba11-76ed-407c-b321-968d4a50c5fd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:41.713467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3e807343-7bc4-4818-a78a-f614151b66d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ca2c8aa6dc4bfbac10e6b132e3ffdc', 'request_id': 'req-3e807343-7bc4-4818-a78a-f614151b66d4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.722895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:41.740081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3e807343-7bc4-4818-a78a-f614151b66d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ca2c8aa6dc4bfbac10e6b132e3ffdc', 'request_id': 'req-3e807343-7bc4-4818-a78a-f614151b66d4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.752843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3e807343-7bc4-4818-a78a-f614151b66d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ca2c8aa6dc4bfbac10e6b132e3ffdc', 'request_id': 'req-3e807343-7bc4-4818-a78a-f614151b66d4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.770082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3e807343-7bc4-4818-a78a-f614151b66d4 admin admin] The token cache is being invalidate because project 48ca2c8aa6dc4bfbac10e6b132e3ffdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:41.770396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3e807343-7bc4-4818-a78a-f614151b66d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.771051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3e807343-7bc4-4818-a78a-f614151b66d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.772805 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3526/7051] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:41 2022] DELETE /identity/v3/projects/48ca2c8aa6dc4bfbac10e6b132e3ffdc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:41.779860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3624ba11-76ed-407c-b321-968d4a50c5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8beb450e494f0d8dfaeba994d97f0f', 'request_id': 'req-3624ba11-76ed-407c-b321-968d4a50c5fd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.780790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a0e86-be92-4302-8863-4745c2e111a0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:41.781083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a0e86-be92-4302-8863-4745c2e111a0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:41.781357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a0e86-be92-4302-8863-4745c2e111a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:41.793751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3624ba11-76ed-407c-b321-968d4a50c5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8beb450e494f0d8dfaeba994d97f0f', 'request_id': 'req-3624ba11-76ed-407c-b321-968d4a50c5fd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.805505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-667a0e86-be92-4302-8863-4745c2e111a0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:41.807910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-667a0e86-be92-4302-8863-4745c2e111a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:41.809505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3624ba11-76ed-407c-b321-968d4a50c5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8beb450e494f0d8dfaeba994d97f0f', 'request_id': 'req-3624ba11-76ed-407c-b321-968d4a50c5fd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.838303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3624ba11-76ed-407c-b321-968d4a50c5fd admin admin] The token cache is being invalidate because project 7b8beb450e494f0d8dfaeba994d97f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:41.839143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3624ba11-76ed-407c-b321-968d4a50c5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.840034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-3624ba11-76ed-407c-b321-968d4a50c5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:41.843036 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3526/7052] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:41 2022] DELETE /identity/v3/projects/7b8beb450e494f0d8dfaeba994d97f0f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:22:41.857099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f62f45-23d1-4ffe-ad96-824527e39bd0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:41.857784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f62f45-23d1-4ffe-ad96-824527e39bd0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:41.858396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f62f45-23d1-4ffe-ad96-824527e39bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:41.869570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:41.907672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-69f62f45-23d1-4ffe-ad96-824527e39bd0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:41.909105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-69f62f45-23d1-4ffe-ad96-824527e39bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:41.914152 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3527/7053] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:41.923494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbf254-a28b-4729-b86f-61a803bc0b59 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:41.924037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbf254-a28b-4729-b86f-61a803bc0b59 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:41.924470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbf254-a28b-4729-b86f-61a803bc0b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:41.926103 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3527/7054] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:41.936043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d830a-ca0f-47da-a899-becfceba70eb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:41.936478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d830a-ca0f-47da-a899-becfceba70eb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:41.936856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d830a-ca0f-47da-a899-becfceba70eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:41.947554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-75dbf254-a28b-4729-b86f-61a803bc0b59 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:41.948894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-75dbf254-a28b-4729-b86f-61a803bc0b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:41.958523 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3528/7055] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:41.962983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbf254-a28b-4729-b86f-61a803bc0b59 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:41.965123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b93d830a-ca0f-47da-a899-becfceba70eb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:41.966566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b93d830a-ca0f-47da-a899-becfceba70eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:41.974087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbf254-a28b-4729-b86f-61a803bc0b59 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:41.980587 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3528/7056] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:41.983878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e4a9-4c90-4b93-a54c-7111973ef6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:41.983878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e4a9-4c90-4b93-a54c-7111973ef6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:41.983878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e4a9-4c90-4b93-a54c-7111973ef6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:41.983878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e4a9-4c90-4b93-a54c-7111973ef6b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:41.984251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98e4a9-4c90-4b93-a54c-7111973ef6b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:22:41.984574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98e4a9-4c90-4b93-a54c-7111973ef6b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:41.985588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d830a-ca0f-47da-a899-becfceba70eb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:41.986481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98e4a9-4c90-4b93-a54c-7111973ef6b9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:41.996468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d830a-ca0f-47da-a899-becfceba70eb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.000337 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3529/7057] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:22:42.005030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ceb481-157a-4734-9d6f-d21c810a4ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.005661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceb481-157a-4734-9d6f-d21c810a4ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.005947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceb481-157a-4734-9d6f-d21c810a4ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.006224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceb481-157a-4734-9d6f-d21c810a4ea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.006636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e4a9-4c90-4b93-a54c-7111973ef6b9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.006929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ceb481-157a-4734-9d6f-d21c810a4ea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:22:42.007243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ceb481-157a-4734-9d6f-d21c810a4ea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.009706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ceb481-157a-4734-9d6f-d21c810a4ea8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:42.039839 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3529/7058] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:22:42.042393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e4a9-4c90-4b93-a54c-7111973ef6b9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.047466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ceb481-157a-4734-9d6f-d21c810a4ea8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.064975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077c533-7c4e-48ac-bbd9-30b0db606bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.065611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077c533-7c4e-48ac-bbd9-30b0db606bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.065968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077c533-7c4e-48ac-bbd9-30b0db606bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.066230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077c533-7c4e-48ac-bbd9-30b0db606bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.066961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077c533-7c4e-48ac-bbd9-30b0db606bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.069735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077c533-7c4e-48ac-bbd9-30b0db606bc2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:42.079101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ceb481-157a-4734-9d6f-d21c810a4ea8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.092800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d37064-4be6-48f9-953d-c25420aea69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.093385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d37064-4be6-48f9-953d-c25420aea69c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.093751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d37064-4be6-48f9-953d-c25420aea69c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.094049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d37064-4be6-48f9-953d-c25420aea69c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.094827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d37064-4be6-48f9-953d-c25420aea69c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.096809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d37064-4be6-48f9-953d-c25420aea69c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:42.125769 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3530/7059] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:42 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:42.127130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077c533-7c4e-48ac-bbd9-30b0db606bc2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.134598 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3530/7060] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:42 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:42.138651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d37064-4be6-48f9-953d-c25420aea69c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.248854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d37064-4be6-48f9-953d-c25420aea69c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.260678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cce94-ff4f-49b4-abd1-2e3dadfdc6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.263436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cce94-ff4f-49b4-abd1-2e3dadfdc6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.263745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cce94-ff4f-49b4-abd1-2e3dadfdc6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.264593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cce94-ff4f-49b4-abd1-2e3dadfdc6a1 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.265270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cce94-ff4f-49b4-abd1-2e3dadfdc6a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.268882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cce94-ff4f-49b4-abd1-2e3dadfdc6a1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:42.269881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077c533-7c4e-48ac-bbd9-30b0db606bc2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.275411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f5fca-fe71-46c3-b51f-1925db0a6cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.276225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f5fca-fe71-46c3-b51f-1925db0a6cff admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.276656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f5fca-fe71-46c3-b51f-1925db0a6cff admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.277127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f5fca-fe71-46c3-b51f-1925db0a6cff admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.278157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f5fca-fe71-46c3-b51f-1925db0a6cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.280328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f5fca-fe71-46c3-b51f-1925db0a6cff admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:42.311066 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3531/7061] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:42 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:42.315107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cce94-ff4f-49b4-abd1-2e3dadfdc6a1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.315860 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3531/7062] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:42 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:42.316954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f5fca-fe71-46c3-b51f-1925db0a6cff admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.330163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f5fca-fe71-46c3-b51f-1925db0a6cff admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.335251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cce94-ff4f-49b4-abd1-2e3dadfdc6a1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.337562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8dbb8-a31f-4801-b406-6daa39704864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.338240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8dbb8-a31f-4801-b406-6daa39704864 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.338517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8dbb8-a31f-4801-b406-6daa39704864 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.338973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8dbb8-a31f-4801-b406-6daa39704864 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.339633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8dbb8-a31f-4801-b406-6daa39704864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.341858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8dbb8-a31f-4801-b406-6daa39704864 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:42.346893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd3d64-e589-4b96-be38-cb778ffc7c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.347455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd3d64-e589-4b96-be38-cb778ffc7c46 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.347740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd3d64-e589-4b96-be38-cb778ffc7c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.348068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd3d64-e589-4b96-be38-cb778ffc7c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.348726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd3d64-e589-4b96-be38-cb778ffc7c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.350640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd3d64-e589-4b96-be38-cb778ffc7c46 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:42.355354 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3532/7063] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:42.359493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8dbb8-a31f-4801-b406-6daa39704864 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.363517 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3532/7064] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:42.368925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd3d64-e589-4b96-be38-cb778ffc7c46 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.371897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8dbb8-a31f-4801-b406-6daa39704864 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.377058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27feb22-bbb6-4e44-a065-2758be77bda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.377673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27feb22-bbb6-4e44-a065-2758be77bda4 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.377957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27feb22-bbb6-4e44-a065-2758be77bda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.378234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27feb22-bbb6-4e44-a065-2758be77bda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.379867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27feb22-bbb6-4e44-a065-2758be77bda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.381483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27feb22-bbb6-4e44-a065-2758be77bda4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:42.390071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd3d64-e589-4b96-be38-cb778ffc7c46 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.397618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735e958-9b4f-4eb4-8d69-af084be6b448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.401275 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3533/7065] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:42.401383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735e958-9b4f-4eb4-8d69-af084be6b448 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.401383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735e958-9b4f-4eb4-8d69-af084be6b448 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.401383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735e958-9b4f-4eb4-8d69-af084be6b448 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.401383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735e958-9b4f-4eb4-8d69-af084be6b448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.402171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735e958-9b4f-4eb4-8d69-af084be6b448 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:42.403349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27feb22-bbb6-4e44-a065-2758be77bda4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.416283 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3533/7066] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:42.422094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735e958-9b4f-4eb4-8d69-af084be6b448 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.423957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:42.428434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27feb22-bbb6-4e44-a065-2758be77bda4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.434964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735e958-9b4f-4eb4-8d69-af084be6b448 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.436717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37aaee1-c5c8-4193-b831-fb8ea6e597fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.437850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aaee1-c5c8-4193-b831-fb8ea6e597fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.438341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aaee1-c5c8-4193-b831-fb8ea6e597fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.438798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aaee1-c5c8-4193-b831-fb8ea6e597fb admin admin] PATH_INFO: `/v3/projects/8f2fce7cefe9480c9a0182254ce597aa/users/5cda1163273d41ac89b5229280fede6c/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.440341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900cac1-d7d2-455d-95d5-c300a1e52636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.441076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900cac1-d7d2-455d-95d5-c300a1e52636 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.441423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900cac1-d7d2-455d-95d5-c300a1e52636 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.442413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900cac1-d7d2-455d-95d5-c300a1e52636 admin admin] PATH_INFO: `/v3/projects/2954bf8b5d6341dd98d8dfe26ec8869e/users/ec1d0e564e454711bc2e8534c984add4/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.460973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37aaee1-c5c8-4193-b831-fb8ea6e597fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2fce7cefe9480c9a0182254ce597aa, user_id=5cda1163273d41ac89b5229280fede6c, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.461737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900cac1-d7d2-455d-95d5-c300a1e52636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2954bf8b5d6341dd98d8dfe26ec8869e, user_id=ec1d0e564e454711bc2e8534c984add4, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.465374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900cac1-d7d2-455d-95d5-c300a1e52636 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:42.466430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37aaee1-c5c8-4193-b831-fb8ea6e597fb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:42.499500 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3534/7068] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:42 2022] PUT /identity/v3/projects/2954bf8b5d6341dd98d8dfe26ec8869e/users/ec1d0e564e454711bc2e8534c984add4/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:42.499500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ef2da-acdd-4b44-b668-d959d4fe736c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.499500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ef2da-acdd-4b44-b668-d959d4fe736c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.499500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ef2da-acdd-4b44-b668-d959d4fe736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.500025 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3534/7068] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:42 2022] PUT /identity/v3/projects/8f2fce7cefe9480c9a0182254ce597aa/users/5cda1163273d41ac89b5229280fede6c/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:42.502134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6544dc-b650-4d24-a56f-fb5f3874e0b3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.503243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6544dc-b650-4d24-a56f-fb5f3874e0b3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.503620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6544dc-b650-4d24-a56f-fb5f3874e0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.533436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-587ef2da-acdd-4b44-b668-d959d4fe736c None None] MFA Rules not processed for user `ec1d0e564e454711bc2e8534c984add4`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:42.535114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-587ef2da-acdd-4b44-b668-d959d4fe736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:42.545194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-be6544dc-b650-4d24-a56f-fb5f3874e0b3 None None] MFA Rules not processed for user `5cda1163273d41ac89b5229280fede6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:42.546625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-be6544dc-b650-4d24-a56f-fb5f3874e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:42.608439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:42.638219 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3535/7069] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:42.644272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ef2da-acdd-4b44-b668-d959d4fe736c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.656565 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3535/7070] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:42.659632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6544dc-b650-4d24-a56f-fb5f3874e0b3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.738898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ef2da-acdd-4b44-b668-d959d4fe736c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.746226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8f953-7946-4e38-b84d-38389030eaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.746899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8f953-7946-4e38-b84d-38389030eaea admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.747162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8f953-7946-4e38-b84d-38389030eaea admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.747437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8f953-7946-4e38-b84d-38389030eaea admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.748075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8f953-7946-4e38-b84d-38389030eaea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.749987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8f953-7946-4e38-b84d-38389030eaea admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:42.768049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6544dc-b650-4d24-a56f-fb5f3874e0b3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.775521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f625eb1-cf55-4f0d-88b8-53cf7daee51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.776302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f625eb1-cf55-4f0d-88b8-53cf7daee51a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.776587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f625eb1-cf55-4f0d-88b8-53cf7daee51a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.776867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f625eb1-cf55-4f0d-88b8-53cf7daee51a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.777506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f625eb1-cf55-4f0d-88b8-53cf7daee51a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.779470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f625eb1-cf55-4f0d-88b8-53cf7daee51a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:42.787461 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3536/7071] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:42 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:42.792297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8f953-7946-4e38-b84d-38389030eaea admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.844295 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3536/7072] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:42 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:42.845882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f625eb1-cf55-4f0d-88b8-53cf7daee51a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:42.928850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8f953-7946-4e38-b84d-38389030eaea admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.967588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:42.981531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f625eb1-cf55-4f0d-88b8-53cf7daee51a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:42.987895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e864c47-0ffe-4c2f-a8ea-d785af2fdaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:42.988683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e864c47-0ffe-4c2f-a8ea-d785af2fdaa0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:42.989013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e864c47-0ffe-4c2f-a8ea-d785af2fdaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:42.989301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e864c47-0ffe-4c2f-a8ea-d785af2fdaa0 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:42.990101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e864c47-0ffe-4c2f-a8ea-d785af2fdaa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:42.992313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e864c47-0ffe-4c2f-a8ea-d785af2fdaa0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:43.009963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe286842-cac6-43be-b27f-921b0c992219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:43.010708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe286842-cac6-43be-b27f-921b0c992219 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:43.011141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe286842-cac6-43be-b27f-921b0c992219 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:43.011502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe286842-cac6-43be-b27f-921b0c992219 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:43.012249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe286842-cac6-43be-b27f-921b0c992219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:43.014787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe286842-cac6-43be-b27f-921b0c992219 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:43.020053 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3537/7073] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:42 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:43.025425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e864c47-0ffe-4c2f-a8ea-d785af2fdaa0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:43.038935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e864c47-0ffe-4c2f-a8ea-d785af2fdaa0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:43.039154 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3537/7074] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:42 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:22:43.043535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe286842-cac6-43be-b27f-921b0c992219 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:43.044779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917b12c-54e5-4318-8048-0926518cee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:43.045427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917b12c-54e5-4318-8048-0926518cee8b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:43.045713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917b12c-54e5-4318-8048-0926518cee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:43.045974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917b12c-54e5-4318-8048-0926518cee8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:43.046616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917b12c-54e5-4318-8048-0926518cee8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:43.048495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917b12c-54e5-4318-8048-0926518cee8b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:43.067186 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3538/7075] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:22:43.069412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe286842-cac6-43be-b27f-921b0c992219 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:43.071115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917b12c-54e5-4318-8048-0926518cee8b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:43.084400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917b12c-54e5-4318-8048-0926518cee8b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:43.085119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b06a1-de72-43af-882a-a7764568aa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:43.086015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b06a1-de72-43af-882a-a7764568aa63 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:43.088861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b06a1-de72-43af-882a-a7764568aa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:43.089800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b06a1-de72-43af-882a-a7764568aa63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:43.090495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b06a1-de72-43af-882a-a7764568aa63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:43.091823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b384043-ab6f-43d8-8310-0b23857cbfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:43.092839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b384043-ab6f-43d8-8310-0b23857cbfe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:43.093879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b384043-ab6f-43d8-8310-0b23857cbfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:43.094313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b384043-ab6f-43d8-8310-0b23857cbfe6 admin admin] PATH_INFO: `/v3/projects/feb9227f00db497c9badf0c012da6105/users/dd2fd2fff2374fb794d82e3d3d962b69/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:43.095173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b06a1-de72-43af-882a-a7764568aa63 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:43.104089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:43.120767 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3538/7076] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:43.124342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b06a1-de72-43af-882a-a7764568aa63 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:43.131656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b384043-ab6f-43d8-8310-0b23857cbfe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb9227f00db497c9badf0c012da6105, user_id=dd2fd2fff2374fb794d82e3d3d962b69, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:43.134596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b384043-ab6f-43d8-8310-0b23857cbfe6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:43.144247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b06a1-de72-43af-882a-a7764568aa63 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:43.158341 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3539/7077] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:43 2022] PUT /identity/v3/projects/feb9227f00db497c9badf0c012da6105/users/dd2fd2fff2374fb794d82e3d3d962b69/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:43.162141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b384043-ab6f-43d8-8310-0b23857cbfe6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:43.168461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd93468-60a6-4378-8cb7-8f785e3b9b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:43.169620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd93468-60a6-4378-8cb7-8f785e3b9b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:43.170898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd93468-60a6-4378-8cb7-8f785e3b9b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:43.171329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd93468-60a6-4378-8cb7-8f785e3b9b49 admin admin] PATH_INFO: `/v3/projects/2a4b027c38ed4d04aeff7553cfe148b7/users/f9ddb829577a4b1eb79f6d2f7f3d0d49/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:43.199717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd93468-60a6-4378-8cb7-8f785e3b9b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4b027c38ed4d04aeff7553cfe148b7, user_id=f9ddb829577a4b1eb79f6d2f7f3d0d49, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:43.203858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd93468-60a6-4378-8cb7-8f785e3b9b49 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:43.224030 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3539/7078] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:43 2022] PUT /identity/v3/projects/2a4b027c38ed4d04aeff7553cfe148b7/users/f9ddb829577a4b1eb79f6d2f7f3d0d49/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:22:43.228616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd93468-60a6-4378-8cb7-8f785e3b9b49 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:43.271242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b384043-ab6f-43d8-8310-0b23857cbfe6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:43.310629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd93468-60a6-4378-8cb7-8f785e3b9b49 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:43.316475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824df42-0d9e-4245-ba6c-9fdfb72647fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:43.317223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824df42-0d9e-4245-ba6c-9fdfb72647fa admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:43.317506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824df42-0d9e-4245-ba6c-9fdfb72647fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:43.317785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824df42-0d9e-4245-ba6c-9fdfb72647fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:43.318629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824df42-0d9e-4245-ba6c-9fdfb72647fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:43.322023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824df42-0d9e-4245-ba6c-9fdfb72647fa admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:43.334516 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3540/7079] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:22:43.345167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824df42-0d9e-4245-ba6c-9fdfb72647fa admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:43.359154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824df42-0d9e-4245-ba6c-9fdfb72647fa admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:43.365635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a2493-35eb-43ad-a96a-cf3f9d07b6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:43.366832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a2493-35eb-43ad-a96a-cf3f9d07b6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:43.367122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a2493-35eb-43ad-a96a-cf3f9d07b6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:43.367562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a2493-35eb-43ad-a96a-cf3f9d07b6b6 admin admin] PATH_INFO: `/v3/projects/2a4b027c38ed4d04aeff7553cfe148b7/users/f9ddb829577a4b1eb79f6d2f7f3d0d49/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:43.370518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a2493-35eb-43ad-a96a-cf3f9d07b6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4b027c38ed4d04aeff7553cfe148b7, user_id=f9ddb829577a4b1eb79f6d2f7f3d0d49, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:43.373567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a2493-35eb-43ad-a96a-cf3f9d07b6b6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:43.374179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8ccb4-88a2-4632-94b2-94f42aff8eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:43.375179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8ccb4-88a2-4632-94b2-94f42aff8eae admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:43.375926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8ccb4-88a2-4632-94b2-94f42aff8eae admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:43.377159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8ccb4-88a2-4632-94b2-94f42aff8eae admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:43.378640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8ccb4-88a2-4632-94b2-94f42aff8eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:43.381069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8ccb4-88a2-4632-94b2-94f42aff8eae admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:43.390857 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3541/7080] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:43 2022] PUT /identity/v3/projects/2a4b027c38ed4d04aeff7553cfe148b7/users/f9ddb829577a4b1eb79f6d2f7f3d0d49/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:43.399310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6cbdb-f4dc-4b0d-8d2f-fce35c79b023 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:43.399630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6cbdb-f4dc-4b0d-8d2f-fce35c79b023 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:43.399916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6cbdb-f4dc-4b0d-8d2f-fce35c79b023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:43.403142 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3540/7081] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:22:43.408134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8ccb4-88a2-4632-94b2-94f42aff8eae admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:43.423945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8ccb4-88a2-4632-94b2-94f42aff8eae admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:43.453628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-34e6cbdb-f4dc-4b0d-8d2f-fce35c79b023 None None] MFA Rules not processed for user `f9ddb829577a4b1eb79f6d2f7f3d0d49`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:43.454975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-34e6cbdb-f4dc-4b0d-8d2f-fce35c79b023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:43.539316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:43.572903 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3542/7082] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:22:43.575917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed263ce-d840-422c-90b7-e3377e4346b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:43.576884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed263ce-d840-422c-90b7-e3377e4346b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:43.577410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed263ce-d840-422c-90b7-e3377e4346b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:43.577890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed263ce-d840-422c-90b7-e3377e4346b8 admin admin] PATH_INFO: `/v3/projects/feb9227f00db497c9badf0c012da6105/users/dd2fd2fff2374fb794d82e3d3d962b69/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:43.580168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed263ce-d840-422c-90b7-e3377e4346b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb9227f00db497c9badf0c012da6105, user_id=dd2fd2fff2374fb794d82e3d3d962b69, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:43.585527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed263ce-d840-422c-90b7-e3377e4346b8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:43.592840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6cbdb-f4dc-4b0d-8d2f-fce35c79b023 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:43.594291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-34e6cbdb-f4dc-4b0d-8d2f-fce35c79b023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:43.605211 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3541/7083] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:43 2022] PUT /identity/v3/projects/feb9227f00db497c9badf0c012da6105/users/dd2fd2fff2374fb794d82e3d3d962b69/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:43.616717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e8d10-454e-4e41-8d8a-9fc988656e0c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:43.617045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e8d10-454e-4e41-8d8a-9fc988656e0c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:43.617284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e8d10-454e-4e41-8d8a-9fc988656e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:43.651837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1b3e8d10-454e-4e41-8d8a-9fc988656e0c None None] MFA Rules not processed for user `dd2fd2fff2374fb794d82e3d3d962b69`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:43.653280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1b3e8d10-454e-4e41-8d8a-9fc988656e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:43.655026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:43.676978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6cbdb-f4dc-4b0d-8d2f-fce35c79b023 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:43.753812 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3542/7084] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:22:43.758273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006faba-1022-486b-b1f6-ff42f5ae5b48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:43.759667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006faba-1022-486b-b1f6-ff42f5ae5b48 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:43.759953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006faba-1022-486b-b1f6-ff42f5ae5b48 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:43.760854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006faba-1022-486b-b1f6-ff42f5ae5b48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:43.761334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e8d10-454e-4e41-8d8a-9fc988656e0c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:43.764796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1b3e8d10-454e-4e41-8d8a-9fc988656e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:43.783923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e8d10-454e-4e41-8d8a-9fc988656e0c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:43.803521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3f33b-b41c-45e8-9e22-abdc4cf12eb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:43.803521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f33b-b41c-45e8-9e22-abdc4cf12eb9 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:43.803521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f33b-b41c-45e8-9e22-abdc4cf12eb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:43.803521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3f33b-b41c-45e8-9e22-abdc4cf12eb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:43.804761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3f33b-b41c-45e8-9e22-abdc4cf12eb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:43.807432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3f33b-b41c-45e8-9e22-abdc4cf12eb9 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:43.840548 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3543/7085] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:43.923576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006faba-1022-486b-b1f6-ff42f5ae5b48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:43.930612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006faba-1022-486b-b1f6-ff42f5ae5b48 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:43.943643 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3543/7086] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:44.550481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3f33b-b41c-45e8-9e22-abdc4cf12eb9 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:44.668046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3f33b-b41c-45e8-9e22-abdc4cf12eb9 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:44.683013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:44.683924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:44.684606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:44.685117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] PATH_INFO: `/v3/users/ec1d0e564e454711bc2e8534c984add4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:44.688058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1d0e564e454711bc2e8534c984add4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:44.690676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:44.759180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1d0e564e454711bc2e8534c984add4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:44.767342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1d0e564e454711bc2e8534c984add4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:44.768060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1d0e564e454711bc2e8534c984add4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:44.772809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:44.785137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1d0e564e454711bc2e8534c984add4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:44.786688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1d0e564e454711bc2e8534c984add4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:44.803701 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3544/7087] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:44 2022] DELETE /identity/v3/users/ec1d0e564e454711bc2e8534c984add4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:44.808656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601587e-65b5-4bf3-b5df-779efa48e5f1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:44.809130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601587e-65b5-4bf3-b5df-779efa48e5f1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:44.809293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601587e-65b5-4bf3-b5df-779efa48e5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:44.846414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:44.847986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:44.854388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2601587e-65b5-4bf3-b5df-779efa48e5f1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:44.857011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2601587e-65b5-4bf3-b5df-779efa48e5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:44.931534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5180a-8453-45db-a220-b6e473b5d53b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:44.937466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a464318-eea1-46dc-8cc9-ee8b7b3babcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:44.938133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a464318-eea1-46dc-8cc9-ee8b7b3babcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:44.938418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a464318-eea1-46dc-8cc9-ee8b7b3babcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:44.938702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a464318-eea1-46dc-8cc9-ee8b7b3babcf admin admin] PATH_INFO: `/v3/users/5cda1163273d41ac89b5229280fede6c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:44.940719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a464318-eea1-46dc-8cc9-ee8b7b3babcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cda1163273d41ac89b5229280fede6c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:44.943717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a464318-eea1-46dc-8cc9-ee8b7b3babcf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:44.957452 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3544/7088] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:22:44.975909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601587e-65b5-4bf3-b5df-779efa48e5f1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:44.978264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2601587e-65b5-4bf3-b5df-779efa48e5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:45.023956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4a464318-eea1-46dc-8cc9-ee8b7b3babcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cda1163273d41ac89b5229280fede6c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:45.035698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4a464318-eea1-46dc-8cc9-ee8b7b3babcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cda1163273d41ac89b5229280fede6c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:45.036616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4a464318-eea1-46dc-8cc9-ee8b7b3babcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cda1163273d41ac89b5229280fede6c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:45.054894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4a464318-eea1-46dc-8cc9-ee8b7b3babcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cda1163273d41ac89b5229280fede6c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:45.056491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-4a464318-eea1-46dc-8cc9-ee8b7b3babcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cda1163273d41ac89b5229280fede6c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:45.075602 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3545/7089] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:44 2022] DELETE /identity/v3/users/5cda1163273d41ac89b5229280fede6c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:45.078889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:45.080838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509068-93be-4861-bd29-66d910fa53c9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:45.081494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509068-93be-4861-bd29-66d910fa53c9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:45.082225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509068-93be-4861-bd29-66d910fa53c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:45.085764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601587e-65b5-4bf3-b5df-779efa48e5f1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:45.106680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-72509068-93be-4861-bd29-66d910fa53c9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:45.108257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-72509068-93be-4861-bd29-66d910fa53c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:45.150029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862d736-23af-4a02-8ef3-787aa81e2c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:45.151193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862d736-23af-4a02-8ef3-787aa81e2c6e service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:45.151525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862d736-23af-4a02-8ef3-787aa81e2c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:45.151800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862d736-23af-4a02-8ef3-787aa81e2c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:45.153592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2862d736-23af-4a02-8ef3-787aa81e2c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:45.195678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:45.210836 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3546/7090] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:45.226332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72509068-93be-4861-bd29-66d910fa53c9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:45.230331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-72509068-93be-4861-bd29-66d910fa53c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:45.250271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72509068-93be-4861-bd29-66d910fa53c9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:45.255482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25919c42-2bd1-4244-99ba-bc00a5aaba9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:45.256190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25919c42-2bd1-4244-99ba-bc00a5aaba9b service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:45.256585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25919c42-2bd1-4244-99ba-bc00a5aaba9b service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:45.257109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25919c42-2bd1-4244-99ba-bc00a5aaba9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:45.270622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25919c42-2bd1-4244-99ba-bc00a5aaba9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:45.272406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25919c42-2bd1-4244-99ba-bc00a5aaba9b service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:45.286917 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3547/7091] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:45.293669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862d736-23af-4a02-8ef3-787aa81e2c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:45.294903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862d736-23af-4a02-8ef3-787aa81e2c6e service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:45.306985 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3545/7092] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:22:45.910387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25919c42-2bd1-4244-99ba-bc00a5aaba9b service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:45.912221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-25919c42-2bd1-4244-99ba-bc00a5aaba9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:45.926963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25919c42-2bd1-4244-99ba-bc00a5aaba9b service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:45.932565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:45.933324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:45.933711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:45.934101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] PATH_INFO: `/v3/projects/8f2fce7cefe9480c9a0182254ce597aa` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:45.935415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2fce7cefe9480c9a0182254ce597aa)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:45.937458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:46.012994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2fce7cefe9480c9a0182254ce597aa', 'request_id': 'req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.027108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2fce7cefe9480c9a0182254ce597aa', 'request_id': 'req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.034294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2fce7cefe9480c9a0182254ce597aa', 'request_id': 'req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.057509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] The token cache is being invalidate because project 8f2fce7cefe9480c9a0182254ce597aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:46.057908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.060016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.064996 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3548/7093] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:45 2022] DELETE /identity/v3/projects/8f2fce7cefe9480c9a0182254ce597aa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:46.066249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862d736-23af-4a02-8ef3-787aa81e2c6e service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:46.085568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862d736-23af-4a02-8ef3-787aa81e2c6e service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:46.153220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:46.154675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:46.188895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:46.189647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:46.189994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:46.190335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] PATH_INFO: `/v3/users/dd2fd2fff2374fb794d82e3d3d962b69` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:46.191992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2fd2fff2374fb794d82e3d3d962b69)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:46.194013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:46.278422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d15d7b-68ae-40a7-9ee2-df5e438821c4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:46.282998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2fd2fff2374fb794d82e3d3d962b69'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.287298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:46.288197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:46.288593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:46.290952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] PATH_INFO: `/v3/projects/2954bf8b5d6341dd98d8dfe26ec8869e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:46.294388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2954bf8b5d6341dd98d8dfe26ec8869e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:46.298589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:46.299550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2fd2fff2374fb794d82e3d3d962b69'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.300742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2fd2fff2374fb794d82e3d3d962b69'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.306447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:46.316334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2fd2fff2374fb794d82e3d3d962b69'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.319396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2fd2fff2374fb794d82e3d3d962b69'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.358805 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3546/7094] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:46 2022] DELETE /identity/v3/users/dd2fd2fff2374fb794d82e3d3d962b69 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:46.388291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2954bf8b5d6341dd98d8dfe26ec8869e', 'request_id': 'req-b90a8393-3271-459a-ae32-e183a3f343a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.400842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2954bf8b5d6341dd98d8dfe26ec8869e', 'request_id': 'req-b90a8393-3271-459a-ae32-e183a3f343a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.411515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2954bf8b5d6341dd98d8dfe26ec8869e', 'request_id': 'req-b90a8393-3271-459a-ae32-e183a3f343a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.423053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:46.424939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] The token cache is being invalidate because project 2954bf8b5d6341dd98d8dfe26ec8869e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:46.425251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.427301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.430805 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3549/7095] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:46 2022] DELETE /identity/v3/projects/2954bf8b5d6341dd98d8dfe26ec8869e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:22:46.434197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:46.436519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:46.578033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114050a9-818b-4881-8f1b-16ae5f7f7564 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:46.656930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8e9f0-8e38-468f-a5a3-732f4b26d350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:46.657690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8e9f0-8e38-468f-a5a3-732f4b26d350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:46.658873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8e9f0-8e38-468f-a5a3-732f4b26d350 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:46.659227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8e9f0-8e38-468f-a5a3-732f4b26d350 admin admin] PATH_INFO: `/v3/users/f9ddb829577a4b1eb79f6d2f7f3d0d49` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:46.660739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8e9f0-8e38-468f-a5a3-732f4b26d350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ddb829577a4b1eb79f6d2f7f3d0d49)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:46.662867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8e9f0-8e38-468f-a5a3-732f4b26d350 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:46.729938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-78e8e9f0-8e38-468f-a5a3-732f4b26d350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ddb829577a4b1eb79f6d2f7f3d0d49'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.740086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-78e8e9f0-8e38-468f-a5a3-732f4b26d350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ddb829577a4b1eb79f6d2f7f3d0d49'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.741229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-78e8e9f0-8e38-468f-a5a3-732f4b26d350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ddb829577a4b1eb79f6d2f7f3d0d49'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.762773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-78e8e9f0-8e38-468f-a5a3-732f4b26d350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ddb829577a4b1eb79f6d2f7f3d0d49'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.763827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-78e8e9f0-8e38-468f-a5a3-732f4b26d350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ddb829577a4b1eb79f6d2f7f3d0d49'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:46.793598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:46.800379 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3547/7096] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:46 2022] DELETE /identity/v3/users/f9ddb829577a4b1eb79f6d2f7f3d0d49 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:47.043226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:47.044767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:47.064004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a8393-3271-459a-ae32-e183a3f343a5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:47.199439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821c591-74d8-43c5-960a-75ce282dc416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:47.200542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821c591-74d8-43c5-960a-75ce282dc416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:47.200542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821c591-74d8-43c5-960a-75ce282dc416 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:47.200873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821c591-74d8-43c5-960a-75ce282dc416 admin admin] PATH_INFO: `/v3/projects/feb9227f00db497c9badf0c012da6105` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:47.202392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821c591-74d8-43c5-960a-75ce282dc416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb9227f00db497c9badf0c012da6105)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:47.207116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821c591-74d8-43c5-960a-75ce282dc416 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:47.294281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6821c591-74d8-43c5-960a-75ce282dc416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb9227f00db497c9badf0c012da6105', 'request_id': 'req-6821c591-74d8-43c5-960a-75ce282dc416'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:47.305222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6821c591-74d8-43c5-960a-75ce282dc416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb9227f00db497c9badf0c012da6105', 'request_id': 'req-6821c591-74d8-43c5-960a-75ce282dc416'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:47.324123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6821c591-74d8-43c5-960a-75ce282dc416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb9227f00db497c9badf0c012da6105', 'request_id': 'req-6821c591-74d8-43c5-960a-75ce282dc416'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:47.344682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6821c591-74d8-43c5-960a-75ce282dc416 admin admin] The token cache is being invalidate because project feb9227f00db497c9badf0c012da6105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:47.345320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6821c591-74d8-43c5-960a-75ce282dc416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:47.346453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6821c591-74d8-43c5-960a-75ce282dc416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:47.349451 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3550/7097] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:47 2022] DELETE /identity/v3/projects/feb9227f00db497c9badf0c012da6105 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:47.355390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37065f1f-4a4f-4e1a-a014-fb750e06452d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:47.355904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37065f1f-4a4f-4e1a-a014-fb750e06452d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:47.356000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37065f1f-4a4f-4e1a-a014-fb750e06452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:47.382321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-37065f1f-4a4f-4e1a-a014-fb750e06452d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:47.386803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-37065f1f-4a4f-4e1a-a014-fb750e06452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:47.461649 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3548/7098] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:47.470000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e61d8-6fe7-4554-9982-4bf8342050d4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:47.470381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e61d8-6fe7-4554-9982-4bf8342050d4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:47.470733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e61d8-6fe7-4554-9982-4bf8342050d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:47.492885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9e6e61d8-6fe7-4554-9982-4bf8342050d4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:47.494413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9e6e61d8-6fe7-4554-9982-4bf8342050d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:47.502962 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3551/7099] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:47.507344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37065f1f-4a4f-4e1a-a014-fb750e06452d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:47.518045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37065f1f-4a4f-4e1a-a014-fb750e06452d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:47.523210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516016f6-6564-481b-9fad-567d239a41f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:47.523833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516016f6-6564-481b-9fad-567d239a41f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:47.527103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516016f6-6564-481b-9fad-567d239a41f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:47.527103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516016f6-6564-481b-9fad-567d239a41f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:47.527103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516016f6-6564-481b-9fad-567d239a41f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:22:47.527103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516016f6-6564-481b-9fad-567d239a41f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:47.528456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516016f6-6564-481b-9fad-567d239a41f7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:47.551583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e61d8-6fe7-4554-9982-4bf8342050d4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:47.555626 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3549/7100] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:22:47.569818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e61d8-6fe7-4554-9982-4bf8342050d4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:47.582084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eac899-c3d0-4b89-b5c0-0e7829f881d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:47.582880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eac899-c3d0-4b89-b5c0-0e7829f881d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:47.583567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eac899-c3d0-4b89-b5c0-0e7829f881d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:47.583567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eac899-c3d0-4b89-b5c0-0e7829f881d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:47.584239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eac899-c3d0-4b89-b5c0-0e7829f881d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:47.587444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eac899-c3d0-4b89-b5c0-0e7829f881d7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:47.623744 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3552/7101] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:47 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:22:47.625007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516016f6-6564-481b-9fad-567d239a41f7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:47.632092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eac899-c3d0-4b89-b5c0-0e7829f881d7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:47.637760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-99eac899-c3d0-4b89-b5c0-0e7829f881d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:47.640603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516016f6-6564-481b-9fad-567d239a41f7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:47.740133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdfd6-a452-4d5c-8e61-22ba340f5b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:47.741705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdfd6-a452-4d5c-8e61-22ba340f5b44 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:47.742785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdfd6-a452-4d5c-8e61-22ba340f5b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:47.744633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdfd6-a452-4d5c-8e61-22ba340f5b44 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:47.746391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdfd6-a452-4d5c-8e61-22ba340f5b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:47.751764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdfd6-a452-4d5c-8e61-22ba340f5b44 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:47.778003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eac899-c3d0-4b89-b5c0-0e7829f881d7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:47.784027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:47.784935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:47.785225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:47.785505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad admin admin] PATH_INFO: `/v3/projects/2a4b027c38ed4d04aeff7553cfe148b7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:47.786993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4b027c38ed4d04aeff7553cfe148b7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:47.790485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:47.791186 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3550/7102] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:47 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:47.792094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:47.794570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdfd6-a452-4d5c-8e61-22ba340f5b44 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:47.809531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdfd6-a452-4d5c-8e61-22ba340f5b44 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:47.818043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db1b2b-4503-4c6d-ba76-1c6c33645c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:47.818944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db1b2b-4503-4c6d-ba76-1c6c33645c39 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:47.819384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db1b2b-4503-4c6d-ba76-1c6c33645c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:47.819813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db1b2b-4503-4c6d-ba76-1c6c33645c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:47.820617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db1b2b-4503-4c6d-ba76-1c6c33645c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:47.824340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db1b2b-4503-4c6d-ba76-1c6c33645c39 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:47.856072 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3551/7103] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:47.859312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db1b2b-4503-4c6d-ba76-1c6c33645c39 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:47.871632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4b027c38ed4d04aeff7553cfe148b7', 'request_id': 'req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:47.873193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db1b2b-4503-4c6d-ba76-1c6c33645c39 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:47.886785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4b027c38ed4d04aeff7553cfe148b7', 'request_id': 'req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:47.901413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4b027c38ed4d04aeff7553cfe148b7', 'request_id': 'req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:47.917657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad admin admin] The token cache is being invalidate because project 2a4b027c38ed4d04aeff7553cfe148b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:47.918005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:47.918636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0587dae-cfbb-4c12-bb2d-738aa330d5ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:47.924045 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3553/7104] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:47 2022] DELETE /identity/v3/projects/2a4b027c38ed4d04aeff7553cfe148b7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:47.925467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca050-8888-4310-a20d-00cafea78ecc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:47.925750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca050-8888-4310-a20d-00cafea78ecc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:47.926628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ca050-8888-4310-a20d-00cafea78ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:47.954358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-943ca050-8888-4310-a20d-00cafea78ecc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:47.955666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-943ca050-8888-4310-a20d-00cafea78ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:47.982496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43aa1b-5e88-4792-af3a-b2fd1f132548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:47.983341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43aa1b-5e88-4792-af3a-b2fd1f132548 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:47.983731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43aa1b-5e88-4792-af3a-b2fd1f132548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:47.984224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43aa1b-5e88-4792-af3a-b2fd1f132548 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:47.985445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43aa1b-5e88-4792-af3a-b2fd1f132548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:47.987795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43aa1b-5e88-4792-af3a-b2fd1f132548 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:48.002675 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3552/7105] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:48.008210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43aa1b-5e88-4792-af3a-b2fd1f132548 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:48.011089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1a43aa1b-5e88-4792-af3a-b2fd1f132548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:48.021805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:48.034337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43aa1b-5e88-4792-af3a-b2fd1f132548 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:48.044783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55303c-4d34-4f8f-8535-500401a70f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:48.045715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55303c-4d34-4f8f-8535-500401a70f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:48.046108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55303c-4d34-4f8f-8535-500401a70f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:48.046615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55303c-4d34-4f8f-8535-500401a70f5b admin admin] PATH_INFO: `/v3/projects/8f3fb40923ac4f6cb605b8296137b9a5/users/36517a6b69704b33a1464a0b70882c02/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:48.065570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55303c-4d34-4f8f-8535-500401a70f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3fb40923ac4f6cb605b8296137b9a5, user_id=36517a6b69704b33a1464a0b70882c02, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:48.066389 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3554/7106] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:22:48.074760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddf50d-14de-4dce-8846-285b76f7d65b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:48.074935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55303c-4d34-4f8f-8535-500401a70f5b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:48.075111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddf50d-14de-4dce-8846-285b76f7d65b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:48.075321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddf50d-14de-4dce-8846-285b76f7d65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:48.101522 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3553/7107] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:48 2022] PUT /identity/v3/projects/8f3fb40923ac4f6cb605b8296137b9a5/users/36517a6b69704b33a1464a0b70882c02/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:48.113402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-21ddf50d-14de-4dce-8846-285b76f7d65b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:48.114616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba19a7-3fc5-4206-a73e-89e5ecb21b50 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:48.114977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba19a7-3fc5-4206-a73e-89e5ecb21b50 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:48.115268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba19a7-3fc5-4206-a73e-89e5ecb21b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:48.115656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-21ddf50d-14de-4dce-8846-285b76f7d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:48.177581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6bba19a7-3fc5-4206-a73e-89e5ecb21b50 None None] MFA Rules not processed for user `36517a6b69704b33a1464a0b70882c02`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:48.178638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6bba19a7-3fc5-4206-a73e-89e5ecb21b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:48.195000 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3555/7108] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:22:48.197085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddf50d-14de-4dce-8846-285b76f7d65b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:48.209608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddf50d-14de-4dce-8846-285b76f7d65b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:48.225097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d42fd-87b7-4859-995c-455cb2081a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:48.227662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d42fd-87b7-4859-995c-455cb2081a1e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:48.227959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d42fd-87b7-4859-995c-455cb2081a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:48.228711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d42fd-87b7-4859-995c-455cb2081a1e admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:48.229446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d42fd-87b7-4859-995c-455cb2081a1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:22:48.229708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d42fd-87b7-4859-995c-455cb2081a1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:48.231372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d42fd-87b7-4859-995c-455cb2081a1e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:48.266320 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3556/7109] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:22:48.270014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d42fd-87b7-4859-995c-455cb2081a1e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:48.287700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d42fd-87b7-4859-995c-455cb2081a1e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:48.299316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d44f6-9c92-4fea-b692-ec4c88b59618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:48.300207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d44f6-9c92-4fea-b692-ec4c88b59618 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:48.300207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d44f6-9c92-4fea-b692-ec4c88b59618 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:48.300517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d44f6-9c92-4fea-b692-ec4c88b59618 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:48.301113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d44f6-9c92-4fea-b692-ec4c88b59618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:48.303049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d44f6-9c92-4fea-b692-ec4c88b59618 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:48.332255 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3554/7110] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:22:48.342691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:48.347824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba19a7-3fc5-4206-a73e-89e5ecb21b50 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:48.350954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6bba19a7-3fc5-4206-a73e-89e5ecb21b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:48.375295 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3557/7111] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:48 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:48.376358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d44f6-9c92-4fea-b692-ec4c88b59618 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:48.454863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba19a7-3fc5-4206-a73e-89e5ecb21b50 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:48.514059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d44f6-9c92-4fea-b692-ec4c88b59618 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:48.525241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb3b72-b010-4046-b297-6b48297b24aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:48.526043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb3b72-b010-4046-b297-6b48297b24aa admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:48.526332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb3b72-b010-4046-b297-6b48297b24aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:48.526791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb3b72-b010-4046-b297-6b48297b24aa admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:48.527442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb3b72-b010-4046-b297-6b48297b24aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:48.529389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb3b72-b010-4046-b297-6b48297b24aa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:48.548941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b221e61-4f0f-45ed-be89-43934e58d774 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:48.549768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b221e61-4f0f-45ed-be89-43934e58d774 service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:48.550206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b221e61-4f0f-45ed-be89-43934e58d774 service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:48.551528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b221e61-4f0f-45ed-be89-43934e58d774 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:48.585574 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3558/7112] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:48 2022] POST /identity/v3/users => generated 282 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:22:48.590618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb3b72-b010-4046-b297-6b48297b24aa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:48.615633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb3b72-b010-4046-b297-6b48297b24aa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:48.629885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:48.633387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b045cf-e9d4-4b4c-96ff-a9888c125ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:48.634462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b045cf-e9d4-4b4c-96ff-a9888c125ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:48.634725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b045cf-e9d4-4b4c-96ff-a9888c125ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:48.635058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b045cf-e9d4-4b4c-96ff-a9888c125ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:48.636293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b045cf-e9d4-4b4c-96ff-a9888c125ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:48.639859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b045cf-e9d4-4b4c-96ff-a9888c125ae1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:48.659420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b221e61-4f0f-45ed-be89-43934e58d774 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:48.661488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b221e61-4f0f-45ed-be89-43934e58d774 service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:48.684089 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3559/7113] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:48.686240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b045cf-e9d4-4b4c-96ff-a9888c125ae1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:48.686708 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3555/7114] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:22:48.713249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b045cf-e9d4-4b4c-96ff-a9888c125ae1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:48.734163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438f125-9004-47e3-989f-3f15bbd0e068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:48.735116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f125-9004-47e3-989f-3f15bbd0e068 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:48.735497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f125-9004-47e3-989f-3f15bbd0e068 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:48.735877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f125-9004-47e3-989f-3f15bbd0e068 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:48.736784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438f125-9004-47e3-989f-3f15bbd0e068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:48.740320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438f125-9004-47e3-989f-3f15bbd0e068 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:48.771939 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3560/7115] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:48.776657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b221e61-4f0f-45ed-be89-43934e58d774 service glance] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:48.798834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b221e61-4f0f-45ed-be89-43934e58d774 service glance] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:48.804090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d1d0d-2734-4f2a-b56f-cb1d0560301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:48.804862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d1d0d-2734-4f2a-b56f-cb1d0560301e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:48.805212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d1d0d-2734-4f2a-b56f-cb1d0560301e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:48.806490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d1d0d-2734-4f2a-b56f-cb1d0560301e admin admin] PATH_INFO: `/v3/projects/8ab9db98dac241fa9de13db233cf9a3b/users/922c0909a79d4cda831e5d0eeced3655/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:48.871135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d1d0d-2734-4f2a-b56f-cb1d0560301e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab9db98dac241fa9de13db233cf9a3b, user_id=922c0909a79d4cda831e5d0eeced3655, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:48.874067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d1d0d-2734-4f2a-b56f-cb1d0560301e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:48.907038 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3556/7116] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:48 2022] PUT /identity/v3/projects/8ab9db98dac241fa9de13db233cf9a3b/users/922c0909a79d4cda831e5d0eeced3655/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:22:48.922417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505f574-ab23-4360-b327-bad4a6730d4a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:48.923318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505f574-ab23-4360-b327-bad4a6730d4a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:48.923705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505f574-ab23-4360-b327-bad4a6730d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:48.987428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2505f574-ab23-4360-b327-bad4a6730d4a None None] MFA Rules not processed for user `922c0909a79d4cda831e5d0eeced3655`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:48.994132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2505f574-ab23-4360-b327-bad4a6730d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:49.160071 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3561/7117] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:49.164831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d1d0d-2734-4f2a-b56f-cb1d0560301e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:49.297958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d1d0d-2734-4f2a-b56f-cb1d0560301e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:49.325767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ff465-b7a6-47b0-9946-2bfe7cfc6749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:49.327792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ff465-b7a6-47b0-9946-2bfe7cfc6749 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:49.328474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ff465-b7a6-47b0-9946-2bfe7cfc6749 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:49.328827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ff465-b7a6-47b0-9946-2bfe7cfc6749 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:49.329702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ff465-b7a6-47b0-9946-2bfe7cfc6749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:49.334007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ff465-b7a6-47b0-9946-2bfe7cfc6749 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:49.375183 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3557/7118] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:49 2022] POST /identity/v3/projects => generated 365 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:49.391540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505f574-ab23-4360-b327-bad4a6730d4a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:49.437009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505f574-ab23-4360-b327-bad4a6730d4a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:49.551531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:49.576505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb9acb-100d-45a1-a835-cb18df070ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:49.577327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb9acb-100d-45a1-a835-cb18df070ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:49.577615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb9acb-100d-45a1-a835-cb18df070ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:49.577892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb9acb-100d-45a1-a835-cb18df070ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:49.578590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb9acb-100d-45a1-a835-cb18df070ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:49.581444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb9acb-100d-45a1-a835-cb18df070ee7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:49.667720 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3562/7119] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:49 2022] POST /identity/v3/users => generated 289 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:49.672284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ff465-b7a6-47b0-9946-2bfe7cfc6749 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:49.693704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ff465-b7a6-47b0-9946-2bfe7cfc6749 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:49.704710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edad483-f037-49d0-9058-0dc6e2303840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:49.705336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edad483-f037-49d0-9058-0dc6e2303840 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:49.705619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edad483-f037-49d0-9058-0dc6e2303840 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:49.705890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edad483-f037-49d0-9058-0dc6e2303840 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:49.706537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edad483-f037-49d0-9058-0dc6e2303840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:49.708169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edad483-f037-49d0-9058-0dc6e2303840 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:49.724775 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3558/7120] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:49.731867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb9acb-100d-45a1-a835-cb18df070ee7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:49.747809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb9acb-100d-45a1-a835-cb18df070ee7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:49.754628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268a63e-fe0f-4bbd-ad7a-01fe79273f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:49.755478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268a63e-fe0f-4bbd-ad7a-01fe79273f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:49.755871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268a63e-fe0f-4bbd-ad7a-01fe79273f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:49.756246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268a63e-fe0f-4bbd-ad7a-01fe79273f3c admin admin] PATH_INFO: `/v3/projects/16871818ce4848f99157f4640df74d9c/users/694f748c0338405a996026cb1085fbc7/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:49.783703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268a63e-fe0f-4bbd-ad7a-01fe79273f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=16871818ce4848f99157f4640df74d9c, user_id=694f748c0338405a996026cb1085fbc7, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:49.787673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268a63e-fe0f-4bbd-ad7a-01fe79273f3c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:49.816770 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3563/7121] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:49 2022] PUT /identity/v3/projects/16871818ce4848f99157f4640df74d9c/users/694f748c0338405a996026cb1085fbc7/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:49.820226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edad483-f037-49d0-9058-0dc6e2303840 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:49.833938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edad483-f037-49d0-9058-0dc6e2303840 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:49.929692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679bd15a-d1ad-4a1a-90a6-bd51ef82d515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:49.930468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bd15a-d1ad-4a1a-90a6-bd51ef82d515 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:49.931430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bd15a-d1ad-4a1a-90a6-bd51ef82d515 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:49.931812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bd15a-d1ad-4a1a-90a6-bd51ef82d515 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:49.932669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bd15a-d1ad-4a1a-90a6-bd51ef82d515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:49.934394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679bd15a-d1ad-4a1a-90a6-bd51ef82d515 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:49.948219 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3559/7122] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:49.952433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268a63e-fe0f-4bbd-ad7a-01fe79273f3c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:49.979165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268a63e-fe0f-4bbd-ad7a-01fe79273f3c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:49.984729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b5dc5-7f31-4d78-89b7-252d847c9f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:49.985502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b5dc5-7f31-4d78-89b7-252d847c9f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:49.985671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b5dc5-7f31-4d78-89b7-252d847c9f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:49.985944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b5dc5-7f31-4d78-89b7-252d847c9f4c admin admin] PATH_INFO: `/v3/projects/16871818ce4848f99157f4640df74d9c/users/694f748c0338405a996026cb1085fbc7/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:49.988858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b5dc5-7f31-4d78-89b7-252d847c9f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=16871818ce4848f99157f4640df74d9c, user_id=694f748c0338405a996026cb1085fbc7, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:49.991794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b5dc5-7f31-4d78-89b7-252d847c9f4c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:50.011601 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3564/7123] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:49 2022] PUT /identity/v3/projects/16871818ce4848f99157f4640df74d9c/users/694f748c0338405a996026cb1085fbc7/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:50.020118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cf475-37bb-45a2-94fa-93064dc7f19d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:50.020432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cf475-37bb-45a2-94fa-93064dc7f19d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:50.020724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cf475-37bb-45a2-94fa-93064dc7f19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:50.056138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d77cf475-37bb-45a2-94fa-93064dc7f19d None None] MFA Rules not processed for user `694f748c0338405a996026cb1085fbc7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:50.057369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d77cf475-37bb-45a2-94fa-93064dc7f19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:50.077328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:50.187526 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3560/7124] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:50.198084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b5dc5-7f31-4d78-89b7-252d847c9f4c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:50.200021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6c5b5dc5-7f31-4d78-89b7-252d847c9f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:50.293030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b5dc5-7f31-4d78-89b7-252d847c9f4c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:50.297159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff13d0e-d554-49cb-8e39-bd0618883bde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:50.297798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff13d0e-d554-49cb-8e39-bd0618883bde service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:50.298080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff13d0e-d554-49cb-8e39-bd0618883bde service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:50.298385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff13d0e-d554-49cb-8e39-bd0618883bde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:50.312977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff13d0e-d554-49cb-8e39-bd0618883bde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:50.314670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff13d0e-d554-49cb-8e39-bd0618883bde service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:50.328820 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3565/7125] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:50.446903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cf475-37bb-45a2-94fa-93064dc7f19d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:50.460288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cf475-37bb-45a2-94fa-93064dc7f19d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:50.469705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7079c-1c2a-49b2-90cf-11c70913a00f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:50.470626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7079c-1c2a-49b2-90cf-11c70913a00f service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:50.471712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7079c-1c2a-49b2-90cf-11c70913a00f service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:50.472807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7079c-1c2a-49b2-90cf-11c70913a00f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:50.627193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7079c-1c2a-49b2-90cf-11c70913a00f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:50.646597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7079c-1c2a-49b2-90cf-11c70913a00f service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:50.679535 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3561/7126] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:51.048615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff13d0e-d554-49cb-8e39-bd0618883bde service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:51.050110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bff13d0e-d554-49cb-8e39-bd0618883bde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:51.176232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff13d0e-d554-49cb-8e39-bd0618883bde service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:51.181804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:51.182474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:51.182786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:51.183097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] PATH_INFO: `/v3/users/6f8442e91abe4b1f8439b1571a4ee385` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:51.184738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8442e91abe4b1f8439b1571a4ee385)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:51.187995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:51.253117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8442e91abe4b1f8439b1571a4ee385'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:51.256810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:51.267199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8442e91abe4b1f8439b1571a4ee385'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:51.268059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8442e91abe4b1f8439b1571a4ee385'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:51.288920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8442e91abe4b1f8439b1571a4ee385'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:51.289697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8442e91abe4b1f8439b1571a4ee385'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:51.312860 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3566/7127] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:51 2022] DELETE /identity/v3/users/6f8442e91abe4b1f8439b1571a4ee385 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:51.318216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379ab97-9823-4842-8e75-fbc80ea64c83 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:51.318995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379ab97-9823-4842-8e75-fbc80ea64c83 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:51.319633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379ab97-9823-4842-8e75-fbc80ea64c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:51.345293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3379ab97-9823-4842-8e75-fbc80ea64c83 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:51.346714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3379ab97-9823-4842-8e75-fbc80ea64c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:51.422837 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3562/7128] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:51.433909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:51.435891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:51.530687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105422b-08d9-46cf-91b3-238f58336bb2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:51.534560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1245a-378b-440e-9975-ffb4ddcca18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:51.535210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1245a-378b-440e-9975-ffb4ddcca18d service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:51.535488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1245a-378b-440e-9975-ffb4ddcca18d service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:51.535763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1245a-378b-440e-9975-ffb4ddcca18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:51.555184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1245a-378b-440e-9975-ffb4ddcca18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:51.557444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1245a-378b-440e-9975-ffb4ddcca18d service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:51.569555 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3567/7129] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:51.790264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379ab97-9823-4842-8e75-fbc80ea64c83 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:51.791872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3379ab97-9823-4842-8e75-fbc80ea64c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:51.840454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379ab97-9823-4842-8e75-fbc80ea64c83 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:51.855506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:51.856154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:51.856437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:51.856710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] PATH_INFO: `/v3/projects/a3933a34d332491981270944ac4f9e4c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:51.857931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3933a34d332491981270944ac4f9e4c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:51.860786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:51.920052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:51.925959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3933a34d332491981270944ac4f9e4c', 'request_id': 'req-5dfbeca1-8fe6-4a34-8762-079ba3397629'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:51.938250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3933a34d332491981270944ac4f9e4c', 'request_id': 'req-5dfbeca1-8fe6-4a34-8762-079ba3397629'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:51.949846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3933a34d332491981270944ac4f9e4c', 'request_id': 'req-5dfbeca1-8fe6-4a34-8762-079ba3397629'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:51.980473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] The token cache is being invalidate because project a3933a34d332491981270944ac4f9e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:51.980764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:51.982037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:51.986485 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3563/7130] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:51 2022] DELETE /identity/v3/projects/a3933a34d332491981270944ac4f9e4c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:22:51.988110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1245a-378b-440e-9975-ffb4ddcca18d service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:52.002079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1245a-378b-440e-9975-ffb4ddcca18d service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:52.125458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e917da3-d0e6-4ea1-8a19-27bfe021d372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:52.126413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e917da3-d0e6-4ea1-8a19-27bfe021d372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:52.126703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e917da3-d0e6-4ea1-8a19-27bfe021d372 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:52.128243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e917da3-d0e6-4ea1-8a19-27bfe021d372 admin admin] PATH_INFO: `/v3/users/b60d1cff5c8e458b943787ccf2f4a35e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:52.129577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e917da3-d0e6-4ea1-8a19-27bfe021d372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60d1cff5c8e458b943787ccf2f4a35e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:52.132023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e917da3-d0e6-4ea1-8a19-27bfe021d372 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:52.237840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9e917da3-d0e6-4ea1-8a19-27bfe021d372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60d1cff5c8e458b943787ccf2f4a35e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:52.266771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9e917da3-d0e6-4ea1-8a19-27bfe021d372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60d1cff5c8e458b943787ccf2f4a35e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:52.268575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9e917da3-d0e6-4ea1-8a19-27bfe021d372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60d1cff5c8e458b943787ccf2f4a35e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:52.304697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:52.315800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9e917da3-d0e6-4ea1-8a19-27bfe021d372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60d1cff5c8e458b943787ccf2f4a35e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:52.318445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9e917da3-d0e6-4ea1-8a19-27bfe021d372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60d1cff5c8e458b943787ccf2f4a35e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:52.348960 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3568/7131] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:51 2022] DELETE /identity/v3/users/b60d1cff5c8e458b943787ccf2f4a35e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:52.880867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:52.882346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:52.908251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbeca1-8fe6-4a34-8762-079ba3397629 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:53.035764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:53.036459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:53.036742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:53.037016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac admin admin] PATH_INFO: `/v3/projects/9781504710d54e16b190bf5c7c702066` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:53.038449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9781504710d54e16b190bf5c7c702066)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:53.041178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:53.114778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9781504710d54e16b190bf5c7c702066', 'request_id': 'req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:53.126998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9781504710d54e16b190bf5c7c702066', 'request_id': 'req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:53.145535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9781504710d54e16b190bf5c7c702066', 'request_id': 'req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:53.174460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac admin admin] The token cache is being invalidate because project 9781504710d54e16b190bf5c7c702066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:53.175238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:53.177412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-af0ef835-3eb7-4dd9-b7d4-d30d3c5172ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:53.180709 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3564/7132] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:52 2022] DELETE /identity/v3/projects/9781504710d54e16b190bf5c7c702066 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:53.187876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34dcbf-53d5-4b70-868b-073db9cc5de6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:53.188171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34dcbf-53d5-4b70-868b-073db9cc5de6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:53.188473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34dcbf-53d5-4b70-868b-073db9cc5de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:53.218950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ac34dcbf-53d5-4b70-868b-073db9cc5de6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:53.220724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ac34dcbf-53d5-4b70-868b-073db9cc5de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:53.365439 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3569/7133] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:53.367256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31523-7920-4ca3-b7e9-239f73370614 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:53.367496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31523-7920-4ca3-b7e9-239f73370614 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:53.367773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31523-7920-4ca3-b7e9-239f73370614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:53.407253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-74e31523-7920-4ca3-b7e9-239f73370614 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:53.408497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-74e31523-7920-4ca3-b7e9-239f73370614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:53.440171 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3565/7134] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:53.443675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34dcbf-53d5-4b70-868b-073db9cc5de6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:53.468022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34dcbf-53d5-4b70-868b-073db9cc5de6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:53.480590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e83fa-8b20-4d99-90cf-e20bcdebeb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:53.481228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e83fa-8b20-4d99-90cf-e20bcdebeb8b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:53.481511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e83fa-8b20-4d99-90cf-e20bcdebeb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:53.481979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e83fa-8b20-4d99-90cf-e20bcdebeb8b admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:53.482921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e83fa-8b20-4d99-90cf-e20bcdebeb8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:22:53.483226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e83fa-8b20-4d99-90cf-e20bcdebeb8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:53.484838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e83fa-8b20-4d99-90cf-e20bcdebeb8b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:53.532636 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3570/7135] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:22:53.537056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e31523-7920-4ca3-b7e9-239f73370614 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:53.549795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e31523-7920-4ca3-b7e9-239f73370614 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:53.569857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e83fa-8b20-4d99-90cf-e20bcdebeb8b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:53.579265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-836e83fa-8b20-4d99-90cf-e20bcdebeb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:53.594693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06e8db-1d52-4ff4-ab78-2bb7ec9e22ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:53.594972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06e8db-1d52-4ff4-ab78-2bb7ec9e22ca admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:53.597115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06e8db-1d52-4ff4-ab78-2bb7ec9e22ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:53.600724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06e8db-1d52-4ff4-ab78-2bb7ec9e22ca admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:53.601574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06e8db-1d52-4ff4-ab78-2bb7ec9e22ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:53.607007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06e8db-1d52-4ff4-ab78-2bb7ec9e22ca admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:53.735146 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3566/7136] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:53 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:22:53.739443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06e8db-1d52-4ff4-ab78-2bb7ec9e22ca admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:53.765714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e83fa-8b20-4d99-90cf-e20bcdebeb8b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:53.873986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041df623-8382-4d58-8bec-9eff47174276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:53.874451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:53.874730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df623-8382-4d58-8bec-9eff47174276 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:53.875304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df623-8382-4d58-8bec-9eff47174276 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:53.876572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041df623-8382-4d58-8bec-9eff47174276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:53.879915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-041df623-8382-4d58-8bec-9eff47174276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:53.897147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041df623-8382-4d58-8bec-9eff47174276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:53.898550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041df623-8382-4d58-8bec-9eff47174276 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:53.909027 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3571/7137] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:53.924564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06e8db-1d52-4ff4-ab78-2bb7ec9e22ca admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:53.928918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8244527-8431-4b33-9b4a-c535f4cf477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:53.929634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8244527-8431-4b33-9b4a-c535f4cf477f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:53.929985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8244527-8431-4b33-9b4a-c535f4cf477f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:53.930434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8244527-8431-4b33-9b4a-c535f4cf477f admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:53.931901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8244527-8431-4b33-9b4a-c535f4cf477f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:53.935285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8244527-8431-4b33-9b4a-c535f4cf477f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:53.968516 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3567/7138] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:53 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:53.972627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041df623-8382-4d58-8bec-9eff47174276 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:53.989598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041df623-8382-4d58-8bec-9eff47174276 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:53.995127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ab211-1841-4c0e-9fe9-02e3443ce243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:53.995741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ab211-1841-4c0e-9fe9-02e3443ce243 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:53.996028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ab211-1841-4c0e-9fe9-02e3443ce243 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:53.996307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ab211-1841-4c0e-9fe9-02e3443ce243 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:53.996950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ab211-1841-4c0e-9fe9-02e3443ce243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:54.001564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ab211-1841-4c0e-9fe9-02e3443ce243 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:54.017414 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3572/7139] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:54.018155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8244527-8431-4b33-9b4a-c535f4cf477f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:54.032744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8244527-8431-4b33-9b4a-c535f4cf477f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:54.038033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f5097-2191-415c-9a43-2865a593a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:54.038702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f5097-2191-415c-9a43-2865a593a9fd admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:54.038973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f5097-2191-415c-9a43-2865a593a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:54.039258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f5097-2191-415c-9a43-2865a593a9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:54.040480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f5097-2191-415c-9a43-2865a593a9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:54.042707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f5097-2191-415c-9a43-2865a593a9fd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:54.068375 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3568/7140] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:22:54.070808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ab211-1841-4c0e-9fe9-02e3443ce243 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:54.089387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ab211-1841-4c0e-9fe9-02e3443ce243 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:54.096156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8710f5b-6c64-4ac3-9ec9-d526f5dcc59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:54.097102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710f5b-6c64-4ac3-9ec9-d526f5dcc59a admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:54.097903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710f5b-6c64-4ac3-9ec9-d526f5dcc59a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:54.099228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710f5b-6c64-4ac3-9ec9-d526f5dcc59a admin admin] PATH_INFO: `/v3/projects/55e7469d09e64042a3c9b9dc0d9da321/users/f966cae595b14bdf921bd3e72f652611/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:54.125961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8710f5b-6c64-4ac3-9ec9-d526f5dcc59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e7469d09e64042a3c9b9dc0d9da321, user_id=f966cae595b14bdf921bd3e72f652611, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:54.129736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8710f5b-6c64-4ac3-9ec9-d526f5dcc59a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:54.152953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:54.160818 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3573/7141] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:54 2022] PUT /identity/v3/projects/55e7469d09e64042a3c9b9dc0d9da321/users/f966cae595b14bdf921bd3e72f652611/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:54.172474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773f42-adc2-4204-9cae-4d97b6beae9d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:54.172777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773f42-adc2-4204-9cae-4d97b6beae9d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:54.173094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773f42-adc2-4204-9cae-4d97b6beae9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:54.232049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ad773f42-adc2-4204-9cae-4d97b6beae9d None None] MFA Rules not processed for user `f966cae595b14bdf921bd3e72f652611`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:54.233671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ad773f42-adc2-4204-9cae-4d97b6beae9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:54.289270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8710f5b-6c64-4ac3-9ec9-d526f5dcc59a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:54.433933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8710f5b-6c64-4ac3-9ec9-d526f5dcc59a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:54.440612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869394f0-8082-4267-9595-52763f3cd715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:54.441256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869394f0-8082-4267-9595-52763f3cd715 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:54.441543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869394f0-8082-4267-9595-52763f3cd715 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:54.441823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869394f0-8082-4267-9595-52763f3cd715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:54.451602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-869394f0-8082-4267-9595-52763f3cd715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:54.451810 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3569/7142] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:22:54.451810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773f42-adc2-4204-9cae-4d97b6beae9d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:54.481019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869394f0-8082-4267-9595-52763f3cd715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:54.482575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869394f0-8082-4267-9595-52763f3cd715 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:54.496121 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3574/7143] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:54.644740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773f42-adc2-4204-9cae-4d97b6beae9d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:54.655396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e120e-5210-4e45-a20b-7bd2ab8a3890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:54.656684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e120e-5210-4e45-a20b-7bd2ab8a3890 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:54.657316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e120e-5210-4e45-a20b-7bd2ab8a3890 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:54.657907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e120e-5210-4e45-a20b-7bd2ab8a3890 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:54.659077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e120e-5210-4e45-a20b-7bd2ab8a3890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:54.662146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e120e-5210-4e45-a20b-7bd2ab8a3890 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:54.710794 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3570/7144] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:54 2022] POST /identity/v3/projects => generated 389 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:54.713847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869394f0-8082-4267-9595-52763f3cd715 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:54.726202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869394f0-8082-4267-9595-52763f3cd715 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:54.816281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30654a-c0df-4245-8a76-62ba6b24318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:54.816613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30654a-c0df-4245-8a76-62ba6b24318c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:54.817158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30654a-c0df-4245-8a76-62ba6b24318c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:54.817667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30654a-c0df-4245-8a76-62ba6b24318c admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:54.818495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30654a-c0df-4245-8a76-62ba6b24318c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:54.821470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30654a-c0df-4245-8a76-62ba6b24318c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:54.871996 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3575/7145] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:54 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:54.876196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e120e-5210-4e45-a20b-7bd2ab8a3890 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:54.898200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e120e-5210-4e45-a20b-7bd2ab8a3890 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:54.929297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244be22-02dd-4c45-8158-5d0510e9b638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:54.933035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244be22-02dd-4c45-8158-5d0510e9b638 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:54.933330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244be22-02dd-4c45-8158-5d0510e9b638 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:54.933869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244be22-02dd-4c45-8158-5d0510e9b638 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:54.934545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244be22-02dd-4c45-8158-5d0510e9b638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:54.947697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244be22-02dd-4c45-8158-5d0510e9b638 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:54.979259 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3571/7146] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:54.983327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30654a-c0df-4245-8a76-62ba6b24318c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:54.998352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30654a-c0df-4245-8a76-62ba6b24318c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:55.015651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee56cf6-80df-40a3-8b92-9556a1c772dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:55.016679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee56cf6-80df-40a3-8b92-9556a1c772dd admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:55.017046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee56cf6-80df-40a3-8b92-9556a1c772dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:55.017396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee56cf6-80df-40a3-8b92-9556a1c772dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:55.018147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee56cf6-80df-40a3-8b92-9556a1c772dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:55.019997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee56cf6-80df-40a3-8b92-9556a1c772dd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:55.051198 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3576/7147] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:22:55.054548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244be22-02dd-4c45-8158-5d0510e9b638 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:55.068101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244be22-02dd-4c45-8158-5d0510e9b638 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:55.073150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310363c-08eb-4312-aac9-cf966d354c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:55.073837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310363c-08eb-4312-aac9-cf966d354c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:55.074118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310363c-08eb-4312-aac9-cf966d354c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:55.074396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310363c-08eb-4312-aac9-cf966d354c82 admin admin] PATH_INFO: `/v3/projects/bce656b25bdc482092311f34e8bab1f4/users/6a1495f325344c12acec97d59b18203f/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:55.088731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:55.092255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310363c-08eb-4312-aac9-cf966d354c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce656b25bdc482092311f34e8bab1f4, user_id=6a1495f325344c12acec97d59b18203f, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:55.097192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310363c-08eb-4312-aac9-cf966d354c82 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:55.154415 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3572/7148] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:55 2022] PUT /identity/v3/projects/bce656b25bdc482092311f34e8bab1f4/users/6a1495f325344c12acec97d59b18203f/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:55.155137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612890e-9627-4554-833a-8eb656801f62 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:55.156014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612890e-9627-4554-833a-8eb656801f62 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:55.156616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612890e-9627-4554-833a-8eb656801f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:55.343858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8612890e-9627-4554-833a-8eb656801f62 None None] MFA Rules not processed for user `6a1495f325344c12acec97d59b18203f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:55.345227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8612890e-9627-4554-833a-8eb656801f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:55.498302 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3577/7149] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:55.503640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310363c-08eb-4312-aac9-cf966d354c82 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:55.655285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310363c-08eb-4312-aac9-cf966d354c82 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:55.663541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d77eb-f4b4-43f0-83db-529a43dfdd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:55.665629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d77eb-f4b4-43f0-83db-529a43dfdd8c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:55.667051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d77eb-f4b4-43f0-83db-529a43dfdd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:55.669433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d77eb-f4b4-43f0-83db-529a43dfdd8c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:55.670195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d77eb-f4b4-43f0-83db-529a43dfdd8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:55.672797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d77eb-f4b4-43f0-83db-529a43dfdd8c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:55.691304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612890e-9627-4554-833a-8eb656801f62 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:55.692745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8612890e-9627-4554-833a-8eb656801f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:55.717655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612890e-9627-4554-833a-8eb656801f62 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:55.734708 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3573/7150] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:55 2022] POST /identity/v3/projects => generated 387 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:55.734951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbd839-ecb4-4210-bb38-29691a99b7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:55.734951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbd839-ecb4-4210-bb38-29691a99b7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:55.734951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbd839-ecb4-4210-bb38-29691a99b7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:55.734951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbd839-ecb4-4210-bb38-29691a99b7b1 admin admin] PATH_INFO: `/v3/users/7b371da2cc354c0fa07ee93d78678bbf` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:55.735269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbd839-ecb4-4210-bb38-29691a99b7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b371da2cc354c0fa07ee93d78678bbf)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:55.735269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbd839-ecb4-4210-bb38-29691a99b7b1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:55.735439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d77eb-f4b4-43f0-83db-529a43dfdd8c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:55.740879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:55.833093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d77eb-f4b4-43f0-83db-529a43dfdd8c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:55.842679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ebbd839-ecb4-4210-bb38-29691a99b7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b371da2cc354c0fa07ee93d78678bbf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:55.844797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d8524-2267-4545-9561-248d038891e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:55.846471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8524-2267-4545-9561-248d038891e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:55.847867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8524-2267-4545-9561-248d038891e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:55.848496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8524-2267-4545-9561-248d038891e1 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:55.850946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d8524-2267-4545-9561-248d038891e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:55.854116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d8524-2267-4545-9561-248d038891e1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:55.859547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ebbd839-ecb4-4210-bb38-29691a99b7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b371da2cc354c0fa07ee93d78678bbf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:55.860416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ebbd839-ecb4-4210-bb38-29691a99b7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b371da2cc354c0fa07ee93d78678bbf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:55.897949 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3574/7151] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:55 2022] POST /identity/v3/users => generated 300 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:22:55.899865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d8524-2267-4545-9561-248d038891e1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:55.902400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ebbd839-ecb4-4210-bb38-29691a99b7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b371da2cc354c0fa07ee93d78678bbf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:55.910028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ebbd839-ecb4-4210-bb38-29691a99b7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b371da2cc354c0fa07ee93d78678bbf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:55.912124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d8524-2267-4545-9561-248d038891e1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:55.938596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1e2ff-1a39-4b1d-838e-50b9745164d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:55.939257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1e2ff-1a39-4b1d-838e-50b9745164d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:55.941529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1e2ff-1a39-4b1d-838e-50b9745164d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:55.941995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1e2ff-1a39-4b1d-838e-50b9745164d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:55.943757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1e2ff-1a39-4b1d-838e-50b9745164d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:55.946119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1e2ff-1a39-4b1d-838e-50b9745164d3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:55.946303 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3578/7152] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:55 2022] DELETE /identity/v3/users/7b371da2cc354c0fa07ee93d78678bbf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:55.952015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4192d5e-3026-4b4e-bb26-922446a12f5c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:55.952312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4192d5e-3026-4b4e-bb26-922446a12f5c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:55.952589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4192d5e-3026-4b4e-bb26-922446a12f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:55.972178 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3575/7153] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:55.975838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a4192d5e-3026-4b4e-bb26-922446a12f5c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:55.976531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1e2ff-1a39-4b1d-838e-50b9745164d3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:55.977447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a4192d5e-3026-4b4e-bb26-922446a12f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:55.994091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f2b1e2ff-1a39-4b1d-838e-50b9745164d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:56.012092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1e2ff-1a39-4b1d-838e-50b9745164d3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:56.128812 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3579/7154] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:56.139632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4192d5e-3026-4b4e-bb26-922446a12f5c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:56.141408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a4192d5e-3026-4b4e-bb26-922446a12f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:56.162683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:56.171996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d08f9c-c425-4cab-96bc-23f32881d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:56.172766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d08f9c-c425-4cab-96bc-23f32881d596 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:56.172983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d08f9c-c425-4cab-96bc-23f32881d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:56.173559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d08f9c-c425-4cab-96bc-23f32881d596 admin admin] PATH_INFO: `/v3/projects/4f385cdb0b2f4fa5b8e8a8e252a5aab4/users/df80b95bf27f46719d54ba16fa4152a1/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:56.199372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d08f9c-c425-4cab-96bc-23f32881d596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f385cdb0b2f4fa5b8e8a8e252a5aab4, user_id=df80b95bf27f46719d54ba16fa4152a1, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:56.202897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d08f9c-c425-4cab-96bc-23f32881d596 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:56.223630 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3576/7155] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:55 2022] PUT /identity/v3/projects/4f385cdb0b2f4fa5b8e8a8e252a5aab4/users/df80b95bf27f46719d54ba16fa4152a1/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:56.227729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d08f9c-c425-4cab-96bc-23f32881d596 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:56.286832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4192d5e-3026-4b4e-bb26-922446a12f5c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:56.353107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d08f9c-c425-4cab-96bc-23f32881d596 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:56.356850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:56.369893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d15a1c-2874-4396-af33-0d8911c68082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:56.370535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d15a1c-2874-4396-af33-0d8911c68082 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:56.370822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d15a1c-2874-4396-af33-0d8911c68082 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:56.371103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d15a1c-2874-4396-af33-0d8911c68082 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:56.371765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d15a1c-2874-4396-af33-0d8911c68082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:56.373377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d15a1c-2874-4396-af33-0d8911c68082 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:56.376924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af975b-e783-4224-94f4-a7699a14eba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:56.377818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af975b-e783-4224-94f4-a7699a14eba5 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:56.378122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af975b-e783-4224-94f4-a7699a14eba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:56.382056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af975b-e783-4224-94f4-a7699a14eba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:56.398888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af975b-e783-4224-94f4-a7699a14eba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:56.401209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af975b-e783-4224-94f4-a7699a14eba5 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:56.405595 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3577/7156] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:56.406512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d15a1c-2874-4396-af33-0d8911c68082 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:56.429360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d15a1c-2874-4396-af33-0d8911c68082 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:56.431124 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3580/7157] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:22:56.447689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321a2f7-8901-40f3-9ab5-fa375c363412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:56.448384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321a2f7-8901-40f3-9ab5-fa375c363412 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:56.448664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321a2f7-8901-40f3-9ab5-fa375c363412 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:56.448947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321a2f7-8901-40f3-9ab5-fa375c363412 admin admin] PATH_INFO: `/v3/projects/4f385cdb0b2f4fa5b8e8a8e252a5aab4/users/df80b95bf27f46719d54ba16fa4152a1/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:56.466468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321a2f7-8901-40f3-9ab5-fa375c363412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f385cdb0b2f4fa5b8e8a8e252a5aab4, user_id=df80b95bf27f46719d54ba16fa4152a1, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:56.469190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321a2f7-8901-40f3-9ab5-fa375c363412 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:56.527870 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3578/7158] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:56 2022] PUT /identity/v3/projects/4f385cdb0b2f4fa5b8e8a8e252a5aab4/users/df80b95bf27f46719d54ba16fa4152a1/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:56.530023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb379b-e467-4085-b0f5-44d74736434f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:56.532911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb379b-e467-4085-b0f5-44d74736434f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:56.533256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb379b-e467-4085-b0f5-44d74736434f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:56.593758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-abfb379b-e467-4085-b0f5-44d74736434f None None] MFA Rules not processed for user `df80b95bf27f46719d54ba16fa4152a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:56.597511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-abfb379b-e467-4085-b0f5-44d74736434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:56.718952 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3581/7159] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:56.727347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321a2f7-8901-40f3-9ab5-fa375c363412 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:56.729852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a321a2f7-8901-40f3-9ab5-fa375c363412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:56.872176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb379b-e467-4085-b0f5-44d74736434f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:56.872591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321a2f7-8901-40f3-9ab5-fa375c363412 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:56.874143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-abfb379b-e467-4085-b0f5-44d74736434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:56.879035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe3dbb-3037-451c-ac64-ae16333e5904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:56.879654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe3dbb-3037-451c-ac64-ae16333e5904 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:56.879936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe3dbb-3037-451c-ac64-ae16333e5904 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:56.880272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe3dbb-3037-451c-ac64-ae16333e5904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:56.886600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8fbe3dbb-3037-451c-ac64-ae16333e5904 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:56.972509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe3dbb-3037-451c-ac64-ae16333e5904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:56.975146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe3dbb-3037-451c-ac64-ae16333e5904 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:56.980575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:56.988328 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3579/7160] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:22:57.004102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb379b-e467-4085-b0f5-44d74736434f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:57.009661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:57.010415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:57.010604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:57.011047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] PATH_INFO: `/v3/projects/3d86908f9d6e404dba7468d5d8f8dc88` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:57.012372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d86908f9d6e404dba7468d5d8f8dc88)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:57.014276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:57.082862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d86908f9d6e404dba7468d5d8f8dc88', 'request_id': 'req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:57.095609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d86908f9d6e404dba7468d5d8f8dc88', 'request_id': 'req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:57.105286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d86908f9d6e404dba7468d5d8f8dc88', 'request_id': 'req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:57.114926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:57.124067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] The token cache is being invalidate because project 3d86908f9d6e404dba7468d5d8f8dc88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:57.125209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:57.128333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:57.130558 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3582/7161] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:56 2022] DELETE /identity/v3/projects/3d86908f9d6e404dba7468d5d8f8dc88 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:57.138294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe3dbb-3037-451c-ac64-ae16333e5904 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:57.161341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe3dbb-3037-451c-ac64-ae16333e5904 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:57.323339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6793e7-59af-4b70-b784-d3bc8b495dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:57.324051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6793e7-59af-4b70-b784-d3bc8b495dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:57.324336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6793e7-59af-4b70-b784-d3bc8b495dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:57.324634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6793e7-59af-4b70-b784-d3bc8b495dc1 admin admin] PATH_INFO: `/v3/users/0c6aaa1aa7464c289da2d6ad7f2134f8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:57.325844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6793e7-59af-4b70-b784-d3bc8b495dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6aaa1aa7464c289da2d6ad7f2134f8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:57.328218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6793e7-59af-4b70-b784-d3bc8b495dc1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:57.418151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee6793e7-59af-4b70-b784-d3bc8b495dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6aaa1aa7464c289da2d6ad7f2134f8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:57.428661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee6793e7-59af-4b70-b784-d3bc8b495dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6aaa1aa7464c289da2d6ad7f2134f8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:57.429570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee6793e7-59af-4b70-b784-d3bc8b495dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6aaa1aa7464c289da2d6ad7f2134f8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:57.449225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee6793e7-59af-4b70-b784-d3bc8b495dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6aaa1aa7464c289da2d6ad7f2134f8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:57.449975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ee6793e7-59af-4b70-b784-d3bc8b495dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6aaa1aa7464c289da2d6ad7f2134f8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:57.487952 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3580/7162] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:22:57 2022] DELETE /identity/v3/users/0c6aaa1aa7464c289da2d6ad7f2134f8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:57.831870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:57.834134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:57.867335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce369f-3ff0-44b6-9d57-4ab380fbd89f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:57.969973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:57.970644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:57.970958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:57.971233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe admin admin] PATH_INFO: `/v3/projects/826ff249ece84d2faac968ed31f7202f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:57.972366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=826ff249ece84d2faac968ed31f7202f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:57.974421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:58.043787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826ff249ece84d2faac968ed31f7202f', 'request_id': 'req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:58.054397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826ff249ece84d2faac968ed31f7202f', 'request_id': 'req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:58.067862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826ff249ece84d2faac968ed31f7202f', 'request_id': 'req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:58.091563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe admin admin] The token cache is being invalidate because project 826ff249ece84d2faac968ed31f7202f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:22:58.091890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:58.093854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7f06dc6d-482e-4910-953e-9e0a7aca6cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:22:58.103763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef07387-0615-4244-a781-f5cc1ecb0fa3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:58.104309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef07387-0615-4244-a781-f5cc1ecb0fa3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:58.104500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef07387-0615-4244-a781-f5cc1ecb0fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:58.108041 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3583/7163] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:22:57 2022] DELETE /identity/v3/projects/826ff249ece84d2faac968ed31f7202f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:22:58.137169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0ef07387-0615-4244-a781-f5cc1ecb0fa3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:58.138594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0ef07387-0615-4244-a781-f5cc1ecb0fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:58.253101 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3581/7164] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:58.268020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e2ab-bbbc-424f-bd10-2d681c71e9bc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:58.268469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e2ab-bbbc-424f-bd10-2d681c71e9bc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:58.270130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e2ab-bbbc-424f-bd10-2d681c71e9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:58.316212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6381e2ab-bbbc-424f-bd10-2d681c71e9bc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:58.326519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6381e2ab-bbbc-424f-bd10-2d681c71e9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:58.353911 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3584/7165] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:58.355571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef07387-0615-4244-a781-f5cc1ecb0fa3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:58.378038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef07387-0615-4244-a781-f5cc1ecb0fa3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:58.406946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7196a58-dd67-4203-a304-00e349419c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:58.408016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7196a58-dd67-4203-a304-00e349419c82 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:58.408491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7196a58-dd67-4203-a304-00e349419c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:58.411179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7196a58-dd67-4203-a304-00e349419c82 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:58.415986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7196a58-dd67-4203-a304-00e349419c82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:22:58.416676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7196a58-dd67-4203-a304-00e349419c82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:58.419563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7196a58-dd67-4203-a304-00e349419c82 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:58.490485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381e2ab-bbbc-424f-bd10-2d681c71e9bc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:58.501227 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3582/7166] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:22:58.520115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381e2ab-bbbc-424f-bd10-2d681c71e9bc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:58.528323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2fd4f-b25b-4b20-a25a-4bf7145f03c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:58.529525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2fd4f-b25b-4b20-a25a-4bf7145f03c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:58.530484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2fd4f-b25b-4b20-a25a-4bf7145f03c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:58.531046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2fd4f-b25b-4b20-a25a-4bf7145f03c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:58.532224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2fd4f-b25b-4b20-a25a-4bf7145f03c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:58.541434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2fd4f-b25b-4b20-a25a-4bf7145f03c9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:58.606067 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3585/7167] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:22:58 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:58.613117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7196a58-dd67-4203-a304-00e349419c82 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:58.635382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:58.661811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7196a58-dd67-4203-a304-00e349419c82 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:58.737305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe1853-fccd-47cc-b973-97ca024e3ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:58.737997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe1853-fccd-47cc-b973-97ca024e3ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:58.738288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe1853-fccd-47cc-b973-97ca024e3ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:58.738675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe1853-fccd-47cc-b973-97ca024e3ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:58.739861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe1853-fccd-47cc-b973-97ca024e3ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:58.741986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe1853-fccd-47cc-b973-97ca024e3ed9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:58.779069 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3583/7168] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:22:58 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:22:58.781229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2fd4f-b25b-4b20-a25a-4bf7145f03c9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:58.800476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2fd4f-b25b-4b20-a25a-4bf7145f03c9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:58.808523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8b662-faf9-41b0-8ff4-ea7f455b0399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:58.809303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8b662-faf9-41b0-8ff4-ea7f455b0399 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:58.809658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8b662-faf9-41b0-8ff4-ea7f455b0399 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:58.810002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8b662-faf9-41b0-8ff4-ea7f455b0399 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:58.810729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8b662-faf9-41b0-8ff4-ea7f455b0399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:58.813333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8b662-faf9-41b0-8ff4-ea7f455b0399 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:58.827551 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3586/7169] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:58.831358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe1853-fccd-47cc-b973-97ca024e3ed9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:58.844000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe1853-fccd-47cc-b973-97ca024e3ed9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:58.849851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aab50-76cf-4982-836a-cc6193c13dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:58.850235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aab50-76cf-4982-836a-cc6193c13dbb admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:58.850522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aab50-76cf-4982-836a-cc6193c13dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:58.850830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aab50-76cf-4982-836a-cc6193c13dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:58.851830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aab50-76cf-4982-836a-cc6193c13dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:58.854523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aab50-76cf-4982-836a-cc6193c13dbb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:58.871706 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3584/7170] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:22:58.872650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8b662-faf9-41b0-8ff4-ea7f455b0399 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:58.887773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8b662-faf9-41b0-8ff4-ea7f455b0399 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:58.895301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b185d01-e59e-48e3-ad01-303659f9b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:58.896111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b185d01-e59e-48e3-ad01-303659f9b9fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:58.896400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b185d01-e59e-48e3-ad01-303659f9b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:58.896729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b185d01-e59e-48e3-ad01-303659f9b9fa admin admin] PATH_INFO: `/v3/projects/00c0f95cf441423c9e85121c00fea8c8/users/a5d58a21e2424844b32d95dc431b86b3/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:58.916867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b185d01-e59e-48e3-ad01-303659f9b9fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c0f95cf441423c9e85121c00fea8c8, user_id=a5d58a21e2424844b32d95dc431b86b3, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:58.919998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b185d01-e59e-48e3-ad01-303659f9b9fa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:58.943042 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3587/7171] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:22:58 2022] PUT /identity/v3/projects/00c0f95cf441423c9e85121c00fea8c8/users/a5d58a21e2424844b32d95dc431b86b3/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:22:58.950570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523d28-0c05-4dfc-8792-caf0063a9d39 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:58.951709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523d28-0c05-4dfc-8792-caf0063a9d39 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:58.952029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523d28-0c05-4dfc-8792-caf0063a9d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:59.012627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ed523d28-0c05-4dfc-8792-caf0063a9d39 None None] MFA Rules not processed for user `a5d58a21e2424844b32d95dc431b86b3`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:22:59.013872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ed523d28-0c05-4dfc-8792-caf0063a9d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:59.121305 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3585/7172] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:22:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:22:59.130922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b185d01-e59e-48e3-ad01-303659f9b9fa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:22:59.134691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5b185d01-e59e-48e3-ad01-303659f9b9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:22:59.186680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:22:59.237819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b185d01-e59e-48e3-ad01-303659f9b9fa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:22:59.243090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd00705-7e4c-4cc8-9c93-9a49bd57da1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:22:59.243940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd00705-7e4c-4cc8-9c93-9a49bd57da1b service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:22:59.244383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd00705-7e4c-4cc8-9c93-9a49bd57da1b service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:22:59.244801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd00705-7e4c-4cc8-9c93-9a49bd57da1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:22:59.256648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd00705-7e4c-4cc8-9c93-9a49bd57da1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:22:59.262181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd00705-7e4c-4cc8-9c93-9a49bd57da1b service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:22:59.284673 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3588/7173] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:22:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:23:00.280737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523d28-0c05-4dfc-8792-caf0063a9d39 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:00.299403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523d28-0c05-4dfc-8792-caf0063a9d39 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:00.312960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e32e9-b15d-4f8c-9d28-a4e97dc6f3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:00.313344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e32e9-b15d-4f8c-9d28-a4e97dc6f3fd service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:00.313630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e32e9-b15d-4f8c-9d28-a4e97dc6f3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:00.314074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e32e9-b15d-4f8c-9d28-a4e97dc6f3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:00.316258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-144e32e9-b15d-4f8c-9d28-a4e97dc6f3fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:00.440252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e32e9-b15d-4f8c-9d28-a4e97dc6f3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:00.443494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e32e9-b15d-4f8c-9d28-a4e97dc6f3fd service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:00.523458 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3586/7174] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:23:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:23:07.189936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f502bb-0322-435c-aa17-95a3d672f117 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:07.190538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f502bb-0322-435c-aa17-95a3d672f117 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:07.190538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f502bb-0322-435c-aa17-95a3d672f117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:07.259074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c3f502bb-0322-435c-aa17-95a3d672f117 None None] MFA Rules not processed for user `d79608fb44284568ae21a2a37e3fbe51`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:23:07.260581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c3f502bb-0322-435c-aa17-95a3d672f117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:07.485831 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3589/7175] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:23:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:23:09.185516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a3694-7fe7-40ed-86b5-3292f6421107 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:09.186152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a3694-7fe7-40ed-86b5-3292f6421107 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:09.186152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a3694-7fe7-40ed-86b5-3292f6421107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:09.213523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:09.228083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b97a3694-7fe7-40ed-86b5-3292f6421107 None None] MFA Rules not processed for user `f966cae595b14bdf921bd3e72f652611`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:23:09.229355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b97a3694-7fe7-40ed-86b5-3292f6421107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:09.513295 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3587/7176] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:23:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:23:16.638346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f502bb-0322-435c-aa17-95a3d672f117 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:16.639784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c3f502bb-0322-435c-aa17-95a3d672f117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:16.916942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f502bb-0322-435c-aa17-95a3d672f117 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:16.923702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe2fe5-bae2-4856-9c76-ecebfd2c957f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:16.924337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe2fe5-bae2-4856-9c76-ecebfd2c957f service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:16.924711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe2fe5-bae2-4856-9c76-ecebfd2c957f service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:16.924994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe2fe5-bae2-4856-9c76-ecebfd2c957f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:16.928100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cebe2fe5-bae2-4856-9c76-ecebfd2c957f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:16.949015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe2fe5-bae2-4856-9c76-ecebfd2c957f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:16.951191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe2fe5-bae2-4856-9c76-ecebfd2c957f service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:16.979539 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3590/7177] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:23:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:23:19.481826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=22 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:23.229917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a3694-7fe7-40ed-86b5-3292f6421107 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:23.250905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a3694-7fe7-40ed-86b5-3292f6421107 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:23.259100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0eafbe-e611-4b73-9231-e8dc2ded6fac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:23.260730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eafbe-e611-4b73-9231-e8dc2ded6fac service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:23.261226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eafbe-e611-4b73-9231-e8dc2ded6fac service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:23.261807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eafbe-e611-4b73-9231-e8dc2ded6fac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:23.264249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ff0eafbe-e611-4b73-9231-e8dc2ded6fac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:23.288458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0eafbe-e611-4b73-9231-e8dc2ded6fac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:23.292092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0eafbe-e611-4b73-9231-e8dc2ded6fac service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:23.333724 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3588/7178] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:23:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:23:24.197678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe2fe5-bae2-4856-9c76-ecebfd2c957f service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:24.201833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cebe2fe5-bae2-4856-9c76-ecebfd2c957f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:24.314959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:24.322364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe2fe5-bae2-4856-9c76-ecebfd2c957f service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:24.338854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:24.339803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:24.340402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:24.340402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] PATH_INFO: `/v3/users/922c0909a79d4cda831e5d0eeced3655` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:24.341901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=922c0909a79d4cda831e5d0eeced3655)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:24.344319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:24.448827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922c0909a79d4cda831e5d0eeced3655'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:24.472824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922c0909a79d4cda831e5d0eeced3655'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:24.475323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922c0909a79d4cda831e5d0eeced3655'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:24.506111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922c0909a79d4cda831e5d0eeced3655'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:24.509367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922c0909a79d4cda831e5d0eeced3655'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:24.547647 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3591/7179] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:23:24 2022] DELETE /identity/v3/users/922c0909a79d4cda831e5d0eeced3655 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:24.549020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5074e-46eb-49af-bbe7-970ac07a1d90 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:24.549526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5074e-46eb-49af-bbe7-970ac07a1d90 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:24.549611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5074e-46eb-49af-bbe7-970ac07a1d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:24.591677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-12e5074e-46eb-49af-bbe7-970ac07a1d90 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:23:24.593185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-12e5074e-46eb-49af-bbe7-970ac07a1d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:24.749007 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3589/7180] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:23:24.775176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:24.776926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:24.898811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131a7cc-f5cf-4dfd-b60d-436c88f06d28 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:24.903817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b23a5-d666-41d3-a436-980932f8538a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:24.904461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b23a5-d666-41d3-a436-980932f8538a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:24.904814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b23a5-d666-41d3-a436-980932f8538a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:24.905031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b23a5-d666-41d3-a436-980932f8538a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:24.927415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b23a5-d666-41d3-a436-980932f8538a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:24.930995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b23a5-d666-41d3-a436-980932f8538a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:24.956300 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3592/7181] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:23:25.788356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5074e-46eb-49af-bbe7-970ac07a1d90 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:25.791183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-12e5074e-46eb-49af-bbe7-970ac07a1d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:25.813096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5074e-46eb-49af-bbe7-970ac07a1d90 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:25.832687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:25.834617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:25.835111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:25.835542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] PATH_INFO: `/v3/projects/8ab9db98dac241fa9de13db233cf9a3b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:25.837823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab9db98dac241fa9de13db233cf9a3b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:25.839953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:25.938267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab9db98dac241fa9de13db233cf9a3b', 'request_id': 'req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:25.952437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab9db98dac241fa9de13db233cf9a3b', 'request_id': 'req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:25.962669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab9db98dac241fa9de13db233cf9a3b', 'request_id': 'req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:26.025533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] The token cache is being invalidate because project 8ab9db98dac241fa9de13db233cf9a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:23:26.025721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:26.027270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:26.030243 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3590/7182] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:23:25 2022] DELETE /identity/v3/projects/8ab9db98dac241fa9de13db233cf9a3b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:26.034529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b23a5-d666-41d3-a436-980932f8538a service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:26.053191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b23a5-d666-41d3-a436-980932f8538a service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:26.174102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d16d1-4895-4aaf-ac57-169f541ff977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:26.175260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d16d1-4895-4aaf-ac57-169f541ff977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:26.175805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d16d1-4895-4aaf-ac57-169f541ff977 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:26.176302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d16d1-4895-4aaf-ac57-169f541ff977 admin admin] PATH_INFO: `/v3/users/694f748c0338405a996026cb1085fbc7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:26.178422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d16d1-4895-4aaf-ac57-169f541ff977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=694f748c0338405a996026cb1085fbc7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:26.184094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d16d1-4895-4aaf-ac57-169f541ff977 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:26.237006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:26.322155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-767d16d1-4895-4aaf-ac57-169f541ff977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '694f748c0338405a996026cb1085fbc7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:26.337528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-767d16d1-4895-4aaf-ac57-169f541ff977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '694f748c0338405a996026cb1085fbc7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:26.339259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-767d16d1-4895-4aaf-ac57-169f541ff977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '694f748c0338405a996026cb1085fbc7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:26.357907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-767d16d1-4895-4aaf-ac57-169f541ff977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '694f748c0338405a996026cb1085fbc7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:26.359460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-767d16d1-4895-4aaf-ac57-169f541ff977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '694f748c0338405a996026cb1085fbc7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:26.387123 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3593/7183] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:23:26 2022] DELETE /identity/v3/users/694f748c0338405a996026cb1085fbc7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:27.040961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:27.042605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:27.063842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b3949-4ec8-44fd-a5f5-dd36083e7921 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:27.212601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a10aa-ae17-48b8-a731-29071a697168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:27.215499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a10aa-ae17-48b8-a731-29071a697168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:27.215792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a10aa-ae17-48b8-a731-29071a697168 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:27.216080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a10aa-ae17-48b8-a731-29071a697168 admin admin] PATH_INFO: `/v3/projects/16871818ce4848f99157f4640df74d9c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:27.222669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a10aa-ae17-48b8-a731-29071a697168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16871818ce4848f99157f4640df74d9c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:27.225683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a10aa-ae17-48b8-a731-29071a697168 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:27.268250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:27.370103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a05a10aa-ae17-48b8-a731-29071a697168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16871818ce4848f99157f4640df74d9c', 'request_id': 'req-a05a10aa-ae17-48b8-a731-29071a697168'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:27.387366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a05a10aa-ae17-48b8-a731-29071a697168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16871818ce4848f99157f4640df74d9c', 'request_id': 'req-a05a10aa-ae17-48b8-a731-29071a697168'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:27.398116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a05a10aa-ae17-48b8-a731-29071a697168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16871818ce4848f99157f4640df74d9c', 'request_id': 'req-a05a10aa-ae17-48b8-a731-29071a697168'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:27.437899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a05a10aa-ae17-48b8-a731-29071a697168 admin admin] The token cache is being invalidate because project 16871818ce4848f99157f4640df74d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:23:27.438479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a05a10aa-ae17-48b8-a731-29071a697168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:27.443148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a05a10aa-ae17-48b8-a731-29071a697168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:27.445118 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3591/7184] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:23:27 2022] DELETE /identity/v3/projects/16871818ce4848f99157f4640df74d9c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:27.451995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9f982-b036-4895-b91d-63c551526af2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:27.452401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9f982-b036-4895-b91d-63c551526af2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:27.452549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9f982-b036-4895-b91d-63c551526af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:27.493588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-23e9f982-b036-4895-b91d-63c551526af2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:23:27.494861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-23e9f982-b036-4895-b91d-63c551526af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:27.597677 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3594/7185] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:23:27.697396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c74e0f-7b36-4a3d-a584-a5409a78430f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:27.699314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c74e0f-7b36-4a3d-a584-a5409a78430f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:27.699607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c74e0f-7b36-4a3d-a584-a5409a78430f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:27.784292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-48c74e0f-7b36-4a3d-a584-a5409a78430f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:23:27.785827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-48c74e0f-7b36-4a3d-a584-a5409a78430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:27.796405 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3592/7186] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:23:27.800881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9f982-b036-4895-b91d-63c551526af2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:27.812936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9f982-b036-4895-b91d-63c551526af2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:27.830279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0601b98-3837-4596-b31b-d88312ec82e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:27.830963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0601b98-3837-4596-b31b-d88312ec82e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:27.831231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0601b98-3837-4596-b31b-d88312ec82e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:27.831501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0601b98-3837-4596-b31b-d88312ec82e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:27.832166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0601b98-3837-4596-b31b-d88312ec82e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:23:27.832473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0601b98-3837-4596-b31b-d88312ec82e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:27.835319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0601b98-3837-4596-b31b-d88312ec82e3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:27.869708 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3595/7187] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:23:27.874965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c74e0f-7b36-4a3d-a584-a5409a78430f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:27.890192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c74e0f-7b36-4a3d-a584-a5409a78430f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:27.903184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05437752-c459-4b60-ba97-1a28a85f3c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:27.904198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05437752-c459-4b60-ba97-1a28a85f3c7a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:27.904631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05437752-c459-4b60-ba97-1a28a85f3c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:27.907224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05437752-c459-4b60-ba97-1a28a85f3c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:27.908162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05437752-c459-4b60-ba97-1a28a85f3c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:27.913294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05437752-c459-4b60-ba97-1a28a85f3c7a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:28.004185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0601b98-3837-4596-b31b-d88312ec82e3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:28.005779 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3593/7188] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:23:27 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:23:28.016180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0601b98-3837-4596-b31b-d88312ec82e3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:28.172592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b9ffb-1cb8-49bc-bd79-26854ea3830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:28.173249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b9ffb-1cb8-49bc-bd79-26854ea3830c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:28.173519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b9ffb-1cb8-49bc-bd79-26854ea3830c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:28.173798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b9ffb-1cb8-49bc-bd79-26854ea3830c admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:28.174450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b9ffb-1cb8-49bc-bd79-26854ea3830c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:28.176423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b9ffb-1cb8-49bc-bd79-26854ea3830c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:28.220673 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3596/7189] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:23:28 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:23:28.224696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05437752-c459-4b60-ba97-1a28a85f3c7a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:28.238414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05437752-c459-4b60-ba97-1a28a85f3c7a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:28.245398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0587824-120b-47be-be99-22eb2ef45860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:28.246264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0587824-120b-47be-be99-22eb2ef45860 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:28.246809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0587824-120b-47be-be99-22eb2ef45860 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:28.247255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0587824-120b-47be-be99-22eb2ef45860 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:28.248193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0587824-120b-47be-be99-22eb2ef45860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:28.250362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0587824-120b-47be-be99-22eb2ef45860 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:28.267592 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3594/7190] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:23:28.268903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b9ffb-1cb8-49bc-bd79-26854ea3830c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:28.283301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b9ffb-1cb8-49bc-bd79-26854ea3830c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:28.303115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fb848-0f6b-4a7f-a9bc-c9fadaf9d143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:28.303755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fb848-0f6b-4a7f-a9bc-c9fadaf9d143 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:28.304040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fb848-0f6b-4a7f-a9bc-c9fadaf9d143 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:28.307034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fb848-0f6b-4a7f-a9bc-c9fadaf9d143 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:28.307792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fb848-0f6b-4a7f-a9bc-c9fadaf9d143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:28.309441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fb848-0f6b-4a7f-a9bc-c9fadaf9d143 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:28.327494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0587824-120b-47be-be99-22eb2ef45860 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:28.327928 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3597/7191] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:23:28.353418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0587824-120b-47be-be99-22eb2ef45860 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:28.359108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6f899-6c0f-40bd-a1a1-0bdbbefa64a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:28.360109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6f899-6c0f-40bd-a1a1-0bdbbefa64a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:28.360398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6f899-6c0f-40bd-a1a1-0bdbbefa64a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:28.360822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6f899-6c0f-40bd-a1a1-0bdbbefa64a5 admin admin] PATH_INFO: `/v3/projects/de278e5df9844fa68c6e5bd3e6e7abb4/users/c0d75a5aaf5248728b42c892e8e53b34/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:28.425986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6f899-6c0f-40bd-a1a1-0bdbbefa64a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de278e5df9844fa68c6e5bd3e6e7abb4, user_id=c0d75a5aaf5248728b42c892e8e53b34, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:28.428841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6f899-6c0f-40bd-a1a1-0bdbbefa64a5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:28.474796 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3595/7192] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:23:28 2022] PUT /identity/v3/projects/de278e5df9844fa68c6e5bd3e6e7abb4/users/c0d75a5aaf5248728b42c892e8e53b34/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:28.486270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ab184-588d-4bd6-83ad-2603ca193fc5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:28.487167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ab184-588d-4bd6-83ad-2603ca193fc5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:28.487600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ab184-588d-4bd6-83ad-2603ca193fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:28.499647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:28.532365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e65ab184-588d-4bd6-83ad-2603ca193fc5 None None] MFA Rules not processed for user `c0d75a5aaf5248728b42c892e8e53b34`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:23:28.541190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e65ab184-588d-4bd6-83ad-2603ca193fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:28.661191 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3598/7193] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:23:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:23:28.667157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6f899-6c0f-40bd-a1a1-0bdbbefa64a5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:28.854502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6f899-6c0f-40bd-a1a1-0bdbbefa64a5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:28.859601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993d514-7d9d-4b2d-934a-848c9406dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:28.860222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993d514-7d9d-4b2d-934a-848c9406dd49 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:28.860511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993d514-7d9d-4b2d-934a-848c9406dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:28.860794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993d514-7d9d-4b2d-934a-848c9406dd49 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:28.861437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993d514-7d9d-4b2d-934a-848c9406dd49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:28.863461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993d514-7d9d-4b2d-934a-848c9406dd49 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:28.902794 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3596/7194] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:23:28 2022] POST /identity/v3/projects => generated 365 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:23:28.907348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ab184-588d-4bd6-83ad-2603ca193fc5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:28.927087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ab184-588d-4bd6-83ad-2603ca193fc5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:29.014508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a121f0-1022-4471-ae97-6e453952ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:29.015254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a121f0-1022-4471-ae97-6e453952ca1b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:29.015788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a121f0-1022-4471-ae97-6e453952ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:29.016060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a121f0-1022-4471-ae97-6e453952ca1b admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:29.016693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a121f0-1022-4471-ae97-6e453952ca1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:29.018694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a121f0-1022-4471-ae97-6e453952ca1b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:29.046192 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3599/7195] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:23:28 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:23:29.050049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993d514-7d9d-4b2d-934a-848c9406dd49 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:29.063435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993d514-7d9d-4b2d-934a-848c9406dd49 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:29.088359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb3e6e-ebbe-4945-9243-730c6920a227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:29.088984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb3e6e-ebbe-4945-9243-730c6920a227 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:29.089269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb3e6e-ebbe-4945-9243-730c6920a227 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:29.089545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb3e6e-ebbe-4945-9243-730c6920a227 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:29.090197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb3e6e-ebbe-4945-9243-730c6920a227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:29.091853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb3e6e-ebbe-4945-9243-730c6920a227 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:29.121135 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3597/7196] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:23:29.122342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a121f0-1022-4471-ae97-6e453952ca1b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:29.141419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a121f0-1022-4471-ae97-6e453952ca1b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:29.147310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad286454-a9be-4271-b82f-c9a6cec90346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:29.148769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286454-a9be-4271-b82f-c9a6cec90346 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:29.149311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286454-a9be-4271-b82f-c9a6cec90346 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:29.149692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad286454-a9be-4271-b82f-c9a6cec90346 admin admin] PATH_INFO: `/v3/projects/f1b49d4360cc445d96dae7adfec4db52/users/1c1fb69ec3dd4745a88af130b308f324/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:29.171684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad286454-a9be-4271-b82f-c9a6cec90346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b49d4360cc445d96dae7adfec4db52, user_id=1c1fb69ec3dd4745a88af130b308f324, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:29.174582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad286454-a9be-4271-b82f-c9a6cec90346 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:29.218796 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3600/7197] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:23:29 2022] PUT /identity/v3/projects/f1b49d4360cc445d96dae7adfec4db52/users/1c1fb69ec3dd4745a88af130b308f324/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:29.221704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb3e6e-ebbe-4945-9243-730c6920a227 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:29.233761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb3e6e-ebbe-4945-9243-730c6920a227 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:29.244156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:29.318328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4f65e-667a-432a-821e-8abfcab9a777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:29.318986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4f65e-667a-432a-821e-8abfcab9a777 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:29.320390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4f65e-667a-432a-821e-8abfcab9a777 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:29.320676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4f65e-667a-432a-821e-8abfcab9a777 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:29.322264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4f65e-667a-432a-821e-8abfcab9a777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:29.323921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4f65e-667a-432a-821e-8abfcab9a777 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:29.338038 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3598/7198] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:23:29.342327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad286454-a9be-4271-b82f-c9a6cec90346 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:29.353987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad286454-a9be-4271-b82f-c9a6cec90346 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:29.359827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b4c9-d93b-4365-98a7-adf20715d041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:29.360661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b4c9-d93b-4365-98a7-adf20715d041 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:29.361049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b4c9-d93b-4365-98a7-adf20715d041 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:29.361452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b4c9-d93b-4365-98a7-adf20715d041 admin admin] PATH_INFO: `/v3/projects/f1b49d4360cc445d96dae7adfec4db52/users/1c1fb69ec3dd4745a88af130b308f324/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:29.364405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53b4c9-d93b-4365-98a7-adf20715d041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b49d4360cc445d96dae7adfec4db52, user_id=1c1fb69ec3dd4745a88af130b308f324, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:29.368749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53b4c9-d93b-4365-98a7-adf20715d041 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:29.390679 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3601/7199] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:23:29 2022] PUT /identity/v3/projects/f1b49d4360cc445d96dae7adfec4db52/users/1c1fb69ec3dd4745a88af130b308f324/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:23:29.392859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc676d-d733-42b3-afd8-e91cec8e25d6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:29.393136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc676d-d733-42b3-afd8-e91cec8e25d6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:29.393682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc676d-d733-42b3-afd8-e91cec8e25d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:29.438840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-90dc676d-d733-42b3-afd8-e91cec8e25d6 None None] MFA Rules not processed for user `1c1fb69ec3dd4745a88af130b308f324`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:23:29.440317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-90dc676d-d733-42b3-afd8-e91cec8e25d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:29.595153 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3599/7200] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:23:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:23:29.611681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b4c9-d93b-4365-98a7-adf20715d041 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:29.613517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ff53b4c9-d93b-4365-98a7-adf20715d041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:29.739224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:29.761846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b4c9-d93b-4365-98a7-adf20715d041 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:29.766770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b9126-6b49-4833-87df-cac5d07c3c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:29.767411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b9126-6b49-4833-87df-cac5d07c3c35 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:29.767696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b9126-6b49-4833-87df-cac5d07c3c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:29.768188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b9126-6b49-4833-87df-cac5d07c3c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:29.788096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b9126-6b49-4833-87df-cac5d07c3c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:29.790825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b9126-6b49-4833-87df-cac5d07c3c35 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:29.814509 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3602/7201] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:23:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:23:34.663943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc676d-d733-42b3-afd8-e91cec8e25d6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:34.907313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc676d-d733-42b3-afd8-e91cec8e25d6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:34.919073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:34.920128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:34.920598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:34.922847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] PATH_INFO: `/v3/users/c0d75a5aaf5248728b42c892e8e53b34` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:34.925535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d75a5aaf5248728b42c892e8e53b34)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:34.931738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:35.042068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:35.088327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d75a5aaf5248728b42c892e8e53b34'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:35.120111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d75a5aaf5248728b42c892e8e53b34'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:35.121330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d75a5aaf5248728b42c892e8e53b34'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:35.147974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d75a5aaf5248728b42c892e8e53b34'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:35.149992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d75a5aaf5248728b42c892e8e53b34'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:35.212498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84458b03-b544-45d6-b713-03c02e95d813 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:35.215514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84458b03-b544-45d6-b713-03c02e95d813 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:35.216189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84458b03-b544-45d6-b713-03c02e95d813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:35.217142 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3600/7202] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:23:34 2022] DELETE /identity/v3/users/c0d75a5aaf5248728b42c892e8e53b34 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:35.265984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-84458b03-b544-45d6-b713-03c02e95d813 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:23:35.269226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-84458b03-b544-45d6-b713-03c02e95d813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:35.411920 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3603/7203] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:23:35.426353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:35.428593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:35.640158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33922e9f-d1a7-407f-86a5-2757f1854d72 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:35.658867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e3109-126a-4eec-b583-326f476efb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:35.661032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e3109-126a-4eec-b583-326f476efb3d service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:35.663568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e3109-126a-4eec-b583-326f476efb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:35.664084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e3109-126a-4eec-b583-326f476efb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:35.694353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e3109-126a-4eec-b583-326f476efb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:35.696200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e3109-126a-4eec-b583-326f476efb3d service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:35.718184 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3601/7204] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:23:36.974932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84458b03-b544-45d6-b713-03c02e95d813 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:36.976596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-84458b03-b544-45d6-b713-03c02e95d813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:37.001722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84458b03-b544-45d6-b713-03c02e95d813 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:37.015841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:37.021832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:37.022129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:37.023648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] PATH_INFO: `/v3/projects/de278e5df9844fa68c6e5bd3e6e7abb4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:37.031065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de278e5df9844fa68c6e5bd3e6e7abb4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:37.034809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:37.243592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de278e5df9844fa68c6e5bd3e6e7abb4', 'request_id': 'req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:37.287535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de278e5df9844fa68c6e5bd3e6e7abb4', 'request_id': 'req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:37.298431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de278e5df9844fa68c6e5bd3e6e7abb4', 'request_id': 'req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:37.318273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] The token cache is being invalidate because project de278e5df9844fa68c6e5bd3e6e7abb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:23:37.318633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:37.320737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:37.326959 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3604/7205] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:23:36 2022] DELETE /identity/v3/projects/de278e5df9844fa68c6e5bd3e6e7abb4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:37.331320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e3109-126a-4eec-b583-326f476efb3d service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:37.351675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e3109-126a-4eec-b583-326f476efb3d service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:37.518853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:37.519823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:37.519823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:37.520648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] PATH_INFO: `/v3/users/1c1fb69ec3dd4745a88af130b308f324` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:37.524403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1fb69ec3dd4745a88af130b308f324)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:37.526608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:37.630374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:37.633298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:37.650793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1fb69ec3dd4745a88af130b308f324'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:37.671800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1fb69ec3dd4745a88af130b308f324'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:37.677801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1fb69ec3dd4745a88af130b308f324'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:37.683404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:37.713957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1fb69ec3dd4745a88af130b308f324'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:37.715861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1fb69ec3dd4745a88af130b308f324'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:37.823463 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3602/7206] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:23:37 2022] DELETE /identity/v3/users/1c1fb69ec3dd4745a88af130b308f324 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:37.840612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19054b5-f40e-4ab6-96fa-0f485d3e2c74 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:37.877157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:38.076116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72dd2ad-860e-4d6e-887c-4bce93f1951f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:38.076870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dd2ad-860e-4d6e-887c-4bce93f1951f service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:38.077106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dd2ad-860e-4d6e-887c-4bce93f1951f service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:38.077365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dd2ad-860e-4d6e-887c-4bce93f1951f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:38.079423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f72dd2ad-860e-4d6e-887c-4bce93f1951f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:38.099288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72dd2ad-860e-4d6e-887c-4bce93f1951f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:38.102032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72dd2ad-860e-4d6e-887c-4bce93f1951f service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:38.138276 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3605/7207] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:23:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:23:39.034549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:39.036805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:39.270329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562f5c8-6a13-4f22-b5d5-ec1ea0f1cd6b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:39.292768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe51e5-38bb-4361-8182-e9c575ac677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:39.293710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe51e5-38bb-4361-8182-e9c575ac677e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:39.317532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe51e5-38bb-4361-8182-e9c575ac677e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:39.318181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe51e5-38bb-4361-8182-e9c575ac677e admin admin] PATH_INFO: `/v3/projects/f1b49d4360cc445d96dae7adfec4db52` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:39.320476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe51e5-38bb-4361-8182-e9c575ac677e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b49d4360cc445d96dae7adfec4db52)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:39.329870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe51e5-38bb-4361-8182-e9c575ac677e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:39.472554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-68fe51e5-38bb-4361-8182-e9c575ac677e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b49d4360cc445d96dae7adfec4db52', 'request_id': 'req-68fe51e5-38bb-4361-8182-e9c575ac677e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:39.481184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-68fe51e5-38bb-4361-8182-e9c575ac677e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b49d4360cc445d96dae7adfec4db52', 'request_id': 'req-68fe51e5-38bb-4361-8182-e9c575ac677e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:39.488612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-68fe51e5-38bb-4361-8182-e9c575ac677e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b49d4360cc445d96dae7adfec4db52', 'request_id': 'req-68fe51e5-38bb-4361-8182-e9c575ac677e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:39.514452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-68fe51e5-38bb-4361-8182-e9c575ac677e admin admin] The token cache is being invalidate because project f1b49d4360cc445d96dae7adfec4db52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:23:39.514929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-68fe51e5-38bb-4361-8182-e9c575ac677e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:39.516086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-68fe51e5-38bb-4361-8182-e9c575ac677e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:39.524472 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3603/7208] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:23:39 2022] DELETE /identity/v3/projects/f1b49d4360cc445d96dae7adfec4db52 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:39.526576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696b99d-f1bb-48b7-8dd6-e73870d7e9b8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:39.527042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696b99d-f1bb-48b7-8dd6-e73870d7e9b8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:39.527227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696b99d-f1bb-48b7-8dd6-e73870d7e9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:39.562542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9696b99d-f1bb-48b7-8dd6-e73870d7e9b8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:23:39.564188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9696b99d-f1bb-48b7-8dd6-e73870d7e9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:39.787567 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3606/7209] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:23:39.796025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d0676-d799-406f-bf11-c36a8bd74360 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:39.796318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d0676-d799-406f-bf11-c36a8bd74360 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:39.796617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d0676-d799-406f-bf11-c36a8bd74360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:39.868320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a28d0676-d799-406f-bf11-c36a8bd74360 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:23:39.874521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a28d0676-d799-406f-bf11-c36a8bd74360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:39.902854 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3604/7210] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:23:39.903699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696b99d-f1bb-48b7-8dd6-e73870d7e9b8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:39.915964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696b99d-f1bb-48b7-8dd6-e73870d7e9b8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:39.939759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4755cba-d766-473c-a169-f3d415c68e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:39.940784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4755cba-d766-473c-a169-f3d415c68e4c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:39.941193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4755cba-d766-473c-a169-f3d415c68e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:39.941567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4755cba-d766-473c-a169-f3d415c68e4c admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:39.946668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4755cba-d766-473c-a169-f3d415c68e4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:23:39.947203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4755cba-d766-473c-a169-f3d415c68e4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:39.948949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4755cba-d766-473c-a169-f3d415c68e4c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:39.994806 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3607/7211] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:23:39.997022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d0676-d799-406f-bf11-c36a8bd74360 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:40.011414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d0676-d799-406f-bf11-c36a8bd74360 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:40.018006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341456c-e274-4406-bbcb-a0037fd70b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:40.018806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341456c-e274-4406-bbcb-a0037fd70b93 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:40.020152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341456c-e274-4406-bbcb-a0037fd70b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:40.021956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341456c-e274-4406-bbcb-a0037fd70b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:40.021956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341456c-e274-4406-bbcb-a0037fd70b93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:40.024958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341456c-e274-4406-bbcb-a0037fd70b93 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:40.145088 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3605/7212] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:23:39 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:23:40.145671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4755cba-d766-473c-a169-f3d415c68e4c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:40.172834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4755cba-d766-473c-a169-f3d415c68e4c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:40.298057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456610dc-e347-40a9-bc04-ae04f98cddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:40.298785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456610dc-e347-40a9-bc04-ae04f98cddc2 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:40.299079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456610dc-e347-40a9-bc04-ae04f98cddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:40.299562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456610dc-e347-40a9-bc04-ae04f98cddc2 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:40.300649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456610dc-e347-40a9-bc04-ae04f98cddc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:40.302927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456610dc-e347-40a9-bc04-ae04f98cddc2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:40.379454 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3608/7213] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:23:40 2022] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:23:40.380680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341456c-e274-4406-bbcb-a0037fd70b93 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:40.396698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341456c-e274-4406-bbcb-a0037fd70b93 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:40.406472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44150470-8f98-480e-a6d9-36d54864484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:40.407416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44150470-8f98-480e-a6d9-36d54864484b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:40.408494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44150470-8f98-480e-a6d9-36d54864484b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:40.409123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44150470-8f98-480e-a6d9-36d54864484b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:40.409976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44150470-8f98-480e-a6d9-36d54864484b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:40.412240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44150470-8f98-480e-a6d9-36d54864484b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:40.450296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456610dc-e347-40a9-bc04-ae04f98cddc2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:40.461330 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3606/7214] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:23:40.462509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456610dc-e347-40a9-bc04-ae04f98cddc2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:40.468379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72599ea6-ece8-4df8-8c81-e81b62fb828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:40.469151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72599ea6-ece8-4df8-8c81-e81b62fb828b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:40.469515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72599ea6-ece8-4df8-8c81-e81b62fb828b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:40.470460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72599ea6-ece8-4df8-8c81-e81b62fb828b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:40.471399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72599ea6-ece8-4df8-8c81-e81b62fb828b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:40.473210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72599ea6-ece8-4df8-8c81-e81b62fb828b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:40.490563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44150470-8f98-480e-a6d9-36d54864484b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:40.502473 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3609/7215] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:23:40.504256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44150470-8f98-480e-a6d9-36d54864484b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:40.511185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122541df-2447-4ba3-8dc2-18e6e5a89e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:40.511955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122541df-2447-4ba3-8dc2-18e6e5a89e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:40.512306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122541df-2447-4ba3-8dc2-18e6e5a89e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:40.512658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122541df-2447-4ba3-8dc2-18e6e5a89e45 admin admin] PATH_INFO: `/v3/projects/168c302d24a64fb6ae514a435f34825c/users/a2db3c617541488ba2b83c3e37433573/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:40.533881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122541df-2447-4ba3-8dc2-18e6e5a89e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=168c302d24a64fb6ae514a435f34825c, user_id=a2db3c617541488ba2b83c3e37433573, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:40.537925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122541df-2447-4ba3-8dc2-18e6e5a89e45 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:40.549745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:40.568832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a016a39-c76c-4a88-b025-dcaeb1b717b0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:40.569415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a016a39-c76c-4a88-b025-dcaeb1b717b0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:40.569415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a016a39-c76c-4a88-b025-dcaeb1b717b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:40.573929 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3607/7216] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:23:40 2022] PUT /identity/v3/projects/168c302d24a64fb6ae514a435f34825c/users/a2db3c617541488ba2b83c3e37433573/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:40.584330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:40.617100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5a016a39-c76c-4a88-b025-dcaeb1b717b0 None None] MFA Rules not processed for user `a2db3c617541488ba2b83c3e37433573`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:23:40.618346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5a016a39-c76c-4a88-b025-dcaeb1b717b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:40.710099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122541df-2447-4ba3-8dc2-18e6e5a89e45 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:40.714153 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3610/7217] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:23:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:23:40.797263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122541df-2447-4ba3-8dc2-18e6e5a89e45 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:40.804768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed8c2c-6512-4c3c-a833-61b093318497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:40.805707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed8c2c-6512-4c3c-a833-61b093318497 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:40.806425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed8c2c-6512-4c3c-a833-61b093318497 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:40.807660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed8c2c-6512-4c3c-a833-61b093318497 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:40.808473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed8c2c-6512-4c3c-a833-61b093318497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:40.822949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed8c2c-6512-4c3c-a833-61b093318497 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:40.859367 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3608/7218] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:23:40 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:23:40.863440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a016a39-c76c-4a88-b025-dcaeb1b717b0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:40.878428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a016a39-c76c-4a88-b025-dcaeb1b717b0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:40.999092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb0746-b4d3-46da-adca-d06b49d86bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:41.001378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0746-b4d3-46da-adca-d06b49d86bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:41.001786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0746-b4d3-46da-adca-d06b49d86bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:41.002190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0746-b4d3-46da-adca-d06b49d86bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:41.018160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb0746-b4d3-46da-adca-d06b49d86bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:41.024240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb0746-b4d3-46da-adca-d06b49d86bb3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:41.064930 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3611/7219] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:23:40 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:23:41.068758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed8c2c-6512-4c3c-a833-61b093318497 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:41.080876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed8c2c-6512-4c3c-a833-61b093318497 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:41.086863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff30aaf-ec42-4e16-ab98-2e727bfcd39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:41.087513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff30aaf-ec42-4e16-ab98-2e727bfcd39c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:41.087805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff30aaf-ec42-4e16-ab98-2e727bfcd39c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:41.088090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff30aaf-ec42-4e16-ab98-2e727bfcd39c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:41.088762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff30aaf-ec42-4e16-ab98-2e727bfcd39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:41.091059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff30aaf-ec42-4e16-ab98-2e727bfcd39c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:41.114559 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3609/7220] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:23:41.118095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb0746-b4d3-46da-adca-d06b49d86bb3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:41.130133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb0746-b4d3-46da-adca-d06b49d86bb3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:41.136170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea86e6-2998-4394-a9c4-82acf17b2ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:41.136866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea86e6-2998-4394-a9c4-82acf17b2ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:41.137151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea86e6-2998-4394-a9c4-82acf17b2ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:41.137432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea86e6-2998-4394-a9c4-82acf17b2ba5 admin admin] PATH_INFO: `/v3/projects/7401f9a98627453d882d4f1747594f0c/users/f5abe00d13484fd0bbc843e0c6c4584b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:41.160026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea86e6-2998-4394-a9c4-82acf17b2ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7401f9a98627453d882d4f1747594f0c, user_id=f5abe00d13484fd0bbc843e0c6c4584b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:41.162723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea86e6-2998-4394-a9c4-82acf17b2ba5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:41.179517 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3612/7221] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:23:41 2022] PUT /identity/v3/projects/7401f9a98627453d882d4f1747594f0c/users/f5abe00d13484fd0bbc843e0c6c4584b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:41.183683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff30aaf-ec42-4e16-ab98-2e727bfcd39c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:41.195290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff30aaf-ec42-4e16-ab98-2e727bfcd39c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:41.268106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafeca6-1921-4ad7-87a9-ee6b4ec8f67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:41.268957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafeca6-1921-4ad7-87a9-ee6b4ec8f67b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:41.269344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafeca6-1921-4ad7-87a9-ee6b4ec8f67b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:41.269693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafeca6-1921-4ad7-87a9-ee6b4ec8f67b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:41.270407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafeca6-1921-4ad7-87a9-ee6b4ec8f67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:41.272108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafeca6-1921-4ad7-87a9-ee6b4ec8f67b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:41.286799 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3610/7222] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:23:41.290365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea86e6-2998-4394-a9c4-82acf17b2ba5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:41.301762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea86e6-2998-4394-a9c4-82acf17b2ba5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:41.307246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2669ee-2cec-45ad-8a94-f4b85300ff76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:41.307908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2669ee-2cec-45ad-8a94-f4b85300ff76 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:41.308313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2669ee-2cec-45ad-8a94-f4b85300ff76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:41.308596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2669ee-2cec-45ad-8a94-f4b85300ff76 admin admin] PATH_INFO: `/v3/projects/7401f9a98627453d882d4f1747594f0c/users/f5abe00d13484fd0bbc843e0c6c4584b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:41.310546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2669ee-2cec-45ad-8a94-f4b85300ff76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7401f9a98627453d882d4f1747594f0c, user_id=f5abe00d13484fd0bbc843e0c6c4584b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:41.313338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2669ee-2cec-45ad-8a94-f4b85300ff76 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:41.326043 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3613/7223] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:23:41 2022] PUT /identity/v3/projects/7401f9a98627453d882d4f1747594f0c/users/f5abe00d13484fd0bbc843e0c6c4584b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:41.340978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b46aa-3d3e-4700-9dca-75e5265cd904 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:41.340978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b46aa-3d3e-4700-9dca-75e5265cd904 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:41.341369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b46aa-3d3e-4700-9dca-75e5265cd904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:41.374291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6d8b46aa-3d3e-4700-9dca-75e5265cd904 None None] MFA Rules not processed for user `f5abe00d13484fd0bbc843e0c6c4584b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:23:41.375606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6d8b46aa-3d3e-4700-9dca-75e5265cd904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:41.456825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:41.473029 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3611/7224] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:23:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:23:41.486233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2669ee-2cec-45ad-8a94-f4b85300ff76 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:41.488100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8c2669ee-2cec-45ad-8a94-f4b85300ff76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:23:41.543909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:41.557737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2669ee-2cec-45ad-8a94-f4b85300ff76 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:41.563074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80e53b-f0ab-42c1-a8e0-a570eaf6e8fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:41.563724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80e53b-f0ab-42c1-a8e0-a570eaf6e8fd service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:41.564057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80e53b-f0ab-42c1-a8e0-a570eaf6e8fd service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:41.564286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80e53b-f0ab-42c1-a8e0-a570eaf6e8fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:41.665437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80e53b-f0ab-42c1-a8e0-a570eaf6e8fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:41.667435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80e53b-f0ab-42c1-a8e0-a570eaf6e8fd service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:41.683411 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3614/7225] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:23:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:23:47.940890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b46aa-3d3e-4700-9dca-75e5265cd904 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:47.957748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b46aa-3d3e-4700-9dca-75e5265cd904 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:47.964772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946147d3-5db2-41b1-bf4a-630838009856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:47.965681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946147d3-5db2-41b1-bf4a-630838009856 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:47.966349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946147d3-5db2-41b1-bf4a-630838009856 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:47.966808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946147d3-5db2-41b1-bf4a-630838009856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:47.987538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946147d3-5db2-41b1-bf4a-630838009856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:47.989316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946147d3-5db2-41b1-bf4a-630838009856 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:48.015902 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3612/7226] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:23:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:23:51.674130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=28 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:57.996581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=8 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:23:59.677559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80e53b-f0ab-42c1-a8e0-a570eaf6e8fd service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:23:59.771410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80e53b-f0ab-42c1-a8e0-a570eaf6e8fd service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:23:59.777568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:23:59.778479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:59.778982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:59.779549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] PATH_INFO: `/v3/users/a2db3c617541488ba2b83c3e37433573` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:23:59.781229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2db3c617541488ba2b83c3e37433573)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:23:59.784507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:23:59.902404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2db3c617541488ba2b83c3e37433573'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:59.910547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2db3c617541488ba2b83c3e37433573'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:59.911635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2db3c617541488ba2b83c3e37433573'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:59.950810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2db3c617541488ba2b83c3e37433573'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:59.951733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2db3c617541488ba2b83c3e37433573'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:23:59.984019 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3615/7227] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:23:59 2022] DELETE /identity/v3/users/a2db3c617541488ba2b83c3e37433573 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:23:59.984539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7da3-dcf2-4033-a900-58038ca03bd7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:23:59.985351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7da3-dcf2-4033-a900-58038ca03bd7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:23:59.985631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb7da3-dcf2-4033-a900-58038ca03bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:00.033979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-28cb7da3-dcf2-4033-a900-58038ca03bd7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:00.035252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-28cb7da3-dcf2-4033-a900-58038ca03bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:00.185198 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3613/7228] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:24:00.192741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:00.195955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:00.375630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ced9f-3827-4c15-9a53-dead3476e54a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:00.396585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0470f-a133-45d0-bcd1-9399cfed6a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:00.397800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0470f-a133-45d0-bcd1-9399cfed6a98 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:00.398148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0470f-a133-45d0-bcd1-9399cfed6a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:00.398652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0470f-a133-45d0-bcd1-9399cfed6a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:00.414720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0470f-a133-45d0-bcd1-9399cfed6a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:00.417360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0470f-a133-45d0-bcd1-9399cfed6a98 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:00.439500 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3616/7229] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:01.629972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7da3-dcf2-4033-a900-58038ca03bd7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:01.632567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-28cb7da3-dcf2-4033-a900-58038ca03bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:01.662866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb7da3-dcf2-4033-a900-58038ca03bd7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:01.684576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:01.685858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:01.686157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:01.686442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] PATH_INFO: `/v3/projects/168c302d24a64fb6ae514a435f34825c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:01.691341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] RBAC: Authorizing `identity:delete_project(project_id=168c302d24a64fb6ae514a435f34825c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:01.694984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:01.778648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '168c302d24a64fb6ae514a435f34825c', 'request_id': 'req-31a0d414-a65b-49d9-9e06-07b3042f28af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:01.784588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '168c302d24a64fb6ae514a435f34825c', 'request_id': 'req-31a0d414-a65b-49d9-9e06-07b3042f28af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:01.797474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '168c302d24a64fb6ae514a435f34825c', 'request_id': 'req-31a0d414-a65b-49d9-9e06-07b3042f28af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:01.818235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] The token cache is being invalidate because project 168c302d24a64fb6ae514a435f34825c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:24:01.818790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:01.820875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:01.822895 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3614/7230] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:24:01 2022] DELETE /identity/v3/projects/168c302d24a64fb6ae514a435f34825c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:01.826880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0470f-a133-45d0-bcd1-9399cfed6a98 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:01.838481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0470f-a133-45d0-bcd1-9399cfed6a98 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:01.875769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:01.929689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66534923-9316-4ddf-a925-99893134a830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:01.930697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66534923-9316-4ddf-a925-99893134a830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:01.931088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66534923-9316-4ddf-a925-99893134a830 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:01.931372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66534923-9316-4ddf-a925-99893134a830 admin admin] PATH_INFO: `/v3/users/f5abe00d13484fd0bbc843e0c6c4584b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:01.932685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66534923-9316-4ddf-a925-99893134a830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5abe00d13484fd0bbc843e0c6c4584b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:01.934628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66534923-9316-4ddf-a925-99893134a830 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:02.001501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-66534923-9316-4ddf-a925-99893134a830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5abe00d13484fd0bbc843e0c6c4584b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:02.009199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-66534923-9316-4ddf-a925-99893134a830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5abe00d13484fd0bbc843e0c6c4584b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:02.009933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-66534923-9316-4ddf-a925-99893134a830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5abe00d13484fd0bbc843e0c6c4584b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:02.025107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-66534923-9316-4ddf-a925-99893134a830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5abe00d13484fd0bbc843e0c6c4584b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:02.025852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-66534923-9316-4ddf-a925-99893134a830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5abe00d13484fd0bbc843e0c6c4584b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:02.042395 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3617/7231] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:24:01 2022] DELETE /identity/v3/users/f5abe00d13484fd0bbc843e0c6c4584b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:02.420939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:02.422680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:02.446844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0d414-a65b-49d9-9e06-07b3042f28af admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:02.522968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:02.524047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:02.524428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:02.524717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b admin admin] PATH_INFO: `/v3/projects/7401f9a98627453d882d4f1747594f0c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:02.526042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7401f9a98627453d882d4f1747594f0c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:02.528089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:02.570509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:02.602850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7401f9a98627453d882d4f1747594f0c', 'request_id': 'req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:02.610349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7401f9a98627453d882d4f1747594f0c', 'request_id': 'req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:02.633870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7401f9a98627453d882d4f1747594f0c', 'request_id': 'req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:02.671010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b admin admin] The token cache is being invalidate because project 7401f9a98627453d882d4f1747594f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:24:02.671386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:02.672333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe09c0e7-2a9c-4daf-9ac8-24b3498c585b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:02.674290 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3615/7232] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:24:02 2022] DELETE /identity/v3/projects/7401f9a98627453d882d4f1747594f0c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:02.678988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714254f-7aa5-4bd6-84d3-6fb5e5c8821e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:02.679287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714254f-7aa5-4bd6-84d3-6fb5e5c8821e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:02.679569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714254f-7aa5-4bd6-84d3-6fb5e5c8821e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:02.700178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3714254f-7aa5-4bd6-84d3-6fb5e5c8821e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:02.701399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3714254f-7aa5-4bd6-84d3-6fb5e5c8821e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:02.793747 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3618/7233] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:02.800761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c15f1-dbc5-435d-9316-63515f1f95e0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:02.801055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c15f1-dbc5-435d-9316-63515f1f95e0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:02.801340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c15f1-dbc5-435d-9316-63515f1f95e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:02.833953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-688c15f1-dbc5-435d-9316-63515f1f95e0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:02.835916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-688c15f1-dbc5-435d-9316-63515f1f95e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:02.846240 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3616/7234] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:02.856863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714254f-7aa5-4bd6-84d3-6fb5e5c8821e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:02.867940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714254f-7aa5-4bd6-84d3-6fb5e5c8821e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:02.872822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a66bf-0a7c-4ac3-8575-45fcb5eb05a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:02.873775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a66bf-0a7c-4ac3-8575-45fcb5eb05a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:02.873775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a66bf-0a7c-4ac3-8575-45fcb5eb05a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:02.873984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a66bf-0a7c-4ac3-8575-45fcb5eb05a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:02.874624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a66bf-0a7c-4ac3-8575-45fcb5eb05a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:24:02.874963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a66bf-0a7c-4ac3-8575-45fcb5eb05a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:02.876601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a66bf-0a7c-4ac3-8575-45fcb5eb05a7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:02.892546 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3619/7235] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:24:02.896772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c15f1-dbc5-435d-9316-63515f1f95e0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:02.907203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c15f1-dbc5-435d-9316-63515f1f95e0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:02.915466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9604fd-965d-4940-941f-709a5e8c4b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:02.916062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9604fd-965d-4940-941f-709a5e8c4b35 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:02.916349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9604fd-965d-4940-941f-709a5e8c4b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:02.916683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9604fd-965d-4940-941f-709a5e8c4b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:02.917328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9604fd-965d-4940-941f-709a5e8c4b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:02.919763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9604fd-965d-4940-941f-709a5e8c4b35 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:02.963916 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3617/7236] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:24:02 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:24:02.964530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a66bf-0a7c-4ac3-8575-45fcb5eb05a7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:02.976798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a66bf-0a7c-4ac3-8575-45fcb5eb05a7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:03.020573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:03.067990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1192073-9d2c-47a4-a880-f35dc89be656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:03.070200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1192073-9d2c-47a4-a880-f35dc89be656 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:03.070617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1192073-9d2c-47a4-a880-f35dc89be656 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:03.071205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1192073-9d2c-47a4-a880-f35dc89be656 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:03.073215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1192073-9d2c-47a4-a880-f35dc89be656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:03.075403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1192073-9d2c-47a4-a880-f35dc89be656 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:03.102910 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3620/7237] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:24:02 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:24:03.105554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9604fd-965d-4940-941f-709a5e8c4b35 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:03.117039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9604fd-965d-4940-941f-709a5e8c4b35 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:03.122939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320286e5-0673-4e8e-8bd5-93d5f931b77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:03.123560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320286e5-0673-4e8e-8bd5-93d5f931b77c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:03.123845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320286e5-0673-4e8e-8bd5-93d5f931b77c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:03.124120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320286e5-0673-4e8e-8bd5-93d5f931b77c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:03.124774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320286e5-0673-4e8e-8bd5-93d5f931b77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:03.126843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320286e5-0673-4e8e-8bd5-93d5f931b77c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:03.143311 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3618/7238] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:24:03.144792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1192073-9d2c-47a4-a880-f35dc89be656 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:03.163539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1192073-9d2c-47a4-a880-f35dc89be656 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:03.169017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf2c8e-ab20-4215-a273-3e4e9eea6b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:03.170027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf2c8e-ab20-4215-a273-3e4e9eea6b7f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:03.170886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf2c8e-ab20-4215-a273-3e4e9eea6b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:03.171576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf2c8e-ab20-4215-a273-3e4e9eea6b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:03.172440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf2c8e-ab20-4215-a273-3e4e9eea6b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:03.174490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf2c8e-ab20-4215-a273-3e4e9eea6b7f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:03.187543 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3621/7239] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:24:03.191342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320286e5-0673-4e8e-8bd5-93d5f931b77c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:03.202702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320286e5-0673-4e8e-8bd5-93d5f931b77c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:03.207961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae283f-643a-4142-a11b-687bec8a6d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:03.208684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae283f-643a-4142-a11b-687bec8a6d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:03.208971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae283f-643a-4142-a11b-687bec8a6d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:03.209245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae283f-643a-4142-a11b-687bec8a6d5b admin admin] PATH_INFO: `/v3/projects/510c55bc61324cae828925c992318e4b/users/0e153f7dee3e447590123af929147de7/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:03.227238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae283f-643a-4142-a11b-687bec8a6d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=510c55bc61324cae828925c992318e4b, user_id=0e153f7dee3e447590123af929147de7, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:03.229910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae283f-643a-4142-a11b-687bec8a6d5b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:03.258208 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3619/7240] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:24:03 2022] PUT /identity/v3/projects/510c55bc61324cae828925c992318e4b/users/0e153f7dee3e447590123af929147de7/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:03.259538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c9d0b-10bc-4fb3-88b2-a8252778a13c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:03.260100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c9d0b-10bc-4fb3-88b2-a8252778a13c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:03.260700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c9d0b-10bc-4fb3-88b2-a8252778a13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:03.306895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-eb1c9d0b-10bc-4fb3-88b2-a8252778a13c None None] MFA Rules not processed for user `0e153f7dee3e447590123af929147de7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:03.310491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eb1c9d0b-10bc-4fb3-88b2-a8252778a13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:03.423233 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3622/7241] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:03.430507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae283f-643a-4142-a11b-687bec8a6d5b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:03.530101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae283f-643a-4142-a11b-687bec8a6d5b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:03.537000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df152333-1bbc-4728-9c12-224a52e61599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:03.538703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df152333-1bbc-4728-9c12-224a52e61599 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:03.539241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df152333-1bbc-4728-9c12-224a52e61599 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:03.539727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df152333-1bbc-4728-9c12-224a52e61599 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:03.540846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df152333-1bbc-4728-9c12-224a52e61599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:03.544141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df152333-1bbc-4728-9c12-224a52e61599 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:03.586425 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3620/7242] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:24:03 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:24:03.587553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c9d0b-10bc-4fb3-88b2-a8252778a13c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:03.599280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c9d0b-10bc-4fb3-88b2-a8252778a13c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:03.673588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fd517-a203-4924-8a52-45444a211e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:03.674178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fd517-a203-4924-8a52-45444a211e98 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:03.674462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fd517-a203-4924-8a52-45444a211e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:03.675106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fd517-a203-4924-8a52-45444a211e98 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:03.675773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fd517-a203-4924-8a52-45444a211e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:03.677905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fd517-a203-4924-8a52-45444a211e98 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:03.708884 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3623/7243] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:24:03 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:24:03.714096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df152333-1bbc-4728-9c12-224a52e61599 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:03.730494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df152333-1bbc-4728-9c12-224a52e61599 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:03.736451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361ce9f-0037-4060-a7c0-e61c15239188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:03.737117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361ce9f-0037-4060-a7c0-e61c15239188 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:03.737456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361ce9f-0037-4060-a7c0-e61c15239188 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:03.737740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361ce9f-0037-4060-a7c0-e61c15239188 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:03.738396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361ce9f-0037-4060-a7c0-e61c15239188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:03.740195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361ce9f-0037-4060-a7c0-e61c15239188 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:03.760929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fd517-a203-4924-8a52-45444a211e98 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:03.773963 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3621/7244] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:24:03.777638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fd517-a203-4924-8a52-45444a211e98 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:03.784723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3832769-714d-4e8e-84ca-ccd5329ac5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:03.785099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3832769-714d-4e8e-84ca-ccd5329ac5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:03.785380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3832769-714d-4e8e-84ca-ccd5329ac5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:03.785655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3832769-714d-4e8e-84ca-ccd5329ac5bb admin admin] PATH_INFO: `/v3/projects/4965e0bf87b04e1eabb990dd47815768/users/45a2bda5773f4dabbc83261ac397e5dd/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:03.804762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3832769-714d-4e8e-84ca-ccd5329ac5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4965e0bf87b04e1eabb990dd47815768, user_id=45a2bda5773f4dabbc83261ac397e5dd, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:03.807548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3832769-714d-4e8e-84ca-ccd5329ac5bb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:03.831101 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3624/7245] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:24:03 2022] PUT /identity/v3/projects/4965e0bf87b04e1eabb990dd47815768/users/45a2bda5773f4dabbc83261ac397e5dd/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:03.834376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361ce9f-0037-4060-a7c0-e61c15239188 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:03.846021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361ce9f-0037-4060-a7c0-e61c15239188 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:03.872836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:03.946804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca64eb6-7f74-44ee-b3d2-4f3351e7cd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:03.947696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca64eb6-7f74-44ee-b3d2-4f3351e7cd9f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:03.948148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca64eb6-7f74-44ee-b3d2-4f3351e7cd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:03.948570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca64eb6-7f74-44ee-b3d2-4f3351e7cd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:03.949705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca64eb6-7f74-44ee-b3d2-4f3351e7cd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:03.952202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca64eb6-7f74-44ee-b3d2-4f3351e7cd9f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:03.976995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3832769-714d-4e8e-84ca-ccd5329ac5bb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:03.977442 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3622/7246] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:24:03.984654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:03.993390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3832769-714d-4e8e-84ca-ccd5329ac5bb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:04.002524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59b728-fa50-49d1-aaac-c4d800f35022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:04.003299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59b728-fa50-49d1-aaac-c4d800f35022 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:04.003598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59b728-fa50-49d1-aaac-c4d800f35022 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:04.003930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59b728-fa50-49d1-aaac-c4d800f35022 admin admin] PATH_INFO: `/v3/projects/4965e0bf87b04e1eabb990dd47815768/users/45a2bda5773f4dabbc83261ac397e5dd/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:04.006458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59b728-fa50-49d1-aaac-c4d800f35022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4965e0bf87b04e1eabb990dd47815768, user_id=45a2bda5773f4dabbc83261ac397e5dd, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:04.016000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59b728-fa50-49d1-aaac-c4d800f35022 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:04.056861 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3625/7247] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:24:03 2022] PUT /identity/v3/projects/4965e0bf87b04e1eabb990dd47815768/users/45a2bda5773f4dabbc83261ac397e5dd/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:04.060511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cfaa7-12ff-4d70-b99e-f32e9c2fb165 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:04.060774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cfaa7-12ff-4d70-b99e-f32e9c2fb165 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:04.061002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cfaa7-12ff-4d70-b99e-f32e9c2fb165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:04.115382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-672cfaa7-12ff-4d70-b99e-f32e9c2fb165 None None] MFA Rules not processed for user `45a2bda5773f4dabbc83261ac397e5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:04.117460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-672cfaa7-12ff-4d70-b99e-f32e9c2fb165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:04.229448 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3623/7248] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:04.248646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59b728-fa50-49d1-aaac-c4d800f35022 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:04.250578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9b59b728-fa50-49d1-aaac-c4d800f35022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:04.423157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59b728-fa50-49d1-aaac-c4d800f35022 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:04.427544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb28eb-cfe7-43a6-b895-aabc3928b5ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:04.428392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb28eb-cfe7-43a6-b895-aabc3928b5ca service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:04.429002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb28eb-cfe7-43a6-b895-aabc3928b5ca service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:04.429538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb28eb-cfe7-43a6-b895-aabc3928b5ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:04.441838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb28eb-cfe7-43a6-b895-aabc3928b5ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:04.443440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb28eb-cfe7-43a6-b895-aabc3928b5ca service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:04.456890 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3626/7249] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:05.018122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cfaa7-12ff-4d70-b99e-f32e9c2fb165 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:05.226469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cfaa7-12ff-4d70-b99e-f32e9c2fb165 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:05.266014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:05.266814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:05.267489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:05.267883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] PATH_INFO: `/v3/users/0e153f7dee3e447590123af929147de7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:05.269509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e153f7dee3e447590123af929147de7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:05.279254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:05.405866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e153f7dee3e447590123af929147de7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:05.407730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:05.424221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e153f7dee3e447590123af929147de7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:05.427190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e153f7dee3e447590123af929147de7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:05.442416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e153f7dee3e447590123af929147de7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:05.443950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e153f7dee3e447590123af929147de7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:05.470168 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3624/7250] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:24:05 2022] DELETE /identity/v3/users/0e153f7dee3e447590123af929147de7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:05.474703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6590-c788-46a0-a982-39753ebe6bc5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:05.477846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6590-c788-46a0-a982-39753ebe6bc5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:05.478333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6590-c788-46a0-a982-39753ebe6bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:05.511886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cd8b6590-c788-46a0-a982-39753ebe6bc5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:05.513197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cd8b6590-c788-46a0-a982-39753ebe6bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:05.637274 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3627/7251] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:05.646224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:05.648500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:05.738834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbfebe-eebc-472f-9743-cfe8e9ce182d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:05.744137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9fa3c-cbf2-4f31-8744-ce37a0ab06a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:05.744820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9fa3c-cbf2-4f31-8744-ce37a0ab06a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:05.745169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9fa3c-cbf2-4f31-8744-ce37a0ab06a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:05.745456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9fa3c-cbf2-4f31-8744-ce37a0ab06a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:05.769553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9fa3c-cbf2-4f31-8744-ce37a0ab06a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:05.771190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9fa3c-cbf2-4f31-8744-ce37a0ab06a5 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:05.787006 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3625/7252] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:06.284848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b6590-c788-46a0-a982-39753ebe6bc5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:06.286307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cd8b6590-c788-46a0-a982-39753ebe6bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:06.307916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b6590-c788-46a0-a982-39753ebe6bc5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:06.319735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:06.320406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:06.320690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:06.320966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] PATH_INFO: `/v3/projects/510c55bc61324cae828925c992318e4b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:06.323502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=510c55bc61324cae828925c992318e4b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:06.325460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:06.462198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510c55bc61324cae828925c992318e4b', 'request_id': 'req-56d7eca3-2811-4d07-aa03-75c22d73d1ea'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:06.475947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510c55bc61324cae828925c992318e4b', 'request_id': 'req-56d7eca3-2811-4d07-aa03-75c22d73d1ea'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:06.486005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510c55bc61324cae828925c992318e4b', 'request_id': 'req-56d7eca3-2811-4d07-aa03-75c22d73d1ea'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:06.501123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] The token cache is being invalidate because project 510c55bc61324cae828925c992318e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:24:06.502237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:06.503709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:06.509518 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3628/7253] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:24:06 2022] DELETE /identity/v3/projects/510c55bc61324cae828925c992318e4b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:06.510418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9fa3c-cbf2-4f31-8744-ce37a0ab06a5 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:06.526157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9fa3c-cbf2-4f31-8744-ce37a0ab06a5 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:06.644428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507b415-e02e-46ec-851e-e1bf7d614c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:06.645012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507b415-e02e-46ec-851e-e1bf7d614c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:06.645345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507b415-e02e-46ec-851e-e1bf7d614c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:06.645773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507b415-e02e-46ec-851e-e1bf7d614c37 admin admin] PATH_INFO: `/v3/users/45a2bda5773f4dabbc83261ac397e5dd` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:06.648016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507b415-e02e-46ec-851e-e1bf7d614c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a2bda5773f4dabbc83261ac397e5dd)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:06.650841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507b415-e02e-46ec-851e-e1bf7d614c37 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:06.734733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2507b415-e02e-46ec-851e-e1bf7d614c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a2bda5773f4dabbc83261ac397e5dd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:06.745548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2507b415-e02e-46ec-851e-e1bf7d614c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a2bda5773f4dabbc83261ac397e5dd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:06.746513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2507b415-e02e-46ec-851e-e1bf7d614c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a2bda5773f4dabbc83261ac397e5dd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:06.763137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2507b415-e02e-46ec-851e-e1bf7d614c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a2bda5773f4dabbc83261ac397e5dd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:06.766583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2507b415-e02e-46ec-851e-e1bf7d614c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a2bda5773f4dabbc83261ac397e5dd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:06.775339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:06.817315 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3626/7254] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:24:06 2022] DELETE /identity/v3/users/45a2bda5773f4dabbc83261ac397e5dd => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:24:07.400987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:07.402811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:07.445574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7eca3-2811-4d07-aa03-75c22d73d1ea admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:07.468114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:07.591220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fc648-a196-4e49-b125-7d1f7c03ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:07.593232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fc648-a196-4e49-b125-7d1f7c03ccca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:07.593705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fc648-a196-4e49-b125-7d1f7c03ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:07.594194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fc648-a196-4e49-b125-7d1f7c03ccca admin admin] PATH_INFO: `/v3/projects/4965e0bf87b04e1eabb990dd47815768` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:07.595709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fc648-a196-4e49-b125-7d1f7c03ccca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4965e0bf87b04e1eabb990dd47815768)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:07.598189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fc648-a196-4e49-b125-7d1f7c03ccca admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:07.677616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-589fc648-a196-4e49-b125-7d1f7c03ccca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4965e0bf87b04e1eabb990dd47815768', 'request_id': 'req-589fc648-a196-4e49-b125-7d1f7c03ccca'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:07.693515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-589fc648-a196-4e49-b125-7d1f7c03ccca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4965e0bf87b04e1eabb990dd47815768', 'request_id': 'req-589fc648-a196-4e49-b125-7d1f7c03ccca'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:07.711351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-589fc648-a196-4e49-b125-7d1f7c03ccca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4965e0bf87b04e1eabb990dd47815768', 'request_id': 'req-589fc648-a196-4e49-b125-7d1f7c03ccca'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:07.726795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-589fc648-a196-4e49-b125-7d1f7c03ccca admin admin] The token cache is being invalidate because project 4965e0bf87b04e1eabb990dd47815768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:24:07.727435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-589fc648-a196-4e49-b125-7d1f7c03ccca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:07.728307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-589fc648-a196-4e49-b125-7d1f7c03ccca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:07.731129 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3629/7255] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:24:07 2022] DELETE /identity/v3/projects/4965e0bf87b04e1eabb990dd47815768 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:07.736553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d5f9c-b2d7-45ea-9f5c-4718eee48333 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:07.737725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d5f9c-b2d7-45ea-9f5c-4718eee48333 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:07.738236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d5f9c-b2d7-45ea-9f5c-4718eee48333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:07.795297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-800d5f9c-b2d7-45ea-9f5c-4718eee48333 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:07.796545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-800d5f9c-b2d7-45ea-9f5c-4718eee48333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:07.942786 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3627/7256] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:07.945238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a697a2-3763-4b47-8d54-d1563e728451 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:07.945676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a697a2-3763-4b47-8d54-d1563e728451 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:07.946009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a697a2-3763-4b47-8d54-d1563e728451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:07.972072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d6a697a2-3763-4b47-8d54-d1563e728451 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:07.973434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d6a697a2-3763-4b47-8d54-d1563e728451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:07.986598 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3630/7257] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:07.992374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d5f9c-b2d7-45ea-9f5c-4718eee48333 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:08.005415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d5f9c-b2d7-45ea-9f5c-4718eee48333 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:08.011898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76379f8-cea3-460b-8231-d17fbca96ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:08.012520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76379f8-cea3-460b-8231-d17fbca96ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:08.012854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76379f8-cea3-460b-8231-d17fbca96ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:08.013185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76379f8-cea3-460b-8231-d17fbca96ef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:08.013845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76379f8-cea3-460b-8231-d17fbca96ef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:24:08.014147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76379f8-cea3-460b-8231-d17fbca96ef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:08.016735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76379f8-cea3-460b-8231-d17fbca96ef0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:08.048738 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3628/7258] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:24:08.049227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a697a2-3763-4b47-8d54-d1563e728451 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:08.063085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a697a2-3763-4b47-8d54-d1563e728451 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:08.070051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a81977-10a9-4314-acbb-a9f46ebb6ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:08.070896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81977-10a9-4314-acbb-a9f46ebb6ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:08.071346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81977-10a9-4314-acbb-a9f46ebb6ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:08.071789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a81977-10a9-4314-acbb-a9f46ebb6ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:08.073008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a81977-10a9-4314-acbb-a9f46ebb6ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:08.075350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a81977-10a9-4314-acbb-a9f46ebb6ff5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:08.116543 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3631/7259] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:24:08 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:24:08.120730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76379f8-cea3-460b-8231-d17fbca96ef0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:08.138705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76379f8-cea3-460b-8231-d17fbca96ef0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:08.268382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1942f8-b913-4297-a096-310ec28669fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:08.269019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1942f8-b913-4297-a096-310ec28669fd admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:08.269303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1942f8-b913-4297-a096-310ec28669fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:08.269583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1942f8-b913-4297-a096-310ec28669fd admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:08.270237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1942f8-b913-4297-a096-310ec28669fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:08.273050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1942f8-b913-4297-a096-310ec28669fd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:08.336296 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3629/7260] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:24:08 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:24:08.338129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a81977-10a9-4314-acbb-a9f46ebb6ff5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:08.353682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a81977-10a9-4314-acbb-a9f46ebb6ff5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:08.375932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaa485-a63e-458c-94db-d77e69b04df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:08.379364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaa485-a63e-458c-94db-d77e69b04df8 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:08.379860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaa485-a63e-458c-94db-d77e69b04df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:08.380284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaa485-a63e-458c-94db-d77e69b04df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:08.381092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaaa485-a63e-458c-94db-d77e69b04df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:08.384104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaaa485-a63e-458c-94db-d77e69b04df8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:08.416431 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3632/7261] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:24:08.418685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1942f8-b913-4297-a096-310ec28669fd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:08.433032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1942f8-b913-4297-a096-310ec28669fd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:08.471307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cca05-e65f-4cad-84e5-2cef4df30b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:08.472302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cca05-e65f-4cad-84e5-2cef4df30b3f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:08.472830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cca05-e65f-4cad-84e5-2cef4df30b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:08.473320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cca05-e65f-4cad-84e5-2cef4df30b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:08.474235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cca05-e65f-4cad-84e5-2cef4df30b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:08.478976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cca05-e65f-4cad-84e5-2cef4df30b3f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:08.513415 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3630/7262] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:24:08.514486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaa485-a63e-458c-94db-d77e69b04df8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:08.528505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaa485-a63e-458c-94db-d77e69b04df8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:08.561733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199da5d9-03d7-49a4-909f-a9031b891c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:08.563288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da5d9-03d7-49a4-909f-a9031b891c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:08.563569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da5d9-03d7-49a4-909f-a9031b891c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:08.563847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da5d9-03d7-49a4-909f-a9031b891c6e admin admin] PATH_INFO: `/v3/projects/191b713b07314031aacf24b243635fb3/users/7b5116f0170346a9a81f765cb44bb2cd/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:08.608667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199da5d9-03d7-49a4-909f-a9031b891c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=191b713b07314031aacf24b243635fb3, user_id=7b5116f0170346a9a81f765cb44bb2cd, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:08.617015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199da5d9-03d7-49a4-909f-a9031b891c6e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:08.638768 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3633/7263] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:24:08 2022] PUT /identity/v3/projects/191b713b07314031aacf24b243635fb3/users/7b5116f0170346a9a81f765cb44bb2cd/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:08.650500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875cc25-77c1-4dc5-96eb-4f039ef8a8d5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:08.650972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875cc25-77c1-4dc5-96eb-4f039ef8a8d5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:08.651116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875cc25-77c1-4dc5-96eb-4f039ef8a8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:08.692200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d875cc25-77c1-4dc5-96eb-4f039ef8a8d5 None None] MFA Rules not processed for user `7b5116f0170346a9a81f765cb44bb2cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:08.693768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d875cc25-77c1-4dc5-96eb-4f039ef8a8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:08.805226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:08.852336 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3631/7264] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:08.862957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199da5d9-03d7-49a4-909f-a9031b891c6e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:08.868418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-199da5d9-03d7-49a4-909f-a9031b891c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:08.938651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:08.962828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199da5d9-03d7-49a4-909f-a9031b891c6e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:08.967634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2d6c6-3142-4e22-ab85-5f0ab7786388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:08.968296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2d6c6-3142-4e22-ab85-5f0ab7786388 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:08.969455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2d6c6-3142-4e22-ab85-5f0ab7786388 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:08.969746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2d6c6-3142-4e22-ab85-5f0ab7786388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:08.980714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2d6c6-3142-4e22-ab85-5f0ab7786388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:08.982501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2d6c6-3142-4e22-ab85-5f0ab7786388 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:08.995453 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3634/7265] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:14.377737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875cc25-77c1-4dc5-96eb-4f039ef8a8d5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:14.379801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d875cc25-77c1-4dc5-96eb-4f039ef8a8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:14.581544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875cc25-77c1-4dc5-96eb-4f039ef8a8d5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:14.589538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:14.590449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:14.590847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:14.591274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] PATH_INFO: `/v3/users/36517a6b69704b33a1464a0b70882c02` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:14.592859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=36517a6b69704b33a1464a0b70882c02)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:14.596626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:14.664979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36517a6b69704b33a1464a0b70882c02'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:14.675629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36517a6b69704b33a1464a0b70882c02'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:14.676298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36517a6b69704b33a1464a0b70882c02'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:14.691542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36517a6b69704b33a1464a0b70882c02'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:14.692824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36517a6b69704b33a1464a0b70882c02'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:14.770861 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3632/7266] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:24:14 2022] DELETE /identity/v3/users/36517a6b69704b33a1464a0b70882c02 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:24:14.772328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aa3ef-ee86-4858-b53c-276250d8a750 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:14.773182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aa3ef-ee86-4858-b53c-276250d8a750 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:14.773652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aa3ef-ee86-4858-b53c-276250d8a750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:14.811930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-087aa3ef-ee86-4858-b53c-276250d8a750 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:14.813518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-087aa3ef-ee86-4858-b53c-276250d8a750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:14.958851 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3635/7267] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:15.000852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:15.003499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:15.083568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46755d49-b6ca-4dbe-820f-acd650cc45ee admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:15.090201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c4815-c32c-499f-971d-a02f9c68873c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:15.092320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c4815-c32c-499f-971d-a02f9c68873c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:15.093178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c4815-c32c-499f-971d-a02f9c68873c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:15.093781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c4815-c32c-499f-971d-a02f9c68873c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:15.116526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c4815-c32c-499f-971d-a02f9c68873c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:15.117745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c4815-c32c-499f-971d-a02f9c68873c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:15.130497 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3633/7268] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:16.316156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aa3ef-ee86-4858-b53c-276250d8a750 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:16.318135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-087aa3ef-ee86-4858-b53c-276250d8a750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:16.398231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c4815-c32c-499f-971d-a02f9c68873c service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:16.400999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-811c4815-c32c-499f-971d-a02f9c68873c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:16.421716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:16.434997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c4815-c32c-499f-971d-a02f9c68873c service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:16.468541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd343a17-45ae-442a-9b52-c304934dfd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:16.471035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343a17-45ae-442a-9b52-c304934dfd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:16.473098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343a17-45ae-442a-9b52-c304934dfd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:16.473578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343a17-45ae-442a-9b52-c304934dfd77 admin admin] PATH_INFO: `/v3/users/d79608fb44284568ae21a2a37e3fbe51` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:16.477266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd343a17-45ae-442a-9b52-c304934dfd77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79608fb44284568ae21a2a37e3fbe51)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:16.484361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd343a17-45ae-442a-9b52-c304934dfd77 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:16.502773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aa3ef-ee86-4858-b53c-276250d8a750 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:16.521053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ad4c9-044d-4eaf-bc07-3a9256d87fd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:16.521898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ad4c9-044d-4eaf-bc07-3a9256d87fd7 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:16.522911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ad4c9-044d-4eaf-bc07-3a9256d87fd7 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:16.523426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ad4c9-044d-4eaf-bc07-3a9256d87fd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:16.528113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7b5ad4c9-044d-4eaf-bc07-3a9256d87fd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:16.607457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd343a17-45ae-442a-9b52-c304934dfd77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79608fb44284568ae21a2a37e3fbe51'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:16.620133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ad4c9-044d-4eaf-bc07-3a9256d87fd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:16.621924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ad4c9-044d-4eaf-bc07-3a9256d87fd7 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:16.627548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd343a17-45ae-442a-9b52-c304934dfd77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79608fb44284568ae21a2a37e3fbe51'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:16.628753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd343a17-45ae-442a-9b52-c304934dfd77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79608fb44284568ae21a2a37e3fbe51'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:16.644712 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3636/7269] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:16.645856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ad4c9-044d-4eaf-bc07-3a9256d87fd7 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:16.650683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7b5ad4c9-044d-4eaf-bc07-3a9256d87fd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:16.653526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd343a17-45ae-442a-9b52-c304934dfd77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79608fb44284568ae21a2a37e3fbe51'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:16.654321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd343a17-45ae-442a-9b52-c304934dfd77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79608fb44284568ae21a2a37e3fbe51'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:16.692446 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3634/7270] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:24:16 2022] DELETE /identity/v3/users/d79608fb44284568ae21a2a37e3fbe51 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:16.700004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ad4c9-044d-4eaf-bc07-3a9256d87fd7 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:16.895830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61104aa8-40cb-46dc-a6bb-9947e98197dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:16.897045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61104aa8-40cb-46dc-a6bb-9947e98197dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:16.897661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61104aa8-40cb-46dc-a6bb-9947e98197dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:16.898218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61104aa8-40cb-46dc-a6bb-9947e98197dc admin admin] PATH_INFO: `/v3/projects/8f3fb40923ac4f6cb605b8296137b9a5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:16.900009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61104aa8-40cb-46dc-a6bb-9947e98197dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3fb40923ac4f6cb605b8296137b9a5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:16.907257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61104aa8-40cb-46dc-a6bb-9947e98197dc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:16.949486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:17.028458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-61104aa8-40cb-46dc-a6bb-9947e98197dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3fb40923ac4f6cb605b8296137b9a5', 'request_id': 'req-61104aa8-40cb-46dc-a6bb-9947e98197dc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:17.049990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-61104aa8-40cb-46dc-a6bb-9947e98197dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3fb40923ac4f6cb605b8296137b9a5', 'request_id': 'req-61104aa8-40cb-46dc-a6bb-9947e98197dc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:17.069970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-61104aa8-40cb-46dc-a6bb-9947e98197dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3fb40923ac4f6cb605b8296137b9a5', 'request_id': 'req-61104aa8-40cb-46dc-a6bb-9947e98197dc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:17.083992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-61104aa8-40cb-46dc-a6bb-9947e98197dc admin admin] The token cache is being invalidate because project 8f3fb40923ac4f6cb605b8296137b9a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:24:17.085170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-61104aa8-40cb-46dc-a6bb-9947e98197dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:17.086369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-61104aa8-40cb-46dc-a6bb-9947e98197dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:17.089955 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3637/7271] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:24:16 2022] DELETE /identity/v3/projects/8f3fb40923ac4f6cb605b8296137b9a5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:17.097581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585d08a-6f2d-4235-ae81-456b77a41410 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:17.097581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585d08a-6f2d-4235-ae81-456b77a41410 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:17.097865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585d08a-6f2d-4235-ae81-456b77a41410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:17.135050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8585d08a-6f2d-4235-ae81-456b77a41410 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:17.137192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8585d08a-6f2d-4235-ae81-456b77a41410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:17.265214 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3635/7272] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:17.274152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9203f-cd4b-43c9-86f9-588a32435634 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:17.274326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585d08a-6f2d-4235-ae81-456b77a41410 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:17.274639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9203f-cd4b-43c9-86f9-588a32435634 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:17.275069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9203f-cd4b-43c9-86f9-588a32435634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:17.276283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8585d08a-6f2d-4235-ae81-456b77a41410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:17.293107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585d08a-6f2d-4235-ae81-456b77a41410 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:17.298360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed22428-6a2e-43ac-8a14-030414d3bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:17.299167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed22428-6a2e-43ac-8a14-030414d3bb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:17.299449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed22428-6a2e-43ac-8a14-030414d3bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:17.299723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed22428-6a2e-43ac-8a14-030414d3bb37 admin admin] PATH_INFO: `/v3/projects/ccf55210931e495482126df98a1434ce` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:17.316303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed22428-6a2e-43ac-8a14-030414d3bb37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf55210931e495482126df98a1434ce)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:17.319059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed22428-6a2e-43ac-8a14-030414d3bb37 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:17.319886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-deb9203f-cd4b-43c9-86f9-588a32435634 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:17.322761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-deb9203f-cd4b-43c9-86f9-588a32435634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:17.338174 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3638/7273] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:17.339208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9203f-cd4b-43c9-86f9-588a32435634 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:17.371437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9203f-cd4b-43c9-86f9-588a32435634 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:17.393595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b563bbf-6e26-41c6-9d84-53b4f4b92f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:17.394255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b563bbf-6e26-41c6-9d84-53b4f4b92f48 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:17.394543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b563bbf-6e26-41c6-9d84-53b4f4b92f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:17.394844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b563bbf-6e26-41c6-9d84-53b4f4b92f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:17.395732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b563bbf-6e26-41c6-9d84-53b4f4b92f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:24:17.396039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b563bbf-6e26-41c6-9d84-53b4f4b92f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:17.398416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b563bbf-6e26-41c6-9d84-53b4f4b92f48 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:17.416595 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3639/7274] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:24:17.420466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5ed22428-6a2e-43ac-8a14-030414d3bb37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf55210931e495482126df98a1434ce', 'request_id': 'req-5ed22428-6a2e-43ac-8a14-030414d3bb37'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:17.421177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b563bbf-6e26-41c6-9d84-53b4f4b92f48 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:17.429800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5ed22428-6a2e-43ac-8a14-030414d3bb37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf55210931e495482126df98a1434ce', 'request_id': 'req-5ed22428-6a2e-43ac-8a14-030414d3bb37'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:17.445143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5ed22428-6a2e-43ac-8a14-030414d3bb37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf55210931e495482126df98a1434ce', 'request_id': 'req-5ed22428-6a2e-43ac-8a14-030414d3bb37'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:17.451695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b563bbf-6e26-41c6-9d84-53b4f4b92f48 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:17.461846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:17.467031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5ed22428-6a2e-43ac-8a14-030414d3bb37 admin admin] The token cache is being invalidate because project ccf55210931e495482126df98a1434ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:24:17.467730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5ed22428-6a2e-43ac-8a14-030414d3bb37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:17.469450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5ed22428-6a2e-43ac-8a14-030414d3bb37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:17.471960 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3636/7275] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:24:17 2022] DELETE /identity/v3/projects/ccf55210931e495482126df98a1434ce => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:17.489068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356b0c6-288d-48f0-82e9-5be6a1b032e6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:17.492233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356b0c6-288d-48f0-82e9-5be6a1b032e6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:17.492654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356b0c6-288d-48f0-82e9-5be6a1b032e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:17.544483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2356b0c6-288d-48f0-82e9-5be6a1b032e6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:17.546306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2356b0c6-288d-48f0-82e9-5be6a1b032e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:17.585239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c251b-651d-4744-89e0-f3e31657da89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:17.585881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c251b-651d-4744-89e0-f3e31657da89 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:17.586162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c251b-651d-4744-89e0-f3e31657da89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:17.586434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c251b-651d-4744-89e0-f3e31657da89 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:17.587100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c251b-651d-4744-89e0-f3e31657da89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:17.589028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c251b-651d-4744-89e0-f3e31657da89 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:17.658795 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3640/7276] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:24:17 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:24:17.663154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c251b-651d-4744-89e0-f3e31657da89 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:17.665906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-be9c251b-651d-4744-89e0-f3e31657da89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:17.675514 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3637/7277] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:17.677181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7f575-cbe6-4e87-9e97-d9a1a93251f8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:17.677607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7f575-cbe6-4e87-9e97-d9a1a93251f8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:17.678771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7f575-cbe6-4e87-9e97-d9a1a93251f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:17.704482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4fe7f575-cbe6-4e87-9e97-d9a1a93251f8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:17.706067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4fe7f575-cbe6-4e87-9e97-d9a1a93251f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:17.793461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c251b-651d-4744-89e0-f3e31657da89 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:17.796300 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3638/7278] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:17.800637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7f575-cbe6-4e87-9e97-d9a1a93251f8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:17.802086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66286ea-0513-4adc-bad3-fb0d7eb827df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:17.804369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66286ea-0513-4adc-bad3-fb0d7eb827df admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:17.804752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66286ea-0513-4adc-bad3-fb0d7eb827df admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:17.805033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66286ea-0513-4adc-bad3-fb0d7eb827df admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:17.805942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66286ea-0513-4adc-bad3-fb0d7eb827df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:17.808585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66286ea-0513-4adc-bad3-fb0d7eb827df admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:17.820789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7f575-cbe6-4e87-9e97-d9a1a93251f8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:17.830235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c3be7-36c1-4dd1-bb75-a0660ac9353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:17.831554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c3be7-36c1-4dd1-bb75-a0660ac9353c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:17.833522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c3be7-36c1-4dd1-bb75-a0660ac9353c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:17.833805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c3be7-36c1-4dd1-bb75-a0660ac9353c admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:17.835718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:17.836043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c3be7-36c1-4dd1-bb75-a0660ac9353c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:24:17.838137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c3be7-36c1-4dd1-bb75-a0660ac9353c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:17.840421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c3be7-36c1-4dd1-bb75-a0660ac9353c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:17.844853 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3641/7279] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:24:17 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:24:17.848709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66286ea-0513-4adc-bad3-fb0d7eb827df admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:17.863083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66286ea-0513-4adc-bad3-fb0d7eb827df admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:17.871217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573bb22-4a87-48b4-9c18-78f2e73bed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:17.871888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573bb22-4a87-48b4-9c18-78f2e73bed8a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:17.872377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573bb22-4a87-48b4-9c18-78f2e73bed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:17.872659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573bb22-4a87-48b4-9c18-78f2e73bed8a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:17.873446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573bb22-4a87-48b4-9c18-78f2e73bed8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:17.875399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e573bb22-4a87-48b4-9c18-78f2e73bed8a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:17.886198 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3639/7280] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:24:17.887530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c3be7-36c1-4dd1-bb75-a0660ac9353c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:17.903373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c3be7-36c1-4dd1-bb75-a0660ac9353c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:17.903574 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3642/7281] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:24:17.904624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573bb22-4a87-48b4-9c18-78f2e73bed8a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:17.906129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d18a8-eada-4a7c-802c-82ecbc553b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:17.906992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d18a8-eada-4a7c-802c-82ecbc553b65 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:17.907398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d18a8-eada-4a7c-802c-82ecbc553b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:17.907912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d18a8-eada-4a7c-802c-82ecbc553b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:17.908894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d18a8-eada-4a7c-802c-82ecbc553b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:17.911060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d18a8-eada-4a7c-802c-82ecbc553b65 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:17.944730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573bb22-4a87-48b4-9c18-78f2e73bed8a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:17.951318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1801c-9061-4243-97ee-5d8efb0265ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:17.951945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1801c-9061-4243-97ee-5d8efb0265ba admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:17.952233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1801c-9061-4243-97ee-5d8efb0265ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:17.952511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1801c-9061-4243-97ee-5d8efb0265ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:17.953161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1801c-9061-4243-97ee-5d8efb0265ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:17.955511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1801c-9061-4243-97ee-5d8efb0265ba admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:17.968436 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3640/7282] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:24:17 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:24:17.969601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d18a8-eada-4a7c-802c-82ecbc553b65 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:17.978337 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3643/7283] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:24:17.982847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1801c-9061-4243-97ee-5d8efb0265ba admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:18.008579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1801c-9061-4243-97ee-5d8efb0265ba admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:18.092783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af17446-765e-4386-a7c7-9e3c9fdf2631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:18.094183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af17446-765e-4386-a7c7-9e3c9fdf2631 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:18.094622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af17446-765e-4386-a7c7-9e3c9fdf2631 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:18.095226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af17446-765e-4386-a7c7-9e3c9fdf2631 admin admin] PATH_INFO: `/v3/projects/f1c3262fde754dea8c59f9f8c7ff9758/users/0b7ad27b7ee348eb96f9abb60ed1fc8f/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:18.112654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d18a8-eada-4a7c-802c-82ecbc553b65 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:18.114956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af17446-765e-4386-a7c7-9e3c9fdf2631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c3262fde754dea8c59f9f8c7ff9758, user_id=0b7ad27b7ee348eb96f9abb60ed1fc8f, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:18.119748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af17446-765e-4386-a7c7-9e3c9fdf2631 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:18.134736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad0be7-0d5f-4ec3-926c-e48834712561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:18.136198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad0be7-0d5f-4ec3-926c-e48834712561 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:18.136536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad0be7-0d5f-4ec3-926c-e48834712561 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:18.136865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad0be7-0d5f-4ec3-926c-e48834712561 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:18.138373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad0be7-0d5f-4ec3-926c-e48834712561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:18.142557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad0be7-0d5f-4ec3-926c-e48834712561 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:18.175431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:18.195101 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3644/7284] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:24:17 2022] PUT /identity/v3/projects/f1c3262fde754dea8c59f9f8c7ff9758/users/0b7ad27b7ee348eb96f9abb60ed1fc8f/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:18.198786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe060-1b8e-49de-8209-f645cbc9672c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:18.198786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe060-1b8e-49de-8209-f645cbc9672c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:18.198786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe060-1b8e-49de-8209-f645cbc9672c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:18.210469 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3641/7285] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:24:17 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:24:18.214876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad0be7-0d5f-4ec3-926c-e48834712561 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:18.238381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad0be7-0d5f-4ec3-926c-e48834712561 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:18.273727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1cfbe060-1b8e-49de-8209-f645cbc9672c None None] MFA Rules not processed for user `0b7ad27b7ee348eb96f9abb60ed1fc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:18.277224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1cfbe060-1b8e-49de-8209-f645cbc9672c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:18.423827 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3645/7286] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:18.425190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780a63e-5371-45fb-a68c-1282634994a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:18.425948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a63e-5371-45fb-a68c-1282634994a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:18.426338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a63e-5371-45fb-a68c-1282634994a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:18.426721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a63e-5371-45fb-a68c-1282634994a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:18.428458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780a63e-5371-45fb-a68c-1282634994a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:18.429542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbe060-1b8e-49de-8209-f645cbc9672c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:18.434789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780a63e-5371-45fb-a68c-1282634994a0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:18.455836 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3642/7287] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:24:18.460857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780a63e-5371-45fb-a68c-1282634994a0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:18.468420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbe060-1b8e-49de-8209-f645cbc9672c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:18.471706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780a63e-5371-45fb-a68c-1282634994a0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:18.480505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af743177-b891-4181-80d4-d14b6b51a9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:18.481147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743177-b891-4181-80d4-d14b6b51a9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:18.481521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743177-b891-4181-80d4-d14b6b51a9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:18.481741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743177-b891-4181-80d4-d14b6b51a9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:18.484315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8271765-56c9-4480-b547-68c18eefa69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:18.484876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af743177-b891-4181-80d4-d14b6b51a9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:18.485434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8271765-56c9-4480-b547-68c18eefa69c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:18.485932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8271765-56c9-4480-b547-68c18eefa69c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:18.487938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af743177-b891-4181-80d4-d14b6b51a9c9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:18.488269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8271765-56c9-4480-b547-68c18eefa69c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:18.489186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8271765-56c9-4480-b547-68c18eefa69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:18.492468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8271765-56c9-4480-b547-68c18eefa69c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:18.508221 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3643/7288] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:24:18.512440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8271765-56c9-4480-b547-68c18eefa69c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:18.527375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8271765-56c9-4480-b547-68c18eefa69c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:18.538025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bae23-eb0e-4928-83fd-1444229c7e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:18.539255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bae23-eb0e-4928-83fd-1444229c7e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:18.539751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bae23-eb0e-4928-83fd-1444229c7e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:18.540266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bae23-eb0e-4928-83fd-1444229c7e75 admin admin] PATH_INFO: `/v3/projects/19300678172b4ddf8ec9dfe3b0a56438/users/9d1b9307efb74379a66c4cac79c8b82d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:18.552657 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3646/7289] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:24:18 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:24:18.557909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af743177-b891-4181-80d4-d14b6b51a9c9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:18.583289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bae23-eb0e-4928-83fd-1444229c7e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19300678172b4ddf8ec9dfe3b0a56438, user_id=9d1b9307efb74379a66c4cac79c8b82d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:18.587887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bae23-eb0e-4928-83fd-1444229c7e75 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:18.606454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:18.626562 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3644/7290] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:24:18 2022] PUT /identity/v3/projects/19300678172b4ddf8ec9dfe3b0a56438/users/9d1b9307efb74379a66c4cac79c8b82d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:18.630510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023640d-34d5-41e2-8c0e-2fc2ba23860a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:18.630832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023640d-34d5-41e2-8c0e-2fc2ba23860a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:18.632408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023640d-34d5-41e2-8c0e-2fc2ba23860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:18.656762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f023640d-34d5-41e2-8c0e-2fc2ba23860a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:18.658532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f023640d-34d5-41e2-8c0e-2fc2ba23860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:18.713712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af743177-b891-4181-80d4-d14b6b51a9c9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:18.755383 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3645/7291] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:18.771761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023640d-34d5-41e2-8c0e-2fc2ba23860a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:18.771761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f023640d-34d5-41e2-8c0e-2fc2ba23860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:18.800051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742a79-3bef-44cf-9794-baaf47c8896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:18.800637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742a79-3bef-44cf-9794-baaf47c8896a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:18.800928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742a79-3bef-44cf-9794-baaf47c8896a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:18.801257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742a79-3bef-44cf-9794-baaf47c8896a admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:18.801963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742a79-3bef-44cf-9794-baaf47c8896a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:18.805714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742a79-3bef-44cf-9794-baaf47c8896a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:18.836533 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3647/7292] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:24:18 2022] POST /identity/v3/users => generated 301 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:24:18.837576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742a79-3bef-44cf-9794-baaf47c8896a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:18.850258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742a79-3bef-44cf-9794-baaf47c8896a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:18.856882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11971b-6b98-483d-94b1-a2ce31813e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:18.858072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11971b-6b98-483d-94b1-a2ce31813e60 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:18.858072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11971b-6b98-483d-94b1-a2ce31813e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:18.858276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11971b-6b98-483d-94b1-a2ce31813e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:18.858908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11971b-6b98-483d-94b1-a2ce31813e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:18.860620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11971b-6b98-483d-94b1-a2ce31813e60 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:18.875228 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3648/7293] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:24:18.879647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11971b-6b98-483d-94b1-a2ce31813e60 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:18.883155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023640d-34d5-41e2-8c0e-2fc2ba23860a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:18.888479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31601204-0c4b-4681-89ce-adaa8d108dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:18.889938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31601204-0c4b-4681-89ce-adaa8d108dbd service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:18.890668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31601204-0c4b-4681-89ce-adaa8d108dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:18.891853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31601204-0c4b-4681-89ce-adaa8d108dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:18.891965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11971b-6b98-483d-94b1-a2ce31813e60 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:18.898299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be412fa-a2eb-4df7-a3c0-14510264aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:18.898993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be412fa-a2eb-4df7-a3c0-14510264aa98 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:18.899309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be412fa-a2eb-4df7-a3c0-14510264aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:18.899553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be412fa-a2eb-4df7-a3c0-14510264aa98 admin admin] PATH_INFO: `/v3/projects/c6634f6c2ab74082ab1874a189df8ee0/users/649710053d984a47877f0e4f0462abe4/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:18.908565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31601204-0c4b-4681-89ce-adaa8d108dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:18.910357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31601204-0c4b-4681-89ce-adaa8d108dbd service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:18.920263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:18.926493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be412fa-a2eb-4df7-a3c0-14510264aa98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6634f6c2ab74082ab1874a189df8ee0, user_id=649710053d984a47877f0e4f0462abe4, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:18.927463 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3646/7294] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:24:18.932302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be412fa-a2eb-4df7-a3c0-14510264aa98 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:18.967287 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3649/7295] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:24:18 2022] PUT /identity/v3/projects/c6634f6c2ab74082ab1874a189df8ee0/users/649710053d984a47877f0e4f0462abe4/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:18.980011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cdf75-eee8-4bda-a84a-56a04a7aa1a6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:18.980367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cdf75-eee8-4bda-a84a-56a04a7aa1a6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:18.980712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cdf75-eee8-4bda-a84a-56a04a7aa1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:19.029148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ce6cdf75-eee8-4bda-a84a-56a04a7aa1a6 None None] MFA Rules not processed for user `649710053d984a47877f0e4f0462abe4`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:19.030966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ce6cdf75-eee8-4bda-a84a-56a04a7aa1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:19.180785 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3647/7296] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:18 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:19.215949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be412fa-a2eb-4df7-a3c0-14510264aa98 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:19.218105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1be412fa-a2eb-4df7-a3c0-14510264aa98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:19.333301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be412fa-a2eb-4df7-a3c0-14510264aa98 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:19.341961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51772aba-e0da-471a-b57f-e3ee5b166e4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:19.343325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772aba-e0da-471a-b57f-e3ee5b166e4d service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:19.343814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772aba-e0da-471a-b57f-e3ee5b166e4d service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:19.344308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772aba-e0da-471a-b57f-e3ee5b166e4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:19.359816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51772aba-e0da-471a-b57f-e3ee5b166e4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:19.361619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51772aba-e0da-471a-b57f-e3ee5b166e4d service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:19.374229 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3650/7297] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:24:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:24:20.484656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cdf75-eee8-4bda-a84a-56a04a7aa1a6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:20.590540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cdf75-eee8-4bda-a84a-56a04a7aa1a6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:20.602299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:20.604438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:20.604746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:20.605015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] PATH_INFO: `/v3/users/0b7ad27b7ee348eb96f9abb60ed1fc8f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:20.606446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7ad27b7ee348eb96f9abb60ed1fc8f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:20.608526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:20.696171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7ad27b7ee348eb96f9abb60ed1fc8f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:20.710834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7ad27b7ee348eb96f9abb60ed1fc8f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:20.712147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7ad27b7ee348eb96f9abb60ed1fc8f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:20.729073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7ad27b7ee348eb96f9abb60ed1fc8f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:20.730717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7ad27b7ee348eb96f9abb60ed1fc8f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:20.764561 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3648/7298] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:24:20 2022] DELETE /identity/v3/users/0b7ad27b7ee348eb96f9abb60ed1fc8f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:20.766411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d1de0-81f5-419f-957c-4094b8b0f3c1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:20.766913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d1de0-81f5-419f-957c-4094b8b0f3c1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:20.767160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d1de0-81f5-419f-957c-4094b8b0f3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:20.801210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f39d1de0-81f5-419f-957c-4094b8b0f3c1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:20.806324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f39d1de0-81f5-419f-957c-4094b8b0f3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:20.821528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:20.952722 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3651/7299] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:20.985505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:20.987161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:21.007114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:21.091174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710736db-f78f-4aff-865e-87d4e191e1bf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:21.095800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead591-8814-4271-9473-d3358936bed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:21.097739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead591-8814-4271-9473-d3358936bed8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:21.098031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead591-8814-4271-9473-d3358936bed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:21.098359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead591-8814-4271-9473-d3358936bed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:21.115019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ead591-8814-4271-9473-d3358936bed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:21.115019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ead591-8814-4271-9473-d3358936bed8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:21.133253 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3649/7300] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:21.863259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d1de0-81f5-419f-957c-4094b8b0f3c1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:21.864735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f39d1de0-81f5-419f-957c-4094b8b0f3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:21.893865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d1de0-81f5-419f-957c-4094b8b0f3c1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:21.920111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:21.921530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:21.923175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:21.923603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] PATH_INFO: `/v3/projects/f1c3262fde754dea8c59f9f8c7ff9758` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:21.925148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c3262fde754dea8c59f9f8c7ff9758)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:21.929126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:22.010382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c3262fde754dea8c59f9f8c7ff9758', 'request_id': 'req-b042985d-336b-4296-8848-e2973115c981'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:22.031313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c3262fde754dea8c59f9f8c7ff9758', 'request_id': 'req-b042985d-336b-4296-8848-e2973115c981'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:22.039925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c3262fde754dea8c59f9f8c7ff9758', 'request_id': 'req-b042985d-336b-4296-8848-e2973115c981'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:22.062539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] The token cache is being invalidate because project f1c3262fde754dea8c59f9f8c7ff9758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:24:22.063102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:22.063932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:22.066934 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3652/7301] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:24:21 2022] DELETE /identity/v3/projects/f1c3262fde754dea8c59f9f8c7ff9758 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:22.072738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead591-8814-4271-9473-d3358936bed8 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:22.092799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead591-8814-4271-9473-d3358936bed8 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:22.246828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffb6a3-fc97-4912-84ac-7c56822e08c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:22.249342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffb6a3-fc97-4912-84ac-7c56822e08c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:22.249342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffb6a3-fc97-4912-84ac-7c56822e08c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:22.257134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffb6a3-fc97-4912-84ac-7c56822e08c2 admin admin] PATH_INFO: `/v3/users/649710053d984a47877f0e4f0462abe4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:22.259380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffb6a3-fc97-4912-84ac-7c56822e08c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=649710053d984a47877f0e4f0462abe4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:22.262268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffb6a3-fc97-4912-84ac-7c56822e08c2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:22.384309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fbffb6a3-fc97-4912-84ac-7c56822e08c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649710053d984a47877f0e4f0462abe4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:22.398162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fbffb6a3-fc97-4912-84ac-7c56822e08c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649710053d984a47877f0e4f0462abe4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:22.399210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fbffb6a3-fc97-4912-84ac-7c56822e08c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649710053d984a47877f0e4f0462abe4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:22.417351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fbffb6a3-fc97-4912-84ac-7c56822e08c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649710053d984a47877f0e4f0462abe4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:22.417567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fbffb6a3-fc97-4912-84ac-7c56822e08c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649710053d984a47877f0e4f0462abe4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:22.445744 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3650/7302] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:24:22 2022] DELETE /identity/v3/users/649710053d984a47877f0e4f0462abe4 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:24:22.965513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:22.967455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:22.997109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042985d-336b-4296-8848-e2973115c981 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:23.182178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:23.182913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:23.183826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:23.184836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] PATH_INFO: `/v3/users/7b5116f0170346a9a81f765cb44bb2cd` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:23.189358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5116f0170346a9a81f765cb44bb2cd)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:23.191599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:23.308138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:23.329925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5116f0170346a9a81f765cb44bb2cd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:23.367119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5116f0170346a9a81f765cb44bb2cd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:23.369740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5116f0170346a9a81f765cb44bb2cd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:23.431850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5116f0170346a9a81f765cb44bb2cd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:23.434435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5116f0170346a9a81f765cb44bb2cd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:23.480992 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3653/7303] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:24:22 2022] DELETE /identity/v3/users/7b5116f0170346a9a81f765cb44bb2cd => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:23.485830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb2b23-e30c-41b0-bb7c-cee7d55da08c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:23.486627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb2b23-e30c-41b0-bb7c-cee7d55da08c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:23.487084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb2b23-e30c-41b0-bb7c-cee7d55da08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:23.531088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8fdb2b23-e30c-41b0-bb7c-cee7d55da08c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:23.532569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8fdb2b23-e30c-41b0-bb7c-cee7d55da08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:23.613798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:23.721727 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3651/7304] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:23.744366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:23.745943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:23.873810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcef62-db22-44dd-92b7-279529c0b2a1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:23.887697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8660dc9-840f-403f-b87c-797621a19548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:23.888256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8660dc9-840f-403f-b87c-797621a19548 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:23.888545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8660dc9-840f-403f-b87c-797621a19548 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:23.888828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8660dc9-840f-403f-b87c-797621a19548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:23.914433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8660dc9-840f-403f-b87c-797621a19548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:23.916008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8660dc9-840f-403f-b87c-797621a19548 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:23.940974 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3654/7305] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:24.193082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb2b23-e30c-41b0-bb7c-cee7d55da08c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:24.195616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8fdb2b23-e30c-41b0-bb7c-cee7d55da08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:24.216375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb2b23-e30c-41b0-bb7c-cee7d55da08c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:24.225194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484771b-19a0-4f60-bcfc-a79c5428d42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:24.226215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484771b-19a0-4f60-bcfc-a79c5428d42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:24.226378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484771b-19a0-4f60-bcfc-a79c5428d42a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:24.227495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484771b-19a0-4f60-bcfc-a79c5428d42a admin admin] PATH_INFO: `/v3/projects/c6634f6c2ab74082ab1874a189df8ee0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:24.229653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484771b-19a0-4f60-bcfc-a79c5428d42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6634f6c2ab74082ab1874a189df8ee0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:24.232499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484771b-19a0-4f60-bcfc-a79c5428d42a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:24.368348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6484771b-19a0-4f60-bcfc-a79c5428d42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6634f6c2ab74082ab1874a189df8ee0', 'request_id': 'req-6484771b-19a0-4f60-bcfc-a79c5428d42a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:24.403702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6484771b-19a0-4f60-bcfc-a79c5428d42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6634f6c2ab74082ab1874a189df8ee0', 'request_id': 'req-6484771b-19a0-4f60-bcfc-a79c5428d42a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:24.426694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6484771b-19a0-4f60-bcfc-a79c5428d42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6634f6c2ab74082ab1874a189df8ee0', 'request_id': 'req-6484771b-19a0-4f60-bcfc-a79c5428d42a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:24.484797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6484771b-19a0-4f60-bcfc-a79c5428d42a admin admin] The token cache is being invalidate because project c6634f6c2ab74082ab1874a189df8ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:24:24.485333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6484771b-19a0-4f60-bcfc-a79c5428d42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:24.486640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6484771b-19a0-4f60-bcfc-a79c5428d42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:24.488750 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3652/7306] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:24:24 2022] DELETE /identity/v3/projects/c6634f6c2ab74082ab1874a189df8ee0 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:25.623678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8660dc9-840f-403f-b87c-797621a19548 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:25.625945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b8660dc9-840f-403f-b87c-797621a19548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:25.666334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8660dc9-840f-403f-b87c-797621a19548 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:25.848173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfbc0a-d785-430b-8ae7-3d48717bb809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:25.848842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfbc0a-d785-430b-8ae7-3d48717bb809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:25.849125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfbc0a-d785-430b-8ae7-3d48717bb809 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:25.849394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfbc0a-d785-430b-8ae7-3d48717bb809 admin admin] PATH_INFO: `/v3/projects/191b713b07314031aacf24b243635fb3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:25.853782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfbc0a-d785-430b-8ae7-3d48717bb809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=191b713b07314031aacf24b243635fb3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:25.856514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfbc0a-d785-430b-8ae7-3d48717bb809 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:25.937472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80cfbc0a-d785-430b-8ae7-3d48717bb809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '191b713b07314031aacf24b243635fb3', 'request_id': 'req-80cfbc0a-d785-430b-8ae7-3d48717bb809'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:25.957611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80cfbc0a-d785-430b-8ae7-3d48717bb809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '191b713b07314031aacf24b243635fb3', 'request_id': 'req-80cfbc0a-d785-430b-8ae7-3d48717bb809'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:25.962278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:25.969375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80cfbc0a-d785-430b-8ae7-3d48717bb809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '191b713b07314031aacf24b243635fb3', 'request_id': 'req-80cfbc0a-d785-430b-8ae7-3d48717bb809'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:25.987801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80cfbc0a-d785-430b-8ae7-3d48717bb809 admin admin] The token cache is being invalidate because project 191b713b07314031aacf24b243635fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:24:25.989073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80cfbc0a-d785-430b-8ae7-3d48717bb809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:25.995880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-80cfbc0a-d785-430b-8ae7-3d48717bb809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:24:25.998712 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3655/7307] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:24:25 2022] DELETE /identity/v3/projects/191b713b07314031aacf24b243635fb3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:26.003621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbc727-2f00-40c9-a231-b239c6fb529b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:26.004590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbc727-2f00-40c9-a231-b239c6fb529b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:26.005107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbc727-2f00-40c9-a231-b239c6fb529b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:26.037270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f8dbc727-2f00-40c9-a231-b239c6fb529b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:26.039168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f8dbc727-2f00-40c9-a231-b239c6fb529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:26.116982 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3653/7308] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:26.124769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227ce1f-82a4-499a-add2-1f9cc5b929d7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:26.125272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227ce1f-82a4-499a-add2-1f9cc5b929d7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:26.125623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227ce1f-82a4-499a-add2-1f9cc5b929d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:26.153458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4227ce1f-82a4-499a-add2-1f9cc5b929d7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:26.155046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4227ce1f-82a4-499a-add2-1f9cc5b929d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:26.165014 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3656/7309] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:26.169150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbc727-2f00-40c9-a231-b239c6fb529b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:26.180054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbc727-2f00-40c9-a231-b239c6fb529b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:26.186331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a30dae-cd48-4f28-b3f2-b73533971f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:26.187385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a30dae-cd48-4f28-b3f2-b73533971f1c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:26.187835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a30dae-cd48-4f28-b3f2-b73533971f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:26.188297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a30dae-cd48-4f28-b3f2-b73533971f1c admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:26.189159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a30dae-cd48-4f28-b3f2-b73533971f1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:24:26.189630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a30dae-cd48-4f28-b3f2-b73533971f1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:26.191815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a30dae-cd48-4f28-b3f2-b73533971f1c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:26.208836 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3654/7310] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:24:26.213905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227ce1f-82a4-499a-add2-1f9cc5b929d7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:26.225133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227ce1f-82a4-499a-add2-1f9cc5b929d7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:26.236895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e81317-77c7-43fb-8c72-04e8c33d7f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:26.237526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81317-77c7-43fb-8c72-04e8c33d7f90 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:26.238935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81317-77c7-43fb-8c72-04e8c33d7f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:26.239316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e81317-77c7-43fb-8c72-04e8c33d7f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:26.240140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e81317-77c7-43fb-8c72-04e8c33d7f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:26.243466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e81317-77c7-43fb-8c72-04e8c33d7f90 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:26.306725 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3657/7311] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:24:26 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:24:26.310512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a30dae-cd48-4f28-b3f2-b73533971f1c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:26.325835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a30dae-cd48-4f28-b3f2-b73533971f1c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:26.389305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:26.416119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0f785-0a96-48a9-86e9-011caf6804a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:26.417040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0f785-0a96-48a9-86e9-011caf6804a8 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:26.417529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0f785-0a96-48a9-86e9-011caf6804a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:26.418142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0f785-0a96-48a9-86e9-011caf6804a8 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:26.418962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0f785-0a96-48a9-86e9-011caf6804a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:26.422059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0f785-0a96-48a9-86e9-011caf6804a8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:26.462730 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3655/7312] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:24:26 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:24:26.466589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e81317-77c7-43fb-8c72-04e8c33d7f90 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:26.482963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e81317-77c7-43fb-8c72-04e8c33d7f90 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:26.497699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4d034-81da-4eaf-9a46-717393651b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:26.498889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4d034-81da-4eaf-9a46-717393651b9a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:26.499351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4d034-81da-4eaf-9a46-717393651b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:26.499959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4d034-81da-4eaf-9a46-717393651b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:26.500881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4d034-81da-4eaf-9a46-717393651b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:26.503176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4d034-81da-4eaf-9a46-717393651b9a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:26.525192 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3658/7313] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:24:26.530146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0f785-0a96-48a9-86e9-011caf6804a8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:26.557852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0f785-0a96-48a9-86e9-011caf6804a8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:26.578826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247235d9-bcef-46ad-af17-0c13f8d5f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:26.579558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247235d9-bcef-46ad-af17-0c13f8d5f11e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:26.579852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247235d9-bcef-46ad-af17-0c13f8d5f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:26.580163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247235d9-bcef-46ad-af17-0c13f8d5f11e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:26.580780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247235d9-bcef-46ad-af17-0c13f8d5f11e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:26.595099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247235d9-bcef-46ad-af17-0c13f8d5f11e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:26.606959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aba7ab-32b6-4b1b-81a2-ef3e42cdf36a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:26.607261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aba7ab-32b6-4b1b-81a2-ef3e42cdf36a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:26.607538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aba7ab-32b6-4b1b-81a2-ef3e42cdf36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:26.625634 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3656/7314] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:24:26.629428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247235d9-bcef-46ad-af17-0c13f8d5f11e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:26.641870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247235d9-bcef-46ad-af17-0c13f8d5f11e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:26.647040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51d07c-3e47-4075-98b6-c2faf1d3feb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:26.647883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d07c-3e47-4075-98b6-c2faf1d3feb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:26.648227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d07c-3e47-4075-98b6-c2faf1d3feb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:26.648424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51d07c-3e47-4075-98b6-c2faf1d3feb0 admin admin] PATH_INFO: `/v3/projects/262060731a07436faf9fe062198b01ef/users/70c455f210244be2a8c2fff0199c2fd0/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:26.673592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51d07c-3e47-4075-98b6-c2faf1d3feb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262060731a07436faf9fe062198b01ef, user_id=70c455f210244be2a8c2fff0199c2fd0, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:26.676749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51d07c-3e47-4075-98b6-c2faf1d3feb0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:26.699068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b3aba7ab-32b6-4b1b-81a2-ef3e42cdf36a None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:26.701477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b3aba7ab-32b6-4b1b-81a2-ef3e42cdf36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:26.721481 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3657/7315] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:24:26 2022] PUT /identity/v3/projects/262060731a07436faf9fe062198b01ef/users/70c455f210244be2a8c2fff0199c2fd0/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:24:26.723400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af99101-3e36-4d3b-9826-258afedbdf2d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:26.730268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af99101-3e36-4d3b-9826-258afedbdf2d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:26.730675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af99101-3e36-4d3b-9826-258afedbdf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:26.774417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0af99101-3e36-4d3b-9826-258afedbdf2d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:26.779582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0af99101-3e36-4d3b-9826-258afedbdf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:26.831974 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3659/7316] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:24:26.844489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4952e-4655-4e43-a122-a26198783e3e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:26.846083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4952e-4655-4e43-a122-a26198783e3e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:26.846621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4952e-4655-4e43-a122-a26198783e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:26.897819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ccf4952e-4655-4e43-a122-a26198783e3e None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:26.899276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ccf4952e-4655-4e43-a122-a26198783e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:26.919131 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3660/7317] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:26.933587 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3658/7318] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:26.942002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4952e-4655-4e43-a122-a26198783e3e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:26.944045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ccf4952e-4655-4e43-a122-a26198783e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:26.947810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af99101-3e36-4d3b-9826-258afedbdf2d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:26.949954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0af99101-3e36-4d3b-9826-258afedbdf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:27.094842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af99101-3e36-4d3b-9826-258afedbdf2d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:27.109956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a4253-ede6-48ab-92c0-99112243e092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:27.110912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4253-ede6-48ab-92c0-99112243e092 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:27.111300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4253-ede6-48ab-92c0-99112243e092 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:27.111660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4253-ede6-48ab-92c0-99112243e092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:27.137292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4952e-4655-4e43-a122-a26198783e3e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:27.147549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a4253-ede6-48ab-92c0-99112243e092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:27.147795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f28f9-9094-4665-81c3-785c08015271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:27.148885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f28f9-9094-4665-81c3-785c08015271 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:27.149182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f28f9-9094-4665-81c3-785c08015271 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:27.149313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a4253-ede6-48ab-92c0-99112243e092 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:27.149473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f28f9-9094-4665-81c3-785c08015271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:27.159803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f28f9-9094-4665-81c3-785c08015271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:27.161458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f28f9-9094-4665-81c3-785c08015271 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:27.175485 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3661/7319] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:27.182901 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3659/7320] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:24:28.854072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f28f9-9094-4665-81c3-785c08015271 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:28.856357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-094f28f9-9094-4665-81c3-785c08015271 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:28.915106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:29.076426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94f078-ca5a-41b6-a537-565a42443c55 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:29.077391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94f078-ca5a-41b6-a537-565a42443c55 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:29.077915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94f078-ca5a-41b6-a537-565a42443c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:29.090245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f28f9-9094-4665-81c3-785c08015271 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:29.095917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc2cf9-a987-469f-b046-63cf1b6bf8d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:29.096748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc2cf9-a987-469f-b046-63cf1b6bf8d3 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:29.097203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc2cf9-a987-469f-b046-63cf1b6bf8d3 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:29.097661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc2cf9-a987-469f-b046-63cf1b6bf8d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:29.100926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-88dc2cf9-a987-469f-b046-63cf1b6bf8d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:29.115817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc2cf9-a987-469f-b046-63cf1b6bf8d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:29.118041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc2cf9-a987-469f-b046-63cf1b6bf8d3 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:29.118678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fb94f078-ca5a-41b6-a537-565a42443c55 None None] MFA Rules not processed for user `70c455f210244be2a8c2fff0199c2fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:29.121942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fb94f078-ca5a-41b6-a537-565a42443c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:29.132962 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3662/7321] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:29.180085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:29.246679 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3660/7322] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:29.257328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc2cf9-a987-469f-b046-63cf1b6bf8d3 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:29.258792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-88dc2cf9-a987-469f-b046-63cf1b6bf8d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:29.414586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc2cf9-a987-469f-b046-63cf1b6bf8d3 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:29.419540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d1319-8d28-42fb-9a3e-dd48bcaa36cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:29.420657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d1319-8d28-42fb-9a3e-dd48bcaa36cf service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:29.420657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d1319-8d28-42fb-9a3e-dd48bcaa36cf service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:29.420969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d1319-8d28-42fb-9a3e-dd48bcaa36cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:29.431761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d1319-8d28-42fb-9a3e-dd48bcaa36cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:29.434188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d1319-8d28-42fb-9a3e-dd48bcaa36cf service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:29.453535 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3663/7323] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:33.683516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dadde7-8f4d-43ee-9e5e-18a77af11894 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:33.686060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dadde7-8f4d-43ee-9e5e-18a77af11894 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:33.686643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dadde7-8f4d-43ee-9e5e-18a77af11894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:33.746705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-51dadde7-8f4d-43ee-9e5e-18a77af11894 None None] MFA Rules not processed for user `70c455f210244be2a8c2fff0199c2fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:33.748220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-51dadde7-8f4d-43ee-9e5e-18a77af11894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:33.756536 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3661/7324] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:39.112512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f34ae-da33-4f4d-9dfe-564c78cac7fc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:39.118110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f34ae-da33-4f4d-9dfe-564c78cac7fc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:39.118632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f34ae-da33-4f4d-9dfe-564c78cac7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:39.155042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0c3f34ae-da33-4f4d-9dfe-564c78cac7fc None None] MFA Rules not processed for user `d0bd3c83dff64f27bd048defad379622`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:39.157324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0c3f34ae-da33-4f4d-9dfe-564c78cac7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:39.268023 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3664/7325] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:43.733442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=17 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:45.123735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f0795-a25d-4063-ab0d-1c26aba2b3f7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:45.124786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f0795-a25d-4063-ab0d-1c26aba2b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:45.125231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f0795-a25d-4063-ab0d-1c26aba2b3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:45.167929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e34f0795-a25d-4063-ab0d-1c26aba2b3f7 None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:45.169549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e34f0795-a25d-4063-ab0d-1c26aba2b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:45.188258 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3662/7326] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:24:46.473240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f34ae-da33-4f4d-9dfe-564c78cac7fc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:46.500968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f34ae-da33-4f4d-9dfe-564c78cac7fc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:46.508832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221fa67-f0cf-4e72-8546-144196d4d186 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:46.509861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221fa67-f0cf-4e72-8546-144196d4d186 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:46.510314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221fa67-f0cf-4e72-8546-144196d4d186 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:46.510883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221fa67-f0cf-4e72-8546-144196d4d186 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:46.514158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7221fa67-f0cf-4e72-8546-144196d4d186 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:46.530464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221fa67-f0cf-4e72-8546-144196d4d186 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:46.532285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221fa67-f0cf-4e72-8546-144196d4d186 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:46.554911 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3665/7327] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:47.506316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f0795-a25d-4063-ab0d-1c26aba2b3f7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:24:47.508546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e34f0795-a25d-4063-ab0d-1c26aba2b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:47.537373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f0795-a25d-4063-ab0d-1c26aba2b3f7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:24:47.551018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0b4ca-04c3-43ed-b23f-553ee75ef290 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:24:47.568004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0b4ca-04c3-43ed-b23f-553ee75ef290 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:47.570136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0b4ca-04c3-43ed-b23f-553ee75ef290 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:47.570646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0b4ca-04c3-43ed-b23f-553ee75ef290 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:47.582601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-74d0b4ca-04c3-43ed-b23f-553ee75ef290 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:47.641679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0b4ca-04c3-43ed-b23f-553ee75ef290 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:24:47.643397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0b4ca-04c3-43ed-b23f-553ee75ef290 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:24:47.683761 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3663/7328] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:24:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:24:55.054459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc28d78-b078-43e1-80bb-d16856944f83 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:55.055957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc28d78-b078-43e1-80bb-d16856944f83 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:55.056507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc28d78-b078-43e1-80bb-d16856944f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:55.112747 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3dc28d78-b078-43e1-80bb-d16856944f83 None None] MFA Rules not processed for user `f966cae595b14bdf921bd3e72f652611`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:55.115245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3dc28d78-b078-43e1-80bb-d16856944f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:55.189459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:24:55.223172 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3666/7329] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:24:55.396980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6ddc5-42fb-4c4f-8d89-9ac3c2698e52 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:24:55.397717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6ddc5-42fb-4c4f-8d89-9ac3c2698e52 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:24:55.397717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6ddc5-42fb-4c4f-8d89-9ac3c2698e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:24:55.432973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9db6ddc5-42fb-4c4f-8d89-9ac3c2698e52 None None] MFA Rules not processed for user `70c455f210244be2a8c2fff0199c2fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:24:55.435324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9db6ddc5-42fb-4c4f-8d89-9ac3c2698e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:24:55.448252 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3664/7330] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:24:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:05.213373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=8 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:05.425181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=12 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:11.274244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d77ea-522b-4b1d-a3e0-be2d7f516f3d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:11.275394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d77ea-522b-4b1d-a3e0-be2d7f516f3d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:11.275878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d77ea-522b-4b1d-a3e0-be2d7f516f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:11.311780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f85d77ea-522b-4b1d-a3e0-be2d7f516f3d None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:11.314186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f85d77ea-522b-4b1d-a3e0-be2d7f516f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:11.337659 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3667/7331] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:25:13.187609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6ddc5-42fb-4c4f-8d89-9ac3c2698e52 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:13.189123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9db6ddc5-42fb-4c4f-8d89-9ac3c2698e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:13.206128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6ddc5-42fb-4c4f-8d89-9ac3c2698e52 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:13.212098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ca229-681b-479f-a5fe-4519ac9431c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:13.212850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ca229-681b-479f-a5fe-4519ac9431c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:13.213200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ca229-681b-479f-a5fe-4519ac9431c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:13.213479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ca229-681b-479f-a5fe-4519ac9431c3 admin admin] PATH_INFO: `/v3/users/a5d58a21e2424844b32d95dc431b86b3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:13.214635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ca229-681b-479f-a5fe-4519ac9431c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d58a21e2424844b32d95dc431b86b3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:13.217258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ca229-681b-479f-a5fe-4519ac9431c3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:13.281460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-866ca229-681b-479f-a5fe-4519ac9431c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d58a21e2424844b32d95dc431b86b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:13.291979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-866ca229-681b-479f-a5fe-4519ac9431c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d58a21e2424844b32d95dc431b86b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:13.292750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-866ca229-681b-479f-a5fe-4519ac9431c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d58a21e2424844b32d95dc431b86b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:13.301666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-866ca229-681b-479f-a5fe-4519ac9431c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d58a21e2424844b32d95dc431b86b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:13.302773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-866ca229-681b-479f-a5fe-4519ac9431c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d58a21e2424844b32d95dc431b86b3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:13.338432 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3665/7332] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:25:13 2022] DELETE /identity/v3/users/a5d58a21e2424844b32d95dc431b86b3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:13.343764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05ca69-3dec-43cb-b958-bd49c7969790 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:13.344258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05ca69-3dec-43cb-b958-bd49c7969790 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:13.348377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05ca69-3dec-43cb-b958-bd49c7969790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:13.369694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7e05ca69-3dec-43cb-b958-bd49c7969790 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:13.370669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7e05ca69-3dec-43cb-b958-bd49c7969790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:13.411884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d021e61-1cc9-4863-a75c-994a278e1f02 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:13.412607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d021e61-1cc9-4863-a75c-994a278e1f02 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:13.413067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d021e61-1cc9-4863-a75c-994a278e1f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:13.433345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6d021e61-1cc9-4863-a75c-994a278e1f02 None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:13.434642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6d021e61-1cc9-4863-a75c-994a278e1f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:13.438798 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3668/7333] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:13.450162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05ca69-3dec-43cb-b958-bd49c7969790 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:13.451981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7e05ca69-3dec-43cb-b958-bd49c7969790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:13.517523 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3666/7334] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:25:13.521435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05ca69-3dec-43cb-b958-bd49c7969790 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:13.525636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f91d5-521b-4fd7-9cf3-737adef3d650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:13.526970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f91d5-521b-4fd7-9cf3-737adef3d650 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:13.527399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f91d5-521b-4fd7-9cf3-737adef3d650 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:13.527746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f91d5-521b-4fd7-9cf3-737adef3d650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:13.538229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f91d5-521b-4fd7-9cf3-737adef3d650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:13.539986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f91d5-521b-4fd7-9cf3-737adef3d650 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:13.553227 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3669/7335] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:25:13.768115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d021e61-1cc9-4863-a75c-994a278e1f02 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:13.770903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6d021e61-1cc9-4863-a75c-994a278e1f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:13.804369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d021e61-1cc9-4863-a75c-994a278e1f02 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:13.812982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df60dd-5d49-4520-98cf-faa53adf6ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:13.812982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df60dd-5d49-4520-98cf-faa53adf6ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:13.812982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df60dd-5d49-4520-98cf-faa53adf6ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:13.812982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df60dd-5d49-4520-98cf-faa53adf6ebc admin admin] PATH_INFO: `/v3/projects/00c0f95cf441423c9e85121c00fea8c8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:13.814033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df60dd-5d49-4520-98cf-faa53adf6ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c0f95cf441423c9e85121c00fea8c8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:13.816316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df60dd-5d49-4520-98cf-faa53adf6ebc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:13.885512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95df60dd-5d49-4520-98cf-faa53adf6ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c0f95cf441423c9e85121c00fea8c8', 'request_id': 'req-95df60dd-5d49-4520-98cf-faa53adf6ebc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:13.894451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95df60dd-5d49-4520-98cf-faa53adf6ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c0f95cf441423c9e85121c00fea8c8', 'request_id': 'req-95df60dd-5d49-4520-98cf-faa53adf6ebc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:13.904197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95df60dd-5d49-4520-98cf-faa53adf6ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c0f95cf441423c9e85121c00fea8c8', 'request_id': 'req-95df60dd-5d49-4520-98cf-faa53adf6ebc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:13.921347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:13.926831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95df60dd-5d49-4520-98cf-faa53adf6ebc admin admin] The token cache is being invalidate because project 00c0f95cf441423c9e85121c00fea8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:25:13.927765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95df60dd-5d49-4520-98cf-faa53adf6ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:13.928935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95df60dd-5d49-4520-98cf-faa53adf6ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:13.930793 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3667/7336] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:25:13 2022] DELETE /identity/v3/projects/00c0f95cf441423c9e85121c00fea8c8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:13.935627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c82a2b-83c5-45a3-81b0-c37dd55bb51b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:13.935918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c82a2b-83c5-45a3-81b0-c37dd55bb51b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:13.936197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c82a2b-83c5-45a3-81b0-c37dd55bb51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:13.956137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c1c82a2b-83c5-45a3-81b0-c37dd55bb51b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:13.957930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c1c82a2b-83c5-45a3-81b0-c37dd55bb51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:14.024488 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3670/7337] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:14.032462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3129c3-9da0-48d3-b34f-5b271d96b34a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:14.032750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3129c3-9da0-48d3-b34f-5b271d96b34a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:14.033024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3129c3-9da0-48d3-b34f-5b271d96b34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:14.054648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5f3129c3-9da0-48d3-b34f-5b271d96b34a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:14.066764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5f3129c3-9da0-48d3-b34f-5b271d96b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:14.088256 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3668/7338] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:14.092260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c82a2b-83c5-45a3-81b0-c37dd55bb51b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:14.107846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c82a2b-83c5-45a3-81b0-c37dd55bb51b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:14.112522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff844c-17a0-4244-86be-4828fdc38282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:14.113131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff844c-17a0-4244-86be-4828fdc38282 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:14.113415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff844c-17a0-4244-86be-4828fdc38282 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:14.113884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff844c-17a0-4244-86be-4828fdc38282 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:14.114713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff844c-17a0-4244-86be-4828fdc38282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:25:14.115050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff844c-17a0-4244-86be-4828fdc38282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:14.116642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff844c-17a0-4244-86be-4828fdc38282 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:14.137580 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3671/7339] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:25:14.138735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3129c3-9da0-48d3-b34f-5b271d96b34a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:14.155890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3129c3-9da0-48d3-b34f-5b271d96b34a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:14.162835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12a0b0-ade3-4c4e-a7cd-8f3fc3a0022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:14.163333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a0b0-ade3-4c4e-a7cd-8f3fc3a0022b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:14.163505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a0b0-ade3-4c4e-a7cd-8f3fc3a0022b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:14.163783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12a0b0-ade3-4c4e-a7cd-8f3fc3a0022b admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:14.164472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12a0b0-ade3-4c4e-a7cd-8f3fc3a0022b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:14.166317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12a0b0-ade3-4c4e-a7cd-8f3fc3a0022b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:14.198594 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3669/7340] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:25:14 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:25:14.201970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff844c-17a0-4244-86be-4828fdc38282 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:14.213424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff844c-17a0-4244-86be-4828fdc38282 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:14.234722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:14.287870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91dff0-1158-4240-8fae-6b4985a46afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:14.287870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91dff0-1158-4240-8fae-6b4985a46afd admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:14.287870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91dff0-1158-4240-8fae-6b4985a46afd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:14.287870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91dff0-1158-4240-8fae-6b4985a46afd admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:14.299302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91dff0-1158-4240-8fae-6b4985a46afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:14.302066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91dff0-1158-4240-8fae-6b4985a46afd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:14.326285 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3672/7341] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:25:14 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:25:14.330395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12a0b0-ade3-4c4e-a7cd-8f3fc3a0022b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:14.343201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12a0b0-ade3-4c4e-a7cd-8f3fc3a0022b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:14.363018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5631275-f833-47a0-be9c-0863e7528f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:14.363018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631275-f833-47a0-be9c-0863e7528f62 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:14.363018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631275-f833-47a0-be9c-0863e7528f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:14.363018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631275-f833-47a0-be9c-0863e7528f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:14.363326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5631275-f833-47a0-be9c-0863e7528f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:14.363326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5631275-f833-47a0-be9c-0863e7528f62 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:14.368533 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3670/7342] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:25:14.372754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91dff0-1158-4240-8fae-6b4985a46afd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:14.384273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91dff0-1158-4240-8fae-6b4985a46afd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:14.389857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbbcae-3296-44ed-a9a8-a6ef3e36ba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:14.390469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbbcae-3296-44ed-a9a8-a6ef3e36ba8d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:14.390767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbbcae-3296-44ed-a9a8-a6ef3e36ba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:14.391059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbbcae-3296-44ed-a9a8-a6ef3e36ba8d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:14.391759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbbcae-3296-44ed-a9a8-a6ef3e36ba8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:14.393562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbbcae-3296-44ed-a9a8-a6ef3e36ba8d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:14.407333 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3673/7343] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:25:14.412536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5631275-f833-47a0-be9c-0863e7528f62 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:14.423917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5631275-f833-47a0-be9c-0863e7528f62 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:14.429831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddc541-bf60-4643-bae8-332cb4dab618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:14.431007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddc541-bf60-4643-bae8-332cb4dab618 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:14.431508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddc541-bf60-4643-bae8-332cb4dab618 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:14.431970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddc541-bf60-4643-bae8-332cb4dab618 admin admin] PATH_INFO: `/v3/projects/31572d272cc1471284400b46f3d01d25/users/a3a82c186e484a9290f1f92ad5032278/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:14.450091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddc541-bf60-4643-bae8-332cb4dab618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31572d272cc1471284400b46f3d01d25, user_id=a3a82c186e484a9290f1f92ad5032278, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:14.453220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddc541-bf60-4643-bae8-332cb4dab618 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:14.471834 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3671/7344] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:25:14 2022] PUT /identity/v3/projects/31572d272cc1471284400b46f3d01d25/users/a3a82c186e484a9290f1f92ad5032278/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:14.482854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c0ed0-881f-4d36-b2c4-92e8324bb7ec None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:14.483151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c0ed0-881f-4d36-b2c4-92e8324bb7ec None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:14.483431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c0ed0-881f-4d36-b2c4-92e8324bb7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:14.518190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4c9c0ed0-881f-4d36-b2c4-92e8324bb7ec None None] MFA Rules not processed for user `a3a82c186e484a9290f1f92ad5032278`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:14.519978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4c9c0ed0-881f-4d36-b2c4-92e8324bb7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:14.666096 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3674/7345] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:25:14.677266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddc541-bf60-4643-bae8-332cb4dab618 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:14.679242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-40ddc541-bf60-4643-bae8-332cb4dab618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:14.753380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddc541-bf60-4643-bae8-332cb4dab618 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:14.757433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d510a1-6380-4a2b-b01a-90cdda15873f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:14.758044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d510a1-6380-4a2b-b01a-90cdda15873f service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:14.758331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d510a1-6380-4a2b-b01a-90cdda15873f service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:14.758611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d510a1-6380-4a2b-b01a-90cdda15873f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:14.767809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d510a1-6380-4a2b-b01a-90cdda15873f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:14.769256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d510a1-6380-4a2b-b01a-90cdda15873f service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:14.779637 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3672/7346] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:15.692995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4f4d-3db4-4a4f-8f14-995c914e766f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:15.693576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4f4d-3db4-4a4f-8f14-995c914e766f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:15.693576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4f4d-3db4-4a4f-8f14-995c914e766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:15.715864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3b9e4f4d-3db4-4a4f-8f14-995c914e766f None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:15.717279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3b9e4f4d-3db4-4a4f-8f14-995c914e766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:15.791754 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3675/7347] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:16.231839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504b8d-d6f5-4aa4-9471-5ca4d87c12a6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:16.232511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504b8d-d6f5-4aa4-9471-5ca4d87c12a6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:16.232511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504b8d-d6f5-4aa4-9471-5ca4d87c12a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:16.251560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-65504b8d-d6f5-4aa4-9471-5ca4d87c12a6 None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:16.252802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-65504b8d-d6f5-4aa4-9471-5ca4d87c12a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:16.264951 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3673/7348] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:16.976207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae97c2f-baec-4210-a598-ab3797651087 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:16.977138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae97c2f-baec-4210-a598-ab3797651087 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:16.977628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae97c2f-baec-4210-a598-ab3797651087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:17.004025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9ae97c2f-baec-4210-a598-ab3797651087 None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:17.006081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9ae97c2f-baec-4210-a598-ab3797651087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:17.020645 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3676/7349] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:17.620073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3080af-2dcd-43b0-8fa0-083b8c3529c6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:17.621177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3080af-2dcd-43b0-8fa0-083b8c3529c6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:17.621636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3080af-2dcd-43b0-8fa0-083b8c3529c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:17.652727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0a3080af-2dcd-43b0-8fa0-083b8c3529c6 None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:17.654221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0a3080af-2dcd-43b0-8fa0-083b8c3529c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:17.677251 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3674/7350] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:18.153462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db95f6-9bc1-4c9a-b0e3-ae5698d20991 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:18.153973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db95f6-9bc1-4c9a-b0e3-ae5698d20991 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:18.154078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db95f6-9bc1-4c9a-b0e3-ae5698d20991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:18.179826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-28db95f6-9bc1-4c9a-b0e3-ae5698d20991 None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:18.182081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-28db95f6-9bc1-4c9a-b0e3-ae5698d20991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:18.192896 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3677/7351] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:18.639828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45edb86-5cd0-474f-848f-c320e9dee42f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:18.640342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45edb86-5cd0-474f-848f-c320e9dee42f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:18.640612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45edb86-5cd0-474f-848f-c320e9dee42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:18.663169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f45edb86-5cd0-474f-848f-c320e9dee42f None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:18.664402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f45edb86-5cd0-474f-848f-c320e9dee42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:18.672265 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3675/7352] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:19.260284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada7f38-8c39-40e0-8138-a947a93eb186 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:19.260914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada7f38-8c39-40e0-8138-a947a93eb186 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:19.261023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada7f38-8c39-40e0-8138-a947a93eb186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:19.294290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9ada7f38-8c39-40e0-8138-a947a93eb186 None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:19.295830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9ada7f38-8c39-40e0-8138-a947a93eb186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:19.308411 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3678/7353] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:20.633824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c25ad-9dd2-407b-8c96-c14f62cd4e21 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:20.634306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c25ad-9dd2-407b-8c96-c14f62cd4e21 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:20.634412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c25ad-9dd2-407b-8c96-c14f62cd4e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:20.668782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-de8c25ad-9dd2-407b-8c96-c14f62cd4e21 None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:20.670423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-de8c25ad-9dd2-407b-8c96-c14f62cd4e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:20.680692 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3676/7354] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:21.134568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada7f38-8c39-40e0-8138-a947a93eb186 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:21.159647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:21.212959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada7f38-8c39-40e0-8138-a947a93eb186 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:21.218251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:21.219046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:21.219428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:21.220075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] PATH_INFO: `/v3/users/a3a82c186e484a9290f1f92ad5032278` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:21.221334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a82c186e484a9290f1f92ad5032278)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:21.224149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:21.306408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a82c186e484a9290f1f92ad5032278'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:21.317062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a82c186e484a9290f1f92ad5032278'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:21.320032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a82c186e484a9290f1f92ad5032278'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:21.340810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a82c186e484a9290f1f92ad5032278'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:21.341690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a82c186e484a9290f1f92ad5032278'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:21.363980 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3679/7355] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:25:21 2022] DELETE /identity/v3/users/a3a82c186e484a9290f1f92ad5032278 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:21.368414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea46ff-f918-4a33-9455-c7dda467d489 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:21.368705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea46ff-f918-4a33-9455-c7dda467d489 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:21.368985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea46ff-f918-4a33-9455-c7dda467d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:21.402371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-43ea46ff-f918-4a33-9455-c7dda467d489 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:21.403778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-43ea46ff-f918-4a33-9455-c7dda467d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:21.532755 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3677/7356] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:21.552533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:21.555285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:21.662675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f59261-9d0f-43b7-b188-1413358ae2cb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:21.667360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3820a-5346-4c03-b7de-6f47260b5722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:21.668088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3820a-5346-4c03-b7de-6f47260b5722 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:21.668576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3820a-5346-4c03-b7de-6f47260b5722 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:21.669006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3820a-5346-4c03-b7de-6f47260b5722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:21.686677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3820a-5346-4c03-b7de-6f47260b5722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:21.688877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3820a-5346-4c03-b7de-6f47260b5722 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:21.702003 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3680/7357] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:22.320506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea46ff-f918-4a33-9455-c7dda467d489 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:22.322125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-43ea46ff-f918-4a33-9455-c7dda467d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:22.352283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea46ff-f918-4a33-9455-c7dda467d489 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:22.376879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbeef8-42d4-460d-be15-14e3d9b99f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:22.377549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbeef8-42d4-460d-be15-14e3d9b99f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:22.377898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbeef8-42d4-460d-be15-14e3d9b99f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:22.378367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbeef8-42d4-460d-be15-14e3d9b99f99 admin admin] PATH_INFO: `/v3/projects/31572d272cc1471284400b46f3d01d25` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:22.380455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbeef8-42d4-460d-be15-14e3d9b99f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31572d272cc1471284400b46f3d01d25)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:22.382628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbeef8-42d4-460d-be15-14e3d9b99f99 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:22.398647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:22.488038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-83bbeef8-42d4-460d-be15-14e3d9b99f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31572d272cc1471284400b46f3d01d25', 'request_id': 'req-83bbeef8-42d4-460d-be15-14e3d9b99f99'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:22.503201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-83bbeef8-42d4-460d-be15-14e3d9b99f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31572d272cc1471284400b46f3d01d25', 'request_id': 'req-83bbeef8-42d4-460d-be15-14e3d9b99f99'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:22.524052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-83bbeef8-42d4-460d-be15-14e3d9b99f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31572d272cc1471284400b46f3d01d25', 'request_id': 'req-83bbeef8-42d4-460d-be15-14e3d9b99f99'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:22.545142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-83bbeef8-42d4-460d-be15-14e3d9b99f99 admin admin] The token cache is being invalidate because project 31572d272cc1471284400b46f3d01d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:25:22.545612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-83bbeef8-42d4-460d-be15-14e3d9b99f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:22.546455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-83bbeef8-42d4-460d-be15-14e3d9b99f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:22.553154 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3678/7358] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:25:22 2022] DELETE /identity/v3/projects/31572d272cc1471284400b46f3d01d25 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:22.554858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d887-2f28-41eb-a633-b1a5968f99f5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:22.555598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d887-2f28-41eb-a633-b1a5968f99f5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:22.555598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d887-2f28-41eb-a633-b1a5968f99f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:22.585825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-40c2d887-2f28-41eb-a633-b1a5968f99f5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:22.588582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-40c2d887-2f28-41eb-a633-b1a5968f99f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:22.653284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:22.705440 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3681/7359] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:22.716403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6404498-89e7-4848-bd60-d7d0940dde21 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:22.716403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6404498-89e7-4848-bd60-d7d0940dde21 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:22.716403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6404498-89e7-4848-bd60-d7d0940dde21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:22.755504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c6404498-89e7-4848-bd60-d7d0940dde21 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:22.757495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c6404498-89e7-4848-bd60-d7d0940dde21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:22.770794 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3679/7360] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:22.774254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2d887-2f28-41eb-a633-b1a5968f99f5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:22.795792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2d887-2f28-41eb-a633-b1a5968f99f5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:22.801761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aa7c3-6d9a-40bc-878c-8a909e880690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:22.802464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aa7c3-6d9a-40bc-878c-8a909e880690 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:22.802700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aa7c3-6d9a-40bc-878c-8a909e880690 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:22.802988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aa7c3-6d9a-40bc-878c-8a909e880690 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:22.803815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4aa7c3-6d9a-40bc-878c-8a909e880690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:25:22.804131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4aa7c3-6d9a-40bc-878c-8a909e880690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:22.805910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4aa7c3-6d9a-40bc-878c-8a909e880690 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:22.826502 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3682/7361] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:25:22.827283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6404498-89e7-4848-bd60-d7d0940dde21 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:22.866118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6404498-89e7-4848-bd60-d7d0940dde21 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:22.883502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc319929-61a0-4bce-990c-115b063ffe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:22.884140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc319929-61a0-4bce-990c-115b063ffe2b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:22.884427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc319929-61a0-4bce-990c-115b063ffe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:22.884703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc319929-61a0-4bce-990c-115b063ffe2b admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:22.885472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc319929-61a0-4bce-990c-115b063ffe2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:22.887689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc319929-61a0-4bce-990c-115b063ffe2b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:22.943597 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3680/7362] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:25:22 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:25:22.947463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aa7c3-6d9a-40bc-878c-8a909e880690 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:22.960604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aa7c3-6d9a-40bc-878c-8a909e880690 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:23.073031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc558c3-fdbc-4ac3-89c2-f99f8a2d2dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:23.073815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc558c3-fdbc-4ac3-89c2-f99f8a2d2dea admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:23.074320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc558c3-fdbc-4ac3-89c2-f99f8a2d2dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:23.074721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc558c3-fdbc-4ac3-89c2-f99f8a2d2dea admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:23.075621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc558c3-fdbc-4ac3-89c2-f99f8a2d2dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:23.079134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc558c3-fdbc-4ac3-89c2-f99f8a2d2dea admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:23.131416 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3683/7363] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:25:22 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:25:23.135580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc319929-61a0-4bce-990c-115b063ffe2b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:23.155267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc319929-61a0-4bce-990c-115b063ffe2b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:23.166568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc80400-5323-4243-8ad6-8c3336e37447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:23.167790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc80400-5323-4243-8ad6-8c3336e37447 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:23.168227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc80400-5323-4243-8ad6-8c3336e37447 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:23.168649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc80400-5323-4243-8ad6-8c3336e37447 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:23.169611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc80400-5323-4243-8ad6-8c3336e37447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:23.171513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc80400-5323-4243-8ad6-8c3336e37447 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:23.190669 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3681/7364] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:25:23.195472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc558c3-fdbc-4ac3-89c2-f99f8a2d2dea admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:23.209191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc558c3-fdbc-4ac3-89c2-f99f8a2d2dea admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:23.216470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec6e2b-97d7-42e4-84bb-0d09289fa3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:23.217895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6e2b-97d7-42e4-84bb-0d09289fa3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:23.218386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6e2b-97d7-42e4-84bb-0d09289fa3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:23.218886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6e2b-97d7-42e4-84bb-0d09289fa3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:23.219802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec6e2b-97d7-42e4-84bb-0d09289fa3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:23.221671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec6e2b-97d7-42e4-84bb-0d09289fa3e3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:23.236377 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3684/7365] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:25:23.240827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc80400-5323-4243-8ad6-8c3336e37447 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:23.256827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc80400-5323-4243-8ad6-8c3336e37447 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:23.262894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056d22d-06c3-4b05-81eb-286c1a6101d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:23.264274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056d22d-06c3-4b05-81eb-286c1a6101d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:23.264797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056d22d-06c3-4b05-81eb-286c1a6101d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:23.265301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056d22d-06c3-4b05-81eb-286c1a6101d5 admin admin] PATH_INFO: `/v3/projects/8fb9f2c8a12c42cdbe76dc50517aad8e/users/27520f7d0d8344b0bd54cdb2fbdc27ac/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:23.290968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056d22d-06c3-4b05-81eb-286c1a6101d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb9f2c8a12c42cdbe76dc50517aad8e, user_id=27520f7d0d8344b0bd54cdb2fbdc27ac, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:23.295781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056d22d-06c3-4b05-81eb-286c1a6101d5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:23.339771 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3682/7366] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:25:23 2022] PUT /identity/v3/projects/8fb9f2c8a12c42cdbe76dc50517aad8e/users/27520f7d0d8344b0bd54cdb2fbdc27ac/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:23.350899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55490258-13bc-4c0b-bb8f-acef796ea415 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:23.351223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55490258-13bc-4c0b-bb8f-acef796ea415 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:23.351669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55490258-13bc-4c0b-bb8f-acef796ea415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:23.419919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-55490258-13bc-4c0b-bb8f-acef796ea415 None None] MFA Rules not processed for user `27520f7d0d8344b0bd54cdb2fbdc27ac`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:23.421330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-55490258-13bc-4c0b-bb8f-acef796ea415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:23.602606 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3685/7367] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:25:23.605504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056d22d-06c3-4b05-81eb-286c1a6101d5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:23.621994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9b649-cb51-42b9-a80b-4747f372e592 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:23.622272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9b649-cb51-42b9-a80b-4747f372e592 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:23.623321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9b649-cb51-42b9-a80b-4747f372e592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:23.689419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056d22d-06c3-4b05-81eb-286c1a6101d5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:23.697556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603a77f-bb83-4a38-9304-2bd060ef68b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:23.698512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603a77f-bb83-4a38-9304-2bd060ef68b5 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:23.699366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603a77f-bb83-4a38-9304-2bd060ef68b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:23.699990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603a77f-bb83-4a38-9304-2bd060ef68b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:23.701026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603a77f-bb83-4a38-9304-2bd060ef68b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:23.703569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603a77f-bb83-4a38-9304-2bd060ef68b5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:23.745676 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3683/7368] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:25:23 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:25:23.746768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:23.748344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603a77f-bb83-4a38-9304-2bd060ef68b5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:23.763596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-08a9b649-cb51-42b9-a80b-4747f372e592 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:23.765870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-08a9b649-cb51-42b9-a80b-4747f372e592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:23.788949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:23.865056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603a77f-bb83-4a38-9304-2bd060ef68b5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:23.874148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e9e0b-a1a2-45bd-a560-31ee26ab7eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:23.875349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e9e0b-a1a2-45bd-a560-31ee26ab7eae admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:23.875641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e9e0b-a1a2-45bd-a560-31ee26ab7eae admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:23.876052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e9e0b-a1a2-45bd-a560-31ee26ab7eae admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:23.876685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e9e0b-a1a2-45bd-a560-31ee26ab7eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:23.878908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e9e0b-a1a2-45bd-a560-31ee26ab7eae admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:23.892326 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3686/7369] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:25:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:23.921991 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3684/7370] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:25:23 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:25:23.926649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9b649-cb51-42b9-a80b-4747f372e592 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:23.944630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9b649-cb51-42b9-a80b-4747f372e592 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:23.953546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085586ed-9915-47b3-880b-a6d7640c0d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:23.954246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085586ed-9915-47b3-880b-a6d7640c0d0d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:23.954568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085586ed-9915-47b3-880b-a6d7640c0d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:23.954824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085586ed-9915-47b3-880b-a6d7640c0d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:23.959418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085586ed-9915-47b3-880b-a6d7640c0d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:23.961868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085586ed-9915-47b3-880b-a6d7640c0d0d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:23.975410 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3687/7371] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:25:23.980482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e9e0b-a1a2-45bd-a560-31ee26ab7eae admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:23.995736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e9e0b-a1a2-45bd-a560-31ee26ab7eae admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:24.002140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34829d6a-eab4-450d-ac87-a8021df65523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:24.003101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34829d6a-eab4-450d-ac87-a8021df65523 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:24.003460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34829d6a-eab4-450d-ac87-a8021df65523 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:24.003808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34829d6a-eab4-450d-ac87-a8021df65523 admin admin] PATH_INFO: `/v3/projects/972888b5b015458ab4e639d6dcf54155/users/2d360db0ff484a50a5e3927f40fc6671/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:24.015699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085586ed-9915-47b3-880b-a6d7640c0d0d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:24.016963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-085586ed-9915-47b3-880b-a6d7640c0d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:24.033247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34829d6a-eab4-450d-ac87-a8021df65523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972888b5b015458ab4e639d6dcf54155, user_id=2d360db0ff484a50a5e3927f40fc6671, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:24.038340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34829d6a-eab4-450d-ac87-a8021df65523 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:24.060919 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3685/7372] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:25:23 2022] PUT /identity/v3/projects/972888b5b015458ab4e639d6dcf54155/users/2d360db0ff484a50a5e3927f40fc6671/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:24.064605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34829d6a-eab4-450d-ac87-a8021df65523 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:24.125709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085586ed-9915-47b3-880b-a6d7640c0d0d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:24.191834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34829d6a-eab4-450d-ac87-a8021df65523 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:24.197143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02a246-7f0d-416b-91d3-77164056560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:24.198184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02a246-7f0d-416b-91d3-77164056560a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:24.198471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02a246-7f0d-416b-91d3-77164056560a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:24.198820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02a246-7f0d-416b-91d3-77164056560a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:24.199558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02a246-7f0d-416b-91d3-77164056560a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:24.201978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02a246-7f0d-416b-91d3-77164056560a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:24.216931 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3686/7373] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:25:24.222382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02a246-7f0d-416b-91d3-77164056560a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:24.235698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02a246-7f0d-416b-91d3-77164056560a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:24.242113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24296148-2607-4223-9bba-fdf493eea20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:24.242546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c41f41-95da-4d8d-9cb2-347eeb576145 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:24.242845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296148-2607-4223-9bba-fdf493eea20f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:24.243138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296148-2607-4223-9bba-fdf493eea20f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:24.243260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c41f41-95da-4d8d-9cb2-347eeb576145 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:24.243420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296148-2607-4223-9bba-fdf493eea20f admin admin] PATH_INFO: `/v3/projects/972888b5b015458ab4e639d6dcf54155/users/2d360db0ff484a50a5e3927f40fc6671/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:24.243538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c41f41-95da-4d8d-9cb2-347eeb576145 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:24.243754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c41f41-95da-4d8d-9cb2-347eeb576145 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:24.245423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24296148-2607-4223-9bba-fdf493eea20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=972888b5b015458ab4e639d6dcf54155, user_id=2d360db0ff484a50a5e3927f40fc6671, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:24.248139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24296148-2607-4223-9bba-fdf493eea20f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:24.271484 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3687/7374] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:25:24 2022] PUT /identity/v3/projects/972888b5b015458ab4e639d6dcf54155/users/2d360db0ff484a50a5e3927f40fc6671/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:24.277646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31009c-29bb-4896-a667-62259a23ce79 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:24.277938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31009c-29bb-4896-a667-62259a23ce79 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:24.278220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31009c-29bb-4896-a667-62259a23ce79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:24.328202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:24.354420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c41f41-95da-4d8d-9cb2-347eeb576145 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:24.355760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-eb31009c-29bb-4896-a667-62259a23ce79 None None] MFA Rules not processed for user `2d360db0ff484a50a5e3927f40fc6671`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:24.357070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-eb31009c-29bb-4896-a667-62259a23ce79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:24.357386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c41f41-95da-4d8d-9cb2-347eeb576145 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:24.374546 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3688/7375] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:25:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:25:24.444615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:24.469596 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3688/7376] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:25:24.483083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c41f41-95da-4d8d-9cb2-347eeb576145 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:24.484602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e7c41f41-95da-4d8d-9cb2-347eeb576145 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:24.617466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c41f41-95da-4d8d-9cb2-347eeb576145 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:24.759423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd644ad1-1256-4f78-9260-c8e8d621552e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:24.760237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd644ad1-1256-4f78-9260-c8e8d621552e service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:24.760494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd644ad1-1256-4f78-9260-c8e8d621552e service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:24.760868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd644ad1-1256-4f78-9260-c8e8d621552e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:24.772019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd644ad1-1256-4f78-9260-c8e8d621552e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:24.773483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd644ad1-1256-4f78-9260-c8e8d621552e service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:24.784057 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3689/7377] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:24.905420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31009c-29bb-4896-a667-62259a23ce79 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:24.921088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31009c-29bb-4896-a667-62259a23ce79 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:24.941291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35105a36-d6f6-490f-be97-870b8f3d52fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:24.944516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35105a36-d6f6-490f-be97-870b8f3d52fe service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:24.945654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35105a36-d6f6-490f-be97-870b8f3d52fe service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:24.946496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35105a36-d6f6-490f-be97-870b8f3d52fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:25.048453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35105a36-d6f6-490f-be97-870b8f3d52fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:25.050485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35105a36-d6f6-490f-be97-870b8f3d52fe service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:25.075054 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3689/7378] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:25.112055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88766-5fcb-4766-b7c6-1a12b7b52e05 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:25.113006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88766-5fcb-4766-b7c6-1a12b7b52e05 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:25.113759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88766-5fcb-4766-b7c6-1a12b7b52e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:25.152535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a1f88766-5fcb-4766-b7c6-1a12b7b52e05 None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:25.154146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a1f88766-5fcb-4766-b7c6-1a12b7b52e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:25.227739 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3690/7379] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:26.033887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b406e-c683-49fd-a693-cb770dfc5fc9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:26.034462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b406e-c683-49fd-a693-cb770dfc5fc9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:26.034462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b406e-c683-49fd-a693-cb770dfc5fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:26.078449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2f6b406e-c683-49fd-a693-cb770dfc5fc9 None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:26.080277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2f6b406e-c683-49fd-a693-cb770dfc5fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:26.104950 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3690/7380] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:28.743483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f88766-5fcb-4766-b7c6-1a12b7b52e05 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:28.888493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:28.947300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f88766-5fcb-4766-b7c6-1a12b7b52e05 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:28.962162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:28.964149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:28.965767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:28.966720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] PATH_INFO: `/v3/users/27520f7d0d8344b0bd54cdb2fbdc27ac` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:28.969083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27520f7d0d8344b0bd54cdb2fbdc27ac)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:28.971821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:29.143999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27520f7d0d8344b0bd54cdb2fbdc27ac'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:29.179649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27520f7d0d8344b0bd54cdb2fbdc27ac'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:29.179649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27520f7d0d8344b0bd54cdb2fbdc27ac'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:29.232466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27520f7d0d8344b0bd54cdb2fbdc27ac'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:29.234013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27520f7d0d8344b0bd54cdb2fbdc27ac'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:29.265343 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3691/7381] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:25:28 2022] DELETE /identity/v3/users/27520f7d0d8344b0bd54cdb2fbdc27ac => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:29.272535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24419f3-33e2-47f1-8203-9bef507ab271 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:29.275750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24419f3-33e2-47f1-8203-9bef507ab271 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:29.276001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24419f3-33e2-47f1-8203-9bef507ab271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:29.348550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d24419f3-33e2-47f1-8203-9bef507ab271 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:29.352390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d24419f3-33e2-47f1-8203-9bef507ab271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:29.510557 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3691/7382] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:25:29.521036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:29.522556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:29.660149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9ed6e-d3e9-4074-9884-719e5bb43515 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:29.666903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a58673-1e82-45b6-bb09-cc503bddfd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:29.668059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a58673-1e82-45b6-bb09-cc503bddfd9d service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:29.668589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a58673-1e82-45b6-bb09-cc503bddfd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:29.669221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a58673-1e82-45b6-bb09-cc503bddfd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:29.705907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a58673-1e82-45b6-bb09-cc503bddfd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:29.710603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a58673-1e82-45b6-bb09-cc503bddfd9d service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:29.730423 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3692/7383] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:30.147914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24419f3-33e2-47f1-8203-9bef507ab271 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:30.149593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d24419f3-33e2-47f1-8203-9bef507ab271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:30.170523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24419f3-33e2-47f1-8203-9bef507ab271 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:30.193387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:30.194486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:30.194789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:30.195071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] PATH_INFO: `/v3/projects/8fb9f2c8a12c42cdbe76dc50517aad8e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:30.197141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb9f2c8a12c42cdbe76dc50517aad8e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:30.201168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:30.324173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb9f2c8a12c42cdbe76dc50517aad8e', 'request_id': 'req-b8a00951-9663-4dbf-bf78-dc904e457f01'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:30.340957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb9f2c8a12c42cdbe76dc50517aad8e', 'request_id': 'req-b8a00951-9663-4dbf-bf78-dc904e457f01'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:30.368000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb9f2c8a12c42cdbe76dc50517aad8e', 'request_id': 'req-b8a00951-9663-4dbf-bf78-dc904e457f01'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:30.404947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] The token cache is being invalidate because project 8fb9f2c8a12c42cdbe76dc50517aad8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:25:30.405501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:30.407241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:30.413090 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3692/7384] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:25:30 2022] DELETE /identity/v3/projects/8fb9f2c8a12c42cdbe76dc50517aad8e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:30.414594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a58673-1e82-45b6-bb09-cc503bddfd9d service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:30.452688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a58673-1e82-45b6-bb09-cc503bddfd9d service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:30.630856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1c9e6-afbb-4ff7-ad80-cf2a490b7406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:30.632612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1c9e6-afbb-4ff7-ad80-cf2a490b7406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:30.632986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1c9e6-afbb-4ff7-ad80-cf2a490b7406 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:30.634947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1c9e6-afbb-4ff7-ad80-cf2a490b7406 admin admin] PATH_INFO: `/v3/users/2d360db0ff484a50a5e3927f40fc6671` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:30.637033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1c9e6-afbb-4ff7-ad80-cf2a490b7406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d360db0ff484a50a5e3927f40fc6671)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:30.640554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1c9e6-afbb-4ff7-ad80-cf2a490b7406 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:30.647726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:30.729507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-50d1c9e6-afbb-4ff7-ad80-cf2a490b7406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d360db0ff484a50a5e3927f40fc6671'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:30.735299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-50d1c9e6-afbb-4ff7-ad80-cf2a490b7406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d360db0ff484a50a5e3927f40fc6671'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:30.737882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-50d1c9e6-afbb-4ff7-ad80-cf2a490b7406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d360db0ff484a50a5e3927f40fc6671'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:30.768297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-50d1c9e6-afbb-4ff7-ad80-cf2a490b7406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d360db0ff484a50a5e3927f40fc6671'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:30.769243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-50d1c9e6-afbb-4ff7-ad80-cf2a490b7406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d360db0ff484a50a5e3927f40fc6671'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:30.801700 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3693/7385] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:25:30 2022] DELETE /identity/v3/users/2d360db0ff484a50a5e3927f40fc6671 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:25:31.418499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:31.421512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:31.475358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a00951-9663-4dbf-bf78-dc904e457f01 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:31.480207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:31.559586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:31.562423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:31.562804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:31.563153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7 admin admin] PATH_INFO: `/v3/projects/972888b5b015458ab4e639d6dcf54155` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:31.564672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=972888b5b015458ab4e639d6dcf54155)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:31.568006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:31.677847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972888b5b015458ab4e639d6dcf54155', 'request_id': 'req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:31.691899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972888b5b015458ab4e639d6dcf54155', 'request_id': 'req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:31.707911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972888b5b015458ab4e639d6dcf54155', 'request_id': 'req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:31.739897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7 admin admin] The token cache is being invalidate because project 972888b5b015458ab4e639d6dcf54155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:25:31.740147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:31.740840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2d59f109-e6e2-4130-bf58-2bc9c5df08a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:31.745729 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3693/7386] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:25:31 2022] DELETE /identity/v3/projects/972888b5b015458ab4e639d6dcf54155 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:31.747820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d91301-8e10-48f5-baf1-d1eccb8e7b86 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:31.748348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d91301-8e10-48f5-baf1-d1eccb8e7b86 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:31.748525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d91301-8e10-48f5-baf1-d1eccb8e7b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:31.790251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-32d91301-8e10-48f5-baf1-d1eccb8e7b86 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:31.793084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-32d91301-8e10-48f5-baf1-d1eccb8e7b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:31.930222 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3694/7387] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:31.932147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60a61-3b22-449b-841a-b50faa40e3b3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:31.932450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60a61-3b22-449b-841a-b50faa40e3b3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:31.932778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b60a61-3b22-449b-841a-b50faa40e3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:31.999655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f0b60a61-3b22-449b-841a-b50faa40e3b3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:32.001223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f0b60a61-3b22-449b-841a-b50faa40e3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:32.016743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d91301-8e10-48f5-baf1-d1eccb8e7b86 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:32.024830 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3694/7388] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:25:32.031209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d91301-8e10-48f5-baf1-d1eccb8e7b86 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:32.039197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e281d5b-3f54-44e0-b94e-dbb055c1eb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:32.040151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281d5b-3f54-44e0-b94e-dbb055c1eb3a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:32.040646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281d5b-3f54-44e0-b94e-dbb055c1eb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:32.040923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281d5b-3f54-44e0-b94e-dbb055c1eb3a admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:32.041586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e281d5b-3f54-44e0-b94e-dbb055c1eb3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:25:32.041895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e281d5b-3f54-44e0-b94e-dbb055c1eb3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:32.044580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e281d5b-3f54-44e0-b94e-dbb055c1eb3a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:32.070511 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3695/7389] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:25:32.071397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b60a61-3b22-449b-841a-b50faa40e3b3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:32.082700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b60a61-3b22-449b-841a-b50faa40e3b3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:32.090683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca6b0b-1de4-456e-a88d-f78755b3a2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:32.091947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca6b0b-1de4-456e-a88d-f78755b3a2fa admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:32.092240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca6b0b-1de4-456e-a88d-f78755b3a2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:32.092523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca6b0b-1de4-456e-a88d-f78755b3a2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:32.093680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca6b0b-1de4-456e-a88d-f78755b3a2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:32.096324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca6b0b-1de4-456e-a88d-f78755b3a2fa admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:32.175290 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3695/7390] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:25:32 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:25:32.176731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e281d5b-3f54-44e0-b94e-dbb055c1eb3a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:32.197439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e281d5b-3f54-44e0-b94e-dbb055c1eb3a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:32.292477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1680f-8a61-4c20-9221-95acf109fec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:32.293111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1680f-8a61-4c20-9221-95acf109fec0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:32.293392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1680f-8a61-4c20-9221-95acf109fec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:32.293666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1680f-8a61-4c20-9221-95acf109fec0 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:32.294298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1680f-8a61-4c20-9221-95acf109fec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:32.296394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1680f-8a61-4c20-9221-95acf109fec0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:32.330921 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3696/7391] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:25:32 2022] POST /identity/v3/users => generated 282 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:25:32.337541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca6b0b-1de4-456e-a88d-f78755b3a2fa admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:32.355327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca6b0b-1de4-456e-a88d-f78755b3a2fa admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:32.374051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d6831-391f-4c0d-9526-8c29f6f96018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:32.374928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6831-391f-4c0d-9526-8c29f6f96018 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:32.375417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6831-391f-4c0d-9526-8c29f6f96018 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:32.376161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d6831-391f-4c0d-9526-8c29f6f96018 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:32.377247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d6831-391f-4c0d-9526-8c29f6f96018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:32.382684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d6831-391f-4c0d-9526-8c29f6f96018 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:32.415498 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3696/7392] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:25:32.415720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1680f-8a61-4c20-9221-95acf109fec0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:32.421121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:32.433258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1680f-8a61-4c20-9221-95acf109fec0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:32.445412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1115ec-72b9-4905-af49-5f43eb72e1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:32.446350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1115ec-72b9-4905-af49-5f43eb72e1bd admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:32.446939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1115ec-72b9-4905-af49-5f43eb72e1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:32.447383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1115ec-72b9-4905-af49-5f43eb72e1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:32.448266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1115ec-72b9-4905-af49-5f43eb72e1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:32.449828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1115ec-72b9-4905-af49-5f43eb72e1bd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:32.486062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d6831-391f-4c0d-9526-8c29f6f96018 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:32.497151 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3697/7393] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:25:32.511345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d6831-391f-4c0d-9526-8c29f6f96018 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:32.521653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac2872-be0d-4fb8-aaaf-13792a728aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:32.522501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac2872-be0d-4fb8-aaaf-13792a728aba admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:32.522950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac2872-be0d-4fb8-aaaf-13792a728aba admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:32.523334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac2872-be0d-4fb8-aaaf-13792a728aba admin admin] PATH_INFO: `/v3/projects/f63a9bb8b6164f9b8554db60f261d776/users/0f2c561b940e40ce9b1d8a840b53f79d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:32.543558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac2872-be0d-4fb8-aaaf-13792a728aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63a9bb8b6164f9b8554db60f261d776, user_id=0f2c561b940e40ce9b1d8a840b53f79d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:32.546461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac2872-be0d-4fb8-aaaf-13792a728aba admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:32.568046 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3697/7394] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:25:32 2022] PUT /identity/v3/projects/f63a9bb8b6164f9b8554db60f261d776/users/0f2c561b940e40ce9b1d8a840b53f79d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:32.580152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb2d43-e16e-4a26-a193-d7ce5e9e8c30 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:32.580834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb2d43-e16e-4a26-a193-d7ce5e9e8c30 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:32.581311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb2d43-e16e-4a26-a193-d7ce5e9e8c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:32.663303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1ceb2d43-e16e-4a26-a193-d7ce5e9e8c30 None None] MFA Rules not processed for user `0f2c561b940e40ce9b1d8a840b53f79d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:32.664946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1ceb2d43-e16e-4a26-a193-d7ce5e9e8c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:32.783239 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3698/7395] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:32.785601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac2872-be0d-4fb8-aaaf-13792a728aba admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:32.851507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:32.912693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac2872-be0d-4fb8-aaaf-13792a728aba admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:32.921615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7c88b-5e49-4612-81b5-6d1700b4c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:32.922245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7c88b-5e49-4612-81b5-6d1700b4c0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:32.922523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7c88b-5e49-4612-81b5-6d1700b4c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:32.922857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7c88b-5e49-4612-81b5-6d1700b4c0e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:32.923664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7c88b-5e49-4612-81b5-6d1700b4c0e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:32.927238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7c88b-5e49-4612-81b5-6d1700b4c0e8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:33.030364 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3698/7396] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:25:32 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:25:33.032191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb2d43-e16e-4a26-a193-d7ce5e9e8c30 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:33.077493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb2d43-e16e-4a26-a193-d7ce5e9e8c30 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:33.203516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ef9f0-5aad-4bc9-9ac3-7e129a8ff743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:33.204665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ef9f0-5aad-4bc9-9ac3-7e129a8ff743 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:33.205071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ef9f0-5aad-4bc9-9ac3-7e129a8ff743 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:33.205432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ef9f0-5aad-4bc9-9ac3-7e129a8ff743 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:33.206177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ef9f0-5aad-4bc9-9ac3-7e129a8ff743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:33.223409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ef9f0-5aad-4bc9-9ac3-7e129a8ff743 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:33.287026 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3699/7397] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:25:33 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:25:33.288694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7c88b-5e49-4612-81b5-6d1700b4c0e8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:33.306386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7c88b-5e49-4612-81b5-6d1700b4c0e8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:33.319621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e59c7b-dcd9-4405-9dd3-43da79ba08cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:33.320533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e59c7b-dcd9-4405-9dd3-43da79ba08cc admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:33.320819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e59c7b-dcd9-4405-9dd3-43da79ba08cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:33.321091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e59c7b-dcd9-4405-9dd3-43da79ba08cc admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:33.321744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e59c7b-dcd9-4405-9dd3-43da79ba08cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:33.323384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e59c7b-dcd9-4405-9dd3-43da79ba08cc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:33.355754 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3699/7398] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:25:33.357483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ef9f0-5aad-4bc9-9ac3-7e129a8ff743 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:33.374676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ef9f0-5aad-4bc9-9ac3-7e129a8ff743 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:33.383716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1ee4-d5e7-41d4-97d3-9be31d3eebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:33.384576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1ee4-d5e7-41d4-97d3-9be31d3eebba admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:33.385130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1ee4-d5e7-41d4-97d3-9be31d3eebba admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:33.385416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb1ee4-d5e7-41d4-97d3-9be31d3eebba admin admin] PATH_INFO: `/v3/projects/20a003948b354d8ea46a78a18f2c6a25/users/4e66f5da57e14129a0144c99aea645c2/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:33.405336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb1ee4-d5e7-41d4-97d3-9be31d3eebba admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a003948b354d8ea46a78a18f2c6a25, user_id=4e66f5da57e14129a0144c99aea645c2, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:33.411329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb1ee4-d5e7-41d4-97d3-9be31d3eebba admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:33.446492 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3700/7399] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:25:33 2022] PUT /identity/v3/projects/20a003948b354d8ea46a78a18f2c6a25/users/4e66f5da57e14129a0144c99aea645c2/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:33.448503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e59c7b-dcd9-4405-9dd3-43da79ba08cc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:33.462204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e59c7b-dcd9-4405-9dd3-43da79ba08cc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:33.582869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e2a54-6ccd-4a87-a035-d6fd54bd1007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:33.584373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e2a54-6ccd-4a87-a035-d6fd54bd1007 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:33.584742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e2a54-6ccd-4a87-a035-d6fd54bd1007 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:33.585066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e2a54-6ccd-4a87-a035-d6fd54bd1007 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:33.585747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e2a54-6ccd-4a87-a035-d6fd54bd1007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:33.588084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e2a54-6ccd-4a87-a035-d6fd54bd1007 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:33.603211 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3700/7400] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:25:33.610407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1ee4-d5e7-41d4-97d3-9be31d3eebba admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:33.626680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb1ee4-d5e7-41d4-97d3-9be31d3eebba admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:33.636701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232906c6-80ca-4910-8209-ee3a96677421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:33.637757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232906c6-80ca-4910-8209-ee3a96677421 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:33.638132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232906c6-80ca-4910-8209-ee3a96677421 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:33.638410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232906c6-80ca-4910-8209-ee3a96677421 admin admin] PATH_INFO: `/v3/projects/20a003948b354d8ea46a78a18f2c6a25/users/4e66f5da57e14129a0144c99aea645c2/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:33.641981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232906c6-80ca-4910-8209-ee3a96677421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a003948b354d8ea46a78a18f2c6a25, user_id=4e66f5da57e14129a0144c99aea645c2, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:33.647262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232906c6-80ca-4910-8209-ee3a96677421 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:33.683573 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3701/7401] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:25:33 2022] PUT /identity/v3/projects/20a003948b354d8ea46a78a18f2c6a25/users/4e66f5da57e14129a0144c99aea645c2/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:33.792379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a017e44-485f-4734-8b94-2caef4aeafc1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:33.792749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a017e44-485f-4734-8b94-2caef4aeafc1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:33.792947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a017e44-485f-4734-8b94-2caef4aeafc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:33.837995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3a017e44-485f-4734-8b94-2caef4aeafc1 None None] MFA Rules not processed for user `4e66f5da57e14129a0144c99aea645c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:33.840578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3a017e44-485f-4734-8b94-2caef4aeafc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:33.960438 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3701/7402] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:33.969487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232906c6-80ca-4910-8209-ee3a96677421 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:33.971243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-232906c6-80ca-4910-8209-ee3a96677421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:34.028928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:34.083065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232906c6-80ca-4910-8209-ee3a96677421 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:34.087820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c8e77-57e3-4096-8acb-7b6cc6ccd1d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:34.088583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c8e77-57e3-4096-8acb-7b6cc6ccd1d8 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:34.093195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c8e77-57e3-4096-8acb-7b6cc6ccd1d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:34.093596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c8e77-57e3-4096-8acb-7b6cc6ccd1d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:34.122357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c8e77-57e3-4096-8acb-7b6cc6ccd1d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:34.125036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c8e77-57e3-4096-8acb-7b6cc6ccd1d8 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:34.138457 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3702/7403] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:34.279484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a017e44-485f-4734-8b94-2caef4aeafc1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:34.309904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a017e44-485f-4734-8b94-2caef4aeafc1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:34.319562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db892896-b460-43e6-877c-fd0f96d5de95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:34.320229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db892896-b460-43e6-877c-fd0f96d5de95 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:34.322061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db892896-b460-43e6-877c-fd0f96d5de95 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:34.322348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db892896-b460-43e6-877c-fd0f96d5de95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:34.369804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:34.424545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db892896-b460-43e6-877c-fd0f96d5de95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:34.426211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db892896-b460-43e6-877c-fd0f96d5de95 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:34.445713 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3702/7404] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:37.741984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c8e77-57e3-4096-8acb-7b6cc6ccd1d8 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:37.744100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8a1c8e77-57e3-4096-8acb-7b6cc6ccd1d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:37.967148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db892896-b460-43e6-877c-fd0f96d5de95 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:37.968766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-db892896-b460-43e6-877c-fd0f96d5de95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:37.970817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c8e77-57e3-4096-8acb-7b6cc6ccd1d8 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:37.986422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7fde7-4876-448f-a0fa-4b5baab3f884 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:37.987109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7fde7-4876-448f-a0fa-4b5baab3f884 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:37.987401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7fde7-4876-448f-a0fa-4b5baab3f884 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:37.987683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7fde7-4876-448f-a0fa-4b5baab3f884 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:37.994831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-02e7fde7-4876-448f-a0fa-4b5baab3f884 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:38.023954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7fde7-4876-448f-a0fa-4b5baab3f884 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:38.031134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7fde7-4876-448f-a0fa-4b5baab3f884 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:38.055791 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3703/7405] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:38.141024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db892896-b460-43e6-877c-fd0f96d5de95 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:38.162878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:38.162878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:38.162878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:38.162878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] PATH_INFO: `/v3/users/f966cae595b14bdf921bd3e72f652611` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:38.163519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f966cae595b14bdf921bd3e72f652611)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:38.163519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:38.284484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f966cae595b14bdf921bd3e72f652611'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:38.294028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f966cae595b14bdf921bd3e72f652611'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:38.294883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f966cae595b14bdf921bd3e72f652611'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:38.319375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f966cae595b14bdf921bd3e72f652611'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:38.320861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f966cae595b14bdf921bd3e72f652611'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:38.361590 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3703/7406] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:25:37 2022] DELETE /identity/v3/users/f966cae595b14bdf921bd3e72f652611 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:25:38.368753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564cde0-3cb8-4beb-abe9-004229a0aaf3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:38.369047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564cde0-3cb8-4beb-abe9-004229a0aaf3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:38.369335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564cde0-3cb8-4beb-abe9-004229a0aaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:38.416521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e564cde0-3cb8-4beb-abe9-004229a0aaf3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:38.417836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e564cde0-3cb8-4beb-abe9-004229a0aaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:38.515832 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3704/7407] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:38.527125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:38.528587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:38.699894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:38.712686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f1ae2-a9d8-4bbb-8448-3baae1197054 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:38.719807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49239f81-2639-42df-8924-73989e9dae5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:38.720554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49239f81-2639-42df-8924-73989e9dae5e service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:38.720906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49239f81-2639-42df-8924-73989e9dae5e service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:38.721251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49239f81-2639-42df-8924-73989e9dae5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:38.747685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49239f81-2639-42df-8924-73989e9dae5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:38.751780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49239f81-2639-42df-8924-73989e9dae5e service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:38.785808 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3704/7408] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:39.157846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564cde0-3cb8-4beb-abe9-004229a0aaf3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:39.159960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e564cde0-3cb8-4beb-abe9-004229a0aaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:39.209990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564cde0-3cb8-4beb-abe9-004229a0aaf3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:39.232201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:39.234328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:39.238915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:39.239966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] PATH_INFO: `/v3/projects/55e7469d09e64042a3c9b9dc0d9da321` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:39.243574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e7469d09e64042a3c9b9dc0d9da321)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:39.252381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:39.400664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e7469d09e64042a3c9b9dc0d9da321', 'request_id': 'req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:39.428820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e7469d09e64042a3c9b9dc0d9da321', 'request_id': 'req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:39.434922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:39.438248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e7469d09e64042a3c9b9dc0d9da321', 'request_id': 'req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:39.470625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] The token cache is being invalidate because project 55e7469d09e64042a3c9b9dc0d9da321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:25:39.471675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:39.475571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:39.482100 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3705/7409] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:25:39 2022] DELETE /identity/v3/projects/55e7469d09e64042a3c9b9dc0d9da321 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:39.485830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49239f81-2639-42df-8924-73989e9dae5e service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:39.523596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49239f81-2639-42df-8924-73989e9dae5e service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:39.785416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:39.788977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:39.791546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:39.792787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] PATH_INFO: `/v3/users/6a1495f325344c12acec97d59b18203f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:39.798010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1495f325344c12acec97d59b18203f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:39.807241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:39.979367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1495f325344c12acec97d59b18203f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:40.001322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1495f325344c12acec97d59b18203f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:40.005868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1495f325344c12acec97d59b18203f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:40.026706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1495f325344c12acec97d59b18203f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:40.027660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1495f325344c12acec97d59b18203f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:40.056888 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3705/7410] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:25:39 2022] DELETE /identity/v3/users/6a1495f325344c12acec97d59b18203f => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:40.818023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:40.819319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:40.853733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799c91e-16e5-4eff-a5ba-ab32bfa2acf5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:41.083721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:41.084938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:41.085909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:41.086819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] PATH_INFO: `/v3/projects/bce656b25bdc482092311f34e8bab1f4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:41.094770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce656b25bdc482092311f34e8bab1f4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:41.096267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:41.219963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce656b25bdc482092311f34e8bab1f4', 'request_id': 'req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:41.234498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce656b25bdc482092311f34e8bab1f4', 'request_id': 'req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:41.246144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce656b25bdc482092311f34e8bab1f4', 'request_id': 'req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:41.268653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] The token cache is being invalidate because project bce656b25bdc482092311f34e8bab1f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:25:41.270532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:41.272379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:41.274816 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3706/7411] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:25:40 2022] DELETE /identity/v3/projects/bce656b25bdc482092311f34e8bab1f4 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:41.279358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:41.285951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:41.311296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2642-174b-4ef7-afa3-82f2979214e4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:41.465857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fc656-892a-4a57-b0e3-1c628e485838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:41.466373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fc656-892a-4a57-b0e3-1c628e485838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:41.466660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fc656-892a-4a57-b0e3-1c628e485838 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:41.467146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fc656-892a-4a57-b0e3-1c628e485838 admin admin] PATH_INFO: `/v3/users/df80b95bf27f46719d54ba16fa4152a1` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:41.469089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fc656-892a-4a57-b0e3-1c628e485838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df80b95bf27f46719d54ba16fa4152a1)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:41.472841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fc656-892a-4a57-b0e3-1c628e485838 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:41.503020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:41.601297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f85fc656-892a-4a57-b0e3-1c628e485838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df80b95bf27f46719d54ba16fa4152a1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:41.619665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f85fc656-892a-4a57-b0e3-1c628e485838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df80b95bf27f46719d54ba16fa4152a1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:41.622967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f85fc656-892a-4a57-b0e3-1c628e485838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df80b95bf27f46719d54ba16fa4152a1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:41.647047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f85fc656-892a-4a57-b0e3-1c628e485838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df80b95bf27f46719d54ba16fa4152a1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:41.647785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f85fc656-892a-4a57-b0e3-1c628e485838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df80b95bf27f46719d54ba16fa4152a1'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:41.682611 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3706/7412] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:25:41 2022] DELETE /identity/v3/users/df80b95bf27f46719d54ba16fa4152a1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:42.086480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:42.089204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:42.125735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3cb04-4cbb-4efc-acf0-a23b0155e51c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:42.381983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:42.382637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:42.382961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:42.383240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] PATH_INFO: `/v3/projects/4f385cdb0b2f4fa5b8e8a8e252a5aab4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:42.384393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f385cdb0b2f4fa5b8e8a8e252a5aab4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:42.386803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:42.463968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:42.517209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f385cdb0b2f4fa5b8e8a8e252a5aab4', 'request_id': 'req-d07b2068-d3d5-4ccd-999b-ceac88353526'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:42.542263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f385cdb0b2f4fa5b8e8a8e252a5aab4', 'request_id': 'req-d07b2068-d3d5-4ccd-999b-ceac88353526'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:42.569232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f385cdb0b2f4fa5b8e8a8e252a5aab4', 'request_id': 'req-d07b2068-d3d5-4ccd-999b-ceac88353526'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:42.594717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] The token cache is being invalidate because project 4f385cdb0b2f4fa5b8e8a8e252a5aab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:25:42.595323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:42.596558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:42.607167 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3707/7413] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:25:42 2022] DELETE /identity/v3/projects/4f385cdb0b2f4fa5b8e8a8e252a5aab4 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:25:44.105916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef6bee-5fa1-4da7-81da-55fe99917de7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:44.107380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef6bee-5fa1-4da7-81da-55fe99917de7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:44.108015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef6bee-5fa1-4da7-81da-55fe99917de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:44.169868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a1ef6bee-5fa1-4da7-81da-55fe99917de7 None None] MFA Rules not processed for user `9d1b9307efb74379a66c4cac79c8b82d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:44.171466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a1ef6bee-5fa1-4da7-81da-55fe99917de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:44.297501 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3707/7414] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:46.324963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:46.327065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:46.491468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b2068-d3d5-4ccd-999b-ceac88353526 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:46.500200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:46.500875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:46.501160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:46.501440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] PATH_INFO: `/v3/users/0f2c561b940e40ce9b1d8a840b53f79d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:46.502650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f2c561b940e40ce9b1d8a840b53f79d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:46.505560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:46.602727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f2c561b940e40ce9b1d8a840b53f79d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:46.616947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f2c561b940e40ce9b1d8a840b53f79d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:46.618391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f2c561b940e40ce9b1d8a840b53f79d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:46.636039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f2c561b940e40ce9b1d8a840b53f79d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:46.637487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f2c561b940e40ce9b1d8a840b53f79d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:46.665088 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3708/7415] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:25:46 2022] DELETE /identity/v3/users/0f2c561b940e40ce9b1d8a840b53f79d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:46.665540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40abc5c-8c56-4ef2-8f12-442a83734867 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:46.666041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40abc5c-8c56-4ef2-8f12-442a83734867 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:46.666278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40abc5c-8c56-4ef2-8f12-442a83734867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:46.707375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a40abc5c-8c56-4ef2-8f12-442a83734867 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:46.709513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a40abc5c-8c56-4ef2-8f12-442a83734867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:46.813042 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3708/7416] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:25:46.826787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:46.826787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:46.896770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:46.976984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76a98b-3a5d-4171-8fed-fa5980a4b6cb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:46.986349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37934f69-83b2-455b-83bb-4c1a35fd33f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:46.989022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37934f69-83b2-455b-83bb-4c1a35fd33f9 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:46.989472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37934f69-83b2-455b-83bb-4c1a35fd33f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:46.989472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37934f69-83b2-455b-83bb-4c1a35fd33f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:47.005877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37934f69-83b2-455b-83bb-4c1a35fd33f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:47.007544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37934f69-83b2-455b-83bb-4c1a35fd33f9 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:47.019541 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3709/7417] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:47.419586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40abc5c-8c56-4ef2-8f12-442a83734867 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:47.422007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a40abc5c-8c56-4ef2-8f12-442a83734867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:47.440347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40abc5c-8c56-4ef2-8f12-442a83734867 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:47.451994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:47.453207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:47.454085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:47.454545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] PATH_INFO: `/v3/projects/f63a9bb8b6164f9b8554db60f261d776` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:47.456229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63a9bb8b6164f9b8554db60f261d776)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:47.460736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:47.571943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:47.642567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63a9bb8b6164f9b8554db60f261d776', 'request_id': 'req-6488e0cf-d009-4a08-897c-e8ee0af149d0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:47.650522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63a9bb8b6164f9b8554db60f261d776', 'request_id': 'req-6488e0cf-d009-4a08-897c-e8ee0af149d0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:47.689382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63a9bb8b6164f9b8554db60f261d776', 'request_id': 'req-6488e0cf-d009-4a08-897c-e8ee0af149d0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:47.729840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] The token cache is being invalidate because project f63a9bb8b6164f9b8554db60f261d776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:25:47.730165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:47.730845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:47.736802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37934f69-83b2-455b-83bb-4c1a35fd33f9 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:47.748552 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3709/7418] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:25:47 2022] DELETE /identity/v3/projects/f63a9bb8b6164f9b8554db60f261d776 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:47.750201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37934f69-83b2-455b-83bb-4c1a35fd33f9 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:47.898501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:47.899562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:47.899849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:47.900123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] PATH_INFO: `/v3/users/4e66f5da57e14129a0144c99aea645c2` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:47.902273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e66f5da57e14129a0144c99aea645c2)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:47.905843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:48.013942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e66f5da57e14129a0144c99aea645c2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:48.028329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e66f5da57e14129a0144c99aea645c2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:48.030806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e66f5da57e14129a0144c99aea645c2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:48.059923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e66f5da57e14129a0144c99aea645c2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:48.061397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e66f5da57e14129a0144c99aea645c2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:48.084761 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3710/7419] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:25:47 2022] DELETE /identity/v3/users/4e66f5da57e14129a0144c99aea645c2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:48.511188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:48.512822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:48.645377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488e0cf-d009-4a08-897c-e8ee0af149d0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:48.679294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:48.681232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:48.823230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966795ee-baac-45fe-a3b6-54515af6806b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:48.824821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966795ee-baac-45fe-a3b6-54515af6806b service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:48.825256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966795ee-baac-45fe-a3b6-54515af6806b service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:48.825938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966795ee-baac-45fe-a3b6-54515af6806b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:48.828045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:48.832091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-966795ee-baac-45fe-a3b6-54515af6806b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:48.861951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ef3d3-63e7-4675-8ba6-c0fbb7120e23 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:48.876726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45b636-24d6-4245-b2f0-563aa66106c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:48.877781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45b636-24d6-4245-b2f0-563aa66106c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:48.878396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45b636-24d6-4245-b2f0-563aa66106c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:48.879238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45b636-24d6-4245-b2f0-563aa66106c9 admin admin] PATH_INFO: `/v3/projects/20a003948b354d8ea46a78a18f2c6a25` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:48.883083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45b636-24d6-4245-b2f0-563aa66106c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a003948b354d8ea46a78a18f2c6a25)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:48.885404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45b636-24d6-4245-b2f0-563aa66106c9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:48.982351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966795ee-baac-45fe-a3b6-54515af6806b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:48.983924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966795ee-baac-45fe-a3b6-54515af6806b service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:48.999228 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3710/7420] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:49.014869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d45b636-24d6-4245-b2f0-563aa66106c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a003948b354d8ea46a78a18f2c6a25', 'request_id': 'req-1d45b636-24d6-4245-b2f0-563aa66106c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:49.039298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d45b636-24d6-4245-b2f0-563aa66106c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a003948b354d8ea46a78a18f2c6a25', 'request_id': 'req-1d45b636-24d6-4245-b2f0-563aa66106c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:49.047410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d45b636-24d6-4245-b2f0-563aa66106c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a003948b354d8ea46a78a18f2c6a25', 'request_id': 'req-1d45b636-24d6-4245-b2f0-563aa66106c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:49.077116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d45b636-24d6-4245-b2f0-563aa66106c9 admin admin] The token cache is being invalidate because project 20a003948b354d8ea46a78a18f2c6a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:25:49.077325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d45b636-24d6-4245-b2f0-563aa66106c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:49.078140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1d45b636-24d6-4245-b2f0-563aa66106c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:49.080056 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3711/7421] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:25:48 2022] DELETE /identity/v3/projects/20a003948b354d8ea46a78a18f2c6a25 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:49.085522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7321d8-ddf8-4234-bb80-891aafec6a33 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:49.085815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7321d8-ddf8-4234-bb80-891aafec6a33 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:49.086100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7321d8-ddf8-4234-bb80-891aafec6a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:49.124205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ec7321d8-ddf8-4234-bb80-891aafec6a33 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:49.125459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ec7321d8-ddf8-4234-bb80-891aafec6a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:49.172479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:49.246063 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3711/7422] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:25:49.255196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1390e-6966-47e7-9e15-05a5a0339da1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:49.255196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1390e-6966-47e7-9e15-05a5a0339da1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:49.255196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1390e-6966-47e7-9e15-05a5a0339da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:49.289946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7eb1390e-6966-47e7-9e15-05a5a0339da1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:49.291640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7eb1390e-6966-47e7-9e15-05a5a0339da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:49.305843 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3712/7423] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:49.306468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7321d8-ddf8-4234-bb80-891aafec6a33 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:49.319385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7321d8-ddf8-4234-bb80-891aafec6a33 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:49.328067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce255ddd-3f5f-49e5-b712-c0c955343f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:49.328704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255ddd-3f5f-49e5-b712-c0c955343f8c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:49.328998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255ddd-3f5f-49e5-b712-c0c955343f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:49.329337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce255ddd-3f5f-49e5-b712-c0c955343f8c admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:49.330004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce255ddd-3f5f-49e5-b712-c0c955343f8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:25:49.330319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce255ddd-3f5f-49e5-b712-c0c955343f8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:49.332903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce255ddd-3f5f-49e5-b712-c0c955343f8c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:49.355602 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3712/7424] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:25:49.357510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1390e-6966-47e7-9e15-05a5a0339da1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:49.370357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1390e-6966-47e7-9e15-05a5a0339da1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:49.385837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51021872-d290-4728-abf4-78dc39da582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:49.386884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021872-d290-4728-abf4-78dc39da582e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:49.387414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021872-d290-4728-abf4-78dc39da582e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:49.387925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021872-d290-4728-abf4-78dc39da582e admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:49.389186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51021872-d290-4728-abf4-78dc39da582e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:49.394527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51021872-d290-4728-abf4-78dc39da582e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:49.435527 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3713/7425] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:25:49 2022] POST /identity/v3/projects => generated 365 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:25:49.436917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce255ddd-3f5f-49e5-b712-c0c955343f8c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:49.449001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce255ddd-3f5f-49e5-b712-c0c955343f8c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:49.549378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8a08d-c4b0-4be5-8b38-c34aea6aec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:49.549912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8a08d-c4b0-4be5-8b38-c34aea6aec62 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:49.550967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8a08d-c4b0-4be5-8b38-c34aea6aec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:49.551242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8a08d-c4b0-4be5-8b38-c34aea6aec62 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:49.552017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8a08d-c4b0-4be5-8b38-c34aea6aec62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:49.553993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8a08d-c4b0-4be5-8b38-c34aea6aec62 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:49.587569 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3713/7426] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:25:49 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:25:49.588893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51021872-d290-4728-abf4-78dc39da582e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:49.604357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51021872-d290-4728-abf4-78dc39da582e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:49.614146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951570d-8494-4efc-98bb-9287adbc050a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:49.614862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951570d-8494-4efc-98bb-9287adbc050a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:49.615151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951570d-8494-4efc-98bb-9287adbc050a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:49.615420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951570d-8494-4efc-98bb-9287adbc050a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:49.616071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951570d-8494-4efc-98bb-9287adbc050a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:49.617675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951570d-8494-4efc-98bb-9287adbc050a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:49.634503 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3714/7427] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:25:49.635717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8a08d-c4b0-4be5-8b38-c34aea6aec62 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:49.647641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8a08d-c4b0-4be5-8b38-c34aea6aec62 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:49.653287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4aa759-60c9-49b5-a044-b4a89d3d0d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:49.653911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aa759-60c9-49b5-a044-b4a89d3d0d11 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:49.654190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aa759-60c9-49b5-a044-b4a89d3d0d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:49.654587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aa759-60c9-49b5-a044-b4a89d3d0d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:49.655269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4aa759-60c9-49b5-a044-b4a89d3d0d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:49.656864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4aa759-60c9-49b5-a044-b4a89d3d0d11 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:49.671211 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3714/7428] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:25:49.672357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951570d-8494-4efc-98bb-9287adbc050a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:49.694333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951570d-8494-4efc-98bb-9287adbc050a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:49.703602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e1df7-adea-4358-9a94-de9f6dbde58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:49.704321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1df7-adea-4358-9a94-de9f6dbde58f admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:49.704577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1df7-adea-4358-9a94-de9f6dbde58f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:49.704857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1df7-adea-4358-9a94-de9f6dbde58f admin admin] PATH_INFO: `/v3/projects/bd15bbc7530b4a21aa16b4ee97c650ff/users/d91bd8eef80849b49f8bf5b2be412070/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:49.738702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e1df7-adea-4358-9a94-de9f6dbde58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd15bbc7530b4a21aa16b4ee97c650ff, user_id=d91bd8eef80849b49f8bf5b2be412070, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:49.742488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e1df7-adea-4358-9a94-de9f6dbde58f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:49.766695 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3715/7429] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:25:49 2022] PUT /identity/v3/projects/bd15bbc7530b4a21aa16b4ee97c650ff/users/d91bd8eef80849b49f8bf5b2be412070/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:49.777726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223a231-d1ce-40e1-90aa-24b818feb605 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:49.778078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223a231-d1ce-40e1-90aa-24b818feb605 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:49.778292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223a231-d1ce-40e1-90aa-24b818feb605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:49.818544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5223a231-d1ce-40e1-90aa-24b818feb605 None None] MFA Rules not processed for user `d91bd8eef80849b49f8bf5b2be412070`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:49.819723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5223a231-d1ce-40e1-90aa-24b818feb605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:49.984200 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3715/7430] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:49.995197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e1df7-adea-4358-9a94-de9f6dbde58f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:49.995197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1b6e1df7-adea-4358-9a94-de9f6dbde58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:50.076194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e1df7-adea-4358-9a94-de9f6dbde58f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:50.092275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78fc92-feea-4210-b74b-5b9f9c619e79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:50.093085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78fc92-feea-4210-b74b-5b9f9c619e79 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:50.106596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78fc92-feea-4210-b74b-5b9f9c619e79 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:50.106596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78fc92-feea-4210-b74b-5b9f9c619e79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:50.108182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78fc92-feea-4210-b74b-5b9f9c619e79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:50.114905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78fc92-feea-4210-b74b-5b9f9c619e79 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:50.121700 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3716/7431] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:25:52.068322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e7b3-dd96-4029-86fc-6054a86810e5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:52.068842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e7b3-dd96-4029-86fc-6054a86810e5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:52.068946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e7b3-dd96-4029-86fc-6054a86810e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:52.090712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6a68e7b3-dd96-4029-86fc-6054a86810e5 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:52.092107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6a68e7b3-dd96-4029-86fc-6054a86810e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:52.114704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:52.161197 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3716/7432] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:25:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:52.177230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78fc92-feea-4210-b74b-5b9f9c619e79 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:52.178307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4f78fc92-feea-4210-b74b-5b9f9c619e79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:52.208053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:52.266033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78fc92-feea-4210-b74b-5b9f9c619e79 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:52.272172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0d378-ca05-4494-8ebb-e5dd7594d274 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:52.272794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0d378-ca05-4494-8ebb-e5dd7594d274 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:52.273077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0d378-ca05-4494-8ebb-e5dd7594d274 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:52.273353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0d378-ca05-4494-8ebb-e5dd7594d274 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:52.281751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0d378-ca05-4494-8ebb-e5dd7594d274 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:52.283390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0d378-ca05-4494-8ebb-e5dd7594d274 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:52.292302 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3717/7433] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:25:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:25:55.410502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68e7b3-dd96-4029-86fc-6054a86810e5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:55.412664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6a68e7b3-dd96-4029-86fc-6054a86810e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:55.495708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68e7b3-dd96-4029-86fc-6054a86810e5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:55.500300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f955a5f-c353-4f40-a0d5-4acaf4476eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:55.500944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f955a5f-c353-4f40-a0d5-4acaf4476eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:55.501228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f955a5f-c353-4f40-a0d5-4acaf4476eba admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:55.501531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f955a5f-c353-4f40-a0d5-4acaf4476eba admin admin] PATH_INFO: `/v3/users/70c455f210244be2a8c2fff0199c2fd0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:55.502667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f955a5f-c353-4f40-a0d5-4acaf4476eba admin admin] RBAC: Authorizing `identity:delete_user(user_id=70c455f210244be2a8c2fff0199c2fd0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:55.505327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f955a5f-c353-4f40-a0d5-4acaf4476eba admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:55.568413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f955a5f-c353-4f40-a0d5-4acaf4476eba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70c455f210244be2a8c2fff0199c2fd0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:55.573524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f955a5f-c353-4f40-a0d5-4acaf4476eba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70c455f210244be2a8c2fff0199c2fd0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:55.581226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f955a5f-c353-4f40-a0d5-4acaf4476eba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70c455f210244be2a8c2fff0199c2fd0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:55.587363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f955a5f-c353-4f40-a0d5-4acaf4476eba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70c455f210244be2a8c2fff0199c2fd0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:55.588184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7f955a5f-c353-4f40-a0d5-4acaf4476eba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70c455f210244be2a8c2fff0199c2fd0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:55.616570 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3717/7434] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:25:55 2022] DELETE /identity/v3/users/70c455f210244be2a8c2fff0199c2fd0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:25:55.871807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0d378-ca05-4494-8ebb-e5dd7594d274 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:55.888030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0d378-ca05-4494-8ebb-e5dd7594d274 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:56.024628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9794a4-e323-451c-8867-37a73270661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:56.025896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9794a4-e323-451c-8867-37a73270661b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:56.026334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9794a4-e323-451c-8867-37a73270661b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:56.026821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9794a4-e323-451c-8867-37a73270661b admin admin] PATH_INFO: `/v3/projects/262060731a07436faf9fe062198b01ef` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:56.028194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9794a4-e323-451c-8867-37a73270661b admin admin] RBAC: Authorizing `identity:delete_project(project_id=262060731a07436faf9fe062198b01ef)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:56.030356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9794a4-e323-451c-8867-37a73270661b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:56.103222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5b9794a4-e323-451c-8867-37a73270661b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262060731a07436faf9fe062198b01ef', 'request_id': 'req-5b9794a4-e323-451c-8867-37a73270661b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:56.114533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5b9794a4-e323-451c-8867-37a73270661b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262060731a07436faf9fe062198b01ef', 'request_id': 'req-5b9794a4-e323-451c-8867-37a73270661b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:56.122779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5b9794a4-e323-451c-8867-37a73270661b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262060731a07436faf9fe062198b01ef', 'request_id': 'req-5b9794a4-e323-451c-8867-37a73270661b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:56.136892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5b9794a4-e323-451c-8867-37a73270661b admin admin] The token cache is being invalidate because project 262060731a07436faf9fe062198b01ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:25:56.137211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5b9794a4-e323-451c-8867-37a73270661b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:56.137868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5b9794a4-e323-451c-8867-37a73270661b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:25:56.143242 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3718/7435] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:25:55 2022] DELETE /identity/v3/projects/262060731a07436faf9fe062198b01ef => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:56.145133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d45fbe-1a38-4c1f-aaef-5299dbccbfa1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:56.145511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d45fbe-1a38-4c1f-aaef-5299dbccbfa1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:56.145860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d45fbe-1a38-4c1f-aaef-5299dbccbfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:56.166919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f5d45fbe-1a38-4c1f-aaef-5299dbccbfa1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:56.168238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f5d45fbe-1a38-4c1f-aaef-5299dbccbfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:56.224121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:56.255957 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3718/7436] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:56.258381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798527bd-3327-4d47-9502-f83916e0b7a7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:56.258845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798527bd-3327-4d47-9502-f83916e0b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:56.259239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798527bd-3327-4d47-9502-f83916e0b7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:56.285482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-798527bd-3327-4d47-9502-f83916e0b7a7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:56.287754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-798527bd-3327-4d47-9502-f83916e0b7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:56.298254 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3719/7437] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:56.303315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d45fbe-1a38-4c1f-aaef-5299dbccbfa1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:56.316709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d45fbe-1a38-4c1f-aaef-5299dbccbfa1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:56.323962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3067a2-0287-4eeb-99c6-2d296284b915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:56.324701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3067a2-0287-4eeb-99c6-2d296284b915 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:56.325092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3067a2-0287-4eeb-99c6-2d296284b915 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:56.325462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3067a2-0287-4eeb-99c6-2d296284b915 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:56.327427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3067a2-0287-4eeb-99c6-2d296284b915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:25:56.327845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3067a2-0287-4eeb-99c6-2d296284b915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:56.330016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3067a2-0287-4eeb-99c6-2d296284b915 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:56.354795 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3719/7438] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:25:56.358822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798527bd-3327-4d47-9502-f83916e0b7a7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:56.370575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798527bd-3327-4d47-9502-f83916e0b7a7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:56.376338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9602fa7-b908-4574-b1c5-eef0dfe17191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:56.377069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9602fa7-b908-4574-b1c5-eef0dfe17191 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:56.377347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9602fa7-b908-4574-b1c5-eef0dfe17191 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:56.377755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9602fa7-b908-4574-b1c5-eef0dfe17191 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:56.378685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9602fa7-b908-4574-b1c5-eef0dfe17191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:56.381318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9602fa7-b908-4574-b1c5-eef0dfe17191 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:56.424139 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3720/7439] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:25:56 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:25:56.425516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3067a2-0287-4eeb-99c6-2d296284b915 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:56.440695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3067a2-0287-4eeb-99c6-2d296284b915 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:56.520863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec287494-8a9b-4f8f-a676-9b8a7edc027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:56.522133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec287494-8a9b-4f8f-a676-9b8a7edc027f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:56.522444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec287494-8a9b-4f8f-a676-9b8a7edc027f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:56.522989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec287494-8a9b-4f8f-a676-9b8a7edc027f admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:56.523659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec287494-8a9b-4f8f-a676-9b8a7edc027f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:56.526062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec287494-8a9b-4f8f-a676-9b8a7edc027f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:56.569647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9602fa7-b908-4574-b1c5-eef0dfe17191 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:56.584062 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3720/7440] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:25:56 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:25:56.586896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9602fa7-b908-4574-b1c5-eef0dfe17191 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:56.592735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ef015-0443-4ca6-ab60-ec6cf53ecdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:56.593381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ef015-0443-4ca6-ab60-ec6cf53ecdeb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:56.593672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ef015-0443-4ca6-ab60-ec6cf53ecdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:56.593952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ef015-0443-4ca6-ab60-ec6cf53ecdeb admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:56.594608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ef015-0443-4ca6-ab60-ec6cf53ecdeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:56.596793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ef015-0443-4ca6-ab60-ec6cf53ecdeb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:56.603719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:25:56.613774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec287494-8a9b-4f8f-a676-9b8a7edc027f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:56.614234 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3721/7441] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:25:56.624768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec287494-8a9b-4f8f-a676-9b8a7edc027f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:56.630315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbde606-0c2b-48fb-a7fb-a5a7a38aff0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:56.630967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbde606-0c2b-48fb-a7fb-a5a7a38aff0e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:56.631256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbde606-0c2b-48fb-a7fb-a5a7a38aff0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:56.631539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbde606-0c2b-48fb-a7fb-a5a7a38aff0e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:56.632186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbde606-0c2b-48fb-a7fb-a5a7a38aff0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:56.633804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbde606-0c2b-48fb-a7fb-a5a7a38aff0e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:56.647969 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3721/7442] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:25:56.651342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ef015-0443-4ca6-ab60-ec6cf53ecdeb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:56.664709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ef015-0443-4ca6-ab60-ec6cf53ecdeb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:56.671375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c5549-e36a-4c62-91d4-1c0d2ac37d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:56.672419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c5549-e36a-4c62-91d4-1c0d2ac37d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:56.672880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c5549-e36a-4c62-91d4-1c0d2ac37d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:56.673346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c5549-e36a-4c62-91d4-1c0d2ac37d4b admin admin] PATH_INFO: `/v3/projects/b8081c70b7e74832a884025d836cdaa6/users/379cfe19da2a475496160840a5716ebb/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:56.691996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c5549-e36a-4c62-91d4-1c0d2ac37d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8081c70b7e74832a884025d836cdaa6, user_id=379cfe19da2a475496160840a5716ebb, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:56.695012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c5549-e36a-4c62-91d4-1c0d2ac37d4b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:56.720803 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3722/7443] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:25:56 2022] PUT /identity/v3/projects/b8081c70b7e74832a884025d836cdaa6/users/379cfe19da2a475496160840a5716ebb/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:25:56.724793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2805b-541f-42d2-8e31-8b5d80a202f8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:56.725082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2805b-541f-42d2-8e31-8b5d80a202f8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:56.725483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2805b-541f-42d2-8e31-8b5d80a202f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:56.786518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-eea2805b-541f-42d2-8e31-8b5d80a202f8 None None] MFA Rules not processed for user `379cfe19da2a475496160840a5716ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:56.787904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-eea2805b-541f-42d2-8e31-8b5d80a202f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:56.882419 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3722/7444] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:25:56.898905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c5549-e36a-4c62-91d4-1c0d2ac37d4b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:25:56.898905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d02c5549-e36a-4c62-91d4-1c0d2ac37d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:56.984370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c5549-e36a-4c62-91d4-1c0d2ac37d4b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:25:56.990910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3821bfa-561c-449b-a5b2-84706ef8f8fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:25:56.991866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3821bfa-561c-449b-a5b2-84706ef8f8fa service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:56.992993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3821bfa-561c-449b-a5b2-84706ef8f8fa service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:56.993481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3821bfa-561c-449b-a5b2-84706ef8f8fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:57.009266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3821bfa-561c-449b-a5b2-84706ef8f8fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:25:57.011990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3821bfa-561c-449b-a5b2-84706ef8f8fa service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:25:57.029765 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3723/7445] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:25:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:25:59.532139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1eb2-9571-40a3-8876-d849b219ddb0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:25:59.532622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1eb2-9571-40a3-8876-d849b219ddb0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:25:59.532731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf1eb2-9571-40a3-8876-d849b219ddb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:25:59.563006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5bdf1eb2-9571-40a3-8876-d849b219ddb0 None None] MFA Rules not processed for user `379cfe19da2a475496160840a5716ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:25:59.563006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5bdf1eb2-9571-40a3-8876-d849b219ddb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:25:59.570636 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3723/7446] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:26:07.020312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:08.511261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28e182-2324-4c8d-b631-54b5397892b8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:08.513078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28e182-2324-4c8d-b631-54b5397892b8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:08.515352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28e182-2324-4c8d-b631-54b5397892b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:08.562046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0b28e182-2324-4c8d-b631-54b5397892b8 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:26:08.563484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0b28e182-2324-4c8d-b631-54b5397892b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:08.652747 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3724/7447] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:26:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:26:08.668238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf1eb2-9571-40a3-8876-d849b219ddb0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:08.669619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5bdf1eb2-9571-40a3-8876-d849b219ddb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:08.730975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:08.795662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf1eb2-9571-40a3-8876-d849b219ddb0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:08.810520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe078d1-c4da-4267-a644-f11e7f5fa239 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:08.811243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe078d1-c4da-4267-a644-f11e7f5fa239 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:08.812150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe078d1-c4da-4267-a644-f11e7f5fa239 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:08.815112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe078d1-c4da-4267-a644-f11e7f5fa239 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:08.825126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe078d1-c4da-4267-a644-f11e7f5fa239 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:08.827068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe078d1-c4da-4267-a644-f11e7f5fa239 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:08.838218 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3724/7448] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:26:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:26:18.655256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=25 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:18.833808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=16 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:23.829197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28e182-2324-4c8d-b631-54b5397892b8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:23.831234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0b28e182-2324-4c8d-b631-54b5397892b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:23.921777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28e182-2324-4c8d-b631-54b5397892b8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:23.929541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7302d1a-0df7-4877-b78f-666cfb6f5524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:23.930469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7302d1a-0df7-4877-b78f-666cfb6f5524 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:23.930715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7302d1a-0df7-4877-b78f-666cfb6f5524 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:23.941691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7302d1a-0df7-4877-b78f-666cfb6f5524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:23.941691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e7302d1a-0df7-4877-b78f-666cfb6f5524 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:24.007046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7302d1a-0df7-4877-b78f-666cfb6f5524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:24.008759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7302d1a-0df7-4877-b78f-666cfb6f5524 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:24.021637 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3725/7449] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:26:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:26:24.121089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe078d1-c4da-4267-a644-f11e7f5fa239 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:24.122819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fbe078d1-c4da-4267-a644-f11e7f5fa239 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:24.221601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe078d1-c4da-4267-a644-f11e7f5fa239 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:24.225628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375a76d-0c5e-4fd0-b221-b47845d23de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:24.226347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375a76d-0c5e-4fd0-b221-b47845d23de9 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:24.226712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375a76d-0c5e-4fd0-b221-b47845d23de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:24.227086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375a76d-0c5e-4fd0-b221-b47845d23de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:24.229120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0375a76d-0c5e-4fd0-b221-b47845d23de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:24.246583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375a76d-0c5e-4fd0-b221-b47845d23de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:24.248090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375a76d-0c5e-4fd0-b221-b47845d23de9 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:24.262018 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3725/7450] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:26:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:26:24.432828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7302d1a-0df7-4877-b78f-666cfb6f5524 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:24.434496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e7302d1a-0df7-4877-b78f-666cfb6f5524 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:24.515589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7302d1a-0df7-4877-b78f-666cfb6f5524 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:24.520639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6d7aa-f8f6-497e-9dab-d36dc1ec165a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:24.523434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6d7aa-f8f6-497e-9dab-d36dc1ec165a service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:24.523434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6d7aa-f8f6-497e-9dab-d36dc1ec165a service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:24.523434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6d7aa-f8f6-497e-9dab-d36dc1ec165a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:24.524108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a5c6d7aa-f8f6-497e-9dab-d36dc1ec165a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:24.540153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6d7aa-f8f6-497e-9dab-d36dc1ec165a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:24.541737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6d7aa-f8f6-497e-9dab-d36dc1ec165a service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:24.556304 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3726/7451] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:26:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:26:24.640241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375a76d-0c5e-4fd0-b221-b47845d23de9 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:24.641682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0375a76d-0c5e-4fd0-b221-b47845d23de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:24.654123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375a76d-0c5e-4fd0-b221-b47845d23de9 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:24.658123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2cc90-92af-4f84-bc37-11c2f2a0acad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:24.658821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2cc90-92af-4f84-bc37-11c2f2a0acad service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:24.659103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2cc90-92af-4f84-bc37-11c2f2a0acad service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:24.659379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2cc90-92af-4f84-bc37-11c2f2a0acad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:24.661065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ddd2cc90-92af-4f84-bc37-11c2f2a0acad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:24.672221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2cc90-92af-4f84-bc37-11c2f2a0acad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:24.673645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2cc90-92af-4f84-bc37-11c2f2a0acad service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:24.683973 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3726/7452] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:26:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:26:24.770230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6d7aa-f8f6-497e-9dab-d36dc1ec165a service glance] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:24.780959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6d7aa-f8f6-497e-9dab-d36dc1ec165a service glance] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:24.785035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf6ade-a1bd-4bac-99d5-d02423e37de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:24.785638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf6ade-a1bd-4bac-99d5-d02423e37de4 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:24.785927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf6ade-a1bd-4bac-99d5-d02423e37de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:24.786235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf6ade-a1bd-4bac-99d5-d02423e37de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:24.788027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8fcf6ade-a1bd-4bac-99d5-d02423e37de4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:24.803371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf6ade-a1bd-4bac-99d5-d02423e37de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:24.804806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf6ade-a1bd-4bac-99d5-d02423e37de4 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:24.817946 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3727/7453] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:26:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:26:29.667884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358b679-d795-4e76-9d38-4608c77c1fd8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:29.668312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358b679-d795-4e76-9d38-4608c77c1fd8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:29.668618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358b679-d795-4e76-9d38-4608c77c1fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:29.712537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7358b679-d795-4e76-9d38-4608c77c1fd8 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:26:29.717515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7358b679-d795-4e76-9d38-4608c77c1fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:29.740845 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3727/7454] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:26:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:26:29.831125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf6ade-a1bd-4bac-99d5-d02423e37de4 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:29.850631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf6ade-a1bd-4bac-99d5-d02423e37de4 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:29.880538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a7b0-a6b6-4980-84bc-6113d6efe590 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:29.881713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a7b0-a6b6-4980-84bc-6113d6efe590 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:29.881713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a7b0-a6b6-4980-84bc-6113d6efe590 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:29.881914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a7b0-a6b6-4980-84bc-6113d6efe590 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:29.896314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469a7b0-a6b6-4980-84bc-6113d6efe590 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:29.897931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469a7b0-a6b6-4980-84bc-6113d6efe590 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:29.908213 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3728/7455] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:26:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:26:31.131663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358b679-d795-4e76-9d38-4608c77c1fd8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:31.148908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358b679-d795-4e76-9d38-4608c77c1fd8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:31.173342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236191c-f4e4-4072-86e5-29d1fa7dbfe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:31.174266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236191c-f4e4-4072-86e5-29d1fa7dbfe2 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:31.174556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236191c-f4e4-4072-86e5-29d1fa7dbfe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:31.180787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236191c-f4e4-4072-86e5-29d1fa7dbfe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:31.210471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7236191c-f4e4-4072-86e5-29d1fa7dbfe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:31.443885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236191c-f4e4-4072-86e5-29d1fa7dbfe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:31.446100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236191c-f4e4-4072-86e5-29d1fa7dbfe2 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:31.458451 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3728/7456] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:26:39.904238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:41.453607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=65 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:47.158161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a7b0-a6b6-4980-84bc-6113d6efe590 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:47.160482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3469a7b0-a6b6-4980-84bc-6113d6efe590 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:47.191233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a7b0-a6b6-4980-84bc-6113d6efe590 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:47.196529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:47.197722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:47.198475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:47.198475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] PATH_INFO: `/v3/users/656876150d884e58a510d2f949cd3f86` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:47.201667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=656876150d884e58a510d2f949cd3f86)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:47.203808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:47.286132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656876150d884e58a510d2f949cd3f86'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:47.294554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656876150d884e58a510d2f949cd3f86'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:47.295374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656876150d884e58a510d2f949cd3f86'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:47.312781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656876150d884e58a510d2f949cd3f86'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:47.313403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656876150d884e58a510d2f949cd3f86'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:47.333988 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3729/7457] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:26:47 2022] DELETE /identity/v3/users/656876150d884e58a510d2f949cd3f86 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:26:47.780211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236191c-f4e4-4072-86e5-29d1fa7dbfe2 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:47.817877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236191c-f4e4-4072-86e5-29d1fa7dbfe2 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:48.016782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:48.019314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:48.019766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:48.020229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] PATH_INFO: `/v3/projects/e733e229eb7e4a99a88b200409e75ec5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:48.023386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e733e229eb7e4a99a88b200409e75ec5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:48.025555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:48.136358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e733e229eb7e4a99a88b200409e75ec5', 'request_id': 'req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:48.152387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e733e229eb7e4a99a88b200409e75ec5', 'request_id': 'req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:48.164792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e733e229eb7e4a99a88b200409e75ec5', 'request_id': 'req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:48.201537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] The token cache is being invalidate because project e733e229eb7e4a99a88b200409e75ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:26:48.201850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:48.202565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:48.204055 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3729/7458] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:26:47 2022] DELETE /identity/v3/projects/e733e229eb7e4a99a88b200409e75ec5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:26:48.210823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:48.212463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:48.237781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672baa1-220f-41aa-8b61-0928fa047bf3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:48.397120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:48.397982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:48.398277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:48.399036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] PATH_INFO: `/v3/users/3106e17937d2423a914c6e8d132a5de2` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:48.400207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3106e17937d2423a914c6e8d132a5de2)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:48.406329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:48.567412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3106e17937d2423a914c6e8d132a5de2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:48.577020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3106e17937d2423a914c6e8d132a5de2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:48.577871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3106e17937d2423a914c6e8d132a5de2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:48.600902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3106e17937d2423a914c6e8d132a5de2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:48.611462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3106e17937d2423a914c6e8d132a5de2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:48.611462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:48.680233 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3730/7459] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:26:48 2022] DELETE /identity/v3/users/3106e17937d2423a914c6e8d132a5de2 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:26:49.235082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:49.238928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:49.314884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a92e-a698-4d9b-96a7-9d1fd9702af0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:49.390519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:49.392824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:49.590288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbefe01-4bd6-4a11-8e38-138bd00a6813 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:49.596008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a104d4-6ab1-41f2-976e-12a18cd04ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:49.596826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a104d4-6ab1-41f2-976e-12a18cd04ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:49.597188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a104d4-6ab1-41f2-976e-12a18cd04ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:49.597398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a104d4-6ab1-41f2-976e-12a18cd04ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:49.599418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:49.599622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c2a104d4-6ab1-41f2-976e-12a18cd04ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:49.605849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:49.608701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:49.609714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] PATH_INFO: `/v3/projects/d2e5a1e3f1c34fe696781bad6a4272e4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:49.612143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e5a1e3f1c34fe696781bad6a4272e4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:49.615860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:49.790155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:49.797272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a104d4-6ab1-41f2-976e-12a18cd04ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:49.804195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a104d4-6ab1-41f2-976e-12a18cd04ea9 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:49.829078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e5a1e3f1c34fe696781bad6a4272e4', 'request_id': 'req-79ce4040-d7c6-4d01-929f-90de4f563c2f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:49.833309 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3731/7460] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:26:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:26:49.864799 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e5a1e3f1c34fe696781bad6a4272e4', 'request_id': 'req-79ce4040-d7c6-4d01-929f-90de4f563c2f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:49.881291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e5a1e3f1c34fe696781bad6a4272e4', 'request_id': 'req-79ce4040-d7c6-4d01-929f-90de4f563c2f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:49.907354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] The token cache is being invalidate because project d2e5a1e3f1c34fe696781bad6a4272e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:26:49.908535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:49.910300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:49.931614 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3730/7461] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:26:49 2022] DELETE /identity/v3/projects/d2e5a1e3f1c34fe696781bad6a4272e4 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:26:51.701546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3114d15-c4ae-425c-a663-a00487ed7aa0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:51.702156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3114d15-c4ae-425c-a663-a00487ed7aa0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:51.702459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3114d15-c4ae-425c-a663-a00487ed7aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:51.734806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e3114d15-c4ae-425c-a663-a00487ed7aa0 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:26:51.736790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e3114d15-c4ae-425c-a663-a00487ed7aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:51.814730 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3732/7462] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:26:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:26:51.822898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:51.824721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:51.934117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce4040-d7c6-4d01-929f-90de4f563c2f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:51.941137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22664c8d-5a9a-4d34-bbfd-4bff12fd533c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:51.942053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664c8d-5a9a-4d34-bbfd-4bff12fd533c service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:51.942514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664c8d-5a9a-4d34-bbfd-4bff12fd533c service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:51.943210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664c8d-5a9a-4d34-bbfd-4bff12fd533c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:51.954177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22664c8d-5a9a-4d34-bbfd-4bff12fd533c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:51.957188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22664c8d-5a9a-4d34-bbfd-4bff12fd533c service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:51.969264 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3731/7463] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:26:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:26:52.631897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3114d15-c4ae-425c-a663-a00487ed7aa0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:52.633339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e3114d15-c4ae-425c-a663-a00487ed7aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:52.700712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:52.721652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3114d15-c4ae-425c-a663-a00487ed7aa0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:52.740959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba1d77-946a-4891-b7f2-0526a0263c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:52.741889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1d77-946a-4891-b7f2-0526a0263c03 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:52.742332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1d77-946a-4891-b7f2-0526a0263c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:52.742830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1d77-946a-4891-b7f2-0526a0263c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:52.751057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-deba1d77-946a-4891-b7f2-0526a0263c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:52.912584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba1d77-946a-4891-b7f2-0526a0263c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:52.914043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba1d77-946a-4891-b7f2-0526a0263c03 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:52.938091 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3733/7464] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:26:57.874277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22664c8d-5a9a-4d34-bbfd-4bff12fd533c service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:57.876213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-22664c8d-5a9a-4d34-bbfd-4bff12fd533c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:57.901138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22664c8d-5a9a-4d34-bbfd-4bff12fd533c service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:57.912430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfa1d8-c3f4-473d-80ba-36d26651775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:57.913051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfa1d8-c3f4-473d-80ba-36d26651775e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:57.913335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfa1d8-c3f4-473d-80ba-36d26651775e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:57.913608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfa1d8-c3f4-473d-80ba-36d26651775e admin admin] PATH_INFO: `/v3/users/d0bd3c83dff64f27bd048defad379622` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:57.915502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfa1d8-c3f4-473d-80ba-36d26651775e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0bd3c83dff64f27bd048defad379622)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:57.917671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfa1d8-c3f4-473d-80ba-36d26651775e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:58.005725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70cfa1d8-c3f4-473d-80ba-36d26651775e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0bd3c83dff64f27bd048defad379622'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:58.015832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70cfa1d8-c3f4-473d-80ba-36d26651775e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0bd3c83dff64f27bd048defad379622'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:58.016716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70cfa1d8-c3f4-473d-80ba-36d26651775e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0bd3c83dff64f27bd048defad379622'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:58.028545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70cfa1d8-c3f4-473d-80ba-36d26651775e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0bd3c83dff64f27bd048defad379622'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:58.038831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-70cfa1d8-c3f4-473d-80ba-36d26651775e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0bd3c83dff64f27bd048defad379622'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:58.062574 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3732/7465] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:26:57 2022] DELETE /identity/v3/users/d0bd3c83dff64f27bd048defad379622 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:26:58.640364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba1d77-946a-4891-b7f2-0526a0263c03 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:58.661376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba1d77-946a-4891-b7f2-0526a0263c03 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:58.787276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79838491-b804-474a-8fa2-f19c1a7f51a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:58.787934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838491-b804-474a-8fa2-f19c1a7f51a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:58.788220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838491-b804-474a-8fa2-f19c1a7f51a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:58.788496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838491-b804-474a-8fa2-f19c1a7f51a1 admin admin] PATH_INFO: `/v3/projects/67287edba1d54d0b902b7f6776e647b3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:58.789722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79838491-b804-474a-8fa2-f19c1a7f51a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67287edba1d54d0b902b7f6776e647b3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:58.791868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79838491-b804-474a-8fa2-f19c1a7f51a1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:58.919349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-79838491-b804-474a-8fa2-f19c1a7f51a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67287edba1d54d0b902b7f6776e647b3', 'request_id': 'req-79838491-b804-474a-8fa2-f19c1a7f51a1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:58.929437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-79838491-b804-474a-8fa2-f19c1a7f51a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67287edba1d54d0b902b7f6776e647b3', 'request_id': 'req-79838491-b804-474a-8fa2-f19c1a7f51a1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:58.940054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-79838491-b804-474a-8fa2-f19c1a7f51a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67287edba1d54d0b902b7f6776e647b3', 'request_id': 'req-79838491-b804-474a-8fa2-f19c1a7f51a1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:58.956982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-79838491-b804-474a-8fa2-f19c1a7f51a1 admin admin] The token cache is being invalidate because project 67287edba1d54d0b902b7f6776e647b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:26:58.957334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-79838491-b804-474a-8fa2-f19c1a7f51a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:58.958046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-79838491-b804-474a-8fa2-f19c1a7f51a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:26:58.960013 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3734/7466] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:26:58 2022] DELETE /identity/v3/projects/67287edba1d54d0b902b7f6776e647b3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:26:58.964794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a914e20-d253-4432-925c-dbf3daca02fb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:58.965636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a914e20-d253-4432-925c-dbf3daca02fb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:58.965924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a914e20-d253-4432-925c-dbf3daca02fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:58.987054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4a914e20-d253-4432-925c-dbf3daca02fb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:26:58.988291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4a914e20-d253-4432-925c-dbf3daca02fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:59.007635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:59.060007 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3733/7467] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:26:59.068470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f93cc-4951-421b-a88c-c5f0783c1435 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:59.068765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f93cc-4951-421b-a88c-c5f0783c1435 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:59.069072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f93cc-4951-421b-a88c-c5f0783c1435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:59.088929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ec1f93cc-4951-421b-a88c-c5f0783c1435 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:26:59.090112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ec1f93cc-4951-421b-a88c-c5f0783c1435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:59.099043 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3735/7468] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:26:59.104091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a914e20-d253-4432-925c-dbf3daca02fb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:59.122857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a914e20-d253-4432-925c-dbf3daca02fb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:59.128091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d427180-7537-4d64-a39c-6e18df54d5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:59.128702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d427180-7537-4d64-a39c-6e18df54d5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:59.129006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d427180-7537-4d64-a39c-6e18df54d5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:59.129280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d427180-7537-4d64-a39c-6e18df54d5c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:59.129929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d427180-7537-4d64-a39c-6e18df54d5c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:26:59.130237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d427180-7537-4d64-a39c-6e18df54d5c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:59.131870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d427180-7537-4d64-a39c-6e18df54d5c1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:59.144817 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3734/7469] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:26:59.149357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f93cc-4951-421b-a88c-c5f0783c1435 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:59.160375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f93cc-4951-421b-a88c-c5f0783c1435 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:59.166162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d150d79-ab75-43b4-9eda-a02526f8bb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:59.166796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d150d79-ab75-43b4-9eda-a02526f8bb1e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:59.167104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d150d79-ab75-43b4-9eda-a02526f8bb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:59.167380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d150d79-ab75-43b4-9eda-a02526f8bb1e admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:59.168017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d150d79-ab75-43b4-9eda-a02526f8bb1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:59.170674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d150d79-ab75-43b4-9eda-a02526f8bb1e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:59.182283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:26:59.207130 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3736/7470] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:26:59 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:26:59.208508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d427180-7537-4d64-a39c-6e18df54d5c1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:59.219299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d427180-7537-4d64-a39c-6e18df54d5c1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:59.278217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d266f-2d87-40a9-a4fa-797aac686d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:59.278872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d266f-2d87-40a9-a4fa-797aac686d05 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:59.279157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d266f-2d87-40a9-a4fa-797aac686d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:59.279432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d266f-2d87-40a9-a4fa-797aac686d05 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:59.280085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d266f-2d87-40a9-a4fa-797aac686d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:59.282002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d266f-2d87-40a9-a4fa-797aac686d05 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:59.308626 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3735/7471] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:26:59 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:26:59.309933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d150d79-ab75-43b4-9eda-a02526f8bb1e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:59.320840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d150d79-ab75-43b4-9eda-a02526f8bb1e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:59.325708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f151b8e-d39f-46da-8db1-825cdb8b2dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:59.326389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f151b8e-d39f-46da-8db1-825cdb8b2dec admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:59.326763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f151b8e-d39f-46da-8db1-825cdb8b2dec admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:59.327127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f151b8e-d39f-46da-8db1-825cdb8b2dec admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:59.327838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f151b8e-d39f-46da-8db1-825cdb8b2dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:59.330208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f151b8e-d39f-46da-8db1-825cdb8b2dec admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:59.344044 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3737/7472] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:26:59.346060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d266f-2d87-40a9-a4fa-797aac686d05 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:59.356829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d266f-2d87-40a9-a4fa-797aac686d05 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:59.363131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b8125-9e9f-4df4-9d3b-bbe4d3b6ab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:59.363944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b8125-9e9f-4df4-9d3b-bbe4d3b6ab89 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:59.364232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b8125-9e9f-4df4-9d3b-bbe4d3b6ab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:59.364509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b8125-9e9f-4df4-9d3b-bbe4d3b6ab89 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:59.365155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b8125-9e9f-4df4-9d3b-bbe4d3b6ab89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:59.366878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b8125-9e9f-4df4-9d3b-bbe4d3b6ab89 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:59.378102 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3736/7473] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:26:59.382333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f151b8e-d39f-46da-8db1-825cdb8b2dec admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:59.393599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f151b8e-d39f-46da-8db1-825cdb8b2dec admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:59.398336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd108f19-83ca-45df-b956-450464532b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:59.399022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd108f19-83ca-45df-b956-450464532b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:59.399309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd108f19-83ca-45df-b956-450464532b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:59.399593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd108f19-83ca-45df-b956-450464532b49 admin admin] PATH_INFO: `/v3/projects/31fe785b7c2042f0a9b77b280467b586/users/87820fd590ab402395340d61df0cd22b/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:59.415463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd108f19-83ca-45df-b956-450464532b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31fe785b7c2042f0a9b77b280467b586, user_id=87820fd590ab402395340d61df0cd22b, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:59.418141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd108f19-83ca-45df-b956-450464532b49 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:59.431661 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3738/7474] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:26:59 2022] PUT /identity/v3/projects/31fe785b7c2042f0a9b77b280467b586/users/87820fd590ab402395340d61df0cd22b/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:26:59.436878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f01f1-99de-4123-9618-827c30c9037b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:59.437173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f01f1-99de-4123-9618-827c30c9037b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:59.437484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f01f1-99de-4123-9618-827c30c9037b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:59.458268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-018f01f1-99de-4123-9618-827c30c9037b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:26:59.459582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-018f01f1-99de-4123-9618-827c30c9037b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:59.527762 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3737/7475] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:26:59.538295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd108f19-83ca-45df-b956-450464532b49 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:26:59.540279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cd108f19-83ca-45df-b956-450464532b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:26:59.613437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd108f19-83ca-45df-b956-450464532b49 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:26:59.617208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c68f89-ee24-4a30-a200-0c3b67a54299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:26:59.617889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c68f89-ee24-4a30-a200-0c3b67a54299 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:26:59.618353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c68f89-ee24-4a30-a200-0c3b67a54299 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:26:59.618641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c68f89-ee24-4a30-a200-0c3b67a54299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:26:59.633014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c68f89-ee24-4a30-a200-0c3b67a54299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:26:59.634613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c68f89-ee24-4a30-a200-0c3b67a54299 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:26:59.651292 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3739/7476] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:27:00.345768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f01f1-99de-4123-9618-827c30c9037b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:00.348238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-018f01f1-99de-4123-9618-827c30c9037b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:00.386084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:00.441962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f01f1-99de-4123-9618-827c30c9037b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:00.450352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7692fe-ad8f-4990-a69f-1caa55a69ae4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:00.451104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7692fe-ad8f-4990-a69f-1caa55a69ae4 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:00.451413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7692fe-ad8f-4990-a69f-1caa55a69ae4 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:00.451950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7692fe-ad8f-4990-a69f-1caa55a69ae4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:00.461091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ff7692fe-ad8f-4990-a69f-1caa55a69ae4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:00.551351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7692fe-ad8f-4990-a69f-1caa55a69ae4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:00.554890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7692fe-ad8f-4990-a69f-1caa55a69ae4 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:00.581280 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3738/7477] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:27:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:27:05.692488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb183de-e930-4605-b8fa-be5c3c26e002 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:05.693971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb183de-e930-4605-b8fa-be5c3c26e002 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:05.694445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb183de-e930-4605-b8fa-be5c3c26e002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:05.725708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2cb183de-e930-4605-b8fa-be5c3c26e002 None None] MFA Rules not processed for user `87820fd590ab402395340d61df0cd22b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:05.727435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2cb183de-e930-4605-b8fa-be5c3c26e002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:05.838966 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3740/7478] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:05.846044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7692fe-ad8f-4990-a69f-1caa55a69ae4 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:05.848333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ff7692fe-ad8f-4990-a69f-1caa55a69ae4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:05.969423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7692fe-ad8f-4990-a69f-1caa55a69ae4 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:05.975951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d74fb-38c3-4f42-9286-cb6ce7c17bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:05.976592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d74fb-38c3-4f42-9286-cb6ce7c17bf5 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:05.976881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d74fb-38c3-4f42-9286-cb6ce7c17bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:05.977164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d74fb-38c3-4f42-9286-cb6ce7c17bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:05.987255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d74fb-38c3-4f42-9286-cb6ce7c17bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:05.988875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d74fb-38c3-4f42-9286-cb6ce7c17bf5 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:06.009974 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3739/7479] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:08.464320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf4ca1-3406-462d-b989-08d3cf33c252 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:08.464787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf4ca1-3406-462d-b989-08d3cf33c252 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:08.464787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf4ca1-3406-462d-b989-08d3cf33c252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:08.520119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b5bf4ca1-3406-462d-b989-08d3cf33c252 None None] MFA Rules not processed for user `87820fd590ab402395340d61df0cd22b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:08.524798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b5bf4ca1-3406-462d-b989-08d3cf33c252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:08.553377 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3741/7480] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:08.607026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d74fb-38c3-4f42-9286-cb6ce7c17bf5 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:08.608489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3f9d74fb-38c3-4f42-9286-cb6ce7c17bf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:08.754858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d74fb-38c3-4f42-9286-cb6ce7c17bf5 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:08.765781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf27e11-aa8f-4902-afbc-57cb23255f6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:08.767203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf27e11-aa8f-4902-afbc-57cb23255f6d service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:08.767881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf27e11-aa8f-4902-afbc-57cb23255f6d service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:08.768364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf27e11-aa8f-4902-afbc-57cb23255f6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:08.774367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3cf27e11-aa8f-4902-afbc-57cb23255f6d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:08.827321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf27e11-aa8f-4902-afbc-57cb23255f6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:08.829724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf27e11-aa8f-4902-afbc-57cb23255f6d service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:08.847356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:08.858851 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3740/7481] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:09.276491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf4ca1-3406-462d-b989-08d3cf33c252 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:09.278130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b5bf4ca1-3406-462d-b989-08d3cf33c252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:09.302508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf4ca1-3406-462d-b989-08d3cf33c252 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:09.307623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b86a4f-705e-4b75-bf3b-5ce32fb278e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:09.308253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b86a4f-705e-4b75-bf3b-5ce32fb278e5 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:09.308533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b86a4f-705e-4b75-bf3b-5ce32fb278e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:09.308803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b86a4f-705e-4b75-bf3b-5ce32fb278e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:09.314103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-01b86a4f-705e-4b75-bf3b-5ce32fb278e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:09.327760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b86a4f-705e-4b75-bf3b-5ce32fb278e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:09.329280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b86a4f-705e-4b75-bf3b-5ce32fb278e5 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:09.340243 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3742/7482] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:15.754770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf27e11-aa8f-4902-afbc-57cb23255f6d service glance] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:15.756253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3cf27e11-aa8f-4902-afbc-57cb23255f6d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:15.773137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf27e11-aa8f-4902-afbc-57cb23255f6d service glance] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:15.778320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:15.779050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:15.779400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:15.779789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] PATH_INFO: `/v3/users/d91bd8eef80849b49f8bf5b2be412070` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:15.780999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91bd8eef80849b49f8bf5b2be412070)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:15.783770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:15.838704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91bd8eef80849b49f8bf5b2be412070'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:15.848819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91bd8eef80849b49f8bf5b2be412070'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:15.849801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91bd8eef80849b49f8bf5b2be412070'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:15.861314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91bd8eef80849b49f8bf5b2be412070'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:15.862002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91bd8eef80849b49f8bf5b2be412070'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:15.885178 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3741/7483] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:27:15 2022] DELETE /identity/v3/users/d91bd8eef80849b49f8bf5b2be412070 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:15.889783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c41073-3552-449d-b608-30eb06f99822 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:15.890210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c41073-3552-449d-b608-30eb06f99822 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:15.890391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c41073-3552-449d-b608-30eb06f99822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:15.910266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d4c41073-3552-449d-b608-30eb06f99822 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:15.911522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d4c41073-3552-449d-b608-30eb06f99822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:15.934936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:15.993698 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3743/7484] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:16.004233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:16.005691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:16.070640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5de221-7a22-49a7-b8dd-4b359c3983ee admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:16.074400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5276f49-8a2a-4755-af30-ec68aaa025d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:16.075039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5276f49-8a2a-4755-af30-ec68aaa025d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:16.075318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5276f49-8a2a-4755-af30-ec68aaa025d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:16.075590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5276f49-8a2a-4755-af30-ec68aaa025d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:16.086555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5276f49-8a2a-4755-af30-ec68aaa025d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:16.088042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5276f49-8a2a-4755-af30-ec68aaa025d1 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:16.099284 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3742/7485] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:16.907057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c41073-3552-449d-b608-30eb06f99822 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:16.908646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d4c41073-3552-449d-b608-30eb06f99822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:16.930801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c41073-3552-449d-b608-30eb06f99822 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:16.943900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee013185-9704-44d7-9235-dbb259a73b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:16.944636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee013185-9704-44d7-9235-dbb259a73b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:16.945061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee013185-9704-44d7-9235-dbb259a73b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:16.945515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee013185-9704-44d7-9235-dbb259a73b5f admin admin] PATH_INFO: `/v3/projects/bd15bbc7530b4a21aa16b4ee97c650ff` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:16.947542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee013185-9704-44d7-9235-dbb259a73b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd15bbc7530b4a21aa16b4ee97c650ff)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:16.958074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee013185-9704-44d7-9235-dbb259a73b5f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:17.042159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee013185-9704-44d7-9235-dbb259a73b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd15bbc7530b4a21aa16b4ee97c650ff', 'request_id': 'req-ee013185-9704-44d7-9235-dbb259a73b5f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.054381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee013185-9704-44d7-9235-dbb259a73b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd15bbc7530b4a21aa16b4ee97c650ff', 'request_id': 'req-ee013185-9704-44d7-9235-dbb259a73b5f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.065424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee013185-9704-44d7-9235-dbb259a73b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd15bbc7530b4a21aa16b4ee97c650ff', 'request_id': 'req-ee013185-9704-44d7-9235-dbb259a73b5f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.084199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee013185-9704-44d7-9235-dbb259a73b5f admin admin] The token cache is being invalidate because project bd15bbc7530b4a21aa16b4ee97c650ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:27:17.084586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee013185-9704-44d7-9235-dbb259a73b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.085839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ee013185-9704-44d7-9235-dbb259a73b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:17.087877 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3744/7486] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:27:16 2022] DELETE /identity/v3/projects/bd15bbc7530b4a21aa16b4ee97c650ff => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:17.092852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b65561-6966-4990-8ead-825bcde27f9a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.093334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b65561-6966-4990-8ead-825bcde27f9a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.093418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b65561-6966-4990-8ead-825bcde27f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.122887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-55b65561-6966-4990-8ead-825bcde27f9a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:17.122887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-55b65561-6966-4990-8ead-825bcde27f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:17.198405 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3743/7487] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:17.206208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1568-9ade-4326-815b-cb4377b2ccbf None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.206497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1568-9ade-4326-815b-cb4377b2ccbf None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.206794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1568-9ade-4326-815b-cb4377b2ccbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.242105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f29c1568-9ade-4326-815b-cb4377b2ccbf None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:17.244725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f29c1568-9ade-4326-815b-cb4377b2ccbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:17.255822 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3745/7488] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:17.260876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b65561-6966-4990-8ead-825bcde27f9a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:17.287064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b65561-6966-4990-8ead-825bcde27f9a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:17.293399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaef729-cb52-4783-a1ce-293aa8db3d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:17.294023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaef729-cb52-4783-a1ce-293aa8db3d1e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.294544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaef729-cb52-4783-a1ce-293aa8db3d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.295082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaef729-cb52-4783-a1ce-293aa8db3d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.296080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaef729-cb52-4783-a1ce-293aa8db3d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:27:17.296477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaef729-cb52-4783-a1ce-293aa8db3d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:17.300013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaef729-cb52-4783-a1ce-293aa8db3d1e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:17.342093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:17.350149 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3744/7489] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:27:17.351178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c1568-9ade-4326-815b-cb4377b2ccbf None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:17.373801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c1568-9ade-4326-815b-cb4377b2ccbf None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:17.380280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56d8dd-6bc6-41bc-9322-3251b907be0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:17.381383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56d8dd-6bc6-41bc-9322-3251b907be0f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.381875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56d8dd-6bc6-41bc-9322-3251b907be0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.382354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56d8dd-6bc6-41bc-9322-3251b907be0f admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.383559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56d8dd-6bc6-41bc-9322-3251b907be0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:17.386793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56d8dd-6bc6-41bc-9322-3251b907be0f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:17.429826 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3746/7490] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:27:17 2022] POST /identity/v3/projects => generated 389 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:27:17.433851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaef729-cb52-4783-a1ce-293aa8db3d1e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:17.446125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaef729-cb52-4783-a1ce-293aa8db3d1e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:17.524442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1840c81-f17b-4406-bc9a-f1db95150ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:17.525065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1840c81-f17b-4406-bc9a-f1db95150ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.525346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1840c81-f17b-4406-bc9a-f1db95150ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.525623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1840c81-f17b-4406-bc9a-f1db95150ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.526285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1840c81-f17b-4406-bc9a-f1db95150ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:17.528447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1840c81-f17b-4406-bc9a-f1db95150ec4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:17.554222 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3745/7491] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:27:17 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:27:17.558499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56d8dd-6bc6-41bc-9322-3251b907be0f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:17.570328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56d8dd-6bc6-41bc-9322-3251b907be0f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:17.575447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7bb33-ec24-43c6-83d1-ebf924cf3d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:17.576270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7bb33-ec24-43c6-83d1-ebf924cf3d3d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.576717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7bb33-ec24-43c6-83d1-ebf924cf3d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.577166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7bb33-ec24-43c6-83d1-ebf924cf3d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.577970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7bb33-ec24-43c6-83d1-ebf924cf3d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:17.579895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7bb33-ec24-43c6-83d1-ebf924cf3d3d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:17.591231 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3747/7492] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:27:17.596040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1840c81-f17b-4406-bc9a-f1db95150ec4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:17.606881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1840c81-f17b-4406-bc9a-f1db95150ec4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:17.613485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a165135-1b8d-4d62-b839-8d5d9e51deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:17.614210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a165135-1b8d-4d62-b839-8d5d9e51deb4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.614620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a165135-1b8d-4d62-b839-8d5d9e51deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.614940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a165135-1b8d-4d62-b839-8d5d9e51deb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.615617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a165135-1b8d-4d62-b839-8d5d9e51deb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:17.617339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a165135-1b8d-4d62-b839-8d5d9e51deb4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:17.630148 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3746/7493] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:27:17.634445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7bb33-ec24-43c6-83d1-ebf924cf3d3d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:17.645719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7bb33-ec24-43c6-83d1-ebf924cf3d3d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:17.650434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d10f59-2315-4333-bcc9-52849e05edc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:17.651122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d10f59-2315-4333-bcc9-52849e05edc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.651407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d10f59-2315-4333-bcc9-52849e05edc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.651709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d10f59-2315-4333-bcc9-52849e05edc0 admin admin] PATH_INFO: `/v3/projects/2713adc364e84f4e82c775431a7c343a/users/f6536b65215e445b87af361cf716d5d9/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.673885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d10f59-2315-4333-bcc9-52849e05edc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2713adc364e84f4e82c775431a7c343a, user_id=f6536b65215e445b87af361cf716d5d9, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:17.677279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d10f59-2315-4333-bcc9-52849e05edc0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:17.702643 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3748/7494] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:27:17 2022] PUT /identity/v3/projects/2713adc364e84f4e82c775431a7c343a/users/f6536b65215e445b87af361cf716d5d9/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:17.715599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e802a3e-112a-4fee-b13d-bc15f4437c9c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:17.716376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e802a3e-112a-4fee-b13d-bc15f4437c9c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:17.716376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e802a3e-112a-4fee-b13d-bc15f4437c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:17.775676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8e802a3e-112a-4fee-b13d-bc15f4437c9c None None] MFA Rules not processed for user `f6536b65215e445b87af361cf716d5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:17.776888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8e802a3e-112a-4fee-b13d-bc15f4437c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:17.904851 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3747/7495] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:17.917701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d10f59-2315-4333-bcc9-52849e05edc0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:17.920008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e5d10f59-2315-4333-bcc9-52849e05edc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:18.009082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:18.020109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d10f59-2315-4333-bcc9-52849e05edc0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:18.024810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb0c5d-4905-4443-9f1c-526122d3a5bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:18.025722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0c5d-4905-4443-9f1c-526122d3a5bd service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:18.026157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0c5d-4905-4443-9f1c-526122d3a5bd service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:18.026614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0c5d-4905-4443-9f1c-526122d3a5bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:18.058777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb0c5d-4905-4443-9f1c-526122d3a5bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:18.058777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb0c5d-4905-4443-9f1c-526122d3a5bd service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:18.071360 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3749/7496] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:24.036851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e802a3e-112a-4fee-b13d-bc15f4437c9c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:24.039191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8e802a3e-112a-4fee-b13d-bc15f4437c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:24.186172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e802a3e-112a-4fee-b13d-bc15f4437c9c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:24.201573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809966e0-0c4b-4c80-9986-2e18af6afaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:24.202330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809966e0-0c4b-4c80-9986-2e18af6afaac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:24.202824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809966e0-0c4b-4c80-9986-2e18af6afaac admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:24.203221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809966e0-0c4b-4c80-9986-2e18af6afaac admin admin] PATH_INFO: `/v3/users/9d1b9307efb74379a66c4cac79c8b82d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:24.205330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809966e0-0c4b-4c80-9986-2e18af6afaac admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1b9307efb74379a66c4cac79c8b82d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:24.207864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809966e0-0c4b-4c80-9986-2e18af6afaac admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:24.223359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:24.322956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-809966e0-0c4b-4c80-9986-2e18af6afaac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1b9307efb74379a66c4cac79c8b82d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:24.339670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-809966e0-0c4b-4c80-9986-2e18af6afaac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1b9307efb74379a66c4cac79c8b82d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:24.340599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-809966e0-0c4b-4c80-9986-2e18af6afaac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1b9307efb74379a66c4cac79c8b82d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:24.356936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-809966e0-0c4b-4c80-9986-2e18af6afaac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1b9307efb74379a66c4cac79c8b82d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:24.360593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-809966e0-0c4b-4c80-9986-2e18af6afaac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1b9307efb74379a66c4cac79c8b82d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:24.390171 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3748/7497] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:27:24 2022] DELETE /identity/v3/users/9d1b9307efb74379a66c4cac79c8b82d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:24.589073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb0c5d-4905-4443-9f1c-526122d3a5bd service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:24.607919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb0c5d-4905-4443-9f1c-526122d3a5bd service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:24.684875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6c96b-76f8-46ea-a9ef-65892214facf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:24.685652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6c96b-76f8-46ea-a9ef-65892214facf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:24.686050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6c96b-76f8-46ea-a9ef-65892214facf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:24.686520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6c96b-76f8-46ea-a9ef-65892214facf admin admin] PATH_INFO: `/v3/projects/19300678172b4ddf8ec9dfe3b0a56438` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:24.688509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6c96b-76f8-46ea-a9ef-65892214facf admin admin] RBAC: Authorizing `identity:delete_project(project_id=19300678172b4ddf8ec9dfe3b0a56438)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:24.691146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6c96b-76f8-46ea-a9ef-65892214facf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:24.757164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91c6c96b-76f8-46ea-a9ef-65892214facf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19300678172b4ddf8ec9dfe3b0a56438', 'request_id': 'req-91c6c96b-76f8-46ea-a9ef-65892214facf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:24.768530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91c6c96b-76f8-46ea-a9ef-65892214facf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19300678172b4ddf8ec9dfe3b0a56438', 'request_id': 'req-91c6c96b-76f8-46ea-a9ef-65892214facf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:24.774924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91c6c96b-76f8-46ea-a9ef-65892214facf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19300678172b4ddf8ec9dfe3b0a56438', 'request_id': 'req-91c6c96b-76f8-46ea-a9ef-65892214facf'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:24.787821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91c6c96b-76f8-46ea-a9ef-65892214facf admin admin] The token cache is being invalidate because project 19300678172b4ddf8ec9dfe3b0a56438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:27:24.788110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91c6c96b-76f8-46ea-a9ef-65892214facf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:24.788783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-91c6c96b-76f8-46ea-a9ef-65892214facf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:24.790781 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3750/7498] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:27:24 2022] DELETE /identity/v3/projects/19300678172b4ddf8ec9dfe3b0a56438 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:24.795524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd213-9eaa-408a-a16e-0a35548c0730 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:24.795811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd213-9eaa-408a-a16e-0a35548c0730 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:24.796078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd213-9eaa-408a-a16e-0a35548c0730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:24.822956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-704dd213-9eaa-408a-a16e-0a35548c0730 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:24.822956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-704dd213-9eaa-408a-a16e-0a35548c0730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:24.903407 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3749/7499] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:24.912020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acade224-f500-44ea-981d-96cc454858f4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:24.912389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acade224-f500-44ea-981d-96cc454858f4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:24.912739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acade224-f500-44ea-981d-96cc454858f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:24.935892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-acade224-f500-44ea-981d-96cc454858f4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:24.937118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-acade224-f500-44ea-981d-96cc454858f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:24.951992 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3751/7500] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:27:24.957026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dd213-9eaa-408a-a16e-0a35548c0730 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:24.970513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dd213-9eaa-408a-a16e-0a35548c0730 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:24.978433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89913fb3-30c2-4729-8235-37feebbe992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:24.979219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89913fb3-30c2-4729-8235-37feebbe992a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:24.979505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89913fb3-30c2-4729-8235-37feebbe992a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:24.979805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89913fb3-30c2-4729-8235-37feebbe992a admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:24.980459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89913fb3-30c2-4729-8235-37feebbe992a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:27:24.980763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89913fb3-30c2-4729-8235-37feebbe992a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:24.982555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89913fb3-30c2-4729-8235-37feebbe992a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:24.998855 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3750/7501] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:27:25.003800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acade224-f500-44ea-981d-96cc454858f4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:25.013937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acade224-f500-44ea-981d-96cc454858f4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:25.019336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a1fc2-946e-4ebf-ba55-bc5464fb1f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:25.019946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a1fc2-946e-4ebf-ba55-bc5464fb1f0b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:25.020229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a1fc2-946e-4ebf-ba55-bc5464fb1f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:25.020499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a1fc2-946e-4ebf-ba55-bc5464fb1f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:25.021146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a1fc2-946e-4ebf-ba55-bc5464fb1f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:25.023121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a1fc2-946e-4ebf-ba55-bc5464fb1f0b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:25.060583 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3752/7502] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:27:25 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:27:25.061838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89913fb3-30c2-4729-8235-37feebbe992a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:25.073541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89913fb3-30c2-4729-8235-37feebbe992a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:25.139873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad066c-3680-4d76-b4c1-89c5153b1b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:25.140531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad066c-3680-4d76-b4c1-89c5153b1b86 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:25.141072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad066c-3680-4d76-b4c1-89c5153b1b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:25.141954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad066c-3680-4d76-b4c1-89c5153b1b86 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:25.142588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad066c-3680-4d76-b4c1-89c5153b1b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:25.144609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad066c-3680-4d76-b4c1-89c5153b1b86 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:25.170269 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3751/7503] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:27:25 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:27:25.174606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a1fc2-946e-4ebf-ba55-bc5464fb1f0b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:25.186536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a1fc2-946e-4ebf-ba55-bc5464fb1f0b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:25.192661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854b8df-2faa-41db-bb73-214d4f236a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:25.193582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b8df-2faa-41db-bb73-214d4f236a37 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:25.194160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b8df-2faa-41db-bb73-214d4f236a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:25.194633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854b8df-2faa-41db-bb73-214d4f236a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:25.195469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854b8df-2faa-41db-bb73-214d4f236a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:25.197341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854b8df-2faa-41db-bb73-214d4f236a37 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:25.217154 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3753/7504] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:27:25.221134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad066c-3680-4d76-b4c1-89c5153b1b86 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:25.231616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:25.241195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad066c-3680-4d76-b4c1-89c5153b1b86 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:25.247831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbd44d-3830-466e-a0b7-879ea54a669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:25.248660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbd44d-3830-466e-a0b7-879ea54a669f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:25.249179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbd44d-3830-466e-a0b7-879ea54a669f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:25.249307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbd44d-3830-466e-a0b7-879ea54a669f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:25.250648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbd44d-3830-466e-a0b7-879ea54a669f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:25.252649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbd44d-3830-466e-a0b7-879ea54a669f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:25.266390 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3752/7505] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:27:25.270702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854b8df-2faa-41db-bb73-214d4f236a37 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:25.281291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854b8df-2faa-41db-bb73-214d4f236a37 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:25.286222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7214a-e769-434a-bb10-45e44bee8289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:25.286931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7214a-e769-434a-bb10-45e44bee8289 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:25.287218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7214a-e769-434a-bb10-45e44bee8289 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:25.287494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7214a-e769-434a-bb10-45e44bee8289 admin admin] PATH_INFO: `/v3/projects/9e898292f09a48768d9a5c94f0e94e6d/users/c71353430b3c4d9897d38d105ea7bf6d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:25.304389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7214a-e769-434a-bb10-45e44bee8289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e898292f09a48768d9a5c94f0e94e6d, user_id=c71353430b3c4d9897d38d105ea7bf6d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:25.307337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7214a-e769-434a-bb10-45e44bee8289 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:25.325198 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3754/7506] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:27:25 2022] PUT /identity/v3/projects/9e898292f09a48768d9a5c94f0e94e6d/users/c71353430b3c4d9897d38d105ea7bf6d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:25.331354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c383e4b-b31f-49b4-aba7-4f4aad59db9b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:25.331652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c383e4b-b31f-49b4-aba7-4f4aad59db9b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:25.331931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c383e4b-b31f-49b4-aba7-4f4aad59db9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:25.377398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2c383e4b-b31f-49b4-aba7-4f4aad59db9b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:25.379960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2c383e4b-b31f-49b4-aba7-4f4aad59db9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:25.477694 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3753/7507] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:25.488259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7214a-e769-434a-bb10-45e44bee8289 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:25.490166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ebe7214a-e769-434a-bb10-45e44bee8289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:25.514850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:25.593193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7214a-e769-434a-bb10-45e44bee8289 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:25.599456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842fad9-bbfc-43b8-a5dc-0e1f39f9edd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:25.600458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842fad9-bbfc-43b8-a5dc-0e1f39f9edd3 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:25.600913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842fad9-bbfc-43b8-a5dc-0e1f39f9edd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:25.601485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842fad9-bbfc-43b8-a5dc-0e1f39f9edd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:25.615966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842fad9-bbfc-43b8-a5dc-0e1f39f9edd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:25.621143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842fad9-bbfc-43b8-a5dc-0e1f39f9edd3 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:25.632852 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3755/7508] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:32.323802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db466-73f6-483f-afef-3c9e58262b57 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:32.324271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db466-73f6-483f-afef-3c9e58262b57 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:32.324359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db466-73f6-483f-afef-3c9e58262b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:32.388969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-507db466-73f6-483f-afef-3c9e58262b57 None None] MFA Rules not processed for user `c71353430b3c4d9897d38d105ea7bf6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:32.390578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-507db466-73f6-483f-afef-3c9e58262b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:32.489090 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3754/7509] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:32 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:32.493303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842fad9-bbfc-43b8-a5dc-0e1f39f9edd3 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:32.505087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842fad9-bbfc-43b8-a5dc-0e1f39f9edd3 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:32.526137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc5aa4-b7f6-481d-8911-d8f2b60382cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:32.527092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc5aa4-b7f6-481d-8911-d8f2b60382cf admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:32.527558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc5aa4-b7f6-481d-8911-d8f2b60382cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:32.527998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc5aa4-b7f6-481d-8911-d8f2b60382cf admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:32.528809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc5aa4-b7f6-481d-8911-d8f2b60382cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:32.530933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc5aa4-b7f6-481d-8911-d8f2b60382cf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:32.586935 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3756/7510] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:27:32 2022] POST /identity/v3/projects => generated 403 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:27:32.590591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507db466-73f6-483f-afef-3c9e58262b57 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:32.610641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507db466-73f6-483f-afef-3c9e58262b57 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:32.699468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937ebb6-8c64-4a02-8ee5-a062fddcfe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:32.700523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937ebb6-8c64-4a02-8ee5-a062fddcfe8b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:32.701175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937ebb6-8c64-4a02-8ee5-a062fddcfe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:32.701626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937ebb6-8c64-4a02-8ee5-a062fddcfe8b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:32.702691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937ebb6-8c64-4a02-8ee5-a062fddcfe8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:32.705680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937ebb6-8c64-4a02-8ee5-a062fddcfe8b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:32.747864 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3755/7511] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:27:32 2022] POST /identity/v3/users => generated 302 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:27:32.749470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc5aa4-b7f6-481d-8911-d8f2b60382cf admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:32.768728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc5aa4-b7f6-481d-8911-d8f2b60382cf admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:32.779808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57c010-6f26-4381-9361-23a06ede72f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:32.780562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57c010-6f26-4381-9361-23a06ede72f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:32.785172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57c010-6f26-4381-9361-23a06ede72f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:32.785626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57c010-6f26-4381-9361-23a06ede72f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:32.786450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57c010-6f26-4381-9361-23a06ede72f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:32.788300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57c010-6f26-4381-9361-23a06ede72f2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:32.823499 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3757/7512] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:27:32.825169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937ebb6-8c64-4a02-8ee5-a062fddcfe8b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:32.841378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937ebb6-8c64-4a02-8ee5-a062fddcfe8b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:32.850426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3338e-0e63-439e-865b-02558d92d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:32.851672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3338e-0e63-439e-865b-02558d92d575 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:32.852112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3338e-0e63-439e-865b-02558d92d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:32.852571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3338e-0e63-439e-865b-02558d92d575 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:32.853405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3338e-0e63-439e-865b-02558d92d575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:32.855241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3338e-0e63-439e-865b-02558d92d575 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:32.878817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57c010-6f26-4381-9361-23a06ede72f2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:32.879278 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3756/7513] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:27:32.894851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57c010-6f26-4381-9361-23a06ede72f2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:32.900575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fe330-fd10-41cd-a4fa-a36b8197fa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:32.901256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe330-fd10-41cd-a4fa-a36b8197fa5e admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:32.901536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe330-fd10-41cd-a4fa-a36b8197fa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:32.902015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe330-fd10-41cd-a4fa-a36b8197fa5e admin admin] PATH_INFO: `/v3/projects/d59176321802453d8cd6af7d04c84f0d/users/2f0af823271244b1a0c4bd4b7b28d151/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:32.918397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fe330-fd10-41cd-a4fa-a36b8197fa5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59176321802453d8cd6af7d04c84f0d, user_id=2f0af823271244b1a0c4bd4b7b28d151, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:32.921425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fe330-fd10-41cd-a4fa-a36b8197fa5e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:32.940826 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3758/7514] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:27:32 2022] PUT /identity/v3/projects/d59176321802453d8cd6af7d04c84f0d/users/2f0af823271244b1a0c4bd4b7b28d151/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:39.567034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cc322-4534-48d4-a281-94010b942234 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:39.567580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cc322-4534-48d4-a281-94010b942234 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:39.567580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cc322-4534-48d4-a281-94010b942234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:39.595830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:39.622713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-215cc322-4534-48d4-a281-94010b942234 None None] MFA Rules not processed for user `2f0af823271244b1a0c4bd4b7b28d151`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:39.624188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-215cc322-4534-48d4-a281-94010b942234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:39.723060 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3757/7515] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:39 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:39.734425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb732c-67ee-4aad-b6eb-6323b98a5093 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:39.735245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb732c-67ee-4aad-b6eb-6323b98a5093 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:39.735245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb732c-67ee-4aad-b6eb-6323b98a5093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:39.776602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c0fb732c-67ee-4aad-b6eb-6323b98a5093 None None] MFA Rules not processed for user `c71353430b3c4d9897d38d105ea7bf6d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:39.778324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c0fb732c-67ee-4aad-b6eb-6323b98a5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:39.887684 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3759/7516] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:39 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:39.905510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cc322-4534-48d4-a281-94010b942234 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:39.907898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-215cc322-4534-48d4-a281-94010b942234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:40.003168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cc322-4534-48d4-a281-94010b942234 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:40.009128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816ace1-a64b-474b-be22-a5265c65d6f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:40.009746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816ace1-a64b-474b-be22-a5265c65d6f2 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:40.010035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816ace1-a64b-474b-be22-a5265c65d6f2 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:40.010307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816ace1-a64b-474b-be22-a5265c65d6f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:40.019903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816ace1-a64b-474b-be22-a5265c65d6f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:40.021505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816ace1-a64b-474b-be22-a5265c65d6f2 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:40.032513 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3758/7517] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:39 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:41.044237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb732c-67ee-4aad-b6eb-6323b98a5093 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:41.047094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c0fb732c-67ee-4aad-b6eb-6323b98a5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:41.170398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb732c-67ee-4aad-b6eb-6323b98a5093 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:41.185870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:41.189061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:41.189403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:41.189695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] PATH_INFO: `/v3/users/f6536b65215e445b87af361cf716d5d9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:41.191424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6536b65215e445b87af361cf716d5d9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:41.193908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:41.201348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:41.272254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6536b65215e445b87af361cf716d5d9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:41.285159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6536b65215e445b87af361cf716d5d9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:41.287434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6536b65215e445b87af361cf716d5d9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:41.308462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6536b65215e445b87af361cf716d5d9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:41.309843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6536b65215e445b87af361cf716d5d9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:41.335922 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3760/7518] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:27:41 2022] DELETE /identity/v3/users/f6536b65215e445b87af361cf716d5d9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:41.336837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e84a58-908a-45c8-b0dc-24f88c827a67 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:41.337321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e84a58-908a-45c8-b0dc-24f88c827a67 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:41.337412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e84a58-908a-45c8-b0dc-24f88c827a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:41.371942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-16e84a58-908a-45c8-b0dc-24f88c827a67 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:41.373178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-16e84a58-908a-45c8-b0dc-24f88c827a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:41.494190 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3759/7519] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:27:41.507154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:41.508812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:41.608182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e0e92-28bc-47be-bec1-be69bc881faa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:41.613251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592eedc-4a52-4a97-99bb-0e7c852e0cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:41.614415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592eedc-4a52-4a97-99bb-0e7c852e0cab service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:41.615117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592eedc-4a52-4a97-99bb-0e7c852e0cab service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:41.615607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592eedc-4a52-4a97-99bb-0e7c852e0cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:41.627431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592eedc-4a52-4a97-99bb-0e7c852e0cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:41.629281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592eedc-4a52-4a97-99bb-0e7c852e0cab service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:41.647988 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3761/7520] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:42.022397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e84a58-908a-45c8-b0dc-24f88c827a67 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:42.026488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-16e84a58-908a-45c8-b0dc-24f88c827a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:42.068073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e84a58-908a-45c8-b0dc-24f88c827a67 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:42.082171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fed3d-4387-4547-8979-9f5ccf6e4eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:42.085480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fed3d-4387-4547-8979-9f5ccf6e4eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:42.085930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fed3d-4387-4547-8979-9f5ccf6e4eda admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:42.086388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fed3d-4387-4547-8979-9f5ccf6e4eda admin admin] PATH_INFO: `/v3/projects/2713adc364e84f4e82c775431a7c343a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:42.089602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fed3d-4387-4547-8979-9f5ccf6e4eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=2713adc364e84f4e82c775431a7c343a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:42.094861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fed3d-4387-4547-8979-9f5ccf6e4eda admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:42.114642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:42.180955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c59fed3d-4387-4547-8979-9f5ccf6e4eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2713adc364e84f4e82c775431a7c343a', 'request_id': 'req-c59fed3d-4387-4547-8979-9f5ccf6e4eda'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:42.192579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c59fed3d-4387-4547-8979-9f5ccf6e4eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2713adc364e84f4e82c775431a7c343a', 'request_id': 'req-c59fed3d-4387-4547-8979-9f5ccf6e4eda'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:42.200724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c59fed3d-4387-4547-8979-9f5ccf6e4eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2713adc364e84f4e82c775431a7c343a', 'request_id': 'req-c59fed3d-4387-4547-8979-9f5ccf6e4eda'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:42.228315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c59fed3d-4387-4547-8979-9f5ccf6e4eda admin admin] The token cache is being invalidate because project 2713adc364e84f4e82c775431a7c343a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:27:42.228698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c59fed3d-4387-4547-8979-9f5ccf6e4eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:42.229554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c59fed3d-4387-4547-8979-9f5ccf6e4eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:27:42.233097 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3760/7521] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:27:42 2022] DELETE /identity/v3/projects/2713adc364e84f4e82c775431a7c343a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:42.241810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d17aa6-9813-4ecb-8b02-0b26bb179143 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:42.241810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d17aa6-9813-4ecb-8b02-0b26bb179143 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:42.241810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d17aa6-9813-4ecb-8b02-0b26bb179143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:42.271000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e7d17aa6-9813-4ecb-8b02-0b26bb179143 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:42.273119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e7d17aa6-9813-4ecb-8b02-0b26bb179143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:42.489118 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3762/7522] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:42.498626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb56ab-8327-491b-8c6e-607eb8e20f7c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:42.500288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb56ab-8327-491b-8c6e-607eb8e20f7c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:42.500288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb56ab-8327-491b-8c6e-607eb8e20f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:42.558754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-59cb56ab-8327-491b-8c6e-607eb8e20f7c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:42.563527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-59cb56ab-8327-491b-8c6e-607eb8e20f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:42.597257 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3761/7523] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:42.601610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d17aa6-9813-4ecb-8b02-0b26bb179143 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:42.616791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d17aa6-9813-4ecb-8b02-0b26bb179143 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:42.627115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3c9ce-6b36-4f9f-baf9-d3e402593375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:42.629317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3c9ce-6b36-4f9f-baf9-d3e402593375 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:42.630878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3c9ce-6b36-4f9f-baf9-d3e402593375 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:42.631840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3c9ce-6b36-4f9f-baf9-d3e402593375 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:42.632598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3c9ce-6b36-4f9f-baf9-d3e402593375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:27:42.635086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3c9ce-6b36-4f9f-baf9-d3e402593375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:42.637528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3c9ce-6b36-4f9f-baf9-d3e402593375 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:42.662840 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3763/7524] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:27:42.664336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb56ab-8327-491b-8c6e-607eb8e20f7c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:42.676402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb56ab-8327-491b-8c6e-607eb8e20f7c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:42.699915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc6e48-6d96-45ae-877b-b145f4f6eef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:42.701031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc6e48-6d96-45ae-877b-b145f4f6eef6 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:42.701545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc6e48-6d96-45ae-877b-b145f4f6eef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:42.702076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc6e48-6d96-45ae-877b-b145f4f6eef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:42.703640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc6e48-6d96-45ae-877b-b145f4f6eef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:42.708486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dc6e48-6d96-45ae-877b-b145f4f6eef6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:42.771111 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3762/7525] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:27:42 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:27:42.775170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3c9ce-6b36-4f9f-baf9-d3e402593375 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:42.794811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3c9ce-6b36-4f9f-baf9-d3e402593375 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:42.842048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:42.984495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f4204-3072-4ac1-8bde-52a34cebbff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:42.985330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4204-3072-4ac1-8bde-52a34cebbff4 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:42.985710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4204-3072-4ac1-8bde-52a34cebbff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:42.986087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f4204-3072-4ac1-8bde-52a34cebbff4 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:42.986858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f4204-3072-4ac1-8bde-52a34cebbff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:42.988922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f4204-3072-4ac1-8bde-52a34cebbff4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:43.045740 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3764/7526] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:27:42 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:27:43.049833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc6e48-6d96-45ae-877b-b145f4f6eef6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:43.066113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc6e48-6d96-45ae-877b-b145f4f6eef6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:43.075792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be35cf4-3a8c-498e-bc50-61d9c1fa9d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:43.077456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be35cf4-3a8c-498e-bc50-61d9c1fa9d7b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:43.078086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be35cf4-3a8c-498e-bc50-61d9c1fa9d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:43.079311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be35cf4-3a8c-498e-bc50-61d9c1fa9d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:43.080375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be35cf4-3a8c-498e-bc50-61d9c1fa9d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:43.084386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be35cf4-3a8c-498e-bc50-61d9c1fa9d7b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:43.104809 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3763/7527] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:27:43.107721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f4204-3072-4ac1-8bde-52a34cebbff4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:43.120654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f4204-3072-4ac1-8bde-52a34cebbff4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:43.126841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accc898-a7b1-4df8-80ae-409768198af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:43.127810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accc898-a7b1-4df8-80ae-409768198af3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:43.128308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accc898-a7b1-4df8-80ae-409768198af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:43.128795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accc898-a7b1-4df8-80ae-409768198af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:43.129685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accc898-a7b1-4df8-80ae-409768198af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:43.131694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accc898-a7b1-4df8-80ae-409768198af3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:43.146733 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3765/7528] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:27:43.150392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be35cf4-3a8c-498e-bc50-61d9c1fa9d7b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:43.166489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be35cf4-3a8c-498e-bc50-61d9c1fa9d7b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:43.175671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af009f3b-06eb-4c96-96a7-609c40d861df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:43.176646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af009f3b-06eb-4c96-96a7-609c40d861df admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:43.177154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af009f3b-06eb-4c96-96a7-609c40d861df admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:43.177639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af009f3b-06eb-4c96-96a7-609c40d861df admin admin] PATH_INFO: `/v3/projects/cedd454715b747299a1f9ff582f31724/users/4ce2b3c1fae6435cb2d0317137b5ddb5/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:43.199475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af009f3b-06eb-4c96-96a7-609c40d861df admin admin] RBAC: Authorizing `identity:create_grant(project_id=cedd454715b747299a1f9ff582f31724, user_id=4ce2b3c1fae6435cb2d0317137b5ddb5, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:43.203687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af009f3b-06eb-4c96-96a7-609c40d861df admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:43.227139 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3764/7529] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:27:43 2022] PUT /identity/v3/projects/cedd454715b747299a1f9ff582f31724/users/4ce2b3c1fae6435cb2d0317137b5ddb5/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:27:43.228463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3baee-8774-41ea-81e4-7a112d932e22 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:43.228821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3baee-8774-41ea-81e4-7a112d932e22 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:43.229452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3baee-8774-41ea-81e4-7a112d932e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:43.311096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bcc3baee-8774-41ea-81e4-7a112d932e22 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:43.312429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bcc3baee-8774-41ea-81e4-7a112d932e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:43.408343 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3766/7530] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:43.419319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af009f3b-06eb-4c96-96a7-609c40d861df admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:43.421892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-af009f3b-06eb-4c96-96a7-609c40d861df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:43.501008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af009f3b-06eb-4c96-96a7-609c40d861df admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:43.507699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f50d3d-9543-4b80-9d95-b57370502417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:43.508705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f50d3d-9543-4b80-9d95-b57370502417 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:43.509156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f50d3d-9543-4b80-9d95-b57370502417 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:43.509655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f50d3d-9543-4b80-9d95-b57370502417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:43.524705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f50d3d-9543-4b80-9d95-b57370502417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:43.526967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f50d3d-9543-4b80-9d95-b57370502417 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:43.551874 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3765/7531] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:44.818625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3923-6bac-4a17-9aad-a326a25e32d8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:44.819967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3923-6bac-4a17-9aad-a326a25e32d8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:44.820356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb3923-6bac-4a17-9aad-a326a25e32d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:44.897092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2edb3923-6bac-4a17-9aad-a326a25e32d8 None None] MFA Rules not processed for user `4ce2b3c1fae6435cb2d0317137b5ddb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:44.902307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2edb3923-6bac-4a17-9aad-a326a25e32d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:45.024706 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3767/7532] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:45.030390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f50d3d-9543-4b80-9d95-b57370502417 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:45.048557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f50d3d-9543-4b80-9d95-b57370502417 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:45.059202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8240e-e382-4601-aa4a-a86514cdf048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:45.059832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8240e-e382-4601-aa4a-a86514cdf048 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:45.060119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8240e-e382-4601-aa4a-a86514cdf048 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:45.060397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8240e-e382-4601-aa4a-a86514cdf048 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:45.061040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8240e-e382-4601-aa4a-a86514cdf048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:45.064702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8240e-e382-4601-aa4a-a86514cdf048 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:45.115428 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3766/7533] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:27:45 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:27:45.119548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb3923-6bac-4a17-9aad-a326a25e32d8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:45.135141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb3923-6bac-4a17-9aad-a326a25e32d8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:45.188811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:45.241912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56506523-b778-4646-99b7-a7b73ef2a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:45.242639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56506523-b778-4646-99b7-a7b73ef2a110 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:45.243013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56506523-b778-4646-99b7-a7b73ef2a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:45.243351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56506523-b778-4646-99b7-a7b73ef2a110 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:45.244060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56506523-b778-4646-99b7-a7b73ef2a110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:45.246091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56506523-b778-4646-99b7-a7b73ef2a110 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:45.274120 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3768/7534] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:27:45 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:27:45.275402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8240e-e382-4601-aa4a-a86514cdf048 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:45.287349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8240e-e382-4601-aa4a-a86514cdf048 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:45.292133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202a5ac-f5af-49ca-b3a3-5049cd83959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:45.293383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202a5ac-f5af-49ca-b3a3-5049cd83959b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:45.293737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202a5ac-f5af-49ca-b3a3-5049cd83959b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:45.294081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202a5ac-f5af-49ca-b3a3-5049cd83959b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:45.294823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202a5ac-f5af-49ca-b3a3-5049cd83959b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:45.297216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202a5ac-f5af-49ca-b3a3-5049cd83959b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:45.309388 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3767/7535] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:27:45.314134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56506523-b778-4646-99b7-a7b73ef2a110 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:45.327116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56506523-b778-4646-99b7-a7b73ef2a110 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:45.333176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1289c90-5e23-465d-a5e5-ecd21a63732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:45.333846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1289c90-5e23-465d-a5e5-ecd21a63732d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:45.334130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1289c90-5e23-465d-a5e5-ecd21a63732d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:45.334411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1289c90-5e23-465d-a5e5-ecd21a63732d admin admin] PATH_INFO: `/v3/projects/cbd2df0c2ba24bc28477313d86092abf/users/a1be82bd18ee47c9a4bd337ceba8cefb/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:45.355158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1289c90-5e23-465d-a5e5-ecd21a63732d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd2df0c2ba24bc28477313d86092abf, user_id=a1be82bd18ee47c9a4bd337ceba8cefb, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:45.358492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1289c90-5e23-465d-a5e5-ecd21a63732d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:45.383863 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3769/7536] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:27:45 2022] PUT /identity/v3/projects/cbd2df0c2ba24bc28477313d86092abf/users/a1be82bd18ee47c9a4bd337ceba8cefb/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:27:45.388172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202a5ac-f5af-49ca-b3a3-5049cd83959b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:45.399968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202a5ac-f5af-49ca-b3a3-5049cd83959b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:45.403962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:45.467440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfac698-a1ad-4ae9-9ee0-186f8b44132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:45.468054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfac698-a1ad-4ae9-9ee0-186f8b44132a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:45.468479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfac698-a1ad-4ae9-9ee0-186f8b44132a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:45.468875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfac698-a1ad-4ae9-9ee0-186f8b44132a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:45.469634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfac698-a1ad-4ae9-9ee0-186f8b44132a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:45.471246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfac698-a1ad-4ae9-9ee0-186f8b44132a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:45.485470 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3768/7537] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:27:45.499200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1289c90-5e23-465d-a5e5-ecd21a63732d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:45.514025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1289c90-5e23-465d-a5e5-ecd21a63732d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:45.519763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7db8b5-5549-4fe9-b363-d5c4ad166c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:45.520490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7db8b5-5549-4fe9-b363-d5c4ad166c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:45.520783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7db8b5-5549-4fe9-b363-d5c4ad166c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:45.521059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7db8b5-5549-4fe9-b363-d5c4ad166c07 admin admin] PATH_INFO: `/v3/projects/cbd2df0c2ba24bc28477313d86092abf/users/a1be82bd18ee47c9a4bd337ceba8cefb/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:45.523106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7db8b5-5549-4fe9-b363-d5c4ad166c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd2df0c2ba24bc28477313d86092abf, user_id=a1be82bd18ee47c9a4bd337ceba8cefb, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:45.525831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7db8b5-5549-4fe9-b363-d5c4ad166c07 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:45.538805 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3770/7538] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:27:45 2022] PUT /identity/v3/projects/cbd2df0c2ba24bc28477313d86092abf/users/a1be82bd18ee47c9a4bd337ceba8cefb/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:27:46.289458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b90a2a-f582-4c16-a8e8-1a5d12bf1627 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:46.290025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b90a2a-f582-4c16-a8e8-1a5d12bf1627 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:46.290025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b90a2a-f582-4c16-a8e8-1a5d12bf1627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:46.324653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a3b90a2a-f582-4c16-a8e8-1a5d12bf1627 None None] MFA Rules not processed for user `a1be82bd18ee47c9a4bd337ceba8cefb`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:46.325828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a3b90a2a-f582-4c16-a8e8-1a5d12bf1627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:46.442298 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3769/7539] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:46.453629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b74c7-890a-4cb6-ba1a-ac4d3c001610 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:46.454160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b74c7-890a-4cb6-ba1a-ac4d3c001610 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:46.454288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b74c7-890a-4cb6-ba1a-ac4d3c001610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:46.477246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6f9b74c7-890a-4cb6-ba1a-ac4d3c001610 None None] MFA Rules not processed for user `4ce2b3c1fae6435cb2d0317137b5ddb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:27:46.478719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6f9b74c7-890a-4cb6-ba1a-ac4d3c001610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:46.550276 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3771/7540] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:27:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:27:46.558440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b90a2a-f582-4c16-a8e8-1a5d12bf1627 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:46.565670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a3b90a2a-f582-4c16-a8e8-1a5d12bf1627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:46.658998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b90a2a-f582-4c16-a8e8-1a5d12bf1627 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:46.665206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20dce5-280f-4b09-8f23-df4241c98e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:46.666296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20dce5-280f-4b09-8f23-df4241c98e49 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:46.666296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20dce5-280f-4b09-8f23-df4241c98e49 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:46.666897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20dce5-280f-4b09-8f23-df4241c98e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:46.678777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20dce5-280f-4b09-8f23-df4241c98e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:46.680524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20dce5-280f-4b09-8f23-df4241c98e49 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:46.692162 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3770/7541] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:53.733233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b74c7-890a-4cb6-ba1a-ac4d3c001610 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:53.747710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b74c7-890a-4cb6-ba1a-ac4d3c001610 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:53.754678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2084af-510c-448b-b6db-dc6704617f72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:53.755329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2084af-510c-448b-b6db-dc6704617f72 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:53.755605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2084af-510c-448b-b6db-dc6704617f72 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:53.755887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2084af-510c-448b-b6db-dc6704617f72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:53.757629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aa2084af-510c-448b-b6db-dc6704617f72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:53.818832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2084af-510c-448b-b6db-dc6704617f72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:53.820453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2084af-510c-448b-b6db-dc6704617f72 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:53.830344 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3772/7542] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:53 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:27:56.686272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:27:58.268229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20dce5-280f-4b09-8f23-df4241c98e49 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:27:58.269766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fe20dce5-280f-4b09-8f23-df4241c98e49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:58.337247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20dce5-280f-4b09-8f23-df4241c98e49 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:27:58.341694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958877b-0261-4af6-be94-d86560401a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:27:58.342390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958877b-0261-4af6-be94-d86560401a6f service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:27:58.342735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958877b-0261-4af6-be94-d86560401a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:27:58.343841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958877b-0261-4af6-be94-d86560401a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:27:58.345832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b958877b-0261-4af6-be94-d86560401a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:27:58.357511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958877b-0261-4af6-be94-d86560401a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:27:58.360062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958877b-0261-4af6-be94-d86560401a6f service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:27:58.371514 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3771/7543] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:27:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:03.825306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:07.166257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2084af-510c-448b-b6db-dc6704617f72 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:07.167797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aa2084af-510c-448b-b6db-dc6704617f72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:07.267052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2084af-510c-448b-b6db-dc6704617f72 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:07.272183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:07.272863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:07.273158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:07.273590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] PATH_INFO: `/v3/users/c71353430b3c4d9897d38d105ea7bf6d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:07.275297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71353430b3c4d9897d38d105ea7bf6d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:07.277559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:07.348554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71353430b3c4d9897d38d105ea7bf6d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:07.357019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71353430b3c4d9897d38d105ea7bf6d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:07.357762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71353430b3c4d9897d38d105ea7bf6d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:07.377601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71353430b3c4d9897d38d105ea7bf6d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:07.378349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71353430b3c4d9897d38d105ea7bf6d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:07.399351 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3773/7544] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:28:07 2022] DELETE /identity/v3/users/c71353430b3c4d9897d38d105ea7bf6d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:28:07.622990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958877b-0261-4af6-be94-d86560401a6f service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:07.656073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958877b-0261-4af6-be94-d86560401a6f service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:07.741777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:07.742659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:07.743038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:07.743389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] PATH_INFO: `/v3/projects/9e898292f09a48768d9a5c94f0e94e6d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:07.744785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e898292f09a48768d9a5c94f0e94e6d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:07.747198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:07.813376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e898292f09a48768d9a5c94f0e94e6d', 'request_id': 'req-6e812c9d-8049-4f16-b8ad-bf95613ebab9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:07.822313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e898292f09a48768d9a5c94f0e94e6d', 'request_id': 'req-6e812c9d-8049-4f16-b8ad-bf95613ebab9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:07.831928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e898292f09a48768d9a5c94f0e94e6d', 'request_id': 'req-6e812c9d-8049-4f16-b8ad-bf95613ebab9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:07.848143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] The token cache is being invalidate because project 9e898292f09a48768d9a5c94f0e94e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:28:07.848488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:07.849105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:07.853795 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3772/7545] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:28:07 2022] DELETE /identity/v3/projects/9e898292f09a48768d9a5c94f0e94e6d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:07.855012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:07.856438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:07.872373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9696-98cf-46b8-b4c5-15f73a5836e6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:07.944861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d66604-24b7-403d-bdc1-986ca1c33e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:07.945650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d66604-24b7-403d-bdc1-986ca1c33e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:07.946001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d66604-24b7-403d-bdc1-986ca1c33e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:07.946361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d66604-24b7-403d-bdc1-986ca1c33e39 admin admin] PATH_INFO: `/v3/users/2f0af823271244b1a0c4bd4b7b28d151` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:07.947605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d66604-24b7-403d-bdc1-986ca1c33e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f0af823271244b1a0c4bd4b7b28d151)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:07.949676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d66604-24b7-403d-bdc1-986ca1c33e39 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:07.976433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:08.017454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0d66604-24b7-403d-bdc1-986ca1c33e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f0af823271244b1a0c4bd4b7b28d151'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:08.025847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0d66604-24b7-403d-bdc1-986ca1c33e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f0af823271244b1a0c4bd4b7b28d151'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:08.026588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0d66604-24b7-403d-bdc1-986ca1c33e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f0af823271244b1a0c4bd4b7b28d151'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:08.041127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0d66604-24b7-403d-bdc1-986ca1c33e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f0af823271244b1a0c4bd4b7b28d151'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:08.041890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0d66604-24b7-403d-bdc1-986ca1c33e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f0af823271244b1a0c4bd4b7b28d151'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:08.059809 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3774/7546] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:28:07 2022] DELETE /identity/v3/users/2f0af823271244b1a0c4bd4b7b28d151 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:08.301052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:08.302591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:08.316347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e812c9d-8049-4f16-b8ad-bf95613ebab9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:08.357033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:08.402032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc547d24-2af5-41b4-bb82-bb1de7d837cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:08.403043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc547d24-2af5-41b4-bb82-bb1de7d837cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:08.403515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc547d24-2af5-41b4-bb82-bb1de7d837cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:08.403971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc547d24-2af5-41b4-bb82-bb1de7d837cb admin admin] PATH_INFO: `/v3/projects/d59176321802453d8cd6af7d04c84f0d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:08.405932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc547d24-2af5-41b4-bb82-bb1de7d837cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59176321802453d8cd6af7d04c84f0d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:08.408541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc547d24-2af5-41b4-bb82-bb1de7d837cb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:08.471481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fc547d24-2af5-41b4-bb82-bb1de7d837cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59176321802453d8cd6af7d04c84f0d', 'request_id': 'req-fc547d24-2af5-41b4-bb82-bb1de7d837cb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:08.478357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fc547d24-2af5-41b4-bb82-bb1de7d837cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59176321802453d8cd6af7d04c84f0d', 'request_id': 'req-fc547d24-2af5-41b4-bb82-bb1de7d837cb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:08.495383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fc547d24-2af5-41b4-bb82-bb1de7d837cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59176321802453d8cd6af7d04c84f0d', 'request_id': 'req-fc547d24-2af5-41b4-bb82-bb1de7d837cb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:08.516345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fc547d24-2af5-41b4-bb82-bb1de7d837cb admin admin] The token cache is being invalidate because project d59176321802453d8cd6af7d04c84f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:28:08.517100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fc547d24-2af5-41b4-bb82-bb1de7d837cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:08.517837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fc547d24-2af5-41b4-bb82-bb1de7d837cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:08.520036 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3773/7547] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:28:08 2022] DELETE /identity/v3/projects/d59176321802453d8cd6af7d04c84f0d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:08.525343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d1d70-c306-4e07-9edb-aa6eedaa8ceb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:08.525835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d1d70-c306-4e07-9edb-aa6eedaa8ceb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:08.526285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d1d70-c306-4e07-9edb-aa6eedaa8ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:08.554252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7b4d1d70-c306-4e07-9edb-aa6eedaa8ceb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:08.556277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7b4d1d70-c306-4e07-9edb-aa6eedaa8ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:08.648115 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3775/7548] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:08.650390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef09241-3c7e-4b15-ab66-902440f0aa13 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:08.650927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef09241-3c7e-4b15-ab66-902440f0aa13 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:08.651029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef09241-3c7e-4b15-ab66-902440f0aa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:08.688901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4ef09241-3c7e-4b15-ab66-902440f0aa13 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:08.690313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4ef09241-3c7e-4b15-ab66-902440f0aa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:08.717395 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3774/7549] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:08.725144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d1d70-c306-4e07-9edb-aa6eedaa8ceb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:08.736887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d1d70-c306-4e07-9edb-aa6eedaa8ceb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:08.758076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c6a91-4006-4eaf-9239-f84629ccad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:08.758833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c6a91-4006-4eaf-9239-f84629ccad06 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:08.759122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c6a91-4006-4eaf-9239-f84629ccad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:08.759517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c6a91-4006-4eaf-9239-f84629ccad06 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:08.760228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c6a91-4006-4eaf-9239-f84629ccad06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:08.760507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c6a91-4006-4eaf-9239-f84629ccad06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:08.763023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c6a91-4006-4eaf-9239-f84629ccad06 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:08.786123 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3776/7550] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:08.792475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef09241-3c7e-4b15-ab66-902440f0aa13 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:08.807049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef09241-3c7e-4b15-ab66-902440f0aa13 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:08.821603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce477-856a-4988-a195-469647474e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:08.822373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce477-856a-4988-a195-469647474e69 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:08.822670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce477-856a-4988-a195-469647474e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:08.822988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce477-856a-4988-a195-469647474e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:08.823718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ce477-856a-4988-a195-469647474e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:08.826107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ce477-856a-4988-a195-469647474e69 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:08.874369 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3775/7551] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:28:08 2022] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:08.876009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c6a91-4006-4eaf-9239-f84629ccad06 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:08.890261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c6a91-4006-4eaf-9239-f84629ccad06 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:08.980287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2223d4-4bac-4bba-ac0b-2602a7ca5edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:08.980961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2223d4-4bac-4bba-ac0b-2602a7ca5edf admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:08.981245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2223d4-4bac-4bba-ac0b-2602a7ca5edf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:08.981530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2223d4-4bac-4bba-ac0b-2602a7ca5edf admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:08.982243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2223d4-4bac-4bba-ac0b-2602a7ca5edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:08.985945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2223d4-4bac-4bba-ac0b-2602a7ca5edf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:09.019539 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3777/7552] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:28:08 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:09.023786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce477-856a-4988-a195-469647474e69 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:09.043056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce477-856a-4988-a195-469647474e69 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:09.075823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cda032-c576-4480-8cbb-587482a1551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:09.076545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cda032-c576-4480-8cbb-587482a1551d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:09.076926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cda032-c576-4480-8cbb-587482a1551d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:09.077699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cda032-c576-4480-8cbb-587482a1551d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:09.078593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cda032-c576-4480-8cbb-587482a1551d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:09.081548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cda032-c576-4480-8cbb-587482a1551d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:09.099158 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3776/7553] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:28:09.103746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2223d4-4bac-4bba-ac0b-2602a7ca5edf admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:09.120774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2223d4-4bac-4bba-ac0b-2602a7ca5edf admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:09.129166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd35c34-7c73-406c-9bf3-3a9db64823ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:09.130785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd35c34-7c73-406c-9bf3-3a9db64823ca admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:09.133515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd35c34-7c73-406c-9bf3-3a9db64823ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:09.133989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd35c34-7c73-406c-9bf3-3a9db64823ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:09.135244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd35c34-7c73-406c-9bf3-3a9db64823ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:09.138064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd35c34-7c73-406c-9bf3-3a9db64823ca admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:09.158329 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3778/7554] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:28:09.159555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cda032-c576-4480-8cbb-587482a1551d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:09.172571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cda032-c576-4480-8cbb-587482a1551d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:09.180340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ab009-c2a7-4e7d-a70b-d281676f55e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:09.181397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ab009-c2a7-4e7d-a70b-d281676f55e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:09.181887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ab009-c2a7-4e7d-a70b-d281676f55e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:09.182156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ab009-c2a7-4e7d-a70b-d281676f55e9 admin admin] PATH_INFO: `/v3/projects/4fc414bcd30546f38d67a8a99de551fa/users/778f9ab247a043dc9c67e42e0237a34a/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:09.200703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ab009-c2a7-4e7d-a70b-d281676f55e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc414bcd30546f38d67a8a99de551fa, user_id=778f9ab247a043dc9c67e42e0237a34a, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:09.204254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ab009-c2a7-4e7d-a70b-d281676f55e9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:09.231064 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3777/7555] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:28:09 2022] PUT /identity/v3/projects/4fc414bcd30546f38d67a8a99de551fa/users/778f9ab247a043dc9c67e42e0237a34a/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:09.232569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c7b21-2cd6-46f8-a9a7-2a6c28740f49 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:09.232864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c7b21-2cd6-46f8-a9a7-2a6c28740f49 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:09.233222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c7b21-2cd6-46f8-a9a7-2a6c28740f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:09.244602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:09.258636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5a2c7b21-2cd6-46f8-a9a7-2a6c28740f49 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:09.261090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5a2c7b21-2cd6-46f8-a9a7-2a6c28740f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:09.354679 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3779/7556] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:09.365826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ab009-c2a7-4e7d-a70b-d281676f55e9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:09.367733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cf9ab009-c2a7-4e7d-a70b-d281676f55e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:09.453470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ab009-c2a7-4e7d-a70b-d281676f55e9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:09.458450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e3f4d-d401-4a14-af22-d6196f643e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:09.459464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e3f4d-d401-4a14-af22-d6196f643e0f service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:09.459817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e3f4d-d401-4a14-af22-d6196f643e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:09.460162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e3f4d-d401-4a14-af22-d6196f643e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:09.473392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e3f4d-d401-4a14-af22-d6196f643e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:09.475769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e3f4d-d401-4a14-af22-d6196f643e0f service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:09.493478 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3778/7557] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:14.949790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49c12e-6bcd-47f9-b28c-95f95f438657 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:14.950305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49c12e-6bcd-47f9-b28c-95f95f438657 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:14.950483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49c12e-6bcd-47f9-b28c-95f95f438657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:14.990567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0b49c12e-6bcd-47f9-b28c-95f95f438657 None None] MFA Rules not processed for user `778f9ab247a043dc9c67e42e0237a34a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:14.992008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0b49c12e-6bcd-47f9-b28c-95f95f438657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:15.078815 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3780/7558] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:28:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:15.093264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e3f4d-d401-4a14-af22-d6196f643e0f service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:15.095718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fd6e3f4d-d401-4a14-af22-d6196f643e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:15.101418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:15.226864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e3f4d-d401-4a14-af22-d6196f643e0f service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:15.240195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09ba6-5d81-422a-bf8e-b96a8f83825b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:15.240195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09ba6-5d81-422a-bf8e-b96a8f83825b service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:15.240569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09ba6-5d81-422a-bf8e-b96a8f83825b service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:15.240786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09ba6-5d81-422a-bf8e-b96a8f83825b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:15.252521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be09ba6-5d81-422a-bf8e-b96a8f83825b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:15.254847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be09ba6-5d81-422a-bf8e-b96a8f83825b service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:15.267740 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3779/7559] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:17.463176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49c12e-6bcd-47f9-b28c-95f95f438657 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:17.465026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0b49c12e-6bcd-47f9-b28c-95f95f438657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:17.491658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49c12e-6bcd-47f9-b28c-95f95f438657 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:17.509129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:17.509737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:17.519276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:17.519276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] PATH_INFO: `/v3/users/4ce2b3c1fae6435cb2d0317137b5ddb5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:17.519839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ce2b3c1fae6435cb2d0317137b5ddb5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:17.522090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:17.522356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21135-304b-4ee1-b40b-ee6ac1f80375 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:17.522874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21135-304b-4ee1-b40b-ee6ac1f80375 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:17.523129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21135-304b-4ee1-b40b-ee6ac1f80375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:17.586984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f4d21135-304b-4ee1-b40b-ee6ac1f80375 None None] MFA Rules not processed for user `778f9ab247a043dc9c67e42e0237a34a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:17.588725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f4d21135-304b-4ee1-b40b-ee6ac1f80375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:17.599902 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3780/7560] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:17.655057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ce2b3c1fae6435cb2d0317137b5ddb5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:17.676665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ce2b3c1fae6435cb2d0317137b5ddb5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:17.679174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ce2b3c1fae6435cb2d0317137b5ddb5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:17.711701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ce2b3c1fae6435cb2d0317137b5ddb5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:17.712788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ce2b3c1fae6435cb2d0317137b5ddb5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:17.755289 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3781/7561] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:28:17 2022] DELETE /identity/v3/users/4ce2b3c1fae6435cb2d0317137b5ddb5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:18.128939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d21135-304b-4ee1-b40b-ee6ac1f80375 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:18.145014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d21135-304b-4ee1-b40b-ee6ac1f80375 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:18.302306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:18.305053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:18.307642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:18.308145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] PATH_INFO: `/v3/projects/cedd454715b747299a1f9ff582f31724` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:18.311455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cedd454715b747299a1f9ff582f31724)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:18.318002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:18.435650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cedd454715b747299a1f9ff582f31724', 'request_id': 'req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:18.450784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cedd454715b747299a1f9ff582f31724', 'request_id': 'req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:18.477485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cedd454715b747299a1f9ff582f31724', 'request_id': 'req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:18.500497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] The token cache is being invalidate because project cedd454715b747299a1f9ff582f31724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:28:18.501134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:18.502544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:18.505619 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3781/7562] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:28:18 2022] DELETE /identity/v3/projects/cedd454715b747299a1f9ff582f31724 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:18.509609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:18.511094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:18.539777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae165dc-621e-44f8-9fb8-a0f21d5bacf0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:18.544633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:18.659845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04d677-6882-42ba-aabf-1fac5648c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:18.660807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04d677-6882-42ba-aabf-1fac5648c93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:18.661277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04d677-6882-42ba-aabf-1fac5648c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:18.661921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04d677-6882-42ba-aabf-1fac5648c93f admin admin] PATH_INFO: `/v3/users/a1be82bd18ee47c9a4bd337ceba8cefb` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:18.663516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04d677-6882-42ba-aabf-1fac5648c93f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1be82bd18ee47c9a4bd337ceba8cefb)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:18.666153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04d677-6882-42ba-aabf-1fac5648c93f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:18.769718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ff04d677-6882-42ba-aabf-1fac5648c93f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1be82bd18ee47c9a4bd337ceba8cefb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:18.787667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ff04d677-6882-42ba-aabf-1fac5648c93f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1be82bd18ee47c9a4bd337ceba8cefb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:18.789553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ff04d677-6882-42ba-aabf-1fac5648c93f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1be82bd18ee47c9a4bd337ceba8cefb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:18.824679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ff04d677-6882-42ba-aabf-1fac5648c93f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1be82bd18ee47c9a4bd337ceba8cefb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:18.826252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ff04d677-6882-42ba-aabf-1fac5648c93f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1be82bd18ee47c9a4bd337ceba8cefb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:18.862373 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3782/7563] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:28:18 2022] DELETE /identity/v3/users/a1be82bd18ee47c9a4bd337ceba8cefb => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:19.113081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:19.114629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:19.140297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4a560-e6df-4ce6-af60-2bcd9cc51e02 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:19.227141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:19.361644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:19.362409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.362806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.363354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69 admin admin] PATH_INFO: `/v3/projects/cbd2df0c2ba24bc28477313d86092abf` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.364852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd2df0c2ba24bc28477313d86092abf)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:19.366884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:19.510810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd2df0c2ba24bc28477313d86092abf', 'request_id': 'req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:19.516486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7172-acb5-4885-9e56-108862a137e2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.517080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7172-acb5-4885-9e56-108862a137e2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.517080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7172-acb5-4885-9e56-108862a137e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.541920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd2df0c2ba24bc28477313d86092abf', 'request_id': 'req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:19.552701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd2df0c2ba24bc28477313d86092abf', 'request_id': 'req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:19.555576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4e6a7172-acb5-4885-9e56-108862a137e2 None None] MFA Rules not processed for user `87820fd590ab402395340d61df0cd22b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:19.556891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4e6a7172-acb5-4885-9e56-108862a137e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:19.589890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69 admin admin] The token cache is being invalidate because project cbd2df0c2ba24bc28477313d86092abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:28:19.590832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:19.591928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-bf37d1ea-3062-4f74-9e12-1bcea28c6a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:28:19.595012 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3782/7564] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:28:19 2022] DELETE /identity/v3/projects/cbd2df0c2ba24bc28477313d86092abf => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:19.599778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8e4bd-4f99-4419-b070-2470d0378a1d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.600066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8e4bd-4f99-4419-b070-2470d0378a1d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.600382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8e4bd-4f99-4419-b070-2470d0378a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.646097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-13e8e4bd-4f99-4419-b070-2470d0378a1d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:19.647916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-13e8e4bd-4f99-4419-b070-2470d0378a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:19.676080 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3783/7565] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:28:19.757426 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3783/7566] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:28:19.765529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b808-eeef-49e1-8c94-330096a05843 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.766200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b808-eeef-49e1-8c94-330096a05843 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.766490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b808-eeef-49e1-8c94-330096a05843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.801235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d359b808-eeef-49e1-8c94-330096a05843 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:19.802707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d359b808-eeef-49e1-8c94-330096a05843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:19.822730 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3784/7567] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:19.823256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8e4bd-4f99-4419-b070-2470d0378a1d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:19.844472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8e4bd-4f99-4419-b070-2470d0378a1d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:19.856281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc16a0-2cb4-46bb-b07b-6e67edb1e1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:19.857306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc16a0-2cb4-46bb-b07b-6e67edb1e1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.857658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc16a0-2cb4-46bb-b07b-6e67edb1e1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.858702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc16a0-2cb4-46bb-b07b-6e67edb1e1c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.859985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc16a0-2cb4-46bb-b07b-6e67edb1e1c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:28:19.860376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc16a0-2cb4-46bb-b07b-6e67edb1e1c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:19.862343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc16a0-2cb4-46bb-b07b-6e67edb1e1c9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:19.896959 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3784/7568] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:28:19.901447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359b808-eeef-49e1-8c94-330096a05843 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:19.925436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359b808-eeef-49e1-8c94-330096a05843 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:19.931050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8ca79-e7ef-4ef9-9092-ba5603442758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:19.931803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8ca79-e7ef-4ef9-9092-ba5603442758 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:19.932097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8ca79-e7ef-4ef9-9092-ba5603442758 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:19.932376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8ca79-e7ef-4ef9-9092-ba5603442758 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:19.933786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8ca79-e7ef-4ef9-9092-ba5603442758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:19.936923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8ca79-e7ef-4ef9-9092-ba5603442758 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:19.988835 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3785/7569] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:28:19 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:19.993319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc16a0-2cb4-46bb-b07b-6e67edb1e1c9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:20.008213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc16a0-2cb4-46bb-b07b-6e67edb1e1c9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:20.042866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:20.106237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862e32e-ce27-4e2c-b31e-b38e7b40c611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:20.107252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862e32e-ce27-4e2c-b31e-b38e7b40c611 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.108844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862e32e-ce27-4e2c-b31e-b38e7b40c611 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.109749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862e32e-ce27-4e2c-b31e-b38e7b40c611 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.110821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862e32e-ce27-4e2c-b31e-b38e7b40c611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:20.113113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862e32e-ce27-4e2c-b31e-b38e7b40c611 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:20.143914 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3785/7570] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:28:19 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:20.148142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8ca79-e7ef-4ef9-9092-ba5603442758 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:20.153942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:20.162302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8ca79-e7ef-4ef9-9092-ba5603442758 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:20.169204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e4aaa-309f-43df-b747-aee24613c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:20.169649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e4aaa-309f-43df-b747-aee24613c80d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.171172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e4aaa-309f-43df-b747-aee24613c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.171172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e4aaa-309f-43df-b747-aee24613c80d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.171884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e4aaa-309f-43df-b747-aee24613c80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:20.173996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e4aaa-309f-43df-b747-aee24613c80d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:20.189382 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3786/7571] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:28:20.190522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862e32e-ce27-4e2c-b31e-b38e7b40c611 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:20.206251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862e32e-ce27-4e2c-b31e-b38e7b40c611 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:20.213869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274171b8-e40e-41e5-9085-c647ab828ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:20.214497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274171b8-e40e-41e5-9085-c647ab828ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.214813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274171b8-e40e-41e5-9085-c647ab828ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.215094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274171b8-e40e-41e5-9085-c647ab828ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.215747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274171b8-e40e-41e5-9085-c647ab828ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:20.217463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274171b8-e40e-41e5-9085-c647ab828ca6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:20.231627 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3786/7572] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:28:20.237089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e4aaa-309f-43df-b747-aee24613c80d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:20.253343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e4aaa-309f-43df-b747-aee24613c80d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:20.265898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bd313-e8fb-4eca-8a8e-053d7f01ac23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:20.266906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bd313-e8fb-4eca-8a8e-053d7f01ac23 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.267209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bd313-e8fb-4eca-8a8e-053d7f01ac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.267494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bd313-e8fb-4eca-8a8e-053d7f01ac23 admin admin] PATH_INFO: `/v3/projects/a20fb31f8312435590cb2eeb6b6439de/users/30add6fc24b34085b5eaac8df54c424f/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.315869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bd313-e8fb-4eca-8a8e-053d7f01ac23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20fb31f8312435590cb2eeb6b6439de, user_id=30add6fc24b34085b5eaac8df54c424f, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:20.327987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bd313-e8fb-4eca-8a8e-053d7f01ac23 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:20.372725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0266f-4532-4f90-99de-ff0ac7887624 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.373160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0266f-4532-4f90-99de-ff0ac7887624 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.373446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0266f-4532-4f90-99de-ff0ac7887624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.374978 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3787/7573] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:28:20 2022] PUT /identity/v3/projects/a20fb31f8312435590cb2eeb6b6439de/users/30add6fc24b34085b5eaac8df54c424f/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:20.408775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e7e0266f-4532-4f90-99de-ff0ac7887624 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:20.410018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e7e0266f-4532-4f90-99de-ff0ac7887624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:20.561811 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3787/7574] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:28:20.574214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bd313-e8fb-4eca-8a8e-053d7f01ac23 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:20.579201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f56bd313-e8fb-4eca-8a8e-053d7f01ac23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:20.746130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bd313-e8fb-4eca-8a8e-053d7f01ac23 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:20.752305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754ce98-5083-4b39-b61e-6ee99db557c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:20.753258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754ce98-5083-4b39-b61e-6ee99db557c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:20.753569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754ce98-5083-4b39-b61e-6ee99db557c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:20.753849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754ce98-5083-4b39-b61e-6ee99db557c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:20.769279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754ce98-5083-4b39-b61e-6ee99db557c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:20.770884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754ce98-5083-4b39-b61e-6ee99db557c4 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:20.787404 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3788/7575] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:22.973311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0266f-4532-4f90-99de-ff0ac7887624 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:22.974815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e7e0266f-4532-4f90-99de-ff0ac7887624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:23.003910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0266f-4532-4f90-99de-ff0ac7887624 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:23.012572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb2244-1726-4b6b-bc4b-761e83f756b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:23.013860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb2244-1726-4b6b-bc4b-761e83f756b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:23.014421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb2244-1726-4b6b-bc4b-761e83f756b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:23.015549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb2244-1726-4b6b-bc4b-761e83f756b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:23.018145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7bcb2244-1726-4b6b-bc4b-761e83f756b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:23.035907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb2244-1726-4b6b-bc4b-761e83f756b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:23.037795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb2244-1726-4b6b-bc4b-761e83f756b1 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:23.051523 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3788/7576] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:25.491019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754ce98-5083-4b39-b61e-6ee99db557c4 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:25.492762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0754ce98-5083-4b39-b61e-6ee99db557c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:25.626020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754ce98-5083-4b39-b61e-6ee99db557c4 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:25.632698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faadb8a-422f-4190-9286-64ef9e749ae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:25.633543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faadb8a-422f-4190-9286-64ef9e749ae1 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:25.634063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faadb8a-422f-4190-9286-64ef9e749ae1 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:25.634521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faadb8a-422f-4190-9286-64ef9e749ae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:25.636984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2faadb8a-422f-4190-9286-64ef9e749ae1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:25.665222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faadb8a-422f-4190-9286-64ef9e749ae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:25.667039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faadb8a-422f-4190-9286-64ef9e749ae1 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:25.695068 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3789/7577] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:29.133251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002759-a13f-429a-aa68-cf69c0d3cb59 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:29.133807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002759-a13f-429a-aa68-cf69c0d3cb59 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:29.133807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002759-a13f-429a-aa68-cf69c0d3cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:29.170871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9c002759-a13f-429a-aa68-cf69c0d3cb59 None None] MFA Rules not processed for user `30add6fc24b34085b5eaac8df54c424f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:29.172073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9c002759-a13f-429a-aa68-cf69c0d3cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:29.290858 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3789/7578] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:28:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:29.292519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faadb8a-422f-4190-9286-64ef9e749ae1 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:29.319432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faadb8a-422f-4190-9286-64ef9e749ae1 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:29.326093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a5e2d-9bc9-4403-b73f-7878e91d4c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:29.327227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a5e2d-9bc9-4403-b73f-7878e91d4c8c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:29.327671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a5e2d-9bc9-4403-b73f-7878e91d4c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:29.328058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a5e2d-9bc9-4403-b73f-7878e91d4c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:29.328818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a5e2d-9bc9-4403-b73f-7878e91d4c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:29.331159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a5e2d-9bc9-4403-b73f-7878e91d4c8c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:29.368879 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3790/7579] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:28:29 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:28:29.372952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c002759-a13f-429a-aa68-cf69c0d3cb59 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:29.391670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c002759-a13f-429a-aa68-cf69c0d3cb59 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:29.420485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:29.489957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0077b9-b65d-4d26-9009-ef6220587422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:29.490617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0077b9-b65d-4d26-9009-ef6220587422 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:29.491667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0077b9-b65d-4d26-9009-ef6220587422 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:29.491667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0077b9-b65d-4d26-9009-ef6220587422 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:29.491940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0077b9-b65d-4d26-9009-ef6220587422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:29.493883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0077b9-b65d-4d26-9009-ef6220587422 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:29.530931 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3790/7580] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:28:29 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:28:29.532873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a5e2d-9bc9-4403-b73f-7878e91d4c8c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:29.553180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a5e2d-9bc9-4403-b73f-7878e91d4c8c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:29.560296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d4826-a0c3-4c32-a9bf-dcddaf7ea56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:29.571472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d4826-a0c3-4c32-a9bf-dcddaf7ea56a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:29.571472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d4826-a0c3-4c32-a9bf-dcddaf7ea56a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:29.571472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d4826-a0c3-4c32-a9bf-dcddaf7ea56a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:29.571472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d4826-a0c3-4c32-a9bf-dcddaf7ea56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:29.572212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d4826-a0c3-4c32-a9bf-dcddaf7ea56a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:29.594917 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3791/7581] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:28:29.598790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0077b9-b65d-4d26-9009-ef6220587422 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:29.612145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0077b9-b65d-4d26-9009-ef6220587422 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:29.618720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a117d-d3db-4f08-beb6-a78c3973f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:29.620214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a117d-d3db-4f08-beb6-a78c3973f34d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:29.620611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a117d-d3db-4f08-beb6-a78c3973f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:29.620961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a117d-d3db-4f08-beb6-a78c3973f34d admin admin] PATH_INFO: `/v3/projects/f75c01923c3a461fb769a875d8817e69/users/ea8f070b6ffe425e94434562595a3dac/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:29.641671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a117d-d3db-4f08-beb6-a78c3973f34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75c01923c3a461fb769a875d8817e69, user_id=ea8f070b6ffe425e94434562595a3dac, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:29.645521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a117d-d3db-4f08-beb6-a78c3973f34d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:29.662088 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3791/7582] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:28:29 2022] PUT /identity/v3/projects/f75c01923c3a461fb769a875d8817e69/users/ea8f070b6ffe425e94434562595a3dac/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:29.667555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d4826-a0c3-4c32-a9bf-dcddaf7ea56a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:29.680754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d4826-a0c3-4c32-a9bf-dcddaf7ea56a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:29.704233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:29.756576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb289a8-a6de-4e44-a31d-0cd9c07bd86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:29.757419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb289a8-a6de-4e44-a31d-0cd9c07bd86f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:29.757702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb289a8-a6de-4e44-a31d-0cd9c07bd86f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:29.757973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb289a8-a6de-4e44-a31d-0cd9c07bd86f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:29.758663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb289a8-a6de-4e44-a31d-0cd9c07bd86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:29.760692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb289a8-a6de-4e44-a31d-0cd9c07bd86f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:29.776587 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3792/7583] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:28:29.778082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a117d-d3db-4f08-beb6-a78c3973f34d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:29.794700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a117d-d3db-4f08-beb6-a78c3973f34d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:29.804403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb080637-abe9-4868-9b06-f672db592b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:29.805382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb080637-abe9-4868-9b06-f672db592b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:29.805766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb080637-abe9-4868-9b06-f672db592b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:29.805957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb080637-abe9-4868-9b06-f672db592b53 admin admin] PATH_INFO: `/v3/projects/f75c01923c3a461fb769a875d8817e69/users/ea8f070b6ffe425e94434562595a3dac/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:29.812775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb080637-abe9-4868-9b06-f672db592b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75c01923c3a461fb769a875d8817e69, user_id=ea8f070b6ffe425e94434562595a3dac, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:29.815962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb080637-abe9-4868-9b06-f672db592b53 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:29.829439 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3792/7584] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:28:29 2022] PUT /identity/v3/projects/f75c01923c3a461fb769a875d8817e69/users/ea8f070b6ffe425e94434562595a3dac/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:28:34.527220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb289a8-a6de-4e44-a31d-0cd9c07bd86f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:34.731476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb289a8-a6de-4e44-a31d-0cd9c07bd86f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:34.906342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a669bd-01ac-42e5-8aba-fd5966d7359f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:34.907021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a669bd-01ac-42e5-8aba-fd5966d7359f service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:34.907314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a669bd-01ac-42e5-8aba-fd5966d7359f service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:34.907594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a669bd-01ac-42e5-8aba-fd5966d7359f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:34.912806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c5a669bd-01ac-42e5-8aba-fd5966d7359f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:34.954024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a669bd-01ac-42e5-8aba-fd5966d7359f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:34.955706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a669bd-01ac-42e5-8aba-fd5966d7359f service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:34.985546 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3793/7585] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:36.784911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b91e-5d8e-4b46-9139-ae16348ec7fc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:36.784911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b91e-5d8e-4b46-9139-ae16348ec7fc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:36.785482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30b91e-5d8e-4b46-9139-ae16348ec7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:36.848418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-aa30b91e-5d8e-4b46-9139-ae16348ec7fc None None] MFA Rules not processed for user `ea8f070b6ffe425e94434562595a3dac`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:36.851573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aa30b91e-5d8e-4b46-9139-ae16348ec7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:37.074508 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3793/7586] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:28:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:37.075451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a669bd-01ac-42e5-8aba-fd5966d7359f service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:37.077081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c5a669bd-01ac-42e5-8aba-fd5966d7359f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:37.188919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:37.211461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a669bd-01ac-42e5-8aba-fd5966d7359f service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:37.215413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86e0f7-b6b8-43ae-a068-6d15d7e96ecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:37.216126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86e0f7-b6b8-43ae-a068-6d15d7e96ecc service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:37.216495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86e0f7-b6b8-43ae-a068-6d15d7e96ecc service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:37.218918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86e0f7-b6b8-43ae-a068-6d15d7e96ecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:37.237432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86e0f7-b6b8-43ae-a068-6d15d7e96ecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:37.239972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86e0f7-b6b8-43ae-a068-6d15d7e96ecc service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:37.253659 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3794/7587] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:28:37.390300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30b91e-5d8e-4b46-9139-ae16348ec7fc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:37.402163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30b91e-5d8e-4b46-9139-ae16348ec7fc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:37.406506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6de07-437d-4eb7-a76e-0f5d5fbcaef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:37.407241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6de07-437d-4eb7-a76e-0f5d5fbcaef6 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:37.407592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6de07-437d-4eb7-a76e-0f5d5fbcaef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:37.407932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6de07-437d-4eb7-a76e-0f5d5fbcaef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:37.481846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6de07-437d-4eb7-a76e-0f5d5fbcaef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:37.483604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6de07-437d-4eb7-a76e-0f5d5fbcaef6 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:37.488371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:37.494234 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3794/7588] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:40.154609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad18e8-23f9-44f3-a3ed-003d39adfd97 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:40.155344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad18e8-23f9-44f3-a3ed-003d39adfd97 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:40.155457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad18e8-23f9-44f3-a3ed-003d39adfd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:40.205797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-16ad18e8-23f9-44f3-a3ed-003d39adfd97 None None] MFA Rules not processed for user `30add6fc24b34085b5eaac8df54c424f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:28:40.216053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-16ad18e8-23f9-44f3-a3ed-003d39adfd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:40.225256 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3795/7589] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:28:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:28:41.539253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6de07-437d-4eb7-a76e-0f5d5fbcaef6 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:28:41.573713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6de07-437d-4eb7-a76e-0f5d5fbcaef6 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:28:41.593643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1b334-03a6-496f-a774-9e89573b0494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:28:41.596999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b334-03a6-496f-a774-9e89573b0494 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:28:41.598972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b334-03a6-496f-a774-9e89573b0494 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:28:41.599294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b334-03a6-496f-a774-9e89573b0494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:28:41.606506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c8b1b334-03a6-496f-a774-9e89573b0494 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:28:41.634792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1b334-03a6-496f-a774-9e89573b0494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:28:41.637242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1b334-03a6-496f-a774-9e89573b0494 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:28:41.658466 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3795/7590] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:28:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:28:50.186812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:28:51.649553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:16.399343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd472652-24a6-462b-89e1-7c2b6b0e39a3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:16.399859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd472652-24a6-462b-89e1-7c2b6b0e39a3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:16.399982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd472652-24a6-462b-89e1-7c2b6b0e39a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:16.420199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cd472652-24a6-462b-89e1-7c2b6b0e39a3 None None] MFA Rules not processed for user `30add6fc24b34085b5eaac8df54c424f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:16.421752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cd472652-24a6-462b-89e1-7c2b6b0e39a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:16.433038 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3796/7591] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:29:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:29:26.414632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:29.872070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d082794-3ae6-45eb-ad26-be8bb09c0d8f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:29.872597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d082794-3ae6-45eb-ad26-be8bb09c0d8f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:29.872720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d082794-3ae6-45eb-ad26-be8bb09c0d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:29.901826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4d082794-3ae6-45eb-ad26-be8bb09c0d8f None None] MFA Rules not processed for user `87820fd590ab402395340d61df0cd22b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:29:29.903279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4d082794-3ae6-45eb-ad26-be8bb09c0d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:29.978985 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3796/7592] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:29:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:29:30.693892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd472652-24a6-462b-89e1-7c2b6b0e39a3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:30.696179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cd472652-24a6-462b-89e1-7c2b6b0e39a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:30.888548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd472652-24a6-462b-89e1-7c2b6b0e39a3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:30.896722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101cf61-6e20-4ead-81a5-e08f78f6586f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:30.897487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101cf61-6e20-4ead-81a5-e08f78f6586f service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:30.897798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101cf61-6e20-4ead-81a5-e08f78f6586f service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:30.898082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101cf61-6e20-4ead-81a5-e08f78f6586f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:30.900794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0101cf61-6e20-4ead-81a5-e08f78f6586f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:30.915324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101cf61-6e20-4ead-81a5-e08f78f6586f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:30.918685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101cf61-6e20-4ead-81a5-e08f78f6586f service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:30.939669 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3797/7593] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:29:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:29:39.977176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=37 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:40.927959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=54 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:29:50.489984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d082794-3ae6-45eb-ad26-be8bb09c0d8f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:50.505041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d082794-3ae6-45eb-ad26-be8bb09c0d8f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:50.511728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ef922-098a-454d-ae3a-64831d5233d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:50.512602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ef922-098a-454d-ae3a-64831d5233d7 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:50.513011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ef922-098a-454d-ae3a-64831d5233d7 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:50.513396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ef922-098a-454d-ae3a-64831d5233d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:50.515299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-462ef922-098a-454d-ae3a-64831d5233d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:50.543394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ef922-098a-454d-ae3a-64831d5233d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:50.545148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ef922-098a-454d-ae3a-64831d5233d7 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:50.556238 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3797/7594] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:29:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:29:54.725458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101cf61-6e20-4ead-81a5-e08f78f6586f service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:29:54.726945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0101cf61-6e20-4ead-81a5-e08f78f6586f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:54.754613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101cf61-6e20-4ead-81a5-e08f78f6586f service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:29:54.759758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e004dd-2009-413f-b6e8-692f02e63f03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:29:54.760695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e004dd-2009-413f-b6e8-692f02e63f03 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:29:54.760983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e004dd-2009-413f-b6e8-692f02e63f03 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:29:54.761797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e004dd-2009-413f-b6e8-692f02e63f03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:29:54.763900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e2e004dd-2009-413f-b6e8-692f02e63f03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:29:54.778088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e004dd-2009-413f-b6e8-692f02e63f03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:29:54.779854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e004dd-2009-413f-b6e8-692f02e63f03 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:29:54.793410 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3798/7595] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:29:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:30:00.551433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=11 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:04.786812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=11 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:06.029877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdc0c-297b-46ae-b894-b84ec795ebe9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:06.030407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdc0c-297b-46ae-b894-b84ec795ebe9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:06.030555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffdc0c-297b-46ae-b894-b84ec795ebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:06.053931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-48ffdc0c-297b-46ae-b894-b84ec795ebe9 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:06.055518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-48ffdc0c-297b-46ae-b894-b84ec795ebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:06.136602 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3798/7596] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:30:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:30:06.196322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e004dd-2009-413f-b6e8-692f02e63f03 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:06.201598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e2e004dd-2009-413f-b6e8-692f02e63f03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:06.302233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e004dd-2009-413f-b6e8-692f02e63f03 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:06.310983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2cc9c-243f-4b4a-873c-4c5974d4bf85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:06.312095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2cc9c-243f-4b4a-873c-4c5974d4bf85 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:06.312615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2cc9c-243f-4b4a-873c-4c5974d4bf85 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:06.313231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2cc9c-243f-4b4a-873c-4c5974d4bf85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:06.326700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2cc9c-243f-4b4a-873c-4c5974d4bf85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:06.329103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2cc9c-243f-4b4a-873c-4c5974d4bf85 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:06.343126 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3799/7597] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:30:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:30:16.128950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=25 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:16.338704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=32 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:20.365775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec94a6-86c2-4efa-a909-0c198367eb58 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:20.366368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec94a6-86c2-4efa-a909-0c198367eb58 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:20.366699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec94a6-86c2-4efa-a909-0c198367eb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:20.389201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ccec94a6-86c2-4efa-a909-0c198367eb58 None None] MFA Rules not processed for user `30add6fc24b34085b5eaac8df54c424f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:20.390613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ccec94a6-86c2-4efa-a909-0c198367eb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:20.399248 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3799/7598] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:30:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:30:30.385806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:34.949375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90af61-e7d0-4022-afcd-822a780615f4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:34.949907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90af61-e7d0-4022-afcd-822a780615f4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:34.950061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90af61-e7d0-4022-afcd-822a780615f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:34.971109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-da90af61-e7d0-4022-afcd-822a780615f4 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:34.972360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-da90af61-e7d0-4022-afcd-822a780615f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:34.979942 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3800/7599] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:30:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:30:34.992759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec94a6-86c2-4efa-a909-0c198367eb58 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:35.006914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec94a6-86c2-4efa-a909-0c198367eb58 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:35.013162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f28426-5d2b-4a6b-9250-8e0b6f6f3318 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:35.014254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f28426-5d2b-4a6b-9250-8e0b6f6f3318 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:35.014607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f28426-5d2b-4a6b-9250-8e0b6f6f3318 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:35.015001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f28426-5d2b-4a6b-9250-8e0b6f6f3318 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:35.023405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f28426-5d2b-4a6b-9250-8e0b6f6f3318 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:35.025070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f28426-5d2b-4a6b-9250-8e0b6f6f3318 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:35.034403 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3800/7600] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:30:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:30:44.974641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:45.031305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:46.179854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e9e18-ef49-42c1-89de-13d837f0d84d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:46.180324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e9e18-ef49-42c1-89de-13d837f0d84d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:46.180538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e9e18-ef49-42c1-89de-13d837f0d84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:46.205508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-543e9e18-ef49-42c1-89de-13d837f0d84d None None] MFA Rules not processed for user `87820fd590ab402395340d61df0cd22b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:30:46.209334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-543e9e18-ef49-42c1-89de-13d837f0d84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:46.218041 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3801/7601] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:30:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:30:56.196326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:30:56.865977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f28426-5d2b-4a6b-9250-8e0b6f6f3318 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:30:56.889210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f28426-5d2b-4a6b-9250-8e0b6f6f3318 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:30:56.893313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c346942-968b-41a1-ac26-a64e7f4b3814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:30:56.894149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c346942-968b-41a1-ac26-a64e7f4b3814 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:30:56.894613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c346942-968b-41a1-ac26-a64e7f4b3814 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:30:56.895056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c346942-968b-41a1-ac26-a64e7f4b3814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:30:56.897070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5c346942-968b-41a1-ac26-a64e7f4b3814 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:30:56.989747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c346942-968b-41a1-ac26-a64e7f4b3814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:30:56.991564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c346942-968b-41a1-ac26-a64e7f4b3814 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:30:57.002657 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3801/7602] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:30:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:31:02.800772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f419580-32d4-4ac4-8f95-384cf9727032 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:02.801327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f419580-32d4-4ac4-8f95-384cf9727032 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:02.801327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f419580-32d4-4ac4-8f95-384cf9727032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:02.865080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1f419580-32d4-4ac4-8f95-384cf9727032 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:02.875451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1f419580-32d4-4ac4-8f95-384cf9727032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:02.893948 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3802/7603] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:31:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:31:02.909755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c346942-968b-41a1-ac26-a64e7f4b3814 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:02.925150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c346942-968b-41a1-ac26-a64e7f4b3814 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:02.930473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006b34f-880a-4aeb-8837-8c7c08c986e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:02.931281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006b34f-880a-4aeb-8837-8c7c08c986e2 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:02.933081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006b34f-880a-4aeb-8837-8c7c08c986e2 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:02.933819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006b34f-880a-4aeb-8837-8c7c08c986e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:02.943075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006b34f-880a-4aeb-8837-8c7c08c986e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:02.945228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006b34f-880a-4aeb-8837-8c7c08c986e2 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:02.975161 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3802/7604] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:31:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:31:12.886849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:12.952441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=38 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:31.841945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ba338-fb47-4360-a691-e8f073787703 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:31.842489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ba338-fb47-4360-a691-e8f073787703 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:31.842583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ba338-fb47-4360-a691-e8f073787703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:31.861966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-554ba338-fb47-4360-a691-e8f073787703 None None] MFA Rules not processed for user `30add6fc24b34085b5eaac8df54c424f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:31.863214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-554ba338-fb47-4360-a691-e8f073787703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:31.871273 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3803/7605] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:31:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:31:32.133069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006b34f-880a-4aeb-8837-8c7c08c986e2 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:32.202540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006b34f-880a-4aeb-8837-8c7c08c986e2 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:32.206180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31420843-eead-44e8-8b48-b17093b2aadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:32.206811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31420843-eead-44e8-8b48-b17093b2aadf service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:32.207097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31420843-eead-44e8-8b48-b17093b2aadf service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:32.207371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31420843-eead-44e8-8b48-b17093b2aadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:32.209109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-31420843-eead-44e8-8b48-b17093b2aadf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:32.239093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31420843-eead-44e8-8b48-b17093b2aadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:32.240535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31420843-eead-44e8-8b48-b17093b2aadf service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:32.251064 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3803/7606] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:31:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:31:41.856638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:42.246158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=35 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:31:50.691763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ba338-fb47-4360-a691-e8f073787703 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:50.702649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ba338-fb47-4360-a691-e8f073787703 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:50.706188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3853f6-8734-4d78-924c-cd47452c47f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:50.706822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3853f6-8734-4d78-924c-cd47452c47f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:50.707102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3853f6-8734-4d78-924c-cd47452c47f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:50.707374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3853f6-8734-4d78-924c-cd47452c47f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:50.709059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-eb3853f6-8734-4d78-924c-cd47452c47f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:50.738400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3853f6-8734-4d78-924c-cd47452c47f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:50.739896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3853f6-8734-4d78-924c-cd47452c47f2 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:50.765206 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3804/7607] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:31:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:31:51.752837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552b832-e9f4-4df0-a786-f7ef66aaf171 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:51.753373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552b832-e9f4-4df0-a786-f7ef66aaf171 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:51.753373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552b832-e9f4-4df0-a786-f7ef66aaf171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:51.775060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4552b832-e9f4-4df0-a786-f7ef66aaf171 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:51.777154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4552b832-e9f4-4df0-a786-f7ef66aaf171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:51.797254 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3804/7608] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:31:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:31:51.820209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3853f6-8734-4d78-924c-cd47452c47f2 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:31:51.844038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3853f6-8734-4d78-924c-cd47452c47f2 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:31:51.849356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29758f1-53c4-4f3d-842b-ffe097c0306f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:31:51.850066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29758f1-53c4-4f3d-842b-ffe097c0306f service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:51.850449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29758f1-53c4-4f3d-842b-ffe097c0306f service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:51.850874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29758f1-53c4-4f3d-842b-ffe097c0306f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:51.860527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29758f1-53c4-4f3d-842b-ffe097c0306f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:31:51.862235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29758f1-53c4-4f3d-842b-ffe097c0306f service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:31:51.871375 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3805/7609] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:31:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:31:53.188477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9432-099e-42d9-83c6-6ace9b0c9fdb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:31:53.188909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9432-099e-42d9-83c6-6ace9b0c9fdb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:31:53.189094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9432-099e-42d9-83c6-6ace9b0c9fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:31:53.212609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6fcb9432-099e-42d9-83c6-6ace9b0c9fdb None None] MFA Rules not processed for user `30add6fc24b34085b5eaac8df54c424f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:31:53.214215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6fcb9432-099e-42d9-83c6-6ace9b0c9fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:31:53.222509 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3805/7610] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:31:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:32:01.868011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=25 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:02.565420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29758f1-53c4-4f3d-842b-ffe097c0306f service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:02.567319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e29758f1-53c4-4f3d-842b-ffe097c0306f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:02.733050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29758f1-53c4-4f3d-842b-ffe097c0306f service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:02.738025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:02.738773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:02.739302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:02.739638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] PATH_INFO: `/v3/users/379cfe19da2a475496160840a5716ebb` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:02.742344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379cfe19da2a475496160840a5716ebb)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:02.744995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:02.829751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379cfe19da2a475496160840a5716ebb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:02.842602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379cfe19da2a475496160840a5716ebb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:02.843349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379cfe19da2a475496160840a5716ebb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:02.857604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379cfe19da2a475496160840a5716ebb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:02.858310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379cfe19da2a475496160840a5716ebb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:02.905968 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3806/7611] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:32:02 2022] DELETE /identity/v3/users/379cfe19da2a475496160840a5716ebb => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:32:02.911128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200d07-32fc-4643-b1cf-81e37786c450 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:02.911678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200d07-32fc-4643-b1cf-81e37786c450 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:02.911764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a200d07-32fc-4643-b1cf-81e37786c450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:02.966519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1a200d07-32fc-4643-b1cf-81e37786c450 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:32:02.970053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1a200d07-32fc-4643-b1cf-81e37786c450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:03.081249 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3806/7612] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:32:03.095319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:03.098790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:03.192455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfa729-7439-4dac-a696-8d3769183b01 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:03.196748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761953dc-44e5-4ba2-9089-661e24484f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:03.197431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761953dc-44e5-4ba2-9089-661e24484f50 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:03.197746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761953dc-44e5-4ba2-9089-661e24484f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:03.198021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761953dc-44e5-4ba2-9089-661e24484f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:03.205708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:03.210795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761953dc-44e5-4ba2-9089-661e24484f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:03.213219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761953dc-44e5-4ba2-9089-661e24484f50 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:03.232964 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3807/7613] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:32:03.451167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a200d07-32fc-4643-b1cf-81e37786c450 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:03.453150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1a200d07-32fc-4643-b1cf-81e37786c450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:03.471139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a200d07-32fc-4643-b1cf-81e37786c450 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:03.477436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:03.478142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:03.479120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:03.479120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76 admin admin] PATH_INFO: `/v3/projects/b8081c70b7e74832a884025d836cdaa6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:03.480250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8081c70b7e74832a884025d836cdaa6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:03.482227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:03.547692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8081c70b7e74832a884025d836cdaa6', 'request_id': 'req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:03.553839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8081c70b7e74832a884025d836cdaa6', 'request_id': 'req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:03.561167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8081c70b7e74832a884025d836cdaa6', 'request_id': 'req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:03.584936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76 admin admin] The token cache is being invalidate because project b8081c70b7e74832a884025d836cdaa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:32:03.585462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:03.586153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fee82211-e1c7-4d9a-892e-cda4b9ddcc76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:03.591463 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3807/7614] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:32:03 2022] DELETE /identity/v3/projects/b8081c70b7e74832a884025d836cdaa6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:32:03.600042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207d90c-5faa-48eb-b042-a541e0b1def0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:03.600638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207d90c-5faa-48eb-b042-a541e0b1def0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:03.601317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207d90c-5faa-48eb-b042-a541e0b1def0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:03.676361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9207d90c-5faa-48eb-b042-a541e0b1def0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:32:03.677578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9207d90c-5faa-48eb-b042-a541e0b1def0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:03.759774 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3808/7615] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:32:03.769798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5d7c6-1922-414e-b6af-fbd29b963e17 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:03.770085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5d7c6-1922-414e-b6af-fbd29b963e17 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:03.770356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5d7c6-1922-414e-b6af-fbd29b963e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:03.799597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-24f5d7c6-1922-414e-b6af-fbd29b963e17 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:32:03.800710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-24f5d7c6-1922-414e-b6af-fbd29b963e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:03.810952 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3808/7616] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:32:03.815624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207d90c-5faa-48eb-b042-a541e0b1def0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:03.826400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207d90c-5faa-48eb-b042-a541e0b1def0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:03.831309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a1407-8e80-4c3c-88b9-6ee906efee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:03.831894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a1407-8e80-4c3c-88b9-6ee906efee7b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:03.832186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a1407-8e80-4c3c-88b9-6ee906efee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:03.832447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a1407-8e80-4c3c-88b9-6ee906efee7b admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:03.833093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a1407-8e80-4c3c-88b9-6ee906efee7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:32:03.833404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a1407-8e80-4c3c-88b9-6ee906efee7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:03.835032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a1407-8e80-4c3c-88b9-6ee906efee7b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:03.848369 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3809/7617] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:32:03.853001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5d7c6-1922-414e-b6af-fbd29b963e17 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:03.867072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5d7c6-1922-414e-b6af-fbd29b963e17 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:03.873736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5daf319-308c-4503-a42b-1386d12d87e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:03.875308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5daf319-308c-4503-a42b-1386d12d87e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:03.875308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5daf319-308c-4503-a42b-1386d12d87e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:03.875308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5daf319-308c-4503-a42b-1386d12d87e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:03.875747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5daf319-308c-4503-a42b-1386d12d87e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:03.877830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5daf319-308c-4503-a42b-1386d12d87e8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:03.932289 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3809/7618] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:32:03 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:32:03.937102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a1407-8e80-4c3c-88b9-6ee906efee7b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:03.949216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a1407-8e80-4c3c-88b9-6ee906efee7b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:04.020460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d3bd-77db-417a-a796-357d337419aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:04.021369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d3bd-77db-417a-a796-357d337419aa admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:04.021653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d3bd-77db-417a-a796-357d337419aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:04.022303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d3bd-77db-417a-a796-357d337419aa admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:04.022632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2d3bd-77db-417a-a796-357d337419aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:04.024600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2d3bd-77db-417a-a796-357d337419aa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:04.048141 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3810/7619] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:32:03 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:32:04.052415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5daf319-308c-4503-a42b-1386d12d87e8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:04.063810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5daf319-308c-4503-a42b-1386d12d87e8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:04.069229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ff2e8-180e-4e14-a50d-3d6258aefde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:04.069864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff2e8-180e-4e14-a50d-3d6258aefde5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:04.070244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff2e8-180e-4e14-a50d-3d6258aefde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:04.070521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff2e8-180e-4e14-a50d-3d6258aefde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:04.071213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ff2e8-180e-4e14-a50d-3d6258aefde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:04.072932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ff2e8-180e-4e14-a50d-3d6258aefde5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:04.084376 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3810/7620] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:32:04.088633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d3bd-77db-417a-a796-357d337419aa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:04.101612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d3bd-77db-417a-a796-357d337419aa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:04.108097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7140a31-e379-4549-be75-61671e485072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:04.108745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7140a31-e379-4549-be75-61671e485072 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:04.108986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7140a31-e379-4549-be75-61671e485072 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:04.109258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7140a31-e379-4549-be75-61671e485072 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:04.110107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7140a31-e379-4549-be75-61671e485072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:04.111575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7140a31-e379-4549-be75-61671e485072 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:04.123065 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3811/7621] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:32:04.127058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ff2e8-180e-4e14-a50d-3d6258aefde5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:04.138850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ff2e8-180e-4e14-a50d-3d6258aefde5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:04.145272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c63be-e09e-48d6-ab17-0fb4ddeca13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:04.146157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c63be-e09e-48d6-ab17-0fb4ddeca13e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:04.146719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c63be-e09e-48d6-ab17-0fb4ddeca13e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:04.146983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c63be-e09e-48d6-ab17-0fb4ddeca13e admin admin] PATH_INFO: `/v3/projects/633dc1e2d9c14e7587d86ff805a3c46b/users/fdc54aca30c341c1829e577f23479ae0/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:04.149968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:04.185069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c63be-e09e-48d6-ab17-0fb4ddeca13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=633dc1e2d9c14e7587d86ff805a3c46b, user_id=fdc54aca30c341c1829e577f23479ae0, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:04.188265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c63be-e09e-48d6-ab17-0fb4ddeca13e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:04.204693 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3811/7622] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:32:04 2022] PUT /identity/v3/projects/633dc1e2d9c14e7587d86ff805a3c46b/users/fdc54aca30c341c1829e577f23479ae0/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:32:04.209782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79d50a-79c3-4d78-b77a-0d28ee29271d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:04.210080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79d50a-79c3-4d78-b77a-0d28ee29271d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:04.210365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79d50a-79c3-4d78-b77a-0d28ee29271d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:04.236199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3d79d50a-79c3-4d78-b77a-0d28ee29271d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:32:04.237493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3d79d50a-79c3-4d78-b77a-0d28ee29271d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:04.281027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:04.326844 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3812/7623] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:32:04.335298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c63be-e09e-48d6-ab17-0fb4ddeca13e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:04.342250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ef1c63be-e09e-48d6-ab17-0fb4ddeca13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:04.428392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c63be-e09e-48d6-ab17-0fb4ddeca13e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:04.433741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86244be-6b2d-45a6-ae68-c8c65f39e2c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:04.435171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86244be-6b2d-45a6-ae68-c8c65f39e2c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:04.435355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86244be-6b2d-45a6-ae68-c8c65f39e2c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:04.435585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86244be-6b2d-45a6-ae68-c8c65f39e2c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:04.446999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86244be-6b2d-45a6-ae68-c8c65f39e2c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:04.449741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86244be-6b2d-45a6-ae68-c8c65f39e2c9 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:04.460005 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3812/7624] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:32:09.208370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec217ad-f7b5-4479-bcad-57d5a0aafcb5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:09.209035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec217ad-f7b5-4479-bcad-57d5a0aafcb5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:09.209035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec217ad-f7b5-4479-bcad-57d5a0aafcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:09.296907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6ec217ad-f7b5-4479-bcad-57d5a0aafcb5 None None] MFA Rules not processed for user `fdc54aca30c341c1829e577f23479ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:32:09.300424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6ec217ad-f7b5-4479-bcad-57d5a0aafcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:09.331441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86244be-6b2d-45a6-ae68-c8c65f39e2c9 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:09.332845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f86244be-6b2d-45a6-ae68-c8c65f39e2c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:09.359489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86244be-6b2d-45a6-ae68-c8c65f39e2c9 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:09.368043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e010ef-decb-43d8-b83d-9af2c066d348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:09.368864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e010ef-decb-43d8-b83d-9af2c066d348 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:09.369155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e010ef-decb-43d8-b83d-9af2c066d348 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:09.369443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e010ef-decb-43d8-b83d-9af2c066d348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:09.371841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-56e010ef-decb-43d8-b83d-9af2c066d348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:09.427966 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3813/7625] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:32:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:32:09.435887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec217ad-f7b5-4479-bcad-57d5a0aafcb5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:09.463073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec217ad-f7b5-4479-bcad-57d5a0aafcb5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:09.474756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a29571-b6c8-4d9c-b61a-9c951b3be66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:09.478290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a29571-b6c8-4d9c-b61a-9c951b3be66a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:09.478670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a29571-b6c8-4d9c-b61a-9c951b3be66a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:09.479048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a29571-b6c8-4d9c-b61a-9c951b3be66a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:09.482369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a29571-b6c8-4d9c-b61a-9c951b3be66a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:09.485090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a29571-b6c8-4d9c-b61a-9c951b3be66a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:09.535782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e010ef-decb-43d8-b83d-9af2c066d348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:09.537485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e010ef-decb-43d8-b83d-9af2c066d348 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:09.540922 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3814/7626] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:32:09 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:32:09.544881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a29571-b6c8-4d9c-b61a-9c951b3be66a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:09.558619 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3813/7627] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:32:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:32:09.652962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a29571-b6c8-4d9c-b61a-9c951b3be66a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:09.659341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77a00d-5116-4bd8-9be7-691bf95b2f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:09.660163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77a00d-5116-4bd8-9be7-691bf95b2f2b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:09.660679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77a00d-5116-4bd8-9be7-691bf95b2f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:09.661106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77a00d-5116-4bd8-9be7-691bf95b2f2b admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:09.662363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77a00d-5116-4bd8-9be7-691bf95b2f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:09.665167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77a00d-5116-4bd8-9be7-691bf95b2f2b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:09.715104 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3815/7628] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:32:09 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:32:09.716251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e010ef-decb-43d8-b83d-9af2c066d348 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:09.727308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e010ef-decb-43d8-b83d-9af2c066d348 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:09.733137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2da4ab-81b8-4dd2-a11b-df80cca41085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:09.733751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2da4ab-81b8-4dd2-a11b-df80cca41085 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:09.734039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2da4ab-81b8-4dd2-a11b-df80cca41085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:09.734315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2da4ab-81b8-4dd2-a11b-df80cca41085 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:09.734992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2da4ab-81b8-4dd2-a11b-df80cca41085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:09.736628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2da4ab-81b8-4dd2-a11b-df80cca41085 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:09.748784 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3814/7629] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:32:09.752909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77a00d-5116-4bd8-9be7-691bf95b2f2b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:09.764889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77a00d-5116-4bd8-9be7-691bf95b2f2b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:09.769810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7db865-17ab-4e97-b5df-12055e97b4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:09.770478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7db865-17ab-4e97-b5df-12055e97b4de admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:09.770791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7db865-17ab-4e97-b5df-12055e97b4de admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:09.771081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7db865-17ab-4e97-b5df-12055e97b4de admin admin] PATH_INFO: `/v3/projects/473a9898fb4d49329fc5937ca370dcd8/users/a70b992120e54bdf904d8de7e43c443c/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:09.797140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7db865-17ab-4e97-b5df-12055e97b4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=473a9898fb4d49329fc5937ca370dcd8, user_id=a70b992120e54bdf904d8de7e43c443c, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:09.800258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7db865-17ab-4e97-b5df-12055e97b4de admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:09.820568 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3816/7630] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:32:09 2022] PUT /identity/v3/projects/473a9898fb4d49329fc5937ca370dcd8/users/a70b992120e54bdf904d8de7e43c443c/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:32:09.821609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2da4ab-81b8-4dd2-a11b-df80cca41085 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:09.836564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2da4ab-81b8-4dd2-a11b-df80cca41085 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:09.902190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c187804-2f3f-4120-a3b0-9cfec46ac834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:09.903084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c187804-2f3f-4120-a3b0-9cfec46ac834 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:09.903433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c187804-2f3f-4120-a3b0-9cfec46ac834 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:09.903723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c187804-2f3f-4120-a3b0-9cfec46ac834 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:09.904401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c187804-2f3f-4120-a3b0-9cfec46ac834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:09.906079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c187804-2f3f-4120-a3b0-9cfec46ac834 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:09.907941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:09.926142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7db865-17ab-4e97-b5df-12055e97b4de admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:09.927203 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3815/7631] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:32:09.939393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7db865-17ab-4e97-b5df-12055e97b4de admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:09.945299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4572e7-9116-4e03-9fd9-847d5f13f814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:09.946260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4572e7-9116-4e03-9fd9-847d5f13f814 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:09.946957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4572e7-9116-4e03-9fd9-847d5f13f814 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:09.947380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4572e7-9116-4e03-9fd9-847d5f13f814 admin admin] PATH_INFO: `/v3/projects/473a9898fb4d49329fc5937ca370dcd8/users/a70b992120e54bdf904d8de7e43c443c/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:09.951851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4572e7-9116-4e03-9fd9-847d5f13f814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473a9898fb4d49329fc5937ca370dcd8, user_id=a70b992120e54bdf904d8de7e43c443c, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:09.954718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4572e7-9116-4e03-9fd9-847d5f13f814 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:09.961310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:09.977050 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3817/7632] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:32:09 2022] PUT /identity/v3/projects/473a9898fb4d49329fc5937ca370dcd8/users/a70b992120e54bdf904d8de7e43c443c/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:32:15.989354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea309b-e688-4401-a14a-32bfebd74167 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:15.989839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea309b-e688-4401-a14a-32bfebd74167 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:15.989952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea309b-e688-4401-a14a-32bfebd74167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:16.025647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-38ea309b-e688-4401-a14a-32bfebd74167 None None] MFA Rules not processed for user `a70b992120e54bdf904d8de7e43c443c`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:32:16.027444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-38ea309b-e688-4401-a14a-32bfebd74167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:16.120703 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3816/7633] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:32:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:32:16.136406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4572e7-9116-4e03-9fd9-847d5f13f814 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:16.138841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aa4572e7-9116-4e03-9fd9-847d5f13f814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:16.237462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4572e7-9116-4e03-9fd9-847d5f13f814 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:16.245177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f193847-a1b1-4e02-8c12-368d94a38e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:16.246051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f193847-a1b1-4e02-8c12-368d94a38e5e service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:16.246403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f193847-a1b1-4e02-8c12-368d94a38e5e service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:16.246703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f193847-a1b1-4e02-8c12-368d94a38e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:16.257331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f193847-a1b1-4e02-8c12-368d94a38e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:16.259587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f193847-a1b1-4e02-8c12-368d94a38e5e service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:16.272811 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3818/7634] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:32:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:32:16.532572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea309b-e688-4401-a14a-32bfebd74167 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:16.533967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-38ea309b-e688-4401-a14a-32bfebd74167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:16.638454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea309b-e688-4401-a14a-32bfebd74167 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:16.644045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616d1d7-d14a-4e9f-9d3c-7d8dba1ec7a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:16.644672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616d1d7-d14a-4e9f-9d3c-7d8dba1ec7a0 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:16.644958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616d1d7-d14a-4e9f-9d3c-7d8dba1ec7a0 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:16.645233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616d1d7-d14a-4e9f-9d3c-7d8dba1ec7a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:16.647038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d616d1d7-d14a-4e9f-9d3c-7d8dba1ec7a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:16.661424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616d1d7-d14a-4e9f-9d3c-7d8dba1ec7a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:16.663538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616d1d7-d14a-4e9f-9d3c-7d8dba1ec7a0 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:16.676509 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3817/7635] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:32:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:32:17.060399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f193847-a1b1-4e02-8c12-368d94a38e5e service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:17.062998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3f193847-a1b1-4e02-8c12-368d94a38e5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:17.083191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f193847-a1b1-4e02-8c12-368d94a38e5e service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:17.091445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecc9b7-0218-4ca9-8e9e-2330a70ff671 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:17.092270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecc9b7-0218-4ca9-8e9e-2330a70ff671 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:17.092623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecc9b7-0218-4ca9-8e9e-2330a70ff671 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:17.092970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecc9b7-0218-4ca9-8e9e-2330a70ff671 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:17.095350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e9ecc9b7-0218-4ca9-8e9e-2330a70ff671 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:17.117941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecc9b7-0218-4ca9-8e9e-2330a70ff671 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:17.119914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecc9b7-0218-4ca9-8e9e-2330a70ff671 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:17.134020 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3819/7636] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:32:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:32:19.191801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616d1d7-d14a-4e9f-9d3c-7d8dba1ec7a0 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:19.220375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616d1d7-d14a-4e9f-9d3c-7d8dba1ec7a0 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:19.230195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634b7d8-8b11-4551-a633-c51d5e1e596f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:19.238183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634b7d8-8b11-4551-a633-c51d5e1e596f service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:19.242929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634b7d8-8b11-4551-a633-c51d5e1e596f service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:19.243077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634b7d8-8b11-4551-a633-c51d5e1e596f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:19.249723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7634b7d8-8b11-4551-a633-c51d5e1e596f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:19.396212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634b7d8-8b11-4551-a633-c51d5e1e596f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:19.402569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634b7d8-8b11-4551-a633-c51d5e1e596f service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:19.415215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:19.434666 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3818/7637] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:32:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:32:21.999991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecc9b7-0218-4ca9-8e9e-2330a70ff671 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:22.020051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecc9b7-0218-4ca9-8e9e-2330a70ff671 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:22.026777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3acf3-5ba6-404d-81e1-2b01d62c13ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:22.027503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3acf3-5ba6-404d-81e1-2b01d62c13ca service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:22.027929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3acf3-5ba6-404d-81e1-2b01d62c13ca service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:22.028206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3acf3-5ba6-404d-81e1-2b01d62c13ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:22.030547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c8c3acf3-5ba6-404d-81e1-2b01d62c13ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:22.053330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3acf3-5ba6-404d-81e1-2b01d62c13ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:22.055447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3acf3-5ba6-404d-81e1-2b01d62c13ca service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:22.073638 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3820/7638] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:32:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:32:26.974427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634b7d8-8b11-4551-a633-c51d5e1e596f service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:26.995510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634b7d8-8b11-4551-a633-c51d5e1e596f service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:27.005750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32a82b-33c1-4f1d-93dd-3c6ca799cdd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:27.006551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a82b-33c1-4f1d-93dd-3c6ca799cdd7 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:27.008168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a82b-33c1-4f1d-93dd-3c6ca799cdd7 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:27.010898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a82b-33c1-4f1d-93dd-3c6ca799cdd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:27.015988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4e32a82b-33c1-4f1d-93dd-3c6ca799cdd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:27.039437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32a82b-33c1-4f1d-93dd-3c6ca799cdd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:27.041329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32a82b-33c1-4f1d-93dd-3c6ca799cdd7 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:27.060918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3acf3-5ba6-404d-81e1-2b01d62c13ca service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:27.076838 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3819/7639] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:32:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:32:27.173557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3acf3-5ba6-404d-81e1-2b01d62c13ca service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:27.178770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:27.179467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:27.179762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:27.180044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] PATH_INFO: `/v3/users/fdc54aca30c341c1829e577f23479ae0` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:27.182465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc54aca30c341c1829e577f23479ae0)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:27.185342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:27.267539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc54aca30c341c1829e577f23479ae0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:27.277352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc54aca30c341c1829e577f23479ae0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:27.278309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc54aca30c341c1829e577f23479ae0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:27.279968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:27.299058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc54aca30c341c1829e577f23479ae0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:27.299703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc54aca30c341c1829e577f23479ae0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:27.320825 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3821/7640] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:32:27 2022] DELETE /identity/v3/users/fdc54aca30c341c1829e577f23479ae0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:32:27.555836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32a82b-33c1-4f1d-93dd-3c6ca799cdd7 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:27.567993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32a82b-33c1-4f1d-93dd-3c6ca799cdd7 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:27.638974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:27.639632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:27.639914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:27.640183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] PATH_INFO: `/v3/projects/633dc1e2d9c14e7587d86ff805a3c46b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:27.641430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=633dc1e2d9c14e7587d86ff805a3c46b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:27.643460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:27.733563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633dc1e2d9c14e7587d86ff805a3c46b', 'request_id': 'req-4d87c362-97a4-4881-ba0e-3453a1e88c9e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:27.740383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633dc1e2d9c14e7587d86ff805a3c46b', 'request_id': 'req-4d87c362-97a4-4881-ba0e-3453a1e88c9e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:27.748129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633dc1e2d9c14e7587d86ff805a3c46b', 'request_id': 'req-4d87c362-97a4-4881-ba0e-3453a1e88c9e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:27.767770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] The token cache is being invalidate because project 633dc1e2d9c14e7587d86ff805a3c46b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:32:27.768054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:27.769314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:27.772451 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3820/7641] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:32:27 2022] DELETE /identity/v3/projects/633dc1e2d9c14e7587d86ff805a3c46b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:32:27.777932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:27.779640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:27.796854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5dfda-eefd-4f92-983d-d12d89ba12e0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:27.896487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d836a2-286d-4783-9f20-ae373d8a67c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:27.897141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d836a2-286d-4783-9f20-ae373d8a67c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:27.897428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d836a2-286d-4783-9f20-ae373d8a67c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:27.897767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d836a2-286d-4783-9f20-ae373d8a67c7 admin admin] PATH_INFO: `/v3/users/a70b992120e54bdf904d8de7e43c443c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:27.899082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d836a2-286d-4783-9f20-ae373d8a67c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a70b992120e54bdf904d8de7e43c443c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:27.901720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d836a2-286d-4783-9f20-ae373d8a67c7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:27.965454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-63d836a2-286d-4783-9f20-ae373d8a67c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a70b992120e54bdf904d8de7e43c443c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:27.976124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-63d836a2-286d-4783-9f20-ae373d8a67c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a70b992120e54bdf904d8de7e43c443c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:27.977729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-63d836a2-286d-4783-9f20-ae373d8a67c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a70b992120e54bdf904d8de7e43c443c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:28.021585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-63d836a2-286d-4783-9f20-ae373d8a67c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a70b992120e54bdf904d8de7e43c443c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:28.022691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-63d836a2-286d-4783-9f20-ae373d8a67c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a70b992120e54bdf904d8de7e43c443c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:28.039310 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3822/7642] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:32:27 2022] DELETE /identity/v3/users/a70b992120e54bdf904d8de7e43c443c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:32:28.347670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:28.349300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:28.375985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87c362-97a4-4881-ba0e-3453a1e88c9e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:28.455839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:28.456435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:28.456802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:28.457080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc admin admin] PATH_INFO: `/v3/projects/473a9898fb4d49329fc5937ca370dcd8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:28.458588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=473a9898fb4d49329fc5937ca370dcd8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:28.460613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:28.483682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:28.517207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473a9898fb4d49329fc5937ca370dcd8', 'request_id': 'req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:28.525887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473a9898fb4d49329fc5937ca370dcd8', 'request_id': 'req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:28.534218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473a9898fb4d49329fc5937ca370dcd8', 'request_id': 'req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:28.555653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc admin admin] The token cache is being invalidate because project 473a9898fb4d49329fc5937ca370dcd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:32:28.555953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:28.557422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8dcc81df-8633-49e1-8960-8a41a2d6bcbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:32:28.560710 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3821/7643] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:32:28 2022] DELETE /identity/v3/projects/473a9898fb4d49329fc5937ca370dcd8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:32:28.564525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5809b3-8faa-417e-975e-95adfb063f7e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:28.565388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5809b3-8faa-417e-975e-95adfb063f7e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:28.565877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5809b3-8faa-417e-975e-95adfb063f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:28.596562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9a5809b3-8faa-417e-975e-95adfb063f7e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:32:28.598213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9a5809b3-8faa-417e-975e-95adfb063f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:28.655338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:28.673227 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3823/7644] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:32:28.681487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b53156-be72-46c4-9d7b-3d0c56b1c8e5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:28.684330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b53156-be72-46c4-9d7b-3d0c56b1c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:28.684603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b53156-be72-46c4-9d7b-3d0c56b1c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:28.719706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-94b53156-be72-46c4-9d7b-3d0c56b1c8e5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:32:28.720962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-94b53156-be72-46c4-9d7b-3d0c56b1c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:28.735253 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3822/7645] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:32:28.737023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5809b3-8faa-417e-975e-95adfb063f7e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:28.749390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5809b3-8faa-417e-975e-95adfb063f7e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:28.756686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f857a5f-c57d-4faf-8317-bbb461e622ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:28.759245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f857a5f-c57d-4faf-8317-bbb461e622ff admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:28.759245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f857a5f-c57d-4faf-8317-bbb461e622ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:28.759245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f857a5f-c57d-4faf-8317-bbb461e622ff admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:28.759657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f857a5f-c57d-4faf-8317-bbb461e622ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:32:28.760792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f857a5f-c57d-4faf-8317-bbb461e622ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:28.763254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f857a5f-c57d-4faf-8317-bbb461e622ff admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:28.778242 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3824/7646] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:32:28.783157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b53156-be72-46c4-9d7b-3d0c56b1c8e5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:28.807530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b53156-be72-46c4-9d7b-3d0c56b1c8e5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:28.817492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccca65f-2a57-498f-bc59-c326624cf162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:28.818390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccca65f-2a57-498f-bc59-c326624cf162 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:28.829129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccca65f-2a57-498f-bc59-c326624cf162 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:28.829560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccca65f-2a57-498f-bc59-c326624cf162 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:28.831018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccca65f-2a57-498f-bc59-c326624cf162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:28.835479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccca65f-2a57-498f-bc59-c326624cf162 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:28.879977 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3823/7647] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:32:28 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:32:28.884514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f857a5f-c57d-4faf-8317-bbb461e622ff admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:28.896474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f857a5f-c57d-4faf-8317-bbb461e622ff admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:28.974997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeebd7-3a6a-419d-81a4-0862d2c4ed94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:28.975969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeebd7-3a6a-419d-81a4-0862d2c4ed94 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:28.976335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeebd7-3a6a-419d-81a4-0862d2c4ed94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:28.976792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeebd7-3a6a-419d-81a4-0862d2c4ed94 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:28.977703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeebd7-3a6a-419d-81a4-0862d2c4ed94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:28.980523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeebd7-3a6a-419d-81a4-0862d2c4ed94 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:29.016236 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3825/7648] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:32:28 2022] POST /identity/v3/users => generated 297 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:32:29.017637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccca65f-2a57-498f-bc59-c326624cf162 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:29.033948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccca65f-2a57-498f-bc59-c326624cf162 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:29.042362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437cfb1-588d-4f72-83cf-0c03352d6c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:29.043175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437cfb1-588d-4f72-83cf-0c03352d6c02 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:29.043525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437cfb1-588d-4f72-83cf-0c03352d6c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:29.043869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437cfb1-588d-4f72-83cf-0c03352d6c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:29.044600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437cfb1-588d-4f72-83cf-0c03352d6c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:29.047765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437cfb1-588d-4f72-83cf-0c03352d6c02 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:29.065278 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3824/7649] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:32:29.068517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeebd7-3a6a-419d-81a4-0862d2c4ed94 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:29.080153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeebd7-3a6a-419d-81a4-0862d2c4ed94 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:29.086958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca5004-a642-46a2-b3b4-0f667b0e97c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:29.087293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca5004-a642-46a2-b3b4-0f667b0e97c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:29.087688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca5004-a642-46a2-b3b4-0f667b0e97c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:29.088487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca5004-a642-46a2-b3b4-0f667b0e97c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:29.088620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca5004-a642-46a2-b3b4-0f667b0e97c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:29.090616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca5004-a642-46a2-b3b4-0f667b0e97c0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:29.110422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437cfb1-588d-4f72-83cf-0c03352d6c02 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:29.110651 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3826/7650] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:32:29.122807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437cfb1-588d-4f72-83cf-0c03352d6c02 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:29.128805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2bbcd-bc7c-473a-887d-d17c9505145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:29.129539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2bbcd-bc7c-473a-887d-d17c9505145a admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:29.129911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2bbcd-bc7c-473a-887d-d17c9505145a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:29.130284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2bbcd-bc7c-473a-887d-d17c9505145a admin admin] PATH_INFO: `/v3/projects/a452c216723049bf83a3bb0b62f22217/users/b0ae958878db4d2a81ba14f57b3128c0/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:29.151618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2bbcd-bc7c-473a-887d-d17c9505145a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a452c216723049bf83a3bb0b62f22217, user_id=b0ae958878db4d2a81ba14f57b3128c0, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:29.154156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2bbcd-bc7c-473a-887d-d17c9505145a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:29.173794 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3825/7651] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:32:29 2022] PUT /identity/v3/projects/a452c216723049bf83a3bb0b62f22217/users/b0ae958878db4d2a81ba14f57b3128c0/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:32:29.185903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e738bc7-d17b-4d05-91bb-6c6a807d8250 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:29.186269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e738bc7-d17b-4d05-91bb-6c6a807d8250 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:29.186537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e738bc7-d17b-4d05-91bb-6c6a807d8250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:29.220841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc8d3-273d-4903-b8ef-e1b607a1d02c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:29.221199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc8d3-273d-4903-b8ef-e1b607a1d02c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:29.221782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defc8d3-273d-4903-b8ef-e1b607a1d02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:29.222447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1e738bc7-d17b-4d05-91bb-6c6a807d8250 None None] MFA Rules not processed for user `b0ae958878db4d2a81ba14f57b3128c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:32:29.223893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1e738bc7-d17b-4d05-91bb-6c6a807d8250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:29.245266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2defc8d3-273d-4903-b8ef-e1b607a1d02c None None] MFA Rules not processed for user `778f9ab247a043dc9c67e42e0237a34a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:32:29.246655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2defc8d3-273d-4903-b8ef-e1b607a1d02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:29.340498 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3826/7652] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:32:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:32:29.346758 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3827/7653] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:32:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:32:29.347761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defc8d3-273d-4903-b8ef-e1b607a1d02c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:29.408198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:29.428644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defc8d3-273d-4903-b8ef-e1b607a1d02c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:29.435295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dc479-7deb-4c85-8a06-490111fe3384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:29.436040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dc479-7deb-4c85-8a06-490111fe3384 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:29.436523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dc479-7deb-4c85-8a06-490111fe3384 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:29.436874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dc479-7deb-4c85-8a06-490111fe3384 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:29.437770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dc479-7deb-4c85-8a06-490111fe3384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:29.440133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dc479-7deb-4c85-8a06-490111fe3384 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:29.476518 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3827/7654] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:32:29 2022] POST /identity/v3/projects => generated 391 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:32:29.481204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e738bc7-d17b-4d05-91bb-6c6a807d8250 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:29.493293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e738bc7-d17b-4d05-91bb-6c6a807d8250 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:29.547035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:29.563779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4a6be-d2e2-4532-b08d-078a2f22929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:29.565260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4a6be-d2e2-4532-b08d-078a2f22929e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:29.565260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4a6be-d2e2-4532-b08d-078a2f22929e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:29.565260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4a6be-d2e2-4532-b08d-078a2f22929e admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:29.566185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4a6be-d2e2-4532-b08d-078a2f22929e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:29.568432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4a6be-d2e2-4532-b08d-078a2f22929e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:29.592752 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3828/7655] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:32:29 2022] POST /identity/v3/users => generated 302 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:32:29.596778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dc479-7deb-4c85-8a06-490111fe3384 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:29.607914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dc479-7deb-4c85-8a06-490111fe3384 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:29.612639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8c94-aa60-4e86-a797-021d6d58751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:29.613250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8c94-aa60-4e86-a797-021d6d58751b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:29.613589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8c94-aa60-4e86-a797-021d6d58751b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:29.613870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8c94-aa60-4e86-a797-021d6d58751b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:29.614629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d8c94-aa60-4e86-a797-021d6d58751b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:29.616284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d8c94-aa60-4e86-a797-021d6d58751b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:29.627967 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3828/7656] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:32:29.632284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4a6be-d2e2-4532-b08d-078a2f22929e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:29.643677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4a6be-d2e2-4532-b08d-078a2f22929e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:29.648548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d866396-5b4f-40a7-a327-ed09c5465b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:29.649256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d866396-5b4f-40a7-a327-ed09c5465b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:29.649544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d866396-5b4f-40a7-a327-ed09c5465b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:29.649819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d866396-5b4f-40a7-a327-ed09c5465b9d admin admin] PATH_INFO: `/v3/projects/507a56fced314b5d933025e1c65ee9bb/users/373297b950c242cd8862f89c166eb1ad/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:29.670155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d866396-5b4f-40a7-a327-ed09c5465b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=507a56fced314b5d933025e1c65ee9bb, user_id=373297b950c242cd8862f89c166eb1ad, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:29.673333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d866396-5b4f-40a7-a327-ed09c5465b9d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:29.689108 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3829/7657] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:32:29 2022] PUT /identity/v3/projects/507a56fced314b5d933025e1c65ee9bb/users/373297b950c242cd8862f89c166eb1ad/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:32:29.693189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8c94-aa60-4e86-a797-021d6d58751b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:29.697278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d866396-5b4f-40a7-a327-ed09c5465b9d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:29.699260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6d866396-5b4f-40a7-a327-ed09c5465b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:29.705238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8c94-aa60-4e86-a797-021d6d58751b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:29.767490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d866396-5b4f-40a7-a327-ed09c5465b9d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:29.771651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1dbd6-51ef-45cb-9c65-00857787f5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:29.772313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1dbd6-51ef-45cb-9c65-00857787f5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:29.772614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1dbd6-51ef-45cb-9c65-00857787f5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:29.773548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1dbd6-51ef-45cb-9c65-00857787f5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:29.775878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2857f10-19e0-4d13-bb63-0cb46c161593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:29.776043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9bc1dbd6-51ef-45cb-9c65-00857787f5e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:29.776553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2857f10-19e0-4d13-bb63-0cb46c161593 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:29.776887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2857f10-19e0-4d13-bb63-0cb46c161593 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:29.777192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2857f10-19e0-4d13-bb63-0cb46c161593 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:29.778057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2857f10-19e0-4d13-bb63-0cb46c161593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:29.779960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2857f10-19e0-4d13-bb63-0cb46c161593 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:29.788168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1dbd6-51ef-45cb-9c65-00857787f5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:29.789759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1dbd6-51ef-45cb-9c65-00857787f5e7 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:29.794158 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3829/7658] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:32:29.798735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2857f10-19e0-4d13-bb63-0cb46c161593 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:29.802811 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3830/7659] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:32:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:32:29.810214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2857f10-19e0-4d13-bb63-0cb46c161593 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:29.815649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1883c07-7948-42b7-8f3f-4fba91898d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:29.816353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1883c07-7948-42b7-8f3f-4fba91898d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:29.816648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1883c07-7948-42b7-8f3f-4fba91898d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:29.817003 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1883c07-7948-42b7-8f3f-4fba91898d25 admin admin] PATH_INFO: `/v3/projects/507a56fced314b5d933025e1c65ee9bb/users/373297b950c242cd8862f89c166eb1ad/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:29.819223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1883c07-7948-42b7-8f3f-4fba91898d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507a56fced314b5d933025e1c65ee9bb, user_id=373297b950c242cd8862f89c166eb1ad, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:29.822080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1883c07-7948-42b7-8f3f-4fba91898d25 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:29.833670 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3830/7660] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:32:29 2022] PUT /identity/v3/projects/507a56fced314b5d933025e1c65ee9bb/users/373297b950c242cd8862f89c166eb1ad/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:32:29.846010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bc893-924b-4023-bfcc-12be5436e7da None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:29.846225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bc893-924b-4023-bfcc-12be5436e7da None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:29.846515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bc893-924b-4023-bfcc-12be5436e7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:29.878488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fb5bc893-924b-4023-bfcc-12be5436e7da None None] MFA Rules not processed for user `373297b950c242cd8862f89c166eb1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:32:29.879801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fb5bc893-924b-4023-bfcc-12be5436e7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:29.964211 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3831/7661] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:32:29 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:32:29.980010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1883c07-7948-42b7-8f3f-4fba91898d25 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:29.981673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d1883c07-7948-42b7-8f3f-4fba91898d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:30.074478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1883c07-7948-42b7-8f3f-4fba91898d25 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:30.080974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af910607-87c1-44df-ac2e-515bf4b68416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:30.081561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af910607-87c1-44df-ac2e-515bf4b68416 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:30.081846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af910607-87c1-44df-ac2e-515bf4b68416 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:30.082118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af910607-87c1-44df-ac2e-515bf4b68416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:30.135917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:30.164920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af910607-87c1-44df-ac2e-515bf4b68416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:30.167313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af910607-87c1-44df-ac2e-515bf4b68416 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:30.179138 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3831/7662] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:32:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:32:34.001677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bc893-924b-4023-bfcc-12be5436e7da None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:32:34.003217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fb5bc893-924b-4023-bfcc-12be5436e7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:34.062431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:34.080940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bc893-924b-4023-bfcc-12be5436e7da None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:32:34.086144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91b310-bf7b-426e-b1f6-adce451a9dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:32:34.087379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91b310-bf7b-426e-b1f6-adce451a9dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:34.087938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91b310-bf7b-426e-b1f6-adce451a9dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:34.089665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91b310-bf7b-426e-b1f6-adce451a9dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:34.102773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91b310-bf7b-426e-b1f6-adce451a9dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:32:34.104384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91b310-bf7b-426e-b1f6-adce451a9dc4 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:32:34.115702 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3832/7663] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:32:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:32:37.558950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc05c-b1b1-4a4e-b7a1-49e58a4c188c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:32:37.559516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc05c-b1b1-4a4e-b7a1-49e58a4c188c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:32:37.559516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc05c-b1b1-4a4e-b7a1-49e58a4c188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:32:37.594756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-806bc05c-b1b1-4a4e-b7a1-49e58a4c188c None None] MFA Rules not processed for user `b0ae958878db4d2a81ba14f57b3128c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:32:37.596087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-806bc05c-b1b1-4a4e-b7a1-49e58a4c188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:32:37.610007 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3832/7664] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:32:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:32:44.111718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:32:47.583225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=11 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:03.569988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91b310-bf7b-426e-b1f6-adce451a9dc4 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:03.581198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91b310-bf7b-426e-b1f6-adce451a9dc4 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:03.585339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af33a05-3bed-4a90-8f03-f9bef302c609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:03.599562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af33a05-3bed-4a90-8f03-f9bef302c609 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:03.599562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af33a05-3bed-4a90-8f03-f9bef302c609 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:03.599562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af33a05-3bed-4a90-8f03-f9bef302c609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:03.599562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3af33a05-3bed-4a90-8f03-f9bef302c609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:03.664496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af33a05-3bed-4a90-8f03-f9bef302c609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:03.666503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af33a05-3bed-4a90-8f03-f9bef302c609 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:03.676976 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3833/7665] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:04.761318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416d040-d24c-4a49-b2bc-ca196783c1cd None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:04.761901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416d040-d24c-4a49-b2bc-ca196783c1cd None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:04.761901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416d040-d24c-4a49-b2bc-ca196783c1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:04.796513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9416d040-d24c-4a49-b2bc-ca196783c1cd None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:04.797728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9416d040-d24c-4a49-b2bc-ca196783c1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:04.912300 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3833/7666] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:33:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:04.973171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af33a05-3bed-4a90-8f03-f9bef302c609 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:04.975251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3af33a05-3bed-4a90-8f03-f9bef302c609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:05.052578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af33a05-3bed-4a90-8f03-f9bef302c609 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:05.058464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59170d69-76f0-4813-97c7-41b36274f883 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:05.059108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59170d69-76f0-4813-97c7-41b36274f883 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:05.059395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59170d69-76f0-4813-97c7-41b36274f883 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:05.059700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59170d69-76f0-4813-97c7-41b36274f883 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:05.068940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59170d69-76f0-4813-97c7-41b36274f883 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:05.071360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59170d69-76f0-4813-97c7-41b36274f883 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:05.081356 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3834/7667] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:33:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:33:07.424877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416d040-d24c-4a49-b2bc-ca196783c1cd None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:07.446784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416d040-d24c-4a49-b2bc-ca196783c1cd None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:07.451129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df0edd-2317-4237-a70d-e0c2a43dbbb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:07.451952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df0edd-2317-4237-a70d-e0c2a43dbbb5 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:07.452346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df0edd-2317-4237-a70d-e0c2a43dbbb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:07.452789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df0edd-2317-4237-a70d-e0c2a43dbbb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:07.455367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-15df0edd-2317-4237-a70d-e0c2a43dbbb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:07.468587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df0edd-2317-4237-a70d-e0c2a43dbbb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:07.470311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df0edd-2317-4237-a70d-e0c2a43dbbb5 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:07.486277 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3834/7668] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:33:07.550683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59170d69-76f0-4813-97c7-41b36274f883 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:07.552493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-59170d69-76f0-4813-97c7-41b36274f883 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:07.585938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59170d69-76f0-4813-97c7-41b36274f883 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:07.591737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c4f82-e2bb-4a19-8db6-86846d73bcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:07.592475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4f82-e2bb-4a19-8db6-86846d73bcc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:07.593001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4f82-e2bb-4a19-8db6-86846d73bcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:07.593436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4f82-e2bb-4a19-8db6-86846d73bcc5 admin admin] PATH_INFO: `/v3/users/87820fd590ab402395340d61df0cd22b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:07.594623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c4f82-e2bb-4a19-8db6-86846d73bcc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87820fd590ab402395340d61df0cd22b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:07.596576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c4f82-e2bb-4a19-8db6-86846d73bcc5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:07.674216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f75c4f82-e2bb-4a19-8db6-86846d73bcc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87820fd590ab402395340d61df0cd22b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:07.685029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f75c4f82-e2bb-4a19-8db6-86846d73bcc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87820fd590ab402395340d61df0cd22b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:07.686558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f75c4f82-e2bb-4a19-8db6-86846d73bcc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87820fd590ab402395340d61df0cd22b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:07.701607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f75c4f82-e2bb-4a19-8db6-86846d73bcc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87820fd590ab402395340d61df0cd22b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:07.703185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f75c4f82-e2bb-4a19-8db6-86846d73bcc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87820fd590ab402395340d61df0cd22b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:07.707780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:07.721340 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3835/7669] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:07 2022] DELETE /identity/v3/users/87820fd590ab402395340d61df0cd22b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:07.912627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df0edd-2317-4237-a70d-e0c2a43dbbb5 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:07.949160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df0edd-2317-4237-a70d-e0c2a43dbbb5 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:08.014679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54e9de-275b-4c18-b1a2-9aa61d172543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.015356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54e9de-275b-4c18-b1a2-9aa61d172543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.015829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54e9de-275b-4c18-b1a2-9aa61d172543 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.016115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54e9de-275b-4c18-b1a2-9aa61d172543 admin admin] PATH_INFO: `/v3/projects/31fe785b7c2042f0a9b77b280467b586` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.017359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54e9de-275b-4c18-b1a2-9aa61d172543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31fe785b7c2042f0a9b77b280467b586)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.019346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54e9de-275b-4c18-b1a2-9aa61d172543 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.076017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fa54e9de-275b-4c18-b1a2-9aa61d172543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31fe785b7c2042f0a9b77b280467b586', 'request_id': 'req-fa54e9de-275b-4c18-b1a2-9aa61d172543'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:08.081807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fa54e9de-275b-4c18-b1a2-9aa61d172543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31fe785b7c2042f0a9b77b280467b586', 'request_id': 'req-fa54e9de-275b-4c18-b1a2-9aa61d172543'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:08.096948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fa54e9de-275b-4c18-b1a2-9aa61d172543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31fe785b7c2042f0a9b77b280467b586', 'request_id': 'req-fa54e9de-275b-4c18-b1a2-9aa61d172543'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:08.112098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fa54e9de-275b-4c18-b1a2-9aa61d172543 admin admin] The token cache is being invalidate because project 31fe785b7c2042f0a9b77b280467b586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:08.112408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fa54e9de-275b-4c18-b1a2-9aa61d172543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:08.113051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fa54e9de-275b-4c18-b1a2-9aa61d172543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:08.120521 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3835/7670] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:07 2022] DELETE /identity/v3/projects/31fe785b7c2042f0a9b77b280467b586 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:08.122124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f23bd-4211-43f3-8b64-565c3fa143f1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.122585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f23bd-4211-43f3-8b64-565c3fa143f1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.122954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f23bd-4211-43f3-8b64-565c3fa143f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.144336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b03f23bd-4211-43f3-8b64-565c3fa143f1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:08.145827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b03f23bd-4211-43f3-8b64-565c3fa143f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:08.246783 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3836/7671] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:08.254959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b788a0-2df1-4350-b487-cf70eba6658f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.255573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b788a0-2df1-4350-b487-cf70eba6658f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.255938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b788a0-2df1-4350-b487-cf70eba6658f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.284175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a3b788a0-2df1-4350-b487-cf70eba6658f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:08.285556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a3b788a0-2df1-4350-b487-cf70eba6658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:08.296295 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3836/7672] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:08.300199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f23bd-4211-43f3-8b64-565c3fa143f1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:08.310893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f23bd-4211-43f3-8b64-565c3fa143f1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:08.315923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf361b-94b5-447b-9c4e-2cec6e4ba0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.316864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf361b-94b5-447b-9c4e-2cec6e4ba0cb admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.317411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf361b-94b5-447b-9c4e-2cec6e4ba0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.317656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf361b-94b5-447b-9c4e-2cec6e4ba0cb admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.318303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf361b-94b5-447b-9c4e-2cec6e4ba0cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:08.318555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf361b-94b5-447b-9c4e-2cec6e4ba0cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.320272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf361b-94b5-447b-9c4e-2cec6e4ba0cb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.339186 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3837/7673] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:33:08.343464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b788a0-2df1-4350-b487-cf70eba6658f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:08.354018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b788a0-2df1-4350-b487-cf70eba6658f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:08.364459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce028f-c55d-4127-9c7e-1454033bc3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.365158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce028f-c55d-4127-9c7e-1454033bc3be admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.365447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce028f-c55d-4127-9c7e-1454033bc3be admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.365725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce028f-c55d-4127-9c7e-1454033bc3be admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.366864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce028f-c55d-4127-9c7e-1454033bc3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.369378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce028f-c55d-4127-9c7e-1454033bc3be admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.405105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:08.422203 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3837/7674] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:08 2022] POST /identity/v3/projects => generated 401 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:08.429715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf361b-94b5-447b-9c4e-2cec6e4ba0cb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:08.447407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf361b-94b5-447b-9c4e-2cec6e4ba0cb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:08.520168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26747-dafb-4f1f-b6ee-68652dfab7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.521037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26747-dafb-4f1f-b6ee-68652dfab7eb admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.521322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26747-dafb-4f1f-b6ee-68652dfab7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.521599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26747-dafb-4f1f-b6ee-68652dfab7eb admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.522239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a26747-dafb-4f1f-b6ee-68652dfab7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.524978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a26747-dafb-4f1f-b6ee-68652dfab7eb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.549359 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3838/7675] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:08 2022] POST /identity/v3/users => generated 301 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:08.553655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce028f-c55d-4127-9c7e-1454033bc3be admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:08.573859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce028f-c55d-4127-9c7e-1454033bc3be admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:08.587881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de369-02c3-45e2-8101-6d6c7c3d7d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.588625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de369-02c3-45e2-8101-6d6c7c3d7d0b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.588977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de369-02c3-45e2-8101-6d6c7c3d7d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.589334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de369-02c3-45e2-8101-6d6c7c3d7d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.590001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5de369-02c3-45e2-8101-6d6c7c3d7d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.591662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5de369-02c3-45e2-8101-6d6c7c3d7d0b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.603293 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3838/7676] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:08.607613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26747-dafb-4f1f-b6ee-68652dfab7eb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:08.620157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26747-dafb-4f1f-b6ee-68652dfab7eb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:08.625301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75ce68-9177-4b3a-a7f4-99aa3c7184fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.625924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75ce68-9177-4b3a-a7f4-99aa3c7184fd admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.626209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75ce68-9177-4b3a-a7f4-99aa3c7184fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.626502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75ce68-9177-4b3a-a7f4-99aa3c7184fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.627186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75ce68-9177-4b3a-a7f4-99aa3c7184fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.628800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75ce68-9177-4b3a-a7f4-99aa3c7184fd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.643795 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3839/7677] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:08.647675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de369-02c3-45e2-8101-6d6c7c3d7d0b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:08.658103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de369-02c3-45e2-8101-6d6c7c3d7d0b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:08.663395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21dbea-8c32-4ee1-86d4-382cb70c525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.664460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21dbea-8c32-4ee1-86d4-382cb70c525e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.665619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21dbea-8c32-4ee1-86d4-382cb70c525e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.666051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21dbea-8c32-4ee1-86d4-382cb70c525e admin admin] PATH_INFO: `/v3/projects/d5a6992f63a74b7b8e4205407a462711/users/80cbc87b55584921a44a79d2b9ddfb55/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.686533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21dbea-8c32-4ee1-86d4-382cb70c525e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a6992f63a74b7b8e4205407a462711, user_id=80cbc87b55584921a44a79d2b9ddfb55, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.689515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21dbea-8c32-4ee1-86d4-382cb70c525e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.708561 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3839/7678] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:08 2022] PUT /identity/v3/projects/d5a6992f63a74b7b8e4205407a462711/users/80cbc87b55584921a44a79d2b9ddfb55/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:08.720776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520c28a-58fa-44e5-9128-ef802cce18c0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.721161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520c28a-58fa-44e5-9128-ef802cce18c0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.721595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520c28a-58fa-44e5-9128-ef802cce18c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.755516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6520c28a-58fa-44e5-9128-ef802cce18c0 None None] MFA Rules not processed for user `80cbc87b55584921a44a79d2b9ddfb55`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:08.756861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6520c28a-58fa-44e5-9128-ef802cce18c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:08.818292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:08.854689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21dbea-8c32-4ee1-86d4-382cb70c525e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:08.854936 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3840/7679] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:08 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:08.940359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21dbea-8c32-4ee1-86d4-382cb70c525e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:08.945527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c24c70-e6a5-455e-88a8-7e1238fc6c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:08.946869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c24c70-e6a5-455e-88a8-7e1238fc6c54 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:08.947168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c24c70-e6a5-455e-88a8-7e1238fc6c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:08.947432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c24c70-e6a5-455e-88a8-7e1238fc6c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:08.948380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c24c70-e6a5-455e-88a8-7e1238fc6c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:08.950425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c24c70-e6a5-455e-88a8-7e1238fc6c54 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:08.988933 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3840/7680] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:08 2022] POST /identity/v3/projects => generated 403 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:08.993817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520c28a-58fa-44e5-9128-ef802cce18c0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:09.006326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520c28a-58fa-44e5-9128-ef802cce18c0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:09.072551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2dd0b-3fc5-44eb-9769-de3b48d9782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:09.073156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2dd0b-3fc5-44eb-9769-de3b48d9782e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.073437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2dd0b-3fc5-44eb-9769-de3b48d9782e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.073709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2dd0b-3fc5-44eb-9769-de3b48d9782e admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.074375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2dd0b-3fc5-44eb-9769-de3b48d9782e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:09.076316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2dd0b-3fc5-44eb-9769-de3b48d9782e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:09.102148 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3841/7681] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:08 2022] POST /identity/v3/users => generated 308 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:09.105618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c24c70-e6a5-455e-88a8-7e1238fc6c54 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:09.116517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c24c70-e6a5-455e-88a8-7e1238fc6c54 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:09.122075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9b020-1592-4692-a88a-513c319ccc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:09.122681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b020-1592-4692-a88a-513c319ccc42 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.122997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b020-1592-4692-a88a-513c319ccc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.123271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b020-1592-4692-a88a-513c319ccc42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.123918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9b020-1592-4692-a88a-513c319ccc42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:09.125513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9b020-1592-4692-a88a-513c319ccc42 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:09.140764 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3841/7682] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:09.142121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2dd0b-3fc5-44eb-9769-de3b48d9782e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:09.153294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2dd0b-3fc5-44eb-9769-de3b48d9782e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:09.158095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1731b84-1cad-42fc-ae04-9def096b5449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:09.158779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1731b84-1cad-42fc-ae04-9def096b5449 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.159067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1731b84-1cad-42fc-ae04-9def096b5449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.159343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1731b84-1cad-42fc-ae04-9def096b5449 admin admin] PATH_INFO: `/v3/projects/069b5913935c4c20aec94aa705729fec/users/2e43a090063042219adaaf8597b0f2aa/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.176567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1731b84-1cad-42fc-ae04-9def096b5449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069b5913935c4c20aec94aa705729fec, user_id=2e43a090063042219adaaf8597b0f2aa, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:09.179579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1731b84-1cad-42fc-ae04-9def096b5449 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:09.195951 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3842/7683] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:09 2022] PUT /identity/v3/projects/069b5913935c4c20aec94aa705729fec/users/2e43a090063042219adaaf8597b0f2aa/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:09.201010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9b020-1592-4692-a88a-513c319ccc42 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:09.214255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9b020-1592-4692-a88a-513c319ccc42 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:09.276751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b8a9b-f1e8-44f2-8388-0c5c20eb408e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:09.277371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b8a9b-f1e8-44f2-8388-0c5c20eb408e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.277655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b8a9b-f1e8-44f2-8388-0c5c20eb408e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.277932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b8a9b-f1e8-44f2-8388-0c5c20eb408e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.278602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b8a9b-f1e8-44f2-8388-0c5c20eb408e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:09.280268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b8a9b-f1e8-44f2-8388-0c5c20eb408e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:09.292897 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3842/7684] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:09.297001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1731b84-1cad-42fc-ae04-9def096b5449 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:09.309757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1731b84-1cad-42fc-ae04-9def096b5449 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:09.313386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324db899-d7cd-4417-bb76-25e25eb8d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:09.314057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324db899-d7cd-4417-bb76-25e25eb8d3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.314343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324db899-d7cd-4417-bb76-25e25eb8d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.314626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324db899-d7cd-4417-bb76-25e25eb8d3bf admin admin] PATH_INFO: `/v3/projects/069b5913935c4c20aec94aa705729fec/users/2e43a090063042219adaaf8597b0f2aa/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.316597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324db899-d7cd-4417-bb76-25e25eb8d3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=069b5913935c4c20aec94aa705729fec, user_id=2e43a090063042219adaaf8597b0f2aa, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:09.319298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324db899-d7cd-4417-bb76-25e25eb8d3bf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:09.339408 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3843/7685] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:09 2022] PUT /identity/v3/projects/069b5913935c4c20aec94aa705729fec/users/2e43a090063042219adaaf8597b0f2aa/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:09.342814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b12ad-ce18-4d8d-8c01-5cf28e2cc961 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.343135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b12ad-ce18-4d8d-8c01-5cf28e2cc961 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.343447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b12ad-ce18-4d8d-8c01-5cf28e2cc961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.374852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-da7b12ad-ce18-4d8d-8c01-5cf28e2cc961 None None] MFA Rules not processed for user `2e43a090063042219adaaf8597b0f2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:09.376082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-da7b12ad-ce18-4d8d-8c01-5cf28e2cc961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:09.395432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:09.465611 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3843/7686] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:09 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:09.470653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324db899-d7cd-4417-bb76-25e25eb8d3bf admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:09.483339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324db899-d7cd-4417-bb76-25e25eb8d3bf admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:09.487961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979d42e-a13b-4f37-8102-2b27964c034e tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e43a090063042219adaaf8597b0f2aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069b5913935c4c20aec94aa705729fec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:09.488613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979d42e-a13b-4f37-8102-2b27964c034e tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.488905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979d42e-a13b-4f37-8102-2b27964c034e tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.489188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979d42e-a13b-4f37-8102-2b27964c034e tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.489877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979d42e-a13b-4f37-8102-2b27964c034e tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:09.491580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8979d42e-a13b-4f37-8102-2b27964c034e tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:09.509454 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3844/7687] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:33:09 2022] POST /identity/v3/roles => generated 240 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:09.513682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b12ad-ce18-4d8d-8c01-5cf28e2cc961 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:09.523597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b12ad-ce18-4d8d-8c01-5cf28e2cc961 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:09.530053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804653fe-f182-4491-b036-7b8488420ea5 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e43a090063042219adaaf8597b0f2aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069b5913935c4c20aec94aa705729fec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:09.531280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804653fe-f182-4491-b036-7b8488420ea5 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.531831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804653fe-f182-4491-b036-7b8488420ea5 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.532234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804653fe-f182-4491-b036-7b8488420ea5 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] PATH_INFO: `/v3/projects/d5a6992f63a74b7b8e4205407a462711/users/80cbc87b55584921a44a79d2b9ddfb55/roles/d08fc7b5614840978b65100349bdd2d3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.535127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804653fe-f182-4491-b036-7b8488420ea5 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d5a6992f63a74b7b8e4205407a462711, user_id=80cbc87b55584921a44a79d2b9ddfb55, role_id=d08fc7b5614840978b65100349bdd2d3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:09.538712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804653fe-f182-4491-b036-7b8488420ea5 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:09.555311 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3844/7688] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:09 2022] PUT /identity/v3/projects/d5a6992f63a74b7b8e4205407a462711/users/80cbc87b55584921a44a79d2b9ddfb55/roles/d08fc7b5614840978b65100349bdd2d3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:09.561668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979d42e-a13b-4f37-8102-2b27964c034e tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:09.635740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8979d42e-a13b-4f37-8102-2b27964c034e tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:09.671856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:09.697909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484af80a-e5a8-4ed3-867e-ebe5d2ee07f3 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cbc87b55584921a44a79d2b9ddfb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a6992f63a74b7b8e4205407a462711', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1878521447'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:09.698175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484af80a-e5a8-4ed3-867e-ebe5d2ee07f3 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.698398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484af80a-e5a8-4ed3-867e-ebe5d2ee07f3 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.698664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484af80a-e5a8-4ed3-867e-ebe5d2ee07f3 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] PATH_INFO: `/v3/users/80cbc87b55584921a44a79d2b9ddfb55/application_credentials` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.699379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484af80a-e5a8-4ed3-867e-ebe5d2ee07f3 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] RBAC: Authorizing `identity:create_application_credential(user_id=80cbc87b55584921a44a79d2b9ddfb55)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:09.700553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484af80a-e5a8-4ed3-867e-ebe5d2ee07f3 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:09.778098 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3845/7689] 10.222.0.70 () {60 vars in 1315 bytes} [Sun Aug 28 19:33:09 2022] POST /identity/v3/users/80cbc87b55584921a44a79d2b9ddfb55/application_credentials => generated 660 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:09.782492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeacb23-8763-42bb-af7e-d0bda2c9eaef None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.782812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeacb23-8763-42bb-af7e-d0bda2c9eaef None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.783143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeacb23-8763-42bb-af7e-d0bda2c9eaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.810528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7eeacb23-8763-42bb-af7e-d0bda2c9eaef None None] MFA Rules not processed for user `80cbc87b55584921a44a79d2b9ddfb55`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:09.811985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7eeacb23-8763-42bb-af7e-d0bda2c9eaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:09.928684 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3845/7690] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:09 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 28 19:33:09.933900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484af80a-e5a8-4ed3-867e-ebe5d2ee07f3 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:09.944143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484af80a-e5a8-4ed3-867e-ebe5d2ee07f3 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:09.950695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335fa82-2e9e-4f6f-ad65-2e65ce1c83a1 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cbc87b55584921a44a79d2b9ddfb55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a6992f63a74b7b8e4205407a462711', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1878521447'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:09.951399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335fa82-2e9e-4f6f-ad65-2e65ce1c83a1 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:09.951694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335fa82-2e9e-4f6f-ad65-2e65ce1c83a1 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:09.951977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335fa82-2e9e-4f6f-ad65-2e65ce1c83a1 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] PATH_INFO: `/v3/users/80cbc87b55584921a44a79d2b9ddfb55/application_credentials/f923abee66d04f74abf5450a91ccccad` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:09.953194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335fa82-2e9e-4f6f-ad65-2e65ce1c83a1 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] RBAC: Authorizing `identity:delete_application_credential(user_id=80cbc87b55584921a44a79d2b9ddfb55, application_credential_id=f923abee66d04f74abf5450a91ccccad)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:09.954709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335fa82-2e9e-4f6f-ad65-2e65ce1c83a1 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:09.974966 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3846/7691] 10.222.0.70 () {58 vars in 1395 bytes} [Sun Aug 28 19:33:09 2022] DELETE /identity/v3/users/80cbc87b55584921a44a79d2b9ddfb55/application_credentials/f923abee66d04f74abf5450a91ccccad => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:09.979643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeacb23-8763-42bb-af7e-d0bda2c9eaef None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:10.025541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:10.050054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeacb23-8763-42bb-af7e-d0bda2c9eaef None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:10.054927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e80c27-a832-42c0-8f85-0bdacf8392c4 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e43a090063042219adaaf8597b0f2aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '069b5913935c4c20aec94aa705729fec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:10.056169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e80c27-a832-42c0-8f85-0bdacf8392c4 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:10.056456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e80c27-a832-42c0-8f85-0bdacf8392c4 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:10.056759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e80c27-a832-42c0-8f85-0bdacf8392c4 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] PATH_INFO: `/v3/roles/d08fc7b5614840978b65100349bdd2d3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:10.058151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e80c27-a832-42c0-8f85-0bdacf8392c4 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d08fc7b5614840978b65100349bdd2d3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:10.059802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e80c27-a832-42c0-8f85-0bdacf8392c4 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:10.101724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d9e80c27-a832-42c0-8f85-0bdacf8392c4 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] Invalidating the token cache because role d08fc7b5614840978b65100349bdd2d3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:10.102024 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d9e80c27-a832-42c0-8f85-0bdacf8392c4 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:10.102978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d9e80c27-a832-42c0-8f85-0bdacf8392c4 tempest-ApplicationCredentialsV3AdminTest-1019552054 tempest-ApplicationCredentialsV3AdminTest-1019552054-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:10.106130 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3846/7692] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:09 2022] DELETE /identity/v3/roles/d08fc7b5614840978b65100349bdd2d3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:10.110435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335fa82-2e9e-4f6f-ad65-2e65ce1c83a1 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:10.112191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4335fa82-2e9e-4f6f-ad65-2e65ce1c83a1 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:10.183068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335fa82-2e9e-4f6f-ad65-2e65ce1c83a1 tempest-ApplicationCredentialsV3AdminTest-679111524 tempest-ApplicationCredentialsV3AdminTest-679111524-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:10.247548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:10.248330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:10.248619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:10.248971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] PATH_INFO: `/v3/users/80cbc87b55584921a44a79d2b9ddfb55` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:10.250383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=80cbc87b55584921a44a79d2b9ddfb55)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:10.253195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:10.257605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:10.308334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80cbc87b55584921a44a79d2b9ddfb55'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:10.316936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80cbc87b55584921a44a79d2b9ddfb55'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:10.317762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80cbc87b55584921a44a79d2b9ddfb55'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:10.331180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80cbc87b55584921a44a79d2b9ddfb55'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:10.331900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80cbc87b55584921a44a79d2b9ddfb55'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:10.347544 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3847/7693] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:10 2022] DELETE /identity/v3/users/80cbc87b55584921a44a79d2b9ddfb55 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:10.351893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be056d-7e26-4d99-90f1-277724b06f10 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:10.352192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be056d-7e26-4d99-90f1-277724b06f10 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:10.352523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be056d-7e26-4d99-90f1-277724b06f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:10.373770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-67be056d-7e26-4d99-90f1-277724b06f10 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:10.375001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-67be056d-7e26-4d99-90f1-277724b06f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:10.442276 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3847/7694] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:10.452658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:10.454186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:10.530886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db468383-db1d-45a7-8cb0-b343fe35a8fa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:10.534580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed85a41-5de6-40b6-a8e0-a0c964bdddc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:10.535233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed85a41-5de6-40b6-a8e0-a0c964bdddc1 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:10.535525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed85a41-5de6-40b6-a8e0-a0c964bdddc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:10.535801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed85a41-5de6-40b6-a8e0-a0c964bdddc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:10.546798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed85a41-5de6-40b6-a8e0-a0c964bdddc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:10.548521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed85a41-5de6-40b6-a8e0-a0c964bdddc1 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:10.558866 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3848/7695] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:10.845470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be056d-7e26-4d99-90f1-277724b06f10 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:10.847056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-67be056d-7e26-4d99-90f1-277724b06f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:10.860613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be056d-7e26-4d99-90f1-277724b06f10 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:10.865909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:10.866590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:10.866870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:10.867208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] PATH_INFO: `/v3/projects/d5a6992f63a74b7b8e4205407a462711` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:10.869050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a6992f63a74b7b8e4205407a462711)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:10.871008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:10.921456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a6992f63a74b7b8e4205407a462711', 'request_id': 'req-4ddd6b9c-bff8-40f1-b979-bb322e502129'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:10.927604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a6992f63a74b7b8e4205407a462711', 'request_id': 'req-4ddd6b9c-bff8-40f1-b979-bb322e502129'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:10.934614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a6992f63a74b7b8e4205407a462711', 'request_id': 'req-4ddd6b9c-bff8-40f1-b979-bb322e502129'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:10.948814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] The token cache is being invalidate because project d5a6992f63a74b7b8e4205407a462711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:10.949113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:10.949783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:10.951506 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3848/7696] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:10 2022] DELETE /identity/v3/projects/d5a6992f63a74b7b8e4205407a462711 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:10.955447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed85a41-5de6-40b6-a8e0-a0c964bdddc1 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:10.966392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed85a41-5de6-40b6-a8e0-a0c964bdddc1 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:11.030147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dd11e-669a-4116-9492-99c0db3397f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:11.030919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd11e-669a-4116-9492-99c0db3397f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:11.031202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd11e-669a-4116-9492-99c0db3397f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:11.031483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd11e-669a-4116-9492-99c0db3397f6 admin admin] PATH_INFO: `/v3/users/2e43a090063042219adaaf8597b0f2aa` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:11.032598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dd11e-669a-4116-9492-99c0db3397f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e43a090063042219adaaf8597b0f2aa)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:11.034528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dd11e-669a-4116-9492-99c0db3397f6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:11.066436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:11.091481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-130dd11e-669a-4116-9492-99c0db3397f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e43a090063042219adaaf8597b0f2aa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:11.098644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-130dd11e-669a-4116-9492-99c0db3397f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e43a090063042219adaaf8597b0f2aa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:11.099431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-130dd11e-669a-4116-9492-99c0db3397f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e43a090063042219adaaf8597b0f2aa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:11.114248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-130dd11e-669a-4116-9492-99c0db3397f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e43a090063042219adaaf8597b0f2aa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:11.115209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-130dd11e-669a-4116-9492-99c0db3397f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e43a090063042219adaaf8597b0f2aa'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:11.131881 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3849/7697] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:10 2022] DELETE /identity/v3/users/2e43a090063042219adaaf8597b0f2aa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:11.422182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:11.423874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:11.437792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd6b9c-bff8-40f1-b979-bb322e502129 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:11.467189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:11.505010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2e383-2638-4412-8130-f18cb95901f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:11.505835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2e383-2638-4412-8130-f18cb95901f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:11.506455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2e383-2638-4412-8130-f18cb95901f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:11.506455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2e383-2638-4412-8130-f18cb95901f4 admin admin] PATH_INFO: `/v3/projects/069b5913935c4c20aec94aa705729fec` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:11.509925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2e383-2638-4412-8130-f18cb95901f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=069b5913935c4c20aec94aa705729fec)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:11.509925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2e383-2638-4412-8130-f18cb95901f4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:11.579438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dd2e383-2638-4412-8130-f18cb95901f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069b5913935c4c20aec94aa705729fec', 'request_id': 'req-5dd2e383-2638-4412-8130-f18cb95901f4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:11.585456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dd2e383-2638-4412-8130-f18cb95901f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069b5913935c4c20aec94aa705729fec', 'request_id': 'req-5dd2e383-2638-4412-8130-f18cb95901f4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:11.592788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dd2e383-2638-4412-8130-f18cb95901f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069b5913935c4c20aec94aa705729fec', 'request_id': 'req-5dd2e383-2638-4412-8130-f18cb95901f4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:11.606442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dd2e383-2638-4412-8130-f18cb95901f4 admin admin] The token cache is being invalidate because project 069b5913935c4c20aec94aa705729fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:11.606759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dd2e383-2638-4412-8130-f18cb95901f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:11.607434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5dd2e383-2638-4412-8130-f18cb95901f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:11.608933 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3849/7698] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:11 2022] DELETE /identity/v3/projects/069b5913935c4c20aec94aa705729fec => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:11.614090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3d86f-df75-4139-9e64-203f5bd0e879 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:11.614382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3d86f-df75-4139-9e64-203f5bd0e879 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:11.614649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3d86f-df75-4139-9e64-203f5bd0e879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:11.636425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cfc3d86f-df75-4139-9e64-203f5bd0e879 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:11.637642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cfc3d86f-df75-4139-9e64-203f5bd0e879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:11.702548 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3850/7699] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:33:11.710350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a41ed0-e05c-474a-85e5-fb007ec4e894 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:11.710636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a41ed0-e05c-474a-85e5-fb007ec4e894 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:11.710942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a41ed0-e05c-474a-85e5-fb007ec4e894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:11.733627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-84a41ed0-e05c-474a-85e5-fb007ec4e894 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:11.734981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-84a41ed0-e05c-474a-85e5-fb007ec4e894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:11.744168 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3850/7700] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:11.748394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3d86f-df75-4139-9e64-203f5bd0e879 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:11.759492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3d86f-df75-4139-9e64-203f5bd0e879 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:11.765046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f49b0-552f-4a2a-8a43-a708eb2010de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:11.765928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f49b0-552f-4a2a-8a43-a708eb2010de admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:11.766214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f49b0-552f-4a2a-8a43-a708eb2010de admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:11.766493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f49b0-552f-4a2a-8a43-a708eb2010de admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:11.767186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f49b0-552f-4a2a-8a43-a708eb2010de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:11.767495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f49b0-552f-4a2a-8a43-a708eb2010de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:11.769112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f49b0-552f-4a2a-8a43-a708eb2010de admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:11.785575 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3851/7701] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:11.786723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a41ed0-e05c-474a-85e5-fb007ec4e894 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:11.796349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a41ed0-e05c-474a-85e5-fb007ec4e894 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:11.802832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda28bd-ff47-4b42-912f-94a254fde97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:11.804740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda28bd-ff47-4b42-912f-94a254fde97e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:11.805056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda28bd-ff47-4b42-912f-94a254fde97e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:11.805346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda28bd-ff47-4b42-912f-94a254fde97e admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:11.805982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda28bd-ff47-4b42-912f-94a254fde97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:11.808114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda28bd-ff47-4b42-912f-94a254fde97e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:11.838674 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3851/7702] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:11 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:11.842895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f49b0-552f-4a2a-8a43-a708eb2010de admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:11.854249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f49b0-552f-4a2a-8a43-a708eb2010de admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:11.916674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92372e0-8f5f-4b2c-869f-92bc43606123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:11.917294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92372e0-8f5f-4b2c-869f-92bc43606123 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:11.917581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92372e0-8f5f-4b2c-869f-92bc43606123 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:11.917860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92372e0-8f5f-4b2c-869f-92bc43606123 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:11.918499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92372e0-8f5f-4b2c-869f-92bc43606123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:11.920536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92372e0-8f5f-4b2c-869f-92bc43606123 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:11.944022 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3852/7703] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:11 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:11.948639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda28bd-ff47-4b42-912f-94a254fde97e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:11.959624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda28bd-ff47-4b42-912f-94a254fde97e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:11.965739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1734ce-67a1-48cc-9bab-aa92546513f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:11.966388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1734ce-67a1-48cc-9bab-aa92546513f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:11.966668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1734ce-67a1-48cc-9bab-aa92546513f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:11.966981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1734ce-67a1-48cc-9bab-aa92546513f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:11.967717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1734ce-67a1-48cc-9bab-aa92546513f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:11.969427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1734ce-67a1-48cc-9bab-aa92546513f3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:11.981334 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3852/7704] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:11.985212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92372e0-8f5f-4b2c-869f-92bc43606123 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:11.996571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92372e0-8f5f-4b2c-869f-92bc43606123 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.001643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d960ffb-35d4-4646-be7c-d4b59decbcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.002258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d960ffb-35d4-4646-be7c-d4b59decbcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.002541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d960ffb-35d4-4646-be7c-d4b59decbcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.002858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d960ffb-35d4-4646-be7c-d4b59decbcf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.003507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d960ffb-35d4-4646-be7c-d4b59decbcf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.005107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d960ffb-35d4-4646-be7c-d4b59decbcf9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.017651 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3853/7705] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:33:12.021756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1734ce-67a1-48cc-9bab-aa92546513f3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.033082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1734ce-67a1-48cc-9bab-aa92546513f3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.037760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86a9fe-cbe3-4ef3-bec7-e7716defec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.038408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86a9fe-cbe3-4ef3-bec7-e7716defec83 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.038691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86a9fe-cbe3-4ef3-bec7-e7716defec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.038999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86a9fe-cbe3-4ef3-bec7-e7716defec83 admin admin] PATH_INFO: `/v3/projects/89d028ba736d43269cc1fe8234698dbc/users/3f3d4016f8de45e28c1165874ef55d58/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.056306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86a9fe-cbe3-4ef3-bec7-e7716defec83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d028ba736d43269cc1fe8234698dbc, user_id=3f3d4016f8de45e28c1165874ef55d58, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.059192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86a9fe-cbe3-4ef3-bec7-e7716defec83 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.073946 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3853/7706] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:12 2022] PUT /identity/v3/projects/89d028ba736d43269cc1fe8234698dbc/users/3f3d4016f8de45e28c1165874ef55d58/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:12.085177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ac353-10dd-4716-9da7-e032a3f8e271 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.085548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ac353-10dd-4716-9da7-e032a3f8e271 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.085831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ac353-10dd-4716-9da7-e032a3f8e271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.106949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:12.118598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6c4ac353-10dd-4716-9da7-e032a3f8e271 None None] MFA Rules not processed for user `3f3d4016f8de45e28c1165874ef55d58`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:12.120425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6c4ac353-10dd-4716-9da7-e032a3f8e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:12.202538 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3854/7707] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:12.207008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86a9fe-cbe3-4ef3-bec7-e7716defec83 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.264629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:12.276629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86a9fe-cbe3-4ef3-bec7-e7716defec83 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.283393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8623ee2-12cd-461f-9db4-f8dd76d9cd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.284012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8623ee2-12cd-461f-9db4-f8dd76d9cd60 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.284295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8623ee2-12cd-461f-9db4-f8dd76d9cd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.284579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8623ee2-12cd-461f-9db4-f8dd76d9cd60 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.285257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8623ee2-12cd-461f-9db4-f8dd76d9cd60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.287418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8623ee2-12cd-461f-9db4-f8dd76d9cd60 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.316876 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3854/7708] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:12 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:12.321050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ac353-10dd-4716-9da7-e032a3f8e271 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.332415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ac353-10dd-4716-9da7-e032a3f8e271 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.394615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ed688-0b28-434c-aa9a-fe3bb3d684cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.395274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ed688-0b28-434c-aa9a-fe3bb3d684cf admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.395666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ed688-0b28-434c-aa9a-fe3bb3d684cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.395944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ed688-0b28-434c-aa9a-fe3bb3d684cf admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.396575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ed688-0b28-434c-aa9a-fe3bb3d684cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.398553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ed688-0b28-434c-aa9a-fe3bb3d684cf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.423652 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3855/7709] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:12 2022] POST /identity/v3/users => generated 301 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:12.427708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8623ee2-12cd-461f-9db4-f8dd76d9cd60 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.440786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8623ee2-12cd-461f-9db4-f8dd76d9cd60 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.445744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e58b2-27b6-4cf7-a80f-05aa1ce25751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.446533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e58b2-27b6-4cf7-a80f-05aa1ce25751 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.447047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e58b2-27b6-4cf7-a80f-05aa1ce25751 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.447325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e58b2-27b6-4cf7-a80f-05aa1ce25751 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.447998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e58b2-27b6-4cf7-a80f-05aa1ce25751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.449619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e58b2-27b6-4cf7-a80f-05aa1ce25751 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.464016 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3855/7710] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:12.465153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ed688-0b28-434c-aa9a-fe3bb3d684cf admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.475904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ed688-0b28-434c-aa9a-fe3bb3d684cf admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.481920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be09df2-b8d5-4e0f-a25b-0975d45200c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.482682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09df2-b8d5-4e0f-a25b-0975d45200c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.483009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09df2-b8d5-4e0f-a25b-0975d45200c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.483291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09df2-b8d5-4e0f-a25b-0975d45200c8 admin admin] PATH_INFO: `/v3/projects/7bfb48a14cc647499c7d6ffbee602d5a/users/3fe6cc08129b455dbd4132e7e3506f98/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.500412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be09df2-b8d5-4e0f-a25b-0975d45200c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfb48a14cc647499c7d6ffbee602d5a, user_id=3fe6cc08129b455dbd4132e7e3506f98, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.503138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be09df2-b8d5-4e0f-a25b-0975d45200c8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.517789 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3856/7711] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:12 2022] PUT /identity/v3/projects/7bfb48a14cc647499c7d6ffbee602d5a/users/3fe6cc08129b455dbd4132e7e3506f98/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:12.521859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e58b2-27b6-4cf7-a80f-05aa1ce25751 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.532650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e58b2-27b6-4cf7-a80f-05aa1ce25751 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.599650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506d55d-8594-440e-82d0-342e019dea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.600282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506d55d-8594-440e-82d0-342e019dea37 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.600569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506d55d-8594-440e-82d0-342e019dea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.600843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506d55d-8594-440e-82d0-342e019dea37 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.601490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506d55d-8594-440e-82d0-342e019dea37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.603918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506d55d-8594-440e-82d0-342e019dea37 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.615078 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3856/7712] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:12.619869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be09df2-b8d5-4e0f-a25b-0975d45200c8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.630708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be09df2-b8d5-4e0f-a25b-0975d45200c8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.637065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5a129-bd2d-43b7-9a4d-4e5e60020cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.637737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5a129-bd2d-43b7-9a4d-4e5e60020cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.638020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5a129-bd2d-43b7-9a4d-4e5e60020cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.638299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5a129-bd2d-43b7-9a4d-4e5e60020cb9 admin admin] PATH_INFO: `/v3/projects/7bfb48a14cc647499c7d6ffbee602d5a/users/3fe6cc08129b455dbd4132e7e3506f98/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.640276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5a129-bd2d-43b7-9a4d-4e5e60020cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfb48a14cc647499c7d6ffbee602d5a, user_id=3fe6cc08129b455dbd4132e7e3506f98, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.643315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5a129-bd2d-43b7-9a4d-4e5e60020cb9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.654573 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3857/7713] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:12 2022] PUT /identity/v3/projects/7bfb48a14cc647499c7d6ffbee602d5a/users/3fe6cc08129b455dbd4132e7e3506f98/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:12.745384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8febe-6982-416b-8528-715f2cd33037 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.745675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8febe-6982-416b-8528-715f2cd33037 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.745956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8febe-6982-416b-8528-715f2cd33037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.776584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-52d8febe-6982-416b-8528-715f2cd33037 None None] MFA Rules not processed for user `3fe6cc08129b455dbd4132e7e3506f98`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:12.777821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-52d8febe-6982-416b-8528-715f2cd33037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:12.854146 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3857/7714] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:12 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:12.858618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5a129-bd2d-43b7-9a4d-4e5e60020cb9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.869798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5a129-bd2d-43b7-9a4d-4e5e60020cb9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.876007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc79e05-191a-43dd-abc7-18678e4ff816 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe6cc08129b455dbd4132e7e3506f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfb48a14cc647499c7d6ffbee602d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.876655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc79e05-191a-43dd-abc7-18678e4ff816 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.876944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc79e05-191a-43dd-abc7-18678e4ff816 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.877225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc79e05-191a-43dd-abc7-18678e4ff816 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] PATH_INFO: `/v3/projects/89d028ba736d43269cc1fe8234698dbc` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.878405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc79e05-191a-43dd-abc7-18678e4ff816 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorizing `identity:get_project(project_id=89d028ba736d43269cc1fe8234698dbc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.880523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc79e05-191a-43dd-abc7-18678e4ff816 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.882437 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3858/7715] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:33:12 2022] GET /identity/v3/projects/89d028ba736d43269cc1fe8234698dbc => generated 389 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:12.886675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8febe-6982-416b-8528-715f2cd33037 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.896769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8febe-6982-416b-8528-715f2cd33037 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:12.902087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2b2ed-22bf-4e31-95d7-bd6990530e4e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe6cc08129b455dbd4132e7e3506f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfb48a14cc647499c7d6ffbee602d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:12.902698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2b2ed-22bf-4e31-95d7-bd6990530e4e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:12.903022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2b2ed-22bf-4e31-95d7-bd6990530e4e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:12.903302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2b2ed-22bf-4e31-95d7-bd6990530e4e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:12.903943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2b2ed-22bf-4e31-95d7-bd6990530e4e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:12.905837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2b2ed-22bf-4e31-95d7-bd6990530e4e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:12.937116 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3858/7716] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:33:12 2022] POST /identity/v3/projects => generated 339 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:12.941675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc79e05-191a-43dd-abc7-18678e4ff816 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:12.953018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc79e05-191a-43dd-abc7-18678e4ff816 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.001855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:13.017337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335903be-311e-4bfd-857b-dee3de4287d3 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe6cc08129b455dbd4132e7e3506f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfb48a14cc647499c7d6ffbee602d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.017969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335903be-311e-4bfd-857b-dee3de4287d3 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.018288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335903be-311e-4bfd-857b-dee3de4287d3 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.018535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335903be-311e-4bfd-857b-dee3de4287d3 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.019222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335903be-311e-4bfd-857b-dee3de4287d3 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.021105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335903be-311e-4bfd-857b-dee3de4287d3 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.041109 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3859/7717] 10.222.0.70 () {58 vars in 1131 bytes} [Sun Aug 28 19:33:12 2022] GET /identity/v3/projects => generated 5501 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:13.045702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2b2ed-22bf-4e31-95d7-bd6990530e4e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.057242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2b2ed-22bf-4e31-95d7-bd6990530e4e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.062028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2369ec-057d-429d-83f3-89d78bd95dc7 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe6cc08129b455dbd4132e7e3506f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfb48a14cc647499c7d6ffbee602d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.062664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2369ec-057d-429d-83f3-89d78bd95dc7 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.062990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2369ec-057d-429d-83f3-89d78bd95dc7 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.063266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2369ec-057d-429d-83f3-89d78bd95dc7 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] PATH_INFO: `/v3/projects/89d028ba736d43269cc1fe8234698dbc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.064404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2369ec-057d-429d-83f3-89d78bd95dc7 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorizing `identity:get_project(project_id=89d028ba736d43269cc1fe8234698dbc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.066486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2369ec-057d-429d-83f3-89d78bd95dc7 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.068355 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3859/7718] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/projects/89d028ba736d43269cc1fe8234698dbc => generated 389 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:33:13.072520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335903be-311e-4bfd-857b-dee3de4287d3 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.082844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335903be-311e-4bfd-857b-dee3de4287d3 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.087603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af652a46-2d44-4c63-ae26-d8fe4edd6ab9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe6cc08129b455dbd4132e7e3506f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfb48a14cc647499c7d6ffbee602d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.088226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652a46-2d44-4c63-ae26-d8fe4edd6ab9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.088508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652a46-2d44-4c63-ae26-d8fe4edd6ab9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.088780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af652a46-2d44-4c63-ae26-d8fe4edd6ab9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] PATH_INFO: `/v3/projects/6a1e3abeaf7a4db280ebadd804d25298` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.089930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af652a46-2d44-4c63-ae26-d8fe4edd6ab9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorizing `identity:get_project(project_id=6a1e3abeaf7a4db280ebadd804d25298)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.092014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af652a46-2d44-4c63-ae26-d8fe4edd6ab9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.093648 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3860/7719] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/projects/6a1e3abeaf7a4db280ebadd804d25298 => generated 339 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:13.098648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2369ec-057d-429d-83f3-89d78bd95dc7 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.111290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2369ec-057d-429d-83f3-89d78bd95dc7 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.119438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f8f2a-0be9-467e-83c4-82c754dfa5a5 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe6cc08129b455dbd4132e7e3506f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfb48a14cc647499c7d6ffbee602d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.120053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f8f2a-0be9-467e-83c4-82c754dfa5a5 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.120337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f8f2a-0be9-467e-83c4-82c754dfa5a5 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.120611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f8f2a-0be9-467e-83c4-82c754dfa5a5 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.121258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f8f2a-0be9-467e-83c4-82c754dfa5a5 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.123142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f8f2a-0be9-467e-83c4-82c754dfa5a5 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.147404 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3860/7720] 10.222.0.70 () {58 vars in 1131 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/projects => generated 5501 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:33:13.152042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af652a46-2d44-4c63-ae26-d8fe4edd6ab9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.162634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af652a46-2d44-4c63-ae26-d8fe4edd6ab9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.168027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4ad51-8da4-4117-a7bc-d2ba40c0bbca tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe6cc08129b455dbd4132e7e3506f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfb48a14cc647499c7d6ffbee602d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.168915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4ad51-8da4-4117-a7bc-d2ba40c0bbca tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.169202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4ad51-8da4-4117-a7bc-d2ba40c0bbca tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.169479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4ad51-8da4-4117-a7bc-d2ba40c0bbca tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.170150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4ad51-8da4-4117-a7bc-d2ba40c0bbca tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:13.170497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4ad51-8da4-4117-a7bc-d2ba40c0bbca tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.172422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4ad51-8da4-4117-a7bc-d2ba40c0bbca tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.199332 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3861/7721] 10.222.0.70 () {58 vars in 1166 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/projects?domain_id=default => generated 5170 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:13.203114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f8f2a-0be9-467e-83c4-82c754dfa5a5 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.213969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f8f2a-0be9-467e-83c4-82c754dfa5a5 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.219435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42117fe1-5a2b-4261-8418-8d0ad9e23e8e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe6cc08129b455dbd4132e7e3506f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfb48a14cc647499c7d6ffbee602d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.220048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42117fe1-5a2b-4261-8418-8d0ad9e23e8e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.220329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42117fe1-5a2b-4261-8418-8d0ad9e23e8e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.220607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42117fe1-5a2b-4261-8418-8d0ad9e23e8e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.221253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42117fe1-5a2b-4261-8418-8d0ad9e23e8e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.223144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42117fe1-5a2b-4261-8418-8d0ad9e23e8e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.225796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:13.246444 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3861/7722] 10.222.0.70 () {58 vars in 1131 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/projects => generated 5501 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:33:13.251159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4ad51-8da4-4117-a7bc-d2ba40c0bbca tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.266295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4ad51-8da4-4117-a7bc-d2ba40c0bbca tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.271252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc2790-0806-4401-8b63-c1eb0f532fd9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe6cc08129b455dbd4132e7e3506f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfb48a14cc647499c7d6ffbee602d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.272539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc2790-0806-4401-8b63-c1eb0f532fd9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.273323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc2790-0806-4401-8b63-c1eb0f532fd9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.273705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc2790-0806-4401-8b63-c1eb0f532fd9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.274471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc2790-0806-4401-8b63-c1eb0f532fd9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:13.274800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc2790-0806-4401-8b63-c1eb0f532fd9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.276818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc2790-0806-4401-8b63-c1eb0f532fd9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.298388 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3862/7723] 10.222.0.70 () {58 vars in 1166 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/projects?domain_id=default => generated 5170 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:13.304028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42117fe1-5a2b-4261-8418-8d0ad9e23e8e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.315985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42117fe1-5a2b-4261-8418-8d0ad9e23e8e tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.321803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad609a3-3c01-46e0-98bb-4b8df4e7d539 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe6cc08129b455dbd4132e7e3506f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfb48a14cc647499c7d6ffbee602d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.329144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad609a3-3c01-46e0-98bb-4b8df4e7d539 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.329472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad609a3-3c01-46e0-98bb-4b8df4e7d539 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.329756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad609a3-3c01-46e0-98bb-4b8df4e7d539 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.330442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad609a3-3c01-46e0-98bb-4b8df4e7d539 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.332640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad609a3-3c01-46e0-98bb-4b8df4e7d539 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.353883 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3862/7724] 10.222.0.70 () {58 vars in 1131 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/projects => generated 5501 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:33:13.358017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc2790-0806-4401-8b63-c1eb0f532fd9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.369709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc2790-0806-4401-8b63-c1eb0f532fd9 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.374916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4739c-9f1a-4204-92ec-2d47d1d24b96 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe6cc08129b455dbd4132e7e3506f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfb48a14cc647499c7d6ffbee602d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.375557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4739c-9f1a-4204-92ec-2d47d1d24b96 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.375846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4739c-9f1a-4204-92ec-2d47d1d24b96 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.376124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4739c-9f1a-4204-92ec-2d47d1d24b96 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.376793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4739c-9f1a-4204-92ec-2d47d1d24b96 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-2015102483) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:13.377098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4739c-9f1a-4204-92ec-2d47d1d24b96 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.380043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4739c-9f1a-4204-92ec-2d47d1d24b96 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.397881 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3863/7725] 10.222.0.70 () {58 vars in 1232 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-2015102483 => generated 537 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:13.403666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad609a3-3c01-46e0-98bb-4b8df4e7d539 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.416347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad609a3-3c01-46e0-98bb-4b8df4e7d539 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.422001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fe6cc08129b455dbd4132e7e3506f98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bfb48a14cc647499c7d6ffbee602d5a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.422651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.422971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.423251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] PATH_INFO: `/v3/projects/6a1e3abeaf7a4db280ebadd804d25298` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.424417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6a1e3abeaf7a4db280ebadd804d25298)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.427232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.481507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1e3abeaf7a4db280ebadd804d25298', 'request_id': 'req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:13.487162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1e3abeaf7a4db280ebadd804d25298', 'request_id': 'req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:13.493454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1e3abeaf7a4db280ebadd804d25298', 'request_id': 'req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:13.509126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] The token cache is being invalidate because project 6a1e3abeaf7a4db280ebadd804d25298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:13.509446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:13.510097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-607d59ef-5f6e-46a9-9c2f-8656e4a25d66 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:13.511715 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3863/7726] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:13 2022] DELETE /identity/v3/projects/6a1e3abeaf7a4db280ebadd804d25298 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:13.515742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4739c-9f1a-4204-92ec-2d47d1d24b96 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.517439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f2d4739c-9f1a-4204-92ec-2d47d1d24b96 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:13.605162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4739c-9f1a-4204-92ec-2d47d1d24b96 tempest-ListProjectsStaticTestJSON-2027287314 tempest-ListProjectsStaticTestJSON-2027287314-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.677624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.678262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.678541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.678857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] PATH_INFO: `/v3/users/3f3d4016f8de45e28c1165874ef55d58` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.679992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3d4016f8de45e28c1165874ef55d58)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.681976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.734090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:13.738249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3d4016f8de45e28c1165874ef55d58'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:13.747107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3d4016f8de45e28c1165874ef55d58'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:13.747867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3d4016f8de45e28c1165874ef55d58'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:13.762006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3d4016f8de45e28c1165874ef55d58'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:13.762728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3d4016f8de45e28c1165874ef55d58'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:13.777597 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3864/7727] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:13 2022] DELETE /identity/v3/users/3f3d4016f8de45e28c1165874ef55d58 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:13.782031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb18ea-83bd-44c6-8fa6-fb4793cd9792 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.782327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb18ea-83bd-44c6-8fa6-fb4793cd9792 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.782606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb18ea-83bd-44c6-8fa6-fb4793cd9792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.803523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4aeb18ea-83bd-44c6-8fa6-fb4793cd9792 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:13.804868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4aeb18ea-83bd-44c6-8fa6-fb4793cd9792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:13.870141 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3864/7728] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:13.879759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:13.881258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:13.944413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15a27b-9d71-4593-8f15-f7ba6b22d6b9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:13.948782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6b62f-d94e-41fe-badf-0e74463515c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:13.949405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6b62f-d94e-41fe-badf-0e74463515c8 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:13.949691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6b62f-d94e-41fe-badf-0e74463515c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:13.949978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6b62f-d94e-41fe-badf-0e74463515c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:13.959983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6b62f-d94e-41fe-badf-0e74463515c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:13.961455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6b62f-d94e-41fe-badf-0e74463515c8 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:13.972180 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3865/7729] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:14.270662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb18ea-83bd-44c6-8fa6-fb4793cd9792 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:14.273618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4aeb18ea-83bd-44c6-8fa6-fb4793cd9792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:14.287728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb18ea-83bd-44c6-8fa6-fb4793cd9792 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:14.299181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:14.299972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:14.300349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:14.300808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] PATH_INFO: `/v3/projects/89d028ba736d43269cc1fe8234698dbc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:14.302167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d028ba736d43269cc1fe8234698dbc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:14.304609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:14.373051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d028ba736d43269cc1fe8234698dbc', 'request_id': 'req-37d43ac5-eed2-4387-94c4-b52b2c6721aa'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:14.378718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d028ba736d43269cc1fe8234698dbc', 'request_id': 'req-37d43ac5-eed2-4387-94c4-b52b2c6721aa'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:14.384200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:14.389462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d028ba736d43269cc1fe8234698dbc', 'request_id': 'req-37d43ac5-eed2-4387-94c4-b52b2c6721aa'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:14.405774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] The token cache is being invalidate because project 89d028ba736d43269cc1fe8234698dbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:14.405774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:14.406533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:14.408208 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3865/7730] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:14 2022] DELETE /identity/v3/projects/89d028ba736d43269cc1fe8234698dbc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:14.412418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6b62f-d94e-41fe-badf-0e74463515c8 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:14.423926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6b62f-d94e-41fe-badf-0e74463515c8 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:14.489058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2d4a2-5087-4ef3-90f8-9e752ed8cc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:14.489767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2d4a2-5087-4ef3-90f8-9e752ed8cc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:14.490428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2d4a2-5087-4ef3-90f8-9e752ed8cc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:14.490713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2d4a2-5087-4ef3-90f8-9e752ed8cc1f admin admin] PATH_INFO: `/v3/users/3fe6cc08129b455dbd4132e7e3506f98` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:14.491917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2d4a2-5087-4ef3-90f8-9e752ed8cc1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe6cc08129b455dbd4132e7e3506f98)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:14.494570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2d4a2-5087-4ef3-90f8-9e752ed8cc1f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:14.546295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9b2d4a2-5087-4ef3-90f8-9e752ed8cc1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe6cc08129b455dbd4132e7e3506f98'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:14.553925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9b2d4a2-5087-4ef3-90f8-9e752ed8cc1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe6cc08129b455dbd4132e7e3506f98'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:14.554664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9b2d4a2-5087-4ef3-90f8-9e752ed8cc1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe6cc08129b455dbd4132e7e3506f98'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:14.564536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:14.571351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9b2d4a2-5087-4ef3-90f8-9e752ed8cc1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe6cc08129b455dbd4132e7e3506f98'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:14.573065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f9b2d4a2-5087-4ef3-90f8-9e752ed8cc1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe6cc08129b455dbd4132e7e3506f98'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:14.592286 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3866/7731] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:14 2022] DELETE /identity/v3/users/3fe6cc08129b455dbd4132e7e3506f98 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:14.885382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:14.886987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:14.906204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43ac5-eed2-4387-94c4-b52b2c6721aa admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:14.972478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f71276-4fa0-47d4-ad9d-694ed0533318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:14.973052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f71276-4fa0-47d4-ad9d-694ed0533318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:14.973364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f71276-4fa0-47d4-ad9d-694ed0533318 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:14.973842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f71276-4fa0-47d4-ad9d-694ed0533318 admin admin] PATH_INFO: `/v3/projects/7bfb48a14cc647499c7d6ffbee602d5a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:14.975265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f71276-4fa0-47d4-ad9d-694ed0533318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bfb48a14cc647499c7d6ffbee602d5a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:14.977211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f71276-4fa0-47d4-ad9d-694ed0533318 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:15.029733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d0f71276-4fa0-47d4-ad9d-694ed0533318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bfb48a14cc647499c7d6ffbee602d5a', 'request_id': 'req-d0f71276-4fa0-47d4-ad9d-694ed0533318'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:15.035506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d0f71276-4fa0-47d4-ad9d-694ed0533318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bfb48a14cc647499c7d6ffbee602d5a', 'request_id': 'req-d0f71276-4fa0-47d4-ad9d-694ed0533318'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:15.042502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d0f71276-4fa0-47d4-ad9d-694ed0533318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bfb48a14cc647499c7d6ffbee602d5a', 'request_id': 'req-d0f71276-4fa0-47d4-ad9d-694ed0533318'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:15.078244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d0f71276-4fa0-47d4-ad9d-694ed0533318 admin admin] The token cache is being invalidate because project 7bfb48a14cc647499c7d6ffbee602d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:15.078709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d0f71276-4fa0-47d4-ad9d-694ed0533318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:15.080252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d0f71276-4fa0-47d4-ad9d-694ed0533318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:15.082481 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3866/7732] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:14 2022] DELETE /identity/v3/projects/7bfb48a14cc647499c7d6ffbee602d5a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:15.087988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643f592-afb0-47dc-9603-a80eeffe7a65 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:15.088279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643f592-afb0-47dc-9603-a80eeffe7a65 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:15.088559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643f592-afb0-47dc-9603-a80eeffe7a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:15.109641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9643f592-afb0-47dc-9603-a80eeffe7a65 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:15.110893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9643f592-afb0-47dc-9603-a80eeffe7a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:15.174857 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3867/7733] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:15.182315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90077d-74cd-4261-a4d3-a8ad629eb2e3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:15.182605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90077d-74cd-4261-a4d3-a8ad629eb2e3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:15.182917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90077d-74cd-4261-a4d3-a8ad629eb2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:15.203000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0f90077d-74cd-4261-a4d3-a8ad629eb2e3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:15.204198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0f90077d-74cd-4261-a4d3-a8ad629eb2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:15.213145 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3867/7734] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:15.217159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643f592-afb0-47dc-9603-a80eeffe7a65 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:15.228012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643f592-afb0-47dc-9603-a80eeffe7a65 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:15.232541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fafd0-968f-474a-820d-a98d20403616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:15.233148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fafd0-968f-474a-820d-a98d20403616 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:15.233426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fafd0-968f-474a-820d-a98d20403616 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:15.233700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fafd0-968f-474a-820d-a98d20403616 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:15.234342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fafd0-968f-474a-820d-a98d20403616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:15.234639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fafd0-968f-474a-820d-a98d20403616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:15.236282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fafd0-968f-474a-820d-a98d20403616 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:15.248915 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3868/7735] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:15.253153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90077d-74cd-4261-a4d3-a8ad629eb2e3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:15.263196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90077d-74cd-4261-a4d3-a8ad629eb2e3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:15.268973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc2b5-613b-40bb-be46-49ebcad6ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:15.269850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc2b5-613b-40bb-be46-49ebcad6ba43 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:15.270163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc2b5-613b-40bb-be46-49ebcad6ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:15.270515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc2b5-613b-40bb-be46-49ebcad6ba43 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:15.271230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afc2b5-613b-40bb-be46-49ebcad6ba43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:15.273423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afc2b5-613b-40bb-be46-49ebcad6ba43 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:15.307764 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3868/7736] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:15 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:15.312133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fafd0-968f-474a-820d-a98d20403616 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:15.323243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fafd0-968f-474a-820d-a98d20403616 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:15.387979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3dbc0-e1a3-4d2d-a540-8d86d11daf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:15.388733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3dbc0-e1a3-4d2d-a540-8d86d11daf9f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:15.389034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3dbc0-e1a3-4d2d-a540-8d86d11daf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:15.389368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3dbc0-e1a3-4d2d-a540-8d86d11daf9f admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:15.390025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3dbc0-e1a3-4d2d-a540-8d86d11daf9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:15.392257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3dbc0-e1a3-4d2d-a540-8d86d11daf9f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:15.417218 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3869/7737] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:15 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:15.421549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc2b5-613b-40bb-be46-49ebcad6ba43 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:15.432786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc2b5-613b-40bb-be46-49ebcad6ba43 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:15.437671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52a955-f542-412a-bc02-da8783c882ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:15.438279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52a955-f542-412a-bc02-da8783c882ef admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:15.438563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52a955-f542-412a-bc02-da8783c882ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:15.438879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52a955-f542-412a-bc02-da8783c882ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:15.439529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52a955-f542-412a-bc02-da8783c882ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:15.441124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52a955-f542-412a-bc02-da8783c882ef admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:15.456377 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3869/7738] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:33:15.457796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3dbc0-e1a3-4d2d-a540-8d86d11daf9f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:15.468911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3dbc0-e1a3-4d2d-a540-8d86d11daf9f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:15.474410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea839cab-2672-44de-a9b1-9aa24fcebbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:15.475051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea839cab-2672-44de-a9b1-9aa24fcebbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:15.475339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea839cab-2672-44de-a9b1-9aa24fcebbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:15.475623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea839cab-2672-44de-a9b1-9aa24fcebbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:15.476299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea839cab-2672-44de-a9b1-9aa24fcebbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:15.478213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea839cab-2672-44de-a9b1-9aa24fcebbf9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:15.490539 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3870/7739] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:33:15.495061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52a955-f542-412a-bc02-da8783c882ef admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:15.505605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52a955-f542-412a-bc02-da8783c882ef admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:15.511470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b04303-3091-4136-a53e-8b900c7b8fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:15.512127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b04303-3091-4136-a53e-8b900c7b8fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:15.512408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b04303-3091-4136-a53e-8b900c7b8fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:15.512684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b04303-3091-4136-a53e-8b900c7b8fd6 admin admin] PATH_INFO: `/v3/projects/01529dc9bcfd4f608f1232df1193272f/users/45fea31b887b48fcade349fdd794bdce/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:15.529470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b04303-3091-4136-a53e-8b900c7b8fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01529dc9bcfd4f608f1232df1193272f, user_id=45fea31b887b48fcade349fdd794bdce, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:15.532217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b04303-3091-4136-a53e-8b900c7b8fd6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:15.545749 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3870/7740] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:15 2022] PUT /identity/v3/projects/01529dc9bcfd4f608f1232df1193272f/users/45fea31b887b48fcade349fdd794bdce/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:15.557397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3808eb-1911-44dc-8c9a-6f4062cc344c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:15.557797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3808eb-1911-44dc-8c9a-6f4062cc344c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:15.558147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3808eb-1911-44dc-8c9a-6f4062cc344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:15.589912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4b3808eb-1911-44dc-8c9a-6f4062cc344c None None] MFA Rules not processed for user `45fea31b887b48fcade349fdd794bdce`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:15.591341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4b3808eb-1911-44dc-8c9a-6f4062cc344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:15.639784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:15.671229 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3871/7741] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:15.676224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b04303-3091-4136-a53e-8b900c7b8fd6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:15.696285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:15.748476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b04303-3091-4136-a53e-8b900c7b8fd6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:15.753848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48250a-3e65-4d51-b892-d045681cb1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:15.754463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48250a-3e65-4d51-b892-d045681cb1fb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:15.754761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48250a-3e65-4d51-b892-d045681cb1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:15.755054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48250a-3e65-4d51-b892-d045681cb1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:15.755849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48250a-3e65-4d51-b892-d045681cb1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:15.758279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48250a-3e65-4d51-b892-d045681cb1fb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:15.792549 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3871/7742] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:15 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:15.796505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3808eb-1911-44dc-8c9a-6f4062cc344c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:15.809177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3808eb-1911-44dc-8c9a-6f4062cc344c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:15.872957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184eadc-34ca-4542-a008-ec8a7faeea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:15.873614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184eadc-34ca-4542-a008-ec8a7faeea91 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:15.873933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184eadc-34ca-4542-a008-ec8a7faeea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:15.874214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184eadc-34ca-4542-a008-ec8a7faeea91 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:15.874959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184eadc-34ca-4542-a008-ec8a7faeea91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:15.877074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184eadc-34ca-4542-a008-ec8a7faeea91 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:15.901011 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3872/7743] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:15 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:15.905012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48250a-3e65-4d51-b892-d045681cb1fb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:15.917945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48250a-3e65-4d51-b892-d045681cb1fb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:15.922858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b61cc2-bd8a-4a43-abc4-0b8a1a2a3908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:15.923469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61cc2-bd8a-4a43-abc4-0b8a1a2a3908 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:15.923764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61cc2-bd8a-4a43-abc4-0b8a1a2a3908 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:15.924074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61cc2-bd8a-4a43-abc4-0b8a1a2a3908 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:15.924729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b61cc2-bd8a-4a43-abc4-0b8a1a2a3908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:15.926341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b61cc2-bd8a-4a43-abc4-0b8a1a2a3908 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:15.940762 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3872/7744] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:15.945064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184eadc-34ca-4542-a008-ec8a7faeea91 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:15.956405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184eadc-34ca-4542-a008-ec8a7faeea91 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:15.961134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe617d-4306-4141-8a68-278f263389d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:15.961882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe617d-4306-4141-8a68-278f263389d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:15.962169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe617d-4306-4141-8a68-278f263389d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:15.962450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe617d-4306-4141-8a68-278f263389d2 admin admin] PATH_INFO: `/v3/projects/5724d617259241f88590a82d683322e3/users/eb80b7762f1a403c9378d34534f9cb57/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:15.979131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe617d-4306-4141-8a68-278f263389d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5724d617259241f88590a82d683322e3, user_id=eb80b7762f1a403c9378d34534f9cb57, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:15.981857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe617d-4306-4141-8a68-278f263389d2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:15.998831 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3873/7745] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:15 2022] PUT /identity/v3/projects/5724d617259241f88590a82d683322e3/users/eb80b7762f1a403c9378d34534f9cb57/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:16.002954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b61cc2-bd8a-4a43-abc4-0b8a1a2a3908 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:16.014781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b61cc2-bd8a-4a43-abc4-0b8a1a2a3908 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:16.076357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87713385-382a-4935-b608-d293ccc884e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:16.076971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87713385-382a-4935-b608-d293ccc884e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.077250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87713385-382a-4935-b608-d293ccc884e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.077518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87713385-382a-4935-b608-d293ccc884e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.078181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87713385-382a-4935-b608-d293ccc884e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:16.079801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87713385-382a-4935-b608-d293ccc884e4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:16.092708 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3873/7746] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:16.096726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe617d-4306-4141-8a68-278f263389d2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:16.108060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe617d-4306-4141-8a68-278f263389d2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:16.115198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cbc94-5057-45b7-96f8-80cf6312f60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:16.115888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cbc94-5057-45b7-96f8-80cf6312f60c admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.116173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cbc94-5057-45b7-96f8-80cf6312f60c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.116452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cbc94-5057-45b7-96f8-80cf6312f60c admin admin] PATH_INFO: `/v3/projects/5724d617259241f88590a82d683322e3/users/eb80b7762f1a403c9378d34534f9cb57/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.119074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cbc94-5057-45b7-96f8-80cf6312f60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5724d617259241f88590a82d683322e3, user_id=eb80b7762f1a403c9378d34534f9cb57, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:16.122764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cbc94-5057-45b7-96f8-80cf6312f60c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:16.134756 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3874/7747] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:16 2022] PUT /identity/v3/projects/5724d617259241f88590a82d683322e3/users/eb80b7762f1a403c9378d34534f9cb57/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:16.144784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012e860-5d92-42f8-9cd8-bfdc13e855ed None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.145074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012e860-5d92-42f8-9cd8-bfdc13e855ed None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.145351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012e860-5d92-42f8-9cd8-bfdc13e855ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.175847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2012e860-5d92-42f8-9cd8-bfdc13e855ed None None] MFA Rules not processed for user `eb80b7762f1a403c9378d34534f9cb57`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:16.177449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2012e860-5d92-42f8-9cd8-bfdc13e855ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:16.253570 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3874/7748] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:16.259046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cbc94-5057-45b7-96f8-80cf6312f60c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:16.271142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cbc94-5057-45b7-96f8-80cf6312f60c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:16.276415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ed32e-9040-44a9-ac28-dcf5daa359ca tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:16.277066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ed32e-9040-44a9-ac28-dcf5daa359ca tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.277355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ed32e-9040-44a9-ac28-dcf5daa359ca tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.277632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ed32e-9040-44a9-ac28-dcf5daa359ca tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.278294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ed32e-9040-44a9-ac28-dcf5daa359ca tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:16.280267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ed32e-9040-44a9-ac28-dcf5daa359ca tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:16.336894 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3875/7749] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:16 2022] POST /identity/v3/projects => generated 359 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:16.342364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012e860-5d92-42f8-9cd8-bfdc13e855ed None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:16.357158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012e860-5d92-42f8-9cd8-bfdc13e855ed None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:16.365534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:16.424630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e773af-6514-4df4-bf60-bf755d4f2249 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:16.425298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e773af-6514-4df4-bf60-bf755d4f2249 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.425590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e773af-6514-4df4-bf60-bf755d4f2249 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.425865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e773af-6514-4df4-bf60-bf755d4f2249 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.426505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e773af-6514-4df4-bf60-bf755d4f2249 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:16.428432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e773af-6514-4df4-bf60-bf755d4f2249 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:16.455858 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3875/7750] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:16 2022] POST /identity/v3/users => generated 413 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:16.460306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ed32e-9040-44a9-ac28-dcf5daa359ca tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:16.473055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ed32e-9040-44a9-ac28-dcf5daa359ca tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:16.479212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4eb8f-fde8-4892-b409-59b5321762fb tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:16.479882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4eb8f-fde8-4892-b409-59b5321762fb tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.480174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4eb8f-fde8-4892-b409-59b5321762fb tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.480452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4eb8f-fde8-4892-b409-59b5321762fb tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/users/304200a8c5ac4ea381c9d9b172cad553` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.496162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4eb8f-fde8-4892-b409-59b5321762fb tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:get_user(user_id=304200a8c5ac4ea381c9d9b172cad553)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:16.498439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4eb8f-fde8-4892-b409-59b5321762fb tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:16.500411 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3876/7751] 10.222.0.70 () {58 vars in 1221 bytes} [Sun Aug 28 19:33:16 2022] GET /identity/v3/users/304200a8c5ac4ea381c9d9b172cad553 => generated 413 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:16.504873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e773af-6514-4df4-bf60-bf755d4f2249 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:16.516480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e773af-6514-4df4-bf60-bf755d4f2249 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:16.521519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e74db-5694-4a32-9cbe-71bbb8438a07 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:16.522135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e74db-5694-4a32-9cbe-71bbb8438a07 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.522424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e74db-5694-4a32-9cbe-71bbb8438a07 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.522732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e74db-5694-4a32-9cbe-71bbb8438a07 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/users/304200a8c5ac4ea381c9d9b172cad553` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.524621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e74db-5694-4a32-9cbe-71bbb8438a07 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_user(user_id=304200a8c5ac4ea381c9d9b172cad553)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:16.527148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e74db-5694-4a32-9cbe-71bbb8438a07 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:16.577694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0e4e74db-5694-4a32-9cbe-71bbb8438a07 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304200a8c5ac4ea381c9d9b172cad553'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:16.585117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0e4e74db-5694-4a32-9cbe-71bbb8438a07 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304200a8c5ac4ea381c9d9b172cad553'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:16.585916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0e4e74db-5694-4a32-9cbe-71bbb8438a07 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304200a8c5ac4ea381c9d9b172cad553'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:16.594999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0e4e74db-5694-4a32-9cbe-71bbb8438a07 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304200a8c5ac4ea381c9d9b172cad553'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:16.595705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0e4e74db-5694-4a32-9cbe-71bbb8438a07 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304200a8c5ac4ea381c9d9b172cad553'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:16.614667 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3876/7752] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:16 2022] DELETE /identity/v3/users/304200a8c5ac4ea381c9d9b172cad553 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:16.618804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4eb8f-fde8-4892-b409-59b5321762fb tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:16.620850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-92e4eb8f-fde8-4892-b409-59b5321762fb tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:16.635432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4eb8f-fde8-4892-b409-59b5321762fb tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:16.692771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:16.702238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:16.702924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.703207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.703483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/97f0c5bd130d4eedb04975839fa133ce` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.704653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=97f0c5bd130d4eedb04975839fa133ce)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:16.706665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:16.759664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f0c5bd130d4eedb04975839fa133ce', 'request_id': 'req-f0d65f50-9931-466d-a991-11e60c3f101e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:16.767994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f0c5bd130d4eedb04975839fa133ce', 'request_id': 'req-f0d65f50-9931-466d-a991-11e60c3f101e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:16.775755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f0c5bd130d4eedb04975839fa133ce', 'request_id': 'req-f0d65f50-9931-466d-a991-11e60c3f101e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:16.787576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project 97f0c5bd130d4eedb04975839fa133ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:16.787876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:16.788647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:16.791295 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3877/7753] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:16 2022] DELETE /identity/v3/projects/97f0c5bd130d4eedb04975839fa133ce => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:16.796269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e74db-5694-4a32-9cbe-71bbb8438a07 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:16.810612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e74db-5694-4a32-9cbe-71bbb8438a07 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:16.879044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db27a74-77a2-4d9c-b21a-3252054d7ead tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:16.879684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27a74-77a2-4d9c-b21a-3252054d7ead tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.879952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27a74-77a2-4d9c-b21a-3252054d7ead tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.880245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27a74-77a2-4d9c-b21a-3252054d7ead tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.880988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db27a74-77a2-4d9c-b21a-3252054d7ead tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:16.883210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db27a74-77a2-4d9c-b21a-3252054d7ead tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:16.906229 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3877/7754] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:16 2022] POST /identity/v3/projects => generated 349 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:16.907877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:16.909305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:16.923549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d65f50-9931-466d-a991-11e60c3f101e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:16.985776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27c118-4c8b-4c81-bc76-af04f11806fd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:16.986416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27c118-4c8b-4c81-bc76-af04f11806fd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:16.986694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27c118-4c8b-4c81-bc76-af04f11806fd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:16.987015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27c118-4c8b-4c81-bc76-af04f11806fd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:16.987688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27c118-4c8b-4c81-bc76-af04f11806fd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:16.988001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27c118-4c8b-4c81-bc76-af04f11806fd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:16.989862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27c118-4c8b-4c81-bc76-af04f11806fd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:17.005840 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3878/7755] 10.222.0.70 () {58 vars in 1160 bytes} [Sun Aug 28 19:33:16 2022] GET /identity/v3/projects?is_domain=True => generated 1021 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:17.007280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db27a74-77a2-4d9c-b21a-3252054d7ead tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.020227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db27a74-77a2-4d9c-b21a-3252054d7ead tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.025670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be84e3-b5ed-4dd3-81ae-388acfc621c6 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.026284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be84e3-b5ed-4dd3-81ae-388acfc621c6 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.026570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be84e3-b5ed-4dd3-81ae-388acfc621c6 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.026880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be84e3-b5ed-4dd3-81ae-388acfc621c6 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.027510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be84e3-b5ed-4dd3-81ae-388acfc621c6 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.029155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be84e3-b5ed-4dd3-81ae-388acfc621c6 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:17.030883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:17.048335 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3878/7756] 10.222.0.70 () {58 vars in 1128 bytes} [Sun Aug 28 19:33:17 2022] GET /identity/v3/domains => generated 830 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:17.049666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27c118-4c8b-4c81-bc76-af04f11806fd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.060461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27c118-4c8b-4c81-bc76-af04f11806fd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.065627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527cee5-6368-4e8b-913a-30a28bedc3c9 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.066342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527cee5-6368-4e8b-913a-30a28bedc3c9 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.066697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527cee5-6368-4e8b-913a-30a28bedc3c9 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.067097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527cee5-6368-4e8b-913a-30a28bedc3c9 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/31fba4064b8f4e6da050e995f035d9fb` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.068420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527cee5-6368-4e8b-913a-30a28bedc3c9 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:update_project(project_id=31fba4064b8f4e6da050e995f035d9fb)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.069462 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-7527cee5-6368-4e8b-913a-30a28bedc3c9 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:33:17.069462 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:33:17.069462 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:33:17.070480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527cee5-6368-4e8b-913a-30a28bedc3c9 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:17.084190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7527cee5-6368-4e8b-913a-30a28bedc3c9 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '31fba4064b8f4e6da050e995f035d9fb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.084918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7527cee5-6368-4e8b-913a-30a28bedc3c9 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '31fba4064b8f4e6da050e995f035d9fb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.112538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7527cee5-6368-4e8b-913a-30a28bedc3c9 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '31fba4064b8f4e6da050e995f035d9fb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.113231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7527cee5-6368-4e8b-913a-30a28bedc3c9 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '31fba4064b8f4e6da050e995f035d9fb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.115924 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3879/7757] 10.222.0.70 () {60 vars in 1252 bytes} [Sun Aug 28 19:33:17 2022] PATCH /identity/v3/projects/31fba4064b8f4e6da050e995f035d9fb => generated 363 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:17.121300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be84e3-b5ed-4dd3-81ae-388acfc621c6 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.123296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-09be84e3-b5ed-4dd3-81ae-388acfc621c6 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:17.139460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be84e3-b5ed-4dd3-81ae-388acfc621c6 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.202356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.203035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.203326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.203601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/31fba4064b8f4e6da050e995f035d9fb` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.215307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=31fba4064b8f4e6da050e995f035d9fb)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.217083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:17.269048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '31fba4064b8f4e6da050e995f035d9fb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.274359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '31fba4064b8f4e6da050e995f035d9fb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.369685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31fba4064b8f4e6da050e995f035d9fb', 'request_id': 'req-6fe19ab2-6066-470d-bcf3-c2ae90dda942'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.375397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31fba4064b8f4e6da050e995f035d9fb', 'request_id': 'req-6fe19ab2-6066-470d-bcf3-c2ae90dda942'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.382839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31fba4064b8f4e6da050e995f035d9fb', 'request_id': 'req-6fe19ab2-6066-470d-bcf3-c2ae90dda942'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.397457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project 31fba4064b8f4e6da050e995f035d9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:17.397751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.398412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.406380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '31fba4064b8f4e6da050e995f035d9fb', 'request_id': 'req-6fe19ab2-6066-470d-bcf3-c2ae90dda942'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.407204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '31fba4064b8f4e6da050e995f035d9fb', 'request_id': 'req-6fe19ab2-6066-470d-bcf3-c2ae90dda942'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.410796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '31fba4064b8f4e6da050e995f035d9fb', 'request_id': 'req-6fe19ab2-6066-470d-bcf3-c2ae90dda942'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.418653 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3879/7758] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:17 2022] DELETE /identity/v3/projects/31fba4064b8f4e6da050e995f035d9fb => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:17.423813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527cee5-6368-4e8b-913a-30a28bedc3c9 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.435146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527cee5-6368-4e8b-913a-30a28bedc3c9 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.486151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:17.503343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f0876-a7ec-4886-90c1-9d65fb0398ec tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.504020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f0876-a7ec-4886-90c1-9d65fb0398ec tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.504582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f0876-a7ec-4886-90c1-9d65fb0398ec tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.504864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f0876-a7ec-4886-90c1-9d65fb0398ec tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.505504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f0876-a7ec-4886-90c1-9d65fb0398ec tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.507666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f0876-a7ec-4886-90c1-9d65fb0398ec tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:17.541563 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3880/7759] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:17 2022] POST /identity/v3/projects => generated 359 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:17.545522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.546936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:17.561346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe19ab2-6066-470d-bcf3-c2ae90dda942 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.597653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:17.628470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0499b8-44c3-4df2-bbba-243858b003da tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.629112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0499b8-44c3-4df2-bbba-243858b003da tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.629397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0499b8-44c3-4df2-bbba-243858b003da tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.629789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0499b8-44c3-4df2-bbba-243858b003da tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/3a48baf6daae49b58dc4cc1b074bebba` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.630853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0499b8-44c3-4df2-bbba-243858b003da tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:get_project(project_id=3a48baf6daae49b58dc4cc1b074bebba)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.633212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0499b8-44c3-4df2-bbba-243858b003da tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:17.638456 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3880/7760] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:33:17 2022] GET /identity/v3/projects/3a48baf6daae49b58dc4cc1b074bebba => generated 359 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:17.639892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f0876-a7ec-4886-90c1-9d65fb0398ec tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.652052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f0876-a7ec-4886-90c1-9d65fb0398ec tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.656691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.657328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.657613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.657893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/3a48baf6daae49b58dc4cc1b074bebba` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.659066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3a48baf6daae49b58dc4cc1b074bebba)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.661141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:17.713932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a48baf6daae49b58dc4cc1b074bebba', 'request_id': 'req-70210320-d68c-41d8-b84e-aa6bae4cdd8b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.722244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a48baf6daae49b58dc4cc1b074bebba', 'request_id': 'req-70210320-d68c-41d8-b84e-aa6bae4cdd8b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.728413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a48baf6daae49b58dc4cc1b074bebba', 'request_id': 'req-70210320-d68c-41d8-b84e-aa6bae4cdd8b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.740590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project 3a48baf6daae49b58dc4cc1b074bebba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:17.740878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.741632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:17.743359 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3881/7761] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:17 2022] DELETE /identity/v3/projects/3a48baf6daae49b58dc4cc1b074bebba => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:17.748437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0499b8-44c3-4df2-bbba-243858b003da tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.750143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bb0499b8-44c3-4df2-bbba-243858b003da tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:17.763668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0499b8-44c3-4df2-bbba-243858b003da tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.821376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479a907-a759-480d-84ba-a9db19e654ff tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.822161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479a907-a759-480d-84ba-a9db19e654ff tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.822450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479a907-a759-480d-84ba-a9db19e654ff tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.822730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479a907-a759-480d-84ba-a9db19e654ff tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.823438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479a907-a759-480d-84ba-a9db19e654ff tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.825805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479a907-a759-480d-84ba-a9db19e654ff tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:17.860267 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3881/7762] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:17 2022] POST /identity/v3/projects => generated 360 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:17.864304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.875515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70210320-d68c-41d8-b84e-aa6bae4cdd8b tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.938930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868e797-a8c0-4e72-a17e-5d57d4eaf681 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.939599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868e797-a8c0-4e72-a17e-5d57d4eaf681 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.939886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868e797-a8c0-4e72-a17e-5d57d4eaf681 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.940166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868e797-a8c0-4e72-a17e-5d57d4eaf681 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/01fca78d7f344b9e90dce6ef29b5789e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.941302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868e797-a8c0-4e72-a17e-5d57d4eaf681 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:get_project(project_id=01fca78d7f344b9e90dce6ef29b5789e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.943396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868e797-a8c0-4e72-a17e-5d57d4eaf681 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:17.948769 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3882/7763] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:33:17 2022] GET /identity/v3/projects/01fca78d7f344b9e90dce6ef29b5789e => generated 360 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:17.950173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479a907-a759-480d-84ba-a9db19e654ff tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:17.961545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479a907-a759-480d-84ba-a9db19e654ff tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:17.966638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:17.967301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:17.967593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:17.967873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/01fca78d7f344b9e90dce6ef29b5789e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:17.969015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=01fca78d7f344b9e90dce6ef29b5789e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:17.971143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.019589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01fca78d7f344b9e90dce6ef29b5789e', 'request_id': 'req-d6816b9e-9a54-4f99-985e-b6c03b953d88'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.025673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01fca78d7f344b9e90dce6ef29b5789e', 'request_id': 'req-d6816b9e-9a54-4f99-985e-b6c03b953d88'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.032575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01fca78d7f344b9e90dce6ef29b5789e', 'request_id': 'req-d6816b9e-9a54-4f99-985e-b6c03b953d88'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.046395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project 01fca78d7f344b9e90dce6ef29b5789e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:18.046702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.047518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.049133 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3882/7764] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:17 2022] DELETE /identity/v3/projects/01fca78d7f344b9e90dce6ef29b5789e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:18.054366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868e797-a8c0-4e72-a17e-5d57d4eaf681 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.057471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d868e797-a8c0-4e72-a17e-5d57d4eaf681 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:18.072224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868e797-a8c0-4e72-a17e-5d57d4eaf681 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:18.131924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:18.139228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731b4bf-7f34-4822-a8ee-8c38fc75829e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:18.139968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731b4bf-7f34-4822-a8ee-8c38fc75829e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:18.140427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731b4bf-7f34-4822-a8ee-8c38fc75829e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:18.140865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731b4bf-7f34-4822-a8ee-8c38fc75829e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:18.142282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731b4bf-7f34-4822-a8ee-8c38fc75829e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:18.146078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731b4bf-7f34-4822-a8ee-8c38fc75829e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.183086 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3883/7765] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:33:18 2022] POST /identity/v3/projects => generated 348 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:18.187103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.197758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6816b9e-9a54-4f99-985e-b6c03b953d88 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:18.248250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:18.267079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09c717-888d-4365-bfe3-dd2ac68705d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:18.267711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09c717-888d-4365-bfe3-dd2ac68705d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:18.267993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09c717-888d-4365-bfe3-dd2ac68705d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:18.268269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09c717-888d-4365-bfe3-dd2ac68705d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/c8220924052640d2b8b48b36f56a6f4c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:18.269517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09c717-888d-4365-bfe3-dd2ac68705d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:get_project(project_id=c8220924052640d2b8b48b36f56a6f4c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:18.271597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09c717-888d-4365-bfe3-dd2ac68705d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.273286 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3883/7766] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:33:18 2022] GET /identity/v3/projects/c8220924052640d2b8b48b36f56a6f4c => generated 348 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:18.278178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731b4bf-7f34-4822-a8ee-8c38fc75829e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.290337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731b4bf-7f34-4822-a8ee-8c38fc75829e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:18.295388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:18.296018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:18.296300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:18.296576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/c8220924052640d2b8b48b36f56a6f4c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:18.297708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c8220924052640d2b8b48b36f56a6f4c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:18.299904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.350350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8220924052640d2b8b48b36f56a6f4c', 'request_id': 'req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.358360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8220924052640d2b8b48b36f56a6f4c', 'request_id': 'req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.364619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8220924052640d2b8b48b36f56a6f4c', 'request_id': 'req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.377363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project c8220924052640d2b8b48b36f56a6f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:18.377648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.378537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.380472 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3884/7767] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:18 2022] DELETE /identity/v3/projects/c8220924052640d2b8b48b36f56a6f4c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:18.386411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09c717-888d-4365-bfe3-dd2ac68705d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.388417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4a09c717-888d-4365-bfe3-dd2ac68705d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:18.404072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09c717-888d-4365-bfe3-dd2ac68705d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:18.468328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ad43f-3002-41cb-a988-60f100544a66 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:18.468946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ad43f-3002-41cb-a988-60f100544a66 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:18.469255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ad43f-3002-41cb-a988-60f100544a66 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:18.469536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ad43f-3002-41cb-a988-60f100544a66 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:18.470218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ad43f-3002-41cb-a988-60f100544a66 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:18.471858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ad43f-3002-41cb-a988-60f100544a66 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.487908 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3884/7768] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:33:18 2022] POST /identity/v3/domains => generated 275 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:18.492110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.502533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af6a06-0fa3-4eef-8093-f923d47eb8d2 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:18.561862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614c461-f8b5-442f-a851-e3dc71322bc3 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:18.562905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614c461-f8b5-442f-a851-e3dc71322bc3 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:18.563494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614c461-f8b5-442f-a851-e3dc71322bc3 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:18.563935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614c461-f8b5-442f-a851-e3dc71322bc3 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:18.564999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614c461-f8b5-442f-a851-e3dc71322bc3 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:18.567141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614c461-f8b5-442f-a851-e3dc71322bc3 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.610364 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3885/7769] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:18 2022] POST /identity/v3/projects => generated 404 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:18.611665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ad43f-3002-41cb-a988-60f100544a66 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.622344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ad43f-3002-41cb-a988-60f100544a66 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:18.681196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a8fef-f641-42c4-af2c-666ea4937ea4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:18.681854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8fef-f641-42c4-af2c-666ea4937ea4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:18.682138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8fef-f641-42c4-af2c-666ea4937ea4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:18.682416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8fef-f641-42c4-af2c-666ea4937ea4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/2f346f3574df4e5584646a3702d2e9ed` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:18.683678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a8fef-f641-42c4-af2c-666ea4937ea4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:get_project(project_id=2f346f3574df4e5584646a3702d2e9ed)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:18.685790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a8fef-f641-42c4-af2c-666ea4937ea4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.687522 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3885/7770] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:33:18 2022] GET /identity/v3/projects/2f346f3574df4e5584646a3702d2e9ed => generated 404 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:18.691959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614c461-f8b5-442f-a851-e3dc71322bc3 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.704622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614c461-f8b5-442f-a851-e3dc71322bc3 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:18.711267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:18.712084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:18.712379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:18.712733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/2f346f3574df4e5584646a3702d2e9ed` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:18.713969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2f346f3574df4e5584646a3702d2e9ed)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:18.715977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.757814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:18.769679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f346f3574df4e5584646a3702d2e9ed', 'request_id': 'req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.778163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f346f3574df4e5584646a3702d2e9ed', 'request_id': 'req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.784073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f346f3574df4e5584646a3702d2e9ed', 'request_id': 'req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.795800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project 2f346f3574df4e5584646a3702d2e9ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:18.796099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.796896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.798422 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3886/7771] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:18 2022] DELETE /identity/v3/projects/2f346f3574df4e5584646a3702d2e9ed => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:18.802671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a8fef-f641-42c4-af2c-666ea4937ea4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.804466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b64a8fef-f641-42c4-af2c-666ea4937ea4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:18.817990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a8fef-f641-42c4-af2c-666ea4937ea4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:18.880182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a666abd-1c3e-464e-8624-5bdecb1671a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:18.880815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a666abd-1c3e-464e-8624-5bdecb1671a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:18.881101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a666abd-1c3e-464e-8624-5bdecb1671a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:18.881374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a666abd-1c3e-464e-8624-5bdecb1671a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/domains/44a78caac64e46ffa04d97f1df3c2649` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:18.882899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a666abd-1c3e-464e-8624-5bdecb1671a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=44a78caac64e46ffa04d97f1df3c2649)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:18.885147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a666abd-1c3e-464e-8624-5bdecb1671a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:18.906818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7a666abd-1c3e-464e-8624-5bdecb1671a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '44a78caac64e46ffa04d97f1df3c2649'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.907585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7a666abd-1c3e-464e-8624-5bdecb1671a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '44a78caac64e46ffa04d97f1df3c2649'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.914015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:18.937287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7a666abd-1c3e-464e-8624-5bdecb1671a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '44a78caac64e46ffa04d97f1df3c2649'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.938136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7a666abd-1c3e-464e-8624-5bdecb1671a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '44a78caac64e46ffa04d97f1df3c2649'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:18.944529 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3886/7772] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:33:18 2022] PATCH /identity/v3/domains/44a78caac64e46ffa04d97f1df3c2649 => generated 276 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:18.946839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:18.959423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b8b80-a52e-4b45-bcc3-5a2e9a5b45a5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:19.023890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:19.024471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:19.024776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:19.025051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/domains/44a78caac64e46ffa04d97f1df3c2649` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:19.035864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=44a78caac64e46ffa04d97f1df3c2649)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:19.037536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:19.061034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '44a78caac64e46ffa04d97f1df3c2649'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.064399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '44a78caac64e46ffa04d97f1df3c2649'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.114046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a78caac64e46ffa04d97f1df3c2649', 'request_id': 'req-b37fee51-e1e1-4818-808f-65543477119a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.122485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a78caac64e46ffa04d97f1df3c2649', 'request_id': 'req-b37fee51-e1e1-4818-808f-65543477119a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.128131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a78caac64e46ffa04d97f1df3c2649', 'request_id': 'req-b37fee51-e1e1-4818-808f-65543477119a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.140187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project 44a78caac64e46ffa04d97f1df3c2649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:19.140481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.141154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.148718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '44a78caac64e46ffa04d97f1df3c2649', 'request_id': 'req-b37fee51-e1e1-4818-808f-65543477119a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.152213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '44a78caac64e46ffa04d97f1df3c2649', 'request_id': 'req-b37fee51-e1e1-4818-808f-65543477119a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.152878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '44a78caac64e46ffa04d97f1df3c2649', 'request_id': 'req-b37fee51-e1e1-4818-808f-65543477119a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.158502 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3887/7773] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:33:18 2022] DELETE /identity/v3/domains/44a78caac64e46ffa04d97f1df3c2649 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:19.163767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a666abd-1c3e-464e-8624-5bdecb1671a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:19.165680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7a666abd-1c3e-464e-8624-5bdecb1671a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:19.179157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a666abd-1c3e-464e-8624-5bdecb1671a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:19.239920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8280025-5601-4b80-a894-64846d50cffd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:19.240542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8280025-5601-4b80-a894-64846d50cffd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:19.240826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8280025-5601-4b80-a894-64846d50cffd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:19.241106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8280025-5601-4b80-a894-64846d50cffd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:19.241875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8280025-5601-4b80-a894-64846d50cffd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:19.244735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8280025-5601-4b80-a894-64846d50cffd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:19.265977 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3887/7774] 10.222.0.70 () {60 vars in 1149 bytes} [Sun Aug 28 19:33:19 2022] POST /identity/v3/domains => generated 276 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:19.270351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:19.271969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:19.281260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:19.288124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fee51-e1e1-4818-808f-65543477119a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:19.360422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fc3bd-de52-4cc7-88a7-4f2e7960d7c4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:19.361850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fc3bd-de52-4cc7-88a7-4f2e7960d7c4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:19.362378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fc3bd-de52-4cc7-88a7-4f2e7960d7c4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:19.363262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fc3bd-de52-4cc7-88a7-4f2e7960d7c4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:19.365787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fc3bd-de52-4cc7-88a7-4f2e7960d7c4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:19.367814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fc3bd-de52-4cc7-88a7-4f2e7960d7c4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:19.413377 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3888/7775] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:19 2022] POST /identity/v3/projects => generated 409 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:19.414912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8280025-5601-4b80-a894-64846d50cffd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:19.426929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8280025-5601-4b80-a894-64846d50cffd tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:19.490671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1251f7-3578-47bc-b902-5b9748d41ca0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:19.491341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1251f7-3578-47bc-b902-5b9748d41ca0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:19.491630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1251f7-3578-47bc-b902-5b9748d41ca0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:19.491911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1251f7-3578-47bc-b902-5b9748d41ca0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:19.492564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1251f7-3578-47bc-b902-5b9748d41ca0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:19.495218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1251f7-3578-47bc-b902-5b9748d41ca0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:19.532791 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3888/7776] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:19 2022] POST /identity/v3/projects => generated 404 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:19.536992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fc3bd-de52-4cc7-88a7-4f2e7960d7c4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:19.547966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fc3bd-de52-4cc7-88a7-4f2e7960d7c4 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:19.612593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:19.613237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:19.613523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:19.613803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/9bd790677bc640eb9914efdf4bb21cd9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:19.614982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9bd790677bc640eb9914efdf4bb21cd9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:19.616961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:19.665486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bd790677bc640eb9914efdf4bb21cd9', 'request_id': 'req-0c59879c-5110-45b0-8fa6-828b4d21fb78'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.673666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bd790677bc640eb9914efdf4bb21cd9', 'request_id': 'req-0c59879c-5110-45b0-8fa6-828b4d21fb78'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.680767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bd790677bc640eb9914efdf4bb21cd9', 'request_id': 'req-0c59879c-5110-45b0-8fa6-828b4d21fb78'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.691899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project 9bd790677bc640eb9914efdf4bb21cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:19.692190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.692945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.694448 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3889/7777] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:19 2022] DELETE /identity/v3/projects/9bd790677bc640eb9914efdf4bb21cd9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:19.698670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1251f7-3578-47bc-b902-5b9748d41ca0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:19.700497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9c1251f7-3578-47bc-b902-5b9748d41ca0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:19.714159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1251f7-3578-47bc-b902-5b9748d41ca0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:19.770626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:19.771298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:19.771581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:19.771854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/724a1f9605324c20b745286a589e50d6` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:19.772982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=724a1f9605324c20b745286a589e50d6)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:19.775695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:19.777211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:19.824597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724a1f9605324c20b745286a589e50d6', 'request_id': 'req-472a1f4a-efa7-4c47-8a09-df23c4611f91'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.829979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724a1f9605324c20b745286a589e50d6', 'request_id': 'req-472a1f4a-efa7-4c47-8a09-df23c4611f91'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.836244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724a1f9605324c20b745286a589e50d6', 'request_id': 'req-472a1f4a-efa7-4c47-8a09-df23c4611f91'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.849568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project 724a1f9605324c20b745286a589e50d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:19.849857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.850494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.852441 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3889/7778] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:19 2022] DELETE /identity/v3/projects/724a1f9605324c20b745286a589e50d6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:19.856408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:19.866655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59879c-5110-45b0-8fa6-828b4d21fb78 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:19.872692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:19.929623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3883fe-7900-4066-8327-32fcaff39a7e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:19.930286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3883fe-7900-4066-8327-32fcaff39a7e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:19.930570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3883fe-7900-4066-8327-32fcaff39a7e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:19.931055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3883fe-7900-4066-8327-32fcaff39a7e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/domains/a891c782235840858dd9243b8a850ea5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:19.932439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3883fe-7900-4066-8327-32fcaff39a7e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a891c782235840858dd9243b8a850ea5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:19.934670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3883fe-7900-4066-8327-32fcaff39a7e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:19.956333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cf3883fe-7900-4066-8327-32fcaff39a7e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a891c782235840858dd9243b8a850ea5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.957043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cf3883fe-7900-4066-8327-32fcaff39a7e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a891c782235840858dd9243b8a850ea5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.982684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cf3883fe-7900-4066-8327-32fcaff39a7e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a891c782235840858dd9243b8a850ea5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.983333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cf3883fe-7900-4066-8327-32fcaff39a7e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a891c782235840858dd9243b8a850ea5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:19.987473 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3890/7779] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:33:19 2022] PATCH /identity/v3/domains/a891c782235840858dd9243b8a850ea5 => generated 277 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:19.989883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:19.991283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:20.004399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a1f4a-efa7-4c47-8a09-df23c4611f91 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:20.079137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:20.079790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:20.080071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:20.080346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/domains/a891c782235840858dd9243b8a850ea5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:20.097456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a891c782235840858dd9243b8a850ea5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:20.099239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:20.122961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a891c782235840858dd9243b8a850ea5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.126017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a891c782235840858dd9243b8a850ea5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.176903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a891c782235840858dd9243b8a850ea5', 'request_id': 'req-64895750-3687-47a4-a9ad-603ab4cbd202'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.183484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a891c782235840858dd9243b8a850ea5', 'request_id': 'req-64895750-3687-47a4-a9ad-603ab4cbd202'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.184698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:20.192845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a891c782235840858dd9243b8a850ea5', 'request_id': 'req-64895750-3687-47a4-a9ad-603ab4cbd202'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.206402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project a891c782235840858dd9243b8a850ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:20.206969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.207766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.215742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a891c782235840858dd9243b8a850ea5', 'request_id': 'req-64895750-3687-47a4-a9ad-603ab4cbd202'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.216614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a891c782235840858dd9243b8a850ea5', 'request_id': 'req-64895750-3687-47a4-a9ad-603ab4cbd202'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.220021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a891c782235840858dd9243b8a850ea5', 'request_id': 'req-64895750-3687-47a4-a9ad-603ab4cbd202'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.226324 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3890/7780] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:33:19 2022] DELETE /identity/v3/domains/a891c782235840858dd9243b8a850ea5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:20.231583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3883fe-7900-4066-8327-32fcaff39a7e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:20.233041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cf3883fe-7900-4066-8327-32fcaff39a7e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:20.246909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3883fe-7900-4066-8327-32fcaff39a7e tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:20.304746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384902f-393b-4be5-b168-9b3171ce579f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:20.305882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384902f-393b-4be5-b168-9b3171ce579f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:20.306164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384902f-393b-4be5-b168-9b3171ce579f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:20.306438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384902f-393b-4be5-b168-9b3171ce579f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:20.307112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384902f-393b-4be5-b168-9b3171ce579f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:20.309099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384902f-393b-4be5-b168-9b3171ce579f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:20.347314 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3891/7781] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:20 2022] POST /identity/v3/projects => generated 378 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:20.348404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:20.351164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:20.364437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64895750-3687-47a4-a9ad-603ab4cbd202 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:20.424786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f0ff8-f40d-4523-be54-72e0b605c94a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:20.425446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0ff8-f40d-4523-be54-72e0b605c94a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:20.425713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0ff8-f40d-4523-be54-72e0b605c94a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:20.425994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f0ff8-f40d-4523-be54-72e0b605c94a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/0ac02a691b42454694031a7e48b113f8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:20.427197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f0ff8-f40d-4523-be54-72e0b605c94a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:get_project(project_id=0ac02a691b42454694031a7e48b113f8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:20.429362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f0ff8-f40d-4523-be54-72e0b605c94a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:20.434861 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3891/7782] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:33:20 2022] GET /identity/v3/projects/0ac02a691b42454694031a7e48b113f8 => generated 378 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:33:20.436344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384902f-393b-4be5-b168-9b3171ce579f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:20.448169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384902f-393b-4be5-b168-9b3171ce579f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:20.453128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770516d0-8805-43c5-bf73-7e3e498a77a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:20.453776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770516d0-8805-43c5-bf73-7e3e498a77a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:20.454064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770516d0-8805-43c5-bf73-7e3e498a77a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:20.454339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770516d0-8805-43c5-bf73-7e3e498a77a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:20.455068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770516d0-8805-43c5-bf73-7e3e498a77a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:20.457105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770516d0-8805-43c5-bf73-7e3e498a77a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:20.475674 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3892/7783] 10.222.0.70 () {58 vars in 1131 bytes} [Sun Aug 28 19:33:20 2022] GET /identity/v3/projects => generated 5496 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:20.480090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f0ff8-f40d-4523-be54-72e0b605c94a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:20.490102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f0ff8-f40d-4523-be54-72e0b605c94a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:20.495439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:20.496065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:20.496348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:20.496625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/0ac02a691b42454694031a7e48b113f8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:20.498052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ac02a691b42454694031a7e48b113f8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:20.499723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:20.554943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac02a691b42454694031a7e48b113f8', 'request_id': 'req-25f732e4-d44c-4509-8583-cf841feb7393'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.561852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac02a691b42454694031a7e48b113f8', 'request_id': 'req-25f732e4-d44c-4509-8583-cf841feb7393'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.568248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac02a691b42454694031a7e48b113f8', 'request_id': 'req-25f732e4-d44c-4509-8583-cf841feb7393'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.585926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project 0ac02a691b42454694031a7e48b113f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:20.586225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.587604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.589146 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3892/7784] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:20 2022] DELETE /identity/v3/projects/0ac02a691b42454694031a7e48b113f8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:20.594345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770516d0-8805-43c5-bf73-7e3e498a77a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:20.596402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-770516d0-8805-43c5-bf73-7e3e498a77a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:20.609750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770516d0-8805-43c5-bf73-7e3e498a77a0 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:20.658140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:20.675393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc6847-70c2-4a90-a1f8-60c9e522d45f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:20.676051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc6847-70c2-4a90-a1f8-60c9e522d45f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:20.676336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc6847-70c2-4a90-a1f8-60c9e522d45f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:20.676614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc6847-70c2-4a90-a1f8-60c9e522d45f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:20.677249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc6847-70c2-4a90-a1f8-60c9e522d45f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:20.679187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc6847-70c2-4a90-a1f8-60c9e522d45f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:20.716101 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3893/7785] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:33:20 2022] POST /identity/v3/projects => generated 347 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:20.717473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:20.728643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f732e4-d44c-4509-8583-cf841feb7393 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:20.779204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:20.793030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeab9f4-506f-4d38-997f-631aa4750b18 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:20.793676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeab9f4-506f-4d38-997f-631aa4750b18 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:20.793964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeab9f4-506f-4d38-997f-631aa4750b18 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:20.794242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeab9f4-506f-4d38-997f-631aa4750b18 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/68787c3ef07349f9817e4911656c71b3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:20.795530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeab9f4-506f-4d38-997f-631aa4750b18 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:update_project(project_id=68787c3ef07349f9817e4911656c71b3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:20.796628 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-fbeab9f4-506f-4d38-997f-631aa4750b18 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:33:20.796628 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:33:20.796628 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:33:20.797850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeab9f4-506f-4d38-997f-631aa4750b18 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:20.839885 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3893/7786] 10.222.0.70 () {60 vars in 1252 bytes} [Sun Aug 28 19:33:20 2022] PATCH /identity/v3/projects/68787c3ef07349f9817e4911656c71b3 => generated 361 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:33:20.843925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc6847-70c2-4a90-a1f8-60c9e522d45f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:20.855012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc6847-70c2-4a90-a1f8-60c9e522d45f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:20.860373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a126ac0-4f80-45e4-831d-3a3e42328eb7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:20.861158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a126ac0-4f80-45e4-831d-3a3e42328eb7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:20.861517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a126ac0-4f80-45e4-831d-3a3e42328eb7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:20.861805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a126ac0-4f80-45e4-831d-3a3e42328eb7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/68787c3ef07349f9817e4911656c71b3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:20.874460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a126ac0-4f80-45e4-831d-3a3e42328eb7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:get_project(project_id=68787c3ef07349f9817e4911656c71b3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:20.876948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a126ac0-4f80-45e4-831d-3a3e42328eb7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:20.878595 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3894/7787] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:33:20 2022] GET /identity/v3/projects/68787c3ef07349f9817e4911656c71b3 => generated 348 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:20.882976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeab9f4-506f-4d38-997f-631aa4750b18 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:20.895126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeab9f4-506f-4d38-997f-631aa4750b18 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:20.900977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:20.901791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:20.902166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:20.902545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/68787c3ef07349f9817e4911656c71b3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:20.903830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=68787c3ef07349f9817e4911656c71b3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:20.906311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:20.956808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68787c3ef07349f9817e4911656c71b3', 'request_id': 'req-29808f2c-7cd9-42a6-9156-cf296c805c74'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.962974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68787c3ef07349f9817e4911656c71b3', 'request_id': 'req-29808f2c-7cd9-42a6-9156-cf296c805c74'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.969450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68787c3ef07349f9817e4911656c71b3', 'request_id': 'req-29808f2c-7cd9-42a6-9156-cf296c805c74'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.982919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project 68787c3ef07349f9817e4911656c71b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:20.983216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.983884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:20.985438 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3894/7788] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:20 2022] DELETE /identity/v3/projects/68787c3ef07349f9817e4911656c71b3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:20.990721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a126ac0-4f80-45e4-831d-3a3e42328eb7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:20.993203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7a126ac0-4f80-45e4-831d-3a3e42328eb7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:21.007433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a126ac0-4f80-45e4-831d-3a3e42328eb7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:21.067974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da16225-0690-47f8-b65f-33f00e76ec81 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:21.068797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da16225-0690-47f8-b65f-33f00e76ec81 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:21.069105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da16225-0690-47f8-b65f-33f00e76ec81 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:21.069449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da16225-0690-47f8-b65f-33f00e76ec81 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:21.070178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da16225-0690-47f8-b65f-33f00e76ec81 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:21.072788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da16225-0690-47f8-b65f-33f00e76ec81 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:21.106158 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3895/7789] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:20 2022] POST /identity/v3/projects => generated 359 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:21.110300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:21.122206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29808f2c-7cd9-42a6-9156-cf296c805c74 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:21.197042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c1757-270d-4f20-b17a-5cbef3ca4462 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:21.197807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c1757-270d-4f20-b17a-5cbef3ca4462 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:21.198145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c1757-270d-4f20-b17a-5cbef3ca4462 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:21.198268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c1757-270d-4f20-b17a-5cbef3ca4462 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/d51b32b262274d869f7c6d97a1b98a57` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:21.199516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c1757-270d-4f20-b17a-5cbef3ca4462 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:update_project(project_id=d51b32b262274d869f7c6d97a1b98a57)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:21.201444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c1757-270d-4f20-b17a-5cbef3ca4462 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:21.254598 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3895/7790] 10.222.0.70 () {60 vars in 1252 bytes} [Sun Aug 28 19:33:21 2022] PATCH /identity/v3/projects/d51b32b262274d869f7c6d97a1b98a57 => generated 371 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:21.259800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da16225-0690-47f8-b65f-33f00e76ec81 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:21.270394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da16225-0690-47f8-b65f-33f00e76ec81 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:21.275437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ad106-97c5-4998-9323-595c56d419cc tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:21.276056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ad106-97c5-4998-9323-595c56d419cc tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:21.276344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ad106-97c5-4998-9323-595c56d419cc tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:21.276614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ad106-97c5-4998-9323-595c56d419cc tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/d51b32b262274d869f7c6d97a1b98a57` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:21.289954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ad106-97c5-4998-9323-595c56d419cc tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:get_project(project_id=d51b32b262274d869f7c6d97a1b98a57)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:21.292205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ad106-97c5-4998-9323-595c56d419cc tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:21.293899 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3896/7791] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:33:21 2022] GET /identity/v3/projects/d51b32b262274d869f7c6d97a1b98a57 => generated 358 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:33:21.298016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c1757-270d-4f20-b17a-5cbef3ca4462 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:21.309535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c1757-270d-4f20-b17a-5cbef3ca4462 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:21.314353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:21.315012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:21.315296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:21.315574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/d51b32b262274d869f7c6d97a1b98a57` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:21.316704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d51b32b262274d869f7c6d97a1b98a57)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:21.318704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:21.329885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:21.373575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51b32b262274d869f7c6d97a1b98a57', 'request_id': 'req-d7aaf2b3-0b0d-4255-8666-72108471a439'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:21.380630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51b32b262274d869f7c6d97a1b98a57', 'request_id': 'req-d7aaf2b3-0b0d-4255-8666-72108471a439'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:21.391662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51b32b262274d869f7c6d97a1b98a57', 'request_id': 'req-d7aaf2b3-0b0d-4255-8666-72108471a439'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:21.405453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project d51b32b262274d869f7c6d97a1b98a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:21.405747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:21.406420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:21.407964 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3896/7792] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:21 2022] DELETE /identity/v3/projects/d51b32b262274d869f7c6d97a1b98a57 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:21.413069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ad106-97c5-4998-9323-595c56d419cc tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:21.415978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-237ad106-97c5-4998-9323-595c56d419cc tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:21.429570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ad106-97c5-4998-9323-595c56d419cc tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:21.488666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a6e4-30ad-4b9c-8b9b-43f3f0cdd2e5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:21.489179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a6e4-30ad-4b9c-8b9b-43f3f0cdd2e5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:21.489465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a6e4-30ad-4b9c-8b9b-43f3f0cdd2e5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:21.489743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a6e4-30ad-4b9c-8b9b-43f3f0cdd2e5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:21.490399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1a6e4-30ad-4b9c-8b9b-43f3f0cdd2e5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:21.492372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1a6e4-30ad-4b9c-8b9b-43f3f0cdd2e5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:21.529447 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3897/7793] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:21 2022] POST /identity/v3/projects => generated 354 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:21.530862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:21.542045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaf2b3-0b0d-4255-8666-72108471a439 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:21.609774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed302b-aafc-4343-9867-5a83e2cf8b65 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:21.610450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed302b-aafc-4343-9867-5a83e2cf8b65 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:21.610764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed302b-aafc-4343-9867-5a83e2cf8b65 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:21.611056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed302b-aafc-4343-9867-5a83e2cf8b65 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/6fc97898a50942b28b536d2bdd1b3c9c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:21.612284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed302b-aafc-4343-9867-5a83e2cf8b65 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:update_project(project_id=6fc97898a50942b28b536d2bdd1b3c9c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:21.614207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed302b-aafc-4343-9867-5a83e2cf8b65 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:21.650502 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3897/7794] 10.222.0.70 () {60 vars in 1252 bytes} [Sun Aug 28 19:33:21 2022] PATCH /identity/v3/projects/6fc97898a50942b28b536d2bdd1b3c9c => generated 368 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:33:21.655078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a6e4-30ad-4b9c-8b9b-43f3f0cdd2e5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:21.667228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a6e4-30ad-4b9c-8b9b-43f3f0cdd2e5 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:21.672149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767e435-279c-4dca-a9b6-34e7f48b0566 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:21.672892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767e435-279c-4dca-a9b6-34e7f48b0566 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:21.673251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767e435-279c-4dca-a9b6-34e7f48b0566 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:21.673614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767e435-279c-4dca-a9b6-34e7f48b0566 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/6fc97898a50942b28b536d2bdd1b3c9c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:21.683777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:21.686615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767e435-279c-4dca-a9b6-34e7f48b0566 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:get_project(project_id=6fc97898a50942b28b536d2bdd1b3c9c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:21.689685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767e435-279c-4dca-a9b6-34e7f48b0566 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:21.692225 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3898/7795] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:33:21 2022] GET /identity/v3/projects/6fc97898a50942b28b536d2bdd1b3c9c => generated 355 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:33:21.696042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed302b-aafc-4343-9867-5a83e2cf8b65 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:21.706243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed302b-aafc-4343-9867-5a83e2cf8b65 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:21.711041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:21.712258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:21.712583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:21.712824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/projects/6fc97898a50942b28b536d2bdd1b3c9c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:21.713968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6fc97898a50942b28b536d2bdd1b3c9c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:21.716035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:21.783514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc97898a50942b28b536d2bdd1b3c9c', 'request_id': 'req-670cddaa-e2fc-4777-9be4-2f4e02c017d7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:21.794897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc97898a50942b28b536d2bdd1b3c9c', 'request_id': 'req-670cddaa-e2fc-4777-9be4-2f4e02c017d7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:21.803063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc97898a50942b28b536d2bdd1b3c9c', 'request_id': 'req-670cddaa-e2fc-4777-9be4-2f4e02c017d7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:21.817717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:21.822542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] The token cache is being invalidate because project 6fc97898a50942b28b536d2bdd1b3c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:21.823103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:21.824341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:21.826446 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3898/7796] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:21 2022] DELETE /identity/v3/projects/6fc97898a50942b28b536d2bdd1b3c9c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:21.832797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767e435-279c-4dca-a9b6-34e7f48b0566 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:21.836121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0767e435-279c-4dca-a9b6-34e7f48b0566 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:21.854495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767e435-279c-4dca-a9b6-34e7f48b0566 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:21.941447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aeaa2-9cce-4311-8cff-54920582df8a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:21.942251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aeaa2-9cce-4311-8cff-54920582df8a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:21.942534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aeaa2-9cce-4311-8cff-54920582df8a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:21.942870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aeaa2-9cce-4311-8cff-54920582df8a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/domains/a891c782235840858dd9243b8a850ea5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:21.952796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aeaa2-9cce-4311-8cff-54920582df8a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-9e1aeaa2-9cce-4311-8cff-54920582df8a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Could not find domain: a891c782235840858dd9243b8a850ea5.: keystone.exception.DomainNotFound: Could not find domain: a891c782235840858dd9243b8a850ea5. Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a891c782235840858dd9243b8a850ea5. Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:21.958293 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:21.959892 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a891c782235840858dd9243b8a850ea5. Aug 28 19:33:21.961077 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:33:21.962935 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3899/7797] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:33:21 2022] PATCH /identity/v3/domains/a891c782235840858dd9243b8a850ea5 => generated 112 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:33:21.965170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:21.976525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670cddaa-e2fc-4777-9be4-2f4e02c017d7 tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:21.983952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ade66-7c7c-46aa-85ec-658540683a2f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb80b7762f1a403c9378d34534f9cb57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5724d617259241f88590a82d683322e3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:21.984619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ade66-7c7c-46aa-85ec-658540683a2f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:21.985105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ade66-7c7c-46aa-85ec-658540683a2f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:21.985586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ade66-7c7c-46aa-85ec-658540683a2f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] PATH_INFO: `/v3/domains/44a78caac64e46ffa04d97f1df3c2649` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:21.994944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ade66-7c7c-46aa-85ec-658540683a2f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-fb5ade66-7c7c-46aa-85ec-658540683a2f tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Could not find domain: 44a78caac64e46ffa04d97f1df3c2649.: keystone.exception.DomainNotFound: Could not find domain: 44a78caac64e46ffa04d97f1df3c2649. Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 44a78caac64e46ffa04d97f1df3c2649. Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:33:22.000360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:33:22.001417 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 44a78caac64e46ffa04d97f1df3c2649. Aug 28 19:33:22.002815 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:33:22.003727 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3899/7798] 10.222.0.70 () {60 vars in 1249 bytes} [Sun Aug 28 19:33:21 2022] PATCH /identity/v3/domains/44a78caac64e46ffa04d97f1df3c2649 => generated 112 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 19:33:22.006113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aeaa2-9cce-4311-8cff-54920582df8a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:22.008566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9e1aeaa2-9cce-4311-8cff-54920582df8a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:22.119419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aeaa2-9cce-4311-8cff-54920582df8a tempest-ProjectsTestJSON-615781266 tempest-ProjectsTestJSON-615781266-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:22.126785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:22.127470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:22.128369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:22.128660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] PATH_INFO: `/v3/users/45fea31b887b48fcade349fdd794bdce` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:22.131171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] RBAC: Authorizing `identity:delete_user(user_id=45fea31b887b48fcade349fdd794bdce)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:22.134206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:22.216051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45fea31b887b48fcade349fdd794bdce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:22.229020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45fea31b887b48fcade349fdd794bdce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:22.229908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45fea31b887b48fcade349fdd794bdce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:22.244247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45fea31b887b48fcade349fdd794bdce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:22.245141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45fea31b887b48fcade349fdd794bdce'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:22.261388 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3900/7799] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:22 2022] DELETE /identity/v3/users/45fea31b887b48fcade349fdd794bdce => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:22.267916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6ff5a-a2dc-4a89-9fc3-ec07450cca65 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:22.267916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6ff5a-a2dc-4a89-9fc3-ec07450cca65 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:22.268314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6ff5a-a2dc-4a89-9fc3-ec07450cca65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:22.289036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7fc6ff5a-a2dc-4a89-9fc3-ec07450cca65 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:22.290409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7fc6ff5a-a2dc-4a89-9fc3-ec07450cca65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:22.352721 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3900/7800] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:22.362717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:22.364333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:22.385652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:22.428800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857f7ea-f82b-45dd-9d15-b868b2a6f90d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:22.432578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb90e5-6dde-4346-b53f-3440924fcd50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:22.433194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb90e5-6dde-4346-b53f-3440924fcd50 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:22.433478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb90e5-6dde-4346-b53f-3440924fcd50 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:22.433753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb90e5-6dde-4346-b53f-3440924fcd50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:22.443247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb90e5-6dde-4346-b53f-3440924fcd50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:22.444687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb90e5-6dde-4346-b53f-3440924fcd50 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:22.454656 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3901/7801] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:22.732749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6ff5a-a2dc-4a89-9fc3-ec07450cca65 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:22.734395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7fc6ff5a-a2dc-4a89-9fc3-ec07450cca65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:22.762444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6ff5a-a2dc-4a89-9fc3-ec07450cca65 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:22.767234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:22.767869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:22.768151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:22.768437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31 admin admin] PATH_INFO: `/v3/projects/01529dc9bcfd4f608f1232df1193272f` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:22.769540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01529dc9bcfd4f608f1232df1193272f)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:22.771749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:22.822206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01529dc9bcfd4f608f1232df1193272f', 'request_id': 'req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:22.828558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01529dc9bcfd4f608f1232df1193272f', 'request_id': 'req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:22.835496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01529dc9bcfd4f608f1232df1193272f', 'request_id': 'req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:22.851163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31 admin admin] The token cache is being invalidate because project 01529dc9bcfd4f608f1232df1193272f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:22.851456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:22.853276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9d7c96f0-f75c-441d-9ea3-e45a69a5fe31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:22.854941 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3901/7802] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:22 2022] DELETE /identity/v3/projects/01529dc9bcfd4f608f1232df1193272f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:22.859171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb90e5-6dde-4346-b53f-3440924fcd50 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:22.870971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb90e5-6dde-4346-b53f-3440924fcd50 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:22.930998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:22.931640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:22.931920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:22.932189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] PATH_INFO: `/v3/users/eb80b7762f1a403c9378d34534f9cb57` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:22.933332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb80b7762f1a403c9378d34534f9cb57)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:22.935307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:22.982795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb80b7762f1a403c9378d34534f9cb57'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:22.989763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb80b7762f1a403c9378d34534f9cb57'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:22.990453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb80b7762f1a403c9378d34534f9cb57'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:23.003349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb80b7762f1a403c9378d34534f9cb57'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:23.004032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb80b7762f1a403c9378d34534f9cb57'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:23.018496 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3902/7803] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:22 2022] DELETE /identity/v3/users/eb80b7762f1a403c9378d34534f9cb57 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:23.300009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be7163-5ba9-4b42-a8b6-91e8f852ccf1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:23.300304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be7163-5ba9-4b42-a8b6-91e8f852ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:23.300579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be7163-5ba9-4b42-a8b6-91e8f852ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:23.306577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:23.308106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:23.320432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c6be7163-5ba9-4b42-a8b6-91e8f852ccf1 None None] MFA Rules not processed for user `30add6fc24b34085b5eaac8df54c424f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:23.322160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c6be7163-5ba9-4b42-a8b6-91e8f852ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:23.359374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:23.385637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c65c65-3769-4d86-b036-29f9f5afd2c0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:23.387065 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3902/7804] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:23.394496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:23.395675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:23.395675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:23.395875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d admin admin] PATH_INFO: `/v3/projects/5724d617259241f88590a82d683322e3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:23.397099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5724d617259241f88590a82d683322e3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:23.401487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:23.454195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5724d617259241f88590a82d683322e3', 'request_id': 'req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:23.462776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5724d617259241f88590a82d683322e3', 'request_id': 'req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:23.469036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5724d617259241f88590a82d683322e3', 'request_id': 'req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:23.481492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d admin admin] The token cache is being invalidate because project 5724d617259241f88590a82d683322e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:23.481929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:23.482497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1fc2f4c8-3133-448a-bf13-30a1d78e8a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:23.484316 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3903/7805] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:23 2022] DELETE /identity/v3/projects/5724d617259241f88590a82d683322e3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:23.491704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a289a5-b5b5-4783-948b-1b2599c0b43a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:23.491993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a289a5-b5b5-4783-948b-1b2599c0b43a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:23.492266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a289a5-b5b5-4783-948b-1b2599c0b43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:23.517552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-19a289a5-b5b5-4783-948b-1b2599c0b43a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:23.518846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-19a289a5-b5b5-4783-948b-1b2599c0b43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:23.532533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:23.598370 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3903/7806] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:23.600141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30bee0-f358-41b3-a70a-aee99127105b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:23.600427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30bee0-f358-41b3-a70a-aee99127105b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:23.600701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30bee0-f358-41b3-a70a-aee99127105b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:23.620593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ef30bee0-f358-41b3-a70a-aee99127105b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:23.621806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ef30bee0-f358-41b3-a70a-aee99127105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:23.630153 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3904/7807] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:23.635596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a289a5-b5b5-4783-948b-1b2599c0b43a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:23.645901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a289a5-b5b5-4783-948b-1b2599c0b43a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:23.651250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53590b11-060a-4bd5-9fd3-7a87773b0b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:23.652240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53590b11-060a-4bd5-9fd3-7a87773b0b52 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:23.652527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53590b11-060a-4bd5-9fd3-7a87773b0b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:23.652803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53590b11-060a-4bd5-9fd3-7a87773b0b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:23.653454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53590b11-060a-4bd5-9fd3-7a87773b0b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:23.653761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53590b11-060a-4bd5-9fd3-7a87773b0b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:23.655389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53590b11-060a-4bd5-9fd3-7a87773b0b52 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:23.671638 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3904/7808] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:23.673049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30bee0-f358-41b3-a70a-aee99127105b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:23.683778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30bee0-f358-41b3-a70a-aee99127105b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:23.688547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338132b9-e753-48c0-a1a9-0af133ee9c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:23.689182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338132b9-e753-48c0-a1a9-0af133ee9c11 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:23.689465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338132b9-e753-48c0-a1a9-0af133ee9c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:23.689737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338132b9-e753-48c0-a1a9-0af133ee9c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:23.690385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338132b9-e753-48c0-a1a9-0af133ee9c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:23.692323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338132b9-e753-48c0-a1a9-0af133ee9c11 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:23.721742 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3905/7809] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:23 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:23.725919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53590b11-060a-4bd5-9fd3-7a87773b0b52 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:23.736146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53590b11-060a-4bd5-9fd3-7a87773b0b52 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:23.795892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea75af-a415-4dbe-86c0-d3e1599e1ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:23.796592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea75af-a415-4dbe-86c0-d3e1599e1ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:23.796879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea75af-a415-4dbe-86c0-d3e1599e1ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:23.797158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea75af-a415-4dbe-86c0-d3e1599e1ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:23.797822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea75af-a415-4dbe-86c0-d3e1599e1ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:23.799936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea75af-a415-4dbe-86c0-d3e1599e1ef0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:23.823237 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3905/7810] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:23 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:23.827323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338132b9-e753-48c0-a1a9-0af133ee9c11 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:23.838307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338132b9-e753-48c0-a1a9-0af133ee9c11 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:23.843217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1589560-c7ec-4d67-ad16-9e453efa4836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:23.843945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1589560-c7ec-4d67-ad16-9e453efa4836 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:23.844326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1589560-c7ec-4d67-ad16-9e453efa4836 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:23.844701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1589560-c7ec-4d67-ad16-9e453efa4836 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:23.845445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1589560-c7ec-4d67-ad16-9e453efa4836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:23.847224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1589560-c7ec-4d67-ad16-9e453efa4836 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:23.861340 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3906/7811] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:23.863244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea75af-a415-4dbe-86c0-d3e1599e1ef0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:23.873745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea75af-a415-4dbe-86c0-d3e1599e1ef0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:23.878643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11de16-a719-4040-83d4-9aa1d0d72f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:23.879333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11de16-a719-4040-83d4-9aa1d0d72f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:23.879622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11de16-a719-4040-83d4-9aa1d0d72f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:23.879899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11de16-a719-4040-83d4-9aa1d0d72f8e admin admin] PATH_INFO: `/v3/projects/852c2306f4064934b5dcb866d0c4d66e/users/9a5cad76829d470ab9009fc239165efe/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:23.897590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11de16-a719-4040-83d4-9aa1d0d72f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=852c2306f4064934b5dcb866d0c4d66e, user_id=9a5cad76829d470ab9009fc239165efe, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:23.901955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11de16-a719-4040-83d4-9aa1d0d72f8e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:23.916287 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3906/7812] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:23 2022] PUT /identity/v3/projects/852c2306f4064934b5dcb866d0c4d66e/users/9a5cad76829d470ab9009fc239165efe/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:23.920219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1589560-c7ec-4d67-ad16-9e453efa4836 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:23.930792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1589560-c7ec-4d67-ad16-9e453efa4836 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:23.988453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd27623-6443-4461-9cb9-68f51956a4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:23.989130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd27623-6443-4461-9cb9-68f51956a4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:23.989409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd27623-6443-4461-9cb9-68f51956a4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:23.989685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd27623-6443-4461-9cb9-68f51956a4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:23.990317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd27623-6443-4461-9cb9-68f51956a4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:23.991936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd27623-6443-4461-9cb9-68f51956a4c9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:24.005941 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3907/7813] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:24.008043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11de16-a719-4040-83d4-9aa1d0d72f8e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:24.020117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11de16-a719-4040-83d4-9aa1d0d72f8e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:24.025737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef121f-d6dd-41c7-8fbd-22d9228f08b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:24.026396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef121f-d6dd-41c7-8fbd-22d9228f08b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:24.026686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef121f-d6dd-41c7-8fbd-22d9228f08b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:24.026987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef121f-d6dd-41c7-8fbd-22d9228f08b9 admin admin] PATH_INFO: `/v3/projects/852c2306f4064934b5dcb866d0c4d66e/users/9a5cad76829d470ab9009fc239165efe/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:24.028919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef121f-d6dd-41c7-8fbd-22d9228f08b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852c2306f4064934b5dcb866d0c4d66e, user_id=9a5cad76829d470ab9009fc239165efe, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:24.031557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef121f-d6dd-41c7-8fbd-22d9228f08b9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:24.043137 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3907/7814] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:24 2022] PUT /identity/v3/projects/852c2306f4064934b5dcb866d0c4d66e/users/9a5cad76829d470ab9009fc239165efe/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:24.056320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e73a5-ee88-4b1a-b1cc-9dfdbebb0be2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:24.056612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e73a5-ee88-4b1a-b1cc-9dfdbebb0be2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:24.056937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e73a5-ee88-4b1a-b1cc-9dfdbebb0be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:24.088212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-572e73a5-ee88-4b1a-b1cc-9dfdbebb0be2 None None] MFA Rules not processed for user `9a5cad76829d470ab9009fc239165efe`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:24.089454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-572e73a5-ee88-4b1a-b1cc-9dfdbebb0be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:24.105935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:24.168530 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3908/7815] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:24.173579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef121f-d6dd-41c7-8fbd-22d9228f08b9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:24.255109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef121f-d6dd-41c7-8fbd-22d9228f08b9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:24.261080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a11089-e526-455d-b1d2-c11722fd1ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:24.261704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a11089-e526-455d-b1d2-c11722fd1ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:24.261977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a11089-e526-455d-b1d2-c11722fd1ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:24.262253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a11089-e526-455d-b1d2-c11722fd1ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:24.262946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a11089-e526-455d-b1d2-c11722fd1ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:24.265472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a11089-e526-455d-b1d2-c11722fd1ff1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:24.270795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:24.302782 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3908/7816] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:24 2022] POST /identity/v3/projects => generated 391 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:24.307140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e73a5-ee88-4b1a-b1cc-9dfdbebb0be2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:24.317993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e73a5-ee88-4b1a-b1cc-9dfdbebb0be2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:24.382359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd65da3-27f3-4aed-9c7c-593ee81fe564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:24.383050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd65da3-27f3-4aed-9c7c-593ee81fe564 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:24.383322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd65da3-27f3-4aed-9c7c-593ee81fe564 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:24.383666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd65da3-27f3-4aed-9c7c-593ee81fe564 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:24.384389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd65da3-27f3-4aed-9c7c-593ee81fe564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:24.386294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd65da3-27f3-4aed-9c7c-593ee81fe564 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:24.409935 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3909/7817] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:24 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:24.413956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a11089-e526-455d-b1d2-c11722fd1ff1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:24.427674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a11089-e526-455d-b1d2-c11722fd1ff1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:24.433309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8322ba-63a7-428b-92fa-52335e863c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:24.433921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8322ba-63a7-428b-92fa-52335e863c8b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:24.434209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8322ba-63a7-428b-92fa-52335e863c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:24.434487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8322ba-63a7-428b-92fa-52335e863c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:24.435168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8322ba-63a7-428b-92fa-52335e863c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:24.436767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8322ba-63a7-428b-92fa-52335e863c8b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:24.451205 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3909/7818] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:24.452798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd65da3-27f3-4aed-9c7c-593ee81fe564 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:24.463454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd65da3-27f3-4aed-9c7c-593ee81fe564 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:24.468178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adeff7-aff9-4b4b-bfad-eaa72e95bbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:24.468793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adeff7-aff9-4b4b-bfad-eaa72e95bbfe admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:24.469081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adeff7-aff9-4b4b-bfad-eaa72e95bbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:24.469361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adeff7-aff9-4b4b-bfad-eaa72e95bbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:24.470012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adeff7-aff9-4b4b-bfad-eaa72e95bbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:24.471655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adeff7-aff9-4b4b-bfad-eaa72e95bbfe admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:24.482561 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3910/7819] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:24.486831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8322ba-63a7-428b-92fa-52335e863c8b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:24.497810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8322ba-63a7-428b-92fa-52335e863c8b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:24.502869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491a7dc-309d-402d-8b96-90c44c9c323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:24.503568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491a7dc-309d-402d-8b96-90c44c9c323c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:24.503887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491a7dc-309d-402d-8b96-90c44c9c323c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:24.504186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491a7dc-309d-402d-8b96-90c44c9c323c admin admin] PATH_INFO: `/v3/projects/74af465ae7e24ad4a23e0702b49734cc/users/263bc4c886f34989b1439d8eea19ec82/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:24.523020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491a7dc-309d-402d-8b96-90c44c9c323c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74af465ae7e24ad4a23e0702b49734cc, user_id=263bc4c886f34989b1439d8eea19ec82, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:24.525875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491a7dc-309d-402d-8b96-90c44c9c323c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:24.540374 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3910/7820] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:24 2022] PUT /identity/v3/projects/74af465ae7e24ad4a23e0702b49734cc/users/263bc4c886f34989b1439d8eea19ec82/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:24.550661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59acfb-bcca-484d-8523-7b30a0ba7353 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:24.551016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59acfb-bcca-484d-8523-7b30a0ba7353 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:24.551302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59acfb-bcca-484d-8523-7b30a0ba7353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:24.583103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8d59acfb-bcca-484d-8523-7b30a0ba7353 None None] MFA Rules not processed for user `263bc4c886f34989b1439d8eea19ec82`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:24.584009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8d59acfb-bcca-484d-8523-7b30a0ba7353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:24.657552 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3911/7821] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:33:24.670182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491a7dc-309d-402d-8b96-90c44c9c323c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:24.671960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d491a7dc-309d-402d-8b96-90c44c9c323c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:24.750074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491a7dc-309d-402d-8b96-90c44c9c323c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:24.755246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13511f2-606c-4821-b4d5-76409faa2881 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:24.755932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13511f2-606c-4821-b4d5-76409faa2881 service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:24.756251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13511f2-606c-4821-b4d5-76409faa2881 service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:24.756627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13511f2-606c-4821-b4d5-76409faa2881 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:24.823836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13511f2-606c-4821-b4d5-76409faa2881 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:24.825292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13511f2-606c-4821-b4d5-76409faa2881 service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:24.835334 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3911/7822] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:24 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:25.692457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59acfb-bcca-484d-8523-7b30a0ba7353 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:25.721781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:25.777590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59acfb-bcca-484d-8523-7b30a0ba7353 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:25.783888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:25.784657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:25.785129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:25.785515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] PATH_INFO: `/v3/users/9a5cad76829d470ab9009fc239165efe` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:25.787105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a5cad76829d470ab9009fc239165efe)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:25.789158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:25.847633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a5cad76829d470ab9009fc239165efe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:25.856769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a5cad76829d470ab9009fc239165efe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:25.858004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a5cad76829d470ab9009fc239165efe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:25.873910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a5cad76829d470ab9009fc239165efe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:25.874978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a5cad76829d470ab9009fc239165efe'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:25.891997 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3912/7823] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:25 2022] DELETE /identity/v3/users/9a5cad76829d470ab9009fc239165efe => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:25.897089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924247ba-9e26-4942-8a2d-d83e8e6a3082 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:25.897580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924247ba-9e26-4942-8a2d-d83e8e6a3082 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:25.898099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924247ba-9e26-4942-8a2d-d83e8e6a3082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:25.943667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-924247ba-9e26-4942-8a2d-d83e8e6a3082 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:25.945393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-924247ba-9e26-4942-8a2d-d83e8e6a3082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:26.001938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:26.018883 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3912/7824] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:33:26.029576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:26.031681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:26.098505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18d9a7-d8e8-4e99-9282-dcdf15a19c11 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:26.102666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb343c76-9183-49ae-a1a9-be8a9f81704e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:26.103333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb343c76-9183-49ae-a1a9-be8a9f81704e service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:26.103623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb343c76-9183-49ae-a1a9-be8a9f81704e service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:26.103907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb343c76-9183-49ae-a1a9-be8a9f81704e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:26.114441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb343c76-9183-49ae-a1a9-be8a9f81704e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:26.116721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb343c76-9183-49ae-a1a9-be8a9f81704e service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:26.128668 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3913/7825] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:26.541614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924247ba-9e26-4942-8a2d-d83e8e6a3082 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:26.543359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-924247ba-9e26-4942-8a2d-d83e8e6a3082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:26.577481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924247ba-9e26-4942-8a2d-d83e8e6a3082 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:26.604064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:26.605463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:26.605969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:26.606445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] PATH_INFO: `/v3/projects/852c2306f4064934b5dcb866d0c4d66e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:26.608470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852c2306f4064934b5dcb866d0c4d66e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:26.613543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:26.713849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852c2306f4064934b5dcb866d0c4d66e', 'request_id': 'req-2411083a-21b6-40dc-8b51-1003d4bce6f5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:26.732230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852c2306f4064934b5dcb866d0c4d66e', 'request_id': 'req-2411083a-21b6-40dc-8b51-1003d4bce6f5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:26.746711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852c2306f4064934b5dcb866d0c4d66e', 'request_id': 'req-2411083a-21b6-40dc-8b51-1003d4bce6f5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:26.767240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] The token cache is being invalidate because project 852c2306f4064934b5dcb866d0c4d66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:26.767967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:26.768908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:26.770722 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3913/7826] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:26 2022] DELETE /identity/v3/projects/852c2306f4064934b5dcb866d0c4d66e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:26.775931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb343c76-9183-49ae-a1a9-be8a9f81704e service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:26.788932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb343c76-9183-49ae-a1a9-be8a9f81704e service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:26.844495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:26.874916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:26.875746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:26.876030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:26.876336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] PATH_INFO: `/v3/users/263bc4c886f34989b1439d8eea19ec82` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:26.878950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] RBAC: Authorizing `identity:delete_user(user_id=263bc4c886f34989b1439d8eea19ec82)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:26.880902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:26.962474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '263bc4c886f34989b1439d8eea19ec82'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:26.970836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:26.973541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:26.976996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '263bc4c886f34989b1439d8eea19ec82'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:26.977833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '263bc4c886f34989b1439d8eea19ec82'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:26.996048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '263bc4c886f34989b1439d8eea19ec82'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:26.997750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '263bc4c886f34989b1439d8eea19ec82'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:27.022775 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3914/7827] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:26 2022] DELETE /identity/v3/users/263bc4c886f34989b1439d8eea19ec82 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:27.062264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411083a-21b6-40dc-8b51-1003d4bce6f5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:27.145353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b423f8-44fa-4997-a2e7-487bc4545d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:27.146888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b423f8-44fa-4997-a2e7-487bc4545d40 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:27.147333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b423f8-44fa-4997-a2e7-487bc4545d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:27.147761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b423f8-44fa-4997-a2e7-487bc4545d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:27.152453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f5b423f8-44fa-4997-a2e7-487bc4545d40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:27.173909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b423f8-44fa-4997-a2e7-487bc4545d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:27.175422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b423f8-44fa-4997-a2e7-487bc4545d40 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:27.188845 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3914/7828] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:27.347291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:27.349367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:27.448545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b423f8-44fa-4997-a2e7-487bc4545d40 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:27.450412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f5b423f8-44fa-4997-a2e7-487bc4545d40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:27.551049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea908445-453d-4593-8f05-892719ef626a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:27.558136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6e630-92ea-4b22-9586-9dce78f81f4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:27.558773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6e630-92ea-4b22-9586-9dce78f81f4e service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:27.559069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6e630-92ea-4b22-9586-9dce78f81f4e service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:27.559346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6e630-92ea-4b22-9586-9dce78f81f4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:27.564166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e6c6e630-92ea-4b22-9586-9dce78f81f4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:27.566242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:27.596940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6e630-92ea-4b22-9586-9dce78f81f4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:27.599071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6e630-92ea-4b22-9586-9dce78f81f4e service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:27.619457 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3915/7829] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:27.620342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6e630-92ea-4b22-9586-9dce78f81f4e service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:27.625716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e6c6e630-92ea-4b22-9586-9dce78f81f4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:27.643438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b423f8-44fa-4997-a2e7-487bc4545d40 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:27.658102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd1254-822b-42f3-9e07-616daf4dc205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:27.658787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd1254-822b-42f3-9e07-616daf4dc205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:27.659054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd1254-822b-42f3-9e07-616daf4dc205 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:27.659329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd1254-822b-42f3-9e07-616daf4dc205 admin admin] PATH_INFO: `/v3/projects/74af465ae7e24ad4a23e0702b49734cc` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:27.661933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd1254-822b-42f3-9e07-616daf4dc205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74af465ae7e24ad4a23e0702b49734cc)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:27.663892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd1254-822b-42f3-9e07-616daf4dc205 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:27.735709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:27.759913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-47bd1254-822b-42f3-9e07-616daf4dc205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74af465ae7e24ad4a23e0702b49734cc', 'request_id': 'req-47bd1254-822b-42f3-9e07-616daf4dc205'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:27.777579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-47bd1254-822b-42f3-9e07-616daf4dc205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74af465ae7e24ad4a23e0702b49734cc', 'request_id': 'req-47bd1254-822b-42f3-9e07-616daf4dc205'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:27.777890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6e630-92ea-4b22-9586-9dce78f81f4e service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:27.794981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-47bd1254-822b-42f3-9e07-616daf4dc205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74af465ae7e24ad4a23e0702b49734cc', 'request_id': 'req-47bd1254-822b-42f3-9e07-616daf4dc205'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:27.824433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-47bd1254-822b-42f3-9e07-616daf4dc205 admin admin] The token cache is being invalidate because project 74af465ae7e24ad4a23e0702b49734cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:27.824540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-47bd1254-822b-42f3-9e07-616daf4dc205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:27.825215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-47bd1254-822b-42f3-9e07-616daf4dc205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:27.831759 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3915/7830] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:27 2022] DELETE /identity/v3/projects/74af465ae7e24ad4a23e0702b49734cc => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:27.833274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0f0d9-38ce-4164-a308-2bc0b6a386f2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:27.833560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0f0d9-38ce-4164-a308-2bc0b6a386f2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:27.833840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0f0d9-38ce-4164-a308-2bc0b6a386f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:27.873075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c1f0f0d9-38ce-4164-a308-2bc0b6a386f2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:27.874287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c1f0f0d9-38ce-4164-a308-2bc0b6a386f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:27.897028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc90b3b-b6e5-4c57-b1f8-6bc074bba616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:27.897991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc90b3b-b6e5-4c57-b1f8-6bc074bba616 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:27.898533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc90b3b-b6e5-4c57-b1f8-6bc074bba616 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:27.898905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc90b3b-b6e5-4c57-b1f8-6bc074bba616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:27.900857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2cc90b3b-b6e5-4c57-b1f8-6bc074bba616 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:27.916906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc90b3b-b6e5-4c57-b1f8-6bc074bba616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:27.919132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc90b3b-b6e5-4c57-b1f8-6bc074bba616 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:27.947059 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3916/7831] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:27.950659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc90b3b-b6e5-4c57-b1f8-6bc074bba616 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:27.955463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2cc90b3b-b6e5-4c57-b1f8-6bc074bba616 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:27.967061 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3916/7832] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:27.976244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b0001-c12b-46a4-8848-7ad0c8198af7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:27.976916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b0001-c12b-46a4-8848-7ad0c8198af7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:27.977390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b0001-c12b-46a4-8848-7ad0c8198af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:28.001198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a10b0001-c12b-46a4-8848-7ad0c8198af7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:28.002865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a10b0001-c12b-46a4-8848-7ad0c8198af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:28.016791 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3917/7833] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:28.017926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b0001-c12b-46a4-8848-7ad0c8198af7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:28.029973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b0001-c12b-46a4-8848-7ad0c8198af7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:28.034911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69f957-1d13-44b9-a31a-3bb071a58148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:28.035650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69f957-1d13-44b9-a31a-3bb071a58148 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:28.036552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69f957-1d13-44b9-a31a-3bb071a58148 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:28.036552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69f957-1d13-44b9-a31a-3bb071a58148 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:28.037612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69f957-1d13-44b9-a31a-3bb071a58148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:28.038022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69f957-1d13-44b9-a31a-3bb071a58148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:28.040769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69f957-1d13-44b9-a31a-3bb071a58148 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:28.060328 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3918/7834] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:28.061389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69f957-1d13-44b9-a31a-3bb071a58148 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:28.064785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc90b3b-b6e5-4c57-b1f8-6bc074bba616 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:28.069050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fb637-5c43-4fb5-8e54-913d8b6a3d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:28.069882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fb637-5c43-4fb5-8e54-913d8b6a3d8a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:28.071049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fb637-5c43-4fb5-8e54-913d8b6a3d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:28.071961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676fb637-5c43-4fb5-8e54-913d8b6a3d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:28.074108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69f957-1d13-44b9-a31a-3bb071a58148 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:28.074675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-676fb637-5c43-4fb5-8e54-913d8b6a3d8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:28.079575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a99bac-a8b0-4725-82b7-b3d82480a22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:28.080562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a99bac-a8b0-4725-82b7-b3d82480a22c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:28.080917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a99bac-a8b0-4725-82b7-b3d82480a22c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:28.081267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a99bac-a8b0-4725-82b7-b3d82480a22c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:28.082177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a99bac-a8b0-4725-82b7-b3d82480a22c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:28.084185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a99bac-a8b0-4725-82b7-b3d82480a22c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:28.095304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fb637-5c43-4fb5-8e54-913d8b6a3d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:28.096830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676fb637-5c43-4fb5-8e54-913d8b6a3d8a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:28.122215 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3919/7835] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:28 2022] POST /identity/v3/projects => generated 361 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:28.122952 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3917/7836] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:28.136281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a99bac-a8b0-4725-82b7-b3d82480a22c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:28.186573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:28.273593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a99bac-a8b0-4725-82b7-b3d82480a22c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:28.281497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f462b6-5cd9-46c9-9db2-2aa02dddd18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:28.282195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f462b6-5cd9-46c9-9db2-2aa02dddd18b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:28.282553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f462b6-5cd9-46c9-9db2-2aa02dddd18b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:28.282889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f462b6-5cd9-46c9-9db2-2aa02dddd18b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:28.283701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f462b6-5cd9-46c9-9db2-2aa02dddd18b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:28.285686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f462b6-5cd9-46c9-9db2-2aa02dddd18b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:28.328812 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3920/7837] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:28 2022] POST /identity/v3/users => generated 281 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:28.329353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fb637-5c43-4fb5-8e54-913d8b6a3d8a service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:28.342901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676fb637-5c43-4fb5-8e54-913d8b6a3d8a service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:28.350399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92fc00-c636-485f-bd48-1188ee27b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:28.351946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92fc00-c636-485f-bd48-1188ee27b370 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:28.352642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92fc00-c636-485f-bd48-1188ee27b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:28.353174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92fc00-c636-485f-bd48-1188ee27b370 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:28.354503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92fc00-c636-485f-bd48-1188ee27b370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:28.356540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92fc00-c636-485f-bd48-1188ee27b370 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:28.371183 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3918/7838] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:28.373442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f462b6-5cd9-46c9-9db2-2aa02dddd18b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:28.385902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f462b6-5cd9-46c9-9db2-2aa02dddd18b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:28.392064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3ad23-9d9f-4944-8b3e-ee3f5cc1f397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:28.393168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3ad23-9d9f-4944-8b3e-ee3f5cc1f397 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:28.393551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3ad23-9d9f-4944-8b3e-ee3f5cc1f397 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:28.394256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3ad23-9d9f-4944-8b3e-ee3f5cc1f397 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:28.395052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3ad23-9d9f-4944-8b3e-ee3f5cc1f397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:28.396791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3ad23-9d9f-4944-8b3e-ee3f5cc1f397 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:28.419348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92fc00-c636-485f-bd48-1188ee27b370 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:28.421534 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3921/7839] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:28.436544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92fc00-c636-485f-bd48-1188ee27b370 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:28.443686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272be7e6-271f-45b7-9373-9f03ac491a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:28.444886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272be7e6-271f-45b7-9373-9f03ac491a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:28.445577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272be7e6-271f-45b7-9373-9f03ac491a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:28.446996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272be7e6-271f-45b7-9373-9f03ac491a39 admin admin] PATH_INFO: `/v3/projects/70342feea3214325b12071512d3f3d58/users/f256a42f980a4195955c8f8172bc0bfc/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:28.464491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272be7e6-271f-45b7-9373-9f03ac491a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70342feea3214325b12071512d3f3d58, user_id=f256a42f980a4195955c8f8172bc0bfc, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:28.467751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272be7e6-271f-45b7-9373-9f03ac491a39 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:28.490822 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3919/7840] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:28 2022] PUT /identity/v3/projects/70342feea3214325b12071512d3f3d58/users/f256a42f980a4195955c8f8172bc0bfc/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:28.500532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa1e6a-7a85-4107-b312-65c313c7dcea None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:28.501126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa1e6a-7a85-4107-b312-65c313c7dcea None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:28.503942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa1e6a-7a85-4107-b312-65c313c7dcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:28.560016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-00aa1e6a-7a85-4107-b312-65c313c7dcea None None] MFA Rules not processed for user `f256a42f980a4195955c8f8172bc0bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:28.561643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-00aa1e6a-7a85-4107-b312-65c313c7dcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:28.667693 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3922/7841] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:33:28.682117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272be7e6-271f-45b7-9373-9f03ac491a39 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:28.757412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:28.783287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272be7e6-271f-45b7-9373-9f03ac491a39 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:28.791831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:28.792765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:28.793268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:28.793771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] PATH_INFO: `/v3/users/f256a42f980a4195955c8f8172bc0bfc` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:28.795592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f256a42f980a4195955c8f8172bc0bfc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:28.799034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:28.878190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f256a42f980a4195955c8f8172bc0bfc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:28.888643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f256a42f980a4195955c8f8172bc0bfc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:28.889896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f256a42f980a4195955c8f8172bc0bfc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:28.908204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f256a42f980a4195955c8f8172bc0bfc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:28.909032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f256a42f980a4195955c8f8172bc0bfc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:28.929428 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3920/7842] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:28 2022] DELETE /identity/v3/users/f256a42f980a4195955c8f8172bc0bfc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:28.932385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea326a10-403a-4aef-a277-e4e2de39ce60 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:28.932783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea326a10-403a-4aef-a277-e4e2de39ce60 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:28.933198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea326a10-403a-4aef-a277-e4e2de39ce60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:28.959455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ea326a10-403a-4aef-a277-e4e2de39ce60 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:28.961887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ea326a10-403a-4aef-a277-e4e2de39ce60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:29.209664 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3923/7843] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:29.220482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:29.222278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:29.321291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae1fd1-ced9-4e0d-85c5-5317670473ee admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:29.325518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da141a98-87e1-45f8-bcd9-e4516c37e0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:29.326458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da141a98-87e1-45f8-bcd9-e4516c37e0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:29.326581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da141a98-87e1-45f8-bcd9-e4516c37e0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:29.326925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da141a98-87e1-45f8-bcd9-e4516c37e0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:29.340369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da141a98-87e1-45f8-bcd9-e4516c37e0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:29.342181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da141a98-87e1-45f8-bcd9-e4516c37e0d0 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:29.356093 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3921/7844] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:29.716002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea326a10-403a-4aef-a277-e4e2de39ce60 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:29.718863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ea326a10-403a-4aef-a277-e4e2de39ce60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:29.744349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea326a10-403a-4aef-a277-e4e2de39ce60 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:29.757805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579b7f2-1e2a-4e3e-b81e-1c841489a279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:29.758571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579b7f2-1e2a-4e3e-b81e-1c841489a279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:29.759794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579b7f2-1e2a-4e3e-b81e-1c841489a279 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:29.759794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579b7f2-1e2a-4e3e-b81e-1c841489a279 admin admin] PATH_INFO: `/v3/projects/70342feea3214325b12071512d3f3d58` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:29.760954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579b7f2-1e2a-4e3e-b81e-1c841489a279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70342feea3214325b12071512d3f3d58)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:29.762965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579b7f2-1e2a-4e3e-b81e-1c841489a279 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:29.800128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:29.829338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b579b7f2-1e2a-4e3e-b81e-1c841489a279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70342feea3214325b12071512d3f3d58', 'request_id': 'req-b579b7f2-1e2a-4e3e-b81e-1c841489a279'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:29.839195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b579b7f2-1e2a-4e3e-b81e-1c841489a279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70342feea3214325b12071512d3f3d58', 'request_id': 'req-b579b7f2-1e2a-4e3e-b81e-1c841489a279'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:29.859565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b579b7f2-1e2a-4e3e-b81e-1c841489a279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70342feea3214325b12071512d3f3d58', 'request_id': 'req-b579b7f2-1e2a-4e3e-b81e-1c841489a279'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:29.875606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b579b7f2-1e2a-4e3e-b81e-1c841489a279 admin admin] The token cache is being invalidate because project 70342feea3214325b12071512d3f3d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:29.876038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b579b7f2-1e2a-4e3e-b81e-1c841489a279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:29.876944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b579b7f2-1e2a-4e3e-b81e-1c841489a279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:29.879190 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3924/7845] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:29 2022] DELETE /identity/v3/projects/70342feea3214325b12071512d3f3d58 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:29.885355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505ac1f-ef9c-4c8b-9ade-d00affed9e20 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:29.886306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505ac1f-ef9c-4c8b-9ade-d00affed9e20 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:29.887484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505ac1f-ef9c-4c8b-9ade-d00affed9e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:29.913455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c505ac1f-ef9c-4c8b-9ade-d00affed9e20 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:29.915948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c505ac1f-ef9c-4c8b-9ade-d00affed9e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:29.990525 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3922/7846] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:29.992895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d5eee-d651-4d77-b1ad-44041df27d88 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:29.993362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d5eee-d651-4d77-b1ad-44041df27d88 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:29.993649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d5eee-d651-4d77-b1ad-44041df27d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.016531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7e7d5eee-d651-4d77-b1ad-44041df27d88 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:30.018522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7e7d5eee-d651-4d77-b1ad-44041df27d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:30.032995 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3925/7847] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:30.034214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505ac1f-ef9c-4c8b-9ade-d00affed9e20 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.041008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:30.045358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505ac1f-ef9c-4c8b-9ade-d00affed9e20 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.051728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14872d1e-3cb2-472c-8c41-41c907524598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.052890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872d1e-3cb2-472c-8c41-41c907524598 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.053520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872d1e-3cb2-472c-8c41-41c907524598 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.054527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14872d1e-3cb2-472c-8c41-41c907524598 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.056111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14872d1e-3cb2-472c-8c41-41c907524598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:30.056716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14872d1e-3cb2-472c-8c41-41c907524598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.059168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14872d1e-3cb2-472c-8c41-41c907524598 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:30.076165 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3923/7848] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:30.080384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d5eee-d651-4d77-b1ad-44041df27d88 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.090637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d5eee-d651-4d77-b1ad-44041df27d88 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.096432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688115f-5ed5-4e9f-aebc-8dc5e245857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.097061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688115f-5ed5-4e9f-aebc-8dc5e245857c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.097350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688115f-5ed5-4e9f-aebc-8dc5e245857c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.097699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688115f-5ed5-4e9f-aebc-8dc5e245857c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.098449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688115f-5ed5-4e9f-aebc-8dc5e245857c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.100429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688115f-5ed5-4e9f-aebc-8dc5e245857c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:30.133804 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3926/7849] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:30 2022] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:30.137769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14872d1e-3cb2-472c-8c41-41c907524598 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.148269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14872d1e-3cb2-472c-8c41-41c907524598 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.220099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a2b2f-09e7-4bb1-b533-346fcd81b0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.220817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a2b2f-09e7-4bb1-b533-346fcd81b0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.221173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a2b2f-09e7-4bb1-b533-346fcd81b0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.221516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a2b2f-09e7-4bb1-b533-346fcd81b0f4 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.222218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a2b2f-09e7-4bb1-b533-346fcd81b0f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.224385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a2b2f-09e7-4bb1-b533-346fcd81b0f4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:30.250505 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3924/7850] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:30 2022] POST /identity/v3/users => generated 303 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:30.254963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688115f-5ed5-4e9f-aebc-8dc5e245857c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.273016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688115f-5ed5-4e9f-aebc-8dc5e245857c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.278971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9f3a1-f3ad-4841-87e0-bc9bcb693255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.280105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9f3a1-f3ad-4841-87e0-bc9bcb693255 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.280518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9f3a1-f3ad-4841-87e0-bc9bcb693255 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.280803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9f3a1-f3ad-4841-87e0-bc9bcb693255 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.281457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9f3a1-f3ad-4841-87e0-bc9bcb693255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.283247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9f3a1-f3ad-4841-87e0-bc9bcb693255 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:30.298582 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3927/7851] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:30.299959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a2b2f-09e7-4bb1-b533-346fcd81b0f4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.312834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a2b2f-09e7-4bb1-b533-346fcd81b0f4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.318158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e032fe-f27b-4a0e-a4f3-bcb2692f82f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.319048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e032fe-f27b-4a0e-a4f3-bcb2692f82f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.319432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e032fe-f27b-4a0e-a4f3-bcb2692f82f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.319802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e032fe-f27b-4a0e-a4f3-bcb2692f82f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.320979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e032fe-f27b-4a0e-a4f3-bcb2692f82f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.322913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e032fe-f27b-4a0e-a4f3-bcb2692f82f1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:30.338494 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3925/7852] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:30.339980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9f3a1-f3ad-4841-87e0-bc9bcb693255 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.351378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9f3a1-f3ad-4841-87e0-bc9bcb693255 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.356968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fc281-beed-4974-bb05-c583c4752fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.357750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fc281-beed-4974-bb05-c583c4752fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.358126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fc281-beed-4974-bb05-c583c4752fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.358509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fc281-beed-4974-bb05-c583c4752fc8 admin admin] PATH_INFO: `/v3/projects/cdfbef514f0a45118731c6adaf79481b/users/491d4dbb7b9c4d91929219dfb02d3c0d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.375994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fc281-beed-4974-bb05-c583c4752fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfbef514f0a45118731c6adaf79481b, user_id=491d4dbb7b9c4d91929219dfb02d3c0d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.378785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fc281-beed-4974-bb05-c583c4752fc8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:30.394630 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3928/7853] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:30 2022] PUT /identity/v3/projects/cdfbef514f0a45118731c6adaf79481b/users/491d4dbb7b9c4d91929219dfb02d3c0d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:30.404978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a20986-ddb5-4180-afad-f64d189e8484 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.405283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a20986-ddb5-4180-afad-f64d189e8484 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.405564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a20986-ddb5-4180-afad-f64d189e8484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.437316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-97a20986-ddb5-4180-afad-f64d189e8484 None None] MFA Rules not processed for user `491d4dbb7b9c4d91929219dfb02d3c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:30.438677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-97a20986-ddb5-4180-afad-f64d189e8484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:30.514341 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3926/7854] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:30.515407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fc281-beed-4974-bb05-c583c4752fc8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.596484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fc281-beed-4974-bb05-c583c4752fc8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.602223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bcade-c90a-4c94-b561-3dbc3816d3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.603260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bcade-c90a-4c94-b561-3dbc3816d3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.603544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bcade-c90a-4c94-b561-3dbc3816d3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.603813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bcade-c90a-4c94-b561-3dbc3816d3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.604442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bcade-c90a-4c94-b561-3dbc3816d3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.606414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bcade-c90a-4c94-b561-3dbc3816d3c1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:30.645662 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3929/7855] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:30 2022] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:30.646735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a20986-ddb5-4180-afad-f64d189e8484 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.661186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a20986-ddb5-4180-afad-f64d189e8484 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.744209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89509744-9157-48eb-9ea8-bdccc8e6020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.744835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89509744-9157-48eb-9ea8-bdccc8e6020b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.745123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89509744-9157-48eb-9ea8-bdccc8e6020b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.745404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89509744-9157-48eb-9ea8-bdccc8e6020b admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.746051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89509744-9157-48eb-9ea8-bdccc8e6020b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.748043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89509744-9157-48eb-9ea8-bdccc8e6020b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:30.763561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:30.782462 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3927/7856] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:30 2022] POST /identity/v3/users => generated 309 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:30.786477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bcade-c90a-4c94-b561-3dbc3816d3c1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.799752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bcade-c90a-4c94-b561-3dbc3816d3c1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.805777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aae077-2429-4bed-9739-c8330c0397e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.806529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aae077-2429-4bed-9739-c8330c0397e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.806865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aae077-2429-4bed-9739-c8330c0397e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.807137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aae077-2429-4bed-9739-c8330c0397e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.807789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aae077-2429-4bed-9739-c8330c0397e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.809512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aae077-2429-4bed-9739-c8330c0397e2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:30.826930 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3930/7857] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:30.827985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89509744-9157-48eb-9ea8-bdccc8e6020b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.839611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89509744-9157-48eb-9ea8-bdccc8e6020b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.844556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c842d43-3bda-45fb-af28-5917e8ab733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.845514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c842d43-3bda-45fb-af28-5917e8ab733d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.845805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c842d43-3bda-45fb-af28-5917e8ab733d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.846086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c842d43-3bda-45fb-af28-5917e8ab733d admin admin] PATH_INFO: `/v3/projects/1d025a1713a64b57aa55aebec01c24c4/users/75385dd6ee654082a09b162e95a11180/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.864138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c842d43-3bda-45fb-af28-5917e8ab733d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d025a1713a64b57aa55aebec01c24c4, user_id=75385dd6ee654082a09b162e95a11180, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.867265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c842d43-3bda-45fb-af28-5917e8ab733d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:30.885527 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3928/7858] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:30 2022] PUT /identity/v3/projects/1d025a1713a64b57aa55aebec01c24c4/users/75385dd6ee654082a09b162e95a11180/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:30.889499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aae077-2429-4bed-9739-c8330c0397e2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:30.901969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aae077-2429-4bed-9739-c8330c0397e2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:30.930689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:30.981979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faa5db-5334-484e-ba95-1b2db89be61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:30.982769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faa5db-5334-484e-ba95-1b2db89be61f admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:30.984254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faa5db-5334-484e-ba95-1b2db89be61f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:30.984254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faa5db-5334-484e-ba95-1b2db89be61f admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:30.984607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faa5db-5334-484e-ba95-1b2db89be61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:30.986347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faa5db-5334-484e-ba95-1b2db89be61f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:31.002794 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3931/7859] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:33:31.004225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c842d43-3bda-45fb-af28-5917e8ab733d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:31.021500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c842d43-3bda-45fb-af28-5917e8ab733d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:31.033254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b462213-cc0b-4a79-8ff3-1b5c5c8cc1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:31.034180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b462213-cc0b-4a79-8ff3-1b5c5c8cc1ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:31.034620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b462213-cc0b-4a79-8ff3-1b5c5c8cc1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:31.035008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b462213-cc0b-4a79-8ff3-1b5c5c8cc1ab admin admin] PATH_INFO: `/v3/projects/1d025a1713a64b57aa55aebec01c24c4/users/75385dd6ee654082a09b162e95a11180/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:31.038040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b462213-cc0b-4a79-8ff3-1b5c5c8cc1ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d025a1713a64b57aa55aebec01c24c4, user_id=75385dd6ee654082a09b162e95a11180, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:31.042785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b462213-cc0b-4a79-8ff3-1b5c5c8cc1ab admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:31.054879 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3929/7860] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:31 2022] PUT /identity/v3/projects/1d025a1713a64b57aa55aebec01c24c4/users/75385dd6ee654082a09b162e95a11180/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:31.065945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991cff0-2a2a-4f3a-9564-71f03485c087 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:31.066239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991cff0-2a2a-4f3a-9564-71f03485c087 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:31.066572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991cff0-2a2a-4f3a-9564-71f03485c087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:31.105070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1991cff0-2a2a-4f3a-9564-71f03485c087 None None] MFA Rules not processed for user `75385dd6ee654082a09b162e95a11180`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:31.106299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1991cff0-2a2a-4f3a-9564-71f03485c087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:31.186719 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3932/7861] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:31 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:31.198415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b462213-cc0b-4a79-8ff3-1b5c5c8cc1ab admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:31.200469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1b462213-cc0b-4a79-8ff3-1b5c5c8cc1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:31.268705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b462213-cc0b-4a79-8ff3-1b5c5c8cc1ab admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:31.273192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dccc99-009d-4095-ae73-cc5af21ac2fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:31.274511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dccc99-009d-4095-ae73-cc5af21ac2fd service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:31.274824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dccc99-009d-4095-ae73-cc5af21ac2fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:31.275152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dccc99-009d-4095-ae73-cc5af21ac2fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:31.346716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dccc99-009d-4095-ae73-cc5af21ac2fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:31.348167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dccc99-009d-4095-ae73-cc5af21ac2fd service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:31.357667 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3930/7862] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:31 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:31.682881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991cff0-2a2a-4f3a-9564-71f03485c087 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:31.684321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1991cff0-2a2a-4f3a-9564-71f03485c087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:31.768196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991cff0-2a2a-4f3a-9564-71f03485c087 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:31.773624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b910747-87aa-4ee8-ae79-fe5d812b97ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:31.774356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b910747-87aa-4ee8-ae79-fe5d812b97ac service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:31.774634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b910747-87aa-4ee8-ae79-fe5d812b97ac service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:31.774935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b910747-87aa-4ee8-ae79-fe5d812b97ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:31.783067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b910747-87aa-4ee8-ae79-fe5d812b97ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:31.784696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b910747-87aa-4ee8-ae79-fe5d812b97ac service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:31.795137 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3933/7863] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:31 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:37.013100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dccc99-009d-4095-ae73-cc5af21ac2fd service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:37.083715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dccc99-009d-4095-ae73-cc5af21ac2fd service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:37.089283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:37.089991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:37.090439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:37.091216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] PATH_INFO: `/v3/users/491d4dbb7b9c4d91929219dfb02d3c0d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:37.092579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] RBAC: Authorizing `identity:delete_user(user_id=491d4dbb7b9c4d91929219dfb02d3c0d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:37.094893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:37.102532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:37.151798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491d4dbb7b9c4d91929219dfb02d3c0d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.158793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491d4dbb7b9c4d91929219dfb02d3c0d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.159464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491d4dbb7b9c4d91929219dfb02d3c0d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.171927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491d4dbb7b9c4d91929219dfb02d3c0d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.172563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491d4dbb7b9c4d91929219dfb02d3c0d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.185628 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3931/7864] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:37 2022] DELETE /identity/v3/users/491d4dbb7b9c4d91929219dfb02d3c0d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:37.190133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50e828-4b94-454a-aecf-b2292a3b92b3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:37.190558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50e828-4b94-454a-aecf-b2292a3b92b3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:37.190688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50e828-4b94-454a-aecf-b2292a3b92b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:37.210361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9e50e828-4b94-454a-aecf-b2292a3b92b3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:37.212478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9e50e828-4b94-454a-aecf-b2292a3b92b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:37.238160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:37.271992 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3934/7865] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:37.282766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:37.284221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:37.343981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0b0cf-1c8d-4fc3-bf67-e3a76c3ac44e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:37.347535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6351d-9ac2-4cbe-9758-8a3ca4ca61d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:37.348140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6351d-9ac2-4cbe-9758-8a3ca4ca61d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:37.348462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6351d-9ac2-4cbe-9758-8a3ca4ca61d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:37.348736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6351d-9ac2-4cbe-9758-8a3ca4ca61d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:37.358335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6351d-9ac2-4cbe-9758-8a3ca4ca61d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:37.359813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6351d-9ac2-4cbe-9758-8a3ca4ca61d7 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:37.369208 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3932/7866] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:37.540518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50e828-4b94-454a-aecf-b2292a3b92b3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:37.541948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9e50e828-4b94-454a-aecf-b2292a3b92b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:37.561199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50e828-4b94-454a-aecf-b2292a3b92b3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:37.568720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:37.569386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:37.569615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:37.569904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] PATH_INFO: `/v3/projects/cdfbef514f0a45118731c6adaf79481b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:37.571711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfbef514f0a45118731c6adaf79481b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:37.573641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:37.621953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfbef514f0a45118731c6adaf79481b', 'request_id': 'req-e582193d-9e01-4c64-86e8-04cf3c4c6d01'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.627379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfbef514f0a45118731c6adaf79481b', 'request_id': 'req-e582193d-9e01-4c64-86e8-04cf3c4c6d01'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.634479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfbef514f0a45118731c6adaf79481b', 'request_id': 'req-e582193d-9e01-4c64-86e8-04cf3c4c6d01'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.647386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] The token cache is being invalidate because project cdfbef514f0a45118731c6adaf79481b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:37.647677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.648314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.649809 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3935/7867] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:37 2022] DELETE /identity/v3/projects/cdfbef514f0a45118731c6adaf79481b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:37.654007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6351d-9ac2-4cbe-9758-8a3ca4ca61d7 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:37.664263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6351d-9ac2-4cbe-9758-8a3ca4ca61d7 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:37.723665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:37.724282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:37.724569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:37.724851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] PATH_INFO: `/v3/users/75385dd6ee654082a09b162e95a11180` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:37.725944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75385dd6ee654082a09b162e95a11180)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:37.727939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:37.761607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:37.776039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75385dd6ee654082a09b162e95a11180'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.782940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75385dd6ee654082a09b162e95a11180'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.783600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75385dd6ee654082a09b162e95a11180'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.796084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75385dd6ee654082a09b162e95a11180'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.796731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75385dd6ee654082a09b162e95a11180'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:37.810160 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3933/7868] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:37 2022] DELETE /identity/v3/users/75385dd6ee654082a09b162e95a11180 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:37.984463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:37.985921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:38.007817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582193d-9e01-4c64-86e8-04cf3c4c6d01 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:38.065157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12013145-7201-40b2-ae38-954ec3adf848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:38.065992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12013145-7201-40b2-ae38-954ec3adf848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.066277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12013145-7201-40b2-ae38-954ec3adf848 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.066553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12013145-7201-40b2-ae38-954ec3adf848 admin admin] PATH_INFO: `/v3/projects/1d025a1713a64b57aa55aebec01c24c4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.067816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12013145-7201-40b2-ae38-954ec3adf848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d025a1713a64b57aa55aebec01c24c4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:38.069725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12013145-7201-40b2-ae38-954ec3adf848 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:38.093488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:38.095050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:38.120199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12013145-7201-40b2-ae38-954ec3adf848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d025a1713a64b57aa55aebec01c24c4', 'request_id': 'req-12013145-7201-40b2-ae38-954ec3adf848'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:38.127205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:38.129420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12013145-7201-40b2-ae38-954ec3adf848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d025a1713a64b57aa55aebec01c24c4', 'request_id': 'req-12013145-7201-40b2-ae38-954ec3adf848'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:38.138706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12013145-7201-40b2-ae38-954ec3adf848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d025a1713a64b57aa55aebec01c24c4', 'request_id': 'req-12013145-7201-40b2-ae38-954ec3adf848'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:38.156674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12013145-7201-40b2-ae38-954ec3adf848 admin admin] The token cache is being invalidate because project 1d025a1713a64b57aa55aebec01c24c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:38.157031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12013145-7201-40b2-ae38-954ec3adf848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:38.158047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-12013145-7201-40b2-ae38-954ec3adf848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:38.160006 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3936/7869] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:37 2022] DELETE /identity/v3/projects/1d025a1713a64b57aa55aebec01c24c4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:38.164971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415fd01-76ad-410f-9e71-ffa70f3a4a37 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.165324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415fd01-76ad-410f-9e71-ffa70f3a4a37 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.165663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415fd01-76ad-410f-9e71-ffa70f3a4a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.188009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3415fd01-76ad-410f-9e71-ffa70f3a4a37 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:38.191157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3415fd01-76ad-410f-9e71-ffa70f3a4a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:38.197346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cd622-3646-44db-833a-89031fdb3986 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:38.267042 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3937/7870] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:33:38.275476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a32ccc-6a61-4b60-87c6-67974f76ddad None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.275795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a32ccc-6a61-4b60-87c6-67974f76ddad None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.276075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a32ccc-6a61-4b60-87c6-67974f76ddad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.280283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39856d-19c2-46b9-ae75-77380fef60bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:38.283389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39856d-19c2-46b9-ae75-77380fef60bd service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.287214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39856d-19c2-46b9-ae75-77380fef60bd service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.287348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39856d-19c2-46b9-ae75-77380fef60bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.290015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fd39856d-19c2-46b9-ae75-77380fef60bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:38.301362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b7a32ccc-6a61-4b60-87c6-67974f76ddad None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:38.302586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b7a32ccc-6a61-4b60-87c6-67974f76ddad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:38.313903 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3938/7871] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:38.317842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a32ccc-6a61-4b60-87c6-67974f76ddad None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:38.329428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a32ccc-6a61-4b60-87c6-67974f76ddad None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:38.334806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd599b-dc4a-4b82-a7bb-4f23f02a5497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:38.335402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd599b-dc4a-4b82-a7bb-4f23f02a5497 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.335682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd599b-dc4a-4b82-a7bb-4f23f02a5497 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.336474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd599b-dc4a-4b82-a7bb-4f23f02a5497 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.337120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd599b-dc4a-4b82-a7bb-4f23f02a5497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:38.337422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd599b-dc4a-4b82-a7bb-4f23f02a5497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:38.339049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd599b-dc4a-4b82-a7bb-4f23f02a5497 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:38.339843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:38.353030 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3939/7872] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:38.357311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd599b-dc4a-4b82-a7bb-4f23f02a5497 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:38.359906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39856d-19c2-46b9-ae75-77380fef60bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:38.361503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39856d-19c2-46b9-ae75-77380fef60bd service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:38.367805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd599b-dc4a-4b82-a7bb-4f23f02a5497 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:38.371345 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3934/7873] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:33:38.372691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cffaa-1aaa-4423-87be-97f53c8ba71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:38.373283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cffaa-1aaa-4423-87be-97f53c8ba71d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.373566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cffaa-1aaa-4423-87be-97f53c8ba71d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.373872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cffaa-1aaa-4423-87be-97f53c8ba71d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.374531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cffaa-1aaa-4423-87be-97f53c8ba71d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:38.376448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cffaa-1aaa-4423-87be-97f53c8ba71d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:38.405367 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3940/7874] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:38 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:38.409814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39856d-19c2-46b9-ae75-77380fef60bd service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:38.421366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39856d-19c2-46b9-ae75-77380fef60bd service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:38.481500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b0535-a8c7-4bd1-adf5-ed4b609dce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:38.482123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b0535-a8c7-4bd1-adf5-ed4b609dce24 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.482469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b0535-a8c7-4bd1-adf5-ed4b609dce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.482765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b0535-a8c7-4bd1-adf5-ed4b609dce24 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.483414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b0535-a8c7-4bd1-adf5-ed4b609dce24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:38.485347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b0535-a8c7-4bd1-adf5-ed4b609dce24 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:38.510819 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3935/7875] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:38 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:38.512992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cffaa-1aaa-4423-87be-97f53c8ba71d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:38.523749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cffaa-1aaa-4423-87be-97f53c8ba71d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:38.528505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bc590-cf20-4341-aad7-c340dab2d78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:38.529150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc590-cf20-4341-aad7-c340dab2d78c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.529429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc590-cf20-4341-aad7-c340dab2d78c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.529703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc590-cf20-4341-aad7-c340dab2d78c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.530349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bc590-cf20-4341-aad7-c340dab2d78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:38.532004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bc590-cf20-4341-aad7-c340dab2d78c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:38.545589 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3941/7876] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:38.549761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b0535-a8c7-4bd1-adf5-ed4b609dce24 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:38.560528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b0535-a8c7-4bd1-adf5-ed4b609dce24 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:38.565251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28c84b-c2cc-4f70-baee-da36debd2f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:38.565860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28c84b-c2cc-4f70-baee-da36debd2f30 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.566143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28c84b-c2cc-4f70-baee-da36debd2f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.566419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28c84b-c2cc-4f70-baee-da36debd2f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.567122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28c84b-c2cc-4f70-baee-da36debd2f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:38.568715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28c84b-c2cc-4f70-baee-da36debd2f30 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:38.582779 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3936/7877] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:38.584241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bc590-cf20-4341-aad7-c340dab2d78c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:38.594713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bc590-cf20-4341-aad7-c340dab2d78c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:38.599603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13969910-9bdd-4a92-998e-23cc2720e1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:38.600255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13969910-9bdd-4a92-998e-23cc2720e1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.600539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13969910-9bdd-4a92-998e-23cc2720e1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.600818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13969910-9bdd-4a92-998e-23cc2720e1d8 admin admin] PATH_INFO: `/v3/projects/b4a67dffc2154725b0ea590369c18b69/users/cc80203774754ec49c9835b1b1dcebe8/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.616797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13969910-9bdd-4a92-998e-23cc2720e1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a67dffc2154725b0ea590369c18b69, user_id=cc80203774754ec49c9835b1b1dcebe8, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:38.620635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13969910-9bdd-4a92-998e-23cc2720e1d8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:38.634059 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3942/7878] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:38 2022] PUT /identity/v3/projects/b4a67dffc2154725b0ea590369c18b69/users/cc80203774754ec49c9835b1b1dcebe8/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:38.645498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1d2cc-84c6-4c3e-988a-38bad78602f3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.645789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1d2cc-84c6-4c3e-988a-38bad78602f3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.646069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1d2cc-84c6-4c3e-988a-38bad78602f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.674491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-01b1d2cc-84c6-4c3e-988a-38bad78602f3 None None] MFA Rules not processed for user `cc80203774754ec49c9835b1b1dcebe8`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:38.675638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-01b1d2cc-84c6-4c3e-988a-38bad78602f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:38.744297 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3937/7879] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:38.748834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13969910-9bdd-4a92-998e-23cc2720e1d8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:38.810228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13969910-9bdd-4a92-998e-23cc2720e1d8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:38.815015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d77eb-9010-47c5-bab6-3a496f51e90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:38.815621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d77eb-9010-47c5-bab6-3a496f51e90b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.815909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d77eb-9010-47c5-bab6-3a496f51e90b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.816189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d77eb-9010-47c5-bab6-3a496f51e90b admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.816825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d77eb-9010-47c5-bab6-3a496f51e90b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:38.818730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d77eb-9010-47c5-bab6-3a496f51e90b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:38.837047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:38.851871 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3943/7880] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:38 2022] POST /identity/v3/projects => generated 397 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:38.855815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1d2cc-84c6-4c3e-988a-38bad78602f3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:38.866898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1d2cc-84c6-4c3e-988a-38bad78602f3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:38.918514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:38.933565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08853e-728c-454c-a139-205857276a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:38.934129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08853e-728c-454c-a139-205857276a30 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.934416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08853e-728c-454c-a139-205857276a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.934697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08853e-728c-454c-a139-205857276a30 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.935392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08853e-728c-454c-a139-205857276a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:38.937326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08853e-728c-454c-a139-205857276a30 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:38.957899 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3938/7881] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:38 2022] POST /identity/v3/users => generated 305 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:38.962654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d77eb-9010-47c5-bab6-3a496f51e90b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:38.973048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d77eb-9010-47c5-bab6-3a496f51e90b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:38.978659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809fcf4-d136-4173-8c69-6c352790ab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:38.979297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809fcf4-d136-4173-8c69-6c352790ab7a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:38.979585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809fcf4-d136-4173-8c69-6c352790ab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:38.979864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809fcf4-d136-4173-8c69-6c352790ab7a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:38.980506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809fcf4-d136-4173-8c69-6c352790ab7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:38.982118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809fcf4-d136-4173-8c69-6c352790ab7a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:38.994517 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3944/7882] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:38.998700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08853e-728c-454c-a139-205857276a30 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:39.009531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08853e-728c-454c-a139-205857276a30 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:39.014260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e63615-ce6a-4b13-9fd4-d6757f584990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:39.014934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63615-ce6a-4b13-9fd4-d6757f584990 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:39.015217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63615-ce6a-4b13-9fd4-d6757f584990 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:39.015491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e63615-ce6a-4b13-9fd4-d6757f584990 admin admin] PATH_INFO: `/v3/projects/bd025919be4546d3bc95825ce892d911/users/00120e5808614d0d9f6066152147de3c/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:39.030779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e63615-ce6a-4b13-9fd4-d6757f584990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd025919be4546d3bc95825ce892d911, user_id=00120e5808614d0d9f6066152147de3c, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:39.033441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e63615-ce6a-4b13-9fd4-d6757f584990 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:39.047126 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3939/7883] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:38 2022] PUT /identity/v3/projects/bd025919be4546d3bc95825ce892d911/users/00120e5808614d0d9f6066152147de3c/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:39.051213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809fcf4-d136-4173-8c69-6c352790ab7a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:39.061326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809fcf4-d136-4173-8c69-6c352790ab7a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:39.118077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3ae55-72d3-4d00-9d7c-4e2a654de795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:39.118700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3ae55-72d3-4d00-9d7c-4e2a654de795 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:39.119013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3ae55-72d3-4d00-9d7c-4e2a654de795 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:39.119294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3ae55-72d3-4d00-9d7c-4e2a654de795 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:39.119963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3ae55-72d3-4d00-9d7c-4e2a654de795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:39.121592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3ae55-72d3-4d00-9d7c-4e2a654de795 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:39.131543 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3945/7884] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:39.136184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e63615-ce6a-4b13-9fd4-d6757f584990 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:39.146525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e63615-ce6a-4b13-9fd4-d6757f584990 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:39.151859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738463d-901d-4ac7-ab81-4518e40411a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:39.152505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738463d-901d-4ac7-ab81-4518e40411a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:39.152785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738463d-901d-4ac7-ab81-4518e40411a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:39.153055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738463d-901d-4ac7-ab81-4518e40411a7 admin admin] PATH_INFO: `/v3/projects/bd025919be4546d3bc95825ce892d911/users/00120e5808614d0d9f6066152147de3c/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:39.154969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738463d-901d-4ac7-ab81-4518e40411a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd025919be4546d3bc95825ce892d911, user_id=00120e5808614d0d9f6066152147de3c, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:39.157616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738463d-901d-4ac7-ab81-4518e40411a7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:39.168533 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3940/7885] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:39 2022] PUT /identity/v3/projects/bd025919be4546d3bc95825ce892d911/users/00120e5808614d0d9f6066152147de3c/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:39.178703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75e928-681e-4d6d-b227-060d479953f1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:39.179044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75e928-681e-4d6d-b227-060d479953f1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:39.179325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75e928-681e-4d6d-b227-060d479953f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:39.207012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5b75e928-681e-4d6d-b227-060d479953f1 None None] MFA Rules not processed for user `00120e5808614d0d9f6066152147de3c`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:39.208149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5b75e928-681e-4d6d-b227-060d479953f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:39.281776 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3946/7886] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:39 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:39.292414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738463d-901d-4ac7-ab81-4518e40411a7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:39.294158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8738463d-901d-4ac7-ab81-4518e40411a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:39.355928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738463d-901d-4ac7-ab81-4518e40411a7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:39.359628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681321e-4106-40e8-8b0a-96989b0458cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:39.360237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681321e-4106-40e8-8b0a-96989b0458cc service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:39.360631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681321e-4106-40e8-8b0a-96989b0458cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:39.360910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681321e-4106-40e8-8b0a-96989b0458cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:39.421201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681321e-4106-40e8-8b0a-96989b0458cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:39.423059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681321e-4106-40e8-8b0a-96989b0458cc service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:39.433055 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3941/7887] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:39.896662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75e928-681e-4d6d-b227-060d479953f1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:39.899480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5b75e928-681e-4d6d-b227-060d479953f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:39.974962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:39.983356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75e928-681e-4d6d-b227-060d479953f1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:39.988892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96225e2-571c-4d09-ac96-c8b0ef3b85e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:39.989512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96225e2-571c-4d09-ac96-c8b0ef3b85e0 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:39.989797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96225e2-571c-4d09-ac96-c8b0ef3b85e0 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:39.990074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96225e2-571c-4d09-ac96-c8b0ef3b85e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:39.999923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96225e2-571c-4d09-ac96-c8b0ef3b85e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:40.001525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96225e2-571c-4d09-ac96-c8b0ef3b85e0 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:40.012660 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3947/7888] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:39 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:41.852694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681321e-4106-40e8-8b0a-96989b0458cc service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:41.869812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681321e-4106-40e8-8b0a-96989b0458cc service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:41.877118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ea39d-516d-4ec3-9d51-2d2668238c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:41.878073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ea39d-516d-4ec3-9d51-2d2668238c3f service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:41.878208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ea39d-516d-4ec3-9d51-2d2668238c3f service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:41.878403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ea39d-516d-4ec3-9d51-2d2668238c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:41.880181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-090ea39d-516d-4ec3-9d51-2d2668238c3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:41.897082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ea39d-516d-4ec3-9d51-2d2668238c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:41.900627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ea39d-516d-4ec3-9d51-2d2668238c3f service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:41.915293 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3942/7889] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:33:42.853387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96225e2-571c-4d09-ac96-c8b0ef3b85e0 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:42.863894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96225e2-571c-4d09-ac96-c8b0ef3b85e0 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:42.867925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382860e-4fcc-45c2-a895-35ab97aa86a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:42.868532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382860e-4fcc-45c2-a895-35ab97aa86a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:42.868819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382860e-4fcc-45c2-a895-35ab97aa86a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:42.869097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382860e-4fcc-45c2-a895-35ab97aa86a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:42.870888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3382860e-4fcc-45c2-a895-35ab97aa86a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:42.882932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382860e-4fcc-45c2-a895-35ab97aa86a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:42.884512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382860e-4fcc-45c2-a895-35ab97aa86a6 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:42.894268 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3948/7890] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:44.256009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ea39d-516d-4ec3-9d51-2d2668238c3f service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:44.269499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ea39d-516d-4ec3-9d51-2d2668238c3f service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:44.273749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dcb7f-ed9d-455e-86c7-9d1fc7edc8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:44.274431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dcb7f-ed9d-455e-86c7-9d1fc7edc8fc service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:44.274715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dcb7f-ed9d-455e-86c7-9d1fc7edc8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:44.275017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dcb7f-ed9d-455e-86c7-9d1fc7edc8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:44.276864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2b6dcb7f-ed9d-455e-86c7-9d1fc7edc8fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:44.322533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:44.349568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dcb7f-ed9d-455e-86c7-9d1fc7edc8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:44.351066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dcb7f-ed9d-455e-86c7-9d1fc7edc8fc service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:44.363435 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3943/7891] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:46.461772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382860e-4fcc-45c2-a895-35ab97aa86a6 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:46.527877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382860e-4fcc-45c2-a895-35ab97aa86a6 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:46.532711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:46.533358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:46.533638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:46.533913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] PATH_INFO: `/v3/users/cc80203774754ec49c9835b1b1dcebe8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:46.535168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc80203774754ec49c9835b1b1dcebe8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:46.537192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:46.594507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc80203774754ec49c9835b1b1dcebe8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:46.601556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc80203774754ec49c9835b1b1dcebe8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:46.602305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc80203774754ec49c9835b1b1dcebe8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:46.609907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc80203774754ec49c9835b1b1dcebe8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:46.610599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc80203774754ec49c9835b1b1dcebe8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:46.629775 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3949/7892] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:46 2022] DELETE /identity/v3/users/cc80203774754ec49c9835b1b1dcebe8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:46.635621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c35c47-5b2d-4353-b415-ac38349d2fdc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:46.636136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c35c47-5b2d-4353-b415-ac38349d2fdc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:46.636228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c35c47-5b2d-4353-b415-ac38349d2fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:46.656801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c4c35c47-5b2d-4353-b415-ac38349d2fdc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:46.658035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c4c35c47-5b2d-4353-b415-ac38349d2fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:46.725290 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3944/7893] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:46.735593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:46.737050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:46.800977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8305de-2381-4643-a0cf-a0c3a6a14364 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:46.805588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d3482-7beb-4fd4-8c28-637bc3ec5769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:46.806221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d3482-7beb-4fd4-8c28-637bc3ec5769 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:46.806508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d3482-7beb-4fd4-8c28-637bc3ec5769 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:46.806859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d3482-7beb-4fd4-8c28-637bc3ec5769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:46.816879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d3482-7beb-4fd4-8c28-637bc3ec5769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:46.818313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d3482-7beb-4fd4-8c28-637bc3ec5769 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:46.822915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:46.830155 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3950/7894] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:47.024572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c35c47-5b2d-4353-b415-ac38349d2fdc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:47.026141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c4c35c47-5b2d-4353-b415-ac38349d2fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:47.041361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c35c47-5b2d-4353-b415-ac38349d2fdc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:47.046613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:47.047233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:47.047588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:47.047874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] PATH_INFO: `/v3/projects/b4a67dffc2154725b0ea590369c18b69` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:47.051221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a67dffc2154725b0ea590369c18b69)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:47.051348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:47.068239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d3482-7beb-4fd4-8c28-637bc3ec5769 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:47.069947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-212d3482-7beb-4fd4-8c28-637bc3ec5769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:47.138541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a67dffc2154725b0ea590369c18b69', 'request_id': 'req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.150415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a67dffc2154725b0ea590369c18b69', 'request_id': 'req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.158484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a67dffc2154725b0ea590369c18b69', 'request_id': 'req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.172925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] The token cache is being invalidate because project b4a67dffc2154725b0ea590369c18b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:47.173656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.175088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.179775 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3945/7895] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:47 2022] DELETE /identity/v3/projects/b4a67dffc2154725b0ea590369c18b69 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:47.183716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:47.185161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:47.186861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d3482-7beb-4fd4-8c28-637bc3ec5769 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:47.264269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167dd61-18aa-4003-a976-c042bcbae9f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:47.264890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167dd61-18aa-4003-a976-c042bcbae9f0 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:47.265169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167dd61-18aa-4003-a976-c042bcbae9f0 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:47.265443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167dd61-18aa-4003-a976-c042bcbae9f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:47.274395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0167dd61-18aa-4003-a976-c042bcbae9f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:47.279242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3c303-56c4-4a7a-9df5-5bf4e98dbbf2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:47.284724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08218fc2-ce92-4fc6-be95-2d28164f547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:47.285565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08218fc2-ce92-4fc6-be95-2d28164f547d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:47.285936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08218fc2-ce92-4fc6-be95-2d28164f547d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:47.286405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08218fc2-ce92-4fc6-be95-2d28164f547d admin admin] PATH_INFO: `/v3/users/00120e5808614d0d9f6066152147de3c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:47.287895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08218fc2-ce92-4fc6-be95-2d28164f547d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00120e5808614d0d9f6066152147de3c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:47.288072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167dd61-18aa-4003-a976-c042bcbae9f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:47.290408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167dd61-18aa-4003-a976-c042bcbae9f0 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:47.291441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08218fc2-ce92-4fc6-be95-2d28164f547d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:47.294184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:47.304048 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3951/7896] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:47.349466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-08218fc2-ce92-4fc6-be95-2d28164f547d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00120e5808614d0d9f6066152147de3c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.358785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-08218fc2-ce92-4fc6-be95-2d28164f547d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00120e5808614d0d9f6066152147de3c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.359574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-08218fc2-ce92-4fc6-be95-2d28164f547d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00120e5808614d0d9f6066152147de3c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.373787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-08218fc2-ce92-4fc6-be95-2d28164f547d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00120e5808614d0d9f6066152147de3c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.374365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-08218fc2-ce92-4fc6-be95-2d28164f547d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00120e5808614d0d9f6066152147de3c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.391199 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3946/7897] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:47 2022] DELETE /identity/v3/users/00120e5808614d0d9f6066152147de3c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:47.601613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167dd61-18aa-4003-a976-c042bcbae9f0 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:47.622247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167dd61-18aa-4003-a976-c042bcbae9f0 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:47.704040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f1c5e-08a0-4a79-998f-1eef64258858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:47.704800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f1c5e-08a0-4a79-998f-1eef64258858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:47.705090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f1c5e-08a0-4a79-998f-1eef64258858 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:47.705367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f1c5e-08a0-4a79-998f-1eef64258858 admin admin] PATH_INFO: `/v3/projects/bd025919be4546d3bc95825ce892d911` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:47.707058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f1c5e-08a0-4a79-998f-1eef64258858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd025919be4546d3bc95825ce892d911)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:47.709116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f1c5e-08a0-4a79-998f-1eef64258858 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:47.740863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:47.771640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b09f1c5e-08a0-4a79-998f-1eef64258858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd025919be4546d3bc95825ce892d911', 'request_id': 'req-b09f1c5e-08a0-4a79-998f-1eef64258858'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.779257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b09f1c5e-08a0-4a79-998f-1eef64258858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd025919be4546d3bc95825ce892d911', 'request_id': 'req-b09f1c5e-08a0-4a79-998f-1eef64258858'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.786186 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b09f1c5e-08a0-4a79-998f-1eef64258858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd025919be4546d3bc95825ce892d911', 'request_id': 'req-b09f1c5e-08a0-4a79-998f-1eef64258858'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.808194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b09f1c5e-08a0-4a79-998f-1eef64258858 admin admin] The token cache is being invalidate because project bd025919be4546d3bc95825ce892d911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:47.808194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b09f1c5e-08a0-4a79-998f-1eef64258858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.809430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b09f1c5e-08a0-4a79-998f-1eef64258858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:47.814246 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3952/7898] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:47 2022] DELETE /identity/v3/projects/bd025919be4546d3bc95825ce892d911 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:47.815985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e0e79-8891-4015-882c-c419a676b24c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:47.816771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e0e79-8891-4015-882c-c419a676b24c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:47.816771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e0e79-8891-4015-882c-c419a676b24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:47.840363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-648e0e79-8891-4015-882c-c419a676b24c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:47.841879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-648e0e79-8891-4015-882c-c419a676b24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:47.929744 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3947/7899] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:47.938602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bea1d0-baf2-4ffc-aa4e-4c18c7286494 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:47.938914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bea1d0-baf2-4ffc-aa4e-4c18c7286494 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:47.939200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bea1d0-baf2-4ffc-aa4e-4c18c7286494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:47.964063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-11bea1d0-baf2-4ffc-aa4e-4c18c7286494 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:47.965343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-11bea1d0-baf2-4ffc-aa4e-4c18c7286494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:47.979436 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3953/7900] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:47.981266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e0e79-8891-4015-882c-c419a676b24c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:48.000175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e0e79-8891-4015-882c-c419a676b24c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:48.006821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75721163-4283-440e-a05a-73fa4d3d765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:48.008555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75721163-4283-440e-a05a-73fa4d3d765f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:48.009046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75721163-4283-440e-a05a-73fa4d3d765f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:48.009623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75721163-4283-440e-a05a-73fa4d3d765f admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:48.010499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75721163-4283-440e-a05a-73fa4d3d765f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:48.010923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75721163-4283-440e-a05a-73fa4d3d765f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:48.013020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75721163-4283-440e-a05a-73fa4d3d765f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:48.031694 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3948/7901] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:48.033427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bea1d0-baf2-4ffc-aa4e-4c18c7286494 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:48.053895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bea1d0-baf2-4ffc-aa4e-4c18c7286494 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:48.060146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75db9d0-8330-4363-9cc6-a2aa799f09e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:48.060971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75db9d0-8330-4363-9cc6-a2aa799f09e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:48.061142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75db9d0-8330-4363-9cc6-a2aa799f09e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:48.061528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75db9d0-8330-4363-9cc6-a2aa799f09e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:48.062359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75db9d0-8330-4363-9cc6-a2aa799f09e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:48.064317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75db9d0-8330-4363-9cc6-a2aa799f09e3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:48.119325 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3954/7902] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:48 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:48.123987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75721163-4283-440e-a05a-73fa4d3d765f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:48.145303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75721163-4283-440e-a05a-73fa4d3d765f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:48.262585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e1860-ff86-4385-a47a-bf4f97e14908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:48.263498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1860-ff86-4385-a47a-bf4f97e14908 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:48.263771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1860-ff86-4385-a47a-bf4f97e14908 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:48.264086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e1860-ff86-4385-a47a-bf4f97e14908 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:48.264779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e1860-ff86-4385-a47a-bf4f97e14908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:48.267828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e1860-ff86-4385-a47a-bf4f97e14908 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:48.294887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:48.311596 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3949/7903] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:48 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:48.311930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75db9d0-8330-4363-9cc6-a2aa799f09e3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:48.325955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75db9d0-8330-4363-9cc6-a2aa799f09e3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:48.333021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367b6d0-ca16-42d1-af72-c13a5e2aa5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:48.334095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367b6d0-ca16-42d1-af72-c13a5e2aa5fc admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:48.334546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367b6d0-ca16-42d1-af72-c13a5e2aa5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:48.335027 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367b6d0-ca16-42d1-af72-c13a5e2aa5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:48.337626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367b6d0-ca16-42d1-af72-c13a5e2aa5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:48.340087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367b6d0-ca16-42d1-af72-c13a5e2aa5fc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:48.356381 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3955/7904] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:33:48.358002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e1860-ff86-4385-a47a-bf4f97e14908 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:48.370863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e1860-ff86-4385-a47a-bf4f97e14908 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:48.376496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a719c75-8eec-4904-92f7-0bf1278c9a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:48.377215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a719c75-8eec-4904-92f7-0bf1278c9a28 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:48.377568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a719c75-8eec-4904-92f7-0bf1278c9a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:48.377993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a719c75-8eec-4904-92f7-0bf1278c9a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:48.378653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a719c75-8eec-4904-92f7-0bf1278c9a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:48.380483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a719c75-8eec-4904-92f7-0bf1278c9a28 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:48.403882 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3950/7905] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:48.404548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367b6d0-ca16-42d1-af72-c13a5e2aa5fc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:48.418733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367b6d0-ca16-42d1-af72-c13a5e2aa5fc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:48.427512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68423c51-c73d-4743-b1a6-d441abbca5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:48.428584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68423c51-c73d-4743-b1a6-d441abbca5fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:48.430113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68423c51-c73d-4743-b1a6-d441abbca5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:48.430960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68423c51-c73d-4743-b1a6-d441abbca5fb admin admin] PATH_INFO: `/v3/projects/c0fc1b6a6abb4c3c989869aeb65fbe5b/users/5dcae79437f946ee9106ce078a13db1e/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:48.449937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68423c51-c73d-4743-b1a6-d441abbca5fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc1b6a6abb4c3c989869aeb65fbe5b, user_id=5dcae79437f946ee9106ce078a13db1e, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:48.452614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68423c51-c73d-4743-b1a6-d441abbca5fb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:48.468642 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3956/7906] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:48 2022] PUT /identity/v3/projects/c0fc1b6a6abb4c3c989869aeb65fbe5b/users/5dcae79437f946ee9106ce078a13db1e/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:48.482828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eab62-e8db-4df8-94f4-78d2af979ca4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:48.483440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eab62-e8db-4df8-94f4-78d2af979ca4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:48.483882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eab62-e8db-4df8-94f4-78d2af979ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:48.527250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bc4eab62-e8db-4df8-94f4-78d2af979ca4 None None] MFA Rules not processed for user `5dcae79437f946ee9106ce078a13db1e`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:48.529052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bc4eab62-e8db-4df8-94f4-78d2af979ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:48.640194 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3951/7907] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:48.644759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68423c51-c73d-4743-b1a6-d441abbca5fb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:48.740604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68423c51-c73d-4743-b1a6-d441abbca5fb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:48.758860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1c98a-7282-4a6e-941a-1f6e2485bb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:48.759674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1c98a-7282-4a6e-941a-1f6e2485bb91 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:48.759953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1c98a-7282-4a6e-941a-1f6e2485bb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:48.760233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1c98a-7282-4a6e-941a-1f6e2485bb91 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:48.760931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1c98a-7282-4a6e-941a-1f6e2485bb91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:48.762954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1c98a-7282-4a6e-941a-1f6e2485bb91 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:48.824027 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3957/7908] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:48 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:48.828175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4eab62-e8db-4df8-94f4-78d2af979ca4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:48.845962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4eab62-e8db-4df8-94f4-78d2af979ca4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:48.922371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721532f-6848-4631-be90-19ba76019dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:48.923125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721532f-6848-4631-be90-19ba76019dca admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:48.923482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721532f-6848-4631-be90-19ba76019dca admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:48.923829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721532f-6848-4631-be90-19ba76019dca admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:48.924710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721532f-6848-4631-be90-19ba76019dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:48.927473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721532f-6848-4631-be90-19ba76019dca admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:48.956864 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3952/7909] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:48 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:33:48.961057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1c98a-7282-4a6e-941a-1f6e2485bb91 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:48.972474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1c98a-7282-4a6e-941a-1f6e2485bb91 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:48.977734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb480cf1-8e19-445b-bfbd-4038e34a23ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:48.978359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb480cf1-8e19-445b-bfbd-4038e34a23ad admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:48.978803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb480cf1-8e19-445b-bfbd-4038e34a23ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:48.979091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb480cf1-8e19-445b-bfbd-4038e34a23ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:48.979753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb480cf1-8e19-445b-bfbd-4038e34a23ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:48.981866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb480cf1-8e19-445b-bfbd-4038e34a23ad admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:48.994080 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3958/7910] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:48.998303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721532f-6848-4631-be90-19ba76019dca admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:49.013969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721532f-6848-4631-be90-19ba76019dca admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:49.023171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4ba40-a1ec-4ecb-95b4-3e9c82ae62a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:49.024015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4ba40-a1ec-4ecb-95b4-3e9c82ae62a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:49.024210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4ba40-a1ec-4ecb-95b4-3e9c82ae62a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:49.024539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4ba40-a1ec-4ecb-95b4-3e9c82ae62a9 admin admin] PATH_INFO: `/v3/projects/a142f288c93a4f2abef26218f2e109b3/users/d2edd7c4586f4dffa14788e9bb2f21f2/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:49.042727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4ba40-a1ec-4ecb-95b4-3e9c82ae62a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a142f288c93a4f2abef26218f2e109b3, user_id=d2edd7c4586f4dffa14788e9bb2f21f2, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:49.045807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4ba40-a1ec-4ecb-95b4-3e9c82ae62a9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:49.061704 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3953/7911] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:48 2022] PUT /identity/v3/projects/a142f288c93a4f2abef26218f2e109b3/users/d2edd7c4586f4dffa14788e9bb2f21f2/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:49.065491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb480cf1-8e19-445b-bfbd-4038e34a23ad admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:49.076808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb480cf1-8e19-445b-bfbd-4038e34a23ad admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:49.096480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:49.140938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a47c4-7461-4425-a07c-71b7d2e68a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:49.141938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a47c4-7461-4425-a07c-71b7d2e68a64 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:49.142398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a47c4-7461-4425-a07c-71b7d2e68a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:49.142537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a47c4-7461-4425-a07c-71b7d2e68a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:49.143182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a47c4-7461-4425-a07c-71b7d2e68a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:49.144842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a47c4-7461-4425-a07c-71b7d2e68a64 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:49.155792 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3959/7912] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:49.159958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4ba40-a1ec-4ecb-95b4-3e9c82ae62a9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:49.171512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4ba40-a1ec-4ecb-95b4-3e9c82ae62a9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:49.176439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7701aea-a162-4969-a1e7-c5e7eba88cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:49.184142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7701aea-a162-4969-a1e7-c5e7eba88cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:49.184474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7701aea-a162-4969-a1e7-c5e7eba88cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:49.184762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7701aea-a162-4969-a1e7-c5e7eba88cf5 admin admin] PATH_INFO: `/v3/projects/a142f288c93a4f2abef26218f2e109b3/users/d2edd7c4586f4dffa14788e9bb2f21f2/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:49.202918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7701aea-a162-4969-a1e7-c5e7eba88cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a142f288c93a4f2abef26218f2e109b3, user_id=d2edd7c4586f4dffa14788e9bb2f21f2, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:49.202918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7701aea-a162-4969-a1e7-c5e7eba88cf5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:49.209781 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3954/7913] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:49 2022] PUT /identity/v3/projects/a142f288c93a4f2abef26218f2e109b3/users/d2edd7c4586f4dffa14788e9bb2f21f2/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:33:49.221037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b99fb-48bc-4f47-b615-de9fe7761242 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:49.221328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b99fb-48bc-4f47-b615-de9fe7761242 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:49.221608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b99fb-48bc-4f47-b615-de9fe7761242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:49.250842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b54b99fb-48bc-4f47-b615-de9fe7761242 None None] MFA Rules not processed for user `d2edd7c4586f4dffa14788e9bb2f21f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:49.251982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b54b99fb-48bc-4f47-b615-de9fe7761242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:49.323115 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3960/7914] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:49.333119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7701aea-a162-4969-a1e7-c5e7eba88cf5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:49.334920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b7701aea-a162-4969-a1e7-c5e7eba88cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:49.368789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:49.401647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7701aea-a162-4969-a1e7-c5e7eba88cf5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:49.405369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae023f07-1f55-456d-93f2-e8c5039d4be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:49.405990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae023f07-1f55-456d-93f2-e8c5039d4be3 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:49.406276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae023f07-1f55-456d-93f2-e8c5039d4be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:49.406553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae023f07-1f55-456d-93f2-e8c5039d4be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:49.416425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae023f07-1f55-456d-93f2-e8c5039d4be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:49.417913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae023f07-1f55-456d-93f2-e8c5039d4be3 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:49.430131 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3955/7915] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:50.320533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b99fb-48bc-4f47-b615-de9fe7761242 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:50.322502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b54b99fb-48bc-4f47-b615-de9fe7761242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:50.417463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b99fb-48bc-4f47-b615-de9fe7761242 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:50.424610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099bbcf-813b-4705-b3f9-97eed2f99911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:50.425301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099bbcf-813b-4705-b3f9-97eed2f99911 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:50.425577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099bbcf-813b-4705-b3f9-97eed2f99911 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:50.425947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099bbcf-813b-4705-b3f9-97eed2f99911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:50.428012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6099bbcf-813b-4705-b3f9-97eed2f99911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:50.475317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:50.495715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099bbcf-813b-4705-b3f9-97eed2f99911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:50.497554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099bbcf-813b-4705-b3f9-97eed2f99911 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:50.509318 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3961/7916] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:51.363237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae023f07-1f55-456d-93f2-e8c5039d4be3 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:51.431564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae023f07-1f55-456d-93f2-e8c5039d4be3 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:51.436004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:51.436652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:51.436914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:51.437183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] PATH_INFO: `/v3/users/5dcae79437f946ee9106ce078a13db1e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:51.438303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dcae79437f946ee9106ce078a13db1e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:51.440249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:51.493496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dcae79437f946ee9106ce078a13db1e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:51.501606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dcae79437f946ee9106ce078a13db1e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:51.502399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dcae79437f946ee9106ce078a13db1e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:51.516301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dcae79437f946ee9106ce078a13db1e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:51.517049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dcae79437f946ee9106ce078a13db1e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:51.532073 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3956/7917] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:51 2022] DELETE /identity/v3/users/5dcae79437f946ee9106ce078a13db1e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:51.536745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e6e2c-b26b-4b9c-b6c2-0beb1af9e481 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:51.537227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e6e2c-b26b-4b9c-b6c2-0beb1af9e481 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:51.537339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e6e2c-b26b-4b9c-b6c2-0beb1af9e481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:51.558497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c54e6e2c-b26b-4b9c-b6c2-0beb1af9e481 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:51.560640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c54e6e2c-b26b-4b9c-b6c2-0beb1af9e481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:51.630797 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3962/7918] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:33:51.642433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:51.644289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:51.715158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b207c-b031-47d6-837f-373be3f99fde admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:51.719009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cdad9-b109-453c-b889-8cdca3ef9caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:51.719718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cdad9-b109-453c-b889-8cdca3ef9caa service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:51.720011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cdad9-b109-453c-b889-8cdca3ef9caa service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:51.720287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cdad9-b109-453c-b889-8cdca3ef9caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:51.726969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:51.732296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cdad9-b109-453c-b889-8cdca3ef9caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:51.734126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cdad9-b109-453c-b889-8cdca3ef9caa service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:51.745512 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3957/7919] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:33:52.024167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e6e2c-b26b-4b9c-b6c2-0beb1af9e481 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:52.025599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c54e6e2c-b26b-4b9c-b6c2-0beb1af9e481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:52.041011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e6e2c-b26b-4b9c-b6c2-0beb1af9e481 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:52.046872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:52.047515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:52.047788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:52.048067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] PATH_INFO: `/v3/projects/c0fc1b6a6abb4c3c989869aeb65fbe5b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:52.049209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0fc1b6a6abb4c3c989869aeb65fbe5b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:52.051454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:52.100637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0fc1b6a6abb4c3c989869aeb65fbe5b', 'request_id': 'req-e78af4de-e91e-471f-8747-3541d58132da'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.106864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0fc1b6a6abb4c3c989869aeb65fbe5b', 'request_id': 'req-e78af4de-e91e-471f-8747-3541d58132da'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.113108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0fc1b6a6abb4c3c989869aeb65fbe5b', 'request_id': 'req-e78af4de-e91e-471f-8747-3541d58132da'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.128578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] The token cache is being invalidate because project c0fc1b6a6abb4c3c989869aeb65fbe5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:52.128872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.129508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.131062 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3963/7920] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:52 2022] DELETE /identity/v3/projects/c0fc1b6a6abb4c3c989869aeb65fbe5b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:52.136089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cdad9-b109-453c-b889-8cdca3ef9caa service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:52.146142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cdad9-b109-453c-b889-8cdca3ef9caa service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:52.204563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ae7d2-ca8e-4f05-b459-c26571698adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:52.205061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ae7d2-ca8e-4f05-b459-c26571698adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:52.205348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ae7d2-ca8e-4f05-b459-c26571698adb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:52.205625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ae7d2-ca8e-4f05-b459-c26571698adb admin admin] PATH_INFO: `/v3/users/d2edd7c4586f4dffa14788e9bb2f21f2` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:52.206804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ae7d2-ca8e-4f05-b459-c26571698adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2edd7c4586f4dffa14788e9bb2f21f2)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:52.208741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ae7d2-ca8e-4f05-b459-c26571698adb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:52.254600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fd5ae7d2-ca8e-4f05-b459-c26571698adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2edd7c4586f4dffa14788e9bb2f21f2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.262728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fd5ae7d2-ca8e-4f05-b459-c26571698adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2edd7c4586f4dffa14788e9bb2f21f2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.263425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fd5ae7d2-ca8e-4f05-b459-c26571698adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2edd7c4586f4dffa14788e9bb2f21f2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.276184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fd5ae7d2-ca8e-4f05-b459-c26571698adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2edd7c4586f4dffa14788e9bb2f21f2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.276823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fd5ae7d2-ca8e-4f05-b459-c26571698adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2edd7c4586f4dffa14788e9bb2f21f2'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.289843 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3958/7921] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:33:52 2022] DELETE /identity/v3/users/d2edd7c4586f4dffa14788e9bb2f21f2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:52.463172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:52.464701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:52.484856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78af4de-e91e-471f-8747-3541d58132da admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:52.546883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a677f7-429d-4c19-b48d-f35a127cafb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:52.547751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a677f7-429d-4c19-b48d-f35a127cafb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:52.547840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a677f7-429d-4c19-b48d-f35a127cafb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:52.548113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a677f7-429d-4c19-b48d-f35a127cafb4 admin admin] PATH_INFO: `/v3/projects/a142f288c93a4f2abef26218f2e109b3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:52.549655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a677f7-429d-4c19-b48d-f35a127cafb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a142f288c93a4f2abef26218f2e109b3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:52.551381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a677f7-429d-4c19-b48d-f35a127cafb4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:52.558932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:52.613122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4a677f7-429d-4c19-b48d-f35a127cafb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a142f288c93a4f2abef26218f2e109b3', 'request_id': 'req-e4a677f7-429d-4c19-b48d-f35a127cafb4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.619704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4a677f7-429d-4c19-b48d-f35a127cafb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a142f288c93a4f2abef26218f2e109b3', 'request_id': 'req-e4a677f7-429d-4c19-b48d-f35a127cafb4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.626171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4a677f7-429d-4c19-b48d-f35a127cafb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a142f288c93a4f2abef26218f2e109b3', 'request_id': 'req-e4a677f7-429d-4c19-b48d-f35a127cafb4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.639527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4a677f7-429d-4c19-b48d-f35a127cafb4 admin admin] The token cache is being invalidate because project a142f288c93a4f2abef26218f2e109b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:33:52.639847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4a677f7-429d-4c19-b48d-f35a127cafb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.640460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4a677f7-429d-4c19-b48d-f35a127cafb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:33:52.641932 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3964/7922] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:33:52 2022] DELETE /identity/v3/projects/a142f288c93a4f2abef26218f2e109b3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:52.646832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e78a0-308e-4094-a7dc-6f7ae1d7adc4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:52.647286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e78a0-308e-4094-a7dc-6f7ae1d7adc4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:52.647414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e78a0-308e-4094-a7dc-6f7ae1d7adc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:52.667768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f82e78a0-308e-4094-a7dc-6f7ae1d7adc4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:52.668979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f82e78a0-308e-4094-a7dc-6f7ae1d7adc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:52.738584 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3959/7923] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:52.746883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffdbeb-f9b7-42cf-adcb-a8f488397fa9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:52.747236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffdbeb-f9b7-42cf-adcb-a8f488397fa9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:52.747519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffdbeb-f9b7-42cf-adcb-a8f488397fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:52.768496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a0ffdbeb-f9b7-42cf-adcb-a8f488397fa9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:52.769716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a0ffdbeb-f9b7-42cf-adcb-a8f488397fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:52.778147 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3965/7924] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:52.782202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e78a0-308e-4094-a7dc-6f7ae1d7adc4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:52.792939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e78a0-308e-4094-a7dc-6f7ae1d7adc4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:52.797633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f987-0de7-4bfb-8c44-6544f509fa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:52.798252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f987-0de7-4bfb-8c44-6544f509fa7b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:52.798538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f987-0de7-4bfb-8c44-6544f509fa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:52.798847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f987-0de7-4bfb-8c44-6544f509fa7b admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:52.799508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62f987-0de7-4bfb-8c44-6544f509fa7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:33:52.799820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62f987-0de7-4bfb-8c44-6544f509fa7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:52.801438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62f987-0de7-4bfb-8c44-6544f509fa7b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:52.811170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:33:52.817647 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3960/7925] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:33:52.822168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffdbeb-f9b7-42cf-adcb-a8f488397fa9 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:52.832093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffdbeb-f9b7-42cf-adcb-a8f488397fa9 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:52.837127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afd857-6484-4f1e-83ee-df8fc98b1855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:52.837741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd857-6484-4f1e-83ee-df8fc98b1855 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:52.838025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd857-6484-4f1e-83ee-df8fc98b1855 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:52.838301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd857-6484-4f1e-83ee-df8fc98b1855 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:52.838960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afd857-6484-4f1e-83ee-df8fc98b1855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:52.840873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afd857-6484-4f1e-83ee-df8fc98b1855 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:52.870021 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3966/7926] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:33:52 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:52.874316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f987-0de7-4bfb-8c44-6544f509fa7b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:52.885124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f987-0de7-4bfb-8c44-6544f509fa7b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:52.945287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb13960-91d7-4e08-9a04-6cd181f7d027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:52.945892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13960-91d7-4e08-9a04-6cd181f7d027 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:52.946177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13960-91d7-4e08-9a04-6cd181f7d027 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:52.946454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13960-91d7-4e08-9a04-6cd181f7d027 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:52.947126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb13960-91d7-4e08-9a04-6cd181f7d027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:52.949048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb13960-91d7-4e08-9a04-6cd181f7d027 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:52.969917 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3961/7927] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:33:52 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:33:52.974242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afd857-6484-4f1e-83ee-df8fc98b1855 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:52.985293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afd857-6484-4f1e-83ee-df8fc98b1855 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:52.990008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6021ddc-082f-448e-8678-fd42e06386d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:52.990624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6021ddc-082f-448e-8678-fd42e06386d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:52.990945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6021ddc-082f-448e-8678-fd42e06386d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:52.991221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6021ddc-082f-448e-8678-fd42e06386d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:52.992668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6021ddc-082f-448e-8678-fd42e06386d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:52.994310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6021ddc-082f-448e-8678-fd42e06386d2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:53.004270 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3967/7928] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:53.008549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb13960-91d7-4e08-9a04-6cd181f7d027 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:53.018778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb13960-91d7-4e08-9a04-6cd181f7d027 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:53.023545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e8c17-f006-40bb-8a93-f1992829cdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:53.024146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e8c17-f006-40bb-8a93-f1992829cdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:53.024433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e8c17-f006-40bb-8a93-f1992829cdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:53.024715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e8c17-f006-40bb-8a93-f1992829cdb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:53.025422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e8c17-f006-40bb-8a93-f1992829cdb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:53.027108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e8c17-f006-40bb-8a93-f1992829cdb1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:53.037731 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3962/7929] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:33:53.042424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6021ddc-082f-448e-8678-fd42e06386d2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:53.052579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6021ddc-082f-448e-8678-fd42e06386d2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:53.058273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96736f96-f7ae-4616-9b6a-5dcbde79e7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:53.058960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96736f96-f7ae-4616-9b6a-5dcbde79e7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:53.059247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96736f96-f7ae-4616-9b6a-5dcbde79e7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:53.059525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96736f96-f7ae-4616-9b6a-5dcbde79e7b0 admin admin] PATH_INFO: `/v3/projects/7962ab3d71924e2282a8087f07f8e33e/users/bc01488d127d4ab2a09993e41f0ff77d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:53.074227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96736f96-f7ae-4616-9b6a-5dcbde79e7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7962ab3d71924e2282a8087f07f8e33e, user_id=bc01488d127d4ab2a09993e41f0ff77d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:53.076906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96736f96-f7ae-4616-9b6a-5dcbde79e7b0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:53.089896 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3968/7930] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:33:53 2022] PUT /identity/v3/projects/7962ab3d71924e2282a8087f07f8e33e/users/bc01488d127d4ab2a09993e41f0ff77d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:33:53.101518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca78382-ca09-4158-9002-e9c5fc6e9d16 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:53.101929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca78382-ca09-4158-9002-e9c5fc6e9d16 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:53.102216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca78382-ca09-4158-9002-e9c5fc6e9d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:53.131074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bca78382-ca09-4158-9002-e9c5fc6e9d16 None None] MFA Rules not processed for user `bc01488d127d4ab2a09993e41f0ff77d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:33:53.132546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bca78382-ca09-4158-9002-e9c5fc6e9d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:53.196426 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3963/7931] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:33:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:33:53.206860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96736f96-f7ae-4616-9b6a-5dcbde79e7b0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:33:53.208557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-96736f96-f7ae-4616-9b6a-5dcbde79e7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:33:53.267177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96736f96-f7ae-4616-9b6a-5dcbde79e7b0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:33:53.271081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a0047-d846-4c0c-b6da-a959802d5e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:33:53.271684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a0047-d846-4c0c-b6da-a959802d5e4c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:33:53.271967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a0047-d846-4c0c-b6da-a959802d5e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:33:53.272243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a0047-d846-4c0c-b6da-a959802d5e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:33:53.282232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a0047-d846-4c0c-b6da-a959802d5e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:33:53.283687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a0047-d846-4c0c-b6da-a959802d5e4c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:33:53.293369 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3969/7932] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:33:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:03.193576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:03.289064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:04.778711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca78382-ca09-4158-9002-e9c5fc6e9d16 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:04.843966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca78382-ca09-4158-9002-e9c5fc6e9d16 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:04.848496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:04.849134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:04.849415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:04.849689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] PATH_INFO: `/v3/users/bc01488d127d4ab2a09993e41f0ff77d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:04.851711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc01488d127d4ab2a09993e41f0ff77d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:04.853757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:04.900824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc01488d127d4ab2a09993e41f0ff77d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:04.908005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc01488d127d4ab2a09993e41f0ff77d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:04.908687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc01488d127d4ab2a09993e41f0ff77d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:04.921580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc01488d127d4ab2a09993e41f0ff77d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:04.922268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc01488d127d4ab2a09993e41f0ff77d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:04.936313 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3964/7933] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:34:04 2022] DELETE /identity/v3/users/bc01488d127d4ab2a09993e41f0ff77d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:04.940890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6e37b-466c-44b1-ba5b-ca1c6c1fae55 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:04.941360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6e37b-466c-44b1-ba5b-ca1c6c1fae55 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:04.941480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6e37b-466c-44b1-ba5b-ca1c6c1fae55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:04.961241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-aba6e37b-466c-44b1-ba5b-ca1c6c1fae55 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:04.962456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aba6e37b-466c-44b1-ba5b-ca1c6c1fae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:05.024491 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3970/7934] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:34:05.034223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:05.035694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:05.096846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1a660-1731-4533-b1e8-d739acc46e8d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:05.101046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edff11f-2a81-45be-89ce-4ed9daf18173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:05.102086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff11f-2a81-45be-89ce-4ed9daf18173 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:05.102414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff11f-2a81-45be-89ce-4ed9daf18173 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:05.102709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff11f-2a81-45be-89ce-4ed9daf18173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:05.112029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edff11f-2a81-45be-89ce-4ed9daf18173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:05.113514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edff11f-2a81-45be-89ce-4ed9daf18173 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:05.124168 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3965/7935] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:05.301154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6e37b-466c-44b1-ba5b-ca1c6c1fae55 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:05.302602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aba6e37b-466c-44b1-ba5b-ca1c6c1fae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:05.315097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6e37b-466c-44b1-ba5b-ca1c6c1fae55 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:05.319969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e05d06-43b3-4fae-95b3-03b1df83e803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:05.320603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e05d06-43b3-4fae-95b3-03b1df83e803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:05.320887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e05d06-43b3-4fae-95b3-03b1df83e803 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:05.321159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e05d06-43b3-4fae-95b3-03b1df83e803 admin admin] PATH_INFO: `/v3/projects/7962ab3d71924e2282a8087f07f8e33e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:05.322970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e05d06-43b3-4fae-95b3-03b1df83e803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7962ab3d71924e2282a8087f07f8e33e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:05.324896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e05d06-43b3-4fae-95b3-03b1df83e803 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:05.374965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-89e05d06-43b3-4fae-95b3-03b1df83e803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7962ab3d71924e2282a8087f07f8e33e', 'request_id': 'req-89e05d06-43b3-4fae-95b3-03b1df83e803'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:05.380403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-89e05d06-43b3-4fae-95b3-03b1df83e803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7962ab3d71924e2282a8087f07f8e33e', 'request_id': 'req-89e05d06-43b3-4fae-95b3-03b1df83e803'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:05.386819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-89e05d06-43b3-4fae-95b3-03b1df83e803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7962ab3d71924e2282a8087f07f8e33e', 'request_id': 'req-89e05d06-43b3-4fae-95b3-03b1df83e803'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:05.400288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-89e05d06-43b3-4fae-95b3-03b1df83e803 admin admin] The token cache is being invalidate because project 7962ab3d71924e2282a8087f07f8e33e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:34:05.400584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-89e05d06-43b3-4fae-95b3-03b1df83e803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:05.401220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-89e05d06-43b3-4fae-95b3-03b1df83e803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:05.402705 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3971/7936] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:34:05 2022] DELETE /identity/v3/projects/7962ab3d71924e2282a8087f07f8e33e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:34:05.408262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbca8e-d586-4502-a755-ac47fa524dd3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:05.408645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbca8e-d586-4502-a755-ac47fa524dd3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:05.408863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbca8e-d586-4502-a755-ac47fa524dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:05.429188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7cbbca8e-d586-4502-a755-ac47fa524dd3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:05.430393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7cbbca8e-d586-4502-a755-ac47fa524dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:05.451773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:05.501195 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3966/7937] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:05.509755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc875f89-760d-498f-83b1-78d58eed95ac None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:05.510054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc875f89-760d-498f-83b1-78d58eed95ac None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:05.510337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc875f89-760d-498f-83b1-78d58eed95ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:05.531536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fc875f89-760d-498f-83b1-78d58eed95ac None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:05.532784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fc875f89-760d-498f-83b1-78d58eed95ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:05.541272 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3972/7938] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:05.545536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbca8e-d586-4502-a755-ac47fa524dd3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:05.555847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbca8e-d586-4502-a755-ac47fa524dd3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:05.560662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e4e37-bfb7-4140-9e4a-3d44c5d618fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:05.561544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e4e37-bfb7-4140-9e4a-3d44c5d618fd admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:05.562119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e4e37-bfb7-4140-9e4a-3d44c5d618fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:05.562851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e4e37-bfb7-4140-9e4a-3d44c5d618fd admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:05.563535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e4e37-bfb7-4140-9e4a-3d44c5d618fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:34:05.563848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e4e37-bfb7-4140-9e4a-3d44c5d618fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:05.565639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e4e37-bfb7-4140-9e4a-3d44c5d618fd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:05.593676 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3967/7939] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:34:05.595119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc875f89-760d-498f-83b1-78d58eed95ac None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:05.604788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc875f89-760d-498f-83b1-78d58eed95ac None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:05.609479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe767c36-22eb-4a06-bd43-86cba01e5b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:05.610067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe767c36-22eb-4a06-bd43-86cba01e5b3f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:05.610344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe767c36-22eb-4a06-bd43-86cba01e5b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:05.610615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe767c36-22eb-4a06-bd43-86cba01e5b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:05.611300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe767c36-22eb-4a06-bd43-86cba01e5b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:05.613187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe767c36-22eb-4a06-bd43-86cba01e5b3f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:05.641434 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3973/7940] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:34:05 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:05.645832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e4e37-bfb7-4140-9e4a-3d44c5d618fd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:05.657174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e4e37-bfb7-4140-9e4a-3d44c5d618fd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:05.722240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38031f2e-9602-4baa-928f-df2af0e497f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:05.723049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031f2e-9602-4baa-928f-df2af0e497f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:05.723490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031f2e-9602-4baa-928f-df2af0e497f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:05.723833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031f2e-9602-4baa-928f-df2af0e497f1 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:05.724539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38031f2e-9602-4baa-928f-df2af0e497f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:05.726811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38031f2e-9602-4baa-928f-df2af0e497f1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:05.750531 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3968/7941] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:34:05 2022] POST /identity/v3/users => generated 281 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:05.754987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe767c36-22eb-4a06-bd43-86cba01e5b3f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:05.767136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe767c36-22eb-4a06-bd43-86cba01e5b3f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:05.772220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac39a52-3a48-4f2f-b782-2b04ee851a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:05.773459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac39a52-3a48-4f2f-b782-2b04ee851a21 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:05.773732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac39a52-3a48-4f2f-b782-2b04ee851a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:05.774005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac39a52-3a48-4f2f-b782-2b04ee851a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:05.774640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac39a52-3a48-4f2f-b782-2b04ee851a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:05.776252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac39a52-3a48-4f2f-b782-2b04ee851a21 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:05.787349 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3974/7942] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:34:05.791653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38031f2e-9602-4baa-928f-df2af0e497f1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:05.802175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38031f2e-9602-4baa-928f-df2af0e497f1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:05.807249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63ca61-66d3-4736-a388-2f5fbd007e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:05.807885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63ca61-66d3-4736-a388-2f5fbd007e11 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:05.808155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63ca61-66d3-4736-a388-2f5fbd007e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:05.808437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63ca61-66d3-4736-a388-2f5fbd007e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:05.809078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63ca61-66d3-4736-a388-2f5fbd007e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:05.810929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63ca61-66d3-4736-a388-2f5fbd007e11 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:05.831347 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3969/7943] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:34:05.836651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac39a52-3a48-4f2f-b782-2b04ee851a21 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:05.847212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac39a52-3a48-4f2f-b782-2b04ee851a21 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:05.852590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530252e3-d780-40f0-9c85-4f79b135711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:05.853249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530252e3-d780-40f0-9c85-4f79b135711f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:05.853596 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530252e3-d780-40f0-9c85-4f79b135711f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:05.853888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530252e3-d780-40f0-9c85-4f79b135711f admin admin] PATH_INFO: `/v3/projects/c372e1d51a184ae094d9a4ce0eec39b2/users/fe4e11d7b36f4f78a42895487ab53254/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:05.870249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530252e3-d780-40f0-9c85-4f79b135711f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c372e1d51a184ae094d9a4ce0eec39b2, user_id=fe4e11d7b36f4f78a42895487ab53254, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:05.872915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530252e3-d780-40f0-9c85-4f79b135711f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:05.886801 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3975/7944] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:34:05 2022] PUT /identity/v3/projects/c372e1d51a184ae094d9a4ce0eec39b2/users/fe4e11d7b36f4f78a42895487ab53254/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:05.898344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a900a-9b15-496c-9c10-28b3d5d76cd9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:05.898344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a900a-9b15-496c-9c10-28b3d5d76cd9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:05.898946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a900a-9b15-496c-9c10-28b3d5d76cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:05.929945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e38a900a-9b15-496c-9c10-28b3d5d76cd9 None None] MFA Rules not processed for user `fe4e11d7b36f4f78a42895487ab53254`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:05.931515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e38a900a-9b15-496c-9c10-28b3d5d76cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:06.024682 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3970/7945] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:06.036762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530252e3-d780-40f0-9c85-4f79b135711f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:06.038724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-530252e3-d780-40f0-9c85-4f79b135711f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:06.061395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:06.103914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530252e3-d780-40f0-9c85-4f79b135711f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:06.108190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4233c-292c-4993-989b-a0504af40829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:06.108997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4233c-292c-4993-989b-a0504af40829 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:06.109322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4233c-292c-4993-989b-a0504af40829 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:06.109665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4233c-292c-4993-989b-a0504af40829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:06.120083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4233c-292c-4993-989b-a0504af40829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:06.121955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4233c-292c-4993-989b-a0504af40829 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:06.133010 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3976/7946] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:08.859821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f098b-dffe-4d52-8489-b5d3275cd464 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:08.860330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f098b-dffe-4d52-8489-b5d3275cd464 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:08.860461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f098b-dffe-4d52-8489-b5d3275cd464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:08.881930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-206f098b-dffe-4d52-8489-b5d3275cd464 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:08.883310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-206f098b-dffe-4d52-8489-b5d3275cd464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:08.898092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:08.952862 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3971/7947] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:34:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:09.005992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4233c-292c-4993-989b-a0504af40829 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:09.008408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-50b4233c-292c-4993-989b-a0504af40829 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:09.087708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4233c-292c-4993-989b-a0504af40829 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:09.093170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a78c07-e56f-44ed-b593-04781967f73f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:09.093810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a78c07-e56f-44ed-b593-04781967f73f service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:09.094135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a78c07-e56f-44ed-b593-04781967f73f service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:09.094410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a78c07-e56f-44ed-b593-04781967f73f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:09.104724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a78c07-e56f-44ed-b593-04781967f73f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:09.106345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a78c07-e56f-44ed-b593-04781967f73f service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:09.116539 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3977/7948] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:34:14.482763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f098b-dffe-4d52-8489-b5d3275cd464 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:14.564811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f098b-dffe-4d52-8489-b5d3275cd464 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:14.571769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:14.572423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:14.572710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:14.572994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] PATH_INFO: `/v3/users/fe4e11d7b36f4f78a42895487ab53254` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:14.574154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe4e11d7b36f4f78a42895487ab53254)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:14.576567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:14.644761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe4e11d7b36f4f78a42895487ab53254'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:14.653769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe4e11d7b36f4f78a42895487ab53254'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:14.654583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe4e11d7b36f4f78a42895487ab53254'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:14.671421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe4e11d7b36f4f78a42895487ab53254'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:14.672181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe4e11d7b36f4f78a42895487ab53254'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:14.693581 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3972/7949] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:34:14 2022] DELETE /identity/v3/users/fe4e11d7b36f4f78a42895487ab53254 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:14.698597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aed6c-85bc-40d6-b0a5-efaab64016f0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:14.699331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aed6c-85bc-40d6-b0a5-efaab64016f0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:14.699331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aed6c-85bc-40d6-b0a5-efaab64016f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:14.723272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-db2aed6c-85bc-40d6-b0a5-efaab64016f0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:14.724544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-db2aed6c-85bc-40d6-b0a5-efaab64016f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:14.796579 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3978/7950] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:14.809266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:14.811636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:14.876955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:14.893633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6c61c-d5d4-461e-a24c-8323437b717a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:14.899873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cc55d-6f03-46ab-b695-69b75b7e3f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:14.901076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc55d-6f03-46ab-b695-69b75b7e3f8c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:14.901538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc55d-6f03-46ab-b695-69b75b7e3f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:14.901821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc55d-6f03-46ab-b695-69b75b7e3f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:14.913454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cc55d-6f03-46ab-b695-69b75b7e3f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:14.915531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cc55d-6f03-46ab-b695-69b75b7e3f8c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:14.927470 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3973/7951] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:15.130708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aed6c-85bc-40d6-b0a5-efaab64016f0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:15.133010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-db2aed6c-85bc-40d6-b0a5-efaab64016f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:15.150147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aed6c-85bc-40d6-b0a5-efaab64016f0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:15.171741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:15.172454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:15.172741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:15.173071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e admin admin] PATH_INFO: `/v3/projects/c372e1d51a184ae094d9a4ce0eec39b2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:15.174462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c372e1d51a184ae094d9a4ce0eec39b2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:15.176636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:15.274117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:15.275911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c372e1d51a184ae094d9a4ce0eec39b2', 'request_id': 'req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:15.283470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c372e1d51a184ae094d9a4ce0eec39b2', 'request_id': 'req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:15.292302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c372e1d51a184ae094d9a4ce0eec39b2', 'request_id': 'req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:15.306278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e admin admin] The token cache is being invalidate because project c372e1d51a184ae094d9a4ce0eec39b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:34:15.306574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:15.307230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dd4f19a4-cb8f-4fe1-b529-89fcfd387a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:15.308851 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3979/7952] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:34:15 2022] DELETE /identity/v3/projects/c372e1d51a184ae094d9a4ce0eec39b2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:15.314102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cedd85-b0a9-443a-8851-b6defea2dcfd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:15.314330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cedd85-b0a9-443a-8851-b6defea2dcfd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:15.314600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cedd85-b0a9-443a-8851-b6defea2dcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:15.336436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c8cedd85-b0a9-443a-8851-b6defea2dcfd None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:15.337744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c8cedd85-b0a9-443a-8851-b6defea2dcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:15.412484 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3974/7953] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:34:15.422774 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778f48e-c334-43c0-a240-6d6b835b6374 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:15.423395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778f48e-c334-43c0-a240-6d6b835b6374 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:15.423929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778f48e-c334-43c0-a240-6d6b835b6374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:15.447106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3778f48e-c334-43c0-a240-6d6b835b6374 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:15.448463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3778f48e-c334-43c0-a240-6d6b835b6374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:15.457037 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3980/7954] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:34:15.461537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cedd85-b0a9-443a-8851-b6defea2dcfd None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:15.472211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cedd85-b0a9-443a-8851-b6defea2dcfd None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:15.477829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516bbe0-589a-4a14-bf2b-4f30b58c949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:15.478549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516bbe0-589a-4a14-bf2b-4f30b58c949a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:15.478981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516bbe0-589a-4a14-bf2b-4f30b58c949a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:15.479356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516bbe0-589a-4a14-bf2b-4f30b58c949a admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:15.480139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516bbe0-589a-4a14-bf2b-4f30b58c949a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:34:15.480535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516bbe0-589a-4a14-bf2b-4f30b58c949a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:15.482200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516bbe0-589a-4a14-bf2b-4f30b58c949a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:15.499217 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3975/7955] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:34:15.500339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778f48e-c334-43c0-a240-6d6b835b6374 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:15.512425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778f48e-c334-43c0-a240-6d6b835b6374 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:15.519111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34416-22c2-4527-a041-07b0656065e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:15.520237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34416-22c2-4527-a041-07b0656065e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:15.520827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34416-22c2-4527-a041-07b0656065e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:15.521403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34416-22c2-4527-a041-07b0656065e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:15.522638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b34416-22c2-4527-a041-07b0656065e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:15.524888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b34416-22c2-4527-a041-07b0656065e1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:15.586915 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3981/7956] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:34:15 2022] POST /identity/v3/projects => generated 353 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:34:15.591978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516bbe0-589a-4a14-bf2b-4f30b58c949a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:15.606804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516bbe0-589a-4a14-bf2b-4f30b58c949a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:15.692054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819e5e1-b4dd-45f7-9d3c-f20de6b57eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:15.692969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819e5e1-b4dd-45f7-9d3c-f20de6b57eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:15.693268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819e5e1-b4dd-45f7-9d3c-f20de6b57eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:15.693604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819e5e1-b4dd-45f7-9d3c-f20de6b57eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:15.695321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819e5e1-b4dd-45f7-9d3c-f20de6b57eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:15.701104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819e5e1-b4dd-45f7-9d3c-f20de6b57eb8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:15.735724 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3976/7957] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:34:15 2022] POST /identity/v3/users => generated 277 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:15.737028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34416-22c2-4527-a041-07b0656065e1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:15.750812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34416-22c2-4527-a041-07b0656065e1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:15.758365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b403b4e-5c1c-4817-9f06-2487181fc63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:15.759608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b403b4e-5c1c-4817-9f06-2487181fc63a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:15.759895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b403b4e-5c1c-4817-9f06-2487181fc63a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:15.760174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b403b4e-5c1c-4817-9f06-2487181fc63a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:15.760988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b403b4e-5c1c-4817-9f06-2487181fc63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:15.763351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b403b4e-5c1c-4817-9f06-2487181fc63a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:15.781059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819e5e1-b4dd-45f7-9d3c-f20de6b57eb8 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:15.784008 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3982/7958] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:34:15.792978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819e5e1-b4dd-45f7-9d3c-f20de6b57eb8 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:15.807469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04248f-325a-4944-8e9b-2f185803ce4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:15.808233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04248f-325a-4944-8e9b-2f185803ce4e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:15.808618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04248f-325a-4944-8e9b-2f185803ce4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:15.809128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04248f-325a-4944-8e9b-2f185803ce4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:15.809896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04248f-325a-4944-8e9b-2f185803ce4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:15.811619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04248f-325a-4944-8e9b-2f185803ce4e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:15.830332 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3977/7959] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:34:15.834469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b403b4e-5c1c-4817-9f06-2487181fc63a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:15.845741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b403b4e-5c1c-4817-9f06-2487181fc63a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:15.851541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f895f2-db88-4ea6-b65d-3c6ffc0c9fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:15.852214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f895f2-db88-4ea6-b65d-3c6ffc0c9fec admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:15.852490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f895f2-db88-4ea6-b65d-3c6ffc0c9fec admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:15.852757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f895f2-db88-4ea6-b65d-3c6ffc0c9fec admin admin] PATH_INFO: `/v3/projects/6b0c480969794b1ebec502be6bdc9dbb/users/ab63f46afe38477787d92805a7b33900/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:15.872231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f895f2-db88-4ea6-b65d-3c6ffc0c9fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0c480969794b1ebec502be6bdc9dbb, user_id=ab63f46afe38477787d92805a7b33900, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:15.874975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f895f2-db88-4ea6-b65d-3c6ffc0c9fec admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:15.890626 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3983/7960] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:34:15 2022] PUT /identity/v3/projects/6b0c480969794b1ebec502be6bdc9dbb/users/ab63f46afe38477787d92805a7b33900/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:15.901329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827afc1-3326-476f-909d-adf15a10f1f2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:15.901612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827afc1-3326-476f-909d-adf15a10f1f2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:15.901926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827afc1-3326-476f-909d-adf15a10f1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:15.935117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f827afc1-3326-476f-909d-adf15a10f1f2 None None] MFA Rules not processed for user `ab63f46afe38477787d92805a7b33900`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:15.936442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f827afc1-3326-476f-909d-adf15a10f1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:15.990421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:16.026431 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3978/7961] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:15 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:16.036968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f895f2-db88-4ea6-b65d-3c6ffc0c9fec admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:16.042165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-02f895f2-db88-4ea6-b65d-3c6ffc0c9fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:16.110467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f895f2-db88-4ea6-b65d-3c6ffc0c9fec admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:16.115722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b16127-58fa-47b6-b18f-e38c9a87e707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:16.117173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b16127-58fa-47b6-b18f-e38c9a87e707 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:16.117756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b16127-58fa-47b6-b18f-e38c9a87e707 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:16.117756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b16127-58fa-47b6-b18f-e38c9a87e707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:16.127928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b16127-58fa-47b6-b18f-e38c9a87e707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:16.132128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b16127-58fa-47b6-b18f-e38c9a87e707 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:16.144763 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3984/7962] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:16 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:17.966582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827afc1-3326-476f-909d-adf15a10f1f2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:18.054359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827afc1-3326-476f-909d-adf15a10f1f2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:18.059582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:18.060236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:18.060522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:18.060833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] PATH_INFO: `/v3/users/ab63f46afe38477787d92805a7b33900` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:18.062060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab63f46afe38477787d92805a7b33900)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:18.067563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:18.144709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab63f46afe38477787d92805a7b33900'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:18.157061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab63f46afe38477787d92805a7b33900'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:18.158325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab63f46afe38477787d92805a7b33900'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:18.176667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab63f46afe38477787d92805a7b33900'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:18.177501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab63f46afe38477787d92805a7b33900'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:18.198327 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3979/7963] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:34:17 2022] DELETE /identity/v3/users/ab63f46afe38477787d92805a7b33900 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:18.202537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c7e27-b148-46bb-ad33-26fed0d047d0 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:18.203455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c7e27-b148-46bb-ad33-26fed0d047d0 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:18.204380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c7e27-b148-46bb-ad33-26fed0d047d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:18.266406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a25c7e27-b148-46bb-ad33-26fed0d047d0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:18.268077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a25c7e27-b148-46bb-ad33-26fed0d047d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:18.361875 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3985/7964] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:18.372530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:18.373954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:18.452166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178a14a-8284-460d-8a4b-fcb0231c5433 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:18.456383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379874ca-cea6-4b35-a2c0-5f0e7ed55b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:18.457010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379874ca-cea6-4b35-a2c0-5f0e7ed55b85 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:18.457297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379874ca-cea6-4b35-a2c0-5f0e7ed55b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:18.457585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379874ca-cea6-4b35-a2c0-5f0e7ed55b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:18.470813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379874ca-cea6-4b35-a2c0-5f0e7ed55b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:18.472354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379874ca-cea6-4b35-a2c0-5f0e7ed55b85 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:18.484455 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3980/7965] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:18.697943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c7e27-b148-46bb-ad33-26fed0d047d0 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:18.699567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a25c7e27-b148-46bb-ad33-26fed0d047d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:18.743922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c7e27-b148-46bb-ad33-26fed0d047d0 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:18.760049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dcf2d-f54d-4c65-8efc-0b050139db2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:18.760693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dcf2d-f54d-4c65-8efc-0b050139db2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:18.761080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dcf2d-f54d-4c65-8efc-0b050139db2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:18.761320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dcf2d-f54d-4c65-8efc-0b050139db2d admin admin] PATH_INFO: `/v3/projects/6b0c480969794b1ebec502be6bdc9dbb` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:18.771554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323dcf2d-f54d-4c65-8efc-0b050139db2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b0c480969794b1ebec502be6bdc9dbb)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:18.774078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323dcf2d-f54d-4c65-8efc-0b050139db2d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:18.792485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:18.837557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-323dcf2d-f54d-4c65-8efc-0b050139db2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b0c480969794b1ebec502be6bdc9dbb', 'request_id': 'req-323dcf2d-f54d-4c65-8efc-0b050139db2d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:18.846487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-323dcf2d-f54d-4c65-8efc-0b050139db2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b0c480969794b1ebec502be6bdc9dbb', 'request_id': 'req-323dcf2d-f54d-4c65-8efc-0b050139db2d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:18.854667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-323dcf2d-f54d-4c65-8efc-0b050139db2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b0c480969794b1ebec502be6bdc9dbb', 'request_id': 'req-323dcf2d-f54d-4c65-8efc-0b050139db2d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:18.874372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-323dcf2d-f54d-4c65-8efc-0b050139db2d admin admin] The token cache is being invalidate because project 6b0c480969794b1ebec502be6bdc9dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:34:18.874776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-323dcf2d-f54d-4c65-8efc-0b050139db2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:18.875797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-323dcf2d-f54d-4c65-8efc-0b050139db2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:18.885657 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3986/7966] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:34:18 2022] DELETE /identity/v3/projects/6b0c480969794b1ebec502be6bdc9dbb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:18.890583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f1f1b-1b20-42c8-be31-e9e62a5e8e6f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:18.891313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f1f1b-1b20-42c8-be31-e9e62a5e8e6f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:18.891313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f1f1b-1b20-42c8-be31-e9e62a5e8e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:18.901368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:18.920083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2d9f1f1b-1b20-42c8-be31-e9e62a5e8e6f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:18.921566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2d9f1f1b-1b20-42c8-be31-e9e62a5e8e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:18.992282 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3981/7967] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:19.000340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da6589-97ad-4bf8-8fe7-a305a6e39f23 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.000630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da6589-97ad-4bf8-8fe7-a305a6e39f23 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.000922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da6589-97ad-4bf8-8fe7-a305a6e39f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.023217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f0da6589-97ad-4bf8-8fe7-a305a6e39f23 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:19.024423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f0da6589-97ad-4bf8-8fe7-a305a6e39f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:19.032985 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3987/7968] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:19.037149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f1f1b-1b20-42c8-be31-e9e62a5e8e6f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:19.048002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f1f1b-1b20-42c8-be31-e9e62a5e8e6f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:19.052642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092305a-2e0d-4dd0-9991-9574159bdda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:19.053252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092305a-2e0d-4dd0-9991-9574159bdda2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.054456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092305a-2e0d-4dd0-9991-9574159bdda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.054735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092305a-2e0d-4dd0-9991-9574159bdda2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.055406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092305a-2e0d-4dd0-9991-9574159bdda2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:34:19.055708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092305a-2e0d-4dd0-9991-9574159bdda2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:19.057310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092305a-2e0d-4dd0-9991-9574159bdda2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:19.070002 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3982/7969] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:34:19.074420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da6589-97ad-4bf8-8fe7-a305a6e39f23 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:19.085598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da6589-97ad-4bf8-8fe7-a305a6e39f23 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:19.090615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3d6fe-2124-4877-a217-463b13ab9e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:19.091589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d6fe-2124-4877-a217-463b13ab9e88 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.091589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d6fe-2124-4877-a217-463b13ab9e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.091836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d6fe-2124-4877-a217-463b13ab9e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.092480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3d6fe-2124-4877-a217-463b13ab9e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:19.094662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3d6fe-2124-4877-a217-463b13ab9e88 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:19.126907 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3988/7970] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:34:19 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:19.127986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092305a-2e0d-4dd0-9991-9574159bdda2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:19.139166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092305a-2e0d-4dd0-9991-9574159bdda2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:19.197316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305caa2-8d18-4815-9467-d81d0e3bc50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:19.197901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305caa2-8d18-4815-9467-d81d0e3bc50f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.198201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305caa2-8d18-4815-9467-d81d0e3bc50f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.198456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305caa2-8d18-4815-9467-d81d0e3bc50f admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.199120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305caa2-8d18-4815-9467-d81d0e3bc50f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:19.201022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305caa2-8d18-4815-9467-d81d0e3bc50f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:19.222897 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3983/7971] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:34:19 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:19.227118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3d6fe-2124-4877-a217-463b13ab9e88 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:19.237505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3d6fe-2124-4877-a217-463b13ab9e88 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:19.242335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd62f94-4088-4a96-b2c8-36dc5e94b28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:19.242967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd62f94-4088-4a96-b2c8-36dc5e94b28d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.243252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd62f94-4088-4a96-b2c8-36dc5e94b28d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.243529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd62f94-4088-4a96-b2c8-36dc5e94b28d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.244167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd62f94-4088-4a96-b2c8-36dc5e94b28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:19.245760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd62f94-4088-4a96-b2c8-36dc5e94b28d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:19.255809 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3989/7972] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:34:19.260737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305caa2-8d18-4815-9467-d81d0e3bc50f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:19.271996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305caa2-8d18-4815-9467-d81d0e3bc50f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:19.277408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bfff8-a353-437c-baab-0a29cb3ed4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:19.278011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bfff8-a353-437c-baab-0a29cb3ed4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.278295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bfff8-a353-437c-baab-0a29cb3ed4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.278570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bfff8-a353-437c-baab-0a29cb3ed4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.279259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bfff8-a353-437c-baab-0a29cb3ed4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:19.281210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bfff8-a353-437c-baab-0a29cb3ed4d7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:19.292535 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3984/7973] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:34:19.296522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd62f94-4088-4a96-b2c8-36dc5e94b28d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:19.307599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd62f94-4088-4a96-b2c8-36dc5e94b28d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:19.312740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7819c-9c7a-493f-90aa-469d907491da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:19.313391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7819c-9c7a-493f-90aa-469d907491da admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.313673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7819c-9c7a-493f-90aa-469d907491da admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.313947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7819c-9c7a-493f-90aa-469d907491da admin admin] PATH_INFO: `/v3/projects/edce8ffa80334490b548ae9fad4e4082/users/621da223fb72430684f49cc54a27d509/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.330048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7819c-9c7a-493f-90aa-469d907491da admin admin] RBAC: Authorizing `identity:create_grant(project_id=edce8ffa80334490b548ae9fad4e4082, user_id=621da223fb72430684f49cc54a27d509, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:19.332792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7819c-9c7a-493f-90aa-469d907491da admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:19.346936 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3990/7974] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:34:19 2022] PUT /identity/v3/projects/edce8ffa80334490b548ae9fad4e4082/users/621da223fb72430684f49cc54a27d509/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:34:19.358003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c6584-7034-4c9d-932a-36d9735ee8a4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.358292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c6584-7034-4c9d-932a-36d9735ee8a4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.358573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c6584-7034-4c9d-932a-36d9735ee8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.389588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5d0c6584-7034-4c9d-932a-36d9735ee8a4 None None] MFA Rules not processed for user `621da223fb72430684f49cc54a27d509`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:19.390893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5d0c6584-7034-4c9d-932a-36d9735ee8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:19.456737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:19.466126 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3985/7975] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:19.467543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7819c-9c7a-493f-90aa-469d907491da admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:19.531300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7819c-9c7a-493f-90aa-469d907491da admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:19.536130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f2ad7-75ef-4f43-80cc-2c7499ed8e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:19.536741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f2ad7-75ef-4f43-80cc-2c7499ed8e5b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.537022 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f2ad7-75ef-4f43-80cc-2c7499ed8e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.537292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f2ad7-75ef-4f43-80cc-2c7499ed8e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.538030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f2ad7-75ef-4f43-80cc-2c7499ed8e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:19.540091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f2ad7-75ef-4f43-80cc-2c7499ed8e5b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:19.567217 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3991/7976] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:34:19 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:19.571905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c6584-7034-4c9d-932a-36d9735ee8a4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:19.583285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c6584-7034-4c9d-932a-36d9735ee8a4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:19.640312 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e390b3-0103-49d7-998e-1b0c85917893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:19.640840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e390b3-0103-49d7-998e-1b0c85917893 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.641123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e390b3-0103-49d7-998e-1b0c85917893 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.641399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e390b3-0103-49d7-998e-1b0c85917893 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.642067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e390b3-0103-49d7-998e-1b0c85917893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:19.644228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e390b3-0103-49d7-998e-1b0c85917893 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:19.665525 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3986/7977] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:34:19 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:19.669938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f2ad7-75ef-4f43-80cc-2c7499ed8e5b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:19.681126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f2ad7-75ef-4f43-80cc-2c7499ed8e5b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:19.685832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba614c-1804-4d96-92ae-418f9da27e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:19.686432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba614c-1804-4d96-92ae-418f9da27e75 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.686832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba614c-1804-4d96-92ae-418f9da27e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.687237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba614c-1804-4d96-92ae-418f9da27e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.687881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba614c-1804-4d96-92ae-418f9da27e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:19.689483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba614c-1804-4d96-92ae-418f9da27e75 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:19.700878 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3992/7978] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:34:19.705183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e390b3-0103-49d7-998e-1b0c85917893 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:19.715575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e390b3-0103-49d7-998e-1b0c85917893 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:19.720353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6740d3d-75cf-444d-85c1-72032b136776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:19.721016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6740d3d-75cf-444d-85c1-72032b136776 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.721317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6740d3d-75cf-444d-85c1-72032b136776 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.721586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6740d3d-75cf-444d-85c1-72032b136776 admin admin] PATH_INFO: `/v3/projects/d3d3d0b2dc084d7d8722d075bd25e79a/users/4b3070a46b474dc6b6445bf6ca758bb5/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.738495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6740d3d-75cf-444d-85c1-72032b136776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d3d0b2dc084d7d8722d075bd25e79a, user_id=4b3070a46b474dc6b6445bf6ca758bb5, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:19.741966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6740d3d-75cf-444d-85c1-72032b136776 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:19.757592 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3987/7979] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:34:19 2022] PUT /identity/v3/projects/d3d3d0b2dc084d7d8722d075bd25e79a/users/4b3070a46b474dc6b6445bf6ca758bb5/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:19.763496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba614c-1804-4d96-92ae-418f9da27e75 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:19.776509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba614c-1804-4d96-92ae-418f9da27e75 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:19.782029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:19.841108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042219da-7819-47ac-b4a6-1cf3554ae831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:19.842012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042219da-7819-47ac-b4a6-1cf3554ae831 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.842302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042219da-7819-47ac-b4a6-1cf3554ae831 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.842613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042219da-7819-47ac-b4a6-1cf3554ae831 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.843359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042219da-7819-47ac-b4a6-1cf3554ae831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:19.845267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042219da-7819-47ac-b4a6-1cf3554ae831 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:19.858119 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3993/7980] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:34:19.862874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6740d3d-75cf-444d-85c1-72032b136776 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:19.884580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6740d3d-75cf-444d-85c1-72032b136776 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:19.889719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e7d5c-e5cd-408d-ad4e-7c7a33a1e961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:19.890581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e7d5c-e5cd-408d-ad4e-7c7a33a1e961 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.890711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e7d5c-e5cd-408d-ad4e-7c7a33a1e961 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.891024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e7d5c-e5cd-408d-ad4e-7c7a33a1e961 admin admin] PATH_INFO: `/v3/projects/d3d3d0b2dc084d7d8722d075bd25e79a/users/4b3070a46b474dc6b6445bf6ca758bb5/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.893353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e7d5c-e5cd-408d-ad4e-7c7a33a1e961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d3d0b2dc084d7d8722d075bd25e79a, user_id=4b3070a46b474dc6b6445bf6ca758bb5, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:19.897015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e7d5c-e5cd-408d-ad4e-7c7a33a1e961 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:19.911355 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3988/7981] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:34:19 2022] PUT /identity/v3/projects/d3d3d0b2dc084d7d8722d075bd25e79a/users/4b3070a46b474dc6b6445bf6ca758bb5/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:19.923031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c20a8-e3df-49f0-994c-9810670c7288 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:19.923437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c20a8-e3df-49f0-994c-9810670c7288 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:19.923796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c20a8-e3df-49f0-994c-9810670c7288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:19.960749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-347c20a8-e3df-49f0-994c-9810670c7288 None None] MFA Rules not processed for user `4b3070a46b474dc6b6445bf6ca758bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:19.962499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-347c20a8-e3df-49f0-994c-9810670c7288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:20.049173 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3994/7982] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:20.061839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e7d5c-e5cd-408d-ad4e-7c7a33a1e961 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:20.063799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d68e7d5c-e5cd-408d-ad4e-7c7a33a1e961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:20.146108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e7d5c-e5cd-408d-ad4e-7c7a33a1e961 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:20.150874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d777281-abbb-4874-b49a-5b2bef11e5dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:20.151471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d777281-abbb-4874-b49a-5b2bef11e5dc service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:20.151829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d777281-abbb-4874-b49a-5b2bef11e5dc service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:20.152121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d777281-abbb-4874-b49a-5b2bef11e5dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:20.162062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d777281-abbb-4874-b49a-5b2bef11e5dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:20.163623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d777281-abbb-4874-b49a-5b2bef11e5dc service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:20.174421 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3989/7983] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:20.296108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c20a8-e3df-49f0-994c-9810670c7288 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:20.311447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c20a8-e3df-49f0-994c-9810670c7288 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:20.316233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccce11-d60b-46f0-9801-f72cc7011f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:20.316960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccce11-d60b-46f0-9801-f72cc7011f5b service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:20.317333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccce11-d60b-46f0-9801-f72cc7011f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:20.317615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccce11-d60b-46f0-9801-f72cc7011f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:20.391692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccce11-d60b-46f0-9801-f72cc7011f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:20.393200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccce11-d60b-46f0-9801-f72cc7011f5b service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:20.407894 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3995/7984] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:24.160098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d777281-abbb-4874-b49a-5b2bef11e5dc service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:24.218318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:24.248412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccce11-d60b-46f0-9801-f72cc7011f5b service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:24.250531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a0ccce11-d60b-46f0-9801-f72cc7011f5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:24.257130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d777281-abbb-4874-b49a-5b2bef11e5dc service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:24.262103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052973b-c7ee-4fd1-9ee5-108872f43259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:24.262817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052973b-c7ee-4fd1-9ee5-108872f43259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:24.263034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052973b-c7ee-4fd1-9ee5-108872f43259 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:24.263391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052973b-c7ee-4fd1-9ee5-108872f43259 admin admin] PATH_INFO: `/v3/users/621da223fb72430684f49cc54a27d509` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:24.264610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052973b-c7ee-4fd1-9ee5-108872f43259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621da223fb72430684f49cc54a27d509)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:24.266648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052973b-c7ee-4fd1-9ee5-108872f43259 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:24.329631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:24.332172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3052973b-c7ee-4fd1-9ee5-108872f43259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621da223fb72430684f49cc54a27d509'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:24.376300 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3052973b-c7ee-4fd1-9ee5-108872f43259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621da223fb72430684f49cc54a27d509'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:24.377427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccce11-d60b-46f0-9801-f72cc7011f5b service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:24.380433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3052973b-c7ee-4fd1-9ee5-108872f43259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621da223fb72430684f49cc54a27d509'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:24.386570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d48a85-e4da-4661-a329-cd8e319b0ada service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:24.387290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d48a85-e4da-4661-a329-cd8e319b0ada service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:24.387710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d48a85-e4da-4661-a329-cd8e319b0ada service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:24.387994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d48a85-e4da-4661-a329-cd8e319b0ada service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:24.390836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a7d48a85-e4da-4661-a329-cd8e319b0ada service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:24.427677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3052973b-c7ee-4fd1-9ee5-108872f43259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621da223fb72430684f49cc54a27d509'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:24.430607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3052973b-c7ee-4fd1-9ee5-108872f43259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621da223fb72430684f49cc54a27d509'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:24.463395 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3990/7985] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:34:24 2022] DELETE /identity/v3/users/621da223fb72430684f49cc54a27d509 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:24.466693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f600d22-97da-425a-a931-bdaca48c62d8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:24.467866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f600d22-97da-425a-a931-bdaca48c62d8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:24.468340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f600d22-97da-425a-a931-bdaca48c62d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:24.499802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d48a85-e4da-4661-a329-cd8e319b0ada service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:24.502515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d48a85-e4da-4661-a329-cd8e319b0ada service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:24.503567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2f600d22-97da-425a-a931-bdaca48c62d8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:24.504777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2f600d22-97da-425a-a931-bdaca48c62d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:24.525465 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3996/7986] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:24.591308 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3991/7987] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:24.603750 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d48a85-e4da-4661-a329-cd8e319b0ada service glance] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:24.605453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a7d48a85-e4da-4661-a329-cd8e319b0ada service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:24.625399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f600d22-97da-425a-a931-bdaca48c62d8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:24.627325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2f600d22-97da-425a-a931-bdaca48c62d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:24.675180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d48a85-e4da-4661-a329-cd8e319b0ada service glance] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:24.698656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f600d22-97da-425a-a931-bdaca48c62d8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:24.702656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048041-497e-47ab-ad1c-34f21a9aaa88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:24.703410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048041-497e-47ab-ad1c-34f21a9aaa88 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:24.703775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048041-497e-47ab-ad1c-34f21a9aaa88 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:24.704125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048041-497e-47ab-ad1c-34f21a9aaa88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:24.705943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2c048041-497e-47ab-ad1c-34f21a9aaa88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:24.718107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c048041-497e-47ab-ad1c-34f21a9aaa88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:24.719902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c048041-497e-47ab-ad1c-34f21a9aaa88 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:24.731708 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3992/7988] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:34:24.738199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226be16-a4cf-4a3f-b43b-67641b129d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:24.738948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226be16-a4cf-4a3f-b43b-67641b129d28 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:24.739423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226be16-a4cf-4a3f-b43b-67641b129d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:24.739776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226be16-a4cf-4a3f-b43b-67641b129d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:24.752161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226be16-a4cf-4a3f-b43b-67641b129d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:24.753691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226be16-a4cf-4a3f-b43b-67641b129d28 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:24.764618 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3997/7989] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:24.835620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048041-497e-47ab-ad1c-34f21a9aaa88 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:24.843752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:24.848969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048041-497e-47ab-ad1c-34f21a9aaa88 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:24.855763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8da8-1303-45ee-b694-f4cee240d751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:24.856394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8da8-1303-45ee-b694-f4cee240d751 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:24.857477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8da8-1303-45ee-b694-f4cee240d751 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:24.858333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8da8-1303-45ee-b694-f4cee240d751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:24.860837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b19e8da8-1303-45ee-b694-f4cee240d751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:24.956172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e8da8-1303-45ee-b694-f4cee240d751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:24.957554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e8da8-1303-45ee-b694-f4cee240d751 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:24.986574 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3993/7990] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:25.057281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226be16-a4cf-4a3f-b43b-67641b129d28 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:25.058814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8226be16-a4cf-4a3f-b43b-67641b129d28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:25.085657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226be16-a4cf-4a3f-b43b-67641b129d28 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:25.091339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:25.092099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:25.092464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:25.092907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] PATH_INFO: `/v3/projects/edce8ffa80334490b548ae9fad4e4082` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:25.094463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] RBAC: Authorizing `identity:delete_project(project_id=edce8ffa80334490b548ae9fad4e4082)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:25.096183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:25.127542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:25.159061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edce8ffa80334490b548ae9fad4e4082', 'request_id': 'req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.165179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edce8ffa80334490b548ae9fad4e4082', 'request_id': 'req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.172742 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edce8ffa80334490b548ae9fad4e4082', 'request_id': 'req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.186535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] The token cache is being invalidate because project edce8ffa80334490b548ae9fad4e4082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:34:25.186871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.187533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.192334 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3998/7991] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:34:25 2022] DELETE /identity/v3/projects/edce8ffa80334490b548ae9fad4e4082 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:25.193560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8da8-1303-45ee-b694-f4cee240d751 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:25.205871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8da8-1303-45ee-b694-f4cee240d751 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:25.272905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a50087-99f8-4ae5-b2ab-ae1792d7933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:25.273800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a50087-99f8-4ae5-b2ab-ae1792d7933f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:25.274157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a50087-99f8-4ae5-b2ab-ae1792d7933f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:25.274501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a50087-99f8-4ae5-b2ab-ae1792d7933f admin admin] PATH_INFO: `/v3/users/4b3070a46b474dc6b6445bf6ca758bb5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:25.275746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a50087-99f8-4ae5-b2ab-ae1792d7933f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3070a46b474dc6b6445bf6ca758bb5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:25.277716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a50087-99f8-4ae5-b2ab-ae1792d7933f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:25.328047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e1a50087-99f8-4ae5-b2ab-ae1792d7933f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3070a46b474dc6b6445bf6ca758bb5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.335877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e1a50087-99f8-4ae5-b2ab-ae1792d7933f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3070a46b474dc6b6445bf6ca758bb5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.336590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e1a50087-99f8-4ae5-b2ab-ae1792d7933f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3070a46b474dc6b6445bf6ca758bb5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.349288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e1a50087-99f8-4ae5-b2ab-ae1792d7933f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3070a46b474dc6b6445bf6ca758bb5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.350511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e1a50087-99f8-4ae5-b2ab-ae1792d7933f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3070a46b474dc6b6445bf6ca758bb5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.364944 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3994/7992] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:34:25 2022] DELETE /identity/v3/users/4b3070a46b474dc6b6445bf6ca758bb5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:25.732879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:25.734376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:25.747726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ef482-7c78-46b3-9dc1-04f7c3c2117f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:25.809852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:25.810582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:25.810895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:25.811190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae admin admin] PATH_INFO: `/v3/projects/d3d3d0b2dc084d7d8722d075bd25e79a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:25.812357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d3d0b2dc084d7d8722d075bd25e79a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:25.814342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:25.861852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d3d0b2dc084d7d8722d075bd25e79a', 'request_id': 'req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.867494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d3d0b2dc084d7d8722d075bd25e79a', 'request_id': 'req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.873706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d3d0b2dc084d7d8722d075bd25e79a', 'request_id': 'req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.886083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae admin admin] The token cache is being invalidate because project d3d3d0b2dc084d7d8722d075bd25e79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:34:25.886393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.887035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4adc2ce-972a-433e-a7aa-546ed6ec4fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:25.889139 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 3999/7993] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:34:25 2022] DELETE /identity/v3/projects/d3d3d0b2dc084d7d8722d075bd25e79a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:25.894243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61da05-1b27-41b5-810e-dad18cc1a8af None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:25.894535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61da05-1b27-41b5-810e-dad18cc1a8af None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:25.894936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61da05-1b27-41b5-810e-dad18cc1a8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:25.916359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bd61da05-1b27-41b5-810e-dad18cc1a8af None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:25.917577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bd61da05-1b27-41b5-810e-dad18cc1a8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:25.922285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:25.984956 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3995/7994] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:25.992468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ed12-4185-4e63-8a77-cd75e3c4fb07 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:25.992757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ed12-4185-4e63-8a77-cd75e3c4fb07 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:25.993041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5ed12-4185-4e63-8a77-cd75e3c4fb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:26.013989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e3c5ed12-4185-4e63-8a77-cd75e3c4fb07 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:26.015320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e3c5ed12-4185-4e63-8a77-cd75e3c4fb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:26.024793 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4000/7995] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:26.029143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61da05-1b27-41b5-810e-dad18cc1a8af None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:26.039368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61da05-1b27-41b5-810e-dad18cc1a8af None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:26.044492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24031660-5a20-4fcb-9ff0-5dd6714f2634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:26.045109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24031660-5a20-4fcb-9ff0-5dd6714f2634 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:26.045397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24031660-5a20-4fcb-9ff0-5dd6714f2634 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:26.045670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24031660-5a20-4fcb-9ff0-5dd6714f2634 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:26.046315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24031660-5a20-4fcb-9ff0-5dd6714f2634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:34:26.046777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24031660-5a20-4fcb-9ff0-5dd6714f2634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:26.048380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24031660-5a20-4fcb-9ff0-5dd6714f2634 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:26.063442 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3996/7996] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:34:26.067155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5ed12-4185-4e63-8a77-cd75e3c4fb07 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:26.077424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5ed12-4185-4e63-8a77-cd75e3c4fb07 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:26.083679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae34eab-5140-463c-888b-01bffeb79fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:26.084353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae34eab-5140-463c-888b-01bffeb79fcf admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:26.085461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae34eab-5140-463c-888b-01bffeb79fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:26.085966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae34eab-5140-463c-888b-01bffeb79fcf admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:26.087188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae34eab-5140-463c-888b-01bffeb79fcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:26.089241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae34eab-5140-463c-888b-01bffeb79fcf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:26.117627 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4001/7997] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:34:26 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:26.122666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24031660-5a20-4fcb-9ff0-5dd6714f2634 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:26.134326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24031660-5a20-4fcb-9ff0-5dd6714f2634 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:26.195818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b9912-29a2-4046-abd6-fa06897c54b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:26.196492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b9912-29a2-4046-abd6-fa06897c54b7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:26.196634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b9912-29a2-4046-abd6-fa06897c54b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:26.196915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b9912-29a2-4046-abd6-fa06897c54b7 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:26.197552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b9912-29a2-4046-abd6-fa06897c54b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:26.199523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b9912-29a2-4046-abd6-fa06897c54b7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:26.222271 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3997/7998] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:34:26 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:26.226430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae34eab-5140-463c-888b-01bffeb79fcf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:26.236980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae34eab-5140-463c-888b-01bffeb79fcf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:26.242328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a91b5-4c62-4e59-b640-85b5286b20ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:26.242976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a91b5-4c62-4e59-b640-85b5286b20ed admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:26.243240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a91b5-4c62-4e59-b640-85b5286b20ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:26.243512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a91b5-4c62-4e59-b640-85b5286b20ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:26.244158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a91b5-4c62-4e59-b640-85b5286b20ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:26.245752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a91b5-4c62-4e59-b640-85b5286b20ed admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:26.259170 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4002/7999] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:34:26.263160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b9912-29a2-4046-abd6-fa06897c54b7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:26.274260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b9912-29a2-4046-abd6-fa06897c54b7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:26.279330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99458be8-5934-4e45-b4e0-076dfab9b09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:26.279942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99458be8-5934-4e45-b4e0-076dfab9b09d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:26.280220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99458be8-5934-4e45-b4e0-076dfab9b09d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:26.280502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99458be8-5934-4e45-b4e0-076dfab9b09d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:26.281143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99458be8-5934-4e45-b4e0-076dfab9b09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:26.282790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99458be8-5934-4e45-b4e0-076dfab9b09d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:26.295825 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3998/8000] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:34:26.300237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a91b5-4c62-4e59-b640-85b5286b20ed admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:26.306912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:26.314113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a91b5-4c62-4e59-b640-85b5286b20ed admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:26.321074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed7691-b6dc-4387-85dd-30718978d504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:26.321768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed7691-b6dc-4387-85dd-30718978d504 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:26.322051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed7691-b6dc-4387-85dd-30718978d504 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:26.322333 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed7691-b6dc-4387-85dd-30718978d504 admin admin] PATH_INFO: `/v3/projects/d57e613ee5d6465ebbacbf458d83d1b0/users/099cc05d6db641bf94b140b0d017a9a9/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:26.339644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed7691-b6dc-4387-85dd-30718978d504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57e613ee5d6465ebbacbf458d83d1b0, user_id=099cc05d6db641bf94b140b0d017a9a9, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:26.342975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed7691-b6dc-4387-85dd-30718978d504 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:26.357340 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4003/8001] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:34:26 2022] PUT /identity/v3/projects/d57e613ee5d6465ebbacbf458d83d1b0/users/099cc05d6db641bf94b140b0d017a9a9/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:26.369548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2cdf1-50ae-4787-a8d4-5d5a6895b20e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:26.369953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2cdf1-50ae-4787-a8d4-5d5a6895b20e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:26.370155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2cdf1-50ae-4787-a8d4-5d5a6895b20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:26.404854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bbb2cdf1-50ae-4787-a8d4-5d5a6895b20e None None] MFA Rules not processed for user `099cc05d6db641bf94b140b0d017a9a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:26.406093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bbb2cdf1-50ae-4787-a8d4-5d5a6895b20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:26.475773 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 3999/8002] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:26.486810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed7691-b6dc-4387-85dd-30718978d504 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:26.488713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d2ed7691-b6dc-4387-85dd-30718978d504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:26.551562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed7691-b6dc-4387-85dd-30718978d504 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:26.556125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4396d2-401f-4fba-927e-dbd1e9a0a2fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:26.556733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4396d2-401f-4fba-927e-dbd1e9a0a2fc service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:26.557017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4396d2-401f-4fba-927e-dbd1e9a0a2fc service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:26.557293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4396d2-401f-4fba-927e-dbd1e9a0a2fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:26.566373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4396d2-401f-4fba-927e-dbd1e9a0a2fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:26.567850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4396d2-401f-4fba-927e-dbd1e9a0a2fc service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:26.578462 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4004/8003] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:26.598113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2cdf1-50ae-4787-a8d4-5d5a6895b20e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:26.603500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:26.665805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2cdf1-50ae-4787-a8d4-5d5a6895b20e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:26.670563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:26.671238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:26.671522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:26.671801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] PATH_INFO: `/v3/users/099cc05d6db641bf94b140b0d017a9a9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:26.672984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] RBAC: Authorizing `identity:delete_user(user_id=099cc05d6db641bf94b140b0d017a9a9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:26.674984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:26.741345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099cc05d6db641bf94b140b0d017a9a9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:26.750103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099cc05d6db641bf94b140b0d017a9a9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:26.750877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099cc05d6db641bf94b140b0d017a9a9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:26.766879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099cc05d6db641bf94b140b0d017a9a9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:26.767610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099cc05d6db641bf94b140b0d017a9a9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:26.783423 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4000/8004] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:34:26 2022] DELETE /identity/v3/users/099cc05d6db641bf94b140b0d017a9a9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:26.787957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12dbe9-d189-45e4-8eb5-eac2bbeb2388 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:26.788674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12dbe9-d189-45e4-8eb5-eac2bbeb2388 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:26.788674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12dbe9-d189-45e4-8eb5-eac2bbeb2388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:26.813426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fc12dbe9-d189-45e4-8eb5-eac2bbeb2388 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:26.815132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fc12dbe9-d189-45e4-8eb5-eac2bbeb2388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:26.881909 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4005/8005] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:34:26.892264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:26.893680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:26.959041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271f9a5-d99c-4510-8015-9fb70881999f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:26.963689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a1732-0690-451f-90f4-ddc513fd97e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:26.964314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1732-0690-451f-90f4-ddc513fd97e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:26.964601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1732-0690-451f-90f4-ddc513fd97e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:26.964882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a1732-0690-451f-90f4-ddc513fd97e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:26.974489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a1732-0690-451f-90f4-ddc513fd97e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:26.976219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a1732-0690-451f-90f4-ddc513fd97e4 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:26.986609 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4001/8006] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:27.275577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12dbe9-d189-45e4-8eb5-eac2bbeb2388 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:27.277284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fc12dbe9-d189-45e4-8eb5-eac2bbeb2388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:27.291656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12dbe9-d189-45e4-8eb5-eac2bbeb2388 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:27.296826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:27.297822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:27.298205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:27.298590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3 admin admin] PATH_INFO: `/v3/projects/d57e613ee5d6465ebbacbf458d83d1b0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:27.299924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57e613ee5d6465ebbacbf458d83d1b0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:27.302856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:27.358949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57e613ee5d6465ebbacbf458d83d1b0', 'request_id': 'req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:27.364406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57e613ee5d6465ebbacbf458d83d1b0', 'request_id': 'req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:27.371770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57e613ee5d6465ebbacbf458d83d1b0', 'request_id': 'req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:27.387739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3 admin admin] The token cache is being invalidate because project d57e613ee5d6465ebbacbf458d83d1b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:34:27.388164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:27.388878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-0d0cbe4b-f8d6-4eb3-bd20-1e5edad664c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:27.390706 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4006/8007] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:34:27 2022] DELETE /identity/v3/projects/d57e613ee5d6465ebbacbf458d83d1b0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:27.395805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb7da7-40e2-48c6-a703-fec9e47fbd2e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:27.396294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb7da7-40e2-48c6-a703-fec9e47fbd2e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:27.396872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb7da7-40e2-48c6-a703-fec9e47fbd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:27.420309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-60cb7da7-40e2-48c6-a703-fec9e47fbd2e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:27.422223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-60cb7da7-40e2-48c6-a703-fec9e47fbd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:27.441225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735d94-05fd-4bfa-855e-7780a76eec96 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:27.441510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735d94-05fd-4bfa-855e-7780a76eec96 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:27.441786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735d94-05fd-4bfa-855e-7780a76eec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:27.451091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:27.453616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:27.463692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7e735d94-05fd-4bfa-855e-7780a76eec96 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:27.465467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7e735d94-05fd-4bfa-855e-7780a76eec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:27.502069 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4002/8008] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:27.509628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae81822-9fe7-4356-8337-9cec195202d3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:27.509929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae81822-9fe7-4356-8337-9cec195202d3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:27.510218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae81822-9fe7-4356-8337-9cec195202d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:27.530732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7ae81822-9fe7-4356-8337-9cec195202d3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:27.531963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7ae81822-9fe7-4356-8337-9cec195202d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:27.538207 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4007/8009] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:34:27.544351 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4003/8010] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:27.545854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e735d94-05fd-4bfa-855e-7780a76eec96 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:27.551198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae81822-9fe7-4356-8337-9cec195202d3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:27.552666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7ae81822-9fe7-4356-8337-9cec195202d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:27.558155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e735d94-05fd-4bfa-855e-7780a76eec96 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:27.567015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe1d2a-87ed-43b8-bf11-9ba6e9f3b55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:27.567657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe1d2a-87ed-43b8-bf11-9ba6e9f3b55d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:27.567940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe1d2a-87ed-43b8-bf11-9ba6e9f3b55d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:27.568215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe1d2a-87ed-43b8-bf11-9ba6e9f3b55d admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:27.568870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe1d2a-87ed-43b8-bf11-9ba6e9f3b55d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:34:27.569206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe1d2a-87ed-43b8-bf11-9ba6e9f3b55d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:27.571116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe1d2a-87ed-43b8-bf11-9ba6e9f3b55d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:27.594060 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4008/8011] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:34:27.595149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe1d2a-87ed-43b8-bf11-9ba6e9f3b55d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:27.607581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe1d2a-87ed-43b8-bf11-9ba6e9f3b55d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:27.613578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dea281-1b41-4997-a58f-7742df69fdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:27.614410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea281-1b41-4997-a58f-7742df69fdef admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:27.615139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea281-1b41-4997-a58f-7742df69fdef admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:27.615139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea281-1b41-4997-a58f-7742df69fdef admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:27.616578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dea281-1b41-4997-a58f-7742df69fdef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:27.618497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dea281-1b41-4997-a58f-7742df69fdef admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:27.654872 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4009/8012] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:34:27 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:27.657070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae81822-9fe7-4356-8337-9cec195202d3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:27.658696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dea281-1b41-4997-a58f-7742df69fdef admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:27.733464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b354f03-03b9-4d16-8a78-656bff4c2e84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:27.734151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b354f03-03b9-4d16-8a78-656bff4c2e84 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:27.734300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dea281-1b41-4997-a58f-7742df69fdef admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:27.734442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b354f03-03b9-4d16-8a78-656bff4c2e84 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:27.734723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b354f03-03b9-4d16-8a78-656bff4c2e84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:27.739346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a051e0-735d-4f22-9d2a-718d7a805f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:27.739965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a051e0-735d-4f22-9d2a-718d7a805f3d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:27.740256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a051e0-735d-4f22-9d2a-718d7a805f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:27.740526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a051e0-735d-4f22-9d2a-718d7a805f3d admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:27.741300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a051e0-735d-4f22-9d2a-718d7a805f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:27.743301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a051e0-735d-4f22-9d2a-718d7a805f3d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:27.767785 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4010/8013] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:34:27 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:34:27.774494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a051e0-735d-4f22-9d2a-718d7a805f3d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:27.784917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a051e0-735d-4f22-9d2a-718d7a805f3d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:27.791263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb963d-83e0-4fc9-a57d-b0c776c501fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:27.792055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb963d-83e0-4fc9-a57d-b0c776c501fe admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:27.792425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb963d-83e0-4fc9-a57d-b0c776c501fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:27.792772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb963d-83e0-4fc9-a57d-b0c776c501fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:27.793429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb963d-83e0-4fc9-a57d-b0c776c501fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:27.795065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb963d-83e0-4fc9-a57d-b0c776c501fe admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:27.802036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:27.806809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b354f03-03b9-4d16-8a78-656bff4c2e84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:27.807143 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4011/8014] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:34:27.808940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b354f03-03b9-4d16-8a78-656bff4c2e84 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:27.810907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb963d-83e0-4fc9-a57d-b0c776c501fe admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:27.818192 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4004/8015] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:34:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:34:27.823559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb963d-83e0-4fc9-a57d-b0c776c501fe admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:27.832518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5894a5f-d895-4d5a-9378-5267f0508ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:27.833146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5894a5f-d895-4d5a-9378-5267f0508ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:27.833438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5894a5f-d895-4d5a-9378-5267f0508ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:27.833716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5894a5f-d895-4d5a-9378-5267f0508ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:27.834366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5894a5f-d895-4d5a-9378-5267f0508ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:27.836616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5894a5f-d895-4d5a-9378-5267f0508ab9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:27.849104 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4012/8016] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:34:27.853942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b354f03-03b9-4d16-8a78-656bff4c2e84 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:27.872320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b354f03-03b9-4d16-8a78-656bff4c2e84 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:27.888633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06302320-94c0-4559-90f6-37a27a710828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:27.889332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06302320-94c0-4559-90f6-37a27a710828 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:27.889641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06302320-94c0-4559-90f6-37a27a710828 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:27.890162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06302320-94c0-4559-90f6-37a27a710828 admin admin] PATH_INFO: `/v3/projects/072d05a164a347faa20ac77c6b12faa9/users/1e9654e47fd542d78b7569c2eb7e9a33/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:27.923684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06302320-94c0-4559-90f6-37a27a710828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072d05a164a347faa20ac77c6b12faa9, user_id=1e9654e47fd542d78b7569c2eb7e9a33, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:27.927932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06302320-94c0-4559-90f6-37a27a710828 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:27.961436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4005/8017] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:34:27 2022] PUT /identity/v3/projects/072d05a164a347faa20ac77c6b12faa9/users/1e9654e47fd542d78b7569c2eb7e9a33/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:27.971781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39ce1-4213-475f-9df9-cb1bb8221492 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:27.972194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39ce1-4213-475f-9df9-cb1bb8221492 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:27.972474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39ce1-4213-475f-9df9-cb1bb8221492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:28.047530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-57e39ce1-4213-475f-9df9-cb1bb8221492 None None] MFA Rules not processed for user `1e9654e47fd542d78b7569c2eb7e9a33`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:28.050902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-57e39ce1-4213-475f-9df9-cb1bb8221492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:28.132136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:28.224208 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4013/8018] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:28.229342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06302320-94c0-4559-90f6-37a27a710828 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:28.365972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06302320-94c0-4559-90f6-37a27a710828 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:28.371726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0cf05-dc29-4d84-8bf9-9beb2ae00ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:28.372713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0cf05-dc29-4d84-8bf9-9beb2ae00ffc admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:28.373045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0cf05-dc29-4d84-8bf9-9beb2ae00ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:28.373355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0cf05-dc29-4d84-8bf9-9beb2ae00ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:28.373997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0cf05-dc29-4d84-8bf9-9beb2ae00ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:28.393755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0cf05-dc29-4d84-8bf9-9beb2ae00ffc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:28.443706 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4006/8019] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:34:28 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:28.445787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e39ce1-4213-475f-9df9-cb1bb8221492 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:28.458136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e39ce1-4213-475f-9df9-cb1bb8221492 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:28.559087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1328f-1e5e-4487-bb8f-e8ca0ab58149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:28.559885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1328f-1e5e-4487-bb8f-e8ca0ab58149 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:28.560275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1328f-1e5e-4487-bb8f-e8ca0ab58149 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:28.560671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1328f-1e5e-4487-bb8f-e8ca0ab58149 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:28.561399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1328f-1e5e-4487-bb8f-e8ca0ab58149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:28.563500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1328f-1e5e-4487-bb8f-e8ca0ab58149 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:28.590036 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4014/8020] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:34:28 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:28.593730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0cf05-dc29-4d84-8bf9-9beb2ae00ffc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:28.606245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0cf05-dc29-4d84-8bf9-9beb2ae00ffc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:28.611617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92116479-3f06-47f2-b7f2-a30825a23831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:28.612590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116479-3f06-47f2-b7f2-a30825a23831 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:28.613067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116479-3f06-47f2-b7f2-a30825a23831 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:28.613552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116479-3f06-47f2-b7f2-a30825a23831 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:28.614383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92116479-3f06-47f2-b7f2-a30825a23831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:28.616308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92116479-3f06-47f2-b7f2-a30825a23831 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:28.633558 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4007/8021] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:34:28.634705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1328f-1e5e-4487-bb8f-e8ca0ab58149 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:28.656693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1328f-1e5e-4487-bb8f-e8ca0ab58149 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:28.662428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e424c-22db-403d-a05b-581c72f9f92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:28.664666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e424c-22db-403d-a05b-581c72f9f92b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:28.665063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e424c-22db-403d-a05b-581c72f9f92b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:28.665448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e424c-22db-403d-a05b-581c72f9f92b admin admin] PATH_INFO: `/v3/projects/8bd82fe8740a4e81b7d16b88e1cd2cd9/users/3b297589ecfd41d7b6b6ecf5d2e67f8d/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:28.690886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e424c-22db-403d-a05b-581c72f9f92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd82fe8740a4e81b7d16b88e1cd2cd9, user_id=3b297589ecfd41d7b6b6ecf5d2e67f8d, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:28.693768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e424c-22db-403d-a05b-581c72f9f92b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:28.722994 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4015/8022] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:34:28 2022] PUT /identity/v3/projects/8bd82fe8740a4e81b7d16b88e1cd2cd9/users/3b297589ecfd41d7b6b6ecf5d2e67f8d/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:34:28.724567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92116479-3f06-47f2-b7f2-a30825a23831 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:28.737196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92116479-3f06-47f2-b7f2-a30825a23831 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:28.800029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77a297-9202-4f38-94ca-337944bb9ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:28.800643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77a297-9202-4f38-94ca-337944bb9ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:28.800926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77a297-9202-4f38-94ca-337944bb9ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:28.801200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77a297-9202-4f38-94ca-337944bb9ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:28.802158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77a297-9202-4f38-94ca-337944bb9ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:28.804391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77a297-9202-4f38-94ca-337944bb9ce3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:28.818436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4008/8023] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:34:28.819808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e424c-22db-403d-a05b-581c72f9f92b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:28.830588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e424c-22db-403d-a05b-581c72f9f92b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:28.836320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950db69b-9738-42d0-95fc-8acb863de71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:28.837111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950db69b-9738-42d0-95fc-8acb863de71c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:28.837537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950db69b-9738-42d0-95fc-8acb863de71c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:28.837908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950db69b-9738-42d0-95fc-8acb863de71c admin admin] PATH_INFO: `/v3/projects/8bd82fe8740a4e81b7d16b88e1cd2cd9/users/3b297589ecfd41d7b6b6ecf5d2e67f8d/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:28.840025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950db69b-9738-42d0-95fc-8acb863de71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd82fe8740a4e81b7d16b88e1cd2cd9, user_id=3b297589ecfd41d7b6b6ecf5d2e67f8d, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:28.843092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950db69b-9738-42d0-95fc-8acb863de71c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:28.856387 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4016/8024] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:34:28 2022] PUT /identity/v3/projects/8bd82fe8740a4e81b7d16b88e1cd2cd9/users/3b297589ecfd41d7b6b6ecf5d2e67f8d/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:34:28.868502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4df2f-a9d3-4763-9796-c5199c8a5bae None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:28.868898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4df2f-a9d3-4763-9796-c5199c8a5bae None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:28.869288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4df2f-a9d3-4763-9796-c5199c8a5bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:28.902065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-aac4df2f-a9d3-4763-9796-c5199c8a5bae None None] MFA Rules not processed for user `3b297589ecfd41d7b6b6ecf5d2e67f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:28.903587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aac4df2f-a9d3-4763-9796-c5199c8a5bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:28.939920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:28.989906 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4009/8025] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:34:29.001135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950db69b-9738-42d0-95fc-8acb863de71c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:29.002956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-950db69b-9738-42d0-95fc-8acb863de71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:29.077234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950db69b-9738-42d0-95fc-8acb863de71c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:29.081357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae92a05-a273-45e7-884d-c0348e7d7010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:29.081973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae92a05-a273-45e7-884d-c0348e7d7010 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:29.082256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae92a05-a273-45e7-884d-c0348e7d7010 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:29.082534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae92a05-a273-45e7-884d-c0348e7d7010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:29.125879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:29.146650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae92a05-a273-45e7-884d-c0348e7d7010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:29.149066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae92a05-a273-45e7-884d-c0348e7d7010 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:29.158234 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4017/8026] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:35.079545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4df2f-a9d3-4763-9796-c5199c8a5bae None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:35.156968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4df2f-a9d3-4763-9796-c5199c8a5bae None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:35.161515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:35.162152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:35.162515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:35.163781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] PATH_INFO: `/v3/users/1e9654e47fd542d78b7569c2eb7e9a33` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:35.165016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e9654e47fd542d78b7569c2eb7e9a33)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:35.166990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:35.222790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e9654e47fd542d78b7569c2eb7e9a33'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.231641 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e9654e47fd542d78b7569c2eb7e9a33'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.232392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e9654e47fd542d78b7569c2eb7e9a33'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.246468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e9654e47fd542d78b7569c2eb7e9a33'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.247232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e9654e47fd542d78b7569c2eb7e9a33'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.263364 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4010/8027] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:34:35 2022] DELETE /identity/v3/users/1e9654e47fd542d78b7569c2eb7e9a33 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:35.268896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fa222-32f0-4247-b5f9-a24ff98a49ac None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:35.269487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fa222-32f0-4247-b5f9-a24ff98a49ac None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:35.269487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fa222-32f0-4247-b5f9-a24ff98a49ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:35.289251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5a1fa222-32f0-4247-b5f9-a24ff98a49ac None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:35.290492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5a1fa222-32f0-4247-b5f9-a24ff98a49ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:35.358232 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4018/8028] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:35.368957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:35.370382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:35.418230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:35.433181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501dc2dd-5d94-4818-b094-0efe5a23d6fe admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:35.436822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96426fa-ccbf-4319-89e0-f43a78f7ab95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:35.437479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96426fa-ccbf-4319-89e0-f43a78f7ab95 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:35.437764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96426fa-ccbf-4319-89e0-f43a78f7ab95 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:35.438037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96426fa-ccbf-4319-89e0-f43a78f7ab95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:35.448098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96426fa-ccbf-4319-89e0-f43a78f7ab95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:35.449527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96426fa-ccbf-4319-89e0-f43a78f7ab95 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:35.458908 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4011/8029] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:34:35.733759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fa222-32f0-4247-b5f9-a24ff98a49ac None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:35.735654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5a1fa222-32f0-4247-b5f9-a24ff98a49ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:35.749623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fa222-32f0-4247-b5f9-a24ff98a49ac None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:35.755105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:35.755894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:35.756318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:35.757012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] PATH_INFO: `/v3/projects/072d05a164a347faa20ac77c6b12faa9` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:35.758603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=072d05a164a347faa20ac77c6b12faa9)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:35.760607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:35.815524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072d05a164a347faa20ac77c6b12faa9', 'request_id': 'req-245836ce-9b22-4844-b146-de1d49828a56'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.821359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072d05a164a347faa20ac77c6b12faa9', 'request_id': 'req-245836ce-9b22-4844-b146-de1d49828a56'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.827832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072d05a164a347faa20ac77c6b12faa9', 'request_id': 'req-245836ce-9b22-4844-b146-de1d49828a56'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.842174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] The token cache is being invalidate because project 072d05a164a347faa20ac77c6b12faa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:34:35.842384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.843041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.844747 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4019/8030] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:34:35 2022] DELETE /identity/v3/projects/072d05a164a347faa20ac77c6b12faa9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:35.848474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96426fa-ccbf-4319-89e0-f43a78f7ab95 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:35.859150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96426fa-ccbf-4319-89e0-f43a78f7ab95 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:35.919084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f5ad4-11f6-47f6-8e99-79ef6ae5beaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:35.919723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f5ad4-11f6-47f6-8e99-79ef6ae5beaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:35.920010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f5ad4-11f6-47f6-8e99-79ef6ae5beaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:35.920291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f5ad4-11f6-47f6-8e99-79ef6ae5beaf admin admin] PATH_INFO: `/v3/users/3b297589ecfd41d7b6b6ecf5d2e67f8d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:35.921449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f5ad4-11f6-47f6-8e99-79ef6ae5beaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b297589ecfd41d7b6b6ecf5d2e67f8d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:35.923476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f5ad4-11f6-47f6-8e99-79ef6ae5beaf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:35.970117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-053f5ad4-11f6-47f6-8e99-79ef6ae5beaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b297589ecfd41d7b6b6ecf5d2e67f8d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.977915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-053f5ad4-11f6-47f6-8e99-79ef6ae5beaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b297589ecfd41d7b6b6ecf5d2e67f8d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.978586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-053f5ad4-11f6-47f6-8e99-79ef6ae5beaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b297589ecfd41d7b6b6ecf5d2e67f8d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.991060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-053f5ad4-11f6-47f6-8e99-79ef6ae5beaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b297589ecfd41d7b6b6ecf5d2e67f8d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:35.991971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-053f5ad4-11f6-47f6-8e99-79ef6ae5beaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b297589ecfd41d7b6b6ecf5d2e67f8d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:36.004998 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4012/8031] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:34:35 2022] DELETE /identity/v3/users/3b297589ecfd41d7b6b6ecf5d2e67f8d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:36.293793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:36.295309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:36.309339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245836ce-9b22-4844-b146-de1d49828a56 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:36.367369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b7a40-0453-4ea8-a8b8-f36033642474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:36.367922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b7a40-0453-4ea8-a8b8-f36033642474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:36.368202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b7a40-0453-4ea8-a8b8-f36033642474 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:36.368474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b7a40-0453-4ea8-a8b8-f36033642474 admin admin] PATH_INFO: `/v3/projects/8bd82fe8740a4e81b7d16b88e1cd2cd9` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:36.369601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b7a40-0453-4ea8-a8b8-f36033642474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd82fe8740a4e81b7d16b88e1cd2cd9)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:36.371564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b7a40-0453-4ea8-a8b8-f36033642474 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:36.373779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:36.422005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-047b7a40-0453-4ea8-a8b8-f36033642474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd82fe8740a4e81b7d16b88e1cd2cd9', 'request_id': 'req-047b7a40-0453-4ea8-a8b8-f36033642474'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:36.428125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-047b7a40-0453-4ea8-a8b8-f36033642474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd82fe8740a4e81b7d16b88e1cd2cd9', 'request_id': 'req-047b7a40-0453-4ea8-a8b8-f36033642474'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:36.435181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-047b7a40-0453-4ea8-a8b8-f36033642474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd82fe8740a4e81b7d16b88e1cd2cd9', 'request_id': 'req-047b7a40-0453-4ea8-a8b8-f36033642474'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:36.447979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-047b7a40-0453-4ea8-a8b8-f36033642474 admin admin] The token cache is being invalidate because project 8bd82fe8740a4e81b7d16b88e1cd2cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:34:36.448272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-047b7a40-0453-4ea8-a8b8-f36033642474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:36.448894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-047b7a40-0453-4ea8-a8b8-f36033642474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:34:36.450416 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4020/8032] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:34:36 2022] DELETE /identity/v3/projects/8bd82fe8740a4e81b7d16b88e1cd2cd9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:36.455383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fdb56-532d-432b-bde0-34e0bf0ba31f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:36.455911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fdb56-532d-432b-bde0-34e0bf0ba31f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:36.456009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fdb56-532d-432b-bde0-34e0bf0ba31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:36.476014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9c4fdb56-532d-432b-bde0-34e0bf0ba31f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:36.477273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9c4fdb56-532d-432b-bde0-34e0bf0ba31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:36.538480 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4013/8033] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:36.545491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823833c-3ec5-4601-84ac-8542031fb5c8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:36.545795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823833c-3ec5-4601-84ac-8542031fb5c8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:36.546052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823833c-3ec5-4601-84ac-8542031fb5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:36.566096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7823833c-3ec5-4601-84ac-8542031fb5c8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:36.567324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7823833c-3ec5-4601-84ac-8542031fb5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:36.576026 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4021/8034] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:36.580215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fdb56-532d-432b-bde0-34e0bf0ba31f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:36.590616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fdb56-532d-432b-bde0-34e0bf0ba31f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:36.595303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309b6ab-4808-4e42-b424-ce8d42dfa8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:36.595908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309b6ab-4808-4e42-b424-ce8d42dfa8fd admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:36.596192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309b6ab-4808-4e42-b424-ce8d42dfa8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:36.596470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309b6ab-4808-4e42-b424-ce8d42dfa8fd admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:36.597133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309b6ab-4808-4e42-b424-ce8d42dfa8fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:34:36.597439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309b6ab-4808-4e42-b424-ce8d42dfa8fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:36.599082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309b6ab-4808-4e42-b424-ce8d42dfa8fd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:36.600820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:36.612477 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4014/8035] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:34:36.617162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823833c-3ec5-4601-84ac-8542031fb5c8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:36.626569 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823833c-3ec5-4601-84ac-8542031fb5c8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:36.631160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a6091-d849-4566-ad69-5933be7c0bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:36.632665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a6091-d849-4566-ad69-5933be7c0bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:36.633038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a6091-d849-4566-ad69-5933be7c0bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:36.633318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a6091-d849-4566-ad69-5933be7c0bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:36.633975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a6091-d849-4566-ad69-5933be7c0bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:36.635875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a6091-d849-4566-ad69-5933be7c0bf3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:36.662126 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4022/8036] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:34:36 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:36.666345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309b6ab-4808-4e42-b424-ce8d42dfa8fd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:36.676343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309b6ab-4808-4e42-b424-ce8d42dfa8fd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:36.734017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44772c25-e098-494c-8790-35d3566a2aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:36.734631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44772c25-e098-494c-8790-35d3566a2aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:36.734955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44772c25-e098-494c-8790-35d3566a2aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:36.735239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44772c25-e098-494c-8790-35d3566a2aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:36.735869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44772c25-e098-494c-8790-35d3566a2aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:36.737885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44772c25-e098-494c-8790-35d3566a2aa2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:36.759563 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4015/8037] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:34:36 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:34:36.763769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a6091-d849-4566-ad69-5933be7c0bf3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:36.774630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a6091-d849-4566-ad69-5933be7c0bf3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:36.779350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deed765-99fc-4c90-99aa-44bdb2ac153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:36.779947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed765-99fc-4c90-99aa-44bdb2ac153a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:36.780232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed765-99fc-4c90-99aa-44bdb2ac153a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:36.780512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deed765-99fc-4c90-99aa-44bdb2ac153a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:36.781153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deed765-99fc-4c90-99aa-44bdb2ac153a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:36.783007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deed765-99fc-4c90-99aa-44bdb2ac153a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:36.793640 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4023/8038] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:34:36.797606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44772c25-e098-494c-8790-35d3566a2aa2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:36.808780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44772c25-e098-494c-8790-35d3566a2aa2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:36.813720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eef5f-29b0-4faa-ae80-9077ae283da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:36.814334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eef5f-29b0-4faa-ae80-9077ae283da6 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:36.814620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eef5f-29b0-4faa-ae80-9077ae283da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:36.814937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eef5f-29b0-4faa-ae80-9077ae283da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:36.815592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11eef5f-29b0-4faa-ae80-9077ae283da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:36.817369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11eef5f-29b0-4faa-ae80-9077ae283da6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:36.828957 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4016/8039] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:34:36.833219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deed765-99fc-4c90-99aa-44bdb2ac153a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:36.843346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deed765-99fc-4c90-99aa-44bdb2ac153a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:36.849815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c9b1f-f3ca-4d28-b9cf-94757d9e88ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:36.850998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9b1f-f3ca-4d28-b9cf-94757d9e88ce admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:36.851517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9b1f-f3ca-4d28-b9cf-94757d9e88ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:36.851813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c9b1f-f3ca-4d28-b9cf-94757d9e88ce admin admin] PATH_INFO: `/v3/projects/381ea16493934ba08abbc2c9174aa29e/users/40a381bd7dca457cb050edd511e103c7/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:36.867141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c9b1f-f3ca-4d28-b9cf-94757d9e88ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=381ea16493934ba08abbc2c9174aa29e, user_id=40a381bd7dca457cb050edd511e103c7, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:36.869804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c9b1f-f3ca-4d28-b9cf-94757d9e88ce admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:36.883916 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4024/8040] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:34:36 2022] PUT /identity/v3/projects/381ea16493934ba08abbc2c9174aa29e/users/40a381bd7dca457cb050edd511e103c7/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:34:36.894584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47ecc8-d491-4802-90b1-9d2684f67f3d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:36.894935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47ecc8-d491-4802-90b1-9d2684f67f3d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:36.895213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47ecc8-d491-4802-90b1-9d2684f67f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:36.926076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bb47ecc8-d491-4802-90b1-9d2684f67f3d None None] MFA Rules not processed for user `40a381bd7dca457cb050edd511e103c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:36.927442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bb47ecc8-d491-4802-90b1-9d2684f67f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:37.003059 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4017/8041] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:37.014435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c9b1f-f3ca-4d28-b9cf-94757d9e88ce admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:37.016208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-260c9b1f-f3ca-4d28-b9cf-94757d9e88ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:37.077528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c9b1f-f3ca-4d28-b9cf-94757d9e88ce admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:37.081490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866edab-c028-4944-8d81-708c944e5ee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:37.082094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866edab-c028-4944-8d81-708c944e5ee0 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:37.082384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866edab-c028-4944-8d81-708c944e5ee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:37.082692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866edab-c028-4944-8d81-708c944e5ee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:37.091260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866edab-c028-4944-8d81-708c944e5ee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:37.092960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866edab-c028-4944-8d81-708c944e5ee0 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:37.102706 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4025/8042] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:41.623305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59971603-daf1-4804-82bd-9b225f5a100e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:41.623822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59971603-daf1-4804-82bd-9b225f5a100e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:41.623929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59971603-daf1-4804-82bd-9b225f5a100e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:41.645691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-59971603-daf1-4804-82bd-9b225f5a100e None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:41.646929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-59971603-daf1-4804-82bd-9b225f5a100e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:41.725810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866edab-c028-4944-8d81-708c944e5ee0 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:41.728054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5866edab-c028-4944-8d81-708c944e5ee0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:41.730368 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4018/8043] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:34:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:34:41.778793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:41.830551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866edab-c028-4944-8d81-708c944e5ee0 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:41.836454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c5a6e-b4bf-4a37-ba32-bdfb2b099815 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:41.837082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c5a6e-b4bf-4a37-ba32-bdfb2b099815 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:41.837419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c5a6e-b4bf-4a37-ba32-bdfb2b099815 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:41.837788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c5a6e-b4bf-4a37-ba32-bdfb2b099815 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:41.846540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c5a6e-b4bf-4a37-ba32-bdfb2b099815 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:41.848533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c5a6e-b4bf-4a37-ba32-bdfb2b099815 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:41.858082 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4026/8044] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:34:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:34:51.703115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:51.855053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=18 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:34:54.754697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed223107-c02e-4dad-b667-1019b3eb8bb2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:54.755591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed223107-c02e-4dad-b667-1019b3eb8bb2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:54.755875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed223107-c02e-4dad-b667-1019b3eb8bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:54.776539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ed223107-c02e-4dad-b667-1019b3eb8bb2 None None] MFA Rules not processed for user `b0ae958878db4d2a81ba14f57b3128c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:34:54.777767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ed223107-c02e-4dad-b667-1019b3eb8bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:54.893820 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4019/8045] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:34:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:34:55.765563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c5a6e-b4bf-4a37-ba32-bdfb2b099815 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:55.767828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-930c5a6e-b4bf-4a37-ba32-bdfb2b099815 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:55.874914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c5a6e-b4bf-4a37-ba32-bdfb2b099815 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:55.880561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b65250-e426-4038-a329-5dc37bd3879c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:55.881460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b65250-e426-4038-a329-5dc37bd3879c service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:55.881962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b65250-e426-4038-a329-5dc37bd3879c service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:55.883007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b65250-e426-4038-a329-5dc37bd3879c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:55.884976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-04b65250-e426-4038-a329-5dc37bd3879c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:55.902072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b65250-e426-4038-a329-5dc37bd3879c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:55.904517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b65250-e426-4038-a329-5dc37bd3879c service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:55.930934 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4027/8046] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:34:56.595491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed223107-c02e-4dad-b667-1019b3eb8bb2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:56.597943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ed223107-c02e-4dad-b667-1019b3eb8bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:56.620365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed223107-c02e-4dad-b667-1019b3eb8bb2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:56.627591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79de75-6368-4223-a4e4-b7985b702f32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:56.628331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79de75-6368-4223-a4e4-b7985b702f32 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:56.629034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79de75-6368-4223-a4e4-b7985b702f32 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:56.630359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79de75-6368-4223-a4e4-b7985b702f32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:56.633016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ad79de75-6368-4223-a4e4-b7985b702f32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:56.650523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79de75-6368-4223-a4e4-b7985b702f32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:56.652638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79de75-6368-4223-a4e4-b7985b702f32 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:56.670818 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4020/8047] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:34:58.759550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b65250-e426-4038-a329-5dc37bd3879c service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:34:58.773526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b65250-e426-4038-a329-5dc37bd3879c service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:34:58.796158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6898d52-8fc3-4f12-865e-c84ededee1b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:34:58.796721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898d52-8fc3-4f12-865e-c84ededee1b9 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:34:58.797099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898d52-8fc3-4f12-865e-c84ededee1b9 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:34:58.797491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898d52-8fc3-4f12-865e-c84ededee1b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:34:58.799424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e6898d52-8fc3-4f12-865e-c84ededee1b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:34:58.818067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6898d52-8fc3-4f12-865e-c84ededee1b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:34:58.820410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6898d52-8fc3-4f12-865e-c84ededee1b9 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:34:58.839631 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4028/8048] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:34:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:35:06.662506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=31 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:08.833561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=38 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:09.180907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79de75-6368-4223-a4e4-b7985b702f32 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:09.254918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79de75-6368-4223-a4e4-b7985b702f32 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:09.260718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:09.262928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:09.262928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:09.262928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] PATH_INFO: `/v3/users/40a381bd7dca457cb050edd511e103c7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:09.263234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a381bd7dca457cb050edd511e103c7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:09.265151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:09.318970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a381bd7dca457cb050edd511e103c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:09.327333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a381bd7dca457cb050edd511e103c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:09.328111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a381bd7dca457cb050edd511e103c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:09.343716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a381bd7dca457cb050edd511e103c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:09.344435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a381bd7dca457cb050edd511e103c7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:09.358567 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4021/8049] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:09 2022] DELETE /identity/v3/users/40a381bd7dca457cb050edd511e103c7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:09.363407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f625706-f22f-4c6c-934a-a6607bb4c5f7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:09.363997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f625706-f22f-4c6c-934a-a6607bb4c5f7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:09.364559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f625706-f22f-4c6c-934a-a6607bb4c5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:09.387147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4f625706-f22f-4c6c-934a-a6607bb4c5f7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:09.388376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4f625706-f22f-4c6c-934a-a6607bb4c5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:09.459651 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4029/8050] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:09.472431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:09.473921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:09.541155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a9bee-3433-4a94-9362-45eb204639ac admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:09.545247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee70e3-2bbd-4fcd-ac63-fa573909bed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:09.546054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee70e3-2bbd-4fcd-ac63-fa573909bed3 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:09.546562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee70e3-2bbd-4fcd-ac63-fa573909bed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:09.547025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee70e3-2bbd-4fcd-ac63-fa573909bed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:09.558162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee70e3-2bbd-4fcd-ac63-fa573909bed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:09.565037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee70e3-2bbd-4fcd-ac63-fa573909bed3 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:09.572807 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4022/8051] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:35:10.047516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f625706-f22f-4c6c-934a-a6607bb4c5f7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:10.047990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4f625706-f22f-4c6c-934a-a6607bb4c5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:10.061889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f625706-f22f-4c6c-934a-a6607bb4c5f7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:10.066831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf5019-c55f-4b78-8c20-881767e9fced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:10.067496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf5019-c55f-4b78-8c20-881767e9fced admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:10.067690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf5019-c55f-4b78-8c20-881767e9fced admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:10.067971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf5019-c55f-4b78-8c20-881767e9fced admin admin] PATH_INFO: `/v3/projects/381ea16493934ba08abbc2c9174aa29e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:10.069129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf5019-c55f-4b78-8c20-881767e9fced admin admin] RBAC: Authorizing `identity:delete_project(project_id=381ea16493934ba08abbc2c9174aa29e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:10.072311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf5019-c55f-4b78-8c20-881767e9fced admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:10.136028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7bf5019-c55f-4b78-8c20-881767e9fced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381ea16493934ba08abbc2c9174aa29e', 'request_id': 'req-c7bf5019-c55f-4b78-8c20-881767e9fced'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:10.141784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7bf5019-c55f-4b78-8c20-881767e9fced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381ea16493934ba08abbc2c9174aa29e', 'request_id': 'req-c7bf5019-c55f-4b78-8c20-881767e9fced'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:10.148204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7bf5019-c55f-4b78-8c20-881767e9fced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381ea16493934ba08abbc2c9174aa29e', 'request_id': 'req-c7bf5019-c55f-4b78-8c20-881767e9fced'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:10.163185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7bf5019-c55f-4b78-8c20-881767e9fced admin admin] The token cache is being invalidate because project 381ea16493934ba08abbc2c9174aa29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:10.163524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7bf5019-c55f-4b78-8c20-881767e9fced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:10.164386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7bf5019-c55f-4b78-8c20-881767e9fced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:10.165894 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4030/8052] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:10 2022] DELETE /identity/v3/projects/381ea16493934ba08abbc2c9174aa29e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:10.170811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084e5e4-4a71-4026-a121-2208c248dbae None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:10.171101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084e5e4-4a71-4026-a121-2208c248dbae None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:10.171376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084e5e4-4a71-4026-a121-2208c248dbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:10.194371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3084e5e4-4a71-4026-a121-2208c248dbae None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:10.196343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3084e5e4-4a71-4026-a121-2208c248dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:10.214020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:10.261338 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4023/8053] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:10.269134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373094d4-6533-4aa8-9135-1c3e9aab07c6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:10.269456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373094d4-6533-4aa8-9135-1c3e9aab07c6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:10.269762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373094d4-6533-4aa8-9135-1c3e9aab07c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:10.291354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-373094d4-6533-4aa8-9135-1c3e9aab07c6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:10.292564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-373094d4-6533-4aa8-9135-1c3e9aab07c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:10.301696 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4031/8054] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:10.307055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084e5e4-4a71-4026-a121-2208c248dbae None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:10.317213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084e5e4-4a71-4026-a121-2208c248dbae None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:10.323180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beb233-7ed1-4e98-a69f-435c0fbd6e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:10.323824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beb233-7ed1-4e98-a69f-435c0fbd6e3a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:10.324108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beb233-7ed1-4e98-a69f-435c0fbd6e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:10.324385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beb233-7ed1-4e98-a69f-435c0fbd6e3a admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:10.325037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beb233-7ed1-4e98-a69f-435c0fbd6e3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:35:10.325346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beb233-7ed1-4e98-a69f-435c0fbd6e3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:10.326983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beb233-7ed1-4e98-a69f-435c0fbd6e3a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:10.339730 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4024/8055] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:10.344179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373094d4-6533-4aa8-9135-1c3e9aab07c6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:10.354021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373094d4-6533-4aa8-9135-1c3e9aab07c6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:10.359135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b4013-59ec-4cf7-b1d2-3d801376959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:10.359751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b4013-59ec-4cf7-b1d2-3d801376959f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:10.360058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b4013-59ec-4cf7-b1d2-3d801376959f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:10.360317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b4013-59ec-4cf7-b1d2-3d801376959f admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:10.360952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b4013-59ec-4cf7-b1d2-3d801376959f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:10.362899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b4013-59ec-4cf7-b1d2-3d801376959f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:10.395840 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4032/8056] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:10 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:10.396989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beb233-7ed1-4e98-a69f-435c0fbd6e3a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:10.407603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beb233-7ed1-4e98-a69f-435c0fbd6e3a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:10.468722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d7430-6498-46f2-952e-de33a546ffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:10.469341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7430-6498-46f2-952e-de33a546ffaf admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:10.469629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7430-6498-46f2-952e-de33a546ffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:10.469915 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7430-6498-46f2-952e-de33a546ffaf admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:10.470588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d7430-6498-46f2-952e-de33a546ffaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:10.472555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d7430-6498-46f2-952e-de33a546ffaf admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:10.506857 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4025/8057] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:10 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:10.509009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b4013-59ec-4cf7-b1d2-3d801376959f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:10.520462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b4013-59ec-4cf7-b1d2-3d801376959f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:10.525514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2cbf2-7bbc-4f68-8f48-3188508ed82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:10.526122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2cbf2-7bbc-4f68-8f48-3188508ed82a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:10.526409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2cbf2-7bbc-4f68-8f48-3188508ed82a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:10.526689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2cbf2-7bbc-4f68-8f48-3188508ed82a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:10.527477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2cbf2-7bbc-4f68-8f48-3188508ed82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:10.529092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2cbf2-7bbc-4f68-8f48-3188508ed82a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:10.543492 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4033/8058] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:35:10.544844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d7430-6498-46f2-952e-de33a546ffaf admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:10.556286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d7430-6498-46f2-952e-de33a546ffaf admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:10.561678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e77502-fcc1-4fa1-bda5-0b7bf9b150a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:10.562297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e77502-fcc1-4fa1-bda5-0b7bf9b150a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:10.562587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e77502-fcc1-4fa1-bda5-0b7bf9b150a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:10.562910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e77502-fcc1-4fa1-bda5-0b7bf9b150a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:10.563568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e77502-fcc1-4fa1-bda5-0b7bf9b150a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:10.565505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e77502-fcc1-4fa1-bda5-0b7bf9b150a8 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:10.579603 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4026/8059] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:10.584061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2cbf2-7bbc-4f68-8f48-3188508ed82a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:10.594488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2cbf2-7bbc-4f68-8f48-3188508ed82a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:10.599229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b71b54-30d5-45bd-8eec-4655d3f7dea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:10.599886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b71b54-30d5-45bd-8eec-4655d3f7dea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:10.600172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b71b54-30d5-45bd-8eec-4655d3f7dea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:10.600453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b71b54-30d5-45bd-8eec-4655d3f7dea8 admin admin] PATH_INFO: `/v3/projects/7fcb0bc19d2a4e9d88611c49a07d7164/users/b5fcd617906f48fbb6304099755e0f16/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:10.616549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b71b54-30d5-45bd-8eec-4655d3f7dea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcb0bc19d2a4e9d88611c49a07d7164, user_id=b5fcd617906f48fbb6304099755e0f16, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:10.620030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b71b54-30d5-45bd-8eec-4655d3f7dea8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:10.634327 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4034/8060] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:10 2022] PUT /identity/v3/projects/7fcb0bc19d2a4e9d88611c49a07d7164/users/b5fcd617906f48fbb6304099755e0f16/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:10.644627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b221a-583e-4a7a-9332-cdf7cf2b0eed None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:10.645066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b221a-583e-4a7a-9332-cdf7cf2b0eed None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:10.645346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b221a-583e-4a7a-9332-cdf7cf2b0eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:10.675660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2f6b221a-583e-4a7a-9332-cdf7cf2b0eed None None] MFA Rules not processed for user `b5fcd617906f48fbb6304099755e0f16`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:10.677403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2f6b221a-583e-4a7a-9332-cdf7cf2b0eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:10.750548 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4027/8061] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:10.761930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b71b54-30d5-45bd-8eec-4655d3f7dea8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:10.763948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-27b71b54-30d5-45bd-8eec-4655d3f7dea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:10.786614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:10.829576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b71b54-30d5-45bd-8eec-4655d3f7dea8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:10.833335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3784a0-7b92-47ad-b086-5dc72192d972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:10.833946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3784a0-7b92-47ad-b086-5dc72192d972 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:10.834226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3784a0-7b92-47ad-b086-5dc72192d972 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:10.834500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3784a0-7b92-47ad-b086-5dc72192d972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:10.844220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3784a0-7b92-47ad-b086-5dc72192d972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:10.845666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3784a0-7b92-47ad-b086-5dc72192d972 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:10.856465 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4035/8062] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:35:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:35:12.242867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91560f1-26ff-4341-9dbe-1a25de3e2f5f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:12.243409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91560f1-26ff-4341-9dbe-1a25de3e2f5f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:12.243537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91560f1-26ff-4341-9dbe-1a25de3e2f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:12.263826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b91560f1-26ff-4341-9dbe-1a25de3e2f5f None None] MFA Rules not processed for user `b5fcd617906f48fbb6304099755e0f16`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:12.265042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b91560f1-26ff-4341-9dbe-1a25de3e2f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:12.272040 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4028/8063] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:20.851929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=17 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:22.256929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:25.312243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4abe-d921-405c-8d2f-82722297fd70 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:25.312753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4abe-d921-405c-8d2f-82722297fd70 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:25.312943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4abe-d921-405c-8d2f-82722297fd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:25.376028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-172a4abe-d921-405c-8d2f-82722297fd70 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:25.377226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-172a4abe-d921-405c-8d2f-82722297fd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:25.438944 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4036/8064] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:35:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:25.460900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91560f1-26ff-4341-9dbe-1a25de3e2f5f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:25.462354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b91560f1-26ff-4341-9dbe-1a25de3e2f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:25.538352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91560f1-26ff-4341-9dbe-1a25de3e2f5f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:25.544264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e826f-4672-4c94-828c-6d7f564ac37f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:25.544881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e826f-4672-4c94-828c-6d7f564ac37f service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:25.545162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e826f-4672-4c94-828c-6d7f564ac37f service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:25.545438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e826f-4672-4c94-828c-6d7f564ac37f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:25.553842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e826f-4672-4c94-828c-6d7f564ac37f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:25.555669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e826f-4672-4c94-828c-6d7f564ac37f service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:25.565062 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4029/8065] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:35:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:35:26.088790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb83e6-13fe-4b4a-9088-0786542f2c5e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:26.089076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb83e6-13fe-4b4a-9088-0786542f2c5e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:26.089352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb83e6-13fe-4b4a-9088-0786542f2c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:26.109763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6abb83e6-13fe-4b4a-9088-0786542f2c5e None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:26.111013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6abb83e6-13fe-4b4a-9088-0786542f2c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:26.118283 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4037/8066] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:26.130513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e826f-4672-4c94-828c-6d7f564ac37f service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:26.143112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e826f-4672-4c94-828c-6d7f564ac37f service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:26.148342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958cc59-5c6a-4850-b2c7-31ef5c8a5ccf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:26.149089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958cc59-5c6a-4850-b2c7-31ef5c8a5ccf service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:26.149366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958cc59-5c6a-4850-b2c7-31ef5c8a5ccf service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:26.149704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958cc59-5c6a-4850-b2c7-31ef5c8a5ccf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:26.159148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958cc59-5c6a-4850-b2c7-31ef5c8a5ccf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:26.160820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958cc59-5c6a-4850-b2c7-31ef5c8a5ccf service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:26.171161 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4030/8067] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:35:26.422195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb83e6-13fe-4b4a-9088-0786542f2c5e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:26.423689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6abb83e6-13fe-4b4a-9088-0786542f2c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:26.451570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5adcb9-23a6-4270-a681-c5025afb6d7d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:26.451859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5adcb9-23a6-4270-a681-c5025afb6d7d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:26.452320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5adcb9-23a6-4270-a681-c5025afb6d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:26.472654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-dd5adcb9-23a6-4270-a681-c5025afb6d7d None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:26.473827 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dd5adcb9-23a6-4270-a681-c5025afb6d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:26.481766 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4031/8068] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:35:26.492540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb83e6-13fe-4b4a-9088-0786542f2c5e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:26.493790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5adcb9-23a6-4270-a681-c5025afb6d7d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:26.496527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5167f-b70f-49bf-bc07-32081d6c6d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:26.497116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5167f-b70f-49bf-bc07-32081d6c6d11 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:26.497395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5167f-b70f-49bf-bc07-32081d6c6d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:26.497859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5167f-b70f-49bf-bc07-32081d6c6d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:26.499797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5be5167f-b70f-49bf-bc07-32081d6c6d11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:26.507388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5adcb9-23a6-4270-a681-c5025afb6d7d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:26.513675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f915471-268d-4a82-87f7-36a346b4e67f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:26.514313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f915471-268d-4a82-87f7-36a346b4e67f service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:26.514602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f915471-268d-4a82-87f7-36a346b4e67f service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:26.514921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f915471-268d-4a82-87f7-36a346b4e67f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:26.524286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f915471-268d-4a82-87f7-36a346b4e67f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:26.526765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f915471-268d-4a82-87f7-36a346b4e67f service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:26.536943 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4032/8069] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 19:35:26.585676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5167f-b70f-49bf-bc07-32081d6c6d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:26.587729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5167f-b70f-49bf-bc07-32081d6c6d11 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:26.600699 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4038/8070] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:35:26.893621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a849f0-1480-48e5-885b-86288fcd23dc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:26.894452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a849f0-1480-48e5-885b-86288fcd23dc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:26.894840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a849f0-1480-48e5-885b-86288fcd23dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:26.915458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-42a849f0-1480-48e5-885b-86288fcd23dc None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:26.917763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-42a849f0-1480-48e5-885b-86288fcd23dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:26.926837 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4033/8071] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:26.942110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5167f-b70f-49bf-bc07-32081d6c6d11 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:26.956522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5167f-b70f-49bf-bc07-32081d6c6d11 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:26.961831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca095352-e70b-4029-911f-812e0134724f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:26.962557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca095352-e70b-4029-911f-812e0134724f service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:26.962992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca095352-e70b-4029-911f-812e0134724f service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:26.964006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca095352-e70b-4029-911f-812e0134724f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:26.973731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca095352-e70b-4029-911f-812e0134724f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:26.975829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca095352-e70b-4029-911f-812e0134724f service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:26.986311 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4039/8072] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:35:30.175520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a849f0-1480-48e5-885b-86288fcd23dc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:30.176975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-42a849f0-1480-48e5-885b-86288fcd23dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:30.195585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a849f0-1480-48e5-885b-86288fcd23dc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:30.200251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcabda-3d14-4a74-8c20-8383d0ce8520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:30.200884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcabda-3d14-4a74-8c20-8383d0ce8520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:30.201165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcabda-3d14-4a74-8c20-8383d0ce8520 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:30.201439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcabda-3d14-4a74-8c20-8383d0ce8520 admin admin] PATH_INFO: `/v3/users/778f9ab247a043dc9c67e42e0237a34a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:30.202591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcabda-3d14-4a74-8c20-8383d0ce8520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=778f9ab247a043dc9c67e42e0237a34a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:30.204584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcabda-3d14-4a74-8c20-8383d0ce8520 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:30.262390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46bcabda-3d14-4a74-8c20-8383d0ce8520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '778f9ab247a043dc9c67e42e0237a34a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.274394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46bcabda-3d14-4a74-8c20-8383d0ce8520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '778f9ab247a043dc9c67e42e0237a34a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.275529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46bcabda-3d14-4a74-8c20-8383d0ce8520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '778f9ab247a043dc9c67e42e0237a34a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.297520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca095352-e70b-4029-911f-812e0134724f service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:30.300275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46bcabda-3d14-4a74-8c20-8383d0ce8520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '778f9ab247a043dc9c67e42e0237a34a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.301242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-46bcabda-3d14-4a74-8c20-8383d0ce8520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '778f9ab247a043dc9c67e42e0237a34a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.303973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:30.313616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca095352-e70b-4029-911f-812e0134724f service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:30.319950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:30.320939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:30.321457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:30.321993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] PATH_INFO: `/v3/users/b5fcd617906f48fbb6304099755e0f16` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:30.323738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5fcd617906f48fbb6304099755e0f16)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:30.326233 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4034/8073] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:30 2022] DELETE /identity/v3/users/778f9ab247a043dc9c67e42e0237a34a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:30.326534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:30.388780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5fcd617906f48fbb6304099755e0f16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.401499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5fcd617906f48fbb6304099755e0f16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.402305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5fcd617906f48fbb6304099755e0f16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.414170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5fcd617906f48fbb6304099755e0f16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.415169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5fcd617906f48fbb6304099755e0f16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.440005 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4040/8074] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:30 2022] DELETE /identity/v3/users/b5fcd617906f48fbb6304099755e0f16 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:30.444447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4f1d4-b895-4a35-bfe3-af8675e41718 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:30.444759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4f1d4-b895-4a35-bfe3-af8675e41718 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:30.445062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4f1d4-b895-4a35-bfe3-af8675e41718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:30.467035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cfc4f1d4-b895-4a35-bfe3-af8675e41718 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:30.468754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cfc4f1d4-b895-4a35-bfe3-af8675e41718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:30.490032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:30.554306 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4035/8075] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:30.568701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:30.571537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:30.586431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4f1d4-b895-4a35-bfe3-af8675e41718 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:30.588751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cfc4f1d4-b895-4a35-bfe3-af8675e41718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:30.600239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e2421-8969-4852-b9f3-6cdd0926ee99 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:30.621879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8a29c-e29a-4549-99cb-efec73275edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:30.622783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8a29c-e29a-4549-99cb-efec73275edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:30.623221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8a29c-e29a-4549-99cb-efec73275edc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:30.623669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8a29c-e29a-4549-99cb-efec73275edc admin admin] PATH_INFO: `/v3/projects/4fc414bcd30546f38d67a8a99de551fa` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:30.625958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8a29c-e29a-4549-99cb-efec73275edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc414bcd30546f38d67a8a99de551fa)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:30.628352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8a29c-e29a-4549-99cb-efec73275edc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:30.671839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4f1d4-b895-4a35-bfe3-af8675e41718 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:30.676140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1455b5-15ab-4ce9-8a97-b8a939d91705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:30.676865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1455b5-15ab-4ce9-8a97-b8a939d91705 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:30.677156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1455b5-15ab-4ce9-8a97-b8a939d91705 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:30.677452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1455b5-15ab-4ce9-8a97-b8a939d91705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:30.691579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1455b5-15ab-4ce9-8a97-b8a939d91705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:30.693429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1455b5-15ab-4ce9-8a97-b8a939d91705 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:30.696296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b4e8a29c-e29a-4549-99cb-efec73275edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc414bcd30546f38d67a8a99de551fa', 'request_id': 'req-b4e8a29c-e29a-4549-99cb-efec73275edc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.704607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b4e8a29c-e29a-4549-99cb-efec73275edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc414bcd30546f38d67a8a99de551fa', 'request_id': 'req-b4e8a29c-e29a-4549-99cb-efec73275edc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.706157 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4036/8076] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:35:30.712666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b4e8a29c-e29a-4549-99cb-efec73275edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc414bcd30546f38d67a8a99de551fa', 'request_id': 'req-b4e8a29c-e29a-4549-99cb-efec73275edc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.746303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b4e8a29c-e29a-4549-99cb-efec73275edc admin admin] The token cache is being invalidate because project 4fc414bcd30546f38d67a8a99de551fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:30.746660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b4e8a29c-e29a-4549-99cb-efec73275edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.750868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b4e8a29c-e29a-4549-99cb-efec73275edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:30.753392 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4041/8077] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:30 2022] DELETE /identity/v3/projects/4fc414bcd30546f38d67a8a99de551fa => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:30.759751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebb724-3ea9-40b9-b714-f7d234d4ce74 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:30.760934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebb724-3ea9-40b9-b714-f7d234d4ce74 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:30.761222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebb724-3ea9-40b9-b714-f7d234d4ce74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:30.787136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-94ebb724-3ea9-40b9-b714-f7d234d4ce74 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:30.787136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-94ebb724-3ea9-40b9-b714-f7d234d4ce74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:30.866950 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4037/8078] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:30.870690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ec3d-f713-4332-884e-a0db02671df8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:30.872101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ec3d-f713-4332-884e-a0db02671df8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:30.872610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ec3d-f713-4332-884e-a0db02671df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:30.898322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-64d5ec3d-f713-4332-884e-a0db02671df8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:30.899770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-64d5ec3d-f713-4332-884e-a0db02671df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:30.911658 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4042/8079] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:35:30.916713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebb724-3ea9-40b9-b714-f7d234d4ce74 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:30.929100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebb724-3ea9-40b9-b714-f7d234d4ce74 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:30.935440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0c4fc-ef88-40ec-ac1b-2cd40e32cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:30.936088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0c4fc-ef88-40ec-ac1b-2cd40e32cec1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:30.936379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0c4fc-ef88-40ec-ac1b-2cd40e32cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:30.936657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0c4fc-ef88-40ec-ac1b-2cd40e32cec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:30.937343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0c4fc-ef88-40ec-ac1b-2cd40e32cec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:35:30.939030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0c4fc-ef88-40ec-ac1b-2cd40e32cec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:30.939349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0c4fc-ef88-40ec-ac1b-2cd40e32cec1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:30.959593 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4038/8080] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:35:30.964195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5ec3d-f713-4332-884e-a0db02671df8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:30.973515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0c4fc-ef88-40ec-ac1b-2cd40e32cec1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:30.977389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5ec3d-f713-4332-884e-a0db02671df8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:30.980812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-07b0c4fc-ef88-40ec-ac1b-2cd40e32cec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:30.989344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538178a8-c291-4f9e-ac51-a742fe2d5edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:30.990202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538178a8-c291-4f9e-ac51-a742fe2d5edb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:30.992123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538178a8-c291-4f9e-ac51-a742fe2d5edb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:30.992475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538178a8-c291-4f9e-ac51-a742fe2d5edb admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:30.993282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538178a8-c291-4f9e-ac51-a742fe2d5edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.001124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538178a8-c291-4f9e-ac51-a742fe2d5edb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.008992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0c4fc-ef88-40ec-ac1b-2cd40e32cec1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.014664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9dda8-9db3-4336-8784-05430a76daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.015408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9dda8-9db3-4336-8784-05430a76daf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.015692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9dda8-9db3-4336-8784-05430a76daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.015966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9dda8-9db3-4336-8784-05430a76daf6 admin admin] PATH_INFO: `/v3/projects/7fcb0bc19d2a4e9d88611c49a07d7164` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.017338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9dda8-9db3-4336-8784-05430a76daf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcb0bc19d2a4e9d88611c49a07d7164)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.019311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9dda8-9db3-4336-8784-05430a76daf6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.068077 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4043/8081] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:30 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:31.072339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538178a8-c291-4f9e-ac51-a742fe2d5edb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.101542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:31.103581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-07d9dda8-9db3-4336-8784-05430a76daf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcb0bc19d2a4e9d88611c49a07d7164', 'request_id': 'req-07d9dda8-9db3-4336-8784-05430a76daf6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:31.116867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-07d9dda8-9db3-4336-8784-05430a76daf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcb0bc19d2a4e9d88611c49a07d7164', 'request_id': 'req-07d9dda8-9db3-4336-8784-05430a76daf6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:31.126643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:31.127559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-07d9dda8-9db3-4336-8784-05430a76daf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcb0bc19d2a4e9d88611c49a07d7164', 'request_id': 'req-07d9dda8-9db3-4336-8784-05430a76daf6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:31.147358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-07d9dda8-9db3-4336-8784-05430a76daf6 admin admin] The token cache is being invalidate because project 7fcb0bc19d2a4e9d88611c49a07d7164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:31.147963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-07d9dda8-9db3-4336-8784-05430a76daf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:31.149007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-07d9dda8-9db3-4336-8784-05430a76daf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:31.154964 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4039/8082] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:30 2022] DELETE /identity/v3/projects/7fcb0bc19d2a4e9d88611c49a07d7164 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:31.157545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa755a23-8498-4e74-8d33-65280eb33ded None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.158800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa755a23-8498-4e74-8d33-65280eb33ded None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.159088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa755a23-8498-4e74-8d33-65280eb33ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.183130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538178a8-c291-4f9e-ac51-a742fe2d5edb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.190130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-aa755a23-8498-4e74-8d33-65280eb33ded None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:31.191449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aa755a23-8498-4e74-8d33-65280eb33ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:31.262183 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4040/8083] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:31.270861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc01bfd-bb65-485e-99b0-a3be7bba207c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.271240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc01bfd-bb65-485e-99b0-a3be7bba207c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.271592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc01bfd-bb65-485e-99b0-a3be7bba207c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.272977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b907e1-f1d4-48fc-b72d-7ecdf1baa3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.273674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b907e1-f1d4-48fc-b72d-7ecdf1baa3ed admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.274021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b907e1-f1d4-48fc-b72d-7ecdf1baa3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.274365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b907e1-f1d4-48fc-b72d-7ecdf1baa3ed admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.275203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b907e1-f1d4-48fc-b72d-7ecdf1baa3ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.277374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b907e1-f1d4-48fc-b72d-7ecdf1baa3ed admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.303949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9dc01bfd-bb65-485e-99b0-a3be7bba207c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:31.305279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9dc01bfd-bb65-485e-99b0-a3be7bba207c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:31.309458 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4044/8084] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:31 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:31.312955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b907e1-f1d4-48fc-b72d-7ecdf1baa3ed admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.314912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-53b907e1-f1d4-48fc-b72d-7ecdf1baa3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:31.320147 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4041/8085] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:31.321147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc01bfd-bb65-485e-99b0-a3be7bba207c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.330875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b907e1-f1d4-48fc-b72d-7ecdf1baa3ed admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.332515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc01bfd-bb65-485e-99b0-a3be7bba207c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.336891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea0b3c-6c37-4f8f-93ab-ca79da333bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.337605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea0b3c-6c37-4f8f-93ab-ca79da333bae admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.337893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea0b3c-6c37-4f8f-93ab-ca79da333bae admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.338017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66ee71-0bb5-4a51-af26-5a62ca07f816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.338405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea0b3c-6c37-4f8f-93ab-ca79da333bae admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.338580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66ee71-0bb5-4a51-af26-5a62ca07f816 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.338876 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66ee71-0bb5-4a51-af26-5a62ca07f816 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.339160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66ee71-0bb5-4a51-af26-5a62ca07f816 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.339311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea0b3c-6c37-4f8f-93ab-ca79da333bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.340261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66ee71-0bb5-4a51-af26-5a62ca07f816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:35:31.340579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66ee71-0bb5-4a51-af26-5a62ca07f816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.341303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea0b3c-6c37-4f8f-93ab-ca79da333bae admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.342287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66ee71-0bb5-4a51-af26-5a62ca07f816 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.355813 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4045/8086] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:31.356331 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4042/8087] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:31.360335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea0b3c-6c37-4f8f-93ab-ca79da333bae admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.360930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66ee71-0bb5-4a51-af26-5a62ca07f816 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.374334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66ee71-0bb5-4a51-af26-5a62ca07f816 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.374528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea0b3c-6c37-4f8f-93ab-ca79da333bae admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.379529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f868391-1227-4274-8659-2dab867ad297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.380232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a3d26-23c8-4e53-8955-6dee1df76999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.380462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f868391-1227-4274-8659-2dab867ad297 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.380935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f868391-1227-4274-8659-2dab867ad297 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.381222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f868391-1227-4274-8659-2dab867ad297 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.381410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a3d26-23c8-4e53-8955-6dee1df76999 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.381845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a3d26-23c8-4e53-8955-6dee1df76999 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.381972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f868391-1227-4274-8659-2dab867ad297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.382213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a3d26-23c8-4e53-8955-6dee1df76999 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.383362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a3d26-23c8-4e53-8955-6dee1df76999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.384328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f868391-1227-4274-8659-2dab867ad297 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.385787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a3d26-23c8-4e53-8955-6dee1df76999 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.402144 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4046/8088] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:31.406600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a3d26-23c8-4e53-8955-6dee1df76999 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.418917 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4043/8089] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:31 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:31.420552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a3d26-23c8-4e53-8955-6dee1df76999 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.423139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f868391-1227-4274-8659-2dab867ad297 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.494050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f714200-93e9-4f16-9ccb-6dc8a6113285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.495821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f714200-93e9-4f16-9ccb-6dc8a6113285 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.496176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f714200-93e9-4f16-9ccb-6dc8a6113285 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.496525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f714200-93e9-4f16-9ccb-6dc8a6113285 admin admin] PATH_INFO: `/v3/projects/b1c8c0d13d684688ac09e35d02dc9694/users/8217cf6927744150bc2d0741f1707b22/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.510945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f868391-1227-4274-8659-2dab867ad297 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.515015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f714200-93e9-4f16-9ccb-6dc8a6113285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c8c0d13d684688ac09e35d02dc9694, user_id=8217cf6927744150bc2d0741f1707b22, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.516331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6099e-2825-4ce4-814c-d9f4826e3beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.517069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6099e-2825-4ce4-814c-d9f4826e3beb admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.517465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6099e-2825-4ce4-814c-d9f4826e3beb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.517748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6099e-2825-4ce4-814c-d9f4826e3beb admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.518350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f714200-93e9-4f16-9ccb-6dc8a6113285 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.518527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6099e-2825-4ce4-814c-d9f4826e3beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.520563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6099e-2825-4ce4-814c-d9f4826e3beb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.537325 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4047/8090] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:31 2022] PUT /identity/v3/projects/b1c8c0d13d684688ac09e35d02dc9694/users/8217cf6927744150bc2d0741f1707b22/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:31.549116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c168c06-f409-43fc-9430-05516e9c33d5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.549408 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c168c06-f409-43fc-9430-05516e9c33d5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.549691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c168c06-f409-43fc-9430-05516e9c33d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.551446 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4044/8091] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:31 2022] POST /identity/v3/users => generated 282 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:31.552333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6099e-2825-4ce4-814c-d9f4826e3beb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.581240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6099e-2825-4ce4-814c-d9f4826e3beb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.583525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7c168c06-f409-43fc-9430-05516e9c33d5 None None] MFA Rules not processed for user `8217cf6927744150bc2d0741f1707b22`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:31.585012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7c168c06-f409-43fc-9430-05516e9c33d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:31.599830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:31.609919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:31.656129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4998c-c529-4f31-82c2-22b0e50181a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.656865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4998c-c529-4f31-82c2-22b0e50181a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.657214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4998c-c529-4f31-82c2-22b0e50181a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.657559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4998c-c529-4f31-82c2-22b0e50181a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.658270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4998c-c529-4f31-82c2-22b0e50181a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.659989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4998c-c529-4f31-82c2-22b0e50181a7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.664281 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4048/8092] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:35:31.671832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c168c06-f409-43fc-9430-05516e9c33d5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.673707 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4045/8093] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:31.678305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4998c-c529-4f31-82c2-22b0e50181a7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.685900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c168c06-f409-43fc-9430-05516e9c33d5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.690525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4998c-c529-4f31-82c2-22b0e50181a7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.691463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec8137-7c8b-4688-9375-d60e33176d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.692196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec8137-7c8b-4688-9375-d60e33176d3f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.692529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec8137-7c8b-4688-9375-d60e33176d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.692884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec8137-7c8b-4688-9375-d60e33176d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.693625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec8137-7c8b-4688-9375-d60e33176d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.695922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec8137-7c8b-4688-9375-d60e33176d3f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.697780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99ec6b-3dbd-4966-bfb1-e410d315a86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.698672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99ec6b-3dbd-4966-bfb1-e410d315a86f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.699225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99ec6b-3dbd-4966-bfb1-e410d315a86f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.699692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99ec6b-3dbd-4966-bfb1-e410d315a86f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.700552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99ec6b-3dbd-4966-bfb1-e410d315a86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.702482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99ec6b-3dbd-4966-bfb1-e410d315a86f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.721655 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4046/8094] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:35:31.723019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99ec6b-3dbd-4966-bfb1-e410d315a86f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.736464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99ec6b-3dbd-4966-bfb1-e410d315a86f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.742416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791f92d-248c-4bc9-8087-ac44128cd7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.744477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791f92d-248c-4bc9-8087-ac44128cd7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.745499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791f92d-248c-4bc9-8087-ac44128cd7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.746007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791f92d-248c-4bc9-8087-ac44128cd7ed admin admin] PATH_INFO: `/v3/projects/3964447817eb41558aa7925a1ab1b5e1/users/318132d8307348b4b3d83c383e155641/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.746367 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4049/8095] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:31 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:31.748147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec8137-7c8b-4688-9375-d60e33176d3f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.775095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791f92d-248c-4bc9-8087-ac44128cd7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3964447817eb41558aa7925a1ab1b5e1, user_id=318132d8307348b4b3d83c383e155641, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.781459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791f92d-248c-4bc9-8087-ac44128cd7ed admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.799674 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4047/8096] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:31 2022] PUT /identity/v3/projects/3964447817eb41558aa7925a1ab1b5e1/users/318132d8307348b4b3d83c383e155641/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:31.804638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ff3c7-1199-4305-af54-2682b1a6574e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.804960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ff3c7-1199-4305-af54-2682b1a6574e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.805243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ff3c7-1199-4305-af54-2682b1a6574e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.818958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec8137-7c8b-4688-9375-d60e33176d3f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.826771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-282ff3c7-1199-4305-af54-2682b1a6574e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:31.828035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-282ff3c7-1199-4305-af54-2682b1a6574e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:31.876079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65ed6a-77e2-4e5d-8ef3-5ef1ac697656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.876693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65ed6a-77e2-4e5d-8ef3-5ef1ac697656 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.876971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65ed6a-77e2-4e5d-8ef3-5ef1ac697656 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.877242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65ed6a-77e2-4e5d-8ef3-5ef1ac697656 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.877953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65ed6a-77e2-4e5d-8ef3-5ef1ac697656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.879831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65ed6a-77e2-4e5d-8ef3-5ef1ac697656 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.890109 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4048/8097] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:35:31.901907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ff3c7-1199-4305-af54-2682b1a6574e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.902833 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4050/8098] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:31 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:31.903758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-282ff3c7-1199-4305-af54-2682b1a6574e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:31.906527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65ed6a-77e2-4e5d-8ef3-5ef1ac697656 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.917164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65ed6a-77e2-4e5d-8ef3-5ef1ac697656 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.922067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8149bc3-e82c-4cad-9d8d-23de08574f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.922660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8149bc3-e82c-4cad-9d8d-23de08574f77 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.922972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8149bc3-e82c-4cad-9d8d-23de08574f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.923243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8149bc3-e82c-4cad-9d8d-23de08574f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.923874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8149bc3-e82c-4cad-9d8d-23de08574f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.925459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8149bc3-e82c-4cad-9d8d-23de08574f77 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.936398 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4051/8099] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:35:31.940363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8149bc3-e82c-4cad-9d8d-23de08574f77 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:31.950291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8149bc3-e82c-4cad-9d8d-23de08574f77 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.955552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b15c3b-7422-4a6a-a0a1-a42067570c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.956202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b15c3b-7422-4a6a-a0a1-a42067570c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.956576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b15c3b-7422-4a6a-a0a1-a42067570c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.956876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b15c3b-7422-4a6a-a0a1-a42067570c2b admin admin] PATH_INFO: `/v3/projects/3b933b8d5cd540f68ff64994ebfb283d/users/e75dc8aed74b4e2c9cc2453292a42e68/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.965067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ff3c7-1199-4305-af54-2682b1a6574e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:31.968708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb774a-7b8a-4a14-bce3-5770998ae83c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:31.969311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb774a-7b8a-4a14-bce3-5770998ae83c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:31.969593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb774a-7b8a-4a14-bce3-5770998ae83c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:31.969866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb774a-7b8a-4a14-bce3-5770998ae83c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:31.975251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b15c3b-7422-4a6a-a0a1-a42067570c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b933b8d5cd540f68ff64994ebfb283d, user_id=e75dc8aed74b4e2c9cc2453292a42e68, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.977946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b15c3b-7422-4a6a-a0a1-a42067570c2b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.980341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb774a-7b8a-4a14-bce3-5770998ae83c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:31.981763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb774a-7b8a-4a14-bce3-5770998ae83c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:31.982549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:31.992817 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4049/8100] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:35:31.995386 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4052/8101] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:31 2022] PUT /identity/v3/projects/3b933b8d5cd540f68ff64994ebfb283d/users/e75dc8aed74b4e2c9cc2453292a42e68/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:31.999140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb774a-7b8a-4a14-bce3-5770998ae83c service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.009288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb774a-7b8a-4a14-bce3-5770998ae83c service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.037238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:32.072662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80606538-4129-4a78-b162-574ce128b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.074150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80606538-4129-4a78-b162-574ce128b370 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.074433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80606538-4129-4a78-b162-574ce128b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.074839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80606538-4129-4a78-b162-574ce128b370 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.075636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80606538-4129-4a78-b162-574ce128b370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.077347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80606538-4129-4a78-b162-574ce128b370 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.088635 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4050/8102] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:35:32.093381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b15c3b-7422-4a6a-a0a1-a42067570c2b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.104163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b15c3b-7422-4a6a-a0a1-a42067570c2b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.108753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c26b2-a018-41ba-8861-24c2eba8a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.109406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c26b2-a018-41ba-8861-24c2eba8a902 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.109686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c26b2-a018-41ba-8861-24c2eba8a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.109960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c26b2-a018-41ba-8861-24c2eba8a902 admin admin] PATH_INFO: `/v3/projects/3b933b8d5cd540f68ff64994ebfb283d/users/e75dc8aed74b4e2c9cc2453292a42e68/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.111884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c26b2-a018-41ba-8861-24c2eba8a902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b933b8d5cd540f68ff64994ebfb283d, user_id=e75dc8aed74b4e2c9cc2453292a42e68, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.114521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c26b2-a018-41ba-8861-24c2eba8a902 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.126547 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4053/8103] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:32 2022] PUT /identity/v3/projects/3b933b8d5cd540f68ff64994ebfb283d/users/e75dc8aed74b4e2c9cc2453292a42e68/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:32.137762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1abf84-abfb-448f-9aa2-480658087863 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.138052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1abf84-abfb-448f-9aa2-480658087863 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.138331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1abf84-abfb-448f-9aa2-480658087863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.170642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0a1abf84-abfb-448f-9aa2-480658087863 None None] MFA Rules not processed for user `e75dc8aed74b4e2c9cc2453292a42e68`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:32.171900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0a1abf84-abfb-448f-9aa2-480658087863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:32.247132 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4051/8104] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:32.251515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c26b2-a018-41ba-8861-24c2eba8a902 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.262979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c26b2-a018-41ba-8861-24c2eba8a902 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.268059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1f4d0-8fd3-490c-9785-b783024ef8ce tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.268676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1f4d0-8fd3-490c-9785-b783024ef8ce tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.268965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1f4d0-8fd3-490c-9785-b783024ef8ce tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.269396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1f4d0-8fd3-490c-9785-b783024ef8ce tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.270191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1f4d0-8fd3-490c-9785-b783024ef8ce tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.272124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1f4d0-8fd3-490c-9785-b783024ef8ce tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.290857 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4054/8105] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:32 2022] POST /identity/v3/services => generated 289 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:32.294642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1abf84-abfb-448f-9aa2-480658087863 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.305096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1abf84-abfb-448f-9aa2-480658087863 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.325220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e27a21-1d19-4e70-a85c-62c418eef974 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.325842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e27a21-1d19-4e70-a85c-62c418eef974 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.326154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e27a21-1d19-4e70-a85c-62c418eef974 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.326462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e27a21-1d19-4e70-a85c-62c418eef974 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.327153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e27a21-1d19-4e70-a85c-62c418eef974 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.328769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e27a21-1d19-4e70-a85c-62c418eef974 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-62e27a21-1d19-4e70-a85c-62c418eef974 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: On instance['enabled']: Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: On instance['enabled']: Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: 'False' Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise error Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application 'False' Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.336237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 19:35:32.337707 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 19:35:32.338735 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 19:35:32.338735 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 19:35:32.338735 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.338735 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.338735 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.338735 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.338735 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 19:35:32.338735 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application 'False' Aug 28 19:35:32.338735 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.338735 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4052/8106] 10.222.0.70 () {60 vars in 1156 bytes} [Sun Aug 28 19:35:32 2022] POST /identity/v3/endpoints => generated 283 bytes in 43 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 19:35:32.343450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1f4d0-8fd3-490c-9785-b783024ef8ce tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.358458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1f4d0-8fd3-490c-9785-b783024ef8ce tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.365872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3061880-f2a6-430b-a303-d7da995c14c9 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.366796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3061880-f2a6-430b-a303-d7da995c14c9 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.367310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3061880-f2a6-430b-a303-d7da995c14c9 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.367818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3061880-f2a6-430b-a303-d7da995c14c9 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.368815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3061880-f2a6-430b-a303-d7da995c14c9 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.371620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3061880-f2a6-430b-a303-d7da995c14c9 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-b3061880-f2a6-430b-a303-d7da995c14c9 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: On instance['enabled']: Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: On instance['enabled']: Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: 'True' Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise error Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application 'True' Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.380095 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 19:35:32.381574 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 19:35:32.382551 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 19:35:32.382551 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 19:35:32.382551 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.382551 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.382551 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.382551 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.382551 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 19:35:32.382551 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application 'True' Aug 28 19:35:32.382551 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.382551 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4055/8107] 10.222.0.70 () {60 vars in 1156 bytes} [Sun Aug 28 19:35:32 2022] POST /identity/v3/endpoints => generated 281 bytes in 39 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 28 19:35:32.389298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e27a21-1d19-4e70-a85c-62c418eef974 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.401274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e27a21-1d19-4e70-a85c-62c418eef974 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.406735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12da86-9997-4c04-9aaf-d0ae30ba43c7 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.407411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12da86-9997-4c04-9aaf-d0ae30ba43c7 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.407697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12da86-9997-4c04-9aaf-d0ae30ba43c7 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.407974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12da86-9997-4c04-9aaf-d0ae30ba43c7 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.408671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12da86-9997-4c04-9aaf-d0ae30ba43c7 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.410324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12da86-9997-4c04-9aaf-d0ae30ba43c7 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.429990 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-ac12da86-9997-4c04-9aaf-d0ae30ba43c7 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-125391679. To ensure interoperability, identifiers should be a valid uuid. Aug 28 19:35:32.429990 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 19:35:32.429990 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:35:32.469863 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4053/8108] 10.222.0.70 () {60 vars in 1156 bytes} [Sun Aug 28 19:35:32 2022] POST /identity/v3/endpoints => generated 358 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:32.471222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3061880-f2a6-430b-a303-d7da995c14c9 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.482860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3061880-f2a6-430b-a303-d7da995c14c9 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.505947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7839327-7791-411c-ad4d-f138b17eb954 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.506575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839327-7791-411c-ad4d-f138b17eb954 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.506935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839327-7791-411c-ad4d-f138b17eb954 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.507156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7839327-7791-411c-ad4d-f138b17eb954 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/regions/tempest-region-125391679` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.508010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7839327-7791-411c-ad4d-f138b17eb954 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-125391679)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.509088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7839327-7791-411c-ad4d-f138b17eb954 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.512111 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4056/8109] 10.222.0.70 () {58 vars in 1203 bytes} [Sun Aug 28 19:35:32 2022] GET /identity/v3/regions/tempest-region-125391679 => generated 178 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:32.516916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12da86-9997-4c04-9aaf-d0ae30ba43c7 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.531106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12da86-9997-4c04-9aaf-d0ae30ba43c7 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.536158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbe37e-baf6-4ef2-be7e-632f3f5e6005 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.536805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbe37e-baf6-4ef2-be7e-632f3f5e6005 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.537088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbe37e-baf6-4ef2-be7e-632f3f5e6005 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.537365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbe37e-baf6-4ef2-be7e-632f3f5e6005 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/endpoints/dd9017fadb924326888e37746f3ff2c9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.544812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbe37e-baf6-4ef2-be7e-632f3f5e6005 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=dd9017fadb924326888e37746f3ff2c9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.546712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbe37e-baf6-4ef2-be7e-632f3f5e6005 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-f0cbe37e-baf6-4ef2-be7e-632f3f5e6005 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: On instance['enabled']: Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: On instance['enabled']: Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: 'False' Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise error Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application 'False' Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.554775 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 19:35:32.556237 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 19:35:32.557754 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 19:35:32.557754 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 28 19:35:32.557754 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.557754 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.557754 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.557754 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.557754 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 19:35:32.557754 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application 'False' Aug 28 19:35:32.557754 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:32.557754 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4054/8110] 10.222.0.70 () {60 vars in 1255 bytes} [Sun Aug 28 19:35:32 2022] PATCH /identity/v3/endpoints/dd9017fadb924326888e37746f3ff2c9 => generated 283 bytes in 40 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 28 19:35:32.561405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7839327-7791-411c-ad4d-f138b17eb954 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.576138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7839327-7791-411c-ad4d-f138b17eb954 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.582702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c97c91-0d55-490e-96e6-07951f179333 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.583396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c97c91-0d55-490e-96e6-07951f179333 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.583685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c97c91-0d55-490e-96e6-07951f179333 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.583995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c97c91-0d55-490e-96e6-07951f179333 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/endpoints/dd9017fadb924326888e37746f3ff2c9` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.585362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c97c91-0d55-490e-96e6-07951f179333 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=dd9017fadb924326888e37746f3ff2c9)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.587093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c97c91-0d55-490e-96e6-07951f179333 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.596034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-55c97c91-0d55-490e-96e6-07951f179333 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'dd9017fadb924326888e37746f3ff2c9', 'request_id': 'req-55c97c91-0d55-490e-96e6-07951f179333'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:32.606909 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4057/8111] 10.222.0.70 () {58 vars in 1236 bytes} [Sun Aug 28 19:35:32 2022] DELETE /identity/v3/endpoints/dd9017fadb924326888e37746f3ff2c9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:32.610961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbe37e-baf6-4ef2-be7e-632f3f5e6005 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.621836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbe37e-baf6-4ef2-be7e-632f3f5e6005 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.637917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf7bb8-82d2-4b0c-ad7e-e0abc21ee96f tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.638553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf7bb8-82d2-4b0c-ad7e-e0abc21ee96f tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.638868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf7bb8-82d2-4b0c-ad7e-e0abc21ee96f tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.639144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf7bb8-82d2-4b0c-ad7e-e0abc21ee96f tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/regions/tempest-region-125391679` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.639928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf7bb8-82d2-4b0c-ad7e-e0abc21ee96f tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-125391679)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.641556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf7bb8-82d2-4b0c-ad7e-e0abc21ee96f tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.663865 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4055/8112] 10.222.0.70 () {58 vars in 1206 bytes} [Sun Aug 28 19:35:32 2022] DELETE /identity/v3/regions/tempest-region-125391679 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:32.669323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c97c91-0d55-490e-96e6-07951f179333 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.680250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c97c91-0d55-490e-96e6-07951f179333 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.699527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29e904-7084-4f47-b3f9-56a27d35a5f1 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.700141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29e904-7084-4f47-b3f9-56a27d35a5f1 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.700422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29e904-7084-4f47-b3f9-56a27d35a5f1 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.700697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29e904-7084-4f47-b3f9-56a27d35a5f1 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.701366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29e904-7084-4f47-b3f9-56a27d35a5f1 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.703041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29e904-7084-4f47-b3f9-56a27d35a5f1 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.723579 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-8d29e904-7084-4f47-b3f9-56a27d35a5f1 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-63769729. To ensure interoperability, identifiers should be a valid uuid. Aug 28 19:35:32.723579 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 28 19:35:32.723579 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:35:32.767917 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4058/8113] 10.222.0.70 () {60 vars in 1156 bytes} [Sun Aug 28 19:35:32 2022] POST /identity/v3/endpoints => generated 357 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:32.771926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf7bb8-82d2-4b0c-ad7e-e0abc21ee96f tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.784685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf7bb8-82d2-4b0c-ad7e-e0abc21ee96f tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.802801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d90c5-d836-4119-9dde-2e93ff308c3e tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.803623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d90c5-d836-4119-9dde-2e93ff308c3e tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.803758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d90c5-d836-4119-9dde-2e93ff308c3e tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.804010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d90c5-d836-4119-9dde-2e93ff308c3e tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/regions/tempest-region-63769729` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.804600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d90c5-d836-4119-9dde-2e93ff308c3e tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-63769729)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.805682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d90c5-d836-4119-9dde-2e93ff308c3e tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.808211 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4056/8114] 10.222.0.70 () {58 vars in 1200 bytes} [Sun Aug 28 19:35:32 2022] GET /identity/v3/regions/tempest-region-63769729 => generated 176 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:32.812269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29e904-7084-4f47-b3f9-56a27d35a5f1 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.829445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29e904-7084-4f47-b3f9-56a27d35a5f1 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.835410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e41cbd-a2cb-4cef-b70b-9d9176a202cc tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.836057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41cbd-a2cb-4cef-b70b-9d9176a202cc tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.836348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41cbd-a2cb-4cef-b70b-9d9176a202cc tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.836631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41cbd-a2cb-4cef-b70b-9d9176a202cc tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/endpoints/70023b206ed64a95adde807f0fb75441` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.843710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e41cbd-a2cb-4cef-b70b-9d9176a202cc tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=70023b206ed64a95adde807f0fb75441)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.844749 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-e0e41cbd-a2cb-4cef-b70b-9d9176a202cc tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:32.844749 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:35:32.844749 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:35:32.845689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e41cbd-a2cb-4cef-b70b-9d9176a202cc tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-e0e41cbd-a2cb-4cef-b70b-9d9176a202cc tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: On instance['enabled']: Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: On instance['enabled']: Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: 'True' Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise error Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application 'True' Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.853571 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 28 19:35:32.856075 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 28 19:35:32.857037 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 28 19:35:32.857037 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 28 19:35:32.857037 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.857037 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 28 19:35:32.857037 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 28 19:35:32.857037 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.857037 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application On instance['enabled']: Aug 28 19:35:32.857037 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application 'True' Aug 28 19:35:32.857037 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:32.857037 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4059/8115] 10.222.0.70 () {60 vars in 1255 bytes} [Sun Aug 28 19:35:32 2022] PATCH /identity/v3/endpoints/70023b206ed64a95adde807f0fb75441 => generated 281 bytes in 44 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 19:35:32.862596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d90c5-d836-4119-9dde-2e93ff308c3e tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.870773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:32.876140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d90c5-d836-4119-9dde-2e93ff308c3e tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.886173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453fce2-06bb-46fb-b2fb-df9826778f1a tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.887504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453fce2-06bb-46fb-b2fb-df9826778f1a tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.888022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453fce2-06bb-46fb-b2fb-df9826778f1a tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.888381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453fce2-06bb-46fb-b2fb-df9826778f1a tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/endpoints/70023b206ed64a95adde807f0fb75441` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.889703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453fce2-06bb-46fb-b2fb-df9826778f1a tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=70023b206ed64a95adde807f0fb75441)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.891788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453fce2-06bb-46fb-b2fb-df9826778f1a tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.902891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1453fce2-06bb-46fb-b2fb-df9826778f1a tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '70023b206ed64a95adde807f0fb75441', 'request_id': 'req-1453fce2-06bb-46fb-b2fb-df9826778f1a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:32.915600 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4057/8116] 10.222.0.70 () {58 vars in 1236 bytes} [Sun Aug 28 19:35:32 2022] DELETE /identity/v3/endpoints/70023b206ed64a95adde807f0fb75441 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:32.920471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e41cbd-a2cb-4cef-b70b-9d9176a202cc tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.932061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e41cbd-a2cb-4cef-b70b-9d9176a202cc tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:32.951947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18c8b8-1cbb-4f50-bcc5-7f3749b443c5 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:32.952888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18c8b8-1cbb-4f50-bcc5-7f3749b443c5 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:32.953370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18c8b8-1cbb-4f50-bcc5-7f3749b443c5 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:32.953773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18c8b8-1cbb-4f50-bcc5-7f3749b443c5 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/regions/tempest-region-63769729` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:32.954355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18c8b8-1cbb-4f50-bcc5-7f3749b443c5 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-63769729)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:32.956135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18c8b8-1cbb-4f50-bcc5-7f3749b443c5 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:32.980477 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4060/8117] 10.222.0.70 () {58 vars in 1203 bytes} [Sun Aug 28 19:35:32 2022] DELETE /identity/v3/regions/tempest-region-63769729 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:32.985110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453fce2-06bb-46fb-b2fb-df9826778f1a tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:32.996859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453fce2-06bb-46fb-b2fb-df9826778f1a tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:33.012387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c7ada-7b38-4868-a1de-5d6da06b1a7b tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75dc8aed74b4e2c9cc2453292a42e68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b933b8d5cd540f68ff64994ebfb283d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:33.013021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c7ada-7b38-4868-a1de-5d6da06b1a7b tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:33.013303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c7ada-7b38-4868-a1de-5d6da06b1a7b tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:33.013577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c7ada-7b38-4868-a1de-5d6da06b1a7b tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] PATH_INFO: `/v3/services/54676e5705634ff493a02365efaae081` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:33.014152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c7ada-7b38-4868-a1de-5d6da06b1a7b tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorizing `identity:delete_service(service_id=54676e5705634ff493a02365efaae081)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:33.015831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c7ada-7b38-4868-a1de-5d6da06b1a7b tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:33.044028 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4058/8118] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:32 2022] DELETE /identity/v3/services/54676e5705634ff493a02365efaae081 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:33.049585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18c8b8-1cbb-4f50-bcc5-7f3749b443c5 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:33.136477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18c8b8-1cbb-4f50-bcc5-7f3749b443c5 tempest-EndpointsNegativeTestJSON-1663940768 tempest-EndpointsNegativeTestJSON-1663940768-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:33.142301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:33.156971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:33.157369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:33.157594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:33.157867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] PATH_INFO: `/v3/users/8217cf6927744150bc2d0741f1707b22` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:33.159747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8217cf6927744150bc2d0741f1707b22)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:33.163168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:33.233438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8217cf6927744150bc2d0741f1707b22'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:33.241414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8217cf6927744150bc2d0741f1707b22'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:33.242993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8217cf6927744150bc2d0741f1707b22'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:33.253632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8217cf6927744150bc2d0741f1707b22'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:33.254260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8217cf6927744150bc2d0741f1707b22'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:33.281662 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4061/8119] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:33 2022] DELETE /identity/v3/users/8217cf6927744150bc2d0741f1707b22 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:33.283671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc535a-da7e-4c4a-8b7e-6ae05bedf3c7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:33.284118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc535a-da7e-4c4a-8b7e-6ae05bedf3c7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:33.284219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc535a-da7e-4c4a-8b7e-6ae05bedf3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:33.304027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ddfc535a-da7e-4c4a-8b7e-6ae05bedf3c7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:33.305165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ddfc535a-da7e-4c4a-8b7e-6ae05bedf3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:33.398202 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4059/8120] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:33.417892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:33.418648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:33.509064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a410072-ee26-4a60-9f75-05aa4bf25bfa admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:33.514558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e93a-d406-4dbf-a368-262e96e539e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:33.515238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e93a-d406-4dbf-a368-262e96e539e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:33.515527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e93a-d406-4dbf-a368-262e96e539e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:33.515807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e93a-d406-4dbf-a368-262e96e539e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:33.526531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6e93a-d406-4dbf-a368-262e96e539e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:33.528283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6e93a-d406-4dbf-a368-262e96e539e9 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:33.541113 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4062/8121] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:35:33.928699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc535a-da7e-4c4a-8b7e-6ae05bedf3c7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:33.930158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ddfc535a-da7e-4c4a-8b7e-6ae05bedf3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:33.953321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc535a-da7e-4c4a-8b7e-6ae05bedf3c7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:33.971745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:33.972494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:33.972786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:33.973062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] PATH_INFO: `/v3/projects/b1c8c0d13d684688ac09e35d02dc9694` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:33.976087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c8c0d13d684688ac09e35d02dc9694)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:33.978189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:34.039787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c8c0d13d684688ac09e35d02dc9694', 'request_id': 'req-850be45a-bcc0-42ad-83a3-606930eeb179'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.048968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c8c0d13d684688ac09e35d02dc9694', 'request_id': 'req-850be45a-bcc0-42ad-83a3-606930eeb179'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.054889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c8c0d13d684688ac09e35d02dc9694', 'request_id': 'req-850be45a-bcc0-42ad-83a3-606930eeb179'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.067194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] The token cache is being invalidate because project b1c8c0d13d684688ac09e35d02dc9694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:34.067413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.068114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.069915 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4060/8122] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:33 2022] DELETE /identity/v3/projects/b1c8c0d13d684688ac09e35d02dc9694 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:34.076104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e93a-d406-4dbf-a368-262e96e539e9 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:34.092984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e93a-d406-4dbf-a368-262e96e539e9 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:34.161025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7cbc2-b7dc-492b-a8fb-3f66d58b311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:34.161748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7cbc2-b7dc-492b-a8fb-3f66d58b311a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:34.162028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7cbc2-b7dc-492b-a8fb-3f66d58b311a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:34.162303 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7cbc2-b7dc-492b-a8fb-3f66d58b311a admin admin] PATH_INFO: `/v3/users/e75dc8aed74b4e2c9cc2453292a42e68` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:34.163565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7cbc2-b7dc-492b-a8fb-3f66d58b311a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75dc8aed74b4e2c9cc2453292a42e68)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:34.165560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7cbc2-b7dc-492b-a8fb-3f66d58b311a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:34.172611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:34.231766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b0e7cbc2-b7dc-492b-a8fb-3f66d58b311a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75dc8aed74b4e2c9cc2453292a42e68'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.241723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b0e7cbc2-b7dc-492b-a8fb-3f66d58b311a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75dc8aed74b4e2c9cc2453292a42e68'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.243159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b0e7cbc2-b7dc-492b-a8fb-3f66d58b311a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75dc8aed74b4e2c9cc2453292a42e68'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.254419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b0e7cbc2-b7dc-492b-a8fb-3f66d58b311a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75dc8aed74b4e2c9cc2453292a42e68'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.255307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b0e7cbc2-b7dc-492b-a8fb-3f66d58b311a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75dc8aed74b4e2c9cc2453292a42e68'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.278550 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4063/8123] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:34 2022] DELETE /identity/v3/users/e75dc8aed74b4e2c9cc2453292a42e68 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:34.615236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:34.616803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:34.639949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850be45a-bcc0-42ad-83a3-606930eeb179 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:34.682968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:34.718519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:34.719515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:34.719895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:34.720234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb admin admin] PATH_INFO: `/v3/projects/3b933b8d5cd540f68ff64994ebfb283d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:34.722886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b933b8d5cd540f68ff64994ebfb283d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:34.725456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:34.796694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b933b8d5cd540f68ff64994ebfb283d', 'request_id': 'req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.806726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b933b8d5cd540f68ff64994ebfb283d', 'request_id': 'req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.816723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b933b8d5cd540f68ff64994ebfb283d', 'request_id': 'req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.834452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb admin admin] The token cache is being invalidate because project 3b933b8d5cd540f68ff64994ebfb283d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:34.834851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.835556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5d638d5e-e6a5-4dcb-b150-6fbf9bc9fecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:34.837493 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4061/8124] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:34 2022] DELETE /identity/v3/projects/3b933b8d5cd540f68ff64994ebfb283d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:34.843190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5de7fd-cd1e-4285-931a-a434dca908af None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:34.843699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5de7fd-cd1e-4285-931a-a434dca908af None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:34.843783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5de7fd-cd1e-4285-931a-a434dca908af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:34.865652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0f5de7fd-cd1e-4285-931a-a434dca908af None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:34.866824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0f5de7fd-cd1e-4285-931a-a434dca908af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:34.936144 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4064/8125] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:34.945124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1274e09-f015-40d1-8756-7ba4e1cfa76d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:34.945418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1274e09-f015-40d1-8756-7ba4e1cfa76d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:34.945698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1274e09-f015-40d1-8756-7ba4e1cfa76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:34.970471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b1274e09-f015-40d1-8756-7ba4e1cfa76d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:34.972311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b1274e09-f015-40d1-8756-7ba4e1cfa76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:34.988526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5de7fd-cd1e-4285-931a-a434dca908af None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:35.005181 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4062/8126] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:35.005770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5de7fd-cd1e-4285-931a-a434dca908af None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:35.013025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f58c56-beed-4a0d-b4ba-884c91e7a548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:35.013740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f58c56-beed-4a0d-b4ba-884c91e7a548 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:35.014032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f58c56-beed-4a0d-b4ba-884c91e7a548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:35.014310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f58c56-beed-4a0d-b4ba-884c91e7a548 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:35.015009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f58c56-beed-4a0d-b4ba-884c91e7a548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:35:35.015322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f58c56-beed-4a0d-b4ba-884c91e7a548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:35.017462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f58c56-beed-4a0d-b4ba-884c91e7a548 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:35.036201 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4065/8127] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:35.040898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1274e09-f015-40d1-8756-7ba4e1cfa76d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:35.053034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1274e09-f015-40d1-8756-7ba4e1cfa76d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:35.061625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21eafc-1fd0-4525-b265-4f096b677462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:35.062258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21eafc-1fd0-4525-b265-4f096b677462 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:35.062540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21eafc-1fd0-4525-b265-4f096b677462 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:35.062845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21eafc-1fd0-4525-b265-4f096b677462 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:35.063867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21eafc-1fd0-4525-b265-4f096b677462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:35.065830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21eafc-1fd0-4525-b265-4f096b677462 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:35.101463 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4063/8128] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:35 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:35.103010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f58c56-beed-4a0d-b4ba-884c91e7a548 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:35.116556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f58c56-beed-4a0d-b4ba-884c91e7a548 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:35.194257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96adff-1144-470d-8978-545b3da323f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:35.195038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96adff-1144-470d-8978-545b3da323f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:35.195585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96adff-1144-470d-8978-545b3da323f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:35.195936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96adff-1144-470d-8978-545b3da323f6 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:35.198159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96adff-1144-470d-8978-545b3da323f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:35.200591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96adff-1144-470d-8978-545b3da323f6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:35.220376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:35.226243 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4066/8129] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:35 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:35.230478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21eafc-1fd0-4525-b265-4f096b677462 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:35.242158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21eafc-1fd0-4525-b265-4f096b677462 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:35.248003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5035a-6fdb-4cc3-8766-01646225cbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:35.248645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5035a-6fdb-4cc3-8766-01646225cbcc admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:35.248930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5035a-6fdb-4cc3-8766-01646225cbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:35.249245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5035a-6fdb-4cc3-8766-01646225cbcc admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:35.250105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5035a-6fdb-4cc3-8766-01646225cbcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:35.252873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5035a-6fdb-4cc3-8766-01646225cbcc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:35.266788 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4064/8130] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:35:35.269977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96adff-1144-470d-8978-545b3da323f6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:35.284560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96adff-1144-470d-8978-545b3da323f6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:35.289953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476ca42-3056-4782-9652-99a48d247eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:35.290978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476ca42-3056-4782-9652-99a48d247eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:35.291356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476ca42-3056-4782-9652-99a48d247eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:35.291903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476ca42-3056-4782-9652-99a48d247eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:35.293098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476ca42-3056-4782-9652-99a48d247eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:35.294947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476ca42-3056-4782-9652-99a48d247eb8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:35.309023 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4067/8131] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:35:35.313256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5035a-6fdb-4cc3-8766-01646225cbcc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:35.328424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5035a-6fdb-4cc3-8766-01646225cbcc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:35.334229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea532a8-aad1-48a6-bdb1-143ea0830489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:35.334939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea532a8-aad1-48a6-bdb1-143ea0830489 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:35.335221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea532a8-aad1-48a6-bdb1-143ea0830489 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:35.335995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea532a8-aad1-48a6-bdb1-143ea0830489 admin admin] PATH_INFO: `/v3/projects/beb1f0598e0b4ba3bb5959ae018981e7/users/4fcbd7c33a874854b8e036de4116da0c/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:35.352127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea532a8-aad1-48a6-bdb1-143ea0830489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb1f0598e0b4ba3bb5959ae018981e7, user_id=4fcbd7c33a874854b8e036de4116da0c, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:35.355547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea532a8-aad1-48a6-bdb1-143ea0830489 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:35.376092 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4065/8132] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:35 2022] PUT /identity/v3/projects/beb1f0598e0b4ba3bb5959ae018981e7/users/4fcbd7c33a874854b8e036de4116da0c/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:35.387531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d72b5-13ad-4520-970d-410738047110 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:35.387865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d72b5-13ad-4520-970d-410738047110 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:35.388167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d72b5-13ad-4520-970d-410738047110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:35.422232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-bd2d72b5-13ad-4520-970d-410738047110 None None] MFA Rules not processed for user `4fcbd7c33a874854b8e036de4116da0c`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:35.423568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bd2d72b5-13ad-4520-970d-410738047110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:35.502710 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4068/8133] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:35.513691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea532a8-aad1-48a6-bdb1-143ea0830489 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:35.605936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea532a8-aad1-48a6-bdb1-143ea0830489 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:35.612486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e37c0-3809-4d3d-9020-31d8ab9d933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:35.613121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e37c0-3809-4d3d-9020-31d8ab9d933a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:35.614464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e37c0-3809-4d3d-9020-31d8ab9d933a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:35.614770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e37c0-3809-4d3d-9020-31d8ab9d933a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:35.615415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e37c0-3809-4d3d-9020-31d8ab9d933a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:35.617362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e37c0-3809-4d3d-9020-31d8ab9d933a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:35.623734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:35.652719 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4066/8134] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:35 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:35.656757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d72b5-13ad-4520-970d-410738047110 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:35.670491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d72b5-13ad-4520-970d-410738047110 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:35.750040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f0fef-7021-44f7-b087-ea3261935d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:35.751047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f0fef-7021-44f7-b087-ea3261935d2b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:35.751361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f0fef-7021-44f7-b087-ea3261935d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:35.751587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f0fef-7021-44f7-b087-ea3261935d2b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:35.752294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f0fef-7021-44f7-b087-ea3261935d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:35.755134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f0fef-7021-44f7-b087-ea3261935d2b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:35.786999 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4069/8135] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:35 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:35.790535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e37c0-3809-4d3d-9020-31d8ab9d933a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:35.805458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e37c0-3809-4d3d-9020-31d8ab9d933a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:35.811156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363379e-2f31-4a56-ba11-a0277db39226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:35.811788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363379e-2f31-4a56-ba11-a0277db39226 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:35.812076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363379e-2f31-4a56-ba11-a0277db39226 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:35.812355 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363379e-2f31-4a56-ba11-a0277db39226 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:35.813064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363379e-2f31-4a56-ba11-a0277db39226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:35.815902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363379e-2f31-4a56-ba11-a0277db39226 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:35.832361 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4067/8136] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:35.836516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f0fef-7021-44f7-b087-ea3261935d2b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:35.851998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f0fef-7021-44f7-b087-ea3261935d2b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:35.860860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb740f-c3d3-4cdc-9eac-b0a030d185f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:35.861698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb740f-c3d3-4cdc-9eac-b0a030d185f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:35.862411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb740f-c3d3-4cdc-9eac-b0a030d185f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:35.862710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb740f-c3d3-4cdc-9eac-b0a030d185f6 admin admin] PATH_INFO: `/v3/projects/47f8713fe3334c099d83f04e95b6dfab/users/45afda9aeaa64f99977540fb30ee2d81/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:35.890015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb740f-c3d3-4cdc-9eac-b0a030d185f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f8713fe3334c099d83f04e95b6dfab, user_id=45afda9aeaa64f99977540fb30ee2d81, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:35.893824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb740f-c3d3-4cdc-9eac-b0a030d185f6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:35.918242 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4070/8137] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:35 2022] PUT /identity/v3/projects/47f8713fe3334c099d83f04e95b6dfab/users/45afda9aeaa64f99977540fb30ee2d81/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:35.922513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363379e-2f31-4a56-ba11-a0277db39226 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:35.934528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363379e-2f31-4a56-ba11-a0277db39226 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.021586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1e7d5-8041-4f0c-a689-154416158e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.022140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1e7d5-8041-4f0c-a689-154416158e05 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.022430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1e7d5-8041-4f0c-a689-154416158e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.022712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1e7d5-8041-4f0c-a689-154416158e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.023672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1e7d5-8041-4f0c-a689-154416158e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.025307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1e7d5-8041-4f0c-a689-154416158e05 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.038230 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4068/8138] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:36.043265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb740f-c3d3-4cdc-9eac-b0a030d185f6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.055644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb740f-c3d3-4cdc-9eac-b0a030d185f6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.061770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1674df-2e17-427b-8bc7-3493790223eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.062441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1674df-2e17-427b-8bc7-3493790223eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.062727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1674df-2e17-427b-8bc7-3493790223eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.063043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1674df-2e17-427b-8bc7-3493790223eb admin admin] PATH_INFO: `/v3/projects/47f8713fe3334c099d83f04e95b6dfab/users/45afda9aeaa64f99977540fb30ee2d81/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.065140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1674df-2e17-427b-8bc7-3493790223eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f8713fe3334c099d83f04e95b6dfab, user_id=45afda9aeaa64f99977540fb30ee2d81, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.067846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1674df-2e17-427b-8bc7-3493790223eb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.080754 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4071/8139] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:36 2022] PUT /identity/v3/projects/47f8713fe3334c099d83f04e95b6dfab/users/45afda9aeaa64f99977540fb30ee2d81/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:36.092396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea302c5a-2974-45b1-a094-8e1bc36ddacf None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.092684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea302c5a-2974-45b1-a094-8e1bc36ddacf None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.092975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea302c5a-2974-45b1-a094-8e1bc36ddacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.130054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ea302c5a-2974-45b1-a094-8e1bc36ddacf None None] MFA Rules not processed for user `45afda9aeaa64f99977540fb30ee2d81`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:36.131333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ea302c5a-2974-45b1-a094-8e1bc36ddacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:36.220653 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4069/8140] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:36.225512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1674df-2e17-427b-8bc7-3493790223eb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.238048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1674df-2e17-427b-8bc7-3493790223eb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.243440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c33956-270a-4e2f-b9bf-079530af5b5a tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.244232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c33956-270a-4e2f-b9bf-079530af5b5a tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.245914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c33956-270a-4e2f-b9bf-079530af5b5a tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.245914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c33956-270a-4e2f-b9bf-079530af5b5a tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.246507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c33956-270a-4e2f-b9bf-079530af5b5a tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.247666 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-96c33956-270a-4e2f-b9bf-079530af5b5a tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:36.247666 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:35:36.247666 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:35:36.248815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c33956-270a-4e2f-b9bf-079530af5b5a tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.274296 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4072/8141] 10.222.0.70 () {60 vars in 1185 bytes} [Sun Aug 28 19:35:36 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:36.275713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea302c5a-2974-45b1-a094-8e1bc36ddacf None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.290764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea302c5a-2974-45b1-a094-8e1bc36ddacf None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.296050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d8ae5-aae4-4e8c-be2b-978bbc3da6e6 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.296736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d8ae5-aae4-4e8c-be2b-978bbc3da6e6 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.297024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d8ae5-aae4-4e8c-be2b-978bbc3da6e6 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.297321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d8ae5-aae4-4e8c-be2b-978bbc3da6e6 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/7c344c82cfe540eeb1e37abafd65980a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.298017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d8ae5-aae4-4e8c-be2b-978bbc3da6e6 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=7c344c82cfe540eeb1e37abafd65980a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.299082 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-f26d8ae5-aae4-4e8c-be2b-978bbc3da6e6 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:36.299082 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:35:36.299082 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:35:36.299987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d8ae5-aae4-4e8c-be2b-978bbc3da6e6 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.313942 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4070/8142] 10.222.0.70 () {58 vars in 1263 bytes} [Sun Aug 28 19:35:36 2022] GET /identity/v3/OS-OAUTH1/consumers/7c344c82cfe540eeb1e37abafd65980a => generated 220 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:36.314348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c33956-270a-4e2f-b9bf-079530af5b5a tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.330090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c33956-270a-4e2f-b9bf-079530af5b5a tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.340297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa08b8-b95a-4960-9e91-89ebe6425b48 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.340997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa08b8-b95a-4960-9e91-89ebe6425b48 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.341435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa08b8-b95a-4960-9e91-89ebe6425b48 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.341860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa08b8-b95a-4960-9e91-89ebe6425b48 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/7c344c82cfe540eeb1e37abafd65980a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.342459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa08b8-b95a-4960-9e91-89ebe6425b48 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=7c344c82cfe540eeb1e37abafd65980a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.343548 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-88fa08b8-b95a-4960-9e91-89ebe6425b48 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:36.343548 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:35:36.343548 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:35:36.345535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa08b8-b95a-4960-9e91-89ebe6425b48 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.345827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-88fa08b8-b95a-4960-9e91-89ebe6425b48 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invalidating token cache because consumer 7c344c82cfe540eeb1e37abafd65980a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:36.346120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-88fa08b8-b95a-4960-9e91-89ebe6425b48 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:36.347030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-88fa08b8-b95a-4960-9e91-89ebe6425b48 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:36.379443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-88fa08b8-b95a-4960-9e91-89ebe6425b48 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '7c344c82cfe540eeb1e37abafd65980a', 'request_id': 'req-88fa08b8-b95a-4960-9e91-89ebe6425b48'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:36.386541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:36.413870 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4073/8143] 10.222.0.70 () {58 vars in 1266 bytes} [Sun Aug 28 19:35:36 2022] DELETE /identity/v3/OS-OAUTH1/consumers/7c344c82cfe540eeb1e37abafd65980a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:36.418166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d8ae5-aae4-4e8c-be2b-978bbc3da6e6 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.420007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f26d8ae5-aae4-4e8c-be2b-978bbc3da6e6 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:36.440669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d8ae5-aae4-4e8c-be2b-978bbc3da6e6 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.462356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89676ce2-e99e-4de1-90f3-0d3b14f24dc0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.463261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676ce2-e99e-4de1-90f3-0d3b14f24dc0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.463623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676ce2-e99e-4de1-90f3-0d3b14f24dc0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.463942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89676ce2-e99e-4de1-90f3-0d3b14f24dc0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.464623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89676ce2-e99e-4de1-90f3-0d3b14f24dc0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.465686 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-89676ce2-e99e-4de1-90f3-0d3b14f24dc0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:36.465686 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:35:36.465686 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:35:36.466590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89676ce2-e99e-4de1-90f3-0d3b14f24dc0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.499067 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4071/8144] 10.222.0.70 () {60 vars in 1185 bytes} [Sun Aug 28 19:35:36 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:36.499672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa08b8-b95a-4960-9e91-89ebe6425b48 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.512457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa08b8-b95a-4960-9e91-89ebe6425b48 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.517505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353668c-3287-433e-9f46-856db3085fd2 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.518295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353668c-3287-433e-9f46-856db3085fd2 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.518844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353668c-3287-433e-9f46-856db3085fd2 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.519222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353668c-3287-433e-9f46-856db3085fd2 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/619d137be3b441598838d5ff5ab62828` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.519931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353668c-3287-433e-9f46-856db3085fd2 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=619d137be3b441598838d5ff5ab62828)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.521058 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-1353668c-3287-433e-9f46-856db3085fd2 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:36.521058 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:35:36.521058 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:35:36.522329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353668c-3287-433e-9f46-856db3085fd2 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.531275 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4074/8145] 10.222.0.70 () {58 vars in 1263 bytes} [Sun Aug 28 19:35:36 2022] GET /identity/v3/OS-OAUTH1/consumers/619d137be3b441598838d5ff5ab62828 => generated 221 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:35:36.533663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89676ce2-e99e-4de1-90f3-0d3b14f24dc0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.548025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89676ce2-e99e-4de1-90f3-0d3b14f24dc0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.558132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f88280-8ba9-4fe6-baf4-12b918c6c250 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.558843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f88280-8ba9-4fe6-baf4-12b918c6c250 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.559152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f88280-8ba9-4fe6-baf4-12b918c6c250 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.559408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f88280-8ba9-4fe6-baf4-12b918c6c250 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/619d137be3b441598838d5ff5ab62828` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.560303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f88280-8ba9-4fe6-baf4-12b918c6c250 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=619d137be3b441598838d5ff5ab62828)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.561016 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-29f88280-8ba9-4fe6-baf4-12b918c6c250 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:36.561016 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:35:36.561016 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:35:36.561913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f88280-8ba9-4fe6-baf4-12b918c6c250 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.564481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-29f88280-8ba9-4fe6-baf4-12b918c6c250 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invalidating token cache because consumer 619d137be3b441598838d5ff5ab62828 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:36.564772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-29f88280-8ba9-4fe6-baf4-12b918c6c250 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:36.565529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-29f88280-8ba9-4fe6-baf4-12b918c6c250 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:36.595913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-29f88280-8ba9-4fe6-baf4-12b918c6c250 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '619d137be3b441598838d5ff5ab62828', 'request_id': 'req-29f88280-8ba9-4fe6-baf4-12b918c6c250'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:36.623319 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4072/8146] 10.222.0.70 () {58 vars in 1266 bytes} [Sun Aug 28 19:35:36 2022] DELETE /identity/v3/OS-OAUTH1/consumers/619d137be3b441598838d5ff5ab62828 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:36.623787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353668c-3287-433e-9f46-856db3085fd2 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.625530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1353668c-3287-433e-9f46-856db3085fd2 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:36.641370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353668c-3287-433e-9f46-856db3085fd2 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.653071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26061a8a-e570-46a6-8395-37e94efd5be3 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.653733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061a8a-e570-46a6-8395-37e94efd5be3 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.654021 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061a8a-e570-46a6-8395-37e94efd5be3 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.654301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061a8a-e570-46a6-8395-37e94efd5be3 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/619d137be3b441598838d5ff5ab62828` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.654939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26061a8a-e570-46a6-8395-37e94efd5be3 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=619d137be3b441598838d5ff5ab62828)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.657685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26061a8a-e570-46a6-8395-37e94efd5be3 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-26061a8a-e570-46a6-8395-37e94efd5be3 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Aug 28 19:35:36.696491 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Aug 28 19:35:36.697544 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Aug 28 19:35:36.697544 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Aug 28 19:35:36.697544 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Aug 28 19:35:36.697544 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Aug 28 19:35:36.697544 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 28 19:35:36.697544 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 28 19:35:36.697544 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 28 19:35:36.697544 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 28 19:35:36.697544 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:36.699075 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4075/8147] 10.222.0.70 () {58 vars in 1263 bytes} [Sun Aug 28 19:35:36 2022] GET /identity/v3/OS-OAUTH1/consumers/619d137be3b441598838d5ff5ab62828 => generated 74 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:35:36.703251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f88280-8ba9-4fe6-baf4-12b918c6c250 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.715505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d9cc1-583e-4e86-bc51-59fb88ece3c1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.715749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f88280-8ba9-4fe6-baf4-12b918c6c250 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.715936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d9cc1-583e-4e86-bc51-59fb88ece3c1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.716300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d9cc1-583e-4e86-bc51-59fb88ece3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.720978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a27401-ea99-43c6-b364-c3b41a23fee9 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.721737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a27401-ea99-43c6-b364-c3b41a23fee9 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.722113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a27401-ea99-43c6-b364-c3b41a23fee9 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.722461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a27401-ea99-43c6-b364-c3b41a23fee9 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/619d137be3b441598838d5ff5ab62828` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.723156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a27401-ea99-43c6-b364-c3b41a23fee9 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=619d137be3b441598838d5ff5ab62828)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.725341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a27401-ea99-43c6-b364-c3b41a23fee9 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.725686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a3a27401-ea99-43c6-b364-c3b41a23fee9 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invalidating token cache because consumer 619d137be3b441598838d5ff5ab62828 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:36.726046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a3a27401-ea99-43c6-b364-c3b41a23fee9 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:36.726893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a3a27401-ea99-43c6-b364-c3b41a23fee9 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:36.731940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-a3a27401-ea99-43c6-b364-c3b41a23fee9 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Aug 28 19:35:36.746189 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:35:36.747471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:35:36.747471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Aug 28 19:35:36.747471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Aug 28 19:35:36.747471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Aug 28 19:35:36.747471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Aug 28 19:35:36.747471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Aug 28 19:35:36.747471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 28 19:35:36.747471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 28 19:35:36.747471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 28 19:35:36.747471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 28 19:35:36.747471 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:36.751210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1f8d9cc1-583e-4e86-bc51-59fb88ece3c1 None None] MFA Rules not processed for user `318132d8307348b4b3d83c383e155641`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:36.751782 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4073/8148] 10.222.0.70 () {58 vars in 1266 bytes} [Sun Aug 28 19:35:36 2022] DELETE /identity/v3/OS-OAUTH1/consumers/619d137be3b441598838d5ff5ab62828 => generated 74 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:35:36.752984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a27401-ea99-43c6-b364-c3b41a23fee9 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.753213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1f8d9cc1-583e-4e86-bc51-59fb88ece3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:36.755424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a3a27401-ea99-43c6-b364-c3b41a23fee9 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:36.774133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a27401-ea99-43c6-b364-c3b41a23fee9 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.779990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680db722-5d71-4660-93f0-5a4bf2a1deaa tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.780688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db722-5d71-4660-93f0-5a4bf2a1deaa tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.781050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db722-5d71-4660-93f0-5a4bf2a1deaa tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.781432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db722-5d71-4660-93f0-5a4bf2a1deaa tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.782205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680db722-5d71-4660-93f0-5a4bf2a1deaa tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.784509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680db722-5d71-4660-93f0-5a4bf2a1deaa tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.831174 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4074/8149] 10.222.0.70 () {60 vars in 1185 bytes} [Sun Aug 28 19:35:36 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:36.836096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680db722-5d71-4660-93f0-5a4bf2a1deaa tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.862400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680db722-5d71-4660-93f0-5a4bf2a1deaa tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.875164 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4076/8150] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:36.879006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b808b5d-b9b0-46c8-bd70-4e579da728dd tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.879860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b808b5d-b9b0-46c8-bd70-4e579da728dd tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.879997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d9cc1-583e-4e86-bc51-59fb88ece3c1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.880170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b808b5d-b9b0-46c8-bd70-4e579da728dd tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.880421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b808b5d-b9b0-46c8-bd70-4e579da728dd tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.881066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b808b5d-b9b0-46c8-bd70-4e579da728dd tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.882674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b808b5d-b9b0-46c8-bd70-4e579da728dd tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.887657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1f8d9cc1-583e-4e86-bc51-59fb88ece3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:36.904305 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4075/8151] 10.222.0.70 () {60 vars in 1185 bytes} [Sun Aug 28 19:35:36 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:36.908324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b808b5d-b9b0-46c8-bd70-4e579da728dd tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.918988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b808b5d-b9b0-46c8-bd70-4e579da728dd tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.923763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802b718-6859-4b98-b4d6-f2310e6b066b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.924452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802b718-6859-4b98-b4d6-f2310e6b066b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.924804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802b718-6859-4b98-b4d6-f2310e6b066b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.925144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802b718-6859-4b98-b4d6-f2310e6b066b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.925823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802b718-6859-4b98-b4d6-f2310e6b066b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.926818 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-2802b718-6859-4b98-b4d6-f2310e6b066b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:36.926818 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:35:36.926818 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:35:36.927704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802b718-6859-4b98-b4d6-f2310e6b066b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.936736 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4076/8152] 10.222.0.70 () {58 vars in 1164 bytes} [Sun Aug 28 19:35:36 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:36.941389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802b718-6859-4b98-b4d6-f2310e6b066b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:36.955326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802b718-6859-4b98-b4d6-f2310e6b066b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.960299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.961550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.961849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.962377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9d8123e106c7455da83131b0d21d2cd4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.963085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=9d8123e106c7455da83131b0d21d2cd4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.965965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:36.966255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invalidating token cache because consumer 9d8123e106c7455da83131b0d21d2cd4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:36.966551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:36.967346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:36.983747 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d9cc1-583e-4e86-bc51-59fb88ece3c1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:36.985596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '9d8123e106c7455da83131b0d21d2cd4', 'request_id': 'req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:36.989273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ddd7f-39d6-470b-a305-077e6d515bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:36.990262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ddd7f-39d6-470b-a305-077e6d515bfe admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:36.990262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ddd7f-39d6-470b-a305-077e6d515bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:36.990446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ddd7f-39d6-470b-a305-077e6d515bfe admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:36.991108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ddd7f-39d6-470b-a305-077e6d515bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:36.993216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ddd7f-39d6-470b-a305-077e6d515bfe admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:37.018070 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4077/8153] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:36 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:37.022236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ddd7f-39d6-470b-a305-077e6d515bfe admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:37.024166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8b5ddd7f-39d6-470b-a305-077e6d515bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:37.025128 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4077/8154] 10.222.0.70 () {58 vars in 1266 bytes} [Sun Aug 28 19:35:36 2022] DELETE /identity/v3/OS-OAUTH1/consumers/9d8123e106c7455da83131b0d21d2cd4 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:37.030158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:37.031619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:37.044655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ddd7f-39d6-470b-a305-077e6d515bfe admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:37.049370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370dd19-74b8-4b81-a5d4-4fab233133bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:37.049995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370dd19-74b8-4b81-a5d4-4fab233133bc admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.050385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370dd19-74b8-4b81-a5d4-4fab233133bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.050662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370dd19-74b8-4b81-a5d4-4fab233133bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.051362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370dd19-74b8-4b81-a5d4-4fab233133bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:37.052978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370dd19-74b8-4b81-a5d4-4fab233133bc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:37.065845 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4078/8155] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:35:37.071361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fdfa7-b0d7-44fc-9a76-6c22739e2e01 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:37.071542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370dd19-74b8-4b81-a5d4-4fab233133bc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:37.078111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43790444-8581-4016-b287-79c0d77cc990 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:37.079125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43790444-8581-4016-b287-79c0d77cc990 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.079621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43790444-8581-4016-b287-79c0d77cc990 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.080130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43790444-8581-4016-b287-79c0d77cc990 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/edabc587265b4221ae4a92501299dfbb` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.081121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43790444-8581-4016-b287-79c0d77cc990 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=edabc587265b4221ae4a92501299dfbb)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:37.084964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43790444-8581-4016-b287-79c0d77cc990 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:37.085570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43790444-8581-4016-b287-79c0d77cc990 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invalidating token cache because consumer edabc587265b4221ae4a92501299dfbb has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:37.085702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370dd19-74b8-4b81-a5d4-4fab233133bc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:37.086189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43790444-8581-4016-b287-79c0d77cc990 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:37.087144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43790444-8581-4016-b287-79c0d77cc990 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:37.092530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783fab6-30fa-47a4-ad0c-3f2389c6a2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:37.093316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783fab6-30fa-47a4-ad0c-3f2389c6a2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.093669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783fab6-30fa-47a4-ad0c-3f2389c6a2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.094175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783fab6-30fa-47a4-ad0c-3f2389c6a2ae admin admin] PATH_INFO: `/v3/system/users/94d8e6010a2449b79708ddf0a68e2efd/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.105745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-43790444-8581-4016-b287-79c0d77cc990 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'edabc587265b4221ae4a92501299dfbb', 'request_id': 'req-43790444-8581-4016-b287-79c0d77cc990'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:37.121331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783fab6-30fa-47a4-ad0c-3f2389c6a2ae admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=94d8e6010a2449b79708ddf0a68e2efd, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:37.123196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783fab6-30fa-47a4-ad0c-3f2389c6a2ae admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:37.125420 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4078/8156] 10.222.0.70 () {58 vars in 1266 bytes} [Sun Aug 28 19:35:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/edabc587265b4221ae4a92501299dfbb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:37.131555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43790444-8581-4016-b287-79c0d77cc990 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:37.133293 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4079/8157] 10.222.0.70 () {60 vars in 1378 bytes} [Sun Aug 28 19:35:37 2022] PUT /identity/v3/system/users/94d8e6010a2449b79708ddf0a68e2efd/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:37.134051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-43790444-8581-4016-b287-79c0d77cc990 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:37.143666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434506a4-d625-4b4b-b1b6-c61d0f6b35c4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.144101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434506a4-d625-4b4b-b1b6-c61d0f6b35c4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.144379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434506a4-d625-4b4b-b1b6-c61d0f6b35c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.155305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43790444-8581-4016-b287-79c0d77cc990 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:37.161123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0be642-59df-4056-ad97-a945cb17607b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:37.161895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0be642-59df-4056-ad97-a945cb17607b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.162182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0be642-59df-4056-ad97-a945cb17607b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.162455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0be642-59df-4056-ad97-a945cb17607b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.163153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0be642-59df-4056-ad97-a945cb17607b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:37.165325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0be642-59df-4056-ad97-a945cb17607b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:37.184822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-434506a4-d625-4b4b-b1b6-c61d0f6b35c4 None None] MFA Rules not processed for user `94d8e6010a2449b79708ddf0a68e2efd`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:37.186178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-434506a4-d625-4b4b-b1b6-c61d0f6b35c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:37.187980 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4079/8158] 10.222.0.70 () {60 vars in 1185 bytes} [Sun Aug 28 19:35:37 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 265 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:37.193782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0be642-59df-4056-ad97-a945cb17607b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:37.201292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:37.217046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0be642-59df-4056-ad97-a945cb17607b tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:37.223466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d48e3-8fb3-4064-bfc3-1acd5bf3bc49 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:37.224497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d48e3-8fb3-4064-bfc3-1acd5bf3bc49 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.224882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d48e3-8fb3-4064-bfc3-1acd5bf3bc49 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.225260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d48e3-8fb3-4064-bfc3-1acd5bf3bc49 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/588a65e270004554ba0b1c6cde69ef9a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.226217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d48e3-8fb3-4064-bfc3-1acd5bf3bc49 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=588a65e270004554ba0b1c6cde69ef9a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:37.227417 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-e02d48e3-8fb3-4064-bfc3-1acd5bf3bc49 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:37.227417 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:35:37.227417 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:35:37.228509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d48e3-8fb3-4064-bfc3-1acd5bf3bc49 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:37.259149 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4080/8159] 10.222.0.70 () {60 vars in 1285 bytes} [Sun Aug 28 19:35:37 2022] PATCH /identity/v3/OS-OAUTH1/consumers/588a65e270004554ba0b1c6cde69ef9a => generated 221 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:37.264189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d48e3-8fb3-4064-bfc3-1acd5bf3bc49 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:37.275535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d48e3-8fb3-4064-bfc3-1acd5bf3bc49 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:37.281097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098e076-484e-415c-93c2-d676e762126d tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:37.281833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098e076-484e-415c-93c2-d676e762126d tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.282027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098e076-484e-415c-93c2-d676e762126d tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.282308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098e076-484e-415c-93c2-d676e762126d tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/588a65e270004554ba0b1c6cde69ef9a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.282934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098e076-484e-415c-93c2-d676e762126d tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=588a65e270004554ba0b1c6cde69ef9a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:37.284560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098e076-484e-415c-93c2-d676e762126d tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:37.289888 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4081/8160] 10.222.0.70 () {58 vars in 1263 bytes} [Sun Aug 28 19:35:37 2022] GET /identity/v3/OS-OAUTH1/consumers/588a65e270004554ba0b1c6cde69ef9a => generated 221 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:35:37.295887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098e076-484e-415c-93c2-d676e762126d tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:37.298882 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4080/8161] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:37 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 19:35:37.300548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434506a4-d625-4b4b-b1b6-c61d0f6b35c4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:37.313510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098e076-484e-415c-93c2-d676e762126d tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:37.319297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45afda9aeaa64f99977540fb30ee2d81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47f8713fe3334c099d83f04e95b6dfab', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:37.319905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.320210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.320541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/588a65e270004554ba0b1c6cde69ef9a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.321072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=588a65e270004554ba0b1c6cde69ef9a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:37.323659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:37.324224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invalidating token cache because consumer 588a65e270004554ba0b1c6cde69ef9a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:37.324375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:37.325085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:37.338647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '588a65e270004554ba0b1c6cde69ef9a', 'request_id': 'req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:37.356930 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4082/8162] 10.222.0.70 () {58 vars in 1266 bytes} [Sun Aug 28 19:35:37 2022] DELETE /identity/v3/OS-OAUTH1/consumers/588a65e270004554ba0b1c6cde69ef9a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:37.362098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:37.363802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:37.384046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65dac0-c80d-4a9f-a581-ba4930ad70e0 tempest-OAUTHConsumersV3Test-2122364832 tempest-OAUTHConsumersV3Test-2122364832-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:37.389635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653a02b-04bc-4f1c-8e50-f73ef62df472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:37.390282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653a02b-04bc-4f1c-8e50-f73ef62df472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.391264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653a02b-04bc-4f1c-8e50-f73ef62df472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.391264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653a02b-04bc-4f1c-8e50-f73ef62df472 admin admin] PATH_INFO: `/v3/users/4fcbd7c33a874854b8e036de4116da0c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.392212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653a02b-04bc-4f1c-8e50-f73ef62df472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fcbd7c33a874854b8e036de4116da0c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:37.394546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653a02b-04bc-4f1c-8e50-f73ef62df472 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:37.434511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434506a4-d625-4b4b-b1b6-c61d0f6b35c4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:37.471693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0653a02b-04bc-4f1c-8e50-f73ef62df472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fcbd7c33a874854b8e036de4116da0c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:37.480494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0653a02b-04bc-4f1c-8e50-f73ef62df472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fcbd7c33a874854b8e036de4116da0c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:37.481313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0653a02b-04bc-4f1c-8e50-f73ef62df472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fcbd7c33a874854b8e036de4116da0c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:37.483357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=80,keystone:INSERT=6,keystone:DELETE=13,keystone:UPDATE=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:37.497308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0653a02b-04bc-4f1c-8e50-f73ef62df472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fcbd7c33a874854b8e036de4116da0c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:37.498304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0653a02b-04bc-4f1c-8e50-f73ef62df472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fcbd7c33a874854b8e036de4116da0c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:37.505166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954e4cf-2ab1-461f-9919-b6d56ee149cf None tempest-ImageQuotaTest-2141054042-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d8e6010a2449b79708ddf0a68e2efd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:37.505788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e4cf-2ab1-461f-9919-b6d56ee149cf None tempest-ImageQuotaTest-2141054042-system-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.506072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e4cf-2ab1-461f-9919-b6d56ee149cf None tempest-ImageQuotaTest-2141054042-system-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.506447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e4cf-2ab1-461f-9919-b6d56ee149cf None tempest-ImageQuotaTest-2141054042-system-admin] PATH_INFO: `/v3/services` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.507081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954e4cf-2ab1-461f-9919-b6d56ee149cf None tempest-ImageQuotaTest-2141054042-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:37.508965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954e4cf-2ab1-461f-9919-b6d56ee149cf None tempest-ImageQuotaTest-2141054042-system-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:37.521209 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4081/8163] 10.222.0.70 () {58 vars in 1110 bytes} [Sun Aug 28 19:35:37 2022] GET /identity/v3/services => generated 2191 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:37.521391 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4083/8164] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:37 2022] DELETE /identity/v3/users/4fcbd7c33a874854b8e036de4116da0c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:37.522571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954e4cf-2ab1-461f-9919-b6d56ee149cf None tempest-ImageQuotaTest-2141054042-system-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:37.523322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0dd0-1546-405f-b4c9-fa1d6998560d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.523625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0dd0-1546-405f-b4c9-fa1d6998560d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.523905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0dd0-1546-405f-b4c9-fa1d6998560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.524494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1954e4cf-2ab1-461f-9919-b6d56ee149cf None tempest-ImageQuotaTest-2141054042-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:37.529790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:37.549387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-40bb0dd0-1546-405f-b4c9-fa1d6998560d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:37.550631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-40bb0dd0-1546-405f-b4c9-fa1d6998560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:37.642534 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4084/8165] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:37.654161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb0dd0-1546-405f-b4c9-fa1d6998560d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:37.655789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-40bb0dd0-1546-405f-b4c9-fa1d6998560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:37.704945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954e4cf-2ab1-461f-9919-b6d56ee149cf None tempest-ImageQuotaTest-2141054042-system-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:37.725689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb0dd0-1546-405f-b4c9-fa1d6998560d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:37.729924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce716ab-e8fe-4690-973f-8b188a9f9b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:37.730562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce716ab-e8fe-4690-973f-8b188a9f9b14 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.730971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce716ab-e8fe-4690-973f-8b188a9f9b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.731181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce716ab-e8fe-4690-973f-8b188a9f9b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.745138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce716ab-e8fe-4690-973f-8b188a9f9b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:37.747087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce716ab-e8fe-4690-973f-8b188a9f9b14 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:37.751918 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ed189-48bb-4407-b283-99a6fda17a39 None tempest-ImageQuotaTest-2141054042-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d8e6010a2449b79708ddf0a68e2efd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:37.752674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ed189-48bb-4407-b283-99a6fda17a39 None tempest-ImageQuotaTest-2141054042-system-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.752965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ed189-48bb-4407-b283-99a6fda17a39 None tempest-ImageQuotaTest-2141054042-system-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.753440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ed189-48bb-4407-b283-99a6fda17a39 None tempest-ImageQuotaTest-2141054042-system-admin] PATH_INFO: `/v3/limits` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.754044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ed189-48bb-4407-b283-99a6fda17a39 None tempest-ImageQuotaTest-2141054042-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:37.755386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ed189-48bb-4407-b283-99a6fda17a39 None tempest-ImageQuotaTest-2141054042-system-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:37.768662 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4085/8166] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-7e9ed189-48bb-4407-b283-99a6fda17a39 None tempest-ImageQuotaTest-2141054042-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Aug 28 19:35:37.808425 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Aug 28 19:35:37.809632 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:35:37.809632 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:35:37.809632 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Aug 28 19:35:37.809632 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Aug 28 19:35:37.809632 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 19:35:37.809632 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 19:35:37.809632 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Aug 28 19:35:37.809632 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Aug 28 19:35:37.809632 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Aug 28 19:35:37.809632 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.NoLimitReference Aug 28 19:35:37.809632 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 28 19:35:37.809632 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:37.810538 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4082/8167] 10.222.0.70 () {60 vars in 1126 bytes} [Sun Aug 28 19:35:37 2022] POST /identity/v3/limits => generated 124 bytes in 288 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Aug 28 19:35:37.816614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce716ab-e8fe-4690-973f-8b188a9f9b14 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:37.903885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:37.947211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce716ab-e8fe-4690-973f-8b188a9f9b14 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:37.992178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf9bce-86d7-4a53-b595-905acf2ed2b7 None tempest-ImageQuotaTest-2141054042-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d8e6010a2449b79708ddf0a68e2efd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:37.993252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9bce-86d7-4a53-b595-905acf2ed2b7 None tempest-ImageQuotaTest-2141054042-system-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:37.993596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9bce-86d7-4a53-b595-905acf2ed2b7 None tempest-ImageQuotaTest-2141054042-system-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:37.993939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9bce-86d7-4a53-b595-905acf2ed2b7 None tempest-ImageQuotaTest-2141054042-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:37.995237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf9bce-86d7-4a53-b595-905acf2ed2b7 None tempest-ImageQuotaTest-2141054042-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:37.996624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf9bce-86d7-4a53-b595-905acf2ed2b7 None tempest-ImageQuotaTest-2141054042-system-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:38.006910 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4086/8168] 10.222.0.70 () {58 vars in 1137 bytes} [Sun Aug 28 19:35:37 2022] GET /identity/v3/registered_limits => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:38.015567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ed189-48bb-4407-b283-99a6fda17a39 None tempest-ImageQuotaTest-2141054042-system-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:38.055289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:38.069721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf9bce-86d7-4a53-b595-905acf2ed2b7 None tempest-ImageQuotaTest-2141054042-system-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:38.071366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a9cf9bce-86d7-4a53-b595-905acf2ed2b7 None tempest-ImageQuotaTest-2141054042-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:38.095532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf9bce-86d7-4a53-b595-905acf2ed2b7 None tempest-ImageQuotaTest-2141054042-system-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:38.101087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:38.101970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:38.110472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:38.110817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] PATH_INFO: `/v3/projects/beb1f0598e0b4ba3bb5959ae018981e7` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:38.112336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb1f0598e0b4ba3bb5959ae018981e7)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:38.114284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:38.158279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ed189-48bb-4407-b283-99a6fda17a39 None tempest-ImageQuotaTest-2141054042-system-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:38.168382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb1f0598e0b4ba3bb5959ae018981e7', 'request_id': 'req-23081a81-f360-498f-893e-732b2328e600'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.177672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb1f0598e0b4ba3bb5959ae018981e7', 'request_id': 'req-23081a81-f360-498f-893e-732b2328e600'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.185352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb1f0598e0b4ba3bb5959ae018981e7', 'request_id': 'req-23081a81-f360-498f-893e-732b2328e600'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.198689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] The token cache is being invalidate because project beb1f0598e0b4ba3bb5959ae018981e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:38.199026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.199702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.199840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f9fe0-1652-4970-91bb-39a2c6e1cb86 None tempest-ImageQuotaTest-2141054042-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94d8e6010a2449b79708ddf0a68e2efd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:38.200444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f9fe0-1652-4970-91bb-39a2c6e1cb86 None tempest-ImageQuotaTest-2141054042-system-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:38.200733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f9fe0-1652-4970-91bb-39a2c6e1cb86 None tempest-ImageQuotaTest-2141054042-system-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:38.201012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f9fe0-1652-4970-91bb-39a2c6e1cb86 None tempest-ImageQuotaTest-2141054042-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:38.201608 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4087/8169] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:38 2022] DELETE /identity/v3/projects/beb1f0598e0b4ba3bb5959ae018981e7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:38.201729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f9fe0-1652-4970-91bb-39a2c6e1cb86 None tempest-ImageQuotaTest-2141054042-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:38.202709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f9fe0-1652-4970-91bb-39a2c6e1cb86 None tempest-ImageQuotaTest-2141054042-system-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:38.205697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:38.207863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:38.214830 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4083/8170] 10.222.0.70 () {58 vars in 1137 bytes} [Sun Aug 28 19:35:38 2022] GET /identity/v3/registered_limits => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:38.283728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23081a81-f360-498f-893e-732b2328e600 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:38.288975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939f46e-f50e-40a6-80d2-8bb51a5a73cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:38.289817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f46e-f50e-40a6-80d2-8bb51a5a73cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:38.290103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f46e-f50e-40a6-80d2-8bb51a5a73cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:38.290390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f46e-f50e-40a6-80d2-8bb51a5a73cd admin admin] PATH_INFO: `/v3/users/45afda9aeaa64f99977540fb30ee2d81` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:38.291626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939f46e-f50e-40a6-80d2-8bb51a5a73cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=45afda9aeaa64f99977540fb30ee2d81)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:38.293579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939f46e-f50e-40a6-80d2-8bb51a5a73cd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:38.320051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:38.361049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e939f46e-f50e-40a6-80d2-8bb51a5a73cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45afda9aeaa64f99977540fb30ee2d81'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.368586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e939f46e-f50e-40a6-80d2-8bb51a5a73cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45afda9aeaa64f99977540fb30ee2d81'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.369364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e939f46e-f50e-40a6-80d2-8bb51a5a73cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45afda9aeaa64f99977540fb30ee2d81'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.382349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e939f46e-f50e-40a6-80d2-8bb51a5a73cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45afda9aeaa64f99977540fb30ee2d81'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.383703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e939f46e-f50e-40a6-80d2-8bb51a5a73cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45afda9aeaa64f99977540fb30ee2d81'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.399598 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4088/8171] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:38 2022] DELETE /identity/v3/users/45afda9aeaa64f99977540fb30ee2d81 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:38.717237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f9fe0-1652-4970-91bb-39a2c6e1cb86 None tempest-ImageQuotaTest-2141054042-system-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:38.719543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6a0f9fe0-1652-4970-91bb-39a2c6e1cb86 None tempest-ImageQuotaTest-2141054042-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:38.811744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f9fe0-1652-4970-91bb-39a2c6e1cb86 None tempest-ImageQuotaTest-2141054042-system-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:38.816759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:38.817490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:38.817887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:38.818238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a admin admin] PATH_INFO: `/v3/projects/47f8713fe3334c099d83f04e95b6dfab` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:38.819578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f8713fe3334c099d83f04e95b6dfab)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:38.821583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:38.874483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:38.880014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f8713fe3334c099d83f04e95b6dfab', 'request_id': 'req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.888520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f8713fe3334c099d83f04e95b6dfab', 'request_id': 'req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.895528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f8713fe3334c099d83f04e95b6dfab', 'request_id': 'req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.912544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a admin admin] The token cache is being invalidate because project 47f8713fe3334c099d83f04e95b6dfab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:38.912971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.913722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1eb79efc-6540-480e-82e3-1ecf4cb9ae6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:38.915624 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4084/8172] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:38 2022] DELETE /identity/v3/projects/47f8713fe3334c099d83f04e95b6dfab => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:38.920856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6c058-98a5-4d49-ab64-87bc3c2e8921 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:38.921380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6c058-98a5-4d49-ab64-87bc3c2e8921 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:38.921493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6c058-98a5-4d49-ab64-87bc3c2e8921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:38.941765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f2c6c058-98a5-4d49-ab64-87bc3c2e8921 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:38.943128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f2c6c058-98a5-4d49-ab64-87bc3c2e8921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:39.028028 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4089/8173] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:39.036327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e200d-afcc-4c6e-a8fd-8ee2336fb042 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:39.036840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e200d-afcc-4c6e-a8fd-8ee2336fb042 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:39.037018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e200d-afcc-4c6e-a8fd-8ee2336fb042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:39.059157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d95e200d-afcc-4c6e-a8fd-8ee2336fb042 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:39.060620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d95e200d-afcc-4c6e-a8fd-8ee2336fb042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:39.070713 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4085/8174] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:39.075700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6c058-98a5-4d49-ab64-87bc3c2e8921 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:39.089841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6c058-98a5-4d49-ab64-87bc3c2e8921 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:39.095368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a7bde-5f48-463b-9241-1d982093b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:39.096685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7bde-5f48-463b-9241-1d982093b62b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:39.097130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7bde-5f48-463b-9241-1d982093b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:39.097687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7bde-5f48-463b-9241-1d982093b62b admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:39.098514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a7bde-5f48-463b-9241-1d982093b62b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:35:39.100146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a7bde-5f48-463b-9241-1d982093b62b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:39.106015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a7bde-5f48-463b-9241-1d982093b62b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:39.127455 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4090/8175] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:39.127812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e200d-afcc-4c6e-a8fd-8ee2336fb042 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:39.140275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e200d-afcc-4c6e-a8fd-8ee2336fb042 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:39.150301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3de40c-2c2f-4614-a54b-d5ab2d6ee121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:39.151850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3de40c-2c2f-4614-a54b-d5ab2d6ee121 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:39.151850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3de40c-2c2f-4614-a54b-d5ab2d6ee121 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:39.152099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3de40c-2c2f-4614-a54b-d5ab2d6ee121 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:39.152815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3de40c-2c2f-4614-a54b-d5ab2d6ee121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:39.155382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3de40c-2c2f-4614-a54b-d5ab2d6ee121 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:39.191542 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4086/8176] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:39 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:39.195621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a7bde-5f48-463b-9241-1d982093b62b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:39.207799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a7bde-5f48-463b-9241-1d982093b62b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:39.309420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5810e1-59d4-4199-9a45-7821326e5ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:39.309969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5810e1-59d4-4199-9a45-7821326e5ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:39.310259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5810e1-59d4-4199-9a45-7821326e5ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:39.310534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5810e1-59d4-4199-9a45-7821326e5ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:39.311231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5810e1-59d4-4199-9a45-7821326e5ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:39.313174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5810e1-59d4-4199-9a45-7821326e5ce0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:39.349684 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4091/8177] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:39 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:39.353441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3de40c-2c2f-4614-a54b-d5ab2d6ee121 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:39.364250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3de40c-2c2f-4614-a54b-d5ab2d6ee121 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:39.369911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6889670-551e-4b38-9341-0ef3a43a5e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:39.370507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6889670-551e-4b38-9341-0ef3a43a5e94 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:39.370886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6889670-551e-4b38-9341-0ef3a43a5e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:39.371528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6889670-551e-4b38-9341-0ef3a43a5e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:39.372274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6889670-551e-4b38-9341-0ef3a43a5e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:39.373920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6889670-551e-4b38-9341-0ef3a43a5e94 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:39.389106 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4087/8178] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:39.393209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5810e1-59d4-4199-9a45-7821326e5ce0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:39.404190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5810e1-59d4-4199-9a45-7821326e5ce0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:39.409046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb8d59-e497-43d0-a360-bd716dbf1c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:39.409679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb8d59-e497-43d0-a360-bd716dbf1c7f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:39.409968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb8d59-e497-43d0-a360-bd716dbf1c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:39.410643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb8d59-e497-43d0-a360-bd716dbf1c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:39.410931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb8d59-e497-43d0-a360-bd716dbf1c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:39.412557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb8d59-e497-43d0-a360-bd716dbf1c7f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:39.415403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:39.429197 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4092/8179] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:39.431554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6889670-551e-4b38-9341-0ef3a43a5e94 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:39.446974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6889670-551e-4b38-9341-0ef3a43a5e94 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:39.453156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644adefb-7caa-4bf3-b3b0-d1c96e6f46cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:39.454083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644adefb-7caa-4bf3-b3b0-d1c96e6f46cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:39.456779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644adefb-7caa-4bf3-b3b0-d1c96e6f46cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:39.457078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644adefb-7caa-4bf3-b3b0-d1c96e6f46cd admin admin] PATH_INFO: `/v3/projects/f632cabe650e4c76b8f3b1296ccb4941/users/04305e94cc3749f0895eb522cd5b4699/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:39.476944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644adefb-7caa-4bf3-b3b0-d1c96e6f46cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f632cabe650e4c76b8f3b1296ccb4941, user_id=04305e94cc3749f0895eb522cd5b4699, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:39.480986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644adefb-7caa-4bf3-b3b0-d1c96e6f46cd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:39.497195 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4088/8180] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:39 2022] PUT /identity/v3/projects/f632cabe650e4c76b8f3b1296ccb4941/users/04305e94cc3749f0895eb522cd5b4699/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:39.508175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976ecdd-9eb2-42db-ac2a-a850bbd7c120 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:39.508476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976ecdd-9eb2-42db-ac2a-a850bbd7c120 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:39.508754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976ecdd-9eb2-42db-ac2a-a850bbd7c120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:39.553336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5976ecdd-9eb2-42db-ac2a-a850bbd7c120 None None] MFA Rules not processed for user `04305e94cc3749f0895eb522cd5b4699`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:39.554611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5976ecdd-9eb2-42db-ac2a-a850bbd7c120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:39.661271 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4093/8181] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:39.665607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644adefb-7caa-4bf3-b3b0-d1c96e6f46cd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:39.760233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644adefb-7caa-4bf3-b3b0-d1c96e6f46cd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:39.768298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9012f10-6a35-47e7-840a-2c3190d284a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:39.768925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9012f10-6a35-47e7-840a-2c3190d284a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:39.769205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9012f10-6a35-47e7-840a-2c3190d284a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:39.769476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9012f10-6a35-47e7-840a-2c3190d284a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:39.770117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9012f10-6a35-47e7-840a-2c3190d284a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:39.772118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9012f10-6a35-47e7-840a-2c3190d284a9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:39.808108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976ecdd-9eb2-42db-ac2a-a850bbd7c120 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:39.810948 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4089/8182] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:39 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:39.822586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976ecdd-9eb2-42db-ac2a-a850bbd7c120 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:39.893307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178fd57-fd6a-4c80-a13f-602b1990fd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:39.894404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178fd57-fd6a-4c80-a13f-602b1990fd25 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:39.894680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178fd57-fd6a-4c80-a13f-602b1990fd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:39.894991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178fd57-fd6a-4c80-a13f-602b1990fd25 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:39.896132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178fd57-fd6a-4c80-a13f-602b1990fd25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:39.899135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178fd57-fd6a-4c80-a13f-602b1990fd25 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:39.935475 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4094/8183] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:39 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:39.936726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9012f10-6a35-47e7-840a-2c3190d284a9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:39.950497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9012f10-6a35-47e7-840a-2c3190d284a9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:39.955555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454151ad-e54c-4314-bf21-98c70cf8ee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:39.956362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454151ad-e54c-4314-bf21-98c70cf8ee78 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:39.956753 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454151ad-e54c-4314-bf21-98c70cf8ee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:39.957110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454151ad-e54c-4314-bf21-98c70cf8ee78 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:39.957820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454151ad-e54c-4314-bf21-98c70cf8ee78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:39.959600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454151ad-e54c-4314-bf21-98c70cf8ee78 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:39.974206 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4090/8184] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:39.975235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178fd57-fd6a-4c80-a13f-602b1990fd25 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:39.990199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178fd57-fd6a-4c80-a13f-602b1990fd25 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:39.997543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff982-e761-4c37-9338-19f20e0b6187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:39.998160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff982-e761-4c37-9338-19f20e0b6187 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:39.998450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff982-e761-4c37-9338-19f20e0b6187 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:39.998734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bff982-e761-4c37-9338-19f20e0b6187 admin admin] PATH_INFO: `/v3/projects/1e36f7c9d0594dfd90435bbe8c4f2432/users/a426df207acc4577990ee4a432ec0002/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.017338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bff982-e761-4c37-9338-19f20e0b6187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e36f7c9d0594dfd90435bbe8c4f2432, user_id=a426df207acc4577990ee4a432ec0002, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.020397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bff982-e761-4c37-9338-19f20e0b6187 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.039475 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4095/8185] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:39 2022] PUT /identity/v3/projects/1e36f7c9d0594dfd90435bbe8c4f2432/users/a426df207acc4577990ee4a432ec0002/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:40.044261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454151ad-e54c-4314-bf21-98c70cf8ee78 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.057502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454151ad-e54c-4314-bf21-98c70cf8ee78 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.100884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:40.119816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd16b-ff0a-45ca-bd1a-0e5f208d0006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.120486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd16b-ff0a-45ca-bd1a-0e5f208d0006 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.120763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd16b-ff0a-45ca-bd1a-0e5f208d0006 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.121037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd16b-ff0a-45ca-bd1a-0e5f208d0006 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.121680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fd16b-ff0a-45ca-bd1a-0e5f208d0006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.123318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fd16b-ff0a-45ca-bd1a-0e5f208d0006 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.133972 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4091/8186] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:40.138212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff982-e761-4c37-9338-19f20e0b6187 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.149736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bff982-e761-4c37-9338-19f20e0b6187 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.155237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94b7fc-7edd-414a-8d1b-9992769ddcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.155901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94b7fc-7edd-414a-8d1b-9992769ddcfb admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.156182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94b7fc-7edd-414a-8d1b-9992769ddcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.156452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94b7fc-7edd-414a-8d1b-9992769ddcfb admin admin] PATH_INFO: `/v3/projects/1e36f7c9d0594dfd90435bbe8c4f2432/users/a426df207acc4577990ee4a432ec0002/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.158369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94b7fc-7edd-414a-8d1b-9992769ddcfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e36f7c9d0594dfd90435bbe8c4f2432, user_id=a426df207acc4577990ee4a432ec0002, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.161173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94b7fc-7edd-414a-8d1b-9992769ddcfb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.172745 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4096/8187] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:40 2022] PUT /identity/v3/projects/1e36f7c9d0594dfd90435bbe8c4f2432/users/a426df207acc4577990ee4a432ec0002/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:40.184616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacbb3b-c968-4e06-88c8-0114fac1560e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.184905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacbb3b-c968-4e06-88c8-0114fac1560e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.185182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacbb3b-c968-4e06-88c8-0114fac1560e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.214302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2eacbb3b-c968-4e06-88c8-0114fac1560e None None] MFA Rules not processed for user `a426df207acc4577990ee4a432ec0002`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:40.215540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2eacbb3b-c968-4e06-88c8-0114fac1560e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:40.290777 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4092/8188] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:40.296794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94b7fc-7edd-414a-8d1b-9992769ddcfb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.309449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94b7fc-7edd-414a-8d1b-9992769ddcfb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.314137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef636ab-c7c2-4096-96fa-e25dc4f0f228 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a426df207acc4577990ee4a432ec0002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e36f7c9d0594dfd90435bbe8c4f2432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.315286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef636ab-c7c2-4096-96fa-e25dc4f0f228 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.315286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef636ab-c7c2-4096-96fa-e25dc4f0f228 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.315508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef636ab-c7c2-4096-96fa-e25dc4f0f228 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] PATH_INFO: `/v3/policies` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.317970 n-d-854118-7 devstack@keystone.service[88374]: WARNING oslo_log.versionutils [None req-1ef636ab-c7c2-4096-96fa-e25dc4f0f228 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 19:35:40.317970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef636ab-c7c2-4096-96fa-e25dc4f0f228 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.318886 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-1ef636ab-c7c2-4096-96fa-e25dc4f0f228 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:40.318886 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:35:40.318886 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:35:40.319753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef636ab-c7c2-4096-96fa-e25dc4f0f228 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.347660 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4097/8189] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:35:40 2022] POST /identity/v3/policies => generated 228 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:40.351864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacbb3b-c968-4e06-88c8-0114fac1560e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.362605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacbb3b-c968-4e06-88c8-0114fac1560e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.367870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471bb03-289e-4e2f-a30d-ed1d30a80a70 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a426df207acc4577990ee4a432ec0002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e36f7c9d0594dfd90435bbe8c4f2432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.368723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471bb03-289e-4e2f-a30d-ed1d30a80a70 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.369336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471bb03-289e-4e2f-a30d-ed1d30a80a70 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.369336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471bb03-289e-4e2f-a30d-ed1d30a80a70 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] PATH_INFO: `/v3/policies/27ee3cd0939a4f8887df759626ecc9ee` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.371367 n-d-854118-7 devstack@keystone.service[88375]: WARNING oslo_log.versionutils [None req-d471bb03-289e-4e2f-a30d-ed1d30a80a70 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 19:35:40.372288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471bb03-289e-4e2f-a30d-ed1d30a80a70 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=27ee3cd0939a4f8887df759626ecc9ee)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.373614 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-d471bb03-289e-4e2f-a30d-ed1d30a80a70 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:40.373614 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:35:40.373614 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:35:40.374611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471bb03-289e-4e2f-a30d-ed1d30a80a70 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.404254 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4093/8190] 10.222.0.70 () {60 vars in 1252 bytes} [Sun Aug 28 19:35:40 2022] PATCH /identity/v3/policies/27ee3cd0939a4f8887df759626ecc9ee => generated 235 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:40.407576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef636ab-c7c2-4096-96fa-e25dc4f0f228 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.419743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef636ab-c7c2-4096-96fa-e25dc4f0f228 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.424811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0290d-c73d-458e-a18c-8f9cfd82e049 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a426df207acc4577990ee4a432ec0002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e36f7c9d0594dfd90435bbe8c4f2432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.425696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0290d-c73d-458e-a18c-8f9cfd82e049 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.425984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0290d-c73d-458e-a18c-8f9cfd82e049 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.426263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0290d-c73d-458e-a18c-8f9cfd82e049 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] PATH_INFO: `/v3/policies/27ee3cd0939a4f8887df759626ecc9ee` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.427482 n-d-854118-7 devstack@keystone.service[88374]: WARNING oslo_log.versionutils [None req-79e0290d-c73d-458e-a18c-8f9cfd82e049 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 19:35:40.428053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0290d-c73d-458e-a18c-8f9cfd82e049 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=27ee3cd0939a4f8887df759626ecc9ee)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.429308 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-79e0290d-c73d-458e-a18c-8f9cfd82e049 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:40.429308 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:35:40.429308 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:35:40.430306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0290d-c73d-458e-a18c-8f9cfd82e049 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.442719 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4098/8191] 10.222.0.70 () {58 vars in 1230 bytes} [Sun Aug 28 19:35:40 2022] GET /identity/v3/policies/27ee3cd0939a4f8887df759626ecc9ee => generated 235 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:40.447026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471bb03-289e-4e2f-a30d-ed1d30a80a70 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.458627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471bb03-289e-4e2f-a30d-ed1d30a80a70 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.463530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38e27f-848b-451e-80ee-a480a26f1bdd tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a426df207acc4577990ee4a432ec0002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e36f7c9d0594dfd90435bbe8c4f2432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.464180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38e27f-848b-451e-80ee-a480a26f1bdd tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.464461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38e27f-848b-451e-80ee-a480a26f1bdd tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.464745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38e27f-848b-451e-80ee-a480a26f1bdd tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] PATH_INFO: `/v3/policies/27ee3cd0939a4f8887df759626ecc9ee` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.465529 n-d-854118-7 devstack@keystone.service[88375]: WARNING oslo_log.versionutils [None req-8c38e27f-848b-451e-80ee-a480a26f1bdd tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 19:35:40.466169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38e27f-848b-451e-80ee-a480a26f1bdd tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=27ee3cd0939a4f8887df759626ecc9ee)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.467496 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-8c38e27f-848b-451e-80ee-a480a26f1bdd tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:40.467496 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:35:40.467496 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:35:40.468531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38e27f-848b-451e-80ee-a480a26f1bdd tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.489508 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4094/8192] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:40 2022] DELETE /identity/v3/policies/27ee3cd0939a4f8887df759626ecc9ee => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:40.495476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0290d-c73d-458e-a18c-8f9cfd82e049 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.510084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0290d-c73d-458e-a18c-8f9cfd82e049 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.515389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94d69e-ddb9-413f-8a38-e0701040a6ba tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a426df207acc4577990ee4a432ec0002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e36f7c9d0594dfd90435bbe8c4f2432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.516019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94d69e-ddb9-413f-8a38-e0701040a6ba tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.516308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94d69e-ddb9-413f-8a38-e0701040a6ba tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.516594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94d69e-ddb9-413f-8a38-e0701040a6ba tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] PATH_INFO: `/v3/policies` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.517808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94d69e-ddb9-413f-8a38-e0701040a6ba tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.519888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94d69e-ddb9-413f-8a38-e0701040a6ba tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.540912 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4099/8193] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:35:40 2022] POST /identity/v3/policies => generated 229 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:40.545858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38e27f-848b-451e-80ee-a480a26f1bdd tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.560166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38e27f-848b-451e-80ee-a480a26f1bdd tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.565400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720434e-2158-4425-a565-ffdc94801835 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a426df207acc4577990ee4a432ec0002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e36f7c9d0594dfd90435bbe8c4f2432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.566028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720434e-2158-4425-a565-ffdc94801835 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.566316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720434e-2158-4425-a565-ffdc94801835 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.566589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720434e-2158-4425-a565-ffdc94801835 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] PATH_INFO: `/v3/policies` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.567973 n-d-854118-7 devstack@keystone.service[88375]: WARNING oslo_log.versionutils [None req-7720434e-2158-4425-a565-ffdc94801835 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 19:35:40.568619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720434e-2158-4425-a565-ffdc94801835 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.570194 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-7720434e-2158-4425-a565-ffdc94801835 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:40.570194 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:35:40.570194 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:35:40.571125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720434e-2158-4425-a565-ffdc94801835 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.594430 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4095/8194] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:35:40 2022] POST /identity/v3/policies => generated 230 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:40.598935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94d69e-ddb9-413f-8a38-e0701040a6ba tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.606661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:40.613975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94d69e-ddb9-413f-8a38-e0701040a6ba tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.623444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6cd70-5f3b-45d0-8063-a9226011d561 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a426df207acc4577990ee4a432ec0002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e36f7c9d0594dfd90435bbe8c4f2432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.623822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6cd70-5f3b-45d0-8063-a9226011d561 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.624112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6cd70-5f3b-45d0-8063-a9226011d561 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.624399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6cd70-5f3b-45d0-8063-a9226011d561 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] PATH_INFO: `/v3/policies` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.625555 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6cd70-5f3b-45d0-8063-a9226011d561 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.627471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6cd70-5f3b-45d0-8063-a9226011d561 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.647828 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4100/8195] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:35:40 2022] POST /identity/v3/policies => generated 228 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:40.652010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720434e-2158-4425-a565-ffdc94801835 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.664896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720434e-2158-4425-a565-ffdc94801835 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.672281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9571c6-6e93-4238-b4a3-dd18293880cf tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a426df207acc4577990ee4a432ec0002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e36f7c9d0594dfd90435bbe8c4f2432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.674792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9571c6-6e93-4238-b4a3-dd18293880cf tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.674792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9571c6-6e93-4238-b4a3-dd18293880cf tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.674792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9571c6-6e93-4238-b4a3-dd18293880cf tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] PATH_INFO: `/v3/policies` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.674792 n-d-854118-7 devstack@keystone.service[88375]: WARNING oslo_log.versionutils [None req-dd9571c6-6e93-4238-b4a3-dd18293880cf tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 19:35:40.674792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9571c6-6e93-4238-b4a3-dd18293880cf tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.675963 n-d-854118-7 devstack@keystone.service[88375]: WARNING py.warnings [None req-dd9571c6-6e93-4238-b4a3-dd18293880cf tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:40.675963 n-d-854118-7 devstack@keystone.service[88375]: warnings.warn(msg) Aug 28 19:35:40.675963 n-d-854118-7 devstack@keystone.service[88375]: Aug 28 19:35:40.676949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9571c6-6e93-4238-b4a3-dd18293880cf tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.687695 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4096/8196] 10.222.0.70 () {58 vars in 1131 bytes} [Sun Aug 28 19:35:40 2022] GET /identity/v3/policies => generated 763 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:40.692079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6cd70-5f3b-45d0-8063-a9226011d561 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.704270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6cd70-5f3b-45d0-8063-a9226011d561 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.709307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3d0e6-5f66-4bc6-af0f-f46bbbd8f1aa tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a426df207acc4577990ee4a432ec0002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e36f7c9d0594dfd90435bbe8c4f2432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.709958 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3d0e6-5f66-4bc6-af0f-f46bbbd8f1aa tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.710315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3d0e6-5f66-4bc6-af0f-f46bbbd8f1aa tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.710602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3d0e6-5f66-4bc6-af0f-f46bbbd8f1aa tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] PATH_INFO: `/v3/policies/a5f2253af6a94cfdb345be4e930cc6a2` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.711480 n-d-854118-7 devstack@keystone.service[88374]: WARNING oslo_log.versionutils [None req-b2d3d0e6-5f66-4bc6-af0f-f46bbbd8f1aa tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 28 19:35:40.712303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3d0e6-5f66-4bc6-af0f-f46bbbd8f1aa tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=a5f2253af6a94cfdb345be4e930cc6a2)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.714267 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-b2d3d0e6-5f66-4bc6-af0f-f46bbbd8f1aa tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:40.714267 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:35:40.714267 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:35:40.715303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3d0e6-5f66-4bc6-af0f-f46bbbd8f1aa tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.735698 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4101/8197] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:40 2022] DELETE /identity/v3/policies/a5f2253af6a94cfdb345be4e930cc6a2 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:40.739979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9571c6-6e93-4238-b4a3-dd18293880cf tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.751841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9571c6-6e93-4238-b4a3-dd18293880cf tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.756848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6875ca-692c-4386-9ef7-a9ce1916776e tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a426df207acc4577990ee4a432ec0002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e36f7c9d0594dfd90435bbe8c4f2432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.757707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6875ca-692c-4386-9ef7-a9ce1916776e tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.758318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6875ca-692c-4386-9ef7-a9ce1916776e tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.758688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6875ca-692c-4386-9ef7-a9ce1916776e tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] PATH_INFO: `/v3/policies/d37acd143989445591aec87df908d6ac` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.760607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6875ca-692c-4386-9ef7-a9ce1916776e tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=d37acd143989445591aec87df908d6ac)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.762692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6875ca-692c-4386-9ef7-a9ce1916776e tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.784695 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4097/8198] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:40 2022] DELETE /identity/v3/policies/d37acd143989445591aec87df908d6ac => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:40.789582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3d0e6-5f66-4bc6-af0f-f46bbbd8f1aa tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.801274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3d0e6-5f66-4bc6-af0f-f46bbbd8f1aa tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.812056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffec07-208e-4887-a227-09d577856226 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a426df207acc4577990ee4a432ec0002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e36f7c9d0594dfd90435bbe8c4f2432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.812716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffec07-208e-4887-a227-09d577856226 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.813002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffec07-208e-4887-a227-09d577856226 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.813277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffec07-208e-4887-a227-09d577856226 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] PATH_INFO: `/v3/policies/a33d5d4d32ba4e9a97a37a8a7bf809ad` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.814348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffec07-208e-4887-a227-09d577856226 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=a33d5d4d32ba4e9a97a37a8a7bf809ad)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.816221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffec07-208e-4887-a227-09d577856226 tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:40.834456 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4102/8199] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:40 2022] DELETE /identity/v3/policies/a33d5d4d32ba4e9a97a37a8a7bf809ad => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:40.840958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6875ca-692c-4386-9ef7-a9ce1916776e tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:40.917601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:40.925039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6875ca-692c-4386-9ef7-a9ce1916776e tempest-PoliciesTestJSON-1583460153 tempest-PoliciesTestJSON-1583460153-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:40.932802 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:40.934067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:40.934604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:40.935132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] PATH_INFO: `/v3/users/04305e94cc3749f0895eb522cd5b4699` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:40.937075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] RBAC: Authorizing `identity:delete_user(user_id=04305e94cc3749f0895eb522cd5b4699)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:40.939630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:41.003995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04305e94cc3749f0895eb522cd5b4699'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:41.014584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04305e94cc3749f0895eb522cd5b4699'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:41.015513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04305e94cc3749f0895eb522cd5b4699'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:41.032243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04305e94cc3749f0895eb522cd5b4699'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:41.033288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04305e94cc3749f0895eb522cd5b4699'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:41.061567 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4098/8200] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:40 2022] DELETE /identity/v3/users/04305e94cc3749f0895eb522cd5b4699 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:41.063648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924190a-24e0-49f5-a311-3925042eec8b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:41.064045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924190a-24e0-49f5-a311-3925042eec8b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:41.064521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924190a-24e0-49f5-a311-3925042eec8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:41.087838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1924190a-24e0-49f5-a311-3925042eec8b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:41.090244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1924190a-24e0-49f5-a311-3925042eec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:41.159028 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4103/8201] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:35:41.169360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:41.170990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:41.254279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156479a-8555-499c-9754-9c87b867256a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:41.258217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85107a07-4962-4260-bee3-5632b4be6887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:41.259014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85107a07-4962-4260-bee3-5632b4be6887 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:41.259293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85107a07-4962-4260-bee3-5632b4be6887 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:41.259564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85107a07-4962-4260-bee3-5632b4be6887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:41.270410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85107a07-4962-4260-bee3-5632b4be6887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:41.271889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85107a07-4962-4260-bee3-5632b4be6887 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:41.284042 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4099/8202] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:35:41.736740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924190a-24e0-49f5-a311-3925042eec8b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:41.738426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1924190a-24e0-49f5-a311-3925042eec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:41.752040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924190a-24e0-49f5-a311-3925042eec8b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:41.757785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:41.758916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:41.759262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:41.759658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] PATH_INFO: `/v3/projects/f632cabe650e4c76b8f3b1296ccb4941` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:41.761402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f632cabe650e4c76b8f3b1296ccb4941)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:41.763548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:41.826127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f632cabe650e4c76b8f3b1296ccb4941', 'request_id': 'req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:41.835194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f632cabe650e4c76b8f3b1296ccb4941', 'request_id': 'req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:41.844377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f632cabe650e4c76b8f3b1296ccb4941', 'request_id': 'req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:41.858843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] The token cache is being invalidate because project f632cabe650e4c76b8f3b1296ccb4941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:41.859145 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:41.859981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:41.861517 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4104/8203] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:41 2022] DELETE /identity/v3/projects/f632cabe650e4c76b8f3b1296ccb4941 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:41.865536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85107a07-4962-4260-bee3-5632b4be6887 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:41.876681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85107a07-4962-4260-bee3-5632b4be6887 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:41.947203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:41.948356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:41.948652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:41.948929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] PATH_INFO: `/v3/users/a426df207acc4577990ee4a432ec0002` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:41.950094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a426df207acc4577990ee4a432ec0002)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:41.952205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:41.986197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:41.987573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:41.990366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:42.010560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3afb5-da5f-42b0-9cd6-bf30d7c07a95 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:42.015574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:42.016210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:42.016503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:42.016772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] PATH_INFO: `/v3/users/318132d8307348b4b3d83c383e155641` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:42.017917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=318132d8307348b4b3d83c383e155641)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:42.019897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:42.021637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a426df207acc4577990ee4a432ec0002'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.028779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a426df207acc4577990ee4a432ec0002'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.029509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a426df207acc4577990ee4a432ec0002'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.037459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a426df207acc4577990ee4a432ec0002'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.038156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a426df207acc4577990ee4a432ec0002'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.061219 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4100/8204] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:41 2022] DELETE /identity/v3/users/a426df207acc4577990ee4a432ec0002 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:42.063453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:42.071111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '318132d8307348b4b3d83c383e155641'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.079527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '318132d8307348b4b3d83c383e155641'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.080428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '318132d8307348b4b3d83c383e155641'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.093269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '318132d8307348b4b3d83c383e155641'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.093665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '318132d8307348b4b3d83c383e155641'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.109325 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4105/8205] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:41 2022] DELETE /identity/v3/users/318132d8307348b4b3d83c383e155641 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:42.344375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:42.347249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:42.438142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:42.439638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:42.442269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab8a88-ef5a-4241-ac07-9f779dcdd939 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:42.514715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:42.515415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:42.515695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:42.515994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] PATH_INFO: `/v3/projects/3964447817eb41558aa7925a1ab1b5e1` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:42.517099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3964447817eb41558aa7925a1ab1b5e1)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:42.519332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:42.546788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5789ef3-01cc-41c6-8a37-93facf50c102 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:42.552497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ca354-3903-4b40-b801-f5bd32421bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:42.553171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ca354-3903-4b40-b801-f5bd32421bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:42.553675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ca354-3903-4b40-b801-f5bd32421bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:42.553960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ca354-3903-4b40-b801-f5bd32421bcd admin admin] PATH_INFO: `/v3/projects/1e36f7c9d0594dfd90435bbe8c4f2432` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:42.555142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ca354-3903-4b40-b801-f5bd32421bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e36f7c9d0594dfd90435bbe8c4f2432)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:42.557081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ca354-3903-4b40-b801-f5bd32421bcd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:42.570888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:42.574455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3964447817eb41558aa7925a1ab1b5e1', 'request_id': 'req-7451543f-e464-4018-8e55-867f8ae3ec60'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.585219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3964447817eb41558aa7925a1ab1b5e1', 'request_id': 'req-7451543f-e464-4018-8e55-867f8ae3ec60'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.592791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3964447817eb41558aa7925a1ab1b5e1', 'request_id': 'req-7451543f-e464-4018-8e55-867f8ae3ec60'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.607128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] The token cache is being invalidate because project 3964447817eb41558aa7925a1ab1b5e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:42.607422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.608172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.608452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c97ca354-3903-4b40-b801-f5bd32421bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e36f7c9d0594dfd90435bbe8c4f2432', 'request_id': 'req-c97ca354-3903-4b40-b801-f5bd32421bcd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.609662 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4101/8206] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:42 2022] DELETE /identity/v3/projects/3964447817eb41558aa7925a1ab1b5e1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:42.613820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:42.615411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:42.616151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c97ca354-3903-4b40-b801-f5bd32421bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e36f7c9d0594dfd90435bbe8c4f2432', 'request_id': 'req-c97ca354-3903-4b40-b801-f5bd32421bcd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.622450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c97ca354-3903-4b40-b801-f5bd32421bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e36f7c9d0594dfd90435bbe8c4f2432', 'request_id': 'req-c97ca354-3903-4b40-b801-f5bd32421bcd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.634713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c97ca354-3903-4b40-b801-f5bd32421bcd admin admin] The token cache is being invalidate because project 1e36f7c9d0594dfd90435bbe8c4f2432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:42.635094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c97ca354-3903-4b40-b801-f5bd32421bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.635951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c97ca354-3903-4b40-b801-f5bd32421bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.637451 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4106/8207] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:42 2022] DELETE /identity/v3/projects/1e36f7c9d0594dfd90435bbe8c4f2432 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:42.642703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dde68d-fb06-487b-9f5c-5d6e86da8259 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:42.643108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dde68d-fb06-487b-9f5c-5d6e86da8259 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:42.643462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dde68d-fb06-487b-9f5c-5d6e86da8259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:42.664986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-47dde68d-fb06-487b-9f5c-5d6e86da8259 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:42.666444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-47dde68d-fb06-487b-9f5c-5d6e86da8259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:42.686854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451543f-e464-4018-8e55-867f8ae3ec60 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:42.710083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:42.730284 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4107/8208] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:35:42.738157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79829977-abc4-4149-b518-0191bc4ffebb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:42.738473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79829977-abc4-4149-b518-0191bc4ffebb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:42.738653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79829977-abc4-4149-b518-0191bc4ffebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:42.748252 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:42.748977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:42.749338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:42.749691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] PATH_INFO: `/v3/users/94d8e6010a2449b79708ddf0a68e2efd` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:42.750885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d8e6010a2449b79708ddf0a68e2efd)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:42.752820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:42.758890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-79829977-abc4-4149-b518-0191bc4ffebb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:42.760713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-79829977-abc4-4149-b518-0191bc4ffebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:42.769186 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4108/8209] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:35:42.773475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79829977-abc4-4149-b518-0191bc4ffebb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:42.784309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79829977-abc4-4149-b518-0191bc4ffebb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:42.789180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddac2ec-c09c-4fab-8b96-ce8494857893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:42.790148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddac2ec-c09c-4fab-8b96-ce8494857893 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:42.790432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddac2ec-c09c-4fab-8b96-ce8494857893 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:42.790708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddac2ec-c09c-4fab-8b96-ce8494857893 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:42.791388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddac2ec-c09c-4fab-8b96-ce8494857893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:35:42.791690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddac2ec-c09c-4fab-8b96-ce8494857893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:42.793694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddac2ec-c09c-4fab-8b96-ce8494857893 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:42.810366 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4109/8210] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:35:42.814677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddac2ec-c09c-4fab-8b96-ce8494857893 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:42.818167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d8e6010a2449b79708ddf0a68e2efd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.825007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddac2ec-c09c-4fab-8b96-ce8494857893 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:42.826515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d8e6010a2449b79708ddf0a68e2efd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.827278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d8e6010a2449b79708ddf0a68e2efd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.829628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889e501-3e75-466a-9e8e-7df45861be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:42.830221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889e501-3e75-466a-9e8e-7df45861be15 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:42.830503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889e501-3e75-466a-9e8e-7df45861be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:42.830800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889e501-3e75-466a-9e8e-7df45861be15 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:42.831676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889e501-3e75-466a-9e8e-7df45861be15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:42.833788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889e501-3e75-466a-9e8e-7df45861be15 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:42.836170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d8e6010a2449b79708ddf0a68e2efd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.836859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d8e6010a2449b79708ddf0a68e2efd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:42.844798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:42.858214 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4102/8211] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:42 2022] DELETE /identity/v3/users/94d8e6010a2449b79708ddf0a68e2efd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:42.863019 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4110/8212] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:42 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:42.870867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:42.870867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:42.957386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8750e51-78d0-45df-a8a9-20e40f4b6d66 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.038952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ec11e-232a-4bd4-b38d-811a4f534e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.039584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ec11e-232a-4bd4-b38d-811a4f534e5b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.039888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ec11e-232a-4bd4-b38d-811a4f534e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.040131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ec11e-232a-4bd4-b38d-811a4f534e5b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.040939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ec11e-232a-4bd4-b38d-811a4f534e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.044166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ec11e-232a-4bd4-b38d-811a4f534e5b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.077342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889e501-3e75-466a-9e8e-7df45861be15 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.078983 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4103/8213] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:42 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:43.090405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889e501-3e75-466a-9e8e-7df45861be15 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.095628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727c630-af9c-47bf-a86c-76dcc81951d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.096230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727c630-af9c-47bf-a86c-76dcc81951d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.096516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727c630-af9c-47bf-a86c-76dcc81951d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.096787 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727c630-af9c-47bf-a86c-76dcc81951d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.097570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727c630-af9c-47bf-a86c-76dcc81951d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.099207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727c630-af9c-47bf-a86c-76dcc81951d3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.109993 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4111/8214] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:43.113970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ec11e-232a-4bd4-b38d-811a4f534e5b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.125133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ec11e-232a-4bd4-b38d-811a4f534e5b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.129905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae336e-24eb-4eba-9ca8-791a9bfd0960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.130511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae336e-24eb-4eba-9ca8-791a9bfd0960 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.130838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae336e-24eb-4eba-9ca8-791a9bfd0960 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.131123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae336e-24eb-4eba-9ca8-791a9bfd0960 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.131800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae336e-24eb-4eba-9ca8-791a9bfd0960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.133666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae336e-24eb-4eba-9ca8-791a9bfd0960 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.145675 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4104/8215] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:43.151070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727c630-af9c-47bf-a86c-76dcc81951d3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.162646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727c630-af9c-47bf-a86c-76dcc81951d3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.168053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320b437-d243-477c-b16b-888132c095e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.168654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320b437-d243-477c-b16b-888132c095e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.168937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320b437-d243-477c-b16b-888132c095e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.169234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320b437-d243-477c-b16b-888132c095e3 admin admin] PATH_INFO: `/v3/projects/7966f95cfedb4edfae21266e5f08042e/users/48ba064ef5f44a58aa00685895347e1b/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.171696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae336e-24eb-4eba-9ca8-791a9bfd0960 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.173526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-59ae336e-24eb-4eba-9ca8-791a9bfd0960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:43.189698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae336e-24eb-4eba-9ca8-791a9bfd0960 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.192643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320b437-d243-477c-b16b-888132c095e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7966f95cfedb4edfae21266e5f08042e, user_id=48ba064ef5f44a58aa00685895347e1b, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.195648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71408c7-5edc-455a-876e-83341d4c632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.195950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320b437-d243-477c-b16b-888132c095e3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.196468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71408c7-5edc-455a-876e-83341d4c632b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.196844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71408c7-5edc-455a-876e-83341d4c632b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.197352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71408c7-5edc-455a-876e-83341d4c632b admin admin] PATH_INFO: `/v3/projects/None` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.206837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71408c7-5edc-455a-876e-83341d4c632b admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.209042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71408c7-5edc-455a-876e-83341d4c632b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.219010 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4112/8216] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:43 2022] PUT /identity/v3/projects/7966f95cfedb4edfae21266e5f08042e/users/48ba064ef5f44a58aa00685895347e1b/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-c71408c7-5edc-455a-876e-83341d4c632b admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:35:43.220420 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:35:43.221634 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 28 19:35:43.221634 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 28 19:35:43.221634 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 19:35:43.221634 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 19:35:43.221634 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 19:35:43.221634 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 19:35:43.221634 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Aug 28 19:35:43.221634 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:43.222137 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4105/8217] 10.222.0.70 () {58 vars in 1149 bytes} [Sun Aug 28 19:35:43 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 19:35:43.232284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabcdfb-a2ad-42dc-a167-b636c72cb345 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.232779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabcdfb-a2ad-42dc-a167-b636c72cb345 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.233072 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabcdfb-a2ad-42dc-a167-b636c72cb345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.234831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407cd9e-c5cc-4ae3-9b78-60887622c711 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.235118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407cd9e-c5cc-4ae3-9b78-60887622c711 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.235402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407cd9e-c5cc-4ae3-9b78-60887622c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.253673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-baabcdfb-a2ad-42dc-a167-b636c72cb345 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:43.255283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-baabcdfb-a2ad-42dc-a167-b636c72cb345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:43.265648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c407cd9e-c5cc-4ae3-9b78-60887622c711 None None] MFA Rules not processed for user `48ba064ef5f44a58aa00685895347e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:43.266917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c407cd9e-c5cc-4ae3-9b78-60887622c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:43.315474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:43.331029 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4113/8218] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:43.337883 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4106/8219] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:35:43.339041 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc4d6-a250-474e-ab8c-c36222582200 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.339335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc4d6-a250-474e-ab8c-c36222582200 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.339613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc4d6-a250-474e-ab8c-c36222582200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.342486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407cd9e-c5cc-4ae3-9b78-60887622c711 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.353702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407cd9e-c5cc-4ae3-9b78-60887622c711 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.358705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f89d7-2f22-4620-99f1-34e5876564cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.359110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3adfc4d6-a250-474e-ab8c-c36222582200 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:43.360299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f89d7-2f22-4620-99f1-34e5876564cb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.360425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3adfc4d6-a250-474e-ab8c-c36222582200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:43.360587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f89d7-2f22-4620-99f1-34e5876564cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.361342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f89d7-2f22-4620-99f1-34e5876564cb admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.362023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f89d7-2f22-4620-99f1-34e5876564cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.364094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f89d7-2f22-4620-99f1-34e5876564cb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.368740 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4114/8220] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:43.373223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc4d6-a250-474e-ab8c-c36222582200 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.386192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc4d6-a250-474e-ab8c-c36222582200 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.392600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5ebcd-72f8-41b2-bc93-4a78a8f2b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.393237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5ebcd-72f8-41b2-bc93-4a78a8f2b82b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.393543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5ebcd-72f8-41b2-bc93-4a78a8f2b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.393821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5ebcd-72f8-41b2-bc93-4a78a8f2b82b admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.394633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5ebcd-72f8-41b2-bc93-4a78a8f2b82b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:35:43.394977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5ebcd-72f8-41b2-bc93-4a78a8f2b82b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.399664 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4107/8221] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:43 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:43.399809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5ebcd-72f8-41b2-bc93-4a78a8f2b82b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.400727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f89d7-2f22-4620-99f1-34e5876564cb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.410376 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4115/8222] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:35:43.414663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5ebcd-72f8-41b2-bc93-4a78a8f2b82b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.426294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5ebcd-72f8-41b2-bc93-4a78a8f2b82b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.467954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f89d7-2f22-4620-99f1-34e5876564cb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.472796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebafa2d-15f1-4353-a3ad-770050b17aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.473406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebafa2d-15f1-4353-a3ad-770050b17aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.473910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebafa2d-15f1-4353-a3ad-770050b17aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.474054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebafa2d-15f1-4353-a3ad-770050b17aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.474557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebafa2d-15f1-4353-a3ad-770050b17aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.476556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebafa2d-15f1-4353-a3ad-770050b17aa4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.479474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:43.491720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff57aac-b3f2-4834-a242-3997ed9e61dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.492342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff57aac-b3f2-4834-a242-3997ed9e61dd admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.492768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff57aac-b3f2-4834-a242-3997ed9e61dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.492959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff57aac-b3f2-4834-a242-3997ed9e61dd admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.493580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff57aac-b3f2-4834-a242-3997ed9e61dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.495706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff57aac-b3f2-4834-a242-3997ed9e61dd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.498842 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4108/8223] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:43 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:43.502487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebafa2d-15f1-4353-a3ad-770050b17aa4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.513322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebafa2d-15f1-4353-a3ad-770050b17aa4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.518386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc2c88-48f1-4fc9-a9c3-b3d5644d21a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.519342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2c88-48f1-4fc9-a9c3-b3d5644d21a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.519501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2c88-48f1-4fc9-a9c3-b3d5644d21a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.519773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2c88-48f1-4fc9-a9c3-b3d5644d21a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.520412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc2c88-48f1-4fc9-a9c3-b3d5644d21a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.522127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc2c88-48f1-4fc9-a9c3-b3d5644d21a5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.536294 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4116/8224] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:43 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:43.536478 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4109/8225] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:35:43.537515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff57aac-b3f2-4834-a242-3997ed9e61dd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.538559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc2c88-48f1-4fc9-a9c3-b3d5644d21a5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.555905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc2c88-48f1-4fc9-a9c3-b3d5644d21a5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.642040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff57aac-b3f2-4834-a242-3997ed9e61dd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.646479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2fe26-8a0d-444c-84ec-c4ed2d91af98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.647191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2fe26-8a0d-444c-84ec-c4ed2d91af98 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.647337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3e23-3f6a-4554-92f3-87d99fd33e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.647469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2fe26-8a0d-444c-84ec-c4ed2d91af98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.648700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2fe26-8a0d-444c-84ec-c4ed2d91af98 admin admin] PATH_INFO: `/v3/projects/3659797ff0ee42fea24d56b0292e7b67/users/0e4f0b696beb4253a2ab071e3e3a6445/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.648850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3e23-3f6a-4554-92f3-87d99fd33e7d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.648850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3e23-3f6a-4554-92f3-87d99fd33e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.648850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3e23-3f6a-4554-92f3-87d99fd33e7d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.649560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e3e23-3f6a-4554-92f3-87d99fd33e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.652487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e3e23-3f6a-4554-92f3-87d99fd33e7d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.664427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2fe26-8a0d-444c-84ec-c4ed2d91af98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3659797ff0ee42fea24d56b0292e7b67, user_id=0e4f0b696beb4253a2ab071e3e3a6445, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.668133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2fe26-8a0d-444c-84ec-c4ed2d91af98 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.682840 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4117/8226] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:43 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:43.686183 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4110/8227] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:43 2022] PUT /identity/v3/projects/3659797ff0ee42fea24d56b0292e7b67/users/0e4f0b696beb4253a2ab071e3e3a6445/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:43.686314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3e23-3f6a-4554-92f3-87d99fd33e7d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.687328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2fe26-8a0d-444c-84ec-c4ed2d91af98 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.696295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3e23-3f6a-4554-92f3-87d99fd33e7d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.728179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:43.759548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2fe26-8a0d-444c-84ec-c4ed2d91af98 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.760572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fb918-69b0-4421-a8d9-8950482ab1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.761187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fb918-69b0-4421-a8d9-8950482ab1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.761468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fb918-69b0-4421-a8d9-8950482ab1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.761753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fb918-69b0-4421-a8d9-8950482ab1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.762363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fb918-69b0-4421-a8d9-8950482ab1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.763995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fb918-69b0-4421-a8d9-8950482ab1d0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.765975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6f39c-4dd1-47fb-9515-e861b3347fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.766664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6f39c-4dd1-47fb-9515-e861b3347fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.767047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6f39c-4dd1-47fb-9515-e861b3347fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.767401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6f39c-4dd1-47fb-9515-e861b3347fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.768117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6f39c-4dd1-47fb-9515-e861b3347fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.769730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6f39c-4dd1-47fb-9515-e861b3347fa1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.778221 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4118/8228] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:43.779262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fb918-69b0-4421-a8d9-8950482ab1d0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.783843 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4111/8229] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:35:43.784826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6f39c-4dd1-47fb-9515-e861b3347fa1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.789967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fb918-69b0-4421-a8d9-8950482ab1d0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.795062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3f4af-f226-4039-a64e-1ef4c1707307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.795672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3f4af-f226-4039-a64e-1ef4c1707307 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.795949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3f4af-f226-4039-a64e-1ef4c1707307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.796239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3f4af-f226-4039-a64e-1ef4c1707307 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.796866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3f4af-f226-4039-a64e-1ef4c1707307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.798152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6f39c-4dd1-47fb-9515-e861b3347fa1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.798523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3f4af-f226-4039-a64e-1ef4c1707307 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.803358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4b155-ed9f-44fc-95c6-3a10610571ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.804105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4b155-ed9f-44fc-95c6-3a10610571ee admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.804798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4b155-ed9f-44fc-95c6-3a10610571ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.804913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4b155-ed9f-44fc-95c6-3a10610571ee admin admin] PATH_INFO: `/v3/projects/3659797ff0ee42fea24d56b0292e7b67/users/0e4f0b696beb4253a2ab071e3e3a6445/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.807367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4b155-ed9f-44fc-95c6-3a10610571ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=3659797ff0ee42fea24d56b0292e7b67, user_id=0e4f0b696beb4253a2ab071e3e3a6445, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.810439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4b155-ed9f-44fc-95c6-3a10610571ee admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.811525 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4119/8230] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:35:43.815969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3f4af-f226-4039-a64e-1ef4c1707307 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.825480 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4112/8231] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:43 2022] PUT /identity/v3/projects/3659797ff0ee42fea24d56b0292e7b67/users/0e4f0b696beb4253a2ab071e3e3a6445/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:43.828304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3f4af-f226-4039-a64e-1ef4c1707307 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:43.836559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b54a9a-45d2-4584-8eb7-c1ca26270905 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.837066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b54a9a-45d2-4584-8eb7-c1ca26270905 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.837579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b54a9a-45d2-4584-8eb7-c1ca26270905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.876328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-56b54a9a-45d2-4584-8eb7-c1ca26270905 None None] MFA Rules not processed for user `0e4f0b696beb4253a2ab071e3e3a6445`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:43.877953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-56b54a9a-45d2-4584-8eb7-c1ca26270905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:43.887035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:43.902259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb6d44-5daf-43cd-9b34-ec72b6f267d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:43.902961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb6d44-5daf-43cd-9b34-ec72b6f267d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.903558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb6d44-5daf-43cd-9b34-ec72b6f267d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.903558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb6d44-5daf-43cd-9b34-ec72b6f267d2 admin admin] PATH_INFO: `/v3/projects/8c7baf012df94742af1d0569708759eb/users/ba61631e54954118963170b67723d2e0/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.921528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb6d44-5daf-43cd-9b34-ec72b6f267d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7baf012df94742af1d0569708759eb, user_id=ba61631e54954118963170b67723d2e0, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:43.924482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb6d44-5daf-43cd-9b34-ec72b6f267d2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:43.941338 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4120/8232] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:43 2022] PUT /identity/v3/projects/8c7baf012df94742af1d0569708759eb/users/ba61631e54954118963170b67723d2e0/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:43.946129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857645e0-5124-4532-8006-04e28f2e60c4 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:43.946421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857645e0-5124-4532-8006-04e28f2e60c4 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:43.946868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857645e0-5124-4532-8006-04e28f2e60c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:43.967627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-857645e0-5124-4532-8006-04e28f2e60c4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:43.969634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-857645e0-5124-4532-8006-04e28f2e60c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:43.970978 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4113/8233] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:35:43.972959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b54a9a-45d2-4584-8eb7-c1ca26270905 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:43.985784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b54a9a-45d2-4584-8eb7-c1ca26270905 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:44.036636 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4121/8234] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:35:44.055452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b230346-92e7-4295-b68a-754b1ba75acc tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e4f0b696beb4253a2ab071e3e3a6445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3659797ff0ee42fea24d56b0292e7b67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:44.056258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b230346-92e7-4295-b68a-754b1ba75acc tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:44.056636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b230346-92e7-4295-b68a-754b1ba75acc tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:44.057965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b230346-92e7-4295-b68a-754b1ba75acc tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:44.058714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b230346-92e7-4295-b68a-754b1ba75acc tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:44.060783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b230346-92e7-4295-b68a-754b1ba75acc tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:44.072232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857645e0-5124-4532-8006-04e28f2e60c4 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:44.074503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-857645e0-5124-4532-8006-04e28f2e60c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:44.099458 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4114/8235] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:43 2022] POST /identity/v3/projects => generated 360 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:44.100365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b230346-92e7-4295-b68a-754b1ba75acc tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:44.134488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:44.145289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857645e0-5124-4532-8006-04e28f2e60c4 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:44.177494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b230346-92e7-4295-b68a-754b1ba75acc tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:44.185535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219d38-5fac-4f7c-a2f4-144307ae8975 tempest-ProjectsNegativeTestJSON-1887512557 tempest-ProjectsNegativeTestJSON-1887512557-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48ba064ef5f44a58aa00685895347e1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7966f95cfedb4edfae21266e5f08042e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:44.186184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219d38-5fac-4f7c-a2f4-144307ae8975 tempest-ProjectsNegativeTestJSON-1887512557 tempest-ProjectsNegativeTestJSON-1887512557-project] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:44.186472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219d38-5fac-4f7c-a2f4-144307ae8975 tempest-ProjectsNegativeTestJSON-1887512557 tempest-ProjectsNegativeTestJSON-1887512557-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:44.186796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219d38-5fac-4f7c-a2f4-144307ae8975 tempest-ProjectsNegativeTestJSON-1887512557 tempest-ProjectsNegativeTestJSON-1887512557-project] PATH_INFO: `/v3/projects/8c0c5835f3ea42bc9a1cf6d0b4b75060` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:44.187945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45219d38-5fac-4f7c-a2f4-144307ae8975 tempest-ProjectsNegativeTestJSON-1887512557 tempest-ProjectsNegativeTestJSON-1887512557-project] RBAC: Authorizing `identity:delete_project(project_id=8c0c5835f3ea42bc9a1cf6d0b4b75060)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-45219d38-5fac-4f7c-a2f4-144307ae8975 tempest-ProjectsNegativeTestJSON-1887512557 tempest-ProjectsNegativeTestJSON-1887512557-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Aug 28 19:35:44.195455 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 28 19:35:44.196586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 28 19:35:44.196586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 28 19:35:44.196586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 28 19:35:44.196586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 28 19:35:44.196586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 28 19:35:44.196586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 28 19:35:44.196586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 28 19:35:44.196586 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:44.200142 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4115/8236] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:44 2022] DELETE /identity/v3/projects/8c0c5835f3ea42bc9a1cf6d0b4b75060 => generated 136 bytes in 100 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:35:44.201185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219d38-5fac-4f7c-a2f4-144307ae8975 tempest-ProjectsNegativeTestJSON-1887512557 tempest-ProjectsNegativeTestJSON-1887512557-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:44.203633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925038f6-821c-4258-ba76-4cbdcdf66381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:44.204359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925038f6-821c-4258-ba76-4cbdcdf66381 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:44.204654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925038f6-821c-4258-ba76-4cbdcdf66381 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:44.205244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925038f6-821c-4258-ba76-4cbdcdf66381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:44.256589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:44.277358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925038f6-821c-4258-ba76-4cbdcdf66381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:44.278846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925038f6-821c-4258-ba76-4cbdcdf66381 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:44.279929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219d38-5fac-4f7c-a2f4-144307ae8975 tempest-ProjectsNegativeTestJSON-1887512557 tempest-ProjectsNegativeTestJSON-1887512557-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:44.285077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ebade-6fb3-477c-a268-93ccd481b6ba tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e4f0b696beb4253a2ab071e3e3a6445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3659797ff0ee42fea24d56b0292e7b67', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:44.285824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ebade-6fb3-477c-a268-93ccd481b6ba tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:44.286175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ebade-6fb3-477c-a268-93ccd481b6ba tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:44.286527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ebade-6fb3-477c-a268-93ccd481b6ba tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] PATH_INFO: `/v3/projects/8c0c5835f3ea42bc9a1cf6d0b4b75060` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:44.287795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ebade-6fb3-477c-a268-93ccd481b6ba tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8c0c5835f3ea42bc9a1cf6d0b4b75060)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:44.289543 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4122/8237] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:35:44.289879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ebade-6fb3-477c-a268-93ccd481b6ba tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:44.340310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-326ebade-6fb3-477c-a268-93ccd481b6ba tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0c5835f3ea42bc9a1cf6d0b4b75060', 'request_id': 'req-326ebade-6fb3-477c-a268-93ccd481b6ba'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:44.347885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-326ebade-6fb3-477c-a268-93ccd481b6ba tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0c5835f3ea42bc9a1cf6d0b4b75060', 'request_id': 'req-326ebade-6fb3-477c-a268-93ccd481b6ba'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:44.356011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-326ebade-6fb3-477c-a268-93ccd481b6ba tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0c5835f3ea42bc9a1cf6d0b4b75060', 'request_id': 'req-326ebade-6fb3-477c-a268-93ccd481b6ba'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:44.371482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-326ebade-6fb3-477c-a268-93ccd481b6ba tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] The token cache is being invalidate because project 8c0c5835f3ea42bc9a1cf6d0b4b75060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:44.372049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-326ebade-6fb3-477c-a268-93ccd481b6ba tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:44.373536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-326ebade-6fb3-477c-a268-93ccd481b6ba tempest-ProjectsNegativeTestJSON-849107987 tempest-ProjectsNegativeTestJSON-849107987-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:44.375550 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4116/8238] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:44 2022] DELETE /identity/v3/projects/8c0c5835f3ea42bc9a1cf6d0b4b75060 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:44.381337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925038f6-821c-4258-ba76-4cbdcdf66381 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:44.395566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925038f6-821c-4258-ba76-4cbdcdf66381 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:44.467192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:44.467834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:44.468111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:44.468381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] PATH_INFO: `/v3/users/48ba064ef5f44a58aa00685895347e1b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:44.469502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ba064ef5f44a58aa00685895347e1b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:44.471473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:44.522474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ba064ef5f44a58aa00685895347e1b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:44.530720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ba064ef5f44a58aa00685895347e1b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:44.531564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ba064ef5f44a58aa00685895347e1b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:44.544614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ba064ef5f44a58aa00685895347e1b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:44.545372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ba064ef5f44a58aa00685895347e1b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:44.558425 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4123/8239] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:44 2022] DELETE /identity/v3/users/48ba064ef5f44a58aa00685895347e1b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:44.567841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a8fc-5669-49c5-a098-7a85dd661867 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:44.568135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a8fc-5669-49c5-a098-7a85dd661867 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:44.568418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07a8fc-5669-49c5-a098-7a85dd661867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:44.590467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-af07a8fc-5669-49c5-a098-7a85dd661867 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:44.592014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-af07a8fc-5669-49c5-a098-7a85dd661867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:44.664716 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4117/8240] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:35:44.675157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:44.676589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:44.747424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efb759-0a1a-4a86-b6ca-1002fd054521 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:44.751268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716247b7-405e-4bb6-8432-53fd7ce3dd4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:44.751962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716247b7-405e-4bb6-8432-53fd7ce3dd4a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:44.752311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716247b7-405e-4bb6-8432-53fd7ce3dd4a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:44.752672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716247b7-405e-4bb6-8432-53fd7ce3dd4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:44.763808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716247b7-405e-4bb6-8432-53fd7ce3dd4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:44.765422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716247b7-405e-4bb6-8432-53fd7ce3dd4a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:44.790105 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4124/8241] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:35:45.353461 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07a8fc-5669-49c5-a098-7a85dd661867 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:45.355915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-af07a8fc-5669-49c5-a098-7a85dd661867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:45.363475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:45.369294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07a8fc-5669-49c5-a098-7a85dd661867 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:45.376617 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:45.378826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:45.379223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:45.380550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] PATH_INFO: `/v3/projects/7966f95cfedb4edfae21266e5f08042e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:45.381860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7966f95cfedb4edfae21266e5f08042e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:45.384246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:45.450930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7966f95cfedb4edfae21266e5f08042e', 'request_id': 'req-73974b4f-f31b-4b86-916b-fee8655be663'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:45.458471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7966f95cfedb4edfae21266e5f08042e', 'request_id': 'req-73974b4f-f31b-4b86-916b-fee8655be663'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:45.467079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7966f95cfedb4edfae21266e5f08042e', 'request_id': 'req-73974b4f-f31b-4b86-916b-fee8655be663'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:45.492573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] The token cache is being invalidate because project 7966f95cfedb4edfae21266e5f08042e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:45.492876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:45.496239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:45.502256 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4118/8242] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:45 2022] DELETE /identity/v3/projects/7966f95cfedb4edfae21266e5f08042e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:45.504112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716247b7-405e-4bb6-8432-53fd7ce3dd4a service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:45.515393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:45.524894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716247b7-405e-4bb6-8432-53fd7ce3dd4a service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:45.634399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d13202-35a9-47ee-8c61-b9ac31343d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:45.635431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d13202-35a9-47ee-8c61-b9ac31343d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:45.636397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d13202-35a9-47ee-8c61-b9ac31343d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:45.636837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d13202-35a9-47ee-8c61-b9ac31343d1a admin admin] PATH_INFO: `/v3/users/0e4f0b696beb4253a2ab071e3e3a6445` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:45.638918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d13202-35a9-47ee-8c61-b9ac31343d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4f0b696beb4253a2ab071e3e3a6445)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:45.641098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d13202-35a9-47ee-8c61-b9ac31343d1a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:45.723215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-89d13202-35a9-47ee-8c61-b9ac31343d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4f0b696beb4253a2ab071e3e3a6445'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:45.735267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-89d13202-35a9-47ee-8c61-b9ac31343d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4f0b696beb4253a2ab071e3e3a6445'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:45.736129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-89d13202-35a9-47ee-8c61-b9ac31343d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4f0b696beb4253a2ab071e3e3a6445'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:45.754970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-89d13202-35a9-47ee-8c61-b9ac31343d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4f0b696beb4253a2ab071e3e3a6445'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:45.755871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-89d13202-35a9-47ee-8c61-b9ac31343d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4f0b696beb4253a2ab071e3e3a6445'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:45.780047 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4125/8243] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:45 2022] DELETE /identity/v3/users/0e4f0b696beb4253a2ab071e3e3a6445 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:46.361633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:46.371359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:46.403551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73974b4f-f31b-4b86-916b-fee8655be663 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:46.533140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c7a5e-34ac-49b0-849c-792e2fa597fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:46.534127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c7a5e-34ac-49b0-849c-792e2fa597fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:46.534478 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c7a5e-34ac-49b0-849c-792e2fa597fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:46.534997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c7a5e-34ac-49b0-849c-792e2fa597fd admin admin] PATH_INFO: `/v3/projects/3659797ff0ee42fea24d56b0292e7b67` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:46.536403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c7a5e-34ac-49b0-849c-792e2fa597fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3659797ff0ee42fea24d56b0292e7b67)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:46.544733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c7a5e-34ac-49b0-849c-792e2fa597fd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:46.676419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f41c7a5e-34ac-49b0-849c-792e2fa597fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3659797ff0ee42fea24d56b0292e7b67', 'request_id': 'req-f41c7a5e-34ac-49b0-849c-792e2fa597fd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:46.696626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f41c7a5e-34ac-49b0-849c-792e2fa597fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3659797ff0ee42fea24d56b0292e7b67', 'request_id': 'req-f41c7a5e-34ac-49b0-849c-792e2fa597fd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:46.709139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f41c7a5e-34ac-49b0-849c-792e2fa597fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3659797ff0ee42fea24d56b0292e7b67', 'request_id': 'req-f41c7a5e-34ac-49b0-849c-792e2fa597fd'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:46.739355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f41c7a5e-34ac-49b0-849c-792e2fa597fd admin admin] The token cache is being invalidate because project 3659797ff0ee42fea24d56b0292e7b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:46.739982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f41c7a5e-34ac-49b0-849c-792e2fa597fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:46.741226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f41c7a5e-34ac-49b0-849c-792e2fa597fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:46.744997 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4119/8244] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:46 2022] DELETE /identity/v3/projects/3659797ff0ee42fea24d56b0292e7b67 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:46.749711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeed91-ff26-45a5-a0ac-43139296e005 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:46.750219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeed91-ff26-45a5-a0ac-43139296e005 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:46.750332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeed91-ff26-45a5-a0ac-43139296e005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:46.772291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0aaeed91-ff26-45a5-a0ac-43139296e005 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:46.773612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0aaeed91-ff26-45a5-a0ac-43139296e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:46.846910 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4126/8245] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:46.854496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44963581-f05c-4c19-81ee-dcbdccdeb9a7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:46.854896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44963581-f05c-4c19-81ee-dcbdccdeb9a7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:46.855187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44963581-f05c-4c19-81ee-dcbdccdeb9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:46.879352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-44963581-f05c-4c19-81ee-dcbdccdeb9a7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:46.880700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-44963581-f05c-4c19-81ee-dcbdccdeb9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:46.890665 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4120/8246] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:46.895461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeed91-ff26-45a5-a0ac-43139296e005 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:46.906823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeed91-ff26-45a5-a0ac-43139296e005 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:46.936722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6f588-54e4-49e7-8a4a-e03502c3a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:46.937363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6f588-54e4-49e7-8a4a-e03502c3a586 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:46.937716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6f588-54e4-49e7-8a4a-e03502c3a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:46.938006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6f588-54e4-49e7-8a4a-e03502c3a586 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:46.938718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6f588-54e4-49e7-8a4a-e03502c3a586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:35:46.939136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6f588-54e4-49e7-8a4a-e03502c3a586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:46.940832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6f588-54e4-49e7-8a4a-e03502c3a586 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:46.968437 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4127/8247] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:46.973433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44963581-f05c-4c19-81ee-dcbdccdeb9a7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:46.993661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44963581-f05c-4c19-81ee-dcbdccdeb9a7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:47.002937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea0f22-24de-49c0-942a-a7afb6292b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:47.004351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea0f22-24de-49c0-942a-a7afb6292b4c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:47.004544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea0f22-24de-49c0-942a-a7afb6292b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:47.004823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea0f22-24de-49c0-942a-a7afb6292b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:47.006093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea0f22-24de-49c0-942a-a7afb6292b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:47.009351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea0f22-24de-49c0-942a-a7afb6292b4c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:47.016910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:47.063866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6f588-54e4-49e7-8a4a-e03502c3a586 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:47.064601 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4121/8248] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:46 2022] POST /identity/v3/projects => generated 369 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:47.075934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6f588-54e4-49e7-8a4a-e03502c3a586 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:47.091141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:47.259879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252403d-525f-46c8-989b-4ea4b7ce72b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:47.261048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252403d-525f-46c8-989b-4ea4b7ce72b7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:47.261330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252403d-525f-46c8-989b-4ea4b7ce72b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:47.261605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252403d-525f-46c8-989b-4ea4b7ce72b7 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:47.262250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252403d-525f-46c8-989b-4ea4b7ce72b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:47.264241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252403d-525f-46c8-989b-4ea4b7ce72b7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:47.300516 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4128/8249] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:47 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:47.305286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea0f22-24de-49c0-942a-a7afb6292b4c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:47.319995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea0f22-24de-49c0-942a-a7afb6292b4c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:47.335535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03681394-6403-4054-ba46-3d940e61f952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:47.336399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03681394-6403-4054-ba46-3d940e61f952 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:47.336786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03681394-6403-4054-ba46-3d940e61f952 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:47.337163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03681394-6403-4054-ba46-3d940e61f952 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:47.338985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03681394-6403-4054-ba46-3d940e61f952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:47.345665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03681394-6403-4054-ba46-3d940e61f952 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:47.362801 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4122/8250] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:47.364717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252403d-525f-46c8-989b-4ea4b7ce72b7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:47.378182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252403d-525f-46c8-989b-4ea4b7ce72b7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:47.393612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb47725-7437-40e1-9bc1-8d2be6894db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:47.394422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb47725-7437-40e1-9bc1-8d2be6894db4 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:47.394831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb47725-7437-40e1-9bc1-8d2be6894db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:47.395197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb47725-7437-40e1-9bc1-8d2be6894db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:47.395920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb47725-7437-40e1-9bc1-8d2be6894db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:47.397644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb47725-7437-40e1-9bc1-8d2be6894db4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:47.423034 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4129/8251] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:47.428266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03681394-6403-4054-ba46-3d940e61f952 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:47.451717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03681394-6403-4054-ba46-3d940e61f952 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:47.459685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88e7d5-d629-4c68-9dd6-256dbadce4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:47.460410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88e7d5-d629-4c68-9dd6-256dbadce4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:47.460699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88e7d5-d629-4c68-9dd6-256dbadce4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:47.460981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88e7d5-d629-4c68-9dd6-256dbadce4bc admin admin] PATH_INFO: `/v3/projects/ede6bffc754a4d8b9ace8395a5aa5de1/users/28a1381960dd44e88d48011d8ddc2f3d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:47.498674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88e7d5-d629-4c68-9dd6-256dbadce4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede6bffc754a4d8b9ace8395a5aa5de1, user_id=28a1381960dd44e88d48011d8ddc2f3d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:47.505229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88e7d5-d629-4c68-9dd6-256dbadce4bc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:47.536354 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4123/8252] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:47 2022] PUT /identity/v3/projects/ede6bffc754a4d8b9ace8395a5aa5de1/users/28a1381960dd44e88d48011d8ddc2f3d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:47.546665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0756c9-47d3-44bf-8a3c-ad4be545a2ad None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:47.547067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0756c9-47d3-44bf-8a3c-ad4be545a2ad None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:47.547345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0756c9-47d3-44bf-8a3c-ad4be545a2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:47.596278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2e0756c9-47d3-44bf-8a3c-ad4be545a2ad None None] MFA Rules not processed for user `28a1381960dd44e88d48011d8ddc2f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:47.597631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2e0756c9-47d3-44bf-8a3c-ad4be545a2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:47.689078 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4130/8253] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:47.693609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88e7d5-d629-4c68-9dd6-256dbadce4bc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:47.786337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88e7d5-d629-4c68-9dd6-256dbadce4bc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:47.793786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb83baa-9ab6-4ea7-b75c-e6f391ece6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:47.794490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb83baa-9ab6-4ea7-b75c-e6f391ece6fd admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:47.794940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb83baa-9ab6-4ea7-b75c-e6f391ece6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:47.795445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb83baa-9ab6-4ea7-b75c-e6f391ece6fd admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:47.796241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb83baa-9ab6-4ea7-b75c-e6f391ece6fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:47.799250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb83baa-9ab6-4ea7-b75c-e6f391ece6fd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:47.849460 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4124/8254] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:47 2022] POST /identity/v3/projects => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:47.853532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0756c9-47d3-44bf-8a3c-ad4be545a2ad None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:47.879649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0756c9-47d3-44bf-8a3c-ad4be545a2ad None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:48.025778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc4a08-66e9-4570-8474-db3b16f69f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:48.026439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc4a08-66e9-4570-8474-db3b16f69f65 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:48.026718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc4a08-66e9-4570-8474-db3b16f69f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:48.027027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc4a08-66e9-4570-8474-db3b16f69f65 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:48.027677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc4a08-66e9-4570-8474-db3b16f69f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:48.029644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc4a08-66e9-4570-8474-db3b16f69f65 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:48.066901 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4131/8255] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:47 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:48.071337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb83baa-9ab6-4ea7-b75c-e6f391ece6fd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:48.082397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb83baa-9ab6-4ea7-b75c-e6f391ece6fd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:48.087804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7c8a9-71a9-4fc2-9716-9da8a1a9a323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:48.088465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c8a9-71a9-4fc2-9716-9da8a1a9a323 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:48.088749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c8a9-71a9-4fc2-9716-9da8a1a9a323 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:48.089065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7c8a9-71a9-4fc2-9716-9da8a1a9a323 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:48.089671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7c8a9-71a9-4fc2-9716-9da8a1a9a323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:48.091314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7c8a9-71a9-4fc2-9716-9da8a1a9a323 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:48.105507 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4125/8256] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:35:48.109833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc4a08-66e9-4570-8474-db3b16f69f65 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:48.125359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc4a08-66e9-4570-8474-db3b16f69f65 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:48.130435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71d2de-8378-4079-9a78-099e109ab48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:48.131400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71d2de-8378-4079-9a78-099e109ab48c admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:48.131695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71d2de-8378-4079-9a78-099e109ab48c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:48.131978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71d2de-8378-4079-9a78-099e109ab48c admin admin] PATH_INFO: `/v3/projects/5c49d2c0c9554ed284a49c6973658060/users/7e8785c8aed743f0946f0811b7e08323/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:48.135347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:48.157978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71d2de-8378-4079-9a78-099e109ab48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c49d2c0c9554ed284a49c6973658060, user_id=7e8785c8aed743f0946f0811b7e08323, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:48.160866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71d2de-8378-4079-9a78-099e109ab48c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:48.186226 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4132/8257] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:48 2022] PUT /identity/v3/projects/5c49d2c0c9554ed284a49c6973658060/users/7e8785c8aed743f0946f0811b7e08323/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:48.190129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7c8a9-71a9-4fc2-9716-9da8a1a9a323 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:48.202199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7c8a9-71a9-4fc2-9716-9da8a1a9a323 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:48.316346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5263f-b66c-4eef-bac7-a868300e40db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:48.316978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5263f-b66c-4eef-bac7-a868300e40db admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:48.317261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5263f-b66c-4eef-bac7-a868300e40db admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:48.317535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5263f-b66c-4eef-bac7-a868300e40db admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:48.318322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5263f-b66c-4eef-bac7-a868300e40db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:48.320729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5263f-b66c-4eef-bac7-a868300e40db admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:48.343616 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4126/8258] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:48.348570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71d2de-8378-4079-9a78-099e109ab48c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:48.367175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71d2de-8378-4079-9a78-099e109ab48c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:48.379352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe519d-b852-4b48-9199-9fec9966ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:48.380057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe519d-b852-4b48-9199-9fec9966ba73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:48.380299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe519d-b852-4b48-9199-9fec9966ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:48.381053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe519d-b852-4b48-9199-9fec9966ba73 admin admin] PATH_INFO: `/v3/projects/5c49d2c0c9554ed284a49c6973658060/users/7e8785c8aed743f0946f0811b7e08323/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:48.386592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe519d-b852-4b48-9199-9fec9966ba73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c49d2c0c9554ed284a49c6973658060, user_id=7e8785c8aed743f0946f0811b7e08323, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:48.391688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe519d-b852-4b48-9199-9fec9966ba73 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:48.417181 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4133/8259] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:48 2022] PUT /identity/v3/projects/5c49d2c0c9554ed284a49c6973658060/users/7e8785c8aed743f0946f0811b7e08323/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:48.443035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168f99-621b-4ed0-b292-e264197a6328 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:48.443501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168f99-621b-4ed0-b292-e264197a6328 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:48.443584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d168f99-621b-4ed0-b292-e264197a6328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:48.492225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3d168f99-621b-4ed0-b292-e264197a6328 None None] MFA Rules not processed for user `7e8785c8aed743f0946f0811b7e08323`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:48.493809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3d168f99-621b-4ed0-b292-e264197a6328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:48.510776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:48.612811 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4127/8260] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:48.614150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe519d-b852-4b48-9199-9fec9966ba73 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:48.625981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe519d-b852-4b48-9199-9fec9966ba73 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:48.633689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df6a9c-1cda-409d-b413-b716b25defe8 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:48.634456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df6a9c-1cda-409d-b413-b716b25defe8 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:48.634881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df6a9c-1cda-409d-b413-b716b25defe8 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:48.635732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df6a9c-1cda-409d-b413-b716b25defe8 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:48.636451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df6a9c-1cda-409d-b413-b716b25defe8 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:48.638861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df6a9c-1cda-409d-b413-b716b25defe8 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:48.681481 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4134/8261] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:35:48 2022] POST /identity/v3/projects => generated 328 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:48.685725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d168f99-621b-4ed0-b292-e264197a6328 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:48.698377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d168f99-621b-4ed0-b292-e264197a6328 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:48.786654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf8d0b-e944-47da-bb71-d88002925519 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:48.787791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf8d0b-e944-47da-bb71-d88002925519 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:48.788091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf8d0b-e944-47da-bb71-d88002925519 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:48.788381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf8d0b-e944-47da-bb71-d88002925519 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:48.789057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf8d0b-e944-47da-bb71-d88002925519 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:48.792211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf8d0b-e944-47da-bb71-d88002925519 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:48.826633 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4128/8262] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:48 2022] POST /identity/v3/users => generated 413 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:48.830655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df6a9c-1cda-409d-b413-b716b25defe8 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:48.845510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df6a9c-1cda-409d-b413-b716b25defe8 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:48.852612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bff27-c75c-4c50-919a-cc56a82a2c01 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:48.853272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bff27-c75c-4c50-919a-cc56a82a2c01 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:48.853638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bff27-c75c-4c50-919a-cc56a82a2c01 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:48.855051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bff27-c75c-4c50-919a-cc56a82a2c01 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:48.855391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bff27-c75c-4c50-919a-cc56a82a2c01 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:48.857480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bff27-c75c-4c50-919a-cc56a82a2c01 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:48.888769 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4135/8263] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:35:48 2022] POST /identity/v3/roles => generated 243 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:48.896051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf8d0b-e944-47da-bb71-d88002925519 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:48.914714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf8d0b-e944-47da-bb71-d88002925519 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:48.923965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5952e-31ab-4986-b056-f53d23c4c5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:48.925562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5952e-31ab-4986-b056-f53d23c4c5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:48.926430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5952e-31ab-4986-b056-f53d23c4c5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:48.927369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5952e-31ab-4986-b056-f53d23c4c5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:48.929141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5952e-31ab-4986-b056-f53d23c4c5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:48.934384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5952e-31ab-4986-b056-f53d23c4c5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:48.962564 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4129/8264] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:35:48 2022] POST /identity/v3/roles => generated 246 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:48.966731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bff27-c75c-4c50-919a-cc56a82a2c01 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:48.982924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bff27-c75c-4c50-919a-cc56a82a2c01 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:48.995728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed97eb-610b-4df1-929d-32d377aaab03 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:48.996457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed97eb-610b-4df1-929d-32d377aaab03 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:48.996790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed97eb-610b-4df1-929d-32d377aaab03 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:48.997478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed97eb-610b-4df1-929d-32d377aaab03 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/33bf7e5c262041a8ae08e606f9466f07/users/b00d703ad66e4ff192d46343fe3dd89a/roles/ca3788bdaf96438a959eaa31150bfbd5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:49.033527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed97eb-610b-4df1-929d-32d377aaab03 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_grant(project_id=33bf7e5c262041a8ae08e606f9466f07, user_id=b00d703ad66e4ff192d46343fe3dd89a, role_id=ca3788bdaf96438a959eaa31150bfbd5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:49.040190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed97eb-610b-4df1-929d-32d377aaab03 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:49.069436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4136/8265] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:48 2022] PUT /identity/v3/projects/33bf7e5c262041a8ae08e606f9466f07/users/b00d703ad66e4ff192d46343fe3dd89a/roles/ca3788bdaf96438a959eaa31150bfbd5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:49.074953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5952e-31ab-4986-b056-f53d23c4c5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:49.090867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5952e-31ab-4986-b056-f53d23c4c5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:49.207559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e65c3-6195-4955-85c7-3e91dec198d9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:49.208265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e65c3-6195-4955-85c7-3e91dec198d9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:49.210258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e65c3-6195-4955-85c7-3e91dec198d9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:49.210630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e65c3-6195-4955-85c7-3e91dec198d9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/33bf7e5c262041a8ae08e606f9466f07/users/b00d703ad66e4ff192d46343fe3dd89a/roles/5cd4036366af45db9a32b11b4372e3a4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:49.215824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e65c3-6195-4955-85c7-3e91dec198d9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_grant(project_id=33bf7e5c262041a8ae08e606f9466f07, user_id=b00d703ad66e4ff192d46343fe3dd89a, role_id=5cd4036366af45db9a32b11b4372e3a4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:49.222222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e65c3-6195-4955-85c7-3e91dec198d9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:49.256271 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4130/8266] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:49 2022] PUT /identity/v3/projects/33bf7e5c262041a8ae08e606f9466f07/users/b00d703ad66e4ff192d46343fe3dd89a/roles/5cd4036366af45db9a32b11b4372e3a4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:49.261165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed97eb-610b-4df1-929d-32d377aaab03 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:49.280749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed97eb-610b-4df1-929d-32d377aaab03 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:49.421621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b720631-e671-4251-b719-10c239770f14 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:49.422280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b720631-e671-4251-b719-10c239770f14 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:49.422568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b720631-e671-4251-b719-10c239770f14 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:49.422874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b720631-e671-4251-b719-10c239770f14 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:49.423556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b720631-e671-4251-b719-10c239770f14 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:49.426420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b720631-e671-4251-b719-10c239770f14 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:49.472354 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4137/8267] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:49 2022] GET /identity/v3/users => generated 7507 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:49.477266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a970a1-2c10-4149-b296-fd2eeb219e70 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:49.477766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a970a1-2c10-4149-b296-fd2eeb219e70 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:49.477864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a970a1-2c10-4149-b296-fd2eeb219e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:49.556242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:49.571366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-00a970a1-2c10-4149-b296-fd2eeb219e70 None None] MFA Rules not processed for user `b00d703ad66e4ff192d46343fe3dd89a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:49.573494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-00a970a1-2c10-4149-b296-fd2eeb219e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:49.687382 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4131/8268] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:49 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:49.690222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a32ba-a911-4e38-a42e-7ea78c4f34f1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:49.691037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a32ba-a911-4e38-a42e-7ea78c4f34f1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:49.691412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a32ba-a911-4e38-a42e-7ea78c4f34f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:49.715460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-df0a32ba-a911-4e38-a42e-7ea78c4f34f1 None None] MFA Rules not processed for user `b00d703ad66e4ff192d46343fe3dd89a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:49.716866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-df0a32ba-a911-4e38-a42e-7ea78c4f34f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:49.730498 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4138/8269] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:49 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:49.732363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a970a1-2c10-4149-b296-fd2eeb219e70 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:49.742924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a970a1-2c10-4149-b296-fd2eeb219e70 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:49.749083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec60efc-1a22-4c25-9e05-d0c5541f3bc1 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b00d703ad66e4ff192d46343fe3dd89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bf7e5c262041a8ae08e606f9466f07', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-253246205', 'tempest-DelegatedRole-745977592'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:49.751079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec60efc-1a22-4c25-9e05-d0c5541f3bc1 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:49.751364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec60efc-1a22-4c25-9e05-d0c5541f3bc1 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:49.751642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec60efc-1a22-4c25-9e05-d0c5541f3bc1 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:49.752334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec60efc-1a22-4c25-9e05-d0c5541f3bc1 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] RBAC: Authorizing `identity:create_trust()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:49.753538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec60efc-1a22-4c25-9e05-d0c5541f3bc1 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:49.877421 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4132/8270] 10.222.0.70 () {60 vars in 1174 bytes} [Sun Aug 28 19:35:49 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:49.879280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a32ba-a911-4e38-a42e-7ea78c4f34f1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:49.893233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a32ba-a911-4e38-a42e-7ea78c4f34f1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:49.913685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ba398-796e-466b-9fb3-eb4fc5286745 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:49.914670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ba398-796e-466b-9fb3-eb4fc5286745 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:49.915230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ba398-796e-466b-9fb3-eb4fc5286745 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:49.915665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ba398-796e-466b-9fb3-eb4fc5286745 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:49.917021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ba398-796e-466b-9fb3-eb4fc5286745 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:49.918228 n-d-854118-7 devstack@keystone.service[88374]: WARNING py.warnings [None req-258ba398-796e-466b-9fb3-eb4fc5286745 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 19:35:49.918228 n-d-854118-7 devstack@keystone.service[88374]: warnings.warn(msg) Aug 28 19:35:49.918228 n-d-854118-7 devstack@keystone.service[88374]: Aug 28 19:35:49.919773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ba398-796e-466b-9fb3-eb4fc5286745 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:49.931265 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4139/8271] 10.222.0.70 () {58 vars in 1155 bytes} [Sun Aug 28 19:35:49 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:49.934081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec60efc-1a22-4c25-9e05-d0c5541f3bc1 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:49.950133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec60efc-1a22-4c25-9e05-d0c5541f3bc1 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:49.971573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a1cd-d710-49ed-ad30-8db8437c0f16 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b00d703ad66e4ff192d46343fe3dd89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bf7e5c262041a8ae08e606f9466f07', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-253246205', 'tempest-DelegatedRole-745977592'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:49.973050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a1cd-d710-49ed-ad30-8db8437c0f16 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:49.973499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a1cd-d710-49ed-ad30-8db8437c0f16 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:49.973921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090a1cd-d710-49ed-ad30-8db8437c0f16 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] PATH_INFO: `/v3/OS-TRUST/trusts/b0c7460236cd4bfba814003c133c0c78` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:49.990381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090a1cd-d710-49ed-ad30-8db8437c0f16 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] RBAC: Authorizing `identity:delete_trust(trust_id=b0c7460236cd4bfba814003c133c0c78)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:49.992054 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090a1cd-d710-49ed-ad30-8db8437c0f16 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:50.027464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a090a1cd-d710-49ed-ad30-8db8437c0f16 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'b0c7460236cd4bfba814003c133c0c78', 'request_id': 'req-a090a1cd-d710-49ed-ad30-8db8437c0f16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.046516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a090a1cd-d710-49ed-ad30-8db8437c0f16 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b0c7460236cd4bfba814003c133c0c78', 'request_id': 'req-a090a1cd-d710-49ed-ad30-8db8437c0f16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.047477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a090a1cd-d710-49ed-ad30-8db8437c0f16 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b0c7460236cd4bfba814003c133c0c78', 'request_id': 'req-a090a1cd-d710-49ed-ad30-8db8437c0f16'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.059650 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4133/8272] 10.222.0.70 () {58 vars in 1254 bytes} [Sun Aug 28 19:35:49 2022] DELETE /identity/v3/OS-TRUST/trusts/b0c7460236cd4bfba814003c133c0c78 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:50.060639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ba398-796e-466b-9fb3-eb4fc5286745 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:50.064226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-258ba398-796e-466b-9fb3-eb4fc5286745 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:50.081847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ba398-796e-466b-9fb3-eb4fc5286745 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:50.087754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa839193-c924-460d-addf-0a68e70c1b93 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b00d703ad66e4ff192d46343fe3dd89a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bf7e5c262041a8ae08e606f9466f07', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-253246205', 'tempest-DelegatedRole-745977592'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:50.089104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa839193-c924-460d-addf-0a68e70c1b93 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:50.089584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa839193-c924-460d-addf-0a68e70c1b93 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:50.089980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa839193-c924-460d-addf-0a68e70c1b93 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] PATH_INFO: `/v3/OS-TRUST/trusts/b0c7460236cd4bfba814003c133c0c78` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-fa839193-c924-460d-addf-0a68e70c1b93 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] Could not find trust: b0c7460236cd4bfba814003c133c0c78.: keystone.exception.TrustNotFound: Could not find trust: b0c7460236cd4bfba814003c133c0c78. Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 19:35:50.141350 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 19:35:50.142478 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 19:35:50.142478 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 19:35:50.142478 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 19:35:50.142478 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 19:35:50.142478 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 19:35:50.142478 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:35:50.142478 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:35:50.142478 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 19:35:50.142478 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 19:35:50.142478 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 19:35:50.142478 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 19:35:50.142478 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: b0c7460236cd4bfba814003c133c0c78. Aug 28 19:35:50.142478 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:50.143722 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4140/8273] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:35:50 2022] GET /identity/v3/OS-TRUST/trusts/b0c7460236cd4bfba814003c133c0c78 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 19:35:50.147374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a1cd-d710-49ed-ad30-8db8437c0f16 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:50.149571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a090a1cd-d710-49ed-ad30-8db8437c0f16 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:50.173791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090a1cd-d710-49ed-ad30-8db8437c0f16 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:50.179556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0b178-a5c6-42b0-8b74-46ad719bad52 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:50.180520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0b178-a5c6-42b0-8b74-46ad719bad52 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:50.180966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0b178-a5c6-42b0-8b74-46ad719bad52 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:50.181370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0b178-a5c6-42b0-8b74-46ad719bad52 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles/5cd4036366af45db9a32b11b4372e3a4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:50.183242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0b178-a5c6-42b0-8b74-46ad719bad52 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5cd4036366af45db9a32b11b4372e3a4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:50.185090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0b178-a5c6-42b0-8b74-46ad719bad52 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:50.244691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f7c0b178-a5c6-42b0-8b74-46ad719bad52 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invalidating the token cache because role 5cd4036366af45db9a32b11b4372e3a4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:50.245369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f7c0b178-a5c6-42b0-8b74-46ad719bad52 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.246039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f7c0b178-a5c6-42b0-8b74-46ad719bad52 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.248733 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4134/8274] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:50 2022] DELETE /identity/v3/roles/5cd4036366af45db9a32b11b4372e3a4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:50.253243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa839193-c924-460d-addf-0a68e70c1b93 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:50.254529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fa839193-c924-460d-addf-0a68e70c1b93 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:50.287662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa839193-c924-460d-addf-0a68e70c1b93 tempest-TrustsV3TestJSON-960476221 tempest-user-744176399] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:50.360044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:50.397160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d78b6-17c0-41c7-ba80-8ed78d0908e4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:50.398266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d78b6-17c0-41c7-ba80-8ed78d0908e4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:50.398764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d78b6-17c0-41c7-ba80-8ed78d0908e4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:50.399206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d78b6-17c0-41c7-ba80-8ed78d0908e4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles/ca3788bdaf96438a959eaa31150bfbd5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:50.402019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d78b6-17c0-41c7-ba80-8ed78d0908e4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ca3788bdaf96438a959eaa31150bfbd5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:50.403944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d78b6-17c0-41c7-ba80-8ed78d0908e4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:50.466172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-450d78b6-17c0-41c7-ba80-8ed78d0908e4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invalidating the token cache because role ca3788bdaf96438a959eaa31150bfbd5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:50.466769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-450d78b6-17c0-41c7-ba80-8ed78d0908e4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.467714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-450d78b6-17c0-41c7-ba80-8ed78d0908e4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.473915 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4141/8275] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:50 2022] DELETE /identity/v3/roles/ca3788bdaf96438a959eaa31150bfbd5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:50.474722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0b178-a5c6-42b0-8b74-46ad719bad52 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:50.488404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0b178-a5c6-42b0-8b74-46ad719bad52 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:50.502844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:50.588907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:50.590335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:50.591101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:50.591609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users/b00d703ad66e4ff192d46343fe3dd89a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:50.593163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b00d703ad66e4ff192d46343fe3dd89a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:50.595413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:50.658554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00d703ad66e4ff192d46343fe3dd89a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.669830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00d703ad66e4ff192d46343fe3dd89a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.670541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00d703ad66e4ff192d46343fe3dd89a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.683913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00d703ad66e4ff192d46343fe3dd89a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.685073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00d703ad66e4ff192d46343fe3dd89a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.696565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c419f-8bd7-48e3-8e0e-51e59be04286 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:50.696869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c419f-8bd7-48e3-8e0e-51e59be04286 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:50.697155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c419f-8bd7-48e3-8e0e-51e59be04286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:50.710598 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4135/8276] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:50 2022] DELETE /identity/v3/users/b00d703ad66e4ff192d46343fe3dd89a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:50.715587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:50.717451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:50.740983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-be2c419f-8bd7-48e3-8e0e-51e59be04286 None None] MFA Rules not processed for user `ba61631e54954118963170b67723d2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:50.742342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-be2c419f-8bd7-48e3-8e0e-51e59be04286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:50.814773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a82401-7c24-483e-9483-256dbe901bfb tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:50.821496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:50.822140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:50.822424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:50.822734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/33bf7e5c262041a8ae08e606f9466f07` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:50.823978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_project(project_id=33bf7e5c262041a8ae08e606f9466f07)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:50.826598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:50.845898 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4142/8277] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:50.846953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c419f-8bd7-48e3-8e0e-51e59be04286 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:50.848382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-be2c419f-8bd7-48e3-8e0e-51e59be04286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:50.915545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:50.942588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33bf7e5c262041a8ae08e606f9466f07', 'request_id': 'req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.962768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33bf7e5c262041a8ae08e606f9466f07', 'request_id': 'req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:50.963304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c419f-8bd7-48e3-8e0e-51e59be04286 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:50.970384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33bf7e5c262041a8ae08e606f9466f07', 'request_id': 'req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:51.018983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] The token cache is being invalidate because project 33bf7e5c262041a8ae08e606f9466f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:51.019364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:51.021409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:51.024945 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4136/8278] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:50 2022] DELETE /identity/v3/projects/33bf7e5c262041a8ae08e606f9466f07 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:51.038315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:51.045347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:51.071528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:51.092003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7fe11-b4fc-4946-bf4f-50f891288d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:51.092922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7fe11-b4fc-4946-bf4f-50f891288d1e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.093202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7fe11-b4fc-4946-bf4f-50f891288d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.093474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7fe11-b4fc-4946-bf4f-50f891288d1e admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:51.094111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7fe11-b4fc-4946-bf4f-50f891288d1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:51.096269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7fe11-b4fc-4946-bf4f-50f891288d1e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:51.132773 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4143/8279] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:35:50 2022] POST /identity/v3/projects => generated 381 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:51.137181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7fe11-b4fc-4946-bf4f-50f891288d1e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:51.138814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-aac7fe11-b4fc-4946-bf4f-50f891288d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:51.142635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957b9f8-4e9c-4629-83d2-0819bbdf8e4d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:51.219046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7fe11-b4fc-4946-bf4f-50f891288d1e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:51.220175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6dd2d-70a8-4ff7-b600-8c8dc380bcea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:51.221205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6dd2d-70a8-4ff7-b600-8c8dc380bcea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.221594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6dd2d-70a8-4ff7-b600-8c8dc380bcea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.221972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6dd2d-70a8-4ff7-b600-8c8dc380bcea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:51.222822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6dd2d-70a8-4ff7-b600-8c8dc380bcea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:51.224328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7d1a1-5ef5-4ab6-bab2-5a0363d0d925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:51.225000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7d1a1-5ef5-4ab6-bab2-5a0363d0d925 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.225141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6dd2d-70a8-4ff7-b600-8c8dc380bcea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:51.225286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7d1a1-5ef5-4ab6-bab2-5a0363d0d925 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.225562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7d1a1-5ef5-4ab6-bab2-5a0363d0d925 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:51.226213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7d1a1-5ef5-4ab6-bab2-5a0363d0d925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:51.228171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7d1a1-5ef5-4ab6-bab2-5a0363d0d925 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:51.261024 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4137/8280] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:35:51 2022] POST /identity/v3/projects => generated 329 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:51.261240 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4144/8281] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:51 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:51.262445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7d1a1-5ef5-4ab6-bab2-5a0363d0d925 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:51.263519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6dd2d-70a8-4ff7-b600-8c8dc380bcea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:51.277039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7d1a1-5ef5-4ab6-bab2-5a0363d0d925 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:51.352332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:51.354683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38f5c5-9da9-4161-8d44-c45a0d7c4d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:51.356518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38f5c5-9da9-4161-8d44-c45a0d7c4d02 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.357017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38f5c5-9da9-4161-8d44-c45a0d7c4d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.357629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38f5c5-9da9-4161-8d44-c45a0d7c4d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:51.358445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38f5c5-9da9-4161-8d44-c45a0d7c4d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:51.360479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38f5c5-9da9-4161-8d44-c45a0d7c4d02 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:51.382776 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4145/8282] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:51.387640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38f5c5-9da9-4161-8d44-c45a0d7c4d02 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:51.396076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6dd2d-70a8-4ff7-b600-8c8dc380bcea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:51.403724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bac04-5a2f-48af-a84a-dc488b7de5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:51.404363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bac04-5a2f-48af-a84a-dc488b7de5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.404701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bac04-5a2f-48af-a84a-dc488b7de5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.404986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bac04-5a2f-48af-a84a-dc488b7de5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:51.405715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bac04-5a2f-48af-a84a-dc488b7de5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:51.406372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38f5c5-9da9-4161-8d44-c45a0d7c4d02 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:51.407864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bac04-5a2f-48af-a84a-dc488b7de5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:51.414129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b49c3-7409-414b-aab3-054490558f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:51.414894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b49c3-7409-414b-aab3-054490558f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.415181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b49c3-7409-414b-aab3-054490558f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.415460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b49c3-7409-414b-aab3-054490558f4b admin admin] PATH_INFO: `/v3/projects/b5bc1d825bc54de395171548461a6117/users/5d80c6f836ab4b24ab4bf802d3dfd963/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:51.438254 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4138/8283] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:51 2022] POST /identity/v3/users => generated 413 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:51.438664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b49c3-7409-414b-aab3-054490558f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5bc1d825bc54de395171548461a6117, user_id=5d80c6f836ab4b24ab4bf802d3dfd963, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:51.442717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b49c3-7409-414b-aab3-054490558f4b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:51.443136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bac04-5a2f-48af-a84a-dc488b7de5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:51.457357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bac04-5a2f-48af-a84a-dc488b7de5f4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:51.467003 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4146/8284] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:51 2022] PUT /identity/v3/projects/b5bc1d825bc54de395171548461a6117/users/5d80c6f836ab4b24ab4bf802d3dfd963/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:51.467955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b49c3-7409-414b-aab3-054490558f4b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:51.511735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:51.525280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e044d6c-1b69-4dd9-af1c-c67d9c8ac8c0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:51.526873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e044d6c-1b69-4dd9-af1c-c67d9c8ac8c0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.527234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e044d6c-1b69-4dd9-af1c-c67d9c8ac8c0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.527521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e044d6c-1b69-4dd9-af1c-c67d9c8ac8c0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:51.528193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e044d6c-1b69-4dd9-af1c-c67d9c8ac8c0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:51.529797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e044d6c-1b69-4dd9-af1c-c67d9c8ac8c0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:51.546505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b49c3-7409-414b-aab3-054490558f4b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:51.548326 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4139/8285] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:35:51 2022] POST /identity/v3/roles => generated 244 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:51.552004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e044d6c-1b69-4dd9-af1c-c67d9c8ac8c0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:51.552147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad2f01-b706-416a-8604-e40f5160e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:51.552789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad2f01-b706-416a-8604-e40f5160e75a admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.553130 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad2f01-b706-416a-8604-e40f5160e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.553469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad2f01-b706-416a-8604-e40f5160e75a admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:51.554179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad2f01-b706-416a-8604-e40f5160e75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:51.555894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad2f01-b706-416a-8604-e40f5160e75a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:51.564059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e044d6c-1b69-4dd9-af1c-c67d9c8ac8c0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:51.569018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053c254-2f00-4334-9154-1043c4f837e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:51.569861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053c254-2f00-4334-9154-1043c4f837e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.569979 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4147/8286] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:51 2022] GET /identity/v3/roles => generated 1655 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:51.570066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053c254-2f00-4334-9154-1043c4f837e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.570175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053c254-2f00-4334-9154-1043c4f837e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:51.570863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053c254-2f00-4334-9154-1043c4f837e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:51.572449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053c254-2f00-4334-9154-1043c4f837e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:51.573956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad2f01-b706-416a-8604-e40f5160e75a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:51.590122 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4140/8287] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:35:51 2022] POST /identity/v3/roles => generated 247 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:51.592896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad2f01-b706-416a-8604-e40f5160e75a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:51.594375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053c254-2f00-4334-9154-1043c4f837e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:51.598451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a316434-0cf0-4d42-8556-4cabb3da3d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:51.599227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a316434-0cf0-4d42-8556-4cabb3da3d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.599548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a316434-0cf0-4d42-8556-4cabb3da3d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.603001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a316434-0cf0-4d42-8556-4cabb3da3d21 admin admin] PATH_INFO: `/v3/projects/b5bc1d825bc54de395171548461a6117/users/5d80c6f836ab4b24ab4bf802d3dfd963/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:51.605636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a316434-0cf0-4d42-8556-4cabb3da3d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5bc1d825bc54de395171548461a6117, user_id=5d80c6f836ab4b24ab4bf802d3dfd963, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:51.608394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a316434-0cf0-4d42-8556-4cabb3da3d21 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:51.608979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053c254-2f00-4334-9154-1043c4f837e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:51.614548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da28bcf-63f1-4f3b-aecb-9d2a3aa4d48c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:51.615296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da28bcf-63f1-4f3b-aecb-9d2a3aa4d48c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.615573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da28bcf-63f1-4f3b-aecb-9d2a3aa4d48c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.615859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da28bcf-63f1-4f3b-aecb-9d2a3aa4d48c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/1bcd83a3a816465e956de8ec4930792a/users/e568a927019c45778f25c96e4e7babcc/roles/8caf38ba1bf946d2b58797e07bdf3200` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:51.620450 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4148/8288] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:51 2022] PUT /identity/v3/projects/b5bc1d825bc54de395171548461a6117/users/5d80c6f836ab4b24ab4bf802d3dfd963/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:51.633664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da28bcf-63f1-4f3b-aecb-9d2a3aa4d48c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1bcd83a3a816465e956de8ec4930792a, user_id=e568a927019c45778f25c96e4e7babcc, role_id=8caf38ba1bf946d2b58797e07bdf3200)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:51.636856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da28bcf-63f1-4f3b-aecb-9d2a3aa4d48c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:51.652578 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4141/8289] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:51 2022] PUT /identity/v3/projects/1bcd83a3a816465e956de8ec4930792a/users/e568a927019c45778f25c96e4e7babcc/roles/8caf38ba1bf946d2b58797e07bdf3200 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:51.656992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a316434-0cf0-4d42-8556-4cabb3da3d21 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:51.739879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a316434-0cf0-4d42-8556-4cabb3da3d21 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:51.808731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeed5e5-d9e8-4609-a26e-95437f00e0af tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:51.809598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeed5e5-d9e8-4609-a26e-95437f00e0af tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.809754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeed5e5-d9e8-4609-a26e-95437f00e0af tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.813605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeed5e5-d9e8-4609-a26e-95437f00e0af tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/1bcd83a3a816465e956de8ec4930792a/users/e568a927019c45778f25c96e4e7babcc/roles/f2fd85b739ee4c548ecf67fbbeef9e4b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:51.817382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeed5e5-d9e8-4609-a26e-95437f00e0af tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1bcd83a3a816465e956de8ec4930792a, user_id=e568a927019c45778f25c96e4e7babcc, role_id=f2fd85b739ee4c548ecf67fbbeef9e4b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:51.821018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeed5e5-d9e8-4609-a26e-95437f00e0af tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:51.837978 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4149/8290] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:51 2022] PUT /identity/v3/projects/1bcd83a3a816465e956de8ec4930792a/users/e568a927019c45778f25c96e4e7babcc/roles/f2fd85b739ee4c548ecf67fbbeef9e4b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:51.842914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da28bcf-63f1-4f3b-aecb-9d2a3aa4d48c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:51.855604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da28bcf-63f1-4f3b-aecb-9d2a3aa4d48c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:51.920970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f503a5-704f-4fe1-808c-18a559ff13ea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:51.922274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f503a5-704f-4fe1-808c-18a559ff13ea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.922274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f503a5-704f-4fe1-808c-18a559ff13ea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.922274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f503a5-704f-4fe1-808c-18a559ff13ea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:51.923007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f503a5-704f-4fe1-808c-18a559ff13ea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:51.924962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f503a5-704f-4fe1-808c-18a559ff13ea tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:51.966105 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4142/8291] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:51 2022] GET /identity/v3/users => generated 7795 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:51.971728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda3867-8ad8-4e4e-b249-eb9f039dd9e9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:51.972236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda3867-8ad8-4e4e-b249-eb9f039dd9e9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:51.972592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda3867-8ad8-4e4e-b249-eb9f039dd9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:52.019148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6bda3867-8ad8-4e4e-b249-eb9f039dd9e9 None None] MFA Rules not processed for user `e568a927019c45778f25c96e4e7babcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:52.020295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6bda3867-8ad8-4e4e-b249-eb9f039dd9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:52.071932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:52.122459 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4150/8292] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:35:52.133610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1954d-4b89-4ec3-87f4-c3bd2d7cec3c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:52.133610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1954d-4b89-4ec3-87f4-c3bd2d7cec3c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:52.133912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1954d-4b89-4ec3-87f4-c3bd2d7cec3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:52.139230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64836f2-f486-4a99-9727-48f7b5da8dee None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:52.140325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64836f2-f486-4a99-9727-48f7b5da8dee None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:52.140681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64836f2-f486-4a99-9727-48f7b5da8dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:52.154785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8ec1954d-4b89-4ec3-87f4-c3bd2d7cec3c None None] MFA Rules not processed for user `30add6fc24b34085b5eaac8df54c424f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:52.156069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8ec1954d-4b89-4ec3-87f4-c3bd2d7cec3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:52.172275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a64836f2-f486-4a99-9727-48f7b5da8dee None None] MFA Rules not processed for user `e568a927019c45778f25c96e4e7babcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:52.174061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a64836f2-f486-4a99-9727-48f7b5da8dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:52.186971 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4151/8293] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:52.190920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:52.191534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64836f2-f486-4a99-9727-48f7b5da8dee None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:52.208349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64836f2-f486-4a99-9727-48f7b5da8dee None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:52.214016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e81eb-4c39-4d7d-8a85-4df6bc0f736f tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568a927019c45778f25c96e4e7babcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bcd83a3a816465e956de8ec4930792a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1413510261', 'tempest-DelegatedRole-1560745261'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:52.215298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e81eb-4c39-4d7d-8a85-4df6bc0f736f tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:52.215583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e81eb-4c39-4d7d-8a85-4df6bc0f736f tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:52.216131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e81eb-4c39-4d7d-8a85-4df6bc0f736f tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:52.216753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e81eb-4c39-4d7d-8a85-4df6bc0f736f tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] RBAC: Authorizing `identity:create_trust()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:52.218484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e81eb-4c39-4d7d-8a85-4df6bc0f736f tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:52.247731 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4143/8294] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:52.344001 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4152/8295] 10.222.0.70 () {60 vars in 1174 bytes} [Sun Aug 28 19:35:52 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:52.348311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1954d-4b89-4ec3-87f4-c3bd2d7cec3c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:52.368373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1954d-4b89-4ec3-87f4-c3bd2d7cec3c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:52.376443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d8b52-63f7-4fb1-9c3a-52c9f8f85ab5 tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568a927019c45778f25c96e4e7babcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bcd83a3a816465e956de8ec4930792a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1413510261', 'tempest-DelegatedRole-1560745261'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:52.377540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d8b52-63f7-4fb1-9c3a-52c9f8f85ab5 tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:52.378082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d8b52-63f7-4fb1-9c3a-52c9f8f85ab5 tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:52.378959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d8b52-63f7-4fb1-9c3a-52c9f8f85ab5 tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:52.380117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d8b52-63f7-4fb1-9c3a-52c9f8f85ab5 tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:52.381851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d8b52-63f7-4fb1-9c3a-52c9f8f85ab5 tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:52.397506 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4144/8296] 10.222.0.70 () {58 vars in 1252 bytes} [Sun Aug 28 19:35:52 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=e568a927019c45778f25c96e4e7babcc => generated 611 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:52.397956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e81eb-4c39-4d7d-8a85-4df6bc0f736f tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:52.409272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e81eb-4c39-4d7d-8a85-4df6bc0f736f tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:52.414736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d9b92-33fe-4892-ad72-c4e24561654c tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568a927019c45778f25c96e4e7babcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bcd83a3a816465e956de8ec4930792a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1413510261', 'tempest-DelegatedRole-1560745261'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:52.416209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d9b92-33fe-4892-ad72-c4e24561654c tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:52.416209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d9b92-33fe-4892-ad72-c4e24561654c tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:52.416209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d9b92-33fe-4892-ad72-c4e24561654c tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] PATH_INFO: `/v3/OS-TRUST/trusts/2ed41f5f4d71420ebf4e1a02497db6ce` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:52.427000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d9b92-33fe-4892-ad72-c4e24561654c tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] RBAC: Authorizing `identity:delete_trust(trust_id=2ed41f5f4d71420ebf4e1a02497db6ce)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:52.428628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d9b92-33fe-4892-ad72-c4e24561654c tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:52.464468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-337d9b92-33fe-4892-ad72-c4e24561654c tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '2ed41f5f4d71420ebf4e1a02497db6ce', 'request_id': 'req-337d9b92-33fe-4892-ad72-c4e24561654c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:52.465528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-337d9b92-33fe-4892-ad72-c4e24561654c tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '2ed41f5f4d71420ebf4e1a02497db6ce', 'request_id': 'req-337d9b92-33fe-4892-ad72-c4e24561654c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:52.478620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-337d9b92-33fe-4892-ad72-c4e24561654c tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '2ed41f5f4d71420ebf4e1a02497db6ce', 'request_id': 'req-337d9b92-33fe-4892-ad72-c4e24561654c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:52.489650 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4153/8297] 10.222.0.70 () {58 vars in 1254 bytes} [Sun Aug 28 19:35:52 2022] DELETE /identity/v3/OS-TRUST/trusts/2ed41f5f4d71420ebf4e1a02497db6ce => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:52.494038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d8b52-63f7-4fb1-9c3a-52c9f8f85ab5 tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:52.496946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f80d8b52-63f7-4fb1-9c3a-52c9f8f85ab5 tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:52.512370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d8b52-63f7-4fb1-9c3a-52c9f8f85ab5 tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:52.518915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75ba23-8132-4410-b790-94720b89209a tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e568a927019c45778f25c96e4e7babcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bcd83a3a816465e956de8ec4930792a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1413510261', 'tempest-DelegatedRole-1560745261'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:52.520044 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75ba23-8132-4410-b790-94720b89209a tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:52.520935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75ba23-8132-4410-b790-94720b89209a tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:52.521372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75ba23-8132-4410-b790-94720b89209a tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] PATH_INFO: `/v3/OS-TRUST/trusts/2ed41f5f4d71420ebf4e1a02497db6ce` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-ff75ba23-8132-4410-b790-94720b89209a tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Could not find trust: 2ed41f5f4d71420ebf4e1a02497db6ce.: keystone.exception.TrustNotFound: Could not find trust: 2ed41f5f4d71420ebf4e1a02497db6ce. Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 19:35:52.534139 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 19:35:52.535865 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 19:35:52.535865 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 19:35:52.535865 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 19:35:52.535865 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 19:35:52.535865 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 19:35:52.535865 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:35:52.535865 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:35:52.535865 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 19:35:52.535865 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 19:35:52.535865 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 19:35:52.535865 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 19:35:52.535865 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 2ed41f5f4d71420ebf4e1a02497db6ce. Aug 28 19:35:52.535865 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:52.541933 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4145/8298] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:35:52 2022] GET /identity/v3/OS-TRUST/trusts/2ed41f5f4d71420ebf4e1a02497db6ce => generated 111 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:35:52.543371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d9b92-33fe-4892-ad72-c4e24561654c tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:52.544949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-337d9b92-33fe-4892-ad72-c4e24561654c tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:52.587704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d9b92-33fe-4892-ad72-c4e24561654c tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:52.594617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363e954-b8fe-495d-a73c-dffb293f7308 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:52.595327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363e954-b8fe-495d-a73c-dffb293f7308 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:52.595623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363e954-b8fe-495d-a73c-dffb293f7308 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:52.595913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363e954-b8fe-495d-a73c-dffb293f7308 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles/f2fd85b739ee4c548ecf67fbbeef9e4b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:52.598563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363e954-b8fe-495d-a73c-dffb293f7308 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f2fd85b739ee4c548ecf67fbbeef9e4b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:52.599995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363e954-b8fe-495d-a73c-dffb293f7308 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:52.653727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a363e954-b8fe-495d-a73c-dffb293f7308 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invalidating the token cache because role f2fd85b739ee4c548ecf67fbbeef9e4b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:52.654085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a363e954-b8fe-495d-a73c-dffb293f7308 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:52.655156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a363e954-b8fe-495d-a73c-dffb293f7308 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:52.658048 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4154/8299] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:52 2022] DELETE /identity/v3/roles/f2fd85b739ee4c548ecf67fbbeef9e4b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:52.662456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75ba23-8132-4410-b790-94720b89209a tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:52.664414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ff75ba23-8132-4410-b790-94720b89209a tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:52.696216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75ba23-8132-4410-b790-94720b89209a tempest-TrustsV3TestJSON-1977956933 tempest-user-702221868] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:52.766142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c57c7-3cc1-42cf-a55a-ca41c698fd37 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:52.766970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c57c7-3cc1-42cf-a55a-ca41c698fd37 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:52.767260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c57c7-3cc1-42cf-a55a-ca41c698fd37 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:52.767544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c57c7-3cc1-42cf-a55a-ca41c698fd37 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles/8caf38ba1bf946d2b58797e07bdf3200` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:52.769422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c57c7-3cc1-42cf-a55a-ca41c698fd37 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8caf38ba1bf946d2b58797e07bdf3200)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:52.771804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c57c7-3cc1-42cf-a55a-ca41c698fd37 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:52.835376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4f1c57c7-3cc1-42cf-a55a-ca41c698fd37 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invalidating the token cache because role 8caf38ba1bf946d2b58797e07bdf3200 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:52.835798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4f1c57c7-3cc1-42cf-a55a-ca41c698fd37 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:52.836857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4f1c57c7-3cc1-42cf-a55a-ca41c698fd37 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:52.847902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363e954-b8fe-495d-a73c-dffb293f7308 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:52.848091 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4146/8300] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:52 2022] DELETE /identity/v3/roles/8caf38ba1bf946d2b58797e07bdf3200 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:52.863060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363e954-b8fe-495d-a73c-dffb293f7308 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:52.919347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:52.982198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:52.982979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:52.983209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:52.983495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users/e568a927019c45778f25c96e4e7babcc` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:52.985642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e568a927019c45778f25c96e4e7babcc)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:52.987316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:53.065452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e568a927019c45778f25c96e4e7babcc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:53.075033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e568a927019c45778f25c96e4e7babcc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:53.076029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e568a927019c45778f25c96e4e7babcc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:53.098328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e568a927019c45778f25c96e4e7babcc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:53.099278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e568a927019c45778f25c96e4e7babcc'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:53.122167 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4155/8301] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:52 2022] DELETE /identity/v3/users/e568a927019c45778f25c96e4e7babcc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:53.126220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c57c7-3cc1-42cf-a55a-ca41c698fd37 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:53.127762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4f1c57c7-3cc1-42cf-a55a-ca41c698fd37 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:53.142730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c57c7-3cc1-42cf-a55a-ca41c698fd37 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:53.236220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:53.237678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:53.238075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:53.238963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/1bcd83a3a816465e956de8ec4930792a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:53.244016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1bcd83a3a816465e956de8ec4930792a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:53.246912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:53.274614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:53.324679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bcd83a3a816465e956de8ec4930792a', 'request_id': 'req-23b20ad9-a894-4088-a34b-0fb0099a05d2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:53.340659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bcd83a3a816465e956de8ec4930792a', 'request_id': 'req-23b20ad9-a894-4088-a34b-0fb0099a05d2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:53.352892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bcd83a3a816465e956de8ec4930792a', 'request_id': 'req-23b20ad9-a894-4088-a34b-0fb0099a05d2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:53.390660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] The token cache is being invalidate because project 1bcd83a3a816465e956de8ec4930792a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:53.390929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:53.391625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:53.393502 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4147/8302] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:53 2022] DELETE /identity/v3/projects/1bcd83a3a816465e956de8ec4930792a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:53.399298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:53.400842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:53.424158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a8d3c-8e98-484e-af61-555e4cdf3e32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:53.512362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cb378-538e-4fa9-a55c-d2c743ffda7f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:53.513092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cb378-538e-4fa9-a55c-d2c743ffda7f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:53.513455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cb378-538e-4fa9-a55c-d2c743ffda7f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:53.513805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cb378-538e-4fa9-a55c-d2c743ffda7f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:53.514779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cb378-538e-4fa9-a55c-d2c743ffda7f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:53.516551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cb378-538e-4fa9-a55c-d2c743ffda7f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:53.555265 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4156/8303] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:35:53 2022] POST /identity/v3/projects => generated 328 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:53.560221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:53.561668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:53.576531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b20ad9-a894-4088-a34b-0fb0099a05d2 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:53.649591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ff7a3-a7a1-47cd-80dd-10896d8b1fc5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:53.650268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ff7a3-a7a1-47cd-80dd-10896d8b1fc5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:53.650553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ff7a3-a7a1-47cd-80dd-10896d8b1fc5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:53.651386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ff7a3-a7a1-47cd-80dd-10896d8b1fc5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:53.652038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ff7a3-a7a1-47cd-80dd-10896d8b1fc5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:53.654513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ff7a3-a7a1-47cd-80dd-10896d8b1fc5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:53.715367 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4148/8304] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:53 2022] POST /identity/v3/users => generated 416 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:53.717110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cb378-538e-4fa9-a55c-d2c743ffda7f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:53.738591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cb378-538e-4fa9-a55c-d2c743ffda7f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:53.750444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144258ab-f87a-41d7-bba7-b5e66d377df4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:53.751783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144258ab-f87a-41d7-bba7-b5e66d377df4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:53.752282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144258ab-f87a-41d7-bba7-b5e66d377df4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:53.752756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144258ab-f87a-41d7-bba7-b5e66d377df4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:53.753858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144258ab-f87a-41d7-bba7-b5e66d377df4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:53.757878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144258ab-f87a-41d7-bba7-b5e66d377df4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:53.790708 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4157/8305] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:35:53 2022] POST /identity/v3/roles => generated 243 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:53.795405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ff7a3-a7a1-47cd-80dd-10896d8b1fc5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:53.811967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ff7a3-a7a1-47cd-80dd-10896d8b1fc5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:53.819540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5990a4-30c8-4411-a426-93f0ca9a8342 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:53.820837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5990a4-30c8-4411-a426-93f0ca9a8342 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:53.821205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5990a4-30c8-4411-a426-93f0ca9a8342 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:53.821553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5990a4-30c8-4411-a426-93f0ca9a8342 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:53.823253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5990a4-30c8-4411-a426-93f0ca9a8342 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:53.825157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5990a4-30c8-4411-a426-93f0ca9a8342 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:53.852781 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4149/8306] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:35:53 2022] POST /identity/v3/roles => generated 247 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:53.857808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144258ab-f87a-41d7-bba7-b5e66d377df4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:53.871691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144258ab-f87a-41d7-bba7-b5e66d377df4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:53.876956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f31b18-1e1a-41bc-832c-04847f784e26 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:53.878050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f31b18-1e1a-41bc-832c-04847f784e26 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:53.878407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f31b18-1e1a-41bc-832c-04847f784e26 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:53.879321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f31b18-1e1a-41bc-832c-04847f784e26 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/9866ad8ef42c4130a4c6e56d7c554de8/users/aebfdd4abba9434f81eadea7005a044f/roles/5989b01d440e415cbce7ab114bf662a8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:53.912374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f31b18-1e1a-41bc-832c-04847f784e26 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9866ad8ef42c4130a4c6e56d7c554de8, user_id=aebfdd4abba9434f81eadea7005a044f, role_id=5989b01d440e415cbce7ab114bf662a8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:53.916293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f31b18-1e1a-41bc-832c-04847f784e26 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:53.936564 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4158/8307] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:53 2022] PUT /identity/v3/projects/9866ad8ef42c4130a4c6e56d7c554de8/users/aebfdd4abba9434f81eadea7005a044f/roles/5989b01d440e415cbce7ab114bf662a8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:53.941777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5990a4-30c8-4411-a426-93f0ca9a8342 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:53.956658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5990a4-30c8-4411-a426-93f0ca9a8342 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:54.063593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d1eb7-9b54-47d3-b651-94596a9fc4d7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:54.065051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d1eb7-9b54-47d3-b651-94596a9fc4d7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:54.065497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d1eb7-9b54-47d3-b651-94596a9fc4d7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:54.066081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d1eb7-9b54-47d3-b651-94596a9fc4d7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/9866ad8ef42c4130a4c6e56d7c554de8/users/aebfdd4abba9434f81eadea7005a044f/roles/a2e4333d493e43d3942a6720248e362d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:54.068992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d1eb7-9b54-47d3-b651-94596a9fc4d7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9866ad8ef42c4130a4c6e56d7c554de8, user_id=aebfdd4abba9434f81eadea7005a044f, role_id=a2e4333d493e43d3942a6720248e362d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:54.072370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d1eb7-9b54-47d3-b651-94596a9fc4d7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:54.103367 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4150/8308] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:53 2022] PUT /identity/v3/projects/9866ad8ef42c4130a4c6e56d7c554de8/users/aebfdd4abba9434f81eadea7005a044f/roles/a2e4333d493e43d3942a6720248e362d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:54.105058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f31b18-1e1a-41bc-832c-04847f784e26 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:54.126833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f31b18-1e1a-41bc-832c-04847f784e26 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:54.148480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:54.261169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e62b6-46bf-4dce-8474-b36094704d1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:54.262241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e62b6-46bf-4dce-8474-b36094704d1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:54.263316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e62b6-46bf-4dce-8474-b36094704d1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:54.263823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e62b6-46bf-4dce-8474-b36094704d1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:54.264748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e62b6-46bf-4dce-8474-b36094704d1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:54.266873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e62b6-46bf-4dce-8474-b36094704d1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:54.317968 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4159/8309] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:54 2022] GET /identity/v3/users => generated 7798 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:54.331239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7884bf-64e2-4210-a6f3-1b602a381fb4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:54.331532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7884bf-64e2-4210-a6f3-1b602a381fb4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:54.331811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7884bf-64e2-4210-a6f3-1b602a381fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:54.409156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:54.450925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5a7884bf-64e2-4210-a6f3-1b602a381fb4 None None] MFA Rules not processed for user `aebfdd4abba9434f81eadea7005a044f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:54.452243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5a7884bf-64e2-4210-a6f3-1b602a381fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:54.571241 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4151/8310] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:54 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:54.579905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0653d9-d13d-4a54-a54a-97c3d2424f67 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:54.580385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0653d9-d13d-4a54-a54a-97c3d2424f67 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:54.580770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0653d9-d13d-4a54-a54a-97c3d2424f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:54.631612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-fa0653d9-d13d-4a54-a54a-97c3d2424f67 None None] MFA Rules not processed for user `aebfdd4abba9434f81eadea7005a044f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:54.636683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fa0653d9-d13d-4a54-a54a-97c3d2424f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:54.660631 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4160/8311] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:54 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:54.661870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7884bf-64e2-4210-a6f3-1b602a381fb4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:54.674420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7884bf-64e2-4210-a6f3-1b602a381fb4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:54.691825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e9e66-0673-4d03-80b1-70faa5638501 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebfdd4abba9434f81eadea7005a044f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9866ad8ef42c4130a4c6e56d7c554de8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1541787021', 'tempest-DelegatedRole-122013795'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:54.692536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e9e66-0673-4d03-80b1-70faa5638501 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:54.693174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e9e66-0673-4d03-80b1-70faa5638501 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:54.693525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e9e66-0673-4d03-80b1-70faa5638501 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:54.694283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e9e66-0673-4d03-80b1-70faa5638501 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorizing `identity:create_trust()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:54.710970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e9e66-0673-4d03-80b1-70faa5638501 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:54.878608 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4152/8312] 10.222.0.70 () {60 vars in 1174 bytes} [Sun Aug 28 19:35:54 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:54.883437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0653d9-d13d-4a54-a54a-97c3d2424f67 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:54.894979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0653d9-d13d-4a54-a54a-97c3d2424f67 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:54.913593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05b1b9-b991-46c1-a644-a89bc75b069f tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebfdd4abba9434f81eadea7005a044f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9866ad8ef42c4130a4c6e56d7c554de8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1541787021', 'tempest-DelegatedRole-122013795'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:54.914462 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05b1b9-b991-46c1-a644-a89bc75b069f tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:54.915015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05b1b9-b991-46c1-a644-a89bc75b069f tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:54.915450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05b1b9-b991-46c1-a644-a89bc75b069f tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] PATH_INFO: `/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:54.939618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05b1b9-b991-46c1-a644-a89bc75b069f tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorizing `identity:get_trust(trust_id=55b218556d7b430481668c8687f37892)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:54.941377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05b1b9-b991-46c1-a644-a89bc75b069f tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:54.957599 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4161/8313] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:35:54 2022] GET /identity/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892 => generated 858 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:54.961604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e9e66-0673-4d03-80b1-70faa5638501 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:54.977235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e9e66-0673-4d03-80b1-70faa5638501 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:54.993307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d639c-2799-4679-b7df-1e0404830d95 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebfdd4abba9434f81eadea7005a044f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9866ad8ef42c4130a4c6e56d7c554de8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1541787021', 'tempest-DelegatedRole-122013795'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:54.993969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d639c-2799-4679-b7df-1e0404830d95 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:54.994251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d639c-2799-4679-b7df-1e0404830d95 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:54.995317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d639c-2799-4679-b7df-1e0404830d95 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] PATH_INFO: `/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:55.014944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d639c-2799-4679-b7df-1e0404830d95 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=55b218556d7b430481668c8687f37892)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:55.015996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d639c-2799-4679-b7df-1e0404830d95 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:55.034095 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4153/8314] 10.222.0.70 () {58 vars in 1269 bytes} [Sun Aug 28 19:35:54 2022] GET /identity/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892/roles => generated 370 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:55.038616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05b1b9-b991-46c1-a644-a89bc75b069f tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:55.066510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05b1b9-b991-46c1-a644-a89bc75b069f tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:55.078581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdbc6a-6378-4948-a12d-8ceb70e60d6c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebfdd4abba9434f81eadea7005a044f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9866ad8ef42c4130a4c6e56d7c554de8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1541787021', 'tempest-DelegatedRole-122013795'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:55.079595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdbc6a-6378-4948-a12d-8ceb70e60d6c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:55.080371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdbc6a-6378-4948-a12d-8ceb70e60d6c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:55.080790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdbc6a-6378-4948-a12d-8ceb70e60d6c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] PATH_INFO: `/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892/roles/5989b01d440e415cbce7ab114bf662a8` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:55.090099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdbc6a-6378-4948-a12d-8ceb70e60d6c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorizing `identity:get_role_for_trust(trust_id=55b218556d7b430481668c8687f37892, role_id=5989b01d440e415cbce7ab114bf662a8)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:55.091875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdbc6a-6378-4948-a12d-8ceb70e60d6c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:55.123106 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4162/8315] 10.222.0.70 () {58 vars in 1368 bytes} [Sun Aug 28 19:35:55 2022] GET /identity/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892/roles/5989b01d440e415cbce7ab114bf662a8 => generated 243 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:35:55.124067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d639c-2799-4679-b7df-1e0404830d95 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:55.143800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d639c-2799-4679-b7df-1e0404830d95 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:55.151771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a143e-1ecf-4b95-ba2f-bdc162d66448 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebfdd4abba9434f81eadea7005a044f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9866ad8ef42c4130a4c6e56d7c554de8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1541787021', 'tempest-DelegatedRole-122013795'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:55.152464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a143e-1ecf-4b95-ba2f-bdc162d66448 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:55.152751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a143e-1ecf-4b95-ba2f-bdc162d66448 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:55.153040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a143e-1ecf-4b95-ba2f-bdc162d66448 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] PATH_INFO: `/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892/roles/5989b01d440e415cbce7ab114bf662a8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:55.172857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a143e-1ecf-4b95-ba2f-bdc162d66448 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorizing `identity:get_role_for_trust(trust_id=55b218556d7b430481668c8687f37892, role_id=5989b01d440e415cbce7ab114bf662a8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:55.174711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a143e-1ecf-4b95-ba2f-bdc162d66448 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:55.196346 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4154/8316] 10.222.0.70 () {58 vars in 1369 bytes} [Sun Aug 28 19:35:55 2022] HEAD /identity/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892/roles/5989b01d440e415cbce7ab114bf662a8 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 28 19:35:55.196874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdbc6a-6378-4948-a12d-8ceb70e60d6c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:55.210417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdbc6a-6378-4948-a12d-8ceb70e60d6c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:55.224335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237ca47-eac7-4c51-ac97-991ea0d9d099 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebfdd4abba9434f81eadea7005a044f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9866ad8ef42c4130a4c6e56d7c554de8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1541787021', 'tempest-DelegatedRole-122013795'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:55.225310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237ca47-eac7-4c51-ac97-991ea0d9d099 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:55.225592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237ca47-eac7-4c51-ac97-991ea0d9d099 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:55.225870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237ca47-eac7-4c51-ac97-991ea0d9d099 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] PATH_INFO: `/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892/roles/a2e4333d493e43d3942a6720248e362d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:55.243030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237ca47-eac7-4c51-ac97-991ea0d9d099 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorizing `identity:get_role_for_trust(trust_id=55b218556d7b430481668c8687f37892, role_id=a2e4333d493e43d3942a6720248e362d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:55.245598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237ca47-eac7-4c51-ac97-991ea0d9d099 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-1237ca47-eac7-4c51-ac97-991ea0d9d099 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Could not find role: a2e4333d493e43d3942a6720248e362d.: keystone.exception.RoleNotFound: Could not find role: a2e4333d493e43d3942a6720248e362d. Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:35:55.267080 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a2e4333d493e43d3942a6720248e362d. Aug 28 19:35:55.271419 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:35:55.272297 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4163/8317] 10.222.0.70 () {58 vars in 1368 bytes} [Sun Aug 28 19:35:55 2022] GET /identity/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892/roles/a2e4333d493e43d3942a6720248e362d => generated 110 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:35:55.273525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a143e-1ecf-4b95-ba2f-bdc162d66448 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:55.294020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a143e-1ecf-4b95-ba2f-bdc162d66448 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:55.306530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a231d3-0700-41d9-86d9-a494dcc85b90 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebfdd4abba9434f81eadea7005a044f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9866ad8ef42c4130a4c6e56d7c554de8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1541787021', 'tempest-DelegatedRole-122013795'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:55.307211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a231d3-0700-41d9-86d9-a494dcc85b90 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:55.307626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a231d3-0700-41d9-86d9-a494dcc85b90 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:55.307775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a231d3-0700-41d9-86d9-a494dcc85b90 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] PATH_INFO: `/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892/roles/a2e4333d493e43d3942a6720248e362d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:55.330638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a231d3-0700-41d9-86d9-a494dcc85b90 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorizing `identity:get_role_for_trust(trust_id=55b218556d7b430481668c8687f37892, role_id=a2e4333d493e43d3942a6720248e362d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:55.343424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a231d3-0700-41d9-86d9-a494dcc85b90 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-50a231d3-0700-41d9-86d9-a494dcc85b90 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Could not find role: a2e4333d493e43d3942a6720248e362d.: keystone.exception.RoleNotFound: Could not find role: a2e4333d493e43d3942a6720248e362d. Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:35:55.379661 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a2e4333d493e43d3942a6720248e362d. Aug 28 19:35:55.380733 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:55.381088 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4155/8318] 10.222.0.70 () {58 vars in 1369 bytes} [Sun Aug 28 19:35:55 2022] HEAD /identity/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892/roles/a2e4333d493e43d3942a6720248e362d => generated 0 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 28 19:35:55.386358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237ca47-eac7-4c51-ac97-991ea0d9d099 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:55.406558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237ca47-eac7-4c51-ac97-991ea0d9d099 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:55.417178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81298cad-b422-475e-8f84-ae362cf6b162 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebfdd4abba9434f81eadea7005a044f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9866ad8ef42c4130a4c6e56d7c554de8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1541787021', 'tempest-DelegatedRole-122013795'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:55.417761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81298cad-b422-475e-8f84-ae362cf6b162 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:55.418134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81298cad-b422-475e-8f84-ae362cf6b162 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:55.418421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81298cad-b422-475e-8f84-ae362cf6b162 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] PATH_INFO: `/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:55.431457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81298cad-b422-475e-8f84-ae362cf6b162 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorizing `identity:delete_trust(trust_id=55b218556d7b430481668c8687f37892)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:55.441939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81298cad-b422-475e-8f84-ae362cf6b162 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:55.470889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-81298cad-b422-475e-8f84-ae362cf6b162 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '55b218556d7b430481668c8687f37892', 'request_id': 'req-81298cad-b422-475e-8f84-ae362cf6b162'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:55.471888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-81298cad-b422-475e-8f84-ae362cf6b162 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '55b218556d7b430481668c8687f37892', 'request_id': 'req-81298cad-b422-475e-8f84-ae362cf6b162'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:55.503160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-81298cad-b422-475e-8f84-ae362cf6b162 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '55b218556d7b430481668c8687f37892', 'request_id': 'req-81298cad-b422-475e-8f84-ae362cf6b162'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:55.513263 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4164/8319] 10.222.0.70 () {58 vars in 1254 bytes} [Sun Aug 28 19:35:55 2022] DELETE /identity/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:55.519317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a231d3-0700-41d9-86d9-a494dcc85b90 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:55.521322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-50a231d3-0700-41d9-86d9-a494dcc85b90 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:55.549112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a231d3-0700-41d9-86d9-a494dcc85b90 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:55.564880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019607-40bd-4813-8a63-fc2b474e8d9c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebfdd4abba9434f81eadea7005a044f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9866ad8ef42c4130a4c6e56d7c554de8', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1541787021', 'tempest-DelegatedRole-122013795'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:55.564880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019607-40bd-4813-8a63-fc2b474e8d9c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:55.564880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019607-40bd-4813-8a63-fc2b474e8d9c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:55.565267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019607-40bd-4813-8a63-fc2b474e8d9c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] PATH_INFO: `/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-c1019607-40bd-4813-8a63-fc2b474e8d9c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Could not find trust: 55b218556d7b430481668c8687f37892.: keystone.exception.TrustNotFound: Could not find trust: 55b218556d7b430481668c8687f37892. Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 19:35:55.586360 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 19:35:55.588048 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 19:35:55.588048 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 19:35:55.588048 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 19:35:55.588048 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 19:35:55.588048 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 19:35:55.588048 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:35:55.588048 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:35:55.588048 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 19:35:55.588048 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 19:35:55.588048 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 19:35:55.588048 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 19:35:55.588048 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 55b218556d7b430481668c8687f37892. Aug 28 19:35:55.588048 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:55.591010 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4156/8320] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:35:55 2022] GET /identity/v3/OS-TRUST/trusts/55b218556d7b430481668c8687f37892 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:35:55.595163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81298cad-b422-475e-8f84-ae362cf6b162 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:55.596822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-81298cad-b422-475e-8f84-ae362cf6b162 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:55.639650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81298cad-b422-475e-8f84-ae362cf6b162 tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:55.653579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593b267-bd49-4d6c-bd7b-c1a26271b419 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:55.654298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b267-bd49-4d6c-bd7b-c1a26271b419 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:55.654586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b267-bd49-4d6c-bd7b-c1a26271b419 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:55.654890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b267-bd49-4d6c-bd7b-c1a26271b419 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles/a2e4333d493e43d3942a6720248e362d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:55.659001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593b267-bd49-4d6c-bd7b-c1a26271b419 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a2e4333d493e43d3942a6720248e362d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:55.660920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593b267-bd49-4d6c-bd7b-c1a26271b419 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:55.750134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8593b267-bd49-4d6c-bd7b-c1a26271b419 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invalidating the token cache because role a2e4333d493e43d3942a6720248e362d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:55.750441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8593b267-bd49-4d6c-bd7b-c1a26271b419 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:55.752129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-8593b267-bd49-4d6c-bd7b-c1a26271b419 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:55.757057 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4165/8321] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:55 2022] DELETE /identity/v3/roles/a2e4333d493e43d3942a6720248e362d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:55.762704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019607-40bd-4813-8a63-fc2b474e8d9c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:55.764635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c1019607-40bd-4813-8a63-fc2b474e8d9c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:55.817202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019607-40bd-4813-8a63-fc2b474e8d9c tempest-TrustsV3TestJSON-353617286 tempest-user-1245697780] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:55.869318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:55.969060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89949a62-3987-4ed0-9be2-98785eb6a1e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:55.969733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89949a62-3987-4ed0-9be2-98785eb6a1e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:55.970020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89949a62-3987-4ed0-9be2-98785eb6a1e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:55.970298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89949a62-3987-4ed0-9be2-98785eb6a1e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles/5989b01d440e415cbce7ab114bf662a8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:55.972779 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89949a62-3987-4ed0-9be2-98785eb6a1e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5989b01d440e415cbce7ab114bf662a8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:55.974409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89949a62-3987-4ed0-9be2-98785eb6a1e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:56.075132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-89949a62-3987-4ed0-9be2-98785eb6a1e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invalidating the token cache because role 5989b01d440e415cbce7ab114bf662a8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:56.075474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-89949a62-3987-4ed0-9be2-98785eb6a1e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:56.076718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-89949a62-3987-4ed0-9be2-98785eb6a1e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:56.080066 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4157/8322] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:55 2022] DELETE /identity/v3/roles/5989b01d440e415cbce7ab114bf662a8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:56.084288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593b267-bd49-4d6c-bd7b-c1a26271b419 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:56.098517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593b267-bd49-4d6c-bd7b-c1a26271b419 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:56.142035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:56.270647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:56.273564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:56.273807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:56.275251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users/aebfdd4abba9434f81eadea7005a044f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:56.280764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_user(user_id=aebfdd4abba9434f81eadea7005a044f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:56.288177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:56.396647 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aebfdd4abba9434f81eadea7005a044f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:56.412769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aebfdd4abba9434f81eadea7005a044f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:56.414029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aebfdd4abba9434f81eadea7005a044f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:56.441146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aebfdd4abba9434f81eadea7005a044f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:56.445759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aebfdd4abba9434f81eadea7005a044f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:56.476436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4166/8323] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:56 2022] DELETE /identity/v3/users/aebfdd4abba9434f81eadea7005a044f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:56.483128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89949a62-3987-4ed0-9be2-98785eb6a1e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:56.486089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-89949a62-3987-4ed0-9be2-98785eb6a1e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:56.505576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89949a62-3987-4ed0-9be2-98785eb6a1e7 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:56.647327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:56.647994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:56.648281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:56.648561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/9866ad8ef42c4130a4c6e56d7c554de8` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:56.651414 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9866ad8ef42c4130a4c6e56d7c554de8)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:56.653402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:56.777375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9866ad8ef42c4130a4c6e56d7c554de8', 'request_id': 'req-90e41e9d-2be2-4f84-b445-46144b556558'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:56.784823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9866ad8ef42c4130a4c6e56d7c554de8', 'request_id': 'req-90e41e9d-2be2-4f84-b445-46144b556558'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:56.802313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9866ad8ef42c4130a4c6e56d7c554de8', 'request_id': 'req-90e41e9d-2be2-4f84-b445-46144b556558'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:56.829078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] The token cache is being invalidate because project 9866ad8ef42c4130a4c6e56d7c554de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:56.829730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:56.830119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:56.832276 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4158/8324] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:56 2022] DELETE /identity/v3/projects/9866ad8ef42c4130a4c6e56d7c554de8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:56.838106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:56.840415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:56.860759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90727585-40e8-4174-8135-7f65f8c9279c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:56.950235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06d096-aec3-4d8b-9819-b65a082869b3 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:56.950688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06d096-aec3-4d8b-9819-b65a082869b3 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:56.952694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06d096-aec3-4d8b-9819-b65a082869b3 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:56.953299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06d096-aec3-4d8b-9819-b65a082869b3 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:56.954342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06d096-aec3-4d8b-9819-b65a082869b3 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:56.958285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06d096-aec3-4d8b-9819-b65a082869b3 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:57.022297 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4167/8325] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:35:56 2022] POST /identity/v3/projects => generated 328 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:57.022675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:57.024210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:57.043098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e41e9d-2be2-4f84-b445-46144b556558 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:57.071403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:57.208947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f455464-e198-44fd-ac61-603036497617 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:57.209594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f455464-e198-44fd-ac61-603036497617 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:57.209897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f455464-e198-44fd-ac61-603036497617 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:57.210180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f455464-e198-44fd-ac61-603036497617 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:57.214457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f455464-e198-44fd-ac61-603036497617 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:57.218867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f455464-e198-44fd-ac61-603036497617 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:57.259701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06d096-aec3-4d8b-9819-b65a082869b3 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:57.271767 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4159/8326] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:57 2022] POST /identity/v3/users => generated 413 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:57.274645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06d096-aec3-4d8b-9819-b65a082869b3 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:57.282988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02875850-f1e7-4313-a6a0-da60b5aae8b1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:57.283705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02875850-f1e7-4313-a6a0-da60b5aae8b1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:57.283999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02875850-f1e7-4313-a6a0-da60b5aae8b1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:57.284282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02875850-f1e7-4313-a6a0-da60b5aae8b1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:57.284969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02875850-f1e7-4313-a6a0-da60b5aae8b1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:57.286903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02875850-f1e7-4313-a6a0-da60b5aae8b1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:57.319967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f455464-e198-44fd-ac61-603036497617 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:57.320434 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4168/8327] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:35:57 2022] POST /identity/v3/roles => generated 243 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:57.333877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f455464-e198-44fd-ac61-603036497617 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:57.340363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bea7e-b902-43d0-ac94-f3f0d45dcbd9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:57.340997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bea7e-b902-43d0-ac94-f3f0d45dcbd9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:57.341287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bea7e-b902-43d0-ac94-f3f0d45dcbd9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:57.341565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bea7e-b902-43d0-ac94-f3f0d45dcbd9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:57.342239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bea7e-b902-43d0-ac94-f3f0d45dcbd9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:57.344638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bea7e-b902-43d0-ac94-f3f0d45dcbd9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:57.366786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02875850-f1e7-4313-a6a0-da60b5aae8b1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:57.377261 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4160/8328] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:35:57 2022] POST /identity/v3/roles => generated 246 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:57.380212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02875850-f1e7-4313-a6a0-da60b5aae8b1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:57.386287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d7fbc-79b7-45c5-9bcc-397cf1841855 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:57.387126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d7fbc-79b7-45c5-9bcc-397cf1841855 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:57.423664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d7fbc-79b7-45c5-9bcc-397cf1841855 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:57.424077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d7fbc-79b7-45c5-9bcc-397cf1841855 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/1fb2662b48544bbb962f1f1561f11868/users/0227a083bba94a7c9fff510d36c5f0c9/roles/bbc97bf752d34a28ac588b2063401f4c` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:57.465183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:57.474480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d7fbc-79b7-45c5-9bcc-397cf1841855 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1fb2662b48544bbb962f1f1561f11868, user_id=0227a083bba94a7c9fff510d36c5f0c9, role_id=bbc97bf752d34a28ac588b2063401f4c)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:57.479020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d7fbc-79b7-45c5-9bcc-397cf1841855 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:57.532463 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4169/8329] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:57 2022] PUT /identity/v3/projects/1fb2662b48544bbb962f1f1561f11868/users/0227a083bba94a7c9fff510d36c5f0c9/roles/bbc97bf752d34a28ac588b2063401f4c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:57.533805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bea7e-b902-43d0-ac94-f3f0d45dcbd9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:57.549816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bea7e-b902-43d0-ac94-f3f0d45dcbd9 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:57.687982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579a22f-1176-444e-9257-0aea4f8a0aa0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:57.689453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579a22f-1176-444e-9257-0aea4f8a0aa0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:57.689900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579a22f-1176-444e-9257-0aea4f8a0aa0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:57.690335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579a22f-1176-444e-9257-0aea4f8a0aa0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/1fb2662b48544bbb962f1f1561f11868/users/0227a083bba94a7c9fff510d36c5f0c9/roles/422f1f1718b64f77a1a6bf5c3a478427` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:57.693557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579a22f-1176-444e-9257-0aea4f8a0aa0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1fb2662b48544bbb962f1f1561f11868, user_id=0227a083bba94a7c9fff510d36c5f0c9, role_id=422f1f1718b64f77a1a6bf5c3a478427)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:57.696821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579a22f-1176-444e-9257-0aea4f8a0aa0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:57.746430 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4161/8330] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:57 2022] PUT /identity/v3/projects/1fb2662b48544bbb962f1f1561f11868/users/0227a083bba94a7c9fff510d36c5f0c9/roles/422f1f1718b64f77a1a6bf5c3a478427 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:57.750078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d7fbc-79b7-45c5-9bcc-397cf1841855 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:57.765717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d7fbc-79b7-45c5-9bcc-397cf1841855 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:57.893103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b393a-d945-4843-badc-e8d426c7c4e5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:57.893750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b393a-d945-4843-badc-e8d426c7c4e5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:57.894155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b393a-d945-4843-badc-e8d426c7c4e5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:57.894444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b393a-d945-4843-badc-e8d426c7c4e5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:57.895175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b393a-d945-4843-badc-e8d426c7c4e5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:57.897100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b393a-d945-4843-badc-e8d426c7c4e5 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:57.935695 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4170/8331] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:35:57 2022] GET /identity/v3/users => generated 7795 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:35:57.940622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b5e7-b071-4a06-bb95-76a4b37b7c18 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:57.941318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b5e7-b071-4a06-bb95-76a4b37b7c18 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:57.941875 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b5e7-b071-4a06-bb95-76a4b37b7c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:58.012733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8bc4b5e7-b071-4a06-bb95-76a4b37b7c18 None None] MFA Rules not processed for user `0227a083bba94a7c9fff510d36c5f0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:58.014532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8bc4b5e7-b071-4a06-bb95-76a4b37b7c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:58.114796 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4162/8332] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:57 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:58.116588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70bb1d-66d3-452f-917b-f545426876d2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:58.116881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70bb1d-66d3-452f-917b-f545426876d2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:58.117157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70bb1d-66d3-452f-917b-f545426876d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:58.138124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9f70bb1d-66d3-452f-917b-f545426876d2 None None] MFA Rules not processed for user `0227a083bba94a7c9fff510d36c5f0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:58.139365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9f70bb1d-66d3-452f-917b-f545426876d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:58.150582 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4171/8333] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:58 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:35:58.152359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4b5e7-b071-4a06-bb95-76a4b37b7c18 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:58.161823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4b5e7-b071-4a06-bb95-76a4b37b7c18 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:58.176297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43da11e-49b4-4fcf-92b3-164d613aec78 tempest-TrustsV3TestJSON-289055573 tempest-user-620469155] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0227a083bba94a7c9fff510d36c5f0c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fb2662b48544bbb962f1f1561f11868', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-152839272', 'tempest-DelegatedRole-184736349'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:58.177878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43da11e-49b4-4fcf-92b3-164d613aec78 tempest-TrustsV3TestJSON-289055573 tempest-user-620469155] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:58.178362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43da11e-49b4-4fcf-92b3-164d613aec78 tempest-TrustsV3TestJSON-289055573 tempest-user-620469155] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:58.179197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43da11e-49b4-4fcf-92b3-164d613aec78 tempest-TrustsV3TestJSON-289055573 tempest-user-620469155] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:58.180568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43da11e-49b4-4fcf-92b3-164d613aec78 tempest-TrustsV3TestJSON-289055573 tempest-user-620469155] RBAC: Authorizing `identity:create_trust()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:58.183397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43da11e-49b4-4fcf-92b3-164d613aec78 tempest-TrustsV3TestJSON-289055573 tempest-user-620469155] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:58.193375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-e43da11e-49b4-4fcf-92b3-164d613aec78 tempest-TrustsV3TestJSON-289055573 tempest-user-620469155] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Aug 28 19:35:58.306430 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise ValueError(str(e)) Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Aug 28 19:35:58.307622 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Aug 28 19:35:58.308819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Aug 28 19:35:58.308819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Aug 28 19:35:58.308819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Aug 28 19:35:58.308819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Aug 28 19:35:58.308819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 28 19:35:58.308819 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:35:58.313086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70bb1d-66d3-452f-917b-f545426876d2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:58.324799 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4163/8334] 10.222.0.70 () {60 vars in 1174 bytes} [Sun Aug 28 19:35:58 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 173 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 28 19:35:58.344755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70bb1d-66d3-452f-917b-f545426876d2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:58.349858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ee411-c4ca-418b-993c-28e201e3aa1c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:58.350577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ee411-c4ca-418b-993c-28e201e3aa1c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:58.350976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ee411-c4ca-418b-993c-28e201e3aa1c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:58.351575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ee411-c4ca-418b-993c-28e201e3aa1c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles/422f1f1718b64f77a1a6bf5c3a478427` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:58.353257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ee411-c4ca-418b-993c-28e201e3aa1c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_role(role_id=422f1f1718b64f77a1a6bf5c3a478427)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:58.356063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ee411-c4ca-418b-993c-28e201e3aa1c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:58.410242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0d8ee411-c4ca-418b-993c-28e201e3aa1c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invalidating the token cache because role 422f1f1718b64f77a1a6bf5c3a478427 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:58.410535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0d8ee411-c4ca-418b-993c-28e201e3aa1c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:58.411760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0d8ee411-c4ca-418b-993c-28e201e3aa1c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:58.413634 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4172/8335] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:58 2022] DELETE /identity/v3/roles/422f1f1718b64f77a1a6bf5c3a478427 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:58.418449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43da11e-49b4-4fcf-92b3-164d613aec78 tempest-TrustsV3TestJSON-289055573 tempest-user-620469155] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:58.420300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e43da11e-49b4-4fcf-92b3-164d613aec78 tempest-TrustsV3TestJSON-289055573 tempest-user-620469155] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:58.455952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43da11e-49b4-4fcf-92b3-164d613aec78 tempest-TrustsV3TestJSON-289055573 tempest-user-620469155] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:58.553960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d01130-b3ba-4aab-b6c4-2a1d8b6dbd1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:58.554616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01130-b3ba-4aab-b6c4-2a1d8b6dbd1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:58.554954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01130-b3ba-4aab-b6c4-2a1d8b6dbd1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:58.555238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01130-b3ba-4aab-b6c4-2a1d8b6dbd1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles/bbc97bf752d34a28ac588b2063401f4c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:58.556667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d01130-b3ba-4aab-b6c4-2a1d8b6dbd1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bbc97bf752d34a28ac588b2063401f4c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:58.558483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d01130-b3ba-4aab-b6c4-2a1d8b6dbd1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:58.608672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4d01130-b3ba-4aab-b6c4-2a1d8b6dbd1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invalidating the token cache because role bbc97bf752d34a28ac588b2063401f4c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:58.609020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4d01130-b3ba-4aab-b6c4-2a1d8b6dbd1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:58.609673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e4d01130-b3ba-4aab-b6c4-2a1d8b6dbd1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:58.612744 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4164/8336] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:58 2022] DELETE /identity/v3/roles/bbc97bf752d34a28ac588b2063401f4c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:35:58.623064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ee411-c4ca-418b-993c-28e201e3aa1c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:58.638364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ee411-c4ca-418b-993c-28e201e3aa1c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:58.710105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:58.711097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:58.711524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:58.712211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users/0227a083bba94a7c9fff510d36c5f0c9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:58.713918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0227a083bba94a7c9fff510d36c5f0c9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:58.716334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:58.789643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:58.813209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0227a083bba94a7c9fff510d36c5f0c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:58.824786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0227a083bba94a7c9fff510d36c5f0c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:58.825544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0227a083bba94a7c9fff510d36c5f0c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:58.843670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0227a083bba94a7c9fff510d36c5f0c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:58.844744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0227a083bba94a7c9fff510d36c5f0c9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:58.882860 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4173/8337] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:35:58 2022] DELETE /identity/v3/users/0227a083bba94a7c9fff510d36c5f0c9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:58.886980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d01130-b3ba-4aab-b6c4-2a1d8b6dbd1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:58.890233 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e4d01130-b3ba-4aab-b6c4-2a1d8b6dbd1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:58.908161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d01130-b3ba-4aab-b6c4-2a1d8b6dbd1e tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:58.993216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:58.993851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:58.994137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:58.994953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/1fb2662b48544bbb962f1f1561f11868` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:58.996220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1fb2662b48544bbb962f1f1561f11868)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:58.998367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:59.050255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:59.096395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb2662b48544bbb962f1f1561f11868', 'request_id': 'req-9f87712b-08ef-48c1-b617-3fc0b714fe9a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:59.116063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb2662b48544bbb962f1f1561f11868', 'request_id': 'req-9f87712b-08ef-48c1-b617-3fc0b714fe9a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:59.125379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb2662b48544bbb962f1f1561f11868', 'request_id': 'req-9f87712b-08ef-48c1-b617-3fc0b714fe9a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:59.147657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] The token cache is being invalidate because project 1fb2662b48544bbb962f1f1561f11868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:35:59.148030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:59.148624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:35:59.155827 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4165/8338] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:35:58 2022] DELETE /identity/v3/projects/1fb2662b48544bbb962f1f1561f11868 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:59.156419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:59.158008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:59.179363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920381c-a86a-4523-b5f4-7535ae589735 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:59.324689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748917-d24d-4864-a004-a923e76fabe1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:59.327133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748917-d24d-4864-a004-a923e76fabe1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:59.327593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748917-d24d-4864-a004-a923e76fabe1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:59.328249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748917-d24d-4864-a004-a923e76fabe1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:59.329532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18748917-d24d-4864-a004-a923e76fabe1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:59.331848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18748917-d24d-4864-a004-a923e76fabe1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:59.423099 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4174/8339] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:35:59 2022] POST /identity/v3/projects => generated 328 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:59.427170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:59.428896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:59.467051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87712b-08ef-48c1-b617-3fc0b714fe9a tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:59.574688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a22dd-9312-4abb-8e0c-e024a9f380ba tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:59.579678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a22dd-9312-4abb-8e0c-e024a9f380ba tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:59.580181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a22dd-9312-4abb-8e0c-e024a9f380ba tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:59.580541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a22dd-9312-4abb-8e0c-e024a9f380ba tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:59.581522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a22dd-9312-4abb-8e0c-e024a9f380ba tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:59.583642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a22dd-9312-4abb-8e0c-e024a9f380ba tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:59.623153 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4166/8340] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:35:59 2022] POST /identity/v3/users => generated 413 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:59.626866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748917-d24d-4864-a004-a923e76fabe1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:59.643583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed26f74-eb2f-49c5-8a34-5cf8134c3cf8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:59.643871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed26f74-eb2f-49c5-8a34-5cf8134c3cf8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:59.644147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed26f74-eb2f-49c5-8a34-5cf8134c3cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:59.648752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748917-d24d-4864-a004-a923e76fabe1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:59.656239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d11718-ac60-4903-a39a-0e087284f965 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:59.657069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d11718-ac60-4903-a39a-0e087284f965 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:59.657472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d11718-ac60-4903-a39a-0e087284f965 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:59.657849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d11718-ac60-4903-a39a-0e087284f965 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:59.658677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d11718-ac60-4903-a39a-0e087284f965 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:59.660569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d11718-ac60-4903-a39a-0e087284f965 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:59.676294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3ed26f74-eb2f-49c5-8a34-5cf8134c3cf8 None None] MFA Rules not processed for user `5d80c6f836ab4b24ab4bf802d3dfd963`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:35:59.677663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ed26f74-eb2f-49c5-8a34-5cf8134c3cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:59.686394 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4175/8341] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:35:59 2022] POST /identity/v3/roles => generated 243 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:35:59.687789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d11718-ac60-4903-a39a-0e087284f965 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:59.714995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d11718-ac60-4903-a39a-0e087284f965 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:59.721704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a243fb4-18c9-47a4-8eb2-e811690bef8f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:59.722478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a243fb4-18c9-47a4-8eb2-e811690bef8f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:59.723187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a243fb4-18c9-47a4-8eb2-e811690bef8f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:59.723659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a243fb4-18c9-47a4-8eb2-e811690bef8f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:59.724905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a243fb4-18c9-47a4-8eb2-e811690bef8f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:59.726688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a243fb4-18c9-47a4-8eb2-e811690bef8f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:59.782662 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4176/8342] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:35:59 2022] POST /identity/v3/roles => generated 247 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:35:59.788099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a243fb4-18c9-47a4-8eb2-e811690bef8f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:59.800545 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4167/8343] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:35:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:35:59.809840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed26f74-eb2f-49c5-8a34-5cf8134c3cf8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:59.812290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3ed26f74-eb2f-49c5-8a34-5cf8134c3cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:35:59.817205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a243fb4-18c9-47a4-8eb2-e811690bef8f tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:59.829868 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813ed4f-e727-4017-b156-48d9c21f1939 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:59.831412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813ed4f-e727-4017-b156-48d9c21f1939 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:59.832423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813ed4f-e727-4017-b156-48d9c21f1939 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:59.833261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813ed4f-e727-4017-b156-48d9c21f1939 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/a62a57d7c0f447b4809b25ef1404a56c/users/0b30ffd032e94bd4838b6a0f6b8df677/roles/6bbc571f21d04c7d85d3d2cb0cdfed33` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:59.849811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:59.860949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813ed4f-e727-4017-b156-48d9c21f1939 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a62a57d7c0f447b4809b25ef1404a56c, user_id=0b30ffd032e94bd4838b6a0f6b8df677, role_id=6bbc571f21d04c7d85d3d2cb0cdfed33)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:35:59.866073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813ed4f-e727-4017-b156-48d9c21f1939 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:35:59.891708 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4177/8344] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:59 2022] PUT /identity/v3/projects/a62a57d7c0f447b4809b25ef1404a56c/users/0b30ffd032e94bd4838b6a0f6b8df677/roles/6bbc571f21d04c7d85d3d2cb0cdfed33 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:35:59.892560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813ed4f-e727-4017-b156-48d9c21f1939 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:35:59.907957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed26f74-eb2f-49c5-8a34-5cf8134c3cf8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:35:59.989069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:35:59.992072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac20421-a1fc-4f98-a6f5-435fa21acd80 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:35:59.992884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac20421-a1fc-4f98-a6f5-435fa21acd80 service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:35:59.993184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac20421-a1fc-4f98-a6f5-435fa21acd80 service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:35:59.993449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac20421-a1fc-4f98-a6f5-435fa21acd80 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:35:59.996695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bac20421-a1fc-4f98-a6f5-435fa21acd80 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:00.006502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813ed4f-e727-4017-b156-48d9c21f1939 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:00.015016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90d2ee-168a-48fa-8c39-0f8920494021 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:00.017220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90d2ee-168a-48fa-8c39-0f8920494021 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:00.017515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90d2ee-168a-48fa-8c39-0f8920494021 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:00.017799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90d2ee-168a-48fa-8c39-0f8920494021 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/a62a57d7c0f447b4809b25ef1404a56c/users/0b30ffd032e94bd4838b6a0f6b8df677/roles/b2d8876e24124563982725452be3a858` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:00.020440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90d2ee-168a-48fa-8c39-0f8920494021 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a62a57d7c0f447b4809b25ef1404a56c, user_id=0b30ffd032e94bd4838b6a0f6b8df677, role_id=b2d8876e24124563982725452be3a858)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:00.024547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90d2ee-168a-48fa-8c39-0f8920494021 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:00.044311 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4178/8345] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:35:59 2022] PUT /identity/v3/projects/a62a57d7c0f447b4809b25ef1404a56c/users/0b30ffd032e94bd4838b6a0f6b8df677/roles/b2d8876e24124563982725452be3a858 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:00.049186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90d2ee-168a-48fa-8c39-0f8920494021 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:00.078841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac20421-a1fc-4f98-a6f5-435fa21acd80 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:00.080433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac20421-a1fc-4f98-a6f5-435fa21acd80 service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:00.092596 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4168/8346] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:35:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:36:00.145280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90d2ee-168a-48fa-8c39-0f8920494021 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:00.152697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e7d39-daa2-43e4-8807-a19938965e98 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:00.152925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e7d39-daa2-43e4-8807-a19938965e98 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:00.153291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e7d39-daa2-43e4-8807-a19938965e98 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:00.153650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e7d39-daa2-43e4-8807-a19938965e98 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:00.154402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e7d39-daa2-43e4-8807-a19938965e98 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:00.156429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e7d39-daa2-43e4-8807-a19938965e98 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:00.212438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9519a7-5571-4158-a7f5-768925b5d53c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:00.212731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9519a7-5571-4158-a7f5-768925b5d53c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:00.213020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9519a7-5571-4158-a7f5-768925b5d53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:00.227086 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4179/8347] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:00 2022] GET /identity/v3/users => generated 7795 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:36:00.343974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6d9519a7-5571-4158-a7f5-768925b5d53c None None] MFA Rules not processed for user `0b30ffd032e94bd4838b6a0f6b8df677`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:00.345410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6d9519a7-5571-4158-a7f5-768925b5d53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:00.484015 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4169/8348] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:00.486140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d801dec-641a-4f0a-b994-ecb780d8cd92 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:00.486637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d801dec-641a-4f0a-b994-ecb780d8cd92 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:00.486735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d801dec-641a-4f0a-b994-ecb780d8cd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:00.520703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7d801dec-641a-4f0a-b994-ecb780d8cd92 None None] MFA Rules not processed for user `0b30ffd032e94bd4838b6a0f6b8df677`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:00.523582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7d801dec-641a-4f0a-b994-ecb780d8cd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:00.536281 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4180/8349] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:00.540603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9519a7-5571-4158-a7f5-768925b5d53c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:00.557383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9519a7-5571-4158-a7f5-768925b5d53c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:00.571563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cdba1-e284-406b-b945-b0a9be46488e tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30ffd032e94bd4838b6a0f6b8df677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62a57d7c0f447b4809b25ef1404a56c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1843410011', 'tempest-DelegatedRole-544973948'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:00.572247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cdba1-e284-406b-b945-b0a9be46488e tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:00.572561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cdba1-e284-406b-b945-b0a9be46488e tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:00.572959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cdba1-e284-406b-b945-b0a9be46488e tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:00.574221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cdba1-e284-406b-b945-b0a9be46488e tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorizing `identity:create_trust()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:00.576581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cdba1-e284-406b-b945-b0a9be46488e tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:00.581961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:00.687325 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4170/8350] 10.222.0.70 () {60 vars in 1174 bytes} [Sun Aug 28 19:36:00 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:36:00.688945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d801dec-641a-4f0a-b994-ecb780d8cd92 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:00.704667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d801dec-641a-4f0a-b994-ecb780d8cd92 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:00.712734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92277f-ba8a-4877-891a-ac6afde1a13d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30ffd032e94bd4838b6a0f6b8df677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62a57d7c0f447b4809b25ef1404a56c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1843410011', 'tempest-DelegatedRole-544973948'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:00.714295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92277f-ba8a-4877-891a-ac6afde1a13d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:00.714591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92277f-ba8a-4877-891a-ac6afde1a13d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:00.715065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92277f-ba8a-4877-891a-ac6afde1a13d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] PATH_INFO: `/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:00.722506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92277f-ba8a-4877-891a-ac6afde1a13d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorizing `identity:get_trust(trust_id=3f93604367744790bfe4382b6def1ece)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:00.724324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92277f-ba8a-4877-891a-ac6afde1a13d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:00.737703 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4181/8351] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:36:00 2022] GET /identity/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece => generated 833 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:00.738913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cdba1-e284-406b-b945-b0a9be46488e tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:00.751686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cdba1-e284-406b-b945-b0a9be46488e tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:00.769928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29915223-8cd1-4a5c-8dcc-99255516298d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30ffd032e94bd4838b6a0f6b8df677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62a57d7c0f447b4809b25ef1404a56c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1843410011', 'tempest-DelegatedRole-544973948'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:00.770828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29915223-8cd1-4a5c-8dcc-99255516298d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:00.771296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29915223-8cd1-4a5c-8dcc-99255516298d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:00.771739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29915223-8cd1-4a5c-8dcc-99255516298d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] PATH_INFO: `/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:00.790088 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29915223-8cd1-4a5c-8dcc-99255516298d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=3f93604367744790bfe4382b6def1ece)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:00.794655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29915223-8cd1-4a5c-8dcc-99255516298d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:00.814797 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4171/8352] 10.222.0.70 () {58 vars in 1269 bytes} [Sun Aug 28 19:36:00 2022] GET /identity/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece/roles => generated 370 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:36:00.816288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92277f-ba8a-4877-891a-ac6afde1a13d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:00.832838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92277f-ba8a-4877-891a-ac6afde1a13d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:00.848622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77c0c5-75f1-4690-ba54-cbc077436b88 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30ffd032e94bd4838b6a0f6b8df677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62a57d7c0f447b4809b25ef1404a56c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1843410011', 'tempest-DelegatedRole-544973948'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:00.849564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c0c5-75f1-4690-ba54-cbc077436b88 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:00.850440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c0c5-75f1-4690-ba54-cbc077436b88 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:00.850766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77c0c5-75f1-4690-ba54-cbc077436b88 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] PATH_INFO: `/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece/roles/6bbc571f21d04c7d85d3d2cb0cdfed33` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:00.873400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77c0c5-75f1-4690-ba54-cbc077436b88 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorizing `identity:get_role_for_trust(trust_id=3f93604367744790bfe4382b6def1ece, role_id=6bbc571f21d04c7d85d3d2cb0cdfed33)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:00.874988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77c0c5-75f1-4690-ba54-cbc077436b88 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:00.904840 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4182/8353] 10.222.0.70 () {58 vars in 1368 bytes} [Sun Aug 28 19:36:00 2022] GET /identity/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece/roles/6bbc571f21d04c7d85d3d2cb0cdfed33 => generated 243 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:00.908372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29915223-8cd1-4a5c-8dcc-99255516298d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:00.926907 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29915223-8cd1-4a5c-8dcc-99255516298d tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:00.937871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd016476-eff1-40ac-98f7-e748df4efdf8 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30ffd032e94bd4838b6a0f6b8df677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62a57d7c0f447b4809b25ef1404a56c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1843410011', 'tempest-DelegatedRole-544973948'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:00.939637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016476-eff1-40ac-98f7-e748df4efdf8 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:00.940765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016476-eff1-40ac-98f7-e748df4efdf8 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:00.941352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016476-eff1-40ac-98f7-e748df4efdf8 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] PATH_INFO: `/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece/roles/6bbc571f21d04c7d85d3d2cb0cdfed33` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:00.960721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd016476-eff1-40ac-98f7-e748df4efdf8 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorizing `identity:get_role_for_trust(trust_id=3f93604367744790bfe4382b6def1ece, role_id=6bbc571f21d04c7d85d3d2cb0cdfed33)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:00.964909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd016476-eff1-40ac-98f7-e748df4efdf8 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:00.985049 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4172/8354] 10.222.0.70 () {58 vars in 1369 bytes} [Sun Aug 28 19:36:00 2022] HEAD /identity/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece/roles/6bbc571f21d04c7d85d3d2cb0cdfed33 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:00.992073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77c0c5-75f1-4690-ba54-cbc077436b88 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:01.004197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77c0c5-75f1-4690-ba54-cbc077436b88 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:01.010452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d865ed1-ac06-4687-ba14-3c7b8d3ff162 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30ffd032e94bd4838b6a0f6b8df677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62a57d7c0f447b4809b25ef1404a56c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1843410011', 'tempest-DelegatedRole-544973948'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:01.011779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d865ed1-ac06-4687-ba14-3c7b8d3ff162 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:01.012269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d865ed1-ac06-4687-ba14-3c7b8d3ff162 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:01.012619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d865ed1-ac06-4687-ba14-3c7b8d3ff162 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] PATH_INFO: `/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece/roles/b2d8876e24124563982725452be3a858` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:01.020884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d865ed1-ac06-4687-ba14-3c7b8d3ff162 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorizing `identity:get_role_for_trust(trust_id=3f93604367744790bfe4382b6def1ece, role_id=b2d8876e24124563982725452be3a858)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:01.022880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d865ed1-ac06-4687-ba14-3c7b8d3ff162 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-0d865ed1-ac06-4687-ba14-3c7b8d3ff162 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Could not find role: b2d8876e24124563982725452be3a858.: keystone.exception.RoleNotFound: Could not find role: b2d8876e24124563982725452be3a858. Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:36:01.037507 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b2d8876e24124563982725452be3a858. Aug 28 19:36:01.038593 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:36:01.040530 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4183/8355] 10.222.0.70 () {58 vars in 1368 bytes} [Sun Aug 28 19:36:00 2022] GET /identity/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece/roles/b2d8876e24124563982725452be3a858 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:36:01.045479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd016476-eff1-40ac-98f7-e748df4efdf8 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:01.070051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd016476-eff1-40ac-98f7-e748df4efdf8 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:01.082783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81780bed-8b0d-4557-bbb7-e0bbf34c5b94 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30ffd032e94bd4838b6a0f6b8df677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62a57d7c0f447b4809b25ef1404a56c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1843410011', 'tempest-DelegatedRole-544973948'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:01.083766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81780bed-8b0d-4557-bbb7-e0bbf34c5b94 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:01.084238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81780bed-8b0d-4557-bbb7-e0bbf34c5b94 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:01.085473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81780bed-8b0d-4557-bbb7-e0bbf34c5b94 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] PATH_INFO: `/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece/roles/b2d8876e24124563982725452be3a858` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:01.097749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81780bed-8b0d-4557-bbb7-e0bbf34c5b94 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorizing `identity:get_role_for_trust(trust_id=3f93604367744790bfe4382b6def1ece, role_id=b2d8876e24124563982725452be3a858)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:01.099261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81780bed-8b0d-4557-bbb7-e0bbf34c5b94 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-81780bed-8b0d-4557-bbb7-e0bbf34c5b94 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Could not find role: b2d8876e24124563982725452be3a858.: keystone.exception.RoleNotFound: Could not find role: b2d8876e24124563982725452be3a858. Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:36:01.115587 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b2d8876e24124563982725452be3a858. Aug 28 19:36:01.116769 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:36:01.119015 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4173/8356] 10.222.0.70 () {58 vars in 1369 bytes} [Sun Aug 28 19:36:01 2022] HEAD /identity/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece/roles/b2d8876e24124563982725452be3a858 => generated 0 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:36:01.123773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d865ed1-ac06-4687-ba14-3c7b8d3ff162 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:01.141567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d865ed1-ac06-4687-ba14-3c7b8d3ff162 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:01.158010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30ffd032e94bd4838b6a0f6b8df677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62a57d7c0f447b4809b25ef1404a56c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1843410011', 'tempest-DelegatedRole-544973948'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:01.158683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:01.159002 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:01.159436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] PATH_INFO: `/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:01.179960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorizing `identity:delete_trust(trust_id=3f93604367744790bfe4382b6def1ece)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:01.181597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:01.225297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '3f93604367744790bfe4382b6def1ece', 'request_id': 'req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:01.225975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '3f93604367744790bfe4382b6def1ece', 'request_id': 'req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:01.247124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '3f93604367744790bfe4382b6def1ece', 'request_id': 'req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:01.255864 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4184/8357] 10.222.0.70 () {58 vars in 1254 bytes} [Sun Aug 28 19:36:01 2022] DELETE /identity/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:01.263667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81780bed-8b0d-4557-bbb7-e0bbf34c5b94 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:01.270366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-81780bed-8b0d-4557-bbb7-e0bbf34c5b94 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:01.298560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81780bed-8b0d-4557-bbb7-e0bbf34c5b94 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:01.311673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd82287-7f16-47a3-a85d-610c90eb05c0 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b30ffd032e94bd4838b6a0f6b8df677', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a62a57d7c0f447b4809b25ef1404a56c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1843410011', 'tempest-DelegatedRole-544973948'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:01.313573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd82287-7f16-47a3-a85d-610c90eb05c0 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:01.314483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd82287-7f16-47a3-a85d-610c90eb05c0 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:01.315899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd82287-7f16-47a3-a85d-610c90eb05c0 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] PATH_INFO: `/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-4dd82287-7f16-47a3-a85d-610c90eb05c0 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Could not find trust: 3f93604367744790bfe4382b6def1ece.: keystone.exception.TrustNotFound: Could not find trust: 3f93604367744790bfe4382b6def1ece. Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 19:36:01.347112 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 19:36:01.348428 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 19:36:01.348428 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 19:36:01.348428 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 19:36:01.348428 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 19:36:01.348428 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 19:36:01.348428 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:36:01.348428 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:36:01.348428 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 19:36:01.348428 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 19:36:01.348428 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 19:36:01.348428 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 19:36:01.348428 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 3f93604367744790bfe4382b6def1ece. Aug 28 19:36:01.348428 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:36:01.352688 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4174/8358] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:36:01 2022] GET /identity/v3/OS-TRUST/trusts/3f93604367744790bfe4382b6def1ece => generated 111 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:36:01.356932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:01.358963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:01.397058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d018401-e5e0-4aa7-bb30-70d0a0dda1bd tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:01.402588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3f38-e975-4ced-97f7-4f36f10997cc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:01.403271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3f38-e975-4ced-97f7-4f36f10997cc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:01.403557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3f38-e975-4ced-97f7-4f36f10997cc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:01.403837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3f38-e975-4ced-97f7-4f36f10997cc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles/b2d8876e24124563982725452be3a858` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:01.406427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e3f38-e975-4ced-97f7-4f36f10997cc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b2d8876e24124563982725452be3a858)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:01.408113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e3f38-e975-4ced-97f7-4f36f10997cc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:01.519249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:01.528364 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-376e3f38-e975-4ced-97f7-4f36f10997cc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invalidating the token cache because role b2d8876e24124563982725452be3a858 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:01.528879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-376e3f38-e975-4ced-97f7-4f36f10997cc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:01.530716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-376e3f38-e975-4ced-97f7-4f36f10997cc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:01.534152 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4185/8359] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:01 2022] DELETE /identity/v3/roles/b2d8876e24124563982725452be3a858 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:01.538559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd82287-7f16-47a3-a85d-610c90eb05c0 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:01.540563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4dd82287-7f16-47a3-a85d-610c90eb05c0 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:01.594773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd82287-7f16-47a3-a85d-610c90eb05c0 tempest-TrustsV3TestJSON-835495103 tempest-user-311590177] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:01.710162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21a50d-90c4-4a22-80bd-90e3a793195c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:01.711387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21a50d-90c4-4a22-80bd-90e3a793195c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:01.711580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21a50d-90c4-4a22-80bd-90e3a793195c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:01.711989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21a50d-90c4-4a22-80bd-90e3a793195c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles/6bbc571f21d04c7d85d3d2cb0cdfed33` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:01.714718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21a50d-90c4-4a22-80bd-90e3a793195c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6bbc571f21d04c7d85d3d2cb0cdfed33)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:01.716798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21a50d-90c4-4a22-80bd-90e3a793195c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:01.769191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:01.778070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e21a50d-90c4-4a22-80bd-90e3a793195c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invalidating the token cache because role 6bbc571f21d04c7d85d3d2cb0cdfed33 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:01.779184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e21a50d-90c4-4a22-80bd-90e3a793195c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:01.780601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9e21a50d-90c4-4a22-80bd-90e3a793195c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:01.785904 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4175/8360] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:01 2022] DELETE /identity/v3/roles/6bbc571f21d04c7d85d3d2cb0cdfed33 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:01.787686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3f38-e975-4ced-97f7-4f36f10997cc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:01.804691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3f38-e975-4ced-97f7-4f36f10997cc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:01.907671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:01.908369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:01.908656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:01.909012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users/0b30ffd032e94bd4838b6a0f6b8df677` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:01.910970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0b30ffd032e94bd4838b6a0f6b8df677)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:01.914526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:02.024830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b30ffd032e94bd4838b6a0f6b8df677'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:02.039250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b30ffd032e94bd4838b6a0f6b8df677'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:02.040475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b30ffd032e94bd4838b6a0f6b8df677'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:02.062584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b30ffd032e94bd4838b6a0f6b8df677'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:02.064461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b30ffd032e94bd4838b6a0f6b8df677'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:02.088127 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4186/8361] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:01 2022] DELETE /identity/v3/users/0b30ffd032e94bd4838b6a0f6b8df677 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:02.093499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21a50d-90c4-4a22-80bd-90e3a793195c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:02.095121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9e21a50d-90c4-4a22-80bd-90e3a793195c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:02.113717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21a50d-90c4-4a22-80bd-90e3a793195c tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:02.275080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:02.276417 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:02.276754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:02.277292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/a62a57d7c0f447b4809b25ef1404a56c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:02.281755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a62a57d7c0f447b4809b25ef1404a56c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:02.286469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:02.377787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62a57d7c0f447b4809b25ef1404a56c', 'request_id': 'req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:02.387268 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62a57d7c0f447b4809b25ef1404a56c', 'request_id': 'req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:02.395599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62a57d7c0f447b4809b25ef1404a56c', 'request_id': 'req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:02.424514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] The token cache is being invalidate because project a62a57d7c0f447b4809b25ef1404a56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:02.425768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:02.427873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:02.433885 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4176/8362] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:36:02 2022] DELETE /identity/v3/projects/a62a57d7c0f447b4809b25ef1404a56c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:02.441235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:02.443356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:02.467144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8488a7-00cf-4d1b-a64b-e9fd39fb7246 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:02.553471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aabdb3-710c-4632-868e-088b9cf06c49 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:02.554142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aabdb3-710c-4632-868e-088b9cf06c49 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:02.554420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aabdb3-710c-4632-868e-088b9cf06c49 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:02.554720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aabdb3-710c-4632-868e-088b9cf06c49 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:02.555466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aabdb3-710c-4632-868e-088b9cf06c49 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:02.559788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aabdb3-710c-4632-868e-088b9cf06c49 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:02.610021 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4187/8363] 10.222.0.70 () {60 vars in 1152 bytes} [Sun Aug 28 19:36:02 2022] POST /identity/v3/projects => generated 329 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:36:02.615839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:02.618917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:02.645843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084edaa-5b9b-4d3b-af93-d1a8e8245a81 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:02.737995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b120925-32a6-4e4f-9bf3-5351e0b082fc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:02.738929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b120925-32a6-4e4f-9bf3-5351e0b082fc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:02.739328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b120925-32a6-4e4f-9bf3-5351e0b082fc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:02.739684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b120925-32a6-4e4f-9bf3-5351e0b082fc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:02.741033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b120925-32a6-4e4f-9bf3-5351e0b082fc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:02.742493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b120925-32a6-4e4f-9bf3-5351e0b082fc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:02.773266 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4177/8364] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:36:02 2022] POST /identity/v3/users => generated 416 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:02.783898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aabdb3-710c-4632-868e-088b9cf06c49 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:02.792180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:02.797754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aabdb3-710c-4632-868e-088b9cf06c49 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:02.805989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c586a16-c6d5-4d95-93a9-184b877feac1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:02.806393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c586a16-c6d5-4d95-93a9-184b877feac1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:02.806570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c586a16-c6d5-4d95-93a9-184b877feac1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:02.806887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c586a16-c6d5-4d95-93a9-184b877feac1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:02.807604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c586a16-c6d5-4d95-93a9-184b877feac1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:02.810071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c586a16-c6d5-4d95-93a9-184b877feac1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:02.840426 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4188/8365] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:36:02 2022] POST /identity/v3/roles => generated 243 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:36:02.844549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b120925-32a6-4e4f-9bf3-5351e0b082fc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:02.860921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b120925-32a6-4e4f-9bf3-5351e0b082fc tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:02.870372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54635df9-7e6e-46bc-bb9d-d22a36c57792 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:02.871265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54635df9-7e6e-46bc-bb9d-d22a36c57792 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:02.871628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54635df9-7e6e-46bc-bb9d-d22a36c57792 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:02.871975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54635df9-7e6e-46bc-bb9d-d22a36c57792 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:02.873101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54635df9-7e6e-46bc-bb9d-d22a36c57792 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:02.876393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54635df9-7e6e-46bc-bb9d-d22a36c57792 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:02.909539 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4178/8366] 10.222.0.70 () {60 vars in 1143 bytes} [Sun Aug 28 19:36:02 2022] POST /identity/v3/roles => generated 246 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:02.913862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c586a16-c6d5-4d95-93a9-184b877feac1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:02.929837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c586a16-c6d5-4d95-93a9-184b877feac1 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:02.940066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080ba2d-3033-4de9-8d41-af4496e8738d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:02.942409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080ba2d-3033-4de9-8d41-af4496e8738d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:02.944471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080ba2d-3033-4de9-8d41-af4496e8738d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:02.945076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080ba2d-3033-4de9-8d41-af4496e8738d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/c20d48c0c0b44ab99e2703054c622847/users/b9f46f93c9a14d29b4a86b04e6d782d9/roles/4b760ccc073543b4ba8668150f0ac60b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:02.999813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080ba2d-3033-4de9-8d41-af4496e8738d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c20d48c0c0b44ab99e2703054c622847, user_id=b9f46f93c9a14d29b4a86b04e6d782d9, role_id=4b760ccc073543b4ba8668150f0ac60b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:03.002963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080ba2d-3033-4de9-8d41-af4496e8738d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:03.046984 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4189/8367] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:36:02 2022] PUT /identity/v3/projects/c20d48c0c0b44ab99e2703054c622847/users/b9f46f93c9a14d29b4a86b04e6d782d9/roles/4b760ccc073543b4ba8668150f0ac60b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:03.050312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54635df9-7e6e-46bc-bb9d-d22a36c57792 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:03.060222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:03.068933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54635df9-7e6e-46bc-bb9d-d22a36c57792 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:03.163281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1bcd4-c561-4dfd-b126-57fb0936e9e0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:03.166504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1bcd4-c561-4dfd-b126-57fb0936e9e0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:03.167177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1bcd4-c561-4dfd-b126-57fb0936e9e0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:03.169701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1bcd4-c561-4dfd-b126-57fb0936e9e0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/c20d48c0c0b44ab99e2703054c622847/users/b9f46f93c9a14d29b4a86b04e6d782d9/roles/90cb12e0a1c4498fa792c8cae862154b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:03.175236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1bcd4-c561-4dfd-b126-57fb0936e9e0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c20d48c0c0b44ab99e2703054c622847, user_id=b9f46f93c9a14d29b4a86b04e6d782d9, role_id=90cb12e0a1c4498fa792c8cae862154b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:03.181746 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1bcd4-c561-4dfd-b126-57fb0936e9e0 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:03.209400 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4179/8368] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:36:03 2022] PUT /identity/v3/projects/c20d48c0c0b44ab99e2703054c622847/users/b9f46f93c9a14d29b4a86b04e6d782d9/roles/90cb12e0a1c4498fa792c8cae862154b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:36:03.215015 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080ba2d-3033-4de9-8d41-af4496e8738d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:03.228721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080ba2d-3033-4de9-8d41-af4496e8738d tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:03.345670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3d160-3cdc-46a1-bb1c-ee10e055ee32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:03.346347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d160-3cdc-46a1-bb1c-ee10e055ee32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:03.346638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d160-3cdc-46a1-bb1c-ee10e055ee32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:03.346983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3d160-3cdc-46a1-bb1c-ee10e055ee32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:03.348197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3d160-3cdc-46a1-bb1c-ee10e055ee32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:03.350626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3d160-3cdc-46a1-bb1c-ee10e055ee32 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:03.411112 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4190/8369] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:03 2022] GET /identity/v3/users => generated 7798 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:36:03.417090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfabc0-c164-41ff-8d99-6c954d762a2b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:03.417418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfabc0-c164-41ff-8d99-6c954d762a2b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:03.417749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfabc0-c164-41ff-8d99-6c954d762a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:03.489195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-68bfabc0-c164-41ff-8d99-6c954d762a2b None None] MFA Rules not processed for user `b9f46f93c9a14d29b4a86b04e6d782d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:03.490862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-68bfabc0-c164-41ff-8d99-6c954d762a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:03.602288 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4180/8370] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:03 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:03.608274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d1a31-887b-4202-b2e3-ebe9040195fd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:03.608893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d1a31-887b-4202-b2e3-ebe9040195fd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:03.608893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d1a31-887b-4202-b2e3-ebe9040195fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:03.636056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-718d1a31-887b-4202-b2e3-ebe9040195fd None None] MFA Rules not processed for user `b9f46f93c9a14d29b4a86b04e6d782d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:03.637409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-718d1a31-887b-4202-b2e3-ebe9040195fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:03.646568 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4191/8371] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:03 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:03.651886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfabc0-c164-41ff-8d99-6c954d762a2b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:03.668705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfabc0-c164-41ff-8d99-6c954d762a2b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:03.673573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a9789-3360-4a4b-9eb6-e73f06aef6d5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f46f93c9a14d29b4a86b04e6d782d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c20d48c0c0b44ab99e2703054c622847', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-237214555', 'tempest-NotDelegatedRole-328020994'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:03.674204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a9789-3360-4a4b-9eb6-e73f06aef6d5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:03.674488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a9789-3360-4a4b-9eb6-e73f06aef6d5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:03.674831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a9789-3360-4a4b-9eb6-e73f06aef6d5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:03.675785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a9789-3360-4a4b-9eb6-e73f06aef6d5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorizing `identity:create_trust()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:03.676951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a9789-3360-4a4b-9eb6-e73f06aef6d5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:03.758794 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4181/8372] 10.222.0.70 () {60 vars in 1174 bytes} [Sun Aug 28 19:36:03 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:36:03.763746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d1a31-887b-4202-b2e3-ebe9040195fd None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:03.773547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d1a31-887b-4202-b2e3-ebe9040195fd None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:03.779127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20151c-e58c-4b7e-896d-ef8f8a7ad630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f46f93c9a14d29b4a86b04e6d782d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c20d48c0c0b44ab99e2703054c622847', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-237214555', 'tempest-NotDelegatedRole-328020994'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:03.781096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20151c-e58c-4b7e-896d-ef8f8a7ad630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:03.781383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20151c-e58c-4b7e-896d-ef8f8a7ad630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:03.781651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20151c-e58c-4b7e-896d-ef8f8a7ad630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] PATH_INFO: `/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:03.788912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20151c-e58c-4b7e-896d-ef8f8a7ad630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorizing `identity:get_trust(trust_id=6564a5870c7b4fd1a2e44215b899ed71)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:03.790417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20151c-e58c-4b7e-896d-ef8f8a7ad630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:03.801671 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4192/8373] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:36:03 2022] GET /identity/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71 => generated 834 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:03.803009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a9789-3360-4a4b-9eb6-e73f06aef6d5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:03.812910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a9789-3360-4a4b-9eb6-e73f06aef6d5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:03.817528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e39d23-5613-4943-b62f-9ce7d9d57d15 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f46f93c9a14d29b4a86b04e6d782d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c20d48c0c0b44ab99e2703054c622847', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-237214555', 'tempest-NotDelegatedRole-328020994'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:03.818178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39d23-5613-4943-b62f-9ce7d9d57d15 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:03.818466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39d23-5613-4943-b62f-9ce7d9d57d15 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:03.818767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e39d23-5613-4943-b62f-9ce7d9d57d15 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] PATH_INFO: `/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:03.824479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:03.826993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e39d23-5613-4943-b62f-9ce7d9d57d15 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=6564a5870c7b4fd1a2e44215b899ed71)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:03.828559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e39d23-5613-4943-b62f-9ce7d9d57d15 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:03.840821 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4182/8374] 10.222.0.70 () {58 vars in 1269 bytes} [Sun Aug 28 19:36:03 2022] GET /identity/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71/roles => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:03.845363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20151c-e58c-4b7e-896d-ef8f8a7ad630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:03.856264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20151c-e58c-4b7e-896d-ef8f8a7ad630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:03.860843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0808a4-92c6-4d0a-876b-a65bf56b4426 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f46f93c9a14d29b4a86b04e6d782d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c20d48c0c0b44ab99e2703054c622847', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-237214555', 'tempest-NotDelegatedRole-328020994'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:03.861542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0808a4-92c6-4d0a-876b-a65bf56b4426 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:03.861825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0808a4-92c6-4d0a-876b-a65bf56b4426 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:03.862101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0808a4-92c6-4d0a-876b-a65bf56b4426 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] PATH_INFO: `/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71/roles/4b760ccc073543b4ba8668150f0ac60b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:03.872642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0808a4-92c6-4d0a-876b-a65bf56b4426 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6564a5870c7b4fd1a2e44215b899ed71, role_id=4b760ccc073543b4ba8668150f0ac60b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:03.874208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0808a4-92c6-4d0a-876b-a65bf56b4426 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:03.881738 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4193/8375] 10.222.0.70 () {58 vars in 1368 bytes} [Sun Aug 28 19:36:03 2022] GET /identity/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71/roles/4b760ccc073543b4ba8668150f0ac60b => generated 243 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:03.886221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e39d23-5613-4943-b62f-9ce7d9d57d15 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:03.896226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e39d23-5613-4943-b62f-9ce7d9d57d15 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:03.901174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2ed1e-24c4-48fa-b1d8-d037d9043630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f46f93c9a14d29b4a86b04e6d782d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c20d48c0c0b44ab99e2703054c622847', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-237214555', 'tempest-NotDelegatedRole-328020994'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:03.901869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2ed1e-24c4-48fa-b1d8-d037d9043630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:03.902152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2ed1e-24c4-48fa-b1d8-d037d9043630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:03.902525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2ed1e-24c4-48fa-b1d8-d037d9043630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] PATH_INFO: `/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71/roles/4b760ccc073543b4ba8668150f0ac60b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:03.909062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2ed1e-24c4-48fa-b1d8-d037d9043630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6564a5870c7b4fd1a2e44215b899ed71, role_id=4b760ccc073543b4ba8668150f0ac60b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:03.910533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2ed1e-24c4-48fa-b1d8-d037d9043630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:03.919404 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4183/8376] 10.222.0.70 () {58 vars in 1369 bytes} [Sun Aug 28 19:36:03 2022] HEAD /identity/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71/roles/4b760ccc073543b4ba8668150f0ac60b => generated 0 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:03.923850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0808a4-92c6-4d0a-876b-a65bf56b4426 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:03.936981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0808a4-92c6-4d0a-876b-a65bf56b4426 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:03.941960 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105fcdc-8331-45cd-a39b-66c78ecb04a5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f46f93c9a14d29b4a86b04e6d782d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c20d48c0c0b44ab99e2703054c622847', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-237214555', 'tempest-NotDelegatedRole-328020994'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:03.942615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105fcdc-8331-45cd-a39b-66c78ecb04a5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:03.942962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105fcdc-8331-45cd-a39b-66c78ecb04a5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:03.943245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105fcdc-8331-45cd-a39b-66c78ecb04a5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] PATH_INFO: `/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71/roles/90cb12e0a1c4498fa792c8cae862154b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:03.949853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105fcdc-8331-45cd-a39b-66c78ecb04a5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6564a5870c7b4fd1a2e44215b899ed71, role_id=90cb12e0a1c4498fa792c8cae862154b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:03.951350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105fcdc-8331-45cd-a39b-66c78ecb04a5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application [None req-2105fcdc-8331-45cd-a39b-66c78ecb04a5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Could not find role: 90cb12e0a1c4498fa792c8cae862154b.: keystone.exception.RoleNotFound: Could not find role: 90cb12e0a1c4498fa792c8cae862154b. Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:36:03.961486 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 90cb12e0a1c4498fa792c8cae862154b. Aug 28 19:36:03.962697 n-d-854118-7 devstack@keystone.service[88374]: ERROR keystone.server.flask.application Aug 28 19:36:03.966286 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4194/8377] 10.222.0.70 () {58 vars in 1368 bytes} [Sun Aug 28 19:36:03 2022] GET /identity/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71/roles/90cb12e0a1c4498fa792c8cae862154b => generated 110 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 19:36:03.967198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2ed1e-24c4-48fa-b1d8-d037d9043630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:03.977095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2ed1e-24c4-48fa-b1d8-d037d9043630 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:03.983288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14e93d-9fa6-45df-95e9-c49968218788 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f46f93c9a14d29b4a86b04e6d782d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c20d48c0c0b44ab99e2703054c622847', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-237214555', 'tempest-NotDelegatedRole-328020994'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:03.984100 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14e93d-9fa6-45df-95e9-c49968218788 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] REQUEST_METHOD: `HEAD` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:03.984392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14e93d-9fa6-45df-95e9-c49968218788 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:03.984677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14e93d-9fa6-45df-95e9-c49968218788 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] PATH_INFO: `/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71/roles/90cb12e0a1c4498fa792c8cae862154b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:03.991281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14e93d-9fa6-45df-95e9-c49968218788 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6564a5870c7b4fd1a2e44215b899ed71, role_id=90cb12e0a1c4498fa792c8cae862154b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:03.992760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14e93d-9fa6-45df-95e9-c49968218788 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-6d14e93d-9fa6-45df-95e9-c49968218788 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Could not find role: 90cb12e0a1c4498fa792c8cae862154b.: keystone.exception.RoleNotFound: Could not find role: 90cb12e0a1c4498fa792c8cae862154b. Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 19:36:04.004716 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 90cb12e0a1c4498fa792c8cae862154b. Aug 28 19:36:04.006002 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:36:04.006002 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4184/8378] 10.222.0.70 () {58 vars in 1369 bytes} [Sun Aug 28 19:36:03 2022] HEAD /identity/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71/roles/90cb12e0a1c4498fa792c8cae862154b => generated 0 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:36:04.010428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105fcdc-8331-45cd-a39b-66c78ecb04a5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:04.020786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105fcdc-8331-45cd-a39b-66c78ecb04a5 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:04.024982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f46f93c9a14d29b4a86b04e6d782d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c20d48c0c0b44ab99e2703054c622847', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-237214555', 'tempest-NotDelegatedRole-328020994'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:04.025594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:04.026400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:04.026677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] PATH_INFO: `/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:04.033276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorizing `identity:delete_trust(trust_id=6564a5870c7b4fd1a2e44215b899ed71)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:04.034731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:04.053653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6564a5870c7b4fd1a2e44215b899ed71', 'request_id': 'req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.054446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6564a5870c7b4fd1a2e44215b899ed71', 'request_id': 'req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.064161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6564a5870c7b4fd1a2e44215b899ed71', 'request_id': 'req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.071974 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4195/8379] 10.222.0.70 () {58 vars in 1254 bytes} [Sun Aug 28 19:36:04 2022] DELETE /identity/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:04.079517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14e93d-9fa6-45df-95e9-c49968218788 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:04.081270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6d14e93d-9fa6-45df-95e9-c49968218788 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:04.096641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14e93d-9fa6-45df-95e9-c49968218788 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:04.101621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3d646-1101-4cf6-b36f-5fa986bc8f73 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9f46f93c9a14d29b4a86b04e6d782d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c20d48c0c0b44ab99e2703054c622847', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-237214555', 'tempest-NotDelegatedRole-328020994'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:04.102272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3d646-1101-4cf6-b36f-5fa986bc8f73 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:04.102618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3d646-1101-4cf6-b36f-5fa986bc8f73 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:04.102992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3d646-1101-4cf6-b36f-5fa986bc8f73 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] PATH_INFO: `/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-11f3d646-1101-4cf6-b36f-5fa986bc8f73 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Could not find trust: 6564a5870c7b4fd1a2e44215b899ed71.: keystone.exception.TrustNotFound: Could not find trust: 6564a5870c7b4fd1a2e44215b899ed71. Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 28 19:36:04.114653 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 28 19:36:04.115912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 28 19:36:04.115912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 19:36:04.115912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 19:36:04.115912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 28 19:36:04.115912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 28 19:36:04.115912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:36:04.115912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:36:04.115912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 28 19:36:04.115912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 28 19:36:04.115912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 28 19:36:04.115912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 28 19:36:04.115912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6564a5870c7b4fd1a2e44215b899ed71. Aug 28 19:36:04.115912 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:36:04.116833 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4185/8380] 10.222.0.70 () {58 vars in 1251 bytes} [Sun Aug 28 19:36:04 2022] GET /identity/v3/OS-TRUST/trusts/6564a5870c7b4fd1a2e44215b899ed71 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 28 19:36:04.120686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:04.122115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:04.142284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffd89b-c2c7-4bf4-8ca8-4ea6c6dbfd17 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:04.148707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3361e6b-11a7-4333-a800-1ddf00cebd82 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:04.148955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3361e6b-11a7-4333-a800-1ddf00cebd82 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:04.149151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3361e6b-11a7-4333-a800-1ddf00cebd82 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:04.149435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3361e6b-11a7-4333-a800-1ddf00cebd82 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles/90cb12e0a1c4498fa792c8cae862154b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:04.152197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3361e6b-11a7-4333-a800-1ddf00cebd82 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_role(role_id=90cb12e0a1c4498fa792c8cae862154b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:04.153845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3361e6b-11a7-4333-a800-1ddf00cebd82 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:04.172789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:04.200175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c3361e6b-11a7-4333-a800-1ddf00cebd82 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invalidating the token cache because role 90cb12e0a1c4498fa792c8cae862154b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:04.200473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c3361e6b-11a7-4333-a800-1ddf00cebd82 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.201294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c3361e6b-11a7-4333-a800-1ddf00cebd82 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.203370 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4196/8381] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:04 2022] DELETE /identity/v3/roles/90cb12e0a1c4498fa792c8cae862154b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:04.207283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3d646-1101-4cf6-b36f-5fa986bc8f73 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:04.209070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-11f3d646-1101-4cf6-b36f-5fa986bc8f73 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:04.225302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3d646-1101-4cf6-b36f-5fa986bc8f73 tempest-TrustsV3TestJSON-1517068029 tempest-user-1417511033] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:04.289818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e048e-c52f-40d2-8673-0d55389d5c19 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:04.290453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e048e-c52f-40d2-8673-0d55389d5c19 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:04.290770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e048e-c52f-40d2-8673-0d55389d5c19 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:04.291034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e048e-c52f-40d2-8673-0d55389d5c19 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/roles/4b760ccc073543b4ba8668150f0ac60b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:04.293193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e048e-c52f-40d2-8673-0d55389d5c19 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4b760ccc073543b4ba8668150f0ac60b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:04.294848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e048e-c52f-40d2-8673-0d55389d5c19 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:04.337015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c46e048e-c52f-40d2-8673-0d55389d5c19 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invalidating the token cache because role 4b760ccc073543b4ba8668150f0ac60b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:04.337311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c46e048e-c52f-40d2-8673-0d55389d5c19 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.338005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c46e048e-c52f-40d2-8673-0d55389d5c19 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.340383 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4186/8382] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:04 2022] DELETE /identity/v3/roles/4b760ccc073543b4ba8668150f0ac60b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:04.344676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3361e6b-11a7-4333-a800-1ddf00cebd82 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:04.359578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3361e6b-11a7-4333-a800-1ddf00cebd82 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:04.425275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:04.425921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:04.426220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:04.426509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/users/b9f46f93c9a14d29b4a86b04e6d782d9` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:04.427835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b9f46f93c9a14d29b4a86b04e6d782d9)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:04.429821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:04.480592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f46f93c9a14d29b4a86b04e6d782d9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.488684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f46f93c9a14d29b4a86b04e6d782d9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.489778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f46f93c9a14d29b4a86b04e6d782d9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.502832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f46f93c9a14d29b4a86b04e6d782d9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.503558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f46f93c9a14d29b4a86b04e6d782d9'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.519943 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4197/8383] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:04 2022] DELETE /identity/v3/users/b9f46f93c9a14d29b4a86b04e6d782d9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:04.524093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e048e-c52f-40d2-8673-0d55389d5c19 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:04.525527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c46e048e-c52f-40d2-8673-0d55389d5c19 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:04.539804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e048e-c52f-40d2-8673-0d55389d5c19 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:04.617493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699a6b4-91f0-4fe4-9078-02e4386922a4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8785c8aed743f0946f0811b7e08323', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c49d2c0c9554ed284a49c6973658060', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:04.618141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699a6b4-91f0-4fe4-9078-02e4386922a4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:04.618431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699a6b4-91f0-4fe4-9078-02e4386922a4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:04.618714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699a6b4-91f0-4fe4-9078-02e4386922a4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] PATH_INFO: `/v3/projects/c20d48c0c0b44ab99e2703054c622847` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:04.620148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699a6b4-91f0-4fe4-9078-02e4386922a4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c20d48c0c0b44ab99e2703054c622847)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:04.622216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699a6b4-91f0-4fe4-9078-02e4386922a4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:04.643402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:04.688449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7699a6b4-91f0-4fe4-9078-02e4386922a4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20d48c0c0b44ab99e2703054c622847', 'request_id': 'req-7699a6b4-91f0-4fe4-9078-02e4386922a4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.695429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7699a6b4-91f0-4fe4-9078-02e4386922a4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20d48c0c0b44ab99e2703054c622847', 'request_id': 'req-7699a6b4-91f0-4fe4-9078-02e4386922a4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.703674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7699a6b4-91f0-4fe4-9078-02e4386922a4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20d48c0c0b44ab99e2703054c622847', 'request_id': 'req-7699a6b4-91f0-4fe4-9078-02e4386922a4'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.720653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7699a6b4-91f0-4fe4-9078-02e4386922a4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] The token cache is being invalidate because project c20d48c0c0b44ab99e2703054c622847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:04.721238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7699a6b4-91f0-4fe4-9078-02e4386922a4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.722188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-7699a6b4-91f0-4fe4-9078-02e4386922a4 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.724827 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4187/8384] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:36:04 2022] DELETE /identity/v3/projects/c20d48c0c0b44ab99e2703054c622847 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:04.730423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:04.732382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:04.811734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ccac7-9763-4f33-80dc-ba99b328fa88 tempest-TrustsV3TestJSON-280755859 tempest-TrustsV3TestJSON-280755859-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:04.817239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:04.872360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:04.873000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:04.873288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:04.873565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] PATH_INFO: `/v3/users/28a1381960dd44e88d48011d8ddc2f3d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:04.874705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a1381960dd44e88d48011d8ddc2f3d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:04.876683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:04.928014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a1381960dd44e88d48011d8ddc2f3d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.936952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a1381960dd44e88d48011d8ddc2f3d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.937605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a1381960dd44e88d48011d8ddc2f3d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.953625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a1381960dd44e88d48011d8ddc2f3d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.954346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a1381960dd44e88d48011d8ddc2f3d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:04.972959 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4198/8385] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:04 2022] DELETE /identity/v3/users/28a1381960dd44e88d48011d8ddc2f3d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:04.977239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cecae-bd6d-4237-a522-ada248aaed92 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:04.977534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cecae-bd6d-4237-a522-ada248aaed92 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:04.977811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cecae-bd6d-4237-a522-ada248aaed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:05.002885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cb6cecae-bd6d-4237-a522-ada248aaed92 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:05.004420 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cb6cecae-bd6d-4237-a522-ada248aaed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:05.082896 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4188/8386] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:05.091021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:05.092633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:05.172736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eeb97-f3be-4bec-adc9-81084c6d2037 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:05.177557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda1c7a-2e2a-4f5e-8392-2edfc3570c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:05.178425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda1c7a-2e2a-4f5e-8392-2edfc3570c2d service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:05.179029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda1c7a-2e2a-4f5e-8392-2edfc3570c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:05.179816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda1c7a-2e2a-4f5e-8392-2edfc3570c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:05.192322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda1c7a-2e2a-4f5e-8392-2edfc3570c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:05.194106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda1c7a-2e2a-4f5e-8392-2edfc3570c2d service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:05.205659 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4199/8387] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:05.491773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cecae-bd6d-4237-a522-ada248aaed92 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:05.493178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cb6cecae-bd6d-4237-a522-ada248aaed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:05.511666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cecae-bd6d-4237-a522-ada248aaed92 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:05.516849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:05.517494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:05.517778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:05.518200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] PATH_INFO: `/v3/projects/ede6bffc754a4d8b9ace8395a5aa5de1` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:05.519335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede6bffc754a4d8b9ace8395a5aa5de1)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:05.521251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:05.575241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede6bffc754a4d8b9ace8395a5aa5de1', 'request_id': 'req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:05.584557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede6bffc754a4d8b9ace8395a5aa5de1', 'request_id': 'req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:05.590996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede6bffc754a4d8b9ace8395a5aa5de1', 'request_id': 'req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:05.606427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] The token cache is being invalidate because project ede6bffc754a4d8b9ace8395a5aa5de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:05.606852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:05.607498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:05.608990 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4189/8388] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:36:05 2022] DELETE /identity/v3/projects/ede6bffc754a4d8b9ace8395a5aa5de1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:05.613087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda1c7a-2e2a-4f5e-8392-2edfc3570c2d service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:05.625826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda1c7a-2e2a-4f5e-8392-2edfc3570c2d service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:05.656901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:05.688911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d71f8-f200-4500-9529-7e2ec37857a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:05.689627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d71f8-f200-4500-9529-7e2ec37857a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:05.689986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d71f8-f200-4500-9529-7e2ec37857a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:05.690342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d71f8-f200-4500-9529-7e2ec37857a4 admin admin] PATH_INFO: `/v3/users/7e8785c8aed743f0946f0811b7e08323` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:05.691608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d71f8-f200-4500-9529-7e2ec37857a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e8785c8aed743f0946f0811b7e08323)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:05.693660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d71f8-f200-4500-9529-7e2ec37857a4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:05.748073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-061d71f8-f200-4500-9529-7e2ec37857a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e8785c8aed743f0946f0811b7e08323'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:05.756668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-061d71f8-f200-4500-9529-7e2ec37857a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e8785c8aed743f0946f0811b7e08323'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:05.757392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-061d71f8-f200-4500-9529-7e2ec37857a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e8785c8aed743f0946f0811b7e08323'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:05.771398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-061d71f8-f200-4500-9529-7e2ec37857a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e8785c8aed743f0946f0811b7e08323'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:05.772177 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-061d71f8-f200-4500-9529-7e2ec37857a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e8785c8aed743f0946f0811b7e08323'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:05.791178 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4200/8389] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:05 2022] DELETE /identity/v3/users/7e8785c8aed743f0946f0811b7e08323 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:06.091436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:06.092966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:06.107583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91b706-f9ba-441a-ab8e-36a393c1fa9f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:06.135947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:06.176077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c775923-c5d5-40fe-a182-3ce725b595ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:06.176840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c775923-c5d5-40fe-a182-3ce725b595ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:06.177199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c775923-c5d5-40fe-a182-3ce725b595ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:06.177551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c775923-c5d5-40fe-a182-3ce725b595ca admin admin] PATH_INFO: `/v3/projects/5c49d2c0c9554ed284a49c6973658060` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:06.178703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c775923-c5d5-40fe-a182-3ce725b595ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c49d2c0c9554ed284a49c6973658060)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:06.180659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c775923-c5d5-40fe-a182-3ce725b595ca admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:06.237683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6c775923-c5d5-40fe-a182-3ce725b595ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c49d2c0c9554ed284a49c6973658060', 'request_id': 'req-6c775923-c5d5-40fe-a182-3ce725b595ca'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:06.244075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6c775923-c5d5-40fe-a182-3ce725b595ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c49d2c0c9554ed284a49c6973658060', 'request_id': 'req-6c775923-c5d5-40fe-a182-3ce725b595ca'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:06.250602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6c775923-c5d5-40fe-a182-3ce725b595ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c49d2c0c9554ed284a49c6973658060', 'request_id': 'req-6c775923-c5d5-40fe-a182-3ce725b595ca'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:06.265411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6c775923-c5d5-40fe-a182-3ce725b595ca admin admin] The token cache is being invalidate because project 5c49d2c0c9554ed284a49c6973658060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:06.265630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6c775923-c5d5-40fe-a182-3ce725b595ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:06.266258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-6c775923-c5d5-40fe-a182-3ce725b595ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:06.267781 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4190/8390] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:36:06 2022] DELETE /identity/v3/projects/5c49d2c0c9554ed284a49c6973658060 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:06.273664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ea1b0-d838-466b-b1cf-f0155135164f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:06.273953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ea1b0-d838-466b-b1cf-f0155135164f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:06.274232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ea1b0-d838-466b-b1cf-f0155135164f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:06.295283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5c7ea1b0-d838-466b-b1cf-f0155135164f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:06.296519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5c7ea1b0-d838-466b-b1cf-f0155135164f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:06.362634 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4201/8391] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:06.371177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6ad2f-181e-490d-a056-3f067f6fe7c3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:06.371470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6ad2f-181e-490d-a056-3f067f6fe7c3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:06.371752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6ad2f-181e-490d-a056-3f067f6fe7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:06.400122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-10f6ad2f-181e-490d-a056-3f067f6fe7c3 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:06.401506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-10f6ad2f-181e-490d-a056-3f067f6fe7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:06.409661 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4191/8392] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:36:06.413975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ea1b0-d838-466b-b1cf-f0155135164f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:06.424912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ea1b0-d838-466b-b1cf-f0155135164f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:06.429758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6eda-09bc-4976-a876-e2cb0c004b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:06.430366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6eda-09bc-4976-a876-e2cb0c004b93 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:06.430650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6eda-09bc-4976-a876-e2cb0c004b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:06.430969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6eda-09bc-4976-a876-e2cb0c004b93 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:06.431612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a6eda-09bc-4976-a876-e2cb0c004b93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:36:06.432663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a6eda-09bc-4976-a876-e2cb0c004b93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:06.434090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a6eda-09bc-4976-a876-e2cb0c004b93 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:06.450803 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4202/8393] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:06.453177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6ad2f-181e-490d-a056-3f067f6fe7c3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:06.463265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6ad2f-181e-490d-a056-3f067f6fe7c3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:06.468288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2c2e8-6a70-4376-8a12-fe9dc0770d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:06.468906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2c2e8-6a70-4376-8a12-fe9dc0770d18 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:06.469185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2c2e8-6a70-4376-8a12-fe9dc0770d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:06.469452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2c2e8-6a70-4376-8a12-fe9dc0770d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:06.470099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2c2e8-6a70-4376-8a12-fe9dc0770d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:06.472221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2c2e8-6a70-4376-8a12-fe9dc0770d18 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:06.501076 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4192/8394] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:36:06 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:06.505176 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6eda-09bc-4976-a876-e2cb0c004b93 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:06.520257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6eda-09bc-4976-a876-e2cb0c004b93 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:06.555223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:06.585538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a12f53-695d-488a-bc5d-8684f82a7f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:06.586185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a12f53-695d-488a-bc5d-8684f82a7f08 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:06.586467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a12f53-695d-488a-bc5d-8684f82a7f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:06.586802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a12f53-695d-488a-bc5d-8684f82a7f08 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:06.587451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a12f53-695d-488a-bc5d-8684f82a7f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:06.589571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a12f53-695d-488a-bc5d-8684f82a7f08 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:06.613075 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4203/8395] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:36:06 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:06.617197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2c2e8-6a70-4376-8a12-fe9dc0770d18 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:06.630140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2c2e8-6a70-4376-8a12-fe9dc0770d18 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:06.636004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6b649-bc09-4367-96c6-c06167f36a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:06.636864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6b649-bc09-4367-96c6-c06167f36a8a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:06.637425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6b649-bc09-4367-96c6-c06167f36a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:06.637703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6b649-bc09-4367-96c6-c06167f36a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:06.638350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6b649-bc09-4367-96c6-c06167f36a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:06.639991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6b649-bc09-4367-96c6-c06167f36a8a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:06.655082 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4193/8396] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:36:06.656548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a12f53-695d-488a-bc5d-8684f82a7f08 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:06.668149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a12f53-695d-488a-bc5d-8684f82a7f08 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:06.672970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d470e-2ec2-472d-9b39-7b916e56d474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:06.673611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d470e-2ec2-472d-9b39-7b916e56d474 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:06.673895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d470e-2ec2-472d-9b39-7b916e56d474 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:06.674164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d470e-2ec2-472d-9b39-7b916e56d474 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:06.674832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d470e-2ec2-472d-9b39-7b916e56d474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:06.676511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d470e-2ec2-472d-9b39-7b916e56d474 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:06.691000 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4204/8397] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:36:06.692594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6b649-bc09-4367-96c6-c06167f36a8a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:06.706407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6b649-bc09-4367-96c6-c06167f36a8a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:06.711321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cd991-d712-45c3-9089-5c86b279957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:06.712052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cd991-d712-45c3-9089-5c86b279957e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:06.712336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cd991-d712-45c3-9089-5c86b279957e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:06.712638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cd991-d712-45c3-9089-5c86b279957e admin admin] PATH_INFO: `/v3/projects/f3352e3e40d540a59aceaba2b38c5863/users/834850eacd9b4e9a81bcb6f28c1ba765/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:06.729039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cd991-d712-45c3-9089-5c86b279957e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3352e3e40d540a59aceaba2b38c5863, user_id=834850eacd9b4e9a81bcb6f28c1ba765, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:06.731796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cd991-d712-45c3-9089-5c86b279957e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:06.746674 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4194/8398] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:36:06 2022] PUT /identity/v3/projects/f3352e3e40d540a59aceaba2b38c5863/users/834850eacd9b4e9a81bcb6f28c1ba765/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:06.756538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca0e77-8244-478b-a93d-a966d70871c9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:06.757057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca0e77-8244-478b-a93d-a966d70871c9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:06.757288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca0e77-8244-478b-a93d-a966d70871c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:06.788562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a1ca0e77-8244-478b-a93d-a966d70871c9 None None] MFA Rules not processed for user `834850eacd9b4e9a81bcb6f28c1ba765`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:06.789709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a1ca0e77-8244-478b-a93d-a966d70871c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:06.859378 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4205/8399] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:06.864577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cd991-d712-45c3-9089-5c86b279957e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:06.878139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cd991-d712-45c3-9089-5c86b279957e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:06.882422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58037d3d-ec8c-4d0c-95fd-992684221a38 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '834850eacd9b4e9a81bcb6f28c1ba765', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3352e3e40d540a59aceaba2b38c5863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:06.883118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037d3d-ec8c-4d0c-95fd-992684221a38 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:06.883662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037d3d-ec8c-4d0c-95fd-992684221a38 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:06.883945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037d3d-ec8c-4d0c-95fd-992684221a38 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:06.884564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58037d3d-ec8c-4d0c-95fd-992684221a38 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=834850eacd9b4e9a81bcb6f28c1ba765)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:06.886071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58037d3d-ec8c-4d0c-95fd-992684221a38 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:06.922774 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4195/8400] 10.222.0.70 () {60 vars in 1299 bytes} [Sun Aug 28 19:36:06 2022] POST /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2 => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:06.927357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca0e77-8244-478b-a93d-a966d70871c9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:06.938640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca0e77-8244-478b-a93d-a966d70871c9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:06.943025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68477b-2a09-482e-a926-a563827525dd tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '834850eacd9b4e9a81bcb6f28c1ba765', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3352e3e40d540a59aceaba2b38c5863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:06.943715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68477b-2a09-482e-a926-a563827525dd tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:06.944012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68477b-2a09-482e-a926-a563827525dd tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:06.944296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68477b-2a09-482e-a926-a563827525dd tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/c1dbb2e0fbe145bd8a6cae3533cfa2af` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:06.946423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68477b-2a09-482e-a926-a563827525dd tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=834850eacd9b4e9a81bcb6f28c1ba765, credential_id=c1dbb2e0fbe145bd8a6cae3533cfa2af)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:06.948125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68477b-2a09-482e-a926-a563827525dd tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:06.977091 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4206/8401] 10.222.0.70 () {58 vars in 1380 bytes} [Sun Aug 28 19:36:06 2022] DELETE /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/c1dbb2e0fbe145bd8a6cae3533cfa2af => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:06.978323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58037d3d-ec8c-4d0c-95fd-992684221a38 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:06.989063 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58037d3d-ec8c-4d0c-95fd-992684221a38 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:06.994015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf11178-d65a-44a7-a8e4-155ddbfee48a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '834850eacd9b4e9a81bcb6f28c1ba765', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3352e3e40d540a59aceaba2b38c5863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:06.995862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf11178-d65a-44a7-a8e4-155ddbfee48a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:06.996234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf11178-d65a-44a7-a8e4-155ddbfee48a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:06.996577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf11178-d65a-44a7-a8e4-155ddbfee48a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:06.997272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf11178-d65a-44a7-a8e4-155ddbfee48a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=834850eacd9b4e9a81bcb6f28c1ba765)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:06.998992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf11178-d65a-44a7-a8e4-155ddbfee48a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:07.019622 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4196/8402] 10.222.0.70 () {60 vars in 1299 bytes} [Sun Aug 28 19:36:06 2022] POST /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2 => generated 367 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:07.023824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68477b-2a09-482e-a926-a563827525dd tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:07.034561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68477b-2a09-482e-a926-a563827525dd tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:07.039911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155c18-6f95-4c22-9d1a-9a0f87d2778f tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '834850eacd9b4e9a81bcb6f28c1ba765', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3352e3e40d540a59aceaba2b38c5863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:07.041067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155c18-6f95-4c22-9d1a-9a0f87d2778f tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.042938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155c18-6f95-4c22-9d1a-9a0f87d2778f tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.043549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155c18-6f95-4c22-9d1a-9a0f87d2778f tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/7c0f0feefcb443d4b724785e150dc7eb` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.046856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155c18-6f95-4c22-9d1a-9a0f87d2778f tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=834850eacd9b4e9a81bcb6f28c1ba765, credential_id=7c0f0feefcb443d4b724785e150dc7eb)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:07.049000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155c18-6f95-4c22-9d1a-9a0f87d2778f tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:07.072343 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4207/8403] 10.222.0.70 () {58 vars in 1380 bytes} [Sun Aug 28 19:36:07 2022] DELETE /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/7c0f0feefcb443d4b724785e150dc7eb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:07.076737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf11178-d65a-44a7-a8e4-155ddbfee48a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:07.086930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf11178-d65a-44a7-a8e4-155ddbfee48a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:07.093688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52622665-77fb-4de2-952a-df4d3f2da0c1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '834850eacd9b4e9a81bcb6f28c1ba765', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3352e3e40d540a59aceaba2b38c5863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:07.093688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52622665-77fb-4de2-952a-df4d3f2da0c1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.093688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52622665-77fb-4de2-952a-df4d3f2da0c1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.094043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52622665-77fb-4de2-952a-df4d3f2da0c1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/7c0f0feefcb443d4b724785e150dc7eb` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application [None req-52622665-77fb-4de2-952a-df4d3f2da0c1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Could not find credential: 9f1cd2205f8ed0b56c367afc30320dd4ff271d46937ac2c5d7309425eaa6ee8d.: keystone.exception.CredentialNotFound: Could not find credential: 9f1cd2205f8ed0b56c367afc30320dd4ff271d46937ac2c5d7309425eaa6ee8d. Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Aug 28 19:36:07.127357 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application with Lock( Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 19:36:07.128748 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._enter() Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.creator() Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application created_value = creator( Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 9f1cd2205f8ed0b56c367afc30320dd4ff271d46937ac2c5d7309425eaa6ee8d. Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: ERROR keystone.server.flask.application Aug 28 19:36:07.134640 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4197/8404] 10.222.0.70 () {58 vars in 1377 bytes} [Sun Aug 28 19:36:07 2022] GET /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/7c0f0feefcb443d4b724785e150dc7eb => generated 148 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 28 19:36:07.136598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155c18-6f95-4c22-9d1a-9a0f87d2778f tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:07.145408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155c18-6f95-4c22-9d1a-9a0f87d2778f tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:07.150064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109248d-55c4-47b4-b4ad-784c8dcbe8a7 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '834850eacd9b4e9a81bcb6f28c1ba765', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3352e3e40d540a59aceaba2b38c5863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:07.151325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109248d-55c4-47b4-b4ad-784c8dcbe8a7 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.151726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109248d-55c4-47b4-b4ad-784c8dcbe8a7 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.151998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109248d-55c4-47b4-b4ad-784c8dcbe8a7 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.152617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109248d-55c4-47b4-b4ad-784c8dcbe8a7 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=834850eacd9b4e9a81bcb6f28c1ba765)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:07.154111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109248d-55c4-47b4-b4ad-784c8dcbe8a7 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:07.191800 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4208/8405] 10.222.0.70 () {60 vars in 1299 bytes} [Sun Aug 28 19:36:07 2022] POST /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2 => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:07.197324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52622665-77fb-4de2-952a-df4d3f2da0c1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:07.209576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52622665-77fb-4de2-952a-df4d3f2da0c1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:07.214106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595ae47-3c9c-4e57-89ce-88a27c41692b tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '834850eacd9b4e9a81bcb6f28c1ba765', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3352e3e40d540a59aceaba2b38c5863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:07.214778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595ae47-3c9c-4e57-89ce-88a27c41692b tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.215066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595ae47-3c9c-4e57-89ce-88a27c41692b tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.215336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595ae47-3c9c-4e57-89ce-88a27c41692b tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.215939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595ae47-3c9c-4e57-89ce-88a27c41692b tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=834850eacd9b4e9a81bcb6f28c1ba765)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:07.217513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595ae47-3c9c-4e57-89ce-88a27c41692b tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:07.237457 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4198/8406] 10.222.0.70 () {60 vars in 1299 bytes} [Sun Aug 28 19:36:07 2022] POST /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2 => generated 367 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:07.238596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109248d-55c4-47b4-b4ad-784c8dcbe8a7 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:07.249677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109248d-55c4-47b4-b4ad-784c8dcbe8a7 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:07.257107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094d7c5-ce12-428d-beca-eaa5b53c005a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '834850eacd9b4e9a81bcb6f28c1ba765', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3352e3e40d540a59aceaba2b38c5863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:07.257844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094d7c5-ce12-428d-beca-eaa5b53c005a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.258209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094d7c5-ce12-428d-beca-eaa5b53c005a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.259114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094d7c5-ce12-428d-beca-eaa5b53c005a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.259784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094d7c5-ce12-428d-beca-eaa5b53c005a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=834850eacd9b4e9a81bcb6f28c1ba765)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:07.262508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094d7c5-ce12-428d-beca-eaa5b53c005a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:07.274011 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4209/8407] 10.222.0.70 () {58 vars in 1278 bytes} [Sun Aug 28 19:36:07 2022] GET /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2 => generated 865 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:07.278864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595ae47-3c9c-4e57-89ce-88a27c41692b tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:07.285474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:07.289803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595ae47-3c9c-4e57-89ce-88a27c41692b tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:07.298229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af234399-f318-4963-a953-5c4bb876cdbf tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '834850eacd9b4e9a81bcb6f28c1ba765', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3352e3e40d540a59aceaba2b38c5863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:07.299324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af234399-f318-4963-a953-5c4bb876cdbf tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.299679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af234399-f318-4963-a953-5c4bb876cdbf tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.300079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af234399-f318-4963-a953-5c4bb876cdbf tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/4a268987911144f6bc1816fea1b183ea` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.302128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af234399-f318-4963-a953-5c4bb876cdbf tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=834850eacd9b4e9a81bcb6f28c1ba765, credential_id=4a268987911144f6bc1816fea1b183ea)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:07.304213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af234399-f318-4963-a953-5c4bb876cdbf tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:07.323092 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4199/8408] 10.222.0.70 () {58 vars in 1380 bytes} [Sun Aug 28 19:36:07 2022] DELETE /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/4a268987911144f6bc1816fea1b183ea => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:07.327682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094d7c5-ce12-428d-beca-eaa5b53c005a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:07.337917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094d7c5-ce12-428d-beca-eaa5b53c005a tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:07.343194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c893d-6e56-4127-b1fe-17066fe55bb1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '834850eacd9b4e9a81bcb6f28c1ba765', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3352e3e40d540a59aceaba2b38c5863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:07.343853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c893d-6e56-4127-b1fe-17066fe55bb1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.344146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c893d-6e56-4127-b1fe-17066fe55bb1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.344429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c893d-6e56-4127-b1fe-17066fe55bb1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/820293bada8d4c8494f99437fcba5cbe` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.346380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c893d-6e56-4127-b1fe-17066fe55bb1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=834850eacd9b4e9a81bcb6f28c1ba765, credential_id=820293bada8d4c8494f99437fcba5cbe)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:07.347864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c893d-6e56-4127-b1fe-17066fe55bb1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:07.366313 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4210/8409] 10.222.0.70 () {58 vars in 1380 bytes} [Sun Aug 28 19:36:07 2022] DELETE /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/820293bada8d4c8494f99437fcba5cbe => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:36:07.372213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af234399-f318-4963-a953-5c4bb876cdbf tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:07.382341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af234399-f318-4963-a953-5c4bb876cdbf tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:07.387985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8d5c9-19db-40c0-8d23-d67028967ba6 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '834850eacd9b4e9a81bcb6f28c1ba765', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3352e3e40d540a59aceaba2b38c5863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:07.388627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d5c9-19db-40c0-8d23-d67028967ba6 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.388906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d5c9-19db-40c0-8d23-d67028967ba6 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.389177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d5c9-19db-40c0-8d23-d67028967ba6 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.389804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8d5c9-19db-40c0-8d23-d67028967ba6 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=834850eacd9b4e9a81bcb6f28c1ba765)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:07.391334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8d5c9-19db-40c0-8d23-d67028967ba6 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:07.407587 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4200/8410] 10.222.0.70 () {60 vars in 1299 bytes} [Sun Aug 28 19:36:07 2022] POST /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2 => generated 367 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:07.412033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c893d-6e56-4127-b1fe-17066fe55bb1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:07.423533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c893d-6e56-4127-b1fe-17066fe55bb1 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:07.427898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0790707-1014-4f50-ad97-322132b2ccf3 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '834850eacd9b4e9a81bcb6f28c1ba765', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3352e3e40d540a59aceaba2b38c5863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:07.428552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0790707-1014-4f50-ad97-322132b2ccf3 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.428840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0790707-1014-4f50-ad97-322132b2ccf3 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.429120 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0790707-1014-4f50-ad97-322132b2ccf3 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/0563031c17eb490ea877d2a8cbe7af1e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.431087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0790707-1014-4f50-ad97-322132b2ccf3 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=834850eacd9b4e9a81bcb6f28c1ba765, credential_id=0563031c17eb490ea877d2a8cbe7af1e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:07.433870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0790707-1014-4f50-ad97-322132b2ccf3 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:07.436907 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4211/8411] 10.222.0.70 () {58 vars in 1377 bytes} [Sun Aug 28 19:36:07 2022] GET /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/0563031c17eb490ea877d2a8cbe7af1e => generated 367 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:07.441584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8d5c9-19db-40c0-8d23-d67028967ba6 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:07.452394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8d5c9-19db-40c0-8d23-d67028967ba6 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:07.456668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f5c67-8132-47b6-a9f9-1389bd65c386 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '834850eacd9b4e9a81bcb6f28c1ba765', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3352e3e40d540a59aceaba2b38c5863', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:07.457315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f5c67-8132-47b6-a9f9-1389bd65c386 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.457598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f5c67-8132-47b6-a9f9-1389bd65c386 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.457876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f5c67-8132-47b6-a9f9-1389bd65c386 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/0563031c17eb490ea877d2a8cbe7af1e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.460025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f5c67-8132-47b6-a9f9-1389bd65c386 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=834850eacd9b4e9a81bcb6f28c1ba765, credential_id=0563031c17eb490ea877d2a8cbe7af1e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:07.461466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f5c67-8132-47b6-a9f9-1389bd65c386 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:07.479832 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4201/8412] 10.222.0.70 () {58 vars in 1380 bytes} [Sun Aug 28 19:36:07 2022] DELETE /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765/credentials/OS-EC2/0563031c17eb490ea877d2a8cbe7af1e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:07.484882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0790707-1014-4f50-ad97-322132b2ccf3 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:07.524367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:07.558465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0790707-1014-4f50-ad97-322132b2ccf3 tempest-EC2CredentialsTest-1217003569 tempest-EC2CredentialsTest-1217003569-project] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:07.568269 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:07.568944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.569229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.569506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] PATH_INFO: `/v3/users/834850eacd9b4e9a81bcb6f28c1ba765` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.570712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=834850eacd9b4e9a81bcb6f28c1ba765)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:07.573271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:07.632169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '834850eacd9b4e9a81bcb6f28c1ba765'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:07.640237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '834850eacd9b4e9a81bcb6f28c1ba765'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:07.641098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '834850eacd9b4e9a81bcb6f28c1ba765'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:07.656622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '834850eacd9b4e9a81bcb6f28c1ba765'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:07.657363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '834850eacd9b4e9a81bcb6f28c1ba765'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:07.671429 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4212/8413] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:07 2022] DELETE /identity/v3/users/834850eacd9b4e9a81bcb6f28c1ba765 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:07.676038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297ccd0-605a-46ef-8960-2b51ccb57d37 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.676559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297ccd0-605a-46ef-8960-2b51ccb57d37 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.676687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297ccd0-605a-46ef-8960-2b51ccb57d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.697888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d297ccd0-605a-46ef-8960-2b51ccb57d37 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:07.699028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d297ccd0-605a-46ef-8960-2b51ccb57d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:07.764640 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4202/8414] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:36:07.775413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:07.777679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:07.846645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef98d19-1516-4165-9681-46fa2e26e4c3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:07.850394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55137c49-dc4c-4dd6-8daa-60c319a56089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:07.851048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55137c49-dc4c-4dd6-8daa-60c319a56089 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:07.851333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55137c49-dc4c-4dd6-8daa-60c319a56089 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:07.851611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55137c49-dc4c-4dd6-8daa-60c319a56089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:07.862382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55137c49-dc4c-4dd6-8daa-60c319a56089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:07.863886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55137c49-dc4c-4dd6-8daa-60c319a56089 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:07.875195 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4213/8415] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:08.165129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297ccd0-605a-46ef-8960-2b51ccb57d37 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:08.167254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d297ccd0-605a-46ef-8960-2b51ccb57d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:08.196053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297ccd0-605a-46ef-8960-2b51ccb57d37 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:08.202797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:08.203382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:08.203707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:08.203930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8 admin admin] PATH_INFO: `/v3/projects/f3352e3e40d540a59aceaba2b38c5863` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:08.205072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3352e3e40d540a59aceaba2b38c5863)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:08.208135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:08.270256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3352e3e40d540a59aceaba2b38c5863', 'request_id': 'req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:08.276521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3352e3e40d540a59aceaba2b38c5863', 'request_id': 'req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:08.284109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3352e3e40d540a59aceaba2b38c5863', 'request_id': 'req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:08.298807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8 admin admin] The token cache is being invalidate because project f3352e3e40d540a59aceaba2b38c5863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:08.299104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:08.299807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c6ea214-81dc-42f1-a6c3-2d6624a379e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:08.302204 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4203/8416] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:36:08 2022] DELETE /identity/v3/projects/f3352e3e40d540a59aceaba2b38c5863 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:08.308245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd626d-ec97-45b9-b365-f35b64f8a888 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:08.308548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd626d-ec97-45b9-b365-f35b64f8a888 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:08.308908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd626d-ec97-45b9-b365-f35b64f8a888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:08.339634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-23fd626d-ec97-45b9-b365-f35b64f8a888 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:08.339634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-23fd626d-ec97-45b9-b365-f35b64f8a888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:08.414014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:08.428501 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4214/8417] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:08.437690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9c0c-e015-42fa-aa87-8169f490cfed None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:08.438094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9c0c-e015-42fa-aa87-8169f490cfed None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:08.438392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9c0c-e015-42fa-aa87-8169f490cfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:08.461112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d91e9c0c-e015-42fa-aa87-8169f490cfed None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:08.462331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d91e9c0c-e015-42fa-aa87-8169f490cfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:08.474529 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4204/8418] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:08.475571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd626d-ec97-45b9-b365-f35b64f8a888 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:08.486696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd626d-ec97-45b9-b365-f35b64f8a888 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:08.491465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdac4b-120d-427a-a47b-d783d737daf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:08.492270 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdac4b-120d-427a-a47b-d783d737daf3 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:08.492613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdac4b-120d-427a-a47b-d783d737daf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:08.492896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdac4b-120d-427a-a47b-d783d737daf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:08.493549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdac4b-120d-427a-a47b-d783d737daf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:36:08.493849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdac4b-120d-427a-a47b-d783d737daf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:08.496142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdac4b-120d-427a-a47b-d783d737daf3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:08.511898 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4215/8419] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:08.513375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e9c0c-e015-42fa-aa87-8169f490cfed None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:08.523157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e9c0c-e015-42fa-aa87-8169f490cfed None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:08.528912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f641-e995-4945-b7b8-1528d5e3a870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:08.529530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f641-e995-4945-b7b8-1528d5e3a870 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:08.529816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f641-e995-4945-b7b8-1528d5e3a870 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:08.530095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81f641-e995-4945-b7b8-1528d5e3a870 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:08.530765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f641-e995-4945-b7b8-1528d5e3a870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:08.532709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81f641-e995-4945-b7b8-1528d5e3a870 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:08.566219 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4205/8420] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:36:08 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:08.567410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdac4b-120d-427a-a47b-d783d737daf3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:08.579357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdac4b-120d-427a-a47b-d783d737daf3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:08.644790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c5dd4-6ec1-4f85-b95d-ea788b9a4a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:08.645331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c5dd4-6ec1-4f85-b95d-ea788b9a4a7b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:08.648422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c5dd4-6ec1-4f85-b95d-ea788b9a4a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:08.648422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c5dd4-6ec1-4f85-b95d-ea788b9a4a7b admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:08.648422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c5dd4-6ec1-4f85-b95d-ea788b9a4a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:08.648760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c5dd4-6ec1-4f85-b95d-ea788b9a4a7b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:08.671359 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4216/8421] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:36:08 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:08.675618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f641-e995-4945-b7b8-1528d5e3a870 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:08.686714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81f641-e995-4945-b7b8-1528d5e3a870 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:08.691684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c2dd0-fc27-469a-a1e0-5ec2c1094741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:08.692296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c2dd0-fc27-469a-a1e0-5ec2c1094741 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:08.692580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c2dd0-fc27-469a-a1e0-5ec2c1094741 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:08.692855 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c2dd0-fc27-469a-a1e0-5ec2c1094741 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:08.693710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c2dd0-fc27-469a-a1e0-5ec2c1094741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:08.695245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c2dd0-fc27-469a-a1e0-5ec2c1094741 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:08.706357 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4206/8422] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:36:08.710778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c5dd4-6ec1-4f85-b95d-ea788b9a4a7b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:08.722532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c5dd4-6ec1-4f85-b95d-ea788b9a4a7b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:08.738854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d81ee0-85a8-4328-96ad-d05c1c343346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:08.739554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d81ee0-85a8-4328-96ad-d05c1c343346 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:08.739840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d81ee0-85a8-4328-96ad-d05c1c343346 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:08.740126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d81ee0-85a8-4328-96ad-d05c1c343346 admin admin] PATH_INFO: `/v3/projects/f4602cd3ad594454b2d898be42c6469a/users/96125fbfd53140d183f177f4db04274b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:08.758160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d81ee0-85a8-4328-96ad-d05c1c343346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4602cd3ad594454b2d898be42c6469a, user_id=96125fbfd53140d183f177f4db04274b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:08.761373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d81ee0-85a8-4328-96ad-d05c1c343346 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:08.776282 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4217/8423] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:36:08 2022] PUT /identity/v3/projects/f4602cd3ad594454b2d898be42c6469a/users/96125fbfd53140d183f177f4db04274b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:08.780472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c2dd0-fc27-469a-a1e0-5ec2c1094741 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:08.786904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:08.794851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c2dd0-fc27-469a-a1e0-5ec2c1094741 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:08.858761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fa7a8-5770-4701-ba0f-53585327da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:08.859432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fa7a8-5770-4701-ba0f-53585327da5c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:08.859719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fa7a8-5770-4701-ba0f-53585327da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:08.859997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fa7a8-5770-4701-ba0f-53585327da5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:08.860641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fa7a8-5770-4701-ba0f-53585327da5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:08.862265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fa7a8-5770-4701-ba0f-53585327da5c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:08.874291 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4207/8424] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:36:08.878673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d81ee0-85a8-4328-96ad-d05c1c343346 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:08.889688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d81ee0-85a8-4328-96ad-d05c1c343346 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:08.894932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29be84-eb7b-495e-a7b6-89fe12da09dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:08.895536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29be84-eb7b-495e-a7b6-89fe12da09dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:08.895817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29be84-eb7b-495e-a7b6-89fe12da09dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:08.896092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29be84-eb7b-495e-a7b6-89fe12da09dc admin admin] PATH_INFO: `/v3/projects/f4602cd3ad594454b2d898be42c6469a/users/96125fbfd53140d183f177f4db04274b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:08.898079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29be84-eb7b-495e-a7b6-89fe12da09dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4602cd3ad594454b2d898be42c6469a, user_id=96125fbfd53140d183f177f4db04274b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:08.901302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29be84-eb7b-495e-a7b6-89fe12da09dc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:08.913033 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4218/8425] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:36:08 2022] PUT /identity/v3/projects/f4602cd3ad594454b2d898be42c6469a/users/96125fbfd53140d183f177f4db04274b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:08.924500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c21e-714d-44c8-8773-558c2c64828e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:08.925071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c21e-714d-44c8-8773-558c2c64828e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:08.925352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c21e-714d-44c8-8773-558c2c64828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:08.955584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6042c21e-714d-44c8-8773-558c2c64828e None None] MFA Rules not processed for user `96125fbfd53140d183f177f4db04274b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:08.956964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6042c21e-714d-44c8-8773-558c2c64828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:09.034704 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4208/8426] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:09.039185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29be84-eb7b-495e-a7b6-89fe12da09dc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:09.113077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29be84-eb7b-495e-a7b6-89fe12da09dc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:09.119341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594ef0d-4f2e-4e20-ba2e-b5a69ee87fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:09.120848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594ef0d-4f2e-4e20-ba2e-b5a69ee87fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:09.121212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594ef0d-4f2e-4e20-ba2e-b5a69ee87fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:09.121497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594ef0d-4f2e-4e20-ba2e-b5a69ee87fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:09.122155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594ef0d-4f2e-4e20-ba2e-b5a69ee87fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:09.124159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594ef0d-4f2e-4e20-ba2e-b5a69ee87fb3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:09.159063 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4219/8427] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:36:09 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:36:09.162963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042c21e-714d-44c8-8773-558c2c64828e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:09.174691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042c21e-714d-44c8-8773-558c2c64828e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:09.238350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c290e2-9436-499f-b5c4-7fedc28ffed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:09.239000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c290e2-9436-499f-b5c4-7fedc28ffed0 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:09.239289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c290e2-9436-499f-b5c4-7fedc28ffed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:09.239629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c290e2-9436-499f-b5c4-7fedc28ffed0 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:09.240272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c290e2-9436-499f-b5c4-7fedc28ffed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:09.242195 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c290e2-9436-499f-b5c4-7fedc28ffed0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:09.269440 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4209/8428] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:36:09 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:09.270696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594ef0d-4f2e-4e20-ba2e-b5a69ee87fb3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:09.282160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594ef0d-4f2e-4e20-ba2e-b5a69ee87fb3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:09.286916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1a523-cfe3-4448-b98e-2b06fb2b1395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:09.287669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1a523-cfe3-4448-b98e-2b06fb2b1395 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:09.287964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1a523-cfe3-4448-b98e-2b06fb2b1395 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:09.288241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1a523-cfe3-4448-b98e-2b06fb2b1395 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:09.288892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1a523-cfe3-4448-b98e-2b06fb2b1395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:09.290487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1a523-cfe3-4448-b98e-2b06fb2b1395 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:09.305030 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4220/8429] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:36:09.309343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c290e2-9436-499f-b5c4-7fedc28ffed0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:09.320362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c290e2-9436-499f-b5c4-7fedc28ffed0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:09.325934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c66d5-db02-40ca-a68e-7eaad96baac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:09.326546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c66d5-db02-40ca-a68e-7eaad96baac6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:09.326866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c66d5-db02-40ca-a68e-7eaad96baac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:09.327148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c66d5-db02-40ca-a68e-7eaad96baac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:09.327821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c66d5-db02-40ca-a68e-7eaad96baac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:09.329427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c66d5-db02-40ca-a68e-7eaad96baac6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:09.341558 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4210/8430] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:36:09.345901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1a523-cfe3-4448-b98e-2b06fb2b1395 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:09.357981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1a523-cfe3-4448-b98e-2b06fb2b1395 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:09.363583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4efa8a-d3b2-4507-95d5-b2e08546c8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:09.364249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4efa8a-d3b2-4507-95d5-b2e08546c8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:09.364542 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4efa8a-d3b2-4507-95d5-b2e08546c8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:09.364833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4efa8a-d3b2-4507-95d5-b2e08546c8d6 admin admin] PATH_INFO: `/v3/projects/b8584432948149cf9dc291778e291035/users/41ffffb14b3b4c4fbc47d3bd2a051860/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:09.368803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:09.384127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4efa8a-d3b2-4507-95d5-b2e08546c8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8584432948149cf9dc291778e291035, user_id=41ffffb14b3b4c4fbc47d3bd2a051860, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:09.388004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4efa8a-d3b2-4507-95d5-b2e08546c8d6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:09.404530 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4221/8431] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:36:09 2022] PUT /identity/v3/projects/b8584432948149cf9dc291778e291035/users/41ffffb14b3b4c4fbc47d3bd2a051860/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:09.416322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edec14-99ab-413f-9c77-08ee1b9024ed None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:09.416625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edec14-99ab-413f-9c77-08ee1b9024ed None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:09.416909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edec14-99ab-413f-9c77-08ee1b9024ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:09.426258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:09.461324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f7edec14-99ab-413f-9c77-08ee1b9024ed None None] MFA Rules not processed for user `41ffffb14b3b4c4fbc47d3bd2a051860`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:09.462544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f7edec14-99ab-413f-9c77-08ee1b9024ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:09.550795 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4211/8432] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:09.566608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4efa8a-d3b2-4507-95d5-b2e08546c8d6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:09.569237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0d4efa8a-d3b2-4507-95d5-b2e08546c8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:09.635379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4efa8a-d3b2-4507-95d5-b2e08546c8d6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:09.639306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953bd9d-61f5-4b93-8978-5ebdfda4bedc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:09.640000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953bd9d-61f5-4b93-8978-5ebdfda4bedc service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:09.640297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953bd9d-61f5-4b93-8978-5ebdfda4bedc service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:09.640584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953bd9d-61f5-4b93-8978-5ebdfda4bedc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:09.706831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953bd9d-61f5-4b93-8978-5ebdfda4bedc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:09.708204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953bd9d-61f5-4b93-8978-5ebdfda4bedc service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:09.719482 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4222/8433] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:10.003781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edec14-99ab-413f-9c77-08ee1b9024ed None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:10.086571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edec14-99ab-413f-9c77-08ee1b9024ed None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:10.091276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:10.091915 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:10.092190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:10.092459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] PATH_INFO: `/v3/users/96125fbfd53140d183f177f4db04274b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:10.093570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96125fbfd53140d183f177f4db04274b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:10.095626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:10.150511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96125fbfd53140d183f177f4db04274b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:10.160429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96125fbfd53140d183f177f4db04274b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:10.161155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96125fbfd53140d183f177f4db04274b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:10.171178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96125fbfd53140d183f177f4db04274b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:10.172422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96125fbfd53140d183f177f4db04274b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:10.196294 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4212/8434] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:10 2022] DELETE /identity/v3/users/96125fbfd53140d183f177f4db04274b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:36:10.202020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082256b-702b-4fce-9390-2646269e9470 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:10.202532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082256b-702b-4fce-9390-2646269e9470 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:10.202818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082256b-702b-4fce-9390-2646269e9470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:10.231244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b082256b-702b-4fce-9390-2646269e9470 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:10.234896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b082256b-702b-4fce-9390-2646269e9470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:10.313702 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4223/8435] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:10.324505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:10.326005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:10.342575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:10.410858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed873339-74d7-45b0-9fcb-88fd2ee00ab7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:10.414841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94f7a-24fa-42ad-b297-2aac68ba0602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:10.415743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94f7a-24fa-42ad-b297-2aac68ba0602 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:10.416086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94f7a-24fa-42ad-b297-2aac68ba0602 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:10.417625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94f7a-24fa-42ad-b297-2aac68ba0602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:10.427945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f94f7a-24fa-42ad-b297-2aac68ba0602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:10.430149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f94f7a-24fa-42ad-b297-2aac68ba0602 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:10.445455 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4213/8436] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:10.884667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082256b-702b-4fce-9390-2646269e9470 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:10.887830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b082256b-702b-4fce-9390-2646269e9470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:10.903988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082256b-702b-4fce-9390-2646269e9470 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:10.912644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:10.913317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:10.913604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:10.913888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] PATH_INFO: `/v3/projects/f4602cd3ad594454b2d898be42c6469a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:10.915354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4602cd3ad594454b2d898be42c6469a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:10.918429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:10.985872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:11.019603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4602cd3ad594454b2d898be42c6469a', 'request_id': 'req-0e8250cc-54f0-4010-b4ce-efd46bab20d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.029788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4602cd3ad594454b2d898be42c6469a', 'request_id': 'req-0e8250cc-54f0-4010-b4ce-efd46bab20d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.037238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4602cd3ad594454b2d898be42c6469a', 'request_id': 'req-0e8250cc-54f0-4010-b4ce-efd46bab20d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.056180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] The token cache is being invalidate because project f4602cd3ad594454b2d898be42c6469a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:11.056779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.058181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.063489 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4224/8437] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:36:10 2022] DELETE /identity/v3/projects/f4602cd3ad594454b2d898be42c6469a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:11.065134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94f7a-24fa-42ad-b297-2aac68ba0602 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:11.083737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94f7a-24fa-42ad-b297-2aac68ba0602 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:11.205548 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5685ca4-7007-4336-a435-1c28728703a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:11.206585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5685ca4-7007-4336-a435-1c28728703a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:11.207033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5685ca4-7007-4336-a435-1c28728703a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:11.207396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5685ca4-7007-4336-a435-1c28728703a0 admin admin] PATH_INFO: `/v3/users/41ffffb14b3b4c4fbc47d3bd2a051860` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:11.208780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5685ca4-7007-4336-a435-1c28728703a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ffffb14b3b4c4fbc47d3bd2a051860)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:11.210912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5685ca4-7007-4336-a435-1c28728703a0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:11.279610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d5685ca4-7007-4336-a435-1c28728703a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ffffb14b3b4c4fbc47d3bd2a051860'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.286849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d5685ca4-7007-4336-a435-1c28728703a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ffffb14b3b4c4fbc47d3bd2a051860'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.287555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d5685ca4-7007-4336-a435-1c28728703a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ffffb14b3b4c4fbc47d3bd2a051860'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.296085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d5685ca4-7007-4336-a435-1c28728703a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ffffb14b3b4c4fbc47d3bd2a051860'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.296791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d5685ca4-7007-4336-a435-1c28728703a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ffffb14b3b4c4fbc47d3bd2a051860'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.316026 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4214/8438] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:11 2022] DELETE /identity/v3/users/41ffffb14b3b4c4fbc47d3bd2a051860 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:36:11.654366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:11.654366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:11.670519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8250cc-54f0-4010-b4ce-efd46bab20d5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:11.739454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee92f3-602b-4989-9edd-659015d85eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:11.740101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee92f3-602b-4989-9edd-659015d85eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:11.740384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee92f3-602b-4989-9edd-659015d85eae admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:11.740657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee92f3-602b-4989-9edd-659015d85eae admin admin] PATH_INFO: `/v3/projects/b8584432948149cf9dc291778e291035` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:11.741770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee92f3-602b-4989-9edd-659015d85eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8584432948149cf9dc291778e291035)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:11.743710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee92f3-602b-4989-9edd-659015d85eae admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:11.795984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-94ee92f3-602b-4989-9edd-659015d85eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8584432948149cf9dc291778e291035', 'request_id': 'req-94ee92f3-602b-4989-9edd-659015d85eae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.805521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-94ee92f3-602b-4989-9edd-659015d85eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8584432948149cf9dc291778e291035', 'request_id': 'req-94ee92f3-602b-4989-9edd-659015d85eae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.812631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-94ee92f3-602b-4989-9edd-659015d85eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8584432948149cf9dc291778e291035', 'request_id': 'req-94ee92f3-602b-4989-9edd-659015d85eae'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.824547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-94ee92f3-602b-4989-9edd-659015d85eae admin admin] The token cache is being invalidate because project b8584432948149cf9dc291778e291035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:11.824839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-94ee92f3-602b-4989-9edd-659015d85eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.825503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-94ee92f3-602b-4989-9edd-659015d85eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:11.827235 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4225/8439] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:36:11 2022] DELETE /identity/v3/projects/b8584432948149cf9dc291778e291035 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:11.832663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0a1a8-5519-4134-a867-d2e3e3f14b8b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:11.833208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0a1a8-5519-4134-a867-d2e3e3f14b8b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:11.833488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0a1a8-5519-4134-a867-d2e3e3f14b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:11.855759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-bdc0a1a8-5519-4134-a867-d2e3e3f14b8b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:11.856976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-bdc0a1a8-5519-4134-a867-d2e3e3f14b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:11.889293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:11.922410 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4215/8440] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:11.929604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc780be-d4cc-455a-9482-c1d3232cace0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:11.929891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc780be-d4cc-455a-9482-c1d3232cace0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:11.930171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc780be-d4cc-455a-9482-c1d3232cace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:11.953770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1bc780be-d4cc-455a-9482-c1d3232cace0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:11.955073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1bc780be-d4cc-455a-9482-c1d3232cace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:11.968326 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4226/8441] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:11.972309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0a1a8-5519-4134-a867-d2e3e3f14b8b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:11.982860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0a1a8-5519-4134-a867-d2e3e3f14b8b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:11.988463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18adba8-e177-4aea-acfa-107c22705b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:11.989082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18adba8-e177-4aea-acfa-107c22705b5e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:11.989362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18adba8-e177-4aea-acfa-107c22705b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:11.989633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18adba8-e177-4aea-acfa-107c22705b5e admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:11.990289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18adba8-e177-4aea-acfa-107c22705b5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:36:11.990594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18adba8-e177-4aea-acfa-107c22705b5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:11.992240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18adba8-e177-4aea-acfa-107c22705b5e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:12.007774 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4216/8442] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:36:12.012731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc780be-d4cc-455a-9482-c1d3232cace0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:12.024004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc780be-d4cc-455a-9482-c1d3232cace0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:12.029895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9ec5d-b5b4-4111-8164-abe0b6696011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:12.030531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9ec5d-b5b4-4111-8164-abe0b6696011 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:12.030849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9ec5d-b5b4-4111-8164-abe0b6696011 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:12.031133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9ec5d-b5b4-4111-8164-abe0b6696011 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:12.031790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9ec5d-b5b4-4111-8164-abe0b6696011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:12.033780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9ec5d-b5b4-4111-8164-abe0b6696011 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:12.064953 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4227/8443] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:36:12 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:12.069256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18adba8-e177-4aea-acfa-107c22705b5e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:12.084991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18adba8-e177-4aea-acfa-107c22705b5e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:12.153525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68ab6d-0c65-4382-9414-37987aa40b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:12.154181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68ab6d-0c65-4382-9414-37987aa40b06 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:12.154472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68ab6d-0c65-4382-9414-37987aa40b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:12.154921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68ab6d-0c65-4382-9414-37987aa40b06 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:12.155579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68ab6d-0c65-4382-9414-37987aa40b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:12.160049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68ab6d-0c65-4382-9414-37987aa40b06 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:12.185687 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4217/8444] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:36:12 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:36:12.187340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9ec5d-b5b4-4111-8164-abe0b6696011 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:12.198936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9ec5d-b5b4-4111-8164-abe0b6696011 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:12.203751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf3432-3ef3-40a0-ad4c-9047b30de726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:12.204372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf3432-3ef3-40a0-ad4c-9047b30de726 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:12.204659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf3432-3ef3-40a0-ad4c-9047b30de726 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:12.204943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf3432-3ef3-40a0-ad4c-9047b30de726 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:12.205588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf3432-3ef3-40a0-ad4c-9047b30de726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:12.207323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf3432-3ef3-40a0-ad4c-9047b30de726 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:12.220262 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4228/8445] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:36:12.223479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68ab6d-0c65-4382-9414-37987aa40b06 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:12.234833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68ab6d-0c65-4382-9414-37987aa40b06 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:12.239521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66971ad0-15dc-47ad-82f8-2f36b22bcf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:12.240125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66971ad0-15dc-47ad-82f8-2f36b22bcf1e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:12.240407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66971ad0-15dc-47ad-82f8-2f36b22bcf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:12.240688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66971ad0-15dc-47ad-82f8-2f36b22bcf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:12.241327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66971ad0-15dc-47ad-82f8-2f36b22bcf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:12.242949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66971ad0-15dc-47ad-82f8-2f36b22bcf1e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:12.254242 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4218/8446] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:36:12.258904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf3432-3ef3-40a0-ad4c-9047b30de726 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:12.272100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf3432-3ef3-40a0-ad4c-9047b30de726 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:12.277575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28148c-a269-4a4e-8a8b-0e24903f828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:12.278245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28148c-a269-4a4e-8a8b-0e24903f828f admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:12.278537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28148c-a269-4a4e-8a8b-0e24903f828f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:12.278854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28148c-a269-4a4e-8a8b-0e24903f828f admin admin] PATH_INFO: `/v3/projects/dab2dd8298154019928acc3d698327fa/users/27c44d668f7948f19a6245a7855a8544/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:12.282877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:12.296981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28148c-a269-4a4e-8a8b-0e24903f828f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab2dd8298154019928acc3d698327fa, user_id=27c44d668f7948f19a6245a7855a8544, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:12.300500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28148c-a269-4a4e-8a8b-0e24903f828f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:12.316488 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4229/8447] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:36:12 2022] PUT /identity/v3/projects/dab2dd8298154019928acc3d698327fa/users/27c44d668f7948f19a6245a7855a8544/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:12.327284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e7b49-e1f6-4ff0-9769-fb152fbc3a73 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:12.327641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e7b49-e1f6-4ff0-9769-fb152fbc3a73 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:12.327986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e7b49-e1f6-4ff0-9769-fb152fbc3a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:12.356353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-978e7b49-e1f6-4ff0-9769-fb152fbc3a73 None None] MFA Rules not processed for user `27c44d668f7948f19a6245a7855a8544`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:12.357561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-978e7b49-e1f6-4ff0-9769-fb152fbc3a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:12.456628 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4219/8448] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:12.475722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28148c-a269-4a4e-8a8b-0e24903f828f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:12.480034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ab28148c-a269-4a4e-8a8b-0e24903f828f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:12.591030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28148c-a269-4a4e-8a8b-0e24903f828f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:12.595378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9cc9d-5f64-4379-b549-7ab9fe7ff857 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:12.595996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9cc9d-5f64-4379-b549-7ab9fe7ff857 service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:12.596265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9cc9d-5f64-4379-b549-7ab9fe7ff857 service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:12.596541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9cc9d-5f64-4379-b549-7ab9fe7ff857 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:12.607202 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9cc9d-5f64-4379-b549-7ab9fe7ff857 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:12.608798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9cc9d-5f64-4379-b549-7ab9fe7ff857 service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:12.622061 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4230/8449] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:12.750507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e7b49-e1f6-4ff0-9769-fb152fbc3a73 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:12.791128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:12.826817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e7b49-e1f6-4ff0-9769-fb152fbc3a73 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:12.834867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:12.835529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:12.835823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:12.836104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] PATH_INFO: `/v3/users/27c44d668f7948f19a6245a7855a8544` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:12.837264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c44d668f7948f19a6245a7855a8544)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:12.840895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:12.894355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c44d668f7948f19a6245a7855a8544'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:12.902075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c44d668f7948f19a6245a7855a8544'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:12.902797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c44d668f7948f19a6245a7855a8544'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:12.911495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c44d668f7948f19a6245a7855a8544'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:12.912118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c44d668f7948f19a6245a7855a8544'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:12.933995 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4220/8450] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:12 2022] DELETE /identity/v3/users/27c44d668f7948f19a6245a7855a8544 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:12.938554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275bd28-6b94-4579-88b1-7dee6432f084 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:12.939070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275bd28-6b94-4579-88b1-7dee6432f084 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:12.939234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275bd28-6b94-4579-88b1-7dee6432f084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:12.959339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c275bd28-6b94-4579-88b1-7dee6432f084 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:12.960617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c275bd28-6b94-4579-88b1-7dee6432f084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:13.027522 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4231/8451] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:13.037243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:13.038688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:13.103611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed466a-859a-438b-99f9-f4b4523e6dda admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:13.108684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e5a58-4b55-4527-8727-c6b96fc45a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:13.109421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e5a58-4b55-4527-8727-c6b96fc45a2a service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:13.109808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e5a58-4b55-4527-8727-c6b96fc45a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:13.110404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e5a58-4b55-4527-8727-c6b96fc45a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:13.124116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e5a58-4b55-4527-8727-c6b96fc45a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:13.125492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e5a58-4b55-4527-8727-c6b96fc45a2a service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:13.137391 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4221/8452] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:13.643207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275bd28-6b94-4579-88b1-7dee6432f084 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:13.644707 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c275bd28-6b94-4579-88b1-7dee6432f084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:13.676415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275bd28-6b94-4579-88b1-7dee6432f084 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:13.681532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:13.682769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:13.683271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:13.683751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52 admin admin] PATH_INFO: `/v3/projects/dab2dd8298154019928acc3d698327fa` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:13.685535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab2dd8298154019928acc3d698327fa)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:13.687529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:13.750267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab2dd8298154019928acc3d698327fa', 'request_id': 'req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:13.768573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab2dd8298154019928acc3d698327fa', 'request_id': 'req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:13.777097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab2dd8298154019928acc3d698327fa', 'request_id': 'req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:13.795565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52 admin admin] The token cache is being invalidate because project dab2dd8298154019928acc3d698327fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:13.795880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:13.796775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9d6e9c22-68e0-435f-bbed-952ae4f7eb52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:13.805963 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4232/8453] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:36:13 2022] DELETE /identity/v3/projects/dab2dd8298154019928acc3d698327fa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:13.806798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb7e8d-0d70-4d6e-bf05-97072fc14d35 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:13.807112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb7e8d-0d70-4d6e-bf05-97072fc14d35 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:13.807605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb7e8d-0d70-4d6e-bf05-97072fc14d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:13.850201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-62fb7e8d-0d70-4d6e-bf05-97072fc14d35 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:13.854104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-62fb7e8d-0d70-4d6e-bf05-97072fc14d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:13.920238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:13.936665 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4222/8454] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:13.944379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b2f1-2bc0-42ec-b7e2-f51e5465860e None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:13.944869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b2f1-2bc0-42ec-b7e2-f51e5465860e None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:13.944991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b2f1-2bc0-42ec-b7e2-f51e5465860e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:13.965604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-dc51b2f1-2bc0-42ec-b7e2-f51e5465860e None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:13.966872 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dc51b2f1-2bc0-42ec-b7e2-f51e5465860e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:13.974909 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4233/8455] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:13.980818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb7e8d-0d70-4d6e-bf05-97072fc14d35 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:13.990821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb7e8d-0d70-4d6e-bf05-97072fc14d35 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:13.995725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86c3f5-e3aa-410e-b78a-af50812ce6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:13.996336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86c3f5-e3aa-410e-b78a-af50812ce6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:13.996624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86c3f5-e3aa-410e-b78a-af50812ce6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:13.996908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86c3f5-e3aa-410e-b78a-af50812ce6c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:13.997559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86c3f5-e3aa-410e-b78a-af50812ce6c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:36:13.997871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86c3f5-e3aa-410e-b78a-af50812ce6c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:13.999524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86c3f5-e3aa-410e-b78a-af50812ce6c2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:14.015298 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4223/8456] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:14.016466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b2f1-2bc0-42ec-b7e2-f51e5465860e None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:14.022796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:14.027502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b2f1-2bc0-42ec-b7e2-f51e5465860e None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:14.033956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2764-b228-4951-91f8-94dcf3deacd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:14.034802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2764-b228-4951-91f8-94dcf3deacd1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:14.035233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2764-b228-4951-91f8-94dcf3deacd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:14.035660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2764-b228-4951-91f8-94dcf3deacd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:14.036443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2764-b228-4951-91f8-94dcf3deacd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:14.038497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2764-b228-4951-91f8-94dcf3deacd1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:14.071959 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4234/8457] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:36:14 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:14.077056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86c3f5-e3aa-410e-b78a-af50812ce6c2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:14.090270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86c3f5-e3aa-410e-b78a-af50812ce6c2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:14.160608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa5382-0d44-4110-a2fe-b886405e58d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:14.161361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa5382-0d44-4110-a2fe-b886405e58d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:14.161649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa5382-0d44-4110-a2fe-b886405e58d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:14.161986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa5382-0d44-4110-a2fe-b886405e58d8 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:14.162665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa5382-0d44-4110-a2fe-b886405e58d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:14.164877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa5382-0d44-4110-a2fe-b886405e58d8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:14.192184 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4224/8458] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:36:14 2022] POST /identity/v3/users => generated 282 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:14.197019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2764-b228-4951-91f8-94dcf3deacd1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:14.212756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2764-b228-4951-91f8-94dcf3deacd1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:14.218917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140f1fe-620f-45af-ae6b-c96d3d49fd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:14.219892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f1fe-620f-45af-ae6b-c96d3d49fd79 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:14.220302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f1fe-620f-45af-ae6b-c96d3d49fd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:14.220687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140f1fe-620f-45af-ae6b-c96d3d49fd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:14.221554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140f1fe-620f-45af-ae6b-c96d3d49fd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:14.223475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140f1fe-620f-45af-ae6b-c96d3d49fd79 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:14.241410 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4235/8459] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:36:14.242714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa5382-0d44-4110-a2fe-b886405e58d8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:14.253998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa5382-0d44-4110-a2fe-b886405e58d8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:14.259388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a981a4-b701-4bf0-91ee-0900cd080afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:14.260010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a981a4-b701-4bf0-91ee-0900cd080afc admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:14.260847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a981a4-b701-4bf0-91ee-0900cd080afc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:14.261090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a981a4-b701-4bf0-91ee-0900cd080afc admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:14.261745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a981a4-b701-4bf0-91ee-0900cd080afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:14.263470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a981a4-b701-4bf0-91ee-0900cd080afc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:14.279165 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4225/8460] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:36:14.283276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140f1fe-620f-45af-ae6b-c96d3d49fd79 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:14.301790 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140f1fe-620f-45af-ae6b-c96d3d49fd79 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:14.309036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a8ebf-3673-4aa7-90c6-d2381c42705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:14.310030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a8ebf-3673-4aa7-90c6-d2381c42705b admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:14.310484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a8ebf-3673-4aa7-90c6-d2381c42705b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:14.311035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a8ebf-3673-4aa7-90c6-d2381c42705b admin admin] PATH_INFO: `/v3/projects/eb4d6f35b6ef452f90f6ea4879896d0d/users/34c1091cff0d45c4982054f4de2ded86/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:14.337259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a8ebf-3673-4aa7-90c6-d2381c42705b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4d6f35b6ef452f90f6ea4879896d0d, user_id=34c1091cff0d45c4982054f4de2ded86, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:14.343113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a8ebf-3673-4aa7-90c6-d2381c42705b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:14.374770 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4236/8461] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:36:14 2022] PUT /identity/v3/projects/eb4d6f35b6ef452f90f6ea4879896d0d/users/34c1091cff0d45c4982054f4de2ded86/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:14.485188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365e9a8-19a8-4d5c-b8e7-83c7cb6648eb None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:14.485476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365e9a8-19a8-4d5c-b8e7-83c7cb6648eb None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:14.485756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365e9a8-19a8-4d5c-b8e7-83c7cb6648eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:14.528664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e365e9a8-19a8-4d5c-b8e7-83c7cb6648eb None None] MFA Rules not processed for user `34c1091cff0d45c4982054f4de2ded86`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:14.529891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e365e9a8-19a8-4d5c-b8e7-83c7cb6648eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:14.629009 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4226/8462] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:14.633861 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a8ebf-3673-4aa7-90c6-d2381c42705b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:14.716143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a8ebf-3673-4aa7-90c6-d2381c42705b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:14.737664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece702cb-a932-41fb-a299-5ff311bd9546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:14.738653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece702cb-a932-41fb-a299-5ff311bd9546 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:14.739171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece702cb-a932-41fb-a299-5ff311bd9546 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:14.739629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece702cb-a932-41fb-a299-5ff311bd9546 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:14.740500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece702cb-a932-41fb-a299-5ff311bd9546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:14.743058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece702cb-a932-41fb-a299-5ff311bd9546 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:14.803826 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4237/8463] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:36:14 2022] POST /identity/v3/projects => generated 363 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:14.806444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365e9a8-19a8-4d5c-b8e7-83c7cb6648eb None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:14.824326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365e9a8-19a8-4d5c-b8e7-83c7cb6648eb None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:14.903386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:14.936093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f21b4-7d56-4dc7-a849-27aadcb27e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:14.936733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f21b4-7d56-4dc7-a849-27aadcb27e26 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:14.937041 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f21b4-7d56-4dc7-a849-27aadcb27e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:14.937319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f21b4-7d56-4dc7-a849-27aadcb27e26 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:14.938942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f21b4-7d56-4dc7-a849-27aadcb27e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:14.940925 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f21b4-7d56-4dc7-a849-27aadcb27e26 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:14.982567 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4227/8464] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:36:14 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:14.987591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece702cb-a932-41fb-a299-5ff311bd9546 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:15.030410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece702cb-a932-41fb-a299-5ff311bd9546 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:15.045035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2a9e8-75f2-45d0-8adf-070be92d4f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:15.045869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a9e8-75f2-45d0-8adf-070be92d4f48 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:15.046271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a9e8-75f2-45d0-8adf-070be92d4f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:15.046610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a9e8-75f2-45d0-8adf-070be92d4f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:15.047503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2a9e8-75f2-45d0-8adf-070be92d4f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:15.049531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2a9e8-75f2-45d0-8adf-070be92d4f48 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:15.067687 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4238/8465] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:36:15.072602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f21b4-7d56-4dc7-a849-27aadcb27e26 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:15.087155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f21b4-7d56-4dc7-a849-27aadcb27e26 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:15.095371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb102-4d54-47d6-b31a-8187088af88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:15.096227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb102-4d54-47d6-b31a-8187088af88e admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:15.096499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb102-4d54-47d6-b31a-8187088af88e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:15.096767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eb102-4d54-47d6-b31a-8187088af88e admin admin] PATH_INFO: `/v3/projects/5d7a8af075dc4cbfb14205ab19e1bf68/users/dbd54a27a6544de9b8ad6e4c0ec8bae2/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:15.117039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eb102-4d54-47d6-b31a-8187088af88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7a8af075dc4cbfb14205ab19e1bf68, user_id=dbd54a27a6544de9b8ad6e4c0ec8bae2, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:15.127018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eb102-4d54-47d6-b31a-8187088af88e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:15.163447 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4228/8466] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:36:15 2022] PUT /identity/v3/projects/5d7a8af075dc4cbfb14205ab19e1bf68/users/dbd54a27a6544de9b8ad6e4c0ec8bae2/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:15.167782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2a9e8-75f2-45d0-8adf-070be92d4f48 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:15.181685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2a9e8-75f2-45d0-8adf-070be92d4f48 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:15.275434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86dabc3-bb6d-4601-b027-5d3412292089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:15.277920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dabc3-bb6d-4601-b027-5d3412292089 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:15.279272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dabc3-bb6d-4601-b027-5d3412292089 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:15.279272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dabc3-bb6d-4601-b027-5d3412292089 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:15.280214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86dabc3-bb6d-4601-b027-5d3412292089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:15.282414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86dabc3-bb6d-4601-b027-5d3412292089 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:15.301568 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4239/8467] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:36:15.302877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb102-4d54-47d6-b31a-8187088af88e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:15.316847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eb102-4d54-47d6-b31a-8187088af88e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:15.325396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc694e-1d7d-426a-b63c-2358d8295eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:15.326221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc694e-1d7d-426a-b63c-2358d8295eab admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:15.326810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc694e-1d7d-426a-b63c-2358d8295eab admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:15.327098 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc694e-1d7d-426a-b63c-2358d8295eab admin admin] PATH_INFO: `/v3/projects/5d7a8af075dc4cbfb14205ab19e1bf68/users/dbd54a27a6544de9b8ad6e4c0ec8bae2/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:15.329187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc694e-1d7d-426a-b63c-2358d8295eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7a8af075dc4cbfb14205ab19e1bf68, user_id=dbd54a27a6544de9b8ad6e4c0ec8bae2, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:15.332505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc694e-1d7d-426a-b63c-2358d8295eab admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:15.350823 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4229/8468] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:36:15 2022] PUT /identity/v3/projects/5d7a8af075dc4cbfb14205ab19e1bf68/users/dbd54a27a6544de9b8ad6e4c0ec8bae2/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:15.360444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cba71f-1b1c-474c-84dc-c0fb641238ef None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:15.362131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cba71f-1b1c-474c-84dc-c0fb641238ef None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:15.362605 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cba71f-1b1c-474c-84dc-c0fb641238ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:15.407079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-21cba71f-1b1c-474c-84dc-c0fb641238ef None None] MFA Rules not processed for user `dbd54a27a6544de9b8ad6e4c0ec8bae2`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:15.408538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-21cba71f-1b1c-474c-84dc-c0fb641238ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:15.417442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:15.523357 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4240/8469] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:36:15.534192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc694e-1d7d-426a-b63c-2358d8295eab admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:15.536302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fafc694e-1d7d-426a-b63c-2358d8295eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:15.632280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc694e-1d7d-426a-b63c-2358d8295eab admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:15.653980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39afd7-2b16-43ed-a7e5-c2c7d979d796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:15.654610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39afd7-2b16-43ed-a7e5-c2c7d979d796 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:15.654998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39afd7-2b16-43ed-a7e5-c2c7d979d796 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:15.655294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39afd7-2b16-43ed-a7e5-c2c7d979d796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:15.672262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39afd7-2b16-43ed-a7e5-c2c7d979d796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:15.674860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39afd7-2b16-43ed-a7e5-c2c7d979d796 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:15.690664 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4230/8470] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:17.804104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cba71f-1b1c-474c-84dc-c0fb641238ef None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:17.821650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cba71f-1b1c-474c-84dc-c0fb641238ef None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:17.826414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09526bf6-d7f6-4756-a0a4-6b499ada314c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:17.827227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09526bf6-d7f6-4756-a0a4-6b499ada314c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:17.827502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09526bf6-d7f6-4756-a0a4-6b499ada314c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:17.827912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09526bf6-d7f6-4756-a0a4-6b499ada314c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:17.918785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09526bf6-d7f6-4756-a0a4-6b499ada314c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:17.921118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09526bf6-d7f6-4756-a0a4-6b499ada314c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:17.937554 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4241/8471] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:19.167602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39afd7-2b16-43ed-a7e5-c2c7d979d796 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:19.269638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39afd7-2b16-43ed-a7e5-c2c7d979d796 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:19.274313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:19.274979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:19.275264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:19.275536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] PATH_INFO: `/v3/users/34c1091cff0d45c4982054f4de2ded86` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:19.277242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c1091cff0d45c4982054f4de2ded86)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:19.279194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:19.328684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:19.330554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c1091cff0d45c4982054f4de2ded86'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:19.340803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c1091cff0d45c4982054f4de2ded86'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:19.343373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c1091cff0d45c4982054f4de2ded86'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:19.350896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c1091cff0d45c4982054f4de2ded86'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:19.351588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c1091cff0d45c4982054f4de2ded86'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:19.373692 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4231/8472] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:19 2022] DELETE /identity/v3/users/34c1091cff0d45c4982054f4de2ded86 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:19.378484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afef74-4164-48df-a57e-e5be924bb9c8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:19.379035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afef74-4164-48df-a57e-e5be924bb9c8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:19.379172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afef74-4164-48df-a57e-e5be924bb9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:19.399361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c8afef74-4164-48df-a57e-e5be924bb9c8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:19.400877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c8afef74-4164-48df-a57e-e5be924bb9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:19.467265 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4242/8473] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:19.477142 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:19.478537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:19.539271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a26976-3ee6-4f37-99cd-8ce7c788b62e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:19.543739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77bfd7-e99d-4947-ad11-351fccdee410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:19.544349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77bfd7-e99d-4947-ad11-351fccdee410 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:19.544631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77bfd7-e99d-4947-ad11-351fccdee410 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:19.544909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77bfd7-e99d-4947-ad11-351fccdee410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:19.554232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77bfd7-e99d-4947-ad11-351fccdee410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:19.555684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77bfd7-e99d-4947-ad11-351fccdee410 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:19.566372 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4232/8474] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:19.839064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afef74-4164-48df-a57e-e5be924bb9c8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:19.840981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c8afef74-4164-48df-a57e-e5be924bb9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:19.856515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afef74-4164-48df-a57e-e5be924bb9c8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:19.862612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:19.863288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:19.863572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:19.863849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] PATH_INFO: `/v3/projects/eb4d6f35b6ef452f90f6ea4879896d0d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:19.864961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4d6f35b6ef452f90f6ea4879896d0d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:19.867168 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:19.908344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:19.918954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4d6f35b6ef452f90f6ea4879896d0d', 'request_id': 'req-ad92c764-7be3-4aad-9085-e60a2215e013'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:19.926458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4d6f35b6ef452f90f6ea4879896d0d', 'request_id': 'req-ad92c764-7be3-4aad-9085-e60a2215e013'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:19.932501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4d6f35b6ef452f90f6ea4879896d0d', 'request_id': 'req-ad92c764-7be3-4aad-9085-e60a2215e013'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:19.944393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] The token cache is being invalidate because project eb4d6f35b6ef452f90f6ea4879896d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:19.944688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:19.945353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:19.946915 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4243/8475] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:36:19 2022] DELETE /identity/v3/projects/eb4d6f35b6ef452f90f6ea4879896d0d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:19.951229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77bfd7-e99d-4947-ad11-351fccdee410 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:19.961018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77bfd7-e99d-4947-ad11-351fccdee410 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:20.017844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f619a6-908a-4fbc-9216-400102cc2d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:20.018495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f619a6-908a-4fbc-9216-400102cc2d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:20.018827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f619a6-908a-4fbc-9216-400102cc2d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:20.019160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f619a6-908a-4fbc-9216-400102cc2d49 admin admin] PATH_INFO: `/v3/users/dbd54a27a6544de9b8ad6e4c0ec8bae2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:20.020301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f619a6-908a-4fbc-9216-400102cc2d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd54a27a6544de9b8ad6e4c0ec8bae2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:20.022214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f619a6-908a-4fbc-9216-400102cc2d49 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:20.068800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-28f619a6-908a-4fbc-9216-400102cc2d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd54a27a6544de9b8ad6e4c0ec8bae2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:20.076861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-28f619a6-908a-4fbc-9216-400102cc2d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd54a27a6544de9b8ad6e4c0ec8bae2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:20.077562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-28f619a6-908a-4fbc-9216-400102cc2d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd54a27a6544de9b8ad6e4c0ec8bae2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:20.085886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-28f619a6-908a-4fbc-9216-400102cc2d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd54a27a6544de9b8ad6e4c0ec8bae2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:20.086673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-28f619a6-908a-4fbc-9216-400102cc2d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd54a27a6544de9b8ad6e4c0ec8bae2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:20.091880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:20.109813 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4233/8476] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:19 2022] DELETE /identity/v3/users/dbd54a27a6544de9b8ad6e4c0ec8bae2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:20.409596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:20.412393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:20.439657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92c764-7be3-4aad-9085-e60a2215e013 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:20.502839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbae65-b245-49a5-acda-7c9ec4f1159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:20.503595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbae65-b245-49a5-acda-7c9ec4f1159f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:20.503974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbae65-b245-49a5-acda-7c9ec4f1159f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:20.504265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbae65-b245-49a5-acda-7c9ec4f1159f admin admin] PATH_INFO: `/v3/projects/5d7a8af075dc4cbfb14205ab19e1bf68` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:20.505507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbae65-b245-49a5-acda-7c9ec4f1159f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7a8af075dc4cbfb14205ab19e1bf68)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:20.507591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbae65-b245-49a5-acda-7c9ec4f1159f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:20.583578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-99cbae65-b245-49a5-acda-7c9ec4f1159f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7a8af075dc4cbfb14205ab19e1bf68', 'request_id': 'req-99cbae65-b245-49a5-acda-7c9ec4f1159f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:20.591455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-99cbae65-b245-49a5-acda-7c9ec4f1159f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7a8af075dc4cbfb14205ab19e1bf68', 'request_id': 'req-99cbae65-b245-49a5-acda-7c9ec4f1159f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:20.597306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-99cbae65-b245-49a5-acda-7c9ec4f1159f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7a8af075dc4cbfb14205ab19e1bf68', 'request_id': 'req-99cbae65-b245-49a5-acda-7c9ec4f1159f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:20.610501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-99cbae65-b245-49a5-acda-7c9ec4f1159f admin admin] The token cache is being invalidate because project 5d7a8af075dc4cbfb14205ab19e1bf68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:20.610829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-99cbae65-b245-49a5-acda-7c9ec4f1159f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:20.611490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-99cbae65-b245-49a5-acda-7c9ec4f1159f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:20.613057 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4244/8477] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:36:20 2022] DELETE /identity/v3/projects/5d7a8af075dc4cbfb14205ab19e1bf68 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:20.617757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204300da-e1a4-49df-b409-cfba3e0b9f77 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:20.618221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204300da-e1a4-49df-b409-cfba3e0b9f77 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:20.618324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204300da-e1a4-49df-b409-cfba3e0b9f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:20.640666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-204300da-e1a4-49df-b409-cfba3e0b9f77 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:20.642096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-204300da-e1a4-49df-b409-cfba3e0b9f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:20.713200 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4234/8478] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:20.722328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999614c9-51bf-47ee-82a9-51f092d7a738 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:20.722697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999614c9-51bf-47ee-82a9-51f092d7a738 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:20.723116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999614c9-51bf-47ee-82a9-51f092d7a738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:20.743561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-999614c9-51bf-47ee-82a9-51f092d7a738 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:20.745504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-999614c9-51bf-47ee-82a9-51f092d7a738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:20.753869 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4245/8479] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:20.758068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204300da-e1a4-49df-b409-cfba3e0b9f77 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:20.769539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204300da-e1a4-49df-b409-cfba3e0b9f77 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:20.774911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418a4a5-92d4-4b6c-b873-b1d9e61be0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:20.775551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418a4a5-92d4-4b6c-b873-b1d9e61be0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:20.775839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418a4a5-92d4-4b6c-b873-b1d9e61be0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:20.776207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418a4a5-92d4-4b6c-b873-b1d9e61be0d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:20.777092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418a4a5-92d4-4b6c-b873-b1d9e61be0d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:36:20.777390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418a4a5-92d4-4b6c-b873-b1d9e61be0d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:20.779020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418a4a5-92d4-4b6c-b873-b1d9e61be0d6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:20.794470 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4235/8480] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:20.795630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999614c9-51bf-47ee-82a9-51f092d7a738 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:20.805883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999614c9-51bf-47ee-82a9-51f092d7a738 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:20.811764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf4700-1ad8-4c9e-9faf-3bdaf3959669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:20.812390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf4700-1ad8-4c9e-9faf-3bdaf3959669 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:20.812894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf4700-1ad8-4c9e-9faf-3bdaf3959669 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:20.813090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf4700-1ad8-4c9e-9faf-3bdaf3959669 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:20.813705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf4700-1ad8-4c9e-9faf-3bdaf3959669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:20.815677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf4700-1ad8-4c9e-9faf-3bdaf3959669 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:20.849310 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4246/8481] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:36:20 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:20.850455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418a4a5-92d4-4b6c-b873-b1d9e61be0d6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:20.862101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418a4a5-92d4-4b6c-b873-b1d9e61be0d6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:20.922659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9974ac7-3aa6-4e41-ba46-af8c8fa0409b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:20.923390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9974ac7-3aa6-4e41-ba46-af8c8fa0409b admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:20.923672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9974ac7-3aa6-4e41-ba46-af8c8fa0409b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:20.923945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9974ac7-3aa6-4e41-ba46-af8c8fa0409b admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:20.924626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9974ac7-3aa6-4e41-ba46-af8c8fa0409b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:20.926530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9974ac7-3aa6-4e41-ba46-af8c8fa0409b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:20.952189 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4236/8482] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:36:20 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:20.953458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf4700-1ad8-4c9e-9faf-3bdaf3959669 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:20.964195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf4700-1ad8-4c9e-9faf-3bdaf3959669 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:20.968923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633fd9e-91a4-44d2-a8f8-62f7716c683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:20.969535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633fd9e-91a4-44d2-a8f8-62f7716c683d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:20.969821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633fd9e-91a4-44d2-a8f8-62f7716c683d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:20.970097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633fd9e-91a4-44d2-a8f8-62f7716c683d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:20.970757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633fd9e-91a4-44d2-a8f8-62f7716c683d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:20.972656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633fd9e-91a4-44d2-a8f8-62f7716c683d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:20.983206 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4247/8483] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:36:20.987120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9974ac7-3aa6-4e41-ba46-af8c8fa0409b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:20.998045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9974ac7-3aa6-4e41-ba46-af8c8fa0409b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:21.002808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f2c7d-83d0-404a-ab66-c3ffdf4fe6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:21.003415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2c7d-83d0-404a-ab66-c3ffdf4fe6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:21.003697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2c7d-83d0-404a-ab66-c3ffdf4fe6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:21.003970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f2c7d-83d0-404a-ab66-c3ffdf4fe6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:21.004607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f2c7d-83d0-404a-ab66-c3ffdf4fe6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:21.006192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f2c7d-83d0-404a-ab66-c3ffdf4fe6d5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:21.020055 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4237/8484] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:36:21.021706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633fd9e-91a4-44d2-a8f8-62f7716c683d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:21.032375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633fd9e-91a4-44d2-a8f8-62f7716c683d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:21.038220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ad635-03a2-42cb-bb74-8964b9ab609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:21.038946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad635-03a2-42cb-bb74-8964b9ab609a admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:21.039237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad635-03a2-42cb-bb74-8964b9ab609a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:21.039539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad635-03a2-42cb-bb74-8964b9ab609a admin admin] PATH_INFO: `/v3/projects/0e1c557d179a44d896b1892895255868/users/7ab30440786942a58e164e69c3dc9ae5/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:21.052598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:21.056540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ad635-03a2-42cb-bb74-8964b9ab609a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1c557d179a44d896b1892895255868, user_id=7ab30440786942a58e164e69c3dc9ae5, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:21.060979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ad635-03a2-42cb-bb74-8964b9ab609a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:21.075974 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4248/8485] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:36:21 2022] PUT /identity/v3/projects/0e1c557d179a44d896b1892895255868/users/7ab30440786942a58e164e69c3dc9ae5/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:21.091741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360df69-9ccc-44a3-9800-3b194e0e2fab None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:21.092051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360df69-9ccc-44a3-9800-3b194e0e2fab None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:21.092329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360df69-9ccc-44a3-9800-3b194e0e2fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:21.121914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c360df69-9ccc-44a3-9800-3b194e0e2fab None None] MFA Rules not processed for user `7ab30440786942a58e164e69c3dc9ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:21.123107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c360df69-9ccc-44a3-9800-3b194e0e2fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:21.164319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:21.194139 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4238/8486] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:36:21.205654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ad635-03a2-42cb-bb74-8964b9ab609a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:21.207547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-708ad635-03a2-42cb-bb74-8964b9ab609a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:21.271985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ad635-03a2-42cb-bb74-8964b9ab609a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:21.277925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437248e-2400-47b6-b3aa-55f94ab864ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:21.278668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437248e-2400-47b6-b3aa-55f94ab864ad service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:21.279058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437248e-2400-47b6-b3aa-55f94ab864ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:21.279561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437248e-2400-47b6-b3aa-55f94ab864ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:21.289774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437248e-2400-47b6-b3aa-55f94ab864ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:21.291309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437248e-2400-47b6-b3aa-55f94ab864ad service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:21.303268 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4249/8487] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:21.869378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360df69-9ccc-44a3-9800-3b194e0e2fab None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:21.937036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360df69-9ccc-44a3-9800-3b194e0e2fab None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:21.941573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:21.942218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:21.942504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:21.942810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] PATH_INFO: `/v3/users/7ab30440786942a58e164e69c3dc9ae5` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:21.943945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab30440786942a58e164e69c3dc9ae5)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:21.945921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:21.996854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab30440786942a58e164e69c3dc9ae5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:22.004500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab30440786942a58e164e69c3dc9ae5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:22.005190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab30440786942a58e164e69c3dc9ae5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:22.013653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab30440786942a58e164e69c3dc9ae5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:22.014404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab30440786942a58e164e69c3dc9ae5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:22.033185 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4239/8488] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:21 2022] DELETE /identity/v3/users/7ab30440786942a58e164e69c3dc9ae5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:22.037866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5e86e-01e9-4bab-bcab-50c8800f3ba0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:22.038335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5e86e-01e9-4bab-bcab-50c8800f3ba0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:22.038616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5e86e-01e9-4bab-bcab-50c8800f3ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:22.059751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9af5e86e-01e9-4bab-bcab-50c8800f3ba0 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:22.061110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9af5e86e-01e9-4bab-bcab-50c8800f3ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:22.128746 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4250/8489] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:36:22.139648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:22.142457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:22.207175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2b8e5-c747-494c-9857-109d434eaa09 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:22.211203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24342d69-8993-4581-9775-38b0afa0c4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:22.211814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24342d69-8993-4581-9775-38b0afa0c4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:22.212097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24342d69-8993-4581-9775-38b0afa0c4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:22.212368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24342d69-8993-4581-9775-38b0afa0c4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:22.221913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24342d69-8993-4581-9775-38b0afa0c4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:22.223490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24342d69-8993-4581-9775-38b0afa0c4a1 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:22.233364 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4240/8490] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:36:22.512079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5e86e-01e9-4bab-bcab-50c8800f3ba0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:22.513697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9af5e86e-01e9-4bab-bcab-50c8800f3ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:22.527658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5e86e-01e9-4bab-bcab-50c8800f3ba0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:22.532634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766e148-58ef-47cd-b160-12a51ba752c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:22.533356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766e148-58ef-47cd-b160-12a51ba752c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:22.533724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766e148-58ef-47cd-b160-12a51ba752c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:22.534067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766e148-58ef-47cd-b160-12a51ba752c3 admin admin] PATH_INFO: `/v3/projects/0e1c557d179a44d896b1892895255868` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:22.536170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766e148-58ef-47cd-b160-12a51ba752c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1c557d179a44d896b1892895255868)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:22.538192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766e148-58ef-47cd-b160-12a51ba752c3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:22.615840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1766e148-58ef-47cd-b160-12a51ba752c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1c557d179a44d896b1892895255868', 'request_id': 'req-1766e148-58ef-47cd-b160-12a51ba752c3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:22.632970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1766e148-58ef-47cd-b160-12a51ba752c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1c557d179a44d896b1892895255868', 'request_id': 'req-1766e148-58ef-47cd-b160-12a51ba752c3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:22.641032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1766e148-58ef-47cd-b160-12a51ba752c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1c557d179a44d896b1892895255868', 'request_id': 'req-1766e148-58ef-47cd-b160-12a51ba752c3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:22.655817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1766e148-58ef-47cd-b160-12a51ba752c3 admin admin] The token cache is being invalidate because project 0e1c557d179a44d896b1892895255868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:22.656235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1766e148-58ef-47cd-b160-12a51ba752c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:22.656961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1766e148-58ef-47cd-b160-12a51ba752c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:22.658758 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4251/8491] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:36:22 2022] DELETE /identity/v3/projects/0e1c557d179a44d896b1892895255868 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:36:22.664263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dda1e0-821d-4920-a35c-ae038227d902 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:22.664666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dda1e0-821d-4920-a35c-ae038227d902 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:22.665029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dda1e0-821d-4920-a35c-ae038227d902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:22.673953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:22.692736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-05dda1e0-821d-4920-a35c-ae038227d902 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:22.693944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-05dda1e0-821d-4920-a35c-ae038227d902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:22.765103 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4241/8492] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:36:22.772871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091a81b-b72f-4952-a58b-4f7d3e314373 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:22.773161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091a81b-b72f-4952-a58b-4f7d3e314373 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:22.773443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091a81b-b72f-4952-a58b-4f7d3e314373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:22.794303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-1091a81b-b72f-4952-a58b-4f7d3e314373 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:22.795544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1091a81b-b72f-4952-a58b-4f7d3e314373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:22.804312 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4252/8493] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:36:22.809515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dda1e0-821d-4920-a35c-ae038227d902 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:22.820121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dda1e0-821d-4920-a35c-ae038227d902 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:22.825442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679dce3-16b1-4b52-8342-01c98addddc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:22.826072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679dce3-16b1-4b52-8342-01c98addddc9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:22.826364 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679dce3-16b1-4b52-8342-01c98addddc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:22.826638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679dce3-16b1-4b52-8342-01c98addddc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:22.827314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679dce3-16b1-4b52-8342-01c98addddc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:36:22.827619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679dce3-16b1-4b52-8342-01c98addddc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:22.829315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679dce3-16b1-4b52-8342-01c98addddc9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:22.842206 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4242/8494] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:22.846677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091a81b-b72f-4952-a58b-4f7d3e314373 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:22.856817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091a81b-b72f-4952-a58b-4f7d3e314373 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:22.861769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eb30c-1fd0-4aae-8c71-8070bd76341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:22.862373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb30c-1fd0-4aae-8c71-8070bd76341c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:22.862652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb30c-1fd0-4aae-8c71-8070bd76341c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:22.863149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb30c-1fd0-4aae-8c71-8070bd76341c admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:22.863785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eb30c-1fd0-4aae-8c71-8070bd76341c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:22.865772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eb30c-1fd0-4aae-8c71-8070bd76341c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:22.876582 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:22.900063 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4253/8495] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:36:22 2022] POST /identity/v3/projects => generated 361 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:22.904678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679dce3-16b1-4b52-8342-01c98addddc9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:22.915612 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679dce3-16b1-4b52-8342-01c98addddc9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:22.982839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f491499-3a9c-46b9-b7b9-cd051185d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:22.983613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f491499-3a9c-46b9-b7b9-cd051185d036 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:22.983923 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f491499-3a9c-46b9-b7b9-cd051185d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:22.984259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f491499-3a9c-46b9-b7b9-cd051185d036 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:22.984822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f491499-3a9c-46b9-b7b9-cd051185d036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:22.986775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f491499-3a9c-46b9-b7b9-cd051185d036 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:23.010942 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4243/8496] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:36:22 2022] POST /identity/v3/users => generated 281 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:23.015279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eb30c-1fd0-4aae-8c71-8070bd76341c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:23.025957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eb30c-1fd0-4aae-8c71-8070bd76341c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:23.030862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2907b2b-9cf4-4e3a-8f29-cf9dff5aa895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:23.031471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2907b2b-9cf4-4e3a-8f29-cf9dff5aa895 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:23.031755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2907b2b-9cf4-4e3a-8f29-cf9dff5aa895 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:23.032033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2907b2b-9cf4-4e3a-8f29-cf9dff5aa895 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:23.032675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2907b2b-9cf4-4e3a-8f29-cf9dff5aa895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:23.034288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2907b2b-9cf4-4e3a-8f29-cf9dff5aa895 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:23.044636 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4254/8497] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:36:23.048972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f491499-3a9c-46b9-b7b9-cd051185d036 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:23.060395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f491499-3a9c-46b9-b7b9-cd051185d036 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:23.065229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db030a7b-5fa1-4694-bdd9-06cf7760892c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:23.065836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030a7b-5fa1-4694-bdd9-06cf7760892c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:23.066117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030a7b-5fa1-4694-bdd9-06cf7760892c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:23.066391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030a7b-5fa1-4694-bdd9-06cf7760892c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:23.067069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db030a7b-5fa1-4694-bdd9-06cf7760892c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:23.068668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db030a7b-5fa1-4694-bdd9-06cf7760892c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:23.084035 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4244/8498] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:36:23.088544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2907b2b-9cf4-4e3a-8f29-cf9dff5aa895 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:23.099382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2907b2b-9cf4-4e3a-8f29-cf9dff5aa895 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:23.104430 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51fd88-3fc8-4f87-b16a-5071c925b11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:23.105165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51fd88-3fc8-4f87-b16a-5071c925b11d admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:23.105518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51fd88-3fc8-4f87-b16a-5071c925b11d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:23.105866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51fd88-3fc8-4f87-b16a-5071c925b11d admin admin] PATH_INFO: `/v3/projects/32996d9c177f49698f8e8b6a88caec77/users/f95a0c0c26c4421ca1d8555ff941e97b/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:23.122184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51fd88-3fc8-4f87-b16a-5071c925b11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32996d9c177f49698f8e8b6a88caec77, user_id=f95a0c0c26c4421ca1d8555ff941e97b, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:23.125037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51fd88-3fc8-4f87-b16a-5071c925b11d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:23.139846 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4255/8499] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:36:23 2022] PUT /identity/v3/projects/32996d9c177f49698f8e8b6a88caec77/users/f95a0c0c26c4421ca1d8555ff941e97b/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:23.151270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c703884-5a21-40d9-a50e-9ef21321a995 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:23.151547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c703884-5a21-40d9-a50e-9ef21321a995 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:23.151803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c703884-5a21-40d9-a50e-9ef21321a995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:23.180067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2c703884-5a21-40d9-a50e-9ef21321a995 None None] MFA Rules not processed for user `f95a0c0c26c4421ca1d8555ff941e97b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:23.181280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2c703884-5a21-40d9-a50e-9ef21321a995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:23.243262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:23.250305 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4245/8500] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:23.260515 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51fd88-3fc8-4f87-b16a-5071c925b11d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:23.262209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2f51fd88-3fc8-4f87-b16a-5071c925b11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:23.341550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51fd88-3fc8-4f87-b16a-5071c925b11d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:23.346147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daec03e-249d-44e1-926c-4d93c6939cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:23.347275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daec03e-249d-44e1-926c-4d93c6939cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:23.347521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daec03e-249d-44e1-926c-4d93c6939cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:23.347805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daec03e-249d-44e1-926c-4d93c6939cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:23.358456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daec03e-249d-44e1-926c-4d93c6939cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:23.359934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daec03e-249d-44e1-926c-4d93c6939cd8 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:23.369136 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4256/8501] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:27.704871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c703884-5a21-40d9-a50e-9ef21321a995 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:27.706462 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2c703884-5a21-40d9-a50e-9ef21321a995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:27.835036 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c703884-5a21-40d9-a50e-9ef21321a995 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:27.840982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc683c-ed57-4283-9b77-36f2f938a975 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:27.841601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc683c-ed57-4283-9b77-36f2f938a975 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:27.841883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc683c-ed57-4283-9b77-36f2f938a975 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:27.842357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc683c-ed57-4283-9b77-36f2f938a975 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:27.844156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7bdc683c-ed57-4283-9b77-36f2f938a975 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:27.920678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc683c-ed57-4283-9b77-36f2f938a975 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:27.922458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc683c-ed57-4283-9b77-36f2f938a975 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:27.934015 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4246/8502] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:36:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:36:33.365066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:37.929154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=59 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:53.590553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daec03e-249d-44e1-926c-4d93c6939cd8 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:53.666271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daec03e-249d-44e1-926c-4d93c6939cd8 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:53.672065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:53.672712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:53.672998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:53.673278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] PATH_INFO: `/v3/users/f95a0c0c26c4421ca1d8555ff941e97b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:53.674414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f95a0c0c26c4421ca1d8555ff941e97b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:53.676502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:53.731748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f95a0c0c26c4421ca1d8555ff941e97b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:53.739901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f95a0c0c26c4421ca1d8555ff941e97b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:53.740724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f95a0c0c26c4421ca1d8555ff941e97b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:53.756449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f95a0c0c26c4421ca1d8555ff941e97b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:53.757182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f95a0c0c26c4421ca1d8555ff941e97b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:53.780568 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4257/8503] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:36:53 2022] DELETE /identity/v3/users/f95a0c0c26c4421ca1d8555ff941e97b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:53.780711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ced55-ffc5-4870-8dd6-e91e50e0b666 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:53.780711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ced55-ffc5-4870-8dd6-e91e50e0b666 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:53.780711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ced55-ffc5-4870-8dd6-e91e50e0b666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:53.803563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8d0ced55-ffc5-4870-8dd6-e91e50e0b666 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:53.804869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8d0ced55-ffc5-4870-8dd6-e91e50e0b666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:53.877236 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4247/8504] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:53.888710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:53.890505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:53.970340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04592a-0909-40e6-bc80-f7b20fb98cad admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:53.974862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f2de7-5c4a-4fa5-a16f-d201b9023dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:53.975499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f2de7-5c4a-4fa5-a16f-d201b9023dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:53.975772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f2de7-5c4a-4fa5-a16f-d201b9023dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:53.976052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f2de7-5c4a-4fa5-a16f-d201b9023dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:53.986094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f2de7-5c4a-4fa5-a16f-d201b9023dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:53.987574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f2de7-5c4a-4fa5-a16f-d201b9023dc0 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:53.997632 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4258/8505] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:36:54.192971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ced55-ffc5-4870-8dd6-e91e50e0b666 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:54.194556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8d0ced55-ffc5-4870-8dd6-e91e50e0b666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:54.216209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ced55-ffc5-4870-8dd6-e91e50e0b666 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:54.221752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a257fd-b72d-452a-a4b0-302bf99cdb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:54.222562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a257fd-b72d-452a-a4b0-302bf99cdb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:54.222994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a257fd-b72d-452a-a4b0-302bf99cdb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:54.223409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a257fd-b72d-452a-a4b0-302bf99cdb2b admin admin] PATH_INFO: `/v3/projects/32996d9c177f49698f8e8b6a88caec77` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:54.224721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a257fd-b72d-452a-a4b0-302bf99cdb2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32996d9c177f49698f8e8b6a88caec77)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:54.227087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a257fd-b72d-452a-a4b0-302bf99cdb2b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:54.290344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-31a257fd-b72d-452a-a4b0-302bf99cdb2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32996d9c177f49698f8e8b6a88caec77', 'request_id': 'req-31a257fd-b72d-452a-a4b0-302bf99cdb2b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:54.296423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-31a257fd-b72d-452a-a4b0-302bf99cdb2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32996d9c177f49698f8e8b6a88caec77', 'request_id': 'req-31a257fd-b72d-452a-a4b0-302bf99cdb2b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:54.303521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-31a257fd-b72d-452a-a4b0-302bf99cdb2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32996d9c177f49698f8e8b6a88caec77', 'request_id': 'req-31a257fd-b72d-452a-a4b0-302bf99cdb2b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:54.317668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-31a257fd-b72d-452a-a4b0-302bf99cdb2b admin admin] The token cache is being invalidate because project 32996d9c177f49698f8e8b6a88caec77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:36:54.317958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-31a257fd-b72d-452a-a4b0-302bf99cdb2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:54.318676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-31a257fd-b72d-452a-a4b0-302bf99cdb2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:36:54.320578 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4248/8506] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:36:54 2022] DELETE /identity/v3/projects/32996d9c177f49698f8e8b6a88caec77 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:54.326409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9f7a8-c8e0-475f-a8dd-2392e6ce10d7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:54.326701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9f7a8-c8e0-475f-a8dd-2392e6ce10d7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:54.327017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9f7a8-c8e0-475f-a8dd-2392e6ce10d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:54.347696 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-73a9f7a8-c8e0-475f-a8dd-2392e6ce10d7 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:54.348967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-73a9f7a8-c8e0-475f-a8dd-2392e6ce10d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:54.367602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:54.420645 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4259/8507] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:54.429094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d4afe-9222-45ca-b49d-43696c5c2735 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:54.429388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d4afe-9222-45ca-b49d-43696c5c2735 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:54.429757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d4afe-9222-45ca-b49d-43696c5c2735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:54.452048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a89d4afe-9222-45ca-b49d-43696c5c2735 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:54.453281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a89d4afe-9222-45ca-b49d-43696c5c2735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:54.461748 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4249/8508] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:36:54.466609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9f7a8-c8e0-475f-a8dd-2392e6ce10d7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:54.478314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9f7a8-c8e0-475f-a8dd-2392e6ce10d7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:54.483290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e3765-40bb-4b66-86fe-8cac9fbd1433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:54.483862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e3765-40bb-4b66-86fe-8cac9fbd1433 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:54.484137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e3765-40bb-4b66-86fe-8cac9fbd1433 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:54.484459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e3765-40bb-4b66-86fe-8cac9fbd1433 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:54.485099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e3765-40bb-4b66-86fe-8cac9fbd1433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:36:54.485399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e3765-40bb-4b66-86fe-8cac9fbd1433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:54.487057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e3765-40bb-4b66-86fe-8cac9fbd1433 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:54.500231 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4260/8509] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:36:54.504884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d4afe-9222-45ca-b49d-43696c5c2735 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:54.516149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d4afe-9222-45ca-b49d-43696c5c2735 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:54.520970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2a616-8d16-4369-a76a-512e3991057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:54.521731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2a616-8d16-4369-a76a-512e3991057f admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:54.522172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2a616-8d16-4369-a76a-512e3991057f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:54.522517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2a616-8d16-4369-a76a-512e3991057f admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:54.523313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2a616-8d16-4369-a76a-512e3991057f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:54.525260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2a616-8d16-4369-a76a-512e3991057f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:54.557559 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4250/8510] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:36:54 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:36:54.559110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e3765-40bb-4b66-86fe-8cac9fbd1433 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:54.571098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e3765-40bb-4b66-86fe-8cac9fbd1433 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:54.637550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6121c93-2582-4ded-b146-a84abb208213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:54.638226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6121c93-2582-4ded-b146-a84abb208213 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:54.638529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6121c93-2582-4ded-b146-a84abb208213 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:54.638838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6121c93-2582-4ded-b146-a84abb208213 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:54.639574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6121c93-2582-4ded-b146-a84abb208213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:54.641656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6121c93-2582-4ded-b146-a84abb208213 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:54.664362 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4261/8511] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:36:54 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:36:54.669182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2a616-8d16-4369-a76a-512e3991057f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:54.680418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2a616-8d16-4369-a76a-512e3991057f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:54.686212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8369d3-f579-4621-8c3a-985d94fc3362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:54.686859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8369d3-f579-4621-8c3a-985d94fc3362 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:54.687147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8369d3-f579-4621-8c3a-985d94fc3362 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:54.687424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8369d3-f579-4621-8c3a-985d94fc3362 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:54.688079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8369d3-f579-4621-8c3a-985d94fc3362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:54.689798 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8369d3-f579-4621-8c3a-985d94fc3362 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:54.700420 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4251/8512] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:36:54.704855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6121c93-2582-4ded-b146-a84abb208213 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:54.715997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6121c93-2582-4ded-b146-a84abb208213 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:54.721189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66711eb6-378d-4ca8-bf35-c6f6cd48c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:54.721802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66711eb6-378d-4ca8-bf35-c6f6cd48c842 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:54.722089 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66711eb6-378d-4ca8-bf35-c6f6cd48c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:54.722369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66711eb6-378d-4ca8-bf35-c6f6cd48c842 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:54.723047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66711eb6-378d-4ca8-bf35-c6f6cd48c842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:54.724695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66711eb6-378d-4ca8-bf35-c6f6cd48c842 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:54.741326 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4262/8513] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:36:54.745483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8369d3-f579-4621-8c3a-985d94fc3362 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:54.758014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8369d3-f579-4621-8c3a-985d94fc3362 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:54.764730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbec98-2887-4ab1-875e-c2f4264760b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:54.765423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbec98-2887-4ab1-875e-c2f4264760b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:54.765711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbec98-2887-4ab1-875e-c2f4264760b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:54.765990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbec98-2887-4ab1-875e-c2f4264760b8 admin admin] PATH_INFO: `/v3/projects/10a9c97cd429451aa228046a6d911d1c/users/d000f35ce1cb4d8ea07a01b1f05a3a40/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:54.783341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbec98-2887-4ab1-875e-c2f4264760b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a9c97cd429451aa228046a6d911d1c, user_id=d000f35ce1cb4d8ea07a01b1f05a3a40, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:54.786155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbec98-2887-4ab1-875e-c2f4264760b8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:54.801958 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4252/8514] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:36:54 2022] PUT /identity/v3/projects/10a9c97cd429451aa228046a6d911d1c/users/d000f35ce1cb4d8ea07a01b1f05a3a40/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:36:54.813975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f1d97-1709-4118-a207-aa09d1ee4a80 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:54.814325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f1d97-1709-4118-a207-aa09d1ee4a80 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:54.814614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f1d97-1709-4118-a207-aa09d1ee4a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:54.844841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-be7f1d97-1709-4118-a207-aa09d1ee4a80 None None] MFA Rules not processed for user `d000f35ce1cb4d8ea07a01b1f05a3a40`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:36:54.846083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-be7f1d97-1709-4118-a207-aa09d1ee4a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:54.917688 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4263/8515] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:36:54.929597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbec98-2887-4ab1-875e-c2f4264760b8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:36:54.931517 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cbdbec98-2887-4ab1-875e-c2f4264760b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:36:54.956123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:36:54.997941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbec98-2887-4ab1-875e-c2f4264760b8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:36:55.001737 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b4c0d-15a1-43b3-8434-425dc29e02e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:36:55.002348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b4c0d-15a1-43b3-8434-425dc29e02e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:36:55.002676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b4c0d-15a1-43b3-8434-425dc29e02e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:36:55.002982 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b4c0d-15a1-43b3-8434-425dc29e02e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:36:55.013951 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b4c0d-15a1-43b3-8434-425dc29e02e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:36:55.015459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b4c0d-15a1-43b3-8434-425dc29e02e4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:36:55.027189 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4253/8516] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:36:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:37:04.914095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:05.021692 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=17 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:29.998273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f1d97-1709-4118-a207-aa09d1ee4a80 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:30.000228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-be7f1d97-1709-4118-a207-aa09d1ee4a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:30.125268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f1d97-1709-4118-a207-aa09d1ee4a80 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:30.131165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b3894-dc92-463b-9209-605260d562a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:30.131932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b3894-dc92-463b-9209-605260d562a2 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:30.132348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b3894-dc92-463b-9209-605260d562a2 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:30.132730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b3894-dc92-463b-9209-605260d562a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:30.134583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1e4b3894-dc92-463b-9209-605260d562a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:30.156117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b3894-dc92-463b-9209-605260d562a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:30.157779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b3894-dc92-463b-9209-605260d562a2 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:30.178304 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4264/8517] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:37:34.419056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b4c0d-15a1-43b3-8434-425dc29e02e4 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:34.421383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3b6b4c0d-15a1-43b3-8434-425dc29e02e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:34.663162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b4c0d-15a1-43b3-8434-425dc29e02e4 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:34.678806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322ec49-0456-463a-b0e9-9b4c7a3015a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:34.679479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322ec49-0456-463a-b0e9-9b4c7a3015a2 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:34.679765 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322ec49-0456-463a-b0e9-9b4c7a3015a2 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:34.680803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322ec49-0456-463a-b0e9-9b4c7a3015a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:34.688429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9322ec49-0456-463a-b0e9-9b4c7a3015a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:34.835085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322ec49-0456-463a-b0e9-9b4c7a3015a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:34.837299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322ec49-0456-463a-b0e9-9b4c7a3015a2 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:34.889240 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4254/8518] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:37:34.978779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b3894-dc92-463b-9209-605260d562a2 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:34.997739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b3894-dc92-463b-9209-605260d562a2 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:35.001773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eddcc2-0018-4121-91ae-4e6c8cf7462d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:35.002433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eddcc2-0018-4121-91ae-4e6c8cf7462d service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:35.002718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eddcc2-0018-4121-91ae-4e6c8cf7462d service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:35.003033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eddcc2-0018-4121-91ae-4e6c8cf7462d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:35.009646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-88eddcc2-0018-4121-91ae-4e6c8cf7462d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:35.051908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eddcc2-0018-4121-91ae-4e6c8cf7462d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:35.057423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eddcc2-0018-4121-91ae-4e6c8cf7462d service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:35.097188 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4265/8519] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:37:35.312376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322ec49-0456-463a-b0e9-9b4c7a3015a2 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:35.331229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322ec49-0456-463a-b0e9-9b4c7a3015a2 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:35.336194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73e48b-72a4-4715-ae50-e13fe8ae8036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:35.336965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73e48b-72a4-4715-ae50-e13fe8ae8036 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:35.337247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73e48b-72a4-4715-ae50-e13fe8ae8036 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:35.337542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73e48b-72a4-4715-ae50-e13fe8ae8036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:35.341474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dd73e48b-72a4-4715-ae50-e13fe8ae8036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:35.434628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73e48b-72a4-4715-ae50-e13fe8ae8036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:35.435955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73e48b-72a4-4715-ae50-e13fe8ae8036 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:35.468648 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4255/8520] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:37:38.251871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eddcc2-0018-4121-91ae-4e6c8cf7462d service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:38.268831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eddcc2-0018-4121-91ae-4e6c8cf7462d service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:38.274028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c70792-a844-4842-8545-db4bc7dd807c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:38.275180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c70792-a844-4842-8545-db4bc7dd807c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:38.276481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c70792-a844-4842-8545-db4bc7dd807c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:38.276886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c70792-a844-4842-8545-db4bc7dd807c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:38.279243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-33c70792-a844-4842-8545-db4bc7dd807c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:38.300944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c70792-a844-4842-8545-db4bc7dd807c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:38.302308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c70792-a844-4842-8545-db4bc7dd807c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:38.321529 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4266/8521] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:37:44.791115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73e48b-72a4-4715-ae50-e13fe8ae8036 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:44.791115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-dd73e48b-72a4-4715-ae50-e13fe8ae8036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:44.811326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:44.820782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73e48b-72a4-4715-ae50-e13fe8ae8036 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:44.832618 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783beff1-099f-4a8d-9ac2-67c203d79c80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:44.833256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783beff1-099f-4a8d-9ac2-67c203d79c80 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:44.833545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783beff1-099f-4a8d-9ac2-67c203d79c80 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:44.833805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783beff1-099f-4a8d-9ac2-67c203d79c80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:44.835689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-783beff1-099f-4a8d-9ac2-67c203d79c80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:44.866570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783beff1-099f-4a8d-9ac2-67c203d79c80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:44.879167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783beff1-099f-4a8d-9ac2-67c203d79c80 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:44.890311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c70792-a844-4842-8545-db4bc7dd807c service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:44.901440 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4256/8522] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:37:45.001744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c70792-a844-4842-8545-db4bc7dd807c service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:45.008236 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:45.009063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:45.009606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:45.010668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] PATH_INFO: `/v3/users/d000f35ce1cb4d8ea07a01b1f05a3a40` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:45.012599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d000f35ce1cb4d8ea07a01b1f05a3a40)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:45.015090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:45.075275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd000f35ce1cb4d8ea07a01b1f05a3a40'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:45.087553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd000f35ce1cb4d8ea07a01b1f05a3a40'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:45.089227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd000f35ce1cb4d8ea07a01b1f05a3a40'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:45.096990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:45.112851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd000f35ce1cb4d8ea07a01b1f05a3a40'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:45.113733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd000f35ce1cb4d8ea07a01b1f05a3a40'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:45.137041 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4267/8523] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:37:44 2022] DELETE /identity/v3/users/d000f35ce1cb4d8ea07a01b1f05a3a40 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:37:45.141769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e886843-a9f0-4c2e-9f48-1bf1c4290a2d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:45.144239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e886843-a9f0-4c2e-9f48-1bf1c4290a2d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:45.144681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e886843-a9f0-4c2e-9f48-1bf1c4290a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:45.191081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0e886843-a9f0-4c2e-9f48-1bf1c4290a2d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:45.193427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0e886843-a9f0-4c2e-9f48-1bf1c4290a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:45.323406 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4257/8524] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:45.324922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:45.329293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:45.483596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbbc2d-876d-497d-8491-47a38a7810fa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:45.496850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcefa2-6e11-4a6d-b152-25a9651f8deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:45.498011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcefa2-6e11-4a6d-b152-25a9651f8deb service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:45.498450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcefa2-6e11-4a6d-b152-25a9651f8deb service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:45.498948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcefa2-6e11-4a6d-b152-25a9651f8deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:45.517033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcefa2-6e11-4a6d-b152-25a9651f8deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:45.519496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcefa2-6e11-4a6d-b152-25a9651f8deb service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:45.558552 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4268/8525] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:37:45.866509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e886843-a9f0-4c2e-9f48-1bf1c4290a2d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:45.868615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0e886843-a9f0-4c2e-9f48-1bf1c4290a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:45.892766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e886843-a9f0-4c2e-9f48-1bf1c4290a2d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:45.907204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:45.908062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:45.908351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:45.908818 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2 admin admin] PATH_INFO: `/v3/projects/10a9c97cd429451aa228046a6d911d1c` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:45.913607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a9c97cd429451aa228046a6d911d1c)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:45.915603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:46.002440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a9c97cd429451aa228046a6d911d1c', 'request_id': 'req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:46.010968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a9c97cd429451aa228046a6d911d1c', 'request_id': 'req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:46.020028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a9c97cd429451aa228046a6d911d1c', 'request_id': 'req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:46.035635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2 admin admin] The token cache is being invalidate because project 10a9c97cd429451aa228046a6d911d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:37:46.036299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:46.037353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4fef87ca-0ca2-4a2e-90e9-204de6d7a9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:46.039100 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4258/8526] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:37:45 2022] DELETE /identity/v3/projects/10a9c97cd429451aa228046a6d911d1c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:37:46.044552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e28f7-da8e-4c1e-b9e5-729b44020b88 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:46.045084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e28f7-da8e-4c1e-b9e5-729b44020b88 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:46.045084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e28f7-da8e-4c1e-b9e5-729b44020b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:46.066578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ef4e28f7-da8e-4c1e-b9e5-729b44020b88 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:46.067828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ef4e28f7-da8e-4c1e-b9e5-729b44020b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:46.139701 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4269/8527] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:46.142723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38e1e-5123-401d-869c-8dfc92b12b7b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:46.143196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38e1e-5123-401d-869c-8dfc92b12b7b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:46.143486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38e1e-5123-401d-869c-8dfc92b12b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:46.184180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e9f38e1e-5123-401d-869c-8dfc92b12b7b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:46.187595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e9f38e1e-5123-401d-869c-8dfc92b12b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:46.196408 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4259/8528] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:46.204653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e28f7-da8e-4c1e-b9e5-729b44020b88 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:46.219520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e28f7-da8e-4c1e-b9e5-729b44020b88 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:46.224266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660496c-88cb-40b5-b14d-ccd92f8d94e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:46.224818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660496c-88cb-40b5-b14d-ccd92f8d94e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:46.225096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660496c-88cb-40b5-b14d-ccd92f8d94e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:46.225366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660496c-88cb-40b5-b14d-ccd92f8d94e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:46.226004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660496c-88cb-40b5-b14d-ccd92f8d94e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:37:46.226307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660496c-88cb-40b5-b14d-ccd92f8d94e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:46.227969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660496c-88cb-40b5-b14d-ccd92f8d94e7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:46.241514 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4270/8529] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:37:46.246625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38e1e-5123-401d-869c-8dfc92b12b7b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:46.263035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38e1e-5123-401d-869c-8dfc92b12b7b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:46.268729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad2b3e-7e4b-4544-9a94-5d9177b3119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:46.270193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad2b3e-7e4b-4544-9a94-5d9177b3119e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:46.270872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad2b3e-7e4b-4544-9a94-5d9177b3119e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:46.271412 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad2b3e-7e4b-4544-9a94-5d9177b3119e admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:46.272262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad2b3e-7e4b-4544-9a94-5d9177b3119e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:46.274296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad2b3e-7e4b-4544-9a94-5d9177b3119e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:46.326051 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4260/8530] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:37:46 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:37:46.327362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660496c-88cb-40b5-b14d-ccd92f8d94e7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:46.340745 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660496c-88cb-40b5-b14d-ccd92f8d94e7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:46.461853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca78523-6042-4801-b5b1-2820bbbf88e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:46.462843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca78523-6042-4801-b5b1-2820bbbf88e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:46.463563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca78523-6042-4801-b5b1-2820bbbf88e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:46.464052 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca78523-6042-4801-b5b1-2820bbbf88e2 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:46.464993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca78523-6042-4801-b5b1-2820bbbf88e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:46.468180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca78523-6042-4801-b5b1-2820bbbf88e2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:46.486362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:46.503500 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4271/8531] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:37:46 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:37:46.508244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad2b3e-7e4b-4544-9a94-5d9177b3119e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:46.522383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad2b3e-7e4b-4544-9a94-5d9177b3119e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:46.529879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ddf98-e1ca-43de-8587-2fa975f9fa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:46.530705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ddf98-e1ca-43de-8587-2fa975f9fa95 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:46.531187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ddf98-e1ca-43de-8587-2fa975f9fa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:46.531636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ddf98-e1ca-43de-8587-2fa975f9fa95 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:46.532507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ddf98-e1ca-43de-8587-2fa975f9fa95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:46.534930 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ddf98-e1ca-43de-8587-2fa975f9fa95 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:46.547883 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4261/8532] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:37:46.551989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca78523-6042-4801-b5b1-2820bbbf88e2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:46.563245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca78523-6042-4801-b5b1-2820bbbf88e2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:46.568704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12726b85-fae0-481c-abaf-b3575f166fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:46.569319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12726b85-fae0-481c-abaf-b3575f166fbc admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:46.569731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12726b85-fae0-481c-abaf-b3575f166fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:46.570123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12726b85-fae0-481c-abaf-b3575f166fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:46.570791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12726b85-fae0-481c-abaf-b3575f166fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:46.573053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12726b85-fae0-481c-abaf-b3575f166fbc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:46.585377 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4272/8533] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:37:46.590699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ddf98-e1ca-43de-8587-2fa975f9fa95 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:46.601220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ddf98-e1ca-43de-8587-2fa975f9fa95 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:46.606788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e255d38-cae3-45c1-8a3e-febd62301138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:46.607449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e255d38-cae3-45c1-8a3e-febd62301138 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:46.607734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e255d38-cae3-45c1-8a3e-febd62301138 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:46.608015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e255d38-cae3-45c1-8a3e-febd62301138 admin admin] PATH_INFO: `/v3/projects/a6743e519cbd4862a5634069d4f89d55/users/bcbbde1c04744d66a84f26b35777d3df/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:46.624018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e255d38-cae3-45c1-8a3e-febd62301138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6743e519cbd4862a5634069d4f89d55, user_id=bcbbde1c04744d66a84f26b35777d3df, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:46.626858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e255d38-cae3-45c1-8a3e-febd62301138 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:46.640486 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4262/8534] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:37:46 2022] PUT /identity/v3/projects/a6743e519cbd4862a5634069d4f89d55/users/bcbbde1c04744d66a84f26b35777d3df/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:37:46.650660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af7160-3573-47ec-9d38-3b638615b31f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:46.651028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af7160-3573-47ec-9d38-3b638615b31f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:46.651500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af7160-3573-47ec-9d38-3b638615b31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:46.684852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-15af7160-3573-47ec-9d38-3b638615b31f None None] MFA Rules not processed for user `bcbbde1c04744d66a84f26b35777d3df`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:46.686067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-15af7160-3573-47ec-9d38-3b638615b31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:46.763780 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4273/8535] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:46.771766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e255d38-cae3-45c1-8a3e-febd62301138 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:46.773836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5e255d38-cae3-45c1-8a3e-febd62301138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:46.792642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:46.850118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e255d38-cae3-45c1-8a3e-febd62301138 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:46.854910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1abf9-3e5e-4607-84fc-e10663646a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:46.855841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1abf9-3e5e-4607-84fc-e10663646a13 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:46.856336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1abf9-3e5e-4607-84fc-e10663646a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:46.856830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1abf9-3e5e-4607-84fc-e10663646a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:46.866287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1abf9-3e5e-4607-84fc-e10663646a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:46.868131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1abf9-3e5e-4607-84fc-e10663646a13 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:46.882121 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4263/8536] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:37:46.900010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af7160-3573-47ec-9d38-3b638615b31f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:46.981003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af7160-3573-47ec-9d38-3b638615b31f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:46.986105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:46.986802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:46.987076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:46.987357 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] PATH_INFO: `/v3/users/bcbbde1c04744d66a84f26b35777d3df` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:46.988568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbbde1c04744d66a84f26b35777d3df)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:46.990527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:47.126907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbbde1c04744d66a84f26b35777d3df'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:47.142104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbbde1c04744d66a84f26b35777d3df'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:47.144863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbbde1c04744d66a84f26b35777d3df'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:47.172792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbbde1c04744d66a84f26b35777d3df'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:47.173654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbbde1c04744d66a84f26b35777d3df'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:47.175770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:47.199434 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4274/8537] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:37:46 2022] DELETE /identity/v3/users/bcbbde1c04744d66a84f26b35777d3df => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:37:47.210829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82859ef1-a811-4fdb-a69c-ac8fd94bf153 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:47.212759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82859ef1-a811-4fdb-a69c-ac8fd94bf153 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:47.213307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82859ef1-a811-4fdb-a69c-ac8fd94bf153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:47.238995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-82859ef1-a811-4fdb-a69c-ac8fd94bf153 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:47.240729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-82859ef1-a811-4fdb-a69c-ac8fd94bf153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:47.378652 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4264/8538] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:47.464931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:47.464931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:47.464931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f67f0d-e77b-4187-b406-370ff8a21cca admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:47.466851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc540f4-3450-4673-8501-16212b2776ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:47.466851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc540f4-3450-4673-8501-16212b2776ff service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:47.466851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc540f4-3450-4673-8501-16212b2776ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:47.466851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc540f4-3450-4673-8501-16212b2776ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:47.473528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc540f4-3450-4673-8501-16212b2776ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:47.475046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc540f4-3450-4673-8501-16212b2776ff service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:47.490811 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4275/8539] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:37:47.956582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82859ef1-a811-4fdb-a69c-ac8fd94bf153 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:47.958330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-82859ef1-a811-4fdb-a69c-ac8fd94bf153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:47.976751 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82859ef1-a811-4fdb-a69c-ac8fd94bf153 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:47.983395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36651d5-c705-4605-8fa4-e511a608c547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:47.984135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36651d5-c705-4605-8fa4-e511a608c547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:47.984475 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36651d5-c705-4605-8fa4-e511a608c547 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:47.985035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36651d5-c705-4605-8fa4-e511a608c547 admin admin] PATH_INFO: `/v3/projects/a6743e519cbd4862a5634069d4f89d55` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:47.986864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36651d5-c705-4605-8fa4-e511a608c547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6743e519cbd4862a5634069d4f89d55)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:47.989846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36651d5-c705-4605-8fa4-e511a608c547 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:48.124047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b36651d5-c705-4605-8fa4-e511a608c547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6743e519cbd4862a5634069d4f89d55', 'request_id': 'req-b36651d5-c705-4605-8fa4-e511a608c547'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:48.136372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b36651d5-c705-4605-8fa4-e511a608c547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6743e519cbd4862a5634069d4f89d55', 'request_id': 'req-b36651d5-c705-4605-8fa4-e511a608c547'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:48.150916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b36651d5-c705-4605-8fa4-e511a608c547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6743e519cbd4862a5634069d4f89d55', 'request_id': 'req-b36651d5-c705-4605-8fa4-e511a608c547'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:48.195979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b36651d5-c705-4605-8fa4-e511a608c547 admin admin] The token cache is being invalidate because project a6743e519cbd4862a5634069d4f89d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:37:48.196661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b36651d5-c705-4605-8fa4-e511a608c547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:48.198078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b36651d5-c705-4605-8fa4-e511a608c547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:48.202538 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4265/8540] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:37:47 2022] DELETE /identity/v3/projects/a6743e519cbd4862a5634069d4f89d55 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:37:48.207998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525829cc-dca8-4f4c-bf13-10e9d32a1dad None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:48.209128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525829cc-dca8-4f4c-bf13-10e9d32a1dad None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:48.209816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525829cc-dca8-4f4c-bf13-10e9d32a1dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:48.243559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-525829cc-dca8-4f4c-bf13-10e9d32a1dad None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:48.246210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-525829cc-dca8-4f4c-bf13-10e9d32a1dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:48.352265 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4276/8541] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:48.363165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2fb16-3658-49d5-928b-74d14c72469b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:48.363304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2fb16-3658-49d5-928b-74d14c72469b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:48.363578 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2fb16-3658-49d5-928b-74d14c72469b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:48.389891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-60d2fb16-3658-49d5-928b-74d14c72469b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:48.393763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-60d2fb16-3658-49d5-928b-74d14c72469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:48.409770 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4266/8542] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:48.411116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525829cc-dca8-4f4c-bf13-10e9d32a1dad None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:48.424722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525829cc-dca8-4f4c-bf13-10e9d32a1dad None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:48.430363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb120dfd-8ada-4832-a4d1-2e47724b1d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:48.431196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb120dfd-8ada-4832-a4d1-2e47724b1d02 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:48.431463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb120dfd-8ada-4832-a4d1-2e47724b1d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:48.431764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb120dfd-8ada-4832-a4d1-2e47724b1d02 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:48.434502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb120dfd-8ada-4832-a4d1-2e47724b1d02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:37:48.435050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb120dfd-8ada-4832-a4d1-2e47724b1d02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:48.436836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb120dfd-8ada-4832-a4d1-2e47724b1d02 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:48.456667 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4277/8543] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:37:48.461141 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2fb16-3658-49d5-928b-74d14c72469b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:48.474267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2fb16-3658-49d5-928b-74d14c72469b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:48.480326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f05dd1-b388-48d6-98a5-f92ef86e731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:48.480968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f05dd1-b388-48d6-98a5-f92ef86e731c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:48.481257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f05dd1-b388-48d6-98a5-f92ef86e731c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:48.481539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f05dd1-b388-48d6-98a5-f92ef86e731c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:48.482203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f05dd1-b388-48d6-98a5-f92ef86e731c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:48.484422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f05dd1-b388-48d6-98a5-f92ef86e731c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:48.543025 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4267/8544] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:37:48 2022] POST /identity/v3/projects => generated 405 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:37:48.544560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb120dfd-8ada-4832-a4d1-2e47724b1d02 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:48.559550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb120dfd-8ada-4832-a4d1-2e47724b1d02 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:48.648645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394eb892-6c20-425b-afa5-2091e7e4232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:48.649282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eb892-6c20-425b-afa5-2091e7e4232f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:48.649571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eb892-6c20-425b-afa5-2091e7e4232f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:48.649888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eb892-6c20-425b-afa5-2091e7e4232f admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:48.651324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394eb892-6c20-425b-afa5-2091e7e4232f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:48.654371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394eb892-6c20-425b-afa5-2091e7e4232f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:48.688851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f05dd1-b388-48d6-98a5-f92ef86e731c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:48.696258 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4278/8545] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:37:48 2022] POST /identity/v3/users => generated 303 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:37:48.701117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f05dd1-b388-48d6-98a5-f92ef86e731c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:48.707140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4b94-0520-4926-9237-7366eb241aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:48.708073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4b94-0520-4926-9237-7366eb241aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:48.708576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4b94-0520-4926-9237-7366eb241aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:48.709084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4b94-0520-4926-9237-7366eb241aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:48.709936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f4b94-0520-4926-9237-7366eb241aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:48.711829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f4b94-0520-4926-9237-7366eb241aa9 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:48.715655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:48.731485 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4268/8546] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:37:48.733205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394eb892-6c20-425b-afa5-2091e7e4232f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:48.749074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394eb892-6c20-425b-afa5-2091e7e4232f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:48.763606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce11ad7-f805-4158-ae63-9786060af3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:48.764249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce11ad7-f805-4158-ae63-9786060af3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:48.764552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce11ad7-f805-4158-ae63-9786060af3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:48.764822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce11ad7-f805-4158-ae63-9786060af3b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:48.766040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce11ad7-f805-4158-ae63-9786060af3b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:48.768077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce11ad7-f805-4158-ae63-9786060af3b5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:48.774146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:48.803317 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4279/8547] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:37:48.808467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4b94-0520-4926-9237-7366eb241aa9 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:48.822101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4b94-0520-4926-9237-7366eb241aa9 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:48.828987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fb05b-32ce-4970-94de-8b778da88cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:48.830643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fb05b-32ce-4970-94de-8b778da88cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:48.831171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fb05b-32ce-4970-94de-8b778da88cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:48.831668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fb05b-32ce-4970-94de-8b778da88cbd admin admin] PATH_INFO: `/v3/projects/7014d69a32374afca958ea0b400a1a25/users/c9c211810dab405d8595de12d81c4372/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:48.854344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fb05b-32ce-4970-94de-8b778da88cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7014d69a32374afca958ea0b400a1a25, user_id=c9c211810dab405d8595de12d81c4372, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:48.858218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fb05b-32ce-4970-94de-8b778da88cbd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:48.880849 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4269/8548] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:37:48 2022] PUT /identity/v3/projects/7014d69a32374afca958ea0b400a1a25/users/c9c211810dab405d8595de12d81c4372/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:37:48.895591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d2731-17f3-4f46-b775-1381a124526c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:48.896056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d2731-17f3-4f46-b775-1381a124526c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:48.896378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d2731-17f3-4f46-b775-1381a124526c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:48.954450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-377d2731-17f3-4f46-b775-1381a124526c None None] MFA Rules not processed for user `c9c211810dab405d8595de12d81c4372`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:48.955975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-377d2731-17f3-4f46-b775-1381a124526c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:49.053509 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4280/8549] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:48 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:49.058871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fb05b-32ce-4970-94de-8b778da88cbd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:49.171190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fb05b-32ce-4970-94de-8b778da88cbd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:49.186102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf34820-3a4b-4d12-9fde-64a9705bdf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:49.186771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf34820-3a4b-4d12-9fde-64a9705bdf10 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:49.187078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf34820-3a4b-4d12-9fde-64a9705bdf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:49.187555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf34820-3a4b-4d12-9fde-64a9705bdf10 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:49.188528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf34820-3a4b-4d12-9fde-64a9705bdf10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:49.192320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf34820-3a4b-4d12-9fde-64a9705bdf10 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:49.257469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d2731-17f3-4f46-b775-1381a124526c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:49.258468 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4270/8550] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:37:49 2022] POST /identity/v3/projects => generated 405 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:37:49.274933 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d2731-17f3-4f46-b775-1381a124526c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:49.364223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ee6dc-6626-4ba9-bc9c-385ab46292e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:49.365022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ee6dc-6626-4ba9-bc9c-385ab46292e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:49.365740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ee6dc-6626-4ba9-bc9c-385ab46292e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:49.365740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ee6dc-6626-4ba9-bc9c-385ab46292e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:49.366309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ee6dc-6626-4ba9-bc9c-385ab46292e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:49.368413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ee6dc-6626-4ba9-bc9c-385ab46292e7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:49.415148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf34820-3a4b-4d12-9fde-64a9705bdf10 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:49.422392 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4281/8551] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:37:49 2022] POST /identity/v3/users => generated 309 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:37:49.428345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf34820-3a4b-4d12-9fde-64a9705bdf10 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:49.433632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adde65-c42b-410f-81c5-09212efb1631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:49.434962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adde65-c42b-410f-81c5-09212efb1631 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:49.435489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adde65-c42b-410f-81c5-09212efb1631 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:49.435985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adde65-c42b-410f-81c5-09212efb1631 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:49.437078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adde65-c42b-410f-81c5-09212efb1631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:49.439040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adde65-c42b-410f-81c5-09212efb1631 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:49.460620 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ee6dc-6626-4ba9-bc9c-385ab46292e7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:49.472087 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4271/8552] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:37:49.476617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ee6dc-6626-4ba9-bc9c-385ab46292e7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:49.484149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b829b41-2a81-41f4-8988-cb9c17b6c3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:49.485187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b829b41-2a81-41f4-8988-cb9c17b6c3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:49.486009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b829b41-2a81-41f4-8988-cb9c17b6c3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:49.486437 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b829b41-2a81-41f4-8988-cb9c17b6c3a7 admin admin] PATH_INFO: `/v3/projects/99610c7846734272afc9410dd1ec414d/users/fe125412da5a42e49970f28038d40d80/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:49.508603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b829b41-2a81-41f4-8988-cb9c17b6c3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99610c7846734272afc9410dd1ec414d, user_id=fe125412da5a42e49970f28038d40d80, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:49.513102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b829b41-2a81-41f4-8988-cb9c17b6c3a7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:49.539146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adde65-c42b-410f-81c5-09212efb1631 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:49.539686 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4282/8553] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:37:49 2022] PUT /identity/v3/projects/99610c7846734272afc9410dd1ec414d/users/fe125412da5a42e49970f28038d40d80/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:37:49.554520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adde65-c42b-410f-81c5-09212efb1631 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:49.669878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a679a-bb0d-4e72-9f45-65cb8460463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:49.670736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a679a-bb0d-4e72-9f45-65cb8460463a admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:49.671216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a679a-bb0d-4e72-9f45-65cb8460463a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:49.671666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a679a-bb0d-4e72-9f45-65cb8460463a admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:49.672559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a679a-bb0d-4e72-9f45-65cb8460463a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:49.675343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a679a-bb0d-4e72-9f45-65cb8460463a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:49.689361 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4272/8554] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:37:49.693734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b829b41-2a81-41f4-8988-cb9c17b6c3a7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:49.707610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b829b41-2a81-41f4-8988-cb9c17b6c3a7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:49.714906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed384a-c3b7-4f42-a873-902ec2e42134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:49.716082 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed384a-c3b7-4f42-a873-902ec2e42134 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:49.716529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed384a-c3b7-4f42-a873-902ec2e42134 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:49.717090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed384a-c3b7-4f42-a873-902ec2e42134 admin admin] PATH_INFO: `/v3/projects/99610c7846734272afc9410dd1ec414d/users/fe125412da5a42e49970f28038d40d80/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:49.719307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed384a-c3b7-4f42-a873-902ec2e42134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99610c7846734272afc9410dd1ec414d, user_id=fe125412da5a42e49970f28038d40d80, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:49.722422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed384a-c3b7-4f42-a873-902ec2e42134 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:49.737362 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4283/8555] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:37:49 2022] PUT /identity/v3/projects/99610c7846734272afc9410dd1ec414d/users/fe125412da5a42e49970f28038d40d80/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:37:49.749386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7e9c3-6a32-4931-9c25-9015eb4eff79 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:49.750248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7e9c3-6a32-4931-9c25-9015eb4eff79 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:49.750691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7e9c3-6a32-4931-9c25-9015eb4eff79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:49.793602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-82a7e9c3-6a32-4931-9c25-9015eb4eff79 None None] MFA Rules not processed for user `fe125412da5a42e49970f28038d40d80`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:49.795012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-82a7e9c3-6a32-4931-9c25-9015eb4eff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:49.860696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:49.911037 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4273/8556] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:49 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:49.924953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed384a-c3b7-4f42-a873-902ec2e42134 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:49.927295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-43ed384a-c3b7-4f42-a873-902ec2e42134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:49.996460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:50.065228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed384a-c3b7-4f42-a873-902ec2e42134 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:50.073783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a21fc-c976-4763-808f-9bcda4a0d8ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:50.074596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a21fc-c976-4763-808f-9bcda4a0d8ac service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:50.075241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a21fc-c976-4763-808f-9bcda4a0d8ac service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:50.075697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a21fc-c976-4763-808f-9bcda4a0d8ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:50.089418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a21fc-c976-4763-808f-9bcda4a0d8ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:50.090280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a21fc-c976-4763-808f-9bcda4a0d8ac service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:50.102318 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4284/8557] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:49 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:37:50.304336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7e9c3-6a32-4931-9c25-9015eb4eff79 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:50.431273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7e9c3-6a32-4931-9c25-9015eb4eff79 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:50.444889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:50.446007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:50.446515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:50.447201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] PATH_INFO: `/v3/users/c9c211810dab405d8595de12d81c4372` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:50.449854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c211810dab405d8595de12d81c4372)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:50.452301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:50.542956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c211810dab405d8595de12d81c4372'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:50.561222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c211810dab405d8595de12d81c4372'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:50.562694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c211810dab405d8595de12d81c4372'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:50.585125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c211810dab405d8595de12d81c4372'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:50.585914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c211810dab405d8595de12d81c4372'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:50.625010 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4274/8558] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:37:50 2022] DELETE /identity/v3/users/c9c211810dab405d8595de12d81c4372 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:37:50.629603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8758e-8b78-4d03-bcba-aae53ee5f3e9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:50.630083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8758e-8b78-4d03-bcba-aae53ee5f3e9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:50.630188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8758e-8b78-4d03-bcba-aae53ee5f3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:50.654573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e6b8758e-8b78-4d03-bcba-aae53ee5f3e9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:50.656245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e6b8758e-8b78-4d03-bcba-aae53ee5f3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:50.750883 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4285/8559] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:37:50.765083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:50.766632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:50.873292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:50.879874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32a32e-f347-4f18-b142-e998d7c672d8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:50.886432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7590f-e565-497b-b65d-1d3a957cc015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:50.887060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7590f-e565-497b-b65d-1d3a957cc015 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:50.887568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7590f-e565-497b-b65d-1d3a957cc015 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:50.887921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7590f-e565-497b-b65d-1d3a957cc015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:50.903928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7590f-e565-497b-b65d-1d3a957cc015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:50.905393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7590f-e565-497b-b65d-1d3a957cc015 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:50.922388 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4275/8560] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:37:51.334773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8758e-8b78-4d03-bcba-aae53ee5f3e9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:51.336454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e6b8758e-8b78-4d03-bcba-aae53ee5f3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:51.368333 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8758e-8b78-4d03-bcba-aae53ee5f3e9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:51.377530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:51.378584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:51.379279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:51.379658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] PATH_INFO: `/v3/projects/7014d69a32374afca958ea0b400a1a25` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:51.381835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7014d69a32374afca958ea0b400a1a25)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:51.386474 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:51.500017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7014d69a32374afca958ea0b400a1a25', 'request_id': 'req-ad57ba15-26de-43a6-86fe-b44e204cede7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:51.513389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7014d69a32374afca958ea0b400a1a25', 'request_id': 'req-ad57ba15-26de-43a6-86fe-b44e204cede7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:51.523941 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7014d69a32374afca958ea0b400a1a25', 'request_id': 'req-ad57ba15-26de-43a6-86fe-b44e204cede7'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:51.544043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] The token cache is being invalidate because project 7014d69a32374afca958ea0b400a1a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:37:51.544719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:51.546623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:51.549070 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4286/8561] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:37:51 2022] DELETE /identity/v3/projects/7014d69a32374afca958ea0b400a1a25 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:37:51.553489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7590f-e565-497b-b65d-1d3a957cc015 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:51.570108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7590f-e565-497b-b65d-1d3a957cc015 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:51.647144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859a61d-da94-43bc-a374-2d7558078634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:51.650099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859a61d-da94-43bc-a374-2d7558078634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:51.650099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859a61d-da94-43bc-a374-2d7558078634 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:51.650099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859a61d-da94-43bc-a374-2d7558078634 admin admin] PATH_INFO: `/v3/users/fe125412da5a42e49970f28038d40d80` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:51.655666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859a61d-da94-43bc-a374-2d7558078634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe125412da5a42e49970f28038d40d80)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:51.658095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859a61d-da94-43bc-a374-2d7558078634 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:51.728394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4859a61d-da94-43bc-a374-2d7558078634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe125412da5a42e49970f28038d40d80'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:51.753663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4859a61d-da94-43bc-a374-2d7558078634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe125412da5a42e49970f28038d40d80'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:51.755546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4859a61d-da94-43bc-a374-2d7558078634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe125412da5a42e49970f28038d40d80'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:51.767979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4859a61d-da94-43bc-a374-2d7558078634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe125412da5a42e49970f28038d40d80'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:51.769017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4859a61d-da94-43bc-a374-2d7558078634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe125412da5a42e49970f28038d40d80'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:51.811078 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4276/8562] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:37:51 2022] DELETE /identity/v3/users/fe125412da5a42e49970f28038d40d80 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:37:52.295593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:52.297280 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:52.323658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57ba15-26de-43a6-86fe-b44e204cede7 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:52.449356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0fb55-b5c2-4ed5-b503-b176d055e317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:52.450034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0fb55-b5c2-4ed5-b503-b176d055e317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:52.450319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0fb55-b5c2-4ed5-b503-b176d055e317 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:52.450683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0fb55-b5c2-4ed5-b503-b176d055e317 admin admin] PATH_INFO: `/v3/projects/99610c7846734272afc9410dd1ec414d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:52.453418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0fb55-b5c2-4ed5-b503-b176d055e317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99610c7846734272afc9410dd1ec414d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:52.455393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0fb55-b5c2-4ed5-b503-b176d055e317 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:52.457395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:52.630674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a4e0fb55-b5c2-4ed5-b503-b176d055e317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99610c7846734272afc9410dd1ec414d', 'request_id': 'req-a4e0fb55-b5c2-4ed5-b503-b176d055e317'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:52.661111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a4e0fb55-b5c2-4ed5-b503-b176d055e317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99610c7846734272afc9410dd1ec414d', 'request_id': 'req-a4e0fb55-b5c2-4ed5-b503-b176d055e317'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:52.674910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a4e0fb55-b5c2-4ed5-b503-b176d055e317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99610c7846734272afc9410dd1ec414d', 'request_id': 'req-a4e0fb55-b5c2-4ed5-b503-b176d055e317'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:52.690108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a4e0fb55-b5c2-4ed5-b503-b176d055e317 admin admin] The token cache is being invalidate because project 99610c7846734272afc9410dd1ec414d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:37:52.690703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a4e0fb55-b5c2-4ed5-b503-b176d055e317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:52.691538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a4e0fb55-b5c2-4ed5-b503-b176d055e317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:37:52.696696 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4287/8563] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:37:52 2022] DELETE /identity/v3/projects/99610c7846734272afc9410dd1ec414d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:37:52.700040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17ce0f-0015-4f47-8734-3b08b4d66ecc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:52.700560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17ce0f-0015-4f47-8734-3b08b4d66ecc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:52.700735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17ce0f-0015-4f47-8734-3b08b4d66ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:52.744522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ae17ce0f-0015-4f47-8734-3b08b4d66ecc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:52.747522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ae17ce0f-0015-4f47-8734-3b08b4d66ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:52.914603 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4277/8564] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:52.928716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5822d-b8ae-404b-911c-a2d1f1ff01eb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:52.929200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5822d-b8ae-404b-911c-a2d1f1ff01eb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:52.929496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5822d-b8ae-404b-911c-a2d1f1ff01eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:52.998786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9cf5822d-b8ae-404b-911c-a2d1f1ff01eb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:53.000133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9cf5822d-b8ae-404b-911c-a2d1f1ff01eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:53.023824 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4288/8565] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:53.027830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17ce0f-0015-4f47-8734-3b08b4d66ecc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:53.051435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17ce0f-0015-4f47-8734-3b08b4d66ecc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:53.072000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9e25d-f4b5-43cc-8d6b-1b7226caa14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:53.073489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e25d-f4b5-43cc-8d6b-1b7226caa14c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:53.074292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e25d-f4b5-43cc-8d6b-1b7226caa14c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:53.074686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9e25d-f4b5-43cc-8d6b-1b7226caa14c admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:53.076693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9e25d-f4b5-43cc-8d6b-1b7226caa14c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:37:53.077019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9e25d-f4b5-43cc-8d6b-1b7226caa14c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:53.081706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9e25d-f4b5-43cc-8d6b-1b7226caa14c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:53.094026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:53.109364 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4278/8566] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:37:53.114371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5822d-b8ae-404b-911c-a2d1f1ff01eb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:53.132835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5822d-b8ae-404b-911c-a2d1f1ff01eb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:53.140195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e73f7e-ef49-4eba-b16d-74651358b25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:53.140830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e73f7e-ef49-4eba-b16d-74651358b25a admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:53.141101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e73f7e-ef49-4eba-b16d-74651358b25a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:53.141377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e73f7e-ef49-4eba-b16d-74651358b25a admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:53.142204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e73f7e-ef49-4eba-b16d-74651358b25a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:53.144658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e73f7e-ef49-4eba-b16d-74651358b25a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:53.190128 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4289/8567] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:37:53 2022] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:37:53.194949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9e25d-f4b5-43cc-8d6b-1b7226caa14c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:53.212130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9e25d-f4b5-43cc-8d6b-1b7226caa14c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:53.438645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0900f-4492-44a7-bbaf-35453702c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:53.439931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0900f-4492-44a7-bbaf-35453702c8ce admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:53.442811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0900f-4492-44a7-bbaf-35453702c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:53.443370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0900f-4492-44a7-bbaf-35453702c8ce admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:53.444302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0900f-4492-44a7-bbaf-35453702c8ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:53.455623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0900f-4492-44a7-bbaf-35453702c8ce admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:53.531670 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4279/8568] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:37:53 2022] POST /identity/v3/users => generated 284 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:37:53.535835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e73f7e-ef49-4eba-b16d-74651358b25a admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:53.548828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e73f7e-ef49-4eba-b16d-74651358b25a admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:53.558780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c233653-5e6c-4ac7-b718-c167b78ef252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:53.559826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c233653-5e6c-4ac7-b718-c167b78ef252 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:53.560321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c233653-5e6c-4ac7-b718-c167b78ef252 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:53.560804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c233653-5e6c-4ac7-b718-c167b78ef252 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:53.561680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c233653-5e6c-4ac7-b718-c167b78ef252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:53.564448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c233653-5e6c-4ac7-b718-c167b78ef252 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:53.591397 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4290/8569] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:37:53.593573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0900f-4492-44a7-bbaf-35453702c8ce admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:53.606071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0900f-4492-44a7-bbaf-35453702c8ce admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:53.624731 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415a043-4c2d-4e92-919e-e319d93a909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:53.625520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415a043-4c2d-4e92-919e-e319d93a909d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:53.625989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415a043-4c2d-4e92-919e-e319d93a909d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:53.629594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415a043-4c2d-4e92-919e-e319d93a909d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:53.630935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415a043-4c2d-4e92-919e-e319d93a909d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:53.632844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415a043-4c2d-4e92-919e-e319d93a909d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:53.649041 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4280/8570] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:37:53.655913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c233653-5e6c-4ac7-b718-c167b78ef252 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:53.680386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c233653-5e6c-4ac7-b718-c167b78ef252 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:53.695992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae61dd-16e4-4d07-bb71-5b42cef243fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:53.699025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae61dd-16e4-4d07-bb71-5b42cef243fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:53.699460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae61dd-16e4-4d07-bb71-5b42cef243fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:53.700024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae61dd-16e4-4d07-bb71-5b42cef243fa admin admin] PATH_INFO: `/v3/projects/ccca0ab0eb2744b28528d269424e3b41/users/d56f874b79da49ad9659dab4a67b5c36/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:53.754436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae61dd-16e4-4d07-bb71-5b42cef243fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccca0ab0eb2744b28528d269424e3b41, user_id=d56f874b79da49ad9659dab4a67b5c36, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:53.757278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae61dd-16e4-4d07-bb71-5b42cef243fa admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:53.817979 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4291/8571] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:37:53 2022] PUT /identity/v3/projects/ccca0ab0eb2744b28528d269424e3b41/users/d56f874b79da49ad9659dab4a67b5c36/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:37:53.834720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57bda-8bc5-492b-87f2-60c49e83a429 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:53.836018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57bda-8bc5-492b-87f2-60c49e83a429 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:53.836018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57bda-8bc5-492b-87f2-60c49e83a429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:53.890846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-b1e57bda-8bc5-492b-87f2-60c49e83a429 None None] MFA Rules not processed for user `d56f874b79da49ad9659dab4a67b5c36`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:53.892280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b1e57bda-8bc5-492b-87f2-60c49e83a429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:54.078512 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4281/8572] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:54.082854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae61dd-16e4-4d07-bb71-5b42cef243fa admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:54.203996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae61dd-16e4-4d07-bb71-5b42cef243fa admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:54.214894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec7c4e-6407-41dd-8dda-ba28771683da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:54.215839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec7c4e-6407-41dd-8dda-ba28771683da admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:54.216291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec7c4e-6407-41dd-8dda-ba28771683da admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:54.216749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec7c4e-6407-41dd-8dda-ba28771683da admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:54.218424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec7c4e-6407-41dd-8dda-ba28771683da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:54.221562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec7c4e-6407-41dd-8dda-ba28771683da admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:54.318273 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4292/8573] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:37:54 2022] POST /identity/v3/projects => generated 369 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:37:54.324466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e57bda-8bc5-492b-87f2-60c49e83a429 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:54.345018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e57bda-8bc5-492b-87f2-60c49e83a429 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:54.477734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51bb25-e3c5-4dcf-9e21-99da843742cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:54.480271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51bb25-e3c5-4dcf-9e21-99da843742cf admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:54.480588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51bb25-e3c5-4dcf-9e21-99da843742cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:54.481000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51bb25-e3c5-4dcf-9e21-99da843742cf admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:54.481602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51bb25-e3c5-4dcf-9e21-99da843742cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:54.484115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51bb25-e3c5-4dcf-9e21-99da843742cf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:54.539179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:54.603217 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4282/8574] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:37:54 2022] POST /identity/v3/users => generated 291 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:37:54.609094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec7c4e-6407-41dd-8dda-ba28771683da admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:54.624819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec7c4e-6407-41dd-8dda-ba28771683da admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:54.644197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded5a11-0e25-4db0-ab5a-84c013ef50cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:54.644977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded5a11-0e25-4db0-ab5a-84c013ef50cc admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:54.645262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded5a11-0e25-4db0-ab5a-84c013ef50cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:54.645611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded5a11-0e25-4db0-ab5a-84c013ef50cc admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:54.646339 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded5a11-0e25-4db0-ab5a-84c013ef50cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:54.654500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded5a11-0e25-4db0-ab5a-84c013ef50cc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:54.667318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:37:54.679232 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4293/8575] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:37:54.685878 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51bb25-e3c5-4dcf-9e21-99da843742cf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:54.703174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51bb25-e3c5-4dcf-9e21-99da843742cf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:54.724216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec133e-3edd-4d5a-83b0-1a6e358ac5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:54.725001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec133e-3edd-4d5a-83b0-1a6e358ac5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:54.725249 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec133e-3edd-4d5a-83b0-1a6e358ac5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:54.725429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec133e-3edd-4d5a-83b0-1a6e358ac5ea admin admin] PATH_INFO: `/v3/projects/0abb2b9351db4d859a4868f8dcd60f06/users/80e2419b05144280bcb92957a3a7702e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:54.762227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec133e-3edd-4d5a-83b0-1a6e358ac5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abb2b9351db4d859a4868f8dcd60f06, user_id=80e2419b05144280bcb92957a3a7702e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:54.765324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec133e-3edd-4d5a-83b0-1a6e358ac5ea admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:54.812604 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4283/8576] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:37:54 2022] PUT /identity/v3/projects/0abb2b9351db4d859a4868f8dcd60f06/users/80e2419b05144280bcb92957a3a7702e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:37:54.816317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded5a11-0e25-4db0-ab5a-84c013ef50cc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:54.842274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded5a11-0e25-4db0-ab5a-84c013ef50cc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:55.049085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305eb93-92d7-4d5e-8d07-f5c216ad6177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:55.050785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305eb93-92d7-4d5e-8d07-f5c216ad6177 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:55.052802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305eb93-92d7-4d5e-8d07-f5c216ad6177 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:55.054127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305eb93-92d7-4d5e-8d07-f5c216ad6177 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:55.055687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305eb93-92d7-4d5e-8d07-f5c216ad6177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:55.057946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305eb93-92d7-4d5e-8d07-f5c216ad6177 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:55.138221 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4294/8577] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:37:55.147259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec133e-3edd-4d5a-83b0-1a6e358ac5ea admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:55.189127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec133e-3edd-4d5a-83b0-1a6e358ac5ea admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:55.212933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc62d4-5fa6-4cb8-b90b-9a9c15fa35ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:55.213700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc62d4-5fa6-4cb8-b90b-9a9c15fa35ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:55.214040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc62d4-5fa6-4cb8-b90b-9a9c15fa35ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:55.214254 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc62d4-5fa6-4cb8-b90b-9a9c15fa35ea admin admin] PATH_INFO: `/v3/projects/0abb2b9351db4d859a4868f8dcd60f06/users/80e2419b05144280bcb92957a3a7702e/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:55.220193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc62d4-5fa6-4cb8-b90b-9a9c15fa35ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abb2b9351db4d859a4868f8dcd60f06, user_id=80e2419b05144280bcb92957a3a7702e, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:55.223996 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc62d4-5fa6-4cb8-b90b-9a9c15fa35ea admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:55.288066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98055ecf-73d8-42c7-a3c5-7efdfc9d5e33 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:55.288290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98055ecf-73d8-42c7-a3c5-7efdfc9d5e33 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:55.288552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98055ecf-73d8-42c7-a3c5-7efdfc9d5e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:55.294060 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4284/8578] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:37:55 2022] PUT /identity/v3/projects/0abb2b9351db4d859a4868f8dcd60f06/users/80e2419b05144280bcb92957a3a7702e/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:37:55.422147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-98055ecf-73d8-42c7-a3c5-7efdfc9d5e33 None None] MFA Rules not processed for user `80e2419b05144280bcb92957a3a7702e`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:55.423523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-98055ecf-73d8-42c7-a3c5-7efdfc9d5e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:55.662804 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4295/8579] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:55.674046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc62d4-5fa6-4cb8-b90b-9a9c15fa35ea admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:55.676291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fbdc62d4-5fa6-4cb8-b90b-9a9c15fa35ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:55.859696 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc62d4-5fa6-4cb8-b90b-9a9c15fa35ea admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:55.868305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4394e-841e-4655-ac3c-c83579e79fd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:55.868682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4394e-841e-4655-ac3c-c83579e79fd2 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:55.870178 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4394e-841e-4655-ac3c-c83579e79fd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:55.870300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4394e-841e-4655-ac3c-c83579e79fd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:55.918896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4394e-841e-4655-ac3c-c83579e79fd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:55.935468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4394e-841e-4655-ac3c-c83579e79fd2 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:55.975278 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4285/8580] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:37:56.154242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98055ecf-73d8-42c7-a3c5-7efdfc9d5e33 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:56.234910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98055ecf-73d8-42c7-a3c5-7efdfc9d5e33 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:37:56.244021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a5ec1-959c-4914-a04d-aadebe7588ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:37:56.245793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5ec1-959c-4914-a04d-aadebe7588ad service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:56.246238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5ec1-959c-4914-a04d-aadebe7588ad service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:56.246676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a5ec1-959c-4914-a04d-aadebe7588ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:56.479795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a5ec1-959c-4914-a04d-aadebe7588ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:37:56.484293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a5ec1-959c-4914-a04d-aadebe7588ad service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:37:56.511761 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4296/8581] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:37:58.474498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f31f98-eec8-49c9-a1ff-971ecde8bdaa None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:37:58.475067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f31f98-eec8-49c9-a1ff-971ecde8bdaa None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:37:58.475353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f31f98-eec8-49c9-a1ff-971ecde8bdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:37:58.507671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-67f31f98-eec8-49c9-a1ff-971ecde8bdaa None None] MFA Rules not processed for user `b0ae958878db4d2a81ba14f57b3128c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:37:58.509204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-67f31f98-eec8-49c9-a1ff-971ecde8bdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:58.678390 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4286/8582] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:37:59.855878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a5ec1-959c-4914-a04d-aadebe7588ad service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:37:59.856916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-115a5ec1-959c-4914-a04d-aadebe7588ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:37:59.924847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:00.001669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a5ec1-959c-4914-a04d-aadebe7588ad service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:00.012586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8f5db-308b-461d-94bf-cff765c3d02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:00.016755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8f5db-308b-461d-94bf-cff765c3d02b service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:00.017302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8f5db-308b-461d-94bf-cff765c3d02b service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:00.017588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8f5db-308b-461d-94bf-cff765c3d02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:00.024056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5fe8f5db-308b-461d-94bf-cff765c3d02b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:00.043560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8f5db-308b-461d-94bf-cff765c3d02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:00.044903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8f5db-308b-461d-94bf-cff765c3d02b service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:00.067041 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4297/8583] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:37:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:38:01.839653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f31f98-eec8-49c9-a1ff-971ecde8bdaa None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:01.905630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c5ce-377f-47ea-872e-da044a40079f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:01.906205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c5ce-377f-47ea-872e-da044a40079f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:01.906618 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c5ce-377f-47ea-872e-da044a40079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:01.953126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ce68c5ce-377f-47ea-872e-da044a40079f None None] MFA Rules not processed for user `30add6fc24b34085b5eaac8df54c424f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:38:01.954579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ce68c5ce-377f-47ea-872e-da044a40079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:02.017055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f31f98-eec8-49c9-a1ff-971ecde8bdaa None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:02.038999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:02.043834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:02.044251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:02.044539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] PATH_INFO: `/v3/users/d56f874b79da49ad9659dab4a67b5c36` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:02.046840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56f874b79da49ad9659dab4a67b5c36)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:02.048964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:02.049481 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4298/8584] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:38:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:38:02.055311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:02.120169 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56f874b79da49ad9659dab4a67b5c36'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:02.132179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56f874b79da49ad9659dab4a67b5c36'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:02.140688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56f874b79da49ad9659dab4a67b5c36'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:02.164535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56f874b79da49ad9659dab4a67b5c36'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:02.168445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56f874b79da49ad9659dab4a67b5c36'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:02.209901 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4287/8585] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:38:01 2022] DELETE /identity/v3/users/d56f874b79da49ad9659dab4a67b5c36 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:38:02.211190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aad20-ea97-4e4d-b97c-282f30fca40c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:02.211486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aad20-ea97-4e4d-b97c-282f30fca40c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:02.211765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7aad20-ea97-4e4d-b97c-282f30fca40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:02.250211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3f7aad20-ea97-4e4d-b97c-282f30fca40c None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:38:02.251753 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3f7aad20-ea97-4e4d-b97c-282f30fca40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:02.376281 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4299/8586] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:38:02.377499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:02.379974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:02.502305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f16f8-b0db-4300-949d-4d198f6780ae admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:02.507176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991e4a5-df49-4b4b-a80a-8c6060fbd067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:02.508020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991e4a5-df49-4b4b-a80a-8c6060fbd067 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:02.508464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991e4a5-df49-4b4b-a80a-8c6060fbd067 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:02.508841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991e4a5-df49-4b4b-a80a-8c6060fbd067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:02.520725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991e4a5-df49-4b4b-a80a-8c6060fbd067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:02.522402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991e4a5-df49-4b4b-a80a-8c6060fbd067 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:02.537948 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4288/8587] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:38:02.614097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aad20-ea97-4e4d-b97c-282f30fca40c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:02.616375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3f7aad20-ea97-4e4d-b97c-282f30fca40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:02.641761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7aad20-ea97-4e4d-b97c-282f30fca40c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:02.655122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b786b-2149-4ced-864f-b92970845baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:02.664336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b786b-2149-4ced-864f-b92970845baa service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:02.667718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b786b-2149-4ced-864f-b92970845baa service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:02.668092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b786b-2149-4ced-864f-b92970845baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:02.674769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7e4b786b-2149-4ced-864f-b92970845baa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:02.692600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b786b-2149-4ced-864f-b92970845baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:02.695149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b786b-2149-4ced-864f-b92970845baa service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:02.709219 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4300/8588] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:38:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:38:02.985562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991e4a5-df49-4b4b-a80a-8c6060fbd067 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:02.988223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8991e4a5-df49-4b4b-a80a-8c6060fbd067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:03.013975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991e4a5-df49-4b4b-a80a-8c6060fbd067 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:03.024067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:03.024900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:03.025343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:03.027286 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] PATH_INFO: `/v3/projects/ccca0ab0eb2744b28528d269424e3b41` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:03.029156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccca0ab0eb2744b28528d269424e3b41)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:03.032717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:03.122713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccca0ab0eb2744b28528d269424e3b41', 'request_id': 'req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:03.138225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccca0ab0eb2744b28528d269424e3b41', 'request_id': 'req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:03.167797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccca0ab0eb2744b28528d269424e3b41', 'request_id': 'req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:03.208153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] The token cache is being invalidate because project ccca0ab0eb2744b28528d269424e3b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:38:03.208639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:03.210624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:03.213907 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4289/8589] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:38:02 2022] DELETE /identity/v3/projects/ccca0ab0eb2744b28528d269424e3b41 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:38:03.218016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b786b-2149-4ced-864f-b92970845baa service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:03.232283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b786b-2149-4ced-864f-b92970845baa service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:03.311636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:03.340570 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5532122-b8b9-4a2b-ad47-8d5599bf1302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:03.341424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5532122-b8b9-4a2b-ad47-8d5599bf1302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:03.341771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5532122-b8b9-4a2b-ad47-8d5599bf1302 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:03.343712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5532122-b8b9-4a2b-ad47-8d5599bf1302 admin admin] PATH_INFO: `/v3/users/80e2419b05144280bcb92957a3a7702e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:03.346728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5532122-b8b9-4a2b-ad47-8d5599bf1302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e2419b05144280bcb92957a3a7702e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:03.352387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5532122-b8b9-4a2b-ad47-8d5599bf1302 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:03.466128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e5532122-b8b9-4a2b-ad47-8d5599bf1302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e2419b05144280bcb92957a3a7702e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:03.476336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e5532122-b8b9-4a2b-ad47-8d5599bf1302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e2419b05144280bcb92957a3a7702e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:03.477422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e5532122-b8b9-4a2b-ad47-8d5599bf1302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e2419b05144280bcb92957a3a7702e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:03.496969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e5532122-b8b9-4a2b-ad47-8d5599bf1302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e2419b05144280bcb92957a3a7702e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:03.498092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-e5532122-b8b9-4a2b-ad47-8d5599bf1302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e2419b05144280bcb92957a3a7702e'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:03.543685 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4301/8590] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:38:03 2022] DELETE /identity/v3/users/80e2419b05144280bcb92957a3a7702e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:38:04.183030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:04.185522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:04.247585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bad881-4bb5-4e39-80c7-736a1d3e96eb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:04.261068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:04.440525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:04.444070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:04.445588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:04.446484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0 admin admin] PATH_INFO: `/v3/projects/0abb2b9351db4d859a4868f8dcd60f06` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:04.450728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abb2b9351db4d859a4868f8dcd60f06)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:04.456393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:04.551693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abb2b9351db4d859a4868f8dcd60f06', 'request_id': 'req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:04.561181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abb2b9351db4d859a4868f8dcd60f06', 'request_id': 'req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:04.569726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abb2b9351db4d859a4868f8dcd60f06', 'request_id': 'req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:04.592315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0 admin admin] The token cache is being invalidate because project 0abb2b9351db4d859a4868f8dcd60f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:38:04.592740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:04.595223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d3d155a6-4b66-4137-b4c6-2471a2dc73d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:04.597688 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4290/8591] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:38:04 2022] DELETE /identity/v3/projects/0abb2b9351db4d859a4868f8dcd60f06 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:38:04.606467 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bd88d-9277-41b9-9b6f-fcf1dde246bb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:04.607061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bd88d-9277-41b9-9b6f-fcf1dde246bb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:04.607213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bd88d-9277-41b9-9b6f-fcf1dde246bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:04.642882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-df6bd88d-9277-41b9-9b6f-fcf1dde246bb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:38:04.644579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-df6bd88d-9277-41b9-9b6f-fcf1dde246bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:04.770144 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4302/8592] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:38:04.780492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d5121-90e5-4ccc-afc2-103d287a6a3d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:04.780881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d5121-90e5-4ccc-afc2-103d287a6a3d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:04.781164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d5121-90e5-4ccc-afc2-103d287a6a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:04.809431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ec8d5121-90e5-4ccc-afc2-103d287a6a3d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:38:04.811601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ec8d5121-90e5-4ccc-afc2-103d287a6a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:04.825176 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4291/8593] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:38:04.830922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bd88d-9277-41b9-9b6f-fcf1dde246bb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:04.848087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bd88d-9277-41b9-9b6f-fcf1dde246bb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:04.856322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e8e74-f5c5-4ad8-93d6-285b46bba503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:04.857361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e8e74-f5c5-4ad8-93d6-285b46bba503 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:04.857841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e8e74-f5c5-4ad8-93d6-285b46bba503 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:04.858311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e8e74-f5c5-4ad8-93d6-285b46bba503 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:04.859317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e8e74-f5c5-4ad8-93d6-285b46bba503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:38:04.859817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e8e74-f5c5-4ad8-93d6-285b46bba503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:04.862024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e8e74-f5c5-4ad8-93d6-285b46bba503 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:04.882411 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4303/8594] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:38:04.888709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d5121-90e5-4ccc-afc2-103d287a6a3d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:04.902935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d5121-90e5-4ccc-afc2-103d287a6a3d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:04.922970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6df7ed-4f6b-45ec-8559-8f17c484a863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:04.923978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6df7ed-4f6b-45ec-8559-8f17c484a863 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:04.925331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6df7ed-4f6b-45ec-8559-8f17c484a863 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:04.925941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6df7ed-4f6b-45ec-8559-8f17c484a863 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:04.926625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6df7ed-4f6b-45ec-8559-8f17c484a863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:04.929280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6df7ed-4f6b-45ec-8559-8f17c484a863 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:05.005285 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4292/8595] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:38:04 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:38:05.006307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e8e74-f5c5-4ad8-93d6-285b46bba503 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:05.021214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e8e74-f5c5-4ad8-93d6-285b46bba503 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:05.123201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff300a16-97a4-4d64-bc2c-3714b12d3337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:05.124246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff300a16-97a4-4d64-bc2c-3714b12d3337 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:05.127040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff300a16-97a4-4d64-bc2c-3714b12d3337 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:05.127552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff300a16-97a4-4d64-bc2c-3714b12d3337 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:05.128450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff300a16-97a4-4d64-bc2c-3714b12d3337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:05.131799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff300a16-97a4-4d64-bc2c-3714b12d3337 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:05.144639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:05.167247 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4304/8596] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:38:05 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:38:05.172658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6df7ed-4f6b-45ec-8559-8f17c484a863 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:05.218646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6df7ed-4f6b-45ec-8559-8f17c484a863 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:05.247904 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e9b30-3392-408f-bdb4-4fd6b6b57202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:05.249188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e9b30-3392-408f-bdb4-4fd6b6b57202 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:05.249682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e9b30-3392-408f-bdb4-4fd6b6b57202 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:05.250162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e9b30-3392-408f-bdb4-4fd6b6b57202 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:05.251133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e9b30-3392-408f-bdb4-4fd6b6b57202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:05.253919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e9b30-3392-408f-bdb4-4fd6b6b57202 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:05.281982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff300a16-97a4-4d64-bc2c-3714b12d3337 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:05.286625 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4293/8597] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:38:05.299802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff300a16-97a4-4d64-bc2c-3714b12d3337 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:05.313380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab20d4-3434-4968-9b54-8ffec0bb4f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:05.313936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab20d4-3434-4968-9b54-8ffec0bb4f4e admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:05.314226 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab20d4-3434-4968-9b54-8ffec0bb4f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:05.314509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab20d4-3434-4968-9b54-8ffec0bb4f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:05.315219 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab20d4-3434-4968-9b54-8ffec0bb4f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:05.317262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab20d4-3434-4968-9b54-8ffec0bb4f4e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:05.360659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e9b30-3392-408f-bdb4-4fd6b6b57202 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:05.361805 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4305/8598] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:38:05.377843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e9b30-3392-408f-bdb4-4fd6b6b57202 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:05.383356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef91cc-d478-4842-b71b-139486723ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:05.384239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef91cc-d478-4842-b71b-139486723ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:05.384627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef91cc-d478-4842-b71b-139486723ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:05.385943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef91cc-d478-4842-b71b-139486723ebd admin admin] PATH_INFO: `/v3/projects/cb8182c403f64309957cf01c1327390b/users/e9f33d98724c459da3f9a5d9193104e4/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:05.407260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef91cc-d478-4842-b71b-139486723ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb8182c403f64309957cf01c1327390b, user_id=e9f33d98724c459da3f9a5d9193104e4, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:05.410262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef91cc-d478-4842-b71b-139486723ebd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:05.443553 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4294/8599] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:38:05 2022] PUT /identity/v3/projects/cb8182c403f64309957cf01c1327390b/users/e9f33d98724c459da3f9a5d9193104e4/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:38:05.457188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2d94-f5e6-41c6-90e2-2ed3ea021a22 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:05.457560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2d94-f5e6-41c6-90e2-2ed3ea021a22 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:05.457774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2d94-f5e6-41c6-90e2-2ed3ea021a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:05.552105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b64b2d94-f5e6-41c6-90e2-2ed3ea021a22 None None] MFA Rules not processed for user `e9f33d98724c459da3f9a5d9193104e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:38:05.553731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b64b2d94-f5e6-41c6-90e2-2ed3ea021a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:05.737646 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4306/8600] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:38:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:38:05.742488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef91cc-d478-4842-b71b-139486723ebd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:05.848049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:05.884158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef91cc-d478-4842-b71b-139486723ebd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:05.890418 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4112c2-0aed-4d4c-8ade-3e413714edab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:05.891184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4112c2-0aed-4d4c-8ade-3e413714edab admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:05.891524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4112c2-0aed-4d4c-8ade-3e413714edab admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:05.891893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4112c2-0aed-4d4c-8ade-3e413714edab admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:05.892587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4112c2-0aed-4d4c-8ade-3e413714edab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:05.894668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4112c2-0aed-4d4c-8ade-3e413714edab admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:05.936458 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4295/8601] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:38:05 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:38:05.940962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b2d94-f5e6-41c6-90e2-2ed3ea021a22 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:05.960536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b2d94-f5e6-41c6-90e2-2ed3ea021a22 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:06.084324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1128dc-0ae6-423b-bd99-f747ef8e55c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:06.084899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1128dc-0ae6-423b-bd99-f747ef8e55c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:06.085227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1128dc-0ae6-423b-bd99-f747ef8e55c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:06.085513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1128dc-0ae6-423b-bd99-f747ef8e55c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:06.086148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1128dc-0ae6-423b-bd99-f747ef8e55c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:06.090170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1128dc-0ae6-423b-bd99-f747ef8e55c1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:06.127751 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4307/8602] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:38:05 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:38:06.134455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4112c2-0aed-4d4c-8ade-3e413714edab admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:06.155970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4112c2-0aed-4d4c-8ade-3e413714edab admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:06.170449 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d169e0-a4c7-4c04-8be1-baf6c2b2bd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:06.173570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d169e0-a4c7-4c04-8be1-baf6c2b2bd9b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:06.175229 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d169e0-a4c7-4c04-8be1-baf6c2b2bd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:06.176713 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d169e0-a4c7-4c04-8be1-baf6c2b2bd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:06.177676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d169e0-a4c7-4c04-8be1-baf6c2b2bd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:06.185309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d169e0-a4c7-4c04-8be1-baf6c2b2bd9b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:06.223206 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4296/8603] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:38:06.224897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1128dc-0ae6-423b-bd99-f747ef8e55c1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:06.239225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1128dc-0ae6-423b-bd99-f747ef8e55c1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:06.247288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d9534-5078-4413-8a03-50faee5fa674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:06.248021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d9534-5078-4413-8a03-50faee5fa674 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:06.248368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d9534-5078-4413-8a03-50faee5fa674 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:06.248650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d9534-5078-4413-8a03-50faee5fa674 admin admin] PATH_INFO: `/v3/projects/d6e7a9b651294cca877e314a3681b4e6/users/38f903032ec14816b47ea7045873b1f7/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:06.287399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d9534-5078-4413-8a03-50faee5fa674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e7a9b651294cca877e314a3681b4e6, user_id=38f903032ec14816b47ea7045873b1f7, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:06.296096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d9534-5078-4413-8a03-50faee5fa674 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:06.319591 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4308/8604] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:38:06 2022] PUT /identity/v3/projects/d6e7a9b651294cca877e314a3681b4e6/users/38f903032ec14816b47ea7045873b1f7/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:38:06.321045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d169e0-a4c7-4c04-8be1-baf6c2b2bd9b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:06.335361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d169e0-a4c7-4c04-8be1-baf6c2b2bd9b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:06.499120 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fe36b-aeb1-4f19-af12-cccde9bbe080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:06.499710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fe36b-aeb1-4f19-af12-cccde9bbe080 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:06.500327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fe36b-aeb1-4f19-af12-cccde9bbe080 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:06.500327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fe36b-aeb1-4f19-af12-cccde9bbe080 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:06.501030 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fe36b-aeb1-4f19-af12-cccde9bbe080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:06.502574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fe36b-aeb1-4f19-af12-cccde9bbe080 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:06.518565 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4297/8605] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:38:06.520106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d9534-5078-4413-8a03-50faee5fa674 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:06.537148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d9534-5078-4413-8a03-50faee5fa674 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:06.544982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429c9d9-781d-4a8a-881b-af5e57807858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:06.545944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429c9d9-781d-4a8a-881b-af5e57807858 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:06.546401 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429c9d9-781d-4a8a-881b-af5e57807858 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:06.546965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429c9d9-781d-4a8a-881b-af5e57807858 admin admin] PATH_INFO: `/v3/projects/d6e7a9b651294cca877e314a3681b4e6/users/38f903032ec14816b47ea7045873b1f7/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:06.549313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429c9d9-781d-4a8a-881b-af5e57807858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e7a9b651294cca877e314a3681b4e6, user_id=38f903032ec14816b47ea7045873b1f7, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:06.553147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429c9d9-781d-4a8a-881b-af5e57807858 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:06.569406 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4309/8606] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:38:06 2022] PUT /identity/v3/projects/d6e7a9b651294cca877e314a3681b4e6/users/38f903032ec14816b47ea7045873b1f7/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:38:06.585226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74388852-5650-464b-9294-45adf01a766a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:06.586067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74388852-5650-464b-9294-45adf01a766a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:06.586363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74388852-5650-464b-9294-45adf01a766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:06.640895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-74388852-5650-464b-9294-45adf01a766a None None] MFA Rules not processed for user `38f903032ec14816b47ea7045873b1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:38:06.642999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-74388852-5650-464b-9294-45adf01a766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:06.778722 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4298/8607] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:38:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:38:06.794242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429c9d9-781d-4a8a-881b-af5e57807858 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:06.797331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1429c9d9-781d-4a8a-881b-af5e57807858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:06.880174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:06.952155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429c9d9-781d-4a8a-881b-af5e57807858 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:06.956272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7529211-7eb6-4882-9360-7fa2ebcf73a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:06.956990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7529211-7eb6-4882-9360-7fa2ebcf73a5 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:06.957596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7529211-7eb6-4882-9360-7fa2ebcf73a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:06.957957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7529211-7eb6-4882-9360-7fa2ebcf73a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:06.974028 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7529211-7eb6-4882-9360-7fa2ebcf73a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:06.975978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7529211-7eb6-4882-9360-7fa2ebcf73a5 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:06.999872 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4310/8608] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:38:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:38:07.168515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74388852-5650-464b-9294-45adf01a766a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:07.184969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74388852-5650-464b-9294-45adf01a766a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:07.189222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf84292-e68a-40a0-9128-7d01214a6cda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:07.190783 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf84292-e68a-40a0-9128-7d01214a6cda service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:07.191067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf84292-e68a-40a0-9128-7d01214a6cda service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:07.191344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf84292-e68a-40a0-9128-7d01214a6cda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:07.231561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:07.285064 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf84292-e68a-40a0-9128-7d01214a6cda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:07.286830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf84292-e68a-40a0-9128-7d01214a6cda service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:07.298256 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4299/8609] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:38:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:38:07.767811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7529211-7eb6-4882-9360-7fa2ebcf73a5 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:07.876792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7529211-7eb6-4882-9360-7fa2ebcf73a5 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:07.897682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:07.902896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:07.903713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:07.904198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] PATH_INFO: `/v3/users/e9f33d98724c459da3f9a5d9193104e4` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:07.906395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f33d98724c459da3f9a5d9193104e4)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:07.911019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:08.002611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f33d98724c459da3f9a5d9193104e4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:08.027337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f33d98724c459da3f9a5d9193104e4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:08.028545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f33d98724c459da3f9a5d9193104e4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:08.060782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f33d98724c459da3f9a5d9193104e4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:08.062659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f33d98724c459da3f9a5d9193104e4'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:08.104568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a77b2-f385-488b-a133-f9910326e739 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:08.105197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a77b2-f385-488b-a133-f9910326e739 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:08.105688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a77b2-f385-488b-a133-f9910326e739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:08.110458 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4311/8610] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:38:07 2022] DELETE /identity/v3/users/e9f33d98724c459da3f9a5d9193104e4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:38:08.145114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-809a77b2-f385-488b-a133-f9910326e739 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:38:08.155634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-809a77b2-f385-488b-a133-f9910326e739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:08.235450 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4300/8611] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:38:08.263615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:08.268563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:08.350657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a77b2-f385-488b-a133-f9910326e739 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:08.354007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-809a77b2-f385-488b-a133-f9910326e739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:08.367945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:08.387548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d290b-f6e1-4f16-b967-421675380385 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:08.391951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1d787-dde1-457c-a27a-e78bb6cabe53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:08.392809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1d787-dde1-457c-a27a-e78bb6cabe53 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:08.393167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1d787-dde1-457c-a27a-e78bb6cabe53 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:08.393520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1d787-dde1-457c-a27a-e78bb6cabe53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:08.405071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1d787-dde1-457c-a27a-e78bb6cabe53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:08.406714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1d787-dde1-457c-a27a-e78bb6cabe53 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:08.418888 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4312/8612] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:38:08.464265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a77b2-f385-488b-a133-f9910326e739 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:08.468896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ada53d-e0dd-4967-887c-dc9d1e0dd381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:08.469852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ada53d-e0dd-4967-887c-dc9d1e0dd381 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:08.470313 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ada53d-e0dd-4967-887c-dc9d1e0dd381 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:08.470905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ada53d-e0dd-4967-887c-dc9d1e0dd381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:08.473275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-56ada53d-e0dd-4967-887c-dc9d1e0dd381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:08.489848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ada53d-e0dd-4967-887c-dc9d1e0dd381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:08.491620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ada53d-e0dd-4967-887c-dc9d1e0dd381 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:08.508422 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4301/8613] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:38:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:38:09.285074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1d787-dde1-457c-a27a-e78bb6cabe53 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:09.286662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f2e1d787-dde1-457c-a27a-e78bb6cabe53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:09.301950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1d787-dde1-457c-a27a-e78bb6cabe53 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:09.307812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:09.308625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:09.308910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:09.309192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] PATH_INFO: `/v3/projects/cb8182c403f64309957cf01c1327390b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:09.310541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb8182c403f64309957cf01c1327390b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:09.312847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:09.372155 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb8182c403f64309957cf01c1327390b', 'request_id': 'req-088e60bc-7609-434e-b610-1f97ec6d7533'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:09.398924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb8182c403f64309957cf01c1327390b', 'request_id': 'req-088e60bc-7609-434e-b610-1f97ec6d7533'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:09.408274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb8182c403f64309957cf01c1327390b', 'request_id': 'req-088e60bc-7609-434e-b610-1f97ec6d7533'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:09.423502 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] The token cache is being invalidate because project cb8182c403f64309957cf01c1327390b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:38:09.423835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:09.424580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:09.426848 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4313/8614] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:38:09 2022] DELETE /identity/v3/projects/cb8182c403f64309957cf01c1327390b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:38:09.430887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ada53d-e0dd-4967-887c-dc9d1e0dd381 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:09.449782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ada53d-e0dd-4967-887c-dc9d1e0dd381 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:09.526281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289015e0-9475-42b6-ad5c-b6ed58970630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:09.527483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289015e0-9475-42b6-ad5c-b6ed58970630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:09.527967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289015e0-9475-42b6-ad5c-b6ed58970630 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:09.528426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289015e0-9475-42b6-ad5c-b6ed58970630 admin admin] PATH_INFO: `/v3/users/38f903032ec14816b47ea7045873b1f7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:09.529866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289015e0-9475-42b6-ad5c-b6ed58970630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f903032ec14816b47ea7045873b1f7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:09.532884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289015e0-9475-42b6-ad5c-b6ed58970630 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:09.555819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:09.613381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-289015e0-9475-42b6-ad5c-b6ed58970630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f903032ec14816b47ea7045873b1f7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:09.633073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-289015e0-9475-42b6-ad5c-b6ed58970630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f903032ec14816b47ea7045873b1f7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:09.636428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-289015e0-9475-42b6-ad5c-b6ed58970630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f903032ec14816b47ea7045873b1f7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:09.650552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-289015e0-9475-42b6-ad5c-b6ed58970630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f903032ec14816b47ea7045873b1f7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:09.651447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-289015e0-9475-42b6-ad5c-b6ed58970630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f903032ec14816b47ea7045873b1f7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:09.680040 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4302/8615] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:38:09 2022] DELETE /identity/v3/users/38f903032ec14816b47ea7045873b1f7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:38:10.041773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:10.045018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:10.078133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e60bc-7609-434e-b610-1f97ec6d7533 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:10.192931 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a0eb6-dae9-49a7-a351-307019fb325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:10.193511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a0eb6-dae9-49a7-a351-307019fb325d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:10.193795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a0eb6-dae9-49a7-a351-307019fb325d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:10.194075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a0eb6-dae9-49a7-a351-307019fb325d admin admin] PATH_INFO: `/v3/projects/d6e7a9b651294cca877e314a3681b4e6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:10.195337 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a0eb6-dae9-49a7-a351-307019fb325d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e7a9b651294cca877e314a3681b4e6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:10.197336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a0eb6-dae9-49a7-a351-307019fb325d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:10.271786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e4a0eb6-dae9-49a7-a351-307019fb325d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e7a9b651294cca877e314a3681b4e6', 'request_id': 'req-7e4a0eb6-dae9-49a7-a351-307019fb325d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:10.280984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e4a0eb6-dae9-49a7-a351-307019fb325d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e7a9b651294cca877e314a3681b4e6', 'request_id': 'req-7e4a0eb6-dae9-49a7-a351-307019fb325d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:10.287928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e4a0eb6-dae9-49a7-a351-307019fb325d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e7a9b651294cca877e314a3681b4e6', 'request_id': 'req-7e4a0eb6-dae9-49a7-a351-307019fb325d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:10.297421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:10.302252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e4a0eb6-dae9-49a7-a351-307019fb325d admin admin] The token cache is being invalidate because project d6e7a9b651294cca877e314a3681b4e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:38:10.302911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e4a0eb6-dae9-49a7-a351-307019fb325d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:10.304622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7e4a0eb6-dae9-49a7-a351-307019fb325d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:38:10.306629 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4314/8616] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:38:10 2022] DELETE /identity/v3/projects/d6e7a9b651294cca877e314a3681b4e6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:38:10.313135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42147d-fc81-4d0d-b741-3d18f2d84194 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:10.313740 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42147d-fc81-4d0d-b741-3d18f2d84194 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:10.314219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42147d-fc81-4d0d-b741-3d18f2d84194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:10.340529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fb42147d-fc81-4d0d-b741-3d18f2d84194 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:38:10.342319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fb42147d-fc81-4d0d-b741-3d18f2d84194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:10.435412 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4303/8617] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:38:10.445631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde74190-d686-4a54-8796-9a2affcfb969 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:10.446035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde74190-d686-4a54-8796-9a2affcfb969 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:10.446412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde74190-d686-4a54-8796-9a2affcfb969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:10.482427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-cde74190-d686-4a54-8796-9a2affcfb969 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:38:10.484011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cde74190-d686-4a54-8796-9a2affcfb969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:10.505229 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4315/8618] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:38:10.509960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42147d-fc81-4d0d-b741-3d18f2d84194 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:10.524824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42147d-fc81-4d0d-b741-3d18f2d84194 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:10.535605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4501ec0-d6f0-44c8-9d37-de3cf8517cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:10.536510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4501ec0-d6f0-44c8-9d37-de3cf8517cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:10.536894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4501ec0-d6f0-44c8-9d37-de3cf8517cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:10.537365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4501ec0-d6f0-44c8-9d37-de3cf8517cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:10.538172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4501ec0-d6f0-44c8-9d37-de3cf8517cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:38:10.538582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4501ec0-d6f0-44c8-9d37-de3cf8517cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:10.540442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4501ec0-d6f0-44c8-9d37-de3cf8517cd0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:10.559460 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4304/8619] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:38:10.563588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde74190-d686-4a54-8796-9a2affcfb969 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:10.577011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde74190-d686-4a54-8796-9a2affcfb969 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:10.582562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6c0ca-acb4-4687-87ae-c5d3fde1c2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:10.583265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6c0ca-acb4-4687-87ae-c5d3fde1c2ed admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:10.583550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6c0ca-acb4-4687-87ae-c5d3fde1c2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:10.583825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6c0ca-acb4-4687-87ae-c5d3fde1c2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:10.584925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6c0ca-acb4-4687-87ae-c5d3fde1c2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:10.586390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6c0ca-acb4-4687-87ae-c5d3fde1c2ed admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:10.626787 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4316/8620] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:38:10 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:38:10.629831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4501ec0-d6f0-44c8-9d37-de3cf8517cd0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:10.646219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4501ec0-d6f0-44c8-9d37-de3cf8517cd0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:10.732422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5b8bd-8b44-4c15-bd42-03c93e5ff1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:10.732948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5b8bd-8b44-4c15-bd42-03c93e5ff1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:10.733307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5b8bd-8b44-4c15-bd42-03c93e5ff1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:10.733591 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5b8bd-8b44-4c15-bd42-03c93e5ff1b6 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:10.734243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5b8bd-8b44-4c15-bd42-03c93e5ff1b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:10.737363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5b8bd-8b44-4c15-bd42-03c93e5ff1b6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:10.767207 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4305/8621] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:38:10 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:38:10.768491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6c0ca-acb4-4687-87ae-c5d3fde1c2ed admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:10.781423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6c0ca-acb4-4687-87ae-c5d3fde1c2ed admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:10.787380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a72f7-e5bc-47bd-a27f-0588c45c199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:10.788084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a72f7-e5bc-47bd-a27f-0588c45c199d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:10.788383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a72f7-e5bc-47bd-a27f-0588c45c199d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:10.788653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a72f7-e5bc-47bd-a27f-0588c45c199d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:10.789536 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a72f7-e5bc-47bd-a27f-0588c45c199d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:10.794443 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a72f7-e5bc-47bd-a27f-0588c45c199d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:10.819104 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4317/8622] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:38:10.820681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5b8bd-8b44-4c15-bd42-03c93e5ff1b6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:10.834493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5b8bd-8b44-4c15-bd42-03c93e5ff1b6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:10.841338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a21ac-8339-4b66-9429-8a633e9500a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:10.841994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a21ac-8339-4b66-9429-8a633e9500a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:10.842289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a21ac-8339-4b66-9429-8a633e9500a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:10.842565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a21ac-8339-4b66-9429-8a633e9500a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:10.843299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a21ac-8339-4b66-9429-8a633e9500a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:10.845470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a21ac-8339-4b66-9429-8a633e9500a4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:10.851946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:10.863630 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4306/8623] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:38:10.864574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a72f7-e5bc-47bd-a27f-0588c45c199d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:10.894010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a72f7-e5bc-47bd-a27f-0588c45c199d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:10.902638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131898c-c6c0-482b-a5c1-d1ce4c671c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:10.903581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131898c-c6c0-482b-a5c1-d1ce4c671c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:10.904060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131898c-c6c0-482b-a5c1-d1ce4c671c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:10.904586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131898c-c6c0-482b-a5c1-d1ce4c671c17 admin admin] PATH_INFO: `/v3/projects/350280a60eeb485490779807236a56f0/users/ddf7222707a442a9bd41ca04a2fccb55/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:10.924092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131898c-c6c0-482b-a5c1-d1ce4c671c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350280a60eeb485490779807236a56f0, user_id=ddf7222707a442a9bd41ca04a2fccb55, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:10.927432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131898c-c6c0-482b-a5c1-d1ce4c671c17 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:10.945809 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4318/8624] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:38:10 2022] PUT /identity/v3/projects/350280a60eeb485490779807236a56f0/users/ddf7222707a442a9bd41ca04a2fccb55/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:38:10.957533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa48ff-56e7-4fd6-8967-86245e5cc653 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:10.957868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa48ff-56e7-4fd6-8967-86245e5cc653 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:10.958075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa48ff-56e7-4fd6-8967-86245e5cc653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:10.997375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-16aa48ff-56e7-4fd6-8967-86245e5cc653 None None] MFA Rules not processed for user `ddf7222707a442a9bd41ca04a2fccb55`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:38:10.999049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-16aa48ff-56e7-4fd6-8967-86245e5cc653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:11.084735 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4307/8625] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:38:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:38:11.089996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131898c-c6c0-482b-a5c1-d1ce4c671c17 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:11.162319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131898c-c6c0-482b-a5c1-d1ce4c671c17 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:11.167727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acbd3d-16ac-49cc-98c7-7805afd0de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:11.168353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acbd3d-16ac-49cc-98c7-7805afd0de94 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:11.168638 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acbd3d-16ac-49cc-98c7-7805afd0de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:11.168919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acbd3d-16ac-49cc-98c7-7805afd0de94 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:11.169559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05acbd3d-16ac-49cc-98c7-7805afd0de94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:11.171581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05acbd3d-16ac-49cc-98c7-7805afd0de94 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:11.201367 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4319/8626] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:38:11 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:38:11.206227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa48ff-56e7-4fd6-8967-86245e5cc653 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:11.217197 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa48ff-56e7-4fd6-8967-86245e5cc653 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:11.277079 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944e790-3953-4843-ad12-35d9c93db801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:11.277703 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944e790-3953-4843-ad12-35d9c93db801 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:11.277991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944e790-3953-4843-ad12-35d9c93db801 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:11.278276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944e790-3953-4843-ad12-35d9c93db801 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:11.278960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944e790-3953-4843-ad12-35d9c93db801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:11.280899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944e790-3953-4843-ad12-35d9c93db801 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:11.305993 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4308/8627] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:38:11 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:38:11.309589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acbd3d-16ac-49cc-98c7-7805afd0de94 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:11.321290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acbd3d-16ac-49cc-98c7-7805afd0de94 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:11.328242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bf3e6-35e4-4469-95dc-22a7c2634362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:11.328950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf3e6-35e4-4469-95dc-22a7c2634362 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:11.329308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf3e6-35e4-4469-95dc-22a7c2634362 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:11.329677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf3e6-35e4-4469-95dc-22a7c2634362 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:11.330438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bf3e6-35e4-4469-95dc-22a7c2634362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:11.332165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bf3e6-35e4-4469-95dc-22a7c2634362 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:11.564173 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4320/8628] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:38:11.568223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944e790-3953-4843-ad12-35d9c93db801 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:11.586537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944e790-3953-4843-ad12-35d9c93db801 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:11.594809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6717c9-6dd9-46b6-b27a-1c566b34668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:11.596078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6717c9-6dd9-46b6-b27a-1c566b34668d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:11.604250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6717c9-6dd9-46b6-b27a-1c566b34668d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:11.604575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6717c9-6dd9-46b6-b27a-1c566b34668d admin admin] PATH_INFO: `/v3/projects/22fb2396ffc4484688ea3163c2a7b1c4/users/3c472ad1e2a344c2adefc8c627f294b9/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:11.623026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6717c9-6dd9-46b6-b27a-1c566b34668d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22fb2396ffc4484688ea3163c2a7b1c4, user_id=3c472ad1e2a344c2adefc8c627f294b9, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:11.625822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6717c9-6dd9-46b6-b27a-1c566b34668d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:11.645812 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4309/8629] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:38:11 2022] PUT /identity/v3/projects/22fb2396ffc4484688ea3163c2a7b1c4/users/3c472ad1e2a344c2adefc8c627f294b9/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:38:11.649480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bf3e6-35e4-4469-95dc-22a7c2634362 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:11.661366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bf3e6-35e4-4469-95dc-22a7c2634362 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:11.743875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8d3ef-c38b-4365-829f-29a3c566f7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:11.744762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8d3ef-c38b-4365-829f-29a3c566f7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:11.745277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8d3ef-c38b-4365-829f-29a3c566f7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:11.745792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8d3ef-c38b-4365-829f-29a3c566f7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:11.746589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8d3ef-c38b-4365-829f-29a3c566f7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:11.748239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8d3ef-c38b-4365-829f-29a3c566f7b6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:11.762874 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4321/8630] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:38:11.764326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6717c9-6dd9-46b6-b27a-1c566b34668d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:11.775345 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6717c9-6dd9-46b6-b27a-1c566b34668d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:11.781237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfa382-a8ae-4023-9680-448c06555e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:11.781966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfa382-a8ae-4023-9680-448c06555e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:11.782510 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfa382-a8ae-4023-9680-448c06555e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:11.782632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfa382-a8ae-4023-9680-448c06555e15 admin admin] PATH_INFO: `/v3/projects/22fb2396ffc4484688ea3163c2a7b1c4/users/3c472ad1e2a344c2adefc8c627f294b9/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:11.785029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfa382-a8ae-4023-9680-448c06555e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22fb2396ffc4484688ea3163c2a7b1c4, user_id=3c472ad1e2a344c2adefc8c627f294b9, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:11.787849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfa382-a8ae-4023-9680-448c06555e15 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:11.800401 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4310/8631] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:38:11 2022] PUT /identity/v3/projects/22fb2396ffc4484688ea3163c2a7b1c4/users/3c472ad1e2a344c2adefc8c627f294b9/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:38:11.810455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4546c42-d2b4-420c-b8a8-c9875120da2b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:11.810772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4546c42-d2b4-420c-b8a8-c9875120da2b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:11.811071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4546c42-d2b4-420c-b8a8-c9875120da2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:11.826843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:11.844997 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a4546c42-d2b4-420c-b8a8-c9875120da2b None None] MFA Rules not processed for user `3c472ad1e2a344c2adefc8c627f294b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:38:11.846220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a4546c42-d2b4-420c-b8a8-c9875120da2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:11.937768 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4322/8632] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:38:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:38:11.950273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfa382-a8ae-4023-9680-448c06555e15 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:11.952383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-83dfa382-a8ae-4023-9680-448c06555e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:12.009595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:12.026090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfa382-a8ae-4023-9680-448c06555e15 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:12.029928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6720d-df34-45ff-94d8-61bce6a46d50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:12.030592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6720d-df34-45ff-94d8-61bce6a46d50 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:12.030986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6720d-df34-45ff-94d8-61bce6a46d50 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:12.031744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6720d-df34-45ff-94d8-61bce6a46d50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:12.109827 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6720d-df34-45ff-94d8-61bce6a46d50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:12.111725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6720d-df34-45ff-94d8-61bce6a46d50 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:12.123320 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4311/8633] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:38:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:38:18.109601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12289c4-28d4-4216-97fb-79664083c7be None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:18.110057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12289c4-28d4-4216-97fb-79664083c7be None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:18.110172 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12289c4-28d4-4216-97fb-79664083c7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:18.129131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e12289c4-28d4-4216-97fb-79664083c7be None None] MFA Rules not processed for user `ba61631e54954118963170b67723d2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:38:18.130327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e12289c4-28d4-4216-97fb-79664083c7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:18.192952 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4323/8634] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:38:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:38:22.118045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=29 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:22.670170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6720d-df34-45ff-94d8-61bce6a46d50 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:22.671897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6ed6720d-df34-45ff-94d8-61bce6a46d50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:22.773796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6720d-df34-45ff-94d8-61bce6a46d50 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:22.781013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336b64c-af4a-458b-8a83-3b645d0d3223 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:22.781657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336b64c-af4a-458b-8a83-3b645d0d3223 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:22.781958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336b64c-af4a-458b-8a83-3b645d0d3223 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:22.782220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336b64c-af4a-458b-8a83-3b645d0d3223 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:22.792566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336b64c-af4a-458b-8a83-3b645d0d3223 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:22.794804 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336b64c-af4a-458b-8a83-3b645d0d3223 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:22.805067 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4312/8635] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:38:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:38:28.185864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=56 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:32.802215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=32 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:37.574026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12289c4-28d4-4216-97fb-79664083c7be None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:37.575635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e12289c4-28d4-4216-97fb-79664083c7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:37.640056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12289c4-28d4-4216-97fb-79664083c7be None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:37.644092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99262dfd-9bbd-401a-8616-d840fbcc3d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:37.644711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99262dfd-9bbd-401a-8616-d840fbcc3d3c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:37.644992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99262dfd-9bbd-401a-8616-d840fbcc3d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:37.645263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99262dfd-9bbd-401a-8616-d840fbcc3d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:37.647012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-99262dfd-9bbd-401a-8616-d840fbcc3d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:37.724569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99262dfd-9bbd-401a-8616-d840fbcc3d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:37.726098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99262dfd-9bbd-401a-8616-d840fbcc3d3c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:37.737554 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4324/8636] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:38:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:38:42.211759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336b64c-af4a-458b-8a83-3b645d0d3223 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:42.214305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3336b64c-af4a-458b-8a83-3b645d0d3223 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:42.229593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336b64c-af4a-458b-8a83-3b645d0d3223 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:42.233368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61768491-9d54-458d-a08f-e68389aa2556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:42.234042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61768491-9d54-458d-a08f-e68389aa2556 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:42.234397 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61768491-9d54-458d-a08f-e68389aa2556 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:42.234845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61768491-9d54-458d-a08f-e68389aa2556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:42.236624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-61768491-9d54-458d-a08f-e68389aa2556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:42.249219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61768491-9d54-458d-a08f-e68389aa2556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:42.250767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61768491-9d54-458d-a08f-e68389aa2556 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:42.262868 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4313/8637] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:38:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:38:47.732075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=50 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:52.255545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:38:56.098914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99262dfd-9bbd-401a-8616-d840fbcc3d3c service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:38:56.100363 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-99262dfd-9bbd-401a-8616-d840fbcc3d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:38:56.115275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99262dfd-9bbd-401a-8616-d840fbcc3d3c service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:38:56.118909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8827c6-4f67-41f9-bff3-1a6568c9a477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:38:56.119512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8827c6-4f67-41f9-bff3-1a6568c9a477 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:38:56.119799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8827c6-4f67-41f9-bff3-1a6568c9a477 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:38:56.120079 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8827c6-4f67-41f9-bff3-1a6568c9a477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:38:56.130184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8827c6-4f67-41f9-bff3-1a6568c9a477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:38:56.131686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8827c6-4f67-41f9-bff3-1a6568c9a477 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:38:56.142460 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4325/8638] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:38:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:06.138062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:14.727112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61768491-9d54-458d-a08f-e68389aa2556 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:14.729764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-61768491-9d54-458d-a08f-e68389aa2556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:14.915509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61768491-9d54-458d-a08f-e68389aa2556 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:14.924505 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cc67c-3c6f-4304-8c59-3582985dfd91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:14.925540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cc67c-3c6f-4304-8c59-3582985dfd91 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:14.926319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cc67c-3c6f-4304-8c59-3582985dfd91 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:14.926950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cc67c-3c6f-4304-8c59-3582985dfd91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:14.929331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-db0cc67c-3c6f-4304-8c59-3582985dfd91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:14.956117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cc67c-3c6f-4304-8c59-3582985dfd91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:14.958608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cc67c-3c6f-4304-8c59-3582985dfd91 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:14.984903 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4314/8639] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:20.697913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8827c6-4f67-41f9-bff3-1a6568c9a477 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:20.699530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6d8827c6-4f67-41f9-bff3-1a6568c9a477 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:20.782310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8827c6-4f67-41f9-bff3-1a6568c9a477 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:20.787909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07760cb5-f61d-4717-90ee-97c9be717732 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:20.788835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07760cb5-f61d-4717-90ee-97c9be717732 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:20.789373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07760cb5-f61d-4717-90ee-97c9be717732 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:20.789955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07760cb5-f61d-4717-90ee-97c9be717732 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:20.791902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-07760cb5-f61d-4717-90ee-97c9be717732 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:20.807860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07760cb5-f61d-4717-90ee-97c9be717732 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:20.809886 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07760cb5-f61d-4717-90ee-97c9be717732 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:20.826298 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4326/8640] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:23.093988 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cc67c-3c6f-4304-8c59-3582985dfd91 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:23.095474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-db0cc67c-3c6f-4304-8c59-3582985dfd91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:23.115172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cc67c-3c6f-4304-8c59-3582985dfd91 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:23.121031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8e025-acf4-43ca-8772-3cd360541003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:23.121642 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8e025-acf4-43ca-8772-3cd360541003 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:23.122102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8e025-acf4-43ca-8772-3cd360541003 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:23.122558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8e025-acf4-43ca-8772-3cd360541003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:23.125312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-06a8e025-acf4-43ca-8772-3cd360541003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:23.143634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8e025-acf4-43ca-8772-3cd360541003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:23.147491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8e025-acf4-43ca-8772-3cd360541003 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:23.178319 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4315/8641] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:26.025784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07760cb5-f61d-4717-90ee-97c9be717732 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:26.047569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07760cb5-f61d-4717-90ee-97c9be717732 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:26.054671 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267c835-2447-4886-a6ca-e1bf83a8a23b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:26.055508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267c835-2447-4886-a6ca-e1bf83a8a23b service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:26.055806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267c835-2447-4886-a6ca-e1bf83a8a23b service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:26.056064 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267c835-2447-4886-a6ca-e1bf83a8a23b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:26.068121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267c835-2447-4886-a6ca-e1bf83a8a23b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:26.069724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267c835-2447-4886-a6ca-e1bf83a8a23b service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:26.083718 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4327/8642] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:39:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:39:33.157524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=40 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:36.075656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=38 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:39.570429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8e025-acf4-43ca-8772-3cd360541003 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:39.572580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-06a8e025-acf4-43ca-8772-3cd360541003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:39.768553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8e025-acf4-43ca-8772-3cd360541003 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:39.774368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:39.775256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:39.775697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:39.776038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] PATH_INFO: `/v3/users/ba61631e54954118963170b67723d2e0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:39.777347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba61631e54954118963170b67723d2e0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:39.779459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:39.865843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba61631e54954118963170b67723d2e0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:39.876730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba61631e54954118963170b67723d2e0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:39.878387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba61631e54954118963170b67723d2e0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:39.888225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba61631e54954118963170b67723d2e0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:39.889101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba61631e54954118963170b67723d2e0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:39.920097 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4316/8643] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:39:39 2022] DELETE /identity/v3/users/ba61631e54954118963170b67723d2e0 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:39:40.140158 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267c835-2447-4886-a6ca-e1bf83a8a23b service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:40.185493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267c835-2447-4886-a6ca-e1bf83a8a23b service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:40.250441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:40.251206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:40.251634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:40.252057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] PATH_INFO: `/v3/projects/8c7baf012df94742af1d0569708759eb` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:40.253299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7baf012df94742af1d0569708759eb)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:40.255440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:40.317298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7baf012df94742af1d0569708759eb', 'request_id': 'req-65908869-0f79-4435-bbd1-4603ddce6f1b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.327148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7baf012df94742af1d0569708759eb', 'request_id': 'req-65908869-0f79-4435-bbd1-4603ddce6f1b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.334056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7baf012df94742af1d0569708759eb', 'request_id': 'req-65908869-0f79-4435-bbd1-4603ddce6f1b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.352294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] The token cache is being invalidate because project 8c7baf012df94742af1d0569708759eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:39:40.352743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.354223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.358900 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4328/8644] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:39:40 2022] DELETE /identity/v3/projects/8c7baf012df94742af1d0569708759eb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:39:40.363245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:40.365526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:40.380673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a6bd2-d873-4a3d-b0d2-7b92470970bd admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:40.428678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:40.443928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8ca3b-81a2-412e-9976-6df92e5c470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:40.444531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8ca3b-81a2-412e-9976-6df92e5c470c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:40.444822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8ca3b-81a2-412e-9976-6df92e5c470c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:40.445101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8ca3b-81a2-412e-9976-6df92e5c470c admin admin] PATH_INFO: `/v3/users/5d80c6f836ab4b24ab4bf802d3dfd963` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:40.446283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8ca3b-81a2-412e-9976-6df92e5c470c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d80c6f836ab4b24ab4bf802d3dfd963)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:40.448255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8ca3b-81a2-412e-9976-6df92e5c470c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:40.495955 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-44d8ca3b-81a2-412e-9976-6df92e5c470c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d80c6f836ab4b24ab4bf802d3dfd963'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.504516 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-44d8ca3b-81a2-412e-9976-6df92e5c470c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d80c6f836ab4b24ab4bf802d3dfd963'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.505242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-44d8ca3b-81a2-412e-9976-6df92e5c470c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d80c6f836ab4b24ab4bf802d3dfd963'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.514342 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-44d8ca3b-81a2-412e-9976-6df92e5c470c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d80c6f836ab4b24ab4bf802d3dfd963'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.515688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-44d8ca3b-81a2-412e-9976-6df92e5c470c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d80c6f836ab4b24ab4bf802d3dfd963'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.534179 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4317/8645] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:39:40 2022] DELETE /identity/v3/users/5d80c6f836ab4b24ab4bf802d3dfd963 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:39:40.732347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:40.733939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:40.756989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65908869-0f79-4435-bbd1-4603ddce6f1b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:40.824963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b3971-b34b-4449-b943-96601774e8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:40.825626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b3971-b34b-4449-b943-96601774e8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:40.825912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b3971-b34b-4449-b943-96601774e8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:40.826410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b3971-b34b-4449-b943-96601774e8ac admin admin] PATH_INFO: `/v3/projects/b5bc1d825bc54de395171548461a6117` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:40.828218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b3971-b34b-4449-b943-96601774e8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5bc1d825bc54de395171548461a6117)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:40.830233 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b3971-b34b-4449-b943-96601774e8ac admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:40.839062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:40.899161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-239b3971-b34b-4449-b943-96601774e8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5bc1d825bc54de395171548461a6117', 'request_id': 'req-239b3971-b34b-4449-b943-96601774e8ac'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.908898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-239b3971-b34b-4449-b943-96601774e8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5bc1d825bc54de395171548461a6117', 'request_id': 'req-239b3971-b34b-4449-b943-96601774e8ac'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.923890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-239b3971-b34b-4449-b943-96601774e8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5bc1d825bc54de395171548461a6117', 'request_id': 'req-239b3971-b34b-4449-b943-96601774e8ac'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.933880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-239b3971-b34b-4449-b943-96601774e8ac admin admin] The token cache is being invalidate because project b5bc1d825bc54de395171548461a6117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:39:40.934169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-239b3971-b34b-4449-b943-96601774e8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.934860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-239b3971-b34b-4449-b943-96601774e8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:39:40.936552 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4329/8646] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:39:40 2022] DELETE /identity/v3/projects/b5bc1d825bc54de395171548461a6117 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:39:50.530613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:50.930468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:39:51.011758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17a741-fe01-4ce6-9ed7-0fabb6f3b85c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:51.012241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17a741-fe01-4ce6-9ed7-0fabb6f3b85c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:51.012608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17a741-fe01-4ce6-9ed7-0fabb6f3b85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:51.034937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2e17a741-fe01-4ce6-9ed7-0fabb6f3b85c None None] MFA Rules not processed for user `b0ae958878db4d2a81ba14f57b3128c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:39:51.037047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2e17a741-fe01-4ce6-9ed7-0fabb6f3b85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:51.109861 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4318/8647] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:39:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:39:54.804056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5bb88-f765-456c-9c48-c5ae7106676a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:54.806579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5bb88-f765-456c-9c48-c5ae7106676a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:54.807291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5bb88-f765-456c-9c48-c5ae7106676a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:54.865525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e4e5bb88-f765-456c-9c48-c5ae7106676a None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:39:54.867276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e4e5bb88-f765-456c-9c48-c5ae7106676a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:54.970916 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4330/8648] 10.222.0.70 () {58 vars in 1062 bytes} [Sun Aug 28 19:39:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:39:54.974011 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17a741-fe01-4ce6-9ed7-0fabb6f3b85c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:54.986792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17a741-fe01-4ce6-9ed7-0fabb6f3b85c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:39:54.990648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4bcf3-7e3a-4c6a-a465-3133bc1db0fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:39:54.992729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4bcf3-7e3a-4c6a-a465-3133bc1db0fc service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:39:54.993218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4bcf3-7e3a-4c6a-a465-3133bc1db0fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:39:54.993509 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4bcf3-7e3a-4c6a-a465-3133bc1db0fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:39:54.995940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1cf4bcf3-7e3a-4c6a-a465-3133bc1db0fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:39:55.113281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4bcf3-7e3a-4c6a-a465-3133bc1db0fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:39:55.115168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4bcf3-7e3a-4c6a-a465-3133bc1db0fc service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:39:55.130467 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4319/8649] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:39:59.897097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5bb88-f765-456c-9c48-c5ae7106676a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:39:59.898964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e4e5bb88-f765-456c-9c48-c5ae7106676a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:00.040193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5bb88-f765-456c-9c48-c5ae7106676a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:00.046438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48448f-3202-48d8-94ff-fc784aeff0a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:00.047773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48448f-3202-48d8-94ff-fc784aeff0a2 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:00.048311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48448f-3202-48d8-94ff-fc784aeff0a2 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:00.048705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48448f-3202-48d8-94ff-fc784aeff0a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:00.050833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3e48448f-3202-48d8-94ff-fc784aeff0a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:00.068361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48448f-3202-48d8-94ff-fc784aeff0a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:00.069973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48448f-3202-48d8-94ff-fc784aeff0a2 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:00.084867 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4331/8650] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:39:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:40:03.876513 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4bcf3-7e3a-4c6a-a465-3133bc1db0fc service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:03.879238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1cf4bcf3-7e3a-4c6a-a465-3133bc1db0fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:04.012616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4bcf3-7e3a-4c6a-a465-3133bc1db0fc service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:04.019307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57773a-9d1c-4fac-a990-d71849b4d49f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:04.019941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57773a-9d1c-4fac-a990-d71849b4d49f service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:04.020228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57773a-9d1c-4fac-a990-d71849b4d49f service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:04.020507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57773a-9d1c-4fac-a990-d71849b4d49f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:04.023117 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2a57773a-9d1c-4fac-a990-d71849b4d49f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:04.041718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57773a-9d1c-4fac-a990-d71849b4d49f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:04.043383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57773a-9d1c-4fac-a990-d71849b4d49f service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:04.063956 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4320/8651] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:40:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:40:05.460417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48448f-3202-48d8-94ff-fc784aeff0a2 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:05.480801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48448f-3202-48d8-94ff-fc784aeff0a2 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:05.494863 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002ce86-4da8-4ab7-8732-bc1533dcfa8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:05.495669 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002ce86-4da8-4ab7-8732-bc1533dcfa8b service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:05.496056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002ce86-4da8-4ab7-8732-bc1533dcfa8b service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:05.496431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002ce86-4da8-4ab7-8732-bc1533dcfa8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:05.503832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d002ce86-4da8-4ab7-8732-bc1533dcfa8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:05.524760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002ce86-4da8-4ab7-8732-bc1533dcfa8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:05.526539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002ce86-4da8-4ab7-8732-bc1533dcfa8b service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:05.540754 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4332/8652] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:40:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:40:14.053972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:15.532976 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=76 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:24.636123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626634f-9beb-4f52-970f-33b59e158d8a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:24.636834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626634f-9beb-4f52-970f-33b59e158d8a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:24.636943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626634f-9beb-4f52-970f-33b59e158d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:24.659920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3626634f-9beb-4f52-970f-33b59e158d8a None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:40:24.661375 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3626634f-9beb-4f52-970f-33b59e158d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:24.669550 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4321/8653] 10.222.0.70 () {58 vars in 1062 bytes} [Sun Aug 28 19:40:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:40:24.676075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002ce86-4da8-4ab7-8732-bc1533dcfa8b service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:24.687635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002ce86-4da8-4ab7-8732-bc1533dcfa8b service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:24.692022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c94d39-1de0-411c-b5c3-cf80a0c749f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:24.693042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c94d39-1de0-411c-b5c3-cf80a0c749f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:24.693535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c94d39-1de0-411c-b5c3-cf80a0c749f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:24.694173 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c94d39-1de0-411c-b5c3-cf80a0c749f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:24.696131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-39c94d39-1de0-411c-b5c3-cf80a0c749f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:24.785295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c94d39-1de0-411c-b5c3-cf80a0c749f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:24.787006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c94d39-1de0-411c-b5c3-cf80a0c749f8 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:24.801507 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4333/8654] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:40:31.695960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626634f-9beb-4f52-970f-33b59e158d8a None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:31.698049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3626634f-9beb-4f52-970f-33b59e158d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:31.720103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626634f-9beb-4f52-970f-33b59e158d8a None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:31.727811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:31.728761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:31.729040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:31.730248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] PATH_INFO: `/v3/users/ddf7222707a442a9bd41ca04a2fccb55` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:31.731697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf7222707a442a9bd41ca04a2fccb55)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:31.735093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:31.828228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf7222707a442a9bd41ca04a2fccb55'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:31.844023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf7222707a442a9bd41ca04a2fccb55'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:31.845132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf7222707a442a9bd41ca04a2fccb55'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:31.856132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf7222707a442a9bd41ca04a2fccb55'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:31.857341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf7222707a442a9bd41ca04a2fccb55'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:31.888068 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4322/8655] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:40:31 2022] DELETE /identity/v3/users/ddf7222707a442a9bd41ca04a2fccb55 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:31.893239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bb1f2-c7b2-4180-ae38-80689908b131 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:31.893798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bb1f2-c7b2-4180-ae38-80689908b131 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:31.893945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bb1f2-c7b2-4180-ae38-80689908b131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:31.918184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-174bb1f2-c7b2-4180-ae38-80689908b131 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:40:31.919597 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-174bb1f2-c7b2-4180-ae38-80689908b131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:32.039648 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4334/8656] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:40:32.051338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:32.053288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:32.162043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da885522-a976-4f65-9dad-292785aeb00b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:32.166241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f421914-7062-4074-9182-1a41ee116510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:32.167515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f421914-7062-4074-9182-1a41ee116510 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:32.167975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f421914-7062-4074-9182-1a41ee116510 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:32.168442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f421914-7062-4074-9182-1a41ee116510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:32.181051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f421914-7062-4074-9182-1a41ee116510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:32.182708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f421914-7062-4074-9182-1a41ee116510 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:32.199013 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4323/8657] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:40:32.327327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bb1f2-c7b2-4180-ae38-80689908b131 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:32.328804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-174bb1f2-c7b2-4180-ae38-80689908b131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:32.349848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bb1f2-c7b2-4180-ae38-80689908b131 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:32.365888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:32.367221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:32.368407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:32.368995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] PATH_INFO: `/v3/users/30add6fc24b34085b5eaac8df54c424f` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:32.371544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30add6fc24b34085b5eaac8df54c424f)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:32.373704 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:32.449788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30add6fc24b34085b5eaac8df54c424f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.460757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30add6fc24b34085b5eaac8df54c424f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.461987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30add6fc24b34085b5eaac8df54c424f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.477806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30add6fc24b34085b5eaac8df54c424f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.479206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30add6fc24b34085b5eaac8df54c424f'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.495765 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4335/8658] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:40:32 2022] DELETE /identity/v3/users/30add6fc24b34085b5eaac8df54c424f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:32.588450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f421914-7062-4074-9182-1a41ee116510 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:32.590595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4f421914-7062-4074-9182-1a41ee116510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:32.608381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f421914-7062-4074-9182-1a41ee116510 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:32.712227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:32.712884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:32.713155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:32.713428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] PATH_INFO: `/v3/projects/350280a60eeb485490779807236a56f0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:32.714574 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=350280a60eeb485490779807236a56f0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:32.719009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:32.720040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:32.721720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:32.730858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:32.762817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca90b6-6bc0-49a2-897c-456cba17c190 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:32.769378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:32.770044 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:32.770477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:32.770788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] PATH_INFO: `/v3/projects/a20fb31f8312435590cb2eeb6b6439de` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:32.772198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20fb31f8312435590cb2eeb6b6439de)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:32.774207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:32.776240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:32.790105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350280a60eeb485490779807236a56f0', 'request_id': 'req-1cd85d8d-a286-4365-867d-bb14269924dc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.798492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350280a60eeb485490779807236a56f0', 'request_id': 'req-1cd85d8d-a286-4365-867d-bb14269924dc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.806857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350280a60eeb485490779807236a56f0', 'request_id': 'req-1cd85d8d-a286-4365-867d-bb14269924dc'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.824086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] The token cache is being invalidate because project 350280a60eeb485490779807236a56f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:40:32.824467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.825106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.827750 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4324/8659] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:40:32 2022] DELETE /identity/v3/projects/350280a60eeb485490779807236a56f0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:32.831467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:32.832865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:32.834916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20fb31f8312435590cb2eeb6b6439de', 'request_id': 'req-d51c5b90-ca05-4148-8022-03d525285457'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.846241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20fb31f8312435590cb2eeb6b6439de', 'request_id': 'req-d51c5b90-ca05-4148-8022-03d525285457'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.853771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20fb31f8312435590cb2eeb6b6439de', 'request_id': 'req-d51c5b90-ca05-4148-8022-03d525285457'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.867730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] The token cache is being invalidate because project a20fb31f8312435590cb2eeb6b6439de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:40:32.867927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.868674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:32.873098 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4336/8660] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:40:32 2022] DELETE /identity/v3/projects/a20fb31f8312435590cb2eeb6b6439de => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:32.874730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:32.876306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:32.910454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd85d8d-a286-4365-867d-bb14269924dc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:32.950875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c5b90-ca05-4148-8022-03d525285457 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:32.956276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:32.956963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:32.957187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:32.957463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] PATH_INFO: `/v3/users/ea8f070b6ffe425e94434562595a3dac` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:32.967400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:32.968116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:32.968395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:32.968671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] PATH_INFO: `/v3/users/3c472ad1e2a344c2adefc8c627f294b9` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:32.969999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c472ad1e2a344c2adefc8c627f294b9)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:32.971899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea8f070b6ffe425e94434562595a3dac)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:32.972049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:32.973829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:33.028094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c472ad1e2a344c2adefc8c627f294b9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.028735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea8f070b6ffe425e94434562595a3dac'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.030219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:33.037166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea8f070b6ffe425e94434562595a3dac'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.037984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea8f070b6ffe425e94434562595a3dac'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.039628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c472ad1e2a344c2adefc8c627f294b9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.040848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c472ad1e2a344c2adefc8c627f294b9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.054376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c472ad1e2a344c2adefc8c627f294b9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.054645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea8f070b6ffe425e94434562595a3dac'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.055511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea8f070b6ffe425e94434562595a3dac'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.055641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c472ad1e2a344c2adefc8c627f294b9'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.066590 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:33.076679 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4337/8661] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:40:32 2022] DELETE /identity/v3/users/ea8f070b6ffe425e94434562595a3dac => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:33.081467 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4325/8662] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:40:32 2022] DELETE /identity/v3/users/3c472ad1e2a344c2adefc8c627f294b9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:33.284372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:33.286206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:33.364146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab7fbf-0570-4d5e-9919-953401443aa3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:33.403481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:33.406353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:33.432336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690d11d-0a36-4664-a634-3e81c53ecf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:33.433124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690d11d-0a36-4664-a634-3e81c53ecf93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:33.433434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690d11d-0a36-4664-a634-3e81c53ecf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:33.433767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690d11d-0a36-4664-a634-3e81c53ecf93 admin admin] PATH_INFO: `/v3/projects/f75c01923c3a461fb769a875d8817e69` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:33.445517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690d11d-0a36-4664-a634-3e81c53ecf93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f75c01923c3a461fb769a875d8817e69)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:33.447498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690d11d-0a36-4664-a634-3e81c53ecf93 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:33.482870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343e4b1-e6b0-4622-aa58-1ab108474e6f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:33.495216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2690d11d-0a36-4664-a634-3e81c53ecf93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75c01923c3a461fb769a875d8817e69', 'request_id': 'req-2690d11d-0a36-4664-a634-3e81c53ecf93'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.503197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2690d11d-0a36-4664-a634-3e81c53ecf93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75c01923c3a461fb769a875d8817e69', 'request_id': 'req-2690d11d-0a36-4664-a634-3e81c53ecf93'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.508649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2690d11d-0a36-4664-a634-3e81c53ecf93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75c01923c3a461fb769a875d8817e69', 'request_id': 'req-2690d11d-0a36-4664-a634-3e81c53ecf93'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.521214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2690d11d-0a36-4664-a634-3e81c53ecf93 admin admin] The token cache is being invalidate because project f75c01923c3a461fb769a875d8817e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:40:33.521523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2690d11d-0a36-4664-a634-3e81c53ecf93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.522123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2690d11d-0a36-4664-a634-3e81c53ecf93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.523610 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4338/8663] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:40:33 2022] DELETE /identity/v3/projects/f75c01923c3a461fb769a875d8817e69 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:33.545413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731f1ab-a492-4a7c-810f-34125e15c4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:33.546084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731f1ab-a492-4a7c-810f-34125e15c4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:33.546370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731f1ab-a492-4a7c-810f-34125e15c4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:33.546657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731f1ab-a492-4a7c-810f-34125e15c4b6 admin admin] PATH_INFO: `/v3/projects/22fb2396ffc4484688ea3163c2a7b1c4` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:33.547919 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731f1ab-a492-4a7c-810f-34125e15c4b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22fb2396ffc4484688ea3163c2a7b1c4)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:33.549938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731f1ab-a492-4a7c-810f-34125e15c4b6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:33.614067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a731f1ab-a492-4a7c-810f-34125e15c4b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22fb2396ffc4484688ea3163c2a7b1c4', 'request_id': 'req-a731f1ab-a492-4a7c-810f-34125e15c4b6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.620052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a731f1ab-a492-4a7c-810f-34125e15c4b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22fb2396ffc4484688ea3163c2a7b1c4', 'request_id': 'req-a731f1ab-a492-4a7c-810f-34125e15c4b6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.627181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a731f1ab-a492-4a7c-810f-34125e15c4b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22fb2396ffc4484688ea3163c2a7b1c4', 'request_id': 'req-a731f1ab-a492-4a7c-810f-34125e15c4b6'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.643259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a731f1ab-a492-4a7c-810f-34125e15c4b6 admin admin] The token cache is being invalidate because project 22fb2396ffc4484688ea3163c2a7b1c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:40:33.643637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a731f1ab-a492-4a7c-810f-34125e15c4b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.644411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a731f1ab-a492-4a7c-810f-34125e15c4b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:33.646364 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4326/8664] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:40:33 2022] DELETE /identity/v3/projects/22fb2396ffc4484688ea3163c2a7b1c4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:40:33.651382 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3980db-0e51-4441-96bb-503b9a09cc77 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:33.651666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3980db-0e51-4441-96bb-503b9a09cc77 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:33.651942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3980db-0e51-4441-96bb-503b9a09cc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:33.673416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ff3980db-0e51-4441-96bb-503b9a09cc77 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:40:33.674661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ff3980db-0e51-4441-96bb-503b9a09cc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:33.698435 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:33.747248 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4339/8665] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:40:33.755741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a95f9-68bb-4cd7-8e41-5f9fc0308209 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:33.756335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a95f9-68bb-4cd7-8e41-5f9fc0308209 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:33.756465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a95f9-68bb-4cd7-8e41-5f9fc0308209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:33.765701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:33.781047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-267a95f9-68bb-4cd7-8e41-5f9fc0308209 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:40:33.783608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-267a95f9-68bb-4cd7-8e41-5f9fc0308209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:33.791948 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4327/8666] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:40:33.796909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3980db-0e51-4441-96bb-503b9a09cc77 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:33.807508 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3980db-0e51-4441-96bb-503b9a09cc77 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:33.812591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4aea3e-bdc8-4d19-97ed-cacc55a5f1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:33.813242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aea3e-bdc8-4d19-97ed-cacc55a5f1ee admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:33.813554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aea3e-bdc8-4d19-97ed-cacc55a5f1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:33.813845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aea3e-bdc8-4d19-97ed-cacc55a5f1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:33.814517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aea3e-bdc8-4d19-97ed-cacc55a5f1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:40:33.814870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aea3e-bdc8-4d19-97ed-cacc55a5f1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:33.816561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4aea3e-bdc8-4d19-97ed-cacc55a5f1ee admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:33.830067 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4340/8667] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:40:33.834652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a95f9-68bb-4cd7-8e41-5f9fc0308209 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:33.846077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a95f9-68bb-4cd7-8e41-5f9fc0308209 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:33.851167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74d628-74b6-45cc-ba15-57bda160e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:33.851916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74d628-74b6-45cc-ba15-57bda160e440 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:33.852269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74d628-74b6-45cc-ba15-57bda160e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:33.852645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74d628-74b6-45cc-ba15-57bda160e440 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:33.853363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74d628-74b6-45cc-ba15-57bda160e440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:33.855377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74d628-74b6-45cc-ba15-57bda160e440 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:33.885948 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4328/8668] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:40:33 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:40:33.891489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4aea3e-bdc8-4d19-97ed-cacc55a5f1ee admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:33.903311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4aea3e-bdc8-4d19-97ed-cacc55a5f1ee admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:33.970055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93caf4c-72d4-4004-88cf-5c3f2c156ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:33.975379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93caf4c-72d4-4004-88cf-5c3f2c156ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:33.975940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93caf4c-72d4-4004-88cf-5c3f2c156ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:33.976405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93caf4c-72d4-4004-88cf-5c3f2c156ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:33.977105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93caf4c-72d4-4004-88cf-5c3f2c156ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:33.979138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93caf4c-72d4-4004-88cf-5c3f2c156ef9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:34.007713 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4341/8669] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:40:33 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:40:34.008922 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74d628-74b6-45cc-ba15-57bda160e440 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:34.020149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74d628-74b6-45cc-ba15-57bda160e440 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:34.025080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f7c60-eff9-46dd-9448-c00ef32fc1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:34.025681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f7c60-eff9-46dd-9448-c00ef32fc1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.025963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f7c60-eff9-46dd-9448-c00ef32fc1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.026236 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f7c60-eff9-46dd-9448-c00ef32fc1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.026941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f7c60-eff9-46dd-9448-c00ef32fc1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:34.028526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f7c60-eff9-46dd-9448-c00ef32fc1d1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:34.039039 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4329/8670] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:40:34.043087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93caf4c-72d4-4004-88cf-5c3f2c156ef9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:34.054240 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93caf4c-72d4-4004-88cf-5c3f2c156ef9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:34.058881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dedfb-1184-4ddc-916c-c14a7d93c92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:34.059505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dedfb-1184-4ddc-916c-c14a7d93c92d admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.059763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dedfb-1184-4ddc-916c-c14a7d93c92d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.060038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dedfb-1184-4ddc-916c-c14a7d93c92d admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.060673 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3dedfb-1184-4ddc-916c-c14a7d93c92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:34.062338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3dedfb-1184-4ddc-916c-c14a7d93c92d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:34.073229 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4342/8671] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:40:34.077594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f7c60-eff9-46dd-9448-c00ef32fc1d1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:34.087882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f7c60-eff9-46dd-9448-c00ef32fc1d1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:34.093199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a86a7-f05f-4c47-8ef3-482ecf5cd193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:34.093858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a86a7-f05f-4c47-8ef3-482ecf5cd193 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.094144 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a86a7-f05f-4c47-8ef3-482ecf5cd193 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.094424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a86a7-f05f-4c47-8ef3-482ecf5cd193 admin admin] PATH_INFO: `/v3/projects/74dd05ce82c545548e660807de68cb10/users/a1a7b824b3dd4272963cbc227a49ae49/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.110006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a86a7-f05f-4c47-8ef3-482ecf5cd193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74dd05ce82c545548e660807de68cb10, user_id=a1a7b824b3dd4272963cbc227a49ae49, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:34.112690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a86a7-f05f-4c47-8ef3-482ecf5cd193 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:34.125711 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4330/8672] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:40:34 2022] PUT /identity/v3/projects/74dd05ce82c545548e660807de68cb10/users/a1a7b824b3dd4272963cbc227a49ae49/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:40:34.137488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451a8d0-46a9-4940-ae13-67a70d74b627 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.137778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451a8d0-46a9-4940-ae13-67a70d74b627 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.138057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451a8d0-46a9-4940-ae13-67a70d74b627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.165803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6451a8d0-46a9-4940-ae13-67a70d74b627 None None] MFA Rules not processed for user `a1a7b824b3dd4272963cbc227a49ae49`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:40:34.167006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6451a8d0-46a9-4940-ae13-67a70d74b627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:34.231509 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4343/8673] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:40:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:40:34.236874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a86a7-f05f-4c47-8ef3-482ecf5cd193 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:34.299198 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a86a7-f05f-4c47-8ef3-482ecf5cd193 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:34.304046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55da6e-acce-4264-be83-c4a5248fd299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:34.304656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55da6e-acce-4264-be83-c4a5248fd299 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.304942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55da6e-acce-4264-be83-c4a5248fd299 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.305223 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55da6e-acce-4264-be83-c4a5248fd299 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.305852 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55da6e-acce-4264-be83-c4a5248fd299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:34.307807 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55da6e-acce-4264-be83-c4a5248fd299 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:34.334797 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4331/8674] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:40:34 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:40:34.339005 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451a8d0-46a9-4940-ae13-67a70d74b627 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:34.350811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451a8d0-46a9-4940-ae13-67a70d74b627 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:34.369828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:34.411663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f69aab-5fa5-4d1a-9fb7-36789d04d39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:34.412271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69aab-5fa5-4d1a-9fb7-36789d04d39f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.412578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69aab-5fa5-4d1a-9fb7-36789d04d39f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.412858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69aab-5fa5-4d1a-9fb7-36789d04d39f admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.413500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f69aab-5fa5-4d1a-9fb7-36789d04d39f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:34.415464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f69aab-5fa5-4d1a-9fb7-36789d04d39f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:34.437808 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4344/8675] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:40:34 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:40:34.442055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55da6e-acce-4264-be83-c4a5248fd299 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:34.453325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55da6e-acce-4264-be83-c4a5248fd299 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:34.458018 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273f87a-ef88-4b24-b2b1-b6ae3eca6564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:34.458613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f87a-ef88-4b24-b2b1-b6ae3eca6564 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.459051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f87a-ef88-4b24-b2b1-b6ae3eca6564 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.459392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273f87a-ef88-4b24-b2b1-b6ae3eca6564 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.460373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273f87a-ef88-4b24-b2b1-b6ae3eca6564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:34.463038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273f87a-ef88-4b24-b2b1-b6ae3eca6564 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:34.475456 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4332/8676] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:40:34.479402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f69aab-5fa5-4d1a-9fb7-36789d04d39f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:34.489594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f69aab-5fa5-4d1a-9fb7-36789d04d39f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:34.494314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132bde4-7bef-4522-89c4-858d9b6e3e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:34.494947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132bde4-7bef-4522-89c4-858d9b6e3e12 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.495230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132bde4-7bef-4522-89c4-858d9b6e3e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.495505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132bde4-7bef-4522-89c4-858d9b6e3e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.496139 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132bde4-7bef-4522-89c4-858d9b6e3e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:34.497733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132bde4-7bef-4522-89c4-858d9b6e3e12 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:34.508143 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4345/8677] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:40:34.512344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273f87a-ef88-4b24-b2b1-b6ae3eca6564 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:34.523301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273f87a-ef88-4b24-b2b1-b6ae3eca6564 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:34.527959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2ca1e-09a5-4ee1-bfb9-93b5982de64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:34.528601 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2ca1e-09a5-4ee1-bfb9-93b5982de64d admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.528887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2ca1e-09a5-4ee1-bfb9-93b5982de64d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.529159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2ca1e-09a5-4ee1-bfb9-93b5982de64d admin admin] PATH_INFO: `/v3/projects/bcc5e99e1b974138af8f6518cf896d25/users/764bc4a589ad4737b8d2d31b78c7cf8d/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.544360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2ca1e-09a5-4ee1-bfb9-93b5982de64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc5e99e1b974138af8f6518cf896d25, user_id=764bc4a589ad4737b8d2d31b78c7cf8d, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:34.547241 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2ca1e-09a5-4ee1-bfb9-93b5982de64d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:34.559812 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4333/8678] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:40:34 2022] PUT /identity/v3/projects/bcc5e99e1b974138af8f6518cf896d25/users/764bc4a589ad4737b8d2d31b78c7cf8d/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:34.570156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb128791-88c4-44b4-909e-08b4819dedf5 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.570448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb128791-88c4-44b4-909e-08b4819dedf5 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.570727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb128791-88c4-44b4-909e-08b4819dedf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.599746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bb128791-88c4-44b4-909e-08b4819dedf5 None None] MFA Rules not processed for user `764bc4a589ad4737b8d2d31b78c7cf8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:40:34.600992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bb128791-88c4-44b4-909e-08b4819dedf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:34.664585 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4346/8679] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:40:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:40:34.669160 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2ca1e-09a5-4ee1-bfb9-93b5982de64d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:34.718339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:34.732775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2ca1e-09a5-4ee1-bfb9-93b5982de64d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:34.737496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dba014-caaf-453d-9d62-8aefac0d824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:34.738103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dba014-caaf-453d-9d62-8aefac0d824d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.738389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dba014-caaf-453d-9d62-8aefac0d824d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.738666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dba014-caaf-453d-9d62-8aefac0d824d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.739325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dba014-caaf-453d-9d62-8aefac0d824d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:34.741230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dba014-caaf-453d-9d62-8aefac0d824d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:34.768594 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4334/8680] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:40:34 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:40:34.772713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb128791-88c4-44b4-909e-08b4819dedf5 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:34.783692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb128791-88c4-44b4-909e-08b4819dedf5 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:34.843419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cfa12-b791-4fd4-a28e-498f2265b28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:34.844036 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cfa12-b791-4fd4-a28e-498f2265b28d admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.844321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cfa12-b791-4fd4-a28e-498f2265b28d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.844599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9cfa12-b791-4fd4-a28e-498f2265b28d admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.845229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cfa12-b791-4fd4-a28e-498f2265b28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:34.847186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9cfa12-b791-4fd4-a28e-498f2265b28d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:34.868727 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4347/8681] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:40:34 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:40:34.872831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dba014-caaf-453d-9d62-8aefac0d824d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:34.883811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dba014-caaf-453d-9d62-8aefac0d824d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:34.888698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b599fa-2fc2-4066-ab34-4905dff1c906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:34.890026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b599fa-2fc2-4066-ab34-4905dff1c906 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.890307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b599fa-2fc2-4066-ab34-4905dff1c906 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.890590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b599fa-2fc2-4066-ab34-4905dff1c906 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.891260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b599fa-2fc2-4066-ab34-4905dff1c906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:34.892847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b599fa-2fc2-4066-ab34-4905dff1c906 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:34.903815 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4335/8682] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:40:34.908183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cfa12-b791-4fd4-a28e-498f2265b28d admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:34.918378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9cfa12-b791-4fd4-a28e-498f2265b28d admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:34.923812 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386725ae-d074-4b46-b422-c5ef34f70038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:34.924463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386725ae-d074-4b46-b422-c5ef34f70038 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:34.924746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386725ae-d074-4b46-b422-c5ef34f70038 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:34.925025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386725ae-d074-4b46-b422-c5ef34f70038 admin admin] PATH_INFO: `/v3/projects/3a10040874fb41eebcce61d3e6a73f39/users/c4632cc2942d44b9bf96b5986917a3b6/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:34.940104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386725ae-d074-4b46-b422-c5ef34f70038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a10040874fb41eebcce61d3e6a73f39, user_id=c4632cc2942d44b9bf96b5986917a3b6, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:34.942767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386725ae-d074-4b46-b422-c5ef34f70038 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:34.945760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:34.957893 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4348/8683] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:40:34 2022] PUT /identity/v3/projects/3a10040874fb41eebcce61d3e6a73f39/users/c4632cc2942d44b9bf96b5986917a3b6/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:34.961917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b599fa-2fc2-4066-ab34-4905dff1c906 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:34.972641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b599fa-2fc2-4066-ab34-4905dff1c906 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:35.032668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92925019-9c09-417a-906d-b007091f84a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:35.033274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92925019-9c09-417a-906d-b007091f84a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:35.033559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92925019-9c09-417a-906d-b007091f84a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:35.033837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92925019-9c09-417a-906d-b007091f84a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:35.034471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92925019-9c09-417a-906d-b007091f84a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:35.036114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92925019-9c09-417a-906d-b007091f84a6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:35.046183 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4336/8684] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:40:35.050444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386725ae-d074-4b46-b422-c5ef34f70038 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:35.061261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386725ae-d074-4b46-b422-c5ef34f70038 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:35.065878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890b24a-54c0-46e4-bb54-b9e5e061aca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:35.066519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890b24a-54c0-46e4-bb54-b9e5e061aca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:35.066895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890b24a-54c0-46e4-bb54-b9e5e061aca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:35.067171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890b24a-54c0-46e4-bb54-b9e5e061aca2 admin admin] PATH_INFO: `/v3/projects/3a10040874fb41eebcce61d3e6a73f39/users/c4632cc2942d44b9bf96b5986917a3b6/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:35.069073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890b24a-54c0-46e4-bb54-b9e5e061aca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a10040874fb41eebcce61d3e6a73f39, user_id=c4632cc2942d44b9bf96b5986917a3b6, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:35.071717 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890b24a-54c0-46e4-bb54-b9e5e061aca2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:35.082390 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4349/8685] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:40:35 2022] PUT /identity/v3/projects/3a10040874fb41eebcce61d3e6a73f39/users/c4632cc2942d44b9bf96b5986917a3b6/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:35.093743 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbc7a6-5520-4d98-932e-32ed7ac8dd13 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:35.094033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbc7a6-5520-4d98-932e-32ed7ac8dd13 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:35.094310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbc7a6-5520-4d98-932e-32ed7ac8dd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:35.121647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-22dbc7a6-5520-4d98-932e-32ed7ac8dd13 None None] MFA Rules not processed for user `c4632cc2942d44b9bf96b5986917a3b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:40:35.122876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-22dbc7a6-5520-4d98-932e-32ed7ac8dd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:35.191082 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4337/8686] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:40:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:40:35.202038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873678f-5d58-4b78-847d-4275e607892f None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:35.202327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873678f-5d58-4b78-847d-4275e607892f None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:35.202601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873678f-5d58-4b78-847d-4275e607892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:35.240888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c873678f-5d58-4b78-847d-4275e607892f None None] MFA Rules not processed for user `afece3fa01d040a1ae8e035ea3ff3219`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:40:35.242018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c873678f-5d58-4b78-847d-4275e607892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:35.293435 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4350/8687] 10.222.0.70 () {58 vars in 1061 bytes} [Sun Aug 28 19:40:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:40:35.300156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbc7a6-5520-4d98-932e-32ed7ac8dd13 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:35.309620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbc7a6-5520-4d98-932e-32ed7ac8dd13 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:35.313944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c70ee-09d0-475a-946f-1f5dea9617ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:35.314545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c70ee-09d0-475a-946f-1f5dea9617ef service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:35.314859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c70ee-09d0-475a-946f-1f5dea9617ef service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:35.315135 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c70ee-09d0-475a-946f-1f5dea9617ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:35.358302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:35.375269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c70ee-09d0-475a-946f-1f5dea9617ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:35.376707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c70ee-09d0-475a-946f-1f5dea9617ef service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:35.385588 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4338/8688] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:40:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:40:36.893324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873678f-5d58-4b78-847d-4275e607892f None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:36.894712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c873678f-5d58-4b78-847d-4275e607892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:36.907674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873678f-5d58-4b78-847d-4275e607892f None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:36.911442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b3ab3-6fb6-4730-b63f-df9f108d4fcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:36.912061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3ab3-6fb6-4730-b63f-df9f108d4fcd service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:36.912341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3ab3-6fb6-4730-b63f-df9f108d4fcd service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:36.912615 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3ab3-6fb6-4730-b63f-df9f108d4fcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:36.969157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b3ab3-6fb6-4730-b63f-df9f108d4fcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:36.970499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b3ab3-6fb6-4730-b63f-df9f108d4fcd service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:36.979856 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4351/8689] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:40:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:40:37.601150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c70ee-09d0-475a-946f-1f5dea9617ef service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:37.612496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c70ee-09d0-475a-946f-1f5dea9617ef service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:37.616128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c94457-1775-4c77-bafa-32f6f80e72b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:37.616729 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c94457-1775-4c77-bafa-32f6f80e72b9 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:37.617014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c94457-1775-4c77-bafa-32f6f80e72b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:37.617296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c94457-1775-4c77-bafa-32f6f80e72b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:37.626898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c94457-1775-4c77-bafa-32f6f80e72b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:37.628348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c94457-1775-4c77-bafa-32f6f80e72b9 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:37.638061 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4339/8690] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:40:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:40:43.635406 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b3ab3-6fb6-4730-b63f-df9f108d4fcd service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:43.699771 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b3ab3-6fb6-4730-b63f-df9f108d4fcd service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:43.705057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:43.705612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:43.705895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:43.706170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] PATH_INFO: `/v3/users/a1a7b824b3dd4272963cbc227a49ae49` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:43.707314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a7b824b3dd4272963cbc227a49ae49)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:43.709241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:43.730980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:43.759568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a7b824b3dd4272963cbc227a49ae49'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:43.767811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a7b824b3dd4272963cbc227a49ae49'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:43.768493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a7b824b3dd4272963cbc227a49ae49'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:43.781012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a7b824b3dd4272963cbc227a49ae49'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:43.781674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a7b824b3dd4272963cbc227a49ae49'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:43.795896 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4352/8691] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:40:43 2022] DELETE /identity/v3/users/a1a7b824b3dd4272963cbc227a49ae49 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:43.800840 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d832240-0664-46a6-8b9e-863e5ad00aac None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:43.801337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d832240-0664-46a6-8b9e-863e5ad00aac None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:43.801479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d832240-0664-46a6-8b9e-863e5ad00aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:43.821652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4d832240-0664-46a6-8b9e-863e5ad00aac None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:40:43.822872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4d832240-0664-46a6-8b9e-863e5ad00aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:43.882518 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4340/8692] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:40:43.892980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:43.894386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:43.953601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411f518-56be-4890-8bc6-610dd91c7526 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:43.957216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b961030-454e-4222-a264-367d9b9e932f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:43.957823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b961030-454e-4222-a264-367d9b9e932f service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:43.958104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b961030-454e-4222-a264-367d9b9e932f service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:43.958376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b961030-454e-4222-a264-367d9b9e932f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:43.968523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b961030-454e-4222-a264-367d9b9e932f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:43.969999 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b961030-454e-4222-a264-367d9b9e932f service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:43.982300 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4353/8693] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:40:44.271621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d832240-0664-46a6-8b9e-863e5ad00aac None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:44.273127 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4d832240-0664-46a6-8b9e-863e5ad00aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:44.286445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d832240-0664-46a6-8b9e-863e5ad00aac None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:44.291227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:44.291869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:44.292154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:44.292435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] PATH_INFO: `/v3/projects/74dd05ce82c545548e660807de68cb10` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:44.293564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] RBAC: Authorizing `identity:delete_project(project_id=74dd05ce82c545548e660807de68cb10)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:44.296092 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:44.353523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74dd05ce82c545548e660807de68cb10', 'request_id': 'req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:44.360205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74dd05ce82c545548e660807de68cb10', 'request_id': 'req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:44.369281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74dd05ce82c545548e660807de68cb10', 'request_id': 'req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:44.387413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] The token cache is being invalidate because project 74dd05ce82c545548e660807de68cb10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:40:44.387707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:44.388349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:44.390235 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4341/8694] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:40:44 2022] DELETE /identity/v3/projects/74dd05ce82c545548e660807de68cb10 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:44.394206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b961030-454e-4222-a264-367d9b9e932f service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:44.404251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b961030-454e-4222-a264-367d9b9e932f service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:44.476442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:44.477011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:44.477298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:44.477577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] PATH_INFO: `/v3/users/764bc4a589ad4737b8d2d31b78c7cf8d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:44.478708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=764bc4a589ad4737b8d2d31b78c7cf8d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:44.480674 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:44.528857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:44.535488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764bc4a589ad4737b8d2d31b78c7cf8d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:44.544104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764bc4a589ad4737b8d2d31b78c7cf8d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:44.544804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764bc4a589ad4737b8d2d31b78c7cf8d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:44.557218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764bc4a589ad4737b8d2d31b78c7cf8d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:44.557864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764bc4a589ad4737b8d2d31b78c7cf8d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:44.573110 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4354/8695] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:40:44 2022] DELETE /identity/v3/users/764bc4a589ad4737b8d2d31b78c7cf8d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:44.853289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:44.854764 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:44.868722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059314e-dea8-4a0e-9c7b-3e4ed251ceec admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:44.924957 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:44.935334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:44.936626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:44.936839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:44.937123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] PATH_INFO: `/v3/projects/bcc5e99e1b974138af8f6518cf896d25` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:44.938349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc5e99e1b974138af8f6518cf896d25)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:44.940343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:44.987331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc5e99e1b974138af8f6518cf896d25', 'request_id': 'req-fe88b4d1-3b83-4941-a909-2dab6f1a8734'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:44.993306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc5e99e1b974138af8f6518cf896d25', 'request_id': 'req-fe88b4d1-3b83-4941-a909-2dab6f1a8734'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:44.999724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc5e99e1b974138af8f6518cf896d25', 'request_id': 'req-fe88b4d1-3b83-4941-a909-2dab6f1a8734'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:45.012689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] The token cache is being invalidate because project bcc5e99e1b974138af8f6518cf896d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:40:45.012987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:45.013628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:45.015732 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4342/8696] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:40:44 2022] DELETE /identity/v3/projects/bcc5e99e1b974138af8f6518cf896d25 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:45.019770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:45.021206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:45.034953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b397fa-8b13-46dc-8e56-ca270d634aa4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:45.090319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da28086-ecd0-4ebe-8ace-b9d67b672b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:45.090990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da28086-ecd0-4ebe-8ace-b9d67b672b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:45.091278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da28086-ecd0-4ebe-8ace-b9d67b672b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:45.091557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da28086-ecd0-4ebe-8ace-b9d67b672b02 admin admin] PATH_INFO: `/v3/users/c4632cc2942d44b9bf96b5986917a3b6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:45.093748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da28086-ecd0-4ebe-8ace-b9d67b672b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4632cc2942d44b9bf96b5986917a3b6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:45.095693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da28086-ecd0-4ebe-8ace-b9d67b672b02 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:45.142492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6da28086-ecd0-4ebe-8ace-b9d67b672b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4632cc2942d44b9bf96b5986917a3b6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:45.149350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6da28086-ecd0-4ebe-8ace-b9d67b672b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4632cc2942d44b9bf96b5986917a3b6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:45.150009 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6da28086-ecd0-4ebe-8ace-b9d67b672b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4632cc2942d44b9bf96b5986917a3b6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:45.162313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6da28086-ecd0-4ebe-8ace-b9d67b672b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4632cc2942d44b9bf96b5986917a3b6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:45.162977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6da28086-ecd0-4ebe-8ace-b9d67b672b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4632cc2942d44b9bf96b5986917a3b6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:45.176089 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4355/8697] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:40:45 2022] DELETE /identity/v3/users/c4632cc2942d44b9bf96b5986917a3b6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:45.451224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:45.452761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:45.467585 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88b4d1-3b83-4941-a909-2dab6f1a8734 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:45.528029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6cc68-065b-4152-bdbc-7748987ab85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:45.528580 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6cc68-065b-4152-bdbc-7748987ab85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:45.528861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6cc68-065b-4152-bdbc-7748987ab85b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:45.529134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6cc68-065b-4152-bdbc-7748987ab85b admin admin] PATH_INFO: `/v3/projects/3a10040874fb41eebcce61d3e6a73f39` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:45.530909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6cc68-065b-4152-bdbc-7748987ab85b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a10040874fb41eebcce61d3e6a73f39)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:45.532835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6cc68-065b-4152-bdbc-7748987ab85b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:45.581306 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-51f6cc68-065b-4152-bdbc-7748987ab85b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a10040874fb41eebcce61d3e6a73f39', 'request_id': 'req-51f6cc68-065b-4152-bdbc-7748987ab85b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:45.587171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-51f6cc68-065b-4152-bdbc-7748987ab85b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a10040874fb41eebcce61d3e6a73f39', 'request_id': 'req-51f6cc68-065b-4152-bdbc-7748987ab85b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:45.594529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-51f6cc68-065b-4152-bdbc-7748987ab85b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a10040874fb41eebcce61d3e6a73f39', 'request_id': 'req-51f6cc68-065b-4152-bdbc-7748987ab85b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:45.607149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-51f6cc68-065b-4152-bdbc-7748987ab85b admin admin] The token cache is being invalidate because project 3a10040874fb41eebcce61d3e6a73f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:40:45.607436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-51f6cc68-065b-4152-bdbc-7748987ab85b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:45.608787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-51f6cc68-065b-4152-bdbc-7748987ab85b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:40:45.610323 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4343/8698] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:40:45 2022] DELETE /identity/v3/projects/3a10040874fb41eebcce61d3e6a73f39 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:45.615451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e2a1e-1b95-4bbb-8e79-090dc4e676e2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:45.615736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e2a1e-1b95-4bbb-8e79-090dc4e676e2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:45.616011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e2a1e-1b95-4bbb-8e79-090dc4e676e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:45.635350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-004e2a1e-1b95-4bbb-8e79-090dc4e676e2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:40:45.636530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-004e2a1e-1b95-4bbb-8e79-090dc4e676e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:45.670291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:45.698148 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4356/8699] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:40:45.706419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f9bff-faee-46fd-ba8c-71ccbe318c67 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:45.706833 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f9bff-faee-46fd-ba8c-71ccbe318c67 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:45.707119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f9bff-faee-46fd-ba8c-71ccbe318c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:45.728147 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-380f9bff-faee-46fd-ba8c-71ccbe318c67 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:40:45.729363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-380f9bff-faee-46fd-ba8c-71ccbe318c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:45.738368 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4344/8700] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:40:45.742712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e2a1e-1b95-4bbb-8e79-090dc4e676e2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:45.753459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e2a1e-1b95-4bbb-8e79-090dc4e676e2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:45.758163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18328581-2d0e-46de-bc86-8411cec4f433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:45.758789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18328581-2d0e-46de-bc86-8411cec4f433 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:45.759108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18328581-2d0e-46de-bc86-8411cec4f433 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:45.759394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18328581-2d0e-46de-bc86-8411cec4f433 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:45.760038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18328581-2d0e-46de-bc86-8411cec4f433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:40:45.760344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18328581-2d0e-46de-bc86-8411cec4f433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:45.762206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18328581-2d0e-46de-bc86-8411cec4f433 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:45.774130 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4357/8701] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:40:45.778365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f9bff-faee-46fd-ba8c-71ccbe318c67 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:45.788040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f9bff-faee-46fd-ba8c-71ccbe318c67 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:45.792744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320395d7-98e9-4197-9513-e6f112f14703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:45.793338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320395d7-98e9-4197-9513-e6f112f14703 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:45.793623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320395d7-98e9-4197-9513-e6f112f14703 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:45.793898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320395d7-98e9-4197-9513-e6f112f14703 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:45.794541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320395d7-98e9-4197-9513-e6f112f14703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:45.797366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320395d7-98e9-4197-9513-e6f112f14703 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:45.801898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:45.829994 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4345/8702] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:40:45 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:40:45.833132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18328581-2d0e-46de-bc86-8411cec4f433 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:45.843930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18328581-2d0e-46de-bc86-8411cec4f433 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:45.903143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5d414-e82d-47f3-b9d7-07cae7540e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:45.903870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5d414-e82d-47f3-b9d7-07cae7540e98 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:45.904157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5d414-e82d-47f3-b9d7-07cae7540e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:45.904431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5d414-e82d-47f3-b9d7-07cae7540e98 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:45.905241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5d414-e82d-47f3-b9d7-07cae7540e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:45.907324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5d414-e82d-47f3-b9d7-07cae7540e98 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:45.928739 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4358/8703] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:40:45 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:40:45.932989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320395d7-98e9-4197-9513-e6f112f14703 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:45.944890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320395d7-98e9-4197-9513-e6f112f14703 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:45.949622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3414-a209-4734-8a33-28aa6d8c6eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:45.950218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3414-a209-4734-8a33-28aa6d8c6eec admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:45.950503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3414-a209-4734-8a33-28aa6d8c6eec admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:45.950812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3414-a209-4734-8a33-28aa6d8c6eec admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:45.951572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c3414-a209-4734-8a33-28aa6d8c6eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:45.953432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c3414-a209-4734-8a33-28aa6d8c6eec admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:45.963277 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4346/8704] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:40:45.967248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5d414-e82d-47f3-b9d7-07cae7540e98 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:45.977538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5d414-e82d-47f3-b9d7-07cae7540e98 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:45.982224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd57a27-f6f1-4bbe-aa0f-75bef2332f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:45.983446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd57a27-f6f1-4bbe-aa0f-75bef2332f80 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:45.983727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd57a27-f6f1-4bbe-aa0f-75bef2332f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:45.984006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd57a27-f6f1-4bbe-aa0f-75bef2332f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:45.984648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd57a27-f6f1-4bbe-aa0f-75bef2332f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:45.986281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd57a27-f6f1-4bbe-aa0f-75bef2332f80 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:45.997732 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4359/8705] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:40:46.002786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3414-a209-4734-8a33-28aa6d8c6eec admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:46.012994 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3414-a209-4734-8a33-28aa6d8c6eec admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:46.017928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fb799-0a03-4f17-a40b-efaa010d3992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:46.018573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fb799-0a03-4f17-a40b-efaa010d3992 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:46.018887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fb799-0a03-4f17-a40b-efaa010d3992 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:46.019216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fb799-0a03-4f17-a40b-efaa010d3992 admin admin] PATH_INFO: `/v3/projects/d717d66fd547435fa48da2beb884f9c7/users/63631f28fa4d400d808992ce64b5827a/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:46.034215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fb799-0a03-4f17-a40b-efaa010d3992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d717d66fd547435fa48da2beb884f9c7, user_id=63631f28fa4d400d808992ce64b5827a, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:46.036826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fb799-0a03-4f17-a40b-efaa010d3992 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:46.050588 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4347/8706] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:40:46 2022] PUT /identity/v3/projects/d717d66fd547435fa48da2beb884f9c7/users/63631f28fa4d400d808992ce64b5827a/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:40:46.060616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f1ced-9171-4875-b383-1b28ff19f1a7 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:46.061194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f1ced-9171-4875-b383-1b28ff19f1a7 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:46.061194 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f1ced-9171-4875-b383-1b28ff19f1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:46.089843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-2a7f1ced-9171-4875-b383-1b28ff19f1a7 None None] MFA Rules not processed for user `63631f28fa4d400d808992ce64b5827a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:40:46.091116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2a7f1ced-9171-4875-b383-1b28ff19f1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:46.156266 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4360/8707] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:40:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:40:46.167887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fb799-0a03-4f17-a40b-efaa010d3992 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:40:46.169641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-821fb799-0a03-4f17-a40b-efaa010d3992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:40:46.243785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fb799-0a03-4f17-a40b-efaa010d3992 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:40:46.247502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec2ac9-37cd-40a5-b739-f95c263db922 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:40:46.248108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec2ac9-37cd-40a5-b739-f95c263db922 service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:40:46.248419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec2ac9-37cd-40a5-b739-f95c263db922 service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:40:46.248725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec2ac9-37cd-40a5-b739-f95c263db922 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:40:46.256992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec2ac9-37cd-40a5-b739-f95c263db922 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:40:46.258493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec2ac9-37cd-40a5-b739-f95c263db922 service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:40:46.267959 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4348/8708] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:40:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:40:56.152818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:40:56.263671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=52,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:18.560438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f1ced-9171-4875-b383-1b28ff19f1a7 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:18.629806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f1ced-9171-4875-b383-1b28ff19f1a7 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:18.634310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:18.635085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:18.635366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:18.635639 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] PATH_INFO: `/v3/users/63631f28fa4d400d808992ce64b5827a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:18.636989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] RBAC: Authorizing `identity:delete_user(user_id=63631f28fa4d400d808992ce64b5827a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:18.638942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:18.688191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63631f28fa4d400d808992ce64b5827a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:18.696379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63631f28fa4d400d808992ce64b5827a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:18.697092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63631f28fa4d400d808992ce64b5827a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:18.710251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63631f28fa4d400d808992ce64b5827a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:18.710948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63631f28fa4d400d808992ce64b5827a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:18.726460 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4361/8709] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:41:18 2022] DELETE /identity/v3/users/63631f28fa4d400d808992ce64b5827a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:41:18.732571 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2629f92-88bf-4c22-a37a-6dbc4a6b5f07 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:18.733404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2629f92-88bf-4c22-a37a-6dbc4a6b5f07 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:18.733404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2629f92-88bf-4c22-a37a-6dbc4a6b5f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:18.755715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f2629f92-88bf-4c22-a37a-6dbc4a6b5f07 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:18.756960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f2629f92-88bf-4c22-a37a-6dbc4a6b5f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:18.831370 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4349/8710] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:41:18.841341 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:18.842966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:18.904831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf44c27-13c3-4c83-9394-d52c4851b43c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:18.908957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7772f-5795-4ff6-abf5-44fc5270e286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:18.909592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7772f-5795-4ff6-abf5-44fc5270e286 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:18.909844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7772f-5795-4ff6-abf5-44fc5270e286 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:18.910118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7772f-5795-4ff6-abf5-44fc5270e286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:18.919262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7772f-5795-4ff6-abf5-44fc5270e286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:18.920692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7772f-5795-4ff6-abf5-44fc5270e286 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:18.930883 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4362/8711] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:41:19.223880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2629f92-88bf-4c22-a37a-6dbc4a6b5f07 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:19.225432 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f2629f92-88bf-4c22-a37a-6dbc4a6b5f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:19.238586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2629f92-88bf-4c22-a37a-6dbc4a6b5f07 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:19.244320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab7a72-1138-4711-a62d-9b28f32810fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:19.244974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7a72-1138-4711-a62d-9b28f32810fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:19.245255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7a72-1138-4711-a62d-9b28f32810fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:19.245531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7a72-1138-4711-a62d-9b28f32810fa admin admin] PATH_INFO: `/v3/projects/d717d66fd547435fa48da2beb884f9c7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:19.246732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab7a72-1138-4711-a62d-9b28f32810fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d717d66fd547435fa48da2beb884f9c7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:19.248685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab7a72-1138-4711-a62d-9b28f32810fa admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:19.314242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-59ab7a72-1138-4711-a62d-9b28f32810fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd717d66fd547435fa48da2beb884f9c7', 'request_id': 'req-59ab7a72-1138-4711-a62d-9b28f32810fa'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:19.321183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-59ab7a72-1138-4711-a62d-9b28f32810fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd717d66fd547435fa48da2beb884f9c7', 'request_id': 'req-59ab7a72-1138-4711-a62d-9b28f32810fa'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:19.327934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-59ab7a72-1138-4711-a62d-9b28f32810fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd717d66fd547435fa48da2beb884f9c7', 'request_id': 'req-59ab7a72-1138-4711-a62d-9b28f32810fa'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:19.342557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-59ab7a72-1138-4711-a62d-9b28f32810fa admin admin] The token cache is being invalidate because project d717d66fd547435fa48da2beb884f9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:41:19.343114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-59ab7a72-1138-4711-a62d-9b28f32810fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:19.343794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-59ab7a72-1138-4711-a62d-9b28f32810fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:19.346112 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4350/8712] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:41:19 2022] DELETE /identity/v3/projects/d717d66fd547435fa48da2beb884f9c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:41:19.352420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edb495-bf6b-43fa-9fc8-897dd6d8c3e1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:19.352708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edb495-bf6b-43fa-9fc8-897dd6d8c3e1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:19.352982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edb495-bf6b-43fa-9fc8-897dd6d8c3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:19.375714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e2edb495-bf6b-43fa-9fc8-897dd6d8c3e1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:19.378126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e2edb495-bf6b-43fa-9fc8-897dd6d8c3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:19.398943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:19.451233 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4363/8713] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:19.459138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b327dcf-17dc-4b29-a846-cff4a86940a4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:19.459433 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b327dcf-17dc-4b29-a846-cff4a86940a4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:19.459741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b327dcf-17dc-4b29-a846-cff4a86940a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:19.482872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4b327dcf-17dc-4b29-a846-cff4a86940a4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:19.484083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4b327dcf-17dc-4b29-a846-cff4a86940a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:19.493058 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4351/8714] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:19.497190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edb495-bf6b-43fa-9fc8-897dd6d8c3e1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:19.508083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edb495-bf6b-43fa-9fc8-897dd6d8c3e1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:19.513708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a8d91-dd8f-44e5-8f07-43108016e058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:19.514778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a8d91-dd8f-44e5-8f07-43108016e058 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:19.514778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a8d91-dd8f-44e5-8f07-43108016e058 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:19.515014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a8d91-dd8f-44e5-8f07-43108016e058 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:19.515516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a8d91-dd8f-44e5-8f07-43108016e058 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:41:19.515813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a8d91-dd8f-44e5-8f07-43108016e058 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:19.517651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a8d91-dd8f-44e5-8f07-43108016e058 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:19.533565 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4364/8715] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:41:19.536270 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b327dcf-17dc-4b29-a846-cff4a86940a4 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:19.545280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b327dcf-17dc-4b29-a846-cff4a86940a4 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:19.551366 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05054023-0fc3-43a7-9864-4074586122c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:19.552211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05054023-0fc3-43a7-9864-4074586122c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:19.552566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05054023-0fc3-43a7-9864-4074586122c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:19.553443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05054023-0fc3-43a7-9864-4074586122c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:19.553619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05054023-0fc3-43a7-9864-4074586122c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:19.555757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05054023-0fc3-43a7-9864-4074586122c8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:19.608753 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4352/8716] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:41:19 2022] POST /identity/v3/projects => generated 397 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:41:19.609991 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a8d91-dd8f-44e5-8f07-43108016e058 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:19.621407 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a8d91-dd8f-44e5-8f07-43108016e058 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:19.682238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f50556-355c-4f5d-ae78-d35f79fdff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:19.683004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f50556-355c-4f5d-ae78-d35f79fdff5b admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:19.683292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f50556-355c-4f5d-ae78-d35f79fdff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:19.683568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f50556-355c-4f5d-ae78-d35f79fdff5b admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:19.684234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f50556-355c-4f5d-ae78-d35f79fdff5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:19.686187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f50556-355c-4f5d-ae78-d35f79fdff5b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:19.707429 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4365/8717] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:41:19 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:41:19.711939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05054023-0fc3-43a7-9864-4074586122c8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:19.726291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05054023-0fc3-43a7-9864-4074586122c8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:19.731598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b52fd-e627-4ecd-9a23-a86f726d8fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:19.732225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b52fd-e627-4ecd-9a23-a86f726d8fcb admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:19.732511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b52fd-e627-4ecd-9a23-a86f726d8fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:19.732997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b52fd-e627-4ecd-9a23-a86f726d8fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:19.733673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b52fd-e627-4ecd-9a23-a86f726d8fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:19.736151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b52fd-e627-4ecd-9a23-a86f726d8fcb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:19.749072 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4353/8718] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:41:19.753741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f50556-355c-4f5d-ae78-d35f79fdff5b admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:19.766954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f50556-355c-4f5d-ae78-d35f79fdff5b admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:19.772849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb797b-ca8e-40e4-bb8a-0b9b43bb5431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:19.773495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb797b-ca8e-40e4-bb8a-0b9b43bb5431 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:19.773780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb797b-ca8e-40e4-bb8a-0b9b43bb5431 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:19.774059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb797b-ca8e-40e4-bb8a-0b9b43bb5431 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:19.774709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb797b-ca8e-40e4-bb8a-0b9b43bb5431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:19.776969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb797b-ca8e-40e4-bb8a-0b9b43bb5431 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:19.792797 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4366/8719] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:41:19.793512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b52fd-e627-4ecd-9a23-a86f726d8fcb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:19.805463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b52fd-e627-4ecd-9a23-a86f726d8fcb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:19.810467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f1fd7-187b-4e7b-b148-fcbfb8e237be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:19.811332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f1fd7-187b-4e7b-b148-fcbfb8e237be admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:19.811684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f1fd7-187b-4e7b-b148-fcbfb8e237be admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:19.812026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f1fd7-187b-4e7b-b148-fcbfb8e237be admin admin] PATH_INFO: `/v3/projects/bd71933848da499997372287572870be/users/36e0db7d8e7f42d19bf228e762956681/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:19.828380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f1fd7-187b-4e7b-b148-fcbfb8e237be admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd71933848da499997372287572870be, user_id=36e0db7d8e7f42d19bf228e762956681, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:19.831553 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f1fd7-187b-4e7b-b148-fcbfb8e237be admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:19.846360 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4354/8720] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:41:19 2022] PUT /identity/v3/projects/bd71933848da499997372287572870be/users/36e0db7d8e7f42d19bf228e762956681/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:41:19.857116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cbd8f-f4c6-4722-a457-5249720f73d2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:19.857116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cbd8f-f4c6-4722-a457-5249720f73d2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:19.857381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cbd8f-f4c6-4722-a457-5249720f73d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:19.887531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0c7cbd8f-f4c6-4722-a457-5249720f73d2 None None] MFA Rules not processed for user `36e0db7d8e7f42d19bf228e762956681`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:19.888808 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0c7cbd8f-f4c6-4722-a457-5249720f73d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:19.956146 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4367/8721] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:41:19 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:19.967367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f1fd7-187b-4e7b-b148-fcbfb8e237be admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:19.969087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-607f1fd7-187b-4e7b-b148-fcbfb8e237be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:19.991017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:20.032104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f1fd7-187b-4e7b-b148-fcbfb8e237be admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:20.035757 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff3662-a222-4622-9fb7-777d2e152e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:20.036359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff3662-a222-4622-9fb7-777d2e152e0f service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:20.036643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff3662-a222-4622-9fb7-777d2e152e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:20.036920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff3662-a222-4622-9fb7-777d2e152e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:20.045132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff3662-a222-4622-9fb7-777d2e152e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:20.046555 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff3662-a222-4622-9fb7-777d2e152e0f service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:20.055733 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4355/8722] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:19 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:41:28.154248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cbd8f-f4c6-4722-a457-5249720f73d2 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:28.176039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:28.223688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cbd8f-f4c6-4722-a457-5249720f73d2 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:28.228193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:28.228839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:28.229126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:28.229411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] PATH_INFO: `/v3/users/36e0db7d8e7f42d19bf228e762956681` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:28.230544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e0db7d8e7f42d19bf228e762956681)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:28.232527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:28.280832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e0db7d8e7f42d19bf228e762956681'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:28.288017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e0db7d8e7f42d19bf228e762956681'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:28.288701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e0db7d8e7f42d19bf228e762956681'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:28.301884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e0db7d8e7f42d19bf228e762956681'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:28.302599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e0db7d8e7f42d19bf228e762956681'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:28.317260 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4368/8723] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:41:28 2022] DELETE /identity/v3/users/36e0db7d8e7f42d19bf228e762956681 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:41:28.321808 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a522f4-c179-4baa-88bd-3ffbf62c54da None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:28.322325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a522f4-c179-4baa-88bd-3ffbf62c54da None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:28.322520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a522f4-c179-4baa-88bd-3ffbf62c54da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:28.342104 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f2a522f4-c179-4baa-88bd-3ffbf62c54da None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:28.343346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f2a522f4-c179-4baa-88bd-3ffbf62c54da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:28.410219 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4356/8724] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:28.419987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:28.421487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:28.482190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931f56e-8374-4446-80a0-dd9a252df284 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:28.486549 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977695e-ddfb-4156-aaa1-e160c0b1f40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:28.487309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977695e-ddfb-4156-aaa1-e160c0b1f40f service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:28.487591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977695e-ddfb-4156-aaa1-e160c0b1f40f service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:28.487866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977695e-ddfb-4156-aaa1-e160c0b1f40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:28.497170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977695e-ddfb-4156-aaa1-e160c0b1f40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:28.498588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977695e-ddfb-4156-aaa1-e160c0b1f40f service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:28.508305 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4369/8725] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:41:28.795820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a522f4-c179-4baa-88bd-3ffbf62c54da None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:28.797360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f2a522f4-c179-4baa-88bd-3ffbf62c54da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:28.811153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a522f4-c179-4baa-88bd-3ffbf62c54da None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:28.817524 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:28.818077 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:28.818357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:28.818766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0 admin admin] PATH_INFO: `/v3/projects/bd71933848da499997372287572870be` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:28.820317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd71933848da499997372287572870be)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:28.822487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:28.879066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd71933848da499997372287572870be', 'request_id': 'req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:28.900463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd71933848da499997372287572870be', 'request_id': 'req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:28.915428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd71933848da499997372287572870be', 'request_id': 'req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:28.932322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0 admin admin] The token cache is being invalidate because project bd71933848da499997372287572870be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:41:28.932683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:28.933396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-1c1bf3bc-e075-442e-beb1-3ef663ca16a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:41:28.935276 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4357/8726] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:41:28 2022] DELETE /identity/v3/projects/bd71933848da499997372287572870be => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:41:28.940751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cacea-6690-4d55-b3f2-0af04c61af56 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:28.941552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cacea-6690-4d55-b3f2-0af04c61af56 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:28.942351 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cacea-6690-4d55-b3f2-0af04c61af56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:28.965101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-791cacea-6690-4d55-b3f2-0af04c61af56 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:28.966470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-791cacea-6690-4d55-b3f2-0af04c61af56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:29.006286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:29.039247 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4370/8727] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:29.048422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474ec2c-198a-4139-a8f3-dc138d685d8b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:29.048877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474ec2c-198a-4139-a8f3-dc138d685d8b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:29.049262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474ec2c-198a-4139-a8f3-dc138d685d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:29.071958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d474ec2c-198a-4139-a8f3-dc138d685d8b None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:29.073279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d474ec2c-198a-4139-a8f3-dc138d685d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:29.085447 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4358/8728] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:41:29.090092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cacea-6690-4d55-b3f2-0af04c61af56 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:29.100614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cacea-6690-4d55-b3f2-0af04c61af56 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:29.105225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b19e0e-18a1-4263-a4ef-eec42ea67e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:29.105864 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b19e0e-18a1-4263-a4ef-eec42ea67e2f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:29.106149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b19e0e-18a1-4263-a4ef-eec42ea67e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:29.106456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b19e0e-18a1-4263-a4ef-eec42ea67e2f admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:29.107132 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b19e0e-18a1-4263-a4ef-eec42ea67e2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:41:29.107439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b19e0e-18a1-4263-a4ef-eec42ea67e2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:29.109107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b19e0e-18a1-4263-a4ef-eec42ea67e2f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:29.124807 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4371/8729] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:41:29.126444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474ec2c-198a-4139-a8f3-dc138d685d8b None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:29.136733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474ec2c-198a-4139-a8f3-dc138d685d8b None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:29.143294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6d6d6-5548-4d27-9b17-7b6499307ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:29.143776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6d6d6-5548-4d27-9b17-7b6499307ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:29.144053 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6d6d6-5548-4d27-9b17-7b6499307ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:29.144324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6d6d6-5548-4d27-9b17-7b6499307ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:29.145005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6d6d6-5548-4d27-9b17-7b6499307ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:29.146947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6d6d6-5548-4d27-9b17-7b6499307ae3 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:29.174694 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4359/8730] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:41:29 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:41:29.179074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b19e0e-18a1-4263-a4ef-eec42ea67e2f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:29.190281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b19e0e-18a1-4263-a4ef-eec42ea67e2f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:29.246373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6981890-19a8-46e4-985c-6422a1e114e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:29.246940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6981890-19a8-46e4-985c-6422a1e114e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:29.247228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6981890-19a8-46e4-985c-6422a1e114e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:29.247523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6981890-19a8-46e4-985c-6422a1e114e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:29.248136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6981890-19a8-46e4-985c-6422a1e114e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:29.250076 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6981890-19a8-46e4-985c-6422a1e114e3 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:29.274829 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4372/8731] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:41:29 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:41:29.279324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6d6d6-5548-4d27-9b17-7b6499307ae3 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:29.290974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6d6d6-5548-4d27-9b17-7b6499307ae3 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:29.295941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1cea9-8662-4c0c-b84f-2e63a89c95d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:29.296562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1cea9-8662-4c0c-b84f-2e63a89c95d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:29.296841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1cea9-8662-4c0c-b84f-2e63a89c95d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:29.297113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1cea9-8662-4c0c-b84f-2e63a89c95d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:29.297763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1cea9-8662-4c0c-b84f-2e63a89c95d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:29.299597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1cea9-8662-4c0c-b84f-2e63a89c95d5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:29.310960 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4360/8732] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:41:29.316027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6981890-19a8-46e4-985c-6422a1e114e3 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:29.326826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6981890-19a8-46e4-985c-6422a1e114e3 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:29.332530 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a50eae-15f2-46ab-85a3-07fc4dac668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:29.333146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a50eae-15f2-46ab-85a3-07fc4dac668b admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:29.333434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a50eae-15f2-46ab-85a3-07fc4dac668b admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:29.333712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a50eae-15f2-46ab-85a3-07fc4dac668b admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:29.334358 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a50eae-15f2-46ab-85a3-07fc4dac668b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:29.336014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a50eae-15f2-46ab-85a3-07fc4dac668b admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:29.348259 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4373/8733] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:41:29.352515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1cea9-8662-4c0c-b84f-2e63a89c95d5 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:29.363854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1cea9-8662-4c0c-b84f-2e63a89c95d5 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:29.368674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d235bb-72c4-4033-8b0f-940b518c014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:29.369334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d235bb-72c4-4033-8b0f-940b518c014b admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:29.369636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d235bb-72c4-4033-8b0f-940b518c014b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:29.369895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d235bb-72c4-4033-8b0f-940b518c014b admin admin] PATH_INFO: `/v3/projects/89c8858448dd4c4f80a47710c64a5823/users/eb4fc63a57ce46fb8d46b2c9f66380c7/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:29.372207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:29.388404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d235bb-72c4-4033-8b0f-940b518c014b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c8858448dd4c4f80a47710c64a5823, user_id=eb4fc63a57ce46fb8d46b2c9f66380c7, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:29.391078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d235bb-72c4-4033-8b0f-940b518c014b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:29.404969 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4361/8734] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:41:29 2022] PUT /identity/v3/projects/89c8858448dd4c4f80a47710c64a5823/users/eb4fc63a57ce46fb8d46b2c9f66380c7/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:41:29.410208 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a124fdf-b5b1-400f-bdc9-07745c3f7702 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:29.410614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a124fdf-b5b1-400f-bdc9-07745c3f7702 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:29.411057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a124fdf-b5b1-400f-bdc9-07745c3f7702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:29.430858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-5a124fdf-b5b1-400f-bdc9-07745c3f7702 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:29.432061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5a124fdf-b5b1-400f-bdc9-07745c3f7702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:29.494406 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4374/8735] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:41:29.505184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d235bb-72c4-4033-8b0f-940b518c014b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:29.507061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-86d235bb-72c4-4033-8b0f-940b518c014b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:29.565214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d235bb-72c4-4033-8b0f-940b518c014b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:29.568983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b14a4-41b7-46ab-be86-105b3b468b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:29.569599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b14a4-41b7-46ab-be86-105b3b468b6c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:29.569885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b14a4-41b7-46ab-be86-105b3b468b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:29.570164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b14a4-41b7-46ab-be86-105b3b468b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:29.580545 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b14a4-41b7-46ab-be86-105b3b468b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:29.582543 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b14a4-41b7-46ab-be86-105b3b468b6c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:29.591788 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4362/8736] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:41:34.038293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65abe1-a444-4cc6-a643-5f34898be8e0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:34.038862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65abe1-a444-4cc6-a643-5f34898be8e0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:34.038862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65abe1-a444-4cc6-a643-5f34898be8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:34.068691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0a65abe1-a444-4cc6-a643-5f34898be8e0 None None] MFA Rules not processed for user `eb4fc63a57ce46fb8d46b2c9f66380c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:34.070180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0a65abe1-a444-4cc6-a643-5f34898be8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:34.106834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:34.145263 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4375/8737] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:41:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:34.149986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b14a4-41b7-46ab-be86-105b3b468b6c service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:34.160034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b14a4-41b7-46ab-be86-105b3b468b6c service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:34.164640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5dc02-87af-4075-8bb8-3475b5fb366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:34.165239 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5dc02-87af-4075-8bb8-3475b5fb366c admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:34.165523 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5dc02-87af-4075-8bb8-3475b5fb366c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:34.165801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5dc02-87af-4075-8bb8-3475b5fb366c admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:34.166442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5dc02-87af-4075-8bb8-3475b5fb366c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:34.168384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5dc02-87af-4075-8bb8-3475b5fb366c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:34.198134 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4363/8738] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:41:34 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:41:34.202047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65abe1-a444-4cc6-a643-5f34898be8e0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:34.213668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65abe1-a444-4cc6-a643-5f34898be8e0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:34.275021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99d40-b97b-47bc-873a-51f1e79d6852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:34.275640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99d40-b97b-47bc-873a-51f1e79d6852 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:34.275924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99d40-b97b-47bc-873a-51f1e79d6852 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:34.276199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99d40-b97b-47bc-873a-51f1e79d6852 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:34.276843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99d40-b97b-47bc-873a-51f1e79d6852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:34.278804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99d40-b97b-47bc-873a-51f1e79d6852 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:34.303751 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4376/8739] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:41:34 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:41:34.305242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5dc02-87af-4075-8bb8-3475b5fb366c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:34.316600 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5dc02-87af-4075-8bb8-3475b5fb366c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:34.321153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2a342-b507-4ccf-86c9-95758c970881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:34.321734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2a342-b507-4ccf-86c9-95758c970881 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:34.322015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2a342-b507-4ccf-86c9-95758c970881 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:34.322285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2a342-b507-4ccf-86c9-95758c970881 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:34.322967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2a342-b507-4ccf-86c9-95758c970881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:34.324568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2a342-b507-4ccf-86c9-95758c970881 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:34.337315 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4364/8740] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:41:34.342512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99d40-b97b-47bc-873a-51f1e79d6852 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:34.359708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99d40-b97b-47bc-873a-51f1e79d6852 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:34.365533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f837463-7cea-4fac-aa82-f62f653e5887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:34.366232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f837463-7cea-4fac-aa82-f62f653e5887 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:34.366518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f837463-7cea-4fac-aa82-f62f653e5887 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:34.366860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f837463-7cea-4fac-aa82-f62f653e5887 admin admin] PATH_INFO: `/v3/projects/f648a2c294b44a0897520f7ffe0787c1/users/9916ecb497e44d0d882cdb204edfd004/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:34.383793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f837463-7cea-4fac-aa82-f62f653e5887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f648a2c294b44a0897520f7ffe0787c1, user_id=9916ecb497e44d0d882cdb204edfd004, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:34.386496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f837463-7cea-4fac-aa82-f62f653e5887 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:34.402604 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4377/8741] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:41:34 2022] PUT /identity/v3/projects/f648a2c294b44a0897520f7ffe0787c1/users/9916ecb497e44d0d882cdb204edfd004/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:41:34.406756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2a342-b507-4ccf-86c9-95758c970881 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:34.417531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2a342-b507-4ccf-86c9-95758c970881 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:34.482886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bffda-2c51-4016-9439-ed90c0d913c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:34.483506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bffda-2c51-4016-9439-ed90c0d913c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:34.483787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bffda-2c51-4016-9439-ed90c0d913c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:34.484057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bffda-2c51-4016-9439-ed90c0d913c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:34.484693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bffda-2c51-4016-9439-ed90c0d913c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:34.487311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bffda-2c51-4016-9439-ed90c0d913c4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:34.498402 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4365/8742] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:41:34.503008 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f837463-7cea-4fac-aa82-f62f653e5887 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:34.533955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f837463-7cea-4fac-aa82-f62f653e5887 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:34.539744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66bf91-95d2-4b99-bb0f-196727ccf818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:34.540507 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66bf91-95d2-4b99-bb0f-196727ccf818 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:34.540882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66bf91-95d2-4b99-bb0f-196727ccf818 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:34.541249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66bf91-95d2-4b99-bb0f-196727ccf818 admin admin] PATH_INFO: `/v3/projects/f648a2c294b44a0897520f7ffe0787c1/users/9916ecb497e44d0d882cdb204edfd004/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:34.543445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66bf91-95d2-4b99-bb0f-196727ccf818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f648a2c294b44a0897520f7ffe0787c1, user_id=9916ecb497e44d0d882cdb204edfd004, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:34.546171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66bf91-95d2-4b99-bb0f-196727ccf818 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:34.558070 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4378/8743] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:41:34 2022] PUT /identity/v3/projects/f648a2c294b44a0897520f7ffe0787c1/users/9916ecb497e44d0d882cdb204edfd004/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:41:39.156939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e9035-5996-416e-b271-9aa622d0e737 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:39.158058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e9035-5996-416e-b271-9aa622d0e737 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:39.158258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e9035-5996-416e-b271-9aa622d0e737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:39.192159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8a8e9035-5996-416e-b271-9aa622d0e737 None None] MFA Rules not processed for user `9916ecb497e44d0d882cdb204edfd004`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:39.193380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8a8e9035-5996-416e-b271-9aa622d0e737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:39.240709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:39.321672 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4366/8744] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:41:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:39.342366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66bf91-95d2-4b99-bb0f-196727ccf818 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:39.344399 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8a66bf91-95d2-4b99-bb0f-196727ccf818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:39.452903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66bf91-95d2-4b99-bb0f-196727ccf818 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:39.458513 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f7b1c-0bd7-4454-af6e-1cdb5dc39199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:39.459273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f7b1c-0bd7-4454-af6e-1cdb5dc39199 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:39.459625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f7b1c-0bd7-4454-af6e-1cdb5dc39199 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:39.459971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f7b1c-0bd7-4454-af6e-1cdb5dc39199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:39.474969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f7b1c-0bd7-4454-af6e-1cdb5dc39199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:39.476693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f7b1c-0bd7-4454-af6e-1cdb5dc39199 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:39.488906 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4379/8745] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:41:39.547568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad821ca5-1186-4ec3-b39b-c96c99ca3578 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:39.547984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad821ca5-1186-4ec3-b39b-c96c99ca3578 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:39.548305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad821ca5-1186-4ec3-b39b-c96c99ca3578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:39.578029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ad821ca5-1186-4ec3-b39b-c96c99ca3578 None None] MFA Rules not processed for user `eb4fc63a57ce46fb8d46b2c9f66380c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:39.580859 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ad821ca5-1186-4ec3-b39b-c96c99ca3578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:39.646346 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4367/8746] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:41:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:40.617234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8c846-a164-417c-8c27-4234d1e71053 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:40.617831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8c846-a164-417c-8c27-4234d1e71053 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:40.617831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8c846-a164-417c-8c27-4234d1e71053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:40.631118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:40.662920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-77b8c846-a164-417c-8c27-4234d1e71053 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:40.664254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-77b8c846-a164-417c-8c27-4234d1e71053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:40.729249 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4380/8747] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 19:41:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:40.741055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad821ca5-1186-4ec3-b39b-c96c99ca3578 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:40.742494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ad821ca5-1186-4ec3-b39b-c96c99ca3578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:40.760221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad821ca5-1186-4ec3-b39b-c96c99ca3578 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:40.765544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebfb8f-9c26-4877-97df-c27c181f43f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:40.766159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebfb8f-9c26-4877-97df-c27c181f43f1 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:40.766993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebfb8f-9c26-4877-97df-c27c181f43f1 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:40.767442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebfb8f-9c26-4877-97df-c27c181f43f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:40.777103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebfb8f-9c26-4877-97df-c27c181f43f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:40.778724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebfb8f-9c26-4877-97df-c27c181f43f1 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:40.791291 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4368/8748] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:41:50.345670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25c324-6df4-40e0-9f5b-e1d2931eacac None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:50.346237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25c324-6df4-40e0-9f5b-e1d2931eacac None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:50.346237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25c324-6df4-40e0-9f5b-e1d2931eacac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:50.365667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7b25c324-6df4-40e0-9f5b-e1d2931eacac None None] MFA Rules not processed for user `eb4fc63a57ce46fb8d46b2c9f66380c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:50.366901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7b25c324-6df4-40e0-9f5b-e1d2931eacac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:50.373805 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4381/8749] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:41:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:50.786189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=43 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:41:50.945582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810ded-8a35-4781-b702-4bebb53ea7c2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:50.945893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810ded-8a35-4781-b702-4bebb53ea7c2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:50.946173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810ded-8a35-4781-b702-4bebb53ea7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:50.968443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1d810ded-8a35-4781-b702-4bebb53ea7c2 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:41:50.969761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1d810ded-8a35-4781-b702-4bebb53ea7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:41:50.979770 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4369/8750] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 19:41:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:41:50.991334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25c324-6df4-40e0-9f5b-e1d2931eacac None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:41:51.006788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25c324-6df4-40e0-9f5b-e1d2931eacac None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:41:51.011820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86184fa6-ba67-4773-9f7d-69b65746bb4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:41:51.012678 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86184fa6-ba67-4773-9f7d-69b65746bb4d service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:41:51.012964 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86184fa6-ba67-4773-9f7d-69b65746bb4d service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:41:51.013245 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86184fa6-ba67-4773-9f7d-69b65746bb4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:41:51.022667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86184fa6-ba67-4773-9f7d-69b65746bb4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:41:51.024287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86184fa6-ba67-4773-9f7d-69b65746bb4d service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:41:51.035046 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4382/8751] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:41:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:00.963172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:01.030439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=41 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:16.336632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d810ded-8a35-4781-b702-4bebb53ea7c2 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:16.416761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d810ded-8a35-4781-b702-4bebb53ea7c2 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:16.421504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:16.422138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:16.422424 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:16.422697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] PATH_INFO: `/v3/users/eb4fc63a57ce46fb8d46b2c9f66380c7` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:16.424452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4fc63a57ce46fb8d46b2c9f66380c7)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:16.426384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:16.472714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4fc63a57ce46fb8d46b2c9f66380c7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.479845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4fc63a57ce46fb8d46b2c9f66380c7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.480519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4fc63a57ce46fb8d46b2c9f66380c7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.487926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4fc63a57ce46fb8d46b2c9f66380c7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.488654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4fc63a57ce46fb8d46b2c9f66380c7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.505900 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4370/8752] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:42:16 2022] DELETE /identity/v3/users/eb4fc63a57ce46fb8d46b2c9f66380c7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:42:16.682195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86184fa6-ba67-4773-9f7d-69b65746bb4d service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:16.693666 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86184fa6-ba67-4773-9f7d-69b65746bb4d service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:16.752438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:16.753070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:16.753422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:16.753614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] PATH_INFO: `/v3/projects/89c8858448dd4c4f80a47710c64a5823` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:16.754714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c8858448dd4c4f80a47710c64a5823)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:16.756681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:16.803459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c8858448dd4c4f80a47710c64a5823', 'request_id': 'req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.810882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c8858448dd4c4f80a47710c64a5823', 'request_id': 'req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.816705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c8858448dd4c4f80a47710c64a5823', 'request_id': 'req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.840324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] The token cache is being invalidate because project 89c8858448dd4c4f80a47710c64a5823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:42:16.840617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.841246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.842713 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4383/8753] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:42:16 2022] DELETE /identity/v3/projects/89c8858448dd4c4f80a47710c64a5823 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:42:16.847381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:16.848845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:16.861889 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b58c0-8420-4032-88ac-8da74165b695 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:16.918504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:16.919190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:16.919497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:16.919792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] PATH_INFO: `/v3/users/9916ecb497e44d0d882cdb204edfd004` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:16.920972 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9916ecb497e44d0d882cdb204edfd004)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:16.922941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:16.935899 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:16.969431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9916ecb497e44d0d882cdb204edfd004'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.977069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9916ecb497e44d0d882cdb204edfd004'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.977727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9916ecb497e44d0d882cdb204edfd004'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.984981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9916ecb497e44d0d882cdb204edfd004'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:16.985724 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9916ecb497e44d0d882cdb204edfd004'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:17.003994 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4371/8754] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:42:16 2022] DELETE /identity/v3/users/9916ecb497e44d0d882cdb204edfd004 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:42:17.184192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:17.185629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:17.199203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16cc55f-11b4-45e1-9084-6f9dd2ab582c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:17.257602 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:17.258183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:17.263062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:17.263062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] PATH_INFO: `/v3/projects/f648a2c294b44a0897520f7ffe0787c1` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:17.263062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f648a2c294b44a0897520f7ffe0787c1)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:17.263062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:17.287129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:17.315779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f648a2c294b44a0897520f7ffe0787c1', 'request_id': 'req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:17.323733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f648a2c294b44a0897520f7ffe0787c1', 'request_id': 'req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:17.330535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f648a2c294b44a0897520f7ffe0787c1', 'request_id': 'req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:17.342565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] The token cache is being invalidate because project f648a2c294b44a0897520f7ffe0787c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:42:17.342907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:17.343585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:17.345096 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4384/8755] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:42:17 2022] DELETE /identity/v3/projects/f648a2c294b44a0897520f7ffe0787c1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:42:26.999847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=22,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:27.339726 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:37.686979 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:37.688469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:37.757837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248e656-b6e7-4613-bd49-b0f8b051354c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:37.808014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ae277-697c-4d6b-9e9d-2770eb80755b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:37.808629 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae277-697c-4d6b-9e9d-2770eb80755b service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:37.808917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae277-697c-4d6b-9e9d-2770eb80755b service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:37.809190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ae277-697c-4d6b-9e9d-2770eb80755b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:37.810944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c22ae277-697c-4d6b-9e9d-2770eb80755b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:37.891715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ae277-697c-4d6b-9e9d-2770eb80755b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:37.893059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ae277-697c-4d6b-9e9d-2770eb80755b service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:37.904136 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4372/8756] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:38.964080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:38.965648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:38.978968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f6cab-d939-4ab9-8bc9-4bfe9434c112 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:38.982664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1705858-fc74-4335-a530-2504c8d41150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:38.983318 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1705858-fc74-4335-a530-2504c8d41150 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:38.983601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1705858-fc74-4335-a530-2504c8d41150 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:38.983878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1705858-fc74-4335-a530-2504c8d41150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:38.985652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b1705858-fc74-4335-a530-2504c8d41150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:39.086616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1705858-fc74-4335-a530-2504c8d41150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:39.088095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1705858-fc74-4335-a530-2504c8d41150 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:39.102160 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4385/8757] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:40.289485 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ae277-697c-4d6b-9e9d-2770eb80755b service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:40.298227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ae277-697c-4d6b-9e9d-2770eb80755b service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:40.302857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a5592-101a-4df6-abe5-944f69390d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:40.304137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5592-101a-4df6-abe5-944f69390d7b service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:40.304428 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5592-101a-4df6-abe5-944f69390d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:40.304707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5592-101a-4df6-abe5-944f69390d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:40.306508 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-391a5592-101a-4df6-abe5-944f69390d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:40.323457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a5592-101a-4df6-abe5-944f69390d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:40.324897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a5592-101a-4df6-abe5-944f69390d7b service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:40.339209 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4373/8758] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:44.586934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1705858-fc74-4335-a530-2504c8d41150 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:44.588388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b1705858-fc74-4335-a530-2504c8d41150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:44.679526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1705858-fc74-4335-a530-2504c8d41150 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:44.684705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf8a11-ec36-46aa-b934-71fa02543cc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:44.685345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf8a11-ec36-46aa-b934-71fa02543cc7 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:44.685632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf8a11-ec36-46aa-b934-71fa02543cc7 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:44.685908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf8a11-ec36-46aa-b934-71fa02543cc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:44.687736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-39bf8a11-ec36-46aa-b934-71fa02543cc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:44.703702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf8a11-ec36-46aa-b934-71fa02543cc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:44.705391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf8a11-ec36-46aa-b934-71fa02543cc7 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:44.719452 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4386/8759] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:44.870868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a5592-101a-4df6-abe5-944f69390d7b service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:44.872946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-391a5592-101a-4df6-abe5-944f69390d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:44.907430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:44.948174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a5592-101a-4df6-abe5-944f69390d7b service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:44.953009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:44.955095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:44.955384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:44.955710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] PATH_INFO: `/v3/users/b0ae958878db4d2a81ba14f57b3128c0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:44.956813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ae958878db4d2a81ba14f57b3128c0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:44.959033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:45.010404 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ae958878db4d2a81ba14f57b3128c0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.018068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ae958878db4d2a81ba14f57b3128c0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.018768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ae958878db4d2a81ba14f57b3128c0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.027398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ae958878db4d2a81ba14f57b3128c0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.028151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ae958878db4d2a81ba14f57b3128c0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.048379 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4374/8760] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:42:44 2022] DELETE /identity/v3/users/b0ae958878db4d2a81ba14f57b3128c0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:42:45.053841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff435fad-8db2-42ae-b515-788a4f9aad53 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:45.054137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff435fad-8db2-42ae-b515-788a4f9aad53 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:45.054415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff435fad-8db2-42ae-b515-788a4f9aad53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:45.084596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ff435fad-8db2-42ae-b515-788a4f9aad53 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:45.085804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ff435fad-8db2-42ae-b515-788a4f9aad53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:45.141123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:45.152436 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4387/8761] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:45.163008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:45.164429 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:45.222319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f9acf-c7e8-4928-927b-4b1ad57354d6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:45.226820 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76837410-1e5c-4be3-8ec6-214461a49bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:45.227431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76837410-1e5c-4be3-8ec6-214461a49bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:45.227716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76837410-1e5c-4be3-8ec6-214461a49bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:45.228001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76837410-1e5c-4be3-8ec6-214461a49bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:45.237325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76837410-1e5c-4be3-8ec6-214461a49bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:45.238792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76837410-1e5c-4be3-8ec6-214461a49bd8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:45.248731 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4375/8762] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:42:45.431877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff435fad-8db2-42ae-b515-788a4f9aad53 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:45.433350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ff435fad-8db2-42ae-b515-788a4f9aad53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:45.449789 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff435fad-8db2-42ae-b515-788a4f9aad53 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:45.454697 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:45.455442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:45.455751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:45.456061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] PATH_INFO: `/v3/projects/a452c216723049bf83a3bb0b62f22217` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:45.457427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a452c216723049bf83a3bb0b62f22217)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:45.460088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:45.508397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a452c216723049bf83a3bb0b62f22217', 'request_id': 'req-6586767c-a30a-46a5-8442-b883399d8f65'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.516180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a452c216723049bf83a3bb0b62f22217', 'request_id': 'req-6586767c-a30a-46a5-8442-b883399d8f65'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.522537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a452c216723049bf83a3bb0b62f22217', 'request_id': 'req-6586767c-a30a-46a5-8442-b883399d8f65'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.533543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] The token cache is being invalidate because project a452c216723049bf83a3bb0b62f22217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:42:45.533834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.534472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.535963 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4388/8763] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:42:45 2022] DELETE /identity/v3/projects/a452c216723049bf83a3bb0b62f22217 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:42:45.540531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76837410-1e5c-4be3-8ec6-214461a49bd8 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:45.552534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76837410-1e5c-4be3-8ec6-214461a49bd8 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:45.598688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:45.613425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d702ca-00b0-4379-9ffc-b8dbf53eb749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:45.614066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d702ca-00b0-4379-9ffc-b8dbf53eb749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:45.614474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d702ca-00b0-4379-9ffc-b8dbf53eb749 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:45.614797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d702ca-00b0-4379-9ffc-b8dbf53eb749 admin admin] PATH_INFO: `/v3/users/373297b950c242cd8862f89c166eb1ad` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:45.628023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d702ca-00b0-4379-9ffc-b8dbf53eb749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=373297b950c242cd8862f89c166eb1ad)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:45.630497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d702ca-00b0-4379-9ffc-b8dbf53eb749 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:45.676822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-71d702ca-00b0-4379-9ffc-b8dbf53eb749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '373297b950c242cd8862f89c166eb1ad'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.683905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-71d702ca-00b0-4379-9ffc-b8dbf53eb749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '373297b950c242cd8862f89c166eb1ad'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.684568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-71d702ca-00b0-4379-9ffc-b8dbf53eb749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '373297b950c242cd8862f89c166eb1ad'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.695714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-71d702ca-00b0-4379-9ffc-b8dbf53eb749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '373297b950c242cd8862f89c166eb1ad'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.696518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-71d702ca-00b0-4379-9ffc-b8dbf53eb749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '373297b950c242cd8862f89c166eb1ad'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:45.718593 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4376/8764] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:42:45 2022] DELETE /identity/v3/users/373297b950c242cd8862f89c166eb1ad => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:42:45.903532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:45.905056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:45.921323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586767c-a30a-46a5-8442-b883399d8f65 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:45.979192 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b1c2e-89bf-4aa9-847c-dad566fd1476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:45.979824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b1c2e-89bf-4aa9-847c-dad566fd1476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:45.980103 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b1c2e-89bf-4aa9-847c-dad566fd1476 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:45.980378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b1c2e-89bf-4aa9-847c-dad566fd1476 admin admin] PATH_INFO: `/v3/projects/507a56fced314b5d933025e1c65ee9bb` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:45.991265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b1c2e-89bf-4aa9-847c-dad566fd1476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507a56fced314b5d933025e1c65ee9bb)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:45.993187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b1c2e-89bf-4aa9-847c-dad566fd1476 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:46.041845 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814b1c2e-89bf-4aa9-847c-dad566fd1476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507a56fced314b5d933025e1c65ee9bb', 'request_id': 'req-814b1c2e-89bf-4aa9-847c-dad566fd1476'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:46.050032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814b1c2e-89bf-4aa9-847c-dad566fd1476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507a56fced314b5d933025e1c65ee9bb', 'request_id': 'req-814b1c2e-89bf-4aa9-847c-dad566fd1476'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:46.056548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814b1c2e-89bf-4aa9-847c-dad566fd1476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507a56fced314b5d933025e1c65ee9bb', 'request_id': 'req-814b1c2e-89bf-4aa9-847c-dad566fd1476'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:46.068846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814b1c2e-89bf-4aa9-847c-dad566fd1476 admin admin] The token cache is being invalidate because project 507a56fced314b5d933025e1c65ee9bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:42:46.069137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814b1c2e-89bf-4aa9-847c-dad566fd1476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:46.069770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-814b1c2e-89bf-4aa9-847c-dad566fd1476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:42:46.071275 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4389/8765] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:42:45 2022] DELETE /identity/v3/projects/507a56fced314b5d933025e1c65ee9bb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:42:55.630550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119ae30-d749-4524-85ab-53870eec6ce6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:55.631171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119ae30-d749-4524-85ab-53870eec6ce6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:55.631309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119ae30-d749-4524-85ab-53870eec6ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:55.681884 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-3119ae30-d749-4524-85ab-53870eec6ce6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:55.683131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-3119ae30-d749-4524-85ab-53870eec6ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:55.742311 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4377/8766] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:55.752071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918ef76-c50d-49d2-9b1e-67a1e47207e6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:55.752767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918ef76-c50d-49d2-9b1e-67a1e47207e6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:55.752904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918ef76-c50d-49d2-9b1e-67a1e47207e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:55.761973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:55.776735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d918ef76-c50d-49d2-9b1e-67a1e47207e6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:55.777955 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d918ef76-c50d-49d2-9b1e-67a1e47207e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:55.785972 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4390/8767] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:42:55.790658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119ae30-d749-4524-85ab-53870eec6ce6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:55.800504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119ae30-d749-4524-85ab-53870eec6ce6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:55.805784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1091693-7207-4312-bb3a-b38378d00fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:55.806387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1091693-7207-4312-bb3a-b38378d00fed admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:55.806698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1091693-7207-4312-bb3a-b38378d00fed admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:55.807016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1091693-7207-4312-bb3a-b38378d00fed admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:55.807665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1091693-7207-4312-bb3a-b38378d00fed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:42:55.807975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1091693-7207-4312-bb3a-b38378d00fed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:55.809572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1091693-7207-4312-bb3a-b38378d00fed admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:55.824653 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4378/8768] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:42:55.838417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918ef76-c50d-49d2-9b1e-67a1e47207e6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:55.847862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918ef76-c50d-49d2-9b1e-67a1e47207e6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:55.852691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8272c-662f-409f-8bc1-378c6f4ca706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:55.853307 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8272c-662f-409f-8bc1-378c6f4ca706 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:55.853610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8272c-662f-409f-8bc1-378c6f4ca706 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:55.853881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8272c-662f-409f-8bc1-378c6f4ca706 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:55.854524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8272c-662f-409f-8bc1-378c6f4ca706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:55.856505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8272c-662f-409f-8bc1-378c6f4ca706 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:55.895146 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4391/8769] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:42:55 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:42:55.899542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1091693-7207-4312-bb3a-b38378d00fed admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:55.911380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1091693-7207-4312-bb3a-b38378d00fed admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:55.928906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:55.971237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8e88d-5b1f-463a-b15b-3b4559589263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:55.971845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8e88d-5b1f-463a-b15b-3b4559589263 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:55.972128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8e88d-5b1f-463a-b15b-3b4559589263 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:55.972400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8e88d-5b1f-463a-b15b-3b4559589263 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:55.973069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8e88d-5b1f-463a-b15b-3b4559589263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:55.975118 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8e88d-5b1f-463a-b15b-3b4559589263 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:55.999092 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4379/8770] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:42:55 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:42:56.001463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8272c-662f-409f-8bc1-378c6f4ca706 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:56.012735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8272c-662f-409f-8bc1-378c6f4ca706 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:56.017420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27884bb5-7e1b-45a4-bcd7-775539aa87bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:56.018021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27884bb5-7e1b-45a4-bcd7-775539aa87bc admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:56.018304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27884bb5-7e1b-45a4-bcd7-775539aa87bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:56.018583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27884bb5-7e1b-45a4-bcd7-775539aa87bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:56.019257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27884bb5-7e1b-45a4-bcd7-775539aa87bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:56.020857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27884bb5-7e1b-45a4-bcd7-775539aa87bc admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:56.031119 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4392/8771] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:42:56.034958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8e88d-5b1f-463a-b15b-3b4559589263 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:56.044739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8e88d-5b1f-463a-b15b-3b4559589263 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:56.049395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3500e-cdf7-440a-b987-93f43b348edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:56.050040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3500e-cdf7-440a-b987-93f43b348edf admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:56.050266 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3500e-cdf7-440a-b987-93f43b348edf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:56.050541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3500e-cdf7-440a-b987-93f43b348edf admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:56.051250 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3500e-cdf7-440a-b987-93f43b348edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:56.052836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3500e-cdf7-440a-b987-93f43b348edf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:56.064006 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4380/8772] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:42:56.068165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27884bb5-7e1b-45a4-bcd7-775539aa87bc admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:56.079088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27884bb5-7e1b-45a4-bcd7-775539aa87bc admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:56.083631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecffbf7-1254-4274-8123-8b9fd386dc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:56.084843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecffbf7-1254-4274-8123-8b9fd386dc34 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:56.085142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecffbf7-1254-4274-8123-8b9fd386dc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:56.085414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecffbf7-1254-4274-8123-8b9fd386dc34 admin admin] PATH_INFO: `/v3/projects/6634a2cb4b12459095af98fa7dfbcda0/users/d174a1e2b4234ecca962e53bc185597a/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:56.100603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecffbf7-1254-4274-8123-8b9fd386dc34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6634a2cb4b12459095af98fa7dfbcda0, user_id=d174a1e2b4234ecca962e53bc185597a, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:56.103242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecffbf7-1254-4274-8123-8b9fd386dc34 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:56.116365 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4393/8773] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:42:56 2022] PUT /identity/v3/projects/6634a2cb4b12459095af98fa7dfbcda0/users/d174a1e2b4234ecca962e53bc185597a/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:42:56.129480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d879890-c210-4e62-a33c-011befdeab47 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:56.129789 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d879890-c210-4e62-a33c-011befdeab47 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:56.130071 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d879890-c210-4e62-a33c-011befdeab47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:56.158312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9d879890-c210-4e62-a33c-011befdeab47 None None] MFA Rules not processed for user `d174a1e2b4234ecca962e53bc185597a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:56.159575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9d879890-c210-4e62-a33c-011befdeab47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:56.230211 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4381/8774] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:42:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:56.234979 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecffbf7-1254-4274-8123-8b9fd386dc34 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:56.298101 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecffbf7-1254-4274-8123-8b9fd386dc34 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:56.302755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2a39e-03fb-477e-ad78-928872526727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:56.304216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a39e-03fb-477e-ad78-928872526727 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:56.304505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a39e-03fb-477e-ad78-928872526727 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:56.304783 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a39e-03fb-477e-ad78-928872526727 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:56.305426 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2a39e-03fb-477e-ad78-928872526727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:56.307361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2a39e-03fb-477e-ad78-928872526727 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:56.333276 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4394/8775] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:42:56 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:42:56.337625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d879890-c210-4e62-a33c-011befdeab47 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:56.348761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d879890-c210-4e62-a33c-011befdeab47 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:56.406409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7014113-94ac-4ceb-970b-56aecd52d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:56.406963 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014113-94ac-4ceb-970b-56aecd52d827 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:56.407267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014113-94ac-4ceb-970b-56aecd52d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:56.407527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014113-94ac-4ceb-970b-56aecd52d827 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:56.408162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7014113-94ac-4ceb-970b-56aecd52d827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:56.410089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7014113-94ac-4ceb-970b-56aecd52d827 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:56.432028 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4382/8776] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:42:56 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:42:56.436070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2a39e-03fb-477e-ad78-928872526727 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:56.447185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2a39e-03fb-477e-ad78-928872526727 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:56.451943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925e47e-ae3b-4232-a850-5b0bc8e463b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:56.452538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e47e-ae3b-4232-a850-5b0bc8e463b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:56.452820 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e47e-ae3b-4232-a850-5b0bc8e463b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:56.453114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925e47e-ae3b-4232-a850-5b0bc8e463b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:56.453733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925e47e-ae3b-4232-a850-5b0bc8e463b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:56.455366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925e47e-ae3b-4232-a850-5b0bc8e463b4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:56.466186 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4395/8777] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:42:56.470443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7014113-94ac-4ceb-970b-56aecd52d827 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:56.481681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7014113-94ac-4ceb-970b-56aecd52d827 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:56.486405 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79ebfb-92cf-4f0c-80fa-cc7687b51c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:56.487096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79ebfb-92cf-4f0c-80fa-cc7687b51c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:56.487380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79ebfb-92cf-4f0c-80fa-cc7687b51c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:56.487657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79ebfb-92cf-4f0c-80fa-cc7687b51c26 admin admin] PATH_INFO: `/v3/projects/0a27a221aee943518f7f6b19f4a87413/users/3f4398de3cfd4b15a6f6961e72fed46d/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:56.502707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79ebfb-92cf-4f0c-80fa-cc7687b51c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a27a221aee943518f7f6b19f4a87413, user_id=3f4398de3cfd4b15a6f6961e72fed46d, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:56.505390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79ebfb-92cf-4f0c-80fa-cc7687b51c26 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:56.507659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:56.519600 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4383/8778] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:42:56 2022] PUT /identity/v3/projects/0a27a221aee943518f7f6b19f4a87413/users/3f4398de3cfd4b15a6f6961e72fed46d/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:42:56.523690 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925e47e-ae3b-4232-a850-5b0bc8e463b4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:56.534614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925e47e-ae3b-4232-a850-5b0bc8e463b4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:56.594279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ca852-1174-48c5-9bf9-1d50cfbcd9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:56.594927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ca852-1174-48c5-9bf9-1d50cfbcd9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:56.595309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ca852-1174-48c5-9bf9-1d50cfbcd9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:56.595496 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ca852-1174-48c5-9bf9-1d50cfbcd9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:56.596138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ca852-1174-48c5-9bf9-1d50cfbcd9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:56.597791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ca852-1174-48c5-9bf9-1d50cfbcd9c4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:56.603937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:42:56.609995 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4396/8779] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:42:56.613834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79ebfb-92cf-4f0c-80fa-cc7687b51c26 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:56.624970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79ebfb-92cf-4f0c-80fa-cc7687b51c26 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:56.629636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b500f86-ff7d-49c0-8ea3-671825594428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:56.630285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b500f86-ff7d-49c0-8ea3-671825594428 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:56.630566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b500f86-ff7d-49c0-8ea3-671825594428 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:56.630880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b500f86-ff7d-49c0-8ea3-671825594428 admin admin] PATH_INFO: `/v3/projects/0a27a221aee943518f7f6b19f4a87413/users/3f4398de3cfd4b15a6f6961e72fed46d/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:56.632909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b500f86-ff7d-49c0-8ea3-671825594428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a27a221aee943518f7f6b19f4a87413, user_id=3f4398de3cfd4b15a6f6961e72fed46d, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:56.635573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b500f86-ff7d-49c0-8ea3-671825594428 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:56.645972 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4384/8780] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:42:56 2022] PUT /identity/v3/projects/0a27a221aee943518f7f6b19f4a87413/users/3f4398de3cfd4b15a6f6961e72fed46d/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:42:56.656533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d1b30-d229-4b11-9a13-4ccc497eb841 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:56.656756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d1b30-d229-4b11-9a13-4ccc497eb841 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:56.657035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d1b30-d229-4b11-9a13-4ccc497eb841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:56.685654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-327d1b30-d229-4b11-9a13-4ccc497eb841 None None] MFA Rules not processed for user `3f4398de3cfd4b15a6f6961e72fed46d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:56.686898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-327d1b30-d229-4b11-9a13-4ccc497eb841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:56.755331 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4397/8781] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:42:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:56.769362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69e3c-11c7-4cba-a6fe-b7bf3d20bc77 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:56.769653 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69e3c-11c7-4cba-a6fe-b7bf3d20bc77 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:56.769932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69e3c-11c7-4cba-a6fe-b7bf3d20bc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:56.790383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-add69e3c-11c7-4cba-a6fe-b7bf3d20bc77 None None] MFA Rules not processed for user `d174a1e2b4234ecca962e53bc185597a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:42:56.791624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-add69e3c-11c7-4cba-a6fe-b7bf3d20bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:56.846647 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4385/8782] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:42:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:42:56.865898 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d1b30-d229-4b11-9a13-4ccc497eb841 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:42:56.867419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-327d1b30-d229-4b11-9a13-4ccc497eb841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:42:56.945244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d1b30-d229-4b11-9a13-4ccc497eb841 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:42:56.950768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852dea1a-5707-4e09-bb33-7d937fcab15f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:42:56.951396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dea1a-5707-4e09-bb33-7d937fcab15f service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:42:56.951684 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dea1a-5707-4e09-bb33-7d937fcab15f service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:42:56.951963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dea1a-5707-4e09-bb33-7d937fcab15f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:42:56.960396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852dea1a-5707-4e09-bb33-7d937fcab15f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:42:56.962016 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852dea1a-5707-4e09-bb33-7d937fcab15f service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:42:56.970949 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4398/8783] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:42:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:05.990067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add69e3c-11c7-4cba-a6fe-b7bf3d20bc77 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:05.991564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-add69e3c-11c7-4cba-a6fe-b7bf3d20bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:06.011261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add69e3c-11c7-4cba-a6fe-b7bf3d20bc77 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:06.017109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782b10a-fbaa-4c96-a71a-d48d03258844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:06.017719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782b10a-fbaa-4c96-a71a-d48d03258844 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:06.018001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782b10a-fbaa-4c96-a71a-d48d03258844 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:06.018275 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782b10a-fbaa-4c96-a71a-d48d03258844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:06.027759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782b10a-fbaa-4c96-a71a-d48d03258844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:06.029381 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782b10a-fbaa-4c96-a71a-d48d03258844 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:06.039606 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4386/8784] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:06.055183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade3708-fec4-487c-8c39-c88498684397 None None] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:06.055713 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade3708-fec4-487c-8c39-c88498684397 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:06.055851 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade3708-fec4-487c-8c39-c88498684397 None None] PATH_INFO: `/` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:06.057129 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4399/8785] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:06.062288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782b10a-fbaa-4c96-a71a-d48d03258844 service nova] Authenticating service token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:43:06.077072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782b10a-fbaa-4c96-a71a-d48d03258844 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:06.085468 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782b10a-fbaa-4c96-a71a-d48d03258844 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:06.090707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffddeb1-179f-4fb4-8741-ae210bb8971f tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f4398de3cfd4b15a6f6961e72fed46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a27a221aee943518f7f6b19f4a87413', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:06.091741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffddeb1-179f-4fb4-8741-ae210bb8971f tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:06.092028 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffddeb1-179f-4fb4-8741-ae210bb8971f tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:06.092308 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffddeb1-179f-4fb4-8741-ae210bb8971f tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] PATH_INFO: `/v3/projects/0a27a221aee943518f7f6b19f4a87413` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:06.093439 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffddeb1-179f-4fb4-8741-ae210bb8971f tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a27a221aee943518f7f6b19f4a87413)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:06.095611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffddeb1-179f-4fb4-8741-ae210bb8971f tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:06.097258 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4387/8786] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:43:06 2022] GET /identity/v3/projects/0a27a221aee943518f7f6b19f4a87413 => generated 393 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 19:43:06.256553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade3708-fec4-487c-8c39-c88498684397 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:06.259659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4ade3708-fec4-487c-8c39-c88498684397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:06.319858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade3708-fec4-487c-8c39-c88498684397 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:06.324343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ea7d5-8a26-426f-923b-7f9322167bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:06.324959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ea7d5-8a26-426f-923b-7f9322167bcd service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:06.325247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ea7d5-8a26-426f-923b-7f9322167bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:06.325524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ea7d5-8a26-426f-923b-7f9322167bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:06.327279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-773ea7d5-8a26-426f-923b-7f9322167bcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:06.340035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ea7d5-8a26-426f-923b-7f9322167bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:06.341464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ea7d5-8a26-426f-923b-7f9322167bcd service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:06.352430 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4400/8787] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:06.514257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6c426-1fe1-4a49-9733-6f89434dfd02 None None] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:06.514539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6c426-1fe1-4a49-9733-6f89434dfd02 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:06.514841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6c426-1fe1-4a49-9733-6f89434dfd02 None None] PATH_INFO: `/` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:06.516172 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4388/8788] 10.222.0.70 () {54 vars in 912 bytes} [Sun Aug 28 19:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 19:43:06.520913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ea7d5-8a26-426f-923b-7f9322167bcd service neutron] Authenticating service token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 19:43:06.539617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ea7d5-8a26-426f-923b-7f9322167bcd service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:06.551415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ea7d5-8a26-426f-923b-7f9322167bcd service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:06.556888 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f875170-13f5-4940-bf14-27518c62fa54 tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f4398de3cfd4b15a6f6961e72fed46d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a27a221aee943518f7f6b19f4a87413', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:06.557521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f875170-13f5-4940-bf14-27518c62fa54 tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:06.557829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f875170-13f5-4940-bf14-27518c62fa54 tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:06.558095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f875170-13f5-4940-bf14-27518c62fa54 tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] PATH_INFO: `/v3/projects/0a27a221aee943518f7f6b19f4a87413` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:06.559263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f875170-13f5-4940-bf14-27518c62fa54 tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a27a221aee943518f7f6b19f4a87413)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:06.561069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f875170-13f5-4940-bf14-27518c62fa54 tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:06.562975 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4401/8789] 10.222.0.70 () {58 vars in 1443 bytes} [Sun Aug 28 19:43:06 2022] GET /identity/v3/projects/0a27a221aee943518f7f6b19f4a87413 => generated 393 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:43:06.720082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6c426-1fe1-4a49-9733-6f89434dfd02 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:06.731506 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6c426-1fe1-4a49-9733-6f89434dfd02 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:06.735059 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759bc43-ee9a-49e0-986d-9042e78a28d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:06.735652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759bc43-ee9a-49e0-986d-9042e78a28d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:06.736559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759bc43-ee9a-49e0-986d-9042e78a28d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:06.736847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759bc43-ee9a-49e0-986d-9042e78a28d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:06.738573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d759bc43-ee9a-49e0-986d-9042e78a28d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:06.750851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759bc43-ee9a-49e0-986d-9042e78a28d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:06.752279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759bc43-ee9a-49e0-986d-9042e78a28d5 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:06.763654 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4389/8790] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:09.508920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f875170-13f5-4940-bf14-27518c62fa54 tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:09.514478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=100 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:09.574478 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f875170-13f5-4940-bf14-27518c62fa54 tempest-ServersAdminNegativeTestJSON-2093318090 tempest-ServersAdminNegativeTestJSON-2093318090-project-admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:09.579384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:09.580086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:09.580370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:09.580649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] PATH_INFO: `/v3/users/d174a1e2b4234ecca962e53bc185597a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:09.581794 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d174a1e2b4234ecca962e53bc185597a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:09.583778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:09.633698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd174a1e2b4234ecca962e53bc185597a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:09.641328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd174a1e2b4234ecca962e53bc185597a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:09.642124 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd174a1e2b4234ecca962e53bc185597a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:09.656061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd174a1e2b4234ecca962e53bc185597a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:09.656742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd174a1e2b4234ecca962e53bc185597a'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:09.671537 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4402/8791] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:43:09 2022] DELETE /identity/v3/users/d174a1e2b4234ecca962e53bc185597a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:43:09.676045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3aa7-8772-480d-86f6-89cc0d4086f1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:09.676541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3aa7-8772-480d-86f6-89cc0d4086f1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:09.676662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a3aa7-8772-480d-86f6-89cc0d4086f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:09.697767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0a4a3aa7-8772-480d-86f6-89cc0d4086f1 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:09.699026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0a4a3aa7-8772-480d-86f6-89cc0d4086f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:09.758894 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4390/8792] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:09.768957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:09.770482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:09.828877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01792389-42e9-4158-a5d4-c8eb3249f491 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:09.832524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbda75a-eb37-4d86-96bc-45ee58482b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:09.833128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbda75a-eb37-4d86-96bc-45ee58482b24 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:09.833409 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbda75a-eb37-4d86-96bc-45ee58482b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:09.833681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbda75a-eb37-4d86-96bc-45ee58482b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:09.842693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbda75a-eb37-4d86-96bc-45ee58482b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:09.844135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbda75a-eb37-4d86-96bc-45ee58482b24 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:09.854147 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4403/8793] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:10.036158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a3aa7-8772-480d-86f6-89cc0d4086f1 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:10.037626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0a4a3aa7-8772-480d-86f6-89cc0d4086f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:10.055768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a3aa7-8772-480d-86f6-89cc0d4086f1 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:10.060908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:10.061474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:10.061781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:10.062015 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] PATH_INFO: `/v3/projects/6634a2cb4b12459095af98fa7dfbcda0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:10.063349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6634a2cb4b12459095af98fa7dfbcda0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:10.065983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:10.109853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:10.112641 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6634a2cb4b12459095af98fa7dfbcda0', 'request_id': 'req-f2ae0e36-fc55-43df-957f-bdcec8110d6c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.120482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6634a2cb4b12459095af98fa7dfbcda0', 'request_id': 'req-f2ae0e36-fc55-43df-957f-bdcec8110d6c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.127097 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6634a2cb4b12459095af98fa7dfbcda0', 'request_id': 'req-f2ae0e36-fc55-43df-957f-bdcec8110d6c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.139633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] The token cache is being invalidate because project 6634a2cb4b12459095af98fa7dfbcda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:43:10.139920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.140536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.142299 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4391/8794] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:43:10 2022] DELETE /identity/v3/projects/6634a2cb4b12459095af98fa7dfbcda0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:43:10.146275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbda75a-eb37-4d86-96bc-45ee58482b24 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:10.156716 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbda75a-eb37-4d86-96bc-45ee58482b24 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:10.181494 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:10.217616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc0516-83ae-4dfb-9a5f-3950cba0935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:10.218252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc0516-83ae-4dfb-9a5f-3950cba0935d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:10.218558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc0516-83ae-4dfb-9a5f-3950cba0935d admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:10.218907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc0516-83ae-4dfb-9a5f-3950cba0935d admin admin] PATH_INFO: `/v3/users/3f4398de3cfd4b15a6f6961e72fed46d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:10.220023 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc0516-83ae-4dfb-9a5f-3950cba0935d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f4398de3cfd4b15a6f6961e72fed46d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:10.221948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc0516-83ae-4dfb-9a5f-3950cba0935d admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:10.268092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-00fc0516-83ae-4dfb-9a5f-3950cba0935d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f4398de3cfd4b15a6f6961e72fed46d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.275821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-00fc0516-83ae-4dfb-9a5f-3950cba0935d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f4398de3cfd4b15a6f6961e72fed46d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.276483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-00fc0516-83ae-4dfb-9a5f-3950cba0935d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f4398de3cfd4b15a6f6961e72fed46d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.288321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-00fc0516-83ae-4dfb-9a5f-3950cba0935d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f4398de3cfd4b15a6f6961e72fed46d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.289709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-00fc0516-83ae-4dfb-9a5f-3950cba0935d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f4398de3cfd4b15a6f6961e72fed46d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.302213 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4404/8795] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:43:10 2022] DELETE /identity/v3/users/3f4398de3cfd4b15a6f6961e72fed46d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:43:10.583558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:10.585042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:10.605385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae0e36-fc55-43df-957f-bdcec8110d6c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:10.662633 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670f174-9f54-4d40-a19b-6861dae3f170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:10.663289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670f174-9f54-4d40-a19b-6861dae3f170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:10.663565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670f174-9f54-4d40-a19b-6861dae3f170 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:10.664000 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670f174-9f54-4d40-a19b-6861dae3f170 admin admin] PATH_INFO: `/v3/projects/0a27a221aee943518f7f6b19f4a87413` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:10.665200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670f174-9f54-4d40-a19b-6861dae3f170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a27a221aee943518f7f6b19f4a87413)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:10.667136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670f174-9f54-4d40-a19b-6861dae3f170 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:10.714835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d670f174-9f54-4d40-a19b-6861dae3f170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a27a221aee943518f7f6b19f4a87413', 'request_id': 'req-d670f174-9f54-4d40-a19b-6861dae3f170'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.720415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d670f174-9f54-4d40-a19b-6861dae3f170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a27a221aee943518f7f6b19f4a87413', 'request_id': 'req-d670f174-9f54-4d40-a19b-6861dae3f170'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.726502 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d670f174-9f54-4d40-a19b-6861dae3f170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a27a221aee943518f7f6b19f4a87413', 'request_id': 'req-d670f174-9f54-4d40-a19b-6861dae3f170'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.739832 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d670f174-9f54-4d40-a19b-6861dae3f170 admin admin] The token cache is being invalidate because project 0a27a221aee943518f7f6b19f4a87413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:43:10.740175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d670f174-9f54-4d40-a19b-6861dae3f170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.740882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d670f174-9f54-4d40-a19b-6861dae3f170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:43:10.742601 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4392/8796] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:43:10 2022] DELETE /identity/v3/projects/0a27a221aee943518f7f6b19f4a87413 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:43:10.748899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6228-9226-4df4-838c-2d6a4b7787e6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:10.749381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6228-9226-4df4-838c-2d6a4b7787e6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:10.749500 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6228-9226-4df4-838c-2d6a4b7787e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:10.769742 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0cff6228-9226-4df4-838c-2d6a4b7787e6 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:10.771316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0cff6228-9226-4df4-838c-2d6a4b7787e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:10.830179 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4405/8797] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:43:10.839611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de77b6-3309-432e-a298-2f47095e8471 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:10.839905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de77b6-3309-432e-a298-2f47095e8471 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:10.840185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de77b6-3309-432e-a298-2f47095e8471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:10.859910 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e9de77b6-3309-432e-a298-2f47095e8471 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:10.861113 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e9de77b6-3309-432e-a298-2f47095e8471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:10.869615 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4393/8798] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:10.873829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6228-9226-4df4-838c-2d6a4b7787e6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:10.884370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6228-9226-4df4-838c-2d6a4b7787e6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:10.889278 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4860c5e-02d8-4427-ba8d-f72aa71d2737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:10.889881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4860c5e-02d8-4427-ba8d-f72aa71d2737 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:10.890166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4860c5e-02d8-4427-ba8d-f72aa71d2737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:10.890442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4860c5e-02d8-4427-ba8d-f72aa71d2737 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:10.891121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4860c5e-02d8-4427-ba8d-f72aa71d2737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:43:10.891424 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4860c5e-02d8-4427-ba8d-f72aa71d2737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:10.893063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4860c5e-02d8-4427-ba8d-f72aa71d2737 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:10.904666 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4406/8799] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:43:10.910007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de77b6-3309-432e-a298-2f47095e8471 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:10.919594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de77b6-3309-432e-a298-2f47095e8471 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:10.924379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a6ea9-503d-4586-84d4-2338495828bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:10.924975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a6ea9-503d-4586-84d4-2338495828bb admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:10.925258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a6ea9-503d-4586-84d4-2338495828bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:10.925530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a6ea9-503d-4586-84d4-2338495828bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:10.926190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a6ea9-503d-4586-84d4-2338495828bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:10.928138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a6ea9-503d-4586-84d4-2338495828bb admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:10.956615 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4394/8800] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:43:10 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:43:10.960878 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4860c5e-02d8-4427-ba8d-f72aa71d2737 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:10.971131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4860c5e-02d8-4427-ba8d-f72aa71d2737 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:11.000996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:11.030617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fa3d8-1d7e-4e54-ab60-731bc82dcf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:11.031327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fa3d8-1d7e-4e54-ab60-731bc82dcf6c admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:11.031613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fa3d8-1d7e-4e54-ab60-731bc82dcf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:11.031891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fa3d8-1d7e-4e54-ab60-731bc82dcf6c admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:11.032509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fa3d8-1d7e-4e54-ab60-731bc82dcf6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:11.034414 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fa3d8-1d7e-4e54-ab60-731bc82dcf6c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:11.055672 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4407/8801] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:43:10 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:43:11.059651 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a6ea9-503d-4586-84d4-2338495828bb admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:11.071183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a6ea9-503d-4586-84d4-2338495828bb admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:11.075794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190f9dd-1838-4118-bb72-f92234046c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:11.076389 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190f9dd-1838-4118-bb72-f92234046c8e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:11.076672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190f9dd-1838-4118-bb72-f92234046c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:11.076947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190f9dd-1838-4118-bb72-f92234046c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:11.077589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190f9dd-1838-4118-bb72-f92234046c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:11.079214 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190f9dd-1838-4118-bb72-f92234046c8e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:11.089459 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4395/8802] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:43:11.093296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fa3d8-1d7e-4e54-ab60-731bc82dcf6c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:11.103731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fa3d8-1d7e-4e54-ab60-731bc82dcf6c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:11.108288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e69a52-84e9-427d-815f-b398dc983a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:11.108892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e69a52-84e9-427d-815f-b398dc983a5c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:11.109179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e69a52-84e9-427d-815f-b398dc983a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:11.109561 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e69a52-84e9-427d-815f-b398dc983a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:11.110100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e69a52-84e9-427d-815f-b398dc983a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:11.111734 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e69a52-84e9-427d-815f-b398dc983a5c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:11.122980 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4408/8803] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:43:11.127128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190f9dd-1838-4118-bb72-f92234046c8e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:11.138201 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190f9dd-1838-4118-bb72-f92234046c8e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:11.142937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c9328-0829-443f-8c96-8b36fb90fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:11.143582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c9328-0829-443f-8c96-8b36fb90fc91 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:11.143894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c9328-0829-443f-8c96-8b36fb90fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:11.144177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c9328-0829-443f-8c96-8b36fb90fc91 admin admin] PATH_INFO: `/v3/projects/44b14d60c0c540b0990467098b99734b/users/f478b6f84efd4d2aa238f9b7b6426de3/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:11.158830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c9328-0829-443f-8c96-8b36fb90fc91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b14d60c0c540b0990467098b99734b, user_id=f478b6f84efd4d2aa238f9b7b6426de3, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:11.161490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c9328-0829-443f-8c96-8b36fb90fc91 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:11.170911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:11.176248 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4396/8804] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:43:11 2022] PUT /identity/v3/projects/44b14d60c0c540b0990467098b99734b/users/f478b6f84efd4d2aa238f9b7b6426de3/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:43:11.181899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96192574-9984-4eec-8bf7-ae162c0c4250 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:11.182193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96192574-9984-4eec-8bf7-ae162c0c4250 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:11.182472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96192574-9984-4eec-8bf7-ae162c0c4250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:11.201648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-96192574-9984-4eec-8bf7-ae162c0c4250 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:11.202890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-96192574-9984-4eec-8bf7-ae162c0c4250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:11.262831 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4409/8805] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:11.272534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c9328-0829-443f-8c96-8b36fb90fc91 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:11.274522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cc7c9328-0829-443f-8c96-8b36fb90fc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:11.333138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c9328-0829-443f-8c96-8b36fb90fc91 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:11.337081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bc440-f2eb-491c-afe7-777665e395da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:11.337690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc440-f2eb-491c-afe7-777665e395da service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:11.337975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc440-f2eb-491c-afe7-777665e395da service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:11.338257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc440-f2eb-491c-afe7-777665e395da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:11.347496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bc440-f2eb-491c-afe7-777665e395da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:11.348850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bc440-f2eb-491c-afe7-777665e395da service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:11.359551 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4397/8806] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:15.472115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0936dc0-9445-4f33-8eaf-a22d829cbbbe None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:15.472700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0936dc0-9445-4f33-8eaf-a22d829cbbbe None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:15.472700 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0936dc0-9445-4f33-8eaf-a22d829cbbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:15.507668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d0936dc0-9445-4f33-8eaf-a22d829cbbbe None None] MFA Rules not processed for user `f478b6f84efd4d2aa238f9b7b6426de3`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:15.509160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d0936dc0-9445-4f33-8eaf-a22d829cbbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:15.597212 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4410/8807] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:43:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:15.610307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f6a62-d6c9-40c2-b214-56bfdd40a06c None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:15.610958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f6a62-d6c9-40c2-b214-56bfdd40a06c None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:15.611103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f6a62-d6c9-40c2-b214-56bfdd40a06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:15.632603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c61f6a62-d6c9-40c2-b214-56bfdd40a06c None None] MFA Rules not processed for user `f478b6f84efd4d2aa238f9b7b6426de3`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:15.634001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c61f6a62-d6c9-40c2-b214-56bfdd40a06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:15.647713 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4398/8808] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:43:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:15.659345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0936dc0-9445-4f33-8eaf-a22d829cbbbe None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:15.661019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d0936dc0-9445-4f33-8eaf-a22d829cbbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:15.716832 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:15.759977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0936dc0-9445-4f33-8eaf-a22d829cbbbe None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:15.766569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a3c36-ed9e-44e8-be38-15bf228b330a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:15.767242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a3c36-ed9e-44e8-be38-15bf228b330a service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:15.767522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a3c36-ed9e-44e8-be38-15bf228b330a service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:15.767793 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a3c36-ed9e-44e8-be38-15bf228b330a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:15.777211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a3c36-ed9e-44e8-be38-15bf228b330a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:15.778867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a3c36-ed9e-44e8-be38-15bf228b330a service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:15.794989 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4411/8809] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:18.212082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f6a62-d6c9-40c2-b214-56bfdd40a06c None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:18.222826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f6a62-d6c9-40c2-b214-56bfdd40a06c None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:18.233134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dde31c-0373-42c0-9b1d-5b5b499e9054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:18.233777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dde31c-0373-42c0-9b1d-5b5b499e9054 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:18.234056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dde31c-0373-42c0-9b1d-5b5b499e9054 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:18.234332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dde31c-0373-42c0-9b1d-5b5b499e9054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:18.236425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d2dde31c-0373-42c0-9b1d-5b5b499e9054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:18.250894 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dde31c-0373-42c0-9b1d-5b5b499e9054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:18.252409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dde31c-0373-42c0-9b1d-5b5b499e9054 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:18.265027 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4399/8810] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:25.786600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=15 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:26.480334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a3c36-ed9e-44e8-be38-15bf228b330a service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:26.481936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-649a3c36-ed9e-44e8-be38-15bf228b330a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:26.495695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a3c36-ed9e-44e8-be38-15bf228b330a service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:26.499416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce47d66-3942-43ed-90e5-4e7a8e6d0655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:26.500025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce47d66-3942-43ed-90e5-4e7a8e6d0655 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:26.500308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce47d66-3942-43ed-90e5-4e7a8e6d0655 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:26.500584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce47d66-3942-43ed-90e5-4e7a8e6d0655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:26.502327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bce47d66-3942-43ed-90e5-4e7a8e6d0655 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:26.515373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce47d66-3942-43ed-90e5-4e7a8e6d0655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:26.516805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce47d66-3942-43ed-90e5-4e7a8e6d0655 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:26.528314 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4412/8811] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:26.609999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d4cd0-b054-4bf8-9172-8899de591191 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:26.610547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d4cd0-b054-4bf8-9172-8899de591191 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:26.610547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d4cd0-b054-4bf8-9172-8899de591191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:26.630237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-207d4cd0-b054-4bf8-9172-8899de591191 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:43:26.631469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-207d4cd0-b054-4bf8-9172-8899de591191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:26.697065 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4400/8812] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 19:43:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:43:26.710211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce47d66-3942-43ed-90e5-4e7a8e6d0655 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:26.711796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bce47d66-3942-43ed-90e5-4e7a8e6d0655 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:26.729491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce47d66-3942-43ed-90e5-4e7a8e6d0655 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:26.734791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd73e7-c2e5-45a6-acb6-f501508e69a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:26.735405 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd73e7-c2e5-45a6-acb6-f501508e69a4 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:26.735691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd73e7-c2e5-45a6-acb6-f501508e69a4 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:26.735971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd73e7-c2e5-45a6-acb6-f501508e69a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:26.745733 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd73e7-c2e5-45a6-acb6-f501508e69a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:26.747404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd73e7-c2e5-45a6-acb6-f501508e69a4 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:26.759491 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4413/8813] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:26.935078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d4cd0-b054-4bf8-9172-8899de591191 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:26.944446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d4cd0-b054-4bf8-9172-8899de591191 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:26.948970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27d74d-85ed-42e0-a482-f6290f266a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:26.949514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27d74d-85ed-42e0-a482-f6290f266a57 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:26.949830 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27d74d-85ed-42e0-a482-f6290f266a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:26.950107 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27d74d-85ed-42e0-a482-f6290f266a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:26.951873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9d27d74d-85ed-42e0-a482-f6290f266a57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:26.967942 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27d74d-85ed-42e0-a482-f6290f266a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:26.969368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27d74d-85ed-42e0-a482-f6290f266a57 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:26.983273 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4401/8814] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:43:36.754121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=12 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:36.975626 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=70 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:43:55.271541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd73e7-c2e5-45a6-acb6-f501508e69a4 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:43:55.283453 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd73e7-c2e5-45a6-acb6-f501508e69a4 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:43:55.287029 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d0626-8335-40f1-86f9-549d4d1b9054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:43:55.287626 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0626-8335-40f1-86f9-549d4d1b9054 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:43:55.287906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0626-8335-40f1-86f9-549d4d1b9054 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:43:55.288879 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0626-8335-40f1-86f9-549d4d1b9054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:43:55.290908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f85d0626-8335-40f1-86f9-549d4d1b9054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:43:55.303315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d0626-8335-40f1-86f9-549d4d1b9054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:43:55.304837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d0626-8335-40f1-86f9-549d4d1b9054 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:43:55.315409 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4414/8815] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:43:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:05.309297 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:08.326149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27d74d-85ed-42e0-a482-f6290f266a57 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:08.340374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27d74d-85ed-42e0-a482-f6290f266a57 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:08.345503 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3d2cd-0f7c-4509-9418-a3d6b1924e62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:08.346796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3d2cd-0f7c-4509-9418-a3d6b1924e62 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:08.347091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3d2cd-0f7c-4509-9418-a3d6b1924e62 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:08.347368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3d2cd-0f7c-4509-9418-a3d6b1924e62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:08.349114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a9a3d2cd-0f7c-4509-9418-a3d6b1924e62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:08.365131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3d2cd-0f7c-4509-9418-a3d6b1924e62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:08.367421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3d2cd-0f7c-4509-9418-a3d6b1924e62 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:08.381953 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4402/8816] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:08.392788 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d0626-8335-40f1-86f9-549d4d1b9054 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:08.404984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d0626-8335-40f1-86f9-549d4d1b9054 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:08.409972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996c493-4d88-40df-a9ff-5bb7205a1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:08.410702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996c493-4d88-40df-a9ff-5bb7205a1ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:08.411117 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996c493-4d88-40df-a9ff-5bb7205a1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:08.411524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996c493-4d88-40df-a9ff-5bb7205a1ac1 admin admin] PATH_INFO: `/v3/users/f478b6f84efd4d2aa238f9b7b6426de3` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:08.413560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996c493-4d88-40df-a9ff-5bb7205a1ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f478b6f84efd4d2aa238f9b7b6426de3)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:08.415651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996c493-4d88-40df-a9ff-5bb7205a1ac1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:08.473328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a996c493-4d88-40df-a9ff-5bb7205a1ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f478b6f84efd4d2aa238f9b7b6426de3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:44:08.481228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a996c493-4d88-40df-a9ff-5bb7205a1ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f478b6f84efd4d2aa238f9b7b6426de3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:44:08.482078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a996c493-4d88-40df-a9ff-5bb7205a1ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f478b6f84efd4d2aa238f9b7b6426de3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:44:08.494535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a996c493-4d88-40df-a9ff-5bb7205a1ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f478b6f84efd4d2aa238f9b7b6426de3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:44:08.495207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-a996c493-4d88-40df-a9ff-5bb7205a1ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f478b6f84efd4d2aa238f9b7b6426de3'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:44:08.508400 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4415/8817] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:44:08 2022] DELETE /identity/v3/users/f478b6f84efd4d2aa238f9b7b6426de3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:44:08.682881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3d2cd-0f7c-4509-9418-a3d6b1924e62 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:08.693655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3d2cd-0f7c-4509-9418-a3d6b1924e62 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:08.751083 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:08.751715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:08.752002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:08.752282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92 admin admin] PATH_INFO: `/v3/projects/44b14d60c0c540b0990467098b99734b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:08.753406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b14d60c0c540b0990467098b99734b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:08.755363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:08.801865 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b14d60c0c540b0990467098b99734b', 'request_id': 'req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:44:08.808351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b14d60c0c540b0990467098b99734b', 'request_id': 'req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:44:08.814520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b14d60c0c540b0990467098b99734b', 'request_id': 'req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:44:08.827655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92 admin admin] The token cache is being invalidate because project 44b14d60c0c540b0990467098b99734b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:44:08.827943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:44:08.828563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-4e18675e-2f88-4093-a2fc-84a3ce6ddb92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:44:08.830072 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4403/8818] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:44:08 2022] DELETE /identity/v3/projects/44b14d60c0c540b0990467098b99734b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:44:08.835943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413d5e8-13b8-4930-b78a-472e8b06a8fc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:08.836163 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413d5e8-13b8-4930-b78a-472e8b06a8fc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:08.836434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413d5e8-13b8-4930-b78a-472e8b06a8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:08.856320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c413d5e8-13b8-4930-b78a-472e8b06a8fc None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:08.857511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c413d5e8-13b8-4930-b78a-472e8b06a8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:08.918458 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4416/8819] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:08.927952 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e086b88-6f82-4a1b-84de-6a16b3eca1ff None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:08.928243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e086b88-6f82-4a1b-84de-6a16b3eca1ff None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:08.929076 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e086b88-6f82-4a1b-84de-6a16b3eca1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:08.949589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1e086b88-6f82-4a1b-84de-6a16b3eca1ff None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:08.950819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1e086b88-6f82-4a1b-84de-6a16b3eca1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:08.959047 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4404/8820] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:08.963347 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413d5e8-13b8-4930-b78a-472e8b06a8fc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:08.973196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413d5e8-13b8-4930-b78a-472e8b06a8fc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:08.977998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d921e5-fc31-4736-b813-446c99480c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:08.978600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d921e5-fc31-4736-b813-446c99480c94 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:08.978923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d921e5-fc31-4736-b813-446c99480c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:08.979199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d921e5-fc31-4736-b813-446c99480c94 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:08.979843 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d921e5-fc31-4736-b813-446c99480c94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:44:08.980148 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d921e5-fc31-4736-b813-446c99480c94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:08.981752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d921e5-fc31-4736-b813-446c99480c94 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:08.993893 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4417/8821] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:44:08.998145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e086b88-6f82-4a1b-84de-6a16b3eca1ff None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:09.008181 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e086b88-6f82-4a1b-84de-6a16b3eca1ff None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:09.013243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbaa636-0986-4508-bb1a-5dba976ff79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:09.013835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaa636-0986-4508-bb1a-5dba976ff79a admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:09.014119 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaa636-0986-4508-bb1a-5dba976ff79a admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:09.014396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaa636-0986-4508-bb1a-5dba976ff79a admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:09.015164 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbaa636-0986-4508-bb1a-5dba976ff79a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:09.017099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbaa636-0986-4508-bb1a-5dba976ff79a admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:09.045390 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4405/8822] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:44:08 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:44:09.049681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d921e5-fc31-4736-b813-446c99480c94 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:09.060476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d921e5-fc31-4736-b813-446c99480c94 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:09.117127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7d127-f5d4-4833-87a8-e09badce94bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:09.117653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7d127-f5d4-4833-87a8-e09badce94bd admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:09.117943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7d127-f5d4-4833-87a8-e09badce94bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:09.118212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7d127-f5d4-4833-87a8-e09badce94bd admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:09.118871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7d127-f5d4-4833-87a8-e09badce94bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:09.120803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7d127-f5d4-4833-87a8-e09badce94bd admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:09.128687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:09.143565 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4418/8823] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:44:09 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:44:09.147887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbaa636-0986-4508-bb1a-5dba976ff79a admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:09.158448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbaa636-0986-4508-bb1a-5dba976ff79a admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:09.164090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd49255-f3ba-4b97-b66c-0333e3a2589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:09.164690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd49255-f3ba-4b97-b66c-0333e3a2589b admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:09.164971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd49255-f3ba-4b97-b66c-0333e3a2589b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:09.165243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd49255-f3ba-4b97-b66c-0333e3a2589b admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:09.165879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd49255-f3ba-4b97-b66c-0333e3a2589b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:09.167514 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd49255-f3ba-4b97-b66c-0333e3a2589b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:09.177248 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4406/8824] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:44:09.181883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7d127-f5d4-4833-87a8-e09badce94bd admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:09.191973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7d127-f5d4-4833-87a8-e09badce94bd admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:09.196651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8bd4c-ff79-4c97-b445-dcb585c9fbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:09.197248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8bd4c-ff79-4c97-b445-dcb585c9fbff admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:09.197534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8bd4c-ff79-4c97-b445-dcb585c9fbff admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:09.197811 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8bd4c-ff79-4c97-b445-dcb585c9fbff admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:09.198442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8bd4c-ff79-4c97-b445-dcb585c9fbff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:09.200107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8bd4c-ff79-4c97-b445-dcb585c9fbff admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:09.211053 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4419/8825] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:44:09.215368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd49255-f3ba-4b97-b66c-0333e3a2589b admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:09.226501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd49255-f3ba-4b97-b66c-0333e3a2589b admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:09.232026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e1225-88d9-4ba4-b67c-a673e1c742da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:09.232725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e1225-88d9-4ba4-b67c-a673e1c742da admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:09.233055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e1225-88d9-4ba4-b67c-a673e1c742da admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:09.233370 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e1225-88d9-4ba4-b67c-a673e1c742da admin admin] PATH_INFO: `/v3/projects/faf190307db14e718f9aa3e725708f46/users/66425e20cf7040deb9538bacf257a1b0/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:09.248916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e1225-88d9-4ba4-b67c-a673e1c742da admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf190307db14e718f9aa3e725708f46, user_id=66425e20cf7040deb9538bacf257a1b0, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:09.251650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e1225-88d9-4ba4-b67c-a673e1c742da admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:09.264954 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4407/8826] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:44:09 2022] PUT /identity/v3/projects/faf190307db14e718f9aa3e725708f46/users/66425e20cf7040deb9538bacf257a1b0/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:44:09.270180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096ea15-d968-4ca6-b110-f58d2ae08bb2 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:09.270493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096ea15-d968-4ca6-b110-f58d2ae08bb2 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:09.270795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096ea15-d968-4ca6-b110-f58d2ae08bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:09.290332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d096ea15-d968-4ca6-b110-f58d2ae08bb2 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:09.291574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d096ea15-d968-4ca6-b110-f58d2ae08bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:09.354334 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4420/8827] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:09.364376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e1225-88d9-4ba4-b67c-a673e1c742da admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:09.367212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a13e1225-88d9-4ba4-b67c-a673e1c742da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:09.382189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:09.429493 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e1225-88d9-4ba4-b67c-a673e1c742da admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:09.433265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd702e43-52b1-4e42-83c8-278f4ed9cfd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:09.433870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd702e43-52b1-4e42-83c8-278f4ed9cfd4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:09.434154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd702e43-52b1-4e42-83c8-278f4ed9cfd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:09.434431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd702e43-52b1-4e42-83c8-278f4ed9cfd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:09.443470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd702e43-52b1-4e42-83c8-278f4ed9cfd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:09.445099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd702e43-52b1-4e42-83c8-278f4ed9cfd4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:09.454592 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4408/8828] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:13.211193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503353b-8927-4cf7-8fa9-f78848796912 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:13.211701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503353b-8927-4cf7-8fa9-f78848796912 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:13.211856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503353b-8927-4cf7-8fa9-f78848796912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:13.240040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-f503353b-8927-4cf7-8fa9-f78848796912 None None] MFA Rules not processed for user `66425e20cf7040deb9538bacf257a1b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:13.241954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f503353b-8927-4cf7-8fa9-f78848796912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:13.318649 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4421/8829] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:44:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:44:13.330337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def96458-52a6-42e3-9e51-c02d215d48b5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:13.330892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def96458-52a6-42e3-9e51-c02d215d48b5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:13.331137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def96458-52a6-42e3-9e51-c02d215d48b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:13.351654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-def96458-52a6-42e3-9e51-c02d215d48b5 None None] MFA Rules not processed for user `66425e20cf7040deb9538bacf257a1b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:44:13.353102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-def96458-52a6-42e3-9e51-c02d215d48b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:13.360897 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4409/8830] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:44:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:44:13.373150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503353b-8927-4cf7-8fa9-f78848796912 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:13.375097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f503353b-8927-4cf7-8fa9-f78848796912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:13.472320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503353b-8927-4cf7-8fa9-f78848796912 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:13.486985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6c911-538a-4b86-b077-e4a739b95867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:13.488178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6c911-538a-4b86-b077-e4a739b95867 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:13.488302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6c911-538a-4b86-b077-e4a739b95867 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:13.488544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6c911-538a-4b86-b077-e4a739b95867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:13.508230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:13.514184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6c911-538a-4b86-b077-e4a739b95867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:13.517007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6c911-538a-4b86-b077-e4a739b95867 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:13.534597 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4422/8831] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:23.345752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=23 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:23.527381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:44:52.370398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def96458-52a6-42e3-9e51-c02d215d48b5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:52.389278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def96458-52a6-42e3-9e51-c02d215d48b5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:52.394916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b5b14-7995-46bd-9477-530784ead1ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:52.395526 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b5b14-7995-46bd-9477-530784ead1ec service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:52.395814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b5b14-7995-46bd-9477-530784ead1ec service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:52.396090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b5b14-7995-46bd-9477-530784ead1ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:52.397825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-776b5b14-7995-46bd-9477-530784ead1ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:52.413522 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b5b14-7995-46bd-9477-530784ead1ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:52.415646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b5b14-7995-46bd-9477-530784ead1ec service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:52.430544 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4410/8832] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:44:59.683703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6c911-538a-4b86-b077-e4a739b95867 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:44:59.685523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-18d6c911-538a-4b86-b077-e4a739b95867 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:59.705223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6c911-538a-4b86-b077-e4a739b95867 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:44:59.710983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b5234-dc4c-40e2-aa5b-e86ab5a01b58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:44:59.711862 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b5234-dc4c-40e2-aa5b-e86ab5a01b58 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:44:59.712215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b5234-dc4c-40e2-aa5b-e86ab5a01b58 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:44:59.712571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b5234-dc4c-40e2-aa5b-e86ab5a01b58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:44:59.714446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b69b5234-dc4c-40e2-aa5b-e86ab5a01b58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:44:59.732429 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b5234-dc4c-40e2-aa5b-e86ab5a01b58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:44:59.733560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b5234-dc4c-40e2-aa5b-e86ab5a01b58 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:44:59.755545 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4423/8833] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:44:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:00.174234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a31859-7331-431c-8b9f-faa46b6f13af None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:00.174801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a31859-7331-431c-8b9f-faa46b6f13af None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:00.174902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a31859-7331-431c-8b9f-faa46b6f13af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:00.194225 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-52a31859-7331-431c-8b9f-faa46b6f13af None None] MFA Rules not processed for user `66425e20cf7040deb9538bacf257a1b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:00.195518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-52a31859-7331-431c-8b9f-faa46b6f13af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:00.202366 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4411/8834] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:45:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:03.325349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b5234-dc4c-40e2-aa5b-e86ab5a01b58 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:03.342144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b5234-dc4c-40e2-aa5b-e86ab5a01b58 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:03.350252 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e98ab-56a3-4f8f-80c9-f6405b810191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:03.350995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e98ab-56a3-4f8f-80c9-f6405b810191 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:03.351880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e98ab-56a3-4f8f-80c9-f6405b810191 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:03.352225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e98ab-56a3-4f8f-80c9-f6405b810191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:03.354408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ec9e98ab-56a3-4f8f-80c9-f6405b810191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:03.370807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e98ab-56a3-4f8f-80c9-f6405b810191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:03.372412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e98ab-56a3-4f8f-80c9-f6405b810191 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:03.394691 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4424/8835] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:10.189558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=9 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:10.837837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a31859-7331-431c-8b9f-faa46b6f13af None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:10.839260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-52a31859-7331-431c-8b9f-faa46b6f13af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:10.913150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a31859-7331-431c-8b9f-faa46b6f13af None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:10.918521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca24a2-3d35-43c1-97f6-0332750577fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:10.919188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca24a2-3d35-43c1-97f6-0332750577fa service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:10.919474 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca24a2-3d35-43c1-97f6-0332750577fa service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:10.919749 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca24a2-3d35-43c1-97f6-0332750577fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:10.921447 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9aca24a2-3d35-43c1-97f6-0332750577fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:10.935817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca24a2-3d35-43c1-97f6-0332750577fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:10.937425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca24a2-3d35-43c1-97f6-0332750577fa service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:10.950946 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4412/8836] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:12.656882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e98ab-56a3-4f8f-80c9-f6405b810191 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:12.658819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ec9e98ab-56a3-4f8f-80c9-f6405b810191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:12.676661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e98ab-56a3-4f8f-80c9-f6405b810191 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:12.682346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dca02-7c51-4bb7-a865-e141068f82d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:12.683000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dca02-7c51-4bb7-a865-e141068f82d7 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:12.683284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dca02-7c51-4bb7-a865-e141068f82d7 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:12.683562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dca02-7c51-4bb7-a865-e141068f82d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:12.685303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7d6dca02-7c51-4bb7-a865-e141068f82d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:12.701295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dca02-7c51-4bb7-a865-e141068f82d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:12.702930 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dca02-7c51-4bb7-a865-e141068f82d7 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:12.716559 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4425/8837] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:20.943212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=32 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:22.708943 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=18 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:53.191917 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca24a2-3d35-43c1-97f6-0332750577fa service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:53.219940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca24a2-3d35-43c1-97f6-0332750577fa service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:53.224785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e3cbe-cd81-4346-a516-f66b48494946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:53.225550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e3cbe-cd81-4346-a516-f66b48494946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:53.226536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e3cbe-cd81-4346-a516-f66b48494946 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:53.227014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e3cbe-cd81-4346-a516-f66b48494946 admin admin] PATH_INFO: `/v3/users/66425e20cf7040deb9538bacf257a1b0` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:53.228363 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e3cbe-cd81-4346-a516-f66b48494946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66425e20cf7040deb9538bacf257a1b0)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:53.230296 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e3cbe-cd81-4346-a516-f66b48494946 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:53.278839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a94e3cbe-cd81-4346-a516-f66b48494946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66425e20cf7040deb9538bacf257a1b0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:45:53.285716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a94e3cbe-cd81-4346-a516-f66b48494946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66425e20cf7040deb9538bacf257a1b0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:45:53.286380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a94e3cbe-cd81-4346-a516-f66b48494946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66425e20cf7040deb9538bacf257a1b0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:45:53.293978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a94e3cbe-cd81-4346-a516-f66b48494946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66425e20cf7040deb9538bacf257a1b0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:45:53.294586 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-a94e3cbe-cd81-4346-a516-f66b48494946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66425e20cf7040deb9538bacf257a1b0'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:45:53.312361 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4413/8838] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:45:53 2022] DELETE /identity/v3/users/66425e20cf7040deb9538bacf257a1b0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:45:53.488187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dca02-7c51-4bb7-a865-e141068f82d7 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:53.509038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dca02-7c51-4bb7-a865-e141068f82d7 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:53.571520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda3d02-33c5-4828-a3fa-5a9758de28e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:53.572093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda3d02-33c5-4828-a3fa-5a9758de28e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:53.572376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda3d02-33c5-4828-a3fa-5a9758de28e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:53.572651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda3d02-33c5-4828-a3fa-5a9758de28e1 admin admin] PATH_INFO: `/v3/projects/faf190307db14e718f9aa3e725708f46` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:53.573826 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda3d02-33c5-4828-a3fa-5a9758de28e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf190307db14e718f9aa3e725708f46)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:53.575881 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda3d02-33c5-4828-a3fa-5a9758de28e1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:53.623725 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fcda3d02-33c5-4828-a3fa-5a9758de28e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf190307db14e718f9aa3e725708f46', 'request_id': 'req-fcda3d02-33c5-4828-a3fa-5a9758de28e1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:45:53.630754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fcda3d02-33c5-4828-a3fa-5a9758de28e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf190307db14e718f9aa3e725708f46', 'request_id': 'req-fcda3d02-33c5-4828-a3fa-5a9758de28e1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:45:53.636354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fcda3d02-33c5-4828-a3fa-5a9758de28e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf190307db14e718f9aa3e725708f46', 'request_id': 'req-fcda3d02-33c5-4828-a3fa-5a9758de28e1'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:45:53.647529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fcda3d02-33c5-4828-a3fa-5a9758de28e1 admin admin] The token cache is being invalidate because project faf190307db14e718f9aa3e725708f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:45:53.648314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fcda3d02-33c5-4828-a3fa-5a9758de28e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:45:53.649118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-fcda3d02-33c5-4828-a3fa-5a9758de28e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:45:53.650555 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4426/8839] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:45:53 2022] DELETE /identity/v3/projects/faf190307db14e718f9aa3e725708f46 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:45:53.655607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37893795-6378-41fd-8dd4-5b4642a34430 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:53.655896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37893795-6378-41fd-8dd4-5b4642a34430 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:53.656174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37893795-6378-41fd-8dd4-5b4642a34430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:53.676305 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-37893795-6378-41fd-8dd4-5b4642a34430 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:53.677497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-37893795-6378-41fd-8dd4-5b4642a34430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:53.736273 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4414/8840] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:53.745200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1b8a6-0704-4527-abdb-cdbb50234f5d None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:53.745488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1b8a6-0704-4527-abdb-cdbb50234f5d None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:53.745767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1b8a6-0704-4527-abdb-cdbb50234f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:53.765525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-83a1b8a6-0704-4527-abdb-cdbb50234f5d None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:53.766767 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-83a1b8a6-0704-4527-abdb-cdbb50234f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:53.775956 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4427/8841] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:53.780234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37893795-6378-41fd-8dd4-5b4642a34430 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:53.790987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37893795-6378-41fd-8dd4-5b4642a34430 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:53.795558 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c81fa-4fb3-4ad6-9e00-633efad776d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:53.796154 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c81fa-4fb3-4ad6-9e00-633efad776d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:53.796438 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c81fa-4fb3-4ad6-9e00-633efad776d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:53.796715 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c81fa-4fb3-4ad6-9e00-633efad776d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:53.797362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c81fa-4fb3-4ad6-9e00-633efad776d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:45:53.797669 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c81fa-4fb3-4ad6-9e00-633efad776d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:53.799294 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c81fa-4fb3-4ad6-9e00-633efad776d1 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:53.811182 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4415/8842] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:45:53.815636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1b8a6-0704-4527-abdb-cdbb50234f5d None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:53.825517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1b8a6-0704-4527-abdb-cdbb50234f5d None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:53.830161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925795-0140-4788-aaf5-f690db75f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:53.830798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925795-0140-4788-aaf5-f690db75f159 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:53.831088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925795-0140-4788-aaf5-f690db75f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:53.831371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9925795-0140-4788-aaf5-f690db75f159 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:53.832043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9925795-0140-4788-aaf5-f690db75f159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:53.833951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9925795-0140-4788-aaf5-f690db75f159 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:53.863502 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4428/8843] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:45:53 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:45:53.867788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c81fa-4fb3-4ad6-9e00-633efad776d1 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:53.878431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c81fa-4fb3-4ad6-9e00-633efad776d1 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:53.928921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:53.940257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799643c-69cc-49e2-9fa8-f1d23f170b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:53.940870 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799643c-69cc-49e2-9fa8-f1d23f170b37 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:53.941153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799643c-69cc-49e2-9fa8-f1d23f170b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:53.941430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799643c-69cc-49e2-9fa8-f1d23f170b37 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:53.942058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799643c-69cc-49e2-9fa8-f1d23f170b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:53.944026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799643c-69cc-49e2-9fa8-f1d23f170b37 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:53.965459 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4416/8844] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:45:53 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:45:53.969589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925795-0140-4788-aaf5-f690db75f159 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:53.980249 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9925795-0140-4788-aaf5-f690db75f159 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:53.984900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e8304-5bf5-4b55-a506-ab027b19c734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:53.985509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e8304-5bf5-4b55-a506-ab027b19c734 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:53.985796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e8304-5bf5-4b55-a506-ab027b19c734 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:53.986078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e8304-5bf5-4b55-a506-ab027b19c734 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:53.986785 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e8304-5bf5-4b55-a506-ab027b19c734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:53.988374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e8304-5bf5-4b55-a506-ab027b19c734 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:53.998851 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4429/8845] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:45:54.003004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799643c-69cc-49e2-9fa8-f1d23f170b37 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:54.013797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799643c-69cc-49e2-9fa8-f1d23f170b37 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:54.018444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995839dd-731e-4535-be6b-b1e220d73223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:54.019074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995839dd-731e-4535-be6b-b1e220d73223 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:54.019357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995839dd-731e-4535-be6b-b1e220d73223 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:54.019630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995839dd-731e-4535-be6b-b1e220d73223 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:54.020263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995839dd-731e-4535-be6b-b1e220d73223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:54.021837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995839dd-731e-4535-be6b-b1e220d73223 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:54.033405 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4417/8846] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:45:54.037792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e8304-5bf5-4b55-a506-ab027b19c734 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:54.048731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e8304-5bf5-4b55-a506-ab027b19c734 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:54.053548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a576b-fbe4-4796-86cb-d777d34e011c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:54.054298 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a576b-fbe4-4796-86cb-d777d34e011c admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:54.055205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a576b-fbe4-4796-86cb-d777d34e011c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:54.055484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a576b-fbe4-4796-86cb-d777d34e011c admin admin] PATH_INFO: `/v3/projects/5ea3e2df331f4884b0ca9ff66cbbdbd2/users/35567d70af874c3bb4bc6262e53e5216/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:54.070525 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a576b-fbe4-4796-86cb-d777d34e011c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea3e2df331f4884b0ca9ff66cbbdbd2, user_id=35567d70af874c3bb4bc6262e53e5216, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:54.073238 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a576b-fbe4-4796-86cb-d777d34e011c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:54.086712 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4430/8847] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:45:54 2022] PUT /identity/v3/projects/5ea3e2df331f4884b0ca9ff66cbbdbd2/users/35567d70af874c3bb4bc6262e53e5216/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:45:54.091860 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d644f-1691-410e-a14a-f1d253154eb9 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:54.092183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d644f-1691-410e-a14a-f1d253154eb9 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:54.092498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d644f-1691-410e-a14a-f1d253154eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:54.111587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-8b1d644f-1691-410e-a14a-f1d253154eb9 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:54.112800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8b1d644f-1691-410e-a14a-f1d253154eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:54.176348 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4418/8848] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:54.186070 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a576b-fbe4-4796-86cb-d777d34e011c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:54.187795 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-269a576b-fbe4-4796-86cb-d777d34e011c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:54.219043 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:45:54.258712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a576b-fbe4-4796-86cb-d777d34e011c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:54.262837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11688b8b-d5dd-431b-8b12-dffb576c4d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:54.263450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11688b8b-d5dd-431b-8b12-dffb576c4d9b service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:54.263738 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11688b8b-d5dd-431b-8b12-dffb576c4d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:54.264014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11688b8b-d5dd-431b-8b12-dffb576c4d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:54.273837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11688b8b-d5dd-431b-8b12-dffb576c4d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:54.275301 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11688b8b-d5dd-431b-8b12-dffb576c4d9b service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:54.284753 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4431/8849] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:58.410777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed44ff8-bc35-4d53-a8c2-43e578978ae7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:58.411251 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed44ff8-bc35-4d53-a8c2-43e578978ae7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:58.411357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed44ff8-bc35-4d53-a8c2-43e578978ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:58.443767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-7ed44ff8-bc35-4d53-a8c2-43e578978ae7 None None] MFA Rules not processed for user `35567d70af874c3bb4bc6262e53e5216`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:58.445519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7ed44ff8-bc35-4d53-a8c2-43e578978ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:58.517153 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4419/8850] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:45:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:45:58.531950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11688b8b-d5dd-431b-8b12-dffb576c4d9b service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:45:58.533354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-11688b8b-d5dd-431b-8b12-dffb576c4d9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:58.611321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11688b8b-d5dd-431b-8b12-dffb576c4d9b service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:45:58.616873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5564b-7055-4326-a5f9-6c37cf8fda1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:45:58.617645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5564b-7055-4326-a5f9-6c37cf8fda1b service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:58.617934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5564b-7055-4326-a5f9-6c37cf8fda1b service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:58.618206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5564b-7055-4326-a5f9-6c37cf8fda1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:58.625952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5564b-7055-4326-a5f9-6c37cf8fda1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:45:58.627573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c5564b-7055-4326-a5f9-6c37cf8fda1b service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:45:58.637049 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4432/8851] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:45:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:45:59.939066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993cf45-36ae-43b4-ba8b-2304988afa59 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:45:59.939551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993cf45-36ae-43b4-ba8b-2304988afa59 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:45:59.939644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993cf45-36ae-43b4-ba8b-2304988afa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:45:59.960766 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9993cf45-36ae-43b4-ba8b-2304988afa59 None None] MFA Rules not processed for user `35567d70af874c3bb4bc6262e53e5216`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:45:59.962283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9993cf45-36ae-43b4-ba8b-2304988afa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:45:59.969666 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4420/8852] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:45:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:46:08.632415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=52 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:46:09.955717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:46:47.627604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5564b-7055-4326-a5f9-6c37cf8fda1b service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:46:47.629012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a3c5564b-7055-4326-a5f9-6c37cf8fda1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:46:47.700969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5564b-7055-4326-a5f9-6c37cf8fda1b service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:46:47.706179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ea747-18db-4989-af03-b896fa69bd78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:46:47.706893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ea747-18db-4989-af03-b896fa69bd78 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:46:47.707185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ea747-18db-4989-af03-b896fa69bd78 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:46:47.707466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ea747-18db-4989-af03-b896fa69bd78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:46:47.709193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-886ea747-18db-4989-af03-b896fa69bd78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:46:47.720959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ea747-18db-4989-af03-b896fa69bd78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:46:47.722559 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ea747-18db-4989-af03-b896fa69bd78 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:46:47.733030 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4433/8853] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:46:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:46:57.728321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=32 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:47:12.641993 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abdfc3-439d-439b-a82a-1b2ff6b82978 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:12.642501 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abdfc3-439d-439b-a82a-1b2ff6b82978 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:12.642594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abdfc3-439d-439b-a82a-1b2ff6b82978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:12.663727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c4abdfc3-439d-439b-a82a-1b2ff6b82978 None None] MFA Rules not processed for user `35567d70af874c3bb4bc6262e53e5216`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:47:12.664948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c4abdfc3-439d-439b-a82a-1b2ff6b82978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:47:12.672780 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4421/8854] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:47:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:47:13.293281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ea747-18db-4989-af03-b896fa69bd78 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:13.294901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-886ea747-18db-4989-af03-b896fa69bd78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:47:13.311611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ea747-18db-4989-af03-b896fa69bd78 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:13.316836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04b482-ff32-488e-b64b-8e5d1e5fe346 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:13.317557 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b482-ff32-488e-b64b-8e5d1e5fe346 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:13.317953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b482-ff32-488e-b64b-8e5d1e5fe346 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:13.318152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b482-ff32-488e-b64b-8e5d1e5fe346 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:13.320038 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ab04b482-ff32-488e-b64b-8e5d1e5fe346 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:47:13.333239 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04b482-ff32-488e-b64b-8e5d1e5fe346 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:13.334865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04b482-ff32-488e-b64b-8e5d1e5fe346 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:13.347162 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4434/8855] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:47:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:47:22.658932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:47:23.342728 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:47:58.039274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abdfc3-439d-439b-a82a-1b2ff6b82978 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:58.040699 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c4abdfc3-439d-439b-a82a-1b2ff6b82978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:47:58.053138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abdfc3-439d-439b-a82a-1b2ff6b82978 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:58.056726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac63a1-1d03-41de-ac20-ca8e3bb70d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:58.057324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac63a1-1d03-41de-ac20-ca8e3bb70d52 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:58.057611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac63a1-1d03-41de-ac20-ca8e3bb70d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:58.057890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac63a1-1d03-41de-ac20-ca8e3bb70d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:58.060781 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-42ac63a1-1d03-41de-ac20-ca8e3bb70d52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:47:58.078080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac63a1-1d03-41de-ac20-ca8e3bb70d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:58.079554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac63a1-1d03-41de-ac20-ca8e3bb70d52 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:58.102387 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4422/8856] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:47:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:47:59.284229 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04b482-ff32-488e-b64b-8e5d1e5fe346 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:47:59.293537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04b482-ff32-488e-b64b-8e5d1e5fe346 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:47:59.297315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c5b4c-7fb0-403d-b3d3-2d766760e9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:47:59.297908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c5b4c-7fb0-403d-b3d3-2d766760e9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:47:59.298190 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c5b4c-7fb0-403d-b3d3-2d766760e9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:47:59.298469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c5b4c-7fb0-403d-b3d3-2d766760e9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:47:59.300197 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-749c5b4c-7fb0-403d-b3d3-2d766760e9e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:47:59.316180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c5b4c-7fb0-403d-b3d3-2d766760e9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:47:59.317607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c5b4c-7fb0-403d-b3d3-2d766760e9e3 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:47:59.331640 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4435/8857] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:47:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:48:08.099823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:48:09.323855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:48:10.439109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628654eb-0db7-4219-a7fe-da0649ca7f9d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:48:10.439733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628654eb-0db7-4219-a7fe-da0649ca7f9d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:48:10.439851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628654eb-0db7-4219-a7fe-da0649ca7f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:48:10.472282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-628654eb-0db7-4219-a7fe-da0649ca7f9d None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:48:10.473547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-628654eb-0db7-4219-a7fe-da0649ca7f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:48:10.491985 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4423/8858] 10.222.0.85 () {58 vars in 1015 bytes} [Sun Aug 28 19:48:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:48:10.505376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68b0a5-7737-496d-a007-d42ab9219094 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:48:10.505804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68b0a5-7737-496d-a007-d42ab9219094 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:48:10.505929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68b0a5-7737-496d-a007-d42ab9219094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:48:10.526754 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-bc68b0a5-7737-496d-a007-d42ab9219094 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:48:10.528122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bc68b0a5-7737-496d-a007-d42ab9219094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:48:10.538038 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4436/8859] 10.222.0.70 () {58 vars in 1058 bytes} [Sun Aug 28 19:48:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:48:10.544768 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628654eb-0db7-4219-a7fe-da0649ca7f9d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:48:10.555552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628654eb-0db7-4219-a7fe-da0649ca7f9d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:48:10.561850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf5d6c-6613-46c8-8b0a-8c1ed6fbd7d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:48:10.562550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf5d6c-6613-46c8-8b0a-8c1ed6fbd7d6 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:48:10.562872 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf5d6c-6613-46c8-8b0a-8c1ed6fbd7d6 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:48:10.563153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf5d6c-6613-46c8-8b0a-8c1ed6fbd7d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:48:10.572174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf5d6c-6613-46c8-8b0a-8c1ed6fbd7d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:48:10.573756 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf5d6c-6613-46c8-8b0a-8c1ed6fbd7d6 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:48:10.584929 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4424/8860] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:48:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:48:14.695594 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ca033-bd2f-43d7-9f3b-12547dd4acfe None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:48:14.696629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ca033-bd2f-43d7-9f3b-12547dd4acfe None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:48:14.696629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ca033-bd2f-43d7-9f3b-12547dd4acfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:48:14.718367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e48ca033-bd2f-43d7-9f3b-12547dd4acfe None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:48:14.719629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e48ca033-bd2f-43d7-9f3b-12547dd4acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:48:14.728536 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4437/8861] 10.222.0.55 () {58 vars in 1015 bytes} [Sun Aug 28 19:48:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:48:14.742707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf5d6c-6613-46c8-8b0a-8c1ed6fbd7d6 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:48:14.756564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf5d6c-6613-46c8-8b0a-8c1ed6fbd7d6 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:48:14.762496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc34109-646a-4564-b995-320f9efca870 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:48:14.763772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc34109-646a-4564-b995-320f9efca870 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:48:14.764058 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc34109-646a-4564-b995-320f9efca870 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:48:14.764338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc34109-646a-4564-b995-320f9efca870 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:48:14.773643 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc34109-646a-4564-b995-320f9efca870 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:48:14.775811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc34109-646a-4564-b995-320f9efca870 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:48:14.787539 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4425/8862] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:48:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:48:20.303990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ca033-bd2f-43d7-9f3b-12547dd4acfe None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:48:20.314074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ca033-bd2f-43d7-9f3b-12547dd4acfe None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:48:20.317583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd81d5-f2d7-4ed6-9101-17442a9d5f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:48:20.318189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd81d5-f2d7-4ed6-9101-17442a9d5f18 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:48:20.318473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd81d5-f2d7-4ed6-9101-17442a9d5f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:48:20.318765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd81d5-f2d7-4ed6-9101-17442a9d5f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:48:20.320749 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-02bd81d5-f2d7-4ed6-9101-17442a9d5f18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:48:20.332957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd81d5-f2d7-4ed6-9101-17442a9d5f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:48:20.334654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd81d5-f2d7-4ed6-9101-17442a9d5f18 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:48:20.345448 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4438/8863] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:48:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:48:24.787482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=23 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:48:30.339372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=12 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:48:30.714857 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6eabc-2401-4500-a906-9db9a4c40e91 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:48:30.715401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6eabc-2401-4500-a906-9db9a4c40e91 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:48:30.715401 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6eabc-2401-4500-a906-9db9a4c40e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:48:30.735464 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9de6eabc-2401-4500-a906-9db9a4c40e91 None None] MFA Rules not processed for user `35567d70af874c3bb4bc6262e53e5216`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:48:30.736689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9de6eabc-2401-4500-a906-9db9a4c40e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:48:30.743892 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4426/8864] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:48:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:48:31.068968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd81d5-f2d7-4ed6-9101-17442a9d5f18 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:48:31.078384 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd81d5-f2d7-4ed6-9101-17442a9d5f18 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:48:31.082087 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770f84a-d57e-4d01-8395-3242bdf6a7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:48:31.082706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770f84a-d57e-4d01-8395-3242bdf6a7bb service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:48:31.083027 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770f84a-d57e-4d01-8395-3242bdf6a7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:48:31.083306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770f84a-d57e-4d01-8395-3242bdf6a7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:48:31.085419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f770f84a-d57e-4d01-8395-3242bdf6a7bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:48:31.099996 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770f84a-d57e-4d01-8395-3242bdf6a7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:48:31.101454 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770f84a-d57e-4d01-8395-3242bdf6a7bb service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:48:31.113639 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4439/8865] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:48:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:48:40.729879 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:48:41.106344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:49:26.226430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6eabc-2401-4500-a906-9db9a4c40e91 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:49:26.236382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6eabc-2401-4500-a906-9db9a4c40e91 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:49:26.240823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b791d-bfc0-4596-ab84-38a0f2e6f2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:49:26.241440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b791d-bfc0-4596-ab84-38a0f2e6f2ed service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:26.241754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b791d-bfc0-4596-ab84-38a0f2e6f2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:26.242032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b791d-bfc0-4596-ab84-38a0f2e6f2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:26.243831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d06b791d-bfc0-4596-ab84-38a0f2e6f2ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:26.256787 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b791d-bfc0-4596-ab84-38a0f2e6f2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:49:26.258235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b791d-bfc0-4596-ab84-38a0f2e6f2ed service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:49:26.269658 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4427/8866] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:49:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:49:36.263338 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:49:46.290034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770f84a-d57e-4d01-8395-3242bdf6a7bb service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:49:46.300372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389903ac-bec9-49ea-80fa-45b4d9a507b8 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:46.300949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389903ac-bec9-49ea-80fa-45b4d9a507b8 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:46.300949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389903ac-bec9-49ea-80fa-45b4d9a507b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:46.305912 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770f84a-d57e-4d01-8395-3242bdf6a7bb service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:49:46.309736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5588a1f-c1b0-4750-ab33-859780997754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:49:46.310343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5588a1f-c1b0-4750-ab33-859780997754 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:46.310629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5588a1f-c1b0-4750-ab33-859780997754 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:46.310940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5588a1f-c1b0-4750-ab33-859780997754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:46.312660 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c5588a1f-c1b0-4750-ab33-859780997754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:46.337374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5588a1f-c1b0-4750-ab33-859780997754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:49:46.338856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5588a1f-c1b0-4750-ab33-859780997754 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:49:46.351368 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4440/8867] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:49:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:49:46.351999 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-389903ac-bec9-49ea-80fa-45b4d9a507b8 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:49:46.353287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-389903ac-bec9-49ea-80fa-45b4d9a507b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:46.386194 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4428/8868] 10.222.0.70 () {58 vars in 1059 bytes} [Sun Aug 28 19:49:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:49:46.433338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a909725-6032-4b4e-8693-9dc2a7aad042 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:46.433654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a909725-6032-4b4e-8693-9dc2a7aad042 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:46.433946 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a909725-6032-4b4e-8693-9dc2a7aad042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:46.454159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0a909725-6032-4b4e-8693-9dc2a7aad042 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:49:46.455438 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0a909725-6032-4b4e-8693-9dc2a7aad042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:46.465777 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4441/8869] 10.222.0.70 () {58 vars in 1058 bytes} [Sun Aug 28 19:49:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:49:46.471989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389903ac-bec9-49ea-80fa-45b4d9a507b8 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:49:46.483448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389903ac-bec9-49ea-80fa-45b4d9a507b8 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:49:46.489168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b3494-b12e-4265-9b4e-8ffd5fc69df7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:49:46.489780 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b3494-b12e-4265-9b4e-8ffd5fc69df7 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:46.490091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b3494-b12e-4265-9b4e-8ffd5fc69df7 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:46.490391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b3494-b12e-4265-9b4e-8ffd5fc69df7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:46.492339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fe9b3494-b12e-4265-9b4e-8ffd5fc69df7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:46.504639 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b3494-b12e-4265-9b4e-8ffd5fc69df7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:49:46.506219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b3494-b12e-4265-9b4e-8ffd5fc69df7 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:49:46.517830 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4429/8870] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:49:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:49:46.700665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a909725-6032-4b4e-8693-9dc2a7aad042 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:49:46.710372 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a909725-6032-4b4e-8693-9dc2a7aad042 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:49:46.714982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e988c62-cddd-4a5b-bf49-e88cb2ef1d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:49:46.715598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988c62-cddd-4a5b-bf49-e88cb2ef1d78 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:46.715887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988c62-cddd-4a5b-bf49-e88cb2ef1d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:46.716164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e988c62-cddd-4a5b-bf49-e88cb2ef1d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:46.717927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3e988c62-cddd-4a5b-bf49-e88cb2ef1d78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:46.734138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e988c62-cddd-4a5b-bf49-e88cb2ef1d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:49:46.735651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e988c62-cddd-4a5b-bf49-e88cb2ef1d78 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:49:46.749810 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4442/8871] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:49:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:49:47.578579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2d9b6-87cd-4cf1-b8ec-ead3f2ed6aff None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:47.579716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2d9b6-87cd-4cf1-b8ec-ead3f2ed6aff None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:47.582973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2d9b6-87cd-4cf1-b8ec-ead3f2ed6aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:47.605851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-82e2d9b6-87cd-4cf1-b8ec-ead3f2ed6aff None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:49:47.606997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-82e2d9b6-87cd-4cf1-b8ec-ead3f2ed6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:47.617373 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4430/8872] 10.222.0.70 () {58 vars in 1059 bytes} [Sun Aug 28 19:49:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:49:47.624710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f843a-2634-4f4e-a3a4-f1eaaf35f90a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:47.625230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f843a-2634-4f4e-a3a4-f1eaaf35f90a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:47.625346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f843a-2634-4f4e-a3a4-f1eaaf35f90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:47.649259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c49f843a-2634-4f4e-a3a4-f1eaaf35f90a None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:49:47.651179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c49f843a-2634-4f4e-a3a4-f1eaaf35f90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:47.661303 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4443/8873] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:49:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:49:47.673500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2d9b6-87cd-4cf1-b8ec-ead3f2ed6aff None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:49:47.684163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2d9b6-87cd-4cf1-b8ec-ead3f2ed6aff None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:49:47.687835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a94a3-e637-465f-b7b7-12067d1d9126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:49:47.688443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a94a3-e637-465f-b7b7-12067d1d9126 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:47.688721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a94a3-e637-465f-b7b7-12067d1d9126 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:47.688990 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a94a3-e637-465f-b7b7-12067d1d9126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:47.701361 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a94a3-e637-465f-b7b7-12067d1d9126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:49:47.702887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a94a3-e637-465f-b7b7-12067d1d9126 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:49:47.714871 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4431/8874] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:49:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:49:48.895085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32665040-4df5-43e1-b798-b7e63e3f30ad None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:48.895934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32665040-4df5-43e1-b798-b7e63e3f30ad None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:48.895934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32665040-4df5-43e1-b798-b7e63e3f30ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:48.915244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-32665040-4df5-43e1-b798-b7e63e3f30ad None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:49:48.917096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-32665040-4df5-43e1-b798-b7e63e3f30ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:49:48.926964 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4444/8875] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:49:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:49:48.938954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a94a3-e637-465f-b7b7-12067d1d9126 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:49:48.947890 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a94a3-e637-465f-b7b7-12067d1d9126 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:49:48.951640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b231d-232c-4f15-a6eb-e9bfce7ce35a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:49:48.952237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b231d-232c-4f15-a6eb-e9bfce7ce35a service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:49:48.952518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b231d-232c-4f15-a6eb-e9bfce7ce35a service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:49:48.952817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b231d-232c-4f15-a6eb-e9bfce7ce35a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:49:48.964161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b231d-232c-4f15-a6eb-e9bfce7ce35a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:49:48.965584 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b231d-232c-4f15-a6eb-e9bfce7ce35a service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:49:48.976614 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4432/8876] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:49:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:49:58.909969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=27 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:49:58.971871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=43 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:50:00.258185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c703622-284e-417a-b987-8888626b078c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:00.258906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c703622-284e-417a-b987-8888626b078c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:00.258906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c703622-284e-417a-b987-8888626b078c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:00.301874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6c703622-284e-417a-b987-8888626b078c None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:50:00.303161 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6c703622-284e-417a-b987-8888626b078c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:00.328445 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4445/8877] 10.222.0.55 () {58 vars in 1015 bytes} [Sun Aug 28 19:50:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:50:00.340211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b231d-232c-4f15-a6eb-e9bfce7ce35a service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:50:00.360167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b231d-232c-4f15-a6eb-e9bfce7ce35a service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:50:00.364151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4419d-5c25-4db6-a856-b160c16e4e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:50:00.364772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4419d-5c25-4db6-a856-b160c16e4e98 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:00.365075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4419d-5c25-4db6-a856-b160c16e4e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:00.365354 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4419d-5c25-4db6-a856-b160c16e4e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:00.374060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4419d-5c25-4db6-a856-b160c16e4e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:50:00.375587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4419d-5c25-4db6-a856-b160c16e4e98 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:50:00.383848 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4433/8878] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:50:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:50:01.180446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334c9ad-72a5-452e-9d2e-46fe61422443 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:01.180746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334c9ad-72a5-452e-9d2e-46fe61422443 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:01.180940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334c9ad-72a5-452e-9d2e-46fe61422443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:01.202772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-7334c9ad-72a5-452e-9d2e-46fe61422443 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:50:01.204055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-7334c9ad-72a5-452e-9d2e-46fe61422443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:01.215807 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4446/8879] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 19:50:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:50:01.234234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4419d-5c25-4db6-a856-b160c16e4e98 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:50:01.248670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4419d-5c25-4db6-a856-b160c16e4e98 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:50:01.254921 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89318d81-26e9-4eca-85bf-3cce310f3eb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:50:01.255533 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89318d81-26e9-4eca-85bf-3cce310f3eb1 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:01.255813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89318d81-26e9-4eca-85bf-3cce310f3eb1 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:01.256086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89318d81-26e9-4eca-85bf-3cce310f3eb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:01.266644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89318d81-26e9-4eca-85bf-3cce310f3eb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:50:01.268472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89318d81-26e9-4eca-85bf-3cce310f3eb1 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:50:01.286957 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4434/8880] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:50:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:50:08.839798 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334c9ad-72a5-452e-9d2e-46fe61422443 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:50:08.852966 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334c9ad-72a5-452e-9d2e-46fe61422443 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:50:08.859360 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdda59c-9987-4138-888e-632ea805833b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:50:08.860004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdda59c-9987-4138-888e-632ea805833b service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:08.860285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdda59c-9987-4138-888e-632ea805833b service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:08.860583 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdda59c-9987-4138-888e-632ea805833b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:08.862356 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-dbdda59c-9987-4138-888e-632ea805833b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:08.880817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdda59c-9987-4138-888e-632ea805833b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:50:08.882775 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdda59c-9987-4138-888e-632ea805833b service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:50:08.899752 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4447/8881] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:50:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:50:11.275793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=15 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:50:15.188980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89318d81-26e9-4eca-85bf-3cce310f3eb1 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:50:15.205068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89318d81-26e9-4eca-85bf-3cce310f3eb1 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:50:15.211495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94317530-574f-40e6-b942-5fc9dee8a928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:50:15.212114 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94317530-574f-40e6-b942-5fc9dee8a928 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:15.212570 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94317530-574f-40e6-b942-5fc9dee8a928 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:15.213008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94317530-574f-40e6-b942-5fc9dee8a928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:15.215561 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-94317530-574f-40e6-b942-5fc9dee8a928 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:15.232443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94317530-574f-40e6-b942-5fc9dee8a928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:50:15.234040 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94317530-574f-40e6-b942-5fc9dee8a928 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:50:15.253601 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4435/8882] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:50:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:50:16.875418 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f9084-2656-4ef5-a14a-e6bc92b4b9fc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:16.875913 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f9084-2656-4ef5-a14a-e6bc92b4b9fc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:16.876171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f9084-2656-4ef5-a14a-e6bc92b4b9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:16.895854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c36f9084-2656-4ef5-a14a-e6bc92b4b9fc None None] MFA Rules not processed for user `35567d70af874c3bb4bc6262e53e5216`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:50:16.897159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c36f9084-2656-4ef5-a14a-e6bc92b4b9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:16.905577 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4448/8883] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:50:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:50:17.224973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88197a-f5df-40e6-9fcb-105243f4c061 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:17.225551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88197a-f5df-40e6-9fcb-105243f4c061 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:17.225672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88197a-f5df-40e6-9fcb-105243f4c061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:17.247002 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6e88197a-f5df-40e6-9fcb-105243f4c061 None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:50:17.248220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6e88197a-f5df-40e6-9fcb-105243f4c061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:17.255091 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4436/8884] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:50:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:50:17.267839 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f9084-2656-4ef5-a14a-e6bc92b4b9fc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:50:17.278763 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f9084-2656-4ef5-a14a-e6bc92b4b9fc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:50:17.282428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd9c17-3bf6-44f2-b587-f39bd7ca6f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:50:17.283080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9c17-3bf6-44f2-b587-f39bd7ca6f69 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:17.283368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9c17-3bf6-44f2-b587-f39bd7ca6f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:17.283651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd9c17-3bf6-44f2-b587-f39bd7ca6f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:17.290805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd9c17-3bf6-44f2-b587-f39bd7ca6f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:50:17.292243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd9c17-3bf6-44f2-b587-f39bd7ca6f69 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:50:17.300625 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4449/8885] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:50:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:50:26.493403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5956d81-ab52-4876-a032-6224c5db920f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:26.493911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5956d81-ab52-4876-a032-6224c5db920f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:26.494032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5956d81-ab52-4876-a032-6224c5db920f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:26.517062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e5956d81-ab52-4876-a032-6224c5db920f None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:50:26.518295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e5956d81-ab52-4876-a032-6224c5db920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:50:26.528788 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4437/8886] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 19:50:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:50:26.546482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd9c17-3bf6-44f2-b587-f39bd7ca6f69 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:50:26.560311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd9c17-3bf6-44f2-b587-f39bd7ca6f69 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:50:26.569321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d491af4-bcac-4cc7-a7c7-8dce55966ddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:50:26.569947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491af4-bcac-4cc7-a7c7-8dce55966ddf service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:50:26.570254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491af4-bcac-4cc7-a7c7-8dce55966ddf service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:50:26.570527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491af4-bcac-4cc7-a7c7-8dce55966ddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:50:26.580908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d491af4-bcac-4cc7-a7c7-8dce55966ddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:50:26.582402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d491af4-bcac-4cc7-a7c7-8dce55966ddf service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:50:26.594758 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4450/8887] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:50:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:50:36.510598 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=12 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:50:36.590255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=40 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:02.364440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5956d81-ab52-4876-a032-6224c5db920f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:02.365843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e5956d81-ab52-4876-a032-6224c5db920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:02.444656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5956d81-ab52-4876-a032-6224c5db920f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:02.448759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dd38f-ca8e-4ee3-8006-cbb053af7798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:02.449374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dd38f-ca8e-4ee3-8006-cbb053af7798 service cinder] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:02.449660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dd38f-ca8e-4ee3-8006-cbb053af7798 service cinder] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:02.449939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dd38f-ca8e-4ee3-8006-cbb053af7798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:02.459067 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88dd38f-ca8e-4ee3-8006-cbb053af7798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:02.460496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88dd38f-ca8e-4ee3-8006-cbb053af7798 service cinder] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:02.470103 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4438/8888] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:51:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:51:12.465372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=35 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:36.218094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663a259-db97-4b2b-92d9-1518ad60d914 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:36.218720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663a259-db97-4b2b-92d9-1518ad60d914 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:36.218720 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663a259-db97-4b2b-92d9-1518ad60d914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:36.239314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-3663a259-db97-4b2b-92d9-1518ad60d914 None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:51:36.240519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3663a259-db97-4b2b-92d9-1518ad60d914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:36.247336 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4451/8889] 10.222.0.85 () {58 vars in 1015 bytes} [Sun Aug 28 19:51:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:51:36.259263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dd38f-ca8e-4ee3-8006-cbb053af7798 service cinder] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:36.269132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88dd38f-ca8e-4ee3-8006-cbb053af7798 service cinder] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:36.272845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682f9d3-7231-419c-8407-5aa3251bed38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:36.273443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682f9d3-7231-419c-8407-5aa3251bed38 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:36.273730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682f9d3-7231-419c-8407-5aa3251bed38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:36.274010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682f9d3-7231-419c-8407-5aa3251bed38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:36.281292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682f9d3-7231-419c-8407-5aa3251bed38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:36.283494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682f9d3-7231-419c-8407-5aa3251bed38 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:36.291833 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4439/8890] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:51:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:51:36.694926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89606b15-2977-441c-b88f-ac48d44c60cc None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:36.695413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89606b15-2977-441c-b88f-ac48d44c60cc None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:36.696119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89606b15-2977-441c-b88f-ac48d44c60cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:36.724514 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-89606b15-2977-441c-b88f-ac48d44c60cc None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:51:36.725850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-89606b15-2977-441c-b88f-ac48d44c60cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:51:36.736694 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4452/8891] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 19:51:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:51:36.753245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682f9d3-7231-419c-8407-5aa3251bed38 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:51:36.768012 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682f9d3-7231-419c-8407-5aa3251bed38 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:51:36.774089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd128104-2859-4d8c-8255-30fee5ebf28d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:51:36.774940 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128104-2859-4d8c-8255-30fee5ebf28d service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:51:36.775291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128104-2859-4d8c-8255-30fee5ebf28d service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:51:36.775632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128104-2859-4d8c-8255-30fee5ebf28d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:51:36.786151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd128104-2859-4d8c-8255-30fee5ebf28d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:51:36.788001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd128104-2859-4d8c-8255-30fee5ebf28d service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:51:36.800177 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4440/8892] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:51:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:51:46.717906 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:51:46.795191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=12 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:23.588521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89606b15-2977-441c-b88f-ac48d44c60cc None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:23.599413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89606b15-2977-441c-b88f-ac48d44c60cc None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:23.603204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb559-d586-4316-b755-b251710bdfcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:23.603825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb559-d586-4316-b755-b251710bdfcf service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:23.604114 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb559-d586-4316-b755-b251710bdfcf service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:23.604389 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb559-d586-4316-b755-b251710bdfcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:23.616209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253bb559-d586-4316-b755-b251710bdfcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:23.617712 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253bb559-d586-4316-b755-b251710bdfcf service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:23.627569 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4453/8893] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:26.457483 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff357ff-f5f6-48c0-b926-5d878ec0f105 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.457973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff357ff-f5f6-48c0-b926-5d878ec0f105 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.458155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff357ff-f5f6-48c0-b926-5d878ec0f105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.522599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-cff357ff-f5f6-48c0-b926-5d878ec0f105 None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:26.528615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cff357ff-f5f6-48c0-b926-5d878ec0f105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:26.534949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb559-d586-4316-b755-b251710bdfcf service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.542403 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4441/8894] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 19:52:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:26.554859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb559-d586-4316-b755-b251710bdfcf service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.566031 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.566776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.567235 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.567526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] PATH_INFO: `/v3/users/35567d70af874c3bb4bc6262e53e5216` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.568719 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35567d70af874c3bb4bc6262e53e5216)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.570850 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.631034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35567d70af874c3bb4bc6262e53e5216'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:26.639657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35567d70af874c3bb4bc6262e53e5216'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:26.640442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35567d70af874c3bb4bc6262e53e5216'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:26.654415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35567d70af874c3bb4bc6262e53e5216'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:26.655181 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35567d70af874c3bb4bc6262e53e5216'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:26.670259 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4454/8895] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:52:26 2022] DELETE /identity/v3/users/35567d70af874c3bb4bc6262e53e5216 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:26.864477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff357ff-f5f6-48c0-b926-5d878ec0f105 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.879743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:26.881306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:26.884174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff357ff-f5f6-48c0-b926-5d878ec0f105 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.959613 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8631f-c9b7-453a-ad20-6c07837622e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.960257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8631f-c9b7-453a-ad20-6c07837622e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.960540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8631f-c9b7-453a-ad20-6c07837622e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.960812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8631f-c9b7-453a-ad20-6c07837622e5 admin admin] PATH_INFO: `/v3/projects/5ea3e2df331f4884b0ca9ff66cbbdbd2` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.961934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8631f-c9b7-453a-ad20-6c07837622e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ea3e2df331f4884b0ca9ff66cbbdbd2)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.964010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8631f-c9b7-453a-ad20-6c07837622e5 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:26.966992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca573620-016d-4063-93e3-0ed986a6da40 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:26.973546 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec286224-ad5b-4e7a-9139-e345181861f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:26.974169 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286224-ad5b-4e7a-9139-e345181861f0 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:26.974457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286224-ad5b-4e7a-9139-e345181861f0 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:26.974762 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286224-ad5b-4e7a-9139-e345181861f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:26.976531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ec286224-ad5b-4e7a-9139-e345181861f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:26.989003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec286224-ad5b-4e7a-9139-e345181861f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:26.990806 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec286224-ad5b-4e7a-9139-e345181861f0 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.004599 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4455/8896] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:27.017903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09b8631f-c9b7-453a-ad20-6c07837622e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea3e2df331f4884b0ca9ff66cbbdbd2', 'request_id': 'req-09b8631f-c9b7-453a-ad20-6c07837622e5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:27.023962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09b8631f-c9b7-453a-ad20-6c07837622e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea3e2df331f4884b0ca9ff66cbbdbd2', 'request_id': 'req-09b8631f-c9b7-453a-ad20-6c07837622e5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:27.030583 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09b8631f-c9b7-453a-ad20-6c07837622e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea3e2df331f4884b0ca9ff66cbbdbd2', 'request_id': 'req-09b8631f-c9b7-453a-ad20-6c07837622e5'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:27.057873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09b8631f-c9b7-453a-ad20-6c07837622e5 admin admin] The token cache is being invalidate because project 5ea3e2df331f4884b0ca9ff66cbbdbd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:52:27.058170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09b8631f-c9b7-453a-ad20-6c07837622e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:27.058835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-09b8631f-c9b7-453a-ad20-6c07837622e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:52:27.060346 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4442/8897] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:52:26 2022] DELETE /identity/v3/projects/5ea3e2df331f4884b0ca9ff66cbbdbd2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:52:27.065477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5906ac6-cfd4-4557-bce1-aa12552d3d13 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.065773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5906ac6-cfd4-4557-bce1-aa12552d3d13 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.066088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5906ac6-cfd4-4557-bce1-aa12552d3d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.086667 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e5906ac6-cfd4-4557-bce1-aa12552d3d13 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:27.087923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e5906ac6-cfd4-4557-bce1-aa12552d3d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:27.134010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:27.154380 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4456/8898] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:27.218734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dbe63-62ec-47d3-b4a4-07fe86240918 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.219033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dbe63-62ec-47d3-b4a4-07fe86240918 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.219473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dbe63-62ec-47d3-b4a4-07fe86240918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.239771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-df9dbe63-62ec-47d3-b4a4-07fe86240918 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:27.240989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-df9dbe63-62ec-47d3-b4a4-07fe86240918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:27.248793 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4443/8899] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:27.253925 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5906ac6-cfd4-4557-bce1-aa12552d3d13 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.264127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5906ac6-cfd4-4557-bce1-aa12552d3d13 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.269694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb3ecd-e49e-49e5-8018-8dc6a9950ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.270288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb3ecd-e49e-49e5-8018-8dc6a9950ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.270573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb3ecd-e49e-49e5-8018-8dc6a9950ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.270884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb3ecd-e49e-49e5-8018-8dc6a9950ae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.271532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb3ecd-e49e-49e5-8018-8dc6a9950ae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:52:27.271842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb3ecd-e49e-49e5-8018-8dc6a9950ae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.273442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb3ecd-e49e-49e5-8018-8dc6a9950ae0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.285073 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4457/8900] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:52:27.289387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dbe63-62ec-47d3-b4a4-07fe86240918 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.298805 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dbe63-62ec-47d3-b4a4-07fe86240918 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.303537 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22404c16-1caf-49d3-afa4-318a6b38428d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.304126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22404c16-1caf-49d3-afa4-318a6b38428d admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.304407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22404c16-1caf-49d3-afa4-318a6b38428d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.304682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22404c16-1caf-49d3-afa4-318a6b38428d admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.305314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22404c16-1caf-49d3-afa4-318a6b38428d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.307885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22404c16-1caf-49d3-afa4-318a6b38428d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.336194 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4444/8901] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:52:27 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:52:27.340264 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb3ecd-e49e-49e5-8018-8dc6a9950ae0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.350983 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb3ecd-e49e-49e5-8018-8dc6a9950ae0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.410110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cd393-1c54-4c46-9577-b6453fa49f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.410802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cd393-1c54-4c46-9577-b6453fa49f2f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.411086 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cd393-1c54-4c46-9577-b6453fa49f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.411366 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cd393-1c54-4c46-9577-b6453fa49f2f admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.412007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cd393-1c54-4c46-9577-b6453fa49f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.413977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cd393-1c54-4c46-9577-b6453fa49f2f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.438988 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4458/8902] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:52:27 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:52:27.440597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22404c16-1caf-49d3-afa4-318a6b38428d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.451009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22404c16-1caf-49d3-afa4-318a6b38428d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.455858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e0cd4-0ecd-4c65-aa74-8e747d5f2309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.456456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0cd4-0ecd-4c65-aa74-8e747d5f2309 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.456770 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0cd4-0ecd-4c65-aa74-8e747d5f2309 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.457049 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0cd4-0ecd-4c65-aa74-8e747d5f2309 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.457689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e0cd4-0ecd-4c65-aa74-8e747d5f2309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.459323 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e0cd4-0ecd-4c65-aa74-8e747d5f2309 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.464603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:27.471118 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4445/8903] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:52:27.474830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cd393-1c54-4c46-9577-b6453fa49f2f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.486686 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cd393-1c54-4c46-9577-b6453fa49f2f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.491903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a465b9-256b-4a41-892f-82f1cd8e0321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.492624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a465b9-256b-4a41-892f-82f1cd8e0321 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.493290 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a465b9-256b-4a41-892f-82f1cd8e0321 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.493574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a465b9-256b-4a41-892f-82f1cd8e0321 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.494215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a465b9-256b-4a41-892f-82f1cd8e0321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.495852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a465b9-256b-4a41-892f-82f1cd8e0321 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.508905 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4459/8904] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:52:27.513530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e0cd4-0ecd-4c65-aa74-8e747d5f2309 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.525108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e0cd4-0ecd-4c65-aa74-8e747d5f2309 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.529881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa643f5e-643c-4404-9ad1-74b50a65d1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.530554 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa643f5e-643c-4404-9ad1-74b50a65d1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.530851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa643f5e-643c-4404-9ad1-74b50a65d1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.531129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa643f5e-643c-4404-9ad1-74b50a65d1c6 admin admin] PATH_INFO: `/v3/projects/e7e6ec1b24824cbb84ed3b5bdaff1a4d/users/5b07560eb7fe48dbb22652ab6a45ec6a/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.545861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa643f5e-643c-4404-9ad1-74b50a65d1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e6ec1b24824cbb84ed3b5bdaff1a4d, user_id=5b07560eb7fe48dbb22652ab6a45ec6a, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.549069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa643f5e-643c-4404-9ad1-74b50a65d1c6 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.562218 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4446/8905] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:52:27 2022] PUT /identity/v3/projects/e7e6ec1b24824cbb84ed3b5bdaff1a4d/users/5b07560eb7fe48dbb22652ab6a45ec6a/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:52:27.568521 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf96d8-4ad6-4afb-88c5-71fdbc9c5927 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.568990 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf96d8-4ad6-4afb-88c5-71fdbc9c5927 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.569073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf96d8-4ad6-4afb-88c5-71fdbc9c5927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.588799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-01cf96d8-4ad6-4afb-88c5-71fdbc9c5927 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:27.589926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-01cf96d8-4ad6-4afb-88c5-71fdbc9c5927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:27.653316 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4460/8906] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:27.663320 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa643f5e-643c-4404-9ad1-74b50a65d1c6 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:27.665215 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fa643f5e-643c-4404-9ad1-74b50a65d1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:27.730386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa643f5e-643c-4404-9ad1-74b50a65d1c6 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:27.734165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e4e94-1081-4be8-bf23-a24658140265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:27.735326 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4e94-1081-4be8-bf23-a24658140265 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:27.735755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4e94-1081-4be8-bf23-a24658140265 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:27.736089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4e94-1081-4be8-bf23-a24658140265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:27.746725 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e4e94-1081-4be8-bf23-a24658140265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:27.748173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e4e94-1081-4be8-bf23-a24658140265 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:27.758910 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4447/8907] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:52:31.935909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba0491-d1a2-492d-84f9-dd7728e4ceba None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:31.936416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba0491-d1a2-492d-84f9-dd7728e4ceba None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:31.936589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba0491-d1a2-492d-84f9-dd7728e4ceba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:31.976773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e0ba0491-d1a2-492d-84f9-dd7728e4ceba None None] MFA Rules not processed for user `5b07560eb7fe48dbb22652ab6a45ec6a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:31.978385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e0ba0491-d1a2-492d-84f9-dd7728e4ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:32.028143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:32.053953 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4461/8908] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:52:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:32.064019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e7ca-c15b-443e-8a5b-212f179dca41 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.064575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e7ca-c15b-443e-8a5b-212f179dca41 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.064575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e7ca-c15b-443e-8a5b-212f179dca41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.086455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-e238e7ca-c15b-443e-8a5b-212f179dca41 None None] MFA Rules not processed for user `5b07560eb7fe48dbb22652ab6a45ec6a`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:32.087847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-e238e7ca-c15b-443e-8a5b-212f179dca41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:32.096253 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4448/8909] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:52:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:32.111973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba0491-d1a2-492d-84f9-dd7728e4ceba None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:32.113396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e0ba0491-d1a2-492d-84f9-dd7728e4ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:32.202143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba0491-d1a2-492d-84f9-dd7728e4ceba None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:32.209164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e4a90-db4d-48da-83d8-95226de80470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:32.209792 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e4a90-db4d-48da-83d8-95226de80470 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.210074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e4a90-db4d-48da-83d8-95226de80470 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.210352 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e4a90-db4d-48da-83d8-95226de80470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.219837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e4a90-db4d-48da-83d8-95226de80470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:32.222011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e4a90-db4d-48da-83d8-95226de80470 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:32.232058 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4462/8910] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:32.488307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e5569-6486-45bf-9c5f-2f960555f0ed None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.488593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e5569-6486-45bf-9c5f-2f960555f0ed None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.488896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e5569-6486-45bf-9c5f-2f960555f0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.510196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-647e5569-6486-45bf-9c5f-2f960555f0ed None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:32.511705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-647e5569-6486-45bf-9c5f-2f960555f0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:32.518391 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4449/8911] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:52:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:52:32.530609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e4a90-db4d-48da-83d8-95226de80470 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:32.541267 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e4a90-db4d-48da-83d8-95226de80470 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:32.544824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615f1fd-5136-48b4-a1b8-93d6e3727c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:32.545428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615f1fd-5136-48b4-a1b8-93d6e3727c0c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.545709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615f1fd-5136-48b4-a1b8-93d6e3727c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.545984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615f1fd-5136-48b4-a1b8-93d6e3727c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.554061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615f1fd-5136-48b4-a1b8-93d6e3727c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:32.555547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615f1fd-5136-48b4-a1b8-93d6e3727c0c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:32.563506 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4463/8912] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:32.889185 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e5569-6486-45bf-9c5f-2f960555f0ed None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:32.890869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-647e5569-6486-45bf-9c5f-2f960555f0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:32.968685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e5569-6486-45bf-9c5f-2f960555f0ed None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:32.974572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f50960-5b10-4b62-8a8d-0a8e85dc5787 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:32.975228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f50960-5b10-4b62-8a8d-0a8e85dc5787 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:32.975512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f50960-5b10-4b62-8a8d-0a8e85dc5787 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:32.975788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f50960-5b10-4b62-8a8d-0a8e85dc5787 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:32.977544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-74f50960-5b10-4b62-8a8d-0a8e85dc5787 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:32.990128 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f50960-5b10-4b62-8a8d-0a8e85dc5787 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:32.991752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f50960-5b10-4b62-8a8d-0a8e85dc5787 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:33.001932 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4450/8913] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:42.553944 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766281b-aa2c-4efc-83df-50151b435bc0 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:42.554428 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766281b-aa2c-4efc-83df-50151b435bc0 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:42.554535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766281b-aa2c-4efc-83df-50151b435bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:42.574387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8766281b-aa2c-4efc-83df-50151b435bc0 None None] MFA Rules not processed for user `5b07560eb7fe48dbb22652ab6a45ec6a`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:52:42.575642 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8766281b-aa2c-4efc-83df-50151b435bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:42.584138 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4464/8914] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:52:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:52:42.997593 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:43.157792 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f50960-5b10-4b62-8a8d-0a8e85dc5787 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:52:43.168704 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f50960-5b10-4b62-8a8d-0a8e85dc5787 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:52:43.173892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf0ee2-809c-485a-b3c8-c83158bc0196 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:52:43.174532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf0ee2-809c-485a-b3c8-c83158bc0196 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:52:43.174848 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf0ee2-809c-485a-b3c8-c83158bc0196 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:52:43.175129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf0ee2-809c-485a-b3c8-c83158bc0196 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:52:43.176888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4dcf0ee2-809c-485a-b3c8-c83158bc0196 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:52:43.191106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf0ee2-809c-485a-b3c8-c83158bc0196 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:52:43.192683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf0ee2-809c-485a-b3c8-c83158bc0196 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:52:43.209489 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4451/8915] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:52:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:52:52.569442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=53 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:52:53.198656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:04.643905 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766281b-aa2c-4efc-83df-50151b435bc0 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:04.661306 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766281b-aa2c-4efc-83df-50151b435bc0 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:04.667665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e15819-b402-425b-a9b2-b253ac3280fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:04.668295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15819-b402-425b-a9b2-b253ac3280fc service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.668577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15819-b402-425b-a9b2-b253ac3280fc service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.668900 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e15819-b402-425b-a9b2-b253ac3280fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.670962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-30e15819-b402-425b-a9b2-b253ac3280fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:04.688682 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e15819-b402-425b-a9b2-b253ac3280fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:04.690455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e15819-b402-425b-a9b2-b253ac3280fc service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:04.713680 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4465/8916] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:04.718839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf0ee2-809c-485a-b3c8-c83158bc0196 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:04.740670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf0ee2-809c-485a-b3c8-c83158bc0196 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:04.746687 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da22b5-de35-4e0b-a17d-f6a1ea9f88a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:04.747482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da22b5-de35-4e0b-a17d-f6a1ea9f88a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:04.747821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da22b5-de35-4e0b-a17d-f6a1ea9f88a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:04.748102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da22b5-de35-4e0b-a17d-f6a1ea9f88a4 admin admin] PATH_INFO: `/v3/users/5b07560eb7fe48dbb22652ab6a45ec6a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:04.749276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da22b5-de35-4e0b-a17d-f6a1ea9f88a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b07560eb7fe48dbb22652ab6a45ec6a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:04.751310 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da22b5-de35-4e0b-a17d-f6a1ea9f88a4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:04.802896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b5da22b5-de35-4e0b-a17d-f6a1ea9f88a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b07560eb7fe48dbb22652ab6a45ec6a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.810536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b5da22b5-de35-4e0b-a17d-f6a1ea9f88a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b07560eb7fe48dbb22652ab6a45ec6a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.811276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b5da22b5-de35-4e0b-a17d-f6a1ea9f88a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b07560eb7fe48dbb22652ab6a45ec6a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.820170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b5da22b5-de35-4e0b-a17d-f6a1ea9f88a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b07560eb7fe48dbb22652ab6a45ec6a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.820835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b5da22b5-de35-4e0b-a17d-f6a1ea9f88a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b07560eb7fe48dbb22652ab6a45ec6a'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:04.843190 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4452/8917] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:04 2022] DELETE /identity/v3/users/5b07560eb7fe48dbb22652ab6a45ec6a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:05.036213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e15819-b402-425b-a9b2-b253ac3280fc service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.048323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e15819-b402-425b-a9b2-b253ac3280fc service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.112277 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.113563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.114436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.114436 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46 admin admin] PATH_INFO: `/v3/projects/e7e6ec1b24824cbb84ed3b5bdaff1a4d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.115511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e6ec1b24824cbb84ed3b5bdaff1a4d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.117504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.167529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e6ec1b24824cbb84ed3b5bdaff1a4d', 'request_id': 'req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:05.176346 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e6ec1b24824cbb84ed3b5bdaff1a4d', 'request_id': 'req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:05.182543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e6ec1b24824cbb84ed3b5bdaff1a4d', 'request_id': 'req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:05.195316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46 admin admin] The token cache is being invalidate because project e7e6ec1b24824cbb84ed3b5bdaff1a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:05.195610 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:05.196283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6b1ebb21-2b3c-4a27-bcac-03ac904ebd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:05.197781 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4466/8918] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:05 2022] DELETE /identity/v3/projects/e7e6ec1b24824cbb84ed3b5bdaff1a4d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:05.202824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b63d2-f673-47c2-a2d5-05ff10e105db None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.203111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b63d2-f673-47c2-a2d5-05ff10e105db None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.203388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b63d2-f673-47c2-a2d5-05ff10e105db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.266664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f92b63d2-f673-47c2-a2d5-05ff10e105db None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:05.268035 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f92b63d2-f673-47c2-a2d5-05ff10e105db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:05.336097 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4453/8919] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:05.344191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4338fbd-8e14-4a63-8a5b-0c0beed6e954 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.344526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4338fbd-8e14-4a63-8a5b-0c0beed6e954 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.344758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4338fbd-8e14-4a63-8a5b-0c0beed6e954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.372528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-a4338fbd-8e14-4a63-8a5b-0c0beed6e954 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:05.373756 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a4338fbd-8e14-4a63-8a5b-0c0beed6e954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:05.382539 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4467/8920] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:05.387500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b63d2-f673-47c2-a2d5-05ff10e105db None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.399847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b63d2-f673-47c2-a2d5-05ff10e105db None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.406006 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91cc3-4922-4a39-b3a3-2dc857abd2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.406646 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91cc3-4922-4a39-b3a3-2dc857abd2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.406978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91cc3-4922-4a39-b3a3-2dc857abd2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.407257 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91cc3-4922-4a39-b3a3-2dc857abd2d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.407944 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f91cc3-4922-4a39-b3a3-2dc857abd2d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:05.408259 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f91cc3-4922-4a39-b3a3-2dc857abd2d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.410434 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f91cc3-4922-4a39-b3a3-2dc857abd2d7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.424001 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4454/8921] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:05.429495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4338fbd-8e14-4a63-8a5b-0c0beed6e954 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.439688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4338fbd-8e14-4a63-8a5b-0c0beed6e954 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.445345 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c64ae-9c16-4aa2-8a53-335397afa887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.446279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c64ae-9c16-4aa2-8a53-335397afa887 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.446589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c64ae-9c16-4aa2-8a53-335397afa887 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.447067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c64ae-9c16-4aa2-8a53-335397afa887 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.447760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c64ae-9c16-4aa2-8a53-335397afa887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.450276 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c64ae-9c16-4aa2-8a53-335397afa887 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.496405 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4468/8922] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:05 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:05.500395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91cc3-4922-4a39-b3a3-2dc857abd2d7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.511705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91cc3-4922-4a39-b3a3-2dc857abd2d7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.546094 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:05.593218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e5a33-729b-427e-a0dd-043fb4e06dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.593752 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e5a33-729b-427e-a0dd-043fb4e06dea admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.594039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e5a33-729b-427e-a0dd-043fb4e06dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.594316 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e5a33-729b-427e-a0dd-043fb4e06dea admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.595261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e5a33-729b-427e-a0dd-043fb4e06dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.597706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e5a33-729b-427e-a0dd-043fb4e06dea admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.625728 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4455/8923] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:05 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:53:05.630388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c64ae-9c16-4aa2-8a53-335397afa887 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.641714 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c64ae-9c16-4aa2-8a53-335397afa887 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.648024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb788e8-c8f8-460c-ab5b-da699dc8018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.649004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb788e8-c8f8-460c-ab5b-da699dc8018c admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.649274 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb788e8-c8f8-460c-ab5b-da699dc8018c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.649608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb788e8-c8f8-460c-ab5b-da699dc8018c admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.650331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb788e8-c8f8-460c-ab5b-da699dc8018c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.652095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb788e8-c8f8-460c-ab5b-da699dc8018c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.665016 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4469/8924] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:53:05.669465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e5a33-729b-427e-a0dd-043fb4e06dea admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.682204 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e5a33-729b-427e-a0dd-043fb4e06dea admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.687819 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76417d4f-98d9-4fa0-844e-84995732c716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.688487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76417d4f-98d9-4fa0-844e-84995732c716 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.688812 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76417d4f-98d9-4fa0-844e-84995732c716 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.689086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76417d4f-98d9-4fa0-844e-84995732c716 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.689809 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76417d4f-98d9-4fa0-844e-84995732c716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.692238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76417d4f-98d9-4fa0-844e-84995732c716 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.708931 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4456/8925] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:05.710553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb788e8-c8f8-460c-ab5b-da699dc8018c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.721486 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb788e8-c8f8-460c-ab5b-da699dc8018c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.727695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f1733-25e4-416f-857a-bd58635d6b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.728466 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f1733-25e4-416f-857a-bd58635d6b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.728760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f1733-25e4-416f-857a-bd58635d6b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.729131 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f1733-25e4-416f-857a-bd58635d6b8f admin admin] PATH_INFO: `/v3/projects/6df978e1aab541f488da89b7ea70c142/users/a78f352b28e44bae83c1898ac1c7ccf3/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.749106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f1733-25e4-416f-857a-bd58635d6b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df978e1aab541f488da89b7ea70c142, user_id=a78f352b28e44bae83c1898ac1c7ccf3, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.752165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f1733-25e4-416f-857a-bd58635d6b8f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:05.767055 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4470/8926] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:05 2022] PUT /identity/v3/projects/6df978e1aab541f488da89b7ea70c142/users/a78f352b28e44bae83c1898ac1c7ccf3/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:05.779109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712321a6-b663-4347-a3e4-6ebdc29e0c34 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.779656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712321a6-b663-4347-a3e4-6ebdc29e0c34 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.779656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712321a6-b663-4347-a3e4-6ebdc29e0c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.810661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-712321a6-b663-4347-a3e4-6ebdc29e0c34 None None] MFA Rules not processed for user `a78f352b28e44bae83c1898ac1c7ccf3`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:05.812292 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-712321a6-b663-4347-a3e4-6ebdc29e0c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:05.883261 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4457/8927] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:05.894050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f1733-25e4-416f-857a-bd58635d6b8f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:05.895776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-146f1733-25e4-416f-857a-bd58635d6b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:05.900564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:05.979882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f1733-25e4-416f-857a-bd58635d6b8f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:05.983744 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd196e-8bdc-4cbe-836e-0edb5a0140f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:05.984365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd196e-8bdc-4cbe-836e-0edb5a0140f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:05.984652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd196e-8bdc-4cbe-836e-0edb5a0140f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:05.984929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd196e-8bdc-4cbe-836e-0edb5a0140f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:05.996803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd196e-8bdc-4cbe-836e-0edb5a0140f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:05.998265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd196e-8bdc-4cbe-836e-0edb5a0140f4 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:06.009221 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4471/8928] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:15.880034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:16.003653 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=29 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:16.447950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712321a6-b663-4347-a3e4-6ebdc29e0c34 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:16.449416 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-712321a6-b663-4347-a3e4-6ebdc29e0c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:16.537958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712321a6-b663-4347-a3e4-6ebdc29e0c34 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:16.544659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e51db-3c5a-4648-b811-276192e5c0a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:16.545282 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e51db-3c5a-4648-b811-276192e5c0a2 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:16.545564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e51db-3c5a-4648-b811-276192e5c0a2 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:16.546039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e51db-3c5a-4648-b811-276192e5c0a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:16.547920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ef0e51db-3c5a-4648-b811-276192e5c0a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:16.564984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e51db-3c5a-4648-b811-276192e5c0a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:16.567540 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e51db-3c5a-4648-b811-276192e5c0a2 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:16.582900 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4458/8929] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:17.684045 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd196e-8bdc-4cbe-836e-0edb5a0140f4 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:17.698633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd196e-8bdc-4cbe-836e-0edb5a0140f4 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:17.704332 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9b5f6-74ff-42b2-8ea9-46f374120ee6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:17.705250 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9b5f6-74ff-42b2-8ea9-46f374120ee6 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:17.707198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9b5f6-74ff-42b2-8ea9-46f374120ee6 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:17.707740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9b5f6-74ff-42b2-8ea9-46f374120ee6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:17.710848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c4f9b5f6-74ff-42b2-8ea9-46f374120ee6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:17.734108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9b5f6-74ff-42b2-8ea9-46f374120ee6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:17.747107 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9b5f6-74ff-42b2-8ea9-46f374120ee6 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:17.777713 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4472/8930] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:20.202497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e51db-3c5a-4648-b811-276192e5c0a2 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:20.267675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e51db-3c5a-4648-b811-276192e5c0a2 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:20.273196 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:20.273769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:20.274057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:20.274334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] PATH_INFO: `/v3/users/a78f352b28e44bae83c1898ac1c7ccf3` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:20.275494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a78f352b28e44bae83c1898ac1c7ccf3)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:20.277427 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:20.326563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a78f352b28e44bae83c1898ac1c7ccf3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:20.334888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a78f352b28e44bae83c1898ac1c7ccf3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:20.335568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a78f352b28e44bae83c1898ac1c7ccf3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:20.343087 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a78f352b28e44bae83c1898ac1c7ccf3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:20.343684 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a78f352b28e44bae83c1898ac1c7ccf3'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:20.361331 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4459/8931] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:20 2022] DELETE /identity/v3/users/a78f352b28e44bae83c1898ac1c7ccf3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:20.366855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67536c34-299a-46b4-86fd-c36acc27d6fd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:20.367328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67536c34-299a-46b4-86fd-c36acc27d6fd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:20.367421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67536c34-299a-46b4-86fd-c36acc27d6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:20.387006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-67536c34-299a-46b4-86fd-c36acc27d6fd None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:20.388220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-67536c34-299a-46b4-86fd-c36acc27d6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:20.448462 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4473/8932] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:20.458307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:20.459786 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:20.470677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:20.519732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3f1f3-b2df-4021-bd1c-f8277c5c74f4 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:20.523659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b0530-9b50-4822-af3d-6037db756eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:20.524279 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0530-9b50-4822-af3d-6037db756eea service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:20.524566 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0530-9b50-4822-af3d-6037db756eea service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:20.524843 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0530-9b50-4822-af3d-6037db756eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:20.535272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b0530-9b50-4822-af3d-6037db756eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:20.536741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b0530-9b50-4822-af3d-6037db756eea service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:20.546618 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4460/8933] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:20.723242 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67536c34-299a-46b4-86fd-c36acc27d6fd None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:20.724687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-67536c34-299a-46b4-86fd-c36acc27d6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:20.737624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67536c34-299a-46b4-86fd-c36acc27d6fd None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:20.742662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:20.743410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:20.743692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:20.743981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49 admin admin] PATH_INFO: `/v3/projects/6df978e1aab541f488da89b7ea70c142` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:20.745097 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df978e1aab541f488da89b7ea70c142)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:20.747051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:20.799116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df978e1aab541f488da89b7ea70c142', 'request_id': 'req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:20.806936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df978e1aab541f488da89b7ea70c142', 'request_id': 'req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:20.812580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df978e1aab541f488da89b7ea70c142', 'request_id': 'req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:20.823805 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49 admin admin] The token cache is being invalidate because project 6df978e1aab541f488da89b7ea70c142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:20.824099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:20.824737 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-7d91e837-4a8e-43e7-ad99-cdbd8aa17e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:20.826213 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4474/8934] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:20 2022] DELETE /identity/v3/projects/6df978e1aab541f488da89b7ea70c142 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:20.832466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0fa19-7640-4b7c-8c45-bcf1e5b0beff None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:20.832755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0fa19-7640-4b7c-8c45-bcf1e5b0beff None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:20.833085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0fa19-7640-4b7c-8c45-bcf1e5b0beff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:20.853714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2dd0fa19-7640-4b7c-8c45-bcf1e5b0beff None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:20.854934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2dd0fa19-7640-4b7c-8c45-bcf1e5b0beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:20.919978 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4461/8935] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:20.928807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19716c28-3a29-435a-9fad-da27c081b27a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:20.929223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19716c28-3a29-435a-9fad-da27c081b27a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:20.929636 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19716c28-3a29-435a-9fad-da27c081b27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:20.953225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-19716c28-3a29-435a-9fad-da27c081b27a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:20.954423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-19716c28-3a29-435a-9fad-da27c081b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:20.962852 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4475/8936] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:20.967334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0fa19-7640-4b7c-8c45-bcf1e5b0beff None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:20.978911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0fa19-7640-4b7c-8c45-bcf1e5b0beff None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:20.984609 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205b357-f238-45d6-88eb-96c56554f780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:20.985258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205b357-f238-45d6-88eb-96c56554f780 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:20.986340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205b357-f238-45d6-88eb-96c56554f780 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:20.986340 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205b357-f238-45d6-88eb-96c56554f780 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:20.987476 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205b357-f238-45d6-88eb-96c56554f780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:20.987842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205b357-f238-45d6-88eb-96c56554f780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:20.989663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205b357-f238-45d6-88eb-96c56554f780 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:21.001884 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4462/8937] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:21.006574 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19716c28-3a29-435a-9fad-da27c081b27a None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:21.016111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19716c28-3a29-435a-9fad-da27c081b27a None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:21.022304 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddee03-ec08-47d0-98dc-bce6b27ae7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:21.022956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddee03-ec08-47d0-98dc-bce6b27ae7ab admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:21.023247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddee03-ec08-47d0-98dc-bce6b27ae7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:21.023520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddee03-ec08-47d0-98dc-bce6b27ae7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:21.024162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddee03-ec08-47d0-98dc-bce6b27ae7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:21.026142 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddee03-ec08-47d0-98dc-bce6b27ae7ab admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:21.055109 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4476/8938] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:21 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:21.059272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205b357-f238-45d6-88eb-96c56554f780 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:21.070226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205b357-f238-45d6-88eb-96c56554f780 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:21.131407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eef66-4739-4299-acdb-ee6c81f40f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:21.132023 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eef66-4739-4299-acdb-ee6c81f40f62 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:21.132337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eef66-4739-4299-acdb-ee6c81f40f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:21.132614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eef66-4739-4299-acdb-ee6c81f40f62 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:21.133246 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44eef66-4739-4299-acdb-ee6c81f40f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:21.135457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44eef66-4739-4299-acdb-ee6c81f40f62 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:21.158200 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4463/8939] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:21 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:21.163651 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddee03-ec08-47d0-98dc-bce6b27ae7ab admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:21.174073 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddee03-ec08-47d0-98dc-bce6b27ae7ab admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:21.178623 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f84d94-8a4b-4da1-8b77-949de8199ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:21.179260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f84d94-8a4b-4da1-8b77-949de8199ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:21.179538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f84d94-8a4b-4da1-8b77-949de8199ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:21.179810 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f84d94-8a4b-4da1-8b77-949de8199ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:21.180447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f84d94-8a4b-4da1-8b77-949de8199ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:21.182067 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f84d94-8a4b-4da1-8b77-949de8199ca2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:21.192479 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4477/8940] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:53:21.196557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eef66-4739-4299-acdb-ee6c81f40f62 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:21.208202 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eef66-4739-4299-acdb-ee6c81f40f62 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:21.212974 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eadd52-729b-4878-9272-537fd368734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:21.213562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eadd52-729b-4878-9272-537fd368734e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:21.213845 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eadd52-729b-4878-9272-537fd368734e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:21.214123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eadd52-729b-4878-9272-537fd368734e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:21.214795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eadd52-729b-4878-9272-537fd368734e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:21.216391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eadd52-729b-4878-9272-537fd368734e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:21.226485 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4464/8941] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:21.230822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f84d94-8a4b-4da1-8b77-949de8199ca2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:21.241034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f84d94-8a4b-4da1-8b77-949de8199ca2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:21.246265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbbaf6-9dd9-4d85-a22b-63b750f7d189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:21.246982 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbbaf6-9dd9-4d85-a22b-63b750f7d189 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:21.247262 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbbaf6-9dd9-4d85-a22b-63b750f7d189 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:21.247537 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbbaf6-9dd9-4d85-a22b-63b750f7d189 admin admin] PATH_INFO: `/v3/projects/b5c96bf6b61d405996fc2f809471973e/users/ad7b471604b647d39c34e212af0b5637/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:21.263945 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbbaf6-9dd9-4d85-a22b-63b750f7d189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c96bf6b61d405996fc2f809471973e, user_id=ad7b471604b647d39c34e212af0b5637, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:21.266599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbbaf6-9dd9-4d85-a22b-63b750f7d189 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:21.280696 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4478/8942] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:21 2022] PUT /identity/v3/projects/b5c96bf6b61d405996fc2f809471973e/users/ad7b471604b647d39c34e212af0b5637/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:21.291395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29189f7a-bf34-4252-bdef-40db73ab5445 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:21.291683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29189f7a-bf34-4252-bdef-40db73ab5445 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:21.291962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29189f7a-bf34-4252-bdef-40db73ab5445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:21.322402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-29189f7a-bf34-4252-bdef-40db73ab5445 None None] MFA Rules not processed for user `ad7b471604b647d39c34e212af0b5637`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:21.323590 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-29189f7a-bf34-4252-bdef-40db73ab5445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:21.328707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:21.391035 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4465/8943] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:21.403604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbbaf6-9dd9-4d85-a22b-63b750f7d189 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:21.405520 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0bbbbaf6-9dd9-4d85-a22b-63b750f7d189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:21.415729 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:21.466231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbbaf6-9dd9-4d85-a22b-63b750f7d189 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:21.469922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee39396-87bb-49dc-9128-f637a0a06d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:21.470534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee39396-87bb-49dc-9128-f637a0a06d70 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:21.470853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee39396-87bb-49dc-9128-f637a0a06d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:21.471127 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee39396-87bb-49dc-9128-f637a0a06d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:21.479992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee39396-87bb-49dc-9128-f637a0a06d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:21.481427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee39396-87bb-49dc-9128-f637a0a06d70 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:21.491749 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4479/8944] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:25.840454 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29189f7a-bf34-4252-bdef-40db73ab5445 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:25.904360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29189f7a-bf34-4252-bdef-40db73ab5445 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:25.909385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:25.910121 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:25.910365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:25.910634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] PATH_INFO: `/v3/users/ad7b471604b647d39c34e212af0b5637` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:25.911821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7b471604b647d39c34e212af0b5637)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:25.913733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:25.961647 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7b471604b647d39c34e212af0b5637'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:25.968631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7b471604b647d39c34e212af0b5637'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:25.969295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7b471604b647d39c34e212af0b5637'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:25.977905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7b471604b647d39c34e212af0b5637'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:25.978706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7b471604b647d39c34e212af0b5637'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:25.996234 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4466/8945] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:53:25 2022] DELETE /identity/v3/users/ad7b471604b647d39c34e212af0b5637 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:26.001157 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8144fd-61cf-4683-b91b-a7bf4b61e172 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.001637 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8144fd-61cf-4683-b91b-a7bf4b61e172 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.001746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8144fd-61cf-4683-b91b-a7bf4b61e172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.021761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-8b8144fd-61cf-4683-b91b-a7bf4b61e172 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:26.022995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8b8144fd-61cf-4683-b91b-a7bf4b61e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:26.081782 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4480/8946] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:26.091690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:26.093099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:26.125209 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:26.154452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966565b1-0e47-435d-9786-bdbd16b3e8fc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:26.158158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480255f3-e182-4c2c-8867-6e97a988e259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:26.159399 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480255f3-e182-4c2c-8867-6e97a988e259 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.159698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480255f3-e182-4c2c-8867-6e97a988e259 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.160075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480255f3-e182-4c2c-8867-6e97a988e259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.169932 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480255f3-e182-4c2c-8867-6e97a988e259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:26.171536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480255f3-e182-4c2c-8867-6e97a988e259 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:26.181254 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4467/8947] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:26.357254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8144fd-61cf-4683-b91b-a7bf4b61e172 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:26.358765 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8b8144fd-61cf-4683-b91b-a7bf4b61e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:26.374692 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8144fd-61cf-4683-b91b-a7bf4b61e172 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:26.379818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc519870-cdb2-4354-9b51-6467e0ff0c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:26.380442 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc519870-cdb2-4354-9b51-6467e0ff0c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.380759 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc519870-cdb2-4354-9b51-6467e0ff0c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.381040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc519870-cdb2-4354-9b51-6467e0ff0c27 admin admin] PATH_INFO: `/v3/projects/b5c96bf6b61d405996fc2f809471973e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.382343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc519870-cdb2-4354-9b51-6467e0ff0c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c96bf6b61d405996fc2f809471973e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:26.384350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc519870-cdb2-4354-9b51-6467e0ff0c27 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:26.436063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cc519870-cdb2-4354-9b51-6467e0ff0c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c96bf6b61d405996fc2f809471973e', 'request_id': 'req-cc519870-cdb2-4354-9b51-6467e0ff0c27'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.443138 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cc519870-cdb2-4354-9b51-6467e0ff0c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c96bf6b61d405996fc2f809471973e', 'request_id': 'req-cc519870-cdb2-4354-9b51-6467e0ff0c27'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.448950 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cc519870-cdb2-4354-9b51-6467e0ff0c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c96bf6b61d405996fc2f809471973e', 'request_id': 'req-cc519870-cdb2-4354-9b51-6467e0ff0c27'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.460411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cc519870-cdb2-4354-9b51-6467e0ff0c27 admin admin] The token cache is being invalidate because project b5c96bf6b61d405996fc2f809471973e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:53:26.460706 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cc519870-cdb2-4354-9b51-6467e0ff0c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.461359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cc519870-cdb2-4354-9b51-6467e0ff0c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:53:26.462901 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4481/8948] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:53:26 2022] DELETE /identity/v3/projects/b5c96bf6b61d405996fc2f809471973e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:26.467908 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8779422-a3a0-4728-85f9-65f55883a604 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.468219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8779422-a3a0-4728-85f9-65f55883a604 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.468492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8779422-a3a0-4728-85f9-65f55883a604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.489180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a8779422-a3a0-4728-85f9-65f55883a604 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:26.490388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a8779422-a3a0-4728-85f9-65f55883a604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:26.550316 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4468/8949] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:26.558254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8c570-25a5-4353-9d6c-feae1504d534 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.558553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8c570-25a5-4353-9d6c-feae1504d534 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.558940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8c570-25a5-4353-9d6c-feae1504d534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.583987 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-ddb8c570-25a5-4353-9d6c-feae1504d534 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:26.584823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ddb8c570-25a5-4353-9d6c-feae1504d534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:26.592904 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4482/8950] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:26.597550 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8779422-a3a0-4728-85f9-65f55883a604 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:26.607710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8779422-a3a0-4728-85f9-65f55883a604 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:26.612693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60023f-1796-4dd6-b96d-a69de1ff9bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:26.613317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60023f-1796-4dd6-b96d-a69de1ff9bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.613723 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60023f-1796-4dd6-b96d-a69de1ff9bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.614289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60023f-1796-4dd6-b96d-a69de1ff9bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.614631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60023f-1796-4dd6-b96d-a69de1ff9bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:53:26.614967 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60023f-1796-4dd6-b96d-a69de1ff9bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:26.616728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60023f-1796-4dd6-b96d-a69de1ff9bb2 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:26.630113 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4469/8951] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:53:26.634472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8c570-25a5-4353-9d6c-feae1504d534 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:26.645258 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8c570-25a5-4353-9d6c-feae1504d534 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:26.650505 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603069ed-2e1c-4d70-91ce-510a821a2268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:26.651313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603069ed-2e1c-4d70-91ce-510a821a2268 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.651599 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603069ed-2e1c-4d70-91ce-510a821a2268 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.651875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603069ed-2e1c-4d70-91ce-510a821a2268 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.652526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603069ed-2e1c-4d70-91ce-510a821a2268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:26.654473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603069ed-2e1c-4d70-91ce-510a821a2268 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:26.684988 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4483/8952] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:26 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:26.690721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60023f-1796-4dd6-b96d-a69de1ff9bb2 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:26.701599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60023f-1796-4dd6-b96d-a69de1ff9bb2 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:26.764874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc64fa-78b7-4bf4-8343-79a16545cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:26.765495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc64fa-78b7-4bf4-8343-79a16545cfa7 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.765777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc64fa-78b7-4bf4-8343-79a16545cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.766056 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc64fa-78b7-4bf4-8343-79a16545cfa7 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.766705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc64fa-78b7-4bf4-8343-79a16545cfa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:26.768928 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc64fa-78b7-4bf4-8343-79a16545cfa7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:26.792266 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4470/8953] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:26 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:53:26.796567 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603069ed-2e1c-4d70-91ce-510a821a2268 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:26.805121 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:26.809113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603069ed-2e1c-4d70-91ce-510a821a2268 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:26.814774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bd097-f3b4-4349-960a-35052e855b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:26.816746 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bd097-f3b4-4349-960a-35052e855b58 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.817247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bd097-f3b4-4349-960a-35052e855b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.817730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bd097-f3b4-4349-960a-35052e855b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.818580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bd097-f3b4-4349-960a-35052e855b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:26.820480 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bd097-f3b4-4349-960a-35052e855b58 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:26.831371 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4484/8954] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:53:26.835648 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc64fa-78b7-4bf4-8343-79a16545cfa7 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:26.846352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc64fa-78b7-4bf4-8343-79a16545cfa7 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:26.851488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7703d87-e03c-47ea-bb63-e866cd228207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:26.852099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7703d87-e03c-47ea-bb63-e866cd228207 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.852383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7703d87-e03c-47ea-bb63-e866cd228207 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.852661 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7703d87-e03c-47ea-bb63-e866cd228207 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.853309 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7703d87-e03c-47ea-bb63-e866cd228207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:26.854950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7703d87-e03c-47ea-bb63-e866cd228207 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:26.867112 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4471/8955] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:53:26.871449 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bd097-f3b4-4349-960a-35052e855b58 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:26.883078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bd097-f3b4-4349-960a-35052e855b58 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:26.888077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afb3dc-a226-48f9-85be-dbe9b4aba2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:26.888743 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afb3dc-a226-48f9-85be-dbe9b4aba2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.889021 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afb3dc-a226-48f9-85be-dbe9b4aba2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.889295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afb3dc-a226-48f9-85be-dbe9b4aba2ed admin admin] PATH_INFO: `/v3/projects/b50dff4c7957465297a5f69c361aaa84/users/9342c8b4405b4adcb36c5ef00707c805/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.904739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afb3dc-a226-48f9-85be-dbe9b4aba2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50dff4c7957465297a5f69c361aaa84, user_id=9342c8b4405b4adcb36c5ef00707c805, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:26.907459 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afb3dc-a226-48f9-85be-dbe9b4aba2ed admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:26.924831 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4485/8956] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:26 2022] PUT /identity/v3/projects/b50dff4c7957465297a5f69c361aaa84/users/9342c8b4405b4adcb36c5ef00707c805/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:26.930014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b89d5-c3a1-444a-a416-622ad62123f4 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:26.930356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b89d5-c3a1-444a-a416-622ad62123f4 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:26.930637 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b89d5-c3a1-444a-a416-622ad62123f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:26.950709 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9d4b89d5-c3a1-444a-a416-622ad62123f4 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:26.951903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9d4b89d5-c3a1-444a-a416-622ad62123f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:26.983665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:27.017813 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4472/8957] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:27.027780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afb3dc-a226-48f9-85be-dbe9b4aba2ed admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:27.029962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-14afb3dc-a226-48f9-85be-dbe9b4aba2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:27.093434 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afb3dc-a226-48f9-85be-dbe9b4aba2ed admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:27.098042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485fb87-2e8b-4171-908d-34ef64d9098c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:27.098659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485fb87-2e8b-4171-908d-34ef64d9098c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:27.098968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485fb87-2e8b-4171-908d-34ef64d9098c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:27.099275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485fb87-2e8b-4171-908d-34ef64d9098c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:27.108768 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485fb87-2e8b-4171-908d-34ef64d9098c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:27.110205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485fb87-2e8b-4171-908d-34ef64d9098c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:27.120724 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4486/8958] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:31.957300 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf413aa-78b6-47fb-9915-6ec098cbd1c7 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:31.957966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf413aa-78b6-47fb-9915-6ec098cbd1c7 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:31.958167 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf413aa-78b6-47fb-9915-6ec098cbd1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:31.998688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-5cf413aa-78b6-47fb-9915-6ec098cbd1c7 None None] MFA Rules not processed for user `9342c8b4405b4adcb36c5ef00707c805`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:32.000497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5cf413aa-78b6-47fb-9915-6ec098cbd1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:32.095564 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4473/8959] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:32.100331 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485fb87-2e8b-4171-908d-34ef64d9098c service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:32.117329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485fb87-2e8b-4171-908d-34ef64d9098c service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:32.123892 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2943441-3f30-40be-b24f-d434cc496055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:32.124498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2943441-3f30-40be-b24f-d434cc496055 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:32.124786 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2943441-3f30-40be-b24f-d434cc496055 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:32.125077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2943441-3f30-40be-b24f-d434cc496055 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:32.125741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2943441-3f30-40be-b24f-d434cc496055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:32.128534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2943441-3f30-40be-b24f-d434cc496055 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:32.164273 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4487/8960] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:53:32 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:53:32.168253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf413aa-78b6-47fb-9915-6ec098cbd1c7 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:32.181998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf413aa-78b6-47fb-9915-6ec098cbd1c7 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:32.259151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc9db8-2a85-48b9-9147-699a48b0c2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:32.259985 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc9db8-2a85-48b9-9147-699a48b0c2ab admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:32.260099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc9db8-2a85-48b9-9147-699a48b0c2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:32.260649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc9db8-2a85-48b9-9147-699a48b0c2ab admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:32.261721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc9db8-2a85-48b9-9147-699a48b0c2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:32.263997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc9db8-2a85-48b9-9147-699a48b0c2ab admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:32.299406 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4474/8961] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:53:32 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:53:32.303949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2943441-3f30-40be-b24f-d434cc496055 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:32.315587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2943441-3f30-40be-b24f-d434cc496055 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:32.320884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a3cc2-524a-4c90-9981-07b3719444a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:32.321512 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a3cc2-524a-4c90-9981-07b3719444a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:32.321813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a3cc2-524a-4c90-9981-07b3719444a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:32.322088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a3cc2-524a-4c90-9981-07b3719444a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:32.322755 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a3cc2-524a-4c90-9981-07b3719444a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:32.324386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a3cc2-524a-4c90-9981-07b3719444a9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:32.340014 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4488/8962] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:53:32.344262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc9db8-2a85-48b9-9147-699a48b0c2ab admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:32.356396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc9db8-2a85-48b9-9147-699a48b0c2ab admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:32.361213 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35dca8-6824-4fc8-9ea0-f5c50391ccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:32.362487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35dca8-6824-4fc8-9ea0-f5c50391ccd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:32.362938 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35dca8-6824-4fc8-9ea0-f5c50391ccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:32.363217 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35dca8-6824-4fc8-9ea0-f5c50391ccd0 admin admin] PATH_INFO: `/v3/projects/8ce5f1c8c3d2449da50e8b7c75ee4c9e/users/f261ab2797f9443b997eef7d87b9ff9d/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:32.379900 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35dca8-6824-4fc8-9ea0-f5c50391ccd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce5f1c8c3d2449da50e8b7c75ee4c9e, user_id=f261ab2797f9443b997eef7d87b9ff9d, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:32.382670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35dca8-6824-4fc8-9ea0-f5c50391ccd0 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:32.399816 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4475/8963] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:32 2022] PUT /identity/v3/projects/8ce5f1c8c3d2449da50e8b7c75ee4c9e/users/f261ab2797f9443b997eef7d87b9ff9d/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:53:32.404195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a3cc2-524a-4c90-9981-07b3719444a9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:32.417119 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a3cc2-524a-4c90-9981-07b3719444a9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:32.489273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d20eb-077a-4255-b903-eda64b967d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:32.489957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d20eb-077a-4255-b903-eda64b967d59 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:32.490268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d20eb-077a-4255-b903-eda64b967d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:32.490587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d20eb-077a-4255-b903-eda64b967d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:32.491293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d20eb-077a-4255-b903-eda64b967d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:32.492903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d20eb-077a-4255-b903-eda64b967d59 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:32.504296 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4489/8964] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:53:32.508624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35dca8-6824-4fc8-9ea0-f5c50391ccd0 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:32.519873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35dca8-6824-4fc8-9ea0-f5c50391ccd0 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:32.527013 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9275556-7f99-4d6a-944a-26c3c0329a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:32.527711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9275556-7f99-4d6a-944a-26c3c0329a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:32.527995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9275556-7f99-4d6a-944a-26c3c0329a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:32.528272 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9275556-7f99-4d6a-944a-26c3c0329a1c admin admin] PATH_INFO: `/v3/projects/8ce5f1c8c3d2449da50e8b7c75ee4c9e/users/f261ab2797f9443b997eef7d87b9ff9d/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:32.530295 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9275556-7f99-4d6a-944a-26c3c0329a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce5f1c8c3d2449da50e8b7c75ee4c9e, user_id=f261ab2797f9443b997eef7d87b9ff9d, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:32.533068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9275556-7f99-4d6a-944a-26c3c0329a1c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:32.544967 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4476/8965] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:53:32 2022] PUT /identity/v3/projects/8ce5f1c8c3d2449da50e8b7c75ee4c9e/users/f261ab2797f9443b997eef7d87b9ff9d/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:53:37.207025 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adeef2-865b-412e-864e-a2b1fd257d5c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:37.207586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adeef2-865b-412e-864e-a2b1fd257d5c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:37.208066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adeef2-865b-412e-864e-a2b1fd257d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:37.243207 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-45adeef2-865b-412e-864e-a2b1fd257d5c None None] MFA Rules not processed for user `f261ab2797f9443b997eef7d87b9ff9d`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:37.244804 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-45adeef2-865b-412e-864e-a2b1fd257d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:37.287166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:37.350017 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4490/8966] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:37.370403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9275556-7f99-4d6a-944a-26c3c0329a1c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:37.372285 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a9275556-7f99-4d6a-944a-26c3c0329a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:37.411260 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:37.490927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9275556-7f99-4d6a-944a-26c3c0329a1c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:37.496803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b28fa-c6d3-49a9-ac60-d323be261d24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:37.497425 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b28fa-c6d3-49a9-ac60-d323be261d24 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:37.497705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b28fa-c6d3-49a9-ac60-d323be261d24 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:37.497986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b28fa-c6d3-49a9-ac60-d323be261d24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:37.573494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b28fa-c6d3-49a9-ac60-d323be261d24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:37.575187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b28fa-c6d3-49a9-ac60-d323be261d24 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:37.585769 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4477/8967] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:37.657877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553bdee-b802-42e2-9164-10d70c6bd583 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:37.658178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553bdee-b802-42e2-9164-10d70c6bd583 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:37.658501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553bdee-b802-42e2-9164-10d70c6bd583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:37.682078 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9553bdee-b802-42e2-9164-10d70c6bd583 None None] MFA Rules not processed for user `9342c8b4405b4adcb36c5ef00707c805`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:37.683365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9553bdee-b802-42e2-9164-10d70c6bd583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:37.691224 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4491/8968] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:53:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:53:46.969902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7a141-4631-45ad-983d-07568030f6a3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:46.970329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7a141-4631-45ad-983d-07568030f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:46.970452 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7a141-4631-45ad-983d-07568030f6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:47.009123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-efd7a141-4631-45ad-983d-07568030f6a3 None None] MFA Rules not processed for user `afece3fa01d040a1ae8e035ea3ff3219`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:53:47.010594 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-efd7a141-4631-45ad-983d-07568030f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:53:47.063327 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4478/8969] 10.222.0.70 () {58 vars in 1061 bytes} [Sun Aug 28 19:53:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:53:47.069468 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553bdee-b802-42e2-9164-10d70c6bd583 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:53:47.079035 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553bdee-b802-42e2-9164-10d70c6bd583 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:53:47.083220 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c549a-3e95-4451-8deb-a996fa67f755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:53:47.083834 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c549a-3e95-4451-8deb-a996fa67f755 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:53:47.084118 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c549a-3e95-4451-8deb-a996fa67f755 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:53:47.084394 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c549a-3e95-4451-8deb-a996fa67f755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:53:47.093386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c549a-3e95-4451-8deb-a996fa67f755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:53:47.094848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c549a-3e95-4451-8deb-a996fa67f755 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:53:47.105384 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4492/8970] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:53:47 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:53:57.057494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=82 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:53:57.100938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=27 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:12.434353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628557f0-7e75-4c9f-aaf9-264b3360e2d2 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:12.434854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628557f0-7e75-4c9f-aaf9-264b3360e2d2 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:12.434964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628557f0-7e75-4c9f-aaf9-264b3360e2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:12.454187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-628557f0-7e75-4c9f-aaf9-264b3360e2d2 None None] MFA Rules not processed for user `9342c8b4405b4adcb36c5ef00707c805`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:12.456052 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-628557f0-7e75-4c9f-aaf9-264b3360e2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:12.462850 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4479/8971] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:54:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:22.449565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:54:47.499047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c549a-3e95-4451-8deb-a996fa67f755 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:47.500601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-333c549a-3e95-4451-8deb-a996fa67f755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:47.575112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c549a-3e95-4451-8deb-a996fa67f755 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:47.578688 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb603263-47b0-4dd3-bbcd-354db99952ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:47.579739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603263-47b0-4dd3-bbcd-354db99952ae service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:47.579921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603263-47b0-4dd3-bbcd-354db99952ae service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:47.580209 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb603263-47b0-4dd3-bbcd-354db99952ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:47.582110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bb603263-47b0-4dd3-bbcd-354db99952ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:47.596477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb603263-47b0-4dd3-bbcd-354db99952ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:47.597908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb603263-47b0-4dd3-bbcd-354db99952ae service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:47.608594 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4493/8972] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:54:50.029987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ad11a-59a3-4918-b6df-8230e0b249cc None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:50.030528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ad11a-59a3-4918-b6df-8230e0b249cc None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:50.030528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ad11a-59a3-4918-b6df-8230e0b249cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:50.050481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-d30ad11a-59a3-4918-b6df-8230e0b249cc None None] MFA Rules not processed for user `9342c8b4405b4adcb36c5ef00707c805`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:54:50.051828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-d30ad11a-59a3-4918-b6df-8230e0b249cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:50.058600 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4480/8973] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:54:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:54:50.655518 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb603263-47b0-4dd3-bbcd-354db99952ae service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:54:50.664780 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb603263-47b0-4dd3-bbcd-354db99952ae service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:54:50.668354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab9981-a4df-409d-bec3-24046544bb71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:54:50.668947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab9981-a4df-409d-bec3-24046544bb71 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:54:50.669227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab9981-a4df-409d-bec3-24046544bb71 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:54:50.669504 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab9981-a4df-409d-bec3-24046544bb71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:54:50.671222 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-06ab9981-a4df-409d-bec3-24046544bb71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:54:50.686154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab9981-a4df-409d-bec3-24046544bb71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:54:50.687619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab9981-a4df-409d-bec3-24046544bb71 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:54:50.700107 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4494/8974] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:54:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:00.047172 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:00.695672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=32 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:23.627662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ad11a-59a3-4918-b6df-8230e0b249cc None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:23.659939 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ad11a-59a3-4918-b6df-8230e0b249cc None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:23.697085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5efc5a-cb2c-49c3-a434-eebd33a5f52b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:23.698289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5efc5a-cb2c-49c3-a434-eebd33a5f52b service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:23.698604 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5efc5a-cb2c-49c3-a434-eebd33a5f52b service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:23.699080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5efc5a-cb2c-49c3-a434-eebd33a5f52b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:23.710133 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7c5efc5a-cb2c-49c3-a434-eebd33a5f52b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:23.727680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5efc5a-cb2c-49c3-a434-eebd33a5f52b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:23.729311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5efc5a-cb2c-49c3-a434-eebd33a5f52b service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:23.744835 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4481/8975] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:28.209463 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43764c6f-ee56-46a1-95d2-b355995f7ffd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.209885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43764c6f-ee56-46a1-95d2-b355995f7ffd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.211592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43764c6f-ee56-46a1-95d2-b355995f7ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.236062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-43764c6f-ee56-46a1-95d2-b355995f7ffd None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:28.237326 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-43764c6f-ee56-46a1-95d2-b355995f7ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:28.347440 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4495/8976] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 19:55:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:28.358621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5efc5a-cb2c-49c3-a434-eebd33a5f52b service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:28.360091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7c5efc5a-cb2c-49c3-a434-eebd33a5f52b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:28.374587 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5efc5a-cb2c-49c3-a434-eebd33a5f52b service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:28.381356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2662de5-08d9-4946-8fdb-945256debf90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:28.381981 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2662de5-08d9-4946-8fdb-945256debf90 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:28.382330 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2662de5-08d9-4946-8fdb-945256debf90 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:28.382614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2662de5-08d9-4946-8fdb-945256debf90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:28.392775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2662de5-08d9-4946-8fdb-945256debf90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:28.394602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2662de5-08d9-4946-8fdb-945256debf90 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:28.405354 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4482/8977] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:31.608687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43764c6f-ee56-46a1-95d2-b355995f7ffd None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:31.699565 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43764c6f-ee56-46a1-95d2-b355995f7ffd None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:31.707289 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:31.707951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:31.708232 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:31.708509 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] PATH_INFO: `/v3/users/9342c8b4405b4adcb36c5ef00707c805` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:31.709665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=9342c8b4405b4adcb36c5ef00707c805)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:31.720287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:31.766350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9342c8b4405b4adcb36c5ef00707c805'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:31.774497 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9342c8b4405b4adcb36c5ef00707c805'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:31.775241 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9342c8b4405b4adcb36c5ef00707c805'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:31.790308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9342c8b4405b4adcb36c5ef00707c805'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:31.791310 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9342c8b4405b4adcb36c5ef00707c805'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:31.810831 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4496/8978] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:31 2022] DELETE /identity/v3/users/9342c8b4405b4adcb36c5ef00707c805 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:31.994402 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2662de5-08d9-4946-8fdb-945256debf90 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:32.011954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2662de5-08d9-4946-8fdb-945256debf90 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:32.083230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:32.083914 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:32.084221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:32.084496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] PATH_INFO: `/v3/projects/b50dff4c7957465297a5f69c361aaa84` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:32.085795 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50dff4c7957465297a5f69c361aaa84)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:32.087920 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:32.141170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50dff4c7957465297a5f69c361aaa84', 'request_id': 'req-b6e55cb6-1270-4428-a5be-b5a99790e43c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.148557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50dff4c7957465297a5f69c361aaa84', 'request_id': 'req-b6e55cb6-1270-4428-a5be-b5a99790e43c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.155443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50dff4c7957465297a5f69c361aaa84', 'request_id': 'req-b6e55cb6-1270-4428-a5be-b5a99790e43c'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.169608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] The token cache is being invalidate because project b50dff4c7957465297a5f69c361aaa84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:32.169826 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.170459 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.172246 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4483/8979] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:31 2022] DELETE /identity/v3/projects/b50dff4c7957465297a5f69c361aaa84 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:32.179408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:32.180942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:32.194670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba872c6-4420-42e3-b6f5-c03cc01912ef admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:32.207685 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:32.261113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbe2da-38bf-47b2-af0c-fb97278599fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:32.261752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbe2da-38bf-47b2-af0c-fb97278599fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:32.262039 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbe2da-38bf-47b2-af0c-fb97278599fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:32.262315 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbe2da-38bf-47b2-af0c-fb97278599fb admin admin] PATH_INFO: `/v3/users/f261ab2797f9443b997eef7d87b9ff9d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:32.263499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbe2da-38bf-47b2-af0c-fb97278599fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f261ab2797f9443b997eef7d87b9ff9d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:32.265458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbe2da-38bf-47b2-af0c-fb97278599fb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:32.331718 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2bbbe2da-38bf-47b2-af0c-fb97278599fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f261ab2797f9443b997eef7d87b9ff9d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.338901 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2bbbe2da-38bf-47b2-af0c-fb97278599fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f261ab2797f9443b997eef7d87b9ff9d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.339909 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2bbbe2da-38bf-47b2-af0c-fb97278599fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f261ab2797f9443b997eef7d87b9ff9d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.352816 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2bbbe2da-38bf-47b2-af0c-fb97278599fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f261ab2797f9443b997eef7d87b9ff9d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.353499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2bbbe2da-38bf-47b2-af0c-fb97278599fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f261ab2797f9443b997eef7d87b9ff9d'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.368050 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4497/8980] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 19:55:32 2022] DELETE /identity/v3/users/f261ab2797f9443b997eef7d87b9ff9d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:32.600431 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:32.602258 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:32.616410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e55cb6-1270-4428-a5be-b5a99790e43c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:32.694145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61927316-fb50-4dc6-9ab6-abebca5976c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:32.694145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61927316-fb50-4dc6-9ab6-abebca5976c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:32.694145 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61927316-fb50-4dc6-9ab6-abebca5976c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:32.695873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61927316-fb50-4dc6-9ab6-abebca5976c7 admin admin] PATH_INFO: `/v3/projects/8ce5f1c8c3d2449da50e8b7c75ee4c9e` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:32.696784 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61927316-fb50-4dc6-9ab6-abebca5976c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce5f1c8c3d2449da50e8b7c75ee4c9e)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:32.698772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61927316-fb50-4dc6-9ab6-abebca5976c7 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:32.706549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:32.757728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-61927316-fb50-4dc6-9ab6-abebca5976c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce5f1c8c3d2449da50e8b7c75ee4c9e', 'request_id': 'req-61927316-fb50-4dc6-9ab6-abebca5976c7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.767877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-61927316-fb50-4dc6-9ab6-abebca5976c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce5f1c8c3d2449da50e8b7c75ee4c9e', 'request_id': 'req-61927316-fb50-4dc6-9ab6-abebca5976c7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.779469 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-61927316-fb50-4dc6-9ab6-abebca5976c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce5f1c8c3d2449da50e8b7c75ee4c9e', 'request_id': 'req-61927316-fb50-4dc6-9ab6-abebca5976c7'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.797659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-61927316-fb50-4dc6-9ab6-abebca5976c7 admin admin] The token cache is being invalidate because project 8ce5f1c8c3d2449da50e8b7c75ee4c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 19:55:32.798913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-61927316-fb50-4dc6-9ab6-abebca5976c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.799847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-61927316-fb50-4dc6-9ab6-abebca5976c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 19:55:32.801441 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4484/8981] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 19:55:32 2022] DELETE /identity/v3/projects/8ce5f1c8c3d2449da50e8b7c75ee4c9e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:32.806880 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1203f-a763-49c6-a1e9-10b07b7f00f8 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:32.807411 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1203f-a763-49c6-a1e9-10b07b7f00f8 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:32.807522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1203f-a763-49c6-a1e9-10b07b7f00f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:32.831668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-81b1203f-a763-49c6-a1e9-10b07b7f00f8 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:32.833034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-81b1203f-a763-49c6-a1e9-10b07b7f00f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:32.901507 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4498/8982] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:32.910357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e20f2-f253-4cf4-8557-d98d4553e4b5 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:32.910676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e20f2-f253-4cf4-8557-d98d4553e4b5 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:32.910987 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e20f2-f253-4cf4-8557-d98d4553e4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:32.932964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0e2e20f2-f253-4cf4-8557-d98d4553e4b5 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:32.934350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0e2e20f2-f253-4cf4-8557-d98d4553e4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:32.942521 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4485/8983] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:32.947415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1203f-a763-49c6-a1e9-10b07b7f00f8 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:32.959373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1203f-a763-49c6-a1e9-10b07b7f00f8 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:32.964294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f1349-2508-44ba-9cb3-419fe52080d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:32.964904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f1349-2508-44ba-9cb3-419fe52080d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:32.965183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f1349-2508-44ba-9cb3-419fe52080d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:32.965457 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f1349-2508-44ba-9cb3-419fe52080d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:32.966100 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f1349-2508-44ba-9cb3-419fe52080d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 19:55:32.966403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f1349-2508-44ba-9cb3-419fe52080d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:32.968093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f1349-2508-44ba-9cb3-419fe52080d0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:32.989336 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4499/8984] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 19:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 19:55:32.994588 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e20f2-f253-4cf4-8557-d98d4553e4b5 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:33.007245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e20f2-f253-4cf4-8557-d98d4553e4b5 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:33.012881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c496027-eca1-44c8-925d-8c3923cc5efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:33.013556 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c496027-eca1-44c8-925d-8c3923cc5efe admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.013887 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c496027-eca1-44c8-925d-8c3923cc5efe admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.014166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c496027-eca1-44c8-925d-8c3923cc5efe admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.014903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c496027-eca1-44c8-925d-8c3923cc5efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:33.017719 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c496027-eca1-44c8-925d-8c3923cc5efe admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:33.058778 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4486/8985] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:32 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 19:55:33.060193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f1349-2508-44ba-9cb3-419fe52080d0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:33.071613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f1349-2508-44ba-9cb3-419fe52080d0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:33.093895 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:33.154287 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37dd2e-cf7b-4f6d-98ab-e135cad68feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:33.154952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37dd2e-cf7b-4f6d-98ab-e135cad68feb admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.155244 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37dd2e-cf7b-4f6d-98ab-e135cad68feb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.155529 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37dd2e-cf7b-4f6d-98ab-e135cad68feb admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.156180 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37dd2e-cf7b-4f6d-98ab-e135cad68feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:33.158829 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37dd2e-cf7b-4f6d-98ab-e135cad68feb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:33.188216 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4500/8986] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:33 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:33.196575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c496027-eca1-44c8-925d-8c3923cc5efe admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:33.212790 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c496027-eca1-44c8-925d-8c3923cc5efe admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:33.217645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa5f62-5893-4403-a9d4-9b14b02a91ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:33.218199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa5f62-5893-4403-a9d4-9b14b02a91ed admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.218480 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa5f62-5893-4403-a9d4-9b14b02a91ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.218763 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa5f62-5893-4403-a9d4-9b14b02a91ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.219477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa5f62-5893-4403-a9d4-9b14b02a91ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:33.221656 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa5f62-5893-4403-a9d4-9b14b02a91ed admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:33.237795 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4487/8987] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:55:33.244691 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37dd2e-cf7b-4f6d-98ab-e135cad68feb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:33.262179 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37dd2e-cf7b-4f6d-98ab-e135cad68feb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:33.270661 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879641bc-1cd5-4989-bc8a-c7df2e72275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:33.271624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879641bc-1cd5-4989-bc8a-c7df2e72275f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.272055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879641bc-1cd5-4989-bc8a-c7df2e72275f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.272464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879641bc-1cd5-4989-bc8a-c7df2e72275f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.273477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879641bc-1cd5-4989-bc8a-c7df2e72275f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:33.276668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879641bc-1cd5-4989-bc8a-c7df2e72275f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:33.303474 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4501/8988] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:33.311958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa5f62-5893-4403-a9d4-9b14b02a91ed admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:33.329754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa5f62-5893-4403-a9d4-9b14b02a91ed admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:33.340772 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f2698-de46-41fd-a210-afdf0540aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:33.342682 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f2698-de46-41fd-a210-afdf0540aeab admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.343559 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f2698-de46-41fd-a210-afdf0540aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.344199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f2698-de46-41fd-a210-afdf0540aeab admin admin] PATH_INFO: `/v3/projects/cc9fabbd10714e16860efe1d68d07a3a/users/80c5628f8f2b4238955c5e7eac12cb84/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.384759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f2698-de46-41fd-a210-afdf0540aeab admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9fabbd10714e16860efe1d68d07a3a, user_id=80c5628f8f2b4238955c5e7eac12cb84, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:33.387595 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f2698-de46-41fd-a210-afdf0540aeab admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:33.404404 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4488/8989] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:33 2022] PUT /identity/v3/projects/cc9fabbd10714e16860efe1d68d07a3a/users/80c5628f8f2b4238955c5e7eac12cb84/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:33.411612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666da64b-578c-4662-a418-cb5be6f7f578 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.412093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666da64b-578c-4662-a418-cb5be6f7f578 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.412511 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666da64b-578c-4662-a418-cb5be6f7f578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.447727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-666da64b-578c-4662-a418-cb5be6f7f578 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:33.449908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-666da64b-578c-4662-a418-cb5be6f7f578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:33.555429 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4502/8990] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:33.569444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f2698-de46-41fd-a210-afdf0540aeab admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:33.571700 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1d4f2698-de46-41fd-a210-afdf0540aeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:33.642758 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f2698-de46-41fd-a210-afdf0540aeab admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:33.647866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c3b9e-122f-4671-9866-f9c5cdfc5ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:33.648565 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c3b9e-122f-4671-9866-f9c5cdfc5ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:33.648892 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c3b9e-122f-4671-9866-f9c5cdfc5ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:33.649255 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c3b9e-122f-4671-9866-f9c5cdfc5ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:33.661026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c3b9e-122f-4671-9866-f9c5cdfc5ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:33.662484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c3b9e-122f-4671-9866-f9c5cdfc5ce0 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:33.674672 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4489/8991] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:37.752427 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f5f69-a6df-4d60-898d-17f7a782e37c None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:37.753160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f5f69-a6df-4d60-898d-17f7a782e37c None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:37.753160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f5f69-a6df-4d60-898d-17f7a782e37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:37.797951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-6e4f5f69-a6df-4d60-898d-17f7a782e37c None None] MFA Rules not processed for user `80c5628f8f2b4238955c5e7eac12cb84`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:37.799732 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6e4f5f69-a6df-4d60-898d-17f7a782e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:37.898803 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4503/8992] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:55:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:37.904690 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c3b9e-122f-4671-9866-f9c5cdfc5ce0 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:37.924960 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c3b9e-122f-4671-9866-f9c5cdfc5ce0 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:37.933110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb4c43-23c9-4988-8336-3b202dc8bd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:37.934267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb4c43-23c9-4988-8336-3b202dc8bd26 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:37.934885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb4c43-23c9-4988-8336-3b202dc8bd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:37.935568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb4c43-23c9-4988-8336-3b202dc8bd26 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:37.936720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb4c43-23c9-4988-8336-3b202dc8bd26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:37.941007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb4c43-23c9-4988-8336-3b202dc8bd26 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:37.978784 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4490/8993] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 19:55:37 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:37.983085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f5f69-a6df-4d60-898d-17f7a782e37c None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:37.996833 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f5f69-a6df-4d60-898d-17f7a782e37c None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:38.042291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:38.082095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c9343-323b-44fc-84c9-8b3d0bb9367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:38.082838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c9343-323b-44fc-84c9-8b3d0bb9367f admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:38.083154 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c9343-323b-44fc-84c9-8b3d0bb9367f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:38.083458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c9343-323b-44fc-84c9-8b3d0bb9367f admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:38.084115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c9343-323b-44fc-84c9-8b3d0bb9367f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:38.086212 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c9343-323b-44fc-84c9-8b3d0bb9367f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:38.116750 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4504/8994] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 19:55:37 2022] POST /identity/v3/users => generated 298 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 19:55:38.120874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb4c43-23c9-4988-8336-3b202dc8bd26 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:38.134549 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb4c43-23c9-4988-8336-3b202dc8bd26 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:38.139691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae751172-c093-4fc6-a705-27e0737be143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:38.140324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae751172-c093-4fc6-a705-27e0737be143 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:38.140670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae751172-c093-4fc6-a705-27e0737be143 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:38.140882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae751172-c093-4fc6-a705-27e0737be143 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:38.146111 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae751172-c093-4fc6-a705-27e0737be143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:38.148001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae751172-c093-4fc6-a705-27e0737be143 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:38.154966 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:38.166169 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4491/8995] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 19:55:38.167396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c9343-323b-44fc-84c9-8b3d0bb9367f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:38.179375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c9343-323b-44fc-84c9-8b3d0bb9367f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:38.185050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f10f7-7d8d-45c9-818f-0ae9884edd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:38.185889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f10f7-7d8d-45c9-818f-0ae9884edd81 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:38.186994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f10f7-7d8d-45c9-818f-0ae9884edd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:38.186994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f10f7-7d8d-45c9-818f-0ae9884edd81 admin admin] PATH_INFO: `/v3/projects/b361d769fe924338a37692dfd19f2e43/users/1cc6e5f0c0b845668cff604c24b8c860/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:38.207499 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f10f7-7d8d-45c9-818f-0ae9884edd81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b361d769fe924338a37692dfd19f2e43, user_id=1cc6e5f0c0b845668cff604c24b8c860, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:38.210387 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f10f7-7d8d-45c9-818f-0ae9884edd81 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:38.226644 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4505/8996] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:38 2022] PUT /identity/v3/projects/b361d769fe924338a37692dfd19f2e43/users/1cc6e5f0c0b845668cff604c24b8c860/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 19:55:38.231139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae751172-c093-4fc6-a705-27e0737be143 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:38.246060 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae751172-c093-4fc6-a705-27e0737be143 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:38.312678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7705aa6-4f15-49c0-941d-1e5d477d405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:38.313387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7705aa6-4f15-49c0-941d-1e5d477d405e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:38.313902 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7705aa6-4f15-49c0-941d-1e5d477d405e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:38.314073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7705aa6-4f15-49c0-941d-1e5d477d405e admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:38.314623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7705aa6-4f15-49c0-941d-1e5d477d405e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:38.316299 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7705aa6-4f15-49c0-941d-1e5d477d405e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:38.326497 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4492/8997] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 19:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 19:55:38.330947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f10f7-7d8d-45c9-818f-0ae9884edd81 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:38.342059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f10f7-7d8d-45c9-818f-0ae9884edd81 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:38.348391 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39aa556-2a76-4895-9bb2-e165574bc666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:38.349061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aa556-2a76-4895-9bb2-e165574bc666 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:38.349348 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aa556-2a76-4895-9bb2-e165574bc666 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:38.349627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39aa556-2a76-4895-9bb2-e165574bc666 admin admin] PATH_INFO: `/v3/projects/b361d769fe924338a37692dfd19f2e43/users/1cc6e5f0c0b845668cff604c24b8c860/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:38.351604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39aa556-2a76-4895-9bb2-e165574bc666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b361d769fe924338a37692dfd19f2e43, user_id=1cc6e5f0c0b845668cff604c24b8c860, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:38.354283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39aa556-2a76-4895-9bb2-e165574bc666 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:38.365965 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4506/8998] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 19:55:38 2022] PUT /identity/v3/projects/b361d769fe924338a37692dfd19f2e43/users/1cc6e5f0c0b845668cff604c24b8c860/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 19:55:43.272735 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75d3c2-645c-417e-8b6f-49ff485a948e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:43.273216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75d3c2-645c-417e-8b6f-49ff485a948e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:43.273298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75d3c2-645c-417e-8b6f-49ff485a948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:43.317935 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ea75d3c2-645c-417e-8b6f-49ff485a948e None None] MFA Rules not processed for user `1cc6e5f0c0b845668cff604c24b8c860`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:43.319312 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ea75d3c2-645c-417e-8b6f-49ff485a948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:43.416976 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4493/8999] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:55:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 19:55:43.464024 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04bac-e389-461c-95ce-e86028cffe26 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:43.464476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04bac-e389-461c-95ce-e86028cffe26 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:43.464571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04bac-e389-461c-95ce-e86028cffe26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:43.527165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-69c04bac-e389-461c-95ce-e86028cffe26 None None] MFA Rules not processed for user `332144d9eb5742498c0c37a70277ce5e`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:43.528419 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-69c04bac-e389-461c-95ce-e86028cffe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:43.618548 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4507/9000] 10.222.0.70 () {58 vars in 1064 bytes} [Sun Aug 28 19:55:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:43.624582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75d3c2-645c-417e-8b6f-49ff485a948e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:43.635481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75d3c2-645c-417e-8b6f-49ff485a948e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:43.639205 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467224f8-3b7a-41bf-be5c-605c405d6b12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:43.639891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467224f8-3b7a-41bf-be5c-605c405d6b12 service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:43.640180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467224f8-3b7a-41bf-be5c-605c405d6b12 service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:43.640467 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467224f8-3b7a-41bf-be5c-605c405d6b12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:43.711095 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467224f8-3b7a-41bf-be5c-605c405d6b12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:43.712738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467224f8-3b7a-41bf-be5c-605c405d6b12 service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:43.726068 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4494/9001] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:43.905632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a2802-d4a8-4caa-9255-d84617705f36 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:43.907381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a2802-d4a8-4caa-9255-d84617705f36 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:43.907761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a2802-d4a8-4caa-9255-d84617705f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:43.979551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4a9a2802-d4a8-4caa-9255-d84617705f36 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:43.980921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4a9a2802-d4a8-4caa-9255-d84617705f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:44.018386 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:44.092085 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4508/9002] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:55:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:44.153936 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4558-0610-4bd0-9138-e09bd0ca2651 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:44.154307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4558-0610-4bd0-9138-e09bd0ca2651 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:44.154654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d4558-0610-4bd0-9138-e09bd0ca2651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:44.191727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=100 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:55:44.226084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c27d4558-0610-4bd0-9138-e09bd0ca2651 None None] MFA Rules not processed for user `8787e53dd76c430e9ebe69b79b69827e`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:44.227720 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c27d4558-0610-4bd0-9138-e09bd0ca2651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:44.314554 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4495/9003] 10.222.0.70 () {58 vars in 1040 bytes} [Sun Aug 28 19:55:44 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:44.321835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a2802-d4a8-4caa-9255-d84617705f36 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:44.336523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a2802-d4a8-4caa-9255-d84617705f36 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:44.342847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4e3c4-2307-4648-b889-b53fef9d22b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:44.343491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4e3c4-2307-4648-b889-b53fef9d22b1 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:44.343907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4e3c4-2307-4648-b889-b53fef9d22b1 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:44.344243 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4e3c4-2307-4648-b889-b53fef9d22b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:44.357740 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4e3c4-2307-4648-b889-b53fef9d22b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:44.359376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4e3c4-2307-4648-b889-b53fef9d22b1 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:44.368807 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4509/9004] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:55:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:55:53.206813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f3a0a-a488-465f-b55c-d7bd5b95026b None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:53.207422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f3a0a-a488-465f-b55c-d7bd5b95026b None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:53.207422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f3a0a-a488-465f-b55c-d7bd5b95026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:53.230961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-6a2f3a0a-a488-465f-b55c-d7bd5b95026b None None] MFA Rules not processed for user `80c5628f8f2b4238955c5e7eac12cb84`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:53.232419 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6a2f3a0a-a488-465f-b55c-d7bd5b95026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:53.241051 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4496/9005] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 19:55:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:53.513855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4e3c4-2307-4648-b889-b53fef9d22b1 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:53.515340 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d5c4e3c4-2307-4648-b889-b53fef9d22b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:53.580325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4e3c4-2307-4648-b889-b53fef9d22b1 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:53.583927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dd74e-ff50-4b83-9a60-25279a3e9ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:53.584568 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dd74e-ff50-4b83-9a60-25279a3e9ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:53.584882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dd74e-ff50-4b83-9a60-25279a3e9ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:53.585159 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dd74e-ff50-4b83-9a60-25279a3e9ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:53.586998 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-059dd74e-ff50-4b83-9a60-25279a3e9ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:53.598392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dd74e-ff50-4b83-9a60-25279a3e9ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:53.599877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dd74e-ff50-4b83-9a60-25279a3e9ff6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:53.608130 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4510/9006] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:55:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:55:55.326220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202c8c4-16a9-49a8-86ef-458b6ae7c251 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:55.326767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202c8c4-16a9-49a8-86ef-458b6ae7c251 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:55.326880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202c8c4-16a9-49a8-86ef-458b6ae7c251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:55.347224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0202c8c4-16a9-49a8-86ef-458b6ae7c251 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 19:55:55.348369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0202c8c4-16a9-49a8-86ef-458b6ae7c251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:55:55.355872 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4497/9007] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 19:55:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 19:55:55.370133 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dd74e-ff50-4b83-9a60-25279a3e9ff6 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:55:55.386215 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dd74e-ff50-4b83-9a60-25279a3e9ff6 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:55:55.392125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17acdcb-3194-471b-a670-97d73944a992 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:55:55.392723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17acdcb-3194-471b-a670-97d73944a992 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:55:55.393010 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17acdcb-3194-471b-a670-97d73944a992 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:55:55.393261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17acdcb-3194-471b-a670-97d73944a992 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:55:55.404730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17acdcb-3194-471b-a670-97d73944a992 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:55:55.407102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17acdcb-3194-471b-a670-97d73944a992 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:55:55.420109 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4511/9008] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 19:55:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 19:56:05.341745 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=41 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:05.414257 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=51 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:12.588471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202c8c4-16a9-49a8-86ef-458b6ae7c251 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:12.590068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0202c8c4-16a9-49a8-86ef-458b6ae7c251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:12.671961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202c8c4-16a9-49a8-86ef-458b6ae7c251 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:12.680238 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624b750-04bc-4b4c-b9d8-46d93a5fc83c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:12.680788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624b750-04bc-4b4c-b9d8-46d93a5fc83c service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:12.681073 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624b750-04bc-4b4c-b9d8-46d93a5fc83c service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:12.681343 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624b750-04bc-4b4c-b9d8-46d93a5fc83c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:12.684211 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7624b750-04bc-4b4c-b9d8-46d93a5fc83c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:56:12.698874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624b750-04bc-4b4c-b9d8-46d93a5fc83c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:12.700451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624b750-04bc-4b4c-b9d8-46d93a5fc83c service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:12.710825 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4498/9009] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:56:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:56:22.706492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=34 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:56:31.039456 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17acdcb-3194-471b-a670-97d73944a992 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:56:31.061978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17acdcb-3194-471b-a670-97d73944a992 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:56:31.073283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07238817-f7ae-431d-9a4b-31332b60dda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:56:31.073929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07238817-f7ae-431d-9a4b-31332b60dda6 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:56:31.074211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07238817-f7ae-431d-9a4b-31332b60dda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:56:31.074498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07238817-f7ae-431d-9a4b-31332b60dda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:56:31.086649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07238817-f7ae-431d-9a4b-31332b60dda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:56:31.088071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07238817-f7ae-431d-9a4b-31332b60dda6 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:56:31.098830 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4512/9010] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:56:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:56:41.093741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:57:36.203678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624b750-04bc-4b4c-b9d8-46d93a5fc83c service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:57:36.221200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624b750-04bc-4b4c-b9d8-46d93a5fc83c service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:57:36.227443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ccfbc-c07b-4689-8d1c-14e8583cb9a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:57:36.228484 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ccfbc-c07b-4689-8d1c-14e8583cb9a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:57:36.228970 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ccfbc-c07b-4689-8d1c-14e8583cb9a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:57:36.229465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ccfbc-c07b-4689-8d1c-14e8583cb9a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:57:36.232377 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-214ccfbc-c07b-4689-8d1c-14e8583cb9a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:57:36.250051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ccfbc-c07b-4689-8d1c-14e8583cb9a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:57:36.252791 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ccfbc-c07b-4689-8d1c-14e8583cb9a4 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:57:36.263467 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4499/9011] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:57:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:57:46.259788 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:58:22.490679 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07238817-f7ae-431d-9a4b-31332b60dda6 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:58:22.492359 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-07238817-f7ae-431d-9a4b-31332b60dda6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:22.580554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07238817-f7ae-431d-9a4b-31332b60dda6 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:58:22.587563 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d993f63-c9f6-4203-9da3-7ed4e1939537 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:58:22.588951 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d993f63-c9f6-4203-9da3-7ed4e1939537 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:22.589448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d993f63-c9f6-4203-9da3-7ed4e1939537 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:22.589799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d993f63-c9f6-4203-9da3-7ed4e1939537 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:22.592735 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4d993f63-c9f6-4203-9da3-7ed4e1939537 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:22.611643 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d993f63-c9f6-4203-9da3-7ed4e1939537 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:58:22.614628 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d993f63-c9f6-4203-9da3-7ed4e1939537 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:58:22.634308 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4513/9012] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:58:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 19:58:22.691129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ccfbc-c07b-4689-8d1c-14e8583cb9a4 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 19:58:22.692976 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-214ccfbc-c07b-4689-8d1c-14e8583cb9a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:22.708888 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ccfbc-c07b-4689-8d1c-14e8583cb9a4 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 19:58:22.714794 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b351-0117-4480-a3be-63b1eeef22c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 19:58:22.715671 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b351-0117-4480-a3be-63b1eeef22c2 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 19:58:22.715958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b351-0117-4480-a3be-63b1eeef22c2 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 19:58:22.716234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b351-0117-4480-a3be-63b1eeef22c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 19:58:22.718627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b837b351-0117-4480-a3be-63b1eeef22c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 19:58:22.730842 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837b351-0117-4480-a3be-63b1eeef22c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 19:58:22.732997 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837b351-0117-4480-a3be-63b1eeef22c2 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 19:58:22.745092 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4500/9013] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 19:58:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 19:58:32.625723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=36 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 19:58:32.739778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:32.953292 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d993f63-c9f6-4203-9da3-7ed4e1939537 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:32.974664 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d993f63-c9f6-4203-9da3-7ed4e1939537 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:32.978216 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c981ec-8d7f-41fb-989e-f9c5c12f5e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:32.978855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c981ec-8d7f-41fb-989e-f9c5c12f5e20 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:32.979137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c981ec-8d7f-41fb-989e-f9c5c12f5e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:32.979412 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c981ec-8d7f-41fb-989e-f9c5c12f5e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:32.981191 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c5c981ec-8d7f-41fb-989e-f9c5c12f5e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:33.043614 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c981ec-8d7f-41fb-989e-f9c5c12f5e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:33.045066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c981ec-8d7f-41fb-989e-f9c5c12f5e20 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:33.068650 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4514/9014] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:33.518269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b351-0117-4480-a3be-63b1eeef22c2 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:33.530344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b837b351-0117-4480-a3be-63b1eeef22c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:33.705663 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b351-0117-4480-a3be-63b1eeef22c2 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:33.713738 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00265e6-fedf-4045-b794-d39fa4794d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:33.714652 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00265e6-fedf-4045-b794-d39fa4794d42 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:33.714992 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00265e6-fedf-4045-b794-d39fa4794d42 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:33.715277 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00265e6-fedf-4045-b794-d39fa4794d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:33.717084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a00265e6-fedf-4045-b794-d39fa4794d42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:33.731909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00265e6-fedf-4045-b794-d39fa4794d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:33.733803 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00265e6-fedf-4045-b794-d39fa4794d42 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:33.747831 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4501/9015] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:00:43.064975 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=32 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:43.742221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=28 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:00:43.912018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c981ec-8d7f-41fb-989e-f9c5c12f5e20 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:43.913477 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c5c981ec-8d7f-41fb-989e-f9c5c12f5e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:43.978926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c981ec-8d7f-41fb-989e-f9c5c12f5e20 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:43.982538 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a9b95-4d8c-46db-9d1d-a7eaa8dac473 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afece3fa01d040a1ae8e035ea3ff3219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:43.983183 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a9b95-4d8c-46db-9d1d-a7eaa8dac473 service cinder] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:43.983472 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a9b95-4d8c-46db-9d1d-a7eaa8dac473 service cinder] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:43.983750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a9b95-4d8c-46db-9d1d-a7eaa8dac473 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:43.993395 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a9b95-4d8c-46db-9d1d-a7eaa8dac473 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:43.994801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a9b95-4d8c-46db-9d1d-a7eaa8dac473 service cinder] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:44.005429 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4515/9016] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:45.403200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00265e6-fedf-4045-b794-d39fa4794d42 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:45.413885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00265e6-fedf-4045-b794-d39fa4794d42 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:45.417664 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40885714-d296-467f-87c6-3900a44283a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:45.418262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40885714-d296-467f-87c6-3900a44283a1 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:45.418546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40885714-d296-467f-87c6-3900a44283a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:45.418851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40885714-d296-467f-87c6-3900a44283a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:45.420621 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-40885714-d296-467f-87c6-3900a44283a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:45.434398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40885714-d296-467f-87c6-3900a44283a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:45.435975 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40885714-d296-467f-87c6-3900a44283a1 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:45.446993 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4502/9017] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:46.457580 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a9b95-4d8c-46db-9d1d-a7eaa8dac473 service cinder] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:46.470840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a9b95-4d8c-46db-9d1d-a7eaa8dac473 service cinder] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:46.478205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560884d-ceb3-414d-b961-862cc81fac28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:46.479433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560884d-ceb3-414d-b961-862cc81fac28 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:46.479854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560884d-ceb3-414d-b961-862cc81fac28 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:46.480134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560884d-ceb3-414d-b961-862cc81fac28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:46.482137 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8560884d-ceb3-414d-b961-862cc81fac28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:46.496830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560884d-ceb3-414d-b961-862cc81fac28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:46.498489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560884d-ceb3-414d-b961-862cc81fac28 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:46.510094 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4516/9018] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:47.824471 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8dfa0-d215-4b1c-9939-b8ff7d4fbc13 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:47.825065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8dfa0-d215-4b1c-9939-b8ff7d4fbc13 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:47.825065 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8dfa0-d215-4b1c-9939-b8ff7d4fbc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:47.863086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9af8dfa0-d215-4b1c-9939-b8ff7d4fbc13 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:47.864856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9af8dfa0-d215-4b1c-9939-b8ff7d4fbc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:47.873128 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4503/9019] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 20:00:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:47.916112 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560884d-ceb3-414d-b961-862cc81fac28 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:47.927699 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560884d-ceb3-414d-b961-862cc81fac28 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:47.933311 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a9aff-b4d7-4fda-8773-3793c11148dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:47.933917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a9aff-b4d7-4fda-8773-3793c11148dd service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:47.934200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a9aff-b4d7-4fda-8773-3793c11148dd service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:47.934476 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a9aff-b4d7-4fda-8773-3793c11148dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:47.943451 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a9aff-b4d7-4fda-8773-3793c11148dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:47.945042 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a9aff-b4d7-4fda-8773-3793c11148dd service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:47.953684 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4517/9020] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 20:00:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:00:48.436623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e75fe6-5fe2-40ff-b728-d8c0a73bf365 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:48.436929 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e75fe6-5fe2-40ff-b728-d8c0a73bf365 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:48.437232 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e75fe6-5fe2-40ff-b728-d8c0a73bf365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:48.461541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-a7e75fe6-5fe2-40ff-b728-d8c0a73bf365 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:48.462849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a7e75fe6-5fe2-40ff-b728-d8c0a73bf365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:48.470869 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4504/9021] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 20:00:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:48.484448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a9aff-b4d7-4fda-8773-3793c11148dd service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:48.496562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a9aff-b4d7-4fda-8773-3793c11148dd service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:48.501865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83a98f-6608-4ba7-ae23-1f68c33d7c42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:48.502473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83a98f-6608-4ba7-ae23-1f68c33d7c42 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:48.502875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83a98f-6608-4ba7-ae23-1f68c33d7c42 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:48.503065 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83a98f-6608-4ba7-ae23-1f68c33d7c42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:48.512586 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83a98f-6608-4ba7-ae23-1f68c33d7c42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:48.514189 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83a98f-6608-4ba7-ae23-1f68c33d7c42 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:48.524891 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4518/9022] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 20:00:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:00:56.977680 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c106bc9-f934-470f-ac19-e8b16e410267 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:56.978192 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c106bc9-f934-470f-ac19-e8b16e410267 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:56.978287 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c106bc9-f934-470f-ac19-e8b16e410267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:56.998444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-2c106bc9-f934-470f-ac19-e8b16e410267 None None] MFA Rules not processed for user `80c5628f8f2b4238955c5e7eac12cb84`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:56.999706 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2c106bc9-f934-470f-ac19-e8b16e410267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:57.007655 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4505/9023] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:00:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:57.279135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83a98f-6608-4ba7-ae23-1f68c33d7c42 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:57.289646 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83a98f-6608-4ba7-ae23-1f68c33d7c42 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:57.294632 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225aa419-aefc-4d05-91b4-c78668feda41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:57.295741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225aa419-aefc-4d05-91b4-c78668feda41 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:57.296255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225aa419-aefc-4d05-91b4-c78668feda41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:57.296777 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225aa419-aefc-4d05-91b4-c78668feda41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:57.299676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-225aa419-aefc-4d05-91b4-c78668feda41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:57.315782 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225aa419-aefc-4d05-91b4-c78668feda41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:57.317275 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225aa419-aefc-4d05-91b4-c78668feda41 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:57.325304 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4519/9024] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:00:57.688810 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c106bc9-f934-470f-ac19-e8b16e410267 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:57.702562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c106bc9-f934-470f-ac19-e8b16e410267 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:57.708673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e28ab-e7a3-4bbd-b5f8-8ce292dfcaa5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:57.709297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e28ab-e7a3-4bbd-b5f8-8ce292dfcaa5 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:57.710039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e28ab-e7a3-4bbd-b5f8-8ce292dfcaa5 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:57.710039 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e28ab-e7a3-4bbd-b5f8-8ce292dfcaa5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:57.711631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4d7e28ab-e7a3-4bbd-b5f8-8ce292dfcaa5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:57.724048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e28ab-e7a3-4bbd-b5f8-8ce292dfcaa5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:57.725659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e28ab-e7a3-4bbd-b5f8-8ce292dfcaa5 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:57.736620 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4506/9025] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:00:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:00:58.955256 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2f6df-eaf9-46e0-8b4a-133ea545e63b None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:58.955797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2f6df-eaf9-46e0-8b4a-133ea545e63b None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:58.955797 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2f6df-eaf9-46e0-8b4a-133ea545e63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:58.978995 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-18a2f6df-eaf9-46e0-8b4a-133ea545e63b None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:00:58.980246 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-18a2f6df-eaf9-46e0-8b4a-133ea545e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:00:58.988759 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4520/9026] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 20:00:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:00:59.001544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e28ab-e7a3-4bbd-b5f8-8ce292dfcaa5 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:00:59.015115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e28ab-e7a3-4bbd-b5f8-8ce292dfcaa5 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:00:59.021365 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224048d2-5d34-4ae3-8a49-ee28b99a008d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:00:59.022096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224048d2-5d34-4ae3-8a49-ee28b99a008d service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:00:59.022385 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224048d2-5d34-4ae3-8a49-ee28b99a008d service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:00:59.022674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224048d2-5d34-4ae3-8a49-ee28b99a008d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:00:59.031903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224048d2-5d34-4ae3-8a49-ee28b99a008d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:00:59.033912 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224048d2-5d34-4ae3-8a49-ee28b99a008d service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:00:59.046985 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4507/9027] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 20:00:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:01:06.583460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2f6df-eaf9-46e0-8b4a-133ea545e63b None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:01:06.592985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2f6df-eaf9-46e0-8b4a-133ea545e63b None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:01:06.596551 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98056a46-5317-40f0-8647-77d78f8ca682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:01:06.597152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98056a46-5317-40f0-8647-77d78f8ca682 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:01:06.597490 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98056a46-5317-40f0-8647-77d78f8ca682 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:01:06.597774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98056a46-5317-40f0-8647-77d78f8ca682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:01:06.600266 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-98056a46-5317-40f0-8647-77d78f8ca682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:01:06.609723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98056a46-5317-40f0-8647-77d78f8ca682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:01:06.611175 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98056a46-5317-40f0-8647-77d78f8ca682 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:01:06.619928 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4521/9028] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:01:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:01:09.043603 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=31 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:01:16.615802 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=59 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:45.732102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434dbd6-c80c-475d-b7a8-de5bf2f6023f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:45.732638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434dbd6-c80c-475d-b7a8-de5bf2f6023f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:45.732638 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434dbd6-c80c-475d-b7a8-de5bf2f6023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:45.753518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f434dbd6-c80c-475d-b7a8-de5bf2f6023f None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:45.754760 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f434dbd6-c80c-475d-b7a8-de5bf2f6023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:45.769898 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4508/9029] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 20:02:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:45.810458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98056a46-5317-40f0-8647-77d78f8ca682 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:45.823362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98056a46-5317-40f0-8647-77d78f8ca682 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:45.828367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf6abe-5f88-44f4-b7c2-dc0787b0c2aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:45.828973 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf6abe-5f88-44f4-b7c2-dc0787b0c2aa service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:45.829260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf6abe-5f88-44f4-b7c2-dc0787b0c2aa service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:45.829539 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf6abe-5f88-44f4-b7c2-dc0787b0c2aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:45.838968 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf6abe-5f88-44f4-b7c2-dc0787b0c2aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:45.840545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf6abe-5f88-44f4-b7c2-dc0787b0c2aa service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:45.849849 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4522/9030] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 20:02:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:02:46.223611 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434dbd6-c80c-475d-b7a8-de5bf2f6023f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:46.234081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434dbd6-c80c-475d-b7a8-de5bf2f6023f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:46.238358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e1527-8962-482a-83ef-2d054455d25b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:46.239043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e1527-8962-482a-83ef-2d054455d25b service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:46.239355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e1527-8962-482a-83ef-2d054455d25b service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:46.239635 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e1527-8962-482a-83ef-2d054455d25b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:46.324785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e1527-8962-482a-83ef-2d054455d25b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:46.326224 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e1527-8962-482a-83ef-2d054455d25b service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:46.345964 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4509/9031] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:49.654111 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf6abe-5f88-44f4-b7c2-dc0787b0c2aa service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:49.666447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf6abe-5f88-44f4-b7c2-dc0787b0c2aa service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:49.671475 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bd86b-c583-49d7-bd7a-4e0a8f4df38c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:49.672091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bd86b-c583-49d7-bd7a-4e0a8f4df38c service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:49.672374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bd86b-c583-49d7-bd7a-4e0a8f4df38c service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:49.672652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bd86b-c583-49d7-bd7a-4e0a8f4df38c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:49.674577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-280bd86b-c583-49d7-bd7a-4e0a8f4df38c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:49.701985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bd86b-c583-49d7-bd7a-4e0a8f4df38c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:49.703625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bd86b-c583-49d7-bd7a-4e0a8f4df38c service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:49.718255 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4523/9032] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:53.069495 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e1527-8962-482a-83ef-2d054455d25b service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:53.082685 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e1527-8962-482a-83ef-2d054455d25b service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:53.095535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8d860-e90a-4b74-9490-dd6d83bd8205 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:53.096180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8d860-e90a-4b74-9490-dd6d83bd8205 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:53.096453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8d860-e90a-4b74-9490-dd6d83bd8205 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:53.096727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8d860-e90a-4b74-9490-dd6d83bd8205 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:53.098472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1bd8d860-e90a-4b74-9490-dd6d83bd8205 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:53.111909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8d860-e90a-4b74-9490-dd6d83bd8205 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:53.113525 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8d860-e90a-4b74-9490-dd6d83bd8205 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:53.124790 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4510/9033] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:53.144838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bd86b-c583-49d7-bd7a-4e0a8f4df38c service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:53.159624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bd86b-c583-49d7-bd7a-4e0a8f4df38c service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:53.165198 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:53.166178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:53.166503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:53.167150 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] PATH_INFO: `/v3/users/80c5628f8f2b4238955c5e7eac12cb84` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:53.168464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c5628f8f2b4238955c5e7eac12cb84)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:53.170495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:53.223813 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c5628f8f2b4238955c5e7eac12cb84'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.231962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c5628f8f2b4238955c5e7eac12cb84'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.232657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c5628f8f2b4238955c5e7eac12cb84'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.245873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c5628f8f2b4238955c5e7eac12cb84'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.246527 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c5628f8f2b4238955c5e7eac12cb84'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.260949 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4524/9034] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 20:02:53 2022] DELETE /identity/v3/users/80c5628f8f2b4238955c5e7eac12cb84 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:53.439926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8d860-e90a-4b74-9490-dd6d83bd8205 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:53.451877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8d860-e90a-4b74-9490-dd6d83bd8205 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:53.514886 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:53.515539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:53.515824 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:53.516101 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] PATH_INFO: `/v3/projects/cc9fabbd10714e16860efe1d68d07a3a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:53.517240 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9fabbd10714e16860efe1d68d07a3a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:53.519207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:53.570688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9fabbd10714e16860efe1d68d07a3a', 'request_id': 'req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.572614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:53.577066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9fabbd10714e16860efe1d68d07a3a', 'request_id': 'req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.585212 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9fabbd10714e16860efe1d68d07a3a', 'request_id': 'req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.614026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] The token cache is being invalidate because project cc9fabbd10714e16860efe1d68d07a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:02:53.614319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.614949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.616499 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4511/9035] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 20:02:53 2022] DELETE /identity/v3/projects/cc9fabbd10714e16860efe1d68d07a3a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:53.620778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:53.622279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:53.636390 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657d724-1449-4d04-8455-faa01fa585b5 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:53.702279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c4744-53fd-4884-9207-96969fc8410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:53.702867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4744-53fd-4884-9207-96969fc8410a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:53.703151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4744-53fd-4884-9207-96969fc8410a admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:53.703425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4744-53fd-4884-9207-96969fc8410a admin admin] PATH_INFO: `/v3/users/1cc6e5f0c0b845668cff604c24b8c860` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:53.704663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c4744-53fd-4884-9207-96969fc8410a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc6e5f0c0b845668cff604c24b8c860)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:53.706606 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c4744-53fd-4884-9207-96969fc8410a admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:53.747535 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:53.757924 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dc8c4744-53fd-4884-9207-96969fc8410a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc6e5f0c0b845668cff604c24b8c860'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.766109 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dc8c4744-53fd-4884-9207-96969fc8410a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc6e5f0c0b845668cff604c24b8c860'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.766846 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dc8c4744-53fd-4884-9207-96969fc8410a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc6e5f0c0b845668cff604c24b8c860'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.780404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dc8c4744-53fd-4884-9207-96969fc8410a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc6e5f0c0b845668cff604c24b8c860'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.781136 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-dc8c4744-53fd-4884-9207-96969fc8410a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc6e5f0c0b845668cff604c24b8c860'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:53.797716 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4525/9036] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 20:02:53 2022] DELETE /identity/v3/users/1cc6e5f0c0b845668cff604c24b8c860 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:53.994636 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:53.996444 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:54.012230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c73df1-70a9-4abe-b4b7-b6f1d9859c02 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:54.083033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27f0ee-415f-4f46-b263-ae5d2ceae617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:54.084777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27f0ee-415f-4f46-b263-ae5d2ceae617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:54.084777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27f0ee-415f-4f46-b263-ae5d2ceae617 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:54.084777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27f0ee-415f-4f46-b263-ae5d2ceae617 admin admin] PATH_INFO: `/v3/projects/b361d769fe924338a37692dfd19f2e43` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:54.086267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27f0ee-415f-4f46-b263-ae5d2ceae617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b361d769fe924338a37692dfd19f2e43)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:54.089437 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27f0ee-415f-4f46-b263-ae5d2ceae617 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:54.140096 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc27f0ee-415f-4f46-b263-ae5d2ceae617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b361d769fe924338a37692dfd19f2e43', 'request_id': 'req-dc27f0ee-415f-4f46-b263-ae5d2ceae617'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:54.146814 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc27f0ee-415f-4f46-b263-ae5d2ceae617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b361d769fe924338a37692dfd19f2e43', 'request_id': 'req-dc27f0ee-415f-4f46-b263-ae5d2ceae617'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:54.154978 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc27f0ee-415f-4f46-b263-ae5d2ceae617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b361d769fe924338a37692dfd19f2e43', 'request_id': 'req-dc27f0ee-415f-4f46-b263-ae5d2ceae617'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:54.169187 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc27f0ee-415f-4f46-b263-ae5d2ceae617 admin admin] The token cache is being invalidate because project b361d769fe924338a37692dfd19f2e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:02:54.169477 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc27f0ee-415f-4f46-b263-ae5d2ceae617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:54.170108 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-dc27f0ee-415f-4f46-b263-ae5d2ceae617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:02:54.171699 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4512/9037] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 20:02:53 2022] DELETE /identity/v3/projects/b361d769fe924338a37692dfd19f2e43 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:02:54.177013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07648556-6a34-4041-bd17-80cc28cafbdb None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:54.177533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07648556-6a34-4041-bd17-80cc28cafbdb None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:54.177652 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07648556-6a34-4041-bd17-80cc28cafbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:54.199014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-07648556-6a34-4041-bd17-80cc28cafbdb None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:54.201526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-07648556-6a34-4041-bd17-80cc28cafbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:54.269428 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4526/9038] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:54.277815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a8b7e-47e7-41c9-8015-3c629096750f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:54.278105 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a8b7e-47e7-41c9-8015-3c629096750f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:54.278384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a8b7e-47e7-41c9-8015-3c629096750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:54.299210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ae9a8b7e-47e7-41c9-8015-3c629096750f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:54.300445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ae9a8b7e-47e7-41c9-8015-3c629096750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:54.309313 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4513/9039] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:54.313634 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07648556-6a34-4041-bd17-80cc28cafbdb None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:54.324920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07648556-6a34-4041-bd17-80cc28cafbdb None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:54.329760 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ced1a-6785-4dce-96fc-0f7306263ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:54.330374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ced1a-6785-4dce-96fc-0f7306263ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:54.330662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ced1a-6785-4dce-96fc-0f7306263ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:54.330969 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ced1a-6785-4dce-96fc-0f7306263ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:54.331631 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ced1a-6785-4dce-96fc-0f7306263ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:02:54.331935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ced1a-6785-4dce-96fc-0f7306263ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:54.333550 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ced1a-6785-4dce-96fc-0f7306263ac1 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:54.346396 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4527/9040] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 20:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:02:54.352825 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a8b7e-47e7-41c9-8015-3c629096750f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:54.368701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a8b7e-47e7-41c9-8015-3c629096750f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:54.373562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21464a-7bf3-48cc-8559-60f63db98e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:54.374301 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21464a-7bf3-48cc-8559-60f63db98e05 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:54.374589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21464a-7bf3-48cc-8559-60f63db98e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:54.374903 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21464a-7bf3-48cc-8559-60f63db98e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:54.375534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21464a-7bf3-48cc-8559-60f63db98e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:54.377441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21464a-7bf3-48cc-8559-60f63db98e05 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:54.408504 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4514/9041] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 20:02:54 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:54.412860 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ced1a-6785-4dce-96fc-0f7306263ac1 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:54.423543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ced1a-6785-4dce-96fc-0f7306263ac1 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:54.482088 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ec4de-ebe5-4c57-8acb-2d5a88d528d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:54.482703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ec4de-ebe5-4c57-8acb-2d5a88d528d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:54.483022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ec4de-ebe5-4c57-8acb-2d5a88d528d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:54.483295 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ec4de-ebe5-4c57-8acb-2d5a88d528d9 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:54.483927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ec4de-ebe5-4c57-8acb-2d5a88d528d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:54.485927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ec4de-ebe5-4c57-8acb-2d5a88d528d9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:54.516611 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4528/9042] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 20:02:54 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:54.521400 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21464a-7bf3-48cc-8559-60f63db98e05 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:54.535714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21464a-7bf3-48cc-8559-60f63db98e05 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:54.540695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008d375-4f6c-4231-870d-36f14e53931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:54.541410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008d375-4f6c-4231-870d-36f14e53931d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:54.541622 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008d375-4f6c-4231-870d-36f14e53931d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:54.541849 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008d375-4f6c-4231-870d-36f14e53931d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:54.542499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008d375-4f6c-4231-870d-36f14e53931d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:54.544151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008d375-4f6c-4231-870d-36f14e53931d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:54.554990 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4515/9043] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:54.560489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ec4de-ebe5-4c57-8acb-2d5a88d528d9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:54.571663 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ec4de-ebe5-4c57-8acb-2d5a88d528d9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:54.577328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df5252-8943-42af-80b6-dfeca785eef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:54.577959 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df5252-8943-42af-80b6-dfeca785eef0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:54.578253 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df5252-8943-42af-80b6-dfeca785eef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:54.578532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df5252-8943-42af-80b6-dfeca785eef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:54.579234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df5252-8943-42af-80b6-dfeca785eef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:54.580935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df5252-8943-42af-80b6-dfeca785eef0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:54.593731 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4529/9044] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:54.597864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008d375-4f6c-4231-870d-36f14e53931d admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:54.610460 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008d375-4f6c-4231-870d-36f14e53931d admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:54.615396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d3c8-cb73-4de0-a3cf-105177653c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:54.616150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d3c8-cb73-4de0-a3cf-105177653c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:54.616358 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d3c8-cb73-4de0-a3cf-105177653c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:54.616623 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d3c8-cb73-4de0-a3cf-105177653c91 admin admin] PATH_INFO: `/v3/projects/ada8ad360e774591959b685b3b51c70b/users/9aaeea3dc104432eb9a17278e4766ae6/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:54.633235 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9d3c8-cb73-4de0-a3cf-105177653c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada8ad360e774591959b685b3b51c70b, user_id=9aaeea3dc104432eb9a17278e4766ae6, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:54.636445 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9d3c8-cb73-4de0-a3cf-105177653c91 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:54.639897 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:54.652830 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4516/9045] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:54 2022] PUT /identity/v3/projects/ada8ad360e774591959b685b3b51c70b/users/9aaeea3dc104432eb9a17278e4766ae6/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:54.663908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b2b60-583f-4e32-8e1d-c5cd4c4307e9 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:54.664201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b2b60-583f-4e32-8e1d-c5cd4c4307e9 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:54.664493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b2b60-583f-4e32-8e1d-c5cd4c4307e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:54.694630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b77b2b60-583f-4e32-8e1d-c5cd4c4307e9 None None] MFA Rules not processed for user `9aaeea3dc104432eb9a17278e4766ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:54.696402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b77b2b60-583f-4e32-8e1d-c5cd4c4307e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:54.705560 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:54.768838 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4530/9046] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:02:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:54.773777 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d3c8-cb73-4de0-a3cf-105177653c91 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:54.852479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d3c8-cb73-4de0-a3cf-105177653c91 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:54.857660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f2583-b95b-441f-82e9-fc624bb169dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:54.858276 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f2583-b95b-441f-82e9-fc624bb169dc admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:54.858564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f2583-b95b-441f-82e9-fc624bb169dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:54.858898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f2583-b95b-441f-82e9-fc624bb169dc admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:54.859539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f2583-b95b-441f-82e9-fc624bb169dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:54.861458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f2583-b95b-441f-82e9-fc624bb169dc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:54.891901 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4517/9047] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 20:02:54 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:54.895769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b2b60-583f-4e32-8e1d-c5cd4c4307e9 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:54.908493 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b2b60-583f-4e32-8e1d-c5cd4c4307e9 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:54.972211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c6d92-712f-4220-8cac-2da5babd5ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:54.973018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c6d92-712f-4220-8cac-2da5babd5ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:54.973182 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c6d92-712f-4220-8cac-2da5babd5ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:54.973400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c6d92-712f-4220-8cac-2da5babd5ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:54.974056 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c6d92-712f-4220-8cac-2da5babd5ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:54.976034 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c6d92-712f-4220-8cac-2da5babd5ce6 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:54.999448 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4531/9048] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 20:02:54 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:02:55.003582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f2583-b95b-441f-82e9-fc624bb169dc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:55.015324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f2583-b95b-441f-82e9-fc624bb169dc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:55.020180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccda91-745f-45be-b9de-d3549ff06631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:55.021025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccda91-745f-45be-b9de-d3549ff06631 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:55.021155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccda91-745f-45be-b9de-d3549ff06631 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:55.021392 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccda91-745f-45be-b9de-d3549ff06631 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:55.021971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccda91-745f-45be-b9de-d3549ff06631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:55.023624 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccda91-745f-45be-b9de-d3549ff06631 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:55.034847 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4518/9049] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:55.039004 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c6d92-712f-4220-8cac-2da5babd5ce6 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:55.049263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c6d92-712f-4220-8cac-2da5babd5ce6 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:55.054581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428e3e4-c4d1-4dd7-8068-f76eb9422e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:55.055814 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428e3e4-c4d1-4dd7-8068-f76eb9422e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:55.056102 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428e3e4-c4d1-4dd7-8068-f76eb9422e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:55.056378 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428e3e4-c4d1-4dd7-8068-f76eb9422e24 admin admin] PATH_INFO: `/v3/projects/0ca9f565787a4ecd87e61158babfc327/users/7878ba8493af469a964d0df60e3c07d5/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:55.073066 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428e3e4-c4d1-4dd7-8068-f76eb9422e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca9f565787a4ecd87e61158babfc327, user_id=7878ba8493af469a964d0df60e3c07d5, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:55.075967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428e3e4-c4d1-4dd7-8068-f76eb9422e24 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:55.091057 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4532/9050] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:55 2022] PUT /identity/v3/projects/0ca9f565787a4ecd87e61158babfc327/users/7878ba8493af469a964d0df60e3c07d5/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:55.095170 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccda91-745f-45be-b9de-d3549ff06631 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:55.106355 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccda91-745f-45be-b9de-d3549ff06631 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:55.165836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782d383-0de9-444b-90a7-008e81860775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:55.166442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782d383-0de9-444b-90a7-008e81860775 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:55.166722 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782d383-0de9-444b-90a7-008e81860775 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:55.167026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782d383-0de9-444b-90a7-008e81860775 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:55.167666 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782d383-0de9-444b-90a7-008e81860775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:55.169283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782d383-0de9-444b-90a7-008e81860775 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:55.179659 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4519/9051] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 20:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:02:55.184059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428e3e4-c4d1-4dd7-8068-f76eb9422e24 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:55.194978 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428e3e4-c4d1-4dd7-8068-f76eb9422e24 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:55.200495 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f53998-7c31-4e4e-b85d-d98d23ea95a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:55.201153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f53998-7c31-4e4e-b85d-d98d23ea95a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:55.201433 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f53998-7c31-4e4e-b85d-d98d23ea95a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:55.201730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f53998-7c31-4e4e-b85d-d98d23ea95a0 admin admin] PATH_INFO: `/v3/projects/0ca9f565787a4ecd87e61158babfc327/users/7878ba8493af469a964d0df60e3c07d5/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:55.203675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f53998-7c31-4e4e-b85d-d98d23ea95a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca9f565787a4ecd87e61158babfc327, user_id=7878ba8493af469a964d0df60e3c07d5, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:55.206374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f53998-7c31-4e4e-b85d-d98d23ea95a0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:55.218105 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4533/9052] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 20:02:55 2022] PUT /identity/v3/projects/0ca9f565787a4ecd87e61158babfc327/users/7878ba8493af469a964d0df60e3c07d5/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:02:55.229158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6ab3f-e0f3-4b8f-82c3-e55b27404f28 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:55.229450 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6ab3f-e0f3-4b8f-82c3-e55b27404f28 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:55.229727 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6ab3f-e0f3-4b8f-82c3-e55b27404f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:55.259180 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-22a6ab3f-e0f3-4b8f-82c3-e55b27404f28 None None] MFA Rules not processed for user `7878ba8493af469a964d0df60e3c07d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:02:55.260446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-22a6ab3f-e0f3-4b8f-82c3-e55b27404f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:55.313933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:55.338076 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4520/9053] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:02:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:02:55.353160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f53998-7c31-4e4e-b85d-d98d23ea95a0 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:55.355106 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-62f53998-7c31-4e4e-b85d-d98d23ea95a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:55.419156 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:02:55.435859 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f53998-7c31-4e4e-b85d-d98d23ea95a0 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:55.441498 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9be15-0172-4bd4-8a0a-6a4d617823fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:55.442115 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9be15-0172-4bd4-8a0a-6a4d617823fe service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:55.442397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9be15-0172-4bd4-8a0a-6a4d617823fe service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:55.442672 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9be15-0172-4bd4-8a0a-6a4d617823fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:55.501573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9be15-0172-4bd4-8a0a-6a4d617823fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:55.503218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9be15-0172-4bd4-8a0a-6a4d617823fe service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:55.512567 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4534/9054] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:02:58.354413 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6ab3f-e0f3-4b8f-82c3-e55b27404f28 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:02:58.356025 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-22a6ab3f-e0f3-4b8f-82c3-e55b27404f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:02:58.422442 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6ab3f-e0f3-4b8f-82c3-e55b27404f28 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:02:58.426551 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5fb56-1cfa-47a6-924e-fc9e96b22ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:02:58.427324 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5fb56-1cfa-47a6-924e-fc9e96b22ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:02:58.427606 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5fb56-1cfa-47a6-924e-fc9e96b22ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:02:58.427881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5fb56-1cfa-47a6-924e-fc9e96b22ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:02:58.438631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5fb56-1cfa-47a6-924e-fc9e96b22ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:02:58.440091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5fb56-1cfa-47a6-924e-fc9e96b22ba5 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:02:58.450820 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4521/9055] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:02:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:01.334026 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eba140-8353-4679-b627-0ecdfcf4dd46 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:01.334635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eba140-8353-4679-b627-0ecdfcf4dd46 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:01.334934 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eba140-8353-4679-b627-0ecdfcf4dd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:01.367974 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-80eba140-8353-4679-b627-0ecdfcf4dd46 None None] MFA Rules not processed for user `9aaeea3dc104432eb9a17278e4766ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:03:01.369830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-80eba140-8353-4679-b627-0ecdfcf4dd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:01.378426 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4535/9056] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:03:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:03:02.168649 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5fb56-1cfa-47a6-924e-fc9e96b22ba5 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:02.171317 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-50a5fb56-1cfa-47a6-924e-fc9e96b22ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:02.256773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5fb56-1cfa-47a6-924e-fc9e96b22ba5 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:02.263531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b918d2-2525-42e8-b525-b7ae85ba91ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:02.264163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b918d2-2525-42e8-b525-b7ae85ba91ca service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:02.265132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b918d2-2525-42e8-b525-b7ae85ba91ca service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:02.265453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b918d2-2525-42e8-b525-b7ae85ba91ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:02.267406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-95b918d2-2525-42e8-b525-b7ae85ba91ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:02.281126 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b918d2-2525-42e8-b525-b7ae85ba91ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:02.282896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b918d2-2525-42e8-b525-b7ae85ba91ca service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:02.294076 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4522/9057] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:04.256972 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eba140-8353-4679-b627-0ecdfcf4dd46 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:04.259543 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-80eba140-8353-4679-b627-0ecdfcf4dd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:04.273971 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eba140-8353-4679-b627-0ecdfcf4dd46 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:04.279200 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5c610-119f-47ed-8703-c5dfeade4c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:04.280113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5c610-119f-47ed-8703-c5dfeade4c6e service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:04.280624 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5c610-119f-47ed-8703-c5dfeade4c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:04.280967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5c610-119f-47ed-8703-c5dfeade4c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:04.283825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-bed5c610-119f-47ed-8703-c5dfeade4c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:04.300894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5c610-119f-47ed-8703-c5dfeade4c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:04.302907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5c610-119f-47ed-8703-c5dfeade4c6e service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:04.316617 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4536/9058] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:10.572717 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b918d2-2525-42e8-b525-b7ae85ba91ca service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:10.586913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b918d2-2525-42e8-b525-b7ae85ba91ca service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:10.592542 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d1463-7a1e-403c-b739-00efdcdc89e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:10.593153 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d1463-7a1e-403c-b739-00efdcdc89e1 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:10.593440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d1463-7a1e-403c-b739-00efdcdc89e1 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:10.593841 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d1463-7a1e-403c-b739-00efdcdc89e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:10.595695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-606d1463-7a1e-403c-b739-00efdcdc89e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:10.611281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d1463-7a1e-403c-b739-00efdcdc89e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:10.612893 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d1463-7a1e-403c-b739-00efdcdc89e1 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:10.626106 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4523/9059] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:14.312186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=37 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:20.620608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=68 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:27.660230 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5c610-119f-47ed-8703-c5dfeade4c6e service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:27.674766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5c610-119f-47ed-8703-c5dfeade4c6e service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:27.681051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670dc80b-a3c2-4986-a80b-fdc65f769274 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:27.681938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dc80b-a3c2-4986-a80b-fdc65f769274 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:27.683188 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dc80b-a3c2-4986-a80b-fdc65f769274 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:27.683584 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670dc80b-a3c2-4986-a80b-fdc65f769274 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:27.685849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-670dc80b-a3c2-4986-a80b-fdc65f769274 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:27.699099 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dc80b-a3c2-4986-a80b-fdc65f769274 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:27.700702 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670dc80b-a3c2-4986-a80b-fdc65f769274 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:27.711343 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4537/9060] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:28.445359 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d1463-7a1e-403c-b739-00efdcdc89e1 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:03:28.457380 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d1463-7a1e-403c-b739-00efdcdc89e1 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:03:28.462615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545548b-2645-48de-9ffc-bc93dc3531ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:03:28.463244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545548b-2645-48de-9ffc-bc93dc3531ee service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:03:28.463530 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545548b-2645-48de-9ffc-bc93dc3531ee service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:03:28.463828 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545548b-2645-48de-9ffc-bc93dc3531ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:03:28.466390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a545548b-2645-48de-9ffc-bc93dc3531ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:03:28.478219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545548b-2645-48de-9ffc-bc93dc3531ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:03:28.479853 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545548b-2645-48de-9ffc-bc93dc3531ee service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:03:28.489820 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4524/9061] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:03:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:03:37.706621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:03:38.485673 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:39.928432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2745d85-d10f-4914-9755-708a267dbfff None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:39.928939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2745d85-d10f-4914-9755-708a267dbfff None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:39.929396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2745d85-d10f-4914-9755-708a267dbfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:39.966648 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d2745d85-d10f-4914-9755-708a267dbfff None None] MFA Rules not processed for user `9aaeea3dc104432eb9a17278e4766ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:04:39.968217 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d2745d85-d10f-4914-9755-708a267dbfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:39.978169 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4538/9062] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:04:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:04:40.641707 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545548b-2645-48de-9ffc-bc93dc3531ee service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:04:40.666881 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545548b-2645-48de-9ffc-bc93dc3531ee service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:04:40.677033 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f3395-d719-477e-ab99-d06bd7950bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:04:40.678866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f3395-d719-477e-ab99-d06bd7950bfe service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:04:40.679675 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f3395-d719-477e-ab99-d06bd7950bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:04:40.680547 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f3395-d719-477e-ab99-d06bd7950bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:04:40.684237 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-168f3395-d719-477e-ab99-d06bd7950bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:04:40.735701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f3395-d719-477e-ab99-d06bd7950bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:04:40.738953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f3395-d719-477e-ab99-d06bd7950bfe service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:04:40.771307 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4525/9063] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:04:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:04:49.955980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:04:50.749850 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=11 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:05:33.768199 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2745d85-d10f-4914-9755-708a267dbfff None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:05:33.779852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2745d85-d10f-4914-9755-708a267dbfff None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:05:33.784211 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c77dd-fe61-4e84-a995-ed27a6401f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:05:33.784842 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c77dd-fe61-4e84-a995-ed27a6401f06 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:05:33.785123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c77dd-fe61-4e84-a995-ed27a6401f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:05:33.785396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c77dd-fe61-4e84-a995-ed27a6401f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:05:33.787255 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e84c77dd-fe61-4e84-a995-ed27a6401f06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:05:33.817988 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c77dd-fe61-4e84-a995-ed27a6401f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:05:33.819556 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c77dd-fe61-4e84-a995-ed27a6401f06 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:05:33.831482 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4539/9064] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:05:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:05:43.825874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=11 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:05.606149 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f3395-d719-477e-ab99-d06bd7950bfe service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:05.608174 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-168f3395-d719-477e-ab99-d06bd7950bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:05.628171 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f3395-d719-477e-ab99-d06bd7950bfe service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:05.634177 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac71ff2-93f3-481f-8a82-fd37750213eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:05.634816 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac71ff2-93f3-481f-8a82-fd37750213eb service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:05.635110 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac71ff2-93f3-481f-8a82-fd37750213eb service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:05.635387 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac71ff2-93f3-481f-8a82-fd37750213eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:05.637102 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aac71ff2-93f3-481f-8a82-fd37750213eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:05.651838 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac71ff2-93f3-481f-8a82-fd37750213eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:05.653463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac71ff2-93f3-481f-8a82-fd37750213eb service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:05.665101 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4526/9065] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:05.811882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c77dd-fe61-4e84-a995-ed27a6401f06 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:05.821748 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c77dd-fe61-4e84-a995-ed27a6401f06 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:05.825715 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d173d8-9491-4e75-9a7a-35cb176bef17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:05.826368 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d173d8-9491-4e75-9a7a-35cb176bef17 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:05.826654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d173d8-9491-4e75-9a7a-35cb176bef17 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:05.826954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d173d8-9491-4e75-9a7a-35cb176bef17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:05.829447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-89d173d8-9491-4e75-9a7a-35cb176bef17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:05.843911 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d173d8-9491-4e75-9a7a-35cb176bef17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:05.845819 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d173d8-9491-4e75-9a7a-35cb176bef17 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:05.858492 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4540/9066] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:06.931694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac71ff2-93f3-481f-8a82-fd37750213eb service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:06.941868 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac71ff2-93f3-481f-8a82-fd37750213eb service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:06.945567 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566a359-3316-46f5-ab3b-e6746aeef050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:06.946173 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566a359-3316-46f5-ab3b-e6746aeef050 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:06.946457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566a359-3316-46f5-ab3b-e6746aeef050 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:06.946733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566a359-3316-46f5-ab3b-e6746aeef050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:06.948488 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4566a359-3316-46f5-ab3b-e6746aeef050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:06.958913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566a359-3316-46f5-ab3b-e6746aeef050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:06.960367 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566a359-3316-46f5-ab3b-e6746aeef050 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:06.968334 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4527/9067] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:07.740957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d173d8-9491-4e75-9a7a-35cb176bef17 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:07.759914 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d173d8-9491-4e75-9a7a-35cb176bef17 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:07.767369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acc535-4bb7-47a4-820a-bdc142a67787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:07.767985 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acc535-4bb7-47a4-820a-bdc142a67787 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:07.768272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acc535-4bb7-47a4-820a-bdc142a67787 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:07.768548 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acc535-4bb7-47a4-820a-bdc142a67787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:07.771178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c8acc535-4bb7-47a4-820a-bdc142a67787 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:07.785210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acc535-4bb7-47a4-820a-bdc142a67787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:07.786840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acc535-4bb7-47a4-820a-bdc142a67787 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:07.799619 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4541/9068] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:16.965372 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=12 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:17.347244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b3961-a9cd-4a4a-b253-93bc6c5f8a4a None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:17.347535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b3961-a9cd-4a4a-b253-93bc6c5f8a4a None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:17.347811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b3961-a9cd-4a4a-b253-93bc6c5f8a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:17.372051 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-778b3961-a9cd-4a4a-b253-93bc6c5f8a4a None None] MFA Rules not processed for user `9aaeea3dc104432eb9a17278e4766ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:06:17.373280 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-778b3961-a9cd-4a4a-b253-93bc6c5f8a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:17.383038 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4528/9069] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:06:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:06:17.759404 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acc535-4bb7-47a4-820a-bdc142a67787 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:06:17.770205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acc535-4bb7-47a4-820a-bdc142a67787 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:06:17.775057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156a7de-ca14-4ef5-aef7-5260b39bc4ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:06:17.776018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156a7de-ca14-4ef5-aef7-5260b39bc4ca service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:06:17.776447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156a7de-ca14-4ef5-aef7-5260b39bc4ca service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:06:17.776823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156a7de-ca14-4ef5-aef7-5260b39bc4ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:06:17.779324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0156a7de-ca14-4ef5-aef7-5260b39bc4ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:06:17.791809 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156a7de-ca14-4ef5-aef7-5260b39bc4ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:06:17.793374 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156a7de-ca14-4ef5-aef7-5260b39bc4ca service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:06:17.806016 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4542/9070] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:06:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:06:27.364422 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:06:27.800703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=18 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:35.619579 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc54ed9-39cf-4226-8385-a381c3341b04 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:35.620206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc54ed9-39cf-4226-8385-a381c3341b04 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:35.620206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc54ed9-39cf-4226-8385-a381c3341b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:35.677376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-4cc54ed9-39cf-4226-8385-a381c3341b04 None None] MFA Rules not processed for user `02ed42702778456ab336afdd250a1d41`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:35.678679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-4cc54ed9-39cf-4226-8385-a381c3341b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:35.698852 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4529/9071] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 20:07:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:07:35.712844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156a7de-ca14-4ef5-aef7-5260b39bc4ca service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:35.735894 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156a7de-ca14-4ef5-aef7-5260b39bc4ca service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:35.739739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9034ca-40e5-428e-be71-d268eaf7e7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:35.740350 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9034ca-40e5-428e-be71-d268eaf7e7ec service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:35.740630 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9034ca-40e5-428e-be71-d268eaf7e7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:35.740907 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9034ca-40e5-428e-be71-d268eaf7e7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:35.749547 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9034ca-40e5-428e-be71-d268eaf7e7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:35.752214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9034ca-40e5-428e-be71-d268eaf7e7ec service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:35.764171 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4543/9072] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:35.849409 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03c007-b377-49e5-bd2e-5a498e65675d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:35.849726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03c007-b377-49e5-bd2e-5a498e65675d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:35.849954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03c007-b377-49e5-bd2e-5a498e65675d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:35.894864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9e03c007-b377-49e5-bd2e-5a498e65675d None None] MFA Rules not processed for user `0055d9c941024cdc894104f1345540fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:35.896086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9e03c007-b377-49e5-bd2e-5a498e65675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:35.906424 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4530/9073] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 20:07:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:07:35.918321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9034ca-40e5-428e-be71-d268eaf7e7ec service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:35.931730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9034ca-40e5-428e-be71-d268eaf7e7ec service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:35.938598 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156d95c-47ac-495e-a214-7e9d3c01a112 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:35.939322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156d95c-47ac-495e-a214-7e9d3c01a112 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:35.939596 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156d95c-47ac-495e-a214-7e9d3c01a112 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:35.939870 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156d95c-47ac-495e-a214-7e9d3c01a112 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:35.948781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156d95c-47ac-495e-a214-7e9d3c01a112 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:35.950385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156d95c-47ac-495e-a214-7e9d3c01a112 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:35.961588 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4544/9074] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:36.154265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e09a22-9bde-48b6-9909-3b81d09cec30 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:36.155001 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e09a22-9bde-48b6-9909-3b81d09cec30 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:36.155383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e09a22-9bde-48b6-9909-3b81d09cec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:36.205519 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-42e09a22-9bde-48b6-9909-3b81d09cec30 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:07:36.206655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-42e09a22-9bde-48b6-9909-3b81d09cec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:36.217029 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4531/9075] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 20:07:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:07:36.228680 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156d95c-47ac-495e-a214-7e9d3c01a112 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:36.242186 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156d95c-47ac-495e-a214-7e9d3c01a112 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:36.246711 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f79de6-4575-49eb-bc20-d14123aecc1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:36.248126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f79de6-4575-49eb-bc20-d14123aecc1c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:36.248416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f79de6-4575-49eb-bc20-d14123aecc1c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:36.248836 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f79de6-4575-49eb-bc20-d14123aecc1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:36.259904 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f79de6-4575-49eb-bc20-d14123aecc1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:36.261325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f79de6-4575-49eb-bc20-d14123aecc1c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:36.273283 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4545/9076] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:07:36.337705 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e09a22-9bde-48b6-9909-3b81d09cec30 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:36.351155 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e09a22-9bde-48b6-9909-3b81d09cec30 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:36.356655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be8090-b7a7-47cf-9460-d070714aa2fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:36.357856 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be8090-b7a7-47cf-9460-d070714aa2fe service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:36.358134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be8090-b7a7-47cf-9460-d070714aa2fe service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:36.358410 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be8090-b7a7-47cf-9460-d070714aa2fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:36.360168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b2be8090-b7a7-47cf-9460-d070714aa2fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:07:36.373511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be8090-b7a7-47cf-9460-d070714aa2fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:36.375132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be8090-b7a7-47cf-9460-d070714aa2fe service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:36.385344 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4532/9077] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:07:46.268128 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=22 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:46.381273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=41 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:07:54.222187 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f79de6-4575-49eb-bc20-d14123aecc1c service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:07:54.237206 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f79de6-4575-49eb-bc20-d14123aecc1c service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:07:54.244838 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c20f9f-27c3-4f5c-b56f-9846f7599478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:07:54.245485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20f9f-27c3-4f5c-b56f-9846f7599478 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:07:54.245769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20f9f-27c3-4f5c-b56f-9846f7599478 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:07:54.246051 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20f9f-27c3-4f5c-b56f-9846f7599478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:07:54.258303 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c20f9f-27c3-4f5c-b56f-9846f7599478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:07:54.259649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c20f9f-27c3-4f5c-b56f-9846f7599478 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:07:54.275250 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4546/9078] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:07:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:04.266393 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:27.227426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be8090-b7a7-47cf-9460-d070714aa2fe service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:27.229560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b2be8090-b7a7-47cf-9460-d070714aa2fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:27.253885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be8090-b7a7-47cf-9460-d070714aa2fe service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:27.259660 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2fd6f-7e54-4246-8333-04e0f3d234f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:27.260284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2fd6f-7e54-4246-8333-04e0f3d234f5 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:27.260572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2fd6f-7e54-4246-8333-04e0f3d234f5 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:27.260851 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2fd6f-7e54-4246-8333-04e0f3d234f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:27.270069 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2fd6f-7e54-4246-8333-04e0f3d234f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:27.272379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2fd6f-7e54-4246-8333-04e0f3d234f5 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:27.283903 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4533/9079] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:30.871937 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c20f9f-27c3-4f5c-b56f-9846f7599478 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:30.887228 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c20f9f-27c3-4f5c-b56f-9846f7599478 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:30.897017 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d6189-51d8-44e1-8d9e-f843325c90e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:30.898373 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d6189-51d8-44e1-8d9e-f843325c90e1 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:30.898989 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d6189-51d8-44e1-8d9e-f843325c90e1 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:30.899279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d6189-51d8-44e1-8d9e-f843325c90e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:30.902050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ed9d6189-51d8-44e1-8d9e-f843325c90e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:30.918963 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d6189-51d8-44e1-8d9e-f843325c90e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:30.921986 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d6189-51d8-44e1-8d9e-f843325c90e1 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:30.940305 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4547/9080] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:33.438628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2fd6f-7e54-4246-8333-04e0f3d234f5 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:33.449813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2fd6f-7e54-4246-8333-04e0f3d234f5 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:33.458423 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f6f33-3450-4af5-9c66-21ce1c87ae5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:33.459291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f6f33-3450-4af5-9c66-21ce1c87ae5d service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:33.459711 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f6f33-3450-4af5-9c66-21ce1c87ae5d service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:33.460219 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f6f33-3450-4af5-9c66-21ce1c87ae5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:33.470552 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f6f33-3450-4af5-9c66-21ce1c87ae5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:33.472261 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f6f33-3450-4af5-9c66-21ce1c87ae5d service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:33.484117 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4534/9081] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:34.393144 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d6189-51d8-44e1-8d9e-f843325c90e1 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:34.405309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d6189-51d8-44e1-8d9e-f843325c90e1 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:34.410050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f8bde-0fbb-4ce0-aaef-9b903b2324ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:34.410689 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f8bde-0fbb-4ce0-aaef-9b903b2324ff service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:34.411482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f8bde-0fbb-4ce0-aaef-9b903b2324ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:34.411910 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f8bde-0fbb-4ce0-aaef-9b903b2324ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:34.425807 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f8bde-0fbb-4ce0-aaef-9b903b2324ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:34.429049 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f8bde-0fbb-4ce0-aaef-9b903b2324ff service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:34.441924 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4548/9082] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:37.257032 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f06384-a0b2-4903-a0e2-0d506fecfb2e None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:37.257602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f06384-a0b2-4903-a0e2-0d506fecfb2e None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:37.257602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f06384-a0b2-4903-a0e2-0d506fecfb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:37.278143 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-68f06384-a0b2-4903-a0e2-0d506fecfb2e None None] MFA Rules not processed for user `9aaeea3dc104432eb9a17278e4766ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:08:37.279490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-68f06384-a0b2-4903-a0e2-0d506fecfb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:08:37.287549 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4535/9083] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:08:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:08:39.510609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f8bde-0fbb-4ce0-aaef-9b903b2324ff service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:39.523421 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f8bde-0fbb-4ce0-aaef-9b903b2324ff service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:39.529665 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a1abb-3365-43c6-90be-89debc0c9994 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:39.530285 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a1abb-3365-43c6-90be-89debc0c9994 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:39.530575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a1abb-3365-43c6-90be-89debc0c9994 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:39.530890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a1abb-3365-43c6-90be-89debc0c9994 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:39.541710 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a1abb-3365-43c6-90be-89debc0c9994 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:39.544110 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a1abb-3365-43c6-90be-89debc0c9994 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:39.556097 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4549/9084] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:08:47.272730 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=19 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:49.550837 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=18 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:08:49.975906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f06384-a0b2-4903-a0e2-0d506fecfb2e None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:08:49.990335 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f06384-a0b2-4903-a0e2-0d506fecfb2e None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:08:49.996744 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b8b92-250d-4dcb-a464-a17493ad2781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:08:49.997411 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b8b92-250d-4dcb-a464-a17493ad2781 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:08:49.997679 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b8b92-250d-4dcb-a464-a17493ad2781 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:08:49.997950 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b8b92-250d-4dcb-a464-a17493ad2781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:08:50.009158 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b8b92-250d-4dcb-a464-a17493ad2781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:08:50.010823 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b8b92-250d-4dcb-a464-a17493ad2781 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:08:50.023275 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4536/9085] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:08:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:09:00.017562 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:30.976683 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b94314-ebfe-4a3c-a995-dcc521e8e904 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:30.977294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b94314-ebfe-4a3c-a995-dcc521e8e904 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:30.977294 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b94314-ebfe-4a3c-a995-dcc521e8e904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:31.000237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-c0b94314-ebfe-4a3c-a995-dcc521e8e904 None None] MFA Rules not processed for user `9aaeea3dc104432eb9a17278e4766ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:10:31.001473 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-c0b94314-ebfe-4a3c-a995-dcc521e8e904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:10:31.014346 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4550/9086] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:10:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:10:33.861670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b8b92-250d-4dcb-a464-a17493ad2781 service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:33.891785 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b8b92-250d-4dcb-a464-a17493ad2781 service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:33.895898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58f15e-ff0c-400f-b444-0010be20f1bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:33.896560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58f15e-ff0c-400f-b444-0010be20f1bd service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:33.896882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58f15e-ff0c-400f-b444-0010be20f1bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:33.897151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58f15e-ff0c-400f-b444-0010be20f1bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:33.907529 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58f15e-ff0c-400f-b444-0010be20f1bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:33.909615 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58f15e-ff0c-400f-b444-0010be20f1bd service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:33.920492 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4537/9087] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:10:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:10:34.015928 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b94314-ebfe-4a3c-a995-dcc521e8e904 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:10:34.035831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b94314-ebfe-4a3c-a995-dcc521e8e904 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:10:34.040033 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45b7ac-97b0-476c-ac7f-7efdb21e6bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:10:34.040774 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45b7ac-97b0-476c-ac7f-7efdb21e6bab service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:10:34.041062 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45b7ac-97b0-476c-ac7f-7efdb21e6bab service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:10:34.041365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45b7ac-97b0-476c-ac7f-7efdb21e6bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:10:34.087455 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45b7ac-97b0-476c-ac7f-7efdb21e6bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:10:34.089231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45b7ac-97b0-476c-ac7f-7efdb21e6bab service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:10:34.122602 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4551/9088] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:10:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:10:43.916138 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=11 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:10:44.119676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=27 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:00.860123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58f15e-ff0c-400f-b444-0010be20f1bd service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:00.868797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58f15e-ff0c-400f-b444-0010be20f1bd service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:00.872668 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686e6e3-4089-4e76-8883-d9f9db57ec19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:00.873965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686e6e3-4089-4e76-8883-d9f9db57ec19 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:00.874244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686e6e3-4089-4e76-8883-d9f9db57ec19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:00.874515 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686e6e3-4089-4e76-8883-d9f9db57ec19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:00.884441 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686e6e3-4089-4e76-8883-d9f9db57ec19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:00.885861 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686e6e3-4089-4e76-8883-d9f9db57ec19 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:00.896684 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4538/9089] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:07.125554 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45b7ac-97b0-476c-ac7f-7efdb21e6bab service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:07.137317 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45b7ac-97b0-476c-ac7f-7efdb21e6bab service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:07.144601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d1df6-d380-4af7-9ee8-8038a492cba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:07.145288 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d1df6-d380-4af7-9ee8-8038a492cba6 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:07.145577 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d1df6-d380-4af7-9ee8-8038a492cba6 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:07.145856 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d1df6-d380-4af7-9ee8-8038a492cba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:07.155908 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d1df6-d380-4af7-9ee8-8038a492cba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:07.157517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d1df6-d380-4af7-9ee8-8038a492cba6 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:07.169537 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4552/9090] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:12:10.891971 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:13.554829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686e6e3-4089-4e76-8883-d9f9db57ec19 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:13.566645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686e6e3-4089-4e76-8883-d9f9db57ec19 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:13.572353 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20321020-b404-4138-8df9-cb0ba7d4c076 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:13.572964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20321020-b404-4138-8df9-cb0ba7d4c076 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:13.573244 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20321020-b404-4138-8df9-cb0ba7d4c076 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:13.573518 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20321020-b404-4138-8df9-cb0ba7d4c076 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:13.575289 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-20321020-b404-4138-8df9-cb0ba7d4c076 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:13.602188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20321020-b404-4138-8df9-cb0ba7d4c076 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:13.603837 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20321020-b404-4138-8df9-cb0ba7d4c076 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:13.618005 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4539/9091] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:13.854343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d1df6-d380-4af7-9ee8-8038a492cba6 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:13.920030 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d1df6-d380-4af7-9ee8-8038a492cba6 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:13.924723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:13.925375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:13.925659 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:13.925935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] PATH_INFO: `/v3/users/9aaeea3dc104432eb9a17278e4766ae6` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:13.927093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aaeea3dc104432eb9a17278e4766ae6)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:13.929057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:13.976873 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aaeea3dc104432eb9a17278e4766ae6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:13.984048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aaeea3dc104432eb9a17278e4766ae6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:13.984739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aaeea3dc104432eb9a17278e4766ae6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:13.996867 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aaeea3dc104432eb9a17278e4766ae6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:13.997506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aaeea3dc104432eb9a17278e4766ae6'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.010795 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4553/9092] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 20:12:13 2022] DELETE /identity/v3/users/9aaeea3dc104432eb9a17278e4766ae6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:14.016089 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14951e9-b0ba-4fce-acf4-1dca96d98e14 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:14.016378 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14951e9-b0ba-4fce-acf4-1dca96d98e14 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:14.016650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14951e9-b0ba-4fce-acf4-1dca96d98e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:14.044256 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-f14951e9-b0ba-4fce-acf4-1dca96d98e14 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:14.045534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f14951e9-b0ba-4fce-acf4-1dca96d98e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:14.106683 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4540/9093] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:14.116441 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:14.117866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:14.176936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4cdef-ea74-42df-a918-901e002481b2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:14.181108 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075919e6-b3e8-416a-bc04-879a0818652a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:14.181723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075919e6-b3e8-416a-bc04-879a0818652a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:14.182006 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075919e6-b3e8-416a-bc04-879a0818652a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:14.182279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075919e6-b3e8-416a-bc04-879a0818652a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:14.193227 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075919e6-b3e8-416a-bc04-879a0818652a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:14.194662 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075919e6-b3e8-416a-bc04-879a0818652a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:14.204976 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4554/9094] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:14.381755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14951e9-b0ba-4fce-acf4-1dca96d98e14 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:14.383436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-f14951e9-b0ba-4fce-acf4-1dca96d98e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:14.401314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14951e9-b0ba-4fce-acf4-1dca96d98e14 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:14.408446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:14.409099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:14.409443 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:14.409759 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] PATH_INFO: `/v3/projects/ada8ad360e774591959b685b3b51c70b` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:14.411061 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada8ad360e774591959b685b3b51c70b)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:14.413085 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:14.460179 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada8ad360e774591959b685b3b51c70b', 'request_id': 'req-ab9a1270-c4e9-4ab9-adf8-7be1952da881'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.465676 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada8ad360e774591959b685b3b51c70b', 'request_id': 'req-ab9a1270-c4e9-4ab9-adf8-7be1952da881'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.473140 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada8ad360e774591959b685b3b51c70b', 'request_id': 'req-ab9a1270-c4e9-4ab9-adf8-7be1952da881'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.485398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] The token cache is being invalidate because project ada8ad360e774591959b685b3b51c70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:12:14.485689 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.486384 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.487944 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4541/9095] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 20:12:14 2022] DELETE /identity/v3/projects/ada8ad360e774591959b685b3b51c70b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:14.492084 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075919e6-b3e8-416a-bc04-879a0818652a service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:14.502260 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075919e6-b3e8-416a-bc04-879a0818652a service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:14.507141 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:14.563432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e3cc4-6c84-4b42-81b2-4f5bc111ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:14.564081 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e3cc4-6c84-4b42-81b2-4f5bc111ed5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:14.564369 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e3cc4-6c84-4b42-81b2-4f5bc111ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:14.564701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e3cc4-6c84-4b42-81b2-4f5bc111ed5c admin admin] PATH_INFO: `/v3/users/7878ba8493af469a964d0df60e3c07d5` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:14.565831 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e3cc4-6c84-4b42-81b2-4f5bc111ed5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7878ba8493af469a964d0df60e3c07d5)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:14.568479 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e3cc4-6c84-4b42-81b2-4f5bc111ed5c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:14.620140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2f9e3cc4-6c84-4b42-81b2-4f5bc111ed5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7878ba8493af469a964d0df60e3c07d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.627552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2f9e3cc4-6c84-4b42-81b2-4f5bc111ed5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7878ba8493af469a964d0df60e3c07d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.628147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2f9e3cc4-6c84-4b42-81b2-4f5bc111ed5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7878ba8493af469a964d0df60e3c07d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.648221 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2f9e3cc4-6c84-4b42-81b2-4f5bc111ed5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7878ba8493af469a964d0df60e3c07d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.648965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2f9e3cc4-6c84-4b42-81b2-4f5bc111ed5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7878ba8493af469a964d0df60e3c07d5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:14.663495 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4555/9096] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 20:12:14 2022] DELETE /identity/v3/users/7878ba8493af469a964d0df60e3c07d5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:14.950390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:14.952607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:14.971863 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a1270-c4e9-4ab9-adf8-7be1952da881 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:15.026782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:15.034947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a61db-4484-44c3-beaf-2418c4f0d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:15.035831 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a61db-4484-44c3-beaf-2418c4f0d50b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:15.036139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a61db-4484-44c3-beaf-2418c4f0d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:15.036597 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a61db-4484-44c3-beaf-2418c4f0d50b admin admin] PATH_INFO: `/v3/projects/0ca9f565787a4ecd87e61158babfc327` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:15.037901 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a61db-4484-44c3-beaf-2418c4f0d50b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca9f565787a4ecd87e61158babfc327)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:15.039867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a61db-4484-44c3-beaf-2418c4f0d50b admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:15.092880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-707a61db-4484-44c3-beaf-2418c4f0d50b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca9f565787a4ecd87e61158babfc327', 'request_id': 'req-707a61db-4484-44c3-beaf-2418c4f0d50b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:15.098398 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-707a61db-4484-44c3-beaf-2418c4f0d50b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca9f565787a4ecd87e61158babfc327', 'request_id': 'req-707a61db-4484-44c3-beaf-2418c4f0d50b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:15.105290 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-707a61db-4484-44c3-beaf-2418c4f0d50b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca9f565787a4ecd87e61158babfc327', 'request_id': 'req-707a61db-4484-44c3-beaf-2418c4f0d50b'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:15.119694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-707a61db-4484-44c3-beaf-2418c4f0d50b admin admin] The token cache is being invalidate because project 0ca9f565787a4ecd87e61158babfc327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:12:15.119977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-707a61db-4484-44c3-beaf-2418c4f0d50b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:15.120610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-707a61db-4484-44c3-beaf-2418c4f0d50b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:12:15.122404 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4542/9097] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 20:12:14 2022] DELETE /identity/v3/projects/0ca9f565787a4ecd87e61158babfc327 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:15.128585 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d30a99-e90f-42e1-8ca2-9f5ecf13d057 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:15.129060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d30a99-e90f-42e1-8ca2-9f5ecf13d057 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:15.129178 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d30a99-e90f-42e1-8ca2-9f5ecf13d057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:15.169126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-d8d30a99-e90f-42e1-8ca2-9f5ecf13d057 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:15.170766 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-d8d30a99-e90f-42e1-8ca2-9f5ecf13d057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:15.230242 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4556/9098] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:15.239288 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888a11c-f329-4ce7-92be-c252587f6d48 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:15.239504 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888a11c-f329-4ce7-92be-c252587f6d48 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:15.239782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888a11c-f329-4ce7-92be-c252587f6d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:15.260926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-9888a11c-f329-4ce7-92be-c252587f6d48 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:15.262132 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9888a11c-f329-4ce7-92be-c252587f6d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:15.270263 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4543/9099] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:15.274526 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d30a99-e90f-42e1-8ca2-9f5ecf13d057 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:15.284458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d30a99-e90f-42e1-8ca2-9f5ecf13d057 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:15.289279 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429a221-b44a-4d29-9944-9201dcc866a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:15.289882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429a221-b44a-4d29-9944-9201dcc866a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:15.290166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429a221-b44a-4d29-9944-9201dcc866a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:15.290444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429a221-b44a-4d29-9944-9201dcc866a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:15.291214 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429a221-b44a-4d29-9944-9201dcc866a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:12:15.291523 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429a221-b44a-4d29-9944-9201dcc866a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:15.293129 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429a221-b44a-4d29-9944-9201dcc866a9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:15.302485 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:15.306331 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4557/9100] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 20:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:12:15.310531 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888a11c-f329-4ce7-92be-c252587f6d48 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:15.320356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888a11c-f329-4ce7-92be-c252587f6d48 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:15.324949 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1558-e1fc-4ec5-9bd6-164e06f5d054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:15.325535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1558-e1fc-4ec5-9bd6-164e06f5d054 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:15.325813 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1558-e1fc-4ec5-9bd6-164e06f5d054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:15.326084 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1558-e1fc-4ec5-9bd6-164e06f5d054 admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:15.326864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d1558-e1fc-4ec5-9bd6-164e06f5d054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:15.328811 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d1558-e1fc-4ec5-9bd6-164e06f5d054 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:15.368178 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4544/9101] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 20:12:15 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:12:15.372040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429a221-b44a-4d29-9944-9201dcc866a9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:15.382769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429a221-b44a-4d29-9944-9201dcc866a9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:15.442423 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121557db-9753-4b55-a791-16483341e1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:15.442977 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121557db-9753-4b55-a791-16483341e1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:15.443259 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121557db-9753-4b55-a791-16483341e1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:15.443533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121557db-9753-4b55-a791-16483341e1a2 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:15.444167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121557db-9753-4b55-a791-16483341e1a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:15.446083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121557db-9753-4b55-a791-16483341e1a2 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:15.467708 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4558/9102] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 20:12:15 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:12:15.471913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1558-e1fc-4ec5-9bd6-164e06f5d054 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:15.482090 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1558-e1fc-4ec5-9bd6-164e06f5d054 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:15.487909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff2e4a-368b-4868-8046-ebdbf7bf867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:15.488511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff2e4a-368b-4868-8046-ebdbf7bf867c admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:15.488797 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff2e4a-368b-4868-8046-ebdbf7bf867c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:15.489068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff2e4a-368b-4868-8046-ebdbf7bf867c admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:15.489702 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff2e4a-368b-4868-8046-ebdbf7bf867c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:15.491325 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff2e4a-368b-4868-8046-ebdbf7bf867c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:15.502017 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4545/9103] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:15.506125 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121557db-9753-4b55-a791-16483341e1a2 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:15.516329 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121557db-9753-4b55-a791-16483341e1a2 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:15.521054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb08df-d845-4cbb-ae5e-9ea2a3b738a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:15.521655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb08df-d845-4cbb-ae5e-9ea2a3b738a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:15.521935 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb08df-d845-4cbb-ae5e-9ea2a3b738a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:15.522210 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb08df-d845-4cbb-ae5e-9ea2a3b738a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:15.523020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb08df-d845-4cbb-ae5e-9ea2a3b738a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:15.524607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb08df-d845-4cbb-ae5e-9ea2a3b738a0 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:15.536043 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4559/9104] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:15.540234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff2e4a-368b-4868-8046-ebdbf7bf867c admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:15.551487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff2e4a-368b-4868-8046-ebdbf7bf867c admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:15.556677 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af84b4-584c-4761-abc4-f6aca7640e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:15.557322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af84b4-584c-4761-abc4-f6aca7640e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:15.557607 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af84b4-584c-4761-abc4-f6aca7640e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:15.557885 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af84b4-584c-4761-abc4-f6aca7640e88 admin admin] PATH_INFO: `/v3/projects/82b1fb75aba5462599f0d3758823031e/users/0bc28dac30a843f7b142c742394d7e91/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:15.575168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af84b4-584c-4761-abc4-f6aca7640e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b1fb75aba5462599f0d3758823031e, user_id=0bc28dac30a843f7b142c742394d7e91, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:15.577995 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af84b4-584c-4761-abc4-f6aca7640e88 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:15.591731 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4546/9105] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 20:12:15 2022] PUT /identity/v3/projects/82b1fb75aba5462599f0d3758823031e/users/0bc28dac30a843f7b142c742394d7e91/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:15.597522 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1c910-0359-45f4-9ed6-27c60829658a None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:15.597821 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1c910-0359-45f4-9ed6-27c60829658a None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:15.598098 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1c910-0359-45f4-9ed6-27c60829658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:15.618370 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-30d1c910-0359-45f4-9ed6-27c60829658a None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:15.619607 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-30d1c910-0359-45f4-9ed6-27c60829658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:15.680217 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4560/9106] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:15.690125 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af84b4-584c-4761-abc4-f6aca7640e88 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:15.691854 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-89af84b4-584c-4761-abc4-f6aca7640e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:15.749734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af84b4-584c-4761-abc4-f6aca7640e88 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:15.753511 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03961baa-5fae-4616-9135-220fd60c38be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:15.754115 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961baa-5fae-4616-9135-220fd60c38be service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:15.754395 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961baa-5fae-4616-9135-220fd60c38be service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:15.754672 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03961baa-5fae-4616-9135-220fd60c38be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:15.763714 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03961baa-5fae-4616-9135-220fd60c38be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:15.765253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03961baa-5fae-4616-9135-220fd60c38be service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:15.774644 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4547/9107] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:19.873524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa3552-5200-4dc0-a88d-b27208eb1488 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:19.874841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa3552-5200-4dc0-a88d-b27208eb1488 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:19.874841 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa3552-5200-4dc0-a88d-b27208eb1488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:19.906676 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-13fa3552-5200-4dc0-a88d-b27208eb1488 None None] MFA Rules not processed for user `0bc28dac30a843f7b142c742394d7e91`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:19.911422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-13fa3552-5200-4dc0-a88d-b27208eb1488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:19.984779 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4561/9108] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:12:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:12:19.989650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03961baa-5fae-4616-9135-220fd60c38be service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:20.000909 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03961baa-5fae-4616-9135-220fd60c38be service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:20.005683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e469e6-789a-4f7f-9889-22c06144b8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:20.006281 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e469e6-789a-4f7f-9889-22c06144b8bf admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:20.006560 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e469e6-789a-4f7f-9889-22c06144b8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:20.006873 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e469e6-789a-4f7f-9889-22c06144b8bf admin admin] PATH_INFO: `/v3/projects` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:20.007498 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e469e6-789a-4f7f-9889-22c06144b8bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:20.009393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e469e6-789a-4f7f-9889-22c06144b8bf admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:20.025934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:20.042706 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4548/9109] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 20:12:19 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:12:20.047149 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa3552-5200-4dc0-a88d-b27208eb1488 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:20.065032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa3552-5200-4dc0-a88d-b27208eb1488 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:20.070054 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:20.137104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90e95-fd8b-41b0-a97f-82f54606cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:20.137727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90e95-fd8b-41b0-a97f-82f54606cc80 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:20.138014 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90e95-fd8b-41b0-a97f-82f54606cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:20.138293 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d90e95-fd8b-41b0-a97f-82f54606cc80 admin admin] PATH_INFO: `/v3/users` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:20.139001 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d90e95-fd8b-41b0-a97f-82f54606cc80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:20.141080 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d90e95-fd8b-41b0-a97f-82f54606cc80 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:20.167167 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4562/9110] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 20:12:20 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 20:12:20.172130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e469e6-789a-4f7f-9889-22c06144b8bf admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:20.183091 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e469e6-789a-4f7f-9889-22c06144b8bf admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:20.188351 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ed70-31de-4c39-9da0-a86bd14a34ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:20.189009 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ed70-31de-4c39-9da0-a86bd14a34ca admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:20.189356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ed70-31de-4c39-9da0-a86bd14a34ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:20.189834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ed70-31de-4c39-9da0-a86bd14a34ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:20.190631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037ed70-31de-4c39-9da0-a86bd14a34ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:20.192319 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037ed70-31de-4c39-9da0-a86bd14a34ca admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:20.204115 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4549/9111] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:20.208503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90e95-fd8b-41b0-a97f-82f54606cc80 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:20.220020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d90e95-fd8b-41b0-a97f-82f54606cc80 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:20.225769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd5234-eb5c-4d1d-9738-f630035cd71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:20.226532 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5234-eb5c-4d1d-9738-f630035cd71f admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:20.226927 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5234-eb5c-4d1d-9738-f630035cd71f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:20.227408 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5234-eb5c-4d1d-9738-f630035cd71f admin admin] PATH_INFO: `/v3/projects/b79e75f4240e4264b1732aaf2a8634e2/users/467ce1fc86c34ae1bf0ad244faa882af/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:20.249778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd5234-eb5c-4d1d-9738-f630035cd71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79e75f4240e4264b1732aaf2a8634e2, user_id=467ce1fc86c34ae1bf0ad244faa882af, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:20.252779 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd5234-eb5c-4d1d-9738-f630035cd71f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:20.278344 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4563/9112] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 20:12:20 2022] PUT /identity/v3/projects/b79e75f4240e4264b1732aaf2a8634e2/users/467ce1fc86c34ae1bf0ad244faa882af/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:20.282866 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ed70-31de-4c39-9da0-a86bd14a34ca admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:20.294273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ed70-31de-4c39-9da0-a86bd14a34ca admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:20.364248 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de595c54-4b29-4130-9d03-df301b9f8a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:20.365136 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de595c54-4b29-4130-9d03-df301b9f8a2d admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:20.365430 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de595c54-4b29-4130-9d03-df301b9f8a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:20.365864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de595c54-4b29-4130-9d03-df301b9f8a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:20.366644 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de595c54-4b29-4130-9d03-df301b9f8a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:20.368762 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de595c54-4b29-4130-9d03-df301b9f8a2d admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:20.382791 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4550/9113] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 20:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:12:20.385823 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd5234-eb5c-4d1d-9738-f630035cd71f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:20.397379 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd5234-eb5c-4d1d-9738-f630035cd71f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:20.402708 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0f81b-01d8-4fed-a10c-80d21079fa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:20.403489 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f81b-01d8-4fed-a10c-80d21079fa63 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:20.403776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f81b-01d8-4fed-a10c-80d21079fa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:20.404047 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f81b-01d8-4fed-a10c-80d21079fa63 admin admin] PATH_INFO: `/v3/projects/b79e75f4240e4264b1732aaf2a8634e2/users/467ce1fc86c34ae1bf0ad244faa882af/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:20.407562 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0f81b-01d8-4fed-a10c-80d21079fa63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79e75f4240e4264b1732aaf2a8634e2, user_id=467ce1fc86c34ae1bf0ad244faa882af, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:20.410776 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0f81b-01d8-4fed-a10c-80d21079fa63 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:20.424186 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4564/9114] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 20:12:20 2022] PUT /identity/v3/projects/b79e75f4240e4264b1732aaf2a8634e2/users/467ce1fc86c34ae1bf0ad244faa882af/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:12:24.940895 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ad445-a2cd-4cfe-b292-ae90f8efe027 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:24.941435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ad445-a2cd-4cfe-b292-ae90f8efe027 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:24.941435 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ad445-a2cd-4cfe-b292-ae90f8efe027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:24.970782 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-c97ad445-a2cd-4cfe-b292-ae90f8efe027 None None] MFA Rules not processed for user `467ce1fc86c34ae1bf0ad244faa882af`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:24.971954 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c97ad445-a2cd-4cfe-b292-ae90f8efe027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:25.074196 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4551/9115] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:12:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:25.091105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0f81b-01d8-4fed-a10c-80d21079fa63 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:25.094286 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8fe0f81b-01d8-4fed-a10c-80d21079fa63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:25.190091 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0f81b-01d8-4fed-a10c-80d21079fa63 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:25.205592 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5f767-5a95-477d-9c1a-4b477f068b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:25.206730 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5f767-5a95-477d-9c1a-4b477f068b2a service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:25.207018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5f767-5a95-477d-9c1a-4b477f068b2a service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:25.207431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5f767-5a95-477d-9c1a-4b477f068b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:25.296422 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5f767-5a95-477d-9c1a-4b477f068b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:25.299134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5f767-5a95-477d-9c1a-4b477f068b2a service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:25.304012 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:25.313612 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4565/9116] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:26.356882 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9f70-51cb-40a5-a2a9-54208def24c6 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:26.357953 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9f70-51cb-40a5-a2a9-54208def24c6 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:26.358302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9f70-51cb-40a5-a2a9-54208def24c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:26.380761 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-feeb9f70-51cb-40a5-a2a9-54208def24c6 None None] MFA Rules not processed for user `0bc28dac30a843f7b142c742394d7e91`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:12:26.381989 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-feeb9f70-51cb-40a5-a2a9-54208def24c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:26.390344 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4552/9117] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:12:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:12:26.772143 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5f767-5a95-477d-9c1a-4b477f068b2a service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:26.773724 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-92d5f767-5a95-477d-9c1a-4b477f068b2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:26.836645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5f767-5a95-477d-9c1a-4b477f068b2a service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:26.840458 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731662-663e-4944-bd33-e13080e59dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:26.841160 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731662-663e-4944-bd33-e13080e59dfe service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:26.841519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731662-663e-4944-bd33-e13080e59dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:26.841847 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731662-663e-4944-bd33-e13080e59dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:26.843764 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-11731662-663e-4944-bd33-e13080e59dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:26.855153 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11731662-663e-4944-bd33-e13080e59dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:26.856609 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11731662-663e-4944-bd33-e13080e59dfe service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:26.866020 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4566/9118] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:29.205535 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9f70-51cb-40a5-a2a9-54208def24c6 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:29.216499 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9f70-51cb-40a5-a2a9-54208def24c6 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:29.221046 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea7464-aa5a-4611-aed2-1be330c601ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:29.221964 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea7464-aa5a-4611-aed2-1be330c601ec service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:29.222538 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea7464-aa5a-4611-aed2-1be330c601ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:29.223037 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea7464-aa5a-4611-aed2-1be330c601ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:29.225137 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aeea7464-aa5a-4611-aed2-1be330c601ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:12:29.238527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea7464-aa5a-4611-aed2-1be330c601ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:29.240043 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea7464-aa5a-4611-aed2-1be330c601ec service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:29.250900 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4553/9119] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:36.862487 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=27 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:38.293741 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731662-663e-4944-bd33-e13080e59dfe service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:12:38.303681 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731662-663e-4944-bd33-e13080e59dfe service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:12:38.307327 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816747c-751d-4b27-8553-a895dffbf5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:12:38.307920 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816747c-751d-4b27-8553-a895dffbf5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:12:38.308201 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816747c-751d-4b27-8553-a895dffbf5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:12:38.308470 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816747c-751d-4b27-8553-a895dffbf5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:12:38.318171 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816747c-751d-4b27-8553-a895dffbf5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:12:38.319633 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816747c-751d-4b27-8553-a895dffbf5e7 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:12:38.331621 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4567/9120] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:12:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:12:39.245134 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:INSERT=1,keystone:SELECT=79 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:12:48.324835 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:35.670466 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea7464-aa5a-4611-aed2-1be330c601ec service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:35.672520 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-aeea7464-aa5a-4611-aed2-1be330c601ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:35.755074 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea7464-aa5a-4611-aed2-1be330c601ec service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:35.760162 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcae27-18d6-4eed-8c97-ad4e0264687a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:35.760769 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcae27-18d6-4eed-8c97-ad4e0264687a service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:35.761055 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcae27-18d6-4eed-8c97-ad4e0264687a service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:35.761332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcae27-18d6-4eed-8c97-ad4e0264687a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:35.763086 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ccdcae27-18d6-4eed-8c97-ad4e0264687a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:35.774614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcae27-18d6-4eed-8c97-ad4e0264687a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:35.776227 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcae27-18d6-4eed-8c97-ad4e0264687a service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:35.786326 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4554/9121] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:38.441627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816747c-751d-4b27-8553-a895dffbf5e7 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:13:38.443071 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-3816747c-751d-4b27-8553-a895dffbf5e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:38.458875 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816747c-751d-4b27-8553-a895dffbf5e7 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:13:38.463852 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61aa1dc-17ae-4f94-ba2a-51f675326cda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:13:38.464452 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aa1dc-17ae-4f94-ba2a-51f675326cda service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:13:38.464736 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aa1dc-17ae-4f94-ba2a-51f675326cda service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:13:38.465018 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aa1dc-17ae-4f94-ba2a-51f675326cda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:13:38.466695 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b61aa1dc-17ae-4f94-ba2a-51f675326cda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:13:38.480349 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61aa1dc-17ae-4f94-ba2a-51f675326cda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:13:38.481939 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61aa1dc-17ae-4f94-ba2a-51f675326cda service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:13:38.493010 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4568/9122] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:13:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:13:45.782112 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=37 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:13:48.488701 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:48.124131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69b87e-8c3f-40d9-8550-219a933f0628 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:48.124678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69b87e-8c3f-40d9-8550-219a933f0628 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:48.125029 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69b87e-8c3f-40d9-8550-219a933f0628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:48.188968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-0c69b87e-8c3f-40d9-8550-219a933f0628 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:14:48.190199 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0c69b87e-8c3f-40d9-8550-219a933f0628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:48.263721 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4555/9123] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 20:14:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:14:48.310353 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61aa1dc-17ae-4f94-ba2a-51f675326cda service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:48.312739 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b61aa1dc-17ae-4f94-ba2a-51f675326cda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:48.406992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61aa1dc-17ae-4f94-ba2a-51f675326cda service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:48.412464 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df8026-cbb5-4ff3-979d-c9789f687206 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:48.413105 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df8026-cbb5-4ff3-979d-c9789f687206 service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:48.413385 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df8026-cbb5-4ff3-979d-c9789f687206 service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:48.413656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df8026-cbb5-4ff3-979d-c9789f687206 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:48.422949 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df8026-cbb5-4ff3-979d-c9789f687206 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:48.424936 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df8026-cbb5-4ff3-979d-c9789f687206 service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:48.433023 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4569/9124] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 20:14:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:14:49.881026 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69b87e-8c3f-40d9-8550-219a933f0628 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:49.883042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-0c69b87e-8c3f-40d9-8550-219a933f0628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:49.906605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69b87e-8c3f-40d9-8550-219a933f0628 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:49.912911 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fadcb-b49d-4b9c-a989-e597518a8763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:49.913536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fadcb-b49d-4b9c-a989-e597518a8763 service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:49.913821 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fadcb-b49d-4b9c-a989-e597518a8763 service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:49.914099 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fadcb-b49d-4b9c-a989-e597518a8763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:49.915984 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-270fadcb-b49d-4b9c-a989-e597518a8763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:14:49.934221 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fadcb-b49d-4b9c-a989-e597518a8763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:14:49.937470 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fadcb-b49d-4b9c-a989-e597518a8763 service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:14:49.953990 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4556/9125] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:14:58.429558 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=41 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:59.945106 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=53 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:14:59.959416 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df8026-cbb5-4ff3-979d-c9789f687206 service swift] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:14:59.970655 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df8026-cbb5-4ff3-979d-c9789f687206 service swift] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:14:59.974649 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ed259-583c-4d08-9109-1c50a95c9ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:14:59.975291 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ed259-583c-4d08-9109-1c50a95c9ded service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:14:59.975579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ed259-583c-4d08-9109-1c50a95c9ded service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:14:59.975858 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ed259-583c-4d08-9109-1c50a95c9ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:14:59.977616 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8f7ed259-583c-4d08-9109-1c50a95c9ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:00.002383 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ed259-583c-4d08-9109-1c50a95c9ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:00.003871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ed259-583c-4d08-9109-1c50a95c9ded service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:00.012020 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4570/9126] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:14:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:00.140415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e9ab-4cb8-41ac-b417-7c8b0bffaf64 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:00.140728 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e9ab-4cb8-41ac-b417-7c8b0bffaf64 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:00.141014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e9ab-4cb8-41ac-b417-7c8b0bffaf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:00.167497 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-1cd0e9ab-4cb8-41ac-b417-7c8b0bffaf64 None None] MFA Rules not processed for user `ea8cbbc34aab42a4ada9cbee1772847b`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:00.168732 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1cd0e9ab-4cb8-41ac-b417-7c8b0bffaf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:00.179148 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4557/9127] 10.222.0.70 () {58 vars in 1018 bytes} [Sun Aug 28 20:15:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:00.192092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ed259-583c-4d08-9109-1c50a95c9ded service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:00.193884 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-8f7ed259-583c-4d08-9109-1c50a95c9ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:00.280587 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ed259-583c-4d08-9109-1c50a95c9ded service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:00.284281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7edc9b-7f18-474b-9bd8-f0b7ab67caf3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:00.284890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7edc9b-7f18-474b-9bd8-f0b7ab67caf3 service glance] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:00.285193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7edc9b-7f18-474b-9bd8-f0b7ab67caf3 service glance] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:00.285469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7edc9b-7f18-474b-9bd8-f0b7ab67caf3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:00.296344 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7edc9b-7f18-474b-9bd8-f0b7ab67caf3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:00.297830 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7edc9b-7f18-474b-9bd8-f0b7ab67caf3 service glance] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:00.308601 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4571/9128] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:00.377532 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0e9ab-4cb8-41ac-b417-7c8b0bffaf64 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:00.386871 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0e9ab-4cb8-41ac-b417-7c8b0bffaf64 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:00.392328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e8403-5fbe-48ef-b1d7-654e0a94a82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:00.392948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e8403-5fbe-48ef-b1d7-654e0a94a82c service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:00.393234 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e8403-5fbe-48ef-b1d7-654e0a94a82c service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:00.393512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e8403-5fbe-48ef-b1d7-654e0a94a82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:00.395336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-613e8403-5fbe-48ef-b1d7-654e0a94a82c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:00.405741 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e8403-5fbe-48ef-b1d7-654e0a94a82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:00.407189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e8403-5fbe-48ef-b1d7-654e0a94a82c service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:00.415488 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4558/9129] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:00.495533 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7edc9b-7f18-474b-9bd8-f0b7ab67caf3 service glance] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:00.506320 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7edc9b-7f18-474b-9bd8-f0b7ab67caf3 service glance] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:00.510074 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf8c9c-6132-4381-8fc3-5763b8e30cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:00.510803 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf8c9c-6132-4381-8fc3-5763b8e30cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:00.511096 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf8c9c-6132-4381-8fc3-5763b8e30cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:00.511460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf8c9c-6132-4381-8fc3-5763b8e30cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:00.513167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4ecf8c9c-6132-4381-8fc3-5763b8e30cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:00.530342 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf8c9c-6132-4381-8fc3-5763b8e30cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:00.531919 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf8c9c-6132-4381-8fc3-5763b8e30cb3 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:00.543961 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4572/9130] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:00.610379 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e8403-5fbe-48ef-b1d7-654e0a94a82c service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:00.623572 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e8403-5fbe-48ef-b1d7-654e0a94a82c service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:00.628796 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505ef68-c37b-4362-9c31-cd7078a978a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:00.629336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505ef68-c37b-4362-9c31-cd7078a978a1 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:00.629620 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505ef68-c37b-4362-9c31-cd7078a978a1 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:00.629896 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505ef68-c37b-4362-9c31-cd7078a978a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:00.631667 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-a505ef68-c37b-4362-9c31-cd7078a978a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:00.644371 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505ef68-c37b-4362-9c31-cd7078a978a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:00.645956 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505ef68-c37b-4362-9c31-cd7078a978a1 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:00.656794 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4559/9131] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:15:03.171410 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8f9d-26dd-4970-be2b-e7eb2efc7707 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:03.171903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8f9d-26dd-4970-be2b-e7eb2efc7707 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:03.172146 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b8f9d-26dd-4970-be2b-e7eb2efc7707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:03.193007 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-0f9b8f9d-26dd-4970-be2b-e7eb2efc7707 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:03.194231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0f9b8f9d-26dd-4970-be2b-e7eb2efc7707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:03.202101 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4573/9132] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 20:15:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:03.214159 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505ef68-c37b-4362-9c31-cd7078a978a1 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:03.226376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505ef68-c37b-4362-9c31-cd7078a978a1 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:03.231521 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0300bb-3d0e-45f3-9752-4c52d1a47fd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:03.232103 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0300bb-3d0e-45f3-9752-4c52d1a47fd2 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:03.232481 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0300bb-3d0e-45f3-9752-4c52d1a47fd2 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:03.233369 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0300bb-3d0e-45f3-9752-4c52d1a47fd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:03.241712 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0300bb-3d0e-45f3-9752-4c52d1a47fd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:03.243581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0300bb-3d0e-45f3-9752-4c52d1a47fd2 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:03.252428 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4560/9133] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 20:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:15:13.187731 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=55 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:13.249269 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=21 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:21.590593 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd90c7-a594-4f29-99db-0f947f7b3855 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:21.591048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd90c7-a594-4f29-99db-0f947f7b3855 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:21.591185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd90c7-a594-4f29-99db-0f947f7b3855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:21.611571 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-84cd90c7-a594-4f29-99db-0f947f7b3855 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:15:21.612784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-84cd90c7-a594-4f29-99db-0f947f7b3855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:21.620351 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4574/9134] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 20:15:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:15:21.634216 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0300bb-3d0e-45f3-9752-4c52d1a47fd2 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:21.649817 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0300bb-3d0e-45f3-9752-4c52d1a47fd2 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:21.655880 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0620d7-2cbf-4113-a9bb-faba43475291 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:21.656486 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0620d7-2cbf-4113-a9bb-faba43475291 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:21.656771 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0620d7-2cbf-4113-a9bb-faba43475291 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:21.657050 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0620d7-2cbf-4113-a9bb-faba43475291 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:21.666867 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0620d7-2cbf-4113-a9bb-faba43475291 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:21.668458 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0620d7-2cbf-4113-a9bb-faba43475291 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:21.677146 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4561/9135] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 20:15:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:15:31.605877 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:31.673778 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:15:54.962362 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd90c7-a594-4f29-99db-0f947f7b3855 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:15:54.972576 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd90c7-a594-4f29-99db-0f947f7b3855 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:15:54.976709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d8eb9-08fa-4423-8e63-4d746a1596fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:15:54.977316 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d8eb9-08fa-4423-8e63-4d746a1596fa service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:15:54.977604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d8eb9-08fa-4423-8e63-4d746a1596fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:15:54.977883 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d8eb9-08fa-4423-8e63-4d746a1596fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:15:54.979617 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-a40d8eb9-08fa-4423-8e63-4d746a1596fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:15:54.990247 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d8eb9-08fa-4423-8e63-4d746a1596fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:15:54.991980 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d8eb9-08fa-4423-8e63-4d746a1596fa service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:15:55.000079 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4575/9136] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:15:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:16:04.996365 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:10.831020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0620d7-2cbf-4113-a9bb-faba43475291 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:10.845263 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0620d7-2cbf-4113-a9bb-faba43475291 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:10.855332 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896855e-55f7-448e-9d4c-eb2acdee1b0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:10.857042 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896855e-55f7-448e-9d4c-eb2acdee1b0b service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:10.857815 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896855e-55f7-448e-9d4c-eb2acdee1b0b service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:10.858710 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896855e-55f7-448e-9d4c-eb2acdee1b0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:10.861800 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b896855e-55f7-448e-9d4c-eb2acdee1b0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:10.896210 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896855e-55f7-448e-9d4c-eb2acdee1b0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:10.898839 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896855e-55f7-448e-9d4c-eb2acdee1b0b service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:10.914495 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4562/9137] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:11.063196 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d8eb9-08fa-4423-8e63-4d746a1596fa service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:11.072896 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d8eb9-08fa-4423-8e63-4d746a1596fa service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:11.076703 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777da81-f942-4e0b-b636-f956e4a98579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:11.077309 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777da81-f942-4e0b-b636-f956e4a98579 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:11.077769 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777da81-f942-4e0b-b636-f956e4a98579 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:11.078053 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777da81-f942-4e0b-b636-f956e4a98579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:11.079929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6777da81-f942-4e0b-b636-f956e4a98579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:11.095772 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777da81-f942-4e0b-b636-f956e4a98579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:11.097218 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777da81-f942-4e0b-b636-f956e4a98579 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:11.110148 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4576/9138] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:12.330253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896855e-55f7-448e-9d4c-eb2acdee1b0b service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:12.340247 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896855e-55f7-448e-9d4c-eb2acdee1b0b service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:12.344004 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dfa34-4439-49aa-a908-6e19e8cc4ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:12.344599 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dfa34-4439-49aa-a908-6e19e8cc4ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:12.344877 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dfa34-4439-49aa-a908-6e19e8cc4ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:12.345150 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dfa34-4439-49aa-a908-6e19e8cc4ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:12.346959 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-1e8dfa34-4439-49aa-a908-6e19e8cc4ee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:12.360969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dfa34-4439-49aa-a908-6e19e8cc4ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:12.362403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dfa34-4439-49aa-a908-6e19e8cc4ee3 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:12.373836 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4563/9139] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:17:14.953581 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d05762-1aa6-4784-acbe-b7ae8841f3e1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:14.954090 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d05762-1aa6-4784-acbe-b7ae8841f3e1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:14.954195 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d05762-1aa6-4784-acbe-b7ae8841f3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:14.975204 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-e2d05762-1aa6-4784-acbe-b7ae8841f3e1 None None] MFA Rules not processed for user `0bc28dac30a843f7b142c742394d7e91`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:17:14.976402 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-e2d05762-1aa6-4784-acbe-b7ae8841f3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:14.983372 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4577/9140] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:17:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:17:22.369265 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=17 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:24.970123 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=9 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:25.449228 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dfa34-4439-49aa-a908-6e19e8cc4ee3 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:25.459356 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dfa34-4439-49aa-a908-6e19e8cc4ee3 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:25.463152 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158c673-e5b0-4ec3-ab02-6a47c4ca0824 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:25.463767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158c673-e5b0-4ec3-ab02-6a47c4ca0824 service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:25.464045 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158c673-e5b0-4ec3-ab02-6a47c4ca0824 service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:25.464318 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158c673-e5b0-4ec3-ab02-6a47c4ca0824 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:25.473081 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158c673-e5b0-4ec3-ab02-6a47c4ca0824 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:25.474546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158c673-e5b0-4ec3-ab02-6a47c4ca0824 service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:25.483800 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4564/9141] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:17:32.117377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d05762-1aa6-4784-acbe-b7ae8841f3e1 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:32.130322 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d05762-1aa6-4784-acbe-b7ae8841f3e1 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:32.136022 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfba38-026f-46d5-a671-6ed8960a7038 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:32.136657 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfba38-026f-46d5-a671-6ed8960a7038 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:32.136947 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfba38-026f-46d5-a671-6ed8960a7038 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:32.137225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfba38-026f-46d5-a671-6ed8960a7038 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:32.139328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-f9bfba38-026f-46d5-a671-6ed8960a7038 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:32.152866 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfba38-026f-46d5-a671-6ed8960a7038 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:32.154488 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfba38-026f-46d5-a671-6ed8960a7038 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:32.166552 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4578/9142] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:33.914362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158c673-e5b0-4ec3-ab02-6a47c4ca0824 service glance] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:33.924655 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158c673-e5b0-4ec3-ab02-6a47c4ca0824 service glance] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:33.929057 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783473e7-c0c2-43d8-9a31-ccb6ad539b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:33.929662 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783473e7-c0c2-43d8-9a31-ccb6ad539b3f service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:33.929943 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783473e7-c0c2-43d8-9a31-ccb6ad539b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:33.930406 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783473e7-c0c2-43d8-9a31-ccb6ad539b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:33.938977 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783473e7-c0c2-43d8-9a31-ccb6ad539b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:33.940748 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783473e7-c0c2-43d8-9a31-ccb6ad539b3f service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:33.952028 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4565/9143] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:34.597140 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfba38-026f-46d5-a671-6ed8960a7038 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:34.616415 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfba38-026f-46d5-a671-6ed8960a7038 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:34.623068 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd6f22-b76a-44c7-a96c-0ae09eb75d01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:34.623921 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd6f22-b76a-44c7-a96c-0ae09eb75d01 service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:34.624545 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd6f22-b76a-44c7-a96c-0ae09eb75d01 service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:34.624903 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd6f22-b76a-44c7-a96c-0ae09eb75d01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:34.626791 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ffdd6f22-b76a-44c7-a96c-0ae09eb75d01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:17:34.641324 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd6f22-b76a-44c7-a96c-0ae09eb75d01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:34.642981 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd6f22-b76a-44c7-a96c-0ae09eb75d01 service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:34.663556 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4579/9144] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:17:43.947075 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=12 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:44.652165 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=12 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:17:51.246557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783473e7-c0c2-43d8-9a31-ccb6ad539b3f service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:17:51.267291 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783473e7-c0c2-43d8-9a31-ccb6ad539b3f service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:17:51.271016 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a8368-e680-434f-ac39-eb75dc511fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:17:51.272010 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a8368-e680-434f-ac39-eb75dc511fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:17:51.272302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a8368-e680-434f-ac39-eb75dc511fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:17:51.272640 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a8368-e680-434f-ac39-eb75dc511fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:17:51.282446 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a8368-e680-434f-ac39-eb75dc511fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:17:51.283934 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a8368-e680-434f-ac39-eb75dc511fe2 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:17:51.294956 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4566/9145] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:17:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:18:01.290608 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=10 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:39.632313 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd6f22-b76a-44c7-a96c-0ae09eb75d01 service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:39.654516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd6f22-b76a-44c7-a96c-0ae09eb75d01 service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:39.660046 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20299e6-ff97-4be8-8a2f-d805dd46cae3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:39.660778 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20299e6-ff97-4be8-8a2f-d805dd46cae3 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:39.661061 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20299e6-ff97-4be8-8a2f-d805dd46cae3 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:39.661334 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20299e6-ff97-4be8-8a2f-d805dd46cae3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:39.670450 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20299e6-ff97-4be8-8a2f-d805dd46cae3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:39.672075 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20299e6-ff97-4be8-8a2f-d805dd46cae3 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:39.684051 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4580/9146] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:18:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:18:43.453048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a8368-e680-434f-ac39-eb75dc511fe2 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:18:43.469969 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a8368-e680-434f-ac39-eb75dc511fe2 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:18:43.475245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e53b50-26c8-4624-b8e7-663fbb2c14c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:18:43.475864 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e53b50-26c8-4624-b8e7-663fbb2c14c9 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:18:43.476632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e53b50-26c8-4624-b8e7-663fbb2c14c9 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:18:43.476632 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e53b50-26c8-4624-b8e7-663fbb2c14c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:18:43.490701 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e53b50-26c8-4624-b8e7-663fbb2c14c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:18:43.492327 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e53b50-26c8-4624-b8e7-663fbb2c14c9 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:18:43.504440 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4567/9147] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:18:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:18:49.678675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=10 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:18:53.499650 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:03.950897 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20299e6-ff97-4be8-8a2f-d805dd46cae3 service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:03.961205 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20299e6-ff97-4be8-8a2f-d805dd46cae3 service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:03.965261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879d3e7-d132-4922-9709-729fa4bb3687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:03.965994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879d3e7-d132-4922-9709-729fa4bb3687 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:03.966284 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879d3e7-d132-4922-9709-729fa4bb3687 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:03.966564 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879d3e7-d132-4922-9709-729fa4bb3687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:03.975460 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879d3e7-d132-4922-9709-729fa4bb3687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:03.976917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879d3e7-d132-4922-9709-729fa4bb3687 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:03.985309 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4581/9148] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:05.115544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e53b50-26c8-4624-b8e7-663fbb2c14c9 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:05.125080 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e53b50-26c8-4624-b8e7-663fbb2c14c9 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:05.129933 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9001a80-66c3-4515-80c3-7397617dd3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:05.130534 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001a80-66c3-4515-80c3-7397617dd3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:05.130847 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001a80-66c3-4515-80c3-7397617dd3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:05.131122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001a80-66c3-4515-80c3-7397617dd3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:05.141721 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9001a80-66c3-4515-80c3-7397617dd3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:05.143283 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9001a80-66c3-4515-80c3-7397617dd3e8 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:05.154772 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4568/9149] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:05.244184 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879d3e7-d132-4922-9709-729fa4bb3687 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:05.256619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879d3e7-d132-4922-9709-729fa4bb3687 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:05.261693 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc43c7a-d393-4bf6-809c-9bebcb587c5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:05.262305 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43c7a-d393-4bf6-809c-9bebcb587c5f service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:05.262612 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43c7a-d393-4bf6-809c-9bebcb587c5f service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:05.262923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc43c7a-d393-4bf6-809c-9bebcb587c5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:05.271984 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc43c7a-d393-4bf6-809c-9bebcb587c5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:05.273579 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc43c7a-d393-4bf6-809c-9bebcb587c5f service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:05.284486 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4582/9150] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:05.418512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9001a80-66c3-4515-80c3-7397617dd3e8 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:20:05.431455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9001a80-66c3-4515-80c3-7397617dd3e8 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:20:05.437253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b33e25-89be-440e-921c-5485dff11e2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:20:05.437891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b33e25-89be-440e-921c-5485dff11e2f service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:20:05.438176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b33e25-89be-440e-921c-5485dff11e2f service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:20:05.438448 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b33e25-89be-440e-921c-5485dff11e2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:20:05.448916 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b33e25-89be-440e-921c-5485dff11e2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:20:05.450496 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b33e25-89be-440e-921c-5485dff11e2f service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:20:05.461025 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4569/9151] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:20:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:20:15.280063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=12 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:20:15.456694 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=12 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:21:51.909644 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc43c7a-d393-4bf6-809c-9bebcb587c5f service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:51.936899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc43c7a-d393-4bf6-809c-9bebcb587c5f service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:51.943396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dada9-87d4-48dd-a6f7-dc572b1a5013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:51.944431 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dada9-87d4-48dd-a6f7-dc572b1a5013 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:51.944938 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dada9-87d4-48dd-a6f7-dc572b1a5013 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:51.945380 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dada9-87d4-48dd-a6f7-dc572b1a5013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:52.056057 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74dada9-87d4-48dd-a6f7-dc572b1a5013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:52.057709 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74dada9-87d4-48dd-a6f7-dc572b1a5013 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:52.081997 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4583/9152] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:56.176844 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b33e25-89be-440e-921c-5485dff11e2f service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:56.247876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b33e25-89be-440e-921c-5485dff11e2f service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:56.255082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72909a-92dc-4428-a619-9395828599f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:56.255801 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72909a-92dc-4428-a619-9395828599f1 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:56.256131 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72909a-92dc-4428-a619-9395828599f1 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:56.256465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72909a-92dc-4428-a619-9395828599f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:56.258391 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6f72909a-92dc-4428-a619-9395828599f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:21:56.300264 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72909a-92dc-4428-a619-9395828599f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:21:56.303592 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72909a-92dc-4428-a619-9395828599f1 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:21:56.321525 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4570/9153] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:21:59.948471 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dada9-87d4-48dd-a6f7-dc572b1a5013 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:21:59.974447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dada9-87d4-48dd-a6f7-dc572b1a5013 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:21:59.984116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43d192-286c-4084-a4e7-ad307b0bba2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:21:59.984965 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d192-286c-4084-a4e7-ad307b0bba2c service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:21:59.985573 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d192-286c-4084-a4e7-ad307b0bba2c service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:21:59.985956 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d192-286c-4084-a4e7-ad307b0bba2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:21:59.987885 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4b43d192-286c-4084-a4e7-ad307b0bba2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:00.005889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43d192-286c-4084-a4e7-ad307b0bba2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:00.010013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43d192-286c-4084-a4e7-ad307b0bba2c service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:00.021472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72909a-92dc-4428-a619-9395828599f1 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:00.030643 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4584/9154] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:21:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:00.039307 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72909a-92dc-4428-a619-9395828599f1 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:00.053348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:00.055148 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:00.055616 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:00.056017 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] PATH_INFO: `/v3/users/0bc28dac30a843f7b142c742394d7e91` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:00.057754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bc28dac30a843f7b142c742394d7e91)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:00.060130 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:00.125455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bc28dac30a843f7b142c742394d7e91'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.133005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bc28dac30a843f7b142c742394d7e91'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.133657 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bc28dac30a843f7b142c742394d7e91'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.146243 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bc28dac30a843f7b142c742394d7e91'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.146931 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bc28dac30a843f7b142c742394d7e91'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.174766 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4571/9155] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 20:22:00 2022] DELETE /identity/v3/users/0bc28dac30a843f7b142c742394d7e91 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:00.399603 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43d192-286c-4084-a4e7-ad307b0bba2c service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:00.413922 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43d192-286c-4084-a4e7-ad307b0bba2c service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:00.493857 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:00.494619 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:00.494940 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:00.495268 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] PATH_INFO: `/v3/projects/82b1fb75aba5462599f0d3758823031e` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:00.497465 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b1fb75aba5462599f0d3758823031e)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:00.501063 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:00.554899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:00.580848 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b1fb75aba5462599f0d3758823031e', 'request_id': 'req-6c384768-3d71-4213-b9b1-9319ffea8f95'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.592723 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b1fb75aba5462599f0d3758823031e', 'request_id': 'req-6c384768-3d71-4213-b9b1-9319ffea8f95'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.603272 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b1fb75aba5462599f0d3758823031e', 'request_id': 'req-6c384768-3d71-4213-b9b1-9319ffea8f95'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.638541 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] The token cache is being invalidate because project 82b1fb75aba5462599f0d3758823031e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:22:00.639282 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.645013 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.645013 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4585/9156] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 20:22:00 2022] DELETE /identity/v3/projects/82b1fb75aba5462599f0d3758823031e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:00.647846 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:00.649293 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:00.665038 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61b47c-86f3-40f2-b59b-66623f323ccc admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:00.733631 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d8b6c-1d83-4f16-ba27-d66e02ba284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:00.735986 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d8b6c-1d83-4f16-ba27-d66e02ba284c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:00.736267 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d8b6c-1d83-4f16-ba27-d66e02ba284c admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:00.736541 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d8b6c-1d83-4f16-ba27-d66e02ba284c admin admin] PATH_INFO: `/v3/users/467ce1fc86c34ae1bf0ad244faa882af` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:00.737734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d8b6c-1d83-4f16-ba27-d66e02ba284c admin admin] RBAC: Authorizing `identity:delete_user(user_id=467ce1fc86c34ae1bf0ad244faa882af)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:00.739739 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d8b6c-1d83-4f16-ba27-d66e02ba284c admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:00.771698 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:00.803948 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe6d8b6c-1d83-4f16-ba27-d66e02ba284c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467ce1fc86c34ae1bf0ad244faa882af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.811507 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe6d8b6c-1d83-4f16-ba27-d66e02ba284c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467ce1fc86c34ae1bf0ad244faa882af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.812274 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe6d8b6c-1d83-4f16-ba27-d66e02ba284c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467ce1fc86c34ae1bf0ad244faa882af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.822374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe6d8b6c-1d83-4f16-ba27-d66e02ba284c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467ce1fc86c34ae1bf0ad244faa882af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.823194 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-fe6d8b6c-1d83-4f16-ba27-d66e02ba284c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467ce1fc86c34ae1bf0ad244faa882af'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:00.848750 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4572/9157] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 20:22:00 2022] DELETE /identity/v3/users/467ce1fc86c34ae1bf0ad244faa882af => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:01.058413 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:01.061299 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:01.080962 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c384768-3d71-4213-b9b1-9319ffea8f95 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:01.159338 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada97ddb-a27c-4a02-b527-933d5400baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:01.159916 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97ddb-a27c-4a02-b527-933d5400baf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:01.160265 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97ddb-a27c-4a02-b527-933d5400baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:01.160510 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97ddb-a27c-4a02-b527-933d5400baf5 admin admin] PATH_INFO: `/v3/projects/b79e75f4240e4264b1732aaf2a8634e2` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:01.161677 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada97ddb-a27c-4a02-b527-933d5400baf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79e75f4240e4264b1732aaf2a8634e2)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:01.163656 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada97ddb-a27c-4a02-b527-933d5400baf5 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:01.222668 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ada97ddb-a27c-4a02-b527-933d5400baf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79e75f4240e4264b1732aaf2a8634e2', 'request_id': 'req-ada97ddb-a27c-4a02-b527-933d5400baf5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:01.233325 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ada97ddb-a27c-4a02-b527-933d5400baf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79e75f4240e4264b1732aaf2a8634e2', 'request_id': 'req-ada97ddb-a27c-4a02-b527-933d5400baf5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:01.241283 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ada97ddb-a27c-4a02-b527-933d5400baf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79e75f4240e4264b1732aaf2a8634e2', 'request_id': 'req-ada97ddb-a27c-4a02-b527-933d5400baf5'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:01.258069 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ada97ddb-a27c-4a02-b527-933d5400baf5 admin admin] The token cache is being invalidate because project b79e75f4240e4264b1732aaf2a8634e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:22:01.258403 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ada97ddb-a27c-4a02-b527-933d5400baf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:01.259085 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-ada97ddb-a27c-4a02-b527-933d5400baf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:22:01.260676 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4586/9158] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 20:22:01 2022] DELETE /identity/v3/projects/b79e75f4240e4264b1732aaf2a8634e2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:01.266020 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a538c1-7d73-4476-8f50-2b706263fc5f None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:01.266582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a538c1-7d73-4476-8f50-2b706263fc5f None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:01.266582 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a538c1-7d73-4476-8f50-2b706263fc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:01.299665 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-79a538c1-7d73-4476-8f50-2b706263fc5f None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:01.300913 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-79a538c1-7d73-4476-8f50-2b706263fc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:01.372775 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4573/9159] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:01.381492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020de0e-f3a3-4caa-82b5-04d3fab2a910 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:01.381492 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020de0e-f3a3-4caa-82b5-04d3fab2a910 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:01.383544 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020de0e-f3a3-4caa-82b5-04d3fab2a910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:01.403578 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-4020de0e-f3a3-4caa-82b5-04d3fab2a910 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:01.404799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-4020de0e-f3a3-4caa-82b5-04d3fab2a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:01.413208 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4587/9160] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:01.417835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a538c1-7d73-4476-8f50-2b706263fc5f None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:01.432472 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a538c1-7d73-4476-8f50-2b706263fc5f None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:01.441512 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38fc10-f42e-43c6-b185-82f1250f262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:01.442946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38fc10-f42e-43c6-b185-82f1250f262e admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:01.442946 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38fc10-f42e-43c6-b185-82f1250f262e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:01.443767 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38fc10-f42e-43c6-b185-82f1250f262e admin admin] PATH_INFO: `/v3/domains` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:01.444298 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38fc10-f42e-43c6-b185-82f1250f262e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 20:22:01.444755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38fc10-f42e-43c6-b185-82f1250f262e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:01.447528 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38fc10-f42e-43c6-b185-82f1250f262e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:01.460459 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4574/9161] 10.222.0.70 () {58 vars in 1153 bytes} [Sun Aug 28 20:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 20:22:01.465994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020de0e-f3a3-4caa-82b5-04d3fab2a910 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:01.479893 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020de0e-f3a3-4caa-82b5-04d3fab2a910 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:01.486040 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4ec29-c155-4065-988e-a19f3626318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:01.486658 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4ec29-c155-4065-988e-a19f3626318e admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:01.487011 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4ec29-c155-4065-988e-a19f3626318e admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:01.487248 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4ec29-c155-4065-988e-a19f3626318e admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:01.487889 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4ec29-c155-4065-988e-a19f3626318e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:01.489818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4ec29-c155-4065-988e-a19f3626318e admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:01.524636 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4588/9162] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 20:22:01 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:01.530463 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38fc10-f42e-43c6-b185-82f1250f262e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:01.541123 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38fc10-f42e-43c6-b185-82f1250f262e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:01.612536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8bb33-8acb-4c06-a3dc-0536ddb81db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:01.613168 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8bb33-8acb-4c06-a3dc-0536ddb81db8 admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:01.613453 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8bb33-8acb-4c06-a3dc-0536ddb81db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:01.613733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8bb33-8acb-4c06-a3dc-0536ddb81db8 admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:01.614373 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8bb33-8acb-4c06-a3dc-0536ddb81db8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:01.616436 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8bb33-8acb-4c06-a3dc-0536ddb81db8 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:01.638313 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4575/9163] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 20:22:01 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:01.643263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4ec29-c155-4065-988e-a19f3626318e admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:01.656000 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4ec29-c155-4065-988e-a19f3626318e admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:01.660992 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbd2d7-6596-4a15-a15d-15aef82d361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:01.661604 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbd2d7-6596-4a15-a15d-15aef82d361f admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:01.661891 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbd2d7-6596-4a15-a15d-15aef82d361f admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:01.662170 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbd2d7-6596-4a15-a15d-15aef82d361f admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:01.662853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbd2d7-6596-4a15-a15d-15aef82d361f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:01.664528 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbd2d7-6596-4a15-a15d-15aef82d361f admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:01.675753 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4589/9164] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:01.680122 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8bb33-8acb-4c06-a3dc-0536ddb81db8 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:01.691754 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8bb33-8acb-4c06-a3dc-0536ddb81db8 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:01.696688 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15e8bf-c545-4956-be99-f494014d5783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:01.697610 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e8bf-c545-4956-be99-f494014d5783 admin admin] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:01.697965 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e8bf-c545-4956-be99-f494014d5783 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:01.698284 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15e8bf-c545-4956-be99-f494014d5783 admin admin] PATH_INFO: `/v3/roles` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:01.699047 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15e8bf-c545-4956-be99-f494014d5783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:01.700836 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15e8bf-c545-4956-be99-f494014d5783 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:01.702334 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:01.719178 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4576/9165] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 20:22:01.721095 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbd2d7-6596-4a15-a15d-15aef82d361f admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:01.729828 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:01.738225 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbd2d7-6596-4a15-a15d-15aef82d361f admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:01.744840 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7e661-39e7-4014-8428-ce5643eb7721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:01.745589 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e661-39e7-4014-8428-ce5643eb7721 admin admin] REQUEST_METHOD: `PUT` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:01.745952 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e661-39e7-4014-8428-ce5643eb7721 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:01.746302 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7e661-39e7-4014-8428-ce5643eb7721 admin admin] PATH_INFO: `/v3/projects/df9cc81444cf476c896eb4cecd5239ef/users/ddb97ddfb11f4c1f94e9b30d325c2348/roles/24fee0983ae345c288f4974d93a3805d` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:01.762193 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7e661-39e7-4014-8428-ce5643eb7721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9cc81444cf476c896eb4cecd5239ef, user_id=ddb97ddfb11f4c1f94e9b30d325c2348, role_id=24fee0983ae345c288f4974d93a3805d)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:01.765055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7e661-39e7-4014-8428-ce5643eb7721 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:01.781071 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4590/9166] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:01 2022] PUT /identity/v3/projects/df9cc81444cf476c896eb4cecd5239ef/users/ddb97ddfb11f4c1f94e9b30d325c2348/roles/24fee0983ae345c288f4974d93a3805d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:22:01.787124 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae0f32-46c0-41fe-ad5c-2df730dea016 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:01.787403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae0f32-46c0-41fe-ad5c-2df730dea016 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:01.787681 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae0f32-46c0-41fe-ad5c-2df730dea016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:01.808490 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-65ae0f32-46c0-41fe-ad5c-2df730dea016 None None] MFA Rules not processed for user `60fe26b30a2d4d8bbf2347a182f6c4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:01.809962 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-65ae0f32-46c0-41fe-ad5c-2df730dea016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:01.874295 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4577/9167] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:01.883994 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7e661-39e7-4014-8428-ce5643eb7721 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:01.885722 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-63d7e661-39e7-4014-8428-ce5643eb7721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:01.947083 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7e661-39e7-4014-8428-ce5643eb7721 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:01.951440 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884de5e4-5697-4d20-90ba-10b5bbe2de5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:01.952055 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de5e4-5697-4d20-90ba-10b5bbe2de5a service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:01.952336 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de5e4-5697-4d20-90ba-10b5bbe2de5a service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:01.952611 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884de5e4-5697-4d20-90ba-10b5bbe2de5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:01.962392 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884de5e4-5697-4d20-90ba-10b5bbe2de5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:01.963865 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884de5e4-5697-4d20-90ba-10b5bbe2de5a service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:01.975210 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4591/9168] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:07.062708 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52a6d-be6f-4da7-848a-b75fa1c21b7d None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:07.063218 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52a6d-be6f-4da7-848a-b75fa1c21b7d None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:07.063331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52a6d-be6f-4da7-848a-b75fa1c21b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:07.099014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-96a52a6d-be6f-4da7-848a-b75fa1c21b7d None None] MFA Rules not processed for user `ddb97ddfb11f4c1f94e9b30d325c2348`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:07.100386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-96a52a6d-be6f-4da7-848a-b75fa1c21b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:07.221431 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4578/9169] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:22:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:07.222781 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884de5e4-5697-4d20-90ba-10b5bbe2de5a service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:07.234918 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884de5e4-5697-4d20-90ba-10b5bbe2de5a service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:07.247758 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3616c-321c-48dc-aaab-f174f4f99de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:07.249151 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3616c-321c-48dc-aaab-f174f4f99de9 admin admin] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:07.249469 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3616c-321c-48dc-aaab-f174f4f99de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:07.249899 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3616c-321c-48dc-aaab-f174f4f99de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:07.250874 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3616c-321c-48dc-aaab-f174f4f99de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:07.252942 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3616c-321c-48dc-aaab-f174f4f99de9 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:07.293904 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4592/9170] 10.222.0.70 () {60 vars in 1153 bytes} [Sun Aug 28 20:22:07 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:07.300193 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a52a6d-be6f-4da7-848a-b75fa1c21b7d None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:07.313958 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a52a6d-be6f-4da7-848a-b75fa1c21b7d None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:07.387337 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12b8c2-e185-4b77-a97d-d873e43c162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:07.387983 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12b8c2-e185-4b77-a97d-d873e43c162e admin admin] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:07.388347 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12b8c2-e185-4b77-a97d-d873e43c162e admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:07.388726 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12b8c2-e185-4b77-a97d-d873e43c162e admin admin] PATH_INFO: `/v3/users` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:07.389494 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12b8c2-e185-4b77-a97d-d873e43c162e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:07.391883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12b8c2-e185-4b77-a97d-d873e43c162e admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:07.425081 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4579/9171] 10.222.0.70 () {60 vars in 1144 bytes} [Sun Aug 28 20:22:07 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 20:22:07.430675 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3616c-321c-48dc-aaab-f174f4f99de9 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:07.457844 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3616c-321c-48dc-aaab-f174f4f99de9 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:07.463237 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c75cc1-8ec4-47ed-85ba-8168924d51c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:07.463917 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c75cc1-8ec4-47ed-85ba-8168924d51c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:07.464224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c75cc1-8ec4-47ed-85ba-8168924d51c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:07.464501 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c75cc1-8ec4-47ed-85ba-8168924d51c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:07.465784 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c75cc1-8ec4-47ed-85ba-8168924d51c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:07.467519 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c75cc1-8ec4-47ed-85ba-8168924d51c4 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:07.486772 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4593/9172] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:07.488166 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12b8c2-e185-4b77-a97d-d873e43c162e admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:07.502630 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12b8c2-e185-4b77-a97d-d873e43c162e admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:07.510451 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de393b22-1cac-4547-9b21-dbfe89adbc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:07.513231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de393b22-1cac-4547-9b21-dbfe89adbc0f admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:07.514253 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de393b22-1cac-4547-9b21-dbfe89adbc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:07.514557 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de393b22-1cac-4547-9b21-dbfe89adbc0f admin admin] PATH_INFO: `/v3/projects/568f6507dc06428c9defc4d63bbe40ca/users/7672af96b0fa405982e64028f64d5f3b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:07.532691 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:07.536492 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de393b22-1cac-4547-9b21-dbfe89adbc0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=568f6507dc06428c9defc4d63bbe40ca, user_id=7672af96b0fa405982e64028f64d5f3b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:07.540304 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de393b22-1cac-4547-9b21-dbfe89adbc0f admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:07.568799 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4580/9173] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:07 2022] PUT /identity/v3/projects/568f6507dc06428c9defc4d63bbe40ca/users/7672af96b0fa405982e64028f64d5f3b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:22:07.572575 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c75cc1-8ec4-47ed-85ba-8168924d51c4 admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:07.587640 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c75cc1-8ec4-47ed-85ba-8168924d51c4 admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:07.663376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb68712-53f4-4b98-916f-5e2aa83de111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:07.664020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb68712-53f4-4b98-916f-5e2aa83de111 admin admin] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:07.664319 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb68712-53f4-4b98-916f-5e2aa83de111 admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:07.664600 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb68712-53f4-4b98-916f-5e2aa83de111 admin admin] PATH_INFO: `/v3/roles` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:07.665254 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb68712-53f4-4b98-916f-5e2aa83de111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:07.666932 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb68712-53f4-4b98-916f-5e2aa83de111 admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:07.684952 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4594/9174] 10.222.0.70 () {58 vars in 1122 bytes} [Sun Aug 28 20:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 20:22:07.686390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de393b22-1cac-4547-9b21-dbfe89adbc0f admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:07.698627 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de393b22-1cac-4547-9b21-dbfe89adbc0f admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:07.707151 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555d2a4-6459-4d07-b1f4-92fa1ff1dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:07.708161 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555d2a4-6459-4d07-b1f4-92fa1ff1dc78 admin admin] REQUEST_METHOD: `PUT` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:07.708577 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555d2a4-6459-4d07-b1f4-92fa1ff1dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:07.708991 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555d2a4-6459-4d07-b1f4-92fa1ff1dc78 admin admin] PATH_INFO: `/v3/projects/568f6507dc06428c9defc4d63bbe40ca/users/7672af96b0fa405982e64028f64d5f3b/roles/9f40fd4221dd48e99cfdb0def78f267a` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:07.712374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555d2a4-6459-4d07-b1f4-92fa1ff1dc78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=568f6507dc06428c9defc4d63bbe40ca, user_id=7672af96b0fa405982e64028f64d5f3b, role_id=9f40fd4221dd48e99cfdb0def78f267a)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:07.716315 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555d2a4-6459-4d07-b1f4-92fa1ff1dc78 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:07.729582 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4581/9175] 10.222.0.70 () {60 vars in 1483 bytes} [Sun Aug 28 20:22:07 2022] PUT /identity/v3/projects/568f6507dc06428c9defc4d63bbe40ca/users/7672af96b0fa405982e64028f64d5f3b/roles/9f40fd4221dd48e99cfdb0def78f267a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:22:13.097849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff4c2c-45ef-44d0-8726-c36fb32f1934 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:13.098328 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff4c2c-45ef-44d0-8726-c36fb32f1934 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:13.098461 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff4c2c-45ef-44d0-8726-c36fb32f1934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:13.131566 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-daff4c2c-45ef-44d0-8726-c36fb32f1934 None None] MFA Rules not processed for user `7672af96b0fa405982e64028f64d5f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:13.132801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-daff4c2c-45ef-44d0-8726-c36fb32f1934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:13.177375 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:13.244066 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4595/9176] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:22:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:13.264184 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555d2a4-6459-4d07-b1f4-92fa1ff1dc78 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:13.267230 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6555d2a4-6459-4d07-b1f4-92fa1ff1dc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:13.415368 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555d2a4-6459-4d07-b1f4-92fa1ff1dc78 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:13.429869 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19acbd4-d9ab-4147-8951-851e680b5b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:13.431734 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19acbd4-d9ab-4147-8951-851e680b5b8c service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:13.432564 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19acbd4-d9ab-4147-8951-851e680b5b8c service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:13.433078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19acbd4-d9ab-4147-8951-851e680b5b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:13.522208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19acbd4-d9ab-4147-8951-851e680b5b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:13.523968 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19acbd4-d9ab-4147-8951-851e680b5b8c service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:13.543254 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4582/9177] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:14.931721 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42157e5a-8743-49c2-bff2-56d3ea1f0dc6 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:14.936388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42157e5a-8743-49c2-bff2-56d3ea1f0dc6 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:14.936388 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42157e5a-8743-49c2-bff2-56d3ea1f0dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:14.975854 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-42157e5a-8743-49c2-bff2-56d3ea1f0dc6 None None] MFA Rules not processed for user `ddb97ddfb11f4c1f94e9b30d325c2348`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:22:14.977019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-42157e5a-8743-49c2-bff2-56d3ea1f0dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:14.987974 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4596/9178] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:22:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:22:15.045362 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19acbd4-d9ab-4147-8951-851e680b5b8c service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:15.050242 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-c19acbd4-d9ab-4147-8951-851e680b5b8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:15.129146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19acbd4-d9ab-4147-8951-851e680b5b8c service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:15.132835 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34fd93-ebcf-4a85-b51c-d5172067f729 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:15.133455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34fd93-ebcf-4a85-b51c-d5172067f729 service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:15.133736 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34fd93-ebcf-4a85-b51c-d5172067f729 service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:15.134007 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34fd93-ebcf-4a85-b51c-d5172067f729 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:15.135822 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5d34fd93-ebcf-4a85-b51c-d5172067f729 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:15.153716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34fd93-ebcf-4a85-b51c-d5172067f729 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:15.156396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34fd93-ebcf-4a85-b51c-d5172067f729 service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:15.172685 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4583/9179] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:15.534694 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42157e5a-8743-49c2-bff2-56d3ea1f0dc6 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:15.619166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42157e5a-8743-49c2-bff2-56d3ea1f0dc6 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:15.623967 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5f9af-3f31-43e2-a229-bf3f47bf463c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:15.624591 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5f9af-3f31-43e2-a229-bf3f47bf463c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:15.624871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5f9af-3f31-43e2-a229-bf3f47bf463c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:15.625164 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5f9af-3f31-43e2-a229-bf3f47bf463c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:15.627223 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1ca5f9af-3f31-43e2-a229-bf3f47bf463c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:15.638314 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5f9af-3f31-43e2-a229-bf3f47bf463c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:15.639825 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5f9af-3f31-43e2-a229-bf3f47bf463c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:15.649574 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4597/9180] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:16.070344 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34fd93-ebcf-4a85-b51c-d5172067f729 service glance] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:16.083390 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34fd93-ebcf-4a85-b51c-d5172067f729 service glance] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:16.090191 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6022b7c-79a0-4bcd-8d6d-4494e1f39f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:16.091066 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6022b7c-79a0-4bcd-8d6d-4494e1f39f01 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:16.091500 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6022b7c-79a0-4bcd-8d6d-4494e1f39f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:16.092245 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6022b7c-79a0-4bcd-8d6d-4494e1f39f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:16.094793 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-b6022b7c-79a0-4bcd-8d6d-4494e1f39f01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:16.111207 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:16.116906 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6022b7c-79a0-4bcd-8d6d-4494e1f39f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:16.120536 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6022b7c-79a0-4bcd-8d6d-4494e1f39f01 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:16.150769 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4584/9181] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:19.167354 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5f9af-3f31-43e2-a229-bf3f47bf463c service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:19.169887 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-1ca5f9af-3f31-43e2-a229-bf3f47bf463c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:19.195482 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5f9af-3f31-43e2-a229-bf3f47bf463c service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:19.203801 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad429d5d-6e5d-4086-9398-f3d85e4c3a3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:19.205993 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad429d5d-6e5d-4086-9398-f3d85e4c3a3e service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:19.206645 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad429d5d-6e5d-4086-9398-f3d85e4c3a3e service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:19.207273 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad429d5d-6e5d-4086-9398-f3d85e4c3a3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:19.210234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-ad429d5d-6e5d-4086-9398-f3d85e4c3a3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:22:19.228817 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad429d5d-6e5d-4086-9398-f3d85e4c3a3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:19.232481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad429d5d-6e5d-4086-9398-f3d85e4c3a3e service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:19.254004 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4598/9182] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:22:26.141068 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=2 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:28.631139 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6022b7c-79a0-4bcd-8d6d-4494e1f39f01 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:22:28.640563 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6022b7c-79a0-4bcd-8d6d-4494e1f39f01 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:22:28.644271 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a27eb-3f0a-48ac-80d1-ad3a477c7a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:22:28.644876 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a27eb-3f0a-48ac-80d1-ad3a477c7a79 service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:22:28.645163 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a27eb-3f0a-48ac-80d1-ad3a477c7a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:22:28.645440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a27eb-3f0a-48ac-80d1-ad3a477c7a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:22:28.655773 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a27eb-3f0a-48ac-80d1-ad3a477c7a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:22:28.657208 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a27eb-3f0a-48ac-80d1-ad3a477c7a79 service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:22:28.667010 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4585/9183] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:22:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:22:29.242595 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=53 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:22:38.662589 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:01.373613 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad429d5d-6e5d-4086-9398-f3d85e4c3a3e service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:01.383134 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad429d5d-6e5d-4086-9398-f3d85e4c3a3e service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:01.387625 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557e0c5-3cc9-4749-81a8-6c486efa7031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:01.388231 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557e0c5-3cc9-4749-81a8-6c486efa7031 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:01.388517 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557e0c5-3cc9-4749-81a8-6c486efa7031 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:01.388796 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557e0c5-3cc9-4749-81a8-6c486efa7031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:01.390503 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5557e0c5-3cc9-4749-81a8-6c486efa7031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:01.400077 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557e0c5-3cc9-4749-81a8-6c486efa7031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:01.402147 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557e0c5-3cc9-4749-81a8-6c486efa7031 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:01.410463 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4599/9184] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:23:11.406824 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:23:44.652329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a27eb-3f0a-48ac-80d1-ad3a477c7a79 service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:44.653973 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-cf6a27eb-3f0a-48ac-80d1-ad3a477c7a79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:44.756352 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a27eb-3f0a-48ac-80d1-ad3a477c7a79 service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:44.765175 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28f0de-7483-45e2-8a6c-8e9067a0a46e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:44.765806 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28f0de-7483-45e2-8a6c-8e9067a0a46e service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:44.766093 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28f0de-7483-45e2-8a6c-8e9067a0a46e service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:44.766374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28f0de-7483-45e2-8a6c-8e9067a0a46e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:44.768339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-7b28f0de-7483-45e2-8a6c-8e9067a0a46e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:44.781670 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28f0de-7483-45e2-8a6c-8e9067a0a46e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:44.783311 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28f0de-7483-45e2-8a6c-8e9067a0a46e service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:44.793694 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4586/9185] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:23:51.413020 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557e0c5-3cc9-4749-81a8-6c486efa7031 service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:23:51.414425 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-5557e0c5-3cc9-4749-81a8-6c486efa7031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:51.429234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557e0c5-3cc9-4749-81a8-6c486efa7031 service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:23:51.435281 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4512ed-ebe9-4f6a-8548-c5c63e4cfb1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:23:51.435882 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4512ed-ebe9-4f6a-8548-c5c63e4cfb1f service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:23:51.436166 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4512ed-ebe9-4f6a-8548-c5c63e4cfb1f service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:23:51.436444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4512ed-ebe9-4f6a-8548-c5c63e4cfb1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:23:51.438126 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fb4512ed-ebe9-4f6a-8548-c5c63e4cfb1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:23:51.450152 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4512ed-ebe9-4f6a-8548-c5c63e4cfb1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:23:51.451761 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4512ed-ebe9-4f6a-8548-c5c63e4cfb1f service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:23:51.461904 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4600/9186] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:23:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:23:54.789070 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=37 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:01.457439 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:30.019858 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4514e-b054-4ccc-b1d8-b6e7d35fc7e1 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:30.020456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4514e-b054-4ccc-b1d8-b6e7d35fc7e1 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:30.020568 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4514e-b054-4ccc-b1d8-b6e7d35fc7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:30.041755 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-fcb4514e-b054-4ccc-b1d8-b6e7d35fc7e1 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:30.043019 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-fcb4514e-b054-4ccc-b1d8-b6e7d35fc7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:30.104638 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4587/9187] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 20:24:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:24:30.166122 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4512ed-ebe9-4f6a-8548-c5c63e4cfb1f service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:30.167890 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-fb4512ed-ebe9-4f6a-8548-c5c63e4cfb1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:30.259569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4512ed-ebe9-4f6a-8548-c5c63e4cfb1f service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:30.265572 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c545-8220-4963-bc1b-c7dd8534888d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:30.266234 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c545-8220-4963-bc1b-c7dd8534888d service swift] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:30.266540 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c545-8220-4963-bc1b-c7dd8534888d service swift] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:30.266855 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c545-8220-4963-bc1b-c7dd8534888d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:30.277367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c545-8220-4963-bc1b-c7dd8534888d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:30.279185 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c545-8220-4963-bc1b-c7dd8534888d service swift] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:30.295599 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4601/9188] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 20:24:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:24:39.994491 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd3207-cc99-47f2-b867-a0b45ae5c2b3 None None] REQUEST_METHOD: `POST` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:39.995482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd3207-cc99-47f2-b867-a0b45ae5c2b3 None None] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:39.995482 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd3207-cc99-47f2-b867-a0b45ae5c2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:40.017396 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.auth.core [None req-ecfd3207-cc99-47f2-b867-a0b45ae5c2b3 None None] MFA Rules not processed for user `ddb97ddfb11f4c1f94e9b30d325c2348`. Rule list: `[]` (Enabled: `True`). {{(pid=88375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:40.019426 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-ecfd3207-cc99-47f2-b867-a0b45ae5c2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:40.029070 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4588/9189] 10.222.0.70 () {58 vars in 958 bytes} [Sun Aug 28 20:24:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 20:24:40.284953 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=32 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:46.059799 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c3d16-de15-4f62-a293-afa682ec0c42 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:46.060397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c3d16-de15-4f62-a293-afa682ec0c42 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:46.060397 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c3d16-de15-4f62-a293-afa682ec0c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:46.083601 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-540c3d16-de15-4f62-a293-afa682ec0c42 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:24:46.084853 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-540c3d16-de15-4f62-a293-afa682ec0c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:46.093745 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4602/9190] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 20:24:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:24:46.107383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd3207-cc99-47f2-b867-a0b45ae5c2b3 None None] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:46.120339 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd3207-cc99-47f2-b867-a0b45ae5c2b3 None None] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:46.125697 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aadb26f-f0ec-4d40-980e-a0f95ea7a496 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:46.126357 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadb26f-f0ec-4d40-980e-a0f95ea7a496 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:46.126686 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadb26f-f0ec-4d40-980e-a0f95ea7a496 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:46.127005 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadb26f-f0ec-4d40-980e-a0f95ea7a496 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:46.136573 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aadb26f-f0ec-4d40-980e-a0f95ea7a496 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:46.138176 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aadb26f-f0ec-4d40-980e-a0f95ea7a496 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:46.146870 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4589/9191] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 20:24:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:24:56.079818 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=3 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:56.143336 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=34 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:24:56.627800 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c3d16-de15-4f62-a293-afa682ec0c42 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:24:56.639019 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c3d16-de15-4f62-a293-afa682ec0c42 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:24:56.642670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae2402-b345-4857-ae96-9e696e9fae73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:24:56.643621 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae2402-b345-4857-ae96-9e696e9fae73 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:24:56.643902 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae2402-b345-4857-ae96-9e696e9fae73 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:24:56.644174 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae2402-b345-4857-ae96-9e696e9fae73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:24:56.645957 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-57ae2402-b345-4857-ae96-9e696e9fae73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:24:56.656524 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae2402-b345-4857-ae96-9e696e9fae73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:24:56.657948 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae2402-b345-4857-ae96-9e696e9fae73 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:24:56.666725 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4603/9192] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:24:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:25:06.662481 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=6 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:13.486183 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aadb26f-f0ec-4d40-980e-a0f95ea7a496 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:13.506331 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aadb26f-f0ec-4d40-980e-a0f95ea7a496 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:13.512487 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318fd3e-9873-4fdb-ac38-ea12b624a19f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:13.513129 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318fd3e-9873-4fdb-ac38-ea12b624a19f service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:13.513415 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318fd3e-9873-4fdb-ac38-ea12b624a19f service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:13.513693 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318fd3e-9873-4fdb-ac38-ea12b624a19f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:13.515465 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-6318fd3e-9873-4fdb-ac38-ea12b624a19f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:13.544314 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318fd3e-9873-4fdb-ac38-ea12b624a19f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:13.546062 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318fd3e-9873-4fdb-ac38-ea12b624a19f service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:13.559617 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4590/9193] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:13.610629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f70c52-1c63-44a9-bdf5-730676daeda1 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:13.611104 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f70c52-1c63-44a9-bdf5-730676daeda1 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:13.611224 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f70c52-1c63-44a9-bdf5-730676daeda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:13.677116 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-b2f70c52-1c63-44a9-bdf5-730676daeda1 None None] MFA Rules not processed for user `332144d9eb5742498c0c37a70277ce5e`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:13.678330 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-b2f70c52-1c63-44a9-bdf5-730676daeda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:13.695543 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4604/9194] 10.222.0.70 () {58 vars in 1064 bytes} [Sun Aug 28 20:27:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:13.701634 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318fd3e-9873-4fdb-ac38-ea12b624a19f service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:13.711479 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318fd3e-9873-4fdb-ac38-ea12b624a19f service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:13.715407 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cef67-df0f-4fd5-a0da-a2c2a0dfd061 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332144d9eb5742498c0c37a70277ce5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:13.716014 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cef67-df0f-4fd5-a0da-a2c2a0dfd061 service glance] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:13.716297 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cef67-df0f-4fd5-a0da-a2c2a0dfd061 service glance] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:13.716576 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cef67-df0f-4fd5-a0da-a2c2a0dfd061 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:13.725206 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cef67-df0f-4fd5-a0da-a2c2a0dfd061 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:13.726937 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cef67-df0f-4fd5-a0da-a2c2a0dfd061 service glance] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:13.736206 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4591/9195] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:27:17.199048 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d3067-d4ab-4124-9792-4bbe267250aa None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:17.199553 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d3067-d4ab-4124-9792-4bbe267250aa None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:17.199650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d3067-d4ab-4124-9792-4bbe267250aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:17.251263 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-9e2d3067-d4ab-4124-9792-4bbe267250aa None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:17.252629 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-9e2d3067-d4ab-4124-9792-4bbe267250aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:17.270980 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4605/9196] 10.222.0.70 () {58 vars in 1009 bytes} [Sun Aug 28 20:27:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:17.311862 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cef67-df0f-4fd5-a0da-a2c2a0dfd061 service glance] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:17.333834 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cef67-df0f-4fd5-a0da-a2c2a0dfd061 service glance] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:17.340376 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c4b36-8fc7-4595-8d80-d0672afc8046 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:17.340980 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c4b36-8fc7-4595-8d80-d0672afc8046 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:17.341262 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c4b36-8fc7-4595-8d80-d0672afc8046 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:17.341544 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c4b36-8fc7-4595-8d80-d0672afc8046 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:17.350273 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c4b36-8fc7-4595-8d80-d0672afc8046 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:17.352575 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c4b36-8fc7-4595-8d80-d0672afc8046 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:17.361204 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4592/9197] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 20:27:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 20:27:26.139483 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adeca4-5a5f-44cc-8a46-80e15b984cbd None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:26.140060 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adeca4-5a5f-44cc-8a46-80e15b984cbd None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:26.140343 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adeca4-5a5f-44cc-8a46-80e15b984cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:26.160213 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-56adeca4-5a5f-44cc-8a46-80e15b984cbd None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:26.161398 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-56adeca4-5a5f-44cc-8a46-80e15b984cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:26.168515 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4606/9198] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 20:27:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:26.181457 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c4b36-8fc7-4595-8d80-d0672afc8046 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:26.191927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c4b36-8fc7-4595-8d80-d0672afc8046 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:26.198203 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3b305-896f-4d6e-8605-a5758383ada2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:26.198829 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b305-896f-4d6e-8605-a5758383ada2 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:26.199116 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b305-896f-4d6e-8605-a5758383ada2 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:26.199386 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b305-896f-4d6e-8605-a5758383ada2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:26.207581 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3b305-896f-4d6e-8605-a5758383ada2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:26.209165 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3b305-896f-4d6e-8605-a5758383ada2 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:26.217108 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4593/9199] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 20:27:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:27:27.703432 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adeca4-5a5f-44cc-8a46-80e15b984cbd None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:27.719757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adeca4-5a5f-44cc-8a46-80e15b984cbd None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:27.730203 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cc14a-1031-4ca6-af14-ef45807689ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:27.731135 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cc14a-1031-4ca6-af14-ef45807689ff service nova] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:27.731420 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cc14a-1031-4ca6-af14-ef45807689ff service nova] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:27.731698 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cc14a-1031-4ca6-af14-ef45807689ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:27.745751 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cc14a-1031-4ca6-af14-ef45807689ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:27.747381 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cc14a-1031-4ca6-af14-ef45807689ff service nova] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:27.759950 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4607/9200] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:27.897082 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3b305-896f-4d6e-8605-a5758383ada2 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:27.907226 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3b305-896f-4d6e-8605-a5758383ada2 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:27.911716 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa4bff-55eb-4de5-9fcc-0ea2df48030d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:27.912322 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa4bff-55eb-4de5-9fcc-0ea2df48030d service neutron] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:27.912605 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa4bff-55eb-4de5-9fcc-0ea2df48030d service neutron] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:27.912883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa4bff-55eb-4de5-9fcc-0ea2df48030d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:27.927182 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa4bff-55eb-4de5-9fcc-0ea2df48030d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:27.929998 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa4bff-55eb-4de5-9fcc-0ea2df48030d service neutron] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:27.945539 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4594/9201] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:29.144376 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cc14a-1031-4ca6-af14-ef45807689ff service nova] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:29.154484 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cc14a-1031-4ca6-af14-ef45807689ff service nova] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:29.158094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508eda2b-c50f-460a-8d72-02ff708b84b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:29.158773 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508eda2b-c50f-460a-8d72-02ff708b84b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:29.159003 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508eda2b-c50f-460a-8d72-02ff708b84b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:29.159321 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508eda2b-c50f-460a-8d72-02ff708b84b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:29.171506 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508eda2b-c50f-460a-8d72-02ff708b84b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:29.173261 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508eda2b-c50f-460a-8d72-02ff708b84b8 service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:29.186704 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4608/9202] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:29.939941 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa4bff-55eb-4de5-9fcc-0ea2df48030d service neutron] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:29.957403 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa4bff-55eb-4de5-9fcc-0ea2df48030d service neutron] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:29.963440 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfae74b-cb9f-44c2-b605-c1ef0b4c887a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea8cbbc34aab42a4ada9cbee1772847b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:29.964048 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfae74b-cb9f-44c2-b605-c1ef0b4c887a service nova] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:29.964329 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfae74b-cb9f-44c2-b605-c1ef0b4c887a service nova] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:29.964602 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfae74b-cb9f-44c2-b605-c1ef0b4c887a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:29.966341 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-2cfae74b-cb9f-44c2-b605-c1ef0b4c887a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:29.979546 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfae74b-cb9f-44c2-b605-c1ef0b4c887a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:29.982654 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfae74b-cb9f-44c2-b605-c1ef0b4c887a service nova] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:29.993349 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4595/9203] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:31.601308 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b40c12-7111-482d-a578-e0ea0b6646c3 None None] REQUEST_METHOD: `POST` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:31.601849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b40c12-7111-482d-a578-e0ea0b6646c3 None None] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:31.601849 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b40c12-7111-482d-a578-e0ea0b6646c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:31.623377 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.auth.core [None req-78b40c12-7111-482d-a578-e0ea0b6646c3 None None] MFA Rules not processed for user `299bba14d2dd48c997974093cb4f443f`. Rule list: `[]` (Enabled: `True`). {{(pid=88374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 20:27:31.624815 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-78b40c12-7111-482d-a578-e0ea0b6646c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:31.633628 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4609/9204] 10.222.0.70 () {58 vars in 967 bytes} [Sun Aug 28 20:27:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 20:27:31.645874 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfae74b-cb9f-44c2-b605-c1ef0b4c887a service nova] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:31.657695 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfae74b-cb9f-44c2-b605-c1ef0b4c887a service nova] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:31.662683 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409c154-047e-4d87-9670-c842b345c0e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8787e53dd76c430e9ebe69b79b69827e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:31.664961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409c154-047e-4d87-9670-c842b345c0e5 service swift] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:31.664961 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409c154-047e-4d87-9670-c842b345c0e5 service swift] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:31.665278 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409c154-047e-4d87-9670-c842b345c0e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:31.673625 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409c154-047e-4d87-9670-c842b345c0e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:31.675321 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409c154-047e-4d87-9670-c842b345c0e5 service swift] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:31.684987 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4596/9205] 10.222.0.70 () {60 vars in 1384 bytes} [Sun Aug 28 20:27:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 20:27:35.906961 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b40c12-7111-482d-a578-e0ea0b6646c3 None None] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:35.917770 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b40c12-7111-482d-a578-e0ea0b6646c3 None None] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:35.921361 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc851cd-bfcd-44c6-b760-bedc2b91704c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02ed42702778456ab336afdd250a1d41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:35.921970 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc851cd-bfcd-44c6-b760-bedc2b91704c service neutron] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:35.922251 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc851cd-bfcd-44c6-b760-bedc2b91704c service neutron] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:35.922531 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc851cd-bfcd-44c6-b760-bedc2b91704c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:35.986162 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc851cd-bfcd-44c6-b760-bedc2b91704c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:35.987650 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc851cd-bfcd-44c6-b760-bedc2b91704c service neutron] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:35.998034 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4610/9206] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:39.581220 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409c154-047e-4d87-9670-c842b345c0e5 service swift] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:39.591945 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=55 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:39.599382 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409c154-047e-4d87-9670-c842b345c0e5 service swift] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:39.605776 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd9cfe-d000-49b0-86aa-3626cffd64ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:39.606393 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd9cfe-d000-49b0-86aa-3626cffd64ae service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:39.606678 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd9cfe-d000-49b0-86aa-3626cffd64ae service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:39.607157 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd9cfe-d000-49b0-86aa-3626cffd64ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:39.608947 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-94fd9cfe-d000-49b0-86aa-3626cffd64ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:39.627302 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd9cfe-d000-49b0-86aa-3626cffd64ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:39.628905 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd9cfe-d000-49b0-86aa-3626cffd64ae service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:39.650561 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4597/9207] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:27:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:27:42.634871 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc851cd-bfcd-44c6-b760-bedc2b91704c service neutron] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:42.640093 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=89 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:42.647271 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc851cd-bfcd-44c6-b760-bedc2b91704c service neutron] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:42.652113 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:42.652750 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:42.653032 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:42.653445 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] PATH_INFO: `/v3/users/ddb97ddfb11f4c1f94e9b30d325c2348` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:42.654569 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb97ddfb11f4c1f94e9b30d325c2348)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:42.656552 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:42.706869 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb97ddfb11f4c1f94e9b30d325c2348'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:42.714094 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb97ddfb11f4c1f94e9b30d325c2348'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:42.714822 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb97ddfb11f4c1f94e9b30d325c2348'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:42.727534 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb97ddfb11f4c1f94e9b30d325c2348'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:42.728296 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb97ddfb11f4c1f94e9b30d325c2348'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:42.754466 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4611/9208] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 20:27:42 2022] DELETE /identity/v3/users/ddb97ddfb11f4c1f94e9b30d325c2348 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 20:27:42.935891 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd9cfe-d000-49b0-86aa-3626cffd64ae service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:42.951421 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd9cfe-d000-49b0-86aa-3626cffd64ae service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:43.013383 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:43.016200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:43.016200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:43.016200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] PATH_INFO: `/v3/projects/df9cc81444cf476c896eb4cecd5239ef` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:43.016200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9cc81444cf476c896eb4cecd5239ef)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:43.018156 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:43.066883 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9cc81444cf476c896eb4cecd5239ef', 'request_id': 'req-8ff35ad9-1439-42ad-81da-aab235a9a782'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.073189 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9cc81444cf476c896eb4cecd5239ef', 'request_id': 'req-8ff35ad9-1439-42ad-81da-aab235a9a782'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.079346 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9cc81444cf476c896eb4cecd5239ef', 'request_id': 'req-8ff35ad9-1439-42ad-81da-aab235a9a782'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.092489 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] The token cache is being invalidate because project df9cc81444cf476c896eb4cecd5239ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:43.092775 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.093394 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.094908 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4598/9209] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 20:27:42 2022] DELETE /identity/v3/projects/df9cc81444cf476c896eb4cecd5239ef => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:43.099396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:43.101323 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:43.115050 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0b236-1c3f-406a-b508-bc65b37fecfb admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:43.173705 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:43.173923 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:43.174167 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:43.174447 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] PATH_INFO: `/v3/users/7672af96b0fa405982e64028f64d5f3b` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:43.175635 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7672af96b0fa405982e64028f64d5f3b)` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:43.177588 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:43.225444 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7672af96b0fa405982e64028f64d5f3b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.232727 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7672af96b0fa405982e64028f64d5f3b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.233400 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7672af96b0fa405982e64028f64d5f3b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.245448 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7672af96b0fa405982e64028f64d5f3b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.246092 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.notifications [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7672af96b0fa405982e64028f64d5f3b'} {{(pid=88374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.248622 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:43.263113 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4612/9210] 10.222.0.70 () {58 vars in 1224 bytes} [Sun Aug 28 20:27:43 2022] DELETE /identity/v3/users/7672af96b0fa405982e64028f64d5f3b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:43.437924 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:27:43.439388 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:27:43.453927 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff35ad9-1439-42ad-81da-aab235a9a782 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:27:43.515718 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60fe26b30a2d4d8bbf2347a182f6c4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e6322e28544af5ae4a5db517170f8c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:27:43.516350 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:27:43.516628 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:27:43.516898 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] PATH_INFO: `/v3/projects/568f6507dc06428c9defc4d63bbe40ca` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:27:43.518008 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=568f6507dc06428c9defc4d63bbe40ca)` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:27:43.520190 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:27:43.542539 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:43.567146 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '568f6507dc06428c9defc4d63bbe40ca', 'request_id': 'req-9128a693-071e-46ea-8af0-302389d1ab67'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.573374 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '568f6507dc06428c9defc4d63bbe40ca', 'request_id': 'req-9128a693-071e-46ea-8af0-302389d1ab67'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.580188 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '568f6507dc06428c9defc4d63bbe40ca', 'request_id': 'req-9128a693-071e-46ea-8af0-302389d1ab67'} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.593328 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] The token cache is being invalidate because project 568f6507dc06428c9defc4d63bbe40ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 20:27:43.593614 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.594231 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.notifications [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 20:27:43.595882 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4599/9211] 10.222.0.70 () {58 vars in 1233 bytes} [Sun Aug 28 20:27:43 2022] DELETE /identity/v3/projects/568f6507dc06428c9defc4d63bbe40ca => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 20:27:53.262371 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:27:53.590031 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:28:49.626516 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:49.627954 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:49.707757 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b1276-5f92-498e-b8e9-e99b8116219c admin admin] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:49.768752 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781989e-6313-461e-bacd-5786cf1d2f7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:49.769367 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781989e-6313-461e-bacd-5786cf1d2f7b service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:49.769654 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781989e-6313-461e-bacd-5786cf1d2f7b service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:49.769929 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781989e-6313-461e-bacd-5786cf1d2f7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:49.771687 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.fernet_utils [None req-0781989e-6313-461e-bacd-5786cf1d2f7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:49.783037 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781989e-6313-461e-bacd-5786cf1d2f7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:49.784627 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781989e-6313-461e-bacd-5786cf1d2f7b service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:49.795304 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4613/9212] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:28:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:28:57.418222 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:28:57.419659 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:57.434456 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128a693-071e-46ea-8af0-302389d1ab67 admin admin] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:28:57.439473 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81e97b-fbce-4805-932c-e95362f4ac98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:28:57.440072 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81e97b-fbce-4805-932c-e95362f4ac98 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:28:57.440349 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81e97b-fbce-4805-932c-e95362f4ac98 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:28:57.440619 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81e97b-fbce-4805-932c-e95362f4ac98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:28:57.442674 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.fernet_utils [None req-5b81e97b-fbce-4805-932c-e95362f4ac98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 20:28:57.455455 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81e97b-fbce-4805-932c-e95362f4ac98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:28:57.457034 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81e97b-fbce-4805-932c-e95362f4ac98 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:28:57.467278 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4600/9213] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:28:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:28:59.790491 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=62 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:29:07.462658 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=6 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:33:54.622926 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781989e-6313-461e-bacd-5786cf1d2f7b service placement] Authenticating user token {{(pid=88374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:33:54.665396 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781989e-6313-461e-bacd-5786cf1d2f7b service placement] Validating token access rules against request {{(pid=88374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:33:54.670417 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae0582-a733-47dc-bd26-096442ac16e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:33:54.671059 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae0582-a733-47dc-bd26-096442ac16e9 service placement] REQUEST_METHOD: `GET` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:33:54.671335 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae0582-a733-47dc-bd26-096442ac16e9 service placement] SCRIPT_NAME: `/identity` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:33:54.671608 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae0582-a733-47dc-bd26-096442ac16e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:33:54.680446 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae0582-a733-47dc-bd26-096442ac16e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:33:54.682058 n-d-854118-7 devstack@keystone.service[88374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae0582-a733-47dc-bd26-096442ac16e9 service placement] RBAC: Authorization granted {{(pid=88374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:33:54.691749 n-d-854118-7 devstack@keystone.service[88374]: [pid: 88374|app: 0|req: 4614/9214] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:33:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 20:34:01.431926 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81e97b-fbce-4805-932c-e95362f4ac98 service placement] Authenticating user token {{(pid=88375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 20:34:01.473200 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81e97b-fbce-4805-932c-e95362f4ac98 service placement] Validating token access rules against request {{(pid=88375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 20:34:01.478733 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cdbab-dace-4d20-a8f1-886935655940 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0055d9c941024cdc894104f1345540fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea7555fde9e5404eb3b0dbfa04ee871f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 20:34:01.479360 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cdbab-dace-4d20-a8f1-886935655940 service placement] REQUEST_METHOD: `GET` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 20:34:01.479645 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cdbab-dace-4d20-a8f1-886935655940 service placement] SCRIPT_NAME: `/identity` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 20:34:01.480078 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cdbab-dace-4d20-a8f1-886935655940 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 20:34:01.488527 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cdbab-dace-4d20-a8f1-886935655940 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 20:34:01.490109 n-d-854118-7 devstack@keystone.service[88375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cdbab-dace-4d20-a8f1-886935655940 service placement] RBAC: Authorization granted {{(pid=88375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 20:34:01.500567 n-d-854118-7 devstack@keystone.service[88375]: [pid: 88375|app: 0|req: 4601/9215] 10.222.0.70 () {60 vars in 1365 bytes} [Sun Aug 28 20:34:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 20:34:04.687670 n-d-854118-7 devstack@keystone.service[88374]: DEBUG dbcounter [-] [88374] Writing DB stats keystone:SELECT=20 {{(pid=88374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 20:34:11.496348 n-d-854118-7 devstack@keystone.service[88375]: DEBUG dbcounter [-] [88375] Writing DB stats keystone:SELECT=20 {{(pid=88375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}